2024-09-21T06:15:09.929 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-21T06:15:09.954 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T06:15:10.045 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913545 branch: wip-pdonnell-testing-20240920.212106-debug description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-quiesce/no 6-workunit/suites/iozone}} email: pdonnell@redhat.com first_in_suite: false job_id: '7913545' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-pdonnell-testing-20240920.212106-debug ceph: cephfs: max_mds: 3 session_timeout: 300 standby_replay: true cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug cephsqlite: 20 debug client: 20 debug mgr: 20 debug ms: 1 mgr/snap_schedule/allow_m_granularity: true mgr/snap_schedule/dump_on_update: true mgr/snap_schedule/log_level: debug mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: global: ms die on skipped message: false mds: mds_bal_replicate_threshold: 1 mgr: cephsqlite lock renewal timeout: 900000 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request mgr-modules: - snap_schedule sha1: 1843221895adccfb3b692060251dd6a0183bc410 subvols: create: 2 subvol_options: --namespace-isolated ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount dry_run: true install: ceph: flavor: default sha1: 1843221895adccfb3b692060251dd6a0183bc410 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=crc - wsync syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240920.212106-debug sha1: 1843221895adccfb3b692060251dd6a0183bc410 owner: scheduled_pdonnell@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 7864 sha1: 1843221895adccfb3b692060251dd6a0183bc410 sleep_before_teardown: 0 subset: 67/512 suite: fs suite_branch: wip-pdonnell-testing-20240920.212106-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 1843221895adccfb3b692060251dd6a0183bc410 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi007.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM/HRtF7xj+QeYlCCfUuYudZETjMoCM68THmXP9FBwKT2u8sdz9YqKY/HUT2sh2uJgPY1zI0qZbwWmRrq+FpHWU= smithi018.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH0bryI+wGq+dIShvG1e4GN8ILg3FD2bvs8KRXWfIAZfNTvpgeWf5sK6bpYx72g4leVLA4lNeeVwGnAJSSR8E/c= smithi144.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIWYuOuzNM9H0PUqYFV3IPNtTs/xYpLCiVjiFGJsxTMAZkGlGPgZsbKalPqtr3a6tANG5ymBwNq2P4KZk/JEy28= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - exec: mon.a: - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - workunit: clients: all: - suites/iozone.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-20_23:48:22 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2902 2024-09-21T06:15:10.045 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa; will attempt to use it 2024-09-21T06:15:10.046 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks 2024-09-21T06:15:10.046 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-21T06:15:10.048 INFO:teuthology.task.internal:Checking packages... 2024-09-21T06:15:10.068 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '1843221895adccfb3b692060251dd6a0183bc410' 2024-09-21T06:15:10.068 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T06:15:10.069 INFO:teuthology.packaging:ref: None 2024-09-21T06:15:10.069 INFO:teuthology.packaging:tag: None 2024-09-21T06:15:10.069 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240920.212106-debug 2024-09-21T06:15:10.069 INFO:teuthology.packaging:sha1: 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:15:10.069 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-pdonnell-testing-20240920.212106-debug 2024-09-21T06:15:10.208 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-5120.g18432218 2024-09-21T06:15:10.210 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-21T06:15:10.217 INFO:teuthology.task.internal:no buildpackages task found 2024-09-21T06:15:10.217 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-21T06:15:10.243 INFO:teuthology.task.internal:Saving configuration 2024-09-21T06:15:10.264 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-21T06:15:10.299 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-21T06:15:10.323 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi007.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913545', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 06:10:21.055492', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM/HRtF7xj+QeYlCCfUuYudZETjMoCM68THmXP9FBwKT2u8sdz9YqKY/HUT2sh2uJgPY1zI0qZbwWmRrq+FpHWU='} 2024-09-21T06:15:10.344 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi018.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913545', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 06:10:21.056799', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH0bryI+wGq+dIShvG1e4GN8ILg3FD2bvs8KRXWfIAZfNTvpgeWf5sK6bpYx72g4leVLA4lNeeVwGnAJSSR8E/c='} 2024-09-21T06:15:10.368 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi144.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913545', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 06:10:21.052832', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIWYuOuzNM9H0PUqYFV3IPNtTs/xYpLCiVjiFGJsxTMAZkGlGPgZsbKalPqtr3a6tANG5ymBwNq2P4KZk/JEy28='} 2024-09-21T06:15:10.368 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-21T06:15:10.375 INFO:teuthology.task.internal:roles: ubuntu@smithi007.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-21T06:15:10.375 INFO:teuthology.task.internal:roles: ubuntu@smithi018.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-21T06:15:10.375 INFO:teuthology.task.internal:roles: ubuntu@smithi144.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-21T06:15:10.375 INFO:teuthology.run_tasks:Running task console_log... 2024-09-21T06:15:10.462 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7efc8084c160>, signals=[15]) 2024-09-21T06:15:10.462 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-21T06:15:10.470 INFO:teuthology.task.internal:Opening connections... 2024-09-21T06:15:10.470 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi007.front.sepia.ceph.com 2024-09-21T06:15:10.471 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:15:10.546 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi018.front.sepia.ceph.com 2024-09-21T06:15:10.547 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:15:10.619 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi144.front.sepia.ceph.com 2024-09-21T06:15:10.619 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:15:10.695 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-21T06:15:10.707 DEBUG:teuthology.orchestra.run.smithi007:> uname -m 2024-09-21T06:15:10.725 INFO:teuthology.orchestra.run.smithi007.stdout:x86_64 2024-09-21T06:15:10.726 DEBUG:teuthology.orchestra.run.smithi007:> cat /etc/os-release 2024-09-21T06:15:10.783 INFO:teuthology.orchestra.run.smithi007.stdout:NAME="CentOS Stream" 2024-09-21T06:15:10.783 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION="9" 2024-09-21T06:15:10.783 INFO:teuthology.orchestra.run.smithi007.stdout:ID="centos" 2024-09-21T06:15:10.784 INFO:teuthology.orchestra.run.smithi007.stdout:ID_LIKE="rhel fedora" 2024-09-21T06:15:10.784 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION_ID="9" 2024-09-21T06:15:10.784 INFO:teuthology.orchestra.run.smithi007.stdout:PLATFORM_ID="platform:el9" 2024-09-21T06:15:10.784 INFO:teuthology.orchestra.run.smithi007.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T06:15:10.784 INFO:teuthology.orchestra.run.smithi007.stdout:ANSI_COLOR="0;31" 2024-09-21T06:15:10.784 INFO:teuthology.orchestra.run.smithi007.stdout:LOGO="fedora-logo-icon" 2024-09-21T06:15:10.784 INFO:teuthology.orchestra.run.smithi007.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T06:15:10.784 INFO:teuthology.orchestra.run.smithi007.stdout:HOME_URL="https://centos.org/" 2024-09-21T06:15:10.784 INFO:teuthology.orchestra.run.smithi007.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T06:15:10.784 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T06:15:10.784 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T06:15:10.785 INFO:teuthology.lock.ops:Updating smithi007.front.sepia.ceph.com on lock server 2024-09-21T06:15:10.803 DEBUG:teuthology.orchestra.run.smithi018:> uname -m 2024-09-21T06:15:10.821 INFO:teuthology.orchestra.run.smithi018.stdout:x86_64 2024-09-21T06:15:10.821 DEBUG:teuthology.orchestra.run.smithi018:> cat /etc/os-release 2024-09-21T06:15:10.879 INFO:teuthology.orchestra.run.smithi018.stdout:NAME="CentOS Stream" 2024-09-21T06:15:10.879 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION="9" 2024-09-21T06:15:10.879 INFO:teuthology.orchestra.run.smithi018.stdout:ID="centos" 2024-09-21T06:15:10.879 INFO:teuthology.orchestra.run.smithi018.stdout:ID_LIKE="rhel fedora" 2024-09-21T06:15:10.880 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION_ID="9" 2024-09-21T06:15:10.880 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM_ID="platform:el9" 2024-09-21T06:15:10.880 INFO:teuthology.orchestra.run.smithi018.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T06:15:10.880 INFO:teuthology.orchestra.run.smithi018.stdout:ANSI_COLOR="0;31" 2024-09-21T06:15:10.880 INFO:teuthology.orchestra.run.smithi018.stdout:LOGO="fedora-logo-icon" 2024-09-21T06:15:10.880 INFO:teuthology.orchestra.run.smithi018.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T06:15:10.880 INFO:teuthology.orchestra.run.smithi018.stdout:HOME_URL="https://centos.org/" 2024-09-21T06:15:10.880 INFO:teuthology.orchestra.run.smithi018.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T06:15:10.880 INFO:teuthology.orchestra.run.smithi018.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T06:15:10.880 INFO:teuthology.orchestra.run.smithi018.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T06:15:10.881 INFO:teuthology.lock.ops:Updating smithi018.front.sepia.ceph.com on lock server 2024-09-21T06:15:10.904 DEBUG:teuthology.orchestra.run.smithi144:> uname -m 2024-09-21T06:15:10.922 INFO:teuthology.orchestra.run.smithi144.stdout:x86_64 2024-09-21T06:15:10.922 DEBUG:teuthology.orchestra.run.smithi144:> cat /etc/os-release 2024-09-21T06:15:10.980 INFO:teuthology.orchestra.run.smithi144.stdout:NAME="CentOS Stream" 2024-09-21T06:15:10.980 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION="9" 2024-09-21T06:15:10.980 INFO:teuthology.orchestra.run.smithi144.stdout:ID="centos" 2024-09-21T06:15:10.980 INFO:teuthology.orchestra.run.smithi144.stdout:ID_LIKE="rhel fedora" 2024-09-21T06:15:10.981 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION_ID="9" 2024-09-21T06:15:10.981 INFO:teuthology.orchestra.run.smithi144.stdout:PLATFORM_ID="platform:el9" 2024-09-21T06:15:10.981 INFO:teuthology.orchestra.run.smithi144.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T06:15:10.981 INFO:teuthology.orchestra.run.smithi144.stdout:ANSI_COLOR="0;31" 2024-09-21T06:15:10.981 INFO:teuthology.orchestra.run.smithi144.stdout:LOGO="fedora-logo-icon" 2024-09-21T06:15:10.981 INFO:teuthology.orchestra.run.smithi144.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T06:15:10.981 INFO:teuthology.orchestra.run.smithi144.stdout:HOME_URL="https://centos.org/" 2024-09-21T06:15:10.981 INFO:teuthology.orchestra.run.smithi144.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T06:15:10.981 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T06:15:10.981 INFO:teuthology.orchestra.run.smithi144.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T06:15:10.981 INFO:teuthology.lock.ops:Updating smithi144.front.sepia.ceph.com on lock server 2024-09-21T06:15:11.004 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-21T06:15:11.017 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-21T06:15:11.058 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-21T06:15:11.058 DEBUG:teuthology.orchestra.run.smithi007:> test '!' -e /home/ubuntu/cephtest 2024-09-21T06:15:11.060 DEBUG:teuthology.orchestra.run.smithi018:> test '!' -e /home/ubuntu/cephtest 2024-09-21T06:15:11.063 DEBUG:teuthology.orchestra.run.smithi144:> test '!' -e /home/ubuntu/cephtest 2024-09-21T06:15:11.080 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-21T06:15:11.091 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-21T06:15:11.092 DEBUG:teuthology.orchestra.run.smithi007:> test -z $(ls -A /var/lib/ceph) 2024-09-21T06:15:11.118 DEBUG:teuthology.orchestra.run.smithi018:> test -z $(ls -A /var/lib/ceph) 2024-09-21T06:15:11.121 DEBUG:teuthology.orchestra.run.smithi144:> test -z $(ls -A /var/lib/ceph) 2024-09-21T06:15:11.147 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-21T06:15:11.228 INFO:teuthology.run_tasks:Running task kernel... 2024-09-21T06:15:11.267 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-21T06:15:11.268 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-09-21T06:15:11.268 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-09-21T06:15:11.268 DEBUG:teuthology.orchestra.run.smithi007:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T06:15:11.284 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:15:11.285 DEBUG:teuthology.orchestra.run.smithi007:> uname -r 2024-09-21T06:15:11.343 INFO:teuthology.orchestra.run.smithi007.stdout:5.14.0-503.el9.x86_64 2024-09-21T06:15:11.343 INFO:teuthology.task.kernel:Running kernel on smithi007: 5.14.0-503.el9.x86_64 2024-09-21T06:15:11.343 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum install -y kernel 2024-09-21T06:15:13.892 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.3 MB 00:00 2024-09-21T06:15:15.760 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 9 - AppStream 28 MB/s | 20 MB 00:00 2024-09-21T06:15:21.528 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 9 - CRB 3.5 MB/s | 6.5 MB 00:01 2024-09-21T06:15:23.070 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 9 - Extras packages 109 kB/s | 19 kB 00:00 2024-09-21T06:15:23.958 INFO:teuthology.orchestra.run.smithi007.stdout:Extra Packages for Enterprise Linux 30 MB/s | 23 MB 00:00 2024-09-21T06:15:29.613 INFO:teuthology.orchestra.run.smithi007.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-21T06:15:31.587 INFO:teuthology.orchestra.run.smithi007.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-21T06:15:31.587 INFO:teuthology.orchestra.run.smithi007.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-21T06:15:31.687 INFO:teuthology.orchestra.run.smithi007.stdout:Dependencies resolved. 2024-09-21T06:15:31.701 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2024-09-21T06:15:31.702 INFO:teuthology.orchestra.run.smithi007.stdout: Package Architecture Version Repository Size 2024-09-21T06:15:31.702 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2024-09-21T06:15:31.702 INFO:teuthology.orchestra.run.smithi007.stdout:Installing: 2024-09-21T06:15:31.702 INFO:teuthology.orchestra.run.smithi007.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-21T06:15:31.702 INFO:teuthology.orchestra.run.smithi007.stdout:Installing dependencies: 2024-09-21T06:15:31.702 INFO:teuthology.orchestra.run.smithi007.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-21T06:15:31.702 INFO:teuthology.orchestra.run.smithi007.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-21T06:15:31.702 INFO:teuthology.orchestra.run.smithi007.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-21T06:15:31.702 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:15:31.702 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction Summary 2024-09-21T06:15:31.702 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2024-09-21T06:15:31.702 INFO:teuthology.orchestra.run.smithi007.stdout:Install 4 Packages 2024-09-21T06:15:31.703 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:15:31.703 INFO:teuthology.orchestra.run.smithi007.stdout:Total download size: 79 M 2024-09-21T06:15:31.703 INFO:teuthology.orchestra.run.smithi007.stdout:Installed size: 126 M 2024-09-21T06:15:31.703 INFO:teuthology.orchestra.run.smithi007.stdout:Downloading Packages: 2024-09-21T06:15:31.948 INFO:teuthology.orchestra.run.smithi007.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 303 kB/s | 36 kB 00:00 2024-09-21T06:15:32.223 INFO:teuthology.orchestra.run.smithi007.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 40 MB/s | 16 MB 00:00 2024-09-21T06:15:32.590 INFO:teuthology.orchestra.run.smithi007.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 45 MB/s | 35 MB 00:00 2024-09-21T06:15:32.949 INFO:teuthology.orchestra.run.smithi007.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 29 MB/s | 29 MB 00:01 2024-09-21T06:15:32.949 INFO:teuthology.orchestra.run.smithi007.stdout:-------------------------------------------------------------------------------- 2024-09-21T06:15:32.949 INFO:teuthology.orchestra.run.smithi007.stdout:Total 63 MB/s | 79 MB 00:01 2024-09-21T06:15:33.663 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction check 2024-09-21T06:15:34.035 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction check succeeded. 2024-09-21T06:15:34.035 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction test 2024-09-21T06:15:35.025 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction test succeeded. 2024-09-21T06:15:35.025 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction 2024-09-21T06:15:37.569 INFO:teuthology.orchestra.run.smithi007.stdout: Preparing : 1/1 2024-09-21T06:15:38.252 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-21T06:15:38.334 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T06:15:41.090 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T06:15:41.210 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T06:15:46.327 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T06:15:46.369 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T06:15:51.509 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T06:16:30.509 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T06:16:30.550 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-21T06:16:30.845 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T06:16:30.845 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-21T06:16:30.845 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T06:16:30.845 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T06:16:31.723 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T06:16:31.723 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:16:31.723 INFO:teuthology.orchestra.run.smithi007.stdout:Installed: 2024-09-21T06:16:31.723 INFO:teuthology.orchestra.run.smithi007.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-21T06:16:31.724 INFO:teuthology.orchestra.run.smithi007.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-21T06:16:31.724 INFO:teuthology.orchestra.run.smithi007.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-21T06:16:31.724 INFO:teuthology.orchestra.run.smithi007.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-21T06:16:31.724 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:16:31.724 INFO:teuthology.orchestra.run.smithi007.stdout:Complete! 2024-09-21T06:16:32.066 DEBUG:teuthology.orchestra.run.smithi007:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T06:16:32.198 INFO:teuthology.orchestra.run.smithi007.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T06:16:32.199 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T06:16:32.199 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-21T06:16:32.199 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-21T06:16:32.199 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-21T06:16:32.199 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-21T06:16:32.199 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi007.front.sepia.ceph.com, path=None, version=distro) 2024-09-21T06:16:32.199 DEBUG:teuthology.orchestra.run.smithi007:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T06:16:32.258 INFO:teuthology.orchestra.run.smithi007.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T06:16:32.259 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T06:16:32.259 DEBUG:teuthology.orchestra.run.smithi007:> sudo rpm -qi grub2-tools 2024-09-21T06:16:32.295 INFO:teuthology.orchestra.run.smithi007.stdout:Name : grub2-tools 2024-09-21T06:16:32.295 INFO:teuthology.orchestra.run.smithi007.stdout:Epoch : 1 2024-09-21T06:16:32.295 INFO:teuthology.orchestra.run.smithi007.stdout:Version : 2.06 2024-09-21T06:16:32.296 INFO:teuthology.orchestra.run.smithi007.stdout:Release : 82.el9 2024-09-21T06:16:32.296 INFO:teuthology.orchestra.run.smithi007.stdout:Architecture: x86_64 2024-09-21T06:16:32.296 INFO:teuthology.orchestra.run.smithi007.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-21T06:16:32.296 INFO:teuthology.orchestra.run.smithi007.stdout:Group : Unspecified 2024-09-21T06:16:32.296 INFO:teuthology.orchestra.run.smithi007.stdout:Size : 8274670 2024-09-21T06:16:32.296 INFO:teuthology.orchestra.run.smithi007.stdout:License : GPLv3+ 2024-09-21T06:16:32.296 INFO:teuthology.orchestra.run.smithi007.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-21T06:16:32.296 INFO:teuthology.orchestra.run.smithi007.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-21T06:16:32.296 INFO:teuthology.orchestra.run.smithi007.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-21T06:16:32.296 INFO:teuthology.orchestra.run.smithi007.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-21T06:16:32.297 INFO:teuthology.orchestra.run.smithi007.stdout:Packager : builder@centos.org 2024-09-21T06:16:32.297 INFO:teuthology.orchestra.run.smithi007.stdout:Vendor : CentOS 2024-09-21T06:16:32.297 INFO:teuthology.orchestra.run.smithi007.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-21T06:16:32.297 INFO:teuthology.orchestra.run.smithi007.stdout:Summary : Support tools for GRUB. 2024-09-21T06:16:32.297 INFO:teuthology.orchestra.run.smithi007.stdout:Description : 2024-09-21T06:16:32.297 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:16:32.297 INFO:teuthology.orchestra.run.smithi007.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-21T06:16:32.297 INFO:teuthology.orchestra.run.smithi007.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-21T06:16:32.297 INFO:teuthology.orchestra.run.smithi007.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-21T06:16:32.297 INFO:teuthology.orchestra.run.smithi007.stdout:hardware devices. 2024-09-21T06:16:32.297 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:16:32.297 INFO:teuthology.orchestra.run.smithi007.stdout:This subpackage provides tools for support of all platforms. 2024-09-21T06:16:32.298 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-21T06:16:32.298 INFO:teuthology.task.kernel:Updating grub on smithi007 to boot 5.14.0-508.el9.x86_64 2024-09-21T06:16:32.298 DEBUG:teuthology.orchestra.run.smithi007:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-21T06:16:32.992 INFO:teuthology.orchestra.run.smithi007.stderr:Generating grub configuration file ... 2024-09-21T06:16:34.280 INFO:teuthology.orchestra.run.smithi007.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-21T06:16:34.295 INFO:teuthology.orchestra.run.smithi007.stderr:done 2024-09-21T06:16:34.297 DEBUG:teuthology.orchestra.run.smithi007:> mktemp 2024-09-21T06:16:34.312 INFO:teuthology.orchestra.run.smithi007.stdout:/tmp/tmp.O4pmecmjVC 2024-09-21T06:16:34.312 DEBUG:teuthology.orchestra.run.smithi007:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.O4pmecmjVC 2024-09-21T06:16:34.378 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 0666 /tmp/tmp.O4pmecmjVC 2024-09-21T06:16:34.507 DEBUG:teuthology.orchestra.remote:smithi007:/tmp/tmp.O4pmecmjVC is 6KB 2024-09-21T06:16:34.527 DEBUG:teuthology.orchestra.run.smithi007:> rm -fr /tmp/tmp.O4pmecmjVC 2024-09-21T06:16:34.541 DEBUG:teuthology.orchestra.run.smithi007:> sudo /bin/ls /boot/loader/entries || true 2024-09-21T06:16:34.603 INFO:teuthology.orchestra.run.smithi007.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-21T06:16:34.603 INFO:teuthology.orchestra.run.smithi007.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-21T06:16:34.603 INFO:teuthology.orchestra.run.smithi007.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-21T06:16:34.603 INFO:teuthology.orchestra.run.smithi007.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-21T06:16:34.604 DEBUG:teuthology.orchestra.run.smithi007:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-21T06:16:34.760 DEBUG:teuthology.orchestra.run.smithi007:> sudo shutdown -r now 2024-09-21T06:17:04.763 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-21T06:17:04.764 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-09-21T06:17:04.764 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:17:23.183 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.7 2024-09-21T06:17:32.184 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-09-21T06:17:32.184 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:18:32.186 DEBUG:teuthology.orchestra.remote:timed out 2024-09-21T06:18:44.187 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-09-21T06:18:44.188 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:18:44.544 DEBUG:teuthology.orchestra.run.smithi007:> true 2024-09-21T06:18:44.940 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-09-21T06:18:44.941 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-508.el9.x86_64"... 2024-09-21T06:18:44.941 DEBUG:teuthology.orchestra.run.smithi007:> uname -r 2024-09-21T06:18:44.957 INFO:teuthology.orchestra.run.smithi007.stdout:5.14.0-508.el9.x86_64 2024-09-21T06:18:44.957 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-21T06:18:44.958 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T06:18:44.958 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-21T06:18:45.959 DEBUG:teuthology.parallel:result is None 2024-09-21T06:18:45.959 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-21T06:18:45.966 INFO:teuthology.task.internal:Creating test directory... 2024-09-21T06:18:45.966 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T06:18:45.969 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T06:18:45.971 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T06:18:45.990 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-21T06:18:46.027 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-21T06:18:46.037 INFO:teuthology.task.internal:Creating archive directory... 2024-09-21T06:18:46.037 DEBUG:teuthology.orchestra.run.smithi007:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T06:18:46.039 DEBUG:teuthology.orchestra.run.smithi018:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T06:18:46.041 DEBUG:teuthology.orchestra.run.smithi144:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T06:18:46.073 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-21T06:18:46.079 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-21T06:18:46.079 DEBUG:teuthology.orchestra.run.smithi018:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T06:18:46.124 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:18:46.124 DEBUG:teuthology.orchestra.run.smithi144:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T06:18:46.141 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:18:46.141 DEBUG:teuthology.orchestra.run.smithi007:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T06:18:46.144 DEBUG:teuthology.orchestra.run.smithi018:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T06:18:46.166 DEBUG:teuthology.orchestra.run.smithi144:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T06:18:46.211 INFO:teuthology.orchestra.run.smithi018.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T06:18:46.231 INFO:teuthology.orchestra.run.smithi018.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T06:18:46.244 INFO:teuthology.orchestra.run.smithi144.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T06:18:46.250 INFO:teuthology.orchestra.run.smithi007.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T06:18:46.262 INFO:teuthology.orchestra.run.smithi144.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T06:18:46.274 INFO:teuthology.orchestra.run.smithi007.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T06:18:46.276 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-21T06:18:46.282 INFO:teuthology.task.internal:Configuring sudo... 2024-09-21T06:18:46.283 DEBUG:teuthology.orchestra.run.smithi007:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T06:18:46.285 DEBUG:teuthology.orchestra.run.smithi018:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T06:18:46.287 DEBUG:teuthology.orchestra.run.smithi144:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T06:18:46.316 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-21T06:18:46.323 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-21T06:18:46.323 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T06:18:46.355 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T06:18:46.357 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T06:18:46.374 DEBUG:teuthology.orchestra.run.smithi007:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T06:18:46.451 DEBUG:teuthology.orchestra.run.smithi007:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T06:18:46.507 DEBUG:teuthology.orchestra.run.smithi007:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T06:18:46.590 DEBUG:teuthology.orchestra.run.smithi007:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T06:18:46.636 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-21T06:18:46.636 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T06:18:46.704 DEBUG:teuthology.orchestra.run.smithi018:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T06:18:46.743 DEBUG:teuthology.orchestra.run.smithi018:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T06:18:46.800 DEBUG:teuthology.orchestra.run.smithi018:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T06:18:46.881 DEBUG:teuthology.orchestra.run.smithi018:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T06:18:46.925 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-21T06:18:46.925 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T06:18:46.991 DEBUG:teuthology.orchestra.run.smithi144:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T06:18:47.035 DEBUG:teuthology.orchestra.run.smithi144:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T06:18:47.096 DEBUG:teuthology.orchestra.run.smithi144:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T06:18:47.182 DEBUG:teuthology.orchestra.run.smithi144:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T06:18:47.227 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-21T06:18:47.227 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T06:18:47.295 DEBUG:teuthology.orchestra.run.smithi007:> sudo service rsyslog restart 2024-09-21T06:18:47.298 DEBUG:teuthology.orchestra.run.smithi018:> sudo service rsyslog restart 2024-09-21T06:18:47.300 DEBUG:teuthology.orchestra.run.smithi144:> sudo service rsyslog restart 2024-09-21T06:18:47.335 INFO:teuthology.orchestra.run.smithi018.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T06:18:47.343 INFO:teuthology.orchestra.run.smithi007.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T06:18:47.380 INFO:teuthology.orchestra.run.smithi144.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T06:18:47.823 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-21T06:18:47.831 INFO:teuthology.task.internal:Starting timer... 2024-09-21T06:18:47.831 INFO:teuthology.run_tasks:Running task pcp... 2024-09-21T06:18:47.864 INFO:teuthology.run_tasks:Running task selinux... 2024-09-21T06:18:48.059 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-09-21T06:18:48.060 DEBUG:teuthology.orchestra.run.smithi007:> sudo service auditd rotate 2024-09-21T06:18:48.133 INFO:teuthology.orchestra.run.smithi007.stdout:Rotating logs: 2024-09-21T06:18:48.135 DEBUG:teuthology.orchestra.run.smithi018:> sudo service auditd rotate 2024-09-21T06:18:48.191 INFO:teuthology.orchestra.run.smithi018.stdout:Rotating logs: 2024-09-21T06:18:48.193 DEBUG:teuthology.orchestra.run.smithi144:> sudo service auditd rotate 2024-09-21T06:18:48.247 INFO:teuthology.orchestra.run.smithi144.stdout:Rotating logs: 2024-09-21T06:18:48.249 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-21T06:18:48.249 DEBUG:teuthology.orchestra.run.smithi007:> /usr/sbin/getenforce 2024-09-21T06:18:48.273 INFO:teuthology.orchestra.run.smithi007.stdout:Permissive 2024-09-21T06:18:48.274 DEBUG:teuthology.orchestra.run.smithi018:> /usr/sbin/getenforce 2024-09-21T06:18:48.300 INFO:teuthology.orchestra.run.smithi018.stdout:Permissive 2024-09-21T06:18:48.300 DEBUG:teuthology.orchestra.run.smithi144:> /usr/sbin/getenforce 2024-09-21T06:18:48.323 INFO:teuthology.orchestra.run.smithi144.stdout:Permissive 2024-09-21T06:18:48.323 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi007.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi018.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi144.front.sepia.ceph.com': 'permissive'} 2024-09-21T06:18:48.323 DEBUG:teuthology.orchestra.run.smithi007:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T06:18:48.352 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:18:48.353 DEBUG:teuthology.orchestra.run.smithi018:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T06:18:48.380 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:18:48.380 DEBUG:teuthology.orchestra.run.smithi144:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T06:18:48.409 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:18:48.409 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-21T06:18:48.409 DEBUG:teuthology.orchestra.run.smithi007:> sudo /usr/sbin/setenforce permissive 2024-09-21T06:18:48.454 DEBUG:teuthology.orchestra.run.smithi018:> sudo /usr/sbin/setenforce permissive 2024-09-21T06:18:48.499 DEBUG:teuthology.orchestra.run.smithi144:> sudo /usr/sbin/setenforce permissive 2024-09-21T06:18:48.531 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-21T06:18:48.541 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-21T06:18:48.544 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-21T06:18:48.660 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-21T06:18:48.669 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-21T06:18:48.670 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi007.front.sepia.ceph.com,smithi018.front.sepia.ceph.com,smithi144.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-21T06:22:58.076 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi007.front.sepia.ceph.com'), Remote(name='ubuntu@smithi018.front.sepia.ceph.com'), Remote(name='ubuntu@smithi144.front.sepia.ceph.com')] 2024-09-21T06:22:58.077 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-09-21T06:22:58.078 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:22:58.152 DEBUG:teuthology.orchestra.run.smithi007:> true 2024-09-21T06:22:58.235 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi007.front.sepia.ceph.com' 2024-09-21T06:22:58.236 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-09-21T06:22:58.236 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:22:58.312 DEBUG:teuthology.orchestra.run.smithi018:> true 2024-09-21T06:22:58.394 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-09-21T06:22:58.395 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi144.front.sepia.ceph.com' 2024-09-21T06:22:58.395 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T06:22:58.473 DEBUG:teuthology.orchestra.run.smithi144:> true 2024-09-21T06:22:58.552 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi144.front.sepia.ceph.com' 2024-09-21T06:22:58.552 INFO:teuthology.run_tasks:Running task clock... 2024-09-21T06:22:58.562 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-21T06:22:58.562 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T06:22:58.563 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T06:22:58.565 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T06:22:58.565 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T06:22:58.568 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T06:22:58.568 DEBUG:teuthology.orchestra.run.smithi144:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T06:22:58.599 INFO:teuthology.orchestra.run.smithi018.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T06:22:58.599 INFO:teuthology.orchestra.run.smithi007.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T06:22:58.614 INFO:teuthology.orchestra.run.smithi018.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T06:22:58.615 INFO:teuthology.orchestra.run.smithi007.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T06:22:58.623 INFO:teuthology.orchestra.run.smithi144.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T06:22:58.638 INFO:teuthology.orchestra.run.smithi144.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T06:22:58.639 INFO:teuthology.orchestra.run.smithi018.stderr:sudo: ntpd: command not found 2024-09-21T06:22:58.643 INFO:teuthology.orchestra.run.smithi007.stderr:sudo: ntpd: command not found 2024-09-21T06:22:58.651 INFO:teuthology.orchestra.run.smithi018.stdout:506 Cannot talk to daemon 2024-09-21T06:22:58.655 INFO:teuthology.orchestra.run.smithi007.stdout:506 Cannot talk to daemon 2024-09-21T06:22:58.663 INFO:teuthology.orchestra.run.smithi144.stderr:sudo: ntpd: command not found 2024-09-21T06:22:58.666 INFO:teuthology.orchestra.run.smithi018.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T06:22:58.671 INFO:teuthology.orchestra.run.smithi007.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T06:22:58.674 INFO:teuthology.orchestra.run.smithi144.stdout:506 Cannot talk to daemon 2024-09-21T06:22:58.680 INFO:teuthology.orchestra.run.smithi018.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T06:22:58.686 INFO:teuthology.orchestra.run.smithi007.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T06:22:58.689 INFO:teuthology.orchestra.run.smithi144.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T06:22:58.703 INFO:teuthology.orchestra.run.smithi144.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T06:22:58.734 INFO:teuthology.orchestra.run.smithi018.stderr:bash: line 1: ntpq: command not found 2024-09-21T06:22:58.737 INFO:teuthology.orchestra.run.smithi018.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T06:22:58.737 INFO:teuthology.orchestra.run.smithi018.stdout:=============================================================================== 2024-09-21T06:22:58.738 INFO:teuthology.orchestra.run.smithi018.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:22:58.738 INFO:teuthology.orchestra.run.smithi018.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:22:58.738 INFO:teuthology.orchestra.run.smithi018.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:22:58.738 INFO:teuthology.orchestra.run.smithi018.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:22:58.758 INFO:teuthology.orchestra.run.smithi007.stderr:bash: line 1: ntpq: command not found 2024-09-21T06:22:58.760 INFO:teuthology.orchestra.run.smithi144.stderr:bash: line 1: ntpq: command not found 2024-09-21T06:22:58.761 INFO:teuthology.orchestra.run.smithi007.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T06:22:58.761 INFO:teuthology.orchestra.run.smithi007.stdout:=============================================================================== 2024-09-21T06:22:58.761 INFO:teuthology.orchestra.run.smithi007.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:22:58.761 INFO:teuthology.orchestra.run.smithi007.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:22:58.761 INFO:teuthology.orchestra.run.smithi007.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:22:58.761 INFO:teuthology.orchestra.run.smithi007.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:22:58.763 INFO:teuthology.orchestra.run.smithi144.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T06:22:58.763 INFO:teuthology.orchestra.run.smithi144.stdout:=============================================================================== 2024-09-21T06:22:58.763 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:22:58.763 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:22:58.763 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:22:58.763 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:22:58.764 INFO:teuthology.run_tasks:Running task install... 2024-09-21T06:22:58.777 DEBUG:teuthology.task.install:project ceph 2024-09-21T06:22:58.777 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'}} 2024-09-21T06:22:58.777 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'} 2024-09-21T06:22:58.778 INFO:teuthology.task.install:Using flavor: default 2024-09-21T06:22:58.782 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-21T06:22:58.782 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-21T06:22:58.783 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T06:22:58.783 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:22:58.784 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T06:22:58.785 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:22:58.786 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T06:22:58.786 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:22:58.942 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T06:22:58.942 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T06:22:58.952 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T06:22:58.952 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T06:22:58.959 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T06:22:58.959 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T06:22:59.058 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T06:22:59.059 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-21T06:22:59.059 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T06:22:59.064 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T06:22:59.064 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-21T06:22:59.064 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T06:22:59.070 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T06:22:59.071 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-21T06:22:59.071 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T06:22:59.087 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T06:22:59.087 DEBUG:teuthology.orchestra.run.smithi007:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T06:22:59.092 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T06:22:59.092 DEBUG:teuthology.orchestra.run.smithi144:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T06:22:59.097 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T06:22:59.097 DEBUG:teuthology.orchestra.run.smithi018:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T06:22:59.155 DEBUG:teuthology.orchestra.run.smithi007:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T06:22:59.158 DEBUG:teuthology.orchestra.run.smithi144:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T06:22:59.163 DEBUG:teuthology.orchestra.run.smithi018:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T06:22:59.234 DEBUG:teuthology.orchestra.run.smithi007:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T06:22:59.235 DEBUG:teuthology.orchestra.run.smithi144:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T06:22:59.240 DEBUG:teuthology.orchestra.run.smithi018:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T06:22:59.299 INFO:teuthology.orchestra.run.smithi007.stdout:check_obsoletes = 1 2024-09-21T06:22:59.300 INFO:teuthology.orchestra.run.smithi144.stdout:check_obsoletes = 1 2024-09-21T06:22:59.301 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum clean all 2024-09-21T06:22:59.302 DEBUG:teuthology.orchestra.run.smithi144:> sudo yum clean all 2024-09-21T06:22:59.304 INFO:teuthology.orchestra.run.smithi018.stdout:check_obsoletes = 1 2024-09-21T06:22:59.306 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum clean all 2024-09-21T06:22:59.527 INFO:teuthology.orchestra.run.smithi144.stdout:45 files removed 2024-09-21T06:22:59.536 INFO:teuthology.orchestra.run.smithi018.stdout:45 files removed 2024-09-21T06:22:59.541 INFO:teuthology.orchestra.run.smithi007.stdout:45 files removed 2024-09-21T06:22:59.554 DEBUG:teuthology.orchestra.run.smithi144:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T06:22:59.563 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T06:22:59.568 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T06:23:00.115 INFO:teuthology.orchestra.run.smithi144.stdout:ceph packages for x86_64 300 kB/s | 84 kB 00:00 2024-09-21T06:23:00.126 INFO:teuthology.orchestra.run.smithi018.stdout:ceph packages for x86_64 303 kB/s | 84 kB 00:00 2024-09-21T06:23:00.140 INFO:teuthology.orchestra.run.smithi007.stdout:ceph packages for x86_64 312 kB/s | 84 kB 00:00 2024-09-21T06:23:00.407 INFO:teuthology.orchestra.run.smithi144.stdout:ceph noarch packages 97 kB/s | 24 kB 00:00 2024-09-21T06:23:00.418 INFO:teuthology.orchestra.run.smithi018.stdout:ceph noarch packages 97 kB/s | 24 kB 00:00 2024-09-21T06:23:00.433 INFO:teuthology.orchestra.run.smithi007.stdout:ceph noarch packages 98 kB/s | 24 kB 00:00 2024-09-21T06:23:00.691 INFO:teuthology.orchestra.run.smithi144.stdout:ceph source packages 7.7 kB/s | 1.9 kB 00:00 2024-09-21T06:23:00.717 INFO:teuthology.orchestra.run.smithi007.stdout:ceph source packages 7.8 kB/s | 1.9 kB 00:00 2024-09-21T06:23:00.727 INFO:teuthology.orchestra.run.smithi018.stdout:ceph source packages 7.0 kB/s | 1.9 kB 00:00 2024-09-21T06:23:01.392 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.3 MB 00:00 2024-09-21T06:23:02.633 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 9 - BaseOS 4.3 MB/s | 8.3 MB 00:01 2024-09-21T06:23:03.536 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - BaseOS 3.0 MB/s | 8.3 MB 00:02 2024-09-21T06:23:05.370 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - AppStream 28 MB/s | 20 MB 00:00 2024-09-21T06:23:05.876 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 9 - AppStream 9.3 MB/s | 20 MB 00:02 2024-09-21T06:23:09.992 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 9 - AppStream 2.7 MB/s | 20 MB 00:07 2024-09-21T06:23:11.338 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - CRB 3.2 MB/s | 6.5 MB 00:02 2024-09-21T06:23:12.914 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - Extras packages 67 kB/s | 19 kB 00:00 2024-09-21T06:23:13.817 INFO:teuthology.orchestra.run.smithi018.stdout:Extra Packages for Enterprise Linux 29 MB/s | 23 MB 00:00 2024-09-21T06:23:14.467 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.5 MB 00:00 2024-09-21T06:23:15.559 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 9 - CRB 1.1 MB/s | 6.5 MB 00:05 2024-09-21T06:23:16.135 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS Stream 9 - Extras packages 48 kB/s | 19 kB 00:00 2024-09-21T06:23:17.064 INFO:teuthology.orchestra.run.smithi007.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-21T06:23:17.076 INFO:teuthology.orchestra.run.smithi144.stdout:CentOS Stream 9 - Extras packages 64 kB/s | 19 kB 00:00 2024-09-21T06:23:17.997 INFO:teuthology.orchestra.run.smithi144.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-21T06:23:19.399 INFO:teuthology.orchestra.run.smithi018.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-21T06:23:21.609 INFO:teuthology.orchestra.run.smithi018.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T06:23:21.610 INFO:teuthology.orchestra.run.smithi018.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T06:23:21.622 INFO:teuthology.orchestra.run.smithi018.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T06:23:21.623 INFO:teuthology.orchestra.run.smithi018.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T06:23:21.624 INFO:teuthology.orchestra.run.smithi018.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T06:23:21.625 INFO:teuthology.orchestra.run.smithi018.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T06:23:21.626 INFO:teuthology.orchestra.run.smithi018.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T06:23:21.629 INFO:teuthology.orchestra.run.smithi018.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T06:23:21.630 INFO:teuthology.orchestra.run.smithi018.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T06:23:21.697 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-09-21T06:23:21.717 INFO:teuthology.orchestra.run.smithi018.stdout:======================================================================================= 2024-09-21T06:23:21.717 INFO:teuthology.orchestra.run.smithi018.stdout: Package Arch Version Repository Size 2024-09-21T06:23:21.717 INFO:teuthology.orchestra.run.smithi018.stdout:======================================================================================= 2024-09-21T06:23:21.717 INFO:teuthology.orchestra.run.smithi018.stdout:Installing: 2024-09-21T06:23:21.717 INFO:teuthology.orchestra.run.smithi018.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T06:23:21.718 INFO:teuthology.orchestra.run.smithi018.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T06:23:21.718 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T06:23:21.718 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T06:23:21.718 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T06:23:21.718 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T06:23:21.718 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T06:23:21.718 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T06:23:21.718 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T06:23:21.718 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T06:23:21.718 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T06:23:21.718 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T06:23:21.719 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T06:23:21.719 INFO:teuthology.orchestra.run.smithi018.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T06:23:21.719 INFO:teuthology.orchestra.run.smithi018.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T06:23:21.719 INFO:teuthology.orchestra.run.smithi018.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T06:23:21.719 INFO:teuthology.orchestra.run.smithi018.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T06:23:21.719 INFO:teuthology.orchestra.run.smithi018.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T06:23:21.719 INFO:teuthology.orchestra.run.smithi018.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T06:23:21.719 INFO:teuthology.orchestra.run.smithi018.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T06:23:21.719 INFO:teuthology.orchestra.run.smithi018.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T06:23:21.719 INFO:teuthology.orchestra.run.smithi018.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T06:23:21.719 INFO:teuthology.orchestra.run.smithi018.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T06:23:21.719 INFO:teuthology.orchestra.run.smithi018.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T06:23:21.719 INFO:teuthology.orchestra.run.smithi018.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T06:23:21.719 INFO:teuthology.orchestra.run.smithi018.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T06:23:21.720 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T06:23:21.720 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T06:23:21.720 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T06:23:21.720 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T06:23:21.720 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T06:23:21.720 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T06:23:21.720 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T06:23:21.720 INFO:teuthology.orchestra.run.smithi018.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T06:23:21.720 INFO:teuthology.orchestra.run.smithi018.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T06:23:21.720 INFO:teuthology.orchestra.run.smithi018.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T06:23:21.720 INFO:teuthology.orchestra.run.smithi018.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T06:23:21.720 INFO:teuthology.orchestra.run.smithi018.stdout:Upgrading: 2024-09-21T06:23:21.720 INFO:teuthology.orchestra.run.smithi018.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T06:23:21.720 INFO:teuthology.orchestra.run.smithi018.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T06:23:21.721 INFO:teuthology.orchestra.run.smithi018.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T06:23:21.721 INFO:teuthology.orchestra.run.smithi018.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T06:23:21.721 INFO:teuthology.orchestra.run.smithi018.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T06:23:21.721 INFO:teuthology.orchestra.run.smithi018.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T06:23:21.721 INFO:teuthology.orchestra.run.smithi018.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T06:23:21.721 INFO:teuthology.orchestra.run.smithi018.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T06:23:21.721 INFO:teuthology.orchestra.run.smithi018.stdout:Installing dependencies: 2024-09-21T06:23:21.721 INFO:teuthology.orchestra.run.smithi018.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T06:23:21.721 INFO:teuthology.orchestra.run.smithi018.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T06:23:21.721 INFO:teuthology.orchestra.run.smithi018.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T06:23:21.721 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T06:23:21.721 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T06:23:21.721 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T06:23:21.721 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T06:23:21.722 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T06:23:21.722 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T06:23:21.722 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T06:23:21.722 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T06:23:21.722 INFO:teuthology.orchestra.run.smithi018.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T06:23:21.722 INFO:teuthology.orchestra.run.smithi018.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T06:23:21.722 INFO:teuthology.orchestra.run.smithi018.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T06:23:21.722 INFO:teuthology.orchestra.run.smithi018.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T06:23:21.722 INFO:teuthology.orchestra.run.smithi018.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T06:23:21.722 INFO:teuthology.orchestra.run.smithi018.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T06:23:21.722 INFO:teuthology.orchestra.run.smithi018.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T06:23:21.722 INFO:teuthology.orchestra.run.smithi018.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T06:23:21.722 INFO:teuthology.orchestra.run.smithi018.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T06:23:21.722 INFO:teuthology.orchestra.run.smithi018.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T06:23:21.723 INFO:teuthology.orchestra.run.smithi018.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T06:23:21.723 INFO:teuthology.orchestra.run.smithi018.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T06:23:21.723 INFO:teuthology.orchestra.run.smithi018.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T06:23:21.723 INFO:teuthology.orchestra.run.smithi018.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T06:23:21.723 INFO:teuthology.orchestra.run.smithi018.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T06:23:21.723 INFO:teuthology.orchestra.run.smithi018.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T06:23:21.723 INFO:teuthology.orchestra.run.smithi018.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T06:23:21.723 INFO:teuthology.orchestra.run.smithi018.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T06:23:21.723 INFO:teuthology.orchestra.run.smithi018.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T06:23:21.723 INFO:teuthology.orchestra.run.smithi018.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T06:23:21.723 INFO:teuthology.orchestra.run.smithi018.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T06:23:21.723 INFO:teuthology.orchestra.run.smithi018.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T06:23:21.723 INFO:teuthology.orchestra.run.smithi018.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T06:23:21.723 INFO:teuthology.orchestra.run.smithi018.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T06:23:21.724 INFO:teuthology.orchestra.run.smithi018.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T06:23:21.724 INFO:teuthology.orchestra.run.smithi018.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T06:23:21.724 INFO:teuthology.orchestra.run.smithi018.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T06:23:21.724 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T06:23:21.724 INFO:teuthology.orchestra.run.smithi018.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T06:23:21.724 INFO:teuthology.orchestra.run.smithi018.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T06:23:21.724 INFO:teuthology.orchestra.run.smithi018.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T06:23:21.724 INFO:teuthology.orchestra.run.smithi018.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T06:23:21.724 INFO:teuthology.orchestra.run.smithi018.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T06:23:21.724 INFO:teuthology.orchestra.run.smithi018.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T06:23:21.724 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T06:23:21.724 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T06:23:21.724 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T06:23:21.725 INFO:teuthology.orchestra.run.smithi018.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T06:23:21.725 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T06:23:21.725 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T06:23:21.725 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T06:23:21.725 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T06:23:21.725 INFO:teuthology.orchestra.run.smithi018.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T06:23:21.725 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T06:23:21.725 INFO:teuthology.orchestra.run.smithi018.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T06:23:21.725 INFO:teuthology.orchestra.run.smithi018.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T06:23:21.725 INFO:teuthology.orchestra.run.smithi018.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T06:23:21.725 INFO:teuthology.orchestra.run.smithi018.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T06:23:21.726 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T06:23:21.726 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T06:23:21.726 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T06:23:21.726 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T06:23:21.726 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T06:23:21.726 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T06:23:21.726 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T06:23:21.726 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T06:23:21.726 INFO:teuthology.orchestra.run.smithi018.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T06:23:21.726 INFO:teuthology.orchestra.run.smithi018.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T06:23:21.726 INFO:teuthology.orchestra.run.smithi018.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T06:23:21.726 INFO:teuthology.orchestra.run.smithi018.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T06:23:21.726 INFO:teuthology.orchestra.run.smithi018.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T06:23:21.726 INFO:teuthology.orchestra.run.smithi018.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T06:23:21.727 INFO:teuthology.orchestra.run.smithi018.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T06:23:21.727 INFO:teuthology.orchestra.run.smithi018.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T06:23:21.727 INFO:teuthology.orchestra.run.smithi018.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T06:23:21.727 INFO:teuthology.orchestra.run.smithi018.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T06:23:21.727 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T06:23:21.727 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T06:23:21.727 INFO:teuthology.orchestra.run.smithi018.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T06:23:21.727 INFO:teuthology.orchestra.run.smithi018.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T06:23:21.727 INFO:teuthology.orchestra.run.smithi018.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T06:23:21.727 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T06:23:21.727 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T06:23:21.727 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T06:23:21.727 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T06:23:21.727 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T06:23:21.727 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T06:23:21.728 INFO:teuthology.orchestra.run.smithi018.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T06:23:21.728 INFO:teuthology.orchestra.run.smithi018.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T06:23:21.728 INFO:teuthology.orchestra.run.smithi018.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T06:23:21.728 INFO:teuthology.orchestra.run.smithi018.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T06:23:21.728 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T06:23:21.728 INFO:teuthology.orchestra.run.smithi018.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T06:23:21.728 INFO:teuthology.orchestra.run.smithi018.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T06:23:21.728 INFO:teuthology.orchestra.run.smithi018.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T06:23:21.728 INFO:teuthology.orchestra.run.smithi018.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T06:23:21.728 INFO:teuthology.orchestra.run.smithi018.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T06:23:21.728 INFO:teuthology.orchestra.run.smithi018.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T06:23:21.728 INFO:teuthology.orchestra.run.smithi018.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T06:23:21.728 INFO:teuthology.orchestra.run.smithi018.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T06:23:21.728 INFO:teuthology.orchestra.run.smithi018.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T06:23:21.728 INFO:teuthology.orchestra.run.smithi018.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T06:23:21.728 INFO:teuthology.orchestra.run.smithi018.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T06:23:21.729 INFO:teuthology.orchestra.run.smithi018.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T06:23:21.729 INFO:teuthology.orchestra.run.smithi018.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T06:23:21.729 INFO:teuthology.orchestra.run.smithi018.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T06:23:21.729 INFO:teuthology.orchestra.run.smithi018.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T06:23:21.729 INFO:teuthology.orchestra.run.smithi018.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T06:23:21.729 INFO:teuthology.orchestra.run.smithi018.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T06:23:21.729 INFO:teuthology.orchestra.run.smithi018.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T06:23:21.729 INFO:teuthology.orchestra.run.smithi018.stdout:Installing weak dependencies: 2024-09-21T06:23:21.729 INFO:teuthology.orchestra.run.smithi018.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T06:23:21.729 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T06:23:21.729 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction Summary 2024-09-21T06:23:21.729 INFO:teuthology.orchestra.run.smithi018.stdout:======================================================================================= 2024-09-21T06:23:21.729 INFO:teuthology.orchestra.run.smithi018.stdout:Install 149 Packages 2024-09-21T06:23:21.730 INFO:teuthology.orchestra.run.smithi018.stdout:Upgrade 8 Packages 2024-09-21T06:23:21.730 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T06:23:21.730 INFO:teuthology.orchestra.run.smithi018.stdout:Total download size: 228 M 2024-09-21T06:23:21.730 INFO:teuthology.orchestra.run.smithi018.stdout:Downloading Packages: 2024-09-21T06:23:22.516 INFO:teuthology.orchestra.run.smithi018.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 48 kB/s | 6.6 kB 00:00 2024-09-21T06:23:22.678 INFO:teuthology.orchestra.run.smithi007.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-21T06:23:22.725 INFO:teuthology.orchestra.run.smithi018.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 4.1 MB/s | 873 kB 00:00 2024-09-21T06:23:22.809 INFO:teuthology.orchestra.run.smithi018.stdout:(3/157): ceph-immutable-object-cache-19.3.0-512 1.7 MB/s | 148 kB 00:00 2024-09-21T06:23:22.884 INFO:teuthology.orchestra.run.smithi018.stdout:(4/157): ceph-base-19.3.0-5120.g18432218.el9.x8 11 MB/s | 5.5 MB 00:00 2024-09-21T06:23:22.993 INFO:teuthology.orchestra.run.smithi018.stdout:(5/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 14 MB/s | 1.5 MB 00:00 2024-09-21T06:23:23.043 INFO:teuthology.orchestra.run.smithi018.stdout:(6/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 9.8 MB/s | 2.3 MB 00:00 2024-09-21T06:23:23.235 INFO:teuthology.orchestra.run.smithi018.stdout:(7/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 21 MB/s | 5.0 MB 00:00 2024-09-21T06:23:23.311 INFO:teuthology.orchestra.run.smithi144.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-21T06:23:23.760 INFO:teuthology.orchestra.run.smithi018.stdout:(8/157): ceph-radosgw-19.3.0-5120.g18432218.el9 20 MB/s | 10 MB 00:00 2024-09-21T06:23:23.985 INFO:teuthology.orchestra.run.smithi018.stdout:(9/157): ceph-common-19.3.0-5120.g18432218.el9. 12 MB/s | 20 MB 00:01 2024-09-21T06:23:24.010 INFO:teuthology.orchestra.run.smithi018.stdout:(10/157): ceph-selinux-19.3.0-5120.g18432218.el 101 kB/s | 25 kB 00:00 2024-09-21T06:23:24.060 INFO:teuthology.orchestra.run.smithi018.stdout:(11/157): cephfs-mirror-19.3.0-5120.g18432218.e 4.4 MB/s | 226 kB 00:00 2024-09-21T06:23:24.253 INFO:teuthology.orchestra.run.smithi018.stdout:(12/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 15 MB/s | 18 MB 00:01 2024-09-21T06:23:24.278 INFO:teuthology.orchestra.run.smithi018.stdout:(13/157): cephfs-shell-19.3.0-5120.g18432218.el 124 kB/s | 27 kB 00:00 2024-09-21T06:23:24.303 INFO:teuthology.orchestra.run.smithi018.stdout:(14/157): libcephfs-devel-19.3.0-5120.g18432218 638 kB/s | 32 kB 00:00 2024-09-21T06:23:24.345 INFO:teuthology.orchestra.run.smithi018.stdout:(15/157): libcephfs2-19.3.0-5120.g18432218.el9. 11 MB/s | 766 kB 00:00 2024-09-21T06:23:24.370 INFO:teuthology.orchestra.run.smithi018.stdout:(16/157): libcephsqlite-19.3.0-5120.g18432218.e 2.3 MB/s | 158 kB 00:00 2024-09-21T06:23:24.396 INFO:teuthology.orchestra.run.smithi018.stdout:(17/157): librados-devel-19.3.0-5120.g18432218. 2.5 MB/s | 127 kB 00:00 2024-09-21T06:23:24.429 INFO:teuthology.orchestra.run.smithi018.stdout:(18/157): libradosstriper1-19.3.0-5120.g1843221 8.5 MB/s | 507 kB 00:00 2024-09-21T06:23:24.496 INFO:teuthology.orchestra.run.smithi018.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 679 kB/s | 45 kB 00:00 2024-09-21T06:23:24.563 INFO:teuthology.orchestra.run.smithi018.stdout:(20/157): python3-ceph-common-19.3.0-5120.g1843 2.2 MB/s | 148 kB 00:00 2024-09-21T06:23:24.647 INFO:teuthology.orchestra.run.smithi018.stdout:(21/157): librgw2-19.3.0-5120.g18432218.el9.x86 21 MB/s | 5.3 MB 00:00 2024-09-21T06:23:24.672 INFO:teuthology.orchestra.run.smithi018.stdout:(22/157): python3-cephfs-19.3.0-5120.g18432218. 1.5 MB/s | 161 kB 00:00 2024-09-21T06:23:24.731 INFO:teuthology.orchestra.run.smithi018.stdout:(23/157): python3-rados-19.3.0-5120.g18432218.e 3.8 MB/s | 321 kB 00:00 2024-09-21T06:23:24.756 INFO:teuthology.orchestra.run.smithi018.stdout:(24/157): python3-rbd-19.3.0-5120.g18432218.el9 3.6 MB/s | 307 kB 00:00 2024-09-21T06:23:24.781 INFO:teuthology.orchestra.run.smithi018.stdout:(25/157): python3-rgw-19.3.0-5120.g18432218.el9 1.9 MB/s | 99 kB 00:00 2024-09-21T06:23:24.806 INFO:teuthology.orchestra.run.smithi018.stdout:(26/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.7 MB/s | 86 kB 00:00 2024-09-21T06:23:24.873 INFO:teuthology.orchestra.run.smithi018.stdout:(27/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 2.5 MB/s | 170 kB 00:00 2024-09-21T06:23:24.950 INFO:teuthology.orchestra.run.smithi007.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T06:23:24.950 INFO:teuthology.orchestra.run.smithi007.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T06:23:24.957 INFO:teuthology.orchestra.run.smithi018.stdout:(28/157): rbd-mirror-19.3.0-5120.g18432218.el9. 18 MB/s | 3.1 MB 00:00 2024-09-21T06:23:24.964 INFO:teuthology.orchestra.run.smithi007.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T06:23:24.965 INFO:teuthology.orchestra.run.smithi007.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T06:23:24.966 INFO:teuthology.orchestra.run.smithi007.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T06:23:24.967 INFO:teuthology.orchestra.run.smithi007.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T06:23:24.969 INFO:teuthology.orchestra.run.smithi007.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T06:23:24.972 INFO:teuthology.orchestra.run.smithi007.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T06:23:24.973 INFO:teuthology.orchestra.run.smithi007.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T06:23:24.982 INFO:teuthology.orchestra.run.smithi018.stdout:(29/157): ceph-grafana-dashboards-19.3.0-5120.g 315 kB/s | 34 kB 00:00 2024-09-21T06:23:25.007 INFO:teuthology.orchestra.run.smithi018.stdout:(30/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 3.0 MB/s | 154 kB 00:00 2024-09-21T06:23:25.041 INFO:teuthology.orchestra.run.smithi007.stdout:Dependencies resolved. 2024-09-21T06:23:25.067 INFO:teuthology.orchestra.run.smithi007.stdout:======================================================================================= 2024-09-21T06:23:25.067 INFO:teuthology.orchestra.run.smithi007.stdout: Package Arch Version Repository Size 2024-09-21T06:23:25.067 INFO:teuthology.orchestra.run.smithi007.stdout:======================================================================================= 2024-09-21T06:23:25.067 INFO:teuthology.orchestra.run.smithi007.stdout:Installing: 2024-09-21T06:23:25.067 INFO:teuthology.orchestra.run.smithi007.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T06:23:25.067 INFO:teuthology.orchestra.run.smithi007.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T06:23:25.067 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T06:23:25.067 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T06:23:25.067 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T06:23:25.067 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T06:23:25.067 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T06:23:25.067 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T06:23:25.068 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T06:23:25.068 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T06:23:25.068 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T06:23:25.068 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T06:23:25.068 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T06:23:25.068 INFO:teuthology.orchestra.run.smithi007.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T06:23:25.068 INFO:teuthology.orchestra.run.smithi007.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T06:23:25.068 INFO:teuthology.orchestra.run.smithi007.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T06:23:25.068 INFO:teuthology.orchestra.run.smithi007.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T06:23:25.068 INFO:teuthology.orchestra.run.smithi007.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T06:23:25.068 INFO:teuthology.orchestra.run.smithi007.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T06:23:25.068 INFO:teuthology.orchestra.run.smithi007.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T06:23:25.068 INFO:teuthology.orchestra.run.smithi007.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T06:23:25.068 INFO:teuthology.orchestra.run.smithi007.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T06:23:25.069 INFO:teuthology.orchestra.run.smithi007.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T06:23:25.069 INFO:teuthology.orchestra.run.smithi007.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T06:23:25.069 INFO:teuthology.orchestra.run.smithi007.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T06:23:25.069 INFO:teuthology.orchestra.run.smithi007.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T06:23:25.069 INFO:teuthology.orchestra.run.smithi007.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T06:23:25.069 INFO:teuthology.orchestra.run.smithi007.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T06:23:25.069 INFO:teuthology.orchestra.run.smithi007.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T06:23:25.069 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T06:23:25.069 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T06:23:25.069 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T06:23:25.069 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T06:23:25.069 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T06:23:25.069 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T06:23:25.069 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T06:23:25.070 INFO:teuthology.orchestra.run.smithi007.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T06:23:25.070 INFO:teuthology.orchestra.run.smithi007.stdout:Upgrading: 2024-09-21T06:23:25.070 INFO:teuthology.orchestra.run.smithi007.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T06:23:25.070 INFO:teuthology.orchestra.run.smithi007.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T06:23:25.070 INFO:teuthology.orchestra.run.smithi007.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T06:23:25.070 INFO:teuthology.orchestra.run.smithi007.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T06:23:25.070 INFO:teuthology.orchestra.run.smithi007.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T06:23:25.070 INFO:teuthology.orchestra.run.smithi007.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T06:23:25.070 INFO:teuthology.orchestra.run.smithi007.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T06:23:25.070 INFO:teuthology.orchestra.run.smithi007.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T06:23:25.070 INFO:teuthology.orchestra.run.smithi007.stdout:Installing dependencies: 2024-09-21T06:23:25.070 INFO:teuthology.orchestra.run.smithi007.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T06:23:25.070 INFO:teuthology.orchestra.run.smithi007.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T06:23:25.071 INFO:teuthology.orchestra.run.smithi007.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T06:23:25.071 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T06:23:25.071 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T06:23:25.071 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T06:23:25.071 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T06:23:25.071 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T06:23:25.071 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T06:23:25.071 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T06:23:25.071 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T06:23:25.071 INFO:teuthology.orchestra.run.smithi007.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T06:23:25.071 INFO:teuthology.orchestra.run.smithi007.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T06:23:25.071 INFO:teuthology.orchestra.run.smithi007.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T06:23:25.071 INFO:teuthology.orchestra.run.smithi007.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T06:23:25.071 INFO:teuthology.orchestra.run.smithi007.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T06:23:25.071 INFO:teuthology.orchestra.run.smithi007.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T06:23:25.071 INFO:teuthology.orchestra.run.smithi007.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T06:23:25.072 INFO:teuthology.orchestra.run.smithi007.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T06:23:25.072 INFO:teuthology.orchestra.run.smithi007.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T06:23:25.072 INFO:teuthology.orchestra.run.smithi007.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T06:23:25.072 INFO:teuthology.orchestra.run.smithi007.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T06:23:25.072 INFO:teuthology.orchestra.run.smithi007.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T06:23:25.072 INFO:teuthology.orchestra.run.smithi007.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T06:23:25.072 INFO:teuthology.orchestra.run.smithi007.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T06:23:25.072 INFO:teuthology.orchestra.run.smithi007.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T06:23:25.072 INFO:teuthology.orchestra.run.smithi007.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T06:23:25.072 INFO:teuthology.orchestra.run.smithi007.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T06:23:25.072 INFO:teuthology.orchestra.run.smithi007.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T06:23:25.072 INFO:teuthology.orchestra.run.smithi007.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T06:23:25.072 INFO:teuthology.orchestra.run.smithi007.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T06:23:25.072 INFO:teuthology.orchestra.run.smithi007.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T06:23:25.073 INFO:teuthology.orchestra.run.smithi007.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T06:23:25.073 INFO:teuthology.orchestra.run.smithi007.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T06:23:25.073 INFO:teuthology.orchestra.run.smithi007.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T06:23:25.073 INFO:teuthology.orchestra.run.smithi007.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T06:23:25.073 INFO:teuthology.orchestra.run.smithi007.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T06:23:25.073 INFO:teuthology.orchestra.run.smithi007.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T06:23:25.073 INFO:teuthology.orchestra.run.smithi007.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T06:23:25.073 INFO:teuthology.orchestra.run.smithi007.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T06:23:25.073 INFO:teuthology.orchestra.run.smithi007.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T06:23:25.073 INFO:teuthology.orchestra.run.smithi007.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T06:23:25.073 INFO:teuthology.orchestra.run.smithi007.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T06:23:25.073 INFO:teuthology.orchestra.run.smithi007.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T06:23:25.073 INFO:teuthology.orchestra.run.smithi007.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T06:23:25.074 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T06:23:25.074 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T06:23:25.074 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T06:23:25.074 INFO:teuthology.orchestra.run.smithi007.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T06:23:25.074 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T06:23:25.074 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T06:23:25.074 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T06:23:25.074 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T06:23:25.074 INFO:teuthology.orchestra.run.smithi007.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T06:23:25.074 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T06:23:25.074 INFO:teuthology.orchestra.run.smithi007.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T06:23:25.074 INFO:teuthology.orchestra.run.smithi007.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T06:23:25.074 INFO:teuthology.orchestra.run.smithi007.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T06:23:25.075 INFO:teuthology.orchestra.run.smithi007.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T06:23:25.075 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T06:23:25.075 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T06:23:25.075 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T06:23:25.075 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T06:23:25.075 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T06:23:25.075 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T06:23:25.075 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T06:23:25.075 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T06:23:25.075 INFO:teuthology.orchestra.run.smithi007.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T06:23:25.075 INFO:teuthology.orchestra.run.smithi007.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T06:23:25.075 INFO:teuthology.orchestra.run.smithi007.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T06:23:25.075 INFO:teuthology.orchestra.run.smithi007.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T06:23:25.075 INFO:teuthology.orchestra.run.smithi007.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T06:23:25.076 INFO:teuthology.orchestra.run.smithi007.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T06:23:25.076 INFO:teuthology.orchestra.run.smithi007.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T06:23:25.076 INFO:teuthology.orchestra.run.smithi007.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T06:23:25.076 INFO:teuthology.orchestra.run.smithi007.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T06:23:25.076 INFO:teuthology.orchestra.run.smithi007.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T06:23:25.076 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T06:23:25.076 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T06:23:25.076 INFO:teuthology.orchestra.run.smithi007.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T06:23:25.076 INFO:teuthology.orchestra.run.smithi007.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T06:23:25.076 INFO:teuthology.orchestra.run.smithi007.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T06:23:25.076 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T06:23:25.076 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T06:23:25.076 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T06:23:25.076 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T06:23:25.076 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T06:23:25.077 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T06:23:25.077 INFO:teuthology.orchestra.run.smithi007.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T06:23:25.077 INFO:teuthology.orchestra.run.smithi007.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T06:23:25.077 INFO:teuthology.orchestra.run.smithi007.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T06:23:25.077 INFO:teuthology.orchestra.run.smithi007.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T06:23:25.077 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T06:23:25.077 INFO:teuthology.orchestra.run.smithi007.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T06:23:25.077 INFO:teuthology.orchestra.run.smithi007.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T06:23:25.077 INFO:teuthology.orchestra.run.smithi007.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T06:23:25.077 INFO:teuthology.orchestra.run.smithi007.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T06:23:25.077 INFO:teuthology.orchestra.run.smithi007.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T06:23:25.077 INFO:teuthology.orchestra.run.smithi007.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T06:23:25.077 INFO:teuthology.orchestra.run.smithi007.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T06:23:25.077 INFO:teuthology.orchestra.run.smithi007.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T06:23:25.077 INFO:teuthology.orchestra.run.smithi007.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T06:23:25.078 INFO:teuthology.orchestra.run.smithi007.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T06:23:25.078 INFO:teuthology.orchestra.run.smithi007.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T06:23:25.078 INFO:teuthology.orchestra.run.smithi007.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T06:23:25.078 INFO:teuthology.orchestra.run.smithi007.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T06:23:25.078 INFO:teuthology.orchestra.run.smithi007.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T06:23:25.078 INFO:teuthology.orchestra.run.smithi007.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T06:23:25.078 INFO:teuthology.orchestra.run.smithi007.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T06:23:25.078 INFO:teuthology.orchestra.run.smithi007.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T06:23:25.078 INFO:teuthology.orchestra.run.smithi007.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T06:23:25.078 INFO:teuthology.orchestra.run.smithi007.stdout:Installing weak dependencies: 2024-09-21T06:23:25.078 INFO:teuthology.orchestra.run.smithi007.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T06:23:25.078 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:23:25.078 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction Summary 2024-09-21T06:23:25.078 INFO:teuthology.orchestra.run.smithi007.stdout:======================================================================================= 2024-09-21T06:23:25.079 INFO:teuthology.orchestra.run.smithi007.stdout:Install 149 Packages 2024-09-21T06:23:25.079 INFO:teuthology.orchestra.run.smithi007.stdout:Upgrade 8 Packages 2024-09-21T06:23:25.079 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:23:25.079 INFO:teuthology.orchestra.run.smithi007.stdout:Total download size: 228 M 2024-09-21T06:23:25.079 INFO:teuthology.orchestra.run.smithi007.stdout:Downloading Packages: 2024-09-21T06:23:25.448 INFO:teuthology.orchestra.run.smithi144.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T06:23:25.449 INFO:teuthology.orchestra.run.smithi144.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T06:23:25.450 INFO:teuthology.orchestra.run.smithi018.stdout:(31/157): ceph-mgr-diskprediction-local-19.3.0- 17 MB/s | 7.4 MB 00:00 2024-09-21T06:23:25.462 INFO:teuthology.orchestra.run.smithi144.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T06:23:25.463 INFO:teuthology.orchestra.run.smithi144.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T06:23:25.464 INFO:teuthology.orchestra.run.smithi144.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T06:23:25.465 INFO:teuthology.orchestra.run.smithi144.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T06:23:25.467 INFO:teuthology.orchestra.run.smithi144.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T06:23:25.470 INFO:teuthology.orchestra.run.smithi144.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T06:23:25.471 INFO:teuthology.orchestra.run.smithi144.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T06:23:25.534 INFO:teuthology.orchestra.run.smithi144.stdout:Dependencies resolved. 2024-09-21T06:23:25.541 INFO:teuthology.orchestra.run.smithi018.stdout:(32/157): ceph-mgr-modules-core-19.3.0-5120.g18 3.1 MB/s | 292 kB 00:00 2024-09-21T06:23:25.555 INFO:teuthology.orchestra.run.smithi144.stdout:======================================================================================= 2024-09-21T06:23:25.555 INFO:teuthology.orchestra.run.smithi144.stdout: Package Arch Version Repository Size 2024-09-21T06:23:25.555 INFO:teuthology.orchestra.run.smithi144.stdout:======================================================================================= 2024-09-21T06:23:25.555 INFO:teuthology.orchestra.run.smithi144.stdout:Installing: 2024-09-21T06:23:25.555 INFO:teuthology.orchestra.run.smithi144.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T06:23:25.555 INFO:teuthology.orchestra.run.smithi144.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T06:23:25.555 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T06:23:25.555 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T06:23:25.555 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T06:23:25.555 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T06:23:25.556 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T06:23:25.556 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T06:23:25.556 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T06:23:25.556 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T06:23:25.556 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T06:23:25.556 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T06:23:25.556 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T06:23:25.556 INFO:teuthology.orchestra.run.smithi144.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T06:23:25.556 INFO:teuthology.orchestra.run.smithi144.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T06:23:25.556 INFO:teuthology.orchestra.run.smithi144.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T06:23:25.556 INFO:teuthology.orchestra.run.smithi144.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T06:23:25.556 INFO:teuthology.orchestra.run.smithi144.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T06:23:25.556 INFO:teuthology.orchestra.run.smithi144.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T06:23:25.556 INFO:teuthology.orchestra.run.smithi144.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T06:23:25.557 INFO:teuthology.orchestra.run.smithi144.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T06:23:25.557 INFO:teuthology.orchestra.run.smithi144.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T06:23:25.557 INFO:teuthology.orchestra.run.smithi144.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T06:23:25.557 INFO:teuthology.orchestra.run.smithi144.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T06:23:25.557 INFO:teuthology.orchestra.run.smithi144.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T06:23:25.557 INFO:teuthology.orchestra.run.smithi144.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T06:23:25.557 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T06:23:25.557 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T06:23:25.557 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T06:23:25.557 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T06:23:25.557 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T06:23:25.557 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T06:23:25.557 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T06:23:25.557 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T06:23:25.558 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T06:23:25.558 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T06:23:25.558 INFO:teuthology.orchestra.run.smithi144.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T06:23:25.558 INFO:teuthology.orchestra.run.smithi144.stdout:Upgrading: 2024-09-21T06:23:25.558 INFO:teuthology.orchestra.run.smithi144.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T06:23:25.558 INFO:teuthology.orchestra.run.smithi144.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T06:23:25.558 INFO:teuthology.orchestra.run.smithi144.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T06:23:25.558 INFO:teuthology.orchestra.run.smithi144.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T06:23:25.558 INFO:teuthology.orchestra.run.smithi144.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T06:23:25.558 INFO:teuthology.orchestra.run.smithi144.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T06:23:25.558 INFO:teuthology.orchestra.run.smithi144.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T06:23:25.558 INFO:teuthology.orchestra.run.smithi144.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T06:23:25.558 INFO:teuthology.orchestra.run.smithi144.stdout:Installing dependencies: 2024-09-21T06:23:25.558 INFO:teuthology.orchestra.run.smithi144.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T06:23:25.559 INFO:teuthology.orchestra.run.smithi144.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T06:23:25.559 INFO:teuthology.orchestra.run.smithi144.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T06:23:25.559 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T06:23:25.559 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T06:23:25.559 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T06:23:25.559 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T06:23:25.559 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T06:23:25.559 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T06:23:25.559 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T06:23:25.559 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T06:23:25.559 INFO:teuthology.orchestra.run.smithi144.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T06:23:25.559 INFO:teuthology.orchestra.run.smithi144.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T06:23:25.559 INFO:teuthology.orchestra.run.smithi144.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T06:23:25.559 INFO:teuthology.orchestra.run.smithi144.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T06:23:25.560 INFO:teuthology.orchestra.run.smithi144.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T06:23:25.560 INFO:teuthology.orchestra.run.smithi144.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T06:23:25.560 INFO:teuthology.orchestra.run.smithi144.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T06:23:25.560 INFO:teuthology.orchestra.run.smithi144.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T06:23:25.560 INFO:teuthology.orchestra.run.smithi144.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T06:23:25.560 INFO:teuthology.orchestra.run.smithi144.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T06:23:25.560 INFO:teuthology.orchestra.run.smithi144.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T06:23:25.560 INFO:teuthology.orchestra.run.smithi144.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T06:23:25.560 INFO:teuthology.orchestra.run.smithi144.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T06:23:25.560 INFO:teuthology.orchestra.run.smithi144.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T06:23:25.560 INFO:teuthology.orchestra.run.smithi144.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T06:23:25.560 INFO:teuthology.orchestra.run.smithi144.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T06:23:25.560 INFO:teuthology.orchestra.run.smithi144.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T06:23:25.560 INFO:teuthology.orchestra.run.smithi144.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T06:23:25.561 INFO:teuthology.orchestra.run.smithi144.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T06:23:25.561 INFO:teuthology.orchestra.run.smithi144.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T06:23:25.561 INFO:teuthology.orchestra.run.smithi144.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T06:23:25.561 INFO:teuthology.orchestra.run.smithi144.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T06:23:25.561 INFO:teuthology.orchestra.run.smithi144.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T06:23:25.561 INFO:teuthology.orchestra.run.smithi144.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T06:23:25.561 INFO:teuthology.orchestra.run.smithi144.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T06:23:25.561 INFO:teuthology.orchestra.run.smithi144.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T06:23:25.561 INFO:teuthology.orchestra.run.smithi144.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T06:23:25.561 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T06:23:25.561 INFO:teuthology.orchestra.run.smithi144.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T06:23:25.561 INFO:teuthology.orchestra.run.smithi144.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T06:23:25.561 INFO:teuthology.orchestra.run.smithi144.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T06:23:25.561 INFO:teuthology.orchestra.run.smithi144.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T06:23:25.562 INFO:teuthology.orchestra.run.smithi144.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T06:23:25.562 INFO:teuthology.orchestra.run.smithi144.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T06:23:25.562 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T06:23:25.562 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T06:23:25.562 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T06:23:25.562 INFO:teuthology.orchestra.run.smithi144.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T06:23:25.562 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T06:23:25.562 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T06:23:25.562 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T06:23:25.562 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T06:23:25.562 INFO:teuthology.orchestra.run.smithi144.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T06:23:25.562 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T06:23:25.562 INFO:teuthology.orchestra.run.smithi144.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T06:23:25.562 INFO:teuthology.orchestra.run.smithi144.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T06:23:25.563 INFO:teuthology.orchestra.run.smithi144.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T06:23:25.563 INFO:teuthology.orchestra.run.smithi144.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T06:23:25.563 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T06:23:25.563 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T06:23:25.563 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T06:23:25.563 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T06:23:25.563 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T06:23:25.563 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T06:23:25.563 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T06:23:25.563 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T06:23:25.563 INFO:teuthology.orchestra.run.smithi144.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T06:23:25.563 INFO:teuthology.orchestra.run.smithi144.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T06:23:25.563 INFO:teuthology.orchestra.run.smithi144.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T06:23:25.563 INFO:teuthology.orchestra.run.smithi144.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T06:23:25.563 INFO:teuthology.orchestra.run.smithi144.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T06:23:25.564 INFO:teuthology.orchestra.run.smithi144.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T06:23:25.564 INFO:teuthology.orchestra.run.smithi144.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T06:23:25.564 INFO:teuthology.orchestra.run.smithi144.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T06:23:25.564 INFO:teuthology.orchestra.run.smithi144.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T06:23:25.564 INFO:teuthology.orchestra.run.smithi144.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T06:23:25.564 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T06:23:25.564 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T06:23:25.564 INFO:teuthology.orchestra.run.smithi144.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T06:23:25.564 INFO:teuthology.orchestra.run.smithi144.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T06:23:25.564 INFO:teuthology.orchestra.run.smithi144.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T06:23:25.564 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T06:23:25.564 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T06:23:25.564 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T06:23:25.564 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T06:23:25.565 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T06:23:25.565 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T06:23:25.565 INFO:teuthology.orchestra.run.smithi144.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T06:23:25.565 INFO:teuthology.orchestra.run.smithi144.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T06:23:25.565 INFO:teuthology.orchestra.run.smithi144.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T06:23:25.565 INFO:teuthology.orchestra.run.smithi144.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T06:23:25.565 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T06:23:25.565 INFO:teuthology.orchestra.run.smithi144.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T06:23:25.565 INFO:teuthology.orchestra.run.smithi144.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T06:23:25.565 INFO:teuthology.orchestra.run.smithi144.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T06:23:25.565 INFO:teuthology.orchestra.run.smithi144.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T06:23:25.565 INFO:teuthology.orchestra.run.smithi144.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T06:23:25.565 INFO:teuthology.orchestra.run.smithi144.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T06:23:25.565 INFO:teuthology.orchestra.run.smithi144.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T06:23:25.566 INFO:teuthology.orchestra.run.smithi144.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T06:23:25.566 INFO:teuthology.orchestra.run.smithi144.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T06:23:25.566 INFO:teuthology.orchestra.run.smithi144.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T06:23:25.566 INFO:teuthology.orchestra.run.smithi144.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T06:23:25.566 INFO:teuthology.orchestra.run.smithi144.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T06:23:25.566 INFO:teuthology.orchestra.run.smithi144.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T06:23:25.566 INFO:teuthology.orchestra.run.smithi144.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T06:23:25.566 INFO:teuthology.orchestra.run.smithi144.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T06:23:25.566 INFO:teuthology.orchestra.run.smithi144.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T06:23:25.566 INFO:teuthology.orchestra.run.smithi144.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T06:23:25.566 INFO:teuthology.orchestra.run.smithi144.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T06:23:25.566 INFO:teuthology.orchestra.run.smithi144.stdout:Installing weak dependencies: 2024-09-21T06:23:25.566 INFO:teuthology.orchestra.run.smithi144.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T06:23:25.566 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-21T06:23:25.567 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction Summary 2024-09-21T06:23:25.567 INFO:teuthology.orchestra.run.smithi144.stdout:======================================================================================= 2024-09-21T06:23:25.567 INFO:teuthology.orchestra.run.smithi144.stdout:Install 149 Packages 2024-09-21T06:23:25.567 INFO:teuthology.orchestra.run.smithi144.stdout:Upgrade 8 Packages 2024-09-21T06:23:25.567 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-21T06:23:25.567 INFO:teuthology.orchestra.run.smithi144.stdout:Total download size: 228 M 2024-09-21T06:23:25.567 INFO:teuthology.orchestra.run.smithi144.stdout:Downloading Packages: 2024-09-21T06:23:25.642 INFO:teuthology.orchestra.run.smithi018.stdout:(33/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 494 kB/s | 49 kB 00:00 2024-09-21T06:23:25.709 INFO:teuthology.orchestra.run.smithi018.stdout:(34/157): ceph-prometheus-alerts-19.3.0-5120.g1 247 kB/s | 16 kB 00:00 2024-09-21T06:23:25.755 INFO:teuthology.orchestra.run.smithi007.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 35 kB/s | 6.6 kB 00:00 2024-09-21T06:23:25.776 INFO:teuthology.orchestra.run.smithi018.stdout:(35/157): ceph-volume-19.3.0-5120.g18432218.el9 4.2 MB/s | 285 kB 00:00 2024-09-21T06:23:25.918 INFO:teuthology.orchestra.run.smithi018.stdout:(36/157): ceph-mgr-dashboard-19.3.0-5120.g18432 15 MB/s | 14 MB 00:00 2024-09-21T06:23:25.960 INFO:teuthology.orchestra.run.smithi018.stdout:(37/157): cephadm-19.3.0-5120.g18432218.el9.noa 4.2 MB/s | 784 kB 00:00 2024-09-21T06:23:25.963 INFO:teuthology.orchestra.run.smithi007.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 4.1 MB/s | 873 kB 00:00 2024-09-21T06:23:25.985 INFO:teuthology.orchestra.run.smithi018.stdout:(38/157): cephfs-top-19.3.0-5120.g18432218.el9. 276 kB/s | 18 kB 00:00 2024-09-21T06:23:26.030 INFO:teuthology.orchestra.run.smithi007.stdout:(3/157): ceph-immutable-object-cache-19.3.0-512 2.2 MB/s | 148 kB 00:00 2024-09-21T06:23:26.239 INFO:teuthology.orchestra.run.smithi007.stdout:(4/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 11 MB/s | 2.3 MB 00:00 2024-09-21T06:23:26.279 INFO:teuthology.orchestra.run.smithi144.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 28 kB/s | 6.6 kB 00:00 2024-09-21T06:23:26.335 INFO:teuthology.orchestra.run.smithi018.stdout:(39/157): ceph-test-19.3.0-5120.g18432218.el9.x 17 MB/s | 40 MB 00:02 2024-09-21T06:23:26.444 INFO:teuthology.orchestra.run.smithi018.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 165 kB/s | 80 kB 00:00 2024-09-21T06:23:26.511 INFO:teuthology.orchestra.run.smithi018.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 1.1 MB/s | 191 kB 00:00 2024-09-21T06:23:26.522 INFO:teuthology.orchestra.run.smithi007.stdout:(5/157): ceph-common-19.3.0-5120.g18432218.el9. 21 MB/s | 20 MB 00:00 2024-09-21T06:23:26.538 INFO:teuthology.orchestra.run.smithi144.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 3.3 MB/s | 873 kB 00:00 2024-09-21T06:23:26.561 INFO:teuthology.orchestra.run.smithi018.stdout:(42/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.1 MB/s | 253 kB 00:00 2024-09-21T06:23:26.564 INFO:teuthology.orchestra.run.smithi007.stdout:(6/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 4.7 MB/s | 1.5 MB 00:00 2024-09-21T06:23:26.595 INFO:teuthology.orchestra.run.smithi018.stdout:(43/157): libgfortran-11.5.0-2.el9.x86_64.rpm 1.3 MB/s | 801 kB 00:00 2024-09-21T06:23:26.611 INFO:teuthology.orchestra.run.smithi018.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-21T06:23:26.630 INFO:teuthology.orchestra.run.smithi144.stdout:(3/157): ceph-immutable-object-cache-19.3.0-512 1.6 MB/s | 148 kB 00:00 2024-09-21T06:23:26.645 INFO:teuthology.orchestra.run.smithi018.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-21T06:23:26.695 INFO:teuthology.orchestra.run.smithi018.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 1.5 MB/s | 125 kB 00:00 2024-09-21T06:23:26.721 INFO:teuthology.orchestra.run.smithi018.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 2.8 MB/s | 215 kB 00:00 2024-09-21T06:23:26.771 INFO:teuthology.orchestra.run.smithi018.stdout:(48/157): python3-cryptography-36.0.1-4.el9.x86 4.7 MB/s | 1.2 MB 00:00 2024-09-21T06:23:26.848 INFO:teuthology.orchestra.run.smithi007.stdout:(7/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 15 MB/s | 5.0 MB 00:00 2024-09-21T06:23:26.946 INFO:teuthology.orchestra.run.smithi018.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 611 kB/s | 107 kB 00:00 2024-09-21T06:23:26.971 INFO:teuthology.orchestra.run.smithi018.stdout:(50/157): automake-1.16.2-8.el9.noarch.rpm 2.4 MB/s | 689 kB 00:00 2024-09-21T06:23:26.988 INFO:teuthology.orchestra.run.smithi018.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 520 kB/s | 22 kB 00:00 2024-09-21T06:23:27.030 INFO:teuthology.orchestra.run.smithi018.stdout:(52/157): flex-2.6.4-9.el9.x86_64.rpm 5.2 MB/s | 313 kB 00:00 2024-09-21T06:23:27.056 INFO:teuthology.orchestra.run.smithi018.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 489 kB/s | 33 kB 00:00 2024-09-21T06:23:27.089 INFO:teuthology.orchestra.run.smithi018.stdout:(54/157): bison-3.7.4-5.el9.x86_64.rpm 2.5 MB/s | 943 kB 00:00 2024-09-21T06:23:27.116 INFO:teuthology.orchestra.run.smithi018.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 301 kB/s | 18 kB 00:00 2024-09-21T06:23:27.122 INFO:teuthology.orchestra.run.smithi144.stdout:(4/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 4.6 MB/s | 2.3 MB 00:00 2024-09-21T06:23:27.150 INFO:teuthology.orchestra.run.smithi018.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 184 kB/s | 11 kB 00:00 2024-09-21T06:23:27.200 INFO:teuthology.orchestra.run.smithi018.stdout:(57/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-09-21T06:23:27.217 INFO:teuthology.orchestra.run.smithi018.stdout:(58/157): libnbd-1.20.2-2.el9.x86_64.rpm 1.7 MB/s | 171 kB 00:00 2024-09-21T06:23:27.259 INFO:teuthology.orchestra.run.smithi018.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 769 kB/s | 45 kB 00:00 2024-09-21T06:23:27.322 INFO:teuthology.orchestra.run.smithi144.stdout:(5/157): ceph-common-19.3.0-5120.g18432218.el9. 16 MB/s | 20 MB 00:01 2024-09-21T06:23:27.326 INFO:teuthology.orchestra.run.smithi018.stdout:(60/157): libtool-2.4.6-46.el9.x86_64.rpm 8.5 MB/s | 581 kB 00:00 2024-09-21T06:23:27.360 INFO:teuthology.orchestra.run.smithi018.stdout:(61/157): librdkafka-1.6.1-102.el9.x86_64.rpm 4.6 MB/s | 662 kB 00:00 2024-09-21T06:23:27.394 INFO:teuthology.orchestra.run.smithi018.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 365 kB/s | 24 kB 00:00 2024-09-21T06:23:27.419 INFO:teuthology.orchestra.run.smithi018.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 808 kB/s | 47 kB 00:00 2024-09-21T06:23:27.472 INFO:teuthology.orchestra.run.smithi144.stdout:(6/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 4.3 MB/s | 1.5 MB 00:00 2024-09-21T06:23:27.486 INFO:teuthology.orchestra.run.smithi018.stdout:(64/157): lua-5.4.4-4.el9.x86_64.rpm 2.8 MB/s | 188 kB 00:00 2024-09-21T06:23:27.490 INFO:teuthology.orchestra.run.smithi007.stdout:(8/157): ceph-radosgw-19.3.0-5120.g18432218.el9 16 MB/s | 10 MB 00:00 2024-09-21T06:23:27.553 INFO:teuthology.orchestra.run.smithi018.stdout:(65/157): openblas-0.3.26-2.el9.x86_64.rpm 577 kB/s | 38 kB 00:00 2024-09-21T06:23:27.578 INFO:teuthology.orchestra.run.smithi018.stdout:(66/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.6 MB/s | 292 kB 00:00 2024-09-21T06:23:27.607 INFO:teuthology.orchestra.run.smithi007.stdout:(9/157): ceph-base-19.3.0-5120.g18432218.el9.x8 2.7 MB/s | 5.5 MB 00:02 2024-09-21T06:23:27.632 INFO:teuthology.orchestra.run.smithi007.stdout:(10/157): ceph-selinux-19.3.0-5120.g18432218.el 177 kB/s | 25 kB 00:00 2024-09-21T06:23:27.689 INFO:teuthology.orchestra.run.smithi144.stdout:(7/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 14 MB/s | 5.0 MB 00:00 2024-09-21T06:23:27.740 INFO:teuthology.orchestra.run.smithi007.stdout:(11/157): cephfs-mirror-19.3.0-5120.g18432218.e 2.0 MB/s | 226 kB 00:00 2024-09-21T06:23:27.781 INFO:teuthology.orchestra.run.smithi144.stdout:(8/157): ceph-base-19.3.0-5120.g18432218.el9.x8 3.2 MB/s | 5.5 MB 00:01 2024-09-21T06:23:27.791 INFO:teuthology.orchestra.run.smithi007.stdout:(12/157): cephfs-shell-19.3.0-5120.g18432218.el 541 kB/s | 27 kB 00:00 2024-09-21T06:23:27.848 INFO:teuthology.orchestra.run.smithi144.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 377 kB/s | 25 kB 00:00 2024-09-21T06:23:27.858 INFO:teuthology.orchestra.run.smithi007.stdout:(13/157): libcephfs-devel-19.3.0-5120.g18432218 475 kB/s | 32 kB 00:00 2024-09-21T06:23:27.950 INFO:teuthology.orchestra.run.smithi007.stdout:(14/157): libcephfs2-19.3.0-5120.g18432218.el9. 8.2 MB/s | 766 kB 00:00 2024-09-21T06:23:28.025 INFO:teuthology.orchestra.run.smithi007.stdout:(15/157): libcephsqlite-19.3.0-5120.g18432218.e 2.1 MB/s | 158 kB 00:00 2024-09-21T06:23:28.100 INFO:teuthology.orchestra.run.smithi007.stdout:(16/157): librados-devel-19.3.0-5120.g18432218. 1.6 MB/s | 127 kB 00:00 2024-09-21T06:23:28.192 INFO:teuthology.orchestra.run.smithi007.stdout:(17/157): libradosstriper1-19.3.0-5120.g1843221 5.4 MB/s | 507 kB 00:00 2024-09-21T06:23:28.236 INFO:teuthology.orchestra.run.smithi018.stdout:(67/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.5 MB/s | 3.0 MB 00:01 2024-09-21T06:23:28.282 INFO:teuthology.orchestra.run.smithi144.stdout:(10/157): ceph-radosgw-19.3.0-5120.g18432218.el 18 MB/s | 10 MB 00:00 2024-09-21T06:23:28.332 INFO:teuthology.orchestra.run.smithi144.stdout:(11/157): cephfs-mirror-19.3.0-5120.g18432218.e 4.4 MB/s | 226 kB 00:00 2024-09-21T06:23:28.376 INFO:teuthology.orchestra.run.smithi007.stdout:(18/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 9.8 MB/s | 18 MB 00:01 2024-09-21T06:23:28.391 INFO:teuthology.orchestra.run.smithi144.stdout:(12/157): cephfs-shell-19.3.0-5120.g18432218.el 463 kB/s | 27 kB 00:00 2024-09-21T06:23:28.427 INFO:teuthology.orchestra.run.smithi007.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 905 kB/s | 45 kB 00:00 2024-09-21T06:23:28.457 INFO:teuthology.orchestra.run.smithi144.stdout:(13/157): libcephfs-devel-19.3.0-5120.g18432218 477 kB/s | 32 kB 00:00 2024-09-21T06:23:28.502 INFO:teuthology.orchestra.run.smithi007.stdout:(20/157): python3-ceph-common-19.3.0-5120.g1843 1.9 MB/s | 148 kB 00:00 2024-09-21T06:23:28.549 INFO:teuthology.orchestra.run.smithi144.stdout:(14/157): libcephfs2-19.3.0-5120.g18432218.el9. 8.2 MB/s | 766 kB 00:00 2024-09-21T06:23:28.577 INFO:teuthology.orchestra.run.smithi007.stdout:(21/157): librgw2-19.3.0-5120.g18432218.el9.x86 14 MB/s | 5.3 MB 00:00 2024-09-21T06:23:28.600 INFO:teuthology.orchestra.run.smithi144.stdout:(15/157): libcephsqlite-19.3.0-5120.g18432218.e 3.1 MB/s | 158 kB 00:00 2024-09-21T06:23:28.602 INFO:teuthology.orchestra.run.smithi007.stdout:(22/157): python3-cephfs-19.3.0-5120.g18432218. 1.6 MB/s | 161 kB 00:00 2024-09-21T06:23:28.644 INFO:teuthology.orchestra.run.smithi007.stdout:(23/157): python3-rados-19.3.0-5120.g18432218.e 4.7 MB/s | 321 kB 00:00 2024-09-21T06:23:28.675 INFO:teuthology.orchestra.run.smithi144.stdout:(16/157): librados-devel-19.3.0-5120.g18432218. 1.7 MB/s | 127 kB 00:00 2024-09-21T06:23:28.678 INFO:teuthology.orchestra.run.smithi007.stdout:(24/157): python3-rbd-19.3.0-5120.g18432218.el9 4.0 MB/s | 307 kB 00:00 2024-09-21T06:23:28.711 INFO:teuthology.orchestra.run.smithi007.stdout:(25/157): python3-rgw-19.3.0-5120.g18432218.el9 1.4 MB/s | 99 kB 00:00 2024-09-21T06:23:28.750 INFO:teuthology.orchestra.run.smithi144.stdout:(17/157): libradosstriper1-19.3.0-5120.g1843221 6.6 MB/s | 507 kB 00:00 2024-09-21T06:23:28.753 INFO:teuthology.orchestra.run.smithi007.stdout:(26/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.1 MB/s | 86 kB 00:00 2024-09-21T06:23:28.862 INFO:teuthology.orchestra.run.smithi007.stdout:(27/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 1.5 MB/s | 170 kB 00:00 2024-09-21T06:23:28.962 INFO:teuthology.orchestra.run.smithi007.stdout:(28/157): ceph-grafana-dashboards-19.3.0-5120.g 343 kB/s | 34 kB 00:00 2024-09-21T06:23:29.020 INFO:teuthology.orchestra.run.smithi018.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 2.0 MB/s | 1.6 MB 00:00 2024-09-21T06:23:29.054 INFO:teuthology.orchestra.run.smithi007.stdout:(29/157): rbd-mirror-19.3.0-5120.g18432218.el9. 9.1 MB/s | 3.1 MB 00:00 2024-09-21T06:23:29.080 INFO:teuthology.orchestra.run.smithi007.stdout:(30/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 1.3 MB/s | 154 kB 00:00 2024-09-21T06:23:29.309 INFO:teuthology.orchestra.run.smithi144.stdout:(18/157): librgw2-19.3.0-5120.g18432218.el9.x86 9.5 MB/s | 5.3 MB 00:00 2024-09-21T06:23:29.409 INFO:teuthology.orchestra.run.smithi144.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 452 kB/s | 45 kB 00:00 2024-09-21T06:23:29.479 INFO:teuthology.orchestra.run.smithi018.stdout:(69/157): postgresql-contrib-13.16-1.el9.x86_64 1.9 MB/s | 910 kB 00:00 2024-09-21T06:23:29.518 INFO:teuthology.orchestra.run.smithi144.stdout:(20/157): python3-ceph-common-19.3.0-5120.g1843 1.3 MB/s | 148 kB 00:00 2024-09-21T06:23:29.546 INFO:teuthology.orchestra.run.smithi018.stdout:(70/157): openblas-openmp-0.3.26-2.el9.x86_64.r 2.5 MB/s | 4.9 MB 00:01 2024-09-21T06:23:29.626 INFO:teuthology.orchestra.run.smithi144.stdout:(21/157): python3-cephfs-19.3.0-5120.g18432218. 1.5 MB/s | 161 kB 00:00 2024-09-21T06:23:29.629 INFO:teuthology.orchestra.run.smithi018.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 915 kB/s | 137 kB 00:00 2024-09-21T06:23:29.804 INFO:teuthology.orchestra.run.smithi018.stdout:(72/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 2.0 MB/s | 4.4 MB 00:02 2024-09-21T06:23:29.888 INFO:teuthology.orchestra.run.smithi018.stdout:(73/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.0 MB/s | 87 kB 00:00 2024-09-21T06:23:30.171 INFO:teuthology.orchestra.run.smithi018.stdout:(74/157): protobuf-3.14.0-13.el9.x86_64.rpm 1.9 MB/s | 1.0 MB 00:00 2024-09-21T06:23:30.188 INFO:teuthology.orchestra.run.smithi007.stdout:(31/157): ceph-mgr-dashboard-19.3.0-5120.g18432 13 MB/s | 14 MB 00:01 2024-09-21T06:23:30.213 INFO:teuthology.orchestra.run.smithi018.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-09-21T06:23:30.277 INFO:teuthology.orchestra.run.smithi144.stdout:(22/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 6.4 MB/s | 18 MB 00:02 2024-09-21T06:23:30.288 INFO:teuthology.orchestra.run.smithi007.stdout:(32/157): ceph-mgr-diskprediction-local-19.3.0- 6.1 MB/s | 7.4 MB 00:01 2024-09-21T06:23:30.301 INFO:teuthology.orchestra.run.smithi144.stdout:(23/157): python3-rados-19.3.0-5120.g18432218.e 476 kB/s | 321 kB 00:00 2024-09-21T06:23:30.314 INFO:teuthology.orchestra.run.smithi007.stdout:(33/157): ceph-mgr-modules-core-19.3.0-5120.g18 2.3 MB/s | 292 kB 00:00 2024-09-21T06:23:30.327 INFO:teuthology.orchestra.run.smithi144.stdout:(24/157): python3-rbd-19.3.0-5120.g18432218.el9 6.0 MB/s | 307 kB 00:00 2024-09-21T06:23:30.339 INFO:teuthology.orchestra.run.smithi007.stdout:(34/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 984 kB/s | 49 kB 00:00 2024-09-21T06:23:30.352 INFO:teuthology.orchestra.run.smithi144.stdout:(25/157): python3-rgw-19.3.0-5120.g18432218.el9 1.9 MB/s | 99 kB 00:00 2024-09-21T06:23:30.355 INFO:teuthology.orchestra.run.smithi018.stdout:(76/157): python3-devel-3.9.19-8.el9.x86_64.rpm 1.7 MB/s | 245 kB 00:00 2024-09-21T06:23:30.364 INFO:teuthology.orchestra.run.smithi007.stdout:(35/157): ceph-prometheus-alerts-19.3.0-5120.g1 328 kB/s | 16 kB 00:00 2024-09-21T06:23:30.377 INFO:teuthology.orchestra.run.smithi144.stdout:(26/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.7 MB/s | 86 kB 00:00 2024-09-21T06:23:30.389 INFO:teuthology.orchestra.run.smithi007.stdout:(36/157): ceph-volume-19.3.0-5120.g18432218.el9 5.6 MB/s | 285 kB 00:00 2024-09-21T06:23:30.431 INFO:teuthology.orchestra.run.smithi007.stdout:(37/157): cephadm-19.3.0-5120.g18432218.el9.noa 11 MB/s | 784 kB 00:00 2024-09-21T06:23:30.456 INFO:teuthology.orchestra.run.smithi007.stdout:(38/157): cephfs-top-19.3.0-5120.g18432218.el9. 276 kB/s | 18 kB 00:00 2024-09-21T06:23:30.505 INFO:teuthology.orchestra.run.smithi018.stdout:(77/157): python3-jinja2-2.11.3-6.el9.noarch.rp 1.6 MB/s | 248 kB 00:00 2024-09-21T06:23:30.547 INFO:teuthology.orchestra.run.smithi018.stdout:(78/157): python3-jsonpatch-1.21-16.el9.noarch. 615 kB/s | 26 kB 00:00 2024-09-21T06:23:30.589 INFO:teuthology.orchestra.run.smithi018.stdout:(79/157): python3-jsonpointer-2.0-4.el9.noarch. 461 kB/s | 19 kB 00:00 2024-09-21T06:23:30.624 INFO:teuthology.orchestra.run.smithi007.stdout:(39/157): fuse-2.9.9-16.el9.x86_64.rpm 415 kB/s | 80 kB 00:00 2024-09-21T06:23:30.698 INFO:teuthology.orchestra.run.smithi018.stdout:(80/157): python3-mako-1.1.4-6.el9.noarch.rpm 1.6 MB/s | 172 kB 00:00 2024-09-21T06:23:30.736 INFO:teuthology.orchestra.run.smithi144.stdout:(27/157): ceph-test-19.3.0-5120.g18432218.el9.x 14 MB/s | 40 MB 00:02 2024-09-21T06:23:30.740 INFO:teuthology.orchestra.run.smithi018.stdout:(81/157): python3-markupsafe-1.1.1-12.el9.x86_6 837 kB/s | 35 kB 00:00 2024-09-21T06:23:30.761 INFO:teuthology.orchestra.run.smithi144.stdout:(28/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 443 kB/s | 170 kB 00:00 2024-09-21T06:23:30.786 INFO:teuthology.orchestra.run.smithi144.stdout:(29/157): ceph-grafana-dashboards-19.3.0-5120.g 688 kB/s | 34 kB 00:00 2024-09-21T06:23:30.803 INFO:teuthology.orchestra.run.smithi144.stdout:(30/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 3.6 MB/s | 154 kB 00:00 2024-09-21T06:23:30.870 INFO:teuthology.orchestra.run.smithi144.stdout:(31/157): rbd-mirror-19.3.0-5120.g18432218.el9. 6.0 MB/s | 3.1 MB 00:00 2024-09-21T06:23:30.937 INFO:teuthology.orchestra.run.smithi144.stdout:(32/157): ceph-mgr-modules-core-19.3.0-5120.g18 4.3 MB/s | 292 kB 00:00 2024-09-21T06:23:31.004 INFO:teuthology.orchestra.run.smithi144.stdout:(33/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 741 kB/s | 49 kB 00:00 2024-09-21T06:23:31.049 INFO:teuthology.orchestra.run.smithi007.stdout:(40/157): ceph-test-19.3.0-5120.g18432218.el9.x 12 MB/s | 40 MB 00:03 2024-09-21T06:23:31.055 INFO:teuthology.orchestra.run.smithi144.stdout:(34/157): ceph-prometheus-alerts-19.3.0-5120.g1 330 kB/s | 16 kB 00:00 2024-09-21T06:23:31.074 INFO:teuthology.orchestra.run.smithi007.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 425 kB/s | 191 kB 00:00 2024-09-21T06:23:31.108 INFO:teuthology.orchestra.run.smithi007.stdout:(42/157): libgfortran-11.5.0-2.el9.x86_64.rpm 1.2 MB/s | 801 kB 00:00 2024-09-21T06:23:31.121 INFO:teuthology.orchestra.run.smithi144.stdout:(35/157): ceph-volume-19.3.0-5120.g18432218.el9 4.2 MB/s | 285 kB 00:00 2024-09-21T06:23:31.183 INFO:teuthology.orchestra.run.smithi007.stdout:(43/157): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 106 kB 00:00 2024-09-21T06:23:31.239 INFO:teuthology.orchestra.run.smithi144.stdout:(36/157): cephadm-19.3.0-5120.g18432218.el9.noa 6.6 MB/s | 784 kB 00:00 2024-09-21T06:23:31.250 INFO:teuthology.orchestra.run.smithi007.stdout:(44/157): python3-pycparser-2.20-6.el9.noarch.r 2.0 MB/s | 135 kB 00:00 2024-09-21T06:23:31.284 INFO:teuthology.orchestra.run.smithi007.stdout:(45/157): python3-cryptography-36.0.1-4.el9.x86 5.9 MB/s | 1.2 MB 00:00 2024-09-21T06:23:31.309 INFO:teuthology.orchestra.run.smithi007.stdout:(46/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 975 kB/s | 253 kB 00:00 2024-09-21T06:23:31.334 INFO:teuthology.orchestra.run.smithi007.stdout:(47/157): python3-requests-2.25.1-8.el9.noarch. 1.5 MB/s | 125 kB 00:00 2024-09-21T06:23:31.389 INFO:teuthology.orchestra.run.smithi144.stdout:(37/157): ceph-mgr-dashboard-19.3.0-5120.g18432 24 MB/s | 14 MB 00:00 2024-09-21T06:23:31.423 INFO:teuthology.orchestra.run.smithi144.stdout:(38/157): cephfs-top-19.3.0-5120.g18432218.el9. 100 kB/s | 18 kB 00:00 2024-09-21T06:23:31.452 INFO:teuthology.orchestra.run.smithi007.stdout:(48/157): python3-urllib3-1.26.5-6.el9.noarch.r 1.3 MB/s | 215 kB 00:00 2024-09-21T06:23:31.510 INFO:teuthology.orchestra.run.smithi007.stdout:(49/157): bison-3.7.4-5.el9.x86_64.rpm 5.3 MB/s | 943 kB 00:00 2024-09-21T06:23:31.544 INFO:teuthology.orchestra.run.smithi007.stdout:(50/157): automake-1.16.2-8.el9.noarch.rpm 2.9 MB/s | 689 kB 00:00 2024-09-21T06:23:31.560 INFO:teuthology.orchestra.run.smithi007.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 432 kB/s | 22 kB 00:00 2024-09-21T06:23:31.586 INFO:teuthology.orchestra.run.smithi007.stdout:(52/157): boost-program-options-1.75.0-8.el9.x8 797 kB/s | 107 kB 00:00 2024-09-21T06:23:31.592 INFO:teuthology.orchestra.run.smithi144.stdout:(39/157): ceph-mgr-diskprediction-local-19.3.0- 9.4 MB/s | 7.4 MB 00:00 2024-09-21T06:23:31.611 INFO:teuthology.orchestra.run.smithi007.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 649 kB/s | 33 kB 00:00 2024-09-21T06:23:31.617 INFO:teuthology.orchestra.run.smithi144.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 351 kB/s | 80 kB 00:00 2024-09-21T06:23:31.653 INFO:teuthology.orchestra.run.smithi007.stdout:(54/157): flex-2.6.4-9.el9.x86_64.rpm 2.8 MB/s | 313 kB 00:00 2024-09-21T06:23:31.667 INFO:teuthology.orchestra.run.smithi144.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 2.5 MB/s | 191 kB 00:00 2024-09-21T06:23:31.678 INFO:teuthology.orchestra.run.smithi007.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 272 kB/s | 18 kB 00:00 2024-09-21T06:23:31.692 INFO:teuthology.orchestra.run.smithi144.stdout:(42/157): libgfortran-11.5.0-2.el9.x86_64.rpm 2.9 MB/s | 801 kB 00:00 2024-09-21T06:23:31.703 INFO:teuthology.orchestra.run.smithi007.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-21T06:23:31.729 INFO:teuthology.orchestra.run.smithi007.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 3.3 MB/s | 171 kB 00:00 2024-09-21T06:23:31.734 INFO:teuthology.orchestra.run.smithi144.stdout:(43/157): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-09-21T06:23:31.763 INFO:teuthology.orchestra.run.smithi007.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-09-21T06:23:31.768 INFO:teuthology.orchestra.run.smithi144.stdout:(44/157): python3-cryptography-36.0.1-4.el9.x86 12 MB/s | 1.2 MB 00:00 2024-09-21T06:23:31.788 INFO:teuthology.orchestra.run.smithi007.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 772 kB/s | 45 kB 00:00 2024-09-21T06:23:31.793 INFO:teuthology.orchestra.run.smithi144.stdout:(45/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.4 MB/s | 253 kB 00:00 2024-09-21T06:23:31.818 INFO:teuthology.orchestra.run.smithi144.stdout:(46/157): python3-pycparser-2.20-6.el9.noarch.r 1.6 MB/s | 135 kB 00:00 2024-09-21T06:23:31.844 INFO:teuthology.orchestra.run.smithi144.stdout:(47/157): python3-requests-2.25.1-8.el9.noarch. 1.6 MB/s | 125 kB 00:00 2024-09-21T06:23:31.847 INFO:teuthology.orchestra.run.smithi007.stdout:(60/157): libtool-2.4.6-46.el9.x86_64.rpm 9.7 MB/s | 581 kB 00:00 2024-09-21T06:23:31.869 INFO:teuthology.orchestra.run.smithi144.stdout:(48/157): python3-urllib3-1.26.5-6.el9.noarch.r 2.8 MB/s | 215 kB 00:00 2024-09-21T06:23:31.897 INFO:teuthology.orchestra.run.smithi007.stdout:(61/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 491 kB/s | 24 kB 00:00 2024-09-21T06:23:31.947 INFO:teuthology.orchestra.run.smithi007.stdout:(62/157): librdkafka-1.6.1-102.el9.x86_64.rpm 3.5 MB/s | 662 kB 00:00 2024-09-21T06:23:31.972 INFO:teuthology.orchestra.run.smithi007.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 629 kB/s | 47 kB 00:00 2024-09-21T06:23:32.031 INFO:teuthology.orchestra.run.smithi007.stdout:(64/157): lua-5.4.4-4.el9.x86_64.rpm 3.2 MB/s | 188 kB 00:00 2024-09-21T06:23:32.036 INFO:teuthology.orchestra.run.smithi144.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 642 kB/s | 107 kB 00:00 2024-09-21T06:23:32.056 INFO:teuthology.orchestra.run.smithi007.stdout:(65/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.6 MB/s | 292 kB 00:00 2024-09-21T06:23:32.082 INFO:teuthology.orchestra.run.smithi007.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 764 kB/s | 38 kB 00:00 2024-09-21T06:23:32.086 INFO:teuthology.orchestra.run.smithi144.stdout:(50/157): elfutils-libelf-devel-0.191-4.el9.x86 434 kB/s | 22 kB 00:00 2024-09-21T06:23:32.119 INFO:teuthology.orchestra.run.smithi144.stdout:(51/157): bison-3.7.4-5.el9.x86_64.rpm 3.3 MB/s | 943 kB 00:00 2024-09-21T06:23:32.145 INFO:teuthology.orchestra.run.smithi144.stdout:(52/157): automake-1.16.2-8.el9.noarch.rpm 2.2 MB/s | 689 kB 00:00 2024-09-21T06:23:32.170 INFO:teuthology.orchestra.run.smithi144.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 649 kB/s | 33 kB 00:00 2024-09-21T06:23:32.195 INFO:teuthology.orchestra.run.smithi144.stdout:(54/157): flex-2.6.4-9.el9.x86_64.rpm 2.8 MB/s | 313 kB 00:00 2024-09-21T06:23:32.221 INFO:teuthology.orchestra.run.smithi144.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 363 kB/s | 18 kB 00:00 2024-09-21T06:23:32.246 INFO:teuthology.orchestra.run.smithi144.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-21T06:23:32.271 INFO:teuthology.orchestra.run.smithi144.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 3.3 MB/s | 171 kB 00:00 2024-09-21T06:23:32.296 INFO:teuthology.orchestra.run.smithi144.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-09-21T06:23:32.322 INFO:teuthology.orchestra.run.smithi144.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 899 kB/s | 45 kB 00:00 2024-09-21T06:23:32.348 INFO:teuthology.orchestra.run.smithi018.stdout:(82/157): postgresql-server-13.16-1.el9.x86_64. 2.1 MB/s | 5.8 MB 00:02 2024-09-21T06:23:32.372 INFO:teuthology.orchestra.run.smithi144.stdout:(60/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 13 MB/s | 3.0 MB 00:00 2024-09-21T06:23:32.414 INFO:teuthology.orchestra.run.smithi144.stdout:(61/157): libtool-2.4.6-46.el9.x86_64.rpm 6.2 MB/s | 581 kB 00:00 2024-09-21T06:23:32.431 INFO:teuthology.orchestra.run.smithi144.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 419 kB/s | 24 kB 00:00 2024-09-21T06:23:32.456 INFO:teuthology.orchestra.run.smithi144.stdout:(63/157): librdkafka-1.6.1-102.el9.x86_64.rpm 4.1 MB/s | 662 kB 00:00 2024-09-21T06:23:32.473 INFO:teuthology.orchestra.run.smithi144.stdout:(64/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 805 kB/s | 47 kB 00:00 2024-09-21T06:23:32.499 INFO:teuthology.orchestra.run.smithi018.stdout:(83/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.6 MB/s | 250 kB 00:00 2024-09-21T06:23:32.499 INFO:teuthology.orchestra.run.smithi144.stdout:(65/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.3 MB/s | 292 kB 00:00 2024-09-21T06:23:32.523 INFO:teuthology.orchestra.run.smithi007.stdout:(67/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 10 MB/s | 4.4 MB 00:00 2024-09-21T06:23:32.524 INFO:teuthology.orchestra.run.smithi144.stdout:(66/157): lua-5.4.4-4.el9.x86_64.rpm 2.7 MB/s | 188 kB 00:00 2024-09-21T06:23:32.549 INFO:teuthology.orchestra.run.smithi144.stdout:(67/157): openblas-0.3.26-2.el9.x86_64.rpm 508 kB/s | 38 kB 00:00 2024-09-21T06:23:32.607 INFO:teuthology.orchestra.run.smithi018.stdout:(84/157): python3-babel-2.9.1-2.el9.noarch.rpm 2.2 MB/s | 6.0 MB 00:02 2024-09-21T06:23:32.657 INFO:teuthology.orchestra.run.smithi018.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 1.4 MB/s | 222 kB 00:00 2024-09-21T06:23:32.691 INFO:teuthology.orchestra.run.smithi144.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-09-21T06:23:32.716 INFO:teuthology.orchestra.run.smithi018.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 710 kB/s | 77 kB 00:00 2024-09-21T06:23:32.724 INFO:teuthology.orchestra.run.smithi007.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 7.9 MB/s | 1.6 MB 00:00 2024-09-21T06:23:32.741 INFO:teuthology.orchestra.run.smithi018.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 505 kB/s | 42 kB 00:00 2024-09-21T06:23:32.791 INFO:teuthology.orchestra.run.smithi144.stdout:(69/157): openblas-openmp-0.3.26-2.el9.x86_64.r 17 MB/s | 4.9 MB 00:00 2024-09-21T06:23:32.834 INFO:teuthology.orchestra.run.smithi144.stdout:(70/157): postgresql-contrib-13.16-1.el9.x86_64 6.3 MB/s | 910 kB 00:00 2024-09-21T06:23:32.849 INFO:teuthology.orchestra.run.smithi007.stdout:(69/157): postgresql-contrib-13.16-1.el9.x86_64 7.1 MB/s | 910 kB 00:00 2024-09-21T06:23:32.850 INFO:teuthology.orchestra.run.smithi018.stdout:(88/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 159 kB 00:00 2024-09-21T06:23:32.859 INFO:teuthology.orchestra.run.smithi144.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 2.0 MB/s | 137 kB 00:00 2024-09-21T06:23:32.908 INFO:teuthology.orchestra.run.smithi007.stdout:(70/157): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-21T06:23:32.909 INFO:teuthology.orchestra.run.smithi018.stdout:(89/157): python3-protobuf-3.14.0-13.el9.noarch 1.4 MB/s | 269 kB 00:00 2024-09-21T06:23:32.942 INFO:teuthology.orchestra.run.smithi144.stdout:(72/157): protobuf-3.14.0-13.el9.x86_64.rpm 12 MB/s | 1.0 MB 00:00 2024-09-21T06:23:32.967 INFO:teuthology.orchestra.run.smithi018.stdout:(90/157): python3-pytz-2021.1-5.el9.noarch.rpm 877 kB/s | 51 kB 00:00 2024-09-21T06:23:33.009 INFO:teuthology.orchestra.run.smithi144.stdout:(73/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 9.1 MB/s | 4.4 MB 00:00 2024-09-21T06:23:33.026 INFO:teuthology.orchestra.run.smithi018.stdout:(91/157): python3-requests-oauthlib-1.3.0-12.el 917 kB/s | 54 kB 00:00 2024-09-21T06:23:33.034 INFO:teuthology.orchestra.run.smithi144.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 951 kB/s | 87 kB 00:00 2024-09-21T06:23:33.051 INFO:teuthology.orchestra.run.smithi018.stdout:(92/157): python3-pyasn1-modules-0.4.8-6.el9.no 1.4 MB/s | 279 kB 00:00 2024-09-21T06:23:33.093 INFO:teuthology.orchestra.run.smithi144.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 1.0 MB/s | 61 kB 00:00 2024-09-21T06:23:33.110 INFO:teuthology.orchestra.run.smithi018.stdout:(93/157): python3-toml-0.10.2-6.el9.noarch.rpm 713 kB/s | 42 kB 00:00 2024-09-21T06:23:33.168 INFO:teuthology.orchestra.run.smithi018.stdout:(94/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 759 kB/s | 44 kB 00:00 2024-09-21T06:23:33.177 INFO:teuthology.orchestra.run.smithi144.stdout:(76/157): postgresql-server-13.16-1.el9.x86_64. 17 MB/s | 5.8 MB 00:00 2024-09-21T06:23:33.216 INFO:teuthology.orchestra.run.smithi007.stdout:(71/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 1.8 MB/s | 3.0 MB 00:01 2024-09-21T06:23:33.310 INFO:teuthology.orchestra.run.smithi018.stdout:(95/157): qatlib-24.02.0-1.el9.x86_64.rpm 1.5 MB/s | 221 kB 00:00 2024-09-21T06:23:33.352 INFO:teuthology.orchestra.run.smithi144.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 946 kB/s | 245 kB 00:00 2024-09-21T06:23:33.360 INFO:teuthology.orchestra.run.smithi018.stdout:(96/157): qatlib-service-24.02.0-1.el9.x86_64.r 717 kB/s | 36 kB 00:00 2024-09-21T06:23:33.417 INFO:teuthology.orchestra.run.smithi007.stdout:(72/157): openblas-openmp-0.3.26-2.el9.x86_64.r 3.6 MB/s | 4.9 MB 00:01 2024-09-21T06:23:33.427 INFO:teuthology.orchestra.run.smithi144.stdout:(78/157): python3-babel-2.9.1-2.el9.noarch.rpm 14 MB/s | 6.0 MB 00:00 2024-09-21T06:23:33.436 INFO:teuthology.orchestra.run.smithi018.stdout:(97/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 1.9 MB/s | 5.1 MB 00:02 2024-09-21T06:23:33.452 INFO:teuthology.orchestra.run.smithi144.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 255 kB/s | 26 kB 00:00 2024-09-21T06:23:33.461 INFO:teuthology.orchestra.run.smithi018.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 474 kB/s | 47 kB 00:00 2024-09-21T06:23:33.467 INFO:teuthology.orchestra.run.smithi007.stdout:(73/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.7 MB/s | 87 kB 00:00 2024-09-21T06:23:33.511 INFO:teuthology.orchestra.run.smithi144.stdout:(80/157): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-21T06:23:33.511 INFO:teuthology.orchestra.run.smithi018.stdout:(99/157): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-21T06:23:33.601 INFO:teuthology.orchestra.run.smithi007.stdout:(74/157): postgresql-server-13.16-1.el9.x86_64. 8.3 MB/s | 5.8 MB 00:00 2024-09-21T06:23:33.603 INFO:teuthology.orchestra.run.smithi018.stdout:(100/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.0 MB/s | 96 kB 00:00 2024-09-21T06:23:33.628 INFO:teuthology.orchestra.run.smithi018.stdout:(101/157): socat-1.7.4.1-6.el9.x86_64.rpm 1.5 MB/s | 304 kB 00:00 2024-09-21T06:23:33.651 INFO:teuthology.orchestra.run.smithi007.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 1.2 MB/s | 61 kB 00:00 2024-09-21T06:23:33.679 INFO:teuthology.orchestra.run.smithi018.stdout:(102/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 893 kB/s | 45 kB 00:00 2024-09-21T06:23:33.704 INFO:teuthology.orchestra.run.smithi018.stdout:(103/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 634 kB/s | 64 kB 00:00 2024-09-21T06:23:33.710 INFO:teuthology.orchestra.run.smithi007.stdout:(76/157): python3-devel-3.9.19-8.el9.x86_64.rpm 4.1 MB/s | 245 kB 00:00 2024-09-21T06:23:33.768 INFO:teuthology.orchestra.run.smithi007.stdout:(77/157): python3-jinja2-2.11.3-6.el9.noarch.rp 4.2 MB/s | 248 kB 00:00 2024-09-21T06:23:33.827 INFO:teuthology.orchestra.run.smithi007.stdout:(78/157): python3-jsonpatch-1.21-16.el9.noarch. 441 kB/s | 26 kB 00:00 2024-09-21T06:23:33.860 INFO:teuthology.orchestra.run.smithi007.stdout:(79/157): protobuf-3.14.0-13.el9.x86_64.rpm 1.6 MB/s | 1.0 MB 00:00 2024-09-21T06:23:33.886 INFO:teuthology.orchestra.run.smithi007.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 327 kB/s | 19 kB 00:00 2024-09-21T06:23:33.936 INFO:teuthology.orchestra.run.smithi007.stdout:(81/157): python3-markupsafe-1.1.1-12.el9.x86_6 694 kB/s | 35 kB 00:00 2024-09-21T06:23:33.986 INFO:teuthology.orchestra.run.smithi007.stdout:(82/157): python3-mako-1.1.4-6.el9.noarch.rpm 1.3 MB/s | 172 kB 00:00 2024-09-21T06:23:34.136 INFO:teuthology.orchestra.run.smithi007.stdout:(83/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.6 MB/s | 250 kB 00:00 2024-09-21T06:23:34.238 INFO:teuthology.orchestra.run.smithi018.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 40 kB/s | 22 kB 00:00 2024-09-21T06:23:34.287 INFO:teuthology.orchestra.run.smithi007.stdout:(84/157): python3-oauthlib-3.1.1-5.el9.noarch.r 1.4 MB/s | 222 kB 00:00 2024-09-21T06:23:34.288 INFO:teuthology.orchestra.run.smithi018.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-21T06:23:34.321 INFO:teuthology.orchestra.run.smithi018.stdout:(106/157): gperftools-libs-2.9.1-3.el9.x86_64.r 9.1 MB/s | 308 kB 00:00 2024-09-21T06:23:34.347 INFO:teuthology.orchestra.run.smithi018.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 781 kB/s | 19 kB 00:00 2024-09-21T06:23:34.379 INFO:teuthology.orchestra.run.smithi007.stdout:(85/157): python3-packaging-20.9-5.el9.noarch.r 843 kB/s | 77 kB 00:00 2024-09-21T06:23:34.456 INFO:teuthology.orchestra.run.smithi018.stdout:(108/157): libarrow-9.0.0-11.el9.x86_64.rpm 41 MB/s | 4.4 MB 00:00 2024-09-21T06:23:34.479 INFO:teuthology.orchestra.run.smithi007.stdout:(86/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 9.4 MB/s | 5.1 MB 00:00 2024-09-21T06:23:34.480 INFO:teuthology.orchestra.run.smithi018.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-21T06:23:34.496 INFO:teuthology.orchestra.run.smithi007.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 361 kB/s | 42 kB 00:00 2024-09-21T06:23:34.506 INFO:teuthology.orchestra.run.smithi018.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-21T06:23:34.531 INFO:teuthology.orchestra.run.smithi018.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-21T06:23:34.538 INFO:teuthology.orchestra.run.smithi007.stdout:(88/157): python3-protobuf-3.14.0-13.el9.noarch 4.5 MB/s | 269 kB 00:00 2024-09-21T06:23:34.557 INFO:teuthology.orchestra.run.smithi018.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 6.0 MB/s | 151 kB 00:00 2024-09-21T06:23:34.561 INFO:teuthology.orchestra.run.smithi144.stdout:(81/157): python3-markupsafe-1.1.1-12.el9.x86_6 33 kB/s | 35 kB 00:01 2024-09-21T06:23:34.590 INFO:teuthology.orchestra.run.smithi018.stdout:(113/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 25 MB/s | 839 kB 00:00 2024-09-21T06:23:34.596 INFO:teuthology.orchestra.run.smithi007.stdout:(89/157): python3-pyasn1-modules-0.4.8-6.el9.no 4.7 MB/s | 279 kB 00:00 2024-09-21T06:23:34.622 INFO:teuthology.orchestra.run.smithi007.stdout:(90/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.2 MB/s | 159 kB 00:00 2024-09-21T06:23:34.624 INFO:teuthology.orchestra.run.smithi018.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 16 MB/s | 548 kB 00:00 2024-09-21T06:23:34.641 INFO:teuthology.orchestra.run.smithi018.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.6 MB/s | 43 kB 00:00 2024-09-21T06:23:34.647 INFO:teuthology.orchestra.run.smithi007.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-21T06:23:34.658 INFO:teuthology.orchestra.run.smithi018.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.9 MB/s | 32 kB 00:00 2024-09-21T06:23:34.672 INFO:teuthology.orchestra.run.smithi007.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-21T06:23:34.683 INFO:teuthology.orchestra.run.smithi018.stdout:(117/157): python3-certifi-2023.05.07-4.el9.noa 567 kB/s | 14 kB 00:00 2024-09-21T06:23:34.717 INFO:teuthology.orchestra.run.smithi018.stdout:(118/157): python3-cheroot-8.6.0-4.el9.noarch.r 5.0 MB/s | 172 kB 00:00 2024-09-21T06:23:34.723 INFO:teuthology.orchestra.run.smithi007.stdout:(93/157): python3-toml-0.10.2-6.el9.noarch.rpm 834 kB/s | 42 kB 00:00 2024-09-21T06:23:34.751 INFO:teuthology.orchestra.run.smithi018.stdout:(119/157): python3-cherrypy-18.6.1-2.el9.noarch 11 MB/s | 358 kB 00:00 2024-09-21T06:23:34.781 INFO:teuthology.orchestra.run.smithi007.stdout:(94/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 758 kB/s | 44 kB 00:00 2024-09-21T06:23:34.784 INFO:teuthology.orchestra.run.smithi018.stdout:(120/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 8.9 MB/s | 303 kB 00:00 2024-09-21T06:23:34.818 INFO:teuthology.orchestra.run.smithi018.stdout:(121/157): protobuf-compiler-3.14.0-13.el9.x86_ 775 kB/s | 863 kB 00:01 2024-09-21T06:23:34.851 INFO:teuthology.orchestra.run.smithi018.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 3.2 MB/s | 220 kB 00:00 2024-09-21T06:23:34.877 INFO:teuthology.orchestra.run.smithi018.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 6.2 MB/s | 144 kB 00:00 2024-09-21T06:23:34.902 INFO:teuthology.orchestra.run.smithi018.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 430 kB/s | 11 kB 00:00 2024-09-21T06:23:34.920 INFO:teuthology.orchestra.run.smithi007.stdout:(95/157): python3-babel-2.9.1-2.el9.noarch.rpm 4.1 MB/s | 6.0 MB 00:01 2024-09-21T06:23:34.927 INFO:teuthology.orchestra.run.smithi018.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 703 kB/s | 18 kB 00:00 2024-09-21T06:23:34.952 INFO:teuthology.orchestra.run.smithi018.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 933 kB/s | 23 kB 00:00 2024-09-21T06:23:34.978 INFO:teuthology.orchestra.run.smithi018.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 777 kB/s | 19 kB 00:00 2024-09-21T06:23:34.982 INFO:teuthology.orchestra.run.smithi007.stdout:(96/157): qatlib-service-24.02.0-1.el9.x86_64.r 580 kB/s | 36 kB 00:00 2024-09-21T06:23:35.003 INFO:teuthology.orchestra.run.smithi018.stdout:(128/157): python3-jaraco-text-3.2.0-6.el9.noar 792 kB/s | 20 kB 00:00 2024-09-21T06:23:35.007 INFO:teuthology.orchestra.run.smithi007.stdout:(97/157): qatlib-24.02.0-1.el9.x86_64.rpm 978 kB/s | 221 kB 00:00 2024-09-21T06:23:35.041 INFO:teuthology.orchestra.run.smithi007.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 808 kB/s | 47 kB 00:00 2024-09-21T06:23:35.087 INFO:teuthology.orchestra.run.smithi018.stdout:(129/157): python3-kubernetes-26.1.0-2.el9.noar 12 MB/s | 1.0 MB 00:00 2024-09-21T06:23:35.099 INFO:teuthology.orchestra.run.smithi007.stdout:(99/157): uuid-1.6.2-55.el9.x86_64.rpm 996 kB/s | 58 kB 00:00 2024-09-21T06:23:35.112 INFO:teuthology.orchestra.run.smithi018.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-21T06:23:35.137 INFO:teuthology.orchestra.run.smithi018.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-21T06:23:35.158 INFO:teuthology.orchestra.run.smithi007.stdout:(100/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.6 MB/s | 96 kB 00:00 2024-09-21T06:23:35.163 INFO:teuthology.orchestra.run.smithi018.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-21T06:23:35.192 INFO:teuthology.orchestra.run.smithi007.stdout:(101/157): socat-1.7.4.1-6.el9.x86_64.rpm 1.6 MB/s | 304 kB 00:00 2024-09-21T06:23:35.196 INFO:teuthology.orchestra.run.smithi018.stdout:(133/157): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-21T06:23:35.217 INFO:teuthology.orchestra.run.smithi007.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-09-21T06:23:35.222 INFO:teuthology.orchestra.run.smithi018.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 660 kB/s | 16 kB 00:00 2024-09-21T06:23:35.243 INFO:teuthology.orchestra.run.smithi007.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 890 kB/s | 45 kB 00:00 2024-09-21T06:23:35.247 INFO:teuthology.orchestra.run.smithi018.stdout:(135/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-21T06:23:35.289 INFO:teuthology.orchestra.run.smithi018.stdout:(136/157): python3-grpcio-1.46.7-10.el9.x86_64. 4.3 MB/s | 2.0 MB 00:00 2024-09-21T06:23:35.315 INFO:teuthology.orchestra.run.smithi018.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 421 kB/s | 28 kB 00:00 2024-09-21T06:23:35.340 INFO:teuthology.orchestra.run.smithi018.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 610 kB/s | 31 kB 00:00 2024-09-21T06:23:35.345 INFO:teuthology.orchestra.run.smithi144.stdout:(82/157): python3-jinja2-2.11.3-6.el9.noarch.rp 114 kB/s | 248 kB 00:02 2024-09-21T06:23:35.365 INFO:teuthology.orchestra.run.smithi018.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-21T06:23:35.378 INFO:teuthology.orchestra.run.smithi144.stdout:(83/157): python3-jsonpointer-2.0-4.el9.noarch. 9.8 kB/s | 19 kB 00:01 2024-09-21T06:23:35.390 INFO:teuthology.orchestra.run.smithi018.stdout:(140/157): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-21T06:23:35.415 INFO:teuthology.orchestra.run.smithi018.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 712 kB/s | 36 kB 00:00 2024-09-21T06:23:35.428 INFO:teuthology.orchestra.run.smithi144.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.9 MB/s | 250 kB 00:00 2024-09-21T06:23:35.441 INFO:teuthology.orchestra.run.smithi018.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-21T06:23:35.458 INFO:teuthology.orchestra.run.smithi018.stdout:(143/157): python3-websocket-client-1.2.3-2.el9 5.3 MB/s | 90 kB 00:00 2024-09-21T06:23:35.483 INFO:teuthology.orchestra.run.smithi018.stdout:(144/157): python3-webob-1.8.8-2.el9.noarch.rpm 3.4 MB/s | 230 kB 00:00 2024-09-21T06:23:35.487 INFO:teuthology.orchestra.run.smithi144.stdout:(85/157): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-21T06:23:35.501 INFO:teuthology.orchestra.run.smithi007.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 79 kB/s | 22 kB 00:00 2024-09-21T06:23:35.509 INFO:teuthology.orchestra.run.smithi018.stdout:(145/157): python3-zc-lockfile-2.0-10.el9.noarc 787 kB/s | 20 kB 00:00 2024-09-21T06:23:35.512 INFO:teuthology.orchestra.run.smithi144.stdout:(86/157): python3-oauthlib-3.1.1-5.el9.noarch.r 1.6 MB/s | 222 kB 00:00 2024-09-21T06:23:35.534 INFO:teuthology.orchestra.run.smithi018.stdout:(146/157): python3-werkzeug-2.0.3-3.el9.1.noarc 5.5 MB/s | 427 kB 00:00 2024-09-21T06:23:35.538 INFO:teuthology.orchestra.run.smithi144.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 841 kB/s | 42 kB 00:00 2024-09-21T06:23:35.559 INFO:teuthology.orchestra.run.smithi018.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-21T06:23:35.560 INFO:teuthology.orchestra.run.smithi007.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-21T06:23:35.593 INFO:teuthology.orchestra.run.smithi007.stdout:(106/157): gperftools-libs-2.9.1-3.el9.x86_64.r 9.0 MB/s | 308 kB 00:00 2024-09-21T06:23:35.596 INFO:teuthology.orchestra.run.smithi144.stdout:(88/157): python3-protobuf-3.14.0-13.el9.noarch 3.1 MB/s | 269 kB 00:00 2024-09-21T06:23:35.610 INFO:teuthology.orchestra.run.smithi007.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 1.1 MB/s | 19 kB 00:00 2024-09-21T06:23:35.618 INFO:teuthology.orchestra.run.smithi018.stdout:(148/157): thrift-0.15.0-2.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2024-09-21T06:23:35.621 INFO:teuthology.orchestra.run.smithi144.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.9 MB/s | 159 kB 00:00 2024-09-21T06:23:35.655 INFO:teuthology.orchestra.run.smithi144.stdout:(90/157): python3-pyasn1-modules-0.4.8-6.el9.no 4.7 MB/s | 279 kB 00:00 2024-09-21T06:23:35.680 INFO:teuthology.orchestra.run.smithi144.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 871 kB/s | 51 kB 00:00 2024-09-21T06:23:35.706 INFO:teuthology.orchestra.run.smithi144.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-21T06:23:35.719 INFO:teuthology.orchestra.run.smithi007.stdout:(108/157): libarrow-9.0.0-11.el9.x86_64.rpm 41 MB/s | 4.4 MB 00:00 2024-09-21T06:23:35.736 INFO:teuthology.orchestra.run.smithi007.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.5 MB/s | 26 kB 00:00 2024-09-21T06:23:35.753 INFO:teuthology.orchestra.run.smithi007.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 2.9 MB/s | 49 kB 00:00 2024-09-21T06:23:35.756 INFO:teuthology.orchestra.run.smithi144.stdout:(93/157): python3-toml-0.10.2-6.el9.noarch.rpm 832 kB/s | 42 kB 00:00 2024-09-21T06:23:35.778 INFO:teuthology.orchestra.run.smithi007.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-21T06:23:35.803 INFO:teuthology.orchestra.run.smithi007.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-09-21T06:23:35.806 INFO:teuthology.orchestra.run.smithi144.stdout:(94/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 885 kB/s | 44 kB 00:00 2024-09-21T06:23:35.810 INFO:teuthology.orchestra.run.smithi018.stdout:(149/157): librados2-19.3.0-5120.g18432218.el9. 14 MB/s | 3.4 MB 00:00 2024-09-21T06:23:35.837 INFO:teuthology.orchestra.run.smithi007.stdout:(113/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 25 MB/s | 839 kB 00:00 2024-09-21T06:23:35.865 INFO:teuthology.orchestra.run.smithi144.stdout:(95/157): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-21T06:23:35.871 INFO:teuthology.orchestra.run.smithi007.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 16 MB/s | 548 kB 00:00 2024-09-21T06:23:35.894 INFO:teuthology.orchestra.run.smithi018.stdout:(150/157): librbd1-19.3.0-5120.g18432218.el9.x8 12 MB/s | 3.2 MB 00:00 2024-09-21T06:23:35.896 INFO:teuthology.orchestra.run.smithi007.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-21T06:23:35.915 INFO:teuthology.orchestra.run.smithi144.stdout:(96/157): qatlib-service-24.02.0-1.el9.x86_64.r 717 kB/s | 36 kB 00:00 2024-09-21T06:23:35.921 INFO:teuthology.orchestra.run.smithi007.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-21T06:23:35.946 INFO:teuthology.orchestra.run.smithi007.stdout:(117/157): python3-certifi-2023.05.07-4.el9.noa 567 kB/s | 14 kB 00:00 2024-09-21T06:23:35.966 INFO:teuthology.orchestra.run.smithi144.stdout:(97/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 946 kB/s | 47 kB 00:00 2024-09-21T06:23:35.972 INFO:teuthology.orchestra.run.smithi007.stdout:(118/157): python3-cheroot-8.6.0-4.el9.noarch.r 6.7 MB/s | 172 kB 00:00 2024-09-21T06:23:36.014 INFO:teuthology.orchestra.run.smithi007.stdout:(119/157): python3-cherrypy-18.6.1-2.el9.noarch 8.4 MB/s | 358 kB 00:00 2024-09-21T06:23:36.024 INFO:teuthology.orchestra.run.smithi144.stdout:(98/157): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-09-21T06:23:36.047 INFO:teuthology.orchestra.run.smithi007.stdout:(120/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 8.9 MB/s | 303 kB 00:00 2024-09-21T06:23:36.073 INFO:teuthology.orchestra.run.smithi007.stdout:(121/157): protobuf-compiler-3.14.0-13.el9.x86_ 1.0 MB/s | 863 kB 00:00 2024-09-21T06:23:36.074 INFO:teuthology.orchestra.run.smithi144.stdout:(99/157): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-21T06:23:36.098 INFO:teuthology.orchestra.run.smithi007.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-21T06:23:36.123 INFO:teuthology.orchestra.run.smithi007.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 8.5 MB/s | 144 kB 00:00 2024-09-21T06:23:36.149 INFO:teuthology.orchestra.run.smithi007.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 465 kB/s | 11 kB 00:00 2024-09-21T06:23:36.174 INFO:teuthology.orchestra.run.smithi007.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 714 kB/s | 18 kB 00:00 2024-09-21T06:23:36.199 INFO:teuthology.orchestra.run.smithi007.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 923 kB/s | 23 kB 00:00 2024-09-21T06:23:36.225 INFO:teuthology.orchestra.run.smithi007.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 780 kB/s | 19 kB 00:00 2024-09-21T06:23:36.250 INFO:teuthology.orchestra.run.smithi007.stdout:(128/157): python3-jaraco-text-3.2.0-6.el9.noar 791 kB/s | 20 kB 00:00 2024-09-21T06:23:36.309 INFO:teuthology.orchestra.run.smithi007.stdout:(129/157): python3-kubernetes-26.1.0-2.el9.noar 17 MB/s | 1.0 MB 00:00 2024-09-21T06:23:36.468 INFO:teuthology.orchestra.run.smithi007.stdout:(130/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 8.9 MB/s | 16 MB 00:01 2024-09-21T06:23:36.493 INFO:teuthology.orchestra.run.smithi007.stdout:(131/157): python3-logutils-0.3.5-21.el9.noarch 252 kB/s | 46 kB 00:00 2024-09-21T06:23:36.526 INFO:teuthology.orchestra.run.smithi007.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-21T06:23:36.560 INFO:teuthology.orchestra.run.smithi007.stdout:(133/157): python3-pecan-1.4.2-3.el9.noarch.rpm 8.5 MB/s | 272 kB 00:00 2024-09-21T06:23:36.585 INFO:teuthology.orchestra.run.smithi007.stdout:(134/157): python3-more-itertools-8.12.0-2.el9. 673 kB/s | 79 kB 00:00 2024-09-21T06:23:36.610 INFO:teuthology.orchestra.run.smithi007.stdout:(135/157): python3-portend-3.1.0-2.el9.noarch.r 327 kB/s | 16 kB 00:00 2024-09-21T06:23:36.636 INFO:teuthology.orchestra.run.smithi007.stdout:(136/157): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-21T06:23:36.653 INFO:teuthology.orchestra.run.smithi007.stdout:(137/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.3 MB/s | 90 kB 00:00 2024-09-21T06:23:36.678 INFO:teuthology.orchestra.run.smithi007.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 733 kB/s | 31 kB 00:00 2024-09-21T06:23:36.703 INFO:teuthology.orchestra.run.smithi007.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-21T06:23:36.745 INFO:teuthology.orchestra.run.smithi007.stdout:(140/157): python3-grpcio-1.46.7-10.el9.x86_64. 3.0 MB/s | 2.0 MB 00:00 2024-09-21T06:23:36.770 INFO:teuthology.orchestra.run.smithi007.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 534 kB/s | 36 kB 00:00 2024-09-21T06:23:36.796 INFO:teuthology.orchestra.run.smithi007.stdout:(142/157): python3-routes-2.5.1-5.el9.noarch.rp 1.3 MB/s | 188 kB 00:00 2024-09-21T06:23:36.821 INFO:teuthology.orchestra.run.smithi007.stdout:(143/157): python3-typing-extensions-4.12.2-2.e 986 kB/s | 74 kB 00:00 2024-09-21T06:23:36.846 INFO:teuthology.orchestra.run.smithi007.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-21T06:23:36.872 INFO:teuthology.orchestra.run.smithi007.stdout:(145/157): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-21T06:23:36.888 INFO:teuthology.orchestra.run.smithi007.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 480 kB/s | 20 kB 00:00 2024-09-21T06:23:36.922 INFO:teuthology.orchestra.run.smithi007.stdout:(147/157): python3-werkzeug-2.0.3-3.el9.1.noarc 4.1 MB/s | 427 kB 00:00 2024-09-21T06:23:36.947 INFO:teuthology.orchestra.run.smithi007.stdout:(148/157): re2-20211101-20.el9.x86_64.rpm 2.5 MB/s | 191 kB 00:00 2024-09-21T06:23:36.998 INFO:teuthology.orchestra.run.smithi007.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-21T06:23:37.215 INFO:teuthology.orchestra.run.smithi007.stdout:(150/157): librbd1-19.3.0-5120.g18432218.el9.x8 12 MB/s | 3.2 MB 00:00 2024-09-21T06:23:37.298 INFO:teuthology.orchestra.run.smithi007.stdout:(151/157): librados2-19.3.0-5120.g18432218.el9. 9.0 MB/s | 3.4 MB 00:00 2024-09-21T06:23:37.357 INFO:teuthology.orchestra.run.smithi007.stdout:(152/157): NetworkManager-team-1.51.0-1.el9.x86 703 kB/s | 41 kB 00:00 2024-09-21T06:23:37.474 INFO:teuthology.orchestra.run.smithi007.stdout:(153/157): NetworkManager-tui-1.51.0-1.el9.x86_ 2.1 MB/s | 249 kB 00:00 2024-09-21T06:23:37.666 INFO:teuthology.orchestra.run.smithi007.stdout:(154/157): NetworkManager-1.51.0-1.el9.x86_64.r 3.5 MB/s | 2.3 MB 00:00 2024-09-21T06:23:37.691 INFO:teuthology.orchestra.run.smithi144.stdout:(100/157): python3-numpy-1.20.1-5.el9.x86_64.rp 1.6 MB/s | 5.1 MB 00:03 2024-09-21T06:23:37.699 INFO:teuthology.orchestra.run.smithi007.stdout:(155/157): openssl-3.2.2-6.el9.x86_64.rpm 6.0 MB/s | 1.4 MB 00:00 2024-09-21T06:23:37.791 INFO:teuthology.orchestra.run.smithi007.stdout:(156/157): NetworkManager-libnm-1.51.0-1.el9.x8 3.1 MB/s | 1.8 MB 00:00 2024-09-21T06:23:38.183 INFO:teuthology.orchestra.run.smithi144.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 45 kB/s | 96 kB 00:02 2024-09-21T06:23:38.225 INFO:teuthology.orchestra.run.smithi144.stdout:(102/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-09-21T06:23:38.308 INFO:teuthology.orchestra.run.smithi144.stdout:(103/157): lua-devel-5.4.4-4.el9.x86_64.rpm 268 kB/s | 22 kB 00:00 2024-09-21T06:23:38.443 INFO:teuthology.orchestra.run.smithi018.stdout:(151/157): NetworkManager-1.51.0-1.el9.x86_64.r 902 kB/s | 2.3 MB 00:02 2024-09-21T06:23:38.484 INFO:teuthology.orchestra.run.smithi144.stdout:(104/157): protobuf-compiler-3.14.0-13.el9.x86_ 4.8 MB/s | 863 kB 00:00 2024-09-21T06:23:38.494 INFO:teuthology.orchestra.run.smithi018.stdout:(152/157): NetworkManager-team-1.51.0-1.el9.x86 818 kB/s | 41 kB 00:00 2024-09-21T06:23:38.534 INFO:teuthology.orchestra.run.smithi144.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-21T06:23:38.559 INFO:teuthology.orchestra.run.smithi144.stdout:(106/157): gperftools-libs-2.9.1-3.el9.x86_64.r 12 MB/s | 308 kB 00:00 2024-09-21T06:23:38.576 INFO:teuthology.orchestra.run.smithi144.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 1.2 MB/s | 19 kB 00:00 2024-09-21T06:23:38.577 INFO:teuthology.orchestra.run.smithi018.stdout:(153/157): NetworkManager-tui-1.51.0-1.el9.x86_ 2.9 MB/s | 249 kB 00:00 2024-09-21T06:23:38.701 INFO:teuthology.orchestra.run.smithi144.stdout:(108/157): libarrow-9.0.0-11.el9.x86_64.rpm 35 MB/s | 4.4 MB 00:00 2024-09-21T06:23:38.727 INFO:teuthology.orchestra.run.smithi144.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-21T06:23:38.752 INFO:teuthology.orchestra.run.smithi144.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-21T06:23:38.777 INFO:teuthology.orchestra.run.smithi144.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-21T06:23:38.803 INFO:teuthology.orchestra.run.smithi144.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-09-21T06:23:38.833 INFO:teuthology.orchestra.run.smithi007.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 2.1 MB/s | 2.4 MB 00:01 2024-09-21T06:23:38.839 INFO:teuthology.orchestra.run.smithi007.stdout:-------------------------------------------------------------------------------- 2024-09-21T06:23:38.839 INFO:teuthology.orchestra.run.smithi007.stdout:Total 17 MB/s | 228 MB 00:13 2024-09-21T06:23:38.844 INFO:teuthology.orchestra.run.smithi144.stdout:(113/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 20 MB/s | 839 kB 00:00 2024-09-21T06:23:38.878 INFO:teuthology.orchestra.run.smithi144.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 16 MB/s | 548 kB 00:00 2024-09-21T06:23:38.895 INFO:teuthology.orchestra.run.smithi144.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.5 MB/s | 43 kB 00:00 2024-09-21T06:23:38.912 INFO:teuthology.orchestra.run.smithi144.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.9 MB/s | 32 kB 00:00 2024-09-21T06:23:38.929 INFO:teuthology.orchestra.run.smithi144.stdout:(117/157): python3-certifi-2023.05.07-4.el9.noa 841 kB/s | 14 kB 00:00 2024-09-21T06:23:38.954 INFO:teuthology.orchestra.run.smithi144.stdout:(118/157): python3-cheroot-8.6.0-4.el9.noarch.r 6.7 MB/s | 172 kB 00:00 2024-09-21T06:23:38.988 INFO:teuthology.orchestra.run.smithi144.stdout:(119/157): python3-cherrypy-18.6.1-2.el9.noarch 10 MB/s | 358 kB 00:00 2024-09-21T06:23:39.013 INFO:teuthology.orchestra.run.smithi144.stdout:(120/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 12 MB/s | 303 kB 00:00 2024-09-21T06:23:39.038 INFO:teuthology.orchestra.run.smithi144.stdout:(121/157): python3-google-auth-2.34.0-1.el9.noa 8.6 MB/s | 220 kB 00:00 2024-09-21T06:23:39.097 INFO:teuthology.orchestra.run.smithi144.stdout:(122/157): python3-grpcio-1.46.7-10.el9.x86_64. 35 MB/s | 2.0 MB 00:00 2024-09-21T06:23:39.122 INFO:teuthology.orchestra.run.smithi144.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 5.6 MB/s | 144 kB 00:00 2024-09-21T06:23:39.139 INFO:teuthology.orchestra.run.smithi144.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 646 kB/s | 11 kB 00:00 2024-09-21T06:23:39.156 INFO:teuthology.orchestra.run.smithi144.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 1.0 MB/s | 18 kB 00:00 2024-09-21T06:23:39.173 INFO:teuthology.orchestra.run.smithi144.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 1.4 MB/s | 23 kB 00:00 2024-09-21T06:23:39.190 INFO:teuthology.orchestra.run.smithi144.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 1.1 MB/s | 19 kB 00:00 2024-09-21T06:23:39.207 INFO:teuthology.orchestra.run.smithi144.stdout:(128/157): python3-jaraco-text-3.2.0-6.el9.noar 1.2 MB/s | 20 kB 00:00 2024-09-21T06:23:39.249 INFO:teuthology.orchestra.run.smithi144.stdout:(129/157): python3-kubernetes-26.1.0-2.el9.noar 25 MB/s | 1.0 MB 00:00 2024-09-21T06:23:39.274 INFO:teuthology.orchestra.run.smithi144.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-21T06:23:39.299 INFO:teuthology.orchestra.run.smithi144.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-21T06:23:39.325 INFO:teuthology.orchestra.run.smithi144.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-21T06:23:39.350 INFO:teuthology.orchestra.run.smithi144.stdout:(133/157): python3-pecan-1.4.2-3.el9.noarch.rpm 11 MB/s | 272 kB 00:00 2024-09-21T06:23:39.375 INFO:teuthology.orchestra.run.smithi144.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 660 kB/s | 16 kB 00:00 2024-09-21T06:23:39.401 INFO:teuthology.orchestra.run.smithi144.stdout:(135/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-21T06:23:39.426 INFO:teuthology.orchestra.run.smithi144.stdout:(136/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 37 kB/s | 64 kB 00:01 2024-09-21T06:23:39.451 INFO:teuthology.orchestra.run.smithi144.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 562 kB/s | 28 kB 00:00 2024-09-21T06:23:39.485 INFO:teuthology.orchestra.run.smithi144.stdout:(138/157): python3-routes-2.5.1-5.el9.noarch.rp 7.2 MB/s | 188 kB 00:00 2024-09-21T06:23:39.510 INFO:teuthology.orchestra.run.smithi144.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 2.5 MB/s | 59 kB 00:00 2024-09-21T06:23:39.535 INFO:teuthology.orchestra.run.smithi144.stdout:(140/157): python3-repoze-lru-0.7-16.el9.noarch 282 kB/s | 31 kB 00:00 2024-09-21T06:23:39.561 INFO:teuthology.orchestra.run.smithi144.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 714 kB/s | 36 kB 00:00 2024-09-21T06:23:39.586 INFO:teuthology.orchestra.run.smithi144.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-21T06:23:39.611 INFO:teuthology.orchestra.run.smithi144.stdout:(143/157): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-21T06:23:39.636 INFO:teuthology.orchestra.run.smithi144.stdout:(144/157): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-21T06:23:39.662 INFO:teuthology.orchestra.run.smithi144.stdout:(145/157): python3-zc-lockfile-2.0-10.el9.noarc 799 kB/s | 20 kB 00:00 2024-09-21T06:23:39.687 INFO:teuthology.orchestra.run.smithi144.stdout:(146/157): re2-20211101-20.el9.x86_64.rpm 7.5 MB/s | 191 kB 00:00 2024-09-21T06:23:39.712 INFO:teuthology.orchestra.run.smithi144.stdout:(147/157): python3-werkzeug-2.0.3-3.el9.1.noarc 4.1 MB/s | 427 kB 00:00 2024-09-21T06:23:39.762 INFO:teuthology.orchestra.run.smithi144.stdout:(148/157): thrift-0.15.0-2.el9.x86_64.rpm 21 MB/s | 1.6 MB 00:00 2024-09-21T06:23:40.080 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction check 2024-09-21T06:23:40.105 INFO:teuthology.orchestra.run.smithi144.stdout:(149/157): librbd1-19.3.0-5120.g18432218.el9.x8 9.3 MB/s | 3.2 MB 00:00 2024-09-21T06:23:40.249 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction check succeeded. 2024-09-21T06:23:40.250 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction test 2024-09-21T06:23:40.380 INFO:teuthology.orchestra.run.smithi144.stdout:(150/157): NetworkManager-1.51.0-1.el9.x86_64.r 8.4 MB/s | 2.3 MB 00:00 2024-09-21T06:23:40.505 INFO:teuthology.orchestra.run.smithi144.stdout:(151/157): librados2-19.3.0-5120.g18432218.el9. 4.3 MB/s | 3.4 MB 00:00 2024-09-21T06:23:40.547 INFO:teuthology.orchestra.run.smithi144.stdout:(152/157): NetworkManager-libnm-1.51.0-1.el9.x8 11 MB/s | 1.8 MB 00:00 2024-09-21T06:23:40.572 INFO:teuthology.orchestra.run.smithi144.stdout:(153/157): NetworkManager-team-1.51.0-1.el9.x86 613 kB/s | 41 kB 00:00 2024-09-21T06:23:40.598 INFO:teuthology.orchestra.run.smithi144.stdout:(154/157): NetworkManager-tui-1.51.0-1.el9.x86_ 4.9 MB/s | 249 kB 00:00 2024-09-21T06:23:40.602 INFO:teuthology.orchestra.run.smithi018.stdout:(154/157): NetworkManager-libnm-1.51.0-1.el9.x8 393 kB/s | 1.8 MB 00:04 2024-09-21T06:23:40.673 INFO:teuthology.orchestra.run.smithi144.stdout:(155/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 32 MB/s | 2.4 MB 00:00 2024-09-21T06:23:40.715 INFO:teuthology.orchestra.run.smithi144.stdout:(156/157): openssl-3.2.2-6.el9.x86_64.rpm 9.5 MB/s | 1.4 MB 00:00 2024-09-21T06:23:41.078 INFO:teuthology.orchestra.run.smithi018.stdout:(155/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 2.0 MB/s | 16 MB 00:08 2024-09-21T06:23:41.678 INFO:teuthology.orchestra.run.smithi018.stdout:(156/157): openssl-3.2.2-6.el9.x86_64.rpm 447 kB/s | 1.4 MB 00:03 2024-09-21T06:23:42.613 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction test succeeded. 2024-09-21T06:23:42.613 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction 2024-09-21T06:23:43.694 INFO:teuthology.orchestra.run.smithi018.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 793 kB/s | 2.4 MB 00:03 2024-09-21T06:23:43.698 INFO:teuthology.orchestra.run.smithi018.stdout:-------------------------------------------------------------------------------- 2024-09-21T06:23:43.698 INFO:teuthology.orchestra.run.smithi018.stdout:Total 10 MB/s | 228 MB 00:21 2024-09-21T06:23:43.923 INFO:teuthology.orchestra.run.smithi144.stdout:(157/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 2.0 MB/s | 16 MB 00:08 2024-09-21T06:23:43.929 INFO:teuthology.orchestra.run.smithi144.stdout:-------------------------------------------------------------------------------- 2024-09-21T06:23:43.929 INFO:teuthology.orchestra.run.smithi144.stdout:Total 12 MB/s | 228 MB 00:18 2024-09-21T06:23:44.957 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction check 2024-09-21T06:23:45.125 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction check succeeded. 2024-09-21T06:23:45.125 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction test 2024-09-21T06:23:45.184 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction check 2024-09-21T06:23:45.336 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction check succeeded. 2024-09-21T06:23:45.336 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction test 2024-09-21T06:23:47.042 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction test succeeded. 2024-09-21T06:23:47.042 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction 2024-09-21T06:23:47.199 INFO:teuthology.orchestra.run.smithi144.stdout:Transaction test succeeded. 2024-09-21T06:23:47.199 INFO:teuthology.orchestra.run.smithi144.stdout:Running transaction 2024-09-21T06:23:49.346 INFO:teuthology.orchestra.run.smithi007.stdout: Preparing : 1/1 2024-09-21T06:23:49.429 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T06:23:49.478 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T06:23:49.567 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T06:23:49.608 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T06:23:49.633 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T06:23:49.692 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T06:23:50.045 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T06:23:50.184 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T06:23:50.314 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T06:23:50.335 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T06:23:50.428 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T06:23:50.457 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T06:23:50.487 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T06:23:50.662 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T06:23:50.721 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T06:23:50.749 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T06:23:50.859 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T06:23:50.883 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T06:23:50.946 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T06:23:50.976 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T06:23:51.002 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T06:23:51.197 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T06:23:51.378 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T06:23:51.499 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T06:23:51.608 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T06:23:51.693 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T06:23:51.924 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T06:23:52.040 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T06:23:52.064 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T06:23:52.099 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T06:23:52.174 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T06:23:52.225 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T06:23:52.266 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T06:23:52.309 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T06:23:52.341 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T06:23:52.369 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T06:23:52.439 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T06:23:52.492 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T06:23:52.522 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T06:23:52.558 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T06:23:52.640 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T06:23:52.677 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T06:23:52.720 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T06:23:52.748 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T06:23:52.821 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T06:23:52.864 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T06:23:52.940 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T06:23:53.087 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T06:23:53.142 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T06:23:53.412 INFO:teuthology.orchestra.run.smithi018.stdout: Preparing : 1/1 2024-09-21T06:23:53.487 INFO:teuthology.orchestra.run.smithi144.stdout: Preparing : 1/1 2024-09-21T06:23:53.506 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T06:23:53.545 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T06:23:53.601 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T06:23:53.639 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T06:23:53.694 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T06:23:53.701 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T06:23:53.735 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T06:23:53.761 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T06:23:53.786 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T06:23:53.788 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T06:23:53.803 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T06:23:53.824 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T06:23:53.825 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T06:23:53.849 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T06:23:53.872 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T06:23:53.903 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T06:23:53.905 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T06:23:53.948 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T06:23:54.113 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T06:23:54.136 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T06:23:54.175 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T06:23:54.270 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T06:23:54.270 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T06:23:54.333 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T06:23:54.372 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T06:23:54.375 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T06:23:54.405 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T06:23:54.444 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T06:23:54.480 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T06:23:54.504 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T06:23:54.528 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T06:23:54.534 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T06:23:54.563 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T06:23:54.606 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T06:23:54.627 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T06:23:54.649 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T06:23:54.655 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T06:23:54.685 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T06:23:54.749 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T06:23:54.771 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T06:23:54.790 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T06:23:54.834 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T06:23:54.847 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T06:23:54.863 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T06:23:54.875 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T06:23:54.893 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T06:23:54.912 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T06:23:54.922 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T06:23:54.948 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T06:23:54.981 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T06:23:55.017 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T06:23:55.039 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T06:23:55.058 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T06:23:55.066 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T06:23:55.074 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T06:23:55.091 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T06:23:55.111 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T06:23:55.115 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T06:23:55.123 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T06:23:55.133 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T06:23:55.152 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T06:23:55.156 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T06:23:55.209 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T06:23:55.241 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T06:23:55.269 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T06:23:55.332 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T06:23:55.339 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T06:23:55.352 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T06:23:55.353 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T06:23:55.375 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T06:23:55.498 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T06:23:55.532 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T06:23:55.572 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T06:23:55.631 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T06:23:55.665 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T06:23:55.699 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T06:23:55.717 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T06:23:55.738 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T06:23:55.739 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T06:23:55.778 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T06:23:55.808 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T06:23:55.825 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T06:23:55.827 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T06:23:55.842 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T06:23:55.876 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T06:23:55.919 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T06:23:55.932 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T06:23:55.951 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T06:23:56.004 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T06:23:56.048 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T06:23:56.063 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T06:23:56.100 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T06:23:56.138 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T06:23:56.187 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T06:23:56.234 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T06:23:56.246 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T06:23:56.249 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T06:23:56.315 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T06:23:56.352 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T06:23:56.391 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T06:23:56.406 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T06:23:56.426 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T06:23:56.481 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T06:23:56.507 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T06:23:56.532 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T06:23:56.552 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T06:23:56.572 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T06:23:56.584 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T06:23:56.615 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T06:23:56.627 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T06:23:56.648 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T06:23:56.660 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T06:23:56.675 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T06:23:56.708 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T06:23:56.747 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T06:23:56.775 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T06:23:56.799 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T06:23:56.828 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T06:23:56.829 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T06:23:56.861 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T06:23:56.864 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T06:23:56.896 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T06:23:56.951 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T06:23:56.986 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T06:23:56.987 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T06:23:57.024 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T06:23:57.030 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T06:23:57.058 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T06:23:57.067 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T06:23:57.076 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T06:23:57.096 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T06:23:57.127 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T06:23:57.131 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T06:23:57.161 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T06:23:57.173 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T06:23:57.190 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T06:23:57.219 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T06:23:57.264 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T06:23:57.267 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T06:23:57.292 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T06:23:57.325 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T06:23:57.379 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T06:23:57.424 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T06:23:57.468 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T06:23:57.479 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T06:23:57.505 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T06:23:57.538 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T06:23:57.594 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T06:23:57.688 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T06:23:57.719 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T06:23:57.799 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T06:23:57.999 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T06:23:58.075 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T06:23:58.104 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T06:23:58.139 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T06:23:58.150 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T06:23:58.177 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T06:23:58.227 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T06:23:58.240 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T06:23:58.275 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T06:23:58.327 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T06:23:58.364 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T06:23:58.377 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T06:23:58.415 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T06:23:58.430 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T06:23:58.485 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T06:23:58.520 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T06:23:58.574 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T06:23:58.586 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T06:23:58.642 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T06:23:58.659 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T06:23:58.692 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T06:23:58.738 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T06:23:58.745 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T06:23:58.791 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T06:23:58.799 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T06:23:58.811 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T06:23:58.827 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T06:23:58.870 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T06:23:58.873 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T06:23:58.911 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T06:23:58.912 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T06:23:58.947 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T06:23:58.995 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T06:23:59.038 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T06:23:59.046 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T06:23:59.082 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T06:23:59.083 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T06:23:59.124 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T06:23:59.127 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T06:23:59.226 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T06:23:59.258 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T06:23:59.268 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T06:23:59.298 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T06:23:59.310 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T06:23:59.325 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T06:23:59.348 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T06:23:59.352 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T06:23:59.422 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T06:23:59.458 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T06:23:59.494 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T06:23:59.534 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T06:23:59.549 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T06:23:59.559 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T06:23:59.584 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T06:23:59.589 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T06:23:59.617 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T06:23:59.651 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T06:23:59.653 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T06:23:59.698 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T06:23:59.730 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T06:23:59.760 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T06:23:59.790 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T06:23:59.795 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T06:23:59.825 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T06:23:59.836 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T06:23:59.853 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T06:23:59.877 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T06:23:59.887 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T06:23:59.912 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T06:23:59.926 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T06:23:59.958 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T06:23:59.988 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T06:23:59.998 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T06:24:00.022 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T06:24:00.042 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T06:24:00.056 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T06:24:00.074 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T06:24:00.090 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T06:24:00.123 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T06:24:00.139 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T06:24:00.175 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T06:24:00.213 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T06:24:00.221 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T06:24:00.225 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T06:24:00.249 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T06:24:00.341 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T06:24:00.341 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T06:24:00.342 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T06:24:00.401 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T06:24:00.454 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T06:24:00.626 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T06:24:00.670 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T06:24:00.762 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T06:24:00.792 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T06:24:00.853 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T06:24:00.938 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T06:24:00.980 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T06:24:01.014 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T06:24:01.113 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T06:24:01.160 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T06:24:01.206 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T06:24:01.216 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T06:24:01.268 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T06:24:01.292 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T06:24:01.302 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T06:24:01.325 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T06:24:01.381 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T06:24:01.406 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T06:24:01.406 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T06:24:01.458 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T06:24:01.478 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T06:24:01.502 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T06:24:01.507 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T06:24:01.508 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T06:24:01.539 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T06:24:01.593 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T06:24:01.616 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T06:24:01.638 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T06:24:01.829 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T06:24:01.860 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T06:24:01.948 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T06:24:02.242 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T06:24:02.354 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T06:24:02.626 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T06:24:02.753 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T06:24:03.561 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T06:24:03.644 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T06:24:03.671 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T06:24:03.704 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T06:24:03.923 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T06:24:03.963 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T06:24:04.030 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T06:24:04.046 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T06:24:04.076 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T06:24:04.131 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T06:24:04.167 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T06:24:04.184 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T06:24:04.197 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T06:24:04.217 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T06:24:04.233 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T06:24:04.560 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T06:24:04.565 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T06:24:04.605 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T06:24:04.625 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T06:24:04.689 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T06:24:04.710 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T06:24:04.717 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T06:24:04.717 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T06:24:04.717 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T06:24:04.717 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:24:04.734 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T06:24:04.746 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T06:24:04.751 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T06:24:04.837 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T06:24:04.892 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T06:24:04.922 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T06:24:05.273 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T06:24:05.299 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T06:24:05.371 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T06:24:05.401 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T06:24:07.162 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T06:24:07.194 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T06:24:07.761 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T06:24:07.797 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T06:24:07.821 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T06:24:07.856 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T06:24:07.873 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T06:24:07.873 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T06:24:07.873 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T06:24:07.873 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-21T06:24:07.906 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T06:24:08.454 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T06:24:08.492 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T06:24:08.590 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T06:24:08.590 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T06:24:08.590 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T06:24:08.590 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T06:24:08.669 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T06:24:17.238 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T06:24:17.238 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /sys 2024-09-21T06:24:17.238 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /proc 2024-09-21T06:24:17.238 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /mnt 2024-09-21T06:24:17.238 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /var/tmp 2024-09-21T06:24:17.238 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /home 2024-09-21T06:24:17.238 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /root 2024-09-21T06:24:17.238 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /tmp 2024-09-21T06:24:17.238 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:24:17.424 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T06:24:17.440 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T06:24:17.440 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:24:17.441 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T06:24:17.441 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:24:19.110 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T06:24:19.138 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T06:24:19.138 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:24:19.138 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T06:24:19.139 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T06:24:19.139 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T06:24:19.139 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:24:19.377 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T06:24:19.402 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T06:24:19.402 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:24:19.402 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T06:24:19.402 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T06:24:19.402 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T06:24:19.403 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:24:19.712 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T06:24:19.712 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /sys 2024-09-21T06:24:19.712 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /proc 2024-09-21T06:24:19.712 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /mnt 2024-09-21T06:24:19.712 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /var/tmp 2024-09-21T06:24:19.713 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /home 2024-09-21T06:24:19.713 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /root 2024-09-21T06:24:19.713 INFO:teuthology.orchestra.run.smithi144.stdout:skipping the directory /tmp 2024-09-21T06:24:19.713 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-21T06:24:19.894 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T06:24:19.895 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T06:24:19.910 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T06:24:19.910 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:24:19.911 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T06:24:19.911 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-21T06:24:19.919 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T06:24:19.919 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:24:19.919 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T06:24:19.919 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T06:24:19.919 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T06:24:19.919 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:24:20.026 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T06:24:20.084 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T06:24:20.148 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T06:24:20.342 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T06:24:20.396 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T06:24:20.477 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T06:24:20.566 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T06:24:20.716 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T06:24:20.755 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T06:24:20.787 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T06:24:20.807 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T06:24:20.807 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /sys 2024-09-21T06:24:20.807 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /proc 2024-09-21T06:24:20.807 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /mnt 2024-09-21T06:24:20.807 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /var/tmp 2024-09-21T06:24:20.807 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /home 2024-09-21T06:24:20.807 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /root 2024-09-21T06:24:20.807 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /tmp 2024-09-21T06:24:20.807 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T06:24:20.814 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T06:24:20.981 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T06:24:21.000 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T06:24:21.000 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:24:21.000 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T06:24:21.000 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T06:24:21.259 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T06:24:21.288 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T06:24:21.320 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T06:24:21.389 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T06:24:21.419 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T06:24:21.505 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T06:24:21.532 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T06:24:21.533 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:24:21.533 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T06:24:21.533 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T06:24:21.533 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T06:24:21.533 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-21T06:24:21.756 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T06:24:21.781 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T06:24:21.781 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:24:21.782 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T06:24:21.782 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T06:24:21.782 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T06:24:21.782 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-21T06:24:22.248 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T06:24:22.272 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T06:24:22.272 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:24:22.272 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T06:24:22.272 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T06:24:22.272 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T06:24:22.272 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-21T06:24:22.371 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T06:24:22.427 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T06:24:22.483 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T06:24:22.643 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T06:24:22.667 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T06:24:22.669 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T06:24:22.669 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:24:22.670 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T06:24:22.670 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T06:24:22.670 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T06:24:22.670 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T06:24:22.715 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T06:24:22.785 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T06:24:22.873 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T06:24:22.910 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T06:24:22.933 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T06:24:22.933 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:24:22.933 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T06:24:22.934 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T06:24:22.934 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T06:24:22.934 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T06:24:23.021 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T06:24:23.057 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T06:24:23.098 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T06:24:23.126 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T06:24:23.436 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T06:24:23.459 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T06:24:23.459 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:24:23.459 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T06:24:23.460 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T06:24:23.460 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T06:24:23.460 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T06:24:23.528 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T06:24:23.558 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T06:24:23.566 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T06:24:23.590 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T06:24:23.625 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T06:24:23.680 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T06:24:23.697 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T06:24:23.714 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T06:24:23.892 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T06:24:23.937 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T06:24:24.017 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T06:24:24.125 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T06:24:24.284 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T06:24:24.320 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T06:24:24.352 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T06:24:24.380 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T06:24:24.786 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T06:24:24.790 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T06:24:24.820 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T06:24:24.842 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T06:24:24.852 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T06:24:24.920 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T06:24:24.951 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T06:24:25.856 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T06:24:25.876 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T06:24:25.998 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T06:24:26.176 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T06:24:26.202 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T06:24:26.227 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T06:24:26.228 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:24:26.228 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T06:24:26.228 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T06:24:26.228 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T06:24:26.228 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:24:26.287 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T06:24:26.299 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T06:24:26.401 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T06:24:26.457 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T06:24:26.884 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T06:24:26.965 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T06:24:27.484 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T06:24:27.522 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T06:24:27.547 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T06:24:27.547 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:24:27.547 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T06:24:27.548 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T06:24:27.548 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T06:24:27.548 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:24:27.590 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T06:24:27.614 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T06:24:27.614 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:24:27.614 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T06:24:27.614 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:24:27.665 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T06:24:27.690 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T06:24:27.690 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:24:27.691 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T06:24:27.691 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T06:24:27.691 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T06:24:27.691 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:24:27.923 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T06:24:27.954 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T06:24:28.024 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T06:24:28.049 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T06:24:28.050 INFO:teuthology.orchestra.run.smithi007.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:24:28.050 INFO:teuthology.orchestra.run.smithi007.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T06:24:28.050 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T06:24:28.050 INFO:teuthology.orchestra.run.smithi007.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T06:24:28.050 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:24:28.067 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T06:24:28.237 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T06:24:28.264 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T06:24:28.288 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T06:24:28.288 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:24:28.288 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T06:24:28.288 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T06:24:28.289 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T06:24:28.289 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-21T06:24:28.340 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T06:24:28.351 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T06:24:28.352 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T06:24:28.415 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T06:24:28.450 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T06:24:28.496 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T06:24:29.431 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T06:24:29.463 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T06:24:29.465 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T06:24:29.501 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T06:24:29.525 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T06:24:29.526 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:24:29.526 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T06:24:29.526 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T06:24:29.526 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T06:24:29.526 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-21T06:24:29.568 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T06:24:29.587 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T06:24:29.591 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T06:24:29.591 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:24:29.591 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T06:24:29.592 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-21T06:24:29.644 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T06:24:29.667 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T06:24:29.667 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:24:29.667 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T06:24:29.667 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T06:24:29.667 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T06:24:29.668 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-21T06:24:29.766 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T06:24:29.792 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T06:24:29.816 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T06:24:29.816 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:24:29.817 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T06:24:29.817 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T06:24:29.817 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T06:24:29.817 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T06:24:29.868 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T06:24:29.880 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T06:24:29.983 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T06:24:29.986 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T06:24:30.010 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T06:24:30.010 INFO:teuthology.orchestra.run.smithi144.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:24:30.010 INFO:teuthology.orchestra.run.smithi144.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T06:24:30.010 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T06:24:30.010 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T06:24:30.010 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-21T06:24:30.034 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T06:24:31.059 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T06:24:31.087 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T06:24:31.111 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T06:24:31.112 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:24:31.112 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T06:24:31.112 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T06:24:31.112 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T06:24:31.112 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T06:24:31.155 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T06:24:31.178 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T06:24:31.178 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:24:31.178 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T06:24:31.178 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T06:24:31.230 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T06:24:31.254 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T06:24:31.254 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:24:31.255 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T06:24:31.255 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T06:24:31.255 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T06:24:31.255 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T06:24:31.589 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T06:24:31.613 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T06:24:31.613 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T06:24:31.613 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T06:24:31.613 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T06:24:31.613 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T06:24:31.613 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T06:24:32.326 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T06:24:32.371 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T06:24:32.412 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T06:24:32.443 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T06:24:32.470 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T06:24:32.700 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T06:24:32.742 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T06:24:32.773 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T06:24:32.802 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T06:24:32.848 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T06:24:33.435 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T06:24:33.471 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T06:24:33.493 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T06:24:33.966 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T06:24:34.007 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T06:24:34.047 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T06:24:34.079 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T06:24:34.107 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T06:24:34.279 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T06:24:34.320 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T06:24:34.359 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T06:24:34.389 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T06:24:34.392 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T06:24:34.435 INFO:teuthology.orchestra.run.smithi144.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T06:24:34.485 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T06:24:34.532 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T06:24:34.633 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T06:24:34.672 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T06:24:34.697 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T06:24:34.723 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T06:24:34.723 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T06:24:34.807 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T06:24:34.807 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T06:24:34.891 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T06:24:34.941 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T06:24:34.946 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T06:24:34.946 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T06:24:35.062 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T06:24:35.133 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T06:24:35.134 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T06:24:35.134 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T06:24:35.153 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T06:24:35.219 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T06:24:35.287 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T06:24:35.827 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T06:24:35.869 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T06:24:35.909 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T06:24:35.941 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T06:24:35.975 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T06:24:36.001 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T06:24:36.063 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T06:24:36.103 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T06:24:36.193 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T06:24:36.196 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T06:24:36.240 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T06:24:36.241 INFO:teuthology.orchestra.run.smithi144.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T06:24:36.266 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T06:24:36.270 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T06:24:36.292 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T06:24:36.292 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T06:24:36.303 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T06:24:36.340 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T06:24:36.385 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T06:24:36.385 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T06:24:36.469 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T06:24:36.495 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T06:24:36.500 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T06:24:36.500 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T06:24:36.679 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T06:24:36.679 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T06:24:36.755 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T06:24:36.818 INFO:teuthology.orchestra.run.smithi144.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T06:24:37.043 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T06:24:37.086 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T06:24:37.106 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T06:24:38.000 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T06:24:38.099 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T06:24:38.141 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T06:24:38.225 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T06:24:38.252 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T06:24:38.277 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T06:24:38.303 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T06:24:38.303 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T06:24:38.387 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T06:24:38.388 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T06:24:38.471 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T06:24:38.496 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T06:24:38.502 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T06:24:38.502 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T06:24:38.681 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T06:24:38.681 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T06:24:38.766 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T06:24:38.832 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T06:24:41.617 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T06:24:41.617 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T06:24:41.617 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T06:24:41.617 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T06:24:41.617 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T06:24:41.617 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T06:24:41.617 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T06:24:41.617 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T06:24:41.617 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T06:24:41.618 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T06:24:41.618 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T06:24:41.618 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T06:24:41.618 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T06:24:41.618 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T06:24:41.618 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T06:24:41.618 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T06:24:41.618 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T06:24:41.618 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T06:24:41.618 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T06:24:41.618 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T06:24:41.618 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T06:24:41.619 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T06:24:41.619 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T06:24:41.619 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T06:24:41.619 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T06:24:41.619 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T06:24:41.619 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T06:24:41.619 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T06:24:41.619 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T06:24:41.619 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T06:24:41.619 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T06:24:41.636 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T06:24:41.636 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T06:24:41.636 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T06:24:41.636 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T06:24:41.636 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T06:24:41.637 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T06:24:41.637 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T06:24:41.637 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T06:24:41.637 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T06:24:41.637 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T06:24:41.637 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T06:24:41.637 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T06:24:41.637 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T06:24:41.637 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T06:24:41.637 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T06:24:41.637 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T06:24:41.637 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T06:24:41.638 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T06:24:41.638 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T06:24:41.638 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T06:24:41.638 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T06:24:41.638 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T06:24:41.638 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T06:24:41.638 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T06:24:41.638 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T06:24:41.638 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T06:24:41.638 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T06:24:41.638 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T06:24:41.639 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T06:24:41.639 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T06:24:41.639 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T06:24:41.639 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T06:24:41.639 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T06:24:41.639 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T06:24:41.639 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T06:24:41.639 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T06:24:41.639 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T06:24:41.639 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T06:24:41.639 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T06:24:41.640 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T06:24:41.640 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T06:24:41.640 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T06:24:41.640 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T06:24:41.640 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T06:24:41.640 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T06:24:41.640 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T06:24:41.640 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T06:24:41.640 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T06:24:41.640 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T06:24:41.640 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T06:24:41.641 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T06:24:41.641 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T06:24:41.641 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T06:24:41.641 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T06:24:41.641 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T06:24:41.641 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T06:24:41.641 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T06:24:41.642 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T06:24:41.642 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T06:24:41.642 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T06:24:41.642 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T06:24:41.642 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T06:24:41.642 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T06:24:41.642 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T06:24:41.642 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T06:24:41.642 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T06:24:41.642 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T06:24:41.642 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T06:24:41.643 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T06:24:41.643 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T06:24:41.643 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T06:24:41.643 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T06:24:41.643 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T06:24:41.643 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T06:24:41.643 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T06:24:41.643 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T06:24:41.643 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T06:24:41.643 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T06:24:41.644 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T06:24:41.644 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T06:24:41.644 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T06:24:41.644 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T06:24:41.644 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T06:24:41.644 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T06:24:41.644 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T06:24:41.644 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T06:24:41.644 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T06:24:41.644 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T06:24:41.644 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T06:24:41.644 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T06:24:41.645 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T06:24:41.645 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T06:24:41.645 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T06:24:41.645 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T06:24:41.645 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T06:24:41.645 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T06:24:41.645 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T06:24:41.645 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T06:24:41.645 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T06:24:41.645 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T06:24:41.645 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T06:24:41.646 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T06:24:41.646 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T06:24:41.646 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T06:24:41.646 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T06:24:41.646 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T06:24:41.646 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T06:24:41.646 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T06:24:41.646 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T06:24:41.646 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T06:24:41.646 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T06:24:41.646 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T06:24:41.646 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T06:24:41.647 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T06:24:41.647 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T06:24:41.647 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T06:24:41.647 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T06:24:41.647 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T06:24:41.647 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T06:24:41.647 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T06:24:41.647 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T06:24:41.647 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T06:24:41.647 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T06:24:41.647 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T06:24:41.647 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T06:24:41.648 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T06:24:41.648 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T06:24:41.648 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T06:24:41.648 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T06:24:41.648 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T06:24:41.648 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T06:24:41.648 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T06:24:41.648 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T06:24:41.648 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T06:24:43.364 INFO:teuthology.orchestra.run.smithi144.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T06:24:43.364 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T06:24:43.364 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T06:24:43.364 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T06:24:43.364 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T06:24:43.364 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T06:24:43.364 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T06:24:43.364 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T06:24:43.364 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T06:24:43.365 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T06:24:43.365 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T06:24:43.365 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T06:24:43.365 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T06:24:43.365 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T06:24:43.365 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T06:24:43.365 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T06:24:43.365 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T06:24:43.365 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T06:24:43.365 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T06:24:43.365 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T06:24:43.365 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T06:24:43.365 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T06:24:43.365 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T06:24:43.365 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T06:24:43.366 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T06:24:43.366 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T06:24:43.366 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T06:24:43.366 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T06:24:43.366 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T06:24:43.366 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T06:24:43.366 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T06:24:43.366 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T06:24:43.366 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T06:24:43.366 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T06:24:43.366 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T06:24:43.366 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T06:24:43.366 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T06:24:43.366 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T06:24:43.366 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T06:24:43.367 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T06:24:43.367 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T06:24:43.367 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T06:24:43.367 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T06:24:43.367 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T06:24:43.367 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T06:24:43.367 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T06:24:43.367 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T06:24:43.367 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T06:24:43.367 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T06:24:43.367 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T06:24:43.367 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T06:24:43.367 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T06:24:43.367 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T06:24:43.367 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T06:24:43.368 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T06:24:43.368 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T06:24:43.368 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T06:24:43.368 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T06:24:43.368 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T06:24:43.368 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T06:24:43.368 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T06:24:43.368 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T06:24:43.368 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T06:24:43.368 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T06:24:43.368 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T06:24:43.368 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T06:24:43.368 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T06:24:43.368 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T06:24:43.368 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T06:24:43.369 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T06:24:43.369 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T06:24:43.369 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T06:24:43.369 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T06:24:43.369 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T06:24:43.369 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T06:24:43.369 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T06:24:43.369 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T06:24:43.369 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T06:24:43.369 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T06:24:43.369 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T06:24:43.369 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T06:24:43.369 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T06:24:43.369 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T06:24:43.369 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T06:24:43.370 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T06:24:43.370 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T06:24:43.370 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T06:24:43.370 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T06:24:43.370 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T06:24:43.370 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T06:24:43.370 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T06:24:43.370 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T06:24:43.370 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T06:24:43.370 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T06:24:43.370 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T06:24:43.370 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T06:24:43.370 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T06:24:43.370 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T06:24:43.370 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T06:24:43.371 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T06:24:43.371 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T06:24:43.371 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T06:24:43.371 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T06:24:43.371 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T06:24:43.371 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T06:24:43.371 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T06:24:43.371 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T06:24:43.371 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T06:24:43.371 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T06:24:43.371 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T06:24:43.371 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T06:24:43.371 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T06:24:43.371 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T06:24:43.371 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T06:24:43.372 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T06:24:43.372 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T06:24:43.372 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T06:24:43.372 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T06:24:43.372 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T06:24:43.372 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T06:24:43.372 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T06:24:43.372 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T06:24:43.372 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T06:24:43.372 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T06:24:43.372 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T06:24:43.372 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T06:24:43.372 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T06:24:43.372 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T06:24:43.372 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T06:24:43.373 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T06:24:43.373 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T06:24:43.373 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T06:24:43.373 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T06:24:43.373 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T06:24:43.373 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T06:24:43.373 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T06:24:43.373 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T06:24:43.373 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T06:24:43.373 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T06:24:43.373 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T06:24:43.373 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T06:24:43.373 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T06:24:43.373 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T06:24:43.373 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T06:24:43.373 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T06:24:43.374 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T06:24:43.374 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T06:24:43.374 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T06:24:43.374 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T06:24:43.374 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T06:24:43.374 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T06:24:43.374 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T06:24:43.374 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T06:24:43.374 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T06:24:43.374 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T06:24:43.374 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T06:24:43.374 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T06:24:43.374 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T06:24:43.374 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T06:24:43.374 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T06:24:43.375 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T06:24:43.375 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T06:24:43.375 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T06:24:43.375 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T06:24:43.375 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T06:24:44.357 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T06:24:44.357 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:24:44.357 INFO:teuthology.orchestra.run.smithi007.stdout:Upgraded: 2024-09-21T06:24:44.357 INFO:teuthology.orchestra.run.smithi007.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T06:24:44.357 INFO:teuthology.orchestra.run.smithi007.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T06:24:44.357 INFO:teuthology.orchestra.run.smithi007.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T06:24:44.357 INFO:teuthology.orchestra.run.smithi007.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T06:24:44.357 INFO:teuthology.orchestra.run.smithi007.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:44.357 INFO:teuthology.orchestra.run.smithi007.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:44.357 INFO:teuthology.orchestra.run.smithi007.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T06:24:44.358 INFO:teuthology.orchestra.run.smithi007.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T06:24:44.358 INFO:teuthology.orchestra.run.smithi007.stdout:Installed: 2024-09-21T06:24:44.358 INFO:teuthology.orchestra.run.smithi007.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T06:24:44.358 INFO:teuthology.orchestra.run.smithi007.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T06:24:44.358 INFO:teuthology.orchestra.run.smithi007.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T06:24:44.358 INFO:teuthology.orchestra.run.smithi007.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T06:24:44.358 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:44.358 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:44.358 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:44.358 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:44.358 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:24:44.358 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:44.358 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:44.358 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:44.359 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:24:44.359 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:24:44.359 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:24:44.359 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:24:44.359 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:24:44.359 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:44.359 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:44.359 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:24:44.359 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:44.359 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:44.359 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:44.359 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:24:44.359 INFO:teuthology.orchestra.run.smithi007.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:24:44.359 INFO:teuthology.orchestra.run.smithi007.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:44.360 INFO:teuthology.orchestra.run.smithi007.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:44.360 INFO:teuthology.orchestra.run.smithi007.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:24:44.360 INFO:teuthology.orchestra.run.smithi007.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T06:24:44.360 INFO:teuthology.orchestra.run.smithi007.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T06:24:44.360 INFO:teuthology.orchestra.run.smithi007.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T06:24:44.360 INFO:teuthology.orchestra.run.smithi007.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T06:24:44.360 INFO:teuthology.orchestra.run.smithi007.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T06:24:44.360 INFO:teuthology.orchestra.run.smithi007.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T06:24:44.360 INFO:teuthology.orchestra.run.smithi007.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T06:24:44.360 INFO:teuthology.orchestra.run.smithi007.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T06:24:44.360 INFO:teuthology.orchestra.run.smithi007.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T06:24:44.360 INFO:teuthology.orchestra.run.smithi007.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T06:24:44.360 INFO:teuthology.orchestra.run.smithi007.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T06:24:44.360 INFO:teuthology.orchestra.run.smithi007.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:44.361 INFO:teuthology.orchestra.run.smithi007.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:44.361 INFO:teuthology.orchestra.run.smithi007.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:44.361 INFO:teuthology.orchestra.run.smithi007.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T06:24:44.361 INFO:teuthology.orchestra.run.smithi007.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T06:24:44.361 INFO:teuthology.orchestra.run.smithi007.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T06:24:44.361 INFO:teuthology.orchestra.run.smithi007.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T06:24:44.361 INFO:teuthology.orchestra.run.smithi007.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T06:24:44.361 INFO:teuthology.orchestra.run.smithi007.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T06:24:44.361 INFO:teuthology.orchestra.run.smithi007.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:44.361 INFO:teuthology.orchestra.run.smithi007.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:44.361 INFO:teuthology.orchestra.run.smithi007.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T06:24:44.361 INFO:teuthology.orchestra.run.smithi007.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:44.361 INFO:teuthology.orchestra.run.smithi007.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T06:24:44.361 INFO:teuthology.orchestra.run.smithi007.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T06:24:44.362 INFO:teuthology.orchestra.run.smithi007.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T06:24:44.362 INFO:teuthology.orchestra.run.smithi007.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T06:24:44.362 INFO:teuthology.orchestra.run.smithi007.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T06:24:44.362 INFO:teuthology.orchestra.run.smithi007.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T06:24:44.362 INFO:teuthology.orchestra.run.smithi007.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T06:24:44.362 INFO:teuthology.orchestra.run.smithi007.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T06:24:44.362 INFO:teuthology.orchestra.run.smithi007.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T06:24:44.362 INFO:teuthology.orchestra.run.smithi007.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T06:24:44.362 INFO:teuthology.orchestra.run.smithi007.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T06:24:44.362 INFO:teuthology.orchestra.run.smithi007.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T06:24:44.362 INFO:teuthology.orchestra.run.smithi007.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T06:24:44.362 INFO:teuthology.orchestra.run.smithi007.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T06:24:44.362 INFO:teuthology.orchestra.run.smithi007.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T06:24:44.362 INFO:teuthology.orchestra.run.smithi007.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T06:24:44.363 INFO:teuthology.orchestra.run.smithi007.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T06:24:44.363 INFO:teuthology.orchestra.run.smithi007.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T06:24:44.363 INFO:teuthology.orchestra.run.smithi007.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T06:24:44.363 INFO:teuthology.orchestra.run.smithi007.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T06:24:44.363 INFO:teuthology.orchestra.run.smithi007.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T06:24:44.363 INFO:teuthology.orchestra.run.smithi007.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T06:24:44.363 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T06:24:44.363 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:44.363 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:44.363 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:44.363 INFO:teuthology.orchestra.run.smithi007.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T06:24:44.363 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T06:24:44.363 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T06:24:44.363 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T06:24:44.363 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T06:24:44.364 INFO:teuthology.orchestra.run.smithi007.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T06:24:44.364 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T06:24:44.364 INFO:teuthology.orchestra.run.smithi007.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T06:24:44.364 INFO:teuthology.orchestra.run.smithi007.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T06:24:44.364 INFO:teuthology.orchestra.run.smithi007.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T06:24:44.364 INFO:teuthology.orchestra.run.smithi007.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T06:24:44.364 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T06:24:44.364 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T06:24:44.364 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T06:24:44.364 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T06:24:44.364 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T06:24:44.364 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T06:24:44.364 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T06:24:44.364 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T06:24:44.365 INFO:teuthology.orchestra.run.smithi007.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T06:24:44.365 INFO:teuthology.orchestra.run.smithi007.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T06:24:44.365 INFO:teuthology.orchestra.run.smithi007.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T06:24:44.365 INFO:teuthology.orchestra.run.smithi007.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T06:24:44.365 INFO:teuthology.orchestra.run.smithi007.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T06:24:44.365 INFO:teuthology.orchestra.run.smithi007.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T06:24:44.365 INFO:teuthology.orchestra.run.smithi007.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T06:24:44.365 INFO:teuthology.orchestra.run.smithi007.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T06:24:44.365 INFO:teuthology.orchestra.run.smithi007.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T06:24:44.365 INFO:teuthology.orchestra.run.smithi007.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T06:24:44.365 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T06:24:44.365 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T06:24:44.365 INFO:teuthology.orchestra.run.smithi007.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T06:24:44.365 INFO:teuthology.orchestra.run.smithi007.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T06:24:44.366 INFO:teuthology.orchestra.run.smithi007.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T06:24:44.366 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T06:24:44.366 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T06:24:44.366 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T06:24:44.366 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T06:24:44.366 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T06:24:44.366 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T06:24:44.366 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:44.366 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:44.366 INFO:teuthology.orchestra.run.smithi007.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T06:24:44.366 INFO:teuthology.orchestra.run.smithi007.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T06:24:44.366 INFO:teuthology.orchestra.run.smithi007.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T06:24:44.366 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:44.366 INFO:teuthology.orchestra.run.smithi007.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T06:24:44.367 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T06:24:44.367 INFO:teuthology.orchestra.run.smithi007.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T06:24:44.367 INFO:teuthology.orchestra.run.smithi007.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T06:24:44.367 INFO:teuthology.orchestra.run.smithi007.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T06:24:44.367 INFO:teuthology.orchestra.run.smithi007.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T06:24:44.367 INFO:teuthology.orchestra.run.smithi007.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T06:24:44.367 INFO:teuthology.orchestra.run.smithi007.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T06:24:44.367 INFO:teuthology.orchestra.run.smithi007.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T06:24:44.367 INFO:teuthology.orchestra.run.smithi007.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T06:24:44.367 INFO:teuthology.orchestra.run.smithi007.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T06:24:44.367 INFO:teuthology.orchestra.run.smithi007.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T06:24:44.367 INFO:teuthology.orchestra.run.smithi007.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T06:24:44.367 INFO:teuthology.orchestra.run.smithi007.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T06:24:44.367 INFO:teuthology.orchestra.run.smithi007.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T06:24:44.368 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:44.368 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:44.368 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:44.368 INFO:teuthology.orchestra.run.smithi007.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T06:24:44.368 INFO:teuthology.orchestra.run.smithi007.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T06:24:44.368 INFO:teuthology.orchestra.run.smithi007.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T06:24:44.368 INFO:teuthology.orchestra.run.smithi007.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T06:24:44.368 INFO:teuthology.orchestra.run.smithi007.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T06:24:44.368 INFO:teuthology.orchestra.run.smithi007.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T06:24:44.369 INFO:teuthology.orchestra.run.smithi007.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T06:24:44.369 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:24:44.369 INFO:teuthology.orchestra.run.smithi007.stdout:Complete! 2024-09-21T06:24:44.906 DEBUG:teuthology.parallel:result is None 2024-09-21T06:24:45.031 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T06:24:45.032 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T06:24:45.032 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T06:24:45.032 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T06:24:45.032 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T06:24:45.032 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T06:24:45.032 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T06:24:45.032 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T06:24:45.032 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T06:24:45.032 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T06:24:45.032 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T06:24:45.032 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T06:24:45.032 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T06:24:45.032 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T06:24:45.033 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T06:24:45.033 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T06:24:45.033 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T06:24:45.033 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T06:24:45.033 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T06:24:45.033 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T06:24:45.033 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T06:24:45.033 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T06:24:45.033 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T06:24:45.033 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T06:24:45.033 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T06:24:45.033 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T06:24:45.033 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T06:24:45.033 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T06:24:45.033 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T06:24:45.034 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T06:24:45.034 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T06:24:45.034 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T06:24:45.034 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T06:24:45.034 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T06:24:45.034 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T06:24:45.034 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T06:24:45.034 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T06:24:45.034 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T06:24:45.034 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T06:24:45.034 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T06:24:45.034 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T06:24:45.034 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T06:24:45.035 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T06:24:45.035 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T06:24:45.035 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T06:24:45.035 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T06:24:45.035 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T06:24:45.035 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T06:24:45.035 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T06:24:45.035 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T06:24:45.035 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T06:24:45.035 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T06:24:45.035 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T06:24:45.035 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T06:24:45.035 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T06:24:45.036 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T06:24:45.036 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T06:24:45.036 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T06:24:45.036 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T06:24:45.036 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T06:24:45.036 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T06:24:45.036 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T06:24:45.036 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T06:24:45.036 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T06:24:45.036 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T06:24:45.036 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T06:24:45.036 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T06:24:45.036 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T06:24:45.036 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T06:24:45.037 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T06:24:45.037 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T06:24:45.037 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T06:24:45.037 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T06:24:45.037 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T06:24:45.037 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T06:24:45.037 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T06:24:45.037 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T06:24:45.037 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T06:24:45.037 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T06:24:45.037 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T06:24:45.037 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T06:24:45.037 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T06:24:45.037 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T06:24:45.037 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T06:24:45.038 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T06:24:45.038 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T06:24:45.038 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T06:24:45.038 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T06:24:45.038 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T06:24:45.038 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T06:24:45.038 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T06:24:45.038 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T06:24:45.038 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T06:24:45.038 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T06:24:45.038 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T06:24:45.038 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T06:24:45.038 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T06:24:45.038 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T06:24:45.038 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T06:24:45.039 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T06:24:45.039 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T06:24:45.039 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T06:24:45.039 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T06:24:45.039 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T06:24:45.039 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T06:24:45.039 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T06:24:45.039 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T06:24:45.039 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T06:24:45.039 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T06:24:45.039 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T06:24:45.039 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T06:24:45.039 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T06:24:45.040 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T06:24:45.040 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T06:24:45.040 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T06:24:45.040 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T06:24:45.040 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T06:24:45.040 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T06:24:45.040 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T06:24:45.040 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T06:24:45.040 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T06:24:45.040 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T06:24:45.040 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T06:24:45.040 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T06:24:45.040 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T06:24:45.040 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T06:24:45.040 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T06:24:45.041 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T06:24:45.041 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T06:24:45.041 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T06:24:45.041 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T06:24:45.041 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T06:24:45.041 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T06:24:45.041 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T06:24:45.041 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T06:24:45.041 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T06:24:45.041 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T06:24:45.041 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T06:24:45.041 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T06:24:45.041 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T06:24:45.041 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T06:24:45.042 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T06:24:45.042 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T06:24:45.042 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T06:24:45.042 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T06:24:45.042 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T06:24:45.042 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T06:24:45.042 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T06:24:45.042 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T06:24:45.042 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T06:24:45.042 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T06:24:45.042 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T06:24:45.042 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T06:24:45.042 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T06:24:45.042 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T06:24:45.043 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T06:24:45.043 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T06:24:45.043 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T06:24:45.043 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T06:24:45.043 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T06:24:45.043 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T06:24:45.043 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T06:24:45.043 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T06:24:45.043 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T06:24:45.043 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T06:24:45.862 INFO:teuthology.orchestra.run.smithi144.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T06:24:45.862 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-21T06:24:45.862 INFO:teuthology.orchestra.run.smithi144.stdout:Upgraded: 2024-09-21T06:24:45.862 INFO:teuthology.orchestra.run.smithi144.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T06:24:45.862 INFO:teuthology.orchestra.run.smithi144.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T06:24:45.862 INFO:teuthology.orchestra.run.smithi144.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T06:24:45.862 INFO:teuthology.orchestra.run.smithi144.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T06:24:45.862 INFO:teuthology.orchestra.run.smithi144.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:45.862 INFO:teuthology.orchestra.run.smithi144.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:45.862 INFO:teuthology.orchestra.run.smithi144.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T06:24:45.862 INFO:teuthology.orchestra.run.smithi144.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T06:24:45.863 INFO:teuthology.orchestra.run.smithi144.stdout:Installed: 2024-09-21T06:24:45.863 INFO:teuthology.orchestra.run.smithi144.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T06:24:45.863 INFO:teuthology.orchestra.run.smithi144.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T06:24:45.863 INFO:teuthology.orchestra.run.smithi144.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T06:24:45.863 INFO:teuthology.orchestra.run.smithi144.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T06:24:45.863 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:45.863 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:45.863 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:45.863 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:45.863 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:24:45.863 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:45.863 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:45.863 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:45.863 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:24:45.864 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:24:45.864 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:24:45.864 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:24:45.864 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:24:45.864 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:45.864 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:45.864 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:24:45.864 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:45.864 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:45.864 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:45.864 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:24:45.864 INFO:teuthology.orchestra.run.smithi144.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:24:45.864 INFO:teuthology.orchestra.run.smithi144.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:45.864 INFO:teuthology.orchestra.run.smithi144.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:45.864 INFO:teuthology.orchestra.run.smithi144.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:24:45.865 INFO:teuthology.orchestra.run.smithi144.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T06:24:45.865 INFO:teuthology.orchestra.run.smithi144.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T06:24:45.865 INFO:teuthology.orchestra.run.smithi144.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T06:24:45.865 INFO:teuthology.orchestra.run.smithi144.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T06:24:45.865 INFO:teuthology.orchestra.run.smithi144.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T06:24:45.865 INFO:teuthology.orchestra.run.smithi144.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T06:24:45.865 INFO:teuthology.orchestra.run.smithi144.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T06:24:45.865 INFO:teuthology.orchestra.run.smithi144.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T06:24:45.865 INFO:teuthology.orchestra.run.smithi144.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T06:24:45.865 INFO:teuthology.orchestra.run.smithi144.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T06:24:45.865 INFO:teuthology.orchestra.run.smithi144.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T06:24:45.865 INFO:teuthology.orchestra.run.smithi144.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:45.865 INFO:teuthology.orchestra.run.smithi144.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:45.865 INFO:teuthology.orchestra.run.smithi144.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:45.865 INFO:teuthology.orchestra.run.smithi144.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T06:24:45.866 INFO:teuthology.orchestra.run.smithi144.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T06:24:45.866 INFO:teuthology.orchestra.run.smithi144.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T06:24:45.866 INFO:teuthology.orchestra.run.smithi144.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T06:24:45.866 INFO:teuthology.orchestra.run.smithi144.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T06:24:45.866 INFO:teuthology.orchestra.run.smithi144.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T06:24:45.866 INFO:teuthology.orchestra.run.smithi144.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:45.866 INFO:teuthology.orchestra.run.smithi144.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:45.866 INFO:teuthology.orchestra.run.smithi144.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T06:24:45.866 INFO:teuthology.orchestra.run.smithi144.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:45.866 INFO:teuthology.orchestra.run.smithi144.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T06:24:45.866 INFO:teuthology.orchestra.run.smithi144.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T06:24:45.866 INFO:teuthology.orchestra.run.smithi144.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T06:24:45.866 INFO:teuthology.orchestra.run.smithi144.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T06:24:45.866 INFO:teuthology.orchestra.run.smithi144.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T06:24:45.867 INFO:teuthology.orchestra.run.smithi144.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T06:24:45.867 INFO:teuthology.orchestra.run.smithi144.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T06:24:45.867 INFO:teuthology.orchestra.run.smithi144.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T06:24:45.867 INFO:teuthology.orchestra.run.smithi144.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T06:24:45.867 INFO:teuthology.orchestra.run.smithi144.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T06:24:45.867 INFO:teuthology.orchestra.run.smithi144.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T06:24:45.867 INFO:teuthology.orchestra.run.smithi144.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T06:24:45.867 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T06:24:45.867 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T06:24:45.867 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T06:24:45.867 INFO:teuthology.orchestra.run.smithi144.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T06:24:45.868 INFO:teuthology.orchestra.run.smithi144.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T06:24:45.868 INFO:teuthology.orchestra.run.smithi144.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T06:24:45.868 INFO:teuthology.orchestra.run.smithi144.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T06:24:45.868 INFO:teuthology.orchestra.run.smithi144.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T06:24:45.868 INFO:teuthology.orchestra.run.smithi144.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T06:24:45.868 INFO:teuthology.orchestra.run.smithi144.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T06:24:45.868 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T06:24:45.868 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:45.868 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:45.868 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:45.868 INFO:teuthology.orchestra.run.smithi144.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T06:24:45.868 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T06:24:45.868 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T06:24:45.869 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T06:24:45.869 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T06:24:45.869 INFO:teuthology.orchestra.run.smithi144.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T06:24:45.869 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T06:24:45.869 INFO:teuthology.orchestra.run.smithi144.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T06:24:45.869 INFO:teuthology.orchestra.run.smithi144.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T06:24:45.869 INFO:teuthology.orchestra.run.smithi144.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T06:24:45.869 INFO:teuthology.orchestra.run.smithi144.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T06:24:45.869 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T06:24:45.869 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T06:24:45.869 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T06:24:45.869 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T06:24:45.869 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T06:24:45.869 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T06:24:45.870 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T06:24:45.870 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T06:24:45.870 INFO:teuthology.orchestra.run.smithi144.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T06:24:45.870 INFO:teuthology.orchestra.run.smithi144.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T06:24:45.870 INFO:teuthology.orchestra.run.smithi144.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T06:24:45.870 INFO:teuthology.orchestra.run.smithi144.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T06:24:45.870 INFO:teuthology.orchestra.run.smithi144.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T06:24:45.870 INFO:teuthology.orchestra.run.smithi144.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T06:24:45.870 INFO:teuthology.orchestra.run.smithi144.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T06:24:45.870 INFO:teuthology.orchestra.run.smithi144.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T06:24:45.870 INFO:teuthology.orchestra.run.smithi144.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T06:24:45.870 INFO:teuthology.orchestra.run.smithi144.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T06:24:45.870 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T06:24:45.870 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T06:24:45.871 INFO:teuthology.orchestra.run.smithi144.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T06:24:45.871 INFO:teuthology.orchestra.run.smithi144.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T06:24:45.871 INFO:teuthology.orchestra.run.smithi144.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T06:24:45.871 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T06:24:45.871 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T06:24:45.871 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T06:24:45.871 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T06:24:45.871 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T06:24:45.871 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T06:24:45.871 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:45.871 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:45.871 INFO:teuthology.orchestra.run.smithi144.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T06:24:45.871 INFO:teuthology.orchestra.run.smithi144.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T06:24:45.871 INFO:teuthology.orchestra.run.smithi144.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T06:24:45.872 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:45.872 INFO:teuthology.orchestra.run.smithi144.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T06:24:45.872 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T06:24:45.872 INFO:teuthology.orchestra.run.smithi144.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T06:24:45.872 INFO:teuthology.orchestra.run.smithi144.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T06:24:45.872 INFO:teuthology.orchestra.run.smithi144.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T06:24:45.872 INFO:teuthology.orchestra.run.smithi144.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T06:24:45.872 INFO:teuthology.orchestra.run.smithi144.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T06:24:45.872 INFO:teuthology.orchestra.run.smithi144.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T06:24:45.872 INFO:teuthology.orchestra.run.smithi144.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T06:24:45.872 INFO:teuthology.orchestra.run.smithi144.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T06:24:45.872 INFO:teuthology.orchestra.run.smithi144.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T06:24:45.872 INFO:teuthology.orchestra.run.smithi144.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T06:24:45.872 INFO:teuthology.orchestra.run.smithi144.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T06:24:45.872 INFO:teuthology.orchestra.run.smithi144.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T06:24:45.873 INFO:teuthology.orchestra.run.smithi144.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T06:24:45.873 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:45.873 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:45.873 INFO:teuthology.orchestra.run.smithi144.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:45.873 INFO:teuthology.orchestra.run.smithi144.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T06:24:45.873 INFO:teuthology.orchestra.run.smithi144.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T06:24:45.873 INFO:teuthology.orchestra.run.smithi144.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T06:24:45.873 INFO:teuthology.orchestra.run.smithi144.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T06:24:45.873 INFO:teuthology.orchestra.run.smithi144.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T06:24:45.873 INFO:teuthology.orchestra.run.smithi144.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T06:24:45.874 INFO:teuthology.orchestra.run.smithi144.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T06:24:45.874 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-21T06:24:45.874 INFO:teuthology.orchestra.run.smithi144.stdout:Complete! 2024-09-21T06:24:46.271 DEBUG:teuthology.parallel:result is None 2024-09-21T06:24:47.851 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T06:24:47.851 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T06:24:47.851 INFO:teuthology.orchestra.run.smithi018.stdout:Upgraded: 2024-09-21T06:24:47.851 INFO:teuthology.orchestra.run.smithi018.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T06:24:47.851 INFO:teuthology.orchestra.run.smithi018.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T06:24:47.852 INFO:teuthology.orchestra.run.smithi018.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T06:24:47.852 INFO:teuthology.orchestra.run.smithi018.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T06:24:47.852 INFO:teuthology.orchestra.run.smithi018.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:47.852 INFO:teuthology.orchestra.run.smithi018.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:47.852 INFO:teuthology.orchestra.run.smithi018.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T06:24:47.852 INFO:teuthology.orchestra.run.smithi018.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T06:24:47.852 INFO:teuthology.orchestra.run.smithi018.stdout:Installed: 2024-09-21T06:24:47.852 INFO:teuthology.orchestra.run.smithi018.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T06:24:47.852 INFO:teuthology.orchestra.run.smithi018.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T06:24:47.852 INFO:teuthology.orchestra.run.smithi018.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T06:24:47.852 INFO:teuthology.orchestra.run.smithi018.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T06:24:47.852 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:47.853 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:47.853 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:47.853 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:47.853 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:24:47.853 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:47.853 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:47.853 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:47.853 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:24:47.853 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:24:47.853 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:24:47.853 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:24:47.853 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:24:47.853 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:47.854 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:47.854 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:24:47.854 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:47.854 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:47.854 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:47.854 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:24:47.854 INFO:teuthology.orchestra.run.smithi018.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:24:47.854 INFO:teuthology.orchestra.run.smithi018.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:47.854 INFO:teuthology.orchestra.run.smithi018.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:47.854 INFO:teuthology.orchestra.run.smithi018.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T06:24:47.854 INFO:teuthology.orchestra.run.smithi018.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T06:24:47.854 INFO:teuthology.orchestra.run.smithi018.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T06:24:47.854 INFO:teuthology.orchestra.run.smithi018.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T06:24:47.855 INFO:teuthology.orchestra.run.smithi018.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T06:24:47.855 INFO:teuthology.orchestra.run.smithi018.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T06:24:47.855 INFO:teuthology.orchestra.run.smithi018.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T06:24:47.855 INFO:teuthology.orchestra.run.smithi018.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T06:24:47.855 INFO:teuthology.orchestra.run.smithi018.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T06:24:47.855 INFO:teuthology.orchestra.run.smithi018.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T06:24:47.855 INFO:teuthology.orchestra.run.smithi018.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T06:24:47.855 INFO:teuthology.orchestra.run.smithi018.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T06:24:47.855 INFO:teuthology.orchestra.run.smithi018.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:47.855 INFO:teuthology.orchestra.run.smithi018.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:47.855 INFO:teuthology.orchestra.run.smithi018.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:47.855 INFO:teuthology.orchestra.run.smithi018.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T06:24:47.855 INFO:teuthology.orchestra.run.smithi018.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T06:24:47.856 INFO:teuthology.orchestra.run.smithi018.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T06:24:47.856 INFO:teuthology.orchestra.run.smithi018.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T06:24:47.856 INFO:teuthology.orchestra.run.smithi018.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T06:24:47.856 INFO:teuthology.orchestra.run.smithi018.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T06:24:47.856 INFO:teuthology.orchestra.run.smithi018.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:47.856 INFO:teuthology.orchestra.run.smithi018.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:47.856 INFO:teuthology.orchestra.run.smithi018.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T06:24:47.856 INFO:teuthology.orchestra.run.smithi018.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:47.856 INFO:teuthology.orchestra.run.smithi018.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T06:24:47.856 INFO:teuthology.orchestra.run.smithi018.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T06:24:47.856 INFO:teuthology.orchestra.run.smithi018.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T06:24:47.856 INFO:teuthology.orchestra.run.smithi018.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T06:24:47.856 INFO:teuthology.orchestra.run.smithi018.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T06:24:47.857 INFO:teuthology.orchestra.run.smithi018.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T06:24:47.857 INFO:teuthology.orchestra.run.smithi018.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T06:24:47.857 INFO:teuthology.orchestra.run.smithi018.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T06:24:47.857 INFO:teuthology.orchestra.run.smithi018.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T06:24:47.857 INFO:teuthology.orchestra.run.smithi018.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T06:24:47.857 INFO:teuthology.orchestra.run.smithi018.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T06:24:47.857 INFO:teuthology.orchestra.run.smithi018.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T06:24:47.857 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T06:24:47.857 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T06:24:47.857 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T06:24:47.857 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T06:24:47.857 INFO:teuthology.orchestra.run.smithi018.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T06:24:47.857 INFO:teuthology.orchestra.run.smithi018.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T06:24:47.858 INFO:teuthology.orchestra.run.smithi018.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T06:24:47.858 INFO:teuthology.orchestra.run.smithi018.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T06:24:47.858 INFO:teuthology.orchestra.run.smithi018.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T06:24:47.858 INFO:teuthology.orchestra.run.smithi018.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T06:24:47.858 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T06:24:47.858 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:47.858 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:47.858 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:47.858 INFO:teuthology.orchestra.run.smithi018.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T06:24:47.858 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T06:24:47.858 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T06:24:47.858 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T06:24:47.859 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T06:24:47.859 INFO:teuthology.orchestra.run.smithi018.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T06:24:47.859 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T06:24:47.859 INFO:teuthology.orchestra.run.smithi018.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T06:24:47.859 INFO:teuthology.orchestra.run.smithi018.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T06:24:47.859 INFO:teuthology.orchestra.run.smithi018.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T06:24:47.859 INFO:teuthology.orchestra.run.smithi018.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T06:24:47.859 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T06:24:47.859 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T06:24:47.859 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T06:24:47.859 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T06:24:47.859 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T06:24:47.859 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T06:24:47.860 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T06:24:47.860 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T06:24:47.860 INFO:teuthology.orchestra.run.smithi018.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T06:24:47.860 INFO:teuthology.orchestra.run.smithi018.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T06:24:47.860 INFO:teuthology.orchestra.run.smithi018.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T06:24:47.860 INFO:teuthology.orchestra.run.smithi018.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T06:24:47.860 INFO:teuthology.orchestra.run.smithi018.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T06:24:47.860 INFO:teuthology.orchestra.run.smithi018.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T06:24:47.860 INFO:teuthology.orchestra.run.smithi018.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T06:24:47.860 INFO:teuthology.orchestra.run.smithi018.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T06:24:47.860 INFO:teuthology.orchestra.run.smithi018.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T06:24:47.860 INFO:teuthology.orchestra.run.smithi018.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T06:24:47.860 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T06:24:47.861 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T06:24:47.861 INFO:teuthology.orchestra.run.smithi018.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T06:24:47.861 INFO:teuthology.orchestra.run.smithi018.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T06:24:47.861 INFO:teuthology.orchestra.run.smithi018.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T06:24:47.861 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T06:24:47.861 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T06:24:47.861 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T06:24:47.861 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T06:24:47.861 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T06:24:47.861 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T06:24:47.861 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:47.861 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:47.861 INFO:teuthology.orchestra.run.smithi018.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T06:24:47.861 INFO:teuthology.orchestra.run.smithi018.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T06:24:47.861 INFO:teuthology.orchestra.run.smithi018.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T06:24:47.861 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:47.862 INFO:teuthology.orchestra.run.smithi018.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T06:24:47.862 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T06:24:47.862 INFO:teuthology.orchestra.run.smithi018.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T06:24:47.862 INFO:teuthology.orchestra.run.smithi018.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T06:24:47.862 INFO:teuthology.orchestra.run.smithi018.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T06:24:47.862 INFO:teuthology.orchestra.run.smithi018.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T06:24:47.862 INFO:teuthology.orchestra.run.smithi018.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T06:24:47.862 INFO:teuthology.orchestra.run.smithi018.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T06:24:47.862 INFO:teuthology.orchestra.run.smithi018.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T06:24:47.862 INFO:teuthology.orchestra.run.smithi018.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T06:24:47.862 INFO:teuthology.orchestra.run.smithi018.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T06:24:47.862 INFO:teuthology.orchestra.run.smithi018.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T06:24:47.862 INFO:teuthology.orchestra.run.smithi018.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T06:24:47.862 INFO:teuthology.orchestra.run.smithi018.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T06:24:47.863 INFO:teuthology.orchestra.run.smithi018.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T06:24:47.863 INFO:teuthology.orchestra.run.smithi018.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:47.863 INFO:teuthology.orchestra.run.smithi018.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:47.863 INFO:teuthology.orchestra.run.smithi018.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T06:24:47.863 INFO:teuthology.orchestra.run.smithi018.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T06:24:47.863 INFO:teuthology.orchestra.run.smithi018.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T06:24:47.863 INFO:teuthology.orchestra.run.smithi018.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T06:24:47.863 INFO:teuthology.orchestra.run.smithi018.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T06:24:47.863 INFO:teuthology.orchestra.run.smithi018.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T06:24:47.863 INFO:teuthology.orchestra.run.smithi018.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T06:24:47.863 INFO:teuthology.orchestra.run.smithi018.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T06:24:47.864 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T06:24:47.864 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-09-21T06:24:48.279 DEBUG:teuthology.parallel:result is None 2024-09-21T06:24:48.279 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:24:48.422 DEBUG:teuthology.orchestra.run.smithi007:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T06:24:48.449 INFO:teuthology.orchestra.run.smithi007.stdout:19.3.0-5120.g18432218.el9 2024-09-21T06:24:48.450 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T06:24:48.450 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T06:24:48.452 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:24:48.591 DEBUG:teuthology.orchestra.run.smithi018:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T06:24:48.614 INFO:teuthology.orchestra.run.smithi018.stdout:19.3.0-5120.g18432218.el9 2024-09-21T06:24:48.614 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T06:24:48.614 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T06:24:48.616 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:24:48.757 DEBUG:teuthology.orchestra.run.smithi144:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T06:24:48.783 INFO:teuthology.orchestra.run.smithi144.stdout:19.3.0-5120.g18432218.el9 2024-09-21T06:24:48.783 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T06:24:48.783 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T06:24:48.785 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-21T06:24:48.785 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-21T06:24:48.785 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T06:24:48.819 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-21T06:24:48.819 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T06:24:48.849 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-21T06:24:48.850 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T06:24:48.881 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-21T06:24:48.881 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-21T06:24:48.882 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T06:24:48.912 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T06:24:48.983 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-21T06:24:48.983 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T06:24:49.010 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T06:24:49.077 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-21T06:24:49.077 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T06:24:49.106 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T06:24:49.174 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-21T06:24:49.174 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-21T06:24:49.174 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T06:24:49.205 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T06:24:49.276 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-21T06:24:49.276 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T06:24:49.304 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T06:24:49.370 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-21T06:24:49.371 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T06:24:49.400 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T06:24:49.468 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-21T06:24:49.468 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-21T06:24:49.468 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T06:24:49.499 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T06:24:49.569 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-21T06:24:49.569 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T06:24:49.597 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T06:24:49.665 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-21T06:24:49.665 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T06:24:49.694 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T06:24:49.762 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-21T06:24:49.867 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug cephsqlite': 20, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mgr/snap_schedule/allow_m_granularity': True, 'mgr/snap_schedule/dump_on_update': True, 'mgr/snap_schedule/log_level': 'debug', 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'global': {'ms die on skipped message': False}, 'mds': {'mds_bal_replicate_threshold': 1}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'mgr-modules': ['snap_schedule'], 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-09-21T06:24:49.867 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:24:49.867 INFO:tasks.cephadm:Cluster fsid is 347cb918-77e2-11ef-baf5-efdc52797490 2024-09-21T06:24:49.867 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-21T06:24:49.868 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.7', 'mon.b': '172.21.15.18', 'mon.c': '172.21.15.144'} 2024-09-21T06:24:49.868 INFO:tasks.cephadm:First mon is mon.a on smithi007 2024-09-21T06:24:49.868 INFO:tasks.cephadm:First mgr is x 2024-09-21T06:24:49.868 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-21T06:24:49.868 DEBUG:teuthology.orchestra.run.smithi007:> sudo hostname $(hostname -s) 2024-09-21T06:24:49.898 DEBUG:teuthology.orchestra.run.smithi018:> sudo hostname $(hostname -s) 2024-09-21T06:24:49.928 DEBUG:teuthology.orchestra.run.smithi144:> sudo hostname $(hostname -s) 2024-09-21T06:24:49.957 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-21T06:24:49.957 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:24:50.103 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/83190/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-5120-g18432218', 'node_name': '172.21.4.75+confusa13', 'job_name': 'ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-5120.g18432218'}, 'url': 'https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-21 00:04:17.484514', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-pdonnell-testing-20240920.212106-debug', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'archs': ['x86_64', 'source', 'arm64'], 'distro': 'centos'}, {'status': 'ready', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/83190/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-5120-g18432218', 'node_name': '172.21.2.22+braggi22', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-5120.g18432218'}, 'url': 'https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-20 22:54:16.499090', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-pdonnell-testing-20240920.212106-debug', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-09-21T06:24:50.243 INFO:tasks.util.chacra:got chacra host 4.chacra.ceph.com, ref wip-pdonnell-testing-20240920.212106-debug, sha1 1843221895adccfb3b692060251dd6a0183bc410 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:24:50.244 INFO:tasks.cephadm:Discovered cachra url: https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm 2024-09-21T06:24:50.244 INFO:tasks.cephadm:Downloading cephadm from url: https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm 2024-09-21T06:24:50.245 DEBUG:teuthology.orchestra.run.smithi007:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T06:24:50.798 INFO:teuthology.orchestra.run.smithi007.stdout:-rw-r--r--. 1 ubuntu ubuntu 804283 Sep 21 06:24 /home/ubuntu/cephtest/cephadm 2024-09-21T06:24:50.799 DEBUG:teuthology.orchestra.run.smithi018:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T06:24:51.339 INFO:teuthology.orchestra.run.smithi018.stdout:-rw-r--r--. 1 ubuntu ubuntu 804283 Sep 21 06:24 /home/ubuntu/cephtest/cephadm 2024-09-21T06:24:51.339 DEBUG:teuthology.orchestra.run.smithi144:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T06:24:51.877 INFO:teuthology.orchestra.run.smithi144.stdout:-rw-r--r--. 1 ubuntu ubuntu 804283 Sep 21 06:24 /home/ubuntu/cephtest/cephadm 2024-09-21T06:24:51.878 DEBUG:teuthology.orchestra.run.smithi007:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T06:24:51.898 DEBUG:teuthology.orchestra.run.smithi018:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T06:24:51.918 DEBUG:teuthology.orchestra.run.smithi144:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T06:24:51.951 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 on all hosts... 2024-09-21T06:24:51.951 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 pull 2024-09-21T06:24:51.954 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 pull 2024-09-21T06:24:51.960 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 pull 2024-09-21T06:24:53.585 INFO:teuthology.orchestra.run.smithi018.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T06:24:53.637 INFO:teuthology.orchestra.run.smithi144.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T06:24:53.713 INFO:teuthology.orchestra.run.smithi007.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T06:25:23.981 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:25:23.981 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T06:25:23.981 INFO:teuthology.orchestra.run.smithi007.stdout: "image_id": "ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977", 2024-09-21T06:25:23.981 INFO:teuthology.orchestra.run.smithi007.stdout: "repo_digests": [ 2024-09-21T06:25:23.981 INFO:teuthology.orchestra.run.smithi007.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262" 2024-09-21T06:25:23.982 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T06:25:23.982 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:25:31.319 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-21T06:25:31.320 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T06:25:31.320 INFO:teuthology.orchestra.run.smithi144.stdout: "image_id": "ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977", 2024-09-21T06:25:31.320 INFO:teuthology.orchestra.run.smithi144.stdout: "repo_digests": [ 2024-09-21T06:25:31.320 INFO:teuthology.orchestra.run.smithi144.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262" 2024-09-21T06:25:31.320 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-09-21T06:25:31.321 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-21T06:25:31.546 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-21T06:25:31.546 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T06:25:31.546 INFO:teuthology.orchestra.run.smithi018.stdout: "image_id": "ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977", 2024-09-21T06:25:31.547 INFO:teuthology.orchestra.run.smithi018.stdout: "repo_digests": [ 2024-09-21T06:25:31.547 INFO:teuthology.orchestra.run.smithi018.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262" 2024-09-21T06:25:31.547 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-21T06:25:31.547 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-21T06:25:31.570 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /etc/ceph 2024-09-21T06:25:31.606 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /etc/ceph 2024-09-21T06:25:31.633 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /etc/ceph 2024-09-21T06:25:31.661 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 777 /etc/ceph 2024-09-21T06:25:31.691 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 777 /etc/ceph 2024-09-21T06:25:31.715 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 777 /etc/ceph 2024-09-21T06:25:31.739 INFO:tasks.cephadm:Writing seed config... 2024-09-21T06:25:31.740 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-21T06:25:31.740 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-09-21T06:25:31.740 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-21T06:25:31.741 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-21T06:25:31.741 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-21T06:25:31.741 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-21T06:25:31.741 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-21T06:25:31.741 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-21T06:25:31.741 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-21T06:25:31.741 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-21T06:25:31.741 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2024-09-21T06:25:31.741 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-21T06:25:31.741 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-09-21T06:25:31.741 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-09-21T06:25:31.741 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-21T06:25:31.741 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-21T06:25:31.741 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-09-21T06:25:31.741 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-21T06:25:31.742 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-21T06:25:31.742 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-21T06:25:31.742 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-21T06:25:31.742 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-21T06:25:31.742 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-21T06:25:31.742 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-09-21T06:25:31.742 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-21T06:25:31.743 DEBUG:teuthology.orchestra.run.smithi007:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-21T06:25:31.761 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 347cb918-77e2-11ef-baf5-efdc52797490 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [mds] mds_bal_replicate_threshold = 1 2024-09-21T06:25:31.762 DEBUG:teuthology.orchestra.run.smithi007:mon.a> sudo journalctl -f -n 0 -u ceph-347cb918-77e2-11ef-baf5-efdc52797490@mon.a.service 2024-09-21T06:25:31.804 DEBUG:teuthology.orchestra.run.smithi007:mgr.x> sudo journalctl -f -n 0 -u ceph-347cb918-77e2-11ef-baf5-efdc52797490@mgr.x.service 2024-09-21T06:25:31.846 INFO:tasks.cephadm:Bootstrapping... 2024-09-21T06:25:31.846 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 -v bootstrap --fsid 347cb918-77e2-11ef-baf5-efdc52797490 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.7 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-21T06:25:32.063 INFO:teuthology.orchestra.run.smithi007.stdout:-------------------------------------------------------------------------------- 2024-09-21T06:25:32.063 INFO:teuthology.orchestra.run.smithi007.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', '-v', 'bootstrap', '--fsid', '347cb918-77e2-11ef-baf5-efdc52797490', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.7', '--skip-admin-label'] 2024-09-21T06:25:32.064 INFO:teuthology.orchestra.run.smithi007.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-21T06:25:32.064 INFO:teuthology.orchestra.run.smithi007.stdout:Verifying podman|docker is present... 2024-09-21T06:25:32.089 INFO:teuthology.orchestra.run.smithi007.stdout:/bin/podman: stdout 5.2.2 2024-09-21T06:25:32.090 INFO:teuthology.orchestra.run.smithi007.stdout:Verifying lvm2 is present... 2024-09-21T06:25:32.090 INFO:teuthology.orchestra.run.smithi007.stdout:Verifying time synchronization is in place... 2024-09-21T06:25:32.097 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-21T06:25:32.098 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-21T06:25:32.104 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-21T06:25:32.104 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout inactive 2024-09-21T06:25:32.111 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout enabled 2024-09-21T06:25:32.117 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout active 2024-09-21T06:25:32.117 INFO:teuthology.orchestra.run.smithi007.stdout:Unit chronyd.service is enabled and running 2024-09-21T06:25:32.118 INFO:teuthology.orchestra.run.smithi007.stdout:Repeating the final host check... 2024-09-21T06:25:32.140 INFO:teuthology.orchestra.run.smithi007.stdout:/bin/podman: stdout 5.2.2 2024-09-21T06:25:32.140 INFO:teuthology.orchestra.run.smithi007.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-21T06:25:32.140 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl is present 2024-09-21T06:25:32.140 INFO:teuthology.orchestra.run.smithi007.stdout:lvcreate is present 2024-09-21T06:25:32.147 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-21T06:25:32.147 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-21T06:25:32.153 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-21T06:25:32.153 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout inactive 2024-09-21T06:25:32.160 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout enabled 2024-09-21T06:25:32.167 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout active 2024-09-21T06:25:32.167 INFO:teuthology.orchestra.run.smithi007.stdout:Unit chronyd.service is enabled and running 2024-09-21T06:25:32.167 INFO:teuthology.orchestra.run.smithi007.stdout:Host looks OK 2024-09-21T06:25:32.167 INFO:teuthology.orchestra.run.smithi007.stdout:Cluster fsid: 347cb918-77e2-11ef-baf5-efdc52797490 2024-09-21T06:25:32.167 INFO:teuthology.orchestra.run.smithi007.stdout:Acquiring lock 140323449477488 on /run/cephadm/347cb918-77e2-11ef-baf5-efdc52797490.lock 2024-09-21T06:25:32.167 INFO:teuthology.orchestra.run.smithi007.stdout:Lock 140323449477488 acquired on /run/cephadm/347cb918-77e2-11ef-baf5-efdc52797490.lock 2024-09-21T06:25:32.168 INFO:teuthology.orchestra.run.smithi007.stdout:Verifying IP 172.21.15.7 port 3300 ... 2024-09-21T06:25:32.168 INFO:teuthology.orchestra.run.smithi007.stdout:Verifying IP 172.21.15.7 port 6789 ... 2024-09-21T06:25:32.168 INFO:teuthology.orchestra.run.smithi007.stdout:Base mon IP(s) is [172.21.15.7:3300, 172.21.15.7:6789], mon addrv is [v2:172.21.15.7:3300,v1:172.21.15.7:6789] 2024-09-21T06:25:32.171 INFO:teuthology.orchestra.run.smithi007.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.7 metric 100 2024-09-21T06:25:32.171 INFO:teuthology.orchestra.run.smithi007.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.7 metric 100 2024-09-21T06:25:32.174 INFO:teuthology.orchestra.run.smithi007.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-21T06:25:32.174 INFO:teuthology.orchestra.run.smithi007.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-21T06:25:32.174 INFO:teuthology.orchestra.run.smithi007.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1790sec hoplimit 64 pref medium 2024-09-21T06:25:32.176 INFO:teuthology.orchestra.run.smithi007.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-21T06:25:32.176 INFO:teuthology.orchestra.run.smithi007.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-21T06:25:32.176 INFO:teuthology.orchestra.run.smithi007.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-21T06:25:32.176 INFO:teuthology.orchestra.run.smithi007.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-21T06:25:32.177 INFO:teuthology.orchestra.run.smithi007.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:15ea/64 scope link 2024-09-21T06:25:32.177 INFO:teuthology.orchestra.run.smithi007.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-21T06:25:32.177 INFO:teuthology.orchestra.run.smithi007.stdout:Mon IP `172.21.15.7` is in CIDR network `172.21.0.0/20` 2024-09-21T06:25:32.177 INFO:teuthology.orchestra.run.smithi007.stdout:Mon IP `172.21.15.7` is in CIDR network `172.21.0.0/20` 2024-09-21T06:25:32.177 INFO:teuthology.orchestra.run.smithi007.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-21T06:25:32.178 INFO:teuthology.orchestra.run.smithi007.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-21T06:25:32.178 INFO:teuthology.orchestra.run.smithi007.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T06:25:33.012 INFO:teuthology.orchestra.run.smithi007.stdout:/bin/podman: stdout ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 2024-09-21T06:25:33.012 INFO:teuthology.orchestra.run.smithi007.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T06:25:33.013 INFO:teuthology.orchestra.run.smithi007.stdout:/bin/podman: stderr Getting image source signatures 2024-09-21T06:25:33.013 INFO:teuthology.orchestra.run.smithi007.stdout:/bin/podman: stderr Copying blob sha256:8425bc7408d91b180e7fdc62f23e7ae6603757f4f36e9969a4eaf9fd9416b764 2024-09-21T06:25:33.013 INFO:teuthology.orchestra.run.smithi007.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-21T06:25:33.013 INFO:teuthology.orchestra.run.smithi007.stdout:/bin/podman: stderr Copying config sha256:ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 2024-09-21T06:25:33.013 INFO:teuthology.orchestra.run.smithi007.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-21T06:25:33.948 INFO:teuthology.orchestra.run.smithi007.stdout:ceph: stdout ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev) 2024-09-21T06:25:33.948 INFO:teuthology.orchestra.run.smithi007.stdout:Ceph version: ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev) 2024-09-21T06:25:33.948 INFO:teuthology.orchestra.run.smithi007.stdout:Extracting ceph user uid/gid from container image... 2024-09-21T06:25:34.778 INFO:teuthology.orchestra.run.smithi007.stdout:stat: stdout 167 167 2024-09-21T06:25:34.778 INFO:teuthology.orchestra.run.smithi007.stdout:Creating initial keys... 2024-09-21T06:25:35.893 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-authtool: stdout AQDfZu5mqtapBRAAVm52GUVV04+oZrXS8tgj1A== 2024-09-21T06:25:36.998 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-authtool: stdout AQDgZu5mVVY5DRAAcB+UYSH4H4zw5Wj+852o2w== 2024-09-21T06:25:37.904 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph-authtool: stdout AQDhZu5mddOIExAAcxJWSbRkhbEzFP2PMhwgUg== 2024-09-21T06:25:37.905 INFO:teuthology.orchestra.run.smithi007.stdout:Creating initial monmap... 2024-09-21T06:25:44.976 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-21T06:25:44.976 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-21T06:25:44.976 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 347cb918-77e2-11ef-baf5-efdc52797490 2024-09-21T06:25:44.976 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-21T06:25:44.976 INFO:teuthology.orchestra.run.smithi007.stdout:monmaptool for a [v2:172.21.15.7:3300,v1:172.21.15.7:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-21T06:25:44.976 INFO:teuthology.orchestra.run.smithi007.stdout:setting min_mon_release = quincy 2024-09-21T06:25:44.976 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/monmaptool: set fsid to 347cb918-77e2-11ef-baf5-efdc52797490 2024-09-21T06:25:44.976 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-21T06:25:44.976 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:25:44.976 INFO:teuthology.orchestra.run.smithi007.stdout:Creating mon... 2024-09-21T06:25:50.490 INFO:teuthology.orchestra.run.smithi007.stdout:create mon.a on 2024-09-21T06:25:50.700 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-21T06:25:50.856 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-21T06:25:51.037 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-347cb918-77e2-11ef-baf5-efdc52797490.target → /etc/systemd/system/ceph-347cb918-77e2-11ef-baf5-efdc52797490.target. 2024-09-21T06:25:51.038 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-347cb918-77e2-11ef-baf5-efdc52797490.target → /etc/systemd/system/ceph-347cb918-77e2-11ef-baf5-efdc52797490.target. 2024-09-21T06:25:51.305 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-347cb918-77e2-11ef-baf5-efdc52797490@mon.a 2024-09-21T06:25:51.306 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stderr Failed to reset failed state of unit ceph-347cb918-77e2-11ef-baf5-efdc52797490@mon.a.service: Unit ceph-347cb918-77e2-11ef-baf5-efdc52797490@mon.a.service not loaded. 2024-09-21T06:25:51.475 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-347cb918-77e2-11ef-baf5-efdc52797490.target.wants/ceph-347cb918-77e2-11ef-baf5-efdc52797490@mon.a.service → /etc/systemd/system/ceph-347cb918-77e2-11ef-baf5-efdc52797490@.service. 2024-09-21T06:25:51.963 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T06:25:51.963 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout disabled 2024-09-21T06:25:51.970 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T06:25:51.970 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout inactive 2024-09-21T06:25:51.970 INFO:teuthology.orchestra.run.smithi007.stdout:firewalld.service is not enabled 2024-09-21T06:25:51.970 INFO:teuthology.orchestra.run.smithi007.stdout:Not possible to enable service . firewalld.service is not available 2024-09-21T06:25:51.971 INFO:teuthology.orchestra.run.smithi007.stdout:Waiting for mon to start... 2024-09-21T06:25:51.971 INFO:teuthology.orchestra.run.smithi007.stdout:Waiting for mon... 2024-09-21T06:25:52.968 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout cluster: 2024-09-21T06:25:52.968 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout id: 347cb918-77e2-11ef-baf5-efdc52797490 2024-09-21T06:25:52.968 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-21T06:25:52.968 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 2024-09-21T06:25:52.968 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout services: 2024-09-21T06:25:52.968 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.530945s) 2024-09-21T06:25:52.968 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-21T06:25:52.969 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-21T06:25:52.969 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 2024-09-21T06:25:52.969 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout data: 2024-09-21T06:25:52.969 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-21T06:25:52.969 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-21T06:25:52.969 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-21T06:25:52.969 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout pgs: 2024-09-21T06:25:52.969 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 2024-09-21T06:25:52.969 INFO:teuthology.orchestra.run.smithi007.stdout:mon is available 2024-09-21T06:25:52.969 INFO:teuthology.orchestra.run.smithi007.stdout:Assimilating anything we can from ceph.conf... 2024-09-21T06:25:54.054 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:53 smithi007 ceph-mon[30605]: from='client.? 172.21.15.7:0/4048313796' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-21T06:25:54.058 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 2024-09-21T06:25:54.058 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout [global] 2024-09-21T06:25:54.058 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout fsid = 347cb918-77e2-11ef-baf5-efdc52797490 2024-09-21T06:25:54.058 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-21T06:25:54.058 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.7:3300,v1:172.21.15.7:6789] 2024-09-21T06:25:54.058 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-21T06:25:54.058 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-21T06:25:54.058 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-21T06:25:54.058 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-21T06:25:54.058 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 2024-09-21T06:25:54.058 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-21T06:25:54.058 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-21T06:25:54.059 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 2024-09-21T06:25:54.059 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout [osd] 2024-09-21T06:25:54.059 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-21T06:25:54.059 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-21T06:25:54.059 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-21T06:25:54.059 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-21T06:25:54.059 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-21T06:25:54.059 INFO:teuthology.orchestra.run.smithi007.stdout:Generating new minimal ceph.conf... 2024-09-21T06:25:55.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:54 smithi007 ceph-mon[30605]: from='client.? 172.21.15.7:0/4249490535' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:25:55.238 INFO:teuthology.orchestra.run.smithi007.stdout:Restarting the monitor... 2024-09-21T06:25:55.560 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:55 smithi007 systemd[1]: Stopping Ceph mon.a for 347cb918-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:25:56.671 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:56 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mon-a[30601]: 2024-09-21T06:25:56.351+0000 7fe0a23a0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:25:56.671 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:56 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mon-a[30601]: 2024-09-21T06:25:56.351+0000 7fe0a23a0640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-21T06:25:56.671 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:56 smithi007 podman[30859]: 2024-09-21 06:25:56.382664016 +0000 UTC m=+0.984682858 container died 7c254d9d29487b11e94b14403abfb2a89a2545b104ff79873cfc1defea9c2298 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mon-a, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0) 2024-09-21T06:25:57.003 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:56 smithi007 podman[30859]: 2024-09-21 06:25:56.776044153 +0000 UTC m=+1.378062991 container cleanup 7c254d9d29487b11e94b14403abfb2a89a2545b104ff79873cfc1defea9c2298 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mon-a, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-21T06:25:57.003 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:56 smithi007 bash[30859]: ceph-347cb918-77e2-11ef-baf5-efdc52797490-mon-a 2024-09-21T06:25:57.337 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 podman[30872]: 2024-09-21 06:25:57.00191682 +0000 UTC m=+0.611642310 container remove 7c254d9d29487b11e94b14403abfb2a89a2545b104ff79873cfc1defea9c2298 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mon-a, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-21T06:25:57.337 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 systemd[1]: ceph-347cb918-77e2-11ef-baf5-efdc52797490@mon.a.service: Deactivated successfully. 2024-09-21T06:25:57.337 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 systemd[1]: Stopped Ceph mon.a for 347cb918-77e2-11ef-baf5-efdc52797490. 2024-09-21T06:25:57.337 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 systemd[1]: Starting Ceph mon.a for 347cb918-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:25:57.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 podman[30964]: 2024-09-21 06:25:57.336006185 +0000 UTC m=+0.110396437 container create bb65e9bcd0004436a7a1d4028d121d805af79dcbb81f1350d21ee5a0f6b77eb8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-21T06:25:57.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 podman[30964]: 2024-09-21 06:25:57.241725162 +0000 UTC m=+0.016115422 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:25:57.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 podman[30964]: 2024-09-21 06:25:57.554804752 +0000 UTC m=+0.329195012 container init bb65e9bcd0004436a7a1d4028d121d805af79dcbb81f1350d21ee5a0f6b77eb8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mon-a, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-21T06:25:57.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 podman[30964]: 2024-09-21 06:25:57.558113617 +0000 UTC m=+0.332503870 container start bb65e9bcd0004436a7a1d4028d121d805af79dcbb81f1350d21ee5a0f6b77eb8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mon-a, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:25:57.628 INFO:teuthology.orchestra.run.smithi007.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-21T06:25:57.847 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: set uid:gid to 167:167 (ceph:ceph) 2024-09-21T06:25:57.847 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev), process ceph-mon, pid 2 2024-09-21T06:25:57.847 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: pidfile_write: ignore empty --pid-file 2024-09-21T06:25:57.847 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: load: jerasure load: lrc 2024-09-21T06:25:57.847 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: RocksDB version: 7.9.2 2024-09-21T06:25:57.847 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Git sha 0 2024-09-21T06:25:57.847 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Compile date 2024-09-20 22:29:49 2024-09-21T06:25:57.847 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: DB SUMMARY 2024-09-21T06:25:57.847 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: DB Session ID: CAUEK9CZAN9ZS3TVJZC1 2024-09-21T06:25:57.847 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: CURRENT file: CURRENT 2024-09-21T06:25:57.847 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: IDENTITY file: IDENTITY 2024-09-21T06:25:57.848 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-21T06:25:57.848 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-21T06:25:57.848 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 94782 ; 2024-09-21T06:25:57.848 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.error_if_exists: 0 2024-09-21T06:25:57.848 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.create_if_missing: 0 2024-09-21T06:25:57.848 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.paranoid_checks: 1 2024-09-21T06:25:57.848 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-21T06:25:57.848 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T06:25:57.848 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-21T06:25:57.848 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.env: 0x555969b28d60 2024-09-21T06:25:57.848 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.fs: PosixFileSystem 2024-09-21T06:25:57.848 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.info_log: 0x55596fb35360 2024-09-21T06:25:57.848 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.max_file_opening_threads: 16 2024-09-21T06:25:57.848 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.statistics: (nil) 2024-09-21T06:25:57.849 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.use_fsync: 0 2024-09-21T06:25:57.849 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.max_log_file_size: 0 2024-09-21T06:25:57.849 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T06:25:57.849 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T06:25:57.849 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.keep_log_file_num: 1000 2024-09-21T06:25:57.849 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.recycle_log_file_num: 0 2024-09-21T06:25:57.849 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.allow_fallocate: 1 2024-09-21T06:25:57.849 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.allow_mmap_reads: 0 2024-09-21T06:25:57.849 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.allow_mmap_writes: 0 2024-09-21T06:25:57.849 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.use_direct_reads: 0 2024-09-21T06:25:57.849 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T06:25:57.849 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.create_missing_column_families: 0 2024-09-21T06:25:57.849 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.db_log_dir: 2024-09-21T06:25:57.849 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.wal_dir: 2024-09-21T06:25:57.850 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T06:25:57.850 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T06:25:57.850 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T06:25:57.850 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T06:25:57.850 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T06:25:57.850 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T06:25:57.850 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.advise_random_on_open: 1 2024-09-21T06:25:57.850 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.db_write_buffer_size: 0 2024-09-21T06:25:57.850 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.write_buffer_manager: 0x55596fb39d60 2024-09-21T06:25:57.850 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T06:25:57.850 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T06:25:57.850 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T06:25:57.850 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.rate_limiter: (nil) 2024-09-21T06:25:57.850 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T06:25:57.851 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.wal_recovery_mode: 2 2024-09-21T06:25:57.851 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.enable_thread_tracking: 0 2024-09-21T06:25:57.851 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.enable_pipelined_write: 0 2024-09-21T06:25:57.851 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.unordered_write: 0 2024-09-21T06:25:57.851 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T06:25:57.851 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T06:25:57.851 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T06:25:57.851 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T06:25:57.851 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.row_cache: None 2024-09-21T06:25:57.851 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.wal_filter: None 2024-09-21T06:25:57.851 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T06:25:57.851 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.allow_ingest_behind: 0 2024-09-21T06:25:57.851 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.two_write_queues: 0 2024-09-21T06:25:57.851 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.manual_wal_flush: 0 2024-09-21T06:25:57.852 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.wal_compression: 0 2024-09-21T06:25:57.852 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.atomic_flush: 0 2024-09-21T06:25:57.852 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T06:25:57.852 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T06:25:57.852 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T06:25:57.852 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.log_readahead_size: 0 2024-09-21T06:25:57.852 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T06:25:57.852 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.best_efforts_recovery: 0 2024-09-21T06:25:57.852 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T06:25:57.852 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T06:25:57.852 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.allow_data_in_errors: 0 2024-09-21T06:25:57.852 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.db_host_id: __hostname__ 2024-09-21T06:25:57.852 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T06:25:57.853 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.max_background_jobs: 2 2024-09-21T06:25:57.854 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.max_background_compactions: -1 2024-09-21T06:25:57.854 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.max_subcompactions: 1 2024-09-21T06:25:57.854 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T06:25:57.854 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T06:25:57.854 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T06:25:57.854 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.max_total_wal_size: 0 2024-09-21T06:25:57.854 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T06:25:57.854 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T06:25:57.854 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T06:25:57.854 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T06:25:57.854 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.max_open_files: -1 2024-09-21T06:25:57.854 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.bytes_per_sync: 0 2024-09-21T06:25:57.854 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T06:25:57.854 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T06:25:57.855 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.compaction_readahead_size: 0 2024-09-21T06:25:57.855 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.max_background_flushes: -1 2024-09-21T06:25:57.855 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Compression algorithms supported: 2024-09-21T06:25:57.855 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: kZSTD supported: 0 2024-09-21T06:25:57.855 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: kXpressCompression supported: 0 2024-09-21T06:25:57.855 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: kBZip2Compression supported: 0 2024-09-21T06:25:57.855 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T06:25:57.855 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: kLZ4Compression supported: 1 2024-09-21T06:25:57.855 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: kZlibCompression supported: 1 2024-09-21T06:25:57.855 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: kLZ4HCCompression supported: 1 2024-09-21T06:25:57.855 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: kSnappyCompression supported: 1 2024-09-21T06:25:57.855 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T06:25:57.855 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T06:25:57.855 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-21T06:25:57.856 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T06:25:57.856 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T06:25:57.856 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.merge_operator: 2024-09-21T06:25:57.856 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.compaction_filter: None 2024-09-21T06:25:57.856 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.compaction_filter_factory: None 2024-09-21T06:25:57.856 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.sst_partitioner_factory: None 2024-09-21T06:25:57.856 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T06:25:57.856 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T06:25:57.856 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55596fb34fa0) 2024-09-21T06:25:57.856 INFO:journalctl@ceph.mon.a.smithi007.stdout: cache_index_and_filter_blocks: 1 2024-09-21T06:25:57.856 INFO:journalctl@ceph.mon.a.smithi007.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T06:25:57.856 INFO:journalctl@ceph.mon.a.smithi007.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T06:25:57.856 INFO:journalctl@ceph.mon.a.smithi007.stdout: pin_top_level_index_and_filter: 1 2024-09-21T06:25:57.856 INFO:journalctl@ceph.mon.a.smithi007.stdout: index_type: 0 2024-09-21T06:25:57.857 INFO:journalctl@ceph.mon.a.smithi007.stdout: data_block_index_type: 0 2024-09-21T06:25:57.857 INFO:journalctl@ceph.mon.a.smithi007.stdout: index_shortening: 1 2024-09-21T06:25:57.857 INFO:journalctl@ceph.mon.a.smithi007.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-21T06:25:57.857 INFO:journalctl@ceph.mon.a.smithi007.stdout: checksum: 4 2024-09-21T06:25:57.857 INFO:journalctl@ceph.mon.a.smithi007.stdout: no_block_cache: 0 2024-09-21T06:25:57.857 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_cache: 0x55596baf9610 2024-09-21T06:25:57.857 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_cache_name: BinnedLRUCache 2024-09-21T06:25:57.857 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_cache_options: 2024-09-21T06:25:57.857 INFO:journalctl@ceph.mon.a.smithi007.stdout: capacity : 536870912 2024-09-21T06:25:57.857 INFO:journalctl@ceph.mon.a.smithi007.stdout: num_shard_bits : 4 2024-09-21T06:25:57.857 INFO:journalctl@ceph.mon.a.smithi007.stdout: strict_capacity_limit : 0 2024-09-21T06:25:57.857 INFO:journalctl@ceph.mon.a.smithi007.stdout: high_pri_pool_ratio: 0.000 2024-09-21T06:25:57.857 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_cache_compressed: (nil) 2024-09-21T06:25:57.857 INFO:journalctl@ceph.mon.a.smithi007.stdout: persistent_cache: (nil) 2024-09-21T06:25:57.857 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_size: 4096 2024-09-21T06:25:57.858 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_size_deviation: 10 2024-09-21T06:25:57.858 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_restart_interval: 16 2024-09-21T06:25:57.858 INFO:journalctl@ceph.mon.a.smithi007.stdout: index_block_restart_interval: 1 2024-09-21T06:25:57.858 INFO:journalctl@ceph.mon.a.smithi007.stdout: metadata_block_size: 4096 2024-09-21T06:25:57.858 INFO:journalctl@ceph.mon.a.smithi007.stdout: partition_filters: 0 2024-09-21T06:25:57.858 INFO:journalctl@ceph.mon.a.smithi007.stdout: use_delta_encoding: 1 2024-09-21T06:25:57.858 INFO:journalctl@ceph.mon.a.smithi007.stdout: filter_policy: bloomfilter 2024-09-21T06:25:57.858 INFO:journalctl@ceph.mon.a.smithi007.stdout: whole_key_filtering: 1 2024-09-21T06:25:57.858 INFO:journalctl@ceph.mon.a.smithi007.stdout: verify_compression: 0 2024-09-21T06:25:57.858 INFO:journalctl@ceph.mon.a.smithi007.stdout: read_amp_bytes_per_bit: 0 2024-09-21T06:25:57.858 INFO:journalctl@ceph.mon.a.smithi007.stdout: format_version: 5 2024-09-21T06:25:57.858 INFO:journalctl@ceph.mon.a.smithi007.stdout: enable_index_compression: 1 2024-09-21T06:25:57.858 INFO:journalctl@ceph.mon.a.smithi007.stdout: block_align: 0 2024-09-21T06:25:57.858 INFO:journalctl@ceph.mon.a.smithi007.stdout: max_auto_readahead_size: 262144 2024-09-21T06:25:57.858 INFO:journalctl@ceph.mon.a.smithi007.stdout: prepopulate_block_cache: 0 2024-09-21T06:25:57.859 INFO:journalctl@ceph.mon.a.smithi007.stdout: initial_auto_readahead_size: 8192 2024-09-21T06:25:57.859 INFO:journalctl@ceph.mon.a.smithi007.stdout: num_file_reads_for_auto_readahead: 2 2024-09-21T06:25:57.859 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.write_buffer_size: 33554432 2024-09-21T06:25:57.859 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.max_write_buffer_number: 2 2024-09-21T06:25:57.859 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.compression: NoCompression 2024-09-21T06:25:57.859 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.bottommost_compression: Disabled 2024-09-21T06:25:57.859 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.prefix_extractor: nullptr 2024-09-21T06:25:57.859 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T06:25:57.859 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.num_levels: 7 2024-09-21T06:25:57.859 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T06:25:57.859 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T06:25:57.859 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T06:25:57.859 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T06:25:57.859 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T06:25:57.860 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T06:25:57.860 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T06:25:57.860 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T06:25:57.860 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T06:25:57.860 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T06:25:57.860 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T06:25:57.860 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T06:25:57.860 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T06:25:57.860 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.compression_opts.level: 32767 2024-09-21T06:25:57.860 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.compression_opts.strategy: 0 2024-09-21T06:25:57.860 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T06:25:57.860 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T06:25:57.860 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T06:25:57.860 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T06:25:57.861 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.compression_opts.enabled: false 2024-09-21T06:25:57.861 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T06:25:57.861 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T06:25:57.861 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T06:25:57.861 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T06:25:57.861 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.target_file_size_base: 67108864 2024-09-21T06:25:57.861 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T06:25:57.861 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T06:25:57.861 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T06:25:57.861 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T06:25:57.861 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T06:25:57.861 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T06:25:57.861 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T06:25:57.861 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T06:25:57.861 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T06:25:57.862 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T06:25:57.862 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T06:25:57.862 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T06:25:57.862 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T06:25:57.862 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T06:25:57.862 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.arena_block_size: 1048576 2024-09-21T06:25:57.862 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T06:25:57.862 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T06:25:57.862 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.disable_auto_compactions: 0 2024-09-21T06:25:57.862 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T06:25:57.862 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T06:25:57.862 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T06:25:57.862 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T06:25:57.862 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T06:25:57.863 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T06:25:57.863 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T06:25:57.863 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T06:25:57.863 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T06:25:57.863 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T06:25:57.863 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T06:25:57.863 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.inplace_update_support: 0 2024-09-21T06:25:57.863 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T06:25:57.863 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T06:25:57.863 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T06:25:57.863 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T06:25:57.863 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.bloom_locality: 0 2024-09-21T06:25:57.863 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.max_successive_merges: 0 2024-09-21T06:25:57.863 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T06:25:57.863 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.paranoid_file_checks: 0 2024-09-21T06:25:57.864 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.force_consistency_checks: 1 2024-09-21T06:25:57.864 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.report_bg_io_stats: 0 2024-09-21T06:25:57.864 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.ttl: 2592000 2024-09-21T06:25:57.864 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T06:25:57.864 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T06:25:57.864 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T06:25:57.864 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.enable_blob_files: false 2024-09-21T06:25:57.864 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.min_blob_size: 0 2024-09-21T06:25:57.864 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.blob_file_size: 268435456 2024-09-21T06:25:57.864 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T06:25:57.864 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T06:25:57.864 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T06:25:57.864 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T06:25:57.864 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T06:25:57.865 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.blob_file_starting_level: 0 2024-09-21T06:25:57.865 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T06:25:57.865 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-21T06:25:57.865 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-21T06:25:57.865 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 895627d1-5daa-42db-a172-d35241c0a48d 2024-09-21T06:25:57.865 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726899957594858, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-21T06:25:57.865 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-21T06:25:57.865 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726899957596040, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 91033, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 283, "table_properties": {"data_size": 89074, "index_size": 279, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 11597, "raw_average_key_size": 47, "raw_value_size": 82482, "raw_average_value_size": 340, "num_data_blocks": 12, "num_entries": 242, "num_filter_entries": 242, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726899957, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "895627d1-5daa-42db-a172-d35241c0a48d", "db_session_id": "CAUEK9CZAN9ZS3TVJZC1", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-21T06:25:57.865 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726899957596123, "job": 1, "event": "recovery_finished"} 2024-09-21T06:25:57.865 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-21T06:25:57.865 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T06:25:57.865 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55596fb58a80 2024-09-21T06:25:57.865 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: DB pointer 0x5559708fe000 2024-09-21T06:25:57.866 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T06:25:57.866 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T06:25:57.866 INFO:journalctl@ceph.mon.a.smithi007.stdout: ** DB Stats ** 2024-09-21T06:25:57.866 INFO:journalctl@ceph.mon.a.smithi007.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T06:25:57.866 INFO:journalctl@ceph.mon.a.smithi007.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T06:25:57.866 INFO:journalctl@ceph.mon.a.smithi007.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T06:25:57.866 INFO:journalctl@ceph.mon.a.smithi007.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T06:25:57.866 INFO:journalctl@ceph.mon.a.smithi007.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T06:25:57.866 INFO:journalctl@ceph.mon.a.smithi007.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T06:25:57.866 INFO:journalctl@ceph.mon.a.smithi007.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T06:25:57.866 INFO:journalctl@ceph.mon.a.smithi007.stdout: 2024-09-21T06:25:57.866 INFO:journalctl@ceph.mon.a.smithi007.stdout: ** Compaction Stats [default] ** 2024-09-21T06:25:57.866 INFO:journalctl@ceph.mon.a.smithi007.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T06:25:57.866 INFO:journalctl@ceph.mon.a.smithi007.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T06:25:57.867 INFO:journalctl@ceph.mon.a.smithi007.stdout: L0 2/0 90.76 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 124.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T06:25:57.867 INFO:journalctl@ceph.mon.a.smithi007.stdout: Sum 2/0 90.76 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 124.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T06:25:57.867 INFO:journalctl@ceph.mon.a.smithi007.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 124.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T06:25:57.867 INFO:journalctl@ceph.mon.a.smithi007.stdout: 2024-09-21T06:25:57.867 INFO:journalctl@ceph.mon.a.smithi007.stdout: ** Compaction Stats [default] ** 2024-09-21T06:25:57.867 INFO:journalctl@ceph.mon.a.smithi007.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T06:25:57.867 INFO:journalctl@ceph.mon.a.smithi007.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T06:25:57.867 INFO:journalctl@ceph.mon.a.smithi007.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 124.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T06:25:57.867 INFO:journalctl@ceph.mon.a.smithi007.stdout: 2024-09-21T06:25:57.867 INFO:journalctl@ceph.mon.a.smithi007.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T06:25:57.867 INFO:journalctl@ceph.mon.a.smithi007.stdout: 2024-09-21T06:25:57.867 INFO:journalctl@ceph.mon.a.smithi007.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T06:25:57.867 INFO:journalctl@ceph.mon.a.smithi007.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-21T06:25:57.867 INFO:journalctl@ceph.mon.a.smithi007.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T06:25:57.867 INFO:journalctl@ceph.mon.a.smithi007.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T06:25:57.868 INFO:journalctl@ceph.mon.a.smithi007.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T06:25:57.868 INFO:journalctl@ceph.mon.a.smithi007.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-21T06:25:57.868 INFO:journalctl@ceph.mon.a.smithi007.stdout: Cumulative compaction: 0.00 GB write, 25.61 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T06:25:57.868 INFO:journalctl@ceph.mon.a.smithi007.stdout: Interval compaction: 0.00 GB write, 25.61 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T06:25:57.868 INFO:journalctl@ceph.mon.a.smithi007.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T06:25:57.868 INFO:journalctl@ceph.mon.a.smithi007.stdout: Block cache BinnedLRUCache@0x55596baf9610#2 capacity: 512.00 MB usage: 1.31 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-21T06:25:57.868 INFO:journalctl@ceph.mon.a.smithi007.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.84 KB,0.000160933%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-09-21T06:25:57.868 INFO:journalctl@ceph.mon.a.smithi007.stdout: 2024-09-21T06:25:57.868 INFO:journalctl@ceph.mon.a.smithi007.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-21T06:25:57.868 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: starting mon.a rank 0 at public addrs [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] at bind addrs [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 347cb918-77e2-11ef-baf5-efdc52797490 2024-09-21T06:25:57.868 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: mon.a@-1(???) e1 preinit fsid 347cb918-77e2-11ef-baf5-efdc52797490 2024-09-21T06:25:57.868 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: mon.a@-1(???).mds e1 new map 2024-09-21T06:25:57.868 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: mon.a@-1(???).mds e1 print_map 2024-09-21T06:25:57.868 INFO:journalctl@ceph.mon.a.smithi007.stdout: e1 2024-09-21T06:25:57.869 INFO:journalctl@ceph.mon.a.smithi007.stdout: btime 2024-09-21T06:25:51:924836+0000 2024-09-21T06:25:57.869 INFO:journalctl@ceph.mon.a.smithi007.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T06:25:57.869 INFO:journalctl@ceph.mon.a.smithi007.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T06:25:57.869 INFO:journalctl@ceph.mon.a.smithi007.stdout: legacy client fscid: -1 2024-09-21T06:25:57.869 INFO:journalctl@ceph.mon.a.smithi007.stdout: 2024-09-21T06:25:57.869 INFO:journalctl@ceph.mon.a.smithi007.stdout: No filesystems configured 2024-09-21T06:25:57.869 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-21T06:25:57.869 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T06:25:57.869 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T06:25:57.869 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T06:25:57.869 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-21T06:25:57.869 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 bash[30964]: bb65e9bcd0004436a7a1d4028d121d805af79dcbb81f1350d21ee5a0f6b77eb8 2024-09-21T06:25:57.869 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 systemd[1]: Started Ceph mon.a for 347cb918-77e2-11ef-baf5-efdc52797490. 2024-09-21T06:25:57.869 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-21T06:25:57.870 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: monmap epoch 1 2024-09-21T06:25:57.870 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: fsid 347cb918-77e2-11ef-baf5-efdc52797490 2024-09-21T06:25:57.870 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: last_changed 2024-09-21T06:25:38.421457+0000 2024-09-21T06:25:57.870 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: created 2024-09-21T06:25:38.421457+0000 2024-09-21T06:25:57.870 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: min_mon_release 19 (squid) 2024-09-21T06:25:57.870 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: election_strategy: 1 2024-09-21T06:25:57.870 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: 0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-21T06:25:57.870 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: fsmap 2024-09-21T06:25:57.870 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: osdmap e1: 0 total, 0 up, 0 in 2024-09-21T06:25:57.870 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:57 smithi007 ceph-mon[30983]: mgrmap e1: no daemons active 2024-09-21T06:25:58.640 INFO:teuthology.orchestra.run.smithi007.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-21T06:25:58.662 INFO:teuthology.orchestra.run.smithi007.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-21T06:25:58.662 INFO:teuthology.orchestra.run.smithi007.stdout:Creating mgr... 2024-09-21T06:25:58.662 INFO:teuthology.orchestra.run.smithi007.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-21T06:25:58.663 INFO:teuthology.orchestra.run.smithi007.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-21T06:25:58.934 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-347cb918-77e2-11ef-baf5-efdc52797490@mgr.x 2024-09-21T06:25:58.934 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stderr Failed to reset failed state of unit ceph-347cb918-77e2-11ef-baf5-efdc52797490@mgr.x.service: Unit ceph-347cb918-77e2-11ef-baf5-efdc52797490@mgr.x.service not loaded. 2024-09-21T06:25:59.099 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-347cb918-77e2-11ef-baf5-efdc52797490.target.wants/ceph-347cb918-77e2-11ef-baf5-efdc52797490@mgr.x.service → /etc/systemd/system/ceph-347cb918-77e2-11ef-baf5-efdc52797490@.service. 2024-09-21T06:25:59.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:25:59 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/4046521413' entity='client.admin' 2024-09-21T06:25:59.640 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T06:25:59.640 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout disabled 2024-09-21T06:25:59.648 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T06:25:59.648 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout inactive 2024-09-21T06:25:59.648 INFO:teuthology.orchestra.run.smithi007.stdout:firewalld.service is not enabled 2024-09-21T06:25:59.648 INFO:teuthology.orchestra.run.smithi007.stdout:Not possible to enable service . firewalld.service is not available 2024-09-21T06:25:59.657 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T06:25:59.657 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout disabled 2024-09-21T06:25:59.665 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T06:25:59.665 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout inactive 2024-09-21T06:25:59.665 INFO:teuthology.orchestra.run.smithi007.stdout:firewalld.service is not enabled 2024-09-21T06:25:59.665 INFO:teuthology.orchestra.run.smithi007.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-21T06:25:59.665 INFO:teuthology.orchestra.run.smithi007.stdout:Waiting for mgr to start... 2024-09-21T06:25:59.665 INFO:teuthology.orchestra.run.smithi007.stdout:Waiting for mgr... 2024-09-21T06:25:59.790 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:25:59 smithi007 systemd[1]: Started Ceph mgr.x for 347cb918-77e2-11ef-baf5-efdc52797490. 2024-09-21T06:26:00.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:00 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2785174313' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-21T06:26:00.709 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 2024-09-21T06:26:00.715 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout { 2024-09-21T06:26:00.715 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "fsid": "347cb918-77e2-11ef-baf5-efdc52797490", 2024-09-21T06:26:00.715 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T06:26:00.715 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T06:26:00.715 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T06:26:00.715 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T06:26:00.716 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:26:00.716 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T06:26:00.716 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T06:26:00.716 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 0 2024-09-21T06:26:00.716 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout ], 2024-09-21T06:26:00.716 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T06:26:00.716 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T06:26:00.716 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout ], 2024-09-21T06:26:00.716 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-21T06:26:00.716 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T06:26:00.716 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T06:26:00.716 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T06:26:00.716 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T06:26:00.717 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:26:00.717 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T06:26:00.717 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T06:26:00.717 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T06:26:00.717 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T06:26:00.717 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T06:26:00.717 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T06:26:00.717 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T06:26:00.717 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T06:26:00.717 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:26:00.717 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T06:26:00.717 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T06:26:00.717 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T06:26:00.717 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T06:26:00.717 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T06:26:00.718 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T06:26:00.718 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T06:26:00.718 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T06:26:00.718 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T06:26:00.718 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:26:00.718 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T06:26:00.718 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T06:26:00.718 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T06:25:51:924836+0000", 2024-09-21T06:26:00.718 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T06:26:00.718 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T06:26:00.718 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:26:00.718 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T06:26:00.718 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-21T06:26:00.719 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T06:26:00.719 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T06:26:00.719 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T06:26:00.719 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T06:26:00.719 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T06:26:00.719 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout ], 2024-09-21T06:26:00.719 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T06:26:00.719 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:26:00.719 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T06:26:00.719 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T06:26:00.719 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T06:25:51.925778+0000", 2024-09-21T06:26:00.719 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T06:26:00.719 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:26:00.720 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T06:26:00.720 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout } 2024-09-21T06:26:00.720 INFO:teuthology.orchestra.run.smithi007.stdout:mgr not available, waiting (1/15)... 2024-09-21T06:26:03.589 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:03 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/1657451911' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-21T06:26:03.837 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 2024-09-21T06:26:03.837 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout { 2024-09-21T06:26:03.837 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "fsid": "347cb918-77e2-11ef-baf5-efdc52797490", 2024-09-21T06:26:03.837 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T06:26:03.837 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T06:26:03.837 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T06:26:03.837 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T06:26:03.837 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:26:03.837 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T06:26:03.838 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T06:26:03.838 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 0 2024-09-21T06:26:03.838 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout ], 2024-09-21T06:26:03.838 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T06:26:03.838 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T06:26:03.838 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout ], 2024-09-21T06:26:03.838 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-09-21T06:26:03.838 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T06:26:03.838 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T06:26:03.838 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T06:26:03.838 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T06:26:03.838 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:26:03.838 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T06:26:03.838 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T06:26:03.839 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T06:26:03.839 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T06:26:03.839 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T06:26:03.842 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T06:26:03.842 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T06:26:03.842 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T06:26:03.842 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:26:03.842 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T06:26:03.842 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T06:26:03.842 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T06:26:03.842 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T06:26:03.843 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T06:26:03.843 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T06:26:03.843 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T06:26:03.843 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T06:26:03.843 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T06:26:03.843 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:26:03.843 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T06:26:03.843 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T06:26:03.843 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T06:25:51:924836+0000", 2024-09-21T06:26:03.843 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T06:26:03.843 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T06:26:03.843 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:26:03.843 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T06:26:03.843 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-21T06:26:03.843 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T06:26:03.844 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T06:26:03.844 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T06:26:03.844 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T06:26:03.844 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T06:26:03.844 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout ], 2024-09-21T06:26:03.844 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T06:26:03.844 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:26:03.844 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T06:26:03.844 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T06:26:03.844 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T06:25:51.925778+0000", 2024-09-21T06:26:03.844 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T06:26:03.844 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:26:03.844 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T06:26:03.844 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout } 2024-09-21T06:26:03.844 INFO:teuthology.orchestra.run.smithi007.stdout:mgr not available, waiting (2/15)... 2024-09-21T06:26:05.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:04 smithi007 ceph-mon[30983]: Activating manager daemon x 2024-09-21T06:26:05.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:04 smithi007 ceph-mon[30983]: mgrmap e2: x(active, starting, since 0.00349688s) 2024-09-21T06:26:05.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:04 smithi007 ceph-mon[30983]: from='mgr.14100 172.21.15.7:0/765777239' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T06:26:05.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:04 smithi007 ceph-mon[30983]: from='mgr.14100 172.21.15.7:0/765777239' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T06:26:05.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:04 smithi007 ceph-mon[30983]: from='mgr.14100 172.21.15.7:0/765777239' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T06:26:05.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:04 smithi007 ceph-mon[30983]: from='mgr.14100 172.21.15.7:0/765777239' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:26:05.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:04 smithi007 ceph-mon[30983]: from='mgr.14100 172.21.15.7:0/765777239' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T06:26:05.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:04 smithi007 ceph-mon[30983]: Manager daemon x is now available 2024-09-21T06:26:05.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:04 smithi007 ceph-mon[30983]: from='mgr.14100 172.21.15.7:0/765777239' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T06:26:05.341 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:04 smithi007 ceph-mon[30983]: from='mgr.14100 172.21.15.7:0/765777239' entity='mgr.x' 2024-09-21T06:26:05.341 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:04 smithi007 ceph-mon[30983]: from='mgr.14100 172.21.15.7:0/765777239' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T06:26:05.341 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:04 smithi007 ceph-mon[30983]: from='mgr.14100 172.21.15.7:0/765777239' entity='mgr.x' 2024-09-21T06:26:05.341 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:04 smithi007 ceph-mon[30983]: from='mgr.14100 172.21.15.7:0/765777239' entity='mgr.x' 2024-09-21T06:26:07.061 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:06 smithi007 ceph-mon[30983]: mgrmap e3: x(active, since 1.0081s) 2024-09-21T06:26:07.061 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:06 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/4034068557' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-21T06:26:07.065 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 2024-09-21T06:26:07.065 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout { 2024-09-21T06:26:07.065 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "fsid": "347cb918-77e2-11ef-baf5-efdc52797490", 2024-09-21T06:26:07.066 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T06:26:07.066 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T06:26:07.066 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T06:26:07.066 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T06:26:07.066 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:26:07.066 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T06:26:07.066 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T06:26:07.066 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 0 2024-09-21T06:26:07.066 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout ], 2024-09-21T06:26:07.066 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T06:26:07.066 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T06:26:07.066 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout ], 2024-09-21T06:26:07.066 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2024-09-21T06:26:07.066 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T06:26:07.067 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T06:26:07.067 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T06:26:07.067 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T06:26:07.067 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:26:07.067 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T06:26:07.067 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T06:26:07.067 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T06:26:07.067 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T06:26:07.067 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T06:26:07.067 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T06:26:07.067 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T06:26:07.067 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T06:26:07.072 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:26:07.072 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T06:26:07.072 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T06:26:07.072 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T06:26:07.072 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T06:26:07.072 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T06:26:07.072 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T06:26:07.073 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T06:26:07.073 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T06:26:07.073 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T06:26:07.073 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:26:07.073 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T06:26:07.073 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T06:26:07.073 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T06:25:51:924836+0000", 2024-09-21T06:26:07.073 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T06:26:07.073 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T06:26:07.073 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:26:07.073 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T06:26:07.073 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T06:26:07.073 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T06:26:07.074 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T06:26:07.074 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T06:26:07.074 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T06:26:07.074 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T06:26:07.074 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout ], 2024-09-21T06:26:07.074 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T06:26:07.074 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:26:07.074 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T06:26:07.074 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T06:26:07.074 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T06:25:51.925778+0000", 2024-09-21T06:26:07.074 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T06:26:07.074 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout }, 2024-09-21T06:26:07.074 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T06:26:07.074 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout } 2024-09-21T06:26:07.074 INFO:teuthology.orchestra.run.smithi007.stdout:mgr is available 2024-09-21T06:26:07.966 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:07 smithi007 ceph-mon[30983]: mgrmap e4: x(active, since 2s) 2024-09-21T06:26:07.966 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:07 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/244160389' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-21T06:26:08.213 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 2024-09-21T06:26:08.213 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout [global] 2024-09-21T06:26:08.213 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout fsid = 347cb918-77e2-11ef-baf5-efdc52797490 2024-09-21T06:26:08.213 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-21T06:26:08.213 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.7:3300,v1:172.21.15.7:6789] 2024-09-21T06:26:08.213 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-21T06:26:08.213 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-21T06:26:08.213 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-21T06:26:08.213 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-21T06:26:08.213 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 2024-09-21T06:26:08.213 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-21T06:26:08.214 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-21T06:26:08.214 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 2024-09-21T06:26:08.214 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout [osd] 2024-09-21T06:26:08.214 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-21T06:26:08.214 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-21T06:26:08.214 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-21T06:26:08.214 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-21T06:26:08.214 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-21T06:26:08.214 INFO:teuthology.orchestra.run.smithi007.stdout:Enabling cephadm module... 2024-09-21T06:26:09.225 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:08 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/3899833491' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2024-09-21T06:26:09.226 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:26:08 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: ignoring --setuser ceph since I am not root 2024-09-21T06:26:09.226 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:26:08 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: ignoring --setgroup ceph since I am not root 2024-09-21T06:26:10.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:09 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/3899833491' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-21T06:26:10.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:09 smithi007 ceph-mon[30983]: mgrmap e5: x(active, since 4s) 2024-09-21T06:26:10.753 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout { 2024-09-21T06:26:10.753 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-21T06:26:10.753 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T06:26:10.753 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-21T06:26:10.753 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-21T06:26:10.753 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout } 2024-09-21T06:26:10.753 INFO:teuthology.orchestra.run.smithi007.stdout:Waiting for the mgr to restart... 2024-09-21T06:26:10.753 INFO:teuthology.orchestra.run.smithi007.stdout:Waiting for mgr epoch 5... 2024-09-21T06:26:11.060 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:10 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2837466733' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-21T06:26:14.589 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:14 smithi007 ceph-mon[30983]: Active manager daemon x restarted 2024-09-21T06:26:14.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:14 smithi007 ceph-mon[30983]: Activating manager daemon x 2024-09-21T06:26:14.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:14 smithi007 ceph-mon[30983]: osdmap e2: 0 total, 0 up, 0 in 2024-09-21T06:26:14.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:14 smithi007 ceph-mon[30983]: mgrmap e6: x(active, starting, since 0.00390359s) 2024-09-21T06:26:14.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:14 smithi007 ceph-mon[30983]: from='mgr.14118 172.21.15.7:0/3669008835' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:26:14.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:14 smithi007 ceph-mon[30983]: from='mgr.14118 172.21.15.7:0/3669008835' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T06:26:14.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:14 smithi007 ceph-mon[30983]: from='mgr.14118 172.21.15.7:0/3669008835' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T06:26:14.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:14 smithi007 ceph-mon[30983]: from='mgr.14118 172.21.15.7:0/3669008835' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T06:26:14.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:14 smithi007 ceph-mon[30983]: from='mgr.14118 172.21.15.7:0/3669008835' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T06:26:14.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:14 smithi007 ceph-mon[30983]: Manager daemon x is now available 2024-09-21T06:26:15.742 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout { 2024-09-21T06:26:15.743 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-21T06:26:15.743 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-21T06:26:15.743 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout } 2024-09-21T06:26:15.743 INFO:teuthology.orchestra.run.smithi007.stdout:mgr epoch 5 is available 2024-09-21T06:26:15.743 INFO:teuthology.orchestra.run.smithi007.stdout:Verifying orchestrator module is enabled... 2024-09-21T06:26:16.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:16 smithi007 ceph-mon[30983]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-21T06:26:16.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:16 smithi007 ceph-mon[30983]: mgrmap e7: x(active, since 1.00651s) 2024-09-21T06:26:16.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:16 smithi007 ceph-mon[30983]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-21T06:26:17.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:17 smithi007 ceph-mon[30983]: from='mgr.14118 172.21.15.7:0/3669008835' entity='mgr.x' 2024-09-21T06:26:17.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:17 smithi007 ceph-mon[30983]: from='mgr.14118 172.21.15.7:0/3669008835' entity='mgr.x' 2024-09-21T06:26:17.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:17 smithi007 ceph-mon[30983]: Found migration_current of "None". Setting to last migration. 2024-09-21T06:26:17.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:17 smithi007 ceph-mon[30983]: from='mgr.14118 172.21.15.7:0/3669008835' entity='mgr.x' 2024-09-21T06:26:17.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:17 smithi007 ceph-mon[30983]: from='mgr.14118 172.21.15.7:0/3669008835' entity='mgr.x' 2024-09-21T06:26:17.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:17 smithi007 ceph-mon[30983]: from='mgr.14118 172.21.15.7:0/3669008835' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:26:17.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:17 smithi007 ceph-mon[30983]: from='mgr.14118 172.21.15.7:0/3669008835' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:26:17.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:17 smithi007 ceph-mon[30983]: from='mgr.14118 172.21.15.7:0/3669008835' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T06:26:17.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:17 smithi007 ceph-mon[30983]: from='mgr.14118 172.21.15.7:0/3669008835' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T06:26:17.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:17 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2832072744' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "orchestrator"} : dispatch 2024-09-21T06:26:17.591 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:26:17 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: 2024-09-21T06:26:17.483+0000 7fe6df848640 -1 log_channel(cephadm) log [ERR] : [21/Sep/2024:06:26:17] ENGINE Error in HTTPServer.serve 2024-09-21T06:26:17.591 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:26:17 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: Traceback (most recent call last): 2024-09-21T06:26:17.591 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:26:17 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T06:26:17.591 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:26:17 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: self._connections.run(self.expiration_interval) 2024-09-21T06:26:17.591 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:26:17 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T06:26:17.591 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:26:17 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: self._run(expiration_interval) 2024-09-21T06:26:17.591 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:26:17 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T06:26:17.591 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:26:17 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T06:26:17.591 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:26:17 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T06:26:17.591 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:26:17 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T06:26:17.591 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:26:17 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T06:26:17.591 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:26:17 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: s = self.context.wrap_socket( 2024-09-21T06:26:17.592 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:26:17 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T06:26:17.592 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:26:17 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: return self.sslsocket_class._create( 2024-09-21T06:26:17.592 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:26:17 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T06:26:17.592 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:26:17 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: self.do_handshake() 2024-09-21T06:26:17.592 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:26:17 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T06:26:17.592 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:26:17 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: self._sslobj.do_handshake() 2024-09-21T06:26:17.592 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:26:17 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T06:26:17.592 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:26:17 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: 2024-09-21T06:26:18.091 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr module 'orchestrator' is already enabled (always-on) 2024-09-21T06:26:18.091 INFO:teuthology.orchestra.run.smithi007.stdout:Setting orchestrator backend to cephadm... 2024-09-21T06:26:18.507 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:18 smithi007 ceph-mon[30983]: [21/Sep/2024:06:26:17] ENGINE Bus STARTING 2024-09-21T06:26:18.507 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:18 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2832072744' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "orchestrator"}]': finished 2024-09-21T06:26:18.507 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:18 smithi007 ceph-mon[30983]: mgrmap e8: x(active, since 3s) 2024-09-21T06:26:18.507 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:18 smithi007 ceph-mon[30983]: [21/Sep/2024:06:26:17] ENGINE Serving on http://172.21.15.7:8765 2024-09-21T06:26:18.507 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:18 smithi007 ceph-mon[30983]: [21/Sep/2024:06:26:17] ENGINE Serving on https://172.21.15.7:7150 2024-09-21T06:26:18.507 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:18 smithi007 ceph-mon[30983]: [21/Sep/2024:06:26:17] ENGINE Bus STARTED 2024-09-21T06:26:18.507 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:18 smithi007 ceph-mon[30983]: from='mgr.14118 172.21.15.7:0/3669008835' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:26:18.507 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:18 smithi007 ceph-mon[30983]: [21/Sep/2024:06:26:17] ENGINE Error in HTTPServer.serve 2024-09-21T06:26:18.507 INFO:journalctl@ceph.mon.a.smithi007.stdout: Traceback (most recent call last): 2024-09-21T06:26:18.508 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T06:26:18.508 INFO:journalctl@ceph.mon.a.smithi007.stdout: self._connections.run(self.expiration_interval) 2024-09-21T06:26:18.508 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T06:26:18.508 INFO:journalctl@ceph.mon.a.smithi007.stdout: self._run(expiration_interval) 2024-09-21T06:26:18.508 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T06:26:18.508 INFO:journalctl@ceph.mon.a.smithi007.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T06:26:18.508 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T06:26:18.508 INFO:journalctl@ceph.mon.a.smithi007.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T06:26:18.508 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T06:26:18.508 INFO:journalctl@ceph.mon.a.smithi007.stdout: s = self.context.wrap_socket( 2024-09-21T06:26:18.508 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T06:26:18.508 INFO:journalctl@ceph.mon.a.smithi007.stdout: return self.sslsocket_class._create( 2024-09-21T06:26:18.508 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T06:26:18.508 INFO:journalctl@ceph.mon.a.smithi007.stdout: self.do_handshake() 2024-09-21T06:26:18.508 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T06:26:18.509 INFO:journalctl@ceph.mon.a.smithi007.stdout: self._sslobj.do_handshake() 2024-09-21T06:26:18.509 INFO:journalctl@ceph.mon.a.smithi007.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T06:26:19.333 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:19 smithi007 ceph-mon[30983]: mgrmap e9: x(active, since 4s) 2024-09-21T06:26:19.333 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:19 smithi007 ceph-mon[30983]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:26:19.333 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:19 smithi007 ceph-mon[30983]: from='mgr.14118 172.21.15.7:0/3669008835' entity='mgr.x' 2024-09-21T06:26:19.333 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:19 smithi007 ceph-mon[30983]: from='mgr.14118 172.21.15.7:0/3669008835' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:26:20.501 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:20 smithi007 ceph-mon[30983]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:26:20.504 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-21T06:26:20.504 INFO:teuthology.orchestra.run.smithi007.stdout:Generating ssh key... 2024-09-21T06:26:21.590 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:26:21 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: Generating public/private rsa key pair. 2024-09-21T06:26:21.590 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:26:21 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: Your identification has been saved in /tmp/tmp9v1tlsth/key 2024-09-21T06:26:21.590 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:26:21 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: Your public key has been saved in /tmp/tmp9v1tlsth/key.pub 2024-09-21T06:26:21.591 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:26:21 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: The key fingerprint is: 2024-09-21T06:26:21.591 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:26:21 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: SHA256:Uqd54ip82ZGfpUtMCKDnGQfAnPv+MnizSkmIvKpu6u8 ceph-347cb918-77e2-11ef-baf5-efdc52797490 2024-09-21T06:26:21.591 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:26:21 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: The key's randomart image is: 2024-09-21T06:26:21.591 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:26:21 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: +---[RSA 3072]----+ 2024-09-21T06:26:21.591 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:26:21 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: | o.oo | 2024-09-21T06:26:21.591 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:26:21 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: | +. o | 2024-09-21T06:26:21.591 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:26:21 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: | ..o o . . | 2024-09-21T06:26:21.591 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:26:21 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: |o..o + o = | 2024-09-21T06:26:21.591 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:26:21 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: |o...o . S.o | 2024-09-21T06:26:21.591 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:26:21 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: | .... oo= . | 2024-09-21T06:26:21.591 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:26:21 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: | .o+ o.oo+ | 2024-09-21T06:26:21.591 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:26:21 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: |.o. O o...+ | 2024-09-21T06:26:21.591 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:26:21 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: |Xo+E.Oo .. | 2024-09-21T06:26:21.591 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:26:21 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: +----[SHA256]-----+ 2024-09-21T06:26:22.488 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:22 smithi007 ceph-mon[30983]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:26:22.488 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:22 smithi007 ceph-mon[30983]: Generating ssh key... 2024-09-21T06:26:22.488 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:22 smithi007 ceph-mon[30983]: from='mgr.14118 172.21.15.7:0/3669008835' entity='mgr.x' 2024-09-21T06:26:22.488 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:22 smithi007 ceph-mon[30983]: from='mgr.14118 172.21.15.7:0/3669008835' entity='mgr.x' 2024-09-21T06:26:23.017 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3zosxKseXYWVK7rtcSpaquhBDNB5vKsKz3jyLvSIcXTd58RTGTrqRz+Qv6Z4ZEDqyiQ3I/8mDIN4ragqZILO1FDOwljj8H+q5Dfr31nMvgKS9Q5y9bCUGYA4eptCPM8/n20xDO1cRCYQNhCurDoqM/Ml0yXFV/EJd0bbtH/ULfiak8PU0hnro3tohasTM8B6zrcMZyv0ecZiz5hdb3BT9O0yi2mh3Ksw6KznW9y6pOJK3rj4C1qhrynF+fR1Pf+CGYHREjw03ZvYcr/5I4IP6TEMgG9kD9N3LSwbqKJTwQE8afFoHbD58VvQj6xLar+hIohHVJJjD/pcJqFgw/o5GlLJB7a5K5AOWOvDd2ptnHo6VPM05J9KxOD4RG9s9JST2RWOhS1kXOylVz6As80ToY2TGSekKxYQPbe1w+miiSzsOOzAtTxUQxBhOAwKnd9hZhM5dFuosL6J4H6AOOK7nFwLbQj6Fka7HZsxDsMJ9iqawF4oaIByTxygaFVUOhQc= ceph-347cb918-77e2-11ef-baf5-efdc52797490 2024-09-21T06:26:23.018 INFO:teuthology.orchestra.run.smithi007.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-21T06:26:23.018 INFO:teuthology.orchestra.run.smithi007.stdout:Adding key to root@localhost authorized_keys... 2024-09-21T06:26:23.027 INFO:teuthology.orchestra.run.smithi007.stdout:Adding host smithi007... 2024-09-21T06:26:23.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:23 smithi007 ceph-mon[30983]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:26:24.377 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:24 smithi007 ceph-mon[30983]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi007", "addr": "172.21.15.7", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:26:25.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:25 smithi007 ceph-mon[30983]: Deploying cephadm binary to smithi007 2024-09-21T06:26:28.167 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout Added host 'smithi007' with addr '172.21.15.7' 2024-09-21T06:26:28.167 INFO:teuthology.orchestra.run.smithi007.stdout:Deploying unmanaged mon service... 2024-09-21T06:26:28.814 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:28 smithi007 ceph-mon[30983]: from='mgr.14118 172.21.15.7:0/3669008835' entity='mgr.x' 2024-09-21T06:26:28.815 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:28 smithi007 ceph-mon[30983]: Added host smithi007 2024-09-21T06:26:28.815 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:28 smithi007 ceph-mon[30983]: from='mgr.14118 172.21.15.7:0/3669008835' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:26:29.635 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-21T06:26:29.635 INFO:teuthology.orchestra.run.smithi007.stdout:Deploying unmanaged mgr service... 2024-09-21T06:26:29.935 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:29 smithi007 ceph-mon[30983]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:26:29.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:29 smithi007 ceph-mon[30983]: Saving service mon spec with placement count:5 2024-09-21T06:26:29.936 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:29 smithi007 ceph-mon[30983]: from='mgr.14118 172.21.15.7:0/3669008835' entity='mgr.x' 2024-09-21T06:26:31.505 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:31 smithi007 ceph-mon[30983]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:26:31.505 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:31 smithi007 ceph-mon[30983]: Saving service mgr spec with placement count:2 2024-09-21T06:26:31.505 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:31 smithi007 ceph-mon[30983]: from='mgr.14118 172.21.15.7:0/3669008835' entity='mgr.x' 2024-09-21T06:26:31.505 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:31 smithi007 ceph-mon[30983]: from='mgr.14118 172.21.15.7:0/3669008835' entity='mgr.x' 2024-09-21T06:26:31.507 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-21T06:26:33.031 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:32 smithi007 ceph-mon[30983]: from='mgr.14118 172.21.15.7:0/3669008835' entity='mgr.x' 2024-09-21T06:26:33.031 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:32 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/1589096374' entity='client.admin' 2024-09-21T06:26:34.196 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:33 smithi007 ceph-mon[30983]: from='mgr.14118 172.21.15.7:0/3669008835' entity='mgr.x' 2024-09-21T06:26:34.196 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:33 smithi007 ceph-mon[30983]: from='mgr.14118 172.21.15.7:0/3669008835' entity='mgr.x' 2024-09-21T06:26:34.196 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:33 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2463933413' entity='client.admin' 2024-09-21T06:26:34.465 INFO:teuthology.orchestra.run.smithi007.stdout:Enabling the dashboard module... 2024-09-21T06:26:35.429 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:35 smithi007 ceph-mon[30983]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:26:35.429 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:35 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/1360788984' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "dashboard"} : dispatch 2024-09-21T06:26:35.429 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:26:35 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: ignoring --setuser ceph since I am not root 2024-09-21T06:26:35.429 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:26:35 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: ignoring --setgroup ceph since I am not root 2024-09-21T06:26:36.216 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:36 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/1360788984' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-21T06:26:36.216 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:36 smithi007 ceph-mon[30983]: mgrmap e10: x(active, since 21s) 2024-09-21T06:26:37.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:37 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/951696325' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-21T06:26:37.712 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout { 2024-09-21T06:26:37.712 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "epoch": 10, 2024-09-21T06:26:37.712 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T06:26:37.712 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-21T06:26:37.713 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-21T06:26:37.713 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout } 2024-09-21T06:26:37.713 INFO:teuthology.orchestra.run.smithi007.stdout:Waiting for the mgr to restart... 2024-09-21T06:26:37.713 INFO:teuthology.orchestra.run.smithi007.stdout:Waiting for mgr epoch 10... 2024-09-21T06:26:40.841 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:40 smithi007 ceph-mon[30983]: Active manager daemon x restarted 2024-09-21T06:26:40.842 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:40 smithi007 ceph-mon[30983]: Activating manager daemon x 2024-09-21T06:26:40.842 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:40 smithi007 ceph-mon[30983]: osdmap e3: 0 total, 0 up, 0 in 2024-09-21T06:26:40.842 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:40 smithi007 ceph-mon[30983]: mgrmap e11: x(active, starting, since 0.00390926s) 2024-09-21T06:26:40.842 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:40 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:26:40.842 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:40 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T06:26:40.842 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:40 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T06:26:40.842 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:40 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T06:26:40.842 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:40 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T06:26:40.842 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:40 smithi007 ceph-mon[30983]: Manager daemon x is now available 2024-09-21T06:26:41.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:41 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:26:41.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:41 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T06:26:41.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:41 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T06:26:41.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:41 smithi007 ceph-mon[30983]: mgrmap e12: x(active, since 1.00751s) 2024-09-21T06:26:42.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:42 smithi007 ceph-mon[30983]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-21T06:26:42.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:42 smithi007 ceph-mon[30983]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-21T06:26:42.703 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:42 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' 2024-09-21T06:26:42.704 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:26:42 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: 2024-09-21T06:26:42.497+0000 7f47a69ab640 -1 log_channel(cephadm) log [ERR] : [21/Sep/2024:06:26:42] ENGINE Error in HTTPServer.serve 2024-09-21T06:26:42.704 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:26:42 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: Traceback (most recent call last): 2024-09-21T06:26:42.704 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:26:42 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T06:26:42.704 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:26:42 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: self._connections.run(self.expiration_interval) 2024-09-21T06:26:42.704 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:26:42 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T06:26:42.704 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:26:42 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: self._run(expiration_interval) 2024-09-21T06:26:42.704 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:26:42 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T06:26:42.704 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:26:42 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T06:26:42.705 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:26:42 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T06:26:42.705 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:26:42 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T06:26:42.705 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:26:42 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T06:26:42.705 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:26:42 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: s = self.context.wrap_socket( 2024-09-21T06:26:42.705 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:26:42 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T06:26:42.705 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:26:42 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: return self.sslsocket_class._create( 2024-09-21T06:26:42.705 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:26:42 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T06:26:42.705 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:26:42 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: self.do_handshake() 2024-09-21T06:26:42.705 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:26:42 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T06:26:42.705 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:26:42 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: self._sslobj.do_handshake() 2024-09-21T06:26:42.705 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:26:42 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T06:26:42.705 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:26:42 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: 2024-09-21T06:26:42.706 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout { 2024-09-21T06:26:42.706 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 12, 2024-09-21T06:26:42.706 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-21T06:26:42.706 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout } 2024-09-21T06:26:42.706 INFO:teuthology.orchestra.run.smithi007.stdout:mgr epoch 10 is available 2024-09-21T06:26:42.706 INFO:teuthology.orchestra.run.smithi007.stdout:Using certmgr to generate dashboard self-signed certificate... 2024-09-21T06:26:43.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:43 smithi007 ceph-mon[30983]: [21/Sep/2024:06:26:42] ENGINE Bus STARTING 2024-09-21T06:26:43.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:43 smithi007 ceph-mon[30983]: [21/Sep/2024:06:26:42] ENGINE Serving on https://172.21.15.7:7150 2024-09-21T06:26:43.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:43 smithi007 ceph-mon[30983]: [21/Sep/2024:06:26:42] ENGINE Error in HTTPServer.serve 2024-09-21T06:26:43.840 INFO:journalctl@ceph.mon.a.smithi007.stdout: Traceback (most recent call last): 2024-09-21T06:26:43.840 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T06:26:43.840 INFO:journalctl@ceph.mon.a.smithi007.stdout: self._connections.run(self.expiration_interval) 2024-09-21T06:26:43.840 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T06:26:43.840 INFO:journalctl@ceph.mon.a.smithi007.stdout: self._run(expiration_interval) 2024-09-21T06:26:43.840 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T06:26:43.840 INFO:journalctl@ceph.mon.a.smithi007.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T06:26:43.840 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T06:26:43.840 INFO:journalctl@ceph.mon.a.smithi007.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T06:26:43.841 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T06:26:43.841 INFO:journalctl@ceph.mon.a.smithi007.stdout: s = self.context.wrap_socket( 2024-09-21T06:26:43.841 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T06:26:43.841 INFO:journalctl@ceph.mon.a.smithi007.stdout: return self.sslsocket_class._create( 2024-09-21T06:26:43.841 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T06:26:43.841 INFO:journalctl@ceph.mon.a.smithi007.stdout: self.do_handshake() 2024-09-21T06:26:43.841 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T06:26:43.841 INFO:journalctl@ceph.mon.a.smithi007.stdout: self._sslobj.do_handshake() 2024-09-21T06:26:43.841 INFO:journalctl@ceph.mon.a.smithi007.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T06:26:43.841 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:43 smithi007 ceph-mon[30983]: [21/Sep/2024:06:26:42] ENGINE Serving on http://172.21.15.7:8765 2024-09-21T06:26:43.841 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:43 smithi007 ceph-mon[30983]: [21/Sep/2024:06:26:42] ENGINE Bus STARTED 2024-09-21T06:26:43.841 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:43 smithi007 ceph-mon[30983]: mgrmap e13: x(active, since 2s) 2024-09-21T06:26:43.841 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:43 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' 2024-09-21T06:26:44.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:44 smithi007 ceph-mon[30983]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "orch certmgr generate-certificates", "module_name": "dashboard", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:26:45.034 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout {"cert": "-----BEGIN CERTIFICATE-----\nMIIFDzCCAvegAwIBAgIUKzgfYM7FDbf6aYf7X9GwMUwYQEcwDQYJKoZIhvcNAQEL\nBQAwFzEVMBMGA1UEAwwMY2VwaGFkbS1yb290MB4XDTI0MDkyMTA2MjY0NFoXDTM0\nMDkyMjA2MjY0NFowFjEUMBIGA1UEAwwLMTcyLjIxLjE1LjcwggIiMA0GCSqGSIb3\nDQEBAQUAA4ICDwAwggIKAoICAQC5sICxWkb+XzqlILxB/Kw7o1B+fnq2uzd6PQv6\nxREOOfbsDkhNig4vjH/8gL09XLvAmaDNNNC8g8g1bNZHwcT2oFIxVLofm5qVnKA/\n54rwSNeiNUfalsNTlHlFDIp9ebWM8xA3ZMidImtqL9ZJ35ym1OY1FWCmLxlHtNS5\naA2jDsz5jsUSDO0zQYtT4NqL+DUOQNqDUvVdBIcntGHpHT811sdVDHDXENIEEBhL\nWPTL4vymCanbfVhHXqyVn9WaklVU4A2bF9c6FEUpF4zAi4CwdIvflNaxj3yWl7G2\n4gRozpTniMZRH4eIKValJYHC/J5TVXNpHSQoAWrzwHyxeamTXnafM9fFWYHqVtHB\n3C41z8wBuuh1T/vDRkOn9vKLpbbzJuzo5upiIuAcS6C7tiYdRUzEbkLrDjwYTPHt\n3LFNZ4wZlZDUUpra6cR1+2OkQI12oc1tjIxunzjLPj0XTk7vN9TR/4FxxjhVr9Gp\nB5SpNl4orW+fyjyYb6VLhVnLHe4fvrIge+y+y+jxCdHcRxFIrI/y3YDFRAl5jfhs\n3GTjXHx9ohSumyqC1ZvRDZqcEykfmrNvQBtECCIrAcGQDZscU0aIko/rkmDoVAqT\nQIk5f3YlFlHEyOJavuVhbffMV3CA2QcSmxHlCP6LFFsAJxwV5j6XHvNaTrwrYeyH\nawNmswIDAQABo1QwUjBCBgNVHREEOzA5gh5zbWl0aGkwMDcuZnJvbnQuc2VwaWEu\nY2VwaC5jb22CEWRhc2hib2FyZF9zZXJ2ZXJzhwSsFQ8HMAwGA1UdEwEB/wQCMAAw\nDQYJKoZIhvcNAQELBQADggIBAEr/PdM25/W3YyMmfv7d285N7ysU/95XMmaj0WOI\n4dSGL6YEJtLkyuNidv58ClmW8OlJygG1NJ5CZzZ8irHlMb0mT8G3oumh345LfqC+\nuKl1Pn6dKKgrgb0CKIuiEFf99mBQYS3YlpzaFk7ZpazBXSO6JTq3Qs/RaOW+6ATZ\nyrRkCByZh0E+Rx+6xD9aCDtm/hKNOooGUcreWEqqYF50Kx4xohTevVUUTgxiXYLa\n71RWi/nwC/EyPxxnygPEKg+EZBcV6fDuupcf2CgbhkFfR7E/ersQ7Y/zdQ1wsAtV\nxIglwe6jymU3Vu9K4m9/0uCtkmu/mA+ou43kROCncTXz/Iq/UsxNjs4fyxejOqkE\nlnMqcGE0UehGYjGA2nSc6rymNdsje9ZeAJ0IWxLDKDGD4R5SqVvrrMnm2QVluxKi\ntG3UCjPaQiUUl9AXYR9KuKQMgEJwWKn7FbvDf5FBJm6HldV6tPmlW+WAtf2kK7WR\n45hTqnawKGxPWLGVhxNZVx64/VSSXCpliB2kX1Lmrk1hjLCIrjZ5ESIrBVE+h1Rc\nEFi8geme+vUeHM2BJcXigWursI9DT+Iv6qzvzWp2OWLv8QEtDP0cLweDqOychB48\n8iL/i03/xJbjeQk2zWk9wUeRs7CQTmKagdidopCQJOi8rL+UdDmePDG2RxHW8B51\nKi/r\n-----END CERTIFICATE-----\n", "key": "-----BEGIN RSA PRIVATE KEY-----\nMIIJKAIBAAKCAgEAubCAsVpG/l86pSC8QfysO6NQfn56trs3ej0L+sURDjn27A5I\nTYoOL4x//IC9PVy7wJmgzTTQvIPINWzWR8HE9qBSMVS6H5ualZygP+eK8EjXojVH\n2pbDU5R5RQyKfXm1jPMQN2TInSJrai/WSd+cptTmNRVgpi8ZR7TUuWgNow7M+Y7F\nEgztM0GLU+Dai/g1DkDag1L1XQSHJ7Rh6R0/NdbHVQxw1xDSBBAYS1j0y+L8pgmp\n231YR16slZ/VmpJVVOANmxfXOhRFKReMwIuAsHSL35TWsY98lpextuIEaM6U54jG\nUR+HiClWpSWBwvyeU1VzaR0kKAFq88B8sXmpk152nzPXxVmB6lbRwdwuNc/MAbro\ndU/7w0ZDp/byi6W28ybs6ObqYiLgHEugu7YmHUVMxG5C6w48GEzx7dyxTWeMGZWQ\n1FKa2unEdftjpECNdqHNbYyMbp84yz49F05O7zfU0f+BccY4Va/RqQeUqTZeKK1v\nn8o8mG+lS4VZyx3uH76yIHvsvsvo8QnR3EcRSKyP8t2AxUQJeY34bNxk41x8faIU\nrpsqgtWb0Q2anBMpH5qzb0AbRAgiKwHBkA2bHFNGiJKP65Jg6FQKk0CJOX92JRZR\nxMjiWr7lYW33zFdwgNkHEpsR5Qj+ixRbACccFeY+lx7zWk68K2Hsh2sDZrMCAwEA\nAQKCAgBLFXe0PxDd4pvQEYCOHiF2q/7sZzAvm1w/bVfeuri+y+lwYgYSdHRv/Zvy\n+guLOGgi5PwEfgq5b4AROkUbFtsR7pnNoLjx9vV28bJKpNGlf47R5EF9veCVdz/i\nD8QgIIqsx8wS2gnUoApXEajQjj7Fpui/JjnCeOD8Ab7SiaSZ/m4bqwM83UU8qJAy\nBoXYezDY5ph06aKVTjNodqPwowbgOky3syQdkouZYPix3vJ9TvdiHB42xmRf14Rp\nrAuvSOSAQWi/AdDhhzi/+OnNIZuTvkygx4pYmfCC5CvUC2hFCONlDAVE4D7pa+3B\nMX1a3tMWV0MnicUI+CnLDlZdXRiX8EMBmN1jemQfpUAydzSqrPTKcOkODA5a31RP\n/FMAEbM0LoAmV63bls88ToFQWB39FpWGMlfhWTLQEe/CBuhN1l3n/84y1+HFLwCK\nW26901ZyUUr4aw3S3GqzlSNOV3G5jbaq1BLEKMpLDaxKKEuIBYMLMIq6XYofXYEo\nhVPBXPn2K/XpTbcVBHFmB4c/opnUyjJaFaj2FkLzl9kcPI5LG6FuKy6ZLwb4Lp1d\neOx8Au0Cf5yKvyK/YPA2g+QbGg7zkw0NOjymAgyW2yH/tsyyCb/PyfqLsj1YXQ/V\nNwKZ0JxF6IjktEKl2PIG/yNa8Om/g4Jqct6lnQtQFvgWhV+0YQKCAQEA+6P7B0s1\n+puBEUW1zGIgV/iD8ImqtNc9xGtl4BUVu7EB3YXs6TaJNk4KFyDCABzgLVRT/UV9\nHuEtjtGC6hMIg9yra9W5cyVYwg0uHEEo4QPBQRGBwQ+p+gUJbPxepsUtyybbXimn\nBOtzowkyq3QKFY5g5M47AnwmzDAnPMhSCvFHczSuazeJJRBKM5eB8SqU25YnChdA\ns9xMLvywxZPKzW7ZyUkVPEf1XGzlaYaluZbT5+LdI4JigvCzyjBQovY8P68BLwae\nH16PN3TFsv7+/jXtqBA3p1bVAsxpzXDLtitkuILaDxnUczyQ9w7QyuNTBds9OaS8\nYE1s4xUJjtpN5QKCAQEAvOgH3s/orGFPaD+n1NaxLXwq2XIBnuz3Irec2iFjebMJ\nzsA88vVQKlTBbXEcDK+7t2FOA1gL9+SzSO24b9U1yxybvlMsICOUAAOzVXunhTX0\n1GoP0+2fGk87MSIVZ/jhAAR5/CKUlX7s3rCpKvWIg0d8KpFx/jtGyeacvmIwOlTN\nG+IEZ34yQYFCZgoPHw4Bt6KeRHKjwSAPUcy+7riZuAIRnxibrGX65Az+DQJo91+f\nd6ANiSpXiNRYTYdxSCfueHCxAzk8JoM1cr9ajEyqHdjV6726msDcdjFxqwokzlgs\nqGRAnJdTIS1wihbg1o3YgOzHs9Xbh2fHFyo1boNYtwKCAQAfe0FhhThIlQHNrmHz\nIueW+eFPy3lOzIrOsvz4zsp8Q8XO9/1Oo+MApzy97fw3VWV6Zk1npzTjExrG/lEZ\nha4QCSBtCjz8OdTj2hBFuqUpmXWo9U69X39NZynpt50D0jFLdB4HpsBdbjN2VyU+\nq/LDBZ/7oA1j3zJfYzrVcN5KvirJL/MOONFwkJwn3jGEgWZEHoHd0lDm742cZ0Ka\nRUYe81pNw1Xjx8DbgkglLpI3KLZ0ET7HPX2jkgd8KRU9ff7FnNhSEMrhc8wJDRPa\ns+ok1YxY9UZxKfzWL8qgyBbEQKOGLeCn+PxKOm6Mag8XAt+VIPuE5aYniigwNKaQ\nd6E9AoIBAErBi/PJ1Sr6a2E256TbvUvhuldIvYl1/yr2/JR56BLOHlB6VORU3f+S\ngOVdgJsopCGi2SuLmVjlYWm34WgoONyDGsMLyQeC7NvAmyR2Bco6mwPAYTkd7PuN\nZUBBW7VEkU3fd6Km0KQEkZpi0N9WQUqqbGGwIytXq+DUaS0SUEGVM4IYRGPsVdkE\nXRFiY6+HbHiOWxF9SH5xwH4/h0OTPAnMj8qlA14LEWlUFulxDbbvWX0Okqy4W+Gj\nHrq3ocXLP5zcA8Dh0oLvI6SgQyYIZL3hBG8BKyp4rgX79R6Zqg0aabnNyp/tZpFX\nmRScjyd5BLeofDMXq4N/NxNcub5dLisCggEBAOv7vrWps/JK2Tgal+jomOXBLkLm\nJB2Qc26ONI7DNZ+RxEnjNymD1fpCfUil1Sm6hnHwVVQhNr9V/YZUjb+tG/PXHVIQ\nTpIdlZgEQpnxLPMOQee2+WLjvFTYBEj1DI9jkaYG/c7l2gGb2r6CvUsRpUhr7d5u\npuHrQnspRrfc1TwFXN8KaQKfQn3WE2wEeQbh7lfFgmfCnPzZtoZLnSUsKlO+89Nm\nm2CKgeQp7N5kiuB7VZfcQgOx4XI7Eg5inrjhgoXwjN7JvamRecNiCMCON6zbjZCM\nVf84zOactgZvAILY3A3W9uNTNAk+4qn0k0wj90FSFtRTr1aY4s8fHRs7JTA=\n-----END RSA PRIVATE KEY-----\n"} 2024-09-21T06:26:46.693 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout SSL certificate updated 2024-09-21T06:26:47.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:47 smithi007 ceph-mon[30983]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:26:47.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:47 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' 2024-09-21T06:26:47.908 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout SSL certificate key updated 2024-09-21T06:26:47.908 INFO:teuthology.orchestra.run.smithi007.stdout:Creating initial admin user... 2024-09-21T06:26:48.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:48 smithi007 ceph-mon[30983]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:26:48.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:48 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' 2024-09-21T06:26:49.414 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$q4Otm1c4XN4kUl7IHyAaVeNbhXA0ICJ/Gfaxi7kUK5cCI7FvOERP2", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726900008, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-21T06:26:49.414 INFO:teuthology.orchestra.run.smithi007.stdout:Fetching dashboard port number... 2024-09-21T06:26:50.058 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:49 smithi007 ceph-mon[30983]: from='client.14170 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:26:50.058 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:49 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' 2024-09-21T06:26:50.613 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stdout 8443 2024-09-21T06:26:50.623 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T06:26:50.623 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout disabled 2024-09-21T06:26:50.631 INFO:teuthology.orchestra.run.smithi007.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T06:26:50.631 INFO:teuthology.orchestra.run.smithi007.stdout:systemctl: stdout inactive 2024-09-21T06:26:50.631 INFO:teuthology.orchestra.run.smithi007.stdout:firewalld.service is not enabled 2024-09-21T06:26:50.631 INFO:teuthology.orchestra.run.smithi007.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-21T06:26:50.633 INFO:teuthology.orchestra.run.smithi007.stdout:Ceph Dashboard is now available at: 2024-09-21T06:26:50.633 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:26:50.633 INFO:teuthology.orchestra.run.smithi007.stdout: URL: https://smithi007.front.sepia.ceph.com:8443/ 2024-09-21T06:26:50.633 INFO:teuthology.orchestra.run.smithi007.stdout: User: admin 2024-09-21T06:26:50.633 INFO:teuthology.orchestra.run.smithi007.stdout: Password: b4y545whp4 2024-09-21T06:26:50.633 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:26:50.633 INFO:teuthology.orchestra.run.smithi007.stdout:Saving cluster configuration to /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/config directory 2024-09-21T06:26:51.046 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:50 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/1572849220' entity='client.admin' cmd={"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} : dispatch 2024-09-21T06:26:51.936 INFO:teuthology.orchestra.run.smithi007.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-21T06:26:51.936 INFO:teuthology.orchestra.run.smithi007.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-21T06:26:51.936 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:26:51.936 INFO:teuthology.orchestra.run.smithi007.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-21T06:26:51.936 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:26:51.936 INFO:teuthology.orchestra.run.smithi007.stdout:Or, if you are only running a single cluster on this host: 2024-09-21T06:26:51.937 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:26:51.937 INFO:teuthology.orchestra.run.smithi007.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-21T06:26:51.937 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:26:51.937 INFO:teuthology.orchestra.run.smithi007.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-21T06:26:51.937 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:26:51.937 INFO:teuthology.orchestra.run.smithi007.stdout: ceph telemetry on 2024-09-21T06:26:51.937 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:26:51.937 INFO:teuthology.orchestra.run.smithi007.stdout:For more information see: 2024-09-21T06:26:51.937 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:26:51.937 INFO:teuthology.orchestra.run.smithi007.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-21T06:26:51.937 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:26:51.937 INFO:teuthology.orchestra.run.smithi007.stdout:Bootstrap complete. 2024-09-21T06:26:51.978 INFO:tasks.cephadm:Fetching config... 2024-09-21T06:26:51.979 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-21T06:26:51.979 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-21T06:26:51.995 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-21T06:26:51.995 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-21T06:26:51.996 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-21T06:26:52.052 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-21T06:26:52.052 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-21T06:26:52.052 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/keyring of=/dev/stdout 2024-09-21T06:26:52.118 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-21T06:26:52.118 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-21T06:26:52.118 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-21T06:26:52.174 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-21T06:26:52.175 DEBUG:teuthology.orchestra.run.smithi007:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3zosxKseXYWVK7rtcSpaquhBDNB5vKsKz3jyLvSIcXTd58RTGTrqRz+Qv6Z4ZEDqyiQ3I/8mDIN4ragqZILO1FDOwljj8H+q5Dfr31nMvgKS9Q5y9bCUGYA4eptCPM8/n20xDO1cRCYQNhCurDoqM/Ml0yXFV/EJd0bbtH/ULfiak8PU0hnro3tohasTM8B6zrcMZyv0ecZiz5hdb3BT9O0yi2mh3Ksw6KznW9y6pOJK3rj4C1qhrynF+fR1Pf+CGYHREjw03ZvYcr/5I4IP6TEMgG9kD9N3LSwbqKJTwQE8afFoHbD58VvQj6xLar+hIohHVJJjD/pcJqFgw/o5GlLJB7a5K5AOWOvDd2ptnHo6VPM05J9KxOD4RG9s9JST2RWOhS1kXOylVz6As80ToY2TGSekKxYQPbe1w+miiSzsOOzAtTxUQxBhOAwKnd9hZhM5dFuosL6J4H6AOOK7nFwLbQj6Fka7HZsxDsMJ9iqawF4oaIByTxygaFVUOhQc= ceph-347cb918-77e2-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T06:26:52.256 INFO:teuthology.orchestra.run.smithi007.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3zosxKseXYWVK7rtcSpaquhBDNB5vKsKz3jyLvSIcXTd58RTGTrqRz+Qv6Z4ZEDqyiQ3I/8mDIN4ragqZILO1FDOwljj8H+q5Dfr31nMvgKS9Q5y9bCUGYA4eptCPM8/n20xDO1cRCYQNhCurDoqM/Ml0yXFV/EJd0bbtH/ULfiak8PU0hnro3tohasTM8B6zrcMZyv0ecZiz5hdb3BT9O0yi2mh3Ksw6KznW9y6pOJK3rj4C1qhrynF+fR1Pf+CGYHREjw03ZvYcr/5I4IP6TEMgG9kD9N3LSwbqKJTwQE8afFoHbD58VvQj6xLar+hIohHVJJjD/pcJqFgw/o5GlLJB7a5K5AOWOvDd2ptnHo6VPM05J9KxOD4RG9s9JST2RWOhS1kXOylVz6As80ToY2TGSekKxYQPbe1w+miiSzsOOzAtTxUQxBhOAwKnd9hZhM5dFuosL6J4H6AOOK7nFwLbQj6Fka7HZsxDsMJ9iqawF4oaIByTxygaFVUOhQc= ceph-347cb918-77e2-11ef-baf5-efdc52797490 2024-09-21T06:26:52.269 DEBUG:teuthology.orchestra.run.smithi018:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3zosxKseXYWVK7rtcSpaquhBDNB5vKsKz3jyLvSIcXTd58RTGTrqRz+Qv6Z4ZEDqyiQ3I/8mDIN4ragqZILO1FDOwljj8H+q5Dfr31nMvgKS9Q5y9bCUGYA4eptCPM8/n20xDO1cRCYQNhCurDoqM/Ml0yXFV/EJd0bbtH/ULfiak8PU0hnro3tohasTM8B6zrcMZyv0ecZiz5hdb3BT9O0yi2mh3Ksw6KznW9y6pOJK3rj4C1qhrynF+fR1Pf+CGYHREjw03ZvYcr/5I4IP6TEMgG9kD9N3LSwbqKJTwQE8afFoHbD58VvQj6xLar+hIohHVJJjD/pcJqFgw/o5GlLJB7a5K5AOWOvDd2ptnHo6VPM05J9KxOD4RG9s9JST2RWOhS1kXOylVz6As80ToY2TGSekKxYQPbe1w+miiSzsOOzAtTxUQxBhOAwKnd9hZhM5dFuosL6J4H6AOOK7nFwLbQj6Fka7HZsxDsMJ9iqawF4oaIByTxygaFVUOhQc= ceph-347cb918-77e2-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T06:26:52.310 INFO:teuthology.orchestra.run.smithi018.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3zosxKseXYWVK7rtcSpaquhBDNB5vKsKz3jyLvSIcXTd58RTGTrqRz+Qv6Z4ZEDqyiQ3I/8mDIN4ragqZILO1FDOwljj8H+q5Dfr31nMvgKS9Q5y9bCUGYA4eptCPM8/n20xDO1cRCYQNhCurDoqM/Ml0yXFV/EJd0bbtH/ULfiak8PU0hnro3tohasTM8B6zrcMZyv0ecZiz5hdb3BT9O0yi2mh3Ksw6KznW9y6pOJK3rj4C1qhrynF+fR1Pf+CGYHREjw03ZvYcr/5I4IP6TEMgG9kD9N3LSwbqKJTwQE8afFoHbD58VvQj6xLar+hIohHVJJjD/pcJqFgw/o5GlLJB7a5K5AOWOvDd2ptnHo6VPM05J9KxOD4RG9s9JST2RWOhS1kXOylVz6As80ToY2TGSekKxYQPbe1w+miiSzsOOzAtTxUQxBhOAwKnd9hZhM5dFuosL6J4H6AOOK7nFwLbQj6Fka7HZsxDsMJ9iqawF4oaIByTxygaFVUOhQc= ceph-347cb918-77e2-11ef-baf5-efdc52797490 2024-09-21T06:26:52.322 DEBUG:teuthology.orchestra.run.smithi144:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3zosxKseXYWVK7rtcSpaquhBDNB5vKsKz3jyLvSIcXTd58RTGTrqRz+Qv6Z4ZEDqyiQ3I/8mDIN4ragqZILO1FDOwljj8H+q5Dfr31nMvgKS9Q5y9bCUGYA4eptCPM8/n20xDO1cRCYQNhCurDoqM/Ml0yXFV/EJd0bbtH/ULfiak8PU0hnro3tohasTM8B6zrcMZyv0ecZiz5hdb3BT9O0yi2mh3Ksw6KznW9y6pOJK3rj4C1qhrynF+fR1Pf+CGYHREjw03ZvYcr/5I4IP6TEMgG9kD9N3LSwbqKJTwQE8afFoHbD58VvQj6xLar+hIohHVJJjD/pcJqFgw/o5GlLJB7a5K5AOWOvDd2ptnHo6VPM05J9KxOD4RG9s9JST2RWOhS1kXOylVz6As80ToY2TGSekKxYQPbe1w+miiSzsOOzAtTxUQxBhOAwKnd9hZhM5dFuosL6J4H6AOOK7nFwLbQj6Fka7HZsxDsMJ9iqawF4oaIByTxygaFVUOhQc= ceph-347cb918-77e2-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T06:26:52.364 INFO:teuthology.orchestra.run.smithi144.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC3zosxKseXYWVK7rtcSpaquhBDNB5vKsKz3jyLvSIcXTd58RTGTrqRz+Qv6Z4ZEDqyiQ3I/8mDIN4ragqZILO1FDOwljj8H+q5Dfr31nMvgKS9Q5y9bCUGYA4eptCPM8/n20xDO1cRCYQNhCurDoqM/Ml0yXFV/EJd0bbtH/ULfiak8PU0hnro3tohasTM8B6zrcMZyv0ecZiz5hdb3BT9O0yi2mh3Ksw6KznW9y6pOJK3rj4C1qhrynF+fR1Pf+CGYHREjw03ZvYcr/5I4IP6TEMgG9kD9N3LSwbqKJTwQE8afFoHbD58VvQj6xLar+hIohHVJJjD/pcJqFgw/o5GlLJB7a5K5AOWOvDd2ptnHo6VPM05J9KxOD4RG9s9JST2RWOhS1kXOylVz6As80ToY2TGSekKxYQPbe1w+miiSzsOOzAtTxUQxBhOAwKnd9hZhM5dFuosL6J4H6AOOK7nFwLbQj6Fka7HZsxDsMJ9iqawF4oaIByTxygaFVUOhQc= ceph-347cb918-77e2-11ef-baf5-efdc52797490 2024-09-21T06:26:52.376 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-21T06:26:52.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:52 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2144969639' entity='client.admin' 2024-09-21T06:26:52.714 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:26:54.638 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:54 smithi007 ceph-mon[30983]: mgrmap e14: x(active, since 12s) 2024-09-21T06:26:54.638 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:54 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/3308919755' entity='client.admin' 2024-09-21T06:26:54.639 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:54 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' 2024-09-21T06:26:54.639 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:54 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' 2024-09-21T06:26:54.639 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:54 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi007", "name": "osd_memory_target"} : dispatch 2024-09-21T06:26:54.639 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:54 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' 2024-09-21T06:26:54.639 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:54 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:26:54.639 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:54 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' 2024-09-21T06:26:54.640 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-21T06:26:54.640 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-21T06:26:54.932 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:26:56.694 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:56 smithi007 ceph-mon[30983]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:26:56.694 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:56 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' 2024-09-21T06:26:56.694 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:56 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:26:56.694 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:56 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:26:56.694 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:56 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:26:56.695 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:56 smithi007 ceph-mon[30983]: Updating smithi007:/etc/ceph/ceph.conf 2024-09-21T06:26:56.695 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:56 smithi007 ceph-mon[30983]: Updating smithi007:/var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:26:56.695 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:56 smithi007 ceph-mon[30983]: Updating smithi007:/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:26:56.695 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:56 smithi007 ceph-mon[30983]: Updating smithi007:/var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T06:26:56.695 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:56 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' 2024-09-21T06:26:56.695 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:56 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' 2024-09-21T06:26:56.695 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:56 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' 2024-09-21T06:26:56.721 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi018 2024-09-21T06:26:56.721 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-21T06:26:56.721 DEBUG:teuthology.orchestra.run.smithi018:> dd of=/etc/ceph/ceph.conf 2024-09-21T06:26:56.740 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-21T06:26:56.740 DEBUG:teuthology.orchestra.run.smithi018:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:26:56.798 INFO:tasks.cephadm:Adding host smithi018 to orchestrator... 2024-09-21T06:26:56.798 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph orch host add smithi018 2024-09-21T06:26:57.048 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:26:58.589 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:58 smithi007 ceph-mon[30983]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi018", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:26:59.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:26:59 smithi007 ceph-mon[30983]: Deploying cephadm binary to smithi018 2024-09-21T06:27:01.486 INFO:teuthology.orchestra.run.smithi007.stdout:Added host 'smithi018' with addr '172.21.15.18' 2024-09-21T06:27:01.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:01 smithi007 ceph-mon[30983]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:27:01.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:01 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' 2024-09-21T06:27:01.783 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:01 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:27:02.079 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph orch host ls --format=json 2024-09-21T06:27:02.329 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:27:03.020 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:27:03.020 INFO:teuthology.orchestra.run.smithi007.stdout:[{"addr": "172.21.15.7", "hostname": "smithi007", "labels": [], "status": ""}, {"addr": "172.21.15.18", "hostname": "smithi018", "labels": [], "status": ""}] 2024-09-21T06:27:03.020 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:02 smithi007 ceph-mon[30983]: Added host smithi018 2024-09-21T06:27:03.020 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:02 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' 2024-09-21T06:27:03.020 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:02 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' 2024-09-21T06:27:03.571 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi144 2024-09-21T06:27:03.571 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-21T06:27:03.571 DEBUG:teuthology.orchestra.run.smithi144:> dd of=/etc/ceph/ceph.conf 2024-09-21T06:27:03.589 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-21T06:27:03.589 DEBUG:teuthology.orchestra.run.smithi144:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:27:03.645 INFO:tasks.cephadm:Adding host smithi144 to orchestrator... 2024-09-21T06:27:03.645 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph orch host add smithi144 2024-09-21T06:27:03.839 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:03 smithi007 ceph-mon[30983]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:27:03.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:03 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' 2024-09-21T06:27:03.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:03 smithi007 ceph-mon[30983]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:27:03.899 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:27:06.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:05 smithi007 ceph-mon[30983]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:27:06.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:05 smithi007 ceph-mon[30983]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi144", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:27:06.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:05 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' 2024-09-21T06:27:06.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:05 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' 2024-09-21T06:27:06.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:05 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' 2024-09-21T06:27:06.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:05 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' 2024-09-21T06:27:06.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:05 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi018", "name": "osd_memory_target"} : dispatch 2024-09-21T06:27:06.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:05 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:27:06.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:05 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:27:07.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:06 smithi007 ceph-mon[30983]: Updating smithi018:/etc/ceph/ceph.conf 2024-09-21T06:27:07.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:06 smithi007 ceph-mon[30983]: Updating smithi018:/var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:27:07.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:06 smithi007 ceph-mon[30983]: Updating smithi018:/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:27:07.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:06 smithi007 ceph-mon[30983]: Deploying cephadm binary to smithi144 2024-09-21T06:27:07.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:06 smithi007 ceph-mon[30983]: Updating smithi018:/var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T06:27:07.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:06 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' 2024-09-21T06:27:07.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:06 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' 2024-09-21T06:27:07.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:06 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' 2024-09-21T06:27:08.302 INFO:teuthology.orchestra.run.smithi007.stdout:Added host 'smithi144' with addr '172.21.15.144' 2024-09-21T06:27:08.302 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:07 smithi007 ceph-mon[30983]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:27:08.876 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph orch host ls --format=json 2024-09-21T06:27:09.126 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:27:09.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:09 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' 2024-09-21T06:27:09.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:09 smithi007 ceph-mon[30983]: Added host smithi144 2024-09-21T06:27:09.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:09 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:27:09.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:09 smithi007 ceph-mon[30983]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:27:09.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:09 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' 2024-09-21T06:27:09.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:09 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' 2024-09-21T06:27:09.789 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:27:09.790 INFO:teuthology.orchestra.run.smithi007.stdout:[{"addr": "172.21.15.7", "hostname": "smithi007", "labels": [], "status": ""}, {"addr": "172.21.15.18", "hostname": "smithi018", "labels": [], "status": ""}, {"addr": "172.21.15.144", "hostname": "smithi144", "labels": [], "status": ""}] 2024-09-21T06:27:10.358 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-21T06:27:10.358 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph osd crush tunables default 2024-09-21T06:27:10.606 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:27:10.871 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:10 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' 2024-09-21T06:27:10.871 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:10 smithi007 ceph-mon[30983]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:27:11.616 INFO:teuthology.orchestra.run.smithi007.stderr:adjusted tunables profile to default 2024-09-21T06:27:11.911 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:11 smithi007 ceph-mon[30983]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:27:11.911 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:11 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/3155913483' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-21T06:27:12.202 INFO:tasks.cephadm:Adding mon.a on smithi007 2024-09-21T06:27:12.202 INFO:tasks.cephadm:Adding mon.b on smithi018 2024-09-21T06:27:12.202 INFO:tasks.cephadm:Adding mon.c on smithi144 2024-09-21T06:27:12.202 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph orch apply mon '3;smithi007:172.21.15.7=a;smithi018:172.21.15.18=b;smithi144:172.21.15.144=c' 2024-09-21T06:27:12.456 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T06:27:12.503 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T06:27:13.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:12 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/3155913483' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-21T06:27:13.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:12 smithi007 ceph-mon[30983]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T06:27:13.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:12 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' 2024-09-21T06:27:13.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:12 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' 2024-09-21T06:27:13.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:12 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' 2024-09-21T06:27:13.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:12 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' 2024-09-21T06:27:13.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:12 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi144", "name": "osd_memory_target"} : dispatch 2024-09-21T06:27:13.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:12 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:27:13.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:12 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:27:13.186 INFO:teuthology.orchestra.run.smithi144.stdout:Scheduled mon update... 2024-09-21T06:27:13.785 DEBUG:teuthology.orchestra.run.smithi018:mon.b> sudo journalctl -f -n 0 -u ceph-347cb918-77e2-11ef-baf5-efdc52797490@mon.b.service 2024-09-21T06:27:13.788 DEBUG:teuthology.orchestra.run.smithi144:mon.c> sudo journalctl -f -n 0 -u ceph-347cb918-77e2-11ef-baf5-efdc52797490@mon.c.service 2024-09-21T06:27:13.790 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T06:27:13.790 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T06:27:14.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:13 smithi007 ceph-mon[30983]: Updating smithi144:/etc/ceph/ceph.conf 2024-09-21T06:27:14.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:13 smithi007 ceph-mon[30983]: Updating smithi144:/var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:27:14.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:13 smithi007 ceph-mon[30983]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:27:14.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:13 smithi007 ceph-mon[30983]: Updating smithi144:/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:27:14.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:13 smithi007 ceph-mon[30983]: Updating smithi144:/var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T06:27:14.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:13 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' 2024-09-21T06:27:14.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:13 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' 2024-09-21T06:27:14.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:13 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' 2024-09-21T06:27:14.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:13 smithi007 ceph-mon[30983]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi007:172.21.15.7=a;smithi018:172.21.15.18=b;smithi144:172.21.15.144=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:27:14.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:13 smithi007 ceph-mon[30983]: Saving service mon spec with placement smithi007:172.21.15.7=a;smithi018:172.21.15.18=b;smithi144:172.21.15.144=c;count:3 2024-09-21T06:27:14.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:13 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' 2024-09-21T06:27:14.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:13 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:27:14.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:13 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:27:14.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:13 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:27:14.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:13 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' 2024-09-21T06:27:14.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:13 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:27:14.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:13 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:27:14.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:13 smithi007 ceph-mon[30983]: Deploying daemon mon.c on smithi144 2024-09-21T06:27:14.885 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:27:16.063 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-21T06:27:16.063 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":1,"fsid":"347cb918-77e2-11ef-baf5-efdc52797490","modified":"2024-09-21T06:25:38.421457Z","created":"2024-09-21T06:25:38.421457Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:3300","nonce":0},{"type":"v1","addr":"172.21.15.7:6789","nonce":0}]},"addr":"172.21.15.7:6789/0","public_addr":"172.21.15.7:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T06:27:16.063 INFO:teuthology.orchestra.run.smithi144.stderr:dumped monmap epoch 1 2024-09-21T06:27:16.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:15 smithi007 ceph-mon[30983]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:27:17.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:16 smithi007 ceph-mon[30983]: from='client.? 172.21.15.144:0/1949149062' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T06:27:17.893 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T06:27:17.894 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T06:27:17.918 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:17 smithi144 systemd[1]: Started Ceph mon.c for 347cb918-77e2-11ef-baf5-efdc52797490. 2024-09-21T06:27:18.145 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:27:23.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:22 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:27:23.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:22 smithi007 ceph-mon[30983]: mon.a calling monitor election 2024-09-21T06:27:23.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:22 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:27:23.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:22 smithi007 ceph-mon[30983]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:27:23.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:22 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:27:23.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:22 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:27:23.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:22 smithi007 ceph-mon[30983]: mon.c calling monitor election 2024-09-21T06:27:23.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:22 smithi007 ceph-mon[30983]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:27:23.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:22 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:27:23.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:22 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:27:23.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:22 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:27:23.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:22 smithi007 ceph-mon[30983]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T06:27:23.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:22 smithi007 ceph-mon[30983]: monmap epoch 2 2024-09-21T06:27:23.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:22 smithi007 ceph-mon[30983]: fsid 347cb918-77e2-11ef-baf5-efdc52797490 2024-09-21T06:27:23.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:22 smithi007 ceph-mon[30983]: last_changed 2024-09-21T06:27:17.726306+0000 2024-09-21T06:27:23.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:22 smithi007 ceph-mon[30983]: created 2024-09-21T06:25:38.421457+0000 2024-09-21T06:27:23.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:22 smithi007 ceph-mon[30983]: min_mon_release 19 (squid) 2024-09-21T06:27:23.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:22 smithi007 ceph-mon[30983]: election_strategy: 1 2024-09-21T06:27:23.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:22 smithi007 ceph-mon[30983]: 0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-21T06:27:23.092 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:22 smithi007 ceph-mon[30983]: 1: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.c 2024-09-21T06:27:23.092 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:22 smithi007 ceph-mon[30983]: fsmap 2024-09-21T06:27:23.092 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:22 smithi007 ceph-mon[30983]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T06:27:23.092 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:22 smithi007 ceph-mon[30983]: mgrmap e14: x(active, since 42s) 2024-09-21T06:27:23.092 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:22 smithi007 ceph-mon[30983]: overall HEALTH_OK 2024-09-21T06:27:23.092 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:22 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' 2024-09-21T06:27:23.092 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:22 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' 2024-09-21T06:27:23.092 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:22 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' 2024-09-21T06:27:23.092 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:22 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:27:23.092 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:22 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:27:23.250 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-21T06:27:23.250 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":2,"fsid":"347cb918-77e2-11ef-baf5-efdc52797490","modified":"2024-09-21T06:27:17.726306Z","created":"2024-09-21T06:25:38.421457Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:3300","nonce":0},{"type":"v1","addr":"172.21.15.7:6789","nonce":0}]},"addr":"172.21.15.7:6789/0","public_addr":"172.21.15.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:3300","nonce":0},{"type":"v1","addr":"172.21.15.144:6789","nonce":0}]},"addr":"172.21.15.144:6789/0","public_addr":"172.21.15.144:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-21T06:27:23.250 INFO:teuthology.orchestra.run.smithi144.stderr:dumped monmap epoch 2 2024-09-21T06:27:23.251 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:22 smithi144 ceph-mon[34653]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:27:23.251 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:22 smithi144 ceph-mon[34653]: mon.a calling monitor election 2024-09-21T06:27:23.251 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:22 smithi144 ceph-mon[34653]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:27:23.251 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:22 smithi144 ceph-mon[34653]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:27:23.251 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:22 smithi144 ceph-mon[34653]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:27:23.251 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:22 smithi144 ceph-mon[34653]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:27:23.251 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:22 smithi144 ceph-mon[34653]: mon.c calling monitor election 2024-09-21T06:27:23.251 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:22 smithi144 ceph-mon[34653]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:27:23.251 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:22 smithi144 ceph-mon[34653]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:27:23.251 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:22 smithi144 ceph-mon[34653]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:27:23.251 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:22 smithi144 ceph-mon[34653]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:27:23.252 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:22 smithi144 ceph-mon[34653]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T06:27:23.252 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:22 smithi144 ceph-mon[34653]: monmap epoch 2 2024-09-21T06:27:23.252 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:22 smithi144 ceph-mon[34653]: fsid 347cb918-77e2-11ef-baf5-efdc52797490 2024-09-21T06:27:23.252 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:22 smithi144 ceph-mon[34653]: last_changed 2024-09-21T06:27:17.726306+0000 2024-09-21T06:27:23.252 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:22 smithi144 ceph-mon[34653]: created 2024-09-21T06:25:38.421457+0000 2024-09-21T06:27:23.252 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:22 smithi144 ceph-mon[34653]: min_mon_release 19 (squid) 2024-09-21T06:27:23.252 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:22 smithi144 ceph-mon[34653]: election_strategy: 1 2024-09-21T06:27:23.252 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:22 smithi144 ceph-mon[34653]: 0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-21T06:27:23.252 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:22 smithi144 ceph-mon[34653]: 1: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.c 2024-09-21T06:27:23.252 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:22 smithi144 ceph-mon[34653]: fsmap 2024-09-21T06:27:23.252 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:22 smithi144 ceph-mon[34653]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T06:27:23.252 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:22 smithi144 ceph-mon[34653]: mgrmap e14: x(active, since 42s) 2024-09-21T06:27:23.252 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:22 smithi144 ceph-mon[34653]: overall HEALTH_OK 2024-09-21T06:27:23.252 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:22 smithi144 ceph-mon[34653]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' 2024-09-21T06:27:23.252 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:22 smithi144 ceph-mon[34653]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' 2024-09-21T06:27:23.253 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:22 smithi144 ceph-mon[34653]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' 2024-09-21T06:27:23.253 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:22 smithi144 ceph-mon[34653]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:27:23.253 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:22 smithi144 ceph-mon[34653]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:27:24.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:23 smithi144 ceph-mon[34653]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:27:24.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:23 smithi144 ceph-mon[34653]: Deploying daemon mon.b on smithi018 2024-09-21T06:27:24.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:23 smithi144 ceph-mon[34653]: from='client.? 172.21.15.144:0/1009365024' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T06:27:24.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:23 smithi144 ceph-mon[34653]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:27:24.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:23 smithi007 ceph-mon[30983]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:27:24.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:23 smithi007 ceph-mon[30983]: Deploying daemon mon.b on smithi018 2024-09-21T06:27:24.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:23 smithi007 ceph-mon[30983]: from='client.? 172.21.15.144:0/1009365024' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T06:27:24.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:23 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:27:24.782 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T06:27:24.782 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T06:27:25.036 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:27:25.090 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:27:24 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: 2024-09-21T06:27:24.725+0000 7f47da3e0640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-21T06:27:25.711 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-21T06:27:25.711 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":2,"fsid":"347cb918-77e2-11ef-baf5-efdc52797490","modified":"2024-09-21T06:27:17.726306Z","created":"2024-09-21T06:25:38.421457Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:3300","nonce":0},{"type":"v1","addr":"172.21.15.7:6789","nonce":0}]},"addr":"172.21.15.7:6789/0","public_addr":"172.21.15.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:3300","nonce":0},{"type":"v1","addr":"172.21.15.144:6789","nonce":0}]},"addr":"172.21.15.144:6789/0","public_addr":"172.21.15.144:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-21T06:27:25.711 INFO:teuthology.orchestra.run.smithi144.stderr:dumped monmap epoch 2 2024-09-21T06:27:26.010 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:25 smithi144 ceph-mon[34653]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:27:26.010 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:25 smithi144 ceph-mon[34653]: from='client.? 172.21.15.144:0/590704379' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T06:27:26.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:25 smithi007 ceph-mon[30983]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:27:26.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:25 smithi007 ceph-mon[30983]: from='client.? 172.21.15.144:0/590704379' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T06:27:26.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:26 smithi018 systemd[1]: Started Ceph mon.b for 347cb918-77e2-11ef-baf5-efdc52797490. 2024-09-21T06:27:27.265 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T06:27:27.265 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T06:27:27.519 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:27:32.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:31 smithi144 ceph-mon[34653]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:27:32.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:31 smithi144 ceph-mon[34653]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:27:32.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:31 smithi144 ceph-mon[34653]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:27:32.036 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:31 smithi144 ceph-mon[34653]: mon.a calling monitor election 2024-09-21T06:27:32.036 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:31 smithi144 ceph-mon[34653]: mon.c calling monitor election 2024-09-21T06:27:32.036 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:31 smithi144 ceph-mon[34653]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:27:32.036 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:31 smithi144 ceph-mon[34653]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:27:32.036 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:31 smithi144 ceph-mon[34653]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:27:32.036 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:31 smithi144 ceph-mon[34653]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:27:32.036 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:31 smithi144 ceph-mon[34653]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:27:32.036 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:31 smithi144 ceph-mon[34653]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:27:32.036 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:31 smithi144 ceph-mon[34653]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:27:32.036 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:31 smithi144 ceph-mon[34653]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:27:32.036 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:31 smithi144 ceph-mon[34653]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T06:27:32.036 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:31 smithi144 ceph-mon[34653]: monmap epoch 3 2024-09-21T06:27:32.036 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:31 smithi144 ceph-mon[34653]: fsid 347cb918-77e2-11ef-baf5-efdc52797490 2024-09-21T06:27:32.036 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:31 smithi144 ceph-mon[34653]: last_changed 2024-09-21T06:27:26.556045+0000 2024-09-21T06:27:32.036 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:31 smithi144 ceph-mon[34653]: created 2024-09-21T06:25:38.421457+0000 2024-09-21T06:27:32.037 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:31 smithi144 ceph-mon[34653]: min_mon_release 19 (squid) 2024-09-21T06:27:32.037 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:31 smithi144 ceph-mon[34653]: election_strategy: 1 2024-09-21T06:27:32.037 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:31 smithi144 ceph-mon[34653]: 0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-21T06:27:32.037 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:31 smithi144 ceph-mon[34653]: 1: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.c 2024-09-21T06:27:32.037 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:31 smithi144 ceph-mon[34653]: 2: [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] mon.b 2024-09-21T06:27:32.037 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:31 smithi144 ceph-mon[34653]: fsmap 2024-09-21T06:27:32.037 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:31 smithi144 ceph-mon[34653]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T06:27:32.037 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:31 smithi144 ceph-mon[34653]: mgrmap e14: x(active, since 51s) 2024-09-21T06:27:32.037 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:31 smithi144 ceph-mon[34653]: overall HEALTH_OK 2024-09-21T06:27:32.037 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:31 smithi144 ceph-mon[34653]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' 2024-09-21T06:27:32.037 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:31 smithi144 ceph-mon[34653]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' 2024-09-21T06:27:32.037 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:31 smithi144 ceph-mon[34653]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' 2024-09-21T06:27:32.037 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:31 smithi144 ceph-mon[34653]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' 2024-09-21T06:27:32.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:31 smithi007 ceph-mon[30983]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:27:32.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:31 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:27:32.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:31 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:27:32.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:31 smithi007 ceph-mon[30983]: mon.a calling monitor election 2024-09-21T06:27:32.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:31 smithi007 ceph-mon[30983]: mon.c calling monitor election 2024-09-21T06:27:32.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:31 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:27:32.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:31 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:27:32.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:31 smithi007 ceph-mon[30983]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:27:32.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:31 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:27:32.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:31 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:27:32.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:31 smithi007 ceph-mon[30983]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:27:32.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:31 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:27:32.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:31 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:27:32.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:31 smithi007 ceph-mon[30983]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T06:27:32.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:31 smithi007 ceph-mon[30983]: monmap epoch 3 2024-09-21T06:27:32.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:31 smithi007 ceph-mon[30983]: fsid 347cb918-77e2-11ef-baf5-efdc52797490 2024-09-21T06:27:32.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:31 smithi007 ceph-mon[30983]: last_changed 2024-09-21T06:27:26.556045+0000 2024-09-21T06:27:32.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:31 smithi007 ceph-mon[30983]: created 2024-09-21T06:25:38.421457+0000 2024-09-21T06:27:32.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:31 smithi007 ceph-mon[30983]: min_mon_release 19 (squid) 2024-09-21T06:27:32.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:31 smithi007 ceph-mon[30983]: election_strategy: 1 2024-09-21T06:27:32.092 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:31 smithi007 ceph-mon[30983]: 0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-21T06:27:32.092 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:31 smithi007 ceph-mon[30983]: 1: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.c 2024-09-21T06:27:32.092 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:31 smithi007 ceph-mon[30983]: 2: [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] mon.b 2024-09-21T06:27:32.092 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:31 smithi007 ceph-mon[30983]: fsmap 2024-09-21T06:27:32.092 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:31 smithi007 ceph-mon[30983]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T06:27:32.092 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:31 smithi007 ceph-mon[30983]: mgrmap e14: x(active, since 51s) 2024-09-21T06:27:32.092 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:31 smithi007 ceph-mon[30983]: overall HEALTH_OK 2024-09-21T06:27:32.092 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:31 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' 2024-09-21T06:27:32.092 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:31 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' 2024-09-21T06:27:32.092 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:31 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' 2024-09-21T06:27:32.092 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:31 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' 2024-09-21T06:27:32.612 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-21T06:27:32.612 INFO:teuthology.orchestra.run.smithi144.stdout:{"epoch":3,"fsid":"347cb918-77e2-11ef-baf5-efdc52797490","modified":"2024-09-21T06:27:26.556045Z","created":"2024-09-21T06:25:38.421457Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:3300","nonce":0},{"type":"v1","addr":"172.21.15.7:6789","nonce":0}]},"addr":"172.21.15.7:6789/0","public_addr":"172.21.15.7:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:3300","nonce":0},{"type":"v1","addr":"172.21.15.144:6789","nonce":0}]},"addr":"172.21.15.144:6789/0","public_addr":"172.21.15.144:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:3300","nonce":0},{"type":"v1","addr":"172.21.15.18:6789","nonce":0}]},"addr":"172.21.15.18:6789/0","public_addr":"172.21.15.18:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-21T06:27:32.613 INFO:teuthology.orchestra.run.smithi144.stderr:dumped monmap epoch 3 2024-09-21T06:27:32.978 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:32 smithi144 ceph-mon[34653]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:27:32.978 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:32 smithi144 ceph-mon[34653]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:27:32.978 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:32 smithi144 ceph-mon[34653]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' 2024-09-21T06:27:32.978 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:32 smithi144 ceph-mon[34653]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' 2024-09-21T06:27:32.978 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:32 smithi144 ceph-mon[34653]: from='client.? 172.21.15.144:0/243266239' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T06:27:33.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:32 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:27:33.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:32 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:27:33.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:32 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' 2024-09-21T06:27:33.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:32 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' 2024-09-21T06:27:33.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:32 smithi007 ceph-mon[30983]: from='client.? 172.21.15.144:0/243266239' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T06:27:33.297 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-21T06:27:33.298 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph config generate-minimal-conf 2024-09-21T06:27:33.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:33 smithi018 ceph-mon[34477]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:27:33.870 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:33 smithi018 ceph-mon[34477]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:27:33.870 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:33 smithi018 ceph-mon[34477]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:27:33.870 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:33 smithi018 ceph-mon[34477]: mon.a calling monitor election 2024-09-21T06:27:33.870 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:33 smithi018 ceph-mon[34477]: mon.c calling monitor election 2024-09-21T06:27:33.870 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:33 smithi018 ceph-mon[34477]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:27:33.870 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:33 smithi018 ceph-mon[34477]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:27:33.870 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:33 smithi018 ceph-mon[34477]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:27:33.870 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:33 smithi018 ceph-mon[34477]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:27:33.870 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:33 smithi018 ceph-mon[34477]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:27:33.870 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:33 smithi018 ceph-mon[34477]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:27:33.870 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:33 smithi018 ceph-mon[34477]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:27:33.871 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:33 smithi018 ceph-mon[34477]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:27:33.871 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:33 smithi018 ceph-mon[34477]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T06:27:33.871 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:33 smithi018 ceph-mon[34477]: monmap epoch 3 2024-09-21T06:27:33.871 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:33 smithi018 ceph-mon[34477]: fsid 347cb918-77e2-11ef-baf5-efdc52797490 2024-09-21T06:27:33.871 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:33 smithi018 ceph-mon[34477]: last_changed 2024-09-21T06:27:26.556045+0000 2024-09-21T06:27:33.871 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:33 smithi018 ceph-mon[34477]: created 2024-09-21T06:25:38.421457+0000 2024-09-21T06:27:33.871 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:33 smithi018 ceph-mon[34477]: min_mon_release 19 (squid) 2024-09-21T06:27:33.871 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:33 smithi018 ceph-mon[34477]: election_strategy: 1 2024-09-21T06:27:33.871 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:33 smithi018 ceph-mon[34477]: 0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-21T06:27:33.871 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:33 smithi018 ceph-mon[34477]: 1: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.c 2024-09-21T06:27:33.871 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:33 smithi018 ceph-mon[34477]: 2: [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] mon.b 2024-09-21T06:27:33.871 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:33 smithi018 ceph-mon[34477]: fsmap 2024-09-21T06:27:33.871 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:33 smithi018 ceph-mon[34477]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T06:27:33.871 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:33 smithi018 ceph-mon[34477]: mgrmap e14: x(active, since 51s) 2024-09-21T06:27:33.871 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:33 smithi018 ceph-mon[34477]: overall HEALTH_OK 2024-09-21T06:27:33.872 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:33 smithi018 ceph-mon[34477]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' 2024-09-21T06:27:33.872 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:33 smithi018 ceph-mon[34477]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' 2024-09-21T06:27:33.872 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:33 smithi018 ceph-mon[34477]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' 2024-09-21T06:27:33.872 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:33 smithi018 ceph-mon[34477]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' 2024-09-21T06:27:33.872 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:33 smithi018 ceph-mon[34477]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:27:33.872 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:33 smithi018 ceph-mon[34477]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:27:33.872 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:33 smithi018 ceph-mon[34477]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' 2024-09-21T06:27:33.872 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:33 smithi018 ceph-mon[34477]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' 2024-09-21T06:27:33.872 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:33 smithi018 ceph-mon[34477]: from='client.? 172.21.15.144:0/243266239' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T06:27:34.345 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:27:34.473 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:34 smithi007 ceph-mon[30983]: mon.b calling monitor election 2024-09-21T06:27:34.474 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:34 smithi007 ceph-mon[30983]: mon.b calling monitor election 2024-09-21T06:27:34.474 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:34 smithi007 ceph-mon[30983]: mon.c calling monitor election 2024-09-21T06:27:34.474 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:34 smithi007 ceph-mon[30983]: mon.a calling monitor election 2024-09-21T06:27:34.474 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:34 smithi007 ceph-mon[30983]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-21T06:27:34.474 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:34 smithi007 ceph-mon[30983]: monmap epoch 3 2024-09-21T06:27:34.474 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:34 smithi007 ceph-mon[30983]: fsid 347cb918-77e2-11ef-baf5-efdc52797490 2024-09-21T06:27:34.474 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:34 smithi007 ceph-mon[30983]: last_changed 2024-09-21T06:27:26.556045+0000 2024-09-21T06:27:34.474 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:34 smithi007 ceph-mon[30983]: created 2024-09-21T06:25:38.421457+0000 2024-09-21T06:27:34.474 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:34 smithi007 ceph-mon[30983]: min_mon_release 19 (squid) 2024-09-21T06:27:34.474 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:34 smithi007 ceph-mon[30983]: election_strategy: 1 2024-09-21T06:27:34.474 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:34 smithi007 ceph-mon[30983]: 0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-21T06:27:34.474 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:34 smithi007 ceph-mon[30983]: 1: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.c 2024-09-21T06:27:34.475 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:34 smithi007 ceph-mon[30983]: 2: [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] mon.b 2024-09-21T06:27:34.475 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:34 smithi007 ceph-mon[30983]: fsmap 2024-09-21T06:27:34.475 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:34 smithi007 ceph-mon[30983]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T06:27:34.475 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:34 smithi007 ceph-mon[30983]: mgrmap e14: x(active, since 53s) 2024-09-21T06:27:34.475 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:34 smithi007 ceph-mon[30983]: overall HEALTH_OK 2024-09-21T06:27:34.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:34 smithi144 ceph-mon[34653]: mon.b calling monitor election 2024-09-21T06:27:34.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:34 smithi144 ceph-mon[34653]: mon.b calling monitor election 2024-09-21T06:27:34.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:34 smithi144 ceph-mon[34653]: mon.c calling monitor election 2024-09-21T06:27:34.536 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:34 smithi144 ceph-mon[34653]: mon.a calling monitor election 2024-09-21T06:27:34.536 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:34 smithi144 ceph-mon[34653]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-21T06:27:34.536 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:34 smithi144 ceph-mon[34653]: monmap epoch 3 2024-09-21T06:27:34.536 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:34 smithi144 ceph-mon[34653]: fsid 347cb918-77e2-11ef-baf5-efdc52797490 2024-09-21T06:27:34.536 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:34 smithi144 ceph-mon[34653]: last_changed 2024-09-21T06:27:26.556045+0000 2024-09-21T06:27:34.536 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:34 smithi144 ceph-mon[34653]: created 2024-09-21T06:25:38.421457+0000 2024-09-21T06:27:34.536 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:34 smithi144 ceph-mon[34653]: min_mon_release 19 (squid) 2024-09-21T06:27:34.536 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:34 smithi144 ceph-mon[34653]: election_strategy: 1 2024-09-21T06:27:34.536 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:34 smithi144 ceph-mon[34653]: 0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-21T06:27:34.536 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:34 smithi144 ceph-mon[34653]: 1: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.c 2024-09-21T06:27:34.536 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:34 smithi144 ceph-mon[34653]: 2: [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] mon.b 2024-09-21T06:27:34.536 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:34 smithi144 ceph-mon[34653]: fsmap 2024-09-21T06:27:34.536 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:34 smithi144 ceph-mon[34653]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T06:27:34.536 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:34 smithi144 ceph-mon[34653]: mgrmap e14: x(active, since 53s) 2024-09-21T06:27:34.536 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:34 smithi144 ceph-mon[34653]: overall HEALTH_OK 2024-09-21T06:27:34.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:34 smithi018 ceph-mon[34477]: mon.b calling monitor election 2024-09-21T06:27:34.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:34 smithi018 ceph-mon[34477]: mon.b calling monitor election 2024-09-21T06:27:34.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:34 smithi018 ceph-mon[34477]: mon.c calling monitor election 2024-09-21T06:27:34.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:34 smithi018 ceph-mon[34477]: mon.a calling monitor election 2024-09-21T06:27:34.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:34 smithi018 ceph-mon[34477]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-21T06:27:34.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:34 smithi018 ceph-mon[34477]: monmap epoch 3 2024-09-21T06:27:34.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:34 smithi018 ceph-mon[34477]: fsid 347cb918-77e2-11ef-baf5-efdc52797490 2024-09-21T06:27:34.620 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:34 smithi018 ceph-mon[34477]: last_changed 2024-09-21T06:27:26.556045+0000 2024-09-21T06:27:34.620 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:34 smithi018 ceph-mon[34477]: created 2024-09-21T06:25:38.421457+0000 2024-09-21T06:27:34.620 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:34 smithi018 ceph-mon[34477]: min_mon_release 19 (squid) 2024-09-21T06:27:34.620 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:34 smithi018 ceph-mon[34477]: election_strategy: 1 2024-09-21T06:27:34.620 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:34 smithi018 ceph-mon[34477]: 0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2024-09-21T06:27:34.620 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:34 smithi018 ceph-mon[34477]: 1: [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] mon.c 2024-09-21T06:27:34.620 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:34 smithi018 ceph-mon[34477]: 2: [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] mon.b 2024-09-21T06:27:34.620 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:34 smithi018 ceph-mon[34477]: fsmap 2024-09-21T06:27:34.620 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:34 smithi018 ceph-mon[34477]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T06:27:34.620 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:34 smithi018 ceph-mon[34477]: mgrmap e14: x(active, since 53s) 2024-09-21T06:27:34.620 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:34 smithi018 ceph-mon[34477]: overall HEALTH_OK 2024-09-21T06:27:35.034 INFO:teuthology.orchestra.run.smithi007.stdout:# minimal ceph.conf for 347cb918-77e2-11ef-baf5-efdc52797490 2024-09-21T06:27:35.035 INFO:teuthology.orchestra.run.smithi007.stdout:[global] 2024-09-21T06:27:35.035 INFO:teuthology.orchestra.run.smithi007.stdout: fsid = 347cb918-77e2-11ef-baf5-efdc52797490 2024-09-21T06:27:35.035 INFO:teuthology.orchestra.run.smithi007.stdout: mon_host = [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] 2024-09-21T06:27:35.641 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:35 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' 2024-09-21T06:27:35.641 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:35 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' 2024-09-21T06:27:35.642 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:35 smithi007 ceph-mon[30983]: Reconfiguring mon.b (monmap changed)... 2024-09-21T06:27:35.642 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:35 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:27:35.642 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:35 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T06:27:35.642 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:35 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:27:35.642 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:35 smithi007 ceph-mon[30983]: Reconfiguring daemon mon.b on smithi018 2024-09-21T06:27:35.642 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:35 smithi007 ceph-mon[30983]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:27:35.642 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:35 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:27:35.642 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:35 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/3866347298' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:27:35.643 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-21T06:27:35.644 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-21T06:27:35.644 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T06:27:35.671 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-21T06:27:35.672 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:27:35.713 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:35 smithi018 ceph-mon[34477]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' 2024-09-21T06:27:35.713 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:35 smithi018 ceph-mon[34477]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' 2024-09-21T06:27:35.713 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:35 smithi018 ceph-mon[34477]: Reconfiguring mon.b (monmap changed)... 2024-09-21T06:27:35.713 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:35 smithi018 ceph-mon[34477]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:27:35.713 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:35 smithi018 ceph-mon[34477]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T06:27:35.713 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:35 smithi018 ceph-mon[34477]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:27:35.713 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:35 smithi018 ceph-mon[34477]: Reconfiguring daemon mon.b on smithi018 2024-09-21T06:27:35.714 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:35 smithi018 ceph-mon[34477]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:27:35.714 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:35 smithi018 ceph-mon[34477]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:27:35.714 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:35 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/3866347298' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:27:35.739 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-21T06:27:35.739 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T06:27:35.769 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-21T06:27:35.769 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:27:35.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:35 smithi144 ceph-mon[34653]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' 2024-09-21T06:27:35.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:35 smithi144 ceph-mon[34653]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' 2024-09-21T06:27:35.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:35 smithi144 ceph-mon[34653]: Reconfiguring mon.b (monmap changed)... 2024-09-21T06:27:35.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:35 smithi144 ceph-mon[34653]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:27:35.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:35 smithi144 ceph-mon[34653]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T06:27:35.786 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:35 smithi144 ceph-mon[34653]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:27:35.786 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:35 smithi144 ceph-mon[34653]: Reconfiguring daemon mon.b on smithi018 2024-09-21T06:27:35.786 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:35 smithi144 ceph-mon[34653]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:27:35.786 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:35 smithi144 ceph-mon[34653]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:27:35.786 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:35 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/3866347298' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:27:35.836 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-21T06:27:35.836 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T06:27:35.866 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-21T06:27:35.866 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:27:35.932 INFO:tasks.cephadm:enabling module snap_schedule 2024-09-21T06:27:35.933 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- sudo ceph --cluster ceph mgr module enable snap_schedule 2024-09-21T06:27:36.184 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:27:37.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:36 smithi144 ceph-mon[34653]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' 2024-09-21T06:27:37.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:36 smithi144 ceph-mon[34653]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' 2024-09-21T06:27:37.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:36 smithi144 ceph-mon[34653]: Reconfiguring mon.c (monmap changed)... 2024-09-21T06:27:37.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:36 smithi144 ceph-mon[34653]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:27:37.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:36 smithi144 ceph-mon[34653]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T06:27:37.036 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:36 smithi144 ceph-mon[34653]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:27:37.036 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:36 smithi144 ceph-mon[34653]: Reconfiguring daemon mon.c on smithi144 2024-09-21T06:27:37.036 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:36 smithi144 ceph-mon[34653]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' 2024-09-21T06:27:37.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:36 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' 2024-09-21T06:27:37.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:36 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' 2024-09-21T06:27:37.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:36 smithi007 ceph-mon[30983]: Reconfiguring mon.c (monmap changed)... 2024-09-21T06:27:37.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:36 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:27:37.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:36 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T06:27:37.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:36 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:27:37.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:36 smithi007 ceph-mon[30983]: Reconfiguring daemon mon.c on smithi144 2024-09-21T06:27:37.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:36 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' 2024-09-21T06:27:37.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:36 smithi018 ceph-mon[34477]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' 2024-09-21T06:27:37.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:36 smithi018 ceph-mon[34477]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' 2024-09-21T06:27:37.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:36 smithi018 ceph-mon[34477]: Reconfiguring mon.c (monmap changed)... 2024-09-21T06:27:37.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:36 smithi018 ceph-mon[34477]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T06:27:37.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:36 smithi018 ceph-mon[34477]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T06:27:37.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:36 smithi018 ceph-mon[34477]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:27:37.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:36 smithi018 ceph-mon[34477]: Reconfiguring daemon mon.c on smithi144 2024-09-21T06:27:37.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:36 smithi018 ceph-mon[34477]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' 2024-09-21T06:27:38.090 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:27:37 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: ignoring --setuser ceph since I am not root 2024-09-21T06:27:38.090 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:27:37 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: ignoring --setgroup ceph since I am not root 2024-09-21T06:27:38.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:37 smithi007 ceph-mon[30983]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:27:38.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:37 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/3427758615' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "snap_schedule"} : dispatch 2024-09-21T06:27:38.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:37 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' 2024-09-21T06:27:38.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:37 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' 2024-09-21T06:27:38.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:37 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:27:38.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:37 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:27:38.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:37 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:27:38.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:37 smithi007 ceph-mon[30983]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' 2024-09-21T06:27:38.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:37 smithi018 ceph-mon[34477]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:27:38.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:37 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/3427758615' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "snap_schedule"} : dispatch 2024-09-21T06:27:38.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:37 smithi018 ceph-mon[34477]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' 2024-09-21T06:27:38.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:37 smithi018 ceph-mon[34477]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' 2024-09-21T06:27:38.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:37 smithi018 ceph-mon[34477]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:27:38.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:37 smithi018 ceph-mon[34477]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:27:38.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:37 smithi018 ceph-mon[34477]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:27:38.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:37 smithi018 ceph-mon[34477]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' 2024-09-21T06:27:38.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:37 smithi144 ceph-mon[34653]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:27:38.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:37 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/3427758615' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "snap_schedule"} : dispatch 2024-09-21T06:27:38.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:37 smithi144 ceph-mon[34653]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' 2024-09-21T06:27:38.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:37 smithi144 ceph-mon[34653]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' 2024-09-21T06:27:38.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:37 smithi144 ceph-mon[34653]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:27:38.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:37 smithi144 ceph-mon[34653]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:27:38.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:37 smithi144 ceph-mon[34653]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:27:38.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:37 smithi144 ceph-mon[34653]: from='mgr.14152 172.21.15.7:0/592112276' entity='mgr.x' 2024-09-21T06:27:38.428 INFO:tasks.cephadm:Adding mgr.x on smithi007 2024-09-21T06:27:38.428 INFO:tasks.cephadm:Adding mgr.y on smithi018 2024-09-21T06:27:38.428 INFO:tasks.cephadm:Adding mgr.z on smithi144 2024-09-21T06:27:38.428 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph orch apply mgr '3;smithi007=x;smithi018=y;smithi144=z' 2024-09-21T06:27:38.680 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:27:39.087 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:38 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/3427758615' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-21T06:27:39.088 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:38 smithi144 ceph-mon[34653]: mgrmap e15: x(active, since 57s) 2024-09-21T06:27:39.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:38 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/3427758615' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-21T06:27:39.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:38 smithi007 ceph-mon[30983]: mgrmap e15: x(active, since 57s) 2024-09-21T06:27:39.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:38 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/3427758615' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-21T06:27:39.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:38 smithi018 ceph-mon[34477]: mgrmap e15: x(active, since 57s) 2024-09-21T06:27:43.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:43 smithi018 ceph-mon[34477]: Active manager daemon x restarted 2024-09-21T06:27:43.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:43 smithi018 ceph-mon[34477]: Activating manager daemon x 2024-09-21T06:27:43.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:43 smithi018 ceph-mon[34477]: osdmap e5: 0 total, 0 up, 0 in 2024-09-21T06:27:43.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:43 smithi018 ceph-mon[34477]: mgrmap e16: x(active, starting, since 0.0046074s) 2024-09-21T06:27:43.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:43 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:27:43.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:43 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:27:43.370 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:43 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:27:43.370 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:43 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T06:27:43.370 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:43 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T06:27:43.370 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:43 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T06:27:43.370 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:43 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T06:27:43.370 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:43 smithi018 ceph-mon[34477]: Manager daemon x is now available 2024-09-21T06:27:43.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:43 smithi144 ceph-mon[34653]: Active manager daemon x restarted 2024-09-21T06:27:43.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:43 smithi144 ceph-mon[34653]: Activating manager daemon x 2024-09-21T06:27:43.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:43 smithi144 ceph-mon[34653]: osdmap e5: 0 total, 0 up, 0 in 2024-09-21T06:27:43.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:43 smithi144 ceph-mon[34653]: mgrmap e16: x(active, starting, since 0.0046074s) 2024-09-21T06:27:43.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:43 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:27:43.536 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:43 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:27:43.536 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:43 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:27:43.536 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:43 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T06:27:43.536 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:43 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T06:27:43.536 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:43 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T06:27:43.536 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:43 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T06:27:43.536 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:43 smithi144 ceph-mon[34653]: Manager daemon x is now available 2024-09-21T06:27:43.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:43 smithi007 ceph-mon[30983]: Active manager daemon x restarted 2024-09-21T06:27:43.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:43 smithi007 ceph-mon[30983]: Activating manager daemon x 2024-09-21T06:27:43.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:43 smithi007 ceph-mon[30983]: osdmap e5: 0 total, 0 up, 0 in 2024-09-21T06:27:43.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:43 smithi007 ceph-mon[30983]: mgrmap e16: x(active, starting, since 0.0046074s) 2024-09-21T06:27:43.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:43 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:27:43.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:43 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:27:43.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:43 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:27:43.591 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:43 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T06:27:43.591 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:43 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T06:27:43.591 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:43 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T06:27:43.591 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:43 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T06:27:43.591 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:43 smithi007 ceph-mon[30983]: Manager daemon x is now available 2024-09-21T06:27:44.063 INFO:teuthology.orchestra.run.smithi144.stdout:Scheduled mgr update... 2024-09-21T06:27:44.363 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:44 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:27:44.363 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:44 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T06:27:44.363 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:44 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T06:27:44.363 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:44 smithi007 ceph-mon[30983]: mgrmap e17: x(active, since 1.01032s) 2024-09-21T06:27:44.363 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:44 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:44.365 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:44 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:27:44.365 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:44 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T06:27:44.365 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:44 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T06:27:44.365 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:44 smithi144 ceph-mon[34653]: mgrmap e17: x(active, since 1.01032s) 2024-09-21T06:27:44.365 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:44 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:44.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:44 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:27:44.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:44 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T06:27:44.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:44 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T06:27:44.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:44 smithi018 ceph-mon[34477]: mgrmap e17: x(active, since 1.01032s) 2024-09-21T06:27:44.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:44 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:44.780 DEBUG:teuthology.orchestra.run.smithi018:mgr.y> sudo journalctl -f -n 0 -u ceph-347cb918-77e2-11ef-baf5-efdc52797490@mgr.y.service 2024-09-21T06:27:44.783 DEBUG:teuthology.orchestra.run.smithi144:mgr.z> sudo journalctl -f -n 0 -u ceph-347cb918-77e2-11ef-baf5-efdc52797490@mgr.z.service 2024-09-21T06:27:44.786 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2024-09-21T06:27:44.786 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph config set client client_mount_timeout 600 2024-09-21T06:27:44.789 INFO:tasks.cephadm:setting config [client] debug_client = 20 2024-09-21T06:27:44.789 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph config set client debug_client 20 2024-09-21T06:27:44.832 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2024-09-21T06:27:44.832 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph config set client debug_ms 1 2024-09-21T06:27:44.876 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2024-09-21T06:27:44.876 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph config set client rados_mon_op_timeout 900 2024-09-21T06:27:44.919 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2024-09-21T06:27:44.919 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph config set client rados_osd_op_timeout 900 2024-09-21T06:27:44.962 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2024-09-21T06:27:44.962 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph config set mds debug_mds 20 2024-09-21T06:27:45.005 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2024-09-21T06:27:45.005 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph config set mds debug_mds_balancer 20 2024-09-21T06:27:45.051 INFO:tasks.cephadm:setting config [mds] debug_ms = 2 2024-09-21T06:27:45.051 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph config set mds debug_ms 2 2024-09-21T06:27:45.101 INFO:tasks.cephadm:setting config [mds] mds_bal_fragment_size_max = 10000 2024-09-21T06:27:45.101 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_fragment_size_max 10000 2024-09-21T06:27:45.151 INFO:tasks.cephadm:setting config [mds] mds_bal_merge_size = 5 2024-09-21T06:27:45.151 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_merge_size 5 2024-09-21T06:27:45.198 INFO:tasks.cephadm:setting config [mds] mds_bal_split_bits = 3 2024-09-21T06:27:45.198 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_split_bits 3 2024-09-21T06:27:45.253 INFO:tasks.cephadm:setting config [mds] mds_bal_split_size = 100 2024-09-21T06:27:45.253 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_split_size 100 2024-09-21T06:27:45.295 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:27:45.313 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2024-09-21T06:27:45.313 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph config set mds mds_debug_frag True 2024-09-21T06:27:45.370 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2024-09-21T06:27:45.370 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph config set mds mds_debug_scatterstat True 2024-09-21T06:27:45.424 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2024-09-21T06:27:45.424 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph config set mds mds_op_complaint_time 180 2024-09-21T06:27:45.425 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:27:45.448 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:27:45.463 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2024-09-21T06:27:45.464 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph config set mds mds_verify_scatter True 2024-09-21T06:27:45.513 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2024-09-21T06:27:45.513 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph config set mds osd_op_complaint_time 180 2024-09-21T06:27:45.558 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2024-09-21T06:27:45.558 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph config set mds rados_mon_op_timeout 900 2024-09-21T06:27:45.622 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2024-09-21T06:27:45.622 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph config set mds rados_osd_op_timeout 900 2024-09-21T06:27:45.651 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:27:45 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: 2024-09-21T06:27:45.389+0000 7fd5d479a640 -1 log_channel(cephadm) log [ERR] : [21/Sep/2024:06:27:45] ENGINE Error in HTTPServer.serve 2024-09-21T06:27:45.651 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:27:45 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: Traceback (most recent call last): 2024-09-21T06:27:45.651 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:27:45 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T06:27:45.651 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:27:45 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: self._connections.run(self.expiration_interval) 2024-09-21T06:27:45.651 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:27:45 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T06:27:45.651 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:27:45 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: self._run(expiration_interval) 2024-09-21T06:27:45.651 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:27:45 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T06:27:45.651 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:27:45 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T06:27:45.652 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:27:45 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T06:27:45.652 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:27:45 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T06:27:45.652 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:27:45 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T06:27:45.652 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:27:45 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: s = self.context.wrap_socket( 2024-09-21T06:27:45.652 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:27:45 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T06:27:45.652 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:27:45 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: return self.sslsocket_class._create( 2024-09-21T06:27:45.652 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:27:45 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T06:27:45.652 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:27:45 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: self.do_handshake() 2024-09-21T06:27:45.652 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:27:45 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T06:27:45.652 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:27:45 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: self._sslobj.do_handshake() 2024-09-21T06:27:45.652 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:27:45 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T06:27:45.652 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:27:45 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: 2024-09-21T06:27:45.653 INFO:tasks.cephadm:setting config [mgr] client_mount_timeout = 30 2024-09-21T06:27:45.653 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph config set mgr client_mount_timeout 30 2024-09-21T06:27:45.707 INFO:tasks.cephadm:setting config [mgr] debug_cephsqlite = 20 2024-09-21T06:27:45.707 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph config set mgr debug_cephsqlite 20 2024-09-21T06:27:45.761 INFO:tasks.cephadm:setting config [mgr] debug_client = 20 2024-09-21T06:27:45.761 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph config set mgr debug_client 20 2024-09-21T06:27:45.815 INFO:tasks.cephadm:setting config [mgr] debug_mgr = 20 2024-09-21T06:27:45.815 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph config set mgr debug_mgr 20 2024-09-21T06:27:45.867 INFO:tasks.cephadm:setting config [mgr] debug_ms = 1 2024-09-21T06:27:45.867 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph config set mgr debug_ms 1 2024-09-21T06:27:45.918 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/allow_m_granularity = True 2024-09-21T06:27:45.918 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2024-09-21T06:27:45.921 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:45 smithi007 ceph-mon[30983]: Saving service mgr spec with placement smithi007=x;smithi018=y;smithi144=z;count:3 2024-09-21T06:27:45.921 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:45 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:45.921 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:45 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:45.921 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:45 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:45.921 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:45 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:45.921 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:45 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:45.921 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:45 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:45.921 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:45 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:45.921 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:45 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:45.921 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:45 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi018", "name": "osd_memory_target"} : dispatch 2024-09-21T06:27:45.997 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/dump_on_update = True 2024-09-21T06:27:45.997 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph config set mgr mgr/snap_schedule/dump_on_update True 2024-09-21T06:27:46.055 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/log_level = debug 2024-09-21T06:27:46.055 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph config set mgr mgr/snap_schedule/log_level debug 2024-09-21T06:27:46.100 INFO:tasks.cephadm:setting config [mgr] mon_warn_on_pool_no_app = False 2024-09-21T06:27:46.100 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph config set mgr mon_warn_on_pool_no_app False 2024-09-21T06:27:46.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:45 smithi018 ceph-mon[34477]: Saving service mgr spec with placement smithi007=x;smithi018=y;smithi144=z;count:3 2024-09-21T06:27:46.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:45 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:46.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:45 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:46.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:45 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:46.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:45 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:46.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:45 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:46.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:45 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:46.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:45 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:46.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:45 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:46.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:45 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi018", "name": "osd_memory_target"} : dispatch 2024-09-21T06:27:46.156 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2024-09-21T06:27:46.156 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph config set mon mon_op_complaint_time 120 2024-09-21T06:27:46.208 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2024-09-21T06:27:46.209 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph config set osd osd_op_complaint_time 180 2024-09-21T06:27:46.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:45 smithi144 ceph-mon[34653]: Saving service mgr spec with placement smithi007=x;smithi018=y;smithi144=z;count:3 2024-09-21T06:27:46.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:45 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:46.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:45 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:46.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:45 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:46.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:45 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:46.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:45 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:46.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:45 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:46.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:45 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:46.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:45 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:46.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:45 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi018", "name": "osd_memory_target"} : dispatch 2024-09-21T06:27:46.296 DEBUG:tasks.cephadm:set 30 configs 2024-09-21T06:27:46.296 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '347cb918-77e2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi007') 2024-09-21T06:27:47.032 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:46 smithi007 ceph-mon[30983]: [21/Sep/2024:06:27:45] ENGINE Bus STARTING 2024-09-21T06:27:47.032 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:46 smithi007 ceph-mon[30983]: [21/Sep/2024:06:27:45] ENGINE Serving on https://172.21.15.7:7150 2024-09-21T06:27:47.032 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:46 smithi007 ceph-mon[30983]: [21/Sep/2024:06:27:45] ENGINE Error in HTTPServer.serve 2024-09-21T06:27:47.032 INFO:journalctl@ceph.mon.a.smithi007.stdout: Traceback (most recent call last): 2024-09-21T06:27:47.032 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T06:27:47.033 INFO:journalctl@ceph.mon.a.smithi007.stdout: self._connections.run(self.expiration_interval) 2024-09-21T06:27:47.033 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T06:27:47.033 INFO:journalctl@ceph.mon.a.smithi007.stdout: self._run(expiration_interval) 2024-09-21T06:27:47.033 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T06:27:47.033 INFO:journalctl@ceph.mon.a.smithi007.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T06:27:47.033 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T06:27:47.033 INFO:journalctl@ceph.mon.a.smithi007.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T06:27:47.033 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T06:27:47.033 INFO:journalctl@ceph.mon.a.smithi007.stdout: s = self.context.wrap_socket( 2024-09-21T06:27:47.033 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T06:27:47.033 INFO:journalctl@ceph.mon.a.smithi007.stdout: return self.sslsocket_class._create( 2024-09-21T06:27:47.033 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T06:27:47.033 INFO:journalctl@ceph.mon.a.smithi007.stdout: self.do_handshake() 2024-09-21T06:27:47.033 INFO:journalctl@ceph.mon.a.smithi007.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T06:27:47.033 INFO:journalctl@ceph.mon.a.smithi007.stdout: self._sslobj.do_handshake() 2024-09-21T06:27:47.034 INFO:journalctl@ceph.mon.a.smithi007.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T06:27:47.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:46 smithi007 ceph-mon[30983]: [21/Sep/2024:06:27:45] ENGINE Serving on http://172.21.15.7:8765 2024-09-21T06:27:47.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:46 smithi007 ceph-mon[30983]: [21/Sep/2024:06:27:45] ENGINE Bus STARTED 2024-09-21T06:27:47.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:46 smithi007 ceph-mon[30983]: mgrmap e18: x(active, since 2s) 2024-09-21T06:27:47.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:46 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:47.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:46 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:47.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:46 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi144", "name": "osd_memory_target"} : dispatch 2024-09-21T06:27:47.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:46 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2962739585' entity='client.admin' 2024-09-21T06:27:47.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:46 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:47.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:46 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:47.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:46 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi007", "name": "osd_memory_target"} : dispatch 2024-09-21T06:27:47.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:46 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:27:47.034 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:46 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:27:47.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:46 smithi018 ceph-mon[34477]: [21/Sep/2024:06:27:45] ENGINE Bus STARTING 2024-09-21T06:27:47.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:46 smithi018 ceph-mon[34477]: [21/Sep/2024:06:27:45] ENGINE Serving on https://172.21.15.7:7150 2024-09-21T06:27:47.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:46 smithi018 ceph-mon[34477]: [21/Sep/2024:06:27:45] ENGINE Error in HTTPServer.serve 2024-09-21T06:27:47.119 INFO:journalctl@ceph.mon.b.smithi018.stdout: Traceback (most recent call last): 2024-09-21T06:27:47.119 INFO:journalctl@ceph.mon.b.smithi018.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T06:27:47.120 INFO:journalctl@ceph.mon.b.smithi018.stdout: self._connections.run(self.expiration_interval) 2024-09-21T06:27:47.120 INFO:journalctl@ceph.mon.b.smithi018.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T06:27:47.120 INFO:journalctl@ceph.mon.b.smithi018.stdout: self._run(expiration_interval) 2024-09-21T06:27:47.120 INFO:journalctl@ceph.mon.b.smithi018.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T06:27:47.120 INFO:journalctl@ceph.mon.b.smithi018.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T06:27:47.120 INFO:journalctl@ceph.mon.b.smithi018.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T06:27:47.120 INFO:journalctl@ceph.mon.b.smithi018.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T06:27:47.120 INFO:journalctl@ceph.mon.b.smithi018.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T06:27:47.120 INFO:journalctl@ceph.mon.b.smithi018.stdout: s = self.context.wrap_socket( 2024-09-21T06:27:47.120 INFO:journalctl@ceph.mon.b.smithi018.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T06:27:47.120 INFO:journalctl@ceph.mon.b.smithi018.stdout: return self.sslsocket_class._create( 2024-09-21T06:27:47.120 INFO:journalctl@ceph.mon.b.smithi018.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T06:27:47.120 INFO:journalctl@ceph.mon.b.smithi018.stdout: self.do_handshake() 2024-09-21T06:27:47.121 INFO:journalctl@ceph.mon.b.smithi018.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T06:27:47.121 INFO:journalctl@ceph.mon.b.smithi018.stdout: self._sslobj.do_handshake() 2024-09-21T06:27:47.121 INFO:journalctl@ceph.mon.b.smithi018.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T06:27:47.121 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:46 smithi018 ceph-mon[34477]: [21/Sep/2024:06:27:45] ENGINE Serving on http://172.21.15.7:8765 2024-09-21T06:27:47.121 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:46 smithi018 ceph-mon[34477]: [21/Sep/2024:06:27:45] ENGINE Bus STARTED 2024-09-21T06:27:47.121 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:46 smithi018 ceph-mon[34477]: mgrmap e18: x(active, since 2s) 2024-09-21T06:27:47.121 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:46 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:47.121 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:46 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:47.121 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:46 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi144", "name": "osd_memory_target"} : dispatch 2024-09-21T06:27:47.121 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:46 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/2962739585' entity='client.admin' 2024-09-21T06:27:47.121 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:46 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:47.121 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:46 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:47.121 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:46 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi007", "name": "osd_memory_target"} : dispatch 2024-09-21T06:27:47.121 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:46 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:27:47.121 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:46 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:27:47.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:46 smithi144 ceph-mon[34653]: [21/Sep/2024:06:27:45] ENGINE Bus STARTING 2024-09-21T06:27:47.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:46 smithi144 ceph-mon[34653]: [21/Sep/2024:06:27:45] ENGINE Serving on https://172.21.15.7:7150 2024-09-21T06:27:47.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:46 smithi144 ceph-mon[34653]: [21/Sep/2024:06:27:45] ENGINE Error in HTTPServer.serve 2024-09-21T06:27:47.285 INFO:journalctl@ceph.mon.c.smithi144.stdout: Traceback (most recent call last): 2024-09-21T06:27:47.286 INFO:journalctl@ceph.mon.c.smithi144.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T06:27:47.286 INFO:journalctl@ceph.mon.c.smithi144.stdout: self._connections.run(self.expiration_interval) 2024-09-21T06:27:47.286 INFO:journalctl@ceph.mon.c.smithi144.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T06:27:47.286 INFO:journalctl@ceph.mon.c.smithi144.stdout: self._run(expiration_interval) 2024-09-21T06:27:47.286 INFO:journalctl@ceph.mon.c.smithi144.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T06:27:47.286 INFO:journalctl@ceph.mon.c.smithi144.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T06:27:47.286 INFO:journalctl@ceph.mon.c.smithi144.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T06:27:47.286 INFO:journalctl@ceph.mon.c.smithi144.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T06:27:47.286 INFO:journalctl@ceph.mon.c.smithi144.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T06:27:47.286 INFO:journalctl@ceph.mon.c.smithi144.stdout: s = self.context.wrap_socket( 2024-09-21T06:27:47.286 INFO:journalctl@ceph.mon.c.smithi144.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T06:27:47.286 INFO:journalctl@ceph.mon.c.smithi144.stdout: return self.sslsocket_class._create( 2024-09-21T06:27:47.287 INFO:journalctl@ceph.mon.c.smithi144.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T06:27:47.287 INFO:journalctl@ceph.mon.c.smithi144.stdout: self.do_handshake() 2024-09-21T06:27:47.287 INFO:journalctl@ceph.mon.c.smithi144.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T06:27:47.287 INFO:journalctl@ceph.mon.c.smithi144.stdout: self._sslobj.do_handshake() 2024-09-21T06:27:47.287 INFO:journalctl@ceph.mon.c.smithi144.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T06:27:47.287 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:46 smithi144 ceph-mon[34653]: [21/Sep/2024:06:27:45] ENGINE Serving on http://172.21.15.7:8765 2024-09-21T06:27:47.287 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:46 smithi144 ceph-mon[34653]: [21/Sep/2024:06:27:45] ENGINE Bus STARTED 2024-09-21T06:27:47.287 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:46 smithi144 ceph-mon[34653]: mgrmap e18: x(active, since 2s) 2024-09-21T06:27:47.287 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:46 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:47.287 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:46 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:47.287 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:46 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi144", "name": "osd_memory_target"} : dispatch 2024-09-21T06:27:47.287 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:46 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/2962739585' entity='client.admin' 2024-09-21T06:27:47.287 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:46 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:47.287 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:46 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:47.288 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:46 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi007", "name": "osd_memory_target"} : dispatch 2024-09-21T06:27:47.288 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:46 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:27:47.288 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:46 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:27:47.497 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '347cb918-77e2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi007') 2024-09-21T06:27:48.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:47 smithi144 ceph-mon[34653]: Updating smithi007:/etc/ceph/ceph.conf 2024-09-21T06:27:48.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:47 smithi144 ceph-mon[34653]: Updating smithi018:/etc/ceph/ceph.conf 2024-09-21T06:27:48.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:47 smithi144 ceph-mon[34653]: Updating smithi144:/etc/ceph/ceph.conf 2024-09-21T06:27:48.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:47 smithi144 ceph-mon[34653]: from='client.? ' entity='client.admin' 2024-09-21T06:27:48.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:47 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:48.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:47 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:48.036 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:47 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:48.036 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:47 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:48.036 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:47 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:48.036 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:47 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:48.036 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:47 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:48.036 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:47 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T06:27:48.036 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:47 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T06:27:48.036 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:47 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T06:27:48.036 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:47 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:27:48.108 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:47 smithi007 ceph-mon[30983]: Updating smithi007:/etc/ceph/ceph.conf 2024-09-21T06:27:48.108 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:47 smithi007 ceph-mon[30983]: Updating smithi018:/etc/ceph/ceph.conf 2024-09-21T06:27:48.108 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:47 smithi007 ceph-mon[30983]: Updating smithi144:/etc/ceph/ceph.conf 2024-09-21T06:27:48.109 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:47 smithi007 ceph-mon[30983]: from='client.? ' entity='client.admin' 2024-09-21T06:27:48.109 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:47 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:48.109 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:47 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:48.109 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:47 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:48.109 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:47 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:48.109 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:47 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:48.109 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:47 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:48.109 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:47 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:48.109 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:47 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T06:27:48.109 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:47 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T06:27:48.109 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:47 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T06:27:48.109 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:47 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:27:48.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:47 smithi018 ceph-mon[34477]: Updating smithi007:/etc/ceph/ceph.conf 2024-09-21T06:27:48.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:47 smithi018 ceph-mon[34477]: Updating smithi018:/etc/ceph/ceph.conf 2024-09-21T06:27:48.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:47 smithi018 ceph-mon[34477]: Updating smithi144:/etc/ceph/ceph.conf 2024-09-21T06:27:48.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:47 smithi018 ceph-mon[34477]: from='client.? ' entity='client.admin' 2024-09-21T06:27:48.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:47 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:48.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:47 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:48.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:47 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:48.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:47 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:48.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:47 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:48.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:47 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:48.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:47 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:48.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:47 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T06:27:48.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:47 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T06:27:48.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:47 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T06:27:48.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:47 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:27:48.403 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '347cb918-77e2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi007') 2024-09-21T06:27:48.778 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:27:48.844 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:27:48.882 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:27:48.886 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:27:48.919 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:27:48.925 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:27:48.999 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:27:49.004 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:27:49.062 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:27:49.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:49.087+0000 7f282b261640 1 -- 172.21.15.7:0/1390913501 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f280c03fb70 msgr2=0x7f280c042080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:49.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:49.087+0000 7f282b261640 1 --2- 172.21.15.7:0/1390913501 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f280c03fb70 0x7f280c042080 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2824079fd0 tx=0x7f2818005db0 comp rx=0 tx=0).stop 2024-09-21T06:27:49.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:49.087+0000 7f282b261640 1 -- 172.21.15.7:0/1390913501 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f28241049b0 msgr2=0x7f282419a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:49.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:49.087+0000 7f282b261640 1 --2- 172.21.15.7:0/1390913501 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f28241049b0 0x7f282419a220 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f281400d770 tx=0x7f281400dc30 comp rx=0 tx=0).stop 2024-09-21T06:27:49.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:49.087+0000 7f282b261640 1 -- 172.21.15.7:0/1390913501 shutdown_connections 2024-09-21T06:27:49.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:49.087+0000 7f282b261640 1 --2- 172.21.15.7:0/1390913501 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f280c03fb70 0x7f280c042080 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:49.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:49.087+0000 7f282b261640 1 --2- 172.21.15.7:0/1390913501 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f282410de10 0x7f282419fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:49.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:49.087+0000 7f282b261640 1 --2- 172.21.15.7:0/1390913501 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2824105300 0x7f282419a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:49.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:49.087+0000 7f282b261640 1 --2- 172.21.15.7:0/1390913501 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f28241049b0 0x7f282419a220 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:49.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:49.087+0000 7f282b261640 1 -- 172.21.15.7:0/1390913501 >> 172.21.15.7:0/1390913501 conn(0x7f2824079730 msgr2=0x7f28240ff730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:49.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:48 smithi007 ceph-mon[30983]: Updating smithi144:/var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:27:49.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:48 smithi007 ceph-mon[30983]: Updating smithi018:/var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:27:49.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:48 smithi007 ceph-mon[30983]: Updating smithi007:/var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:27:49.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:48 smithi007 ceph-mon[30983]: Updating smithi144:/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:27:49.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:48 smithi007 ceph-mon[30983]: Updating smithi018:/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:27:49.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:48 smithi007 ceph-mon[30983]: Updating smithi007:/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:27:49.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:48 smithi007 ceph-mon[30983]: Updating smithi144:/var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T06:27:49.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:48 smithi007 ceph-mon[30983]: Updating smithi018:/var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T06:27:49.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:48 smithi007 ceph-mon[30983]: Updating smithi007:/var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T06:27:49.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:48 smithi007 ceph-mon[30983]: Deploying daemon mgr.z on smithi144 2024-09-21T06:27:49.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:49.087+0000 7f282b261640 1 -- 172.21.15.7:0/1390913501 shutdown_connections 2024-09-21T06:27:49.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:49.087+0000 7f282b261640 1 -- 172.21.15.7:0/1390913501 wait complete. 2024-09-21T06:27:49.110 INFO:journalctl@ceph.mgr.z.smithi144.stdout:Sep 21 06:27:48 smithi144 systemd[1]: Starting Ceph mgr.z for 347cb918-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:27:49.111 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:48 smithi144 ceph-mon[34653]: Updating smithi144:/var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:27:49.111 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:48 smithi144 ceph-mon[34653]: Updating smithi018:/var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:27:49.111 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:48 smithi144 ceph-mon[34653]: Updating smithi007:/var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:27:49.111 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:48 smithi144 ceph-mon[34653]: Updating smithi144:/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:27:49.111 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:48 smithi144 ceph-mon[34653]: Updating smithi018:/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:27:49.111 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:48 smithi144 ceph-mon[34653]: Updating smithi007:/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:27:49.111 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:48 smithi144 ceph-mon[34653]: Updating smithi144:/var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T06:27:49.111 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:48 smithi144 ceph-mon[34653]: Updating smithi018:/var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T06:27:49.111 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:48 smithi144 ceph-mon[34653]: Updating smithi007:/var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T06:27:49.111 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:48 smithi144 ceph-mon[34653]: Deploying daemon mgr.z on smithi144 2024-09-21T06:27:49.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:48 smithi018 ceph-mon[34477]: Updating smithi144:/var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:27:49.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:48 smithi018 ceph-mon[34477]: Updating smithi018:/var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:27:49.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:48 smithi018 ceph-mon[34477]: Updating smithi007:/var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T06:27:49.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:48 smithi018 ceph-mon[34477]: Updating smithi144:/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:27:49.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:48 smithi018 ceph-mon[34477]: Updating smithi018:/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:27:49.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:48 smithi018 ceph-mon[34477]: Updating smithi007:/etc/ceph/ceph.client.admin.keyring 2024-09-21T06:27:49.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:48 smithi018 ceph-mon[34477]: Updating smithi144:/var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T06:27:49.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:48 smithi018 ceph-mon[34477]: Updating smithi018:/var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T06:27:49.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:48 smithi018 ceph-mon[34477]: Updating smithi007:/var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T06:27:49.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:48 smithi018 ceph-mon[34477]: Deploying daemon mgr.z on smithi144 2024-09-21T06:27:49.360 INFO:journalctl@ceph.mgr.z.smithi144.stdout:Sep 21 06:27:49 smithi144 podman[36616]: 2024-09-21 06:27:49.109053819 +0000 UTC m=+0.109116321 container create ee87c85254f1a98671fee1e67f14f7b9f6f823d0eb502fb853c2157ab91105ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-z, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-21T06:27:49.361 INFO:journalctl@ceph.mgr.z.smithi144.stdout:Sep 21 06:27:49 smithi144 podman[36616]: 2024-09-21 06:27:49.015451578 +0000 UTC m=+0.015514081 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:27:49.361 INFO:journalctl@ceph.mgr.z.smithi144.stdout:Sep 21 06:27:49 smithi144 podman[36616]: 2024-09-21 06:27:49.322084465 +0000 UTC m=+0.322146970 container init ee87c85254f1a98671fee1e67f14f7b9f6f823d0eb502fb853c2157ab91105ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-z, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-21T06:27:49.361 INFO:journalctl@ceph.mgr.z.smithi144.stdout:Sep 21 06:27:49 smithi144 podman[36616]: 2024-09-21 06:27:49.324842715 +0000 UTC m=+0.324905227 container start ee87c85254f1a98671fee1e67f14f7b9f6f823d0eb502fb853c2157ab91105ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-z, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-21T06:27:49.517 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:27:49.518 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:27:49.518 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:27:49.785 INFO:journalctl@ceph.mgr.z.smithi144.stdout:Sep 21 06:27:49 smithi144 ceph-mgr[36634]: -- 172.21.15.144:0/3940557894 <== mon.1 v2:172.21.15.144:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56356a0210e0 con 0x56356edc4000 2024-09-21T06:27:49.785 INFO:journalctl@ceph.mgr.z.smithi144.stdout:Sep 21 06:27:49 smithi144 bash[36616]: ee87c85254f1a98671fee1e67f14f7b9f6f823d0eb502fb853c2157ab91105ac 2024-09-21T06:27:49.785 INFO:journalctl@ceph.mgr.z.smithi144.stdout:Sep 21 06:27:49 smithi144 systemd[1]: Started Ceph mgr.z for 347cb918-77e2-11ef-baf5-efdc52797490. 2024-09-21T06:27:49.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:49.793+0000 7efd1e7ec640 1 -- 172.21.15.7:0/4274768553 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd18102a60 msgr2=0x7efd18102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:49.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:49.793+0000 7efd1e7ec640 1 --2- 172.21.15.7:0/4274768553 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd18102a60 0x7efd18102e70 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7efd08009900 tx=0x7efd0802a410 comp rx=0 tx=0).stop 2024-09-21T06:27:49.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:49.793+0000 7efd1e7ec640 1 -- 172.21.15.7:0/4274768553 shutdown_connections 2024-09-21T06:27:49.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:49.793+0000 7efd1e7ec640 1 --2- 172.21.15.7:0/4274768553 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd18108cf0 0x7efd1810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:49.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:49.793+0000 7efd1e7ec640 1 --2- 172.21.15.7:0/4274768553 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd181083a0 0x7efd181087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:49.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:49.793+0000 7efd1e7ec640 1 --2- 172.21.15.7:0/4274768553 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd18102a60 0x7efd18102e70 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:49.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:49.793+0000 7efd1e7ec640 1 -- 172.21.15.7:0/4274768553 >> 172.21.15.7:0/4274768553 conn(0x7efd18079730 msgr2=0x7efd18079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:49.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:49.793+0000 7efd1e7ec640 1 -- 172.21.15.7:0/4274768553 shutdown_connections 2024-09-21T06:27:49.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:49.793+0000 7efd1e7ec640 1 -- 172.21.15.7:0/4274768553 wait complete. 2024-09-21T06:27:49.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:49.794+0000 7efd1e7ec640 1 Processor -- start 2024-09-21T06:27:49.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:49.794+0000 7efd1e7ec640 1 -- start start 2024-09-21T06:27:49.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:49.794+0000 7efd1e7ec640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd18102a60 0x7efd1819a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:49.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:49.794+0000 7efd1e7ec640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd181083a0 0x7efd1819a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:49.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:49.794+0000 7efd1e7ec640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd18108cf0 0x7efd1819fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:49.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:49.794+0000 7efd1e7ec640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7efd18112720 con 0x7efd18108cf0 2024-09-21T06:27:49.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:49.794+0000 7efd1e7ec640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7efd181125a0 con 0x7efd18102a60 2024-09-21T06:27:49.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:49.794+0000 7efd1e7ec640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7efd181128a0 con 0x7efd181083a0 2024-09-21T06:27:49.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:49.795+0000 7efd17fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd18102a60 0x7efd1819a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:49.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:49.795+0000 7efd0ffff640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd181083a0 0x7efd1819a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:49.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:49.795+0000 7efd1cd89640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd18108cf0 0x7efd1819fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:49.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:49.795+0000 7efd17fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd18102a60 0x7efd1819a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.7:58032/0 (socket says 172.21.15.7:58032) 2024-09-21T06:27:49.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:49.795+0000 7efd17fff640 1 -- 172.21.15.7:0/997895150 learned_addr learned my addr 172.21.15.7:0/997895150 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:27:49.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:49.795+0000 7efd0ffff640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd181083a0 0x7efd1819a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.7:33410/0 (socket says 172.21.15.7:33410) 2024-09-21T06:27:49.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:49.795+0000 7efd1cd89640 1 -- 172.21.15.7:0/997895150 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd181083a0 msgr2=0x7efd1819a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:49.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:49.795+0000 7efd1cd89640 1 --2- 172.21.15.7:0/997895150 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd181083a0 0x7efd1819a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:49.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:49.795+0000 7efd1cd89640 1 -- 172.21.15.7:0/997895150 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd18102a60 msgr2=0x7efd1819a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:49.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:49.795+0000 7efd1cd89640 1 --2- 172.21.15.7:0/997895150 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd18102a60 0x7efd1819a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:49.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:49.795+0000 7efd1cd89640 1 -- 172.21.15.7:0/997895150 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd181a0290 con 0x7efd18108cf0 2024-09-21T06:27:49.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:49.795+0000 7efd17fff640 1 --2- 172.21.15.7:0/997895150 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd18102a60 0x7efd1819a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:27:49.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:49.795+0000 7efd1cd89640 1 --2- 172.21.15.7:0/997895150 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd18108cf0 0x7efd1819fb60 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7efd10009fd0 tx=0x7efd1000ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:49.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:49.795+0000 7efd15ffb640 1 -- 172.21.15.7:0/997895150 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd1000ce20 con 0x7efd18108cf0 2024-09-21T06:27:49.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:49.795+0000 7efd15ffb640 1 -- 172.21.15.7:0/997895150 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(24 keys) ==== 1039+0+0 (secure 0 0 0) 0x7efd10005020 con 0x7efd18108cf0 2024-09-21T06:27:49.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:49.795+0000 7efd1e7ec640 1 -- 172.21.15.7:0/997895150 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd181a0580 con 0x7efd18108cf0 2024-09-21T06:27:49.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:49.796+0000 7efd15ffb640 1 -- 172.21.15.7:0/997895150 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd10010690 con 0x7efd18108cf0 2024-09-21T06:27:49.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:49.796+0000 7efd1e7ec640 1 -- 172.21.15.7:0/997895150 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd181a6ce0 con 0x7efd18108cf0 2024-09-21T06:27:49.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:49.797+0000 7efd15ffb640 1 -- 172.21.15.7:0/997895150 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 51914+0+0 (secure 0 0 0) 0x7efd10010830 con 0x7efd18108cf0 2024-09-21T06:27:49.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:49.796+0000 7efd1e7ec640 1 -- 172.21.15.7:0/997895150 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd18102e70 con 0x7efd18108cf0 2024-09-21T06:27:49.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:49.797+0000 7efd15ffb640 1 --2- 172.21.15.7:0/997895150 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7efd0403fb70 0x7efd04042080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:49.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:49.797+0000 7efd15ffb640 1 -- 172.21.15.7:0/997895150 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7efd10054ca0 con 0x7efd18108cf0 2024-09-21T06:27:49.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:49.797+0000 7efd17fff640 1 --2- 172.21.15.7:0/997895150 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7efd0403fb70 0x7efd04042080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:49.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:49.797+0000 7efd17fff640 1 --2- 172.21.15.7:0/997895150 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7efd0403fb70 0x7efd04042080 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7efd08031440 tx=0x7efd080058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:49.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:49.802+0000 7efd15ffb640 1 -- 172.21.15.7:0/997895150 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7efd10008220 con 0x7efd18108cf0 2024-09-21T06:27:49.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:49.992+0000 7efd1e7ec640 1 -- 172.21.15.7:0/997895150 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7efd181a6eb0 con 0x7efd18108cf0 2024-09-21T06:27:49.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:49.992+0000 7efd15ffb640 1 -- 172.21.15.7:0/997895150 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v12)=0 v12) ==== 106+0+0 (secure 0 0 0) 0x7efd10013c20 con 0x7efd18108cf0 2024-09-21T06:27:49.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:49.994+0000 7efd1e7ec640 1 -- 172.21.15.7:0/997895150 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7efd0403fb70 msgr2=0x7efd04042080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:49.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:49.994+0000 7efd1e7ec640 1 --2- 172.21.15.7:0/997895150 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7efd0403fb70 0x7efd04042080 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7efd08031440 tx=0x7efd080058d0 comp rx=0 tx=0).stop 2024-09-21T06:27:49.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:49.994+0000 7efd1e7ec640 1 -- 172.21.15.7:0/997895150 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd18108cf0 msgr2=0x7efd1819fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:49.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:49.994+0000 7efd1e7ec640 1 --2- 172.21.15.7:0/997895150 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd18108cf0 0x7efd1819fb60 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7efd10009fd0 tx=0x7efd1000ef10 comp rx=0 tx=0).stop 2024-09-21T06:27:49.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:49.995+0000 7efd1e7ec640 1 -- 172.21.15.7:0/997895150 shutdown_connections 2024-09-21T06:27:49.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:49.995+0000 7efd1e7ec640 1 --2- 172.21.15.7:0/997895150 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7efd0403fb70 0x7efd04042080 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:49.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:49.995+0000 7efd1e7ec640 1 --2- 172.21.15.7:0/997895150 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd18108cf0 0x7efd1819fb60 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:49.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:49.995+0000 7efd1e7ec640 1 --2- 172.21.15.7:0/997895150 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd181083a0 0x7efd1819a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:49.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:49.995+0000 7efd1e7ec640 1 --2- 172.21.15.7:0/997895150 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd18102a60 0x7efd1819a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:49.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:49.995+0000 7efd1e7ec640 1 -- 172.21.15.7:0/997895150 >> 172.21.15.7:0/997895150 conn(0x7efd18079730 msgr2=0x7efd18101c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:49.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:49.995+0000 7efd1e7ec640 1 -- 172.21.15.7:0/997895150 shutdown_connections 2024-09-21T06:27:49.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:49.995+0000 7efd1e7ec640 1 -- 172.21.15.7:0/997895150 wait complete. 2024-09-21T06:27:50.248 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:50 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/1390913501' entity='client.admin' 2024-09-21T06:27:50.248 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:50 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:50.248 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:50 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:50.248 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:50 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:50.249 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:50 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T06:27:50.249 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:50 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T06:27:50.249 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:50 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T06:27:50.249 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:50 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:27:50.249 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:50 smithi007 ceph-mon[30983]: Deploying daemon mgr.y on smithi018 2024-09-21T06:27:50.321 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:50 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/1390913501' entity='client.admin' 2024-09-21T06:27:50.321 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:50 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:50.321 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:50 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:50.321 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:50 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:50.322 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:50 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T06:27:50.322 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:50 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T06:27:50.322 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:50 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T06:27:50.322 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:50 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:27:50.322 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:50 smithi018 ceph-mon[34477]: Deploying daemon mgr.y on smithi018 2024-09-21T06:27:50.505 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:50 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/1390913501' entity='client.admin' 2024-09-21T06:27:50.505 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:50 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:50.505 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:50 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:50.505 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:50 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:50.505 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:50 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T06:27:50.505 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:50 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T06:27:50.505 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:50 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T06:27:50.505 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:50 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:27:50.505 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:50 smithi144 ceph-mon[34653]: Deploying daemon mgr.y on smithi018 2024-09-21T06:27:50.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:50.538+0000 7f063b59e640 1 -- 172.21.15.7:0/3264835557 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f063c1092d0 msgr2=0x7f063c1096e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:50.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:50.538+0000 7f063b59e640 1 --2- 172.21.15.7:0/3264835557 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f063c1092d0 0x7f063c1096e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0624009900 tx=0x7f062402a410 comp rx=0 tx=0).stop 2024-09-21T06:27:50.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:50.538+0000 7f063b59e640 1 -- 172.21.15.7:0/3264835557 shutdown_connections 2024-09-21T06:27:50.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:50.538+0000 7f063b59e640 1 --2- 172.21.15.7:0/3264835557 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f063c109c20 0x7f063c110450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:50.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:50.538+0000 7f063b59e640 1 --2- 172.21.15.7:0/3264835557 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f063c1092d0 0x7f063c1096e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:50.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:50.538+0000 7f063b59e640 1 --2- 172.21.15.7:0/3264835557 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f063c103990 0x7f063c103da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:50.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:50.538+0000 7f063b59e640 1 -- 172.21.15.7:0/3264835557 >> 172.21.15.7:0/3264835557 conn(0x7f063c0ff440 msgr2=0x7f063c101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:50.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:50.538+0000 7f063b59e640 1 -- 172.21.15.7:0/3264835557 shutdown_connections 2024-09-21T06:27:50.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:50.538+0000 7f063b59e640 1 -- 172.21.15.7:0/3264835557 wait complete. 2024-09-21T06:27:50.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:50.539+0000 7f063b59e640 1 Processor -- start 2024-09-21T06:27:50.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:50.539+0000 7f063b59e640 1 -- start start 2024-09-21T06:27:50.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:50.540+0000 7f063b59e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f063c103990 0x7f063c19a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:50.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:50.540+0000 7f063b59e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f063c1092d0 0x7f063c19a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:50.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:50.540+0000 7f063b59e640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f063c109c20 0x7f063c19fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:50.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:50.540+0000 7f063b59e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f063c1136f0 con 0x7f063c1092d0 2024-09-21T06:27:50.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:50.540+0000 7f063b59e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f063c113570 con 0x7f063c103990 2024-09-21T06:27:50.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:50.540+0000 7f063b59e640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f063c113870 con 0x7f063c109c20 2024-09-21T06:27:50.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:50.540+0000 7f0633fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f063c1092d0 0x7f063c19a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:50.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:50.540+0000 7f0633fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f063c1092d0 0x7f063c19a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51612/0 (socket says 172.21.15.7:51612) 2024-09-21T06:27:50.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:50.540+0000 7f0633fff640 1 -- 172.21.15.7:0/3589623101 learned_addr learned my addr 172.21.15.7:0/3589623101 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:27:50.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:50.540+0000 7f063ad9d640 1 --2- 172.21.15.7:0/3589623101 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f063c109c20 0x7f063c19fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:50.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:50.540+0000 7f063a59c640 1 --2- 172.21.15.7:0/3589623101 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f063c103990 0x7f063c19a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:50.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:50.540+0000 7f0633fff640 1 -- 172.21.15.7:0/3589623101 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f063c109c20 msgr2=0x7f063c19fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:50.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:50.540+0000 7f0633fff640 1 --2- 172.21.15.7:0/3589623101 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f063c109c20 0x7f063c19fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:50.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:50.540+0000 7f0633fff640 1 -- 172.21.15.7:0/3589623101 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f063c103990 msgr2=0x7f063c19a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:50.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:50.540+0000 7f0633fff640 1 --2- 172.21.15.7:0/3589623101 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f063c103990 0x7f063c19a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:50.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:50.540+0000 7f0633fff640 1 -- 172.21.15.7:0/3589623101 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f063c1a00b0 con 0x7f063c1092d0 2024-09-21T06:27:50.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:50.540+0000 7f0633fff640 1 --2- 172.21.15.7:0/3589623101 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f063c1092d0 0x7f063c19a7a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0624005ab0 tx=0x7f0624003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:50.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:50.541+0000 7f06337fe640 1 -- 172.21.15.7:0/3589623101 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f062403f070 con 0x7f063c1092d0 2024-09-21T06:27:50.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:50.541+0000 7f06337fe640 1 -- 172.21.15.7:0/3589623101 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(24 keys) ==== 1039+0+0 (secure 0 0 0) 0x7f0624031d20 con 0x7f063c1092d0 2024-09-21T06:27:50.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:50.541+0000 7f06337fe640 1 -- 172.21.15.7:0/3589623101 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0624035030 con 0x7f063c1092d0 2024-09-21T06:27:50.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:50.541+0000 7f063b59e640 1 -- 172.21.15.7:0/3589623101 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f063c1a0340 con 0x7f063c1092d0 2024-09-21T06:27:50.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:50.541+0000 7f063b59e640 1 -- 172.21.15.7:0/3589623101 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f063c1a07d0 con 0x7f063c1092d0 2024-09-21T06:27:50.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:50.542+0000 7f063b59e640 1 -- 172.21.15.7:0/3589623101 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f063c103da0 con 0x7f063c1092d0 2024-09-21T06:27:50.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:50.542+0000 7f06337fe640 1 -- 172.21.15.7:0/3589623101 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 51914+0+0 (secure 0 0 0) 0x7f0624042070 con 0x7f063c1092d0 2024-09-21T06:27:50.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:50.542+0000 7f06337fe640 1 --2- 172.21.15.7:0/3589623101 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f062803fba0 0x7f06280420b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:50.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:50.542+0000 7f06337fe640 1 -- 172.21.15.7:0/3589623101 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f0624074da0 con 0x7f063c1092d0 2024-09-21T06:27:50.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:50.542+0000 7f063a59c640 1 --2- 172.21.15.7:0/3589623101 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f062803fba0 0x7f06280420b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:50.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:50.543+0000 7f063a59c640 1 --2- 172.21.15.7:0/3589623101 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f062803fba0 0x7f06280420b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f062c005fd0 tx=0x7f062c00b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:50.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:50.547+0000 7f06337fe640 1 -- 172.21.15.7:0/3589623101 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0624042e10 con 0x7f063c1092d0 2024-09-21T06:27:50.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:50.736+0000 7f063b59e640 1 -- 172.21.15.7:0/3589623101 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f063c10ba10 con 0x7f063c1092d0 2024-09-21T06:27:50.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:50.739+0000 7f06337fe640 1 -- 172.21.15.7:0/3589623101 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v13)=0 v13) ==== 121+0+0 (secure 0 0 0) 0x7f062403b4f0 con 0x7f063c1092d0 2024-09-21T06:27:50.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:50.741+0000 7f063b59e640 1 -- 172.21.15.7:0/3589623101 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f062803fba0 msgr2=0x7f06280420b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:50.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:50.741+0000 7f063b59e640 1 --2- 172.21.15.7:0/3589623101 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f062803fba0 0x7f06280420b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f062c005fd0 tx=0x7f062c00b390 comp rx=0 tx=0).stop 2024-09-21T06:27:50.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:50.741+0000 7f063b59e640 1 -- 172.21.15.7:0/3589623101 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f063c1092d0 msgr2=0x7f063c19a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:50.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:50.741+0000 7f063b59e640 1 --2- 172.21.15.7:0/3589623101 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f063c1092d0 0x7f063c19a7a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0624005ab0 tx=0x7f0624003cd0 comp rx=0 tx=0).stop 2024-09-21T06:27:50.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:50.741+0000 7f063b59e640 1 -- 172.21.15.7:0/3589623101 shutdown_connections 2024-09-21T06:27:50.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:50.741+0000 7f063b59e640 1 --2- 172.21.15.7:0/3589623101 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f062803fba0 0x7f06280420b0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:50.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:50.741+0000 7f063b59e640 1 --2- 172.21.15.7:0/3589623101 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f063c109c20 0x7f063c19fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:50.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:50.741+0000 7f063b59e640 1 --2- 172.21.15.7:0/3589623101 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f063c1092d0 0x7f063c19a7a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:50.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:50.741+0000 7f063b59e640 1 --2- 172.21.15.7:0/3589623101 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f063c103990 0x7f063c19a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:50.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:50.741+0000 7f063b59e640 1 -- 172.21.15.7:0/3589623101 >> 172.21.15.7:0/3589623101 conn(0x7f063c0ff440 msgr2=0x7f063c101860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:50.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:50.742+0000 7f063b59e640 1 -- 172.21.15.7:0/3589623101 shutdown_connections 2024-09-21T06:27:50.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:50.742+0000 7f063b59e640 1 -- 172.21.15.7:0/3589623101 wait complete. 2024-09-21T06:27:51.048 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:27:51.048 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:27:51.050 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:27:51.050 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:27:51.051 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:27:51.213 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:27:51.214 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:27:51.217 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:27:51.217 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:27:51.617 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 21 06:27:51 smithi018 systemd[1]: Starting Ceph mgr.y for 347cb918-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:27:51.707 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '347cb918-77e2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi007') 2024-09-21T06:27:51.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:51 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/3589623101' entity='client.admin' 2024-09-21T06:27:51.869 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 21 06:27:51 smithi018 podman[36003]: 2024-09-21 06:27:51.616481115 +0000 UTC m=+0.112066067 container create d6428692c41630d2fe3af19b3cee3c49ce7f785acb7d2c92f301fb8d481c120b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-y, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:27:51.869 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 21 06:27:51 smithi018 podman[36003]: 2024-09-21 06:27:51.520536976 +0000 UTC m=+0.016121936 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:27:51.869 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 21 06:27:51 smithi018 podman[36003]: 2024-09-21 06:27:51.818610329 +0000 UTC m=+0.314195277 container init d6428692c41630d2fe3af19b3cee3c49ce7f785acb7d2c92f301fb8d481c120b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-y, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:27:51.869 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 21 06:27:51 smithi018 podman[36003]: 2024-09-21 06:27:51.821828966 +0000 UTC m=+0.317413914 container start d6428692c41630d2fe3af19b3cee3c49ce7f785acb7d2c92f301fb8d481c120b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-y, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-21T06:27:51.870 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 21 06:27:51 smithi018 ceph-mgr[36022]: -- 172.21.15.18:0/554314739 <== mon.2 v2:172.21.15.18:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563f626830e0 con 0x563f626a1a80 2024-09-21T06:27:51.968 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:51 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/3589623101' entity='client.admin' 2024-09-21T06:27:52.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:51 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/3589623101' entity='client.admin' 2024-09-21T06:27:52.369 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 21 06:27:51 smithi018 bash[36003]: d6428692c41630d2fe3af19b3cee3c49ce7f785acb7d2c92f301fb8d481c120b 2024-09-21T06:27:52.369 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 21 06:27:51 smithi018 systemd[1]: Started Ceph mgr.y for 347cb918-77e2-11ef-baf5-efdc52797490. 2024-09-21T06:27:52.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:52.868+0000 7f7630999640 1 -- 172.21.15.7:0/534335128 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f762c1094e0 msgr2=0x7f762c1098f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:52.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:52.868+0000 7f7630999640 1 --2- 172.21.15.7:0/534335128 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f762c1094e0 0x7f762c1098f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7614009900 tx=0x7f761402a410 comp rx=0 tx=0).stop 2024-09-21T06:27:52.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:52.868+0000 7f7630999640 1 -- 172.21.15.7:0/534335128 shutdown_connections 2024-09-21T06:27:52.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:52.868+0000 7f7630999640 1 --2- 172.21.15.7:0/534335128 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f762c109e30 0x7f762c110660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:52.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:52.868+0000 7f7630999640 1 --2- 172.21.15.7:0/534335128 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f762c1094e0 0x7f762c1098f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:52.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:52.868+0000 7f7630999640 1 --2- 172.21.15.7:0/534335128 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f762c103ba0 0x7f762c103fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:52.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:52.868+0000 7f7630999640 1 -- 172.21.15.7:0/534335128 >> 172.21.15.7:0/534335128 conn(0x7f762c0ff630 msgr2=0x7f762c101a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:52.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:52.869+0000 7f7630999640 1 -- 172.21.15.7:0/534335128 shutdown_connections 2024-09-21T06:27:52.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:52.869+0000 7f7630999640 1 -- 172.21.15.7:0/534335128 wait complete. 2024-09-21T06:27:52.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:52.869+0000 7f7630999640 1 Processor -- start 2024-09-21T06:27:52.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:52.869+0000 7f7630999640 1 -- start start 2024-09-21T06:27:52.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:52.870+0000 7f7630999640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f762c103ba0 0x7f762c19a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:52.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:52.870+0000 7f7630999640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f762c1094e0 0x7f762c19a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:52.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:52.870+0000 7f7630999640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f762c109e30 0x7f762c19fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:52.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:52.870+0000 7f7630999640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f762c1138b0 con 0x7f762c109e30 2024-09-21T06:27:52.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:52.870+0000 7f7630999640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f762c113730 con 0x7f762c103ba0 2024-09-21T06:27:52.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:52.870+0000 7f7630999640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f762c113a30 con 0x7f762c1094e0 2024-09-21T06:27:52.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:52.870+0000 7f762ad9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f762c109e30 0x7f762c19fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:52.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:52.870+0000 7f762a59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f762c103ba0 0x7f762c19a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:52.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:52.870+0000 7f762a59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f762c103ba0 0x7f762c19a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.7:52104/0 (socket says 172.21.15.7:52104) 2024-09-21T06:27:52.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:52.870+0000 7f762a59c640 1 -- 172.21.15.7:0/517341217 learned_addr learned my addr 172.21.15.7:0/517341217 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:27:52.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:52.870+0000 7f7623fff640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f762c1094e0 0x7f762c19a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:52.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:52.870+0000 7f762a59c640 1 -- 172.21.15.7:0/517341217 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f762c1094e0 msgr2=0x7f762c19a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:52.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:52.870+0000 7f762a59c640 1 --2- 172.21.15.7:0/517341217 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f762c1094e0 0x7f762c19a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:52.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:52.870+0000 7f762a59c640 1 -- 172.21.15.7:0/517341217 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f762c109e30 msgr2=0x7f762c19fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:52.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:52.870+0000 7f762a59c640 1 --2- 172.21.15.7:0/517341217 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f762c109e30 0x7f762c19fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:52.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:52.870+0000 7f762a59c640 1 -- 172.21.15.7:0/517341217 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f762c1a02b0 con 0x7f762c103ba0 2024-09-21T06:27:52.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:52.870+0000 7f762a59c640 1 --2- 172.21.15.7:0/517341217 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f762c103ba0 0x7f762c19a340 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f761c00d950 tx=0x7f761c00de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:52.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:52.871+0000 7f76237fe640 1 -- 172.21.15.7:0/517341217 <== mon.2 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f761c017070 con 0x7f762c103ba0 2024-09-21T06:27:52.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:52.871+0000 7f76237fe640 1 -- 172.21.15.7:0/517341217 <== mon.2 v2:172.21.15.18:3300/0 2 ==== config(24 keys) ==== 1039+0+0 (secure 0 0 0) 0x7f761c009c30 con 0x7f762c103ba0 2024-09-21T06:27:52.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:52.871+0000 7f7630999640 1 -- 172.21.15.7:0/517341217 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f762c1a05a0 con 0x7f762c103ba0 2024-09-21T06:27:52.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:52.871+0000 7f76237fe640 1 -- 172.21.15.7:0/517341217 <== mon.2 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f761c00f620 con 0x7f762c103ba0 2024-09-21T06:27:52.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:52.871+0000 7f7630999640 1 -- 172.21.15.7:0/517341217 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f762c1a6d00 con 0x7f762c103ba0 2024-09-21T06:27:52.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:52.872+0000 7f7630999640 1 -- 172.21.15.7:0/517341217 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f762c103fb0 con 0x7f762c103ba0 2024-09-21T06:27:52.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:52.872+0000 7f76237fe640 1 -- 172.21.15.7:0/517341217 <== mon.2 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 51914+0+0 (secure 0 0 0) 0x7f761c00f7c0 con 0x7f762c103ba0 2024-09-21T06:27:52.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:52.872+0000 7f76237fe640 1 --2- 172.21.15.7:0/517341217 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f761803fb70 0x7f7618042080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:52.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:52.872+0000 7f76237fe640 1 -- 172.21.15.7:0/517341217 <== mon.2 v2:172.21.15.18:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f761c054300 con 0x7f762c103ba0 2024-09-21T06:27:52.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:52.872+0000 7f7623fff640 1 --2- 172.21.15.7:0/517341217 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f761803fb70 0x7f7618042080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:52.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:52.873+0000 7f7623fff640 1 --2- 172.21.15.7:0/517341217 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f761803fb70 0x7f7618042080 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7614009230 tx=0x7f7614031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:52.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:52.877+0000 7f76237fe640 1 -- 172.21.15.7:0/517341217 <== mon.2 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f761c010e20 con 0x7f762c103ba0 2024-09-21T06:27:53.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.068+0000 7f7630999640 1 -- 172.21.15.7:0/517341217 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7f762c10bc20 con 0x7f762c103ba0 2024-09-21T06:27:53.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.073+0000 7f76237fe640 1 -- 172.21.15.7:0/517341217 <== mon.2 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v14)=0 v14) ==== 133+0+0 (secure 0 0 0) 0x7f761c01e120 con 0x7f762c103ba0 2024-09-21T06:27:53.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.075+0000 7f7630999640 1 -- 172.21.15.7:0/517341217 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f761803fb70 msgr2=0x7f7618042080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:53.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.075+0000 7f7630999640 1 --2- 172.21.15.7:0/517341217 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f761803fb70 0x7f7618042080 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7614009230 tx=0x7f7614031400 comp rx=0 tx=0).stop 2024-09-21T06:27:53.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.075+0000 7f7630999640 1 -- 172.21.15.7:0/517341217 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f762c103ba0 msgr2=0x7f762c19a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:53.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.075+0000 7f7630999640 1 --2- 172.21.15.7:0/517341217 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f762c103ba0 0x7f762c19a340 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f761c00d950 tx=0x7f761c00de10 comp rx=0 tx=0).stop 2024-09-21T06:27:53.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.076+0000 7f7630999640 1 -- 172.21.15.7:0/517341217 shutdown_connections 2024-09-21T06:27:53.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.076+0000 7f7630999640 1 --2- 172.21.15.7:0/517341217 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f761803fb70 0x7f7618042080 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:53.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.076+0000 7f7630999640 1 --2- 172.21.15.7:0/517341217 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f762c109e30 0x7f762c19fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:53.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.076+0000 7f7630999640 1 --2- 172.21.15.7:0/517341217 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f762c1094e0 0x7f762c19a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:53.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.076+0000 7f7630999640 1 --2- 172.21.15.7:0/517341217 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f762c103ba0 0x7f762c19a340 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:53.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.076+0000 7f7630999640 1 -- 172.21.15.7:0/517341217 >> 172.21.15.7:0/517341217 conn(0x7f762c0ff630 msgr2=0x7f762c101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:53.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.076+0000 7f7630999640 1 -- 172.21.15.7:0/517341217 shutdown_connections 2024-09-21T06:27:53.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.076+0000 7f7630999640 1 -- 172.21.15.7:0/517341217 wait complete. 2024-09-21T06:27:53.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:52 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:53.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:52 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:53.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:52 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:53.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:52 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:53.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:52 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:27:53.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:52 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:53.315 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:52 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:53.315 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:52 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:53.315 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:52 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:53.315 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:52 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:53.315 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:52 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:27:53.315 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:52 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:53.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:52 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:53.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:52 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:53.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:52 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:53.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:52 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:53.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:52 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:27:53.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:52 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:53.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.489+0000 7feb860de640 1 -- 172.21.15.7:0/2295360738 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb80103b80 msgr2=0x7feb80103f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:53.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.489+0000 7feb860de640 1 --2- 172.21.15.7:0/2295360738 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb80103b80 0x7feb80103f90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7feb70009860 tx=0x7feb7002a340 comp rx=0 tx=0).stop 2024-09-21T06:27:53.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.489+0000 7feb860de640 1 -- 172.21.15.7:0/2295360738 shutdown_connections 2024-09-21T06:27:53.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.489+0000 7feb860de640 1 --2- 172.21.15.7:0/2295360738 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb80109e10 0x7feb80110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:53.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.489+0000 7feb860de640 1 --2- 172.21.15.7:0/2295360738 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb801094c0 0x7feb801098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:53.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.489+0000 7feb860de640 1 --2- 172.21.15.7:0/2295360738 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb80103b80 0x7feb80103f90 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:53.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.489+0000 7feb860de640 1 -- 172.21.15.7:0/2295360738 >> 172.21.15.7:0/2295360738 conn(0x7feb800ff610 msgr2=0x7feb80101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:53.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.489+0000 7feb860de640 1 -- 172.21.15.7:0/2295360738 shutdown_connections 2024-09-21T06:27:53.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.489+0000 7feb860de640 1 -- 172.21.15.7:0/2295360738 wait complete. 2024-09-21T06:27:53.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.490+0000 7feb860de640 1 Processor -- start 2024-09-21T06:27:53.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.490+0000 7feb860de640 1 -- start start 2024-09-21T06:27:53.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.490+0000 7feb860de640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb80103b80 0x7feb8019a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:53.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.490+0000 7feb860de640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb801094c0 0x7feb8019a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:53.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.490+0000 7feb860de640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb80109e10 0x7feb8019fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:53.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.490+0000 7feb860de640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7feb80113890 con 0x7feb801094c0 2024-09-21T06:27:53.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.490+0000 7feb860de640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7feb80113710 con 0x7feb80109e10 2024-09-21T06:27:53.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.490+0000 7feb860de640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7feb80113a10 con 0x7feb80103b80 2024-09-21T06:27:53.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.490+0000 7feb7effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb801094c0 0x7feb8019a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:53.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.490+0000 7feb7effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb801094c0 0x7feb8019a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51650/0 (socket says 172.21.15.7:51650) 2024-09-21T06:27:53.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.490+0000 7feb7effd640 1 -- 172.21.15.7:0/3556747063 learned_addr learned my addr 172.21.15.7:0/3556747063 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:27:53.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.491+0000 7feb7ffff640 1 --2- 172.21.15.7:0/3556747063 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb80109e10 0x7feb8019fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:53.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.491+0000 7feb7f7fe640 1 --2- 172.21.15.7:0/3556747063 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb80103b80 0x7feb8019a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:53.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.491+0000 7feb7ffff640 1 -- 172.21.15.7:0/3556747063 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb80103b80 msgr2=0x7feb8019a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:53.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.491+0000 7feb7ffff640 1 --2- 172.21.15.7:0/3556747063 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb80103b80 0x7feb8019a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:53.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.491+0000 7feb7ffff640 1 -- 172.21.15.7:0/3556747063 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb801094c0 msgr2=0x7feb8019a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:53.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.491+0000 7feb7ffff640 1 --2- 172.21.15.7:0/3556747063 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb801094c0 0x7feb8019a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:53.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.491+0000 7feb7ffff640 1 -- 172.21.15.7:0/3556747063 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb801a0250 con 0x7feb80109e10 2024-09-21T06:27:53.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.491+0000 7feb7effd640 1 --2- 172.21.15.7:0/3556747063 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb801094c0 0x7feb8019a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:27:53.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.491+0000 7feb7f7fe640 1 --2- 172.21.15.7:0/3556747063 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb80103b80 0x7feb8019a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:27:53.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.491+0000 7feb7ffff640 1 --2- 172.21.15.7:0/3556747063 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb80109e10 0x7feb8019fb20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7feb78009fd0 tx=0x7feb7800ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:53.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.491+0000 7feb7cff9640 1 -- 172.21.15.7:0/3556747063 <== mon.2 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb7800ce20 con 0x7feb80109e10 2024-09-21T06:27:53.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.492+0000 7feb7cff9640 1 -- 172.21.15.7:0/3556747063 <== mon.2 v2:172.21.15.18:3300/0 2 ==== config(24 keys) ==== 1039+0+0 (secure 0 0 0) 0x7feb78005020 con 0x7feb80109e10 2024-09-21T06:27:53.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.492+0000 7feb860de640 1 -- 172.21.15.7:0/3556747063 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb801a0540 con 0x7feb80109e10 2024-09-21T06:27:53.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.492+0000 7feb7cff9640 1 -- 172.21.15.7:0/3556747063 <== mon.2 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb78010690 con 0x7feb80109e10 2024-09-21T06:27:53.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.492+0000 7feb860de640 1 -- 172.21.15.7:0/3556747063 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb800755f0 con 0x7feb80109e10 2024-09-21T06:27:53.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.493+0000 7feb7cff9640 1 -- 172.21.15.7:0/3556747063 <== mon.2 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 18) ==== 51914+0+0 (secure 0 0 0) 0x7feb78010830 con 0x7feb80109e10 2024-09-21T06:27:53.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.493+0000 7feb860de640 1 -- 172.21.15.7:0/3556747063 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb80104e00 con 0x7feb80109e10 2024-09-21T06:27:53.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.493+0000 7feb7cff9640 1 --2- 172.21.15.7:0/3556747063 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7feb6803fb70 0x7feb68042080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:53.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.493+0000 7feb7cff9640 1 -- 172.21.15.7:0/3556747063 <== mon.2 v2:172.21.15.18:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7feb78054c50 con 0x7feb80109e10 2024-09-21T06:27:53.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.493+0000 7feb7f7fe640 1 --2- 172.21.15.7:0/3556747063 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7feb6803fb70 0x7feb68042080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:53.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.494+0000 7feb7f7fe640 1 --2- 172.21.15.7:0/3556747063 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7feb6803fb70 0x7feb68042080 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7feb700303f0 tx=0x7feb70000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:53.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.499+0000 7feb7cff9640 1 -- 172.21.15.7:0/3556747063 <== mon.2 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7feb78016370 con 0x7feb80109e10 2024-09-21T06:27:53.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.415+0000 7ff22dd52640 1 -- 172.21.15.7:0/2750358136 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff228104a30 msgr2=0x7ff228104e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:53.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.415+0000 7ff22dd52640 1 --2- 172.21.15.7:0/2750358136 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff228104a30 0x7ff228104e40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff218009900 tx=0x7ff21802a410 comp rx=0 tx=0).stop 2024-09-21T06:27:53.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.415+0000 7ff22dd52640 1 -- 172.21.15.7:0/2750358136 shutdown_connections 2024-09-21T06:27:53.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.415+0000 7ff22dd52640 1 --2- 172.21.15.7:0/2750358136 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff22810de60 0x7ff228110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:53.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.415+0000 7ff22dd52640 1 --2- 172.21.15.7:0/2750358136 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff228105380 0x7ff22810d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:53.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.415+0000 7ff22dd52640 1 --2- 172.21.15.7:0/2750358136 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff228104a30 0x7ff228104e40 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:53.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.415+0000 7ff22dd52640 1 -- 172.21.15.7:0/2750358136 >> 172.21.15.7:0/2750358136 conn(0x7ff2280797b0 msgr2=0x7ff228079bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:53.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.415+0000 7ff22dd52640 1 -- 172.21.15.7:0/2750358136 shutdown_connections 2024-09-21T06:27:53.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.415+0000 7ff22dd52640 1 -- 172.21.15.7:0/2750358136 wait complete. 2024-09-21T06:27:53.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.416+0000 7ff22dd52640 1 Processor -- start 2024-09-21T06:27:53.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.416+0000 7ff22dd52640 1 -- start start 2024-09-21T06:27:53.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.416+0000 7ff22dd52640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff228104a30 0x7ff228102770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:53.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.416+0000 7ff22dd52640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff228105380 0x7ff228102cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:53.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.416+0000 7ff22dd52640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff22810de60 0x7ff2281031f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:53.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.416+0000 7ff22dd52640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff228113860 con 0x7ff22810de60 2024-09-21T06:27:53.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.416+0000 7ff22dd52640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff2281136e0 con 0x7ff228105380 2024-09-21T06:27:53.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.416+0000 7ff22dd52640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff2281139e0 con 0x7ff228104a30 2024-09-21T06:27:53.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.417+0000 7ff227fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff22810de60 0x7ff2281031f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:53.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.417+0000 7ff227fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff22810de60 0x7ff2281031f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51640/0 (socket says 172.21.15.7:51640) 2024-09-21T06:27:53.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.417+0000 7ff2277fe640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff228104a30 0x7ff228102770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:53.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.417+0000 7ff227fff640 1 -- 172.21.15.7:0/2512408096 learned_addr learned my addr 172.21.15.7:0/2512408096 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:27:53.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.417+0000 7ff226ffd640 1 --2- 172.21.15.7:0/2512408096 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff228105380 0x7ff228102cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:53.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.417+0000 7ff227fff640 1 -- 172.21.15.7:0/2512408096 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff228104a30 msgr2=0x7ff228102770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:53.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.417+0000 7ff227fff640 1 --2- 172.21.15.7:0/2512408096 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff228104a30 0x7ff228102770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:53.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.417+0000 7ff227fff640 1 -- 172.21.15.7:0/2512408096 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff228105380 msgr2=0x7ff228102cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:53.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.417+0000 7ff227fff640 1 --2- 172.21.15.7:0/2512408096 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff228105380 0x7ff228102cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:53.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.417+0000 7ff227fff640 1 -- 172.21.15.7:0/2512408096 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2281a8590 con 0x7ff22810de60 2024-09-21T06:27:53.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.417+0000 7ff226ffd640 1 --2- 172.21.15.7:0/2512408096 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff228105380 0x7ff228102cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:27:53.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.417+0000 7ff227fff640 1 --2- 172.21.15.7:0/2512408096 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff22810de60 0x7ff2281031f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff22000eb10 tx=0x7ff22000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:53.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.417+0000 7ff224ff9640 1 -- 172.21.15.7:0/2512408096 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff220004b20 con 0x7ff22810de60 2024-09-21T06:27:53.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.417+0000 7ff22dd52640 1 -- 172.21.15.7:0/2512408096 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2281a8880 con 0x7ff22810de60 2024-09-21T06:27:53.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.417+0000 7ff224ff9640 1 -- 172.21.15.7:0/2512408096 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(24 keys) ==== 1039+0+0 (secure 0 0 0) 0x7ff220004cc0 con 0x7ff22810de60 2024-09-21T06:27:53.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.417+0000 7ff224ff9640 1 -- 172.21.15.7:0/2512408096 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff220010690 con 0x7ff22810de60 2024-09-21T06:27:53.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.418+0000 7ff22dd52640 1 -- 172.21.15.7:0/2512408096 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2281a8dc0 con 0x7ff22810de60 2024-09-21T06:27:53.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.419+0000 7ff224ff9640 1 -- 172.21.15.7:0/2512408096 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 18) ==== 51914+0+0 (secure 0 0 0) 0x7ff220010830 con 0x7ff22810de60 2024-09-21T06:27:53.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.419+0000 7ff22dd52640 1 -- 172.21.15.7:0/2512408096 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff228104e40 con 0x7ff22810de60 2024-09-21T06:27:53.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.419+0000 7ff224ff9640 1 --2- 172.21.15.7:0/2512408096 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7ff21003fb70 0x7ff210042080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:53.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.419+0000 7ff224ff9640 1 -- 172.21.15.7:0/2512408096 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7ff220054b10 con 0x7ff22810de60 2024-09-21T06:27:53.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.419+0000 7ff2277fe640 1 --2- 172.21.15.7:0/2512408096 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7ff21003fb70 0x7ff210042080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:53.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.420+0000 7ff2277fe640 1 --2- 172.21.15.7:0/2512408096 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7ff21003fb70 0x7ff210042080 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff218000c00 tx=0x7ff218031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:53.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.424+0000 7ff224ff9640 1 -- 172.21.15.7:0/2512408096 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff2200059f0 con 0x7ff22810de60 2024-09-21T06:27:53.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.623+0000 7ff22dd52640 1 -- 172.21.15.7:0/2512408096 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7ff228108f70 con 0x7ff22810de60 2024-09-21T06:27:53.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.626+0000 7ff224ff9640 1 -- 172.21.15.7:0/2512408096 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v15)=0 v15) ==== 120+0+0 (secure 0 0 0) 0x7ff220016330 con 0x7ff22810de60 2024-09-21T06:27:53.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.628+0000 7ff22dd52640 1 -- 172.21.15.7:0/2512408096 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7ff21003fb70 msgr2=0x7ff210042080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:53.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.628+0000 7ff22dd52640 1 --2- 172.21.15.7:0/2512408096 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7ff21003fb70 0x7ff210042080 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff218000c00 tx=0x7ff218031400 comp rx=0 tx=0).stop 2024-09-21T06:27:53.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.628+0000 7ff22dd52640 1 -- 172.21.15.7:0/2512408096 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff22810de60 msgr2=0x7ff2281031f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:53.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.628+0000 7ff22dd52640 1 --2- 172.21.15.7:0/2512408096 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff22810de60 0x7ff2281031f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff22000eb10 tx=0x7ff22000c2d0 comp rx=0 tx=0).stop 2024-09-21T06:27:53.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.628+0000 7ff22dd52640 1 -- 172.21.15.7:0/2512408096 shutdown_connections 2024-09-21T06:27:53.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.628+0000 7ff22dd52640 1 --2- 172.21.15.7:0/2512408096 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7ff21003fb70 0x7ff210042080 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:53.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.629+0000 7ff22dd52640 1 --2- 172.21.15.7:0/2512408096 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff22810de60 0x7ff2281031f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:53.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.629+0000 7ff22dd52640 1 --2- 172.21.15.7:0/2512408096 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff228105380 0x7ff228102cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:53.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.629+0000 7ff22dd52640 1 --2- 172.21.15.7:0/2512408096 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff228104a30 0x7ff228102770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:53.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.629+0000 7ff22dd52640 1 -- 172.21.15.7:0/2512408096 >> 172.21.15.7:0/2512408096 conn(0x7ff2280797b0 msgr2=0x7ff228100a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:53.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.629+0000 7ff22dd52640 1 -- 172.21.15.7:0/2512408096 shutdown_connections 2024-09-21T06:27:53.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.629+0000 7ff22dd52640 1 -- 172.21.15.7:0/2512408096 wait complete. 2024-09-21T06:27:53.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.704+0000 7feb860de640 1 -- 172.21.15.7:0/3556747063 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7feb8010bb90 con 0x7feb80109e10 2024-09-21T06:27:53.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.708+0000 7feb7cff9640 1 -- 172.21.15.7:0/3556747063 <== mon.2 v2:172.21.15.18:3300/0 7 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7feb78054e50 con 0x7feb80109e10 2024-09-21T06:27:53.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.709+0000 7feb7cff9640 1 -- 172.21.15.7:0/3556747063 <== mon.2 v2:172.21.15.18:3300/0 8 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v16)=0 v16) ==== 123+0+0 (secure 0 0 0) 0x7feb78019d90 con 0x7feb80109e10 2024-09-21T06:27:53.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.712+0000 7feb860de640 1 -- 172.21.15.7:0/3556747063 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7feb6803fb70 msgr2=0x7feb68042080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:53.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.712+0000 7feb860de640 1 --2- 172.21.15.7:0/3556747063 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7feb6803fb70 0x7feb68042080 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7feb700303f0 tx=0x7feb70000bc0 comp rx=0 tx=0).stop 2024-09-21T06:27:53.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.712+0000 7feb860de640 1 -- 172.21.15.7:0/3556747063 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb80109e10 msgr2=0x7feb8019fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:53.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.712+0000 7feb860de640 1 --2- 172.21.15.7:0/3556747063 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb80109e10 0x7feb8019fb20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7feb78009fd0 tx=0x7feb7800ef10 comp rx=0 tx=0).stop 2024-09-21T06:27:53.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.712+0000 7feb860de640 1 -- 172.21.15.7:0/3556747063 shutdown_connections 2024-09-21T06:27:53.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.712+0000 7feb860de640 1 --2- 172.21.15.7:0/3556747063 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7feb6803fb70 0x7feb68042080 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:53.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.712+0000 7feb860de640 1 --2- 172.21.15.7:0/3556747063 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb80109e10 0x7feb8019fb20 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:53.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.712+0000 7feb860de640 1 --2- 172.21.15.7:0/3556747063 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feb801094c0 0x7feb8019a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:53.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.712+0000 7feb860de640 1 --2- 172.21.15.7:0/3556747063 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feb80103b80 0x7feb8019a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:53.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.712+0000 7feb860de640 1 -- 172.21.15.7:0/3556747063 >> 172.21.15.7:0/3556747063 conn(0x7feb800ff610 msgr2=0x7feb80101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:53.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.712+0000 7feb860de640 1 -- 172.21.15.7:0/3556747063 shutdown_connections 2024-09-21T06:27:53.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:53.712+0000 7feb860de640 1 -- 172.21.15.7:0/3556747063 wait complete. 2024-09-21T06:27:54.267 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:53 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:54.267 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:53 smithi007 ceph-mon[30983]: from='client.? ' entity='client.admin' 2024-09-21T06:27:54.268 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:53 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:54.268 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:53 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:54.268 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:53 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:27:54.268 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:53 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:27:54.268 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:53 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:54.268 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:53 smithi007 ceph-mon[30983]: Reconfiguring mgr.x (unknown last config time)... 2024-09-21T06:27:54.268 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:53 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T06:27:54.268 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:53 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T06:27:54.268 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:53 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:27:54.268 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:53 smithi007 ceph-mon[30983]: Reconfiguring daemon mgr.x on smithi007 2024-09-21T06:27:54.268 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:53 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:54.268 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:53 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2512408096' entity='client.admin' 2024-09-21T06:27:54.268 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:53 smithi007 ceph-mon[30983]: from='client.? ' entity='client.admin' 2024-09-21T06:27:54.270 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:53 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:54.270 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:53 smithi018 ceph-mon[34477]: from='client.? ' entity='client.admin' 2024-09-21T06:27:54.270 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:53 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:54.270 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:53 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:54.270 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:53 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:27:54.270 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:53 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:27:54.270 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:53 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:54.271 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:53 smithi018 ceph-mon[34477]: Reconfiguring mgr.x (unknown last config time)... 2024-09-21T06:27:54.271 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:53 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T06:27:54.271 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:53 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T06:27:54.271 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:53 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:27:54.271 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:53 smithi018 ceph-mon[34477]: Reconfiguring daemon mgr.x on smithi007 2024-09-21T06:27:54.271 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:53 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:54.271 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:53 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/2512408096' entity='client.admin' 2024-09-21T06:27:54.271 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:53 smithi018 ceph-mon[34477]: from='client.? ' entity='client.admin' 2024-09-21T06:27:54.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:53 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:54.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:53 smithi144 ceph-mon[34653]: from='client.? ' entity='client.admin' 2024-09-21T06:27:54.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:53 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:54.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:53 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:54.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:53 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:27:54.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:53 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:27:54.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:53 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:54.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:53 smithi144 ceph-mon[34653]: Reconfiguring mgr.x (unknown last config time)... 2024-09-21T06:27:54.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:53 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T06:27:54.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:53 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T06:27:54.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:53 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:27:54.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:53 smithi144 ceph-mon[34653]: Reconfiguring daemon mgr.x on smithi007 2024-09-21T06:27:54.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:53 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:27:54.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:53 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/2512408096' entity='client.admin' 2024-09-21T06:27:54.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:53 smithi144 ceph-mon[34653]: from='client.? ' entity='client.admin' 2024-09-21T06:27:55.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:54 smithi007 ceph-mon[30983]: Standby manager daemon z started 2024-09-21T06:27:55.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:54 smithi007 ceph-mon[30983]: from='mgr.? 172.21.15.144:0/73801360' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-21T06:27:55.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:54 smithi007 ceph-mon[30983]: from='mgr.? 172.21.15.144:0/73801360' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T06:27:55.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:54 smithi007 ceph-mon[30983]: from='mgr.? 172.21.15.144:0/73801360' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-21T06:27:55.086 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:54 smithi007 ceph-mon[30983]: from='mgr.? 172.21.15.144:0/73801360' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T06:27:55.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:54 smithi144 ceph-mon[34653]: Standby manager daemon z started 2024-09-21T06:27:55.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:54 smithi144 ceph-mon[34653]: from='mgr.? 172.21.15.144:0/73801360' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-21T06:27:55.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:54 smithi144 ceph-mon[34653]: from='mgr.? 172.21.15.144:0/73801360' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T06:27:55.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:54 smithi144 ceph-mon[34653]: from='mgr.? 172.21.15.144:0/73801360' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-21T06:27:55.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:54 smithi144 ceph-mon[34653]: from='mgr.? 172.21.15.144:0/73801360' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T06:27:55.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:54 smithi018 ceph-mon[34477]: Standby manager daemon z started 2024-09-21T06:27:55.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:54 smithi018 ceph-mon[34477]: from='mgr.? 172.21.15.144:0/73801360' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-21T06:27:55.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:54 smithi018 ceph-mon[34477]: from='mgr.? 172.21.15.144:0/73801360' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T06:27:55.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:54 smithi018 ceph-mon[34477]: from='mgr.? 172.21.15.144:0/73801360' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-21T06:27:55.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:54 smithi018 ceph-mon[34477]: from='mgr.? 172.21.15.144:0/73801360' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T06:27:55.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:55.542+0000 7f22afbc0640 1 -- 172.21.15.7:0/1361123604 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22a8108cf0 msgr2=0x7f22a810f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:55.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:55.542+0000 7f22afbc0640 1 --2- 172.21.15.7:0/1361123604 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22a8108cf0 0x7f22a810f520 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f22a0009ca0 tx=0x7f22a002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:27:55.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:55.542+0000 7f22afbc0640 1 -- 172.21.15.7:0/1361123604 shutdown_connections 2024-09-21T06:27:55.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:55.542+0000 7f22afbc0640 1 --2- 172.21.15.7:0/1361123604 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22a8108cf0 0x7f22a810f520 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:55.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:55.542+0000 7f22afbc0640 1 --2- 172.21.15.7:0/1361123604 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22a81083a0 0x7f22a81087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:55.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:55.542+0000 7f22afbc0640 1 --2- 172.21.15.7:0/1361123604 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f22a8102a60 0x7f22a8102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:55.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:55.542+0000 7f22afbc0640 1 -- 172.21.15.7:0/1361123604 >> 172.21.15.7:0/1361123604 conn(0x7f22a8079730 msgr2=0x7f22a8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:55.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:55.542+0000 7f22afbc0640 1 -- 172.21.15.7:0/1361123604 shutdown_connections 2024-09-21T06:27:55.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:55.542+0000 7f22afbc0640 1 -- 172.21.15.7:0/1361123604 wait complete. 2024-09-21T06:27:55.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:55.543+0000 7f22afbc0640 1 Processor -- start 2024-09-21T06:27:55.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:55.543+0000 7f22afbc0640 1 -- start start 2024-09-21T06:27:55.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:55.543+0000 7f22afbc0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22a8102a60 0x7f22a819b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:55.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:55.543+0000 7f22afbc0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22a81083a0 0x7f22a819b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:55.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:55.543+0000 7f22afbc0640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f22a8108cf0 0x7f22a819bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:55.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:55.543+0000 7f22afbc0640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f22a8112840 con 0x7f22a81083a0 2024-09-21T06:27:55.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:55.543+0000 7f22afbc0640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f22a81126c0 con 0x7f22a8102a60 2024-09-21T06:27:55.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:55.543+0000 7f22afbc0640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f22a81129c0 con 0x7f22a8108cf0 2024-09-21T06:27:55.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:55.543+0000 7f22ad15b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22a81083a0 0x7f22a819b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:55.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:55.543+0000 7f22ad15b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22a81083a0 0x7f22a819b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51670/0 (socket says 172.21.15.7:51670) 2024-09-21T06:27:55.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:55.543+0000 7f22ad95c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22a8102a60 0x7f22a819b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:55.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:55.543+0000 7f22ad15b640 1 -- 172.21.15.7:0/1748165266 learned_addr learned my addr 172.21.15.7:0/1748165266 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:27:55.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:55.543+0000 7f22ae15d640 1 --2- 172.21.15.7:0/1748165266 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f22a8108cf0 0x7f22a819bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:55.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:55.543+0000 7f22ad15b640 1 -- 172.21.15.7:0/1748165266 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f22a8108cf0 msgr2=0x7f22a819bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:55.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:55.543+0000 7f22ad15b640 1 --2- 172.21.15.7:0/1748165266 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f22a8108cf0 0x7f22a819bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:55.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:55.543+0000 7f22ad15b640 1 -- 172.21.15.7:0/1748165266 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22a8102a60 msgr2=0x7f22a819b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:55.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:55.543+0000 7f22ad15b640 1 --2- 172.21.15.7:0/1748165266 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22a8102a60 0x7f22a819b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:55.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:55.543+0000 7f22ad15b640 1 -- 172.21.15.7:0/1748165266 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22a81a64f0 con 0x7f22a81083a0 2024-09-21T06:27:55.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:55.544+0000 7f22ad95c640 1 --2- 172.21.15.7:0/1748165266 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22a8102a60 0x7f22a819b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:27:55.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:55.544+0000 7f22ad15b640 1 --2- 172.21.15.7:0/1748165266 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22a81083a0 0x7f22a819b770 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f229800e9c0 tx=0x7f229800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:55.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:55.544+0000 7f229effd640 1 -- 172.21.15.7:0/1748165266 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f229800cd80 con 0x7f22a81083a0 2024-09-21T06:27:55.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:55.544+0000 7f229effd640 1 -- 172.21.15.7:0/1748165266 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f22980054b0 con 0x7f22a81083a0 2024-09-21T06:27:55.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:55.544+0000 7f22afbc0640 1 -- 172.21.15.7:0/1748165266 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22a81a67e0 con 0x7f22a81083a0 2024-09-21T06:27:55.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:55.544+0000 7f229effd640 1 -- 172.21.15.7:0/1748165266 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2298010430 con 0x7f22a81083a0 2024-09-21T06:27:55.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:55.544+0000 7f22afbc0640 1 -- 172.21.15.7:0/1748165266 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22a81a6d70 con 0x7f22a81083a0 2024-09-21T06:27:55.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:55.545+0000 7f22afbc0640 1 -- 172.21.15.7:0/1748165266 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22a8102e70 con 0x7f22a81083a0 2024-09-21T06:27:55.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:55.546+0000 7f229effd640 1 -- 172.21.15.7:0/1748165266 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 19) ==== 103193+0+0 (secure 0 0 0) 0x7f2298005020 con 0x7f22a81083a0 2024-09-21T06:27:55.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:55.547+0000 7f229effd640 1 --2- 172.21.15.7:0/1748165266 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f229407b020 0x7f229407d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:55.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:55.547+0000 7f22ad95c640 1 --2- 172.21.15.7:0/1748165266 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f229407b020 0x7f229407d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:55.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:55.547+0000 7f229effd640 1 -- 172.21.15.7:0/1748165266 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f229809d2b0 con 0x7f22a81083a0 2024-09-21T06:27:55.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:55.547+0000 7f22ad95c640 1 --2- 172.21.15.7:0/1748165266 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f229407b020 0x7f229407d530 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f22a806b9e0 tx=0x7f22a4005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:55.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:55.552+0000 7f229effd640 1 -- 172.21.15.7:0/1748165266 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2298069cc0 con 0x7f22a81083a0 2024-09-21T06:27:55.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:55.742+0000 7f22afbc0640 1 -- 172.21.15.7:0/1748165266 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=debug_mgr}] v 0) -- 0x7f22a806b290 con 0x7f22a81083a0 2024-09-21T06:27:55.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:55.743+0000 7f229effd640 1 -- 172.21.15.7:0/1748165266 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mgr}]=0 v16)=0 v16) ==== 108+0+0 (secure 0 0 0) 0x7f229806eb70 con 0x7f22a81083a0 2024-09-21T06:27:55.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:55.745+0000 7f22afbc0640 1 -- 172.21.15.7:0/1748165266 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f229407b020 msgr2=0x7f229407d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:55.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:55.745+0000 7f22afbc0640 1 --2- 172.21.15.7:0/1748165266 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f229407b020 0x7f229407d530 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f22a806b9e0 tx=0x7f22a4005f90 comp rx=0 tx=0).stop 2024-09-21T06:27:55.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:55.745+0000 7f22afbc0640 1 -- 172.21.15.7:0/1748165266 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22a81083a0 msgr2=0x7f22a819b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:55.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:55.745+0000 7f22afbc0640 1 --2- 172.21.15.7:0/1748165266 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22a81083a0 0x7f22a819b770 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f229800e9c0 tx=0x7f229800ee80 comp rx=0 tx=0).stop 2024-09-21T06:27:55.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:55.745+0000 7f22afbc0640 1 -- 172.21.15.7:0/1748165266 shutdown_connections 2024-09-21T06:27:55.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:55.746+0000 7f22afbc0640 1 --2- 172.21.15.7:0/1748165266 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f229407b020 0x7f229407d530 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:55.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:55.746+0000 7f22afbc0640 1 --2- 172.21.15.7:0/1748165266 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f22a8108cf0 0x7f22a819bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:55.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:55.746+0000 7f22afbc0640 1 --2- 172.21.15.7:0/1748165266 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f22a81083a0 0x7f22a819b770 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:55.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:55.746+0000 7f22afbc0640 1 --2- 172.21.15.7:0/1748165266 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22a8102a60 0x7f22a819b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:55.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:55.746+0000 7f22afbc0640 1 -- 172.21.15.7:0/1748165266 >> 172.21.15.7:0/1748165266 conn(0x7f22a8079730 msgr2=0x7f22a81044c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:55.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:55.746+0000 7f22afbc0640 1 -- 172.21.15.7:0/1748165266 shutdown_connections 2024-09-21T06:27:55.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:55.746+0000 7f22afbc0640 1 -- 172.21.15.7:0/1748165266 wait complete. 2024-09-21T06:27:56.044 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:55 smithi007 ceph-mon[30983]: mgrmap e19: x(active, since 11s), standbys: z 2024-09-21T06:27:56.044 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:55 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-21T06:27:56.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:55 smithi144 ceph-mon[34653]: mgrmap e19: x(active, since 11s), standbys: z 2024-09-21T06:27:56.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:55 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-21T06:27:56.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:55 smithi018 ceph-mon[34477]: mgrmap e19: x(active, since 11s), standbys: z 2024-09-21T06:27:56.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:55 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-21T06:27:56.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.260+0000 7fe5fd503640 1 -- 172.21.15.7:0/853071012 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5f810de30 msgr2=0x7fe5f8110320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:56.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.260+0000 7fe5fd503640 1 --2- 172.21.15.7:0/853071012 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5f810de30 0x7fe5f8110320 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe5f0009ca0 tx=0x7fe5f002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:27:56.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.260+0000 7fe5fd503640 1 -- 172.21.15.7:0/853071012 shutdown_connections 2024-09-21T06:27:56.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.260+0000 7fe5fd503640 1 --2- 172.21.15.7:0/853071012 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5f810de30 0x7fe5f8110320 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:56.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.261+0000 7fe5fd503640 1 --2- 172.21.15.7:0/853071012 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe5f8105320 0x7fe5f810d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:56.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.261+0000 7fe5fd503640 1 --2- 172.21.15.7:0/853071012 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5f81049d0 0x7fe5f8104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:56.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.261+0000 7fe5fd503640 1 -- 172.21.15.7:0/853071012 >> 172.21.15.7:0/853071012 conn(0x7fe5f8079740 msgr2=0x7fe5f8079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:56.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.261+0000 7fe5fd503640 1 -- 172.21.15.7:0/853071012 shutdown_connections 2024-09-21T06:27:56.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.261+0000 7fe5fd503640 1 -- 172.21.15.7:0/853071012 wait complete. 2024-09-21T06:27:56.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.262+0000 7fe5fd503640 1 Processor -- start 2024-09-21T06:27:56.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.262+0000 7fe5fd503640 1 -- start start 2024-09-21T06:27:56.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.262+0000 7fe5fd503640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5f81049d0 0x7fe5f819a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:56.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.262+0000 7fe5fd503640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe5f8105320 0x7fe5f819a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:56.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.262+0000 7fe5fd503640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5f810de30 0x7fe5f819fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:56.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.262+0000 7fe5fd503640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe5f8113970 con 0x7fe5f81049d0 2024-09-21T06:27:56.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.262+0000 7fe5f6ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5f81049d0 0x7fe5f819a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:56.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.262+0000 7fe5fd503640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe5f81137f0 con 0x7fe5f810de30 2024-09-21T06:27:56.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.262+0000 7fe5fd503640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe5f8113af0 con 0x7fe5f8105320 2024-09-21T06:27:56.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.262+0000 7fe5f6ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5f81049d0 0x7fe5f819a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51694/0 (socket says 172.21.15.7:51694) 2024-09-21T06:27:56.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.262+0000 7fe5f6ffd640 1 -- 172.21.15.7:0/642158921 learned_addr learned my addr 172.21.15.7:0/642158921 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:27:56.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.263+0000 7fe5f77fe640 1 --2- 172.21.15.7:0/642158921 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5f810de30 0x7fe5f819fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:56.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.263+0000 7fe5f67fc640 1 --2- 172.21.15.7:0/642158921 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe5f8105320 0x7fe5f819a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:56.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.263+0000 7fe5f6ffd640 1 -- 172.21.15.7:0/642158921 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe5f8105320 msgr2=0x7fe5f819a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:56.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.263+0000 7fe5f6ffd640 1 --2- 172.21.15.7:0/642158921 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe5f8105320 0x7fe5f819a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:56.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.263+0000 7fe5f6ffd640 1 -- 172.21.15.7:0/642158921 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5f810de30 msgr2=0x7fe5f819fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:56.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.263+0000 7fe5f6ffd640 1 --2- 172.21.15.7:0/642158921 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5f810de30 0x7fe5f819fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:56.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.263+0000 7fe5f6ffd640 1 -- 172.21.15.7:0/642158921 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5f81a0310 con 0x7fe5f81049d0 2024-09-21T06:27:56.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.263+0000 7fe5f77fe640 1 --2- 172.21.15.7:0/642158921 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5f810de30 0x7fe5f819fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:27:56.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.263+0000 7fe5f6ffd640 1 --2- 172.21.15.7:0/642158921 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5f81049d0 0x7fe5f819a3a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe5e800e9c0 tx=0x7fe5e800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:56.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.263+0000 7fe5dffff640 1 -- 172.21.15.7:0/642158921 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5e800cde0 con 0x7fe5f81049d0 2024-09-21T06:27:56.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.263+0000 7fe5dffff640 1 -- 172.21.15.7:0/642158921 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fe5e80108c0 con 0x7fe5f81049d0 2024-09-21T06:27:56.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.263+0000 7fe5fd503640 1 -- 172.21.15.7:0/642158921 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5f81a0600 con 0x7fe5f81049d0 2024-09-21T06:27:56.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.263+0000 7fe5dffff640 1 -- 172.21.15.7:0/642158921 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5e8018880 con 0x7fe5f81049d0 2024-09-21T06:27:56.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.264+0000 7fe5fd503640 1 -- 172.21.15.7:0/642158921 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5f81a6d60 con 0x7fe5f81049d0 2024-09-21T06:27:56.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.265+0000 7fe5fd503640 1 -- 172.21.15.7:0/642158921 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5f8104de0 con 0x7fe5f81049d0 2024-09-21T06:27:56.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.266+0000 7fe5dffff640 1 -- 172.21.15.7:0/642158921 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 19) ==== 103193+0+0 (secure 0 0 0) 0x7fe5e801f020 con 0x7fe5f81049d0 2024-09-21T06:27:56.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.266+0000 7fe5dffff640 1 --2- 172.21.15.7:0/642158921 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fe5e007b020 0x7fe5e007d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:56.617 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.267+0000 7fe5dffff640 1 -- 172.21.15.7:0/642158921 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fe5e809d0f0 con 0x7fe5f81049d0 2024-09-21T06:27:56.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.267+0000 7fe5f67fc640 1 --2- 172.21.15.7:0/642158921 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fe5e007b020 0x7fe5e007d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:56.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.267+0000 7fe5f67fc640 1 --2- 172.21.15.7:0/642158921 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fe5e007b020 0x7fe5e007d530 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe5f8102420 tx=0x7fe5ec005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:56.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.271+0000 7fe5dffff640 1 -- 172.21.15.7:0/642158921 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe5e8069a80 con 0x7fe5f81049d0 2024-09-21T06:27:56.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.512+0000 7fe5fd503640 1 -- 172.21.15.7:0/642158921 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7fe5f8108f90 con 0x7fe5f81049d0 2024-09-21T06:27:56.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.517+0000 7fe5dffff640 1 -- 172.21.15.7:0/642158921 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v18)=0 v18) ==== 138+0+0 (secure 0 0 0) 0x7fe5e806e930 con 0x7fe5f81049d0 2024-09-21T06:27:56.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.520+0000 7fe5fd503640 1 -- 172.21.15.7:0/642158921 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fe5e007b020 msgr2=0x7fe5e007d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:56.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.520+0000 7fe5fd503640 1 --2- 172.21.15.7:0/642158921 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fe5e007b020 0x7fe5e007d530 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe5f8102420 tx=0x7fe5ec005f90 comp rx=0 tx=0).stop 2024-09-21T06:27:56.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.520+0000 7fe5fd503640 1 -- 172.21.15.7:0/642158921 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5f81049d0 msgr2=0x7fe5f819a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:56.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.520+0000 7fe5fd503640 1 --2- 172.21.15.7:0/642158921 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5f81049d0 0x7fe5f819a3a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe5e800e9c0 tx=0x7fe5e800ee80 comp rx=0 tx=0).stop 2024-09-21T06:27:56.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.520+0000 7fe5fd503640 1 -- 172.21.15.7:0/642158921 shutdown_connections 2024-09-21T06:27:56.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.520+0000 7fe5fd503640 1 --2- 172.21.15.7:0/642158921 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fe5e007b020 0x7fe5e007d530 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:56.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.520+0000 7fe5fd503640 1 --2- 172.21.15.7:0/642158921 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5f810de30 0x7fe5f819fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:56.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.520+0000 7fe5fd503640 1 --2- 172.21.15.7:0/642158921 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe5f8105320 0x7fe5f819a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:56.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.520+0000 7fe5fd503640 1 --2- 172.21.15.7:0/642158921 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe5f81049d0 0x7fe5f819a3a0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:56.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.520+0000 7fe5fd503640 1 -- 172.21.15.7:0/642158921 >> 172.21.15.7:0/642158921 conn(0x7fe5f8079740 msgr2=0x7fe5f8100840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:56.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.520+0000 7fe5fd503640 1 -- 172.21.15.7:0/642158921 shutdown_connections 2024-09-21T06:27:56.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.520+0000 7fe5fd503640 1 -- 172.21.15.7:0/642158921 wait complete. 2024-09-21T06:27:57.550 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:57 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/1418602668' entity='client.admin' 2024-09-21T06:27:57.550 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:57 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/642158921' entity='client.admin' 2024-09-21T06:27:57.550 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:57 smithi007 ceph-mon[30983]: from='client.? ' entity='client.admin' 2024-09-21T06:27:57.550 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:57 smithi007 ceph-mon[30983]: Standby manager daemon y started 2024-09-21T06:27:57.550 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:57 smithi007 ceph-mon[30983]: from='mgr.? 172.21.15.18:0/2965838655' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-21T06:27:57.550 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:57 smithi007 ceph-mon[30983]: from='mgr.? 172.21.15.18:0/2965838655' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T06:27:57.551 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:57 smithi007 ceph-mon[30983]: from='mgr.? 172.21.15.18:0/2965838655' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-21T06:27:57.551 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:57 smithi007 ceph-mon[30983]: from='mgr.? 172.21.15.18:0/2965838655' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T06:27:57.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:57 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/1418602668' entity='client.admin' 2024-09-21T06:27:57.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:57 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/642158921' entity='client.admin' 2024-09-21T06:27:57.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:57 smithi018 ceph-mon[34477]: from='client.? ' entity='client.admin' 2024-09-21T06:27:57.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:57 smithi018 ceph-mon[34477]: Standby manager daemon y started 2024-09-21T06:27:57.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:57 smithi018 ceph-mon[34477]: from='mgr.? 172.21.15.18:0/2965838655' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-21T06:27:57.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:57 smithi018 ceph-mon[34477]: from='mgr.? 172.21.15.18:0/2965838655' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T06:27:57.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:57 smithi018 ceph-mon[34477]: from='mgr.? 172.21.15.18:0/2965838655' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-21T06:27:57.620 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:57 smithi018 ceph-mon[34477]: from='mgr.? 172.21.15.18:0/2965838655' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T06:27:57.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:57 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/1418602668' entity='client.admin' 2024-09-21T06:27:57.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:57 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/642158921' entity='client.admin' 2024-09-21T06:27:57.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:57 smithi144 ceph-mon[34653]: from='client.? ' entity='client.admin' 2024-09-21T06:27:57.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:57 smithi144 ceph-mon[34653]: Standby manager daemon y started 2024-09-21T06:27:57.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:57 smithi144 ceph-mon[34653]: from='mgr.? 172.21.15.18:0/2965838655' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-21T06:27:57.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:57 smithi144 ceph-mon[34653]: from='mgr.? 172.21.15.18:0/2965838655' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T06:27:57.786 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:57 smithi144 ceph-mon[34653]: from='mgr.? 172.21.15.18:0/2965838655' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-21T06:27:57.786 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:57 smithi144 ceph-mon[34653]: from='mgr.? 172.21.15.18:0/2965838655' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T06:27:58.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.420+0000 7f0df131c640 1 -- 172.21.15.7:0/2048646420 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0dec108cf0 msgr2=0x7f0dec10f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:58.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.420+0000 7f0df131c640 1 --2- 172.21.15.7:0/2048646420 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0dec108cf0 0x7f0dec10f520 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0de4009ca0 tx=0x7f0de402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:27:58.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.421+0000 7f0df131c640 1 -- 172.21.15.7:0/2048646420 shutdown_connections 2024-09-21T06:27:58.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.421+0000 7f0df131c640 1 --2- 172.21.15.7:0/2048646420 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0dec108cf0 0x7f0dec10f520 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:58.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.421+0000 7f0df131c640 1 --2- 172.21.15.7:0/2048646420 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0dec1083a0 0x7f0dec1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:58.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.421+0000 7f0df131c640 1 --2- 172.21.15.7:0/2048646420 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0dec102a60 0x7f0dec102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:58.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.421+0000 7f0df131c640 1 -- 172.21.15.7:0/2048646420 >> 172.21.15.7:0/2048646420 conn(0x7f0dec079730 msgr2=0x7f0dec079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:58.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.421+0000 7f0df131c640 1 -- 172.21.15.7:0/2048646420 shutdown_connections 2024-09-21T06:27:58.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.421+0000 7f0df131c640 1 -- 172.21.15.7:0/2048646420 wait complete. 2024-09-21T06:27:58.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.421+0000 7f0df131c640 1 Processor -- start 2024-09-21T06:27:58.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.422+0000 7f0df131c640 1 -- start start 2024-09-21T06:27:58.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.422+0000 7f0df131c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0dec102a60 0x7f0dec19a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:58.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.422+0000 7f0df131c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0dec1083a0 0x7f0dec19a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:58.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.422+0000 7f0df131c640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0dec108cf0 0x7f0dec19fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:58.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.422+0000 7f0df131c640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0dec113950 con 0x7f0dec102a60 2024-09-21T06:27:58.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.422+0000 7f0df131c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0dec1137d0 con 0x7f0dec1083a0 2024-09-21T06:27:58.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.422+0000 7f0df131c640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0dec113ad0 con 0x7f0dec108cf0 2024-09-21T06:27:58.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.422+0000 7f0deaffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0dec102a60 0x7f0dec19a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:58.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.422+0000 7f0deaffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0dec102a60 0x7f0dec19a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51748/0 (socket says 172.21.15.7:51748) 2024-09-21T06:27:58.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.422+0000 7f0deaffd640 1 -- 172.21.15.7:0/4205984399 learned_addr learned my addr 172.21.15.7:0/4205984399 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:27:58.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.422+0000 7f0dea7fc640 1 --2- 172.21.15.7:0/4205984399 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0dec1083a0 0x7f0dec19a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:58.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.422+0000 7f0deb7fe640 1 --2- 172.21.15.7:0/4205984399 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0dec108cf0 0x7f0dec19fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:58.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.423+0000 7f0deaffd640 1 -- 172.21.15.7:0/4205984399 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0dec108cf0 msgr2=0x7f0dec19fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:58.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.423+0000 7f0deaffd640 1 --2- 172.21.15.7:0/4205984399 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0dec108cf0 0x7f0dec19fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:58.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.423+0000 7f0deaffd640 1 -- 172.21.15.7:0/4205984399 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0dec1083a0 msgr2=0x7f0dec19a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:58.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.423+0000 7f0deaffd640 1 --2- 172.21.15.7:0/4205984399 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0dec1083a0 0x7f0dec19a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:58.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.423+0000 7f0deaffd640 1 -- 172.21.15.7:0/4205984399 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dec1a0310 con 0x7f0dec102a60 2024-09-21T06:27:58.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.423+0000 7f0deaffd640 1 --2- 172.21.15.7:0/4205984399 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0dec102a60 0x7f0dec19a3a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc00d950 tx=0x7f0ddc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:58.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.423+0000 7f0dd3fff640 1 -- 172.21.15.7:0/4205984399 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ddc017030 con 0x7f0dec102a60 2024-09-21T06:27:58.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.423+0000 7f0dd3fff640 1 -- 172.21.15.7:0/4205984399 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f0ddc004020 con 0x7f0dec102a60 2024-09-21T06:27:58.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.423+0000 7f0dd3fff640 1 -- 172.21.15.7:0/4205984399 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ddc0055e0 con 0x7f0dec102a60 2024-09-21T06:27:58.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.423+0000 7f0df131c640 1 -- 172.21.15.7:0/4205984399 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0dec1a0600 con 0x7f0dec102a60 2024-09-21T06:27:58.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.423+0000 7f0df131c640 1 -- 172.21.15.7:0/4205984399 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0dec1a6d60 con 0x7f0dec102a60 2024-09-21T06:27:58.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.424+0000 7f0df131c640 1 -- 172.21.15.7:0/4205984399 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0dec102e70 con 0x7f0dec102a60 2024-09-21T06:27:58.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.426+0000 7f0dd3fff640 1 -- 172.21.15.7:0/4205984399 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 154472+0+0 (secure 0 0 0) 0x7f0ddc009a30 con 0x7f0dec102a60 2024-09-21T06:27:58.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.427+0000 7f0dd3fff640 1 --2- 172.21.15.7:0/4205984399 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f0dd40b6550 0x7f0dd40b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:58.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.427+0000 7f0dea7fc640 1 --2- 172.21.15.7:0/4205984399 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f0dd40b6550 0x7f0dd40b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:58.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.427+0000 7f0dd3fff640 1 -- 172.21.15.7:0/4205984399 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f0ddc0e5680 con 0x7f0dec102a60 2024-09-21T06:27:58.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.427+0000 7f0dea7fc640 1 --2- 172.21.15.7:0/4205984399 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f0dd40b6550 0x7f0dd40b8a60 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0dec105ef0 tx=0x7f0de000b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:58.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.430+0000 7f0dd3fff640 1 -- 172.21.15.7:0/4205984399 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0ddc0adb90 con 0x7f0dec102a60 2024-09-21T06:27:58.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.621+0000 7f0df131c640 1 -- 172.21.15.7:0/4205984399 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=debug_cephsqlite}] v 0) -- 0x7f0dec19b4d0 con 0x7f0dec102a60 2024-09-21T06:27:58.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.630+0000 7f0dd3fff640 1 -- 172.21.15.7:0/4205984399 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_cephsqlite}]=0 v21)=0 v21) ==== 115+0+0 (secure 0 0 0) 0x7f0ddc0b1f70 con 0x7f0dec102a60 2024-09-21T06:27:58.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.632+0000 7f0df131c640 1 -- 172.21.15.7:0/4205984399 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f0dd40b6550 msgr2=0x7f0dd40b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:58.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.632+0000 7f0df131c640 1 --2- 172.21.15.7:0/4205984399 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f0dd40b6550 0x7f0dd40b8a60 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0dec105ef0 tx=0x7f0de000b410 comp rx=0 tx=0).stop 2024-09-21T06:27:58.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.632+0000 7f0df131c640 1 -- 172.21.15.7:0/4205984399 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0dec102a60 msgr2=0x7f0dec19a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:58.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.632+0000 7f0df131c640 1 --2- 172.21.15.7:0/4205984399 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0dec102a60 0x7f0dec19a3a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc00d950 tx=0x7f0ddc00de10 comp rx=0 tx=0).stop 2024-09-21T06:27:58.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.633+0000 7f0df131c640 1 -- 172.21.15.7:0/4205984399 shutdown_connections 2024-09-21T06:27:58.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.633+0000 7f0df131c640 1 --2- 172.21.15.7:0/4205984399 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f0dd40b6550 0x7f0dd40b8a60 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:58.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.633+0000 7f0df131c640 1 --2- 172.21.15.7:0/4205984399 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0dec108cf0 0x7f0dec19fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:58.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.633+0000 7f0df131c640 1 --2- 172.21.15.7:0/4205984399 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0dec1083a0 0x7f0dec19a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:58.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.633+0000 7f0df131c640 1 --2- 172.21.15.7:0/4205984399 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0dec102a60 0x7f0dec19a3a0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:58.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.633+0000 7f0df131c640 1 -- 172.21.15.7:0/4205984399 >> 172.21.15.7:0/4205984399 conn(0x7f0dec079730 msgr2=0x7f0dec104460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:58.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.633+0000 7f0df131c640 1 -- 172.21.15.7:0/4205984399 shutdown_connections 2024-09-21T06:27:58.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.633+0000 7f0df131c640 1 -- 172.21.15.7:0/4205984399 wait complete. 2024-09-21T06:27:58.714 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:58 smithi007 ceph-mon[30983]: mgrmap e20: x(active, since 14s), standbys: z, y 2024-09-21T06:27:58.714 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:58 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T06:27:58.714 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:58 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/950318636' entity='client.admin' 2024-09-21T06:27:58.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:58 smithi018 ceph-mon[34477]: mgrmap e20: x(active, since 14s), standbys: z, y 2024-09-21T06:27:58.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:58 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T06:27:58.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:58 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/950318636' entity='client.admin' 2024-09-21T06:27:58.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.615+0000 7ff5909d8640 1 -- 172.21.15.7:0/198093023 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff58c1049b0 msgr2=0x7ff58c104dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:58.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.615+0000 7ff5909d8640 1 --2- 172.21.15.7:0/198093023 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff58c1049b0 0x7ff58c104dc0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff57c009900 tx=0x7ff57c02a410 comp rx=0 tx=0).stop 2024-09-21T06:27:58.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.615+0000 7ff5909d8640 1 -- 172.21.15.7:0/198093023 shutdown_connections 2024-09-21T06:27:58.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.615+0000 7ff5909d8640 1 --2- 172.21.15.7:0/198093023 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff58c10de10 0x7ff58c110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:58.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.615+0000 7ff5909d8640 1 --2- 172.21.15.7:0/198093023 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff58c105300 0x7ff58c10d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:58.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.615+0000 7ff5909d8640 1 --2- 172.21.15.7:0/198093023 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff58c1049b0 0x7ff58c104dc0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:58.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.615+0000 7ff5909d8640 1 -- 172.21.15.7:0/198093023 >> 172.21.15.7:0/198093023 conn(0x7ff58c079730 msgr2=0x7ff58c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:58.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.615+0000 7ff5909d8640 1 -- 172.21.15.7:0/198093023 shutdown_connections 2024-09-21T06:27:58.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.615+0000 7ff5909d8640 1 -- 172.21.15.7:0/198093023 wait complete. 2024-09-21T06:27:58.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.616+0000 7ff5909d8640 1 Processor -- start 2024-09-21T06:27:58.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.616+0000 7ff5909d8640 1 -- start start 2024-09-21T06:27:58.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.616+0000 7ff5909d8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff58c1049b0 0x7ff58c19a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:58.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.616+0000 7ff5909d8640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff58c105300 0x7ff58c19aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:58.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.616+0000 7ff5909d8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff58c10de10 0x7ff58c19fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:58.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.616+0000 7ff5909d8640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff58c1139a0 con 0x7ff58c10de10 2024-09-21T06:27:58.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.616+0000 7ff5909d8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff58c113820 con 0x7ff58c1049b0 2024-09-21T06:27:58.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.616+0000 7ff5909d8640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff58c113b20 con 0x7ff58c105300 2024-09-21T06:27:58.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.616+0000 7ff58ad9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff58c10de10 0x7ff58c19fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:58.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.617+0000 7ff58ad9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff58c10de10 0x7ff58c19fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51766/0 (socket says 172.21.15.7:51766) 2024-09-21T06:27:58.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.617+0000 7ff58ad9d640 1 -- 172.21.15.7:0/1959471257 learned_addr learned my addr 172.21.15.7:0/1959471257 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:27:58.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.617+0000 7ff583fff640 1 --2- 172.21.15.7:0/1959471257 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff58c105300 0x7ff58c19aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:58.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.617+0000 7ff58a59c640 1 --2- 172.21.15.7:0/1959471257 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff58c1049b0 0x7ff58c19a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:58.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.617+0000 7ff58ad9d640 1 -- 172.21.15.7:0/1959471257 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff58c105300 msgr2=0x7ff58c19aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:58.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.617+0000 7ff58ad9d640 1 --2- 172.21.15.7:0/1959471257 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff58c105300 0x7ff58c19aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:58.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.617+0000 7ff58ad9d640 1 -- 172.21.15.7:0/1959471257 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff58c1049b0 msgr2=0x7ff58c19a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:58.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.617+0000 7ff58ad9d640 1 --2- 172.21.15.7:0/1959471257 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff58c1049b0 0x7ff58c19a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:58.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.617+0000 7ff58ad9d640 1 -- 172.21.15.7:0/1959471257 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff58c1a03e0 con 0x7ff58c10de10 2024-09-21T06:27:58.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.617+0000 7ff58ad9d640 1 --2- 172.21.15.7:0/1959471257 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff58c10de10 0x7ff58c19fcb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff58400eb10 tx=0x7ff58400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:58.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.617+0000 7ff5837fe640 1 -- 172.21.15.7:0/1959471257 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff584004b20 con 0x7ff58c10de10 2024-09-21T06:27:58.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.617+0000 7ff5837fe640 1 -- 172.21.15.7:0/1959471257 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7ff584004cc0 con 0x7ff58c10de10 2024-09-21T06:27:58.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.617+0000 7ff5909d8640 1 -- 172.21.15.7:0/1959471257 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff58c1a06d0 con 0x7ff58c10de10 2024-09-21T06:27:58.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.617+0000 7ff5837fe640 1 -- 172.21.15.7:0/1959471257 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff584010690 con 0x7ff58c10de10 2024-09-21T06:27:58.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.617+0000 7ff5909d8640 1 -- 172.21.15.7:0/1959471257 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff58c1a6e30 con 0x7ff58c10de10 2024-09-21T06:27:58.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.619+0000 7ff5909d8640 1 -- 172.21.15.7:0/1959471257 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff58c104dc0 con 0x7ff58c10de10 2024-09-21T06:27:58.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.620+0000 7ff5837fe640 1 -- 172.21.15.7:0/1959471257 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 154472+0+0 (secure 0 0 0) 0x7ff584005020 con 0x7ff58c10de10 2024-09-21T06:27:58.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.621+0000 7ff5837fe640 1 --2- 172.21.15.7:0/1959471257 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7ff5780b64d0 0x7ff5780b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:58.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.621+0000 7ff58a59c640 1 --2- 172.21.15.7:0/1959471257 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7ff5780b64d0 0x7ff5780b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:58.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.621+0000 7ff5837fe640 1 -- 172.21.15.7:0/1959471257 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7ff5840e5cb0 con 0x7ff58c10de10 2024-09-21T06:27:58.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.622+0000 7ff58a59c640 1 --2- 172.21.15.7:0/1959471257 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7ff5780b64d0 0x7ff5780b89e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff57c006010 tx=0x7ff57c000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:58.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.626+0000 7ff5837fe640 1 -- 172.21.15.7:0/1959471257 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff5840ae140 con 0x7ff58c10de10 2024-09-21T06:27:58.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.844+0000 7ff5909d8640 1 -- 172.21.15.7:0/1959471257 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/log_level}] v 0) -- 0x7ff58c108980 con 0x7ff58c10de10 2024-09-21T06:27:58.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.848+0000 7ff5837fe640 1 -- 172.21.15.7:0/1959471257 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/log_level}]=0 v22)=0 v22) ==== 129+0+0 (secure 0 0 0) 0x7ff5840b2520 con 0x7ff58c10de10 2024-09-21T06:27:58.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.851+0000 7ff5909d8640 1 -- 172.21.15.7:0/1959471257 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7ff5780b64d0 msgr2=0x7ff5780b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:58.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.851+0000 7ff5909d8640 1 --2- 172.21.15.7:0/1959471257 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7ff5780b64d0 0x7ff5780b89e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff57c006010 tx=0x7ff57c000bc0 comp rx=0 tx=0).stop 2024-09-21T06:27:58.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.851+0000 7ff5909d8640 1 -- 172.21.15.7:0/1959471257 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff58c10de10 msgr2=0x7ff58c19fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:58.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.851+0000 7ff5909d8640 1 --2- 172.21.15.7:0/1959471257 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff58c10de10 0x7ff58c19fcb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff58400eb10 tx=0x7ff58400c2d0 comp rx=0 tx=0).stop 2024-09-21T06:27:58.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.851+0000 7ff5909d8640 1 -- 172.21.15.7:0/1959471257 shutdown_connections 2024-09-21T06:27:58.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.851+0000 7ff5909d8640 1 --2- 172.21.15.7:0/1959471257 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7ff5780b64d0 0x7ff5780b89e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:58.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.851+0000 7ff5909d8640 1 --2- 172.21.15.7:0/1959471257 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff58c10de10 0x7ff58c19fcb0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:58.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.851+0000 7ff5909d8640 1 --2- 172.21.15.7:0/1959471257 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff58c105300 0x7ff58c19aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:58.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.851+0000 7ff5909d8640 1 --2- 172.21.15.7:0/1959471257 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff58c1049b0 0x7ff58c19a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:58.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.851+0000 7ff5909d8640 1 -- 172.21.15.7:0/1959471257 >> 172.21.15.7:0/1959471257 conn(0x7ff58c079730 msgr2=0x7ff58c100880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:58.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.851+0000 7ff5909d8640 1 -- 172.21.15.7:0/1959471257 shutdown_connections 2024-09-21T06:27:58.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.851+0000 7ff5909d8640 1 -- 172.21.15.7:0/1959471257 wait complete. 2024-09-21T06:27:59.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:58 smithi144 ceph-mon[34653]: mgrmap e20: x(active, since 14s), standbys: z, y 2024-09-21T06:27:59.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:58 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T06:27:59.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:58 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/950318636' entity='client.admin' 2024-09-21T06:27:59.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.404+0000 7fa97dd7f640 1 -- 172.21.15.7:0/3250222773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa978103b60 msgr2=0x7fa978103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:59.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.404+0000 7fa97dd7f640 1 --2- 172.21.15.7:0/3250222773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa978103b60 0x7fa978103f70 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa968009900 tx=0x7fa96802a410 comp rx=0 tx=0).stop 2024-09-21T06:27:59.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.404+0000 7fa97dd7f640 1 -- 172.21.15.7:0/3250222773 shutdown_connections 2024-09-21T06:27:59.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.404+0000 7fa97dd7f640 1 --2- 172.21.15.7:0/3250222773 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa978109df0 0x7fa978110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:59.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.404+0000 7fa97dd7f640 1 --2- 172.21.15.7:0/3250222773 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9781094a0 0x7fa9781098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:59.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.404+0000 7fa97dd7f640 1 --2- 172.21.15.7:0/3250222773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa978103b60 0x7fa978103f70 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:59.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.404+0000 7fa97dd7f640 1 -- 172.21.15.7:0/3250222773 >> 172.21.15.7:0/3250222773 conn(0x7fa97807b850 msgr2=0x7fa97807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:59.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.404+0000 7fa97dd7f640 1 -- 172.21.15.7:0/3250222773 shutdown_connections 2024-09-21T06:27:59.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.404+0000 7fa97dd7f640 1 -- 172.21.15.7:0/3250222773 wait complete. 2024-09-21T06:27:59.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.405+0000 7fa97dd7f640 1 Processor -- start 2024-09-21T06:27:59.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.405+0000 7fa97dd7f640 1 -- start start 2024-09-21T06:27:59.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.406+0000 7fa97dd7f640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa978103b60 0x7fa97819a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:59.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.406+0000 7fa97dd7f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9781094a0 0x7fa97819a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:59.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.406+0000 7fa97dd7f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa978109df0 0x7fa97819fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:59.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.406+0000 7fa97dd7f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa978113990 con 0x7fa9781094a0 2024-09-21T06:27:59.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.406+0000 7fa97dd7f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa978113810 con 0x7fa978109df0 2024-09-21T06:27:59.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.406+0000 7fa97dd7f640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa978113b10 con 0x7fa978103b60 2024-09-21T06:27:59.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.406+0000 7fa976ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9781094a0 0x7fa97819a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:59.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.406+0000 7fa976ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9781094a0 0x7fa97819a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51800/0 (socket says 172.21.15.7:51800) 2024-09-21T06:27:59.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.406+0000 7fa976ffd640 1 -- 172.21.15.7:0/2238206502 learned_addr learned my addr 172.21.15.7:0/2238206502 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:27:59.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.406+0000 7fa9777fe640 1 --2- 172.21.15.7:0/2238206502 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa978103b60 0x7fa97819a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:59.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.406+0000 7fa977fff640 1 --2- 172.21.15.7:0/2238206502 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa978109df0 0x7fa97819fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:59.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.406+0000 7fa976ffd640 1 -- 172.21.15.7:0/2238206502 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa978103b60 msgr2=0x7fa97819a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:59.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.406+0000 7fa976ffd640 1 --2- 172.21.15.7:0/2238206502 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa978103b60 0x7fa97819a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:59.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.406+0000 7fa976ffd640 1 -- 172.21.15.7:0/2238206502 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa978109df0 msgr2=0x7fa97819fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:59.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.406+0000 7fa976ffd640 1 --2- 172.21.15.7:0/2238206502 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa978109df0 0x7fa97819fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:59.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.406+0000 7fa976ffd640 1 -- 172.21.15.7:0/2238206502 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9781a0330 con 0x7fa9781094a0 2024-09-21T06:27:59.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.406+0000 7fa977fff640 1 --2- 172.21.15.7:0/2238206502 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa978109df0 0x7fa97819fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:27:59.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.406+0000 7fa976ffd640 1 --2- 172.21.15.7:0/2238206502 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9781094a0 0x7fa97819a960 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa96c00e9f0 tx=0x7fa96c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:59.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.407+0000 7fa974ff9640 1 -- 172.21.15.7:0/2238206502 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa96c00ccc0 con 0x7fa9781094a0 2024-09-21T06:27:59.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.407+0000 7fa974ff9640 1 -- 172.21.15.7:0/2238206502 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fa96c0108c0 con 0x7fa9781094a0 2024-09-21T06:27:59.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.407+0000 7fa974ff9640 1 -- 172.21.15.7:0/2238206502 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa96c018730 con 0x7fa9781094a0 2024-09-21T06:27:59.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.407+0000 7fa97dd7f640 1 -- 172.21.15.7:0/2238206502 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9781a0620 con 0x7fa9781094a0 2024-09-21T06:27:59.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.407+0000 7fa97dd7f640 1 -- 172.21.15.7:0/2238206502 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9781a6d80 con 0x7fa9781094a0 2024-09-21T06:27:59.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.408+0000 7fa97dd7f640 1 -- 172.21.15.7:0/2238206502 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa978103f70 con 0x7fa9781094a0 2024-09-21T06:27:59.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.409+0000 7fa974ff9640 1 -- 172.21.15.7:0/2238206502 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 154472+0+0 (secure 0 0 0) 0x7fa96c010430 con 0x7fa9781094a0 2024-09-21T06:27:59.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.410+0000 7fa974ff9640 1 --2- 172.21.15.7:0/2238206502 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa9600b6550 0x7fa9600b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:59.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.410+0000 7fa9777fe640 1 --2- 172.21.15.7:0/2238206502 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa9600b6550 0x7fa9600b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:59.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.410+0000 7fa974ff9640 1 -- 172.21.15.7:0/2238206502 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fa96c0e5f20 con 0x7fa9781094a0 2024-09-21T06:27:59.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.411+0000 7fa9777fe640 1 --2- 172.21.15.7:0/2238206502 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa9600b6550 0x7fa9600b8a60 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa968009230 tx=0x7fa9680058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:59.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.413+0000 7fa974ff9640 1 -- 172.21.15.7:0/2238206502 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa96c0ae3b0 con 0x7fa9781094a0 2024-09-21T06:27:59.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.605+0000 7fa97dd7f640 1 -- 172.21.15.7:0/2238206502 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7fa97819b4f0 con 0x7fa9781094a0 2024-09-21T06:27:59.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.609+0000 7fa974ff9640 1 -- 172.21.15.7:0/2238206502 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v24)=0 v24) ==== 118+0+0 (secure 0 0 0) 0x7fa97819b4f0 con 0x7fa9781094a0 2024-09-21T06:27:59.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.612+0000 7fa97dd7f640 1 -- 172.21.15.7:0/2238206502 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa9600b6550 msgr2=0x7fa9600b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:59.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.612+0000 7fa97dd7f640 1 --2- 172.21.15.7:0/2238206502 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa9600b6550 0x7fa9600b8a60 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa968009230 tx=0x7fa9680058d0 comp rx=0 tx=0).stop 2024-09-21T06:27:59.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.612+0000 7fa97dd7f640 1 -- 172.21.15.7:0/2238206502 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9781094a0 msgr2=0x7fa97819a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:59.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.612+0000 7fa97dd7f640 1 --2- 172.21.15.7:0/2238206502 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9781094a0 0x7fa97819a960 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa96c00e9f0 tx=0x7fa96c00eeb0 comp rx=0 tx=0).stop 2024-09-21T06:27:59.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.612+0000 7fa97dd7f640 1 -- 172.21.15.7:0/2238206502 shutdown_connections 2024-09-21T06:27:59.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.612+0000 7fa97dd7f640 1 --2- 172.21.15.7:0/2238206502 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa9600b6550 0x7fa9600b8a60 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:59.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.612+0000 7fa97dd7f640 1 --2- 172.21.15.7:0/2238206502 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa978109df0 0x7fa97819fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:59.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.612+0000 7fa97dd7f640 1 --2- 172.21.15.7:0/2238206502 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9781094a0 0x7fa97819a960 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:59.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.612+0000 7fa97dd7f640 1 --2- 172.21.15.7:0/2238206502 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa978103b60 0x7fa97819a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:59.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.612+0000 7fa97dd7f640 1 -- 172.21.15.7:0/2238206502 >> 172.21.15.7:0/2238206502 conn(0x7fa97807b850 msgr2=0x7fa978107690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:59.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.612+0000 7fa97dd7f640 1 -- 172.21.15.7:0/2238206502 shutdown_connections 2024-09-21T06:27:59.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.612+0000 7fa97dd7f640 1 -- 172.21.15.7:0/2238206502 wait complete. 2024-09-21T06:27:59.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.137+0000 7fdc29b77640 1 -- 172.21.15.7:0/3019213409 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc2410de10 msgr2=0x7fdc24110300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:59.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.137+0000 7fdc29b77640 1 --2- 172.21.15.7:0/3019213409 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc2410de10 0x7fdc24110300 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c009ca0 tx=0x7fdc1c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:27:59.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.137+0000 7fdc29b77640 1 -- 172.21.15.7:0/3019213409 shutdown_connections 2024-09-21T06:27:59.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.137+0000 7fdc29b77640 1 --2- 172.21.15.7:0/3019213409 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc2410de10 0x7fdc24110300 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:59.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.137+0000 7fdc29b77640 1 --2- 172.21.15.7:0/3019213409 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc24105300 0x7fdc2410d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:59.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.137+0000 7fdc29b77640 1 --2- 172.21.15.7:0/3019213409 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc241049b0 0x7fdc24104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:59.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.137+0000 7fdc29b77640 1 -- 172.21.15.7:0/3019213409 >> 172.21.15.7:0/3019213409 conn(0x7fdc24079730 msgr2=0x7fdc24079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:59.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.137+0000 7fdc29b77640 1 -- 172.21.15.7:0/3019213409 shutdown_connections 2024-09-21T06:27:59.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.137+0000 7fdc29b77640 1 -- 172.21.15.7:0/3019213409 wait complete. 2024-09-21T06:27:59.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.138+0000 7fdc29b77640 1 Processor -- start 2024-09-21T06:27:59.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.139+0000 7fdc29b77640 1 -- start start 2024-09-21T06:27:59.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.139+0000 7fdc29b77640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc241049b0 0x7fdc2419a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:59.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.139+0000 7fdc29b77640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc24105300 0x7fdc2419a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:59.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.139+0000 7fdc29b77640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc2410de10 0x7fdc2419fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:59.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.139+0000 7fdc29b77640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fdc24113950 con 0x7fdc2410de10 2024-09-21T06:27:59.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.139+0000 7fdc29b77640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fdc241137d0 con 0x7fdc24105300 2024-09-21T06:27:59.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.139+0000 7fdc29b77640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fdc24113ad0 con 0x7fdc241049b0 2024-09-21T06:27:59.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.139+0000 7fdc23fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc2410de10 0x7fdc2419fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:59.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.139+0000 7fdc23fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc2410de10 0x7fdc2419fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51682/0 (socket says 172.21.15.7:51682) 2024-09-21T06:27:59.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.139+0000 7fdc23fff640 1 -- 172.21.15.7:0/1418602668 learned_addr learned my addr 172.21.15.7:0/1418602668 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:27:59.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.139+0000 7fdc22ffd640 1 --2- 172.21.15.7:0/1418602668 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc24105300 0x7fdc2419a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:59.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.139+0000 7fdc237fe640 1 --2- 172.21.15.7:0/1418602668 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc241049b0 0x7fdc2419a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:59.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.139+0000 7fdc23fff640 1 -- 172.21.15.7:0/1418602668 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc241049b0 msgr2=0x7fdc2419a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:59.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.139+0000 7fdc23fff640 1 --2- 172.21.15.7:0/1418602668 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc241049b0 0x7fdc2419a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:59.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.139+0000 7fdc23fff640 1 -- 172.21.15.7:0/1418602668 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc24105300 msgr2=0x7fdc2419a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:59.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.139+0000 7fdc23fff640 1 --2- 172.21.15.7:0/1418602668 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc24105300 0x7fdc2419a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:59.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.139+0000 7fdc23fff640 1 -- 172.21.15.7:0/1418602668 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc241a02f0 con 0x7fdc2410de10 2024-09-21T06:27:59.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.139+0000 7fdc237fe640 1 --2- 172.21.15.7:0/1418602668 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc241049b0 0x7fdc2419a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:27:59.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.139+0000 7fdc22ffd640 1 --2- 172.21.15.7:0/1418602668 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc24105300 0x7fdc2419a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:27:59.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.140+0000 7fdc23fff640 1 --2- 172.21.15.7:0/1418602668 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc2410de10 0x7fdc2419fbc0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c031040 tx=0x7fdc1c032fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:59.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.140+0000 7fdc20ff9640 1 -- 172.21.15.7:0/1418602668 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc1c003bf0 con 0x7fdc2410de10 2024-09-21T06:27:59.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.140+0000 7fdc20ff9640 1 -- 172.21.15.7:0/1418602668 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fdc1c003d90 con 0x7fdc2410de10 2024-09-21T06:27:59.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.140+0000 7fdc20ff9640 1 -- 172.21.15.7:0/1418602668 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc1c030b50 con 0x7fdc2410de10 2024-09-21T06:27:59.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.140+0000 7fdc29b77640 1 -- 172.21.15.7:0/1418602668 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc241a0580 con 0x7fdc2410de10 2024-09-21T06:27:59.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.140+0000 7fdc29b77640 1 -- 172.21.15.7:0/1418602668 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc241a6d40 con 0x7fdc2410de10 2024-09-21T06:27:59.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.141+0000 7fdc29b77640 1 -- 172.21.15.7:0/1418602668 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc2406b560 con 0x7fdc2410de10 2024-09-21T06:27:59.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.142+0000 7fdc20ff9640 1 -- 172.21.15.7:0/1418602668 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 19) ==== 103193+0+0 (secure 0 0 0) 0x7fdc1c030cf0 con 0x7fdc2410de10 2024-09-21T06:27:59.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.142+0000 7fdc20ff9640 1 --2- 172.21.15.7:0/1418602668 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fdc0c07b020 0x7fdc0c07d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:27:59.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.142+0000 7fdc237fe640 1 --2- 172.21.15.7:0/1418602668 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fdc0c07b020 0x7fdc0c07d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:27:59.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.142+0000 7fdc20ff9640 1 -- 172.21.15.7:0/1418602668 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fdc1c0bdfc0 con 0x7fdc2410de10 2024-09-21T06:27:59.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.143+0000 7fdc237fe640 1 --2- 172.21.15.7:0/1418602668 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fdc0c07b020 0x7fdc0c07d530 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fdc2406bc60 tx=0x7fdc14005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:27:59.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.147+0000 7fdc20ff9640 1 -- 172.21.15.7:0/1418602668 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdc1c086680 con 0x7fdc2410de10 2024-09-21T06:27:59.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.343+0000 7fdc29b77640 1 -- 172.21.15.7:0/1418602668 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=debug_client}] v 0) -- 0x7fdc24108f10 con 0x7fdc2410de10 2024-09-21T06:27:59.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.349+0000 7fdc20ff9640 1 -- 172.21.15.7:0/1418602668 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v17)=0 v17) ==== 111+0+0 (secure 0 0 0) 0x7fdc1c08aa60 con 0x7fdc2410de10 2024-09-21T06:27:59.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.351+0000 7fdc29b77640 1 -- 172.21.15.7:0/1418602668 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fdc0c07b020 msgr2=0x7fdc0c07d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:59.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.351+0000 7fdc29b77640 1 --2- 172.21.15.7:0/1418602668 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fdc0c07b020 0x7fdc0c07d530 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fdc2406bc60 tx=0x7fdc14005f90 comp rx=0 tx=0).stop 2024-09-21T06:27:59.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.351+0000 7fdc29b77640 1 -- 172.21.15.7:0/1418602668 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc2410de10 msgr2=0x7fdc2419fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:27:59.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.351+0000 7fdc29b77640 1 --2- 172.21.15.7:0/1418602668 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc2410de10 0x7fdc2419fbc0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c031040 tx=0x7fdc1c032fb0 comp rx=0 tx=0).stop 2024-09-21T06:27:59.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.351+0000 7fdc29b77640 1 -- 172.21.15.7:0/1418602668 shutdown_connections 2024-09-21T06:27:59.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.351+0000 7fdc29b77640 1 --2- 172.21.15.7:0/1418602668 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fdc0c07b020 0x7fdc0c07d530 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:59.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.351+0000 7fdc29b77640 1 --2- 172.21.15.7:0/1418602668 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdc2410de10 0x7fdc2419fbc0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:59.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.351+0000 7fdc29b77640 1 --2- 172.21.15.7:0/1418602668 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc24105300 0x7fdc2419a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:59.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.351+0000 7fdc29b77640 1 --2- 172.21.15.7:0/1418602668 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdc241049b0 0x7fdc2419a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:27:59.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.352+0000 7fdc29b77640 1 -- 172.21.15.7:0/1418602668 >> 172.21.15.7:0/1418602668 conn(0x7fdc24079730 msgr2=0x7fdc24100880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:27:59.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.352+0000 7fdc29b77640 1 -- 172.21.15.7:0/1418602668 shutdown_connections 2024-09-21T06:27:59.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.352+0000 7fdc29b77640 1 -- 172.21.15.7:0/1418602668 wait complete. 2024-09-21T06:27:59.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:59 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/4205984399' entity='client.admin' 2024-09-21T06:27:59.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:59 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/1959471257' entity='client.admin' 2024-09-21T06:27:59.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:59 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/3779541543' entity='client.admin' 2024-09-21T06:27:59.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:27:59 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2238206502' entity='client.admin' 2024-09-21T06:28:00.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:59 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/4205984399' entity='client.admin' 2024-09-21T06:28:00.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:59 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/1959471257' entity='client.admin' 2024-09-21T06:28:00.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:59 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/3779541543' entity='client.admin' 2024-09-21T06:28:00.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:27:59 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/2238206502' entity='client.admin' 2024-09-21T06:28:00.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:57.835+0000 7f5f816b7640 1 -- 172.21.15.7:0/762199982 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f7c1049b0 msgr2=0x7f5f7c104dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:00.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:57.836+0000 7f5f816b7640 1 --2- 172.21.15.7:0/762199982 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f7c1049b0 0x7f5f7c104dc0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c009900 tx=0x7f5f6c02a410 comp rx=0 tx=0).stop 2024-09-21T06:28:00.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:57.836+0000 7f5f816b7640 1 -- 172.21.15.7:0/762199982 shutdown_connections 2024-09-21T06:28:00.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:57.836+0000 7f5f816b7640 1 --2- 172.21.15.7:0/762199982 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f7c10de10 0x7f5f7c110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:00.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:57.836+0000 7f5f816b7640 1 --2- 172.21.15.7:0/762199982 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f7c105300 0x7f5f7c10d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:00.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:57.836+0000 7f5f816b7640 1 --2- 172.21.15.7:0/762199982 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f7c1049b0 0x7f5f7c104dc0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:00.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:57.836+0000 7f5f816b7640 1 -- 172.21.15.7:0/762199982 >> 172.21.15.7:0/762199982 conn(0x7f5f7c079730 msgr2=0x7f5f7c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:00.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:57.836+0000 7f5f816b7640 1 -- 172.21.15.7:0/762199982 shutdown_connections 2024-09-21T06:28:00.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:57.836+0000 7f5f816b7640 1 -- 172.21.15.7:0/762199982 wait complete. 2024-09-21T06:28:00.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:57.837+0000 7f5f816b7640 1 Processor -- start 2024-09-21T06:28:00.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:57.837+0000 7f5f816b7640 1 -- start start 2024-09-21T06:28:00.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:57.837+0000 7f5f816b7640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f7c1049b0 0x7f5f7c19a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:00.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:57.837+0000 7f5f816b7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f7c105300 0x7f5f7c19a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:00.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:57.837+0000 7f5f816b7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f7c10de10 0x7f5f7c19fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:00.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:57.837+0000 7f5f816b7640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5f7c113950 con 0x7f5f7c105300 2024-09-21T06:28:00.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:57.837+0000 7f5f816b7640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5f7c1137d0 con 0x7f5f7c10de10 2024-09-21T06:28:00.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:57.837+0000 7f5f816b7640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5f7c113ad0 con 0x7f5f7c1049b0 2024-09-21T06:28:00.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:57.837+0000 7f5f73fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f7c105300 0x7f5f7c19a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:00.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:57.837+0000 7f5f73fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f7c105300 0x7f5f7c19a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51734/0 (socket says 172.21.15.7:51734) 2024-09-21T06:28:00.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:57.837+0000 7f5f73fff640 1 -- 172.21.15.7:0/950318636 learned_addr learned my addr 172.21.15.7:0/950318636 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:28:00.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:57.837+0000 7f5f7b7fe640 1 --2- 172.21.15.7:0/950318636 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f7c10de10 0x7f5f7c19fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:00.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:57.837+0000 7f5f7affd640 1 --2- 172.21.15.7:0/950318636 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f7c1049b0 0x7f5f7c19a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:00.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:57.837+0000 7f5f73fff640 1 -- 172.21.15.7:0/950318636 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f7c1049b0 msgr2=0x7f5f7c19a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:00.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:57.838+0000 7f5f73fff640 1 --2- 172.21.15.7:0/950318636 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f7c1049b0 0x7f5f7c19a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:00.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:57.838+0000 7f5f73fff640 1 -- 172.21.15.7:0/950318636 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f7c10de10 msgr2=0x7f5f7c19fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:00.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:57.838+0000 7f5f73fff640 1 --2- 172.21.15.7:0/950318636 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f7c10de10 0x7f5f7c19fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:00.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:57.838+0000 7f5f73fff640 1 -- 172.21.15.7:0/950318636 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f7c1a0290 con 0x7f5f7c105300 2024-09-21T06:28:00.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:57.838+0000 7f5f73fff640 1 --2- 172.21.15.7:0/950318636 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f7c105300 0x7f5f7c19a980 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5f6400c8c0 tx=0x7f5f6400cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:00.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:57.838+0000 7f5f78ff9640 1 -- 172.21.15.7:0/950318636 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f64007bb0 con 0x7f5f7c105300 2024-09-21T06:28:00.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:57.838+0000 7f5f78ff9640 1 -- 172.21.15.7:0/950318636 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f5f64007d50 con 0x7f5f7c105300 2024-09-21T06:28:00.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:57.838+0000 7f5f816b7640 1 -- 172.21.15.7:0/950318636 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f7c1a0580 con 0x7f5f7c105300 2024-09-21T06:28:00.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:57.838+0000 7f5f78ff9640 1 -- 172.21.15.7:0/950318636 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f640186c0 con 0x7f5f7c105300 2024-09-21T06:28:00.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:57.838+0000 7f5f816b7640 1 -- 172.21.15.7:0/950318636 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f7c1a6da0 con 0x7f5f7c105300 2024-09-21T06:28:00.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:57.839+0000 7f5f816b7640 1 -- 172.21.15.7:0/950318636 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f7c104dc0 con 0x7f5f7c105300 2024-09-21T06:28:00.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:57.841+0000 7f5f78ff9640 1 -- 172.21.15.7:0/950318636 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 154472+0+0 (secure 0 0 0) 0x7f5f6400fa00 con 0x7f5f7c105300 2024-09-21T06:28:00.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:57.841+0000 7f5f78ff9640 1 --2- 172.21.15.7:0/950318636 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f5f680b6580 0x7f5f680b8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:00.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:57.842+0000 7f5f7affd640 1 --2- 172.21.15.7:0/950318636 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f5f680b6580 0x7f5f680b8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:00.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:57.842+0000 7f5f78ff9640 1 -- 172.21.15.7:0/950318636 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f5f640e5ab0 con 0x7f5f7c105300 2024-09-21T06:28:00.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:57.842+0000 7f5f7affd640 1 --2- 172.21.15.7:0/950318636 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f5f680b6580 0x7f5f680b8a90 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c000c00 tx=0x7f5f6c009680 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:00.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:57.844+0000 7f5f78ff9640 1 -- 172.21.15.7:0/950318636 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5f64014030 con 0x7f5f7c105300 2024-09-21T06:28:00.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.033+0000 7f5f816b7640 1 -- 172.21.15.7:0/950318636 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f5f7c19b510 con 0x7f5f7c105300 2024-09-21T06:28:00.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.037+0000 7f5f78ff9640 1 -- 172.21.15.7:0/950318636 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v20)=0 v20) ==== 106+0+0 (secure 0 0 0) 0x7f5f640ae050 con 0x7f5f7c105300 2024-09-21T06:28:00.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.040+0000 7f5f816b7640 1 -- 172.21.15.7:0/950318636 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f5f680b6580 msgr2=0x7f5f680b8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:00.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.040+0000 7f5f816b7640 1 --2- 172.21.15.7:0/950318636 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f5f680b6580 0x7f5f680b8a90 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c000c00 tx=0x7f5f6c009680 comp rx=0 tx=0).stop 2024-09-21T06:28:00.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.040+0000 7f5f816b7640 1 -- 172.21.15.7:0/950318636 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f7c105300 msgr2=0x7f5f7c19a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:00.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.040+0000 7f5f816b7640 1 --2- 172.21.15.7:0/950318636 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f7c105300 0x7f5f7c19a980 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5f6400c8c0 tx=0x7f5f6400cd80 comp rx=0 tx=0).stop 2024-09-21T06:28:00.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.040+0000 7f5f816b7640 1 -- 172.21.15.7:0/950318636 shutdown_connections 2024-09-21T06:28:00.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.040+0000 7f5f816b7640 1 --2- 172.21.15.7:0/950318636 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f5f680b6580 0x7f5f680b8a90 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:00.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.040+0000 7f5f816b7640 1 --2- 172.21.15.7:0/950318636 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f7c10de10 0x7f5f7c19fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:00.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.040+0000 7f5f816b7640 1 --2- 172.21.15.7:0/950318636 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5f7c105300 0x7f5f7c19a980 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:00.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.040+0000 7f5f816b7640 1 --2- 172.21.15.7:0/950318636 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5f7c1049b0 0x7f5f7c19a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:00.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.040+0000 7f5f816b7640 1 -- 172.21.15.7:0/950318636 >> 172.21.15.7:0/950318636 conn(0x7f5f7c079730 msgr2=0x7f5f7c100840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:00.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.040+0000 7f5f816b7640 1 -- 172.21.15.7:0/950318636 shutdown_connections 2024-09-21T06:28:00.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.040+0000 7f5f816b7640 1 -- 172.21.15.7:0/950318636 wait complete. 2024-09-21T06:28:00.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:59 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/4205984399' entity='client.admin' 2024-09-21T06:28:00.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:59 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/1959471257' entity='client.admin' 2024-09-21T06:28:00.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:59 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/3779541543' entity='client.admin' 2024-09-21T06:28:00.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:27:59 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/2238206502' entity='client.admin' 2024-09-21T06:28:00.455 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:28:01.017 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:28:01.017 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:28:01.056 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '347cb918-77e2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi007') 2024-09-21T06:28:01.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.675+0000 7f70673d5640 1 -- 172.21.15.7:0/3572267514 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f70601048b0 msgr2=0x7f7060104cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:01.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.675+0000 7f70673d5640 1 --2- 172.21.15.7:0/3572267514 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f70601048b0 0x7f7060104cc0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f705c009900 tx=0x7f705c02a410 comp rx=0 tx=0).stop 2024-09-21T06:28:01.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.675+0000 7f70673d5640 1 -- 172.21.15.7:0/3572267514 shutdown_connections 2024-09-21T06:28:01.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.675+0000 7f70673d5640 1 --2- 172.21.15.7:0/3572267514 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f706010de60 0x7f7060110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:01.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.675+0000 7f70673d5640 1 --2- 172.21.15.7:0/3572267514 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70601052e0 0x7f706010d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:01.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.675+0000 7f70673d5640 1 --2- 172.21.15.7:0/3572267514 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f70601048b0 0x7f7060104cc0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:01.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.675+0000 7f70673d5640 1 -- 172.21.15.7:0/3572267514 >> 172.21.15.7:0/3572267514 conn(0x7f7060079730 msgr2=0x7f7060079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:01.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.675+0000 7f70673d5640 1 -- 172.21.15.7:0/3572267514 shutdown_connections 2024-09-21T06:28:01.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.675+0000 7f70673d5640 1 -- 172.21.15.7:0/3572267514 wait complete. 2024-09-21T06:28:01.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.675+0000 7f70673d5640 1 Processor -- start 2024-09-21T06:28:01.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.676+0000 7f70673d5640 1 -- start start 2024-09-21T06:28:01.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.676+0000 7f70673d5640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70601048b0 0x7f706019a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:01.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.676+0000 7f70673d5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f70601052e0 0x7f706019a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:01.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.676+0000 7f70673d5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f706010de60 0x7f706019fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:01.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.676+0000 7f70673d5640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7060113950 con 0x7f70601052e0 2024-09-21T06:28:01.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.676+0000 7f70673d5640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f70601137d0 con 0x7f706010de60 2024-09-21T06:28:01.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.676+0000 7f70673d5640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7060113ad0 con 0x7f70601048b0 2024-09-21T06:28:01.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.676+0000 7f7064970640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f70601052e0 0x7f706019a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:01.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.676+0000 7f7064970640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f70601052e0 0x7f706019a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51806/0 (socket says 172.21.15.7:51806) 2024-09-21T06:28:01.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.676+0000 7f7064970640 1 -- 172.21.15.7:0/1226560691 learned_addr learned my addr 172.21.15.7:0/1226560691 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:28:01.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.676+0000 7f7065171640 1 --2- 172.21.15.7:0/1226560691 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70601048b0 0x7f706019a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:01.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.676+0000 7f7065972640 1 --2- 172.21.15.7:0/1226560691 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f706010de60 0x7f706019fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:01.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.676+0000 7f7064970640 1 -- 172.21.15.7:0/1226560691 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70601048b0 msgr2=0x7f706019a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:01.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.676+0000 7f7064970640 1 --2- 172.21.15.7:0/1226560691 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70601048b0 0x7f706019a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:01.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.676+0000 7f7064970640 1 -- 172.21.15.7:0/1226560691 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f706010de60 msgr2=0x7f706019fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:01.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.676+0000 7f7064970640 1 --2- 172.21.15.7:0/1226560691 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f706010de60 0x7f706019fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:01.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.676+0000 7f7064970640 1 -- 172.21.15.7:0/1226560691 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70601a0370 con 0x7f70601052e0 2024-09-21T06:28:01.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.676+0000 7f7064970640 1 --2- 172.21.15.7:0/1226560691 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f70601052e0 0x7f706019a9a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f705000e9f0 tx=0x7f705000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:01.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.677+0000 7f70567fc640 1 -- 172.21.15.7:0/1226560691 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f705000ccc0 con 0x7f70601052e0 2024-09-21T06:28:01.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.677+0000 7f70567fc640 1 -- 172.21.15.7:0/1226560691 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f70500054b0 con 0x7f70601052e0 2024-09-21T06:28:01.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.677+0000 7f70673d5640 1 -- 172.21.15.7:0/1226560691 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70601a0660 con 0x7f70601052e0 2024-09-21T06:28:01.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.677+0000 7f70567fc640 1 -- 172.21.15.7:0/1226560691 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7050010430 con 0x7f70601052e0 2024-09-21T06:28:01.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.677+0000 7f70673d5640 1 -- 172.21.15.7:0/1226560691 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70601a6dc0 con 0x7f70601052e0 2024-09-21T06:28:01.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.678+0000 7f70673d5640 1 -- 172.21.15.7:0/1226560691 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f706006c120 con 0x7f70601052e0 2024-09-21T06:28:01.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.680+0000 7f70567fc640 1 -- 172.21.15.7:0/1226560691 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 154472+0+0 (secure 0 0 0) 0x7f70500046c0 con 0x7f70601052e0 2024-09-21T06:28:01.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.680+0000 7f70567fc640 1 --2- 172.21.15.7:0/1226560691 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f704c0b6550 0x7f704c0b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:01.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.680+0000 7f7065171640 1 --2- 172.21.15.7:0/1226560691 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f704c0b6550 0x7f704c0b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:01.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.680+0000 7f70567fc640 1 -- 172.21.15.7:0/1226560691 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f70500e5dd0 con 0x7f70601052e0 2024-09-21T06:28:01.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.681+0000 7f7065171640 1 --2- 172.21.15.7:0/1226560691 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f704c0b6550 0x7f704c0b8a60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f705c000c00 tx=0x7f705c009680 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:01.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.683+0000 7f70567fc640 1 -- 172.21.15.7:0/1226560691 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7050056710 con 0x7f70601052e0 2024-09-21T06:28:01.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.875+0000 7f70673d5640 1 -- 172.21.15.7:0/1226560691 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) -- 0x7f7060104cc0 con 0x7f70601052e0 2024-09-21T06:28:01.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.879+0000 7f70567fc640 1 -- 172.21.15.7:0/1226560691 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v25)=0 v25) ==== 119+0+0 (secure 0 0 0) 0x7f7060104cc0 con 0x7f70601052e0 2024-09-21T06:28:01.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.882+0000 7f70673d5640 1 -- 172.21.15.7:0/1226560691 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f704c0b6550 msgr2=0x7f704c0b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:01.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.882+0000 7f70673d5640 1 --2- 172.21.15.7:0/1226560691 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f704c0b6550 0x7f704c0b8a60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f705c000c00 tx=0x7f705c009680 comp rx=0 tx=0).stop 2024-09-21T06:28:01.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.882+0000 7f70673d5640 1 -- 172.21.15.7:0/1226560691 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f70601052e0 msgr2=0x7f706019a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:01.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.882+0000 7f70673d5640 1 --2- 172.21.15.7:0/1226560691 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f70601052e0 0x7f706019a9a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f705000e9f0 tx=0x7f705000eeb0 comp rx=0 tx=0).stop 2024-09-21T06:28:01.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.882+0000 7f70673d5640 1 -- 172.21.15.7:0/1226560691 shutdown_connections 2024-09-21T06:28:01.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.882+0000 7f70673d5640 1 --2- 172.21.15.7:0/1226560691 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f704c0b6550 0x7f704c0b8a60 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:01.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.882+0000 7f70673d5640 1 --2- 172.21.15.7:0/1226560691 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f706010de60 0x7f706019fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:01.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.882+0000 7f70673d5640 1 --2- 172.21.15.7:0/1226560691 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f70601052e0 0x7f706019a9a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:01.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.882+0000 7f70673d5640 1 --2- 172.21.15.7:0/1226560691 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70601048b0 0x7f706019a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:01.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.882+0000 7f70673d5640 1 -- 172.21.15.7:0/1226560691 >> 172.21.15.7:0/1226560691 conn(0x7f7060079730 msgr2=0x7f70600ff7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:01.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.882+0000 7f70673d5640 1 -- 172.21.15.7:0/1226560691 shutdown_connections 2024-09-21T06:28:01.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:59.882+0000 7f70673d5640 1 -- 172.21.15.7:0/1226560691 wait complete. 2024-09-21T06:28:01.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:00 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/1226560691' entity='client.admin' 2024-09-21T06:28:01.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:00 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/1226560691' entity='client.admin' 2024-09-21T06:28:01.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:00 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/1226560691' entity='client.admin' 2024-09-21T06:28:01.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.733+0000 7fb021fd3640 1 -- 172.21.15.7:0/2485191000 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb01c1049b0 msgr2=0x7fb01c104dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:01.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.733+0000 7fb021fd3640 1 --2- 172.21.15.7:0/2485191000 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb01c1049b0 0x7fb01c104dc0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb004009900 tx=0x7fb00402a410 comp rx=0 tx=0).stop 2024-09-21T06:28:01.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.733+0000 7fb021fd3640 1 -- 172.21.15.7:0/2485191000 shutdown_connections 2024-09-21T06:28:01.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.733+0000 7fb021fd3640 1 --2- 172.21.15.7:0/2485191000 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb01c10de10 0x7fb01c110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:01.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.733+0000 7fb021fd3640 1 --2- 172.21.15.7:0/2485191000 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb01c105300 0x7fb01c10d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:01.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.733+0000 7fb021fd3640 1 --2- 172.21.15.7:0/2485191000 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb01c1049b0 0x7fb01c104dc0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:01.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.733+0000 7fb021fd3640 1 -- 172.21.15.7:0/2485191000 >> 172.21.15.7:0/2485191000 conn(0x7fb01c079730 msgr2=0x7fb01c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:01.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.733+0000 7fb021fd3640 1 -- 172.21.15.7:0/2485191000 shutdown_connections 2024-09-21T06:28:01.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.733+0000 7fb021fd3640 1 -- 172.21.15.7:0/2485191000 wait complete. 2024-09-21T06:28:01.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.734+0000 7fb021fd3640 1 Processor -- start 2024-09-21T06:28:01.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.734+0000 7fb021fd3640 1 -- start start 2024-09-21T06:28:01.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.734+0000 7fb021fd3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb01c1049b0 0x7fb01c19a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:01.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.734+0000 7fb021fd3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb01c105300 0x7fb01c19a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:01.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.734+0000 7fb021fd3640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb01c10de10 0x7fb01c19fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:01.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.734+0000 7fb021fd3640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb01c113950 con 0x7fb01c1049b0 2024-09-21T06:28:01.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.734+0000 7fb021fd3640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb01c1137d0 con 0x7fb01c105300 2024-09-21T06:28:01.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.734+0000 7fb021fd3640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb01c113ad0 con 0x7fb01c10de10 2024-09-21T06:28:01.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.734+0000 7fb01b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb01c1049b0 0x7fb01c19a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:01.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.734+0000 7fb01b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb01c1049b0 0x7fb01c19a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51780/0 (socket says 172.21.15.7:51780) 2024-09-21T06:28:01.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.734+0000 7fb01b7fe640 1 -- 172.21.15.7:0/3779541543 learned_addr learned my addr 172.21.15.7:0/3779541543 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:28:01.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.734+0000 7fb01affd640 1 --2- 172.21.15.7:0/3779541543 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb01c105300 0x7fb01c19a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:01.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.734+0000 7fb01bfff640 1 --2- 172.21.15.7:0/3779541543 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb01c10de10 0x7fb01c19fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:01.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.735+0000 7fb01b7fe640 1 -- 172.21.15.7:0/3779541543 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb01c10de10 msgr2=0x7fb01c19fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:01.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.735+0000 7fb01b7fe640 1 --2- 172.21.15.7:0/3779541543 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb01c10de10 0x7fb01c19fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:01.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.735+0000 7fb01b7fe640 1 -- 172.21.15.7:0/3779541543 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb01c105300 msgr2=0x7fb01c19a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:01.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.735+0000 7fb01b7fe640 1 --2- 172.21.15.7:0/3779541543 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb01c105300 0x7fb01c19a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:01.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.735+0000 7fb01b7fe640 1 -- 172.21.15.7:0/3779541543 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb01c1a0370 con 0x7fb01c1049b0 2024-09-21T06:28:01.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.735+0000 7fb01affd640 1 --2- 172.21.15.7:0/3779541543 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb01c105300 0x7fb01c19a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:28:01.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.735+0000 7fb01bfff640 1 --2- 172.21.15.7:0/3779541543 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb01c10de10 0x7fb01c19fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:28:01.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.735+0000 7fb01b7fe640 1 --2- 172.21.15.7:0/3779541543 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb01c1049b0 0x7fb01c19a400 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb004005940 tx=0x7fb0040042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:01.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.735+0000 7fb018ff9640 1 -- 172.21.15.7:0/3779541543 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb00403f030 con 0x7fb01c1049b0 2024-09-21T06:28:01.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.735+0000 7fb018ff9640 1 -- 172.21.15.7:0/3779541543 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fb004031800 con 0x7fb01c1049b0 2024-09-21T06:28:01.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.735+0000 7fb021fd3640 1 -- 172.21.15.7:0/3779541543 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb01c1a0600 con 0x7fb01c1049b0 2024-09-21T06:28:01.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.735+0000 7fb018ff9640 1 -- 172.21.15.7:0/3779541543 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb004035070 con 0x7fb01c1049b0 2024-09-21T06:28:01.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.735+0000 7fb021fd3640 1 -- 172.21.15.7:0/3779541543 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb01c1a6dc0 con 0x7fb01c1049b0 2024-09-21T06:28:01.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.736+0000 7fb021fd3640 1 -- 172.21.15.7:0/3779541543 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb01c104dc0 con 0x7fb01c1049b0 2024-09-21T06:28:01.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.738+0000 7fb018ff9640 1 -- 172.21.15.7:0/3779541543 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 154472+0+0 (secure 0 0 0) 0x7fb004042030 con 0x7fb01c1049b0 2024-09-21T06:28:01.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.739+0000 7fb018ff9640 1 --2- 172.21.15.7:0/3779541543 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fb0080b64d0 0x7fb0080b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:01.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.739+0000 7fb01affd640 1 --2- 172.21.15.7:0/3779541543 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fb0080b64d0 0x7fb0080b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:01.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.739+0000 7fb018ff9640 1 -- 172.21.15.7:0/3779541543 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fb004105d10 con 0x7fb01c1049b0 2024-09-21T06:28:01.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.739+0000 7fb01affd640 1 --2- 172.21.15.7:0/3779541543 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fb0080b64d0 0x7fb0080b89e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb00c005fd0 tx=0x7fb00c005ea0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:01.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.743+0000 7fb018ff9640 1 -- 172.21.15.7:0/3779541543 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb0040ce1a0 con 0x7fb01c1049b0 2024-09-21T06:28:01.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.941+0000 7fb021fd3640 1 -- 172.21.15.7:0/3779541543 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) -- 0x7fb01c19b530 con 0x7fb01c1049b0 2024-09-21T06:28:01.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.945+0000 7fb018ff9640 1 -- 172.21.15.7:0/3779541543 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v23)=0 v23) ==== 116+0+0 (secure 0 0 0) 0x7fb0040d2580 con 0x7fb01c1049b0 2024-09-21T06:28:01.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.947+0000 7fb021fd3640 1 -- 172.21.15.7:0/3779541543 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fb0080b64d0 msgr2=0x7fb0080b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:01.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.947+0000 7fb021fd3640 1 --2- 172.21.15.7:0/3779541543 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fb0080b64d0 0x7fb0080b89e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb00c005fd0 tx=0x7fb00c005ea0 comp rx=0 tx=0).stop 2024-09-21T06:28:01.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.947+0000 7fb021fd3640 1 -- 172.21.15.7:0/3779541543 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb01c1049b0 msgr2=0x7fb01c19a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:01.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.947+0000 7fb021fd3640 1 --2- 172.21.15.7:0/3779541543 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb01c1049b0 0x7fb01c19a400 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb004005940 tx=0x7fb0040042f0 comp rx=0 tx=0).stop 2024-09-21T06:28:01.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.947+0000 7fb021fd3640 1 -- 172.21.15.7:0/3779541543 shutdown_connections 2024-09-21T06:28:01.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.947+0000 7fb021fd3640 1 --2- 172.21.15.7:0/3779541543 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fb0080b64d0 0x7fb0080b89e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:01.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.947+0000 7fb021fd3640 1 --2- 172.21.15.7:0/3779541543 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb01c10de10 0x7fb01c19fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:01.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.947+0000 7fb021fd3640 1 --2- 172.21.15.7:0/3779541543 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb01c105300 0x7fb01c19a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:01.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.947+0000 7fb021fd3640 1 --2- 172.21.15.7:0/3779541543 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb01c1049b0 0x7fb01c19a400 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:01.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.947+0000 7fb021fd3640 1 -- 172.21.15.7:0/3779541543 >> 172.21.15.7:0/3779541543 conn(0x7fb01c079730 msgr2=0x7fb01c1008c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:01.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.947+0000 7fb021fd3640 1 -- 172.21.15.7:0/3779541543 shutdown_connections 2024-09-21T06:28:01.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:58.947+0000 7fb021fd3640 1 -- 172.21.15.7:0/3779541543 wait complete. 2024-09-21T06:28:01.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:01.923+0000 7f3ae619e640 1 -- 172.21.15.7:0/1655578906 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ae0102d30 msgr2=0x7f3ae010fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:01.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:01.923+0000 7f3ae619e640 1 --2- 172.21.15.7:0/1655578906 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ae0102d30 0x7f3ae010fa50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3ad4009900 tx=0x7f3ad402a480 comp rx=0 tx=0).stop 2024-09-21T06:28:01.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:01.923+0000 7f3ae619e640 1 -- 172.21.15.7:0/1655578906 shutdown_connections 2024-09-21T06:28:01.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:01.923+0000 7f3ae619e640 1 --2- 172.21.15.7:0/1655578906 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ae010ff90 0x7f3ae01123b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:01.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:01.923+0000 7f3ae619e640 1 --2- 172.21.15.7:0/1655578906 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ae0102d30 0x7f3ae010fa50 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:01.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:01.923+0000 7f3ae619e640 1 --2- 172.21.15.7:0/1655578906 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ae01023e0 0x7f3ae01027f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:01.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:01.923+0000 7f3ae619e640 1 -- 172.21.15.7:0/1655578906 >> 172.21.15.7:0/1655578906 conn(0x7f3ae00fe2c0 msgr2=0x7f3ae0100710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:01.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:01.923+0000 7f3ae619e640 1 -- 172.21.15.7:0/1655578906 shutdown_connections 2024-09-21T06:28:01.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:01.923+0000 7f3ae619e640 1 -- 172.21.15.7:0/1655578906 wait complete. 2024-09-21T06:28:01.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:01.924+0000 7f3ae619e640 1 Processor -- start 2024-09-21T06:28:01.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:01.924+0000 7f3ae619e640 1 -- start start 2024-09-21T06:28:01.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:01.924+0000 7f3ae619e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ae01023e0 0x7f3ae019c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:01.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:01.924+0000 7f3ae619e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ae0102d30 0x7f3ae019c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:01.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:01.924+0000 7f3ae619e640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ae010ff90 0x7f3ae01a1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:01.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:01.924+0000 7f3ae619e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3ae0115960 con 0x7f3ae0102d30 2024-09-21T06:28:01.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:01.924+0000 7f3ae619e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3ae01157e0 con 0x7f3ae01023e0 2024-09-21T06:28:01.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:01.924+0000 7f3ae619e640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3ae0115ae0 con 0x7f3ae010ff90 2024-09-21T06:28:01.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:01.925+0000 7f3ae499b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ae0102d30 0x7f3ae019c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:01.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:01.925+0000 7f3ae499b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ae0102d30 0x7f3ae019c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40100/0 (socket says 172.21.15.7:40100) 2024-09-21T06:28:01.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:01.925+0000 7f3ae499b640 1 -- 172.21.15.7:0/3155039346 learned_addr learned my addr 172.21.15.7:0/3155039346 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:28:01.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:01.925+0000 7f3ae519c640 1 --2- 172.21.15.7:0/3155039346 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ae01023e0 0x7f3ae019c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:01.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:01.925+0000 7f3ae599d640 1 --2- 172.21.15.7:0/3155039346 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ae010ff90 0x7f3ae01a1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:01.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:01.925+0000 7f3ae499b640 1 -- 172.21.15.7:0/3155039346 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ae010ff90 msgr2=0x7f3ae01a1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:01.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:01.925+0000 7f3ae499b640 1 --2- 172.21.15.7:0/3155039346 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ae010ff90 0x7f3ae01a1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:01.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:01.925+0000 7f3ae499b640 1 -- 172.21.15.7:0/3155039346 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ae01023e0 msgr2=0x7f3ae019c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:01.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:01.925+0000 7f3ae499b640 1 --2- 172.21.15.7:0/3155039346 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ae01023e0 0x7f3ae019c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:01.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:01.925+0000 7f3ae499b640 1 -- 172.21.15.7:0/3155039346 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ae01a2360 con 0x7f3ae0102d30 2024-09-21T06:28:01.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:01.925+0000 7f3ae599d640 1 --2- 172.21.15.7:0/3155039346 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ae010ff90 0x7f3ae01a1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:28:01.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:01.925+0000 7f3ae519c640 1 --2- 172.21.15.7:0/3155039346 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ae01023e0 0x7f3ae019c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:28:01.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:01.925+0000 7f3ae499b640 1 --2- 172.21.15.7:0/3155039346 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ae0102d30 0x7f3ae019c990 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3ad4006010 tx=0x7f3ad40040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:01.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:01.925+0000 7f3ad27fc640 1 -- 172.21.15.7:0/3155039346 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ad403f030 con 0x7f3ae0102d30 2024-09-21T06:28:01.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:01.925+0000 7f3ae619e640 1 -- 172.21.15.7:0/3155039346 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ae01a25f0 con 0x7f3ae0102d30 2024-09-21T06:28:01.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:01.925+0000 7f3ad27fc640 1 -- 172.21.15.7:0/3155039346 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f3ad4003a80 con 0x7f3ae0102d30 2024-09-21T06:28:01.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:01.925+0000 7f3ad27fc640 1 -- 172.21.15.7:0/3155039346 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ad4035070 con 0x7f3ae0102d30 2024-09-21T06:28:01.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:01.925+0000 7f3ae619e640 1 -- 172.21.15.7:0/3155039346 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ae01a8db0 con 0x7f3ae0102d30 2024-09-21T06:28:01.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:01.927+0000 7f3ae619e640 1 -- 172.21.15.7:0/3155039346 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ae006b560 con 0x7f3ae0102d30 2024-09-21T06:28:01.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:01.928+0000 7f3ad27fc640 1 -- 172.21.15.7:0/3155039346 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 154472+0+0 (secure 0 0 0) 0x7f3ad4042030 con 0x7f3ae0102d30 2024-09-21T06:28:01.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:01.929+0000 7f3ad27fc640 1 --2- 172.21.15.7:0/3155039346 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f3acc0b6550 0x7f3acc0b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:01.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:01.929+0000 7f3ae519c640 1 --2- 172.21.15.7:0/3155039346 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f3acc0b6550 0x7f3acc0b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:01.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:01.929+0000 7f3ad27fc640 1 -- 172.21.15.7:0/3155039346 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f3ad4105ef0 con 0x7f3ae0102d30 2024-09-21T06:28:01.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:01.930+0000 7f3ae519c640 1 --2- 172.21.15.7:0/3155039346 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f3acc0b6550 0x7f3acc0b8a60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3adc009c20 tx=0x7f3adc005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:01.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:01.932+0000 7f3ad27fc640 1 -- 172.21.15.7:0/3155039346 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3ad40ce2e0 con 0x7f3ae0102d30 2024-09-21T06:28:02.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:02.117+0000 7f4c40e15640 1 -- 172.21.15.7:0/3427609657 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c3c109e00 msgr2=0x7f4c3c110630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:02.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:02.117+0000 7f4c40e15640 1 --2- 172.21.15.7:0/3427609657 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c3c109e00 0x7f4c3c110630 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f4c34009ca0 tx=0x7f4c3402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:28:02.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:02.117+0000 7f4c40e15640 1 -- 172.21.15.7:0/3427609657 shutdown_connections 2024-09-21T06:28:02.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:02.117+0000 7f4c40e15640 1 --2- 172.21.15.7:0/3427609657 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c3c109e00 0x7f4c3c110630 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:02.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:02.117+0000 7f4c40e15640 1 --2- 172.21.15.7:0/3427609657 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4c3c1094b0 0x7f4c3c1098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:02.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:02.117+0000 7f4c40e15640 1 --2- 172.21.15.7:0/3427609657 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c3c101f70 0x7f4c3c102380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:02.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:02.117+0000 7f4c40e15640 1 -- 172.21.15.7:0/3427609657 >> 172.21.15.7:0/3427609657 conn(0x7f4c3c077c60 msgr2=0x7f4c3c0780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:02.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:02.117+0000 7f4c40e15640 1 -- 172.21.15.7:0/3427609657 shutdown_connections 2024-09-21T06:28:02.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:02.117+0000 7f4c40e15640 1 -- 172.21.15.7:0/3427609657 wait complete. 2024-09-21T06:28:02.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:02.118+0000 7f4c40e15640 1 Processor -- start 2024-09-21T06:28:02.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:02.118+0000 7f4c40e15640 1 -- start start 2024-09-21T06:28:02.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:02.118+0000 7f4c40e15640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4c3c101f70 0x7f4c3c19a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:02.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:02.119+0000 7f4c40e15640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c3c1094b0 0x7f4c3c19a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:02.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:02.119+0000 7f4c40e15640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c3c109e00 0x7f4c3c19fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:02.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:02.119+0000 7f4c40e15640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4c3c1139a0 con 0x7f4c3c1094b0 2024-09-21T06:28:02.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:02.119+0000 7f4c40e15640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4c3c113820 con 0x7f4c3c101f70 2024-09-21T06:28:02.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:02.119+0000 7f4c40e15640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4c3c113b20 con 0x7f4c3c109e00 2024-09-21T06:28:02.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:02.119+0000 7f4c39d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c3c1094b0 0x7f4c3c19a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:02.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:02.119+0000 7f4c39d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c3c1094b0 0x7f4c3c19a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40118/0 (socket says 172.21.15.7:40118) 2024-09-21T06:28:02.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:02.119+0000 7f4c39d9b640 1 -- 172.21.15.7:0/1508951719 learned_addr learned my addr 172.21.15.7:0/1508951719 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:28:02.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:02.119+0000 7f4c3a59c640 1 --2- 172.21.15.7:0/1508951719 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4c3c101f70 0x7f4c3c19a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:02.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:02.119+0000 7f4c3ad9d640 1 --2- 172.21.15.7:0/1508951719 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c3c109e00 0x7f4c3c19fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:02.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:02.119+0000 7f4c39d9b640 1 -- 172.21.15.7:0/1508951719 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c3c109e00 msgr2=0x7f4c3c19fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:02.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:02.119+0000 7f4c39d9b640 1 --2- 172.21.15.7:0/1508951719 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c3c109e00 0x7f4c3c19fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:02.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:02.119+0000 7f4c39d9b640 1 -- 172.21.15.7:0/1508951719 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4c3c101f70 msgr2=0x7f4c3c19a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:02.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:02.119+0000 7f4c39d9b640 1 --2- 172.21.15.7:0/1508951719 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4c3c101f70 0x7f4c3c19a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:02.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:02.119+0000 7f4c39d9b640 1 -- 172.21.15.7:0/1508951719 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c3c1a0280 con 0x7f4c3c1094b0 2024-09-21T06:28:02.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:02.119+0000 7f4c39d9b640 1 --2- 172.21.15.7:0/1508951719 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c3c1094b0 0x7f4c3c19a8b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4c3000e9f0 tx=0x7f4c3000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:02.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:02.120+0000 7f4c2b7fe640 1 -- 172.21.15.7:0/1508951719 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c3000ccc0 con 0x7f4c3c1094b0 2024-09-21T06:28:02.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:02.120+0000 7f4c2b7fe640 1 -- 172.21.15.7:0/1508951719 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f4c300108c0 con 0x7f4c3c1094b0 2024-09-21T06:28:02.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:02.120+0000 7f4c40e15640 1 -- 172.21.15.7:0/1508951719 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c3c1a0570 con 0x7f4c3c1094b0 2024-09-21T06:28:02.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:02.120+0000 7f4c2b7fe640 1 -- 172.21.15.7:0/1508951719 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c30018730 con 0x7f4c3c1094b0 2024-09-21T06:28:02.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:02.120+0000 7f4c40e15640 1 -- 172.21.15.7:0/1508951719 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c3c1a6cd0 con 0x7f4c3c1094b0 2024-09-21T06:28:02.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:02.121+0000 7f4c40e15640 1 -- 172.21.15.7:0/1508951719 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c3c102380 con 0x7f4c3c1094b0 2024-09-21T06:28:02.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:02.123+0000 7f4c2b7fe640 1 -- 172.21.15.7:0/1508951719 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 154472+0+0 (secure 0 0 0) 0x7f4c30010430 con 0x7f4c3c1094b0 2024-09-21T06:28:02.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:02.124+0000 7f4c2b7fe640 1 --2- 172.21.15.7:0/1508951719 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f4c240b6550 0x7f4c240b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:02.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:02.124+0000 7f4c3a59c640 1 --2- 172.21.15.7:0/1508951719 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f4c240b6550 0x7f4c240b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:02.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:02.124+0000 7f4c2b7fe640 1 -- 172.21.15.7:0/1508951719 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f4c300e5e60 con 0x7f4c3c1094b0 2024-09-21T06:28:02.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:02.124+0000 7f4c3a59c640 1 --2- 172.21.15.7:0/1508951719 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f4c240b6550 0x7f4c240b8a60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c009bd0 tx=0x7f4c2c005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:02.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:02.127+0000 7f4c2b7fe640 1 -- 172.21.15.7:0/1508951719 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4c300b26b0 con 0x7f4c3c1094b0 2024-09-21T06:28:02.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:02.130+0000 7f3ae619e640 1 -- 172.21.15.7:0/3155039346 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7f3ae01027f0 con 0x7f3ae0102d30 2024-09-21T06:28:02.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:02.135+0000 7f3ad27fc640 1 -- 172.21.15.7:0/3155039346 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v26)=0 v26) ==== 121+0+0 (secure 0 0 0) 0x7f3ad40d26c0 con 0x7f3ae0102d30 2024-09-21T06:28:02.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:02.137+0000 7f3ae619e640 1 -- 172.21.15.7:0/3155039346 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f3acc0b6550 msgr2=0x7f3acc0b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:02.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:02.137+0000 7f3ae619e640 1 --2- 172.21.15.7:0/3155039346 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f3acc0b6550 0x7f3acc0b8a60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3adc009c20 tx=0x7f3adc005f90 comp rx=0 tx=0).stop 2024-09-21T06:28:02.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:02.137+0000 7f3ae619e640 1 -- 172.21.15.7:0/3155039346 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ae0102d30 msgr2=0x7f3ae019c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:02.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:02.137+0000 7f3ae619e640 1 --2- 172.21.15.7:0/3155039346 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ae0102d30 0x7f3ae019c990 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3ad4006010 tx=0x7f3ad40040c0 comp rx=0 tx=0).stop 2024-09-21T06:28:02.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:02.137+0000 7f3ae619e640 1 -- 172.21.15.7:0/3155039346 shutdown_connections 2024-09-21T06:28:02.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:02.137+0000 7f3ae619e640 1 --2- 172.21.15.7:0/3155039346 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f3acc0b6550 0x7f3acc0b8a60 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:02.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:02.137+0000 7f3ae619e640 1 --2- 172.21.15.7:0/3155039346 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3ae010ff90 0x7f3ae01a1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:02.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:02.137+0000 7f3ae619e640 1 --2- 172.21.15.7:0/3155039346 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3ae0102d30 0x7f3ae019c990 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:02.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:02.137+0000 7f3ae619e640 1 --2- 172.21.15.7:0/3155039346 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ae01023e0 0x7f3ae019c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:02.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:02.137+0000 7f3ae619e640 1 -- 172.21.15.7:0/3155039346 >> 172.21.15.7:0/3155039346 conn(0x7f3ae00fe2c0 msgr2=0x7f3ae0101100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:02.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:02.137+0000 7f3ae619e640 1 -- 172.21.15.7:0/3155039346 shutdown_connections 2024-09-21T06:28:02.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:02.138+0000 7f3ae619e640 1 -- 172.21.15.7:0/3155039346 wait complete. 2024-09-21T06:28:02.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:02.319+0000 7f4c40e15640 1 -- 172.21.15.7:0/1508951719 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7f4c3c10bc50 con 0x7f4c3c1094b0 2024-09-21T06:28:02.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:02.323+0000 7f4c2b7fe640 1 -- 172.21.15.7:0/1508951719 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v27)=0 v27) ==== 121+0+0 (secure 0 0 0) 0x7f4c300b75f0 con 0x7f4c3c1094b0 2024-09-21T06:28:02.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:02.325+0000 7f4c40e15640 1 -- 172.21.15.7:0/1508951719 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f4c240b6550 msgr2=0x7f4c240b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:02.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:02.325+0000 7f4c40e15640 1 --2- 172.21.15.7:0/1508951719 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f4c240b6550 0x7f4c240b8a60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c009bd0 tx=0x7f4c2c005f90 comp rx=0 tx=0).stop 2024-09-21T06:28:02.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:02.326+0000 7f4c40e15640 1 -- 172.21.15.7:0/1508951719 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c3c1094b0 msgr2=0x7f4c3c19a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:02.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:02.326+0000 7f4c40e15640 1 --2- 172.21.15.7:0/1508951719 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c3c1094b0 0x7f4c3c19a8b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4c3000e9f0 tx=0x7f4c3000eeb0 comp rx=0 tx=0).stop 2024-09-21T06:28:02.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:02.326+0000 7f4c40e15640 1 -- 172.21.15.7:0/1508951719 shutdown_connections 2024-09-21T06:28:02.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:02.326+0000 7f4c40e15640 1 --2- 172.21.15.7:0/1508951719 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f4c240b6550 0x7f4c240b8a60 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:02.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:02.326+0000 7f4c40e15640 1 --2- 172.21.15.7:0/1508951719 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c3c109e00 0x7f4c3c19fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:02.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:02.326+0000 7f4c40e15640 1 --2- 172.21.15.7:0/1508951719 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c3c1094b0 0x7f4c3c19a8b0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:02.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:02.326+0000 7f4c40e15640 1 --2- 172.21.15.7:0/1508951719 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4c3c101f70 0x7f4c3c19a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:02.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:02.326+0000 7f4c40e15640 1 -- 172.21.15.7:0/1508951719 >> 172.21.15.7:0/1508951719 conn(0x7f4c3c077c60 msgr2=0x7f4c3c107500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:02.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:02.326+0000 7f4c40e15640 1 -- 172.21.15.7:0/1508951719 shutdown_connections 2024-09-21T06:28:02.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:02.326+0000 7f4c40e15640 1 -- 172.21.15.7:0/1508951719 wait complete. 2024-09-21T06:28:03.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:03 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/3155039346' entity='client.admin' 2024-09-21T06:28:03.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:03 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/1508951719' entity='client.admin' 2024-09-21T06:28:03.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:03 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/3155039346' entity='client.admin' 2024-09-21T06:28:03.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:03 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/1508951719' entity='client.admin' 2024-09-21T06:28:03.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:03 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/3155039346' entity='client.admin' 2024-09-21T06:28:03.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:03 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/1508951719' entity='client.admin' 2024-09-21T06:28:04.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.386+0000 7f78b4e84640 1 -- 172.21.15.7:0/2807616458 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78b0103b90 msgr2=0x7f78b0103fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:04.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.386+0000 7f78b4e84640 1 --2- 172.21.15.7:0/2807616458 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78b0103b90 0x7f78b0103fa0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f78a0009900 tx=0x7f78a002a410 comp rx=0 tx=0).stop 2024-09-21T06:28:04.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.386+0000 7f78b4e84640 1 -- 172.21.15.7:0/2807616458 shutdown_connections 2024-09-21T06:28:04.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.386+0000 7f78b4e84640 1 --2- 172.21.15.7:0/2807616458 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78b0109e20 0x7f78b0110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:04.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.386+0000 7f78b4e84640 1 --2- 172.21.15.7:0/2807616458 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f78b01094d0 0x7f78b01098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:04.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.386+0000 7f78b4e84640 1 --2- 172.21.15.7:0/2807616458 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78b0103b90 0x7f78b0103fa0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:04.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.386+0000 7f78b4e84640 1 -- 172.21.15.7:0/2807616458 >> 172.21.15.7:0/2807616458 conn(0x7f78b00ff620 msgr2=0x7f78b0101a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:04.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.386+0000 7f78b4e84640 1 -- 172.21.15.7:0/2807616458 shutdown_connections 2024-09-21T06:28:04.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.386+0000 7f78b4e84640 1 -- 172.21.15.7:0/2807616458 wait complete. 2024-09-21T06:28:04.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.387+0000 7f78b4e84640 1 Processor -- start 2024-09-21T06:28:04.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.387+0000 7f78b4e84640 1 -- start start 2024-09-21T06:28:04.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.388+0000 7f78b4e84640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78b0103b90 0x7f78b019a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:04.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.388+0000 7f78b4e84640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78b01094d0 0x7f78b019a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:04.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.388+0000 7f78b4e84640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f78b0109e20 0x7f78b019fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:04.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.388+0000 7f78b4e84640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f78b01139c0 con 0x7f78b01094d0 2024-09-21T06:28:04.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.388+0000 7f78b4e84640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f78b0113840 con 0x7f78b0109e20 2024-09-21T06:28:04.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.388+0000 7f78b4e84640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f78b0113b40 con 0x7f78b0103b90 2024-09-21T06:28:04.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.388+0000 7f78add9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78b01094d0 0x7f78b019a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:04.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.388+0000 7f78add9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78b01094d0 0x7f78b019a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51706/0 (socket says 172.21.15.7:51706) 2024-09-21T06:28:04.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.388+0000 7f78add9b640 1 -- 172.21.15.7:0/670506623 learned_addr learned my addr 172.21.15.7:0/670506623 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:28:04.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.388+0000 7f78ae59c640 1 --2- 172.21.15.7:0/670506623 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78b0103b90 0x7f78b019a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:04.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.388+0000 7f78aed9d640 1 --2- 172.21.15.7:0/670506623 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f78b0109e20 0x7f78b019fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:04.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.388+0000 7f78ae59c640 1 -- 172.21.15.7:0/670506623 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f78b0109e20 msgr2=0x7f78b019fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:04.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.388+0000 7f78ae59c640 1 --2- 172.21.15.7:0/670506623 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f78b0109e20 0x7f78b019fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:04.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.388+0000 7f78ae59c640 1 -- 172.21.15.7:0/670506623 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78b01094d0 msgr2=0x7f78b019a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:04.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.388+0000 7f78ae59c640 1 --2- 172.21.15.7:0/670506623 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78b01094d0 0x7f78b019a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:04.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.388+0000 7f78ae59c640 1 -- 172.21.15.7:0/670506623 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78b01a0340 con 0x7f78b0103b90 2024-09-21T06:28:04.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.388+0000 7f78aed9d640 1 --2- 172.21.15.7:0/670506623 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f78b0109e20 0x7f78b019fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:28:04.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.388+0000 7f78add9b640 1 --2- 172.21.15.7:0/670506623 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78b01094d0 0x7f78b019a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:28:04.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.389+0000 7f78ae59c640 1 --2- 172.21.15.7:0/670506623 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78b0103b90 0x7f78b019a3d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f78a002a930 tx=0x7f78a0032c70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:04.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.389+0000 7f789f7fe640 1 -- 172.21.15.7:0/670506623 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78a003f070 con 0x7f78b0103b90 2024-09-21T06:28:04.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.389+0000 7f789f7fe640 1 -- 172.21.15.7:0/670506623 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f78a0031400 con 0x7f78b0103b90 2024-09-21T06:28:04.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.389+0000 7f789f7fe640 1 -- 172.21.15.7:0/670506623 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78a0035070 con 0x7f78b0103b90 2024-09-21T06:28:04.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.389+0000 7f78b4e84640 1 -- 172.21.15.7:0/670506623 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78b01a05d0 con 0x7f78b0103b90 2024-09-21T06:28:04.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.389+0000 7f78b4e84640 1 -- 172.21.15.7:0/670506623 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78b00755f0 con 0x7f78b0103b90 2024-09-21T06:28:04.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.390+0000 7f78b4e84640 1 -- 172.21.15.7:0/670506623 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78b0104e10 con 0x7f78b0103b90 2024-09-21T06:28:04.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.391+0000 7f789f7fe640 1 -- 172.21.15.7:0/670506623 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 19) ==== 103193+0+0 (secure 0 0 0) 0x7f78a0003a00 con 0x7f78b0103b90 2024-09-21T06:28:04.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.392+0000 7f789f7fe640 1 --2- 172.21.15.7:0/670506623 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f789807b020 0x7f789807d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:04.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.392+0000 7f789f7fe640 1 -- 172.21.15.7:0/670506623 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f78a00bd030 con 0x7f78b0103b90 2024-09-21T06:28:04.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.392+0000 7f78add9b640 1 --2- 172.21.15.7:0/670506623 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f789807b020 0x7f789807d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:04.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.392+0000 7f78add9b640 1 --2- 172.21.15.7:0/670506623 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f789807b020 0x7f789807d530 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f78b01090a0 tx=0x7f78a4014040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:04.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.397+0000 7f789f7fe640 1 -- 172.21.15.7:0/670506623 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f78a00899c0 con 0x7f78b0103b90 2024-09-21T06:28:04.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.600+0000 7f78b4e84640 1 -- 172.21.15.7:0/670506623 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7f78b010bba0 con 0x7f78b0103b90 2024-09-21T06:28:04.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.607+0000 7f789f7fe640 1 -- 172.21.15.7:0/670506623 <== mon.1 v2:172.21.15.144:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v19)=0 v19) ==== 117+0+0 (secure 0 0 0) 0x7f78a008e870 con 0x7f78b0103b90 2024-09-21T06:28:04.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.610+0000 7f78b4e84640 1 -- 172.21.15.7:0/670506623 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f789807b020 msgr2=0x7f789807d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:04.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.610+0000 7f78b4e84640 1 --2- 172.21.15.7:0/670506623 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f789807b020 0x7f789807d530 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f78b01090a0 tx=0x7f78a4014040 comp rx=0 tx=0).stop 2024-09-21T06:28:04.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.610+0000 7f78b4e84640 1 -- 172.21.15.7:0/670506623 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78b0103b90 msgr2=0x7f78b019a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:04.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.610+0000 7f78b4e84640 1 --2- 172.21.15.7:0/670506623 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78b0103b90 0x7f78b019a3d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f78a002a930 tx=0x7f78a0032c70 comp rx=0 tx=0).stop 2024-09-21T06:28:04.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.610+0000 7f78b4e84640 1 -- 172.21.15.7:0/670506623 shutdown_connections 2024-09-21T06:28:04.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.610+0000 7f78b4e84640 1 --2- 172.21.15.7:0/670506623 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f789807b020 0x7f789807d530 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:04.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.610+0000 7f78b4e84640 1 --2- 172.21.15.7:0/670506623 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f78b0109e20 0x7f78b019fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:04.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.610+0000 7f78b4e84640 1 --2- 172.21.15.7:0/670506623 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f78b01094d0 0x7f78b019a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:04.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.610+0000 7f78b4e84640 1 --2- 172.21.15.7:0/670506623 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f78b0103b90 0x7f78b019a3d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:04.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.610+0000 7f78b4e84640 1 -- 172.21.15.7:0/670506623 >> 172.21.15.7:0/670506623 conn(0x7f78b00ff620 msgr2=0x7f78b0101a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:04.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.610+0000 7f78b4e84640 1 -- 172.21.15.7:0/670506623 shutdown_connections 2024-09-21T06:28:04.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:27:56.610+0000 7f78b4e84640 1 -- 172.21.15.7:0/670506623 wait complete. 2024-09-21T06:28:04.589 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:04 smithi007 ceph-mon[30983]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:04.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:04 smithi018 ceph-mon[34477]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:04.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:04 smithi144 ceph-mon[34653]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:04.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:04.879+0000 7f8a7a6ea640 1 -- 172.21.15.7:0/3776328213 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a7410de70 msgr2=0x7f8a74110340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:04.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:04.879+0000 7f8a7a6ea640 1 --2- 172.21.15.7:0/3776328213 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a7410de70 0x7f8a74110340 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c009ca0 tx=0x7f8a6c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:28:04.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:04.879+0000 7f8a7a6ea640 1 -- 172.21.15.7:0/3776328213 shutdown_connections 2024-09-21T06:28:04.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:04.879+0000 7f8a7a6ea640 1 --2- 172.21.15.7:0/3776328213 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a7410de70 0x7f8a74110340 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:04.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:04.879+0000 7f8a7a6ea640 1 --2- 172.21.15.7:0/3776328213 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a741052a0 0x7f8a7410d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:04.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:04.879+0000 7f8a7a6ea640 1 --2- 172.21.15.7:0/3776328213 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8a741048c0 0x7f8a74104cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:04.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:04.879+0000 7f8a7a6ea640 1 -- 172.21.15.7:0/3776328213 >> 172.21.15.7:0/3776328213 conn(0x7f8a74079790 msgr2=0x7f8a74079ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:04.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:04.879+0000 7f8a7a6ea640 1 -- 172.21.15.7:0/3776328213 shutdown_connections 2024-09-21T06:28:04.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:04.879+0000 7f8a7a6ea640 1 -- 172.21.15.7:0/3776328213 wait complete. 2024-09-21T06:28:04.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:04.880+0000 7f8a7a6ea640 1 Processor -- start 2024-09-21T06:28:04.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:04.880+0000 7f8a7a6ea640 1 -- start start 2024-09-21T06:28:04.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:04.880+0000 7f8a7a6ea640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a741048c0 0x7f8a7419c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:04.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:04.880+0000 7f8a7a6ea640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a741052a0 0x7f8a7419cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:04.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:04.880+0000 7f8a7a6ea640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8a7410de70 0x7f8a741a1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:04.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:04.880+0000 7f8a7a6ea640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8a74113990 con 0x7f8a741048c0 2024-09-21T06:28:04.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:04.880+0000 7f8a7a6ea640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8a74113810 con 0x7f8a741052a0 2024-09-21T06:28:04.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:04.880+0000 7f8a7a6ea640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8a74113b10 con 0x7f8a7410de70 2024-09-21T06:28:04.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:04.881+0000 7f8a73fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a741048c0 0x7f8a7419c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:04.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:04.881+0000 7f8a73fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a741048c0 0x7f8a7419c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40142/0 (socket says 172.21.15.7:40142) 2024-09-21T06:28:04.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:04.881+0000 7f8a73fff640 1 -- 172.21.15.7:0/162430891 learned_addr learned my addr 172.21.15.7:0/162430891 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:28:04.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:04.881+0000 7f8a737fe640 1 --2- 172.21.15.7:0/162430891 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a741052a0 0x7f8a7419cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:04.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:04.881+0000 7f8a78c87640 1 --2- 172.21.15.7:0/162430891 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8a7410de70 0x7f8a741a1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:04.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:04.881+0000 7f8a73fff640 1 -- 172.21.15.7:0/162430891 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8a7410de70 msgr2=0x7f8a741a1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:04.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:04.881+0000 7f8a73fff640 1 --2- 172.21.15.7:0/162430891 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8a7410de70 0x7f8a741a1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:04.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:04.881+0000 7f8a73fff640 1 -- 172.21.15.7:0/162430891 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a741052a0 msgr2=0x7f8a7419cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:04.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:04.881+0000 7f8a73fff640 1 --2- 172.21.15.7:0/162430891 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a741052a0 0x7f8a7419cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:04.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:04.881+0000 7f8a73fff640 1 -- 172.21.15.7:0/162430891 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a741a2510 con 0x7f8a741048c0 2024-09-21T06:28:04.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:04.881+0000 7f8a78c87640 1 --2- 172.21.15.7:0/162430891 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8a7410de70 0x7f8a741a1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:28:04.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:04.881+0000 7f8a73fff640 1 --2- 172.21.15.7:0/162430891 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a741048c0 0x7f8a7419c5a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8a6400d770 tx=0x7f8a6400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:04.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:04.881+0000 7f8a717fa640 1 -- 172.21.15.7:0/162430891 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a64017070 con 0x7f8a741048c0 2024-09-21T06:28:04.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:04.881+0000 7f8a717fa640 1 -- 172.21.15.7:0/162430891 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f8a640054b0 con 0x7f8a741048c0 2024-09-21T06:28:04.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:04.881+0000 7f8a7a6ea640 1 -- 172.21.15.7:0/162430891 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a741a2800 con 0x7f8a741048c0 2024-09-21T06:28:04.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:04.881+0000 7f8a717fa640 1 -- 172.21.15.7:0/162430891 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a64004c70 con 0x7f8a741048c0 2024-09-21T06:28:04.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:04.881+0000 7f8a7a6ea640 1 -- 172.21.15.7:0/162430891 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a741a8f60 con 0x7f8a741048c0 2024-09-21T06:28:04.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:04.882+0000 7f8a7a6ea640 1 -- 172.21.15.7:0/162430891 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a74104cd0 con 0x7f8a741048c0 2024-09-21T06:28:04.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:04.884+0000 7f8a717fa640 1 -- 172.21.15.7:0/162430891 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 154472+0+0 (secure 0 0 0) 0x7f8a64004e10 con 0x7f8a741048c0 2024-09-21T06:28:04.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:04.885+0000 7f8a717fa640 1 --2- 172.21.15.7:0/162430891 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f8a5c0b6550 0x7f8a5c0b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:04.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:04.885+0000 7f8a737fe640 1 --2- 172.21.15.7:0/162430891 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f8a5c0b6550 0x7f8a5c0b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:04.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:04.885+0000 7f8a717fa640 1 -- 172.21.15.7:0/162430891 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f8a640e55d0 con 0x7f8a741048c0 2024-09-21T06:28:04.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:04.886+0000 7f8a737fe640 1 --2- 172.21.15.7:0/162430891 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f8a5c0b6550 0x7f8a5c0b8a60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8a7410fba0 tx=0x7f8a68005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:04.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:04.888+0000 7f8a717fa640 1 -- 172.21.15.7:0/162430891 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8a640adae0 con 0x7f8a741048c0 2024-09-21T06:28:05.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:05.084+0000 7f8a7a6ea640 1 -- 172.21.15.7:0/162430891 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7f8a741a9200 con 0x7f8a741048c0 2024-09-21T06:28:05.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:05.089+0000 7f8a717fa640 1 -- 172.21.15.7:0/162430891 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v28)=0 v28) ==== 119+0+0 (secure 0 0 0) 0x7f8a640b1ec0 con 0x7f8a741048c0 2024-09-21T06:28:05.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:05.091+0000 7f8a7a6ea640 1 -- 172.21.15.7:0/162430891 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f8a5c0b6550 msgr2=0x7f8a5c0b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:05.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:05.091+0000 7f8a7a6ea640 1 --2- 172.21.15.7:0/162430891 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f8a5c0b6550 0x7f8a5c0b8a60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8a7410fba0 tx=0x7f8a68005f90 comp rx=0 tx=0).stop 2024-09-21T06:28:05.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:05.091+0000 7f8a7a6ea640 1 -- 172.21.15.7:0/162430891 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a741048c0 msgr2=0x7f8a7419c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:05.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:05.091+0000 7f8a7a6ea640 1 --2- 172.21.15.7:0/162430891 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a741048c0 0x7f8a7419c5a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8a6400d770 tx=0x7f8a6400dc30 comp rx=0 tx=0).stop 2024-09-21T06:28:05.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:05.091+0000 7f8a7a6ea640 1 -- 172.21.15.7:0/162430891 shutdown_connections 2024-09-21T06:28:05.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:05.091+0000 7f8a7a6ea640 1 --2- 172.21.15.7:0/162430891 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f8a5c0b6550 0x7f8a5c0b8a60 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:05.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:05.091+0000 7f8a7a6ea640 1 --2- 172.21.15.7:0/162430891 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8a7410de70 0x7f8a741a1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:05.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:05.091+0000 7f8a7a6ea640 1 --2- 172.21.15.7:0/162430891 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a741052a0 0x7f8a7419cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:05.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:05.091+0000 7f8a7a6ea640 1 --2- 172.21.15.7:0/162430891 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8a741048c0 0x7f8a7419c5a0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:05.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:05.091+0000 7f8a7a6ea640 1 -- 172.21.15.7:0/162430891 >> 172.21.15.7:0/162430891 conn(0x7f8a74079790 msgr2=0x7f8a7410cf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:05.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:05.092+0000 7f8a7a6ea640 1 -- 172.21.15.7:0/162430891 shutdown_connections 2024-09-21T06:28:05.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:05.092+0000 7f8a7a6ea640 1 -- 172.21.15.7:0/162430891 wait complete. 2024-09-21T06:28:06.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:06 smithi007 ceph-mon[30983]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:06.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:06 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/162430891' entity='client.admin' 2024-09-21T06:28:06.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:06 smithi018 ceph-mon[34477]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:06.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:06 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/162430891' entity='client.admin' 2024-09-21T06:28:06.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:06 smithi144 ceph-mon[34653]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:06.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:06 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/162430891' entity='client.admin' 2024-09-21T06:28:07.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.372+0000 7f7d72767640 1 -- 172.21.15.7:0/157564715 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d6c10de30 msgr2=0x7f7d6c110320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:07.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.372+0000 7f7d72767640 1 --2- 172.21.15.7:0/157564715 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d6c10de30 0x7f7d6c110320 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7d64009ca0 tx=0x7f7d6402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:28:07.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.372+0000 7f7d72767640 1 -- 172.21.15.7:0/157564715 shutdown_connections 2024-09-21T06:28:07.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.372+0000 7f7d72767640 1 --2- 172.21.15.7:0/157564715 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d6c10de30 0x7f7d6c110320 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:07.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.372+0000 7f7d72767640 1 --2- 172.21.15.7:0/157564715 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7d6c105320 0x7f7d6c10d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:07.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.372+0000 7f7d72767640 1 --2- 172.21.15.7:0/157564715 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7d6c1049d0 0x7f7d6c104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:07.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.372+0000 7f7d72767640 1 -- 172.21.15.7:0/157564715 >> 172.21.15.7:0/157564715 conn(0x7f7d6c079740 msgr2=0x7f7d6c079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:07.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.372+0000 7f7d72767640 1 -- 172.21.15.7:0/157564715 shutdown_connections 2024-09-21T06:28:07.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.373+0000 7f7d72767640 1 -- 172.21.15.7:0/157564715 wait complete. 2024-09-21T06:28:07.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.373+0000 7f7d72767640 1 Processor -- start 2024-09-21T06:28:07.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.373+0000 7f7d72767640 1 -- start start 2024-09-21T06:28:07.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.374+0000 7f7d72767640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d6c1049d0 0x7f7d6c19c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:07.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.374+0000 7f7d72767640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7d6c105320 0x7f7d6c19cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:07.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.374+0000 7f7d72767640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7d6c10de30 0x7f7d6c1a1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:07.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.374+0000 7f7d72767640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7d6c113970 con 0x7f7d6c1049d0 2024-09-21T06:28:07.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.374+0000 7f7d72767640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7d6c1137f0 con 0x7f7d6c105320 2024-09-21T06:28:07.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.374+0000 7f7d72767640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7d6c113af0 con 0x7f7d6c10de30 2024-09-21T06:28:07.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.374+0000 7f7d6bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d6c1049d0 0x7f7d6c19c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:07.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.374+0000 7f7d6bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d6c1049d0 0x7f7d6c19c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40146/0 (socket says 172.21.15.7:40146) 2024-09-21T06:28:07.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.374+0000 7f7d6bfff640 1 -- 172.21.15.7:0/1429513458 learned_addr learned my addr 172.21.15.7:0/1429513458 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:28:07.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.374+0000 7f7d6b7fe640 1 --2- 172.21.15.7:0/1429513458 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7d6c105320 0x7f7d6c19cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:07.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.374+0000 7f7d70d04640 1 --2- 172.21.15.7:0/1429513458 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7d6c10de30 0x7f7d6c1a1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:07.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.374+0000 7f7d6bfff640 1 -- 172.21.15.7:0/1429513458 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7d6c10de30 msgr2=0x7f7d6c1a1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:07.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.374+0000 7f7d6bfff640 1 --2- 172.21.15.7:0/1429513458 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7d6c10de30 0x7f7d6c1a1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:07.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.374+0000 7f7d6bfff640 1 -- 172.21.15.7:0/1429513458 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7d6c105320 msgr2=0x7f7d6c19cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:07.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.374+0000 7f7d6bfff640 1 --2- 172.21.15.7:0/1429513458 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7d6c105320 0x7f7d6c19cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:07.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.374+0000 7f7d6bfff640 1 -- 172.21.15.7:0/1429513458 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d6c1a2530 con 0x7f7d6c1049d0 2024-09-21T06:28:07.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.375+0000 7f7d6bfff640 1 --2- 172.21.15.7:0/1429513458 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d6c1049d0 0x7f7d6c19c5c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7d5c00d950 tx=0x7f7d5c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:07.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.375+0000 7f7d697fa640 1 -- 172.21.15.7:0/1429513458 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d5c017070 con 0x7f7d6c1049d0 2024-09-21T06:28:07.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.375+0000 7f7d697fa640 1 -- 172.21.15.7:0/1429513458 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f7d5c009c30 con 0x7f7d6c1049d0 2024-09-21T06:28:07.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.375+0000 7f7d72767640 1 -- 172.21.15.7:0/1429513458 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d6c1a2820 con 0x7f7d6c1049d0 2024-09-21T06:28:07.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.375+0000 7f7d697fa640 1 -- 172.21.15.7:0/1429513458 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d5c010e60 con 0x7f7d6c1049d0 2024-09-21T06:28:07.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.375+0000 7f7d72767640 1 -- 172.21.15.7:0/1429513458 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d6c1a8f80 con 0x7f7d6c1049d0 2024-09-21T06:28:07.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.376+0000 7f7d72767640 1 -- 172.21.15.7:0/1429513458 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d6c06c220 con 0x7f7d6c1049d0 2024-09-21T06:28:07.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.378+0000 7f7d697fa640 1 -- 172.21.15.7:0/1429513458 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 154472+0+0 (secure 0 0 0) 0x7f7d5c01a070 con 0x7f7d6c1049d0 2024-09-21T06:28:07.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.379+0000 7f7d697fa640 1 --2- 172.21.15.7:0/1429513458 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f7d540b6550 0x7f7d540b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:07.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.379+0000 7f7d6b7fe640 1 --2- 172.21.15.7:0/1429513458 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f7d540b6550 0x7f7d540b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:07.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.379+0000 7f7d697fa640 1 -- 172.21.15.7:0/1429513458 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f7d5c0e51b0 con 0x7f7d6c1049d0 2024-09-21T06:28:07.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.379+0000 7f7d6b7fe640 1 --2- 172.21.15.7:0/1429513458 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f7d540b6550 0x7f7d540b8a60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c10fc00 tx=0x7f7d6000b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:07.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.382+0000 7f7d697fa640 1 -- 172.21.15.7:0/1429513458 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7d5c009de0 con 0x7f7d6c1049d0 2024-09-21T06:28:07.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.519+0000 7ffb7e11b640 1 -- 172.21.15.7:0/2179603387 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb78103b80 msgr2=0x7ffb78103f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:07.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.519+0000 7ffb7e11b640 1 --2- 172.21.15.7:0/2179603387 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb78103b80 0x7ffb78103f90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ffb68009900 tx=0x7ffb6802a410 comp rx=0 tx=0).stop 2024-09-21T06:28:07.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.519+0000 7ffb7e11b640 1 -- 172.21.15.7:0/2179603387 shutdown_connections 2024-09-21T06:28:07.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.519+0000 7ffb7e11b640 1 --2- 172.21.15.7:0/2179603387 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb78109e10 0x7ffb78110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:07.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.519+0000 7ffb7e11b640 1 --2- 172.21.15.7:0/2179603387 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb781094c0 0x7ffb781098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:07.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.519+0000 7ffb7e11b640 1 --2- 172.21.15.7:0/2179603387 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb78103b80 0x7ffb78103f90 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:07.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.519+0000 7ffb7e11b640 1 -- 172.21.15.7:0/2179603387 >> 172.21.15.7:0/2179603387 conn(0x7ffb780ff610 msgr2=0x7ffb78101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:07.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.519+0000 7ffb7e11b640 1 -- 172.21.15.7:0/2179603387 shutdown_connections 2024-09-21T06:28:07.522 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.520+0000 7ffb7e11b640 1 -- 172.21.15.7:0/2179603387 wait complete. 2024-09-21T06:28:07.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.521+0000 7ffb7e11b640 1 Processor -- start 2024-09-21T06:28:07.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.521+0000 7ffb7e11b640 1 -- start start 2024-09-21T06:28:07.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.521+0000 7ffb7e11b640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb78103b80 0x7ffb7819a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:07.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.521+0000 7ffb7e11b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb781094c0 0x7ffb7819a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:07.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.521+0000 7ffb7e11b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb78109e10 0x7ffb7819fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:07.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.521+0000 7ffb7e11b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ffb78113a00 con 0x7ffb781094c0 2024-09-21T06:28:07.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.521+0000 7ffb7e11b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ffb78113880 con 0x7ffb78109e10 2024-09-21T06:28:07.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.521+0000 7ffb7e11b640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ffb78113b80 con 0x7ffb78103b80 2024-09-21T06:28:07.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.521+0000 7ffb76ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb781094c0 0x7ffb7819a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:07.524 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.521+0000 7ffb76ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb781094c0 0x7ffb7819a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40164/0 (socket says 172.21.15.7:40164) 2024-09-21T06:28:07.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.521+0000 7ffb76ffd640 1 -- 172.21.15.7:0/2008901106 learned_addr learned my addr 172.21.15.7:0/2008901106 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:28:07.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.521+0000 7ffb777fe640 1 --2- 172.21.15.7:0/2008901106 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb78103b80 0x7ffb7819a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:07.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.521+0000 7ffb77fff640 1 --2- 172.21.15.7:0/2008901106 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb78109e10 0x7ffb7819fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:07.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.522+0000 7ffb76ffd640 1 -- 172.21.15.7:0/2008901106 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb78103b80 msgr2=0x7ffb7819a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:07.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.522+0000 7ffb76ffd640 1 --2- 172.21.15.7:0/2008901106 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb78103b80 0x7ffb7819a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:07.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.522+0000 7ffb76ffd640 1 -- 172.21.15.7:0/2008901106 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb78109e10 msgr2=0x7ffb7819fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:07.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.522+0000 7ffb76ffd640 1 --2- 172.21.15.7:0/2008901106 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb78109e10 0x7ffb7819fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:07.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.522+0000 7ffb76ffd640 1 -- 172.21.15.7:0/2008901106 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb781a0340 con 0x7ffb781094c0 2024-09-21T06:28:07.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.522+0000 7ffb76ffd640 1 --2- 172.21.15.7:0/2008901106 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb781094c0 0x7ffb7819a970 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c00d740 tx=0x7ffb6c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:07.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.522+0000 7ffb74ff9640 1 -- 172.21.15.7:0/2008901106 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb6c017070 con 0x7ffb781094c0 2024-09-21T06:28:07.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.522+0000 7ffb74ff9640 1 -- 172.21.15.7:0/2008901106 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7ffb6c00de50 con 0x7ffb781094c0 2024-09-21T06:28:07.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.522+0000 7ffb74ff9640 1 -- 172.21.15.7:0/2008901106 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb6c00f620 con 0x7ffb781094c0 2024-09-21T06:28:07.525 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.522+0000 7ffb7e11b640 1 -- 172.21.15.7:0/2008901106 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb781a0630 con 0x7ffb781094c0 2024-09-21T06:28:07.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.522+0000 7ffb7e11b640 1 -- 172.21.15.7:0/2008901106 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb780755f0 con 0x7ffb781094c0 2024-09-21T06:28:07.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.523+0000 7ffb7e11b640 1 -- 172.21.15.7:0/2008901106 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb78104e00 con 0x7ffb781094c0 2024-09-21T06:28:07.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.525+0000 7ffb74ff9640 1 -- 172.21.15.7:0/2008901106 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 154472+0+0 (secure 0 0 0) 0x7ffb6c01a070 con 0x7ffb781094c0 2024-09-21T06:28:07.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.526+0000 7ffb74ff9640 1 --2- 172.21.15.7:0/2008901106 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7ffb600b64d0 0x7ffb600b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:07.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.526+0000 7ffb777fe640 1 --2- 172.21.15.7:0/2008901106 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7ffb600b64d0 0x7ffb600b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:07.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.526+0000 7ffb74ff9640 1 -- 172.21.15.7:0/2008901106 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7ffb6c0e5090 con 0x7ffb781094c0 2024-09-21T06:28:07.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.527+0000 7ffb777fe640 1 --2- 172.21.15.7:0/2008901106 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7ffb600b64d0 0x7ffb600b89e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ffb68000c00 tx=0x7ffb68005e80 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:07.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.533+0000 7ffb74ff9640 1 -- 172.21.15.7:0/2008901106 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ffb6c0b1900 con 0x7ffb781094c0 2024-09-21T06:28:07.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.580+0000 7f7d72767640 1 -- 172.21.15.7:0/1429513458 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) -- 0x7f7d6c104de0 con 0x7f7d6c1049d0 2024-09-21T06:28:07.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.586+0000 7f7d697fa640 1 -- 172.21.15.7:0/1429513458 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v29)=0 v29) ==== 127+0+0 (secure 0 0 0) 0x7f7d5c0ad620 con 0x7f7d6c1049d0 2024-09-21T06:28:07.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.589+0000 7f7d72767640 1 -- 172.21.15.7:0/1429513458 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f7d540b6550 msgr2=0x7f7d540b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:07.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.589+0000 7f7d72767640 1 --2- 172.21.15.7:0/1429513458 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f7d540b6550 0x7f7d540b8a60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c10fc00 tx=0x7f7d6000b410 comp rx=0 tx=0).stop 2024-09-21T06:28:07.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.589+0000 7f7d72767640 1 -- 172.21.15.7:0/1429513458 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d6c1049d0 msgr2=0x7f7d6c19c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:07.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.589+0000 7f7d72767640 1 --2- 172.21.15.7:0/1429513458 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d6c1049d0 0x7f7d6c19c5c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7d5c00d950 tx=0x7f7d5c00de10 comp rx=0 tx=0).stop 2024-09-21T06:28:07.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.589+0000 7f7d72767640 1 -- 172.21.15.7:0/1429513458 shutdown_connections 2024-09-21T06:28:07.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.589+0000 7f7d72767640 1 --2- 172.21.15.7:0/1429513458 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f7d540b6550 0x7f7d540b8a60 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:07.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.589+0000 7f7d72767640 1 --2- 172.21.15.7:0/1429513458 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7d6c10de30 0x7f7d6c1a1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:07.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.589+0000 7f7d72767640 1 --2- 172.21.15.7:0/1429513458 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7d6c105320 0x7f7d6c19cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:07.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.589+0000 7f7d72767640 1 --2- 172.21.15.7:0/1429513458 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7d6c1049d0 0x7f7d6c19c5c0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:07.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.589+0000 7f7d72767640 1 -- 172.21.15.7:0/1429513458 >> 172.21.15.7:0/1429513458 conn(0x7f7d6c079740 msgr2=0x7f7d6c10cc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:07.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.589+0000 7f7d72767640 1 -- 172.21.15.7:0/1429513458 shutdown_connections 2024-09-21T06:28:07.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.589+0000 7f7d72767640 1 -- 172.21.15.7:0/1429513458 wait complete. 2024-09-21T06:28:07.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.731+0000 7ffb7e11b640 1 -- 172.21.15.7:0/2008901106 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7ffb7810bb90 con 0x7ffb781094c0 2024-09-21T06:28:07.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.735+0000 7ffb74ff9640 1 -- 172.21.15.7:0/2008901106 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v30)=0 v30) ==== 108+0+0 (secure 0 0 0) 0x7ffb6c0b6840 con 0x7ffb781094c0 2024-09-21T06:28:07.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.738+0000 7ffb7e11b640 1 -- 172.21.15.7:0/2008901106 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7ffb600b64d0 msgr2=0x7ffb600b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:07.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.738+0000 7ffb7e11b640 1 --2- 172.21.15.7:0/2008901106 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7ffb600b64d0 0x7ffb600b89e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ffb68000c00 tx=0x7ffb68005e80 comp rx=0 tx=0).stop 2024-09-21T06:28:07.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.738+0000 7ffb7e11b640 1 -- 172.21.15.7:0/2008901106 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb781094c0 msgr2=0x7ffb7819a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:07.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.738+0000 7ffb7e11b640 1 --2- 172.21.15.7:0/2008901106 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb781094c0 0x7ffb7819a970 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c00d740 tx=0x7ffb6c00dc00 comp rx=0 tx=0).stop 2024-09-21T06:28:07.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.738+0000 7ffb7e11b640 1 -- 172.21.15.7:0/2008901106 shutdown_connections 2024-09-21T06:28:07.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.738+0000 7ffb7e11b640 1 --2- 172.21.15.7:0/2008901106 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7ffb600b64d0 0x7ffb600b89e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:07.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.738+0000 7ffb7e11b640 1 --2- 172.21.15.7:0/2008901106 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb78109e10 0x7ffb7819fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:07.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.738+0000 7ffb7e11b640 1 --2- 172.21.15.7:0/2008901106 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ffb781094c0 0x7ffb7819a970 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:07.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.738+0000 7ffb7e11b640 1 --2- 172.21.15.7:0/2008901106 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ffb78103b80 0x7ffb7819a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:07.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.738+0000 7ffb7e11b640 1 -- 172.21.15.7:0/2008901106 >> 172.21.15.7:0/2008901106 conn(0x7ffb780ff610 msgr2=0x7ffb78101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:07.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.738+0000 7ffb7e11b640 1 -- 172.21.15.7:0/2008901106 shutdown_connections 2024-09-21T06:28:07.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:07.738+0000 7ffb7e11b640 1 -- 172.21.15.7:0/2008901106 wait complete. 2024-09-21T06:28:08.413 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:28:08.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.428+0000 7f394b896640 1 -- 172.21.15.7:0/3452596997 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3944102ae0 msgr2=0x7f3944102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:08.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.428+0000 7f394b896640 1 --2- 172.21.15.7:0/3452596997 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3944102ae0 0x7f3944102ef0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3934009ca0 tx=0x7f393402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:28:08.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.428+0000 7f394b896640 1 -- 172.21.15.7:0/3452596997 shutdown_connections 2024-09-21T06:28:08.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.428+0000 7f394b896640 1 --2- 172.21.15.7:0/3452596997 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3944108d20 0x7f394410f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:08.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.428+0000 7f394b896640 1 --2- 172.21.15.7:0/3452596997 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39441083d0 0x7f39441087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:08.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.428+0000 7f394b896640 1 --2- 172.21.15.7:0/3452596997 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3944102ae0 0x7f3944102ef0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:08.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.428+0000 7f394b896640 1 -- 172.21.15.7:0/3452596997 >> 172.21.15.7:0/3452596997 conn(0x7f3944079790 msgr2=0x7f3944079ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:08.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.429+0000 7f394b896640 1 -- 172.21.15.7:0/3452596997 shutdown_connections 2024-09-21T06:28:08.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.429+0000 7f394b896640 1 -- 172.21.15.7:0/3452596997 wait complete. 2024-09-21T06:28:08.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.430+0000 7f394b896640 1 Processor -- start 2024-09-21T06:28:08.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.430+0000 7f394b896640 1 -- start start 2024-09-21T06:28:08.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.430+0000 7f394b896640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3944102ae0 0x7f394419b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:08.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.430+0000 7f394b896640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39441083d0 0x7f394419b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:08.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.430+0000 7f394b896640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3944108d20 0x7f394419bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:08.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.430+0000 7f394b896640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f39441128c0 con 0x7f3944102ae0 2024-09-21T06:28:08.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.430+0000 7f394b896640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3944112740 con 0x7f39441083d0 2024-09-21T06:28:08.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.430+0000 7f394b896640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3944112a40 con 0x7f3944108d20 2024-09-21T06:28:08.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.430+0000 7f3949632640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3944102ae0 0x7f394419b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:08.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.430+0000 7f3949632640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3944102ae0 0x7f394419b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40178/0 (socket says 172.21.15.7:40178) 2024-09-21T06:28:08.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.430+0000 7f3949632640 1 -- 172.21.15.7:0/2133974563 learned_addr learned my addr 172.21.15.7:0/2133974563 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:28:08.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.431+0000 7f3949e33640 1 --2- 172.21.15.7:0/2133974563 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3944108d20 0x7f394419bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:08.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.431+0000 7f3948e31640 1 --2- 172.21.15.7:0/2133974563 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39441083d0 0x7f394419b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:08.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.431+0000 7f3949632640 1 -- 172.21.15.7:0/2133974563 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3944108d20 msgr2=0x7f394419bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:08.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.431+0000 7f3949632640 1 --2- 172.21.15.7:0/2133974563 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3944108d20 0x7f394419bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:08.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.431+0000 7f3949632640 1 -- 172.21.15.7:0/2133974563 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39441083d0 msgr2=0x7f394419b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:08.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.431+0000 7f3949632640 1 --2- 172.21.15.7:0/2133974563 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39441083d0 0x7f394419b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:08.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.431+0000 7f3949632640 1 -- 172.21.15.7:0/2133974563 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39441a6490 con 0x7f3944102ae0 2024-09-21T06:28:08.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.431+0000 7f3949632640 1 --2- 172.21.15.7:0/2133974563 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3944102ae0 0x7f394419b1d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3934005e30 tx=0x7f39340307f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:08.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.431+0000 7f39427fc640 1 -- 172.21.15.7:0/2133974563 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3934031830 con 0x7f3944102ae0 2024-09-21T06:28:08.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.431+0000 7f39427fc640 1 -- 172.21.15.7:0/2133974563 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f393403b890 con 0x7f3944102ae0 2024-09-21T06:28:08.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.431+0000 7f394b896640 1 -- 172.21.15.7:0/2133974563 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39441a6720 con 0x7f3944102ae0 2024-09-21T06:28:08.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.431+0000 7f39427fc640 1 -- 172.21.15.7:0/2133974563 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f393403a770 con 0x7f3944102ae0 2024-09-21T06:28:08.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.431+0000 7f394b896640 1 -- 172.21.15.7:0/2133974563 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39441a6c60 con 0x7f3944102ae0 2024-09-21T06:28:08.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.432+0000 7f394b896640 1 -- 172.21.15.7:0/2133974563 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3944102ef0 con 0x7f3944102ae0 2024-09-21T06:28:08.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.434+0000 7f39427fc640 1 -- 172.21.15.7:0/2133974563 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 154472+0+0 (secure 0 0 0) 0x7f393403b400 con 0x7f3944102ae0 2024-09-21T06:28:08.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.435+0000 7f39427fc640 1 --2- 172.21.15.7:0/2133974563 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f392c0b64d0 0x7f392c0b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:08.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.435+0000 7f3948e31640 1 --2- 172.21.15.7:0/2133974563 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f392c0b64d0 0x7f392c0b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:08.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.435+0000 7f39427fc640 1 -- 172.21.15.7:0/2133974563 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f3934106c60 con 0x7f3944102ae0 2024-09-21T06:28:08.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.436+0000 7f3948e31640 1 --2- 172.21.15.7:0/2133974563 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f392c0b64d0 0x7f392c0b89e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f394407a0e0 tx=0x7f393800b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:08.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.439+0000 7f39427fc640 1 -- 172.21.15.7:0/2133974563 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f39340cf0f0 con 0x7f3944102ae0 2024-09-21T06:28:08.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.605+0000 7f024e331640 1 -- 172.21.15.7:0/4245516651 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0248102a60 msgr2=0x7f0248102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:08.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.605+0000 7f024e331640 1 --2- 172.21.15.7:0/4245516651 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0248102a60 0x7f0248102e70 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0238009900 tx=0x7f023802a410 comp rx=0 tx=0).stop 2024-09-21T06:28:08.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.605+0000 7f024e331640 1 -- 172.21.15.7:0/4245516651 shutdown_connections 2024-09-21T06:28:08.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.605+0000 7f024e331640 1 --2- 172.21.15.7:0/4245516651 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0248108cf0 0x7f024810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:08.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.605+0000 7f024e331640 1 --2- 172.21.15.7:0/4245516651 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f02481083a0 0x7f02481087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:08.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.605+0000 7f024e331640 1 --2- 172.21.15.7:0/4245516651 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0248102a60 0x7f0248102e70 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:08.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.605+0000 7f024e331640 1 -- 172.21.15.7:0/4245516651 >> 172.21.15.7:0/4245516651 conn(0x7f0248079730 msgr2=0x7f0248079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:08.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.605+0000 7f024e331640 1 -- 172.21.15.7:0/4245516651 shutdown_connections 2024-09-21T06:28:08.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.605+0000 7f024e331640 1 -- 172.21.15.7:0/4245516651 wait complete. 2024-09-21T06:28:08.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.606+0000 7f024e331640 1 Processor -- start 2024-09-21T06:28:08.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.606+0000 7f024e331640 1 -- start start 2024-09-21T06:28:08.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.606+0000 7f024e331640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0248102a60 0x7f024819a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:08.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.606+0000 7f024e331640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f02481083a0 0x7f024819a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:08.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.606+0000 7f024e331640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0248108cf0 0x7f024819fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:08.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.606+0000 7f024e331640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0248112840 con 0x7f0248108cf0 2024-09-21T06:28:08.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.606+0000 7f024e331640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f02481126c0 con 0x7f02481083a0 2024-09-21T06:28:08.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.606+0000 7f024e331640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f02481129c0 con 0x7f0248102a60 2024-09-21T06:28:08.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.606+0000 7f024c8ce640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0248108cf0 0x7f024819fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:08.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.606+0000 7f024c8ce640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0248108cf0 0x7f024819fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40198/0 (socket says 172.21.15.7:40198) 2024-09-21T06:28:08.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.606+0000 7f024c8ce640 1 -- 172.21.15.7:0/4023414301 learned_addr learned my addr 172.21.15.7:0/4023414301 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:28:08.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.606+0000 7f023ffff640 1 --2- 172.21.15.7:0/4023414301 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f02481083a0 0x7f024819a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:08.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.607+0000 7f0247fff640 1 --2- 172.21.15.7:0/4023414301 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0248102a60 0x7f024819a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:08.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.607+0000 7f024c8ce640 1 -- 172.21.15.7:0/4023414301 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0248102a60 msgr2=0x7f024819a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:08.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.607+0000 7f024c8ce640 1 --2- 172.21.15.7:0/4023414301 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0248102a60 0x7f024819a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:08.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.607+0000 7f024c8ce640 1 -- 172.21.15.7:0/4023414301 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f02481083a0 msgr2=0x7f024819a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:08.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.607+0000 7f024c8ce640 1 --2- 172.21.15.7:0/4023414301 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f02481083a0 0x7f024819a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:08.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.607+0000 7f024c8ce640 1 -- 172.21.15.7:0/4023414301 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02481a02b0 con 0x7f0248108cf0 2024-09-21T06:28:08.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.607+0000 7f024c8ce640 1 --2- 172.21.15.7:0/4023414301 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0248108cf0 0x7f024819fb80 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f024000eb10 tx=0x7f024000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:08.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.607+0000 7f0245ffb640 1 -- 172.21.15.7:0/4023414301 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0240004b20 con 0x7f0248108cf0 2024-09-21T06:28:08.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.607+0000 7f024e331640 1 -- 172.21.15.7:0/4023414301 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02481a05a0 con 0x7f0248108cf0 2024-09-21T06:28:08.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.607+0000 7f0245ffb640 1 -- 172.21.15.7:0/4023414301 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f0240004cc0 con 0x7f0248108cf0 2024-09-21T06:28:08.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.607+0000 7f0245ffb640 1 -- 172.21.15.7:0/4023414301 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0240010690 con 0x7f0248108cf0 2024-09-21T06:28:08.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.607+0000 7f024e331640 1 -- 172.21.15.7:0/4023414301 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02481a6d00 con 0x7f0248108cf0 2024-09-21T06:28:08.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.608+0000 7f024e331640 1 -- 172.21.15.7:0/4023414301 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0248102e70 con 0x7f0248108cf0 2024-09-21T06:28:08.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.611+0000 7f0245ffb640 1 -- 172.21.15.7:0/4023414301 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 154472+0+0 (secure 0 0 0) 0x7f0240005020 con 0x7f0248108cf0 2024-09-21T06:28:08.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.612+0000 7f0245ffb640 1 --2- 172.21.15.7:0/4023414301 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f02340b64d0 0x7f02340b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:08.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.612+0000 7f0247fff640 1 --2- 172.21.15.7:0/4023414301 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f02340b64d0 0x7f02340b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:08.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.612+0000 7f0245ffb640 1 -- 172.21.15.7:0/4023414301 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f02400e5d50 con 0x7f0248108cf0 2024-09-21T06:28:08.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.612+0000 7f0247fff640 1 --2- 172.21.15.7:0/4023414301 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f02340b64d0 0x7f02340b89e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0238000c00 tx=0x7f0238009680 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:08.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.617+0000 7f0245ffb640 1 -- 172.21.15.7:0/4023414301 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f02400ae1e0 con 0x7f0248108cf0 2024-09-21T06:28:08.638 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.636+0000 7f394b896640 1 -- 172.21.15.7:0/2133974563 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7f394402e640 con 0x7f3944102ae0 2024-09-21T06:28:08.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.642+0000 7f39427fc640 1 -- 172.21.15.7:0/2133974563 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v31)=0 v31) ==== 122+0+0 (secure 0 0 0) 0x7f39340098b0 con 0x7f3944102ae0 2024-09-21T06:28:08.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.644+0000 7f394b896640 1 -- 172.21.15.7:0/2133974563 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f392c0b64d0 msgr2=0x7f392c0b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:08.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.644+0000 7f394b896640 1 --2- 172.21.15.7:0/2133974563 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f392c0b64d0 0x7f392c0b89e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f394407a0e0 tx=0x7f393800b410 comp rx=0 tx=0).stop 2024-09-21T06:28:08.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.644+0000 7f394b896640 1 -- 172.21.15.7:0/2133974563 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3944102ae0 msgr2=0x7f394419b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:08.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.644+0000 7f394b896640 1 --2- 172.21.15.7:0/2133974563 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3944102ae0 0x7f394419b1d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3934005e30 tx=0x7f39340307f0 comp rx=0 tx=0).stop 2024-09-21T06:28:08.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.645+0000 7f394b896640 1 -- 172.21.15.7:0/2133974563 shutdown_connections 2024-09-21T06:28:08.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.645+0000 7f394b896640 1 --2- 172.21.15.7:0/2133974563 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f392c0b64d0 0x7f392c0b89e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:08.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.645+0000 7f394b896640 1 --2- 172.21.15.7:0/2133974563 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3944108d20 0x7f394419bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:08.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.645+0000 7f394b896640 1 --2- 172.21.15.7:0/2133974563 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39441083d0 0x7f394419b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:08.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.645+0000 7f394b896640 1 --2- 172.21.15.7:0/2133974563 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3944102ae0 0x7f394419b1d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:08.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.645+0000 7f394b896640 1 -- 172.21.15.7:0/2133974563 >> 172.21.15.7:0/2133974563 conn(0x7f3944079790 msgr2=0x7f3944106520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:08.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.645+0000 7f394b896640 1 -- 172.21.15.7:0/2133974563 shutdown_connections 2024-09-21T06:28:08.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.645+0000 7f394b896640 1 -- 172.21.15.7:0/2133974563 wait complete. 2024-09-21T06:28:08.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.814+0000 7f024e331640 1 -- 172.21.15.7:0/4023414301 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f02481a7040 con 0x7f0248108cf0 2024-09-21T06:28:08.816 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:08 smithi007 ceph-mon[30983]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:08.816 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:08 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/1429513458' entity='client.admin' 2024-09-21T06:28:08.816 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:08 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2008901106' entity='client.admin' 2024-09-21T06:28:08.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.818+0000 7f0245ffb640 1 -- 172.21.15.7:0/4023414301 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v32)=0 v32) ==== 123+0+0 (secure 0 0 0) 0x7f02400b25c0 con 0x7f0248108cf0 2024-09-21T06:28:08.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.819+0000 7f0245ffb640 1 -- 172.21.15.7:0/4023414301 <== mon.0 v2:172.21.15.7:3300/0 8 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f02400a9240 con 0x7f0248108cf0 2024-09-21T06:28:08.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.821+0000 7f024e331640 1 -- 172.21.15.7:0/4023414301 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f02340b64d0 msgr2=0x7f02340b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:08.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.821+0000 7f024e331640 1 --2- 172.21.15.7:0/4023414301 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f02340b64d0 0x7f02340b89e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0238000c00 tx=0x7f0238009680 comp rx=0 tx=0).stop 2024-09-21T06:28:08.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.821+0000 7f024e331640 1 -- 172.21.15.7:0/4023414301 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0248108cf0 msgr2=0x7f024819fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:08.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.821+0000 7f024e331640 1 --2- 172.21.15.7:0/4023414301 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0248108cf0 0x7f024819fb80 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f024000eb10 tx=0x7f024000c2d0 comp rx=0 tx=0).stop 2024-09-21T06:28:08.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.821+0000 7f024e331640 1 -- 172.21.15.7:0/4023414301 shutdown_connections 2024-09-21T06:28:08.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.821+0000 7f024e331640 1 --2- 172.21.15.7:0/4023414301 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f02340b64d0 0x7f02340b89e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:08.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.821+0000 7f024e331640 1 --2- 172.21.15.7:0/4023414301 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0248108cf0 0x7f024819fb80 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:08.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.821+0000 7f024e331640 1 --2- 172.21.15.7:0/4023414301 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f02481083a0 0x7f024819a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:08.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.821+0000 7f024e331640 1 --2- 172.21.15.7:0/4023414301 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0248102a60 0x7f024819a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:08.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.821+0000 7f024e331640 1 -- 172.21.15.7:0/4023414301 >> 172.21.15.7:0/4023414301 conn(0x7f0248079730 msgr2=0x7f0248101ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:08.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.821+0000 7f024e331640 1 -- 172.21.15.7:0/4023414301 shutdown_connections 2024-09-21T06:28:08.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:08.821+0000 7f024e331640 1 -- 172.21.15.7:0/4023414301 wait complete. 2024-09-21T06:28:08.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:08 smithi018 ceph-mon[34477]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:08.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:08 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/1429513458' entity='client.admin' 2024-09-21T06:28:08.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:08 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/2008901106' entity='client.admin' 2024-09-21T06:28:09.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:08 smithi144 ceph-mon[34653]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:09.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:08 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/1429513458' entity='client.admin' 2024-09-21T06:28:09.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:08 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/2008901106' entity='client.admin' 2024-09-21T06:28:09.529 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '347cb918-77e2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi007') 2024-09-21T06:28:09.657 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:28:09.657 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:28:09.839 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:09 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2133974563' entity='client.admin' 2024-09-21T06:28:09.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:09 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/4023414301' entity='client.admin' 2024-09-21T06:28:10.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:09 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/2133974563' entity='client.admin' 2024-09-21T06:28:10.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:09 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/4023414301' entity='client.admin' 2024-09-21T06:28:10.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:09 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/2133974563' entity='client.admin' 2024-09-21T06:28:10.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:09 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/4023414301' entity='client.admin' 2024-09-21T06:28:11.010 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:10 smithi007 ceph-mon[30983]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:11.010 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:10 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2476730750' entity='client.admin' 2024-09-21T06:28:11.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:10 smithi018 ceph-mon[34477]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:11.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:10 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/2476730750' entity='client.admin' 2024-09-21T06:28:11.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:10 smithi144 ceph-mon[34653]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:11.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:10 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/2476730750' entity='client.admin' 2024-09-21T06:28:12.601 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '347cb918-77e2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi007') 2024-09-21T06:28:12.601 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '347cb918-77e2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi007') 2024-09-21T06:28:12.601 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '347cb918-77e2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'], check_status=True, hostname='smithi007') 2024-09-21T06:28:12.601 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '347cb918-77e2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'], check_status=True, hostname='smithi007') 2024-09-21T06:28:12.742 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:12 smithi007 ceph-mon[30983]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:12.742 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:12 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:28:12.742 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:12 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:28:12.742 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:12 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:28:12.742 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:12 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:28:12.742 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:12 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:28:12.742 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:12 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:28:12.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:12 smithi144 ceph-mon[34653]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:12.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:12 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:28:12.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:12 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:28:12.786 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:12 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:28:12.786 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:12 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:28:12.786 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:12 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:28:12.786 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:12 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:28:12.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:12 smithi018 ceph-mon[34477]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:12.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:12 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:28:12.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:12 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:28:12.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:12 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:28:12.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:12 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:28:12.870 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:12 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:28:12.870 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:12 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:28:13.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:10.184+0000 7f157030f640 1 -- 172.21.15.7:0/1949187906 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f156810de30 msgr2=0x7f1568110320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:13.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:10.184+0000 7f157030f640 1 --2- 172.21.15.7:0/1949187906 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f156810de30 0x7f1568110320 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1560009ca0 tx=0x7f156002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:28:13.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:10.184+0000 7f157030f640 1 -- 172.21.15.7:0/1949187906 shutdown_connections 2024-09-21T06:28:13.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:10.184+0000 7f157030f640 1 --2- 172.21.15.7:0/1949187906 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f156810de30 0x7f1568110320 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:13.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:10.184+0000 7f157030f640 1 --2- 172.21.15.7:0/1949187906 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1568105320 0x7f156810d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:13.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:10.184+0000 7f157030f640 1 --2- 172.21.15.7:0/1949187906 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f15681049d0 0x7f1568104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:13.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:10.184+0000 7f157030f640 1 -- 172.21.15.7:0/1949187906 >> 172.21.15.7:0/1949187906 conn(0x7f1568079740 msgr2=0x7f1568079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:13.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:10.184+0000 7f157030f640 1 -- 172.21.15.7:0/1949187906 shutdown_connections 2024-09-21T06:28:13.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:10.184+0000 7f157030f640 1 -- 172.21.15.7:0/1949187906 wait complete. 2024-09-21T06:28:13.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:10.184+0000 7f157030f640 1 Processor -- start 2024-09-21T06:28:13.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:10.185+0000 7f157030f640 1 -- start start 2024-09-21T06:28:13.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:10.185+0000 7f157030f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f15681049d0 0x7f156819c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:13.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:10.185+0000 7f157030f640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1568105320 0x7f156819cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:13.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:10.185+0000 7f157030f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f156810de30 0x7f15681a1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:13.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:10.185+0000 7f157030f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1568113ab0 con 0x7f15681049d0 2024-09-21T06:28:13.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:10.185+0000 7f157030f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1568113930 con 0x7f156810de30 2024-09-21T06:28:13.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:10.185+0000 7f157030f640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1568113c30 con 0x7f1568105320 2024-09-21T06:28:13.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:10.185+0000 7f156e0ab640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f15681049d0 0x7f156819c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:13.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:10.185+0000 7f156e0ab640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f15681049d0 0x7f156819c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40218/0 (socket says 172.21.15.7:40218) 2024-09-21T06:28:13.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:10.185+0000 7f156e0ab640 1 -- 172.21.15.7:0/2476730750 learned_addr learned my addr 172.21.15.7:0/2476730750 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:28:13.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:10.185+0000 7f156d8aa640 1 --2- 172.21.15.7:0/2476730750 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1568105320 0x7f156819cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:13.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:10.185+0000 7f156e8ac640 1 --2- 172.21.15.7:0/2476730750 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f156810de30 0x7f15681a1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:13.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:10.185+0000 7f156e0ab640 1 -- 172.21.15.7:0/2476730750 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1568105320 msgr2=0x7f156819cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:13.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:10.185+0000 7f156e0ab640 1 --2- 172.21.15.7:0/2476730750 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1568105320 0x7f156819cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:13.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:10.185+0000 7f156e0ab640 1 -- 172.21.15.7:0/2476730750 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f156810de30 msgr2=0x7f15681a1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:13.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:10.185+0000 7f156e0ab640 1 --2- 172.21.15.7:0/2476730750 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f156810de30 0x7f15681a1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:13.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:10.185+0000 7f156e0ab640 1 -- 172.21.15.7:0/2476730750 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15681a25d0 con 0x7f15681049d0 2024-09-21T06:28:13.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:10.185+0000 7f156e8ac640 1 --2- 172.21.15.7:0/2476730750 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f156810de30 0x7f15681a1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:28:13.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:10.186+0000 7f156e0ab640 1 --2- 172.21.15.7:0/2476730750 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f15681049d0 0x7f156819c660 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f156400d950 tx=0x7f156400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:13.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:10.186+0000 7f155b7fe640 1 -- 172.21.15.7:0/2476730750 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1564017070 con 0x7f15681049d0 2024-09-21T06:28:13.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:10.186+0000 7f155b7fe640 1 -- 172.21.15.7:0/2476730750 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1564009c30 con 0x7f15681049d0 2024-09-21T06:28:13.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:10.186+0000 7f155b7fe640 1 -- 172.21.15.7:0/2476730750 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f156400f620 con 0x7f15681049d0 2024-09-21T06:28:13.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:10.186+0000 7f157030f640 1 -- 172.21.15.7:0/2476730750 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15681a28c0 con 0x7f15681049d0 2024-09-21T06:28:13.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:10.186+0000 7f157030f640 1 -- 172.21.15.7:0/2476730750 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15681a9020 con 0x7f15681049d0 2024-09-21T06:28:13.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:10.187+0000 7f157030f640 1 -- 172.21.15.7:0/2476730750 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f156806c240 con 0x7f15681049d0 2024-09-21T06:28:13.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:10.188+0000 7f155b7fe640 1 -- 172.21.15.7:0/2476730750 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 154472+0+0 (secure 0 0 0) 0x7f156401a070 con 0x7f15681049d0 2024-09-21T06:28:13.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:10.189+0000 7f155b7fe640 1 --2- 172.21.15.7:0/2476730750 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f15540b6550 0x7f15540b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:13.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:10.189+0000 7f156d8aa640 1 --2- 172.21.15.7:0/2476730750 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f15540b6550 0x7f15540b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:13.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:10.189+0000 7f155b7fe640 1 -- 172.21.15.7:0/2476730750 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f15640e50d0 con 0x7f15681049d0 2024-09-21T06:28:13.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:10.190+0000 7f156d8aa640 1 --2- 172.21.15.7:0/2476730750 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f15540b6550 0x7f15540b8a60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f156810fb70 tx=0x7f155c00b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:13.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:10.192+0000 7f155b7fe640 1 -- 172.21.15.7:0/2476730750 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1564009de0 con 0x7f15681049d0 2024-09-21T06:28:13.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:10.380+0000 7f157030f640 1 -- 172.21.15.7:0/2476730750 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7f1568104de0 con 0x7f15681049d0 2024-09-21T06:28:13.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:10.384+0000 7f155b7fe640 1 -- 172.21.15.7:0/2476730750 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v33)=0 v33) ==== 125+0+0 (secure 0 0 0) 0x7f15640ad5e0 con 0x7f15681049d0 2024-09-21T06:28:13.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:10.387+0000 7f157030f640 1 -- 172.21.15.7:0/2476730750 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f15540b6550 msgr2=0x7f15540b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:13.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:10.387+0000 7f157030f640 1 --2- 172.21.15.7:0/2476730750 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f15540b6550 0x7f15540b8a60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f156810fb70 tx=0x7f155c00b410 comp rx=0 tx=0).stop 2024-09-21T06:28:13.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:10.387+0000 7f157030f640 1 -- 172.21.15.7:0/2476730750 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f15681049d0 msgr2=0x7f156819c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:13.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:10.387+0000 7f157030f640 1 --2- 172.21.15.7:0/2476730750 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f15681049d0 0x7f156819c660 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f156400d950 tx=0x7f156400de10 comp rx=0 tx=0).stop 2024-09-21T06:28:13.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:10.387+0000 7f157030f640 1 -- 172.21.15.7:0/2476730750 shutdown_connections 2024-09-21T06:28:13.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:10.387+0000 7f157030f640 1 --2- 172.21.15.7:0/2476730750 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f15540b6550 0x7f15540b8a60 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:13.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:10.387+0000 7f157030f640 1 --2- 172.21.15.7:0/2476730750 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f156810de30 0x7f15681a1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:13.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:10.387+0000 7f157030f640 1 --2- 172.21.15.7:0/2476730750 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1568105320 0x7f156819cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:13.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:10.387+0000 7f157030f640 1 --2- 172.21.15.7:0/2476730750 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f15681049d0 0x7f156819c660 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:13.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:10.387+0000 7f157030f640 1 -- 172.21.15.7:0/2476730750 >> 172.21.15.7:0/2476730750 conn(0x7f1568079740 msgr2=0x7f15681036c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:13.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:10.387+0000 7f157030f640 1 -- 172.21.15.7:0/2476730750 shutdown_connections 2024-09-21T06:28:13.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:10.387+0000 7f157030f640 1 -- 172.21.15.7:0/2476730750 wait complete. 2024-09-21T06:28:14.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:14.158+0000 7fcb7086a640 1 -- 172.21.15.7:0/538995499 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb6c108cf0 msgr2=0x7fcb6c10f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:14.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:14.158+0000 7fcb7086a640 1 --2- 172.21.15.7:0/538995499 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb6c108cf0 0x7fcb6c10f520 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fcb64009ca0 tx=0x7fcb6402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:28:14.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:14.159+0000 7fcb7086a640 1 -- 172.21.15.7:0/538995499 shutdown_connections 2024-09-21T06:28:14.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:14.159+0000 7fcb7086a640 1 --2- 172.21.15.7:0/538995499 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb6c108cf0 0x7fcb6c10f520 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:14.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:14.159+0000 7fcb7086a640 1 --2- 172.21.15.7:0/538995499 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb6c1083a0 0x7fcb6c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:14.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:14.159+0000 7fcb7086a640 1 --2- 172.21.15.7:0/538995499 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcb6c102a60 0x7fcb6c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:14.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:14.159+0000 7fcb7086a640 1 -- 172.21.15.7:0/538995499 >> 172.21.15.7:0/538995499 conn(0x7fcb6c079730 msgr2=0x7fcb6c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:14.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:14.159+0000 7fcb7086a640 1 -- 172.21.15.7:0/538995499 shutdown_connections 2024-09-21T06:28:14.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:14.159+0000 7fcb7086a640 1 -- 172.21.15.7:0/538995499 wait complete. 2024-09-21T06:28:14.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:14.160+0000 7fcb7086a640 1 Processor -- start 2024-09-21T06:28:14.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:14.160+0000 7fcb7086a640 1 -- start start 2024-09-21T06:28:14.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:14.160+0000 7fcb7086a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcb6c102a60 0x7fcb6c19b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:14.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:14.160+0000 7fcb7086a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb6c1083a0 0x7fcb6c19b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:14.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:14.160+0000 7fcb7086a640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb6c108cf0 0x7fcb6c19bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:14.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:14.160+0000 7fcb7086a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fcb6c112960 con 0x7fcb6c1083a0 2024-09-21T06:28:14.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:14.160+0000 7fcb7086a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcb6c1127e0 con 0x7fcb6c102a60 2024-09-21T06:28:14.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:14.160+0000 7fcb7086a640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fcb6c112ae0 con 0x7fcb6c108cf0 2024-09-21T06:28:14.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:14.160+0000 7fcb69d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb6c1083a0 0x7fcb6c19b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:14.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:14.160+0000 7fcb69d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb6c1083a0 0x7fcb6c19b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52322/0 (socket says 172.21.15.7:52322) 2024-09-21T06:28:14.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:14.160+0000 7fcb69d9b640 1 -- 172.21.15.7:0/2373169580 learned_addr learned my addr 172.21.15.7:0/2373169580 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:28:14.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:14.160+0000 7fcb6a59c640 1 --2- 172.21.15.7:0/2373169580 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcb6c102a60 0x7fcb6c19b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:14.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:14.160+0000 7fcb6ad9d640 1 --2- 172.21.15.7:0/2373169580 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb6c108cf0 0x7fcb6c19bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:14.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:14.160+0000 7fcb69d9b640 1 -- 172.21.15.7:0/2373169580 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb6c108cf0 msgr2=0x7fcb6c19bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:14.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:14.160+0000 7fcb69d9b640 1 --2- 172.21.15.7:0/2373169580 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb6c108cf0 0x7fcb6c19bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:14.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:14.160+0000 7fcb69d9b640 1 -- 172.21.15.7:0/2373169580 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcb6c102a60 msgr2=0x7fcb6c19b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:14.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:14.160+0000 7fcb69d9b640 1 --2- 172.21.15.7:0/2373169580 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcb6c102a60 0x7fcb6c19b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:14.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:14.160+0000 7fcb69d9b640 1 -- 172.21.15.7:0/2373169580 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb6c1a64a0 con 0x7fcb6c1083a0 2024-09-21T06:28:14.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:14.161+0000 7fcb69d9b640 1 --2- 172.21.15.7:0/2373169580 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb6c1083a0 0x7fcb6c19b750 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fcb6000d770 tx=0x7fcb6000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:14.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:14.161+0000 7fcb5b7fe640 1 -- 172.21.15.7:0/2373169580 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb60017070 con 0x7fcb6c1083a0 2024-09-21T06:28:14.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:14.161+0000 7fcb5b7fe640 1 -- 172.21.15.7:0/2373169580 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcb60009c30 con 0x7fcb6c1083a0 2024-09-21T06:28:14.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:14.161+0000 7fcb7086a640 1 -- 172.21.15.7:0/2373169580 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb6c1a6790 con 0x7fcb6c1083a0 2024-09-21T06:28:14.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:14.161+0000 7fcb5b7fe640 1 -- 172.21.15.7:0/2373169580 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb6000f620 con 0x7fcb6c1083a0 2024-09-21T06:28:14.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:14.161+0000 7fcb7086a640 1 -- 172.21.15.7:0/2373169580 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb6c1a6cd0 con 0x7fcb6c1083a0 2024-09-21T06:28:14.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:14.162+0000 7fcb7086a640 1 -- 172.21.15.7:0/2373169580 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb6c102e70 con 0x7fcb6c1083a0 2024-09-21T06:28:14.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:14.164+0000 7fcb5b7fe640 1 -- 172.21.15.7:0/2373169580 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 154472+0+0 (secure 0 0 0) 0x7fcb6001a070 con 0x7fcb6c1083a0 2024-09-21T06:28:14.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:14.164+0000 7fcb5b7fe640 1 --2- 172.21.15.7:0/2373169580 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fcb540b6500 0x7fcb540b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:14.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:14.164+0000 7fcb6a59c640 1 --2- 172.21.15.7:0/2373169580 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fcb540b6500 0x7fcb540b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:14.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:14.164+0000 7fcb5b7fe640 1 -- 172.21.15.7:0/2373169580 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fcb600e51c0 con 0x7fcb6c1083a0 2024-09-21T06:28:14.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:14.165+0000 7fcb6a59c640 1 --2- 172.21.15.7:0/2373169580 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fcb540b6500 0x7fcb540b8a10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c06b9c0 tx=0x7fcb5c005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:14.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:14.167+0000 7fcb5b7fe640 1 -- 172.21.15.7:0/2373169580 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcb600b1990 con 0x7fcb6c1083a0 2024-09-21T06:28:14.284 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:13 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/3226507896' entity='client.admin' 2024-09-21T06:28:14.285 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:13 smithi007 ceph-mon[30983]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:14.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:13 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/3226507896' entity='client.admin' 2024-09-21T06:28:14.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:13 smithi144 ceph-mon[34653]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:14.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:14.356+0000 7fcb7086a640 1 -- 172.21.15.7:0/2373169580 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7fcb6c02e640 con 0x7fcb6c1083a0 2024-09-21T06:28:14.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:14.360+0000 7fcb5b7fe640 1 -- 172.21.15.7:0/2373169580 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v35)=0 v35) ==== 120+0+0 (secure 0 0 0) 0x7fcb600b68d0 con 0x7fcb6c1083a0 2024-09-21T06:28:14.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:14.363+0000 7fcb7086a640 1 -- 172.21.15.7:0/2373169580 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fcb540b6500 msgr2=0x7fcb540b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:14.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:14.363+0000 7fcb7086a640 1 --2- 172.21.15.7:0/2373169580 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fcb540b6500 0x7fcb540b8a10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c06b9c0 tx=0x7fcb5c005f90 comp rx=0 tx=0).stop 2024-09-21T06:28:14.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:14.363+0000 7fcb7086a640 1 -- 172.21.15.7:0/2373169580 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb6c1083a0 msgr2=0x7fcb6c19b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:14.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:14.363+0000 7fcb7086a640 1 --2- 172.21.15.7:0/2373169580 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb6c1083a0 0x7fcb6c19b750 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fcb6000d770 tx=0x7fcb6000dc30 comp rx=0 tx=0).stop 2024-09-21T06:28:14.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:14.363+0000 7fcb7086a640 1 -- 172.21.15.7:0/2373169580 shutdown_connections 2024-09-21T06:28:14.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:14.363+0000 7fcb7086a640 1 --2- 172.21.15.7:0/2373169580 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fcb540b6500 0x7fcb540b8a10 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:14.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:14.363+0000 7fcb7086a640 1 --2- 172.21.15.7:0/2373169580 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb6c108cf0 0x7fcb6c19bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:14.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:14.363+0000 7fcb7086a640 1 --2- 172.21.15.7:0/2373169580 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb6c1083a0 0x7fcb6c19b750 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:14.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:14.363+0000 7fcb7086a640 1 --2- 172.21.15.7:0/2373169580 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcb6c102a60 0x7fcb6c19b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:14.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:14.363+0000 7fcb7086a640 1 -- 172.21.15.7:0/2373169580 >> 172.21.15.7:0/2373169580 conn(0x7fcb6c079730 msgr2=0x7fcb6c1043b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:14.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:14.363+0000 7fcb7086a640 1 -- 172.21.15.7:0/2373169580 shutdown_connections 2024-09-21T06:28:14.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:14.363+0000 7fcb7086a640 1 -- 172.21.15.7:0/2373169580 wait complete. 2024-09-21T06:28:14.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:13 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/3226507896' entity='client.admin' 2024-09-21T06:28:14.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:13 smithi018 ceph-mon[34477]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:14.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:12.745+0000 7fddc5ec5640 1 -- 172.21.15.7:0/1733389479 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fddc010de90 msgr2=0x7fddc0110380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:14.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:12.745+0000 7fddc5ec5640 1 --2- 172.21.15.7:0/1733389479 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fddc010de90 0x7fddc0110380 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fddb8009ca0 tx=0x7fddb802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:28:14.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:12.745+0000 7fddc5ec5640 1 -- 172.21.15.7:0/1733389479 shutdown_connections 2024-09-21T06:28:14.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:12.745+0000 7fddc5ec5640 1 --2- 172.21.15.7:0/1733389479 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fddc010de90 0x7fddc0110380 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:14.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:12.745+0000 7fddc5ec5640 1 --2- 172.21.15.7:0/1733389479 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fddc0105380 0x7fddc010d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:14.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:12.745+0000 7fddc5ec5640 1 --2- 172.21.15.7:0/1733389479 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddc0104a30 0x7fddc0104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:14.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:12.745+0000 7fddc5ec5640 1 -- 172.21.15.7:0/1733389479 >> 172.21.15.7:0/1733389479 conn(0x7fddc0079770 msgr2=0x7fddc0079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:14.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:12.745+0000 7fddc5ec5640 1 -- 172.21.15.7:0/1733389479 shutdown_connections 2024-09-21T06:28:14.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:12.745+0000 7fddc5ec5640 1 -- 172.21.15.7:0/1733389479 wait complete. 2024-09-21T06:28:14.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:12.745+0000 7fddc5ec5640 1 Processor -- start 2024-09-21T06:28:14.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:12.746+0000 7fddc5ec5640 1 -- start start 2024-09-21T06:28:14.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:12.746+0000 7fddc5ec5640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddc0104a30 0x7fddc0102770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:14.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:12.746+0000 7fddc5ec5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fddc0105380 0x7fddc0102cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:14.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:12.746+0000 7fddc5ec5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fddc010de90 0x7fddc01031f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:14.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:12.746+0000 7fddc5ec5640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fddc0113b10 con 0x7fddc0105380 2024-09-21T06:28:14.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:12.746+0000 7fddc5ec5640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fddc0113990 con 0x7fddc010de90 2024-09-21T06:28:14.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:12.746+0000 7fddc5ec5640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fddc0113c90 con 0x7fddc0104a30 2024-09-21T06:28:14.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:12.746+0000 7fddbeffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fddc0105380 0x7fddc0102cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:14.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:12.746+0000 7fddbeffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fddc0105380 0x7fddc0102cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52304/0 (socket says 172.21.15.7:52304) 2024-09-21T06:28:14.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:12.746+0000 7fddbeffd640 1 -- 172.21.15.7:0/3226507896 learned_addr learned my addr 172.21.15.7:0/3226507896 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:28:14.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:12.746+0000 7fddbf7fe640 1 --2- 172.21.15.7:0/3226507896 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddc0104a30 0x7fddc0102770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:14.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:12.746+0000 7fddbffff640 1 --2- 172.21.15.7:0/3226507896 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fddc010de90 0x7fddc01031f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:14.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:12.747+0000 7fddbeffd640 1 -- 172.21.15.7:0/3226507896 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddc0104a30 msgr2=0x7fddc0102770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:14.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:12.747+0000 7fddbeffd640 1 --2- 172.21.15.7:0/3226507896 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddc0104a30 0x7fddc0102770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:14.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:12.747+0000 7fddbeffd640 1 -- 172.21.15.7:0/3226507896 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fddc010de90 msgr2=0x7fddc01031f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:14.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:12.747+0000 7fddbeffd640 1 --2- 172.21.15.7:0/3226507896 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fddc010de90 0x7fddc01031f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:14.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:12.747+0000 7fddbeffd640 1 -- 172.21.15.7:0/3226507896 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddc01a86b0 con 0x7fddc0105380 2024-09-21T06:28:14.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:12.747+0000 7fddbffff640 1 --2- 172.21.15.7:0/3226507896 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fddc010de90 0x7fddc01031f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:28:14.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:12.747+0000 7fddbeffd640 1 --2- 172.21.15.7:0/3226507896 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fddc0105380 0x7fddc0102cb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fddb400c8c0 tx=0x7fddb400cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:14.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:12.747+0000 7fddbcff9640 1 -- 172.21.15.7:0/3226507896 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddb4007bb0 con 0x7fddc0105380 2024-09-21T06:28:14.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:12.747+0000 7fddc5ec5640 1 -- 172.21.15.7:0/3226507896 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddc01a89a0 con 0x7fddc0105380 2024-09-21T06:28:14.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:12.747+0000 7fddbcff9640 1 -- 172.21.15.7:0/3226507896 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fddb4007d50 con 0x7fddc0105380 2024-09-21T06:28:14.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:12.747+0000 7fddbcff9640 1 -- 172.21.15.7:0/3226507896 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddb40187c0 con 0x7fddc0105380 2024-09-21T06:28:14.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:12.747+0000 7fddc5ec5640 1 -- 172.21.15.7:0/3226507896 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddc01a8ee0 con 0x7fddc0105380 2024-09-21T06:28:14.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:12.748+0000 7fddc5ec5640 1 -- 172.21.15.7:0/3226507896 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddc006c260 con 0x7fddc0105380 2024-09-21T06:28:14.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:12.750+0000 7fddbcff9640 1 -- 172.21.15.7:0/3226507896 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 154472+0+0 (secure 0 0 0) 0x7fddb400fa20 con 0x7fddc0105380 2024-09-21T06:28:14.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:12.751+0000 7fddbcff9640 1 --2- 172.21.15.7:0/3226507896 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fdda80b6550 0x7fdda80b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:14.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:12.751+0000 7fddbf7fe640 1 --2- 172.21.15.7:0/3226507896 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fdda80b6550 0x7fdda80b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:14.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:12.751+0000 7fddbcff9640 1 -- 172.21.15.7:0/3226507896 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fddb40e5b70 con 0x7fddc0105380 2024-09-21T06:28:14.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:12.752+0000 7fddbf7fe640 1 --2- 172.21.15.7:0/3226507896 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fdda80b6550 0x7fdda80b8a60 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fddc01041c0 tx=0x7fddb000b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:14.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:12.754+0000 7fddbcff9640 1 -- 172.21.15.7:0/3226507896 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fddb4014030 con 0x7fddc0105380 2024-09-21T06:28:14.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:12.947+0000 7fddc5ec5640 1 -- 172.21.15.7:0/3226507896 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7fddc01a9230 con 0x7fddc0105380 2024-09-21T06:28:14.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:12.951+0000 7fddbcff9640 1 -- 172.21.15.7:0/3226507896 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v34)=0 v34) ==== 121+0+0 (secure 0 0 0) 0x7fddb40adff0 con 0x7fddc0105380 2024-09-21T06:28:14.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:12.953+0000 7fddc5ec5640 1 -- 172.21.15.7:0/3226507896 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fdda80b6550 msgr2=0x7fdda80b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:14.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:12.953+0000 7fddc5ec5640 1 --2- 172.21.15.7:0/3226507896 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fdda80b6550 0x7fdda80b8a60 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fddc01041c0 tx=0x7fddb000b390 comp rx=0 tx=0).stop 2024-09-21T06:28:14.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:12.953+0000 7fddc5ec5640 1 -- 172.21.15.7:0/3226507896 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fddc0105380 msgr2=0x7fddc0102cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:14.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:12.953+0000 7fddc5ec5640 1 --2- 172.21.15.7:0/3226507896 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fddc0105380 0x7fddc0102cb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fddb400c8c0 tx=0x7fddb400cd80 comp rx=0 tx=0).stop 2024-09-21T06:28:14.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:12.953+0000 7fddc5ec5640 1 -- 172.21.15.7:0/3226507896 shutdown_connections 2024-09-21T06:28:14.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:12.953+0000 7fddc5ec5640 1 --2- 172.21.15.7:0/3226507896 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fdda80b6550 0x7fdda80b8a60 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:14.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:12.953+0000 7fddc5ec5640 1 --2- 172.21.15.7:0/3226507896 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fddc010de90 0x7fddc01031f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:14.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:12.953+0000 7fddc5ec5640 1 --2- 172.21.15.7:0/3226507896 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fddc0105380 0x7fddc0102cb0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:14.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:12.953+0000 7fddc5ec5640 1 --2- 172.21.15.7:0/3226507896 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddc0104a30 0x7fddc0102770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:14.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:12.953+0000 7fddc5ec5640 1 -- 172.21.15.7:0/3226507896 >> 172.21.15.7:0/3226507896 conn(0x7fddc0079770 msgr2=0x7fddc0100630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:14.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:12.953+0000 7fddc5ec5640 1 -- 172.21.15.7:0/3226507896 shutdown_connections 2024-09-21T06:28:14.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:12.953+0000 7fddc5ec5640 1 -- 172.21.15.7:0/3226507896 wait complete. 2024-09-21T06:28:15.436 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:15 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2373169580' entity='client.admin' 2024-09-21T06:28:15.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:15 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/2373169580' entity='client.admin' 2024-09-21T06:28:15.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.653+0000 7f4e5f02e640 1 -- 172.21.15.7:0/3822011980 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e58109e10 msgr2=0x7f4e58110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:15.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.653+0000 7f4e5f02e640 1 --2- 172.21.15.7:0/3822011980 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e58109e10 0x7f4e58110640 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4e40009900 tx=0x7f4e4002a410 comp rx=0 tx=0).stop 2024-09-21T06:28:15.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.653+0000 7f4e5f02e640 1 -- 172.21.15.7:0/3822011980 shutdown_connections 2024-09-21T06:28:15.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.653+0000 7f4e5f02e640 1 --2- 172.21.15.7:0/3822011980 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e58109e10 0x7f4e58110640 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:15.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.653+0000 7f4e5f02e640 1 --2- 172.21.15.7:0/3822011980 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e581094c0 0x7f4e581098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:15.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.653+0000 7f4e5f02e640 1 --2- 172.21.15.7:0/3822011980 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e58103b80 0x7f4e58103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:15.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.653+0000 7f4e5f02e640 1 -- 172.21.15.7:0/3822011980 >> 172.21.15.7:0/3822011980 conn(0x7f4e580ff610 msgr2=0x7f4e58101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:15.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.653+0000 7f4e5f02e640 1 -- 172.21.15.7:0/3822011980 shutdown_connections 2024-09-21T06:28:15.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.653+0000 7f4e5f02e640 1 -- 172.21.15.7:0/3822011980 wait complete. 2024-09-21T06:28:15.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.654+0000 7f4e5f02e640 1 Processor -- start 2024-09-21T06:28:15.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.654+0000 7f4e5f02e640 1 -- start start 2024-09-21T06:28:15.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.654+0000 7f4e5f02e640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e58103b80 0x7f4e5819a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:15.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.654+0000 7f4e5f02e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e581094c0 0x7f4e5819a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:15.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.654+0000 7f4e5f02e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e58109e10 0x7f4e5819fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:15.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.654+0000 7f4e5f02e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4e58113b20 con 0x7f4e581094c0 2024-09-21T06:28:15.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.654+0000 7f4e5f02e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4e581139a0 con 0x7f4e58109e10 2024-09-21T06:28:15.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.654+0000 7f4e5f02e640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4e58113ca0 con 0x7f4e58103b80 2024-09-21T06:28:15.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.655+0000 7f4e57fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e581094c0 0x7f4e5819a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:15.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.655+0000 7f4e57fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e581094c0 0x7f4e5819a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52334/0 (socket says 172.21.15.7:52334) 2024-09-21T06:28:15.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.655+0000 7f4e57fff640 1 -- 172.21.15.7:0/1055470471 learned_addr learned my addr 172.21.15.7:0/1055470471 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:28:15.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.655+0000 7f4e5cdca640 1 --2- 172.21.15.7:0/1055470471 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e58103b80 0x7f4e5819a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:15.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.655+0000 7f4e5d5cb640 1 --2- 172.21.15.7:0/1055470471 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e58109e10 0x7f4e5819fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:15.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.655+0000 7f4e57fff640 1 -- 172.21.15.7:0/1055470471 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e58103b80 msgr2=0x7f4e5819a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:15.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.655+0000 7f4e57fff640 1 --2- 172.21.15.7:0/1055470471 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e58103b80 0x7f4e5819a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:15.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.655+0000 7f4e57fff640 1 -- 172.21.15.7:0/1055470471 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e58109e10 msgr2=0x7f4e5819fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:15.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.655+0000 7f4e57fff640 1 --2- 172.21.15.7:0/1055470471 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e58109e10 0x7f4e5819fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:15.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.655+0000 7f4e57fff640 1 -- 172.21.15.7:0/1055470471 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e581a02e0 con 0x7f4e581094c0 2024-09-21T06:28:15.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.655+0000 7f4e5d5cb640 1 --2- 172.21.15.7:0/1055470471 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e58109e10 0x7f4e5819fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:28:15.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.655+0000 7f4e57fff640 1 --2- 172.21.15.7:0/1055470471 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e581094c0 0x7f4e5819a9d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4e4800cce0 tx=0x7f4e4800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:15.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.655+0000 7f4e55ffb640 1 -- 172.21.15.7:0/1055470471 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e4800f450 con 0x7f4e581094c0 2024-09-21T06:28:15.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.655+0000 7f4e55ffb640 1 -- 172.21.15.7:0/1055470471 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4e4800faa0 con 0x7f4e581094c0 2024-09-21T06:28:15.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.655+0000 7f4e5f02e640 1 -- 172.21.15.7:0/1055470471 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e581a05d0 con 0x7f4e581094c0 2024-09-21T06:28:15.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.655+0000 7f4e55ffb640 1 -- 172.21.15.7:0/1055470471 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e48018c50 con 0x7f4e581094c0 2024-09-21T06:28:15.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.655+0000 7f4e5f02e640 1 -- 172.21.15.7:0/1055470471 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e581a6df0 con 0x7f4e581094c0 2024-09-21T06:28:15.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.656+0000 7f4e5f02e640 1 -- 172.21.15.7:0/1055470471 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e58103f90 con 0x7f4e581094c0 2024-09-21T06:28:15.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.658+0000 7f4e55ffb640 1 -- 172.21.15.7:0/1055470471 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 154472+0+0 (secure 0 0 0) 0x7f4e4800fc50 con 0x7f4e581094c0 2024-09-21T06:28:15.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.659+0000 7f4e55ffb640 1 --2- 172.21.15.7:0/1055470471 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f4e440b6580 0x7f4e440b8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:15.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.659+0000 7f4e5cdca640 1 --2- 172.21.15.7:0/1055470471 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f4e440b6580 0x7f4e440b8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:15.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.659+0000 7f4e55ffb640 1 -- 172.21.15.7:0/1055470471 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f4e480e5f00 con 0x7f4e581094c0 2024-09-21T06:28:15.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.659+0000 7f4e5cdca640 1 --2- 172.21.15.7:0/1055470471 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f4e440b6580 0x7f4e440b8a90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4e50005fd0 tx=0x7f4e50005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:15.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.662+0000 7f4e55ffb640 1 -- 172.21.15.7:0/1055470471 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4e48056710 con 0x7f4e581094c0 2024-09-21T06:28:15.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:15 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/2373169580' entity='client.admin' 2024-09-21T06:28:15.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.853+0000 7f4e5f02e640 1 -- 172.21.15.7:0/1055470471 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7f4e5802e640 con 0x7f4e581094c0 2024-09-21T06:28:15.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.858+0000 7f4e55ffb640 1 -- 172.21.15.7:0/1055470471 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v36)=0 v36) ==== 116+0+0 (secure 0 0 0) 0x7f4e48014030 con 0x7f4e581094c0 2024-09-21T06:28:15.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.861+0000 7f4e5f02e640 1 -- 172.21.15.7:0/1055470471 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f4e440b6580 msgr2=0x7f4e440b8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:15.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.861+0000 7f4e5f02e640 1 --2- 172.21.15.7:0/1055470471 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f4e440b6580 0x7f4e440b8a90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4e50005fd0 tx=0x7f4e50005850 comp rx=0 tx=0).stop 2024-09-21T06:28:15.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.861+0000 7f4e5f02e640 1 -- 172.21.15.7:0/1055470471 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e581094c0 msgr2=0x7f4e5819a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:15.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.861+0000 7f4e5f02e640 1 --2- 172.21.15.7:0/1055470471 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e581094c0 0x7f4e5819a9d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4e4800cce0 tx=0x7f4e4800a620 comp rx=0 tx=0).stop 2024-09-21T06:28:15.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.861+0000 7f4e5f02e640 1 -- 172.21.15.7:0/1055470471 shutdown_connections 2024-09-21T06:28:15.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.861+0000 7f4e5f02e640 1 --2- 172.21.15.7:0/1055470471 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f4e440b6580 0x7f4e440b8a90 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:15.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.861+0000 7f4e5f02e640 1 --2- 172.21.15.7:0/1055470471 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e58109e10 0x7f4e5819fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:15.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.861+0000 7f4e5f02e640 1 --2- 172.21.15.7:0/1055470471 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e581094c0 0x7f4e5819a9d0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:15.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.861+0000 7f4e5f02e640 1 --2- 172.21.15.7:0/1055470471 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e58103b80 0x7f4e5819a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:15.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.861+0000 7f4e5f02e640 1 -- 172.21.15.7:0/1055470471 >> 172.21.15.7:0/1055470471 conn(0x7f4e580ff610 msgr2=0x7f4e58106a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:15.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.861+0000 7f4e5f02e640 1 -- 172.21.15.7:0/1055470471 shutdown_connections 2024-09-21T06:28:15.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.861+0000 7f4e5f02e640 1 -- 172.21.15.7:0/1055470471 wait complete. 2024-09-21T06:28:15.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.884+0000 7f5919b17640 1 -- 172.21.15.7:0/1958343526 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5914102ae0 msgr2=0x7f5914102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:15.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.884+0000 7f5919b17640 1 --2- 172.21.15.7:0/1958343526 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5914102ae0 0x7f5914102ef0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5904009900 tx=0x7f590402a410 comp rx=0 tx=0).stop 2024-09-21T06:28:15.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.884+0000 7f5919b17640 1 -- 172.21.15.7:0/1958343526 shutdown_connections 2024-09-21T06:28:15.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.884+0000 7f5919b17640 1 --2- 172.21.15.7:0/1958343526 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5914108d20 0x7f591410f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:15.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.884+0000 7f5919b17640 1 --2- 172.21.15.7:0/1958343526 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59141083d0 0x7f59141087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:15.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.884+0000 7f5919b17640 1 --2- 172.21.15.7:0/1958343526 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5914102ae0 0x7f5914102ef0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:15.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.884+0000 7f5919b17640 1 -- 172.21.15.7:0/1958343526 >> 172.21.15.7:0/1958343526 conn(0x7f5914079790 msgr2=0x7f5914079ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:15.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.884+0000 7f5919b17640 1 -- 172.21.15.7:0/1958343526 shutdown_connections 2024-09-21T06:28:15.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.884+0000 7f5919b17640 1 -- 172.21.15.7:0/1958343526 wait complete. 2024-09-21T06:28:15.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.885+0000 7f5919b17640 1 Processor -- start 2024-09-21T06:28:15.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.885+0000 7f5919b17640 1 -- start start 2024-09-21T06:28:15.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.885+0000 7f5919b17640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5914102ae0 0x7f591419a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:15.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.885+0000 7f5919b17640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59141083d0 0x7f591419ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:15.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.885+0000 7f5919b17640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5914108d20 0x7f591419fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:15.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.885+0000 7f5919b17640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f59141129e0 con 0x7f5914102ae0 2024-09-21T06:28:15.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.885+0000 7f5919b17640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5914112860 con 0x7f5914108d20 2024-09-21T06:28:15.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.885+0000 7f5919b17640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5914112b60 con 0x7f59141083d0 2024-09-21T06:28:15.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.886+0000 7f59137fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5914102ae0 0x7f591419a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:15.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.886+0000 7f59137fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5914102ae0 0x7f591419a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52362/0 (socket says 172.21.15.7:52362) 2024-09-21T06:28:15.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.886+0000 7f59137fe640 1 -- 172.21.15.7:0/3050665432 learned_addr learned my addr 172.21.15.7:0/3050665432 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:28:15.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.886+0000 7f5913fff640 1 --2- 172.21.15.7:0/3050665432 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5914108d20 0x7f591419fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:15.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.886+0000 7f5912ffd640 1 --2- 172.21.15.7:0/3050665432 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59141083d0 0x7f591419ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:15.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.886+0000 7f59137fe640 1 -- 172.21.15.7:0/3050665432 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59141083d0 msgr2=0x7f591419ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:15.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.886+0000 7f59137fe640 1 --2- 172.21.15.7:0/3050665432 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59141083d0 0x7f591419ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:15.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.886+0000 7f59137fe640 1 -- 172.21.15.7:0/3050665432 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5914108d20 msgr2=0x7f591419fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:15.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.886+0000 7f59137fe640 1 --2- 172.21.15.7:0/3050665432 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5914108d20 0x7f591419fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:15.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.886+0000 7f59137fe640 1 -- 172.21.15.7:0/3050665432 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59141a04d0 con 0x7f5914102ae0 2024-09-21T06:28:15.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.886+0000 7f5913fff640 1 --2- 172.21.15.7:0/3050665432 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5914108d20 0x7f591419fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:28:15.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.886+0000 7f59137fe640 1 --2- 172.21.15.7:0/3050665432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5914102ae0 0x7f591419a560 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5904005940 tx=0x7f59040040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:15.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.887+0000 7f5910ff9640 1 -- 172.21.15.7:0/3050665432 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f590403f030 con 0x7f5914102ae0 2024-09-21T06:28:15.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.887+0000 7f5910ff9640 1 -- 172.21.15.7:0/3050665432 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f59040044c0 con 0x7f5914102ae0 2024-09-21T06:28:15.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.887+0000 7f5919b17640 1 -- 172.21.15.7:0/3050665432 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59141a0760 con 0x7f5914102ae0 2024-09-21T06:28:15.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.887+0000 7f5910ff9640 1 -- 172.21.15.7:0/3050665432 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5904035070 con 0x7f5914102ae0 2024-09-21T06:28:15.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.887+0000 7f5919b17640 1 -- 172.21.15.7:0/3050665432 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59140ff550 con 0x7f5914102ae0 2024-09-21T06:28:15.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.888+0000 7f5919b17640 1 -- 172.21.15.7:0/3050665432 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5914103d10 con 0x7f5914102ae0 2024-09-21T06:28:15.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.890+0000 7f5910ff9640 1 -- 172.21.15.7:0/3050665432 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 154472+0+0 (secure 0 0 0) 0x7f5904042030 con 0x7f5914102ae0 2024-09-21T06:28:15.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.891+0000 7f5910ff9640 1 --2- 172.21.15.7:0/3050665432 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f58fc0ba8e0 0x7f58fc0bcdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:15.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.892+0000 7f5910ff9640 1 -- 172.21.15.7:0/3050665432 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f5904105730 con 0x7f5914102ae0 2024-09-21T06:28:15.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.892+0000 7f5912ffd640 1 --2- 172.21.15.7:0/3050665432 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f58fc0ba8e0 0x7f58fc0bcdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:15.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.892+0000 7f5912ffd640 1 --2- 172.21.15.7:0/3050665432 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f58fc0ba8e0 0x7f58fc0bcdf0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f59141049c0 tx=0x7f5908005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:15.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:15.896+0000 7f5910ff9640 1 -- 172.21.15.7:0/3050665432 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f59040d1fa0 con 0x7f5914102ae0 2024-09-21T06:28:16.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:16.086+0000 7f5919b17640 1 -- 172.21.15.7:0/3050665432 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7f591410bb30 con 0x7f5914102ae0 2024-09-21T06:28:16.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:16.091+0000 7f5910ff9640 1 -- 172.21.15.7:0/3050665432 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v37)=0 v37) ==== 115+0+0 (secure 0 0 0) 0x7f59040d6ee0 con 0x7f5914102ae0 2024-09-21T06:28:16.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:16.093+0000 7f5919b17640 1 -- 172.21.15.7:0/3050665432 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f58fc0ba8e0 msgr2=0x7f58fc0bcdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:16.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:16.093+0000 7f5919b17640 1 --2- 172.21.15.7:0/3050665432 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f58fc0ba8e0 0x7f58fc0bcdf0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f59141049c0 tx=0x7f5908005f90 comp rx=0 tx=0).stop 2024-09-21T06:28:16.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:16.093+0000 7f5919b17640 1 -- 172.21.15.7:0/3050665432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5914102ae0 msgr2=0x7f591419a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:16.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:16.093+0000 7f5919b17640 1 --2- 172.21.15.7:0/3050665432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5914102ae0 0x7f591419a560 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5904005940 tx=0x7f59040040c0 comp rx=0 tx=0).stop 2024-09-21T06:28:16.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:16.093+0000 7f5919b17640 1 -- 172.21.15.7:0/3050665432 shutdown_connections 2024-09-21T06:28:16.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:16.093+0000 7f5919b17640 1 --2- 172.21.15.7:0/3050665432 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f58fc0ba8e0 0x7f58fc0bcdf0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:16.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:16.093+0000 7f5919b17640 1 --2- 172.21.15.7:0/3050665432 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5914108d20 0x7f591419fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:16.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:16.093+0000 7f5919b17640 1 --2- 172.21.15.7:0/3050665432 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f59141083d0 0x7f591419ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:16.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:16.093+0000 7f5919b17640 1 --2- 172.21.15.7:0/3050665432 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5914102ae0 0x7f591419a560 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:16.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:16.093+0000 7f5919b17640 1 -- 172.21.15.7:0/3050665432 >> 172.21.15.7:0/3050665432 conn(0x7f5914079790 msgr2=0x7f5914101b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:16.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:16.093+0000 7f5919b17640 1 -- 172.21.15.7:0/3050665432 shutdown_connections 2024-09-21T06:28:16.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:16.093+0000 7f5919b17640 1 -- 172.21.15.7:0/3050665432 wait complete. 2024-09-21T06:28:16.486 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '347cb918-77e2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'], check_status=True, hostname='smithi007') 2024-09-21T06:28:16.486 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '347cb918-77e2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'], check_status=True, hostname='smithi007') 2024-09-21T06:28:16.486 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '347cb918-77e2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi007') 2024-09-21T06:28:17.045 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:16 smithi007 ceph-mon[30983]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:17.046 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:16 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/1055470471' entity='client.admin' 2024-09-21T06:28:17.046 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:16 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/3050665432' entity='client.admin' 2024-09-21T06:28:17.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:16 smithi018 ceph-mon[34477]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:17.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:16 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/1055470471' entity='client.admin' 2024-09-21T06:28:17.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:16 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/3050665432' entity='client.admin' 2024-09-21T06:28:17.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:16 smithi144 ceph-mon[34653]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:17.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:16 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/1055470471' entity='client.admin' 2024-09-21T06:28:17.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:16 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/3050665432' entity='client.admin' 2024-09-21T06:28:17.697 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '347cb918-77e2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi007') 2024-09-21T06:28:17.698 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '347cb918-77e2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi007') 2024-09-21T06:28:17.698 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '347cb918-77e2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi007') 2024-09-21T06:28:17.698 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '347cb918-77e2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi007') 2024-09-21T06:28:17.698 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '347cb918-77e2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi007') 2024-09-21T06:28:17.698 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '347cb918-77e2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi007') 2024-09-21T06:28:17.698 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '347cb918-77e2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'client_mount_timeout', '30'], check_status=True, hostname='smithi007') 2024-09-21T06:28:17.698 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '347cb918-77e2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_cephsqlite', '20'], check_status=True, hostname='smithi007') 2024-09-21T06:28:17.698 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '347cb918-77e2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_client', '20'], check_status=True, hostname='smithi007') 2024-09-21T06:28:17.699 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '347cb918-77e2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_mgr', '20'], check_status=True, hostname='smithi007') 2024-09-21T06:28:17.699 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '347cb918-77e2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_ms', '1'], check_status=True, hostname='smithi007') 2024-09-21T06:28:17.699 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '347cb918-77e2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/allow_m_granularity', 'True'], check_status=True, hostname='smithi007') 2024-09-21T06:28:17.699 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '347cb918-77e2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/dump_on_update', 'True'], check_status=True, hostname='smithi007') 2024-09-21T06:28:17.699 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '347cb918-77e2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/log_level', 'debug'], check_status=True, hostname='smithi007') 2024-09-21T06:28:17.699 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '347cb918-77e2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi007') 2024-09-21T06:28:17.699 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '347cb918-77e2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi007') 2024-09-21T06:28:17.699 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '347cb918-77e2-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi007') 2024-09-21T06:28:17.700 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph config dump 2024-09-21T06:28:17.957 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:28:18.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:18.393+0000 7fee939db640 1 -- 172.21.15.7:0/427234419 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee8c105350 msgr2=0x7fee8c10d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:18.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:18.393+0000 7fee939db640 1 --2- 172.21.15.7:0/427234419 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee8c105350 0x7fee8c10d990 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fee7c009900 tx=0x7fee7c02a410 comp rx=0 tx=0).stop 2024-09-21T06:28:18.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:18.393+0000 7fee939db640 1 -- 172.21.15.7:0/427234419 shutdown_connections 2024-09-21T06:28:18.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:18.393+0000 7fee939db640 1 --2- 172.21.15.7:0/427234419 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee8c10ded0 0x7fee8c110370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:18.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:18.393+0000 7fee939db640 1 --2- 172.21.15.7:0/427234419 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee8c105350 0x7fee8c10d990 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:18.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:18.393+0000 7fee939db640 1 --2- 172.21.15.7:0/427234419 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee8c104920 0x7fee8c104d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:18.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:18.393+0000 7fee939db640 1 -- 172.21.15.7:0/427234419 >> 172.21.15.7:0/427234419 conn(0x7fee8c079770 msgr2=0x7fee8c079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:18.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:18.393+0000 7fee939db640 1 -- 172.21.15.7:0/427234419 shutdown_connections 2024-09-21T06:28:18.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:18.393+0000 7fee939db640 1 -- 172.21.15.7:0/427234419 wait complete. 2024-09-21T06:28:18.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:18.394+0000 7fee939db640 1 Processor -- start 2024-09-21T06:28:18.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:18.394+0000 7fee939db640 1 -- start start 2024-09-21T06:28:18.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:18.394+0000 7fee939db640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee8c104920 0x7fee8c102830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:18.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:18.394+0000 7fee939db640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee8c105350 0x7fee8c102d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:18.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:18.394+0000 7fee939db640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee8c10ded0 0x7fee8c1032b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:18.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:18.394+0000 7fee939db640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fee8c113b30 con 0x7fee8c10ded0 2024-09-21T06:28:18.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:18.394+0000 7fee939db640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fee8c1139b0 con 0x7fee8c104920 2024-09-21T06:28:18.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:18.394+0000 7fee939db640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fee8c113cb0 con 0x7fee8c105350 2024-09-21T06:28:18.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:18.395+0000 7fee91f78640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee8c10ded0 0x7fee8c1032b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:18.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:18.395+0000 7fee91f78640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee8c10ded0 0x7fee8c1032b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52382/0 (socket says 172.21.15.7:52382) 2024-09-21T06:28:18.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:18.395+0000 7fee91f78640 1 -- 172.21.15.7:0/617768539 learned_addr learned my addr 172.21.15.7:0/617768539 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:28:18.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:18.395+0000 7fee91777640 1 --2- 172.21.15.7:0/617768539 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee8c104920 0x7fee8c102830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:18.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:18.395+0000 7fee90f76640 1 --2- 172.21.15.7:0/617768539 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee8c105350 0x7fee8c102d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:18.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:18.395+0000 7fee91f78640 1 -- 172.21.15.7:0/617768539 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee8c105350 msgr2=0x7fee8c102d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:18.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:18.395+0000 7fee91f78640 1 --2- 172.21.15.7:0/617768539 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee8c105350 0x7fee8c102d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:18.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:18.395+0000 7fee91f78640 1 -- 172.21.15.7:0/617768539 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee8c104920 msgr2=0x7fee8c102830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:18.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:18.395+0000 7fee91f78640 1 --2- 172.21.15.7:0/617768539 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee8c104920 0x7fee8c102830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:18.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:18.395+0000 7fee91f78640 1 -- 172.21.15.7:0/617768539 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee8c1a87e0 con 0x7fee8c10ded0 2024-09-21T06:28:18.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:18.395+0000 7fee91f78640 1 --2- 172.21.15.7:0/617768539 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee8c10ded0 0x7fee8c1032b0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fee8400eaa0 tx=0x7fee8400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:18.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:18.395+0000 7fee827fc640 1 -- 172.21.15.7:0/617768539 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee8400cdb0 con 0x7fee8c10ded0 2024-09-21T06:28:18.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:18.395+0000 7fee827fc640 1 -- 172.21.15.7:0/617768539 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fee84005020 con 0x7fee8c10ded0 2024-09-21T06:28:18.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:18.395+0000 7fee939db640 1 -- 172.21.15.7:0/617768539 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee8c1a8ad0 con 0x7fee8c10ded0 2024-09-21T06:28:18.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:18.395+0000 7fee827fc640 1 -- 172.21.15.7:0/617768539 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee840116d0 con 0x7fee8c10ded0 2024-09-21T06:28:18.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:18.395+0000 7fee939db640 1 -- 172.21.15.7:0/617768539 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee8c1a9030 con 0x7fee8c10ded0 2024-09-21T06:28:18.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:18.397+0000 7fee939db640 1 -- 172.21.15.7:0/617768539 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee8c06c1a0 con 0x7fee8c10ded0 2024-09-21T06:28:18.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:18.398+0000 7fee827fc640 1 -- 172.21.15.7:0/617768539 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 154472+0+0 (secure 0 0 0) 0x7fee840051d0 con 0x7fee8c10ded0 2024-09-21T06:28:18.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:18.399+0000 7fee827fc640 1 --2- 172.21.15.7:0/617768539 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fee780b65d0 0x7fee780b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:18.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:18.399+0000 7fee91777640 1 --2- 172.21.15.7:0/617768539 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fee780b65d0 0x7fee780b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:18.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:18.399+0000 7fee827fc640 1 -- 172.21.15.7:0/617768539 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fee840e5880 con 0x7fee8c10ded0 2024-09-21T06:28:18.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:18.399+0000 7fee91777640 1 --2- 172.21.15.7:0/617768539 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fee780b65d0 0x7fee780b8ae0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fee8c104280 tx=0x7fee8800b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:18.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:18.403+0000 7fee827fc640 1 -- 172.21.15.7:0/617768539 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fee84016030 con 0x7fee8c10ded0 2024-09-21T06:28:18.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:18.591+0000 7fee939db640 1 -- 172.21.15.7:0/617768539 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7fee8c103b30 con 0x7fee8c10ded0 2024-09-21T06:28:18.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:18.592+0000 7fee827fc640 1 -- 172.21.15.7:0/617768539 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v37) ==== 59+0+22127 (secure 0 0 0) 0x7fee8c103b30 con 0x7fee8c10ded0 2024-09-21T06:28:18.594 INFO:teuthology.orchestra.run.smithi007.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-21T06:28:18.594 INFO:teuthology.orchestra.run.smithi007.stdout:global dev auth_debug true 2024-09-21T06:28:18.594 INFO:teuthology.orchestra.run.smithi007.stdout:global basic container_image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 * 2024-09-21T06:28:18.594 INFO:teuthology.orchestra.run.smithi007.stdout:global dev debug_asserts_on_shutdown true 2024-09-21T06:28:18.595 INFO:teuthology.orchestra.run.smithi007.stdout:global basic log_to_file true 2024-09-21T06:28:18.595 INFO:teuthology.orchestra.run.smithi007.stdout:global basic log_to_journald false 2024-09-21T06:28:18.595 INFO:teuthology.orchestra.run.smithi007.stdout:global basic log_to_stderr false 2024-09-21T06:28:18.595 INFO:teuthology.orchestra.run.smithi007.stdout:global advanced mon_allow_pool_delete true 2024-09-21T06:28:18.595 INFO:teuthology.orchestra.run.smithi007.stdout:global advanced mon_clock_drift_allowed 1.000000 2024-09-21T06:28:18.595 INFO:teuthology.orchestra.run.smithi007.stdout:global advanced mon_cluster_log_to_file true 2024-09-21T06:28:18.595 INFO:teuthology.orchestra.run.smithi007.stdout:global advanced mon_max_pg_per_osd 10000 2024-09-21T06:28:18.595 INFO:teuthology.orchestra.run.smithi007.stdout:global advanced mon_pg_warn_max_object_skew 0.000000 2024-09-21T06:28:18.595 INFO:teuthology.orchestra.run.smithi007.stdout:global advanced mon_warn_on_crush_straw_calc_version_zero false 2024-09-21T06:28:18.595 INFO:teuthology.orchestra.run.smithi007.stdout:global advanced mon_warn_on_legacy_crush_tunables false 2024-09-21T06:28:18.595 INFO:teuthology.orchestra.run.smithi007.stdout:global advanced mon_warn_on_osd_down_out_interval_zero false 2024-09-21T06:28:18.595 INFO:teuthology.orchestra.run.smithi007.stdout:global dev mon_warn_on_pool_pg_num_not_power_of_two false 2024-09-21T06:28:18.596 INFO:teuthology.orchestra.run.smithi007.stdout:global advanced mon_warn_on_too_few_osds false 2024-09-21T06:28:18.596 INFO:teuthology.orchestra.run.smithi007.stdout:global dev ms_die_on_bug true 2024-09-21T06:28:18.596 INFO:teuthology.orchestra.run.smithi007.stdout:global dev ms_die_on_old_message true 2024-09-21T06:28:18.596 INFO:teuthology.orchestra.run.smithi007.stdout:global dev ms_die_on_skipped_message false 2024-09-21T06:28:18.596 INFO:teuthology.orchestra.run.smithi007.stdout:global advanced osd_pool_default_erasure_code_profile plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-21T06:28:18.596 INFO:teuthology.orchestra.run.smithi007.stdout:global advanced osd_pool_default_pg_autoscale_mode off 2024-09-21T06:28:18.596 INFO:teuthology.orchestra.run.smithi007.stdout:mon advanced auth_allow_insecure_global_id_reclaim false 2024-09-21T06:28:18.596 INFO:teuthology.orchestra.run.smithi007.stdout:mon advanced auth_mon_ticket_ttl 660.000000 2024-09-21T06:28:18.596 INFO:teuthology.orchestra.run.smithi007.stdout:mon advanced auth_service_ticket_ttl 240.000000 2024-09-21T06:28:18.596 INFO:teuthology.orchestra.run.smithi007.stdout:mon advanced debug_mon 20/20 2024-09-21T06:28:18.596 INFO:teuthology.orchestra.run.smithi007.stdout:mon advanced debug_ms 1/1 2024-09-21T06:28:18.596 INFO:teuthology.orchestra.run.smithi007.stdout:mon advanced debug_paxos 20/20 2024-09-21T06:28:18.597 INFO:teuthology.orchestra.run.smithi007.stdout:mon advanced mon_data_avail_warn 5 2024-09-21T06:28:18.597 INFO:teuthology.orchestra.run.smithi007.stdout:mon advanced mon_down_mkfs_grace 300 2024-09-21T06:28:18.597 INFO:teuthology.orchestra.run.smithi007.stdout:mon advanced mon_mgr_mkfs_grace 240 2024-09-21T06:28:18.597 INFO:teuthology.orchestra.run.smithi007.stdout:mon advanced mon_op_complaint_time 120 2024-09-21T06:28:18.597 INFO:teuthology.orchestra.run.smithi007.stdout:mon dev mon_osd_prime_pg_temp true 2024-09-21T06:28:18.597 INFO:teuthology.orchestra.run.smithi007.stdout:mon advanced mon_osd_reporter_subtree_level osd 2024-09-21T06:28:18.597 INFO:teuthology.orchestra.run.smithi007.stdout:mon advanced mon_reweight_min_bytes_per_osd 10 2024-09-21T06:28:18.597 INFO:teuthology.orchestra.run.smithi007.stdout:mon advanced mon_reweight_min_pgs_per_osd 4 2024-09-21T06:28:18.597 INFO:teuthology.orchestra.run.smithi007.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim false 2024-09-21T06:28:18.597 INFO:teuthology.orchestra.run.smithi007.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim_allowed false 2024-09-21T06:28:18.597 INFO:teuthology.orchestra.run.smithi007.stdout:mon advanced public_network 172.21.0.0/20 * 2024-09-21T06:28:18.597 INFO:teuthology.orchestra.run.smithi007.stdout:mgr advanced cephsqlite_lock_renewal_timeout 900000 2024-09-21T06:28:18.598 INFO:teuthology.orchestra.run.smithi007.stdout:mgr advanced client_mount_timeout 30 2024-09-21T06:28:18.598 INFO:teuthology.orchestra.run.smithi007.stdout:mgr advanced debug_cephsqlite 20/20 2024-09-21T06:28:18.598 INFO:teuthology.orchestra.run.smithi007.stdout:mgr advanced debug_client 20/20 2024-09-21T06:28:18.598 INFO:teuthology.orchestra.run.smithi007.stdout:mgr advanced debug_mgr 20/20 2024-09-21T06:28:18.598 INFO:teuthology.orchestra.run.smithi007.stdout:mgr advanced debug_ms 1/1 2024-09-21T06:28:18.598 INFO:teuthology.orchestra.run.smithi007.stdout:mgr advanced mgr/cephadm/allow_ptrace true * 2024-09-21T06:28:18.598 INFO:teuthology.orchestra.run.smithi007.stdout:mgr advanced mgr/cephadm/container_init True * 2024-09-21T06:28:18.598 INFO:teuthology.orchestra.run.smithi007.stdout:mgr advanced mgr/cephadm/migration_current 7 * 2024-09-21T06:28:18.598 INFO:teuthology.orchestra.run.smithi007.stdout:mgr advanced mgr/dashboard/ssl_server_port 8443 * 2024-09-21T06:28:18.598 INFO:teuthology.orchestra.run.smithi007.stdout:mgr advanced mgr/orchestrator/orchestrator cephadm 2024-09-21T06:28:18.598 INFO:teuthology.orchestra.run.smithi007.stdout:mgr advanced mgr/snap_schedule/allow_m_granularity true 2024-09-21T06:28:18.599 INFO:teuthology.orchestra.run.smithi007.stdout:mgr advanced mgr/snap_schedule/dump_on_update true 2024-09-21T06:28:18.599 INFO:teuthology.orchestra.run.smithi007.stdout:mgr advanced mgr/snap_schedule/log_level debug 2024-09-21T06:28:18.599 INFO:teuthology.orchestra.run.smithi007.stdout:mgr advanced mon_reweight_min_bytes_per_osd 10 2024-09-21T06:28:18.599 INFO:teuthology.orchestra.run.smithi007.stdout:mgr advanced mon_reweight_min_pgs_per_osd 4 2024-09-21T06:28:18.599 INFO:teuthology.orchestra.run.smithi007.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-21T06:28:18.599 INFO:teuthology.orchestra.run.smithi007.stdout:osd dev bdev_debug_aio true 2024-09-21T06:28:18.599 INFO:teuthology.orchestra.run.smithi007.stdout:osd dev bluestore_block_size 96636764160 * 2024-09-21T06:28:18.599 INFO:teuthology.orchestra.run.smithi007.stdout:osd advanced bluestore_compression_mode aggressive 2024-09-21T06:28:18.599 INFO:teuthology.orchestra.run.smithi007.stdout:osd dev bluestore_fsck_on_mount true 2024-09-21T06:28:18.599 INFO:teuthology.orchestra.run.smithi007.stdout:osd advanced debug_bluefs 20/20 2024-09-21T06:28:18.599 INFO:teuthology.orchestra.run.smithi007.stdout:osd advanced debug_bluestore 20/20 2024-09-21T06:28:18.599 INFO:teuthology.orchestra.run.smithi007.stdout:osd advanced debug_ms 1/1 2024-09-21T06:28:18.600 INFO:teuthology.orchestra.run.smithi007.stdout:osd advanced debug_osd 20/20 2024-09-21T06:28:18.600 INFO:teuthology.orchestra.run.smithi007.stdout:osd advanced debug_rocksdb 10/10 2024-09-21T06:28:18.600 INFO:teuthology.orchestra.run.smithi007.stdout:osd dev osd_debug_misdirected_ops true 2024-09-21T06:28:18.600 INFO:teuthology.orchestra.run.smithi007.stdout:osd dev osd_debug_op_order true 2024-09-21T06:28:18.600 INFO:teuthology.orchestra.run.smithi007.stdout:osd dev osd_debug_pg_log_writeout true 2024-09-21T06:28:18.600 INFO:teuthology.orchestra.run.smithi007.stdout:osd dev osd_debug_shutdown true 2024-09-21T06:28:18.600 INFO:teuthology.orchestra.run.smithi007.stdout:osd dev osd_debug_verify_cached_snaps true 2024-09-21T06:28:18.600 INFO:teuthology.orchestra.run.smithi007.stdout:osd dev osd_debug_verify_missing_on_start true 2024-09-21T06:28:18.600 INFO:teuthology.orchestra.run.smithi007.stdout:osd dev osd_debug_verify_stray_on_activate true 2024-09-21T06:28:18.600 INFO:teuthology.orchestra.run.smithi007.stdout:osd advanced osd_deep_scrub_update_digest_min_age 30 2024-09-21T06:28:18.600 INFO:teuthology.orchestra.run.smithi007.stdout:osd advanced osd_failsafe_full_ratio 0.950000 2024-09-21T06:28:18.600 INFO:teuthology.orchestra.run.smithi007.stdout:osd advanced osd_max_omap_entries_per_request 10 2024-09-21T06:28:18.601 INFO:teuthology.orchestra.run.smithi007.stdout:osd advanced osd_mclock_profile high_recovery_ops 2024-09-21T06:28:18.601 INFO:teuthology.orchestra.run.smithi007.stdout:osd advanced osd_memory_target_autotune true 2024-09-21T06:28:18.601 INFO:teuthology.orchestra.run.smithi007.stdout:osd advanced osd_objectstore bluestore * 2024-09-21T06:28:18.601 INFO:teuthology.orchestra.run.smithi007.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-21T06:28:18.601 INFO:teuthology.orchestra.run.smithi007.stdout:osd advanced osd_op_queue debug_random * 2024-09-21T06:28:18.601 INFO:teuthology.orchestra.run.smithi007.stdout:osd advanced osd_op_queue_cut_off debug_random * 2024-09-21T06:28:18.601 INFO:teuthology.orchestra.run.smithi007.stdout:osd advanced osd_recover_clone_overlap true 2024-09-21T06:28:18.601 INFO:teuthology.orchestra.run.smithi007.stdout:osd advanced osd_recovery_max_chunk 1048576 2024-09-21T06:28:18.601 INFO:teuthology.orchestra.run.smithi007.stdout:osd advanced osd_scrub_load_threshold 5.000000 2024-09-21T06:28:18.601 INFO:teuthology.orchestra.run.smithi007.stdout:osd advanced osd_scrub_max_interval 600.000000 2024-09-21T06:28:18.601 INFO:teuthology.orchestra.run.smithi007.stdout:osd advanced osd_shutdown_pgref_assert true 2024-09-21T06:28:18.601 INFO:teuthology.orchestra.run.smithi007.stdout:mds advanced debug_mds 20/20 2024-09-21T06:28:18.602 INFO:teuthology.orchestra.run.smithi007.stdout:mds advanced debug_mds_balancer 20/20 2024-09-21T06:28:18.602 INFO:teuthology.orchestra.run.smithi007.stdout:mds advanced debug_ms 2/2 2024-09-21T06:28:18.602 INFO:teuthology.orchestra.run.smithi007.stdout:mds advanced mds_bal_fragment_size_max 10000 2024-09-21T06:28:18.602 INFO:teuthology.orchestra.run.smithi007.stdout:mds advanced mds_bal_merge_size 5 2024-09-21T06:28:18.602 INFO:teuthology.orchestra.run.smithi007.stdout:mds advanced mds_bal_replicate_threshold 1.000000 2024-09-21T06:28:18.602 INFO:teuthology.orchestra.run.smithi007.stdout:mds advanced mds_bal_split_bits 3 2024-09-21T06:28:18.602 INFO:teuthology.orchestra.run.smithi007.stdout:mds advanced mds_bal_split_size 100 2024-09-21T06:28:18.602 INFO:teuthology.orchestra.run.smithi007.stdout:mds dev mds_debug_frag true 2024-09-21T06:28:18.602 INFO:teuthology.orchestra.run.smithi007.stdout:mds dev mds_debug_scatterstat true 2024-09-21T06:28:18.602 INFO:teuthology.orchestra.run.smithi007.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-21T06:28:18.602 INFO:teuthology.orchestra.run.smithi007.stdout:mds dev mds_verify_scatter true 2024-09-21T06:28:18.602 INFO:teuthology.orchestra.run.smithi007.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-21T06:28:18.603 INFO:teuthology.orchestra.run.smithi007.stdout:mds advanced rados_mon_op_timeout 900 2024-09-21T06:28:18.603 INFO:teuthology.orchestra.run.smithi007.stdout:mds advanced rados_osd_op_timeout 900 2024-09-21T06:28:18.603 INFO:teuthology.orchestra.run.smithi007.stdout:client advanced client_mount_timeout 600 2024-09-21T06:28:18.603 INFO:teuthology.orchestra.run.smithi007.stdout:client advanced debug_client 20/20 2024-09-21T06:28:18.603 INFO:teuthology.orchestra.run.smithi007.stdout:client advanced debug_ms 1/1 2024-09-21T06:28:18.603 INFO:teuthology.orchestra.run.smithi007.stdout:client advanced rados_mon_op_timeout 900 2024-09-21T06:28:18.603 INFO:teuthology.orchestra.run.smithi007.stdout:client advanced rados_osd_op_timeout 900 2024-09-21T06:28:18.603 INFO:teuthology.orchestra.run.smithi007.stdout:client.rgw advanced rgw_cache_enabled true 2024-09-21T06:28:18.603 INFO:teuthology.orchestra.run.smithi007.stdout:client.rgw advanced rgw_enable_ops_log true 2024-09-21T06:28:18.603 INFO:teuthology.orchestra.run.smithi007.stdout:client.rgw advanced rgw_enable_usage_log true 2024-09-21T06:28:18.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:18.594+0000 7fee939db640 1 -- 172.21.15.7:0/617768539 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fee780b65d0 msgr2=0x7fee780b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:18.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:18.594+0000 7fee939db640 1 --2- 172.21.15.7:0/617768539 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fee780b65d0 0x7fee780b8ae0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fee8c104280 tx=0x7fee8800b410 comp rx=0 tx=0).stop 2024-09-21T06:28:18.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:18.594+0000 7fee939db640 1 -- 172.21.15.7:0/617768539 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee8c10ded0 msgr2=0x7fee8c1032b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:18.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:18.594+0000 7fee939db640 1 --2- 172.21.15.7:0/617768539 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee8c10ded0 0x7fee8c1032b0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fee8400eaa0 tx=0x7fee8400ef60 comp rx=0 tx=0).stop 2024-09-21T06:28:18.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:18.594+0000 7fee939db640 1 -- 172.21.15.7:0/617768539 shutdown_connections 2024-09-21T06:28:18.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:18.594+0000 7fee939db640 1 --2- 172.21.15.7:0/617768539 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fee780b65d0 0x7fee780b8ae0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:18.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:18.594+0000 7fee939db640 1 --2- 172.21.15.7:0/617768539 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee8c10ded0 0x7fee8c1032b0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:18.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:18.594+0000 7fee939db640 1 --2- 172.21.15.7:0/617768539 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee8c105350 0x7fee8c102d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:18.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:18.594+0000 7fee939db640 1 --2- 172.21.15.7:0/617768539 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee8c104920 0x7fee8c102830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:18.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:18.594+0000 7fee939db640 1 -- 172.21.15.7:0/617768539 >> 172.21.15.7:0/617768539 conn(0x7fee8c079770 msgr2=0x7fee8c106910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:18.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:18.594+0000 7fee939db640 1 -- 172.21.15.7:0/617768539 shutdown_connections 2024-09-21T06:28:18.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:18.594+0000 7fee939db640 1 -- 172.21.15.7:0/617768539 wait complete. 2024-09-21T06:28:19.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:18 smithi018 ceph-mon[34477]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:19.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:18 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/617768539' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2024-09-21T06:28:19.249 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:18 smithi007 ceph-mon[30983]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:19.249 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:18 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/617768539' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2024-09-21T06:28:19.278 INFO:tasks.cephadm:Deploying OSDs... 2024-09-21T06:28:19.278 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-21T06:28:19.279 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T06:28:19.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:18 smithi144 ceph-mon[34653]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:19.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:18 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/617768539' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2024-09-21T06:28:19.296 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T06:28:19.296 DEBUG:teuthology.orchestra.run.smithi007:> stat /dev/vg_nvme/lv_1 2024-09-21T06:28:19.352 INFO:teuthology.orchestra.run.smithi007.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T06:28:19.352 INFO:teuthology.orchestra.run.smithi007.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:28:19.352 INFO:teuthology.orchestra.run.smithi007.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-21T06:28:19.352 INFO:teuthology.orchestra.run.smithi007.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:28:19.352 INFO:teuthology.orchestra.run.smithi007.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:28:19.352 INFO:teuthology.orchestra.run.smithi007.stdout:Access: 2024-09-21 06:26:55.205380523 +0000 2024-09-21T06:28:19.352 INFO:teuthology.orchestra.run.smithi007.stdout:Modify: 2024-09-21 06:22:15.363946938 +0000 2024-09-21T06:28:19.352 INFO:teuthology.orchestra.run.smithi007.stdout:Change: 2024-09-21 06:22:15.363946938 +0000 2024-09-21T06:28:19.352 INFO:teuthology.orchestra.run.smithi007.stdout: Birth: 2024-09-21 06:22:15.363946938 +0000 2024-09-21T06:28:19.353 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T06:28:19.418 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records in 2024-09-21T06:28:19.418 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records out 2024-09-21T06:28:19.418 INFO:teuthology.orchestra.run.smithi007.stderr:512 bytes copied, 0.000113207 s, 4.5 MB/s 2024-09-21T06:28:19.419 DEBUG:teuthology.orchestra.run.smithi007:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T06:28:19.476 DEBUG:teuthology.orchestra.run.smithi007:> stat /dev/vg_nvme/lv_2 2024-09-21T06:28:19.533 INFO:teuthology.orchestra.run.smithi007.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T06:28:19.533 INFO:teuthology.orchestra.run.smithi007.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:28:19.533 INFO:teuthology.orchestra.run.smithi007.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-21T06:28:19.533 INFO:teuthology.orchestra.run.smithi007.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:28:19.534 INFO:teuthology.orchestra.run.smithi007.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:28:19.534 INFO:teuthology.orchestra.run.smithi007.stdout:Access: 2024-09-21 06:26:55.237380044 +0000 2024-09-21T06:28:19.534 INFO:teuthology.orchestra.run.smithi007.stdout:Modify: 2024-09-21 06:22:15.681942213 +0000 2024-09-21T06:28:19.534 INFO:teuthology.orchestra.run.smithi007.stdout:Change: 2024-09-21 06:22:15.681942213 +0000 2024-09-21T06:28:19.534 INFO:teuthology.orchestra.run.smithi007.stdout: Birth: 2024-09-21 06:22:15.681942213 +0000 2024-09-21T06:28:19.535 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T06:28:19.597 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records in 2024-09-21T06:28:19.597 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records out 2024-09-21T06:28:19.598 INFO:teuthology.orchestra.run.smithi007.stderr:512 bytes copied, 9.237e-05 s, 5.5 MB/s 2024-09-21T06:28:19.599 DEBUG:teuthology.orchestra.run.smithi007:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T06:28:19.655 DEBUG:teuthology.orchestra.run.smithi007:> stat /dev/vg_nvme/lv_3 2024-09-21T06:28:19.711 INFO:teuthology.orchestra.run.smithi007.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T06:28:19.711 INFO:teuthology.orchestra.run.smithi007.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:28:19.711 INFO:teuthology.orchestra.run.smithi007.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-21T06:28:19.711 INFO:teuthology.orchestra.run.smithi007.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:28:19.711 INFO:teuthology.orchestra.run.smithi007.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:28:19.712 INFO:teuthology.orchestra.run.smithi007.stdout:Access: 2024-09-21 06:26:55.269379564 +0000 2024-09-21T06:28:19.712 INFO:teuthology.orchestra.run.smithi007.stdout:Modify: 2024-09-21 06:22:16.031937013 +0000 2024-09-21T06:28:19.712 INFO:teuthology.orchestra.run.smithi007.stdout:Change: 2024-09-21 06:22:16.031937013 +0000 2024-09-21T06:28:19.712 INFO:teuthology.orchestra.run.smithi007.stdout: Birth: 2024-09-21 06:22:16.031937013 +0000 2024-09-21T06:28:19.712 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T06:28:19.776 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records in 2024-09-21T06:28:19.776 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records out 2024-09-21T06:28:19.776 INFO:teuthology.orchestra.run.smithi007.stderr:512 bytes copied, 0.000110573 s, 4.6 MB/s 2024-09-21T06:28:19.778 DEBUG:teuthology.orchestra.run.smithi007:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T06:28:19.834 DEBUG:teuthology.orchestra.run.smithi007:> stat /dev/vg_nvme/lv_4 2024-09-21T06:28:19.891 INFO:teuthology.orchestra.run.smithi007.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T06:28:19.892 INFO:teuthology.orchestra.run.smithi007.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:28:19.892 INFO:teuthology.orchestra.run.smithi007.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-21T06:28:19.892 INFO:teuthology.orchestra.run.smithi007.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:28:19.892 INFO:teuthology.orchestra.run.smithi007.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:28:19.892 INFO:teuthology.orchestra.run.smithi007.stdout:Access: 2024-09-21 06:26:55.300379100 +0000 2024-09-21T06:28:19.892 INFO:teuthology.orchestra.run.smithi007.stdout:Modify: 2024-09-21 06:22:16.356932184 +0000 2024-09-21T06:28:19.892 INFO:teuthology.orchestra.run.smithi007.stdout:Change: 2024-09-21 06:22:16.356932184 +0000 2024-09-21T06:28:19.892 INFO:teuthology.orchestra.run.smithi007.stdout: Birth: 2024-09-21 06:22:16.356932184 +0000 2024-09-21T06:28:19.893 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T06:28:19.955 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records in 2024-09-21T06:28:19.956 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records out 2024-09-21T06:28:19.956 INFO:teuthology.orchestra.run.smithi007.stderr:512 bytes copied, 9.3037e-05 s, 5.5 MB/s 2024-09-21T06:28:19.957 DEBUG:teuthology.orchestra.run.smithi007:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T06:28:20.013 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-21T06:28:20.013 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T06:28:20.032 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T06:28:20.033 DEBUG:teuthology.orchestra.run.smithi018:> stat /dev/vg_nvme/lv_1 2024-09-21T06:28:20.091 INFO:teuthology.orchestra.run.smithi018.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T06:28:20.091 INFO:teuthology.orchestra.run.smithi018.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:28:20.091 INFO:teuthology.orchestra.run.smithi018.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-09-21T06:28:20.091 INFO:teuthology.orchestra.run.smithi018.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:28:20.091 INFO:teuthology.orchestra.run.smithi018.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:28:20.091 INFO:teuthology.orchestra.run.smithi018.stdout:Access: 2024-09-21 06:27:51.343355470 +0000 2024-09-21T06:28:20.091 INFO:teuthology.orchestra.run.smithi018.stdout:Modify: 2024-09-21 06:22:39.986036289 +0000 2024-09-21T06:28:20.091 INFO:teuthology.orchestra.run.smithi018.stdout:Change: 2024-09-21 06:22:39.986036289 +0000 2024-09-21T06:28:20.091 INFO:teuthology.orchestra.run.smithi018.stdout: Birth: 2024-09-21 06:22:39.986036289 +0000 2024-09-21T06:28:20.092 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T06:28:20.160 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records in 2024-09-21T06:28:20.160 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records out 2024-09-21T06:28:20.160 INFO:teuthology.orchestra.run.smithi018.stderr:512 bytes copied, 0.00011129 s, 4.6 MB/s 2024-09-21T06:28:20.161 DEBUG:teuthology.orchestra.run.smithi018:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T06:28:20.220 DEBUG:teuthology.orchestra.run.smithi018:> stat /dev/vg_nvme/lv_2 2024-09-21T06:28:20.278 INFO:teuthology.orchestra.run.smithi018.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T06:28:20.278 INFO:teuthology.orchestra.run.smithi018.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:28:20.278 INFO:teuthology.orchestra.run.smithi018.stdout:Device: 5h/5d Inode: 682 Links: 1 2024-09-21T06:28:20.278 INFO:teuthology.orchestra.run.smithi018.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:28:20.278 INFO:teuthology.orchestra.run.smithi018.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:28:20.278 INFO:teuthology.orchestra.run.smithi018.stdout:Access: 2024-09-21 06:27:51.343355470 +0000 2024-09-21T06:28:20.279 INFO:teuthology.orchestra.run.smithi018.stdout:Modify: 2024-09-21 06:22:40.309032405 +0000 2024-09-21T06:28:20.279 INFO:teuthology.orchestra.run.smithi018.stdout:Change: 2024-09-21 06:22:40.309032405 +0000 2024-09-21T06:28:20.279 INFO:teuthology.orchestra.run.smithi018.stdout: Birth: 2024-09-21 06:22:40.309032405 +0000 2024-09-21T06:28:20.279 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T06:28:20.343 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records in 2024-09-21T06:28:20.343 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records out 2024-09-21T06:28:20.343 INFO:teuthology.orchestra.run.smithi018.stderr:512 bytes copied, 0.000118378 s, 4.3 MB/s 2024-09-21T06:28:20.345 DEBUG:teuthology.orchestra.run.smithi018:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T06:28:20.403 DEBUG:teuthology.orchestra.run.smithi018:> stat /dev/vg_nvme/lv_3 2024-09-21T06:28:20.459 INFO:teuthology.orchestra.run.smithi018.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T06:28:20.459 INFO:teuthology.orchestra.run.smithi018.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:28:20.459 INFO:teuthology.orchestra.run.smithi018.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-21T06:28:20.459 INFO:teuthology.orchestra.run.smithi018.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:28:20.459 INFO:teuthology.orchestra.run.smithi018.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:28:20.459 INFO:teuthology.orchestra.run.smithi018.stdout:Access: 2024-09-21 06:27:51.344355458 +0000 2024-09-21T06:28:20.459 INFO:teuthology.orchestra.run.smithi018.stdout:Modify: 2024-09-21 06:22:40.637028460 +0000 2024-09-21T06:28:20.460 INFO:teuthology.orchestra.run.smithi018.stdout:Change: 2024-09-21 06:22:40.637028460 +0000 2024-09-21T06:28:20.460 INFO:teuthology.orchestra.run.smithi018.stdout: Birth: 2024-09-21 06:22:40.637028460 +0000 2024-09-21T06:28:20.460 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T06:28:20.523 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records in 2024-09-21T06:28:20.523 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records out 2024-09-21T06:28:20.523 INFO:teuthology.orchestra.run.smithi018.stderr:512 bytes copied, 0.000101947 s, 5.0 MB/s 2024-09-21T06:28:20.524 DEBUG:teuthology.orchestra.run.smithi018:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T06:28:20.582 DEBUG:teuthology.orchestra.run.smithi018:> stat /dev/vg_nvme/lv_4 2024-09-21T06:28:20.637 INFO:teuthology.orchestra.run.smithi018.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T06:28:20.638 INFO:teuthology.orchestra.run.smithi018.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:28:20.638 INFO:teuthology.orchestra.run.smithi018.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-21T06:28:20.638 INFO:teuthology.orchestra.run.smithi018.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:28:20.638 INFO:teuthology.orchestra.run.smithi018.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:28:20.638 INFO:teuthology.orchestra.run.smithi018.stdout:Access: 2024-09-21 06:27:51.344355458 +0000 2024-09-21T06:28:20.638 INFO:teuthology.orchestra.run.smithi018.stdout:Modify: 2024-09-21 06:22:40.960024575 +0000 2024-09-21T06:28:20.638 INFO:teuthology.orchestra.run.smithi018.stdout:Change: 2024-09-21 06:22:40.960024575 +0000 2024-09-21T06:28:20.638 INFO:teuthology.orchestra.run.smithi018.stdout: Birth: 2024-09-21 06:22:40.960024575 +0000 2024-09-21T06:28:20.638 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T06:28:20.702 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records in 2024-09-21T06:28:20.702 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records out 2024-09-21T06:28:20.702 INFO:teuthology.orchestra.run.smithi018.stderr:512 bytes copied, 9.5477e-05 s, 5.4 MB/s 2024-09-21T06:28:20.703 DEBUG:teuthology.orchestra.run.smithi018:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T06:28:20.759 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-09-21T06:28:20.760 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T06:28:20.780 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T06:28:20.780 DEBUG:teuthology.orchestra.run.smithi144:> stat /dev/vg_nvme/lv_1 2024-09-21T06:28:20.838 INFO:teuthology.orchestra.run.smithi144.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T06:28:20.838 INFO:teuthology.orchestra.run.smithi144.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:28:20.838 INFO:teuthology.orchestra.run.smithi144.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-21T06:28:20.838 INFO:teuthology.orchestra.run.smithi144.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:28:20.838 INFO:teuthology.orchestra.run.smithi144.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:28:20.838 INFO:teuthology.orchestra.run.smithi144.stdout:Access: 2024-09-21 06:27:48.843175481 +0000 2024-09-21T06:28:20.838 INFO:teuthology.orchestra.run.smithi144.stdout:Modify: 2024-09-21 06:22:36.277761439 +0000 2024-09-21T06:28:20.838 INFO:teuthology.orchestra.run.smithi144.stdout:Change: 2024-09-21 06:22:36.277761439 +0000 2024-09-21T06:28:20.839 INFO:teuthology.orchestra.run.smithi144.stdout: Birth: 2024-09-21 06:22:36.277761439 +0000 2024-09-21T06:28:20.839 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T06:28:20.908 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-21T06:28:20.908 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-21T06:28:20.908 INFO:teuthology.orchestra.run.smithi144.stderr:512 bytes copied, 0.000292828 s, 1.7 MB/s 2024-09-21T06:28:20.910 DEBUG:teuthology.orchestra.run.smithi144:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T06:28:20.968 DEBUG:teuthology.orchestra.run.smithi144:> stat /dev/vg_nvme/lv_2 2024-09-21T06:28:21.026 INFO:teuthology.orchestra.run.smithi144.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T06:28:21.026 INFO:teuthology.orchestra.run.smithi144.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:28:21.026 INFO:teuthology.orchestra.run.smithi144.stdout:Device: 5h/5d Inode: 682 Links: 1 2024-09-21T06:28:21.026 INFO:teuthology.orchestra.run.smithi144.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:28:21.026 INFO:teuthology.orchestra.run.smithi144.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:28:21.026 INFO:teuthology.orchestra.run.smithi144.stdout:Access: 2024-09-21 06:27:48.844175465 +0000 2024-09-21T06:28:21.026 INFO:teuthology.orchestra.run.smithi144.stdout:Modify: 2024-09-21 06:22:36.610755800 +0000 2024-09-21T06:28:21.026 INFO:teuthology.orchestra.run.smithi144.stdout:Change: 2024-09-21 06:22:36.610755800 +0000 2024-09-21T06:28:21.026 INFO:teuthology.orchestra.run.smithi144.stdout: Birth: 2024-09-21 06:22:36.610755800 +0000 2024-09-21T06:28:21.027 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T06:28:21.091 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-21T06:28:21.091 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-21T06:28:21.091 INFO:teuthology.orchestra.run.smithi144.stderr:512 bytes copied, 0.000197578 s, 2.6 MB/s 2024-09-21T06:28:21.092 DEBUG:teuthology.orchestra.run.smithi144:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T06:28:21.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:20 smithi018 ceph-mon[34477]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:21.150 DEBUG:teuthology.orchestra.run.smithi144:> stat /dev/vg_nvme/lv_3 2024-09-21T06:28:21.207 INFO:teuthology.orchestra.run.smithi144.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T06:28:21.207 INFO:teuthology.orchestra.run.smithi144.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:28:21.207 INFO:teuthology.orchestra.run.smithi144.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-21T06:28:21.207 INFO:teuthology.orchestra.run.smithi144.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:28:21.207 INFO:teuthology.orchestra.run.smithi144.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:28:21.208 INFO:teuthology.orchestra.run.smithi144.stdout:Access: 2024-09-21 06:27:48.844175465 +0000 2024-09-21T06:28:21.208 INFO:teuthology.orchestra.run.smithi144.stdout:Modify: 2024-09-21 06:22:36.939750229 +0000 2024-09-21T06:28:21.208 INFO:teuthology.orchestra.run.smithi144.stdout:Change: 2024-09-21 06:22:36.939750229 +0000 2024-09-21T06:28:21.208 INFO:teuthology.orchestra.run.smithi144.stdout: Birth: 2024-09-21 06:22:36.939750229 +0000 2024-09-21T06:28:21.208 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T06:28:21.271 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:20 smithi144 ceph-mon[34653]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:21.274 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-21T06:28:21.274 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-21T06:28:21.274 INFO:teuthology.orchestra.run.smithi144.stderr:512 bytes copied, 0.000281384 s, 1.8 MB/s 2024-09-21T06:28:21.275 DEBUG:teuthology.orchestra.run.smithi144:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T06:28:21.333 DEBUG:teuthology.orchestra.run.smithi144:> stat /dev/vg_nvme/lv_4 2024-09-21T06:28:21.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:20 smithi007 ceph-mon[30983]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:21.390 INFO:teuthology.orchestra.run.smithi144.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T06:28:21.390 INFO:teuthology.orchestra.run.smithi144.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T06:28:21.390 INFO:teuthology.orchestra.run.smithi144.stdout:Device: 5h/5d Inode: 720 Links: 1 2024-09-21T06:28:21.390 INFO:teuthology.orchestra.run.smithi144.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:28:21.390 INFO:teuthology.orchestra.run.smithi144.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T06:28:21.390 INFO:teuthology.orchestra.run.smithi144.stdout:Access: 2024-09-21 06:27:48.844175465 +0000 2024-09-21T06:28:21.390 INFO:teuthology.orchestra.run.smithi144.stdout:Modify: 2024-09-21 06:22:37.257744844 +0000 2024-09-21T06:28:21.391 INFO:teuthology.orchestra.run.smithi144.stdout:Change: 2024-09-21 06:22:37.257744844 +0000 2024-09-21T06:28:21.391 INFO:teuthology.orchestra.run.smithi144.stdout: Birth: 2024-09-21 06:22:37.257744844 +0000 2024-09-21T06:28:21.391 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T06:28:21.455 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-09-21T06:28:21.456 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-09-21T06:28:21.456 INFO:teuthology.orchestra.run.smithi144.stderr:512 bytes copied, 0.000207131 s, 2.5 MB/s 2024-09-21T06:28:21.457 DEBUG:teuthology.orchestra.run.smithi144:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T06:28:21.515 INFO:tasks.cephadm:Deploying osd.0 on smithi007 with /dev/vg_nvme/lv_4... 2024-09-21T06:28:21.515 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T06:28:21.781 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:28:23.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:22 smithi007 ceph-mon[30983]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:23.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:22 smithi018 ceph-mon[34477]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:23.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:22 smithi144 ceph-mon[34653]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:24.165 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:28:24.191 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi007:vg_nvme/lv_4 2024-09-21T06:28:24.448 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:28:24.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:24.961+0000 7f722c4f8640 1 -- 172.21.15.7:0/3963815996 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7224109e10 msgr2=0x7f7224110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:24.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:24.961+0000 7f722c4f8640 1 --2- 172.21.15.7:0/3963815996 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7224109e10 0x7f7224110640 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f721c009ca0 tx=0x7f721c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:28:24.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:24.961+0000 7f722c4f8640 1 -- 172.21.15.7:0/3963815996 shutdown_connections 2024-09-21T06:28:24.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:24.961+0000 7f722c4f8640 1 --2- 172.21.15.7:0/3963815996 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7224109e10 0x7f7224110640 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:24.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:24.961+0000 7f722c4f8640 1 --2- 172.21.15.7:0/3963815996 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72241094c0 0x7f72241098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:24.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:24.961+0000 7f722c4f8640 1 --2- 172.21.15.7:0/3963815996 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7224103b80 0x7f7224103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:24.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:24.961+0000 7f722c4f8640 1 -- 172.21.15.7:0/3963815996 >> 172.21.15.7:0/3963815996 conn(0x7f72240ff610 msgr2=0x7f7224101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:24.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:24.961+0000 7f722c4f8640 1 -- 172.21.15.7:0/3963815996 shutdown_connections 2024-09-21T06:28:24.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:24.961+0000 7f722c4f8640 1 -- 172.21.15.7:0/3963815996 wait complete. 2024-09-21T06:28:24.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:24.962+0000 7f722c4f8640 1 Processor -- start 2024-09-21T06:28:24.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:24.962+0000 7f722c4f8640 1 -- start start 2024-09-21T06:28:24.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:24.962+0000 7f722c4f8640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7224103b80 0x7f722419a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:24.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:24.962+0000 7f722c4f8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72241094c0 0x7f722419aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:24.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:24.963+0000 7f722c4f8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7224109e10 0x7f722419fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:24.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:24.963+0000 7f722c4f8640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7224113ad0 con 0x7f7224109e10 2024-09-21T06:28:24.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:24.963+0000 7f722c4f8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7224113950 con 0x7f72241094c0 2024-09-21T06:28:24.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:24.963+0000 7f722c4f8640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7224113c50 con 0x7f7224103b80 2024-09-21T06:28:24.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:24.963+0000 7f722aa95640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7224109e10 0x7f722419fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:24.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:24.963+0000 7f722aa95640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7224109e10 0x7f722419fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57386/0 (socket says 172.21.15.7:57386) 2024-09-21T06:28:24.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:24.963+0000 7f722aa95640 1 -- 172.21.15.7:0/3777789444 learned_addr learned my addr 172.21.15.7:0/3777789444 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:28:24.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:24.963+0000 7f722a294640 1 --2- 172.21.15.7:0/3777789444 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7224103b80 0x7f722419a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:24.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:24.963+0000 7f7229a93640 1 --2- 172.21.15.7:0/3777789444 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72241094c0 0x7f722419aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:24.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:24.963+0000 7f722aa95640 1 -- 172.21.15.7:0/3777789444 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7224103b80 msgr2=0x7f722419a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:24.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:24.963+0000 7f722aa95640 1 --2- 172.21.15.7:0/3777789444 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7224103b80 0x7f722419a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:24.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:24.963+0000 7f722aa95640 1 -- 172.21.15.7:0/3777789444 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72241094c0 msgr2=0x7f722419aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:24.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:24.963+0000 7f722aa95640 1 --2- 172.21.15.7:0/3777789444 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72241094c0 0x7f722419aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:24.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:24.963+0000 7f722aa95640 1 -- 172.21.15.7:0/3777789444 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72241a0470 con 0x7f7224109e10 2024-09-21T06:28:24.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:24.963+0000 7f722a294640 1 --2- 172.21.15.7:0/3777789444 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7224103b80 0x7f722419a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:28:24.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:24.963+0000 7f7229a93640 1 --2- 172.21.15.7:0/3777789444 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72241094c0 0x7f722419aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:28:24.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:24.963+0000 7f722aa95640 1 --2- 172.21.15.7:0/3777789444 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7224109e10 0x7f722419fd40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f721c0098d0 tx=0x7f721c0317b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:24.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:24.963+0000 7f721b7fe640 1 -- 172.21.15.7:0/3777789444 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f721c003b70 con 0x7f7224109e10 2024-09-21T06:28:24.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:24.963+0000 7f721b7fe640 1 -- 172.21.15.7:0/3777789444 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f721c003d10 con 0x7f7224109e10 2024-09-21T06:28:24.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:24.963+0000 7f721b7fe640 1 -- 172.21.15.7:0/3777789444 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f721c02fa20 con 0x7f7224109e10 2024-09-21T06:28:24.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:24.964+0000 7f722c4f8640 1 -- 172.21.15.7:0/3777789444 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72241a0700 con 0x7f7224109e10 2024-09-21T06:28:24.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:24.964+0000 7f722c4f8640 1 -- 172.21.15.7:0/3777789444 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72241a6ec0 con 0x7f7224109e10 2024-09-21T06:28:24.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:24.965+0000 7f722c4f8640 1 -- 172.21.15.7:0/3777789444 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7224104e00 con 0x7f7224109e10 2024-09-21T06:28:24.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:24.966+0000 7f721b7fe640 1 -- 172.21.15.7:0/3777789444 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 154472+0+0 (secure 0 0 0) 0x7f721c02fbe0 con 0x7f7224109e10 2024-09-21T06:28:24.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:24.967+0000 7f721b7fe640 1 --2- 172.21.15.7:0/3777789444 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f72100b6550 0x7f72100b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:24.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:24.967+0000 7f722a294640 1 --2- 172.21.15.7:0/3777789444 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f72100b6550 0x7f72100b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:24.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:24.967+0000 7f721b7fe640 1 -- 172.21.15.7:0/3777789444 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f721c106d60 con 0x7f7224109e10 2024-09-21T06:28:24.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:24.968+0000 7f722a294640 1 --2- 172.21.15.7:0/3777789444 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f72100b6550 0x7f72100b8a60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7220009c20 tx=0x7f7220005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:24.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:24.970+0000 7f721b7fe640 1 -- 172.21.15.7:0/3777789444 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f721c0cf1f0 con 0x7f7224109e10 2024-09-21T06:28:25.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:25.168+0000 7f722c4f8640 1 -- 172.21.15.7:0/3777789444 --> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f7224063800 con 0x7f72100b6550 2024-09-21T06:28:25.171 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:24 smithi007 ceph-mon[30983]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:25.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:24 smithi144 ceph-mon[34653]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:25.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:24 smithi018 ceph-mon[34477]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:26.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:25 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:28:26.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:25 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:28:26.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:25 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:28:26.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:25 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:28:26.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:25 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:28:26.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:25 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:28:26.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:25 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:28:26.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:25 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:28:26.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:25 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:28:27.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:26 smithi007 ceph-mon[30983]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:27.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:26 smithi007 ceph-mon[30983]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:28:27.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:26 smithi144 ceph-mon[34653]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:27.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:26 smithi144 ceph-mon[34653]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:28:27.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:26 smithi018 ceph-mon[34477]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:27.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:26 smithi018 ceph-mon[34477]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:28:28.066 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:27 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2071852247' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1be5c4a4-3931-4d8b-95c7-c05f5b73fcfb"} : dispatch 2024-09-21T06:28:28.066 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:27 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2071852247' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1be5c4a4-3931-4d8b-95c7-c05f5b73fcfb"}]': finished 2024-09-21T06:28:28.066 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:27 smithi007 ceph-mon[30983]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T06:28:28.066 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:27 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:28:28.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:27 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/2071852247' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1be5c4a4-3931-4d8b-95c7-c05f5b73fcfb"} : dispatch 2024-09-21T06:28:28.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:27 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/2071852247' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1be5c4a4-3931-4d8b-95c7-c05f5b73fcfb"}]': finished 2024-09-21T06:28:28.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:27 smithi144 ceph-mon[34653]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T06:28:28.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:27 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:28:28.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:27 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/2071852247' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1be5c4a4-3931-4d8b-95c7-c05f5b73fcfb"} : dispatch 2024-09-21T06:28:28.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:27 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/2071852247' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1be5c4a4-3931-4d8b-95c7-c05f5b73fcfb"}]': finished 2024-09-21T06:28:28.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:27 smithi018 ceph-mon[34477]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T06:28:28.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:27 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:28:29.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:28 smithi144 ceph-mon[34653]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:29.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:28 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/4098559456' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:28:29.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:28 smithi007 ceph-mon[30983]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:29.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:28 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/4098559456' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:28:29.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:28 smithi018 ceph-mon[34477]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:29.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:28 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/4098559456' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:28:31.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:30 smithi144 ceph-mon[34653]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:31.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:30 smithi007 ceph-mon[30983]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:31.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:30 smithi018 ceph-mon[34477]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:33.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:32 smithi007 ceph-mon[30983]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:33.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:32 smithi144 ceph-mon[34653]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:33.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:32 smithi018 ceph-mon[34477]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:34.981 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:34 smithi007 ceph-mon[30983]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:35.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:34 smithi144 ceph-mon[34653]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:35.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:34 smithi018 ceph-mon[34477]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:36.129 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:35 smithi007 ceph-mon[30983]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:36.129 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:35 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T06:28:36.129 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:35 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:28:36.129 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:35 smithi007 ceph-mon[30983]: Deploying daemon osd.0 on smithi007 2024-09-21T06:28:36.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:35 smithi144 ceph-mon[34653]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:36.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:35 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T06:28:36.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:35 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:28:36.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:35 smithi144 ceph-mon[34653]: Deploying daemon osd.0 on smithi007 2024-09-21T06:28:36.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:35 smithi018 ceph-mon[34477]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:36.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:35 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T06:28:36.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:35 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:28:36.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:35 smithi018 ceph-mon[34477]: Deploying daemon osd.0 on smithi007 2024-09-21T06:28:38.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:38 smithi018 ceph-mon[34477]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:38.524 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:38 smithi007 ceph-mon[30983]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:38.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:38 smithi144 ceph-mon[34653]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:40.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:40 smithi018 ceph-mon[34477]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:40.486 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:40 smithi007 ceph-mon[30983]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:40.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:40 smithi144 ceph-mon[34653]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:42.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:42 smithi007 ceph-mon[30983]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:42.341 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:42 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:28:42.341 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:42 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:28:42.341 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:42 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:28:42.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:42 smithi018 ceph-mon[34477]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:42.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:42 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:28:42.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:42 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:28:42.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:42 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:28:42.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:42 smithi144 ceph-mon[34653]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:42.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:42 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:28:42.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:42 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:28:42.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:42 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:28:44.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:44 smithi007 ceph-mon[30983]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:44.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:44 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:28:44.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:44 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:28:44.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:44 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:28:44.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:44 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:28:44.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:44 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:28:44.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:44 smithi144 ceph-mon[34653]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:44.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:44 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:28:44.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:44 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:28:44.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:44 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:28:44.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:44 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:28:44.536 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:44 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:28:44.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:44 smithi018 ceph-mon[34477]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:44.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:44 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:28:44.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:44 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:28:44.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:44 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:28:44.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:44 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:28:44.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:44 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:28:46.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:46.244+0000 7f721b7fe640 1 -- 172.21.15.7:0/3777789444 <== mgr.14223 v2:172.21.15.7:6800/3442812985 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f7224063800 con 0x7f72100b6550 2024-09-21T06:28:46.246 INFO:teuthology.orchestra.run.smithi007.stdout:Created osd(s) 0 on host 'smithi007' 2024-09-21T06:28:46.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:46.248+0000 7f722c4f8640 1 -- 172.21.15.7:0/3777789444 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f72100b6550 msgr2=0x7f72100b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:46.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:46.248+0000 7f722c4f8640 1 --2- 172.21.15.7:0/3777789444 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f72100b6550 0x7f72100b8a60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7220009c20 tx=0x7f7220005f90 comp rx=0 tx=0).stop 2024-09-21T06:28:46.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:46.248+0000 7f722c4f8640 1 -- 172.21.15.7:0/3777789444 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7224109e10 msgr2=0x7f722419fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:46.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:46.248+0000 7f722c4f8640 1 --2- 172.21.15.7:0/3777789444 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7224109e10 0x7f722419fd40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f721c0098d0 tx=0x7f721c0317b0 comp rx=0 tx=0).stop 2024-09-21T06:28:46.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:46.248+0000 7f722c4f8640 1 -- 172.21.15.7:0/3777789444 shutdown_connections 2024-09-21T06:28:46.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:46.248+0000 7f722c4f8640 1 --2- 172.21.15.7:0/3777789444 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f72100b6550 0x7f72100b8a60 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:46.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:46.248+0000 7f722c4f8640 1 --2- 172.21.15.7:0/3777789444 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7224109e10 0x7f722419fd40 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:46.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:46.248+0000 7f722c4f8640 1 --2- 172.21.15.7:0/3777789444 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72241094c0 0x7f722419aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:46.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:46.248+0000 7f722c4f8640 1 --2- 172.21.15.7:0/3777789444 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7224103b80 0x7f722419a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:46.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:46.248+0000 7f722c4f8640 1 -- 172.21.15.7:0/3777789444 >> 172.21.15.7:0/3777789444 conn(0x7f72240ff610 msgr2=0x7f7224106a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:46.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:46.248+0000 7f722c4f8640 1 -- 172.21.15.7:0/3777789444 shutdown_connections 2024-09-21T06:28:46.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:28:46.248+0000 7f722c4f8640 1 -- 172.21.15.7:0/3777789444 wait complete. 2024-09-21T06:28:46.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:46 smithi144 ceph-mon[34653]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:46.553 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:46 smithi007 ceph-mon[30983]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:46.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:46 smithi018 ceph-mon[34477]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:46.896 DEBUG:teuthology.orchestra.run.smithi007:osd.0> sudo journalctl -f -n 0 -u ceph-347cb918-77e2-11ef-baf5-efdc52797490@osd.0.service 2024-09-21T06:28:46.902 INFO:tasks.cephadm:Deploying osd.1 on smithi018 with /dev/vg_nvme/lv_4... 2024-09-21T06:28:46.902 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T06:28:47.146 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T06:28:47.266 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:47 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:28:47.266 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:47 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:28:47.266 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:47 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:28:47.413 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:47 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:28:47.413 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:47 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:28:47.413 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:47 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:28:47.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:47 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:28:47.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:47 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:28:47.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:47 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:28:48.121 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 21 06:28:47 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-0[47737]: 2024-09-21T06:28:47.859+0000 7ffb23727640 -1 osd.0 0 log_to_monitors true 2024-09-21T06:28:48.378 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:48 smithi007 ceph-mon[30983]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:48.378 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:48 smithi007 ceph-mon[30983]: from='osd.0 [v2:172.21.15.7:6802/942632794,v1:172.21.15.7:6803/942632794]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T06:28:48.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:48 smithi144 ceph-mon[34653]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:48.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:48 smithi144 ceph-mon[34653]: from='osd.0 [v2:172.21.15.7:6802/942632794,v1:172.21.15.7:6803/942632794]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T06:28:48.543 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:48 smithi018 ceph-mon[34477]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:48.543 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:48 smithi018 ceph-mon[34477]: from='osd.0 [v2:172.21.15.7:6802/942632794,v1:172.21.15.7:6803/942632794]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T06:28:49.477 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T06:28:49.504 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi018:vg_nvme/lv_4 2024-09-21T06:28:49.525 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:49 smithi018 ceph-mon[34477]: from='osd.0 [v2:172.21.15.7:6802/942632794,v1:172.21.15.7:6803/942632794]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T06:28:49.525 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:49 smithi018 ceph-mon[34477]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T06:28:49.525 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:49 smithi018 ceph-mon[34477]: from='osd.0 [v2:172.21.15.7:6802/942632794,v1:172.21.15.7:6803/942632794]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi007", "root=default"]} : dispatch 2024-09-21T06:28:49.525 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:49 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:28:49.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:49 smithi144 ceph-mon[34653]: from='osd.0 [v2:172.21.15.7:6802/942632794,v1:172.21.15.7:6803/942632794]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T06:28:49.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:49 smithi144 ceph-mon[34653]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T06:28:49.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:49 smithi144 ceph-mon[34653]: from='osd.0 [v2:172.21.15.7:6802/942632794,v1:172.21.15.7:6803/942632794]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi007", "root=default"]} : dispatch 2024-09-21T06:28:49.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:49 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:28:49.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:49 smithi007 ceph-mon[30983]: from='osd.0 [v2:172.21.15.7:6802/942632794,v1:172.21.15.7:6803/942632794]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T06:28:49.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:49 smithi007 ceph-mon[30983]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T06:28:49.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:49 smithi007 ceph-mon[30983]: from='osd.0 [v2:172.21.15.7:6802/942632794,v1:172.21.15.7:6803/942632794]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi007", "root=default"]} : dispatch 2024-09-21T06:28:49.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:49 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:28:49.590 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 21 06:28:49 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-0[47737]: 2024-09-21T06:28:49.259+0000 7ffb1f6a9640 -1 osd.0 0 waiting for initial osdmap 2024-09-21T06:28:49.590 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 21 06:28:49 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-0[47737]: 2024-09-21T06:28:49.263+0000 7ffb1b4a7640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T06:28:49.757 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T06:28:50.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:28:50.186+0000 7f6f360e1640 1 -- 172.21.15.18:0/2216701539 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f30108cf0 msgr2=0x7f6f3010f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:50.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:28:50.186+0000 7f6f360e1640 1 --2- 172.21.15.18:0/2216701539 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f30108cf0 0x7f6f3010f520 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6f28009ca0 tx=0x7f6f2802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:28:50.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:28:50.186+0000 7f6f360e1640 1 -- 172.21.15.18:0/2216701539 shutdown_connections 2024-09-21T06:28:50.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:28:50.186+0000 7f6f360e1640 1 --2- 172.21.15.18:0/2216701539 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f30108cf0 0x7f6f3010f520 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:50.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:28:50.186+0000 7f6f360e1640 1 --2- 172.21.15.18:0/2216701539 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6f301083a0 0x7f6f301087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:50.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:28:50.186+0000 7f6f360e1640 1 --2- 172.21.15.18:0/2216701539 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f30102a60 0x7f6f30102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:50.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:28:50.186+0000 7f6f360e1640 1 -- 172.21.15.18:0/2216701539 >> 172.21.15.18:0/2216701539 conn(0x7f6f30079730 msgr2=0x7f6f30079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:28:50.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:28:50.186+0000 7f6f360e1640 1 -- 172.21.15.18:0/2216701539 shutdown_connections 2024-09-21T06:28:50.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:28:50.186+0000 7f6f360e1640 1 -- 172.21.15.18:0/2216701539 wait complete. 2024-09-21T06:28:50.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:28:50.186+0000 7f6f360e1640 1 Processor -- start 2024-09-21T06:28:50.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:28:50.186+0000 7f6f360e1640 1 -- start start 2024-09-21T06:28:50.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:28:50.187+0000 7f6f360e1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f30102a60 0x7f6f3019a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:50.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:28:50.187+0000 7f6f360e1640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6f301083a0 0x7f6f3019a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:50.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:28:50.187+0000 7f6f360e1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f30108cf0 0x7f6f3019fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:50.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:28:50.187+0000 7f6f360e1640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6f30112960 con 0x7f6f30102a60 2024-09-21T06:28:50.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:28:50.187+0000 7f6f360e1640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6f301127e0 con 0x7f6f30108cf0 2024-09-21T06:28:50.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:28:50.187+0000 7f6f360e1640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6f30112ae0 con 0x7f6f301083a0 2024-09-21T06:28:50.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:28:50.187+0000 7f6f2ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f30108cf0 0x7f6f3019fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:50.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:28:50.187+0000 7f6f2ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f30108cf0 0x7f6f3019fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:35674/0 (socket says 172.21.15.18:35674) 2024-09-21T06:28:50.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:28:50.187+0000 7f6f2ffff640 1 -- 172.21.15.18:0/2260632590 learned_addr learned my addr 172.21.15.18:0/2260632590 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T06:28:50.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:28:50.187+0000 7f6f27fff640 1 --2- 172.21.15.18:0/2260632590 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6f301083a0 0x7f6f3019a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:50.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:28:50.187+0000 7f6f2f7fe640 1 --2- 172.21.15.18:0/2260632590 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f30102a60 0x7f6f3019a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:50.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:28:50.187+0000 7f6f2ffff640 1 -- 172.21.15.18:0/2260632590 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6f301083a0 msgr2=0x7f6f3019a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:50.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:28:50.187+0000 7f6f2ffff640 1 --2- 172.21.15.18:0/2260632590 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6f301083a0 0x7f6f3019a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:50.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:28:50.187+0000 7f6f2ffff640 1 -- 172.21.15.18:0/2260632590 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f30102a60 msgr2=0x7f6f3019a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:28:50.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:28:50.187+0000 7f6f2ffff640 1 --2- 172.21.15.18:0/2260632590 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f30102a60 0x7f6f3019a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:28:50.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:28:50.187+0000 7f6f2ffff640 1 -- 172.21.15.18:0/2260632590 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f301a03b0 con 0x7f6f30108cf0 2024-09-21T06:28:50.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:28:50.187+0000 7f6f2f7fe640 1 --2- 172.21.15.18:0/2260632590 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f30102a60 0x7f6f3019a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:28:50.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:28:50.187+0000 7f6f2ffff640 1 --2- 172.21.15.18:0/2260632590 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f30108cf0 0x7f6f3019fc80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6f280098d0 tx=0x7f6f280317b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:50.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:28:50.188+0000 7f6f2d7fa640 1 -- 172.21.15.18:0/2260632590 <== mon.2 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f28003b70 con 0x7f6f30108cf0 2024-09-21T06:28:50.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:28:50.188+0000 7f6f2d7fa640 1 -- 172.21.15.18:0/2260632590 <== mon.2 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6f28003d10 con 0x7f6f30108cf0 2024-09-21T06:28:50.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:28:50.188+0000 7f6f360e1640 1 -- 172.21.15.18:0/2260632590 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f301a0640 con 0x7f6f30108cf0 2024-09-21T06:28:50.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:28:50.188+0000 7f6f360e1640 1 -- 172.21.15.18:0/2260632590 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f301a6e00 con 0x7f6f30108cf0 2024-09-21T06:28:50.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:28:50.188+0000 7f6f2d7fa640 1 -- 172.21.15.18:0/2260632590 <== mon.2 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f2802fa20 con 0x7f6f30108cf0 2024-09-21T06:28:50.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:28:50.189+0000 7f6f360e1640 1 -- 172.21.15.18:0/2260632590 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f30102e70 con 0x7f6f30108cf0 2024-09-21T06:28:50.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:28:50.190+0000 7f6f2d7fa640 1 -- 172.21.15.18:0/2260632590 <== mon.2 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 20) ==== 154472+0+0 (secure 0 0 0) 0x7f6f2802fcc0 con 0x7f6f30108cf0 2024-09-21T06:28:50.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:28:50.191+0000 7f6f2d7fa640 1 --2- 172.21.15.18:0/2260632590 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f6f1c0b6550 0x7f6f1c0b8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:28:50.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:28:50.191+0000 7f6f2d7fa640 1 -- 172.21.15.18:0/2260632590 <== mon.2 v2:172.21.15.18:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1702+0+0 (secure 0 0 0) 0x7f6f28106c00 con 0x7f6f30108cf0 2024-09-21T06:28:50.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:28:50.191+0000 7f6f2f7fe640 1 --2- 172.21.15.18:0/2260632590 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f6f1c0b6550 0x7f6f1c0b8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:28:50.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:28:50.192+0000 7f6f2f7fe640 1 --2- 172.21.15.18:0/2260632590 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f6f1c0b6550 0x7f6f1c0b8a60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6f20009c20 tx=0x7f6f20005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:28:50.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:28:50.195+0000 7f6f2d7fa640 1 -- 172.21.15.18:0/2260632590 <== mon.2 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6f280cef40 con 0x7f6f30108cf0 2024-09-21T06:28:50.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:50 smithi018 ceph-mon[34477]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:50.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:50 smithi018 ceph-mon[34477]: from='osd.0 [v2:172.21.15.7:6802/942632794,v1:172.21.15.7:6803/942632794]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-09-21T06:28:50.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:50 smithi018 ceph-mon[34477]: osdmap e8: 1 total, 0 up, 1 in 2024-09-21T06:28:50.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:50 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:28:50.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:50 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:28:50.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:50 smithi018 ceph-mon[34477]: Detected new or changed devices on smithi007 2024-09-21T06:28:50.370 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:50 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:28:50.370 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:50 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:28:50.370 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:50 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T06:28:50.370 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:50 smithi018 ceph-mon[34477]: Adjusting osd_memory_target on smithi007 to 17092M 2024-09-21T06:28:50.370 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:50 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:28:50.370 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:50 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:28:50.370 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:50 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:28:50.370 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:50 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:28:50.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:28:50.395+0000 7f6f360e1640 1 -- 172.21.15.18:0/2260632590 --> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f6f30063800 con 0x7f6f1c0b6550 2024-09-21T06:28:50.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:50 smithi144 ceph-mon[34653]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:50.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:50 smithi144 ceph-mon[34653]: from='osd.0 [v2:172.21.15.7:6802/942632794,v1:172.21.15.7:6803/942632794]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-09-21T06:28:50.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:50 smithi144 ceph-mon[34653]: osdmap e8: 1 total, 0 up, 1 in 2024-09-21T06:28:50.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:50 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:28:50.536 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:50 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:28:50.536 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:50 smithi144 ceph-mon[34653]: Detected new or changed devices on smithi007 2024-09-21T06:28:50.536 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:50 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:28:50.536 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:50 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:28:50.536 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:50 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T06:28:50.536 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:50 smithi144 ceph-mon[34653]: Adjusting osd_memory_target on smithi007 to 17092M 2024-09-21T06:28:50.536 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:50 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:28:50.536 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:50 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:28:50.536 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:50 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:28:50.536 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:50 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:28:50.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:50 smithi007 ceph-mon[30983]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:50.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:50 smithi007 ceph-mon[30983]: from='osd.0 [v2:172.21.15.7:6802/942632794,v1:172.21.15.7:6803/942632794]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-09-21T06:28:50.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:50 smithi007 ceph-mon[30983]: osdmap e8: 1 total, 0 up, 1 in 2024-09-21T06:28:50.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:50 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:28:50.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:50 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:28:50.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:50 smithi007 ceph-mon[30983]: Detected new or changed devices on smithi007 2024-09-21T06:28:50.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:50 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:28:50.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:50 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:28:50.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:50 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T06:28:50.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:50 smithi007 ceph-mon[30983]: Adjusting osd_memory_target on smithi007 to 17092M 2024-09-21T06:28:50.591 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:50 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:28:50.591 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:50 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:28:50.591 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:50 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:28:50.591 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:50 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:28:51.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:51 smithi018 ceph-mon[34477]: purged_snaps scrub starts 2024-09-21T06:28:51.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:51 smithi018 ceph-mon[34477]: purged_snaps scrub ok 2024-09-21T06:28:51.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:51 smithi018 ceph-mon[34477]: osd.0 [v2:172.21.15.7:6802/942632794,v1:172.21.15.7:6803/942632794] boot 2024-09-21T06:28:51.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:51 smithi018 ceph-mon[34477]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T06:28:51.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:51 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:28:51.370 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:51 smithi018 ceph-mon[34477]: from='client.24326 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:28:51.370 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:51 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:28:51.370 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:51 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:28:51.370 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:51 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:28:51.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:51 smithi144 ceph-mon[34653]: purged_snaps scrub starts 2024-09-21T06:28:51.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:51 smithi144 ceph-mon[34653]: purged_snaps scrub ok 2024-09-21T06:28:51.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:51 smithi144 ceph-mon[34653]: osd.0 [v2:172.21.15.7:6802/942632794,v1:172.21.15.7:6803/942632794] boot 2024-09-21T06:28:51.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:51 smithi144 ceph-mon[34653]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T06:28:51.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:51 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:28:51.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:51 smithi144 ceph-mon[34653]: from='client.24326 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:28:51.536 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:51 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:28:51.536 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:51 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:28:51.536 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:51 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:28:51.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:51 smithi007 ceph-mon[30983]: purged_snaps scrub starts 2024-09-21T06:28:51.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:51 smithi007 ceph-mon[30983]: purged_snaps scrub ok 2024-09-21T06:28:51.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:51 smithi007 ceph-mon[30983]: osd.0 [v2:172.21.15.7:6802/942632794,v1:172.21.15.7:6803/942632794] boot 2024-09-21T06:28:51.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:51 smithi007 ceph-mon[30983]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T06:28:51.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:51 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T06:28:51.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:51 smithi007 ceph-mon[30983]: from='client.24326 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:28:51.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:51 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:28:51.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:51 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:28:51.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:51 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:28:52.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:52 smithi144 ceph-mon[34653]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:52.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:52 smithi144 ceph-mon[34653]: osdmap e10: 1 total, 1 up, 1 in 2024-09-21T06:28:52.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:52 smithi007 ceph-mon[30983]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:52.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:52 smithi007 ceph-mon[30983]: osdmap e10: 1 total, 1 up, 1 in 2024-09-21T06:28:52.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:52 smithi018 ceph-mon[34477]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T06:28:52.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:52 smithi018 ceph-mon[34477]: osdmap e10: 1 total, 1 up, 1 in 2024-09-21T06:28:53.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:53 smithi144 ceph-mon[34653]: from='client.? 172.21.15.18:0/2981120067' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "7ae136a8-c614-47e5-b265-c6cfa857a7fa"} : dispatch 2024-09-21T06:28:53.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:53 smithi144 ceph-mon[34653]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "7ae136a8-c614-47e5-b265-c6cfa857a7fa"} : dispatch 2024-09-21T06:28:53.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:53 smithi144 ceph-mon[34653]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7ae136a8-c614-47e5-b265-c6cfa857a7fa"}]': finished 2024-09-21T06:28:53.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:53 smithi144 ceph-mon[34653]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T06:28:53.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:53 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:28:53.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:53 smithi007 ceph-mon[30983]: from='client.? 172.21.15.18:0/2981120067' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "7ae136a8-c614-47e5-b265-c6cfa857a7fa"} : dispatch 2024-09-21T06:28:53.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:53 smithi007 ceph-mon[30983]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "7ae136a8-c614-47e5-b265-c6cfa857a7fa"} : dispatch 2024-09-21T06:28:53.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:53 smithi007 ceph-mon[30983]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7ae136a8-c614-47e5-b265-c6cfa857a7fa"}]': finished 2024-09-21T06:28:53.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:53 smithi007 ceph-mon[30983]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T06:28:53.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:53 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:28:53.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:53 smithi018 ceph-mon[34477]: from='client.? 172.21.15.18:0/2981120067' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "7ae136a8-c614-47e5-b265-c6cfa857a7fa"} : dispatch 2024-09-21T06:28:53.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:53 smithi018 ceph-mon[34477]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "7ae136a8-c614-47e5-b265-c6cfa857a7fa"} : dispatch 2024-09-21T06:28:53.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:53 smithi018 ceph-mon[34477]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7ae136a8-c614-47e5-b265-c6cfa857a7fa"}]': finished 2024-09-21T06:28:53.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:53 smithi018 ceph-mon[34477]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T06:28:53.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:53 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:28:54.523 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:54 smithi018 ceph-mon[34477]: pgmap v34: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:28:54.523 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:54 smithi018 ceph-mon[34477]: from='client.? 172.21.15.18:0/1516406436' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:28:54.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:54 smithi144 ceph-mon[34653]: pgmap v34: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:28:54.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:54 smithi144 ceph-mon[34653]: from='client.? 172.21.15.18:0/1516406436' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:28:54.589 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:54 smithi007 ceph-mon[30983]: pgmap v34: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:28:54.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:54 smithi007 ceph-mon[30983]: from='client.? 172.21.15.18:0/1516406436' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:28:56.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:56 smithi144 ceph-mon[34653]: pgmap v35: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:28:56.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:56 smithi007 ceph-mon[30983]: pgmap v35: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:28:56.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:56 smithi018 ceph-mon[34477]: pgmap v35: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:28:58.464 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:28:58 smithi018 ceph-mon[34477]: pgmap v36: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:28:58.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:28:58 smithi144 ceph-mon[34653]: pgmap v36: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:28:58.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:28:58 smithi007 ceph-mon[30983]: pgmap v36: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:29:00.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:00 smithi018 ceph-mon[34477]: pgmap v37: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:29:00.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:00 smithi144 ceph-mon[34653]: pgmap v37: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:29:00.589 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:00 smithi007 ceph-mon[30983]: pgmap v37: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:29:01.544 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:01 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T06:29:01.544 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:01 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:29:01.589 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:01 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T06:29:01.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:01 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:29:01.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:01 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T06:29:01.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:01 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:29:02.475 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:02 smithi018 ceph-mon[34477]: Deploying daemon osd.1 on smithi018 2024-09-21T06:29:02.475 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:02 smithi018 ceph-mon[34477]: pgmap v38: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:29:02.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:02 smithi007 ceph-mon[30983]: Deploying daemon osd.1 on smithi018 2024-09-21T06:29:02.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:02 smithi007 ceph-mon[30983]: pgmap v38: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:29:02.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:02 smithi144 ceph-mon[34653]: Deploying daemon osd.1 on smithi018 2024-09-21T06:29:02.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:02 smithi144 ceph-mon[34653]: pgmap v38: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:29:04.567 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:04 smithi018 ceph-mon[34477]: pgmap v39: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:29:04.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:04 smithi007 ceph-mon[30983]: pgmap v39: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:29:04.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:04 smithi144 ceph-mon[34653]: pgmap v39: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:29:06.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:06 smithi007 ceph-mon[30983]: pgmap v40: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:29:06.597 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:06 smithi018 ceph-mon[34477]: pgmap v40: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:29:06.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:06 smithi144 ceph-mon[34653]: pgmap v40: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:29:07.568 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:07 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:29:07.568 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:07 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:29:07.568 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:07 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:29:07.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:07 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:29:07.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:07 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:29:07.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:07 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:29:07.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:07 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:29:07.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:07 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:29:07.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:07 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:29:08.572 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:08 smithi018 ceph-mon[34477]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:29:08.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:08 smithi007 ceph-mon[30983]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:29:08.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:08 smithi144 ceph-mon[34653]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:29:10.508 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:10 smithi018 ceph-mon[34477]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:29:10.508 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:10 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:29:10.508 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:10 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:29:10.508 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:10 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:29:10.509 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:10 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:29:10.509 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:10 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:29:10.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:29:10.547+0000 7f6f2d7fa640 1 -- 172.21.15.18:0/2260632590 <== mgr.14223 v2:172.21.15.7:6800/3442812985 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f6f30063800 con 0x7f6f1c0b6550 2024-09-21T06:29:10.550 INFO:teuthology.orchestra.run.smithi018.stdout:Created osd(s) 1 on host 'smithi018' 2024-09-21T06:29:10.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:29:10.549+0000 7f6f360e1640 1 -- 172.21.15.18:0/2260632590 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f6f1c0b6550 msgr2=0x7f6f1c0b8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:10.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:29:10.549+0000 7f6f360e1640 1 --2- 172.21.15.18:0/2260632590 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f6f1c0b6550 0x7f6f1c0b8a60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6f20009c20 tx=0x7f6f20005f90 comp rx=0 tx=0).stop 2024-09-21T06:29:10.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:29:10.549+0000 7f6f360e1640 1 -- 172.21.15.18:0/2260632590 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f30108cf0 msgr2=0x7f6f3019fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:10.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:29:10.549+0000 7f6f360e1640 1 --2- 172.21.15.18:0/2260632590 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f30108cf0 0x7f6f3019fc80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6f280098d0 tx=0x7f6f280317b0 comp rx=0 tx=0).stop 2024-09-21T06:29:10.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:29:10.549+0000 7f6f360e1640 1 -- 172.21.15.18:0/2260632590 shutdown_connections 2024-09-21T06:29:10.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:29:10.549+0000 7f6f360e1640 1 --2- 172.21.15.18:0/2260632590 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f6f1c0b6550 0x7f6f1c0b8a60 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:10.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:29:10.549+0000 7f6f360e1640 1 --2- 172.21.15.18:0/2260632590 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f30108cf0 0x7f6f3019fc80 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:10.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:29:10.549+0000 7f6f360e1640 1 --2- 172.21.15.18:0/2260632590 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6f301083a0 0x7f6f3019a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:10.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:29:10.549+0000 7f6f360e1640 1 --2- 172.21.15.18:0/2260632590 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6f30102a60 0x7f6f3019a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:10.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:29:10.550+0000 7f6f360e1640 1 -- 172.21.15.18:0/2260632590 >> 172.21.15.18:0/2260632590 conn(0x7f6f30079730 msgr2=0x7f6f3006b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:10.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:29:10.550+0000 7f6f360e1640 1 -- 172.21.15.18:0/2260632590 shutdown_connections 2024-09-21T06:29:10.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:29:10.550+0000 7f6f360e1640 1 -- 172.21.15.18:0/2260632590 wait complete. 2024-09-21T06:29:10.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:10 smithi144 ceph-mon[34653]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:29:10.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:10 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:29:10.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:10 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:29:10.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:10 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:29:10.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:10 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:29:10.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:10 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:29:10.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:10 smithi007 ceph-mon[30983]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:29:10.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:10 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:29:10.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:10 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:29:10.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:10 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:29:10.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:10 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:29:10.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:10 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:29:11.196 DEBUG:teuthology.orchestra.run.smithi018:osd.1> sudo journalctl -f -n 0 -u ceph-347cb918-77e2-11ef-baf5-efdc52797490@osd.1.service 2024-09-21T06:29:11.238 INFO:tasks.cephadm:Deploying osd.2 on smithi144 with /dev/vg_nvme/lv_4... 2024-09-21T06:29:11.239 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T06:29:11.493 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:29:11.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:11 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:29:11.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:11 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:29:11.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:11 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:29:11.540 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:11 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:29:11.540 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:11 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:29:11.540 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:11 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:29:11.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:11 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:29:11.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:11 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:29:11.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:11 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:29:12.824 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:12 smithi144 ceph-mon[34653]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:29:12.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:12 smithi007 ceph-mon[30983]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:29:12.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:12 smithi018 ceph-mon[34477]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:29:13.257 INFO:journalctl@ceph.osd.1.smithi018.stdout:Sep 21 06:29:12 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-1[39091]: 2024-09-21T06:29:12.964+0000 7fbffaaeb640 -1 osd.1 0 log_to_monitors true 2024-09-21T06:29:13.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:13 smithi144 ceph-mon[34653]: from='osd.1 [v2:172.21.15.18:6800/1839342931,v1:172.21.15.18:6801/1839342931]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T06:29:13.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:13 smithi144 ceph-mon[34653]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T06:29:13.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:13 smithi007 ceph-mon[30983]: from='osd.1 [v2:172.21.15.18:6800/1839342931,v1:172.21.15.18:6801/1839342931]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T06:29:13.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:13 smithi007 ceph-mon[30983]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T06:29:13.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:13 smithi018 ceph-mon[34477]: from='osd.1 [v2:172.21.15.18:6800/1839342931,v1:172.21.15.18:6801/1839342931]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T06:29:13.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:13 smithi018 ceph-mon[34477]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T06:29:13.967 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-21T06:29:13.993 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi144:vg_nvme/lv_4 2024-09-21T06:29:14.245 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:29:14.643 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:14 smithi144 ceph-mon[34653]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:29:14.643 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:14 smithi144 ceph-mon[34653]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T06:29:14.643 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:14 smithi144 ceph-mon[34653]: from='osd.1 [v2:172.21.15.18:6800/1839342931,v1:172.21.15.18:6801/1839342931]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi018", "root=default"]} : dispatch 2024-09-21T06:29:14.643 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:14 smithi144 ceph-mon[34653]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T06:29:14.643 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:14 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:29:14.643 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:14 smithi144 ceph-mon[34653]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi018", "root=default"]} : dispatch 2024-09-21T06:29:14.643 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:14 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:29:14.644 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:14 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:29:14.644 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:14 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T06:29:14.644 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:14 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:29:14.644 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:14 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:29:14.644 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:14 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:29:14.644 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:14 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:29:14.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:29:14.734+0000 7ff1af212640 1 -- 172.21.15.144:0/2603144431 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1a8102a60 msgr2=0x7ff1a8102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:14.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:29:14.734+0000 7ff1af212640 1 --2- 172.21.15.144:0/2603144431 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1a8102a60 0x7ff1a8102e70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff19c009900 tx=0x7ff19c02a410 comp rx=0 tx=0).stop 2024-09-21T06:29:14.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:29:14.734+0000 7ff1af212640 1 -- 172.21.15.144:0/2603144431 shutdown_connections 2024-09-21T06:29:14.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:29:14.734+0000 7ff1af212640 1 --2- 172.21.15.144:0/2603144431 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff1a8108cf0 0x7ff1a810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:14.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:29:14.734+0000 7ff1af212640 1 --2- 172.21.15.144:0/2603144431 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff1a81083a0 0x7ff1a81087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:14.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:29:14.734+0000 7ff1af212640 1 --2- 172.21.15.144:0/2603144431 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1a8102a60 0x7ff1a8102e70 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:14.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:29:14.734+0000 7ff1af212640 1 -- 172.21.15.144:0/2603144431 >> 172.21.15.144:0/2603144431 conn(0x7ff1a8079730 msgr2=0x7ff1a8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:14.739 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:29:14.734+0000 7ff1af212640 1 -- 172.21.15.144:0/2603144431 shutdown_connections 2024-09-21T06:29:14.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:29:14.734+0000 7ff1af212640 1 -- 172.21.15.144:0/2603144431 wait complete. 2024-09-21T06:29:14.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:29:14.735+0000 7ff1af212640 1 Processor -- start 2024-09-21T06:29:14.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:29:14.735+0000 7ff1af212640 1 -- start start 2024-09-21T06:29:14.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:29:14.735+0000 7ff1af212640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1a8102a60 0x7ff1a8199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:14.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:29:14.735+0000 7ff1af212640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff1a81083a0 0x7ff1a8199910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:14.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:29:14.735+0000 7ff1af212640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff1a8108cf0 0x7ff1a819ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:14.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:29:14.735+0000 7ff1af212640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff1a8112960 con 0x7ff1a81083a0 2024-09-21T06:29:14.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:29:14.735+0000 7ff1af212640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff1a81127e0 con 0x7ff1a8108cf0 2024-09-21T06:29:14.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:29:14.735+0000 7ff1af212640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff1a8112ae0 con 0x7ff1a8102a60 2024-09-21T06:29:14.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:29:14.735+0000 7ff1acfae640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1a8102a60 0x7ff1a8199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:14.740 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:29:14.735+0000 7ff1acfae640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1a8102a60 0x7ff1a8199370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:46246/0 (socket says 172.21.15.144:46246) 2024-09-21T06:29:14.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:29:14.735+0000 7ff1acfae640 1 -- 172.21.15.144:0/2919230209 learned_addr learned my addr 172.21.15.144:0/2919230209 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-21T06:29:14.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:29:14.735+0000 7ff1ad7af640 1 --2- 172.21.15.144:0/2919230209 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff1a8108cf0 0x7ff1a819ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:14.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:29:14.735+0000 7ff1a7fff640 1 --2- 172.21.15.144:0/2919230209 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff1a81083a0 0x7ff1a8199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:14.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:29:14.736+0000 7ff1acfae640 1 -- 172.21.15.144:0/2919230209 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff1a8108cf0 msgr2=0x7ff1a819ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:14.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:29:14.736+0000 7ff1acfae640 1 --2- 172.21.15.144:0/2919230209 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff1a8108cf0 0x7ff1a819ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:14.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:29:14.736+0000 7ff1acfae640 1 -- 172.21.15.144:0/2919230209 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff1a81083a0 msgr2=0x7ff1a8199910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:14.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:29:14.736+0000 7ff1acfae640 1 --2- 172.21.15.144:0/2919230209 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff1a81083a0 0x7ff1a8199910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:14.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:29:14.736+0000 7ff1acfae640 1 -- 172.21.15.144:0/2919230209 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1a819f220 con 0x7ff1a8102a60 2024-09-21T06:29:14.741 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:29:14.736+0000 7ff1a7fff640 1 --2- 172.21.15.144:0/2919230209 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff1a81083a0 0x7ff1a8199910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:29:14.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:29:14.736+0000 7ff1acfae640 1 --2- 172.21.15.144:0/2919230209 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1a8102a60 0x7ff1a8199370 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff19c006010 tx=0x7ff19c0042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:14.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:29:14.736+0000 7ff1a5ffb640 1 -- 172.21.15.144:0/2919230209 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff19c03f030 con 0x7ff1a8102a60 2024-09-21T06:29:14.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:29:14.736+0000 7ff1a5ffb640 1 -- 172.21.15.144:0/2919230209 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff19c003800 con 0x7ff1a8102a60 2024-09-21T06:29:14.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:29:14.736+0000 7ff1a5ffb640 1 -- 172.21.15.144:0/2919230209 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff19c035070 con 0x7ff1a8102a60 2024-09-21T06:29:14.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:29:14.736+0000 7ff1af212640 1 -- 172.21.15.144:0/2919230209 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1a819f4b0 con 0x7ff1a8102a60 2024-09-21T06:29:14.742 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:29:14.736+0000 7ff1af212640 1 -- 172.21.15.144:0/2919230209 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1a819f940 con 0x7ff1a8102a60 2024-09-21T06:29:14.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:29:14.737+0000 7ff1af212640 1 -- 172.21.15.144:0/2919230209 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1a8102e70 con 0x7ff1a8102a60 2024-09-21T06:29:14.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:29:14.739+0000 7ff1a5ffb640 1 -- 172.21.15.144:0/2919230209 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 20) ==== 154472+0+0 (secure 0 0 0) 0x7ff19c003cb0 con 0x7ff1a8102a60 2024-09-21T06:29:14.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:29:14.740+0000 7ff1a5ffb640 1 --2- 172.21.15.144:0/2919230209 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7ff1980b6500 0x7ff1980b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:14.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:29:14.740+0000 7ff1a5ffb640 1 -- 172.21.15.144:0/2919230209 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2244+0+0 (secure 0 0 0) 0x7ff19c106630 con 0x7ff1a8102a60 2024-09-21T06:29:14.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:29:14.740+0000 7ff1a7fff640 1 --2- 172.21.15.144:0/2919230209 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7ff1980b6500 0x7ff1980b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:14.743 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:29:14.740+0000 7ff1a7fff640 1 --2- 172.21.15.144:0/2919230209 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7ff1980b6500 0x7ff1980b8a10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff1a8100c50 tx=0x7ff194005d30 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:14.745 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:29:14.743+0000 7ff1a5ffb640 1 -- 172.21.15.144:0/2919230209 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff19c0ce750 con 0x7ff1a8102a60 2024-09-21T06:29:14.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:14 smithi007 ceph-mon[30983]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:29:14.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:14 smithi007 ceph-mon[30983]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T06:29:14.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:14 smithi007 ceph-mon[30983]: from='osd.1 [v2:172.21.15.18:6800/1839342931,v1:172.21.15.18:6801/1839342931]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi018", "root=default"]} : dispatch 2024-09-21T06:29:14.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:14 smithi007 ceph-mon[30983]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T06:29:14.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:14 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:29:14.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:14 smithi007 ceph-mon[30983]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi018", "root=default"]} : dispatch 2024-09-21T06:29:14.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:14 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:29:14.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:14 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:29:14.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:14 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T06:29:14.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:14 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:29:14.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:14 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:29:14.841 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:14 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:29:14.841 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:14 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:29:14.869 INFO:journalctl@ceph.osd.1.smithi018.stdout:Sep 21 06:29:14 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-1[39091]: 2024-09-21T06:29:14.563+0000 7fbff6a6d640 -1 osd.1 0 waiting for initial osdmap 2024-09-21T06:29:14.869 INFO:journalctl@ceph.osd.1.smithi018.stdout:Sep 21 06:29:14 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-1[39091]: 2024-09-21T06:29:14.567+0000 7fbff286b640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T06:29:14.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:14 smithi018 ceph-mon[34477]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:29:14.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:14 smithi018 ceph-mon[34477]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T06:29:14.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:14 smithi018 ceph-mon[34477]: from='osd.1 [v2:172.21.15.18:6800/1839342931,v1:172.21.15.18:6801/1839342931]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi018", "root=default"]} : dispatch 2024-09-21T06:29:14.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:14 smithi018 ceph-mon[34477]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T06:29:14.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:14 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:29:14.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:14 smithi018 ceph-mon[34477]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi018", "root=default"]} : dispatch 2024-09-21T06:29:14.870 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:14 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:29:14.870 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:14 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:29:14.870 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:14 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T06:29:14.870 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:14 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:29:14.870 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:14 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:29:14.870 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:14 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:29:14.870 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:14 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:29:14.932 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:29:14.930+0000 7ff1af212640 1 -- 172.21.15.144:0/2919230209 --> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7ff1a8063800 con 0x7ff1980b6500 2024-09-21T06:29:15.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:15 smithi007 ceph-mon[30983]: Detected new or changed devices on smithi018 2024-09-21T06:29:15.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:15 smithi007 ceph-mon[30983]: Adjusting osd_memory_target on smithi018 to 17092M 2024-09-21T06:29:15.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:15 smithi007 ceph-mon[30983]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-09-21T06:29:15.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:15 smithi007 ceph-mon[30983]: osdmap e13: 2 total, 1 up, 2 in 2024-09-21T06:29:15.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:15 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:29:15.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:15 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:29:15.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:15 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:29:15.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:15 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:29:15.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:15 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:29:15.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:15 smithi018 ceph-mon[34477]: Detected new or changed devices on smithi018 2024-09-21T06:29:15.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:15 smithi018 ceph-mon[34477]: Adjusting osd_memory_target on smithi018 to 17092M 2024-09-21T06:29:15.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:15 smithi018 ceph-mon[34477]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-09-21T06:29:15.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:15 smithi018 ceph-mon[34477]: osdmap e13: 2 total, 1 up, 2 in 2024-09-21T06:29:15.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:15 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:29:15.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:15 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:29:15.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:15 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:29:15.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:15 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:29:15.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:15 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:29:16.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:15 smithi144 ceph-mon[34653]: Detected new or changed devices on smithi018 2024-09-21T06:29:16.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:15 smithi144 ceph-mon[34653]: Adjusting osd_memory_target on smithi018 to 17092M 2024-09-21T06:29:16.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:15 smithi144 ceph-mon[34653]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-09-21T06:29:16.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:15 smithi144 ceph-mon[34653]: osdmap e13: 2 total, 1 up, 2 in 2024-09-21T06:29:16.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:15 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:29:16.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:15 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:29:16.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:15 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:29:16.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:15 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:29:16.036 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:15 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:29:16.778 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:16 smithi144 ceph-mon[34653]: purged_snaps scrub starts 2024-09-21T06:29:16.778 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:16 smithi144 ceph-mon[34653]: purged_snaps scrub ok 2024-09-21T06:29:16.778 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:16 smithi144 ceph-mon[34653]: from='client.24349 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:29:16.778 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:16 smithi144 ceph-mon[34653]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:29:16.778 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:16 smithi144 ceph-mon[34653]: osd.1 [v2:172.21.15.18:6800/1839342931,v1:172.21.15.18:6801/1839342931] boot 2024-09-21T06:29:16.779 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:16 smithi144 ceph-mon[34653]: osdmap e14: 2 total, 2 up, 2 in 2024-09-21T06:29:16.779 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:16 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:29:16.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:16 smithi007 ceph-mon[30983]: purged_snaps scrub starts 2024-09-21T06:29:16.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:16 smithi007 ceph-mon[30983]: purged_snaps scrub ok 2024-09-21T06:29:16.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:16 smithi007 ceph-mon[30983]: from='client.24349 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:29:16.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:16 smithi007 ceph-mon[30983]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:29:16.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:16 smithi007 ceph-mon[30983]: osd.1 [v2:172.21.15.18:6800/1839342931,v1:172.21.15.18:6801/1839342931] boot 2024-09-21T06:29:16.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:16 smithi007 ceph-mon[30983]: osdmap e14: 2 total, 2 up, 2 in 2024-09-21T06:29:16.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:16 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:29:16.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:16 smithi018 ceph-mon[34477]: purged_snaps scrub starts 2024-09-21T06:29:16.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:16 smithi018 ceph-mon[34477]: purged_snaps scrub ok 2024-09-21T06:29:16.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:16 smithi018 ceph-mon[34477]: from='client.24349 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:29:16.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:16 smithi018 ceph-mon[34477]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T06:29:16.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:16 smithi018 ceph-mon[34477]: osd.1 [v2:172.21.15.18:6800/1839342931,v1:172.21.15.18:6801/1839342931] boot 2024-09-21T06:29:16.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:16 smithi018 ceph-mon[34477]: osdmap e14: 2 total, 2 up, 2 in 2024-09-21T06:29:16.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:16 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T06:29:17.725 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:17 smithi144 ceph-mon[34653]: osdmap e15: 2 total, 2 up, 2 in 2024-09-21T06:29:17.725 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:17 smithi144 ceph-mon[34653]: from='client.? 172.21.15.144:0/362453409' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "97b13994-4680-4573-9c2e-ac65ea740e78"} : dispatch 2024-09-21T06:29:17.725 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:17 smithi144 ceph-mon[34653]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "97b13994-4680-4573-9c2e-ac65ea740e78"} : dispatch 2024-09-21T06:29:17.725 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:17 smithi144 ceph-mon[34653]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "97b13994-4680-4573-9c2e-ac65ea740e78"}]': finished 2024-09-21T06:29:17.726 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:17 smithi144 ceph-mon[34653]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T06:29:17.726 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:17 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:29:17.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:17 smithi007 ceph-mon[30983]: osdmap e15: 2 total, 2 up, 2 in 2024-09-21T06:29:17.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:17 smithi007 ceph-mon[30983]: from='client.? 172.21.15.144:0/362453409' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "97b13994-4680-4573-9c2e-ac65ea740e78"} : dispatch 2024-09-21T06:29:17.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:17 smithi007 ceph-mon[30983]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "97b13994-4680-4573-9c2e-ac65ea740e78"} : dispatch 2024-09-21T06:29:17.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:17 smithi007 ceph-mon[30983]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "97b13994-4680-4573-9c2e-ac65ea740e78"}]': finished 2024-09-21T06:29:17.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:17 smithi007 ceph-mon[30983]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T06:29:17.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:17 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:29:17.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:17 smithi018 ceph-mon[34477]: osdmap e15: 2 total, 2 up, 2 in 2024-09-21T06:29:17.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:17 smithi018 ceph-mon[34477]: from='client.? 172.21.15.144:0/362453409' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "97b13994-4680-4573-9c2e-ac65ea740e78"} : dispatch 2024-09-21T06:29:17.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:17 smithi018 ceph-mon[34477]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "97b13994-4680-4573-9c2e-ac65ea740e78"} : dispatch 2024-09-21T06:29:17.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:17 smithi018 ceph-mon[34477]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "97b13994-4680-4573-9c2e-ac65ea740e78"}]': finished 2024-09-21T06:29:17.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:17 smithi018 ceph-mon[34477]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T06:29:17.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:17 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:29:18.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:18 smithi007 ceph-mon[30983]: pgmap v50: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:29:18.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:18 smithi007 ceph-mon[30983]: from='client.? 172.21.15.144:0/1681369293' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:29:18.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:18 smithi018 ceph-mon[34477]: pgmap v50: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:29:18.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:18 smithi018 ceph-mon[34477]: from='client.? 172.21.15.144:0/1681369293' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:29:19.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:18 smithi144 ceph-mon[34653]: pgmap v50: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:29:19.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:18 smithi144 ceph-mon[34653]: from='client.? 172.21.15.144:0/1681369293' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:29:20.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:20 smithi007 ceph-mon[30983]: pgmap v52: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:29:20.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:20 smithi018 ceph-mon[34477]: pgmap v52: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:29:21.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:20 smithi144 ceph-mon[34653]: pgmap v52: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:29:22.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:22 smithi007 ceph-mon[30983]: pgmap v53: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:29:22.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:22 smithi018 ceph-mon[34477]: pgmap v53: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:29:22.873 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:22 smithi144 ceph-mon[34653]: pgmap v53: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:29:24.674 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:24 smithi144 ceph-mon[34653]: pgmap v54: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:29:24.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:24 smithi018 ceph-mon[34477]: pgmap v54: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:29:25.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:24 smithi007 ceph-mon[30983]: pgmap v54: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:29:25.860 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:25 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T06:29:25.860 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:25 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:29:25.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:25 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T06:29:25.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:25 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:29:26.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:25 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T06:29:26.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:25 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:29:26.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:26 smithi144 ceph-mon[34653]: pgmap v55: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:29:26.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:26 smithi144 ceph-mon[34653]: Deploying daemon osd.2 on smithi144 2024-09-21T06:29:26.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:26 smithi018 ceph-mon[34477]: pgmap v55: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:29:26.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:26 smithi018 ceph-mon[34477]: Deploying daemon osd.2 on smithi144 2024-09-21T06:29:27.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:26 smithi007 ceph-mon[30983]: pgmap v55: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:29:27.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:26 smithi007 ceph-mon[30983]: Deploying daemon osd.2 on smithi144 2024-09-21T06:29:28.679 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:28 smithi144 ceph-mon[34653]: pgmap v56: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:29:28.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:28 smithi018 ceph-mon[34477]: pgmap v56: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:29:29.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:28 smithi007 ceph-mon[30983]: pgmap v56: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:29:30.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:30 smithi144 ceph-mon[34653]: pgmap v57: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:29:30.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:30 smithi018 ceph-mon[34477]: pgmap v57: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:29:31.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:30 smithi007 ceph-mon[30983]: pgmap v57: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:29:31.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:31 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:29:31.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:31 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:29:31.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:31 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:29:31.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:31 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:29:31.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:31 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:29:31.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:31 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:29:32.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:31 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:29:32.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:31 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:29:32.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:31 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:29:32.611 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:32 smithi144 ceph-mon[34653]: pgmap v58: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:29:32.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:32 smithi018 ceph-mon[34477]: pgmap v58: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:29:33.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:32 smithi007 ceph-mon[30983]: pgmap v58: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:29:34.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:34 smithi144 ceph-mon[34653]: pgmap v59: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:29:34.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:34 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:29:34.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:34 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:29:34.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:34 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:29:34.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:34 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:29:34.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:34 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:29:34.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:34 smithi007 ceph-mon[30983]: pgmap v59: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:29:34.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:34 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:29:34.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:34 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:29:34.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:34 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:29:34.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:34 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:29:34.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:34 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:29:34.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:34 smithi018 ceph-mon[34477]: pgmap v59: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:29:34.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:34 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:29:34.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:34 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:29:34.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:34 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:29:34.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:34 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:29:34.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:34 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:29:35.843 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:29:35.841+0000 7ff1a5ffb640 1 -- 172.21.15.144:0/2919230209 <== mgr.14223 v2:172.21.15.7:6800/3442812985 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7ff1a8063800 con 0x7ff1980b6500 2024-09-21T06:29:35.843 INFO:teuthology.orchestra.run.smithi144.stdout:Created osd(s) 2 on host 'smithi144' 2024-09-21T06:29:35.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:29:35.844+0000 7ff1af212640 1 -- 172.21.15.144:0/2919230209 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7ff1980b6500 msgr2=0x7ff1980b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:35.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:29:35.844+0000 7ff1af212640 1 --2- 172.21.15.144:0/2919230209 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7ff1980b6500 0x7ff1980b8a10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff1a8100c50 tx=0x7ff194005d30 comp rx=0 tx=0).stop 2024-09-21T06:29:35.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:29:35.844+0000 7ff1af212640 1 -- 172.21.15.144:0/2919230209 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1a8102a60 msgr2=0x7ff1a8199370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:35.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:29:35.844+0000 7ff1af212640 1 --2- 172.21.15.144:0/2919230209 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1a8102a60 0x7ff1a8199370 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff19c006010 tx=0x7ff19c0042f0 comp rx=0 tx=0).stop 2024-09-21T06:29:35.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:29:35.844+0000 7ff1af212640 1 -- 172.21.15.144:0/2919230209 shutdown_connections 2024-09-21T06:29:35.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:29:35.844+0000 7ff1af212640 1 --2- 172.21.15.144:0/2919230209 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7ff1980b6500 0x7ff1980b8a10 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:35.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:29:35.844+0000 7ff1af212640 1 --2- 172.21.15.144:0/2919230209 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff1a8108cf0 0x7ff1a819ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:35.846 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:29:35.844+0000 7ff1af212640 1 --2- 172.21.15.144:0/2919230209 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff1a81083a0 0x7ff1a8199910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:35.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:29:35.844+0000 7ff1af212640 1 --2- 172.21.15.144:0/2919230209 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff1a8102a60 0x7ff1a8199370 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:35.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:29:35.844+0000 7ff1af212640 1 -- 172.21.15.144:0/2919230209 >> 172.21.15.144:0/2919230209 conn(0x7ff1a8079730 msgr2=0x7ff1a81014b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:35.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:29:35.844+0000 7ff1af212640 1 -- 172.21.15.144:0/2919230209 shutdown_connections 2024-09-21T06:29:35.847 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:29:35.844+0000 7ff1af212640 1 -- 172.21.15.144:0/2919230209 wait complete. 2024-09-21T06:29:36.413 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:36 smithi144 ceph-mon[34653]: pgmap v60: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:29:36.413 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:36 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:29:36.413 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:36 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:29:36.413 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:36 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:29:36.440 DEBUG:teuthology.orchestra.run.smithi144:osd.2> sudo journalctl -f -n 0 -u ceph-347cb918-77e2-11ef-baf5-efdc52797490@osd.2.service 2024-09-21T06:29:36.442 INFO:tasks.cephadm:Deploying osd.3 on smithi007 with /dev/vg_nvme/lv_3... 2024-09-21T06:29:36.443 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T06:29:36.589 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:36 smithi007 ceph-mon[30983]: pgmap v60: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:29:36.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:36 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:29:36.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:36 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:29:36.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:36 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:29:36.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:36 smithi018 ceph-mon[34477]: pgmap v60: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:29:36.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:36 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:29:36.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:36 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:29:36.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:36 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:29:36.714 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:29:37.906 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 21 06:29:37 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-2[39773]: 2024-09-21T06:29:37.633+0000 7f9e20878640 -1 osd.2 0 log_to_monitors true 2024-09-21T06:29:38.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:38 smithi144 ceph-mon[34653]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:29:38.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:38 smithi144 ceph-mon[34653]: from='osd.2 [v2:172.21.15.144:6800/1699582162,v1:172.21.15.144:6801/1699582162]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T06:29:38.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:38 smithi144 ceph-mon[34653]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T06:29:38.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:38 smithi007 ceph-mon[30983]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:29:38.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:38 smithi007 ceph-mon[30983]: from='osd.2 [v2:172.21.15.144:6800/1699582162,v1:172.21.15.144:6801/1699582162]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T06:29:38.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:38 smithi007 ceph-mon[30983]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T06:29:38.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:38 smithi018 ceph-mon[34477]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:29:38.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:38 smithi018 ceph-mon[34477]: from='osd.2 [v2:172.21.15.144:6800/1699582162,v1:172.21.15.144:6801/1699582162]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T06:29:38.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:38 smithi018 ceph-mon[34477]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T06:29:39.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:39 smithi007 ceph-mon[30983]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T06:29:39.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:39 smithi007 ceph-mon[30983]: osdmap e17: 3 total, 2 up, 3 in 2024-09-21T06:29:39.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:39 smithi007 ceph-mon[30983]: from='osd.2 [v2:172.21.15.144:6800/1699582162,v1:172.21.15.144:6801/1699582162]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi144", "root=default"]} : dispatch 2024-09-21T06:29:39.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:39 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:29:39.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:39 smithi007 ceph-mon[30983]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi144", "root=default"]} : dispatch 2024-09-21T06:29:39.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:39 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:29:39.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:39 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:29:39.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:39 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T06:29:39.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:39 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:29:39.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:39 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:29:39.341 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:39 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:29:39.341 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:39 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:29:39.390 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:29:39.416 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi007:vg_nvme/lv_3 2024-09-21T06:29:39.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:39 smithi144 ceph-mon[34653]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T06:29:39.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:39 smithi144 ceph-mon[34653]: osdmap e17: 3 total, 2 up, 3 in 2024-09-21T06:29:39.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:39 smithi144 ceph-mon[34653]: from='osd.2 [v2:172.21.15.144:6800/1699582162,v1:172.21.15.144:6801/1699582162]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi144", "root=default"]} : dispatch 2024-09-21T06:29:39.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:39 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:29:39.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:39 smithi144 ceph-mon[34653]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi144", "root=default"]} : dispatch 2024-09-21T06:29:39.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:39 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:29:39.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:39 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:29:39.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:39 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T06:29:39.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:39 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:29:39.536 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:39 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:29:39.536 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:39 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:29:39.536 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:39 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:29:39.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:39 smithi018 ceph-mon[34477]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T06:29:39.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:39 smithi018 ceph-mon[34477]: osdmap e17: 3 total, 2 up, 3 in 2024-09-21T06:29:39.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:39 smithi018 ceph-mon[34477]: from='osd.2 [v2:172.21.15.144:6800/1699582162,v1:172.21.15.144:6801/1699582162]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi144", "root=default"]} : dispatch 2024-09-21T06:29:39.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:39 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:29:39.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:39 smithi018 ceph-mon[34477]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi144", "root=default"]} : dispatch 2024-09-21T06:29:39.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:39 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:29:39.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:39 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:29:39.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:39 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T06:29:39.620 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:39 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:29:39.620 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:39 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:29:39.620 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:39 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:29:39.620 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:39 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:29:39.675 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:29:40.035 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 21 06:29:39 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-2[39773]: 2024-09-21T06:29:39.716+0000 7f9e1d00f640 -1 osd.2 0 waiting for initial osdmap 2024-09-21T06:29:40.035 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 21 06:29:39 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-2[39773]: 2024-09-21T06:29:39.723+0000 7f9e145f0640 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T06:29:40.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:29:40.133+0000 7f3f98d56640 1 -- 172.21.15.7:0/220596881 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f941049b0 msgr2=0x7f3f94104dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:40.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:29:40.133+0000 7f3f98d56640 1 --2- 172.21.15.7:0/220596881 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f941049b0 0x7f3f94104dc0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3f84009900 tx=0x7f3f8402a410 comp rx=0 tx=0).stop 2024-09-21T06:29:40.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:29:40.133+0000 7f3f98d56640 1 -- 172.21.15.7:0/220596881 shutdown_connections 2024-09-21T06:29:40.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:29:40.133+0000 7f3f98d56640 1 --2- 172.21.15.7:0/220596881 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f9410de10 0x7f3f94110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:40.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:29:40.133+0000 7f3f98d56640 1 --2- 172.21.15.7:0/220596881 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f94105300 0x7f3f9410d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:40.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:29:40.133+0000 7f3f98d56640 1 --2- 172.21.15.7:0/220596881 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f941049b0 0x7f3f94104dc0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:40.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:29:40.133+0000 7f3f98d56640 1 -- 172.21.15.7:0/220596881 >> 172.21.15.7:0/220596881 conn(0x7f3f94079730 msgr2=0x7f3f94079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:29:40.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:29:40.133+0000 7f3f98d56640 1 -- 172.21.15.7:0/220596881 shutdown_connections 2024-09-21T06:29:40.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:29:40.133+0000 7f3f98d56640 1 -- 172.21.15.7:0/220596881 wait complete. 2024-09-21T06:29:40.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:29:40.134+0000 7f3f98d56640 1 Processor -- start 2024-09-21T06:29:40.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:29:40.134+0000 7f3f98d56640 1 -- start start 2024-09-21T06:29:40.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:29:40.134+0000 7f3f98d56640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f941049b0 0x7f3f9419a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:40.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:29:40.134+0000 7f3f98d56640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f94105300 0x7f3f9419aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:40.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:29:40.134+0000 7f3f98d56640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f9410de10 0x7f3f9419fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:40.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:29:40.134+0000 7f3f98d56640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3f94113a90 con 0x7f3f941049b0 2024-09-21T06:29:40.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:29:40.134+0000 7f3f98d56640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3f94113910 con 0x7f3f9410de10 2024-09-21T06:29:40.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:29:40.134+0000 7f3f98d56640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3f94113c10 con 0x7f3f94105300 2024-09-21T06:29:40.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:29:40.134+0000 7f3f9259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f941049b0 0x7f3f9419a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:40.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:29:40.134+0000 7f3f9259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f941049b0 0x7f3f9419a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33304/0 (socket says 172.21.15.7:33304) 2024-09-21T06:29:40.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:29:40.134+0000 7f3f9259c640 1 -- 172.21.15.7:0/1690437247 learned_addr learned my addr 172.21.15.7:0/1690437247 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:29:40.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:29:40.134+0000 7f3f91d9b640 1 --2- 172.21.15.7:0/1690437247 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f94105300 0x7f3f9419aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:40.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:29:40.134+0000 7f3f92d9d640 1 --2- 172.21.15.7:0/1690437247 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f9410de10 0x7f3f9419fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:40.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:29:40.135+0000 7f3f9259c640 1 -- 172.21.15.7:0/1690437247 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f94105300 msgr2=0x7f3f9419aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:40.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:29:40.135+0000 7f3f9259c640 1 --2- 172.21.15.7:0/1690437247 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f94105300 0x7f3f9419aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:40.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:29:40.135+0000 7f3f9259c640 1 -- 172.21.15.7:0/1690437247 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f9410de10 msgr2=0x7f3f9419fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:29:40.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:29:40.135+0000 7f3f9259c640 1 --2- 172.21.15.7:0/1690437247 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f9410de10 0x7f3f9419fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:29:40.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:29:40.135+0000 7f3f9259c640 1 -- 172.21.15.7:0/1690437247 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f941a0430 con 0x7f3f941049b0 2024-09-21T06:29:40.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:29:40.135+0000 7f3f91d9b640 1 --2- 172.21.15.7:0/1690437247 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f94105300 0x7f3f9419aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:29:40.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:29:40.135+0000 7f3f9259c640 1 --2- 172.21.15.7:0/1690437247 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f941049b0 0x7f3f9419a4c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3f84006010 tx=0x7f3f84004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:40.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:29:40.135+0000 7f3f837fe640 1 -- 172.21.15.7:0/1690437247 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f8403f030 con 0x7f3f941049b0 2024-09-21T06:29:40.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:29:40.135+0000 7f3f837fe640 1 -- 172.21.15.7:0/1690437247 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f84003aa0 con 0x7f3f941049b0 2024-09-21T06:29:40.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:29:40.135+0000 7f3f98d56640 1 -- 172.21.15.7:0/1690437247 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f941a06c0 con 0x7f3f941049b0 2024-09-21T06:29:40.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:29:40.135+0000 7f3f837fe640 1 -- 172.21.15.7:0/1690437247 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f84035070 con 0x7f3f941049b0 2024-09-21T06:29:40.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:29:40.135+0000 7f3f98d56640 1 -- 172.21.15.7:0/1690437247 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f941a6e80 con 0x7f3f941049b0 2024-09-21T06:29:40.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:29:40.137+0000 7f3f98d56640 1 -- 172.21.15.7:0/1690437247 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f9406b560 con 0x7f3f941049b0 2024-09-21T06:29:40.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:29:40.138+0000 7f3f837fe640 1 -- 172.21.15.7:0/1690437247 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 20) ==== 154472+0+0 (secure 0 0 0) 0x7f3f84042030 con 0x7f3f941049b0 2024-09-21T06:29:40.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:29:40.139+0000 7f3f837fe640 1 --2- 172.21.15.7:0/1690437247 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f3f7c0b64d0 0x7f3f7c0b89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:29:40.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:29:40.139+0000 7f3f91d9b640 1 --2- 172.21.15.7:0/1690437247 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f3f7c0b64d0 0x7f3f7c0b89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:29:40.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:29:40.139+0000 7f3f837fe640 1 -- 172.21.15.7:0/1690437247 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2786+0+0 (secure 0 0 0) 0x7f3f84105d50 con 0x7f3f941049b0 2024-09-21T06:29:40.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:29:40.139+0000 7f3f91d9b640 1 --2- 172.21.15.7:0/1690437247 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f3f7c0b64d0 0x7f3f7c0b89e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3f94102410 tx=0x7f3f8800b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:29:40.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:29:40.143+0000 7f3f837fe640 1 -- 172.21.15.7:0/1690437247 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3f840d2030 con 0x7f3f941049b0 2024-09-21T06:29:40.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:29:40.351+0000 7f3f98d56640 1 -- 172.21.15.7:0/1690437247 --> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f3f94063800 con 0x7f3f7c0b64d0 2024-09-21T06:29:40.589 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:40 smithi007 ceph-mon[30983]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:29:40.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:40 smithi007 ceph-mon[30983]: Detected new or changed devices on smithi144 2024-09-21T06:29:40.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:40 smithi007 ceph-mon[30983]: Adjusting osd_memory_target on smithi144 to 17088M 2024-09-21T06:29:40.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:40 smithi007 ceph-mon[30983]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]': finished 2024-09-21T06:29:40.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:40 smithi007 ceph-mon[30983]: osdmap e18: 3 total, 2 up, 3 in 2024-09-21T06:29:40.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:40 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:29:40.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:40 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:29:40.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:40 smithi007 ceph-mon[30983]: from='osd.2 ' entity='osd.2' 2024-09-21T06:29:40.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:40 smithi018 ceph-mon[34477]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:29:40.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:40 smithi018 ceph-mon[34477]: Detected new or changed devices on smithi144 2024-09-21T06:29:40.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:40 smithi018 ceph-mon[34477]: Adjusting osd_memory_target on smithi144 to 17088M 2024-09-21T06:29:40.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:40 smithi018 ceph-mon[34477]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]': finished 2024-09-21T06:29:40.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:40 smithi018 ceph-mon[34477]: osdmap e18: 3 total, 2 up, 3 in 2024-09-21T06:29:40.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:40 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:29:40.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:40 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:29:40.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:40 smithi018 ceph-mon[34477]: from='osd.2 ' entity='osd.2' 2024-09-21T06:29:40.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:40 smithi144 ceph-mon[34653]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:29:40.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:40 smithi144 ceph-mon[34653]: Detected new or changed devices on smithi144 2024-09-21T06:29:40.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:40 smithi144 ceph-mon[34653]: Adjusting osd_memory_target on smithi144 to 17088M 2024-09-21T06:29:40.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:40 smithi144 ceph-mon[34653]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]': finished 2024-09-21T06:29:40.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:40 smithi144 ceph-mon[34653]: osdmap e18: 3 total, 2 up, 3 in 2024-09-21T06:29:40.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:40 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:29:40.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:40 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:29:40.786 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:40 smithi144 ceph-mon[34653]: from='osd.2 ' entity='osd.2' 2024-09-21T06:29:41.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:41 smithi007 ceph-mon[30983]: purged_snaps scrub starts 2024-09-21T06:29:41.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:41 smithi007 ceph-mon[30983]: purged_snaps scrub ok 2024-09-21T06:29:41.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:41 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:29:41.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:41 smithi007 ceph-mon[30983]: from='client.14511 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:29:41.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:41 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:29:41.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:41 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:29:41.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:41 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:29:41.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:41 smithi007 ceph-mon[30983]: osd.2 [v2:172.21.15.144:6800/1699582162,v1:172.21.15.144:6801/1699582162] boot 2024-09-21T06:29:41.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:41 smithi007 ceph-mon[30983]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T06:29:41.591 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:41 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:29:41.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:41 smithi018 ceph-mon[34477]: purged_snaps scrub starts 2024-09-21T06:29:41.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:41 smithi018 ceph-mon[34477]: purged_snaps scrub ok 2024-09-21T06:29:41.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:41 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:29:41.620 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:41 smithi018 ceph-mon[34477]: from='client.14511 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:29:41.620 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:41 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:29:41.620 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:41 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:29:41.620 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:41 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:29:41.620 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:41 smithi018 ceph-mon[34477]: osd.2 [v2:172.21.15.144:6800/1699582162,v1:172.21.15.144:6801/1699582162] boot 2024-09-21T06:29:41.620 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:41 smithi018 ceph-mon[34477]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T06:29:41.620 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:41 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:29:41.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:41 smithi144 ceph-mon[34653]: purged_snaps scrub starts 2024-09-21T06:29:41.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:41 smithi144 ceph-mon[34653]: purged_snaps scrub ok 2024-09-21T06:29:41.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:41 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:29:41.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:41 smithi144 ceph-mon[34653]: from='client.14511 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:29:41.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:41 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:29:41.786 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:41 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:29:41.786 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:41 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:29:41.786 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:41 smithi144 ceph-mon[34653]: osd.2 [v2:172.21.15.144:6800/1699582162,v1:172.21.15.144:6801/1699582162] boot 2024-09-21T06:29:41.786 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:41 smithi144 ceph-mon[34653]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T06:29:41.786 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:41 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T06:29:42.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:42 smithi007 ceph-mon[30983]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:29:42.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:42 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T06:29:42.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:42 smithi018 ceph-mon[34477]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:29:42.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:42 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T06:29:42.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:42 smithi144 ceph-mon[34653]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T06:29:42.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:42 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T06:29:43.165 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:43 smithi007 sudo[52177]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T06:29:43.166 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:43 smithi007 sudo[52177]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T06:29:43.166 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:43 smithi007 sudo[52177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T06:29:43.166 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:43 smithi007 sudo[52177]: pam_unix(sudo:session): session closed for user root 2024-09-21T06:29:43.166 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:43 smithi007 sudo[52180]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T06:29:43.166 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:43 smithi007 sudo[52180]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T06:29:43.166 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:43 smithi007 sudo[52180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T06:29:43.166 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:43 smithi007 sudo[52180]: pam_unix(sudo:session): session closed for user root 2024-09-21T06:29:43.166 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 21 06:29:42 smithi007 sudo[52165]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T06:29:43.166 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 21 06:29:42 smithi007 sudo[52165]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T06:29:43.166 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 21 06:29:42 smithi007 sudo[52165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T06:29:43.167 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 21 06:29:42 smithi007 sudo[52165]: pam_unix(sudo:session): session closed for user root 2024-09-21T06:29:43.167 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 21 06:29:42 smithi007 sudo[52168]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T06:29:43.167 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 21 06:29:42 smithi007 sudo[52168]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T06:29:43.167 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 21 06:29:42 smithi007 sudo[52168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T06:29:43.167 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 21 06:29:42 smithi007 sudo[52168]: pam_unix(sudo:session): session closed for user root 2024-09-21T06:29:43.200 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:43 smithi018 sudo[42763]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T06:29:43.200 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:43 smithi018 sudo[42763]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T06:29:43.200 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:43 smithi018 sudo[42763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T06:29:43.200 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:43 smithi018 sudo[42763]: pam_unix(sudo:session): session closed for user root 2024-09-21T06:29:43.200 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:43 smithi018 sudo[42766]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T06:29:43.200 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:43 smithi018 sudo[42766]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T06:29:43.201 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:43 smithi018 sudo[42766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T06:29:43.201 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:43 smithi018 sudo[42766]: pam_unix(sudo:session): session closed for user root 2024-09-21T06:29:43.201 INFO:journalctl@ceph.osd.1.smithi018.stdout:Sep 21 06:29:42 smithi018 sudo[42757]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T06:29:43.201 INFO:journalctl@ceph.osd.1.smithi018.stdout:Sep 21 06:29:42 smithi018 sudo[42757]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T06:29:43.201 INFO:journalctl@ceph.osd.1.smithi018.stdout:Sep 21 06:29:42 smithi018 sudo[42757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T06:29:43.201 INFO:journalctl@ceph.osd.1.smithi018.stdout:Sep 21 06:29:42 smithi018 sudo[42757]: pam_unix(sudo:session): session closed for user root 2024-09-21T06:29:43.201 INFO:journalctl@ceph.osd.1.smithi018.stdout:Sep 21 06:29:42 smithi018 sudo[42760]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T06:29:43.201 INFO:journalctl@ceph.osd.1.smithi018.stdout:Sep 21 06:29:42 smithi018 sudo[42760]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T06:29:43.202 INFO:journalctl@ceph.osd.1.smithi018.stdout:Sep 21 06:29:42 smithi018 sudo[42760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T06:29:43.202 INFO:journalctl@ceph.osd.1.smithi018.stdout:Sep 21 06:29:42 smithi018 sudo[42760]: pam_unix(sudo:session): session closed for user root 2024-09-21T06:29:43.285 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 21 06:29:43 smithi144 sudo[43268]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T06:29:43.285 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 21 06:29:43 smithi144 sudo[43268]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T06:29:43.285 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 21 06:29:43 smithi144 sudo[43268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T06:29:43.285 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 21 06:29:43 smithi144 sudo[43268]: pam_unix(sudo:session): session closed for user root 2024-09-21T06:29:43.285 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 21 06:29:43 smithi144 sudo[43271]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T06:29:43.285 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 21 06:29:43 smithi144 sudo[43271]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T06:29:43.285 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 21 06:29:43 smithi144 sudo[43271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T06:29:43.286 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 21 06:29:43 smithi144 sudo[43271]: pam_unix(sudo:session): session closed for user root 2024-09-21T06:29:43.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:43 smithi144 sudo[43274]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T06:29:43.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:43 smithi144 sudo[43274]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T06:29:43.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:43 smithi144 sudo[43274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T06:29:43.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:43 smithi144 sudo[43274]: pam_unix(sudo:session): session closed for user root 2024-09-21T06:29:43.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:43 smithi144 sudo[43277]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T06:29:43.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:43 smithi144 sudo[43277]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T06:29:43.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:43 smithi144 sudo[43277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T06:29:43.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:43 smithi144 sudo[43277]: pam_unix(sudo:session): session closed for user root 2024-09-21T06:29:43.443 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:43 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T06:29:43.443 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:43 smithi007 ceph-mon[30983]: osdmap e20: 3 total, 3 up, 3 in 2024-09-21T06:29:43.443 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:43 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T06:29:43.443 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:43 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/1556182992' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ddf70d51-404d-491d-a6a8-15fca4ef01db"} : dispatch 2024-09-21T06:29:43.443 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:43 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T06:29:43.443 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:43 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/1556182992' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ddf70d51-404d-491d-a6a8-15fca4ef01db"}]': finished 2024-09-21T06:29:43.443 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:43 smithi007 ceph-mon[30983]: osdmap e21: 4 total, 3 up, 4 in 2024-09-21T06:29:43.443 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:43 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:29:43.443 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:43 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:29:43.443 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:43 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:29:43.443 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:43 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:29:43.443 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:43 smithi007 ceph-mon[30983]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T06:29:43.444 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:43 smithi007 ceph-mon[30983]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T06:29:43.444 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:43 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:29:43.444 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:43 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:29:43.444 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:43 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:29:43.444 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:43 smithi007 ceph-mon[30983]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T06:29:43.444 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:43 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:29:43.444 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:43 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:29:43.444 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:43 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:29:43.444 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:43 smithi007 ceph-mon[30983]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T06:29:43.444 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:43 smithi007 ceph-mon[30983]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T06:29:43.444 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:43 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:29:43.444 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:43 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:29:43.444 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:43 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:29:43.444 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:43 smithi007 ceph-mon[30983]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T06:29:43.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:43 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T06:29:43.620 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:43 smithi018 ceph-mon[34477]: osdmap e20: 3 total, 3 up, 3 in 2024-09-21T06:29:43.620 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:43 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T06:29:43.620 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:43 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/1556182992' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ddf70d51-404d-491d-a6a8-15fca4ef01db"} : dispatch 2024-09-21T06:29:43.620 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:43 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T06:29:43.620 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:43 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/1556182992' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ddf70d51-404d-491d-a6a8-15fca4ef01db"}]': finished 2024-09-21T06:29:43.620 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:43 smithi018 ceph-mon[34477]: osdmap e21: 4 total, 3 up, 4 in 2024-09-21T06:29:43.620 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:43 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:29:43.620 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:43 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:29:43.620 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:43 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:29:43.620 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:43 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:29:43.620 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:43 smithi018 ceph-mon[34477]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T06:29:43.620 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:43 smithi018 ceph-mon[34477]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T06:29:43.621 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:43 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:29:43.621 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:43 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:29:43.621 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:43 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:29:43.621 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:43 smithi018 ceph-mon[34477]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T06:29:43.621 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:43 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:29:43.621 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:43 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:29:43.621 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:43 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:29:43.621 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:43 smithi018 ceph-mon[34477]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T06:29:43.621 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:43 smithi018 ceph-mon[34477]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T06:29:43.621 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:43 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:29:43.621 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:43 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:29:43.621 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:43 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:29:43.621 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:43 smithi018 ceph-mon[34477]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T06:29:43.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:43 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T06:29:43.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:43 smithi144 ceph-mon[34653]: osdmap e20: 3 total, 3 up, 3 in 2024-09-21T06:29:43.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:43 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T06:29:43.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:43 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/1556182992' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ddf70d51-404d-491d-a6a8-15fca4ef01db"} : dispatch 2024-09-21T06:29:43.786 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:43 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T06:29:43.786 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:43 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/1556182992' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ddf70d51-404d-491d-a6a8-15fca4ef01db"}]': finished 2024-09-21T06:29:43.786 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:43 smithi144 ceph-mon[34653]: osdmap e21: 4 total, 3 up, 4 in 2024-09-21T06:29:43.786 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:43 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:29:43.786 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:43 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:29:43.786 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:43 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:29:43.786 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:43 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:29:43.786 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:43 smithi144 ceph-mon[34653]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T06:29:43.786 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:43 smithi144 ceph-mon[34653]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T06:29:43.786 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:43 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:29:43.786 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:43 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:29:43.786 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:43 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:29:43.786 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:43 smithi144 ceph-mon[34653]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T06:29:43.786 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:43 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:29:43.787 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:43 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:29:43.787 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:43 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:29:43.787 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:43 smithi144 ceph-mon[34653]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T06:29:43.787 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:43 smithi144 ceph-mon[34653]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T06:29:43.787 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:43 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T06:29:43.787 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:43 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T06:29:43.787 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:43 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T06:29:43.787 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:43 smithi144 ceph-mon[34653]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T06:29:44.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:29:44.083+0000 7f3f837fe640 1 -- 172.21.15.7:0/1690437247 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mgrmap(e 21) ==== 154528+0+0 (secure 0 0 0) 0x7f3f8410c080 con 0x7f3f941049b0 2024-09-21T06:29:44.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:44 smithi007 ceph-mon[30983]: pgmap v69: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:29:44.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:44 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2782991606' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:29:44.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:44 smithi007 ceph-mon[30983]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T06:29:44.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:44 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:29:44.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:44 smithi007 ceph-mon[30983]: mgrmap e21: x(active, since 2m), standbys: z, y 2024-09-21T06:29:44.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:44 smithi018 ceph-mon[34477]: pgmap v69: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:29:44.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:44 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/2782991606' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:29:44.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:44 smithi018 ceph-mon[34477]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T06:29:44.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:44 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:29:44.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:44 smithi018 ceph-mon[34477]: mgrmap e21: x(active, since 2m), standbys: z, y 2024-09-21T06:29:44.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:44 smithi144 ceph-mon[34653]: pgmap v69: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:29:44.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:44 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/2782991606' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:29:44.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:44 smithi144 ceph-mon[34653]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T06:29:44.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:44 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:29:44.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:44 smithi144 ceph-mon[34653]: mgrmap e21: x(active, since 2m), standbys: z, y 2024-09-21T06:29:46.589 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:46 smithi007 ceph-mon[30983]: pgmap v71: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:29:46.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:46 smithi018 ceph-mon[34477]: pgmap v71: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:29:46.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:46 smithi144 ceph-mon[34653]: pgmap v71: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:29:48.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:48 smithi007 ceph-mon[30983]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:29:48.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:48 smithi018 ceph-mon[34477]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:29:48.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:48 smithi144 ceph-mon[34653]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:29:50.495 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:50 smithi007 ceph-mon[30983]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:29:50.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:50 smithi018 ceph-mon[34477]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:29:50.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:50 smithi144 ceph-mon[34653]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:29:52.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:52 smithi007 ceph-mon[30983]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:29:52.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:52 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T06:29:52.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:52 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:29:52.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:52 smithi007 ceph-mon[30983]: Deploying daemon osd.3 on smithi007 2024-09-21T06:29:52.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:52 smithi018 ceph-mon[34477]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:29:52.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:52 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T06:29:52.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:52 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:29:52.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:52 smithi018 ceph-mon[34477]: Deploying daemon osd.3 on smithi007 2024-09-21T06:29:52.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:52 smithi144 ceph-mon[34653]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:29:52.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:52 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T06:29:52.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:52 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:29:52.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:52 smithi144 ceph-mon[34653]: Deploying daemon osd.3 on smithi007 2024-09-21T06:29:54.559 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:54 smithi007 ceph-mon[30983]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:29:54.587 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:54 smithi144 ceph-mon[34653]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:29:54.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:54 smithi018 ceph-mon[34477]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:29:56.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:56 smithi007 ceph-mon[30983]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:29:56.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:56 smithi018 ceph-mon[34477]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:29:56.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:56 smithi144 ceph-mon[34653]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:29:58.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:58 smithi007 ceph-mon[30983]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:29:58.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:58 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:29:58.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:58 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:29:58.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:29:58 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:29:58.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:58 smithi018 ceph-mon[34477]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:29:58.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:58 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:29:58.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:58 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:29:58.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:29:58 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:29:58.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:58 smithi144 ceph-mon[34653]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:29:58.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:58 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:29:58.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:58 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:29:58.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:29:58 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:00.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:00 smithi007 ceph-mon[30983]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:30:00.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:00 smithi007 ceph-mon[30983]: overall HEALTH_OK 2024-09-21T06:30:00.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:00 smithi018 ceph-mon[34477]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:30:00.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:00 smithi018 ceph-mon[34477]: overall HEALTH_OK 2024-09-21T06:30:00.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:00 smithi144 ceph-mon[34653]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:30:00.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:00 smithi144 ceph-mon[34653]: overall HEALTH_OK 2024-09-21T06:30:01.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:01 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:01.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:01 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:01.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:01 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:30:01.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:01 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:30:01.835 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:01 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:02.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:01 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:02.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:01 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:02.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:01 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:30:02.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:01 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:30:02.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:01 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:02.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:01 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:02.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:01 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:02.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:01 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:30:02.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:01 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:30:02.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:01 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:02.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:30:02.167+0000 7f3f837fe640 1 -- 172.21.15.7:0/1690437247 <== mgr.14223 v2:172.21.15.7:6800/3442812985 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f3f94063800 con 0x7f3f7c0b64d0 2024-09-21T06:30:02.169 INFO:teuthology.orchestra.run.smithi007.stdout:Created osd(s) 3 on host 'smithi007' 2024-09-21T06:30:02.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:30:02.170+0000 7f3f98d56640 1 -- 172.21.15.7:0/1690437247 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f3f7c0b64d0 msgr2=0x7f3f7c0b89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:02.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:30:02.170+0000 7f3f98d56640 1 --2- 172.21.15.7:0/1690437247 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f3f7c0b64d0 0x7f3f7c0b89e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3f94102410 tx=0x7f3f8800b410 comp rx=0 tx=0).stop 2024-09-21T06:30:02.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:30:02.170+0000 7f3f98d56640 1 -- 172.21.15.7:0/1690437247 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f941049b0 msgr2=0x7f3f9419a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:02.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:30:02.170+0000 7f3f98d56640 1 --2- 172.21.15.7:0/1690437247 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f941049b0 0x7f3f9419a4c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f3f84006010 tx=0x7f3f84004060 comp rx=0 tx=0).stop 2024-09-21T06:30:02.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:30:02.170+0000 7f3f98d56640 1 -- 172.21.15.7:0/1690437247 shutdown_connections 2024-09-21T06:30:02.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:30:02.170+0000 7f3f98d56640 1 --2- 172.21.15.7:0/1690437247 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f3f7c0b64d0 0x7f3f7c0b89e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:02.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:30:02.170+0000 7f3f98d56640 1 --2- 172.21.15.7:0/1690437247 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f9410de10 0x7f3f9419fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:02.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:30:02.170+0000 7f3f98d56640 1 --2- 172.21.15.7:0/1690437247 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f94105300 0x7f3f9419aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:02.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:30:02.170+0000 7f3f98d56640 1 --2- 172.21.15.7:0/1690437247 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f941049b0 0x7f3f9419a4c0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:02.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:30:02.170+0000 7f3f98d56640 1 -- 172.21.15.7:0/1690437247 >> 172.21.15.7:0/1690437247 conn(0x7f3f94079730 msgr2=0x7f3f94100770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:02.172 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:30:02.170+0000 7f3f98d56640 1 -- 172.21.15.7:0/1690437247 shutdown_connections 2024-09-21T06:30:02.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:30:02.170+0000 7f3f98d56640 1 -- 172.21.15.7:0/1690437247 wait complete. 2024-09-21T06:30:02.772 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:02 smithi007 ceph-mon[30983]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:30:02.773 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:02 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:30:02.773 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:02 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:02.773 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:02 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:02.800 DEBUG:teuthology.orchestra.run.smithi007:osd.3> sudo journalctl -f -n 0 -u ceph-347cb918-77e2-11ef-baf5-efdc52797490@osd.3.service 2024-09-21T06:30:02.803 INFO:tasks.cephadm:Deploying osd.4 on smithi018 with /dev/vg_nvme/lv_3... 2024-09-21T06:30:02.803 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T06:30:03.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:02 smithi144 ceph-mon[34653]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:30:03.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:02 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:30:03.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:02 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:03.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:02 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:03.063 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T06:30:03.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:02 smithi018 ceph-mon[34477]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:30:03.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:02 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:30:03.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:02 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:03.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:02 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:04.287 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 21 06:30:04 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-3[54169]: 2024-09-21T06:30:04.119+0000 7f10193c1640 -1 osd.3 0 log_to_monitors true 2024-09-21T06:30:04.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:04 smithi018 ceph-mon[34477]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:30:04.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:04 smithi018 ceph-mon[34477]: from='osd.3 [v2:172.21.15.7:6810/3202935163,v1:172.21.15.7:6811/3202935163]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T06:30:04.996 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:04 smithi007 ceph-mon[30983]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:30:04.996 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:04 smithi007 ceph-mon[30983]: from='osd.3 [v2:172.21.15.7:6810/3202935163,v1:172.21.15.7:6811/3202935163]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T06:30:05.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:04 smithi144 ceph-mon[34653]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:30:05.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:04 smithi144 ceph-mon[34653]: from='osd.3 [v2:172.21.15.7:6810/3202935163,v1:172.21.15.7:6811/3202935163]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T06:30:05.731 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T06:30:05.758 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi018:vg_nvme/lv_3 2024-09-21T06:30:06.009 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T06:30:06.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:05 smithi144 ceph-mon[34653]: from='osd.3 [v2:172.21.15.7:6810/3202935163,v1:172.21.15.7:6811/3202935163]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T06:30:06.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:05 smithi144 ceph-mon[34653]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T06:30:06.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:05 smithi144 ceph-mon[34653]: from='osd.3 [v2:172.21.15.7:6810/3202935163,v1:172.21.15.7:6811/3202935163]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi007", "root=default"]} : dispatch 2024-09-21T06:30:06.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:05 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:30:06.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:05 smithi144 ceph-mon[34653]: from='osd.3 [v2:172.21.15.7:6810/3202935163,v1:172.21.15.7:6811/3202935163]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-09-21T06:30:06.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:05 smithi007 ceph-mon[30983]: from='osd.3 [v2:172.21.15.7:6810/3202935163,v1:172.21.15.7:6811/3202935163]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T06:30:06.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:05 smithi007 ceph-mon[30983]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T06:30:06.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:05 smithi007 ceph-mon[30983]: from='osd.3 [v2:172.21.15.7:6810/3202935163,v1:172.21.15.7:6811/3202935163]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi007", "root=default"]} : dispatch 2024-09-21T06:30:06.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:05 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:30:06.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:05 smithi007 ceph-mon[30983]: from='osd.3 [v2:172.21.15.7:6810/3202935163,v1:172.21.15.7:6811/3202935163]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-09-21T06:30:06.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:05 smithi018 ceph-mon[34477]: from='osd.3 [v2:172.21.15.7:6810/3202935163,v1:172.21.15.7:6811/3202935163]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T06:30:06.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:05 smithi018 ceph-mon[34477]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T06:30:06.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:05 smithi018 ceph-mon[34477]: from='osd.3 [v2:172.21.15.7:6810/3202935163,v1:172.21.15.7:6811/3202935163]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi007", "root=default"]} : dispatch 2024-09-21T06:30:06.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:05 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:30:06.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:05 smithi018 ceph-mon[34477]: from='osd.3 [v2:172.21.15.7:6810/3202935163,v1:172.21.15.7:6811/3202935163]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-09-21T06:30:06.430 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 21 06:30:06 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-3[54169]: 2024-09-21T06:30:06.128+0000 7f1015343640 -1 osd.3 0 waiting for initial osdmap 2024-09-21T06:30:06.431 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 21 06:30:06 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-3[54169]: 2024-09-21T06:30:06.133+0000 7f100d139640 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T06:30:06.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:30:06.505+0000 7fe611264640 1 -- 172.21.15.18:0/1819128155 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe60c104860 msgr2=0x7fe60c104c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:06.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:30:06.505+0000 7fe611264640 1 --2- 172.21.15.18:0/1819128155 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe60c104860 0x7fe60c104c70 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc009ca0 tx=0x7fe5fc02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:30:06.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:30:06.505+0000 7fe611264640 1 -- 172.21.15.18:0/1819128155 shutdown_connections 2024-09-21T06:30:06.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:30:06.505+0000 7fe611264640 1 --2- 172.21.15.18:0/1819128155 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe60c10de10 0x7fe60c1102f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:06.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:30:06.505+0000 7fe611264640 1 --2- 172.21.15.18:0/1819128155 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe60c105290 0x7fe60c10d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:06.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:30:06.505+0000 7fe611264640 1 --2- 172.21.15.18:0/1819128155 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe60c104860 0x7fe60c104c70 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:06.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:30:06.505+0000 7fe611264640 1 -- 172.21.15.18:0/1819128155 >> 172.21.15.18:0/1819128155 conn(0x7fe60c079730 msgr2=0x7fe60c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:06.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:30:06.505+0000 7fe611264640 1 -- 172.21.15.18:0/1819128155 shutdown_connections 2024-09-21T06:30:06.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:30:06.505+0000 7fe611264640 1 -- 172.21.15.18:0/1819128155 wait complete. 2024-09-21T06:30:06.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:30:06.506+0000 7fe611264640 1 Processor -- start 2024-09-21T06:30:06.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:30:06.506+0000 7fe611264640 1 -- start start 2024-09-21T06:30:06.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:30:06.506+0000 7fe611264640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe60c104860 0x7fe60c19a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:06.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:30:06.506+0000 7fe611264640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe60c105290 0x7fe60c19ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:06.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:30:06.506+0000 7fe611264640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe60c10de10 0x7fe60c19fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:06.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:30:06.506+0000 7fe611264640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe60c113a80 con 0x7fe60c104860 2024-09-21T06:30:06.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:30:06.506+0000 7fe611264640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe60c113900 con 0x7fe60c10de10 2024-09-21T06:30:06.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:30:06.506+0000 7fe611264640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe60c113c00 con 0x7fe60c105290 2024-09-21T06:30:06.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:30:06.506+0000 7fe60b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe60c10de10 0x7fe60c19fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:06.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:30:06.506+0000 7fe60b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe60c10de10 0x7fe60c19fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50854/0 (socket says 172.21.15.18:50854) 2024-09-21T06:30:06.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:30:06.507+0000 7fe60b7fe640 1 -- 172.21.15.18:0/2398262759 learned_addr learned my addr 172.21.15.18:0/2398262759 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T06:30:06.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:30:06.507+0000 7fe60affd640 1 --2- 172.21.15.18:0/2398262759 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe60c104860 0x7fe60c19a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:06.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:30:06.507+0000 7fe60a7fc640 1 --2- 172.21.15.18:0/2398262759 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe60c105290 0x7fe60c19ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:06.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:30:06.507+0000 7fe60b7fe640 1 -- 172.21.15.18:0/2398262759 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe60c105290 msgr2=0x7fe60c19ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:06.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:30:06.507+0000 7fe60b7fe640 1 --2- 172.21.15.18:0/2398262759 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe60c105290 0x7fe60c19ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:06.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:30:06.507+0000 7fe60b7fe640 1 -- 172.21.15.18:0/2398262759 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe60c104860 msgr2=0x7fe60c19a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:06.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:30:06.507+0000 7fe60b7fe640 1 --2- 172.21.15.18:0/2398262759 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe60c104860 0x7fe60c19a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:06.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:30:06.507+0000 7fe60b7fe640 1 -- 172.21.15.18:0/2398262759 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe60c1a0500 con 0x7fe60c10de10 2024-09-21T06:30:06.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:30:06.507+0000 7fe60affd640 1 --2- 172.21.15.18:0/2398262759 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe60c104860 0x7fe60c19a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:30:06.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:30:06.507+0000 7fe60b7fe640 1 --2- 172.21.15.18:0/2398262759 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe60c10de10 0x7fe60c19fdd0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe60400d750 tx=0x7fe60400dc10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:06.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:30:06.507+0000 7fe603fff640 1 -- 172.21.15.18:0/2398262759 <== mon.2 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe604017070 con 0x7fe60c10de10 2024-09-21T06:30:06.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:30:06.507+0000 7fe611264640 1 -- 172.21.15.18:0/2398262759 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe60c1a07f0 con 0x7fe60c10de10 2024-09-21T06:30:06.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:30:06.507+0000 7fe603fff640 1 -- 172.21.15.18:0/2398262759 <== mon.2 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe6040054d0 con 0x7fe60c10de10 2024-09-21T06:30:06.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:30:06.507+0000 7fe603fff640 1 -- 172.21.15.18:0/2398262759 <== mon.2 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe604004c60 con 0x7fe60c10de10 2024-09-21T06:30:06.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:30:06.507+0000 7fe611264640 1 -- 172.21.15.18:0/2398262759 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe60c1a6f50 con 0x7fe60c10de10 2024-09-21T06:30:06.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:30:06.509+0000 7fe611264640 1 -- 172.21.15.18:0/2398262759 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe60c104c70 con 0x7fe60c10de10 2024-09-21T06:30:06.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:30:06.510+0000 7fe603fff640 1 -- 172.21.15.18:0/2398262759 <== mon.2 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 21) ==== 154528+0+0 (secure 0 0 0) 0x7fe604009bd0 con 0x7fe60c10de10 2024-09-21T06:30:06.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:30:06.511+0000 7fe603fff640 1 --2- 172.21.15.18:0/2398262759 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fe5f80b6560 0x7fe5f80b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:06.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:30:06.511+0000 7fe603fff640 1 -- 172.21.15.18:0/2398262759 <== mon.2 v2:172.21.15.18:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 3604+0+0 (secure 0 0 0) 0x7fe6040e5da0 con 0x7fe60c10de10 2024-09-21T06:30:06.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:30:06.511+0000 7fe60affd640 1 --2- 172.21.15.18:0/2398262759 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fe5f80b6560 0x7fe5f80b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:06.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:30:06.512+0000 7fe60affd640 1 --2- 172.21.15.18:0/2398262759 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fe5f80b6560 0x7fe5f80b8a70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc005e30 tx=0x7fe5fc009360 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:06.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:30:06.514+0000 7fe603fff640 1 -- 172.21.15.18:0/2398262759 <== mon.2 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe6040b1c70 con 0x7fe60c10de10 2024-09-21T06:30:06.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:30:06.718+0000 7fe611264640 1 -- 172.21.15.18:0/2398262759 --> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fe60c063800 con 0x7fe5f80b6560 2024-09-21T06:30:07.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:06 smithi144 ceph-mon[34653]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:30:07.036 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:06 smithi144 ceph-mon[34653]: osdmap e24: 4 total, 3 up, 4 in 2024-09-21T06:30:07.036 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:06 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:30:07.036 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:06 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:30:07.036 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:06 smithi144 ceph-mon[34653]: Detected new or changed devices on smithi007 2024-09-21T06:30:07.036 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:06 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:07.036 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:06 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:07.036 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:06 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T06:30:07.036 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:06 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T06:30:07.036 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:06 smithi144 ceph-mon[34653]: Adjusting osd_memory_target on smithi007 to 8546M 2024-09-21T06:30:07.036 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:06 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:07.036 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:06 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:30:07.036 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:06 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:30:07.037 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:06 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:07.037 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:06 smithi144 ceph-mon[34653]: from='osd.3 [v2:172.21.15.7:6810/3202935163,v1:172.21.15.7:6811/3202935163]' entity='osd.3' 2024-09-21T06:30:07.037 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:06 smithi144 ceph-mon[34653]: osd.3 [v2:172.21.15.7:6810/3202935163,v1:172.21.15.7:6811/3202935163] boot 2024-09-21T06:30:07.037 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:06 smithi144 ceph-mon[34653]: osdmap e25: 4 total, 4 up, 4 in 2024-09-21T06:30:07.037 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:06 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:30:07.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:06 smithi007 ceph-mon[30983]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:30:07.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:06 smithi007 ceph-mon[30983]: osdmap e24: 4 total, 3 up, 4 in 2024-09-21T06:30:07.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:06 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:30:07.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:06 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:30:07.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:06 smithi007 ceph-mon[30983]: Detected new or changed devices on smithi007 2024-09-21T06:30:07.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:06 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:07.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:06 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:07.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:06 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T06:30:07.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:06 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T06:30:07.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:06 smithi007 ceph-mon[30983]: Adjusting osd_memory_target on smithi007 to 8546M 2024-09-21T06:30:07.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:06 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:07.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:06 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:30:07.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:06 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:30:07.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:06 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:07.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:06 smithi007 ceph-mon[30983]: from='osd.3 [v2:172.21.15.7:6810/3202935163,v1:172.21.15.7:6811/3202935163]' entity='osd.3' 2024-09-21T06:30:07.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:06 smithi007 ceph-mon[30983]: osd.3 [v2:172.21.15.7:6810/3202935163,v1:172.21.15.7:6811/3202935163] boot 2024-09-21T06:30:07.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:06 smithi007 ceph-mon[30983]: osdmap e25: 4 total, 4 up, 4 in 2024-09-21T06:30:07.092 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:06 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:30:07.098 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:06 smithi018 ceph-mon[34477]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T06:30:07.098 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:06 smithi018 ceph-mon[34477]: osdmap e24: 4 total, 3 up, 4 in 2024-09-21T06:30:07.098 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:06 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:30:07.098 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:06 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:30:07.099 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:06 smithi018 ceph-mon[34477]: Detected new or changed devices on smithi007 2024-09-21T06:30:07.099 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:06 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:07.099 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:06 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:07.099 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:06 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T06:30:07.099 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:06 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T06:30:07.099 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:06 smithi018 ceph-mon[34477]: Adjusting osd_memory_target on smithi007 to 8546M 2024-09-21T06:30:07.099 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:06 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:07.099 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:06 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:30:07.099 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:06 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:30:07.099 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:06 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:07.099 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:06 smithi018 ceph-mon[34477]: from='osd.3 [v2:172.21.15.7:6810/3202935163,v1:172.21.15.7:6811/3202935163]' entity='osd.3' 2024-09-21T06:30:07.100 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:06 smithi018 ceph-mon[34477]: osd.3 [v2:172.21.15.7:6810/3202935163,v1:172.21.15.7:6811/3202935163] boot 2024-09-21T06:30:07.100 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:06 smithi018 ceph-mon[34477]: osdmap e25: 4 total, 4 up, 4 in 2024-09-21T06:30:07.100 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:06 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T06:30:08.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:07 smithi144 ceph-mon[34653]: purged_snaps scrub starts 2024-09-21T06:30:08.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:07 smithi144 ceph-mon[34653]: purged_snaps scrub ok 2024-09-21T06:30:08.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:07 smithi144 ceph-mon[34653]: from='client.24401 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:30:08.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:07 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:30:08.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:07 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:30:08.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:07 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:30:08.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:07 smithi144 ceph-mon[34653]: osdmap e26: 4 total, 4 up, 4 in 2024-09-21T06:30:08.061 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:07 smithi018 ceph-mon[34477]: purged_snaps scrub starts 2024-09-21T06:30:08.061 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:07 smithi018 ceph-mon[34477]: purged_snaps scrub ok 2024-09-21T06:30:08.061 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:07 smithi018 ceph-mon[34477]: from='client.24401 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:30:08.061 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:07 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:30:08.061 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:07 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:30:08.061 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:07 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:30:08.062 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:07 smithi018 ceph-mon[34477]: osdmap e26: 4 total, 4 up, 4 in 2024-09-21T06:30:08.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:07 smithi007 ceph-mon[30983]: purged_snaps scrub starts 2024-09-21T06:30:08.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:07 smithi007 ceph-mon[30983]: purged_snaps scrub ok 2024-09-21T06:30:08.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:07 smithi007 ceph-mon[30983]: from='client.24401 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:30:08.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:07 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:30:08.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:07 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:30:08.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:07 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:30:08.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:07 smithi007 ceph-mon[30983]: osdmap e26: 4 total, 4 up, 4 in 2024-09-21T06:30:09.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:08 smithi144 ceph-mon[34653]: pgmap v85: 1 pgs: 1 peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:30:09.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:08 smithi144 ceph-mon[34653]: osdmap e27: 4 total, 4 up, 4 in 2024-09-21T06:30:09.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:08 smithi007 ceph-mon[30983]: pgmap v85: 1 pgs: 1 peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:30:09.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:08 smithi007 ceph-mon[30983]: osdmap e27: 4 total, 4 up, 4 in 2024-09-21T06:30:09.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:08 smithi018 ceph-mon[34477]: pgmap v85: 1 pgs: 1 peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:30:09.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:08 smithi018 ceph-mon[34477]: osdmap e27: 4 total, 4 up, 4 in 2024-09-21T06:30:10.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:09 smithi144 ceph-mon[34653]: from='client.? 172.21.15.18:0/2735117663' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f2ae4340-accf-4ac0-a4d3-c08302712ce1"} : dispatch 2024-09-21T06:30:10.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:09 smithi144 ceph-mon[34653]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f2ae4340-accf-4ac0-a4d3-c08302712ce1"} : dispatch 2024-09-21T06:30:10.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:09 smithi144 ceph-mon[34653]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f2ae4340-accf-4ac0-a4d3-c08302712ce1"}]': finished 2024-09-21T06:30:10.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:09 smithi144 ceph-mon[34653]: osdmap e28: 5 total, 4 up, 5 in 2024-09-21T06:30:10.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:09 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:30:10.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:09 smithi007 ceph-mon[30983]: from='client.? 172.21.15.18:0/2735117663' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f2ae4340-accf-4ac0-a4d3-c08302712ce1"} : dispatch 2024-09-21T06:30:10.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:09 smithi007 ceph-mon[30983]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f2ae4340-accf-4ac0-a4d3-c08302712ce1"} : dispatch 2024-09-21T06:30:10.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:09 smithi007 ceph-mon[30983]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f2ae4340-accf-4ac0-a4d3-c08302712ce1"}]': finished 2024-09-21T06:30:10.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:09 smithi007 ceph-mon[30983]: osdmap e28: 5 total, 4 up, 5 in 2024-09-21T06:30:10.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:09 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:30:10.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:09 smithi018 ceph-mon[34477]: from='client.? 172.21.15.18:0/2735117663' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f2ae4340-accf-4ac0-a4d3-c08302712ce1"} : dispatch 2024-09-21T06:30:10.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:09 smithi018 ceph-mon[34477]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f2ae4340-accf-4ac0-a4d3-c08302712ce1"} : dispatch 2024-09-21T06:30:10.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:09 smithi018 ceph-mon[34477]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f2ae4340-accf-4ac0-a4d3-c08302712ce1"}]': finished 2024-09-21T06:30:10.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:09 smithi018 ceph-mon[34477]: osdmap e28: 5 total, 4 up, 5 in 2024-09-21T06:30:10.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:09 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:30:11.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:10 smithi144 ceph-mon[34653]: pgmap v88: 1 pgs: 1 peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:30:11.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:10 smithi144 ceph-mon[34653]: from='client.? 172.21.15.18:0/319532570' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:30:11.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:10 smithi007 ceph-mon[30983]: pgmap v88: 1 pgs: 1 peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:30:11.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:10 smithi007 ceph-mon[30983]: from='client.? 172.21.15.18:0/319532570' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:30:11.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:10 smithi018 ceph-mon[34477]: pgmap v88: 1 pgs: 1 peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:30:11.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:10 smithi018 ceph-mon[34477]: from='client.? 172.21.15.18:0/319532570' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:30:13.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:12 smithi144 ceph-mon[34653]: pgmap v90: 1 pgs: 1 peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:30:13.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:12 smithi007 ceph-mon[30983]: pgmap v90: 1 pgs: 1 peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:30:13.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:12 smithi018 ceph-mon[34477]: pgmap v90: 1 pgs: 1 peering; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:30:14.795 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:14 smithi018 ceph-mon[34477]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T06:30:15.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:14 smithi144 ceph-mon[34653]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T06:30:15.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:14 smithi007 ceph-mon[30983]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T06:30:16.850 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:16 smithi018 ceph-mon[34477]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-09-21T06:30:17.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:16 smithi144 ceph-mon[34653]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-09-21T06:30:17.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:16 smithi007 ceph-mon[30983]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-09-21T06:30:17.994 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:17 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T06:30:17.994 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:17 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:30:18.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:17 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T06:30:18.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:17 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:30:18.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:17 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T06:30:18.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:17 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:30:19.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:18 smithi144 ceph-mon[34653]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-09-21T06:30:19.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:18 smithi144 ceph-mon[34653]: Deploying daemon osd.4 on smithi018 2024-09-21T06:30:19.048 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:18 smithi018 ceph-mon[34477]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-09-21T06:30:19.048 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:18 smithi018 ceph-mon[34477]: Deploying daemon osd.4 on smithi018 2024-09-21T06:30:19.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:18 smithi007 ceph-mon[30983]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-09-21T06:30:19.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:18 smithi007 ceph-mon[30983]: Deploying daemon osd.4 on smithi018 2024-09-21T06:30:21.004 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:20 smithi018 ceph-mon[34477]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T06:30:21.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:20 smithi144 ceph-mon[34653]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T06:30:21.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:20 smithi007 ceph-mon[30983]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T06:30:23.021 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:22 smithi018 ceph-mon[34477]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:30:23.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:22 smithi144 ceph-mon[34653]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:30:23.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:22 smithi007 ceph-mon[30983]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:30:24.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:23 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:30:24.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:23 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:24.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:23 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:24.081 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:23 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:30:24.081 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:23 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:24.081 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:23 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:24.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:23 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:30:24.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:23 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:24.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:23 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:24.991 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:24 smithi007 ceph-mon[30983]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:30:25.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:24 smithi144 ceph-mon[34653]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:30:25.056 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:24 smithi018 ceph-mon[34477]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:30:26.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:26 smithi018 ceph-mon[34477]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:30:26.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:26 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:26.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:26 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:26.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:26 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:30:26.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:26 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:30:26.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:26 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:27.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:26 smithi144 ceph-mon[34653]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:30:27.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:26 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:27.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:26 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:27.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:26 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:30:27.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:26 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:30:27.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:26 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:27.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:26 smithi007 ceph-mon[30983]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:30:27.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:26 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:27.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:26 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:27.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:26 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:30:27.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:26 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:30:27.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:26 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:27.314 INFO:teuthology.orchestra.run.smithi018.stdout:Created osd(s) 4 on host 'smithi018' 2024-09-21T06:30:27.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:30:27.311+0000 7fe603fff640 1 -- 172.21.15.18:0/2398262759 <== mgr.14223 v2:172.21.15.7:6800/3442812985 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe60c063800 con 0x7fe5f80b6560 2024-09-21T06:30:27.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:30:27.314+0000 7fe611264640 1 -- 172.21.15.18:0/2398262759 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fe5f80b6560 msgr2=0x7fe5f80b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:27.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:30:27.314+0000 7fe611264640 1 --2- 172.21.15.18:0/2398262759 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fe5f80b6560 0x7fe5f80b8a70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc005e30 tx=0x7fe5fc009360 comp rx=0 tx=0).stop 2024-09-21T06:30:27.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:30:27.314+0000 7fe611264640 1 -- 172.21.15.18:0/2398262759 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe60c10de10 msgr2=0x7fe60c19fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:27.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:30:27.314+0000 7fe611264640 1 --2- 172.21.15.18:0/2398262759 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe60c10de10 0x7fe60c19fdd0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe60400d750 tx=0x7fe60400dc10 comp rx=0 tx=0).stop 2024-09-21T06:30:27.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:30:27.314+0000 7fe611264640 1 -- 172.21.15.18:0/2398262759 shutdown_connections 2024-09-21T06:30:27.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:30:27.314+0000 7fe611264640 1 --2- 172.21.15.18:0/2398262759 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fe5f80b6560 0x7fe5f80b8a70 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:27.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:30:27.314+0000 7fe611264640 1 --2- 172.21.15.18:0/2398262759 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe60c10de10 0x7fe60c19fdd0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:27.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:30:27.314+0000 7fe611264640 1 --2- 172.21.15.18:0/2398262759 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe60c105290 0x7fe60c19ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:27.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:30:27.314+0000 7fe611264640 1 --2- 172.21.15.18:0/2398262759 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe60c104860 0x7fe60c19a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:27.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:30:27.314+0000 7fe611264640 1 -- 172.21.15.18:0/2398262759 >> 172.21.15.18:0/2398262759 conn(0x7fe60c079730 msgr2=0x7fe60c100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:27.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:30:27.314+0000 7fe611264640 1 -- 172.21.15.18:0/2398262759 shutdown_connections 2024-09-21T06:30:27.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:30:27.314+0000 7fe611264640 1 -- 172.21.15.18:0/2398262759 wait complete. 2024-09-21T06:30:27.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:27 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:30:27.870 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:27 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:27.870 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:27 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:27.948 DEBUG:teuthology.orchestra.run.smithi018:osd.4> sudo journalctl -f -n 0 -u ceph-347cb918-77e2-11ef-baf5-efdc52797490@osd.4.service 2024-09-21T06:30:27.951 INFO:tasks.cephadm:Deploying osd.5 on smithi144 with /dev/vg_nvme/lv_3... 2024-09-21T06:30:27.951 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T06:30:27.982 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:27 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:30:27.982 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:27 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:27.982 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:27 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:28.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:27 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:30:28.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:27 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:28.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:27 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:28.207 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:30:29.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:28 smithi144 ceph-mon[34653]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:30:29.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:28 smithi007 ceph-mon[30983]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:30:29.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:28 smithi018 ceph-mon[34477]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:30:29.739 INFO:journalctl@ceph.osd.4.smithi018.stdout:Sep 21 06:30:29 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-4[45350]: 2024-09-21T06:30:29.533+0000 7f594a3d5640 -1 osd.4 0 log_to_monitors true 2024-09-21T06:30:30.002 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:29 smithi144 ceph-mon[34653]: from='osd.4 [v2:172.21.15.18:6808/1058105724,v1:172.21.15.18:6809/1058105724]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T06:30:30.003 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:29 smithi144 ceph-mon[34653]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T06:30:30.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:29 smithi007 ceph-mon[30983]: from='osd.4 [v2:172.21.15.18:6808/1058105724,v1:172.21.15.18:6809/1058105724]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T06:30:30.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:29 smithi007 ceph-mon[30983]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T06:30:30.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:29 smithi018 ceph-mon[34477]: from='osd.4 [v2:172.21.15.18:6808/1058105724,v1:172.21.15.18:6809/1058105724]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T06:30:30.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:29 smithi018 ceph-mon[34477]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T06:30:30.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:30 smithi018 ceph-mon[34477]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:30:30.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:30 smithi018 ceph-mon[34477]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T06:30:30.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:30 smithi018 ceph-mon[34477]: osdmap e29: 5 total, 4 up, 5 in 2024-09-21T06:30:30.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:30 smithi018 ceph-mon[34477]: from='osd.4 [v2:172.21.15.18:6808/1058105724,v1:172.21.15.18:6809/1058105724]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi018", "root=default"]} : dispatch 2024-09-21T06:30:30.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:30 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:30:30.870 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:30 smithi018 ceph-mon[34477]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi018", "root=default"]} : dispatch 2024-09-21T06:30:30.870 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:30 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:30.870 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:30 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:30.870 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:30 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T06:30:30.870 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:30 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T06:30:30.870 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:30 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:30.870 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:30 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:30:30.870 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:30 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:30:30.870 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:30 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:30.879 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:30 smithi144 ceph-mon[34653]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:30:30.879 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:30 smithi144 ceph-mon[34653]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T06:30:30.879 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:30 smithi144 ceph-mon[34653]: osdmap e29: 5 total, 4 up, 5 in 2024-09-21T06:30:30.879 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:30 smithi144 ceph-mon[34653]: from='osd.4 [v2:172.21.15.18:6808/1058105724,v1:172.21.15.18:6809/1058105724]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi018", "root=default"]} : dispatch 2024-09-21T06:30:30.879 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:30 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:30:30.879 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:30 smithi144 ceph-mon[34653]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi018", "root=default"]} : dispatch 2024-09-21T06:30:30.879 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:30 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:30.879 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:30 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:30.879 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:30 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T06:30:30.879 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:30 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T06:30:30.879 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:30 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:30.879 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:30 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:30:30.879 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:30 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:30:30.880 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:30 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:30.882 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-21T06:30:30.909 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi144:vg_nvme/lv_3 2024-09-21T06:30:31.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:30 smithi007 ceph-mon[30983]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:30:31.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:30 smithi007 ceph-mon[30983]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T06:30:31.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:30 smithi007 ceph-mon[30983]: osdmap e29: 5 total, 4 up, 5 in 2024-09-21T06:30:31.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:30 smithi007 ceph-mon[30983]: from='osd.4 [v2:172.21.15.18:6808/1058105724,v1:172.21.15.18:6809/1058105724]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi018", "root=default"]} : dispatch 2024-09-21T06:30:31.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:30 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:30:31.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:30 smithi007 ceph-mon[30983]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi018", "root=default"]} : dispatch 2024-09-21T06:30:31.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:30 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:31.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:30 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:31.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:30 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T06:30:31.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:30 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T06:30:31.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:30 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:31.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:30 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:30:31.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:30 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:30:31.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:30 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:31.194 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:30:31.619 INFO:journalctl@ceph.osd.4.smithi018.stdout:Sep 21 06:30:31 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-4[45350]: 2024-09-21T06:30:31.170+0000 7f5946357640 -1 osd.4 0 waiting for initial osdmap 2024-09-21T06:30:31.619 INFO:journalctl@ceph.osd.4.smithi018.stdout:Sep 21 06:30:31 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-4[45350]: 2024-09-21T06:30:31.176+0000 7f593e14d640 -1 osd.4 30 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T06:30:31.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:30:31.665+0000 7f5211cc5640 1 -- 172.21.15.144:0/2080451555 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f520c109df0 msgr2=0x7f520c110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:31.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:30:31.665+0000 7f5211cc5640 1 --2- 172.21.15.144:0/2080451555 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f520c109df0 0x7f520c110620 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5204009ca0 tx=0x7f520402a8e0 comp rx=0 tx=0).stop 2024-09-21T06:30:31.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:30:31.665+0000 7f5211cc5640 1 -- 172.21.15.144:0/2080451555 shutdown_connections 2024-09-21T06:30:31.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:30:31.665+0000 7f5211cc5640 1 --2- 172.21.15.144:0/2080451555 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f520c109df0 0x7f520c110620 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:31.667 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:30:31.665+0000 7f5211cc5640 1 --2- 172.21.15.144:0/2080451555 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f520c1094a0 0x7f520c1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:31.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:30:31.665+0000 7f5211cc5640 1 --2- 172.21.15.144:0/2080451555 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f520c103b60 0x7f520c103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:31.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:30:31.665+0000 7f5211cc5640 1 -- 172.21.15.144:0/2080451555 >> 172.21.15.144:0/2080451555 conn(0x7f520c07b850 msgr2=0x7f520c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:31.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:30:31.665+0000 7f5211cc5640 1 -- 172.21.15.144:0/2080451555 shutdown_connections 2024-09-21T06:30:31.668 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:30:31.665+0000 7f5211cc5640 1 -- 172.21.15.144:0/2080451555 wait complete. 2024-09-21T06:30:31.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:30:31.666+0000 7f5211cc5640 1 Processor -- start 2024-09-21T06:30:31.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:30:31.666+0000 7f5211cc5640 1 -- start start 2024-09-21T06:30:31.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:30:31.667+0000 7f5211cc5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f520c103b60 0x7f520c19a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:31.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:30:31.667+0000 7f5211cc5640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f520c1094a0 0x7f520c19aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:31.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:30:31.667+0000 7f5211cc5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f520c109df0 0x7f520c19fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:31.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:30:31.667+0000 7f5211cc5640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f520c113af0 con 0x7f520c109df0 2024-09-21T06:30:31.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:30:31.667+0000 7f5211cc5640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f520c113970 con 0x7f520c103b60 2024-09-21T06:30:31.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:30:31.667+0000 7f5211cc5640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f520c113c70 con 0x7f520c1094a0 2024-09-21T06:30:31.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:30:31.667+0000 7f520affd640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f520c1094a0 0x7f520c19aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:31.670 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:30:31.667+0000 7f520affd640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f520c1094a0 0x7f520c19aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:57732/0 (socket says 172.21.15.144:57732) 2024-09-21T06:30:31.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:30:31.667+0000 7f520affd640 1 -- 172.21.15.144:0/2706080491 learned_addr learned my addr 172.21.15.144:0/2706080491 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-21T06:30:31.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:30:31.667+0000 7f520bfff640 1 --2- 172.21.15.144:0/2706080491 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f520c109df0 0x7f520c19fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:31.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:30:31.667+0000 7f520b7fe640 1 --2- 172.21.15.144:0/2706080491 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f520c103b60 0x7f520c19a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:31.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:30:31.667+0000 7f520affd640 1 -- 172.21.15.144:0/2706080491 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f520c103b60 msgr2=0x7f520c19a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:31.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:30:31.667+0000 7f520affd640 1 --2- 172.21.15.144:0/2706080491 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f520c103b60 0x7f520c19a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:31.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:30:31.667+0000 7f520affd640 1 -- 172.21.15.144:0/2706080491 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f520c109df0 msgr2=0x7f520c19fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:31.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:30:31.667+0000 7f520affd640 1 --2- 172.21.15.144:0/2706080491 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f520c109df0 0x7f520c19fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:31.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:30:31.667+0000 7f520affd640 1 -- 172.21.15.144:0/2706080491 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f520c1a0430 con 0x7f520c1094a0 2024-09-21T06:30:31.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:30:31.667+0000 7f520affd640 1 --2- 172.21.15.144:0/2706080491 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f520c1094a0 0x7f520c19aa60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5200006fd0 tx=0x7f520000b8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:31.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:30:31.667+0000 7f5208ff9640 1 -- 172.21.15.144:0/2706080491 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5200011830 con 0x7f520c1094a0 2024-09-21T06:30:31.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:30:31.667+0000 7f5208ff9640 1 -- 172.21.15.144:0/2706080491 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5200016070 con 0x7f520c1094a0 2024-09-21T06:30:31.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:30:31.668+0000 7f5208ff9640 1 -- 172.21.15.144:0/2706080491 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5200010e00 con 0x7f520c1094a0 2024-09-21T06:30:31.671 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:30:31.668+0000 7f5211cc5640 1 -- 172.21.15.144:0/2706080491 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f520c1a0720 con 0x7f520c1094a0 2024-09-21T06:30:31.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:30:31.668+0000 7f5211cc5640 1 -- 172.21.15.144:0/2706080491 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f520c1a6e80 con 0x7f520c1094a0 2024-09-21T06:30:31.672 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:30:31.669+0000 7f5211cc5640 1 -- 172.21.15.144:0/2706080491 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f520c103f70 con 0x7f520c1094a0 2024-09-21T06:30:31.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:30:31.671+0000 7f5208ff9640 1 -- 172.21.15.144:0/2706080491 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 21) ==== 154528+0+0 (secure 0 0 0) 0x7f52000119d0 con 0x7f520c1094a0 2024-09-21T06:30:31.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:30:31.672+0000 7f5208ff9640 1 --2- 172.21.15.144:0/2706080491 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f51f40b6560 0x7f51f40b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:31.673 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:30:31.672+0000 7f5208ff9640 1 -- 172.21.15.144:0/2706080491 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4036+0+0 (secure 0 0 0) 0x7f52000e5e80 con 0x7f520c1094a0 2024-09-21T06:30:31.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:30:31.672+0000 7f520b7fe640 1 --2- 172.21.15.144:0/2706080491 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f51f40b6560 0x7f51f40b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:31.674 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:30:31.673+0000 7f520b7fe640 1 --2- 172.21.15.144:0/2706080491 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f51f40b6560 0x7f51f40b8a70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f51fc0058c0 tx=0x7f51fc00a4c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:31.677 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:30:31.675+0000 7f5208ff9640 1 -- 172.21.15.144:0/2706080491 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f52000ad7c0 con 0x7f520c1094a0 2024-09-21T06:30:31.874 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:30:31.872+0000 7f5211cc5640 1 -- 172.21.15.144:0/2706080491 --> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f520c063800 con 0x7f51f40b6560 2024-09-21T06:30:31.874 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:31 smithi144 ceph-mon[34653]: Detected new or changed devices on smithi018 2024-09-21T06:30:31.874 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:31 smithi144 ceph-mon[34653]: Adjusting osd_memory_target on smithi018 to 8546M 2024-09-21T06:30:31.874 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:31 smithi144 ceph-mon[34653]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-09-21T06:30:31.874 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:31 smithi144 ceph-mon[34653]: osdmap e30: 5 total, 4 up, 5 in 2024-09-21T06:30:31.874 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:31 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:30:31.874 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:31 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:30:31.874 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:31 smithi144 ceph-mon[34653]: from='osd.4 ' entity='osd.4' 2024-09-21T06:30:32.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:31 smithi007 ceph-mon[30983]: Detected new or changed devices on smithi018 2024-09-21T06:30:32.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:31 smithi007 ceph-mon[30983]: Adjusting osd_memory_target on smithi018 to 8546M 2024-09-21T06:30:32.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:31 smithi007 ceph-mon[30983]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-09-21T06:30:32.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:31 smithi007 ceph-mon[30983]: osdmap e30: 5 total, 4 up, 5 in 2024-09-21T06:30:32.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:31 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:30:32.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:31 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:30:32.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:31 smithi007 ceph-mon[30983]: from='osd.4 ' entity='osd.4' 2024-09-21T06:30:32.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:31 smithi018 ceph-mon[34477]: Detected new or changed devices on smithi018 2024-09-21T06:30:32.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:31 smithi018 ceph-mon[34477]: Adjusting osd_memory_target on smithi018 to 8546M 2024-09-21T06:30:32.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:31 smithi018 ceph-mon[34477]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-09-21T06:30:32.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:31 smithi018 ceph-mon[34477]: osdmap e30: 5 total, 4 up, 5 in 2024-09-21T06:30:32.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:31 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:30:32.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:31 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:30:32.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:31 smithi018 ceph-mon[34477]: from='osd.4 ' entity='osd.4' 2024-09-21T06:30:32.905 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:32 smithi144 ceph-mon[34653]: purged_snaps scrub starts 2024-09-21T06:30:32.905 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:32 smithi144 ceph-mon[34653]: purged_snaps scrub ok 2024-09-21T06:30:32.905 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:32 smithi144 ceph-mon[34653]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:30:32.906 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:32 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:30:32.906 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:32 smithi144 ceph-mon[34653]: from='client.24427 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:30:32.906 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:32 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:30:32.906 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:32 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:30:32.906 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:32 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:30:32.906 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:32 smithi144 ceph-mon[34653]: osd.4 [v2:172.21.15.18:6808/1058105724,v1:172.21.15.18:6809/1058105724] boot 2024-09-21T06:30:32.906 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:32 smithi144 ceph-mon[34653]: osdmap e31: 5 total, 5 up, 5 in 2024-09-21T06:30:32.906 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:32 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:30:33.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:32 smithi007 ceph-mon[30983]: purged_snaps scrub starts 2024-09-21T06:30:33.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:32 smithi007 ceph-mon[30983]: purged_snaps scrub ok 2024-09-21T06:30:33.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:32 smithi007 ceph-mon[30983]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:30:33.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:32 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:30:33.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:32 smithi007 ceph-mon[30983]: from='client.24427 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:30:33.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:32 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:30:33.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:32 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:30:33.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:32 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:30:33.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:32 smithi007 ceph-mon[30983]: osd.4 [v2:172.21.15.18:6808/1058105724,v1:172.21.15.18:6809/1058105724] boot 2024-09-21T06:30:33.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:32 smithi007 ceph-mon[30983]: osdmap e31: 5 total, 5 up, 5 in 2024-09-21T06:30:33.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:32 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:30:33.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:32 smithi018 ceph-mon[34477]: purged_snaps scrub starts 2024-09-21T06:30:33.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:32 smithi018 ceph-mon[34477]: purged_snaps scrub ok 2024-09-21T06:30:33.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:32 smithi018 ceph-mon[34477]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 119 MiB used, 357 GiB / 358 GiB avail 2024-09-21T06:30:33.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:32 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:30:33.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:32 smithi018 ceph-mon[34477]: from='client.24427 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:30:33.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:32 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:30:33.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:32 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:30:33.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:32 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:30:33.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:32 smithi018 ceph-mon[34477]: osd.4 [v2:172.21.15.18:6808/1058105724,v1:172.21.15.18:6809/1058105724] boot 2024-09-21T06:30:33.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:32 smithi018 ceph-mon[34477]: osdmap e31: 5 total, 5 up, 5 in 2024-09-21T06:30:33.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:32 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T06:30:34.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:34 smithi144 ceph-mon[34653]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:30:34.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:34 smithi144 ceph-mon[34653]: osdmap e32: 5 total, 5 up, 5 in 2024-09-21T06:30:34.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:34 smithi007 ceph-mon[30983]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:30:34.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:34 smithi007 ceph-mon[30983]: osdmap e32: 5 total, 5 up, 5 in 2024-09-21T06:30:34.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:34 smithi018 ceph-mon[34477]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:30:34.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:34 smithi018 ceph-mon[34477]: osdmap e32: 5 total, 5 up, 5 in 2024-09-21T06:30:35.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:35 smithi144 ceph-mon[34653]: from='client.? 172.21.15.144:0/2593943641' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d56abc37-de6f-47a4-9f5e-67224da78f4c"} : dispatch 2024-09-21T06:30:35.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:35 smithi144 ceph-mon[34653]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d56abc37-de6f-47a4-9f5e-67224da78f4c"} : dispatch 2024-09-21T06:30:35.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:35 smithi144 ceph-mon[34653]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d56abc37-de6f-47a4-9f5e-67224da78f4c"}]': finished 2024-09-21T06:30:35.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:35 smithi144 ceph-mon[34653]: osdmap e33: 6 total, 5 up, 6 in 2024-09-21T06:30:35.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:35 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T06:30:35.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:35 smithi144 ceph-mon[34653]: from='client.? 172.21.15.144:0/3323566766' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:30:35.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:35 smithi007 ceph-mon[30983]: from='client.? 172.21.15.144:0/2593943641' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d56abc37-de6f-47a4-9f5e-67224da78f4c"} : dispatch 2024-09-21T06:30:35.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:35 smithi007 ceph-mon[30983]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d56abc37-de6f-47a4-9f5e-67224da78f4c"} : dispatch 2024-09-21T06:30:35.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:35 smithi007 ceph-mon[30983]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d56abc37-de6f-47a4-9f5e-67224da78f4c"}]': finished 2024-09-21T06:30:35.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:35 smithi007 ceph-mon[30983]: osdmap e33: 6 total, 5 up, 6 in 2024-09-21T06:30:35.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:35 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T06:30:35.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:35 smithi007 ceph-mon[30983]: from='client.? 172.21.15.144:0/3323566766' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:30:35.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:35 smithi018 ceph-mon[34477]: from='client.? 172.21.15.144:0/2593943641' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d56abc37-de6f-47a4-9f5e-67224da78f4c"} : dispatch 2024-09-21T06:30:35.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:35 smithi018 ceph-mon[34477]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d56abc37-de6f-47a4-9f5e-67224da78f4c"} : dispatch 2024-09-21T06:30:35.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:35 smithi018 ceph-mon[34477]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d56abc37-de6f-47a4-9f5e-67224da78f4c"}]': finished 2024-09-21T06:30:35.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:35 smithi018 ceph-mon[34477]: osdmap e33: 6 total, 5 up, 6 in 2024-09-21T06:30:35.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:35 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T06:30:35.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:35 smithi018 ceph-mon[34477]: from='client.? 172.21.15.144:0/3323566766' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:30:36.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:36 smithi007 ceph-mon[30983]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:30:36.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:36 smithi018 ceph-mon[34477]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:30:36.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:36 smithi144 ceph-mon[34653]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:30:38.589 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:38 smithi007 ceph-mon[30983]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:30:38.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:38 smithi018 ceph-mon[34477]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:30:38.677 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:38 smithi144 ceph-mon[34653]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:30:40.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:40 smithi144 ceph-mon[34653]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:30:40.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:40 smithi007 ceph-mon[30983]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:30:40.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:40 smithi018 ceph-mon[34477]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:30:42.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:42 smithi144 ceph-mon[34653]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:30:42.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:42 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T06:30:42.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:42 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:30:42.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:42 smithi007 ceph-mon[30983]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:30:42.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:42 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T06:30:42.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:42 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:30:42.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:42 smithi018 ceph-mon[34477]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:30:42.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:42 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T06:30:42.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:42 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:30:43.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:43 smithi007 ceph-mon[30983]: Deploying daemon osd.5 on smithi144 2024-09-21T06:30:43.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:43 smithi018 ceph-mon[34477]: Deploying daemon osd.5 on smithi144 2024-09-21T06:30:43.623 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:43 smithi144 ceph-mon[34653]: Deploying daemon osd.5 on smithi144 2024-09-21T06:30:44.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:44 smithi144 ceph-mon[34653]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:30:44.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:44 smithi007 ceph-mon[30983]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:30:44.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:44 smithi018 ceph-mon[34477]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:30:46.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:46 smithi007 ceph-mon[30983]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:30:46.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:46 smithi018 ceph-mon[34477]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:30:46.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:46 smithi144 ceph-mon[34653]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:30:48.589 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:48 smithi007 ceph-mon[30983]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:30:48.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:48 smithi018 ceph-mon[34477]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:30:48.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:48 smithi144 ceph-mon[34653]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:30:49.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:49 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:30:49.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:49 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:49.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:49 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:49.589 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:49 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:30:49.589 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:49 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:49.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:49 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:49.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:49 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:30:49.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:49 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:49.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:49 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:50.724 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:50 smithi144 ceph-mon[34653]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:30:50.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:50 smithi007 ceph-mon[30983]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:30:50.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:50 smithi018 ceph-mon[34477]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:30:52.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:52 smithi144 ceph-mon[34653]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:30:52.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:52 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:52.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:52 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:52.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:52 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:30:52.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:52 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:30:52.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:52 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:52.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:52 smithi007 ceph-mon[30983]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:30:52.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:52 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:52.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:52 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:52.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:52 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:30:52.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:52 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:30:52.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:52 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:52.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:52 smithi018 ceph-mon[34477]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:30:52.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:52 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:52.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:52 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:52.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:52 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:30:52.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:52 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:30:52.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:52 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:52.631 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:30:52.629+0000 7f5208ff9640 1 -- 172.21.15.144:0/2706080491 <== mgr.14223 v2:172.21.15.7:6800/3442812985 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f520c063800 con 0x7f51f40b6560 2024-09-21T06:30:52.632 INFO:teuthology.orchestra.run.smithi144.stdout:Created osd(s) 5 on host 'smithi144' 2024-09-21T06:30:52.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:30:52.632+0000 7f5211cc5640 1 -- 172.21.15.144:0/2706080491 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f51f40b6560 msgr2=0x7f51f40b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:52.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:30:52.632+0000 7f5211cc5640 1 --2- 172.21.15.144:0/2706080491 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f51f40b6560 0x7f51f40b8a70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f51fc0058c0 tx=0x7f51fc00a4c0 comp rx=0 tx=0).stop 2024-09-21T06:30:52.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:30:52.632+0000 7f5211cc5640 1 -- 172.21.15.144:0/2706080491 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f520c1094a0 msgr2=0x7f520c19aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:52.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:30:52.632+0000 7f5211cc5640 1 --2- 172.21.15.144:0/2706080491 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f520c1094a0 0x7f520c19aa60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5200006fd0 tx=0x7f520000b8e0 comp rx=0 tx=0).stop 2024-09-21T06:30:52.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:30:52.632+0000 7f5211cc5640 1 -- 172.21.15.144:0/2706080491 shutdown_connections 2024-09-21T06:30:52.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:30:52.632+0000 7f5211cc5640 1 --2- 172.21.15.144:0/2706080491 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f51f40b6560 0x7f51f40b8a70 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:52.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:30:52.632+0000 7f5211cc5640 1 --2- 172.21.15.144:0/2706080491 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f520c109df0 0x7f520c19fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:52.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:30:52.632+0000 7f5211cc5640 1 --2- 172.21.15.144:0/2706080491 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f520c1094a0 0x7f520c19aa60 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:52.634 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:30:52.632+0000 7f5211cc5640 1 --2- 172.21.15.144:0/2706080491 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f520c103b60 0x7f520c19a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:52.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:30:52.632+0000 7f5211cc5640 1 -- 172.21.15.144:0/2706080491 >> 172.21.15.144:0/2706080491 conn(0x7f520c07b850 msgr2=0x7f520c1074f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:52.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:30:52.632+0000 7f5211cc5640 1 -- 172.21.15.144:0/2706080491 shutdown_connections 2024-09-21T06:30:52.635 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:30:52.632+0000 7f5211cc5640 1 -- 172.21.15.144:0/2706080491 wait complete. 2024-09-21T06:30:53.202 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:53 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:30:53.202 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:53 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:53.202 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:53 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:53.203 DEBUG:teuthology.orchestra.run.smithi144:osd.5> sudo journalctl -f -n 0 -u ceph-347cb918-77e2-11ef-baf5-efdc52797490@osd.5.service 2024-09-21T06:30:53.206 INFO:tasks.cephadm:Deploying osd.6 on smithi007 with /dev/vg_nvme/lv_2... 2024-09-21T06:30:53.206 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T06:30:53.476 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:30:53.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:53 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:30:53.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:53 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:53.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:53 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:53.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:53 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:30:53.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:53 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:53.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:53 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:54.635 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:54 smithi144 ceph-mon[34653]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:30:54.886 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 06:30:54 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-5[45912]: 2024-09-21T06:30:54.633+0000 7f0c6677c640 -1 osd.5 0 log_to_monitors true 2024-09-21T06:30:54.988 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:54 smithi007 ceph-mon[30983]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:30:55.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:54 smithi018 ceph-mon[34477]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:30:55.694 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:55 smithi144 ceph-mon[34653]: from='osd.5 [v2:172.21.15.144:6808/2814586621,v1:172.21.15.144:6809/2814586621]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T06:30:55.694 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:55 smithi144 ceph-mon[34653]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T06:30:55.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:55 smithi007 ceph-mon[30983]: from='osd.5 [v2:172.21.15.144:6808/2814586621,v1:172.21.15.144:6809/2814586621]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T06:30:55.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:55 smithi007 ceph-mon[30983]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T06:30:55.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:55 smithi018 ceph-mon[34477]: from='osd.5 [v2:172.21.15.144:6808/2814586621,v1:172.21.15.144:6809/2814586621]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T06:30:55.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:55 smithi018 ceph-mon[34477]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T06:30:56.462 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:30:56.488 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi007:vg_nvme/lv_2 2024-09-21T06:30:56.746 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:30:56.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:56 smithi007 ceph-mon[30983]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:30:56.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:56 smithi007 ceph-mon[30983]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T06:30:56.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:56 smithi007 ceph-mon[30983]: from='osd.5 [v2:172.21.15.144:6808/2814586621,v1:172.21.15.144:6809/2814586621]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi144", "root=default"]} : dispatch 2024-09-21T06:30:56.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:56 smithi007 ceph-mon[30983]: osdmap e34: 6 total, 5 up, 6 in 2024-09-21T06:30:56.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:56 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T06:30:56.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:56 smithi007 ceph-mon[30983]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi144", "root=default"]} : dispatch 2024-09-21T06:30:56.841 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:56 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:56.841 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:56 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:56.841 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:56 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T06:30:56.841 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:56 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T06:30:56.841 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:56 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:56.841 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:56 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:30:56.841 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:56 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:30:56.841 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:56 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:57.035 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 06:30:56 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-5[45912]: 2024-09-21T06:30:56.644+0000 7f0c626fe640 -1 osd.5 0 waiting for initial osdmap 2024-09-21T06:30:57.035 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 06:30:56 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-5[45912]: 2024-09-21T06:30:56.652+0000 7f0c5e4fc640 -1 osd.5 35 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T06:30:57.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:56 smithi144 ceph-mon[34653]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:30:57.036 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:56 smithi144 ceph-mon[34653]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T06:30:57.036 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:56 smithi144 ceph-mon[34653]: from='osd.5 [v2:172.21.15.144:6808/2814586621,v1:172.21.15.144:6809/2814586621]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi144", "root=default"]} : dispatch 2024-09-21T06:30:57.036 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:56 smithi144 ceph-mon[34653]: osdmap e34: 6 total, 5 up, 6 in 2024-09-21T06:30:57.036 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:56 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T06:30:57.036 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:56 smithi144 ceph-mon[34653]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi144", "root=default"]} : dispatch 2024-09-21T06:30:57.036 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:56 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:57.036 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:56 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:57.036 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:56 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T06:30:57.036 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:56 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T06:30:57.036 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:56 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:57.036 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:56 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:30:57.036 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:56 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:30:57.037 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:56 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:57.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:56 smithi018 ceph-mon[34477]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:30:57.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:56 smithi018 ceph-mon[34477]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T06:30:57.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:56 smithi018 ceph-mon[34477]: from='osd.5 [v2:172.21.15.144:6808/2814586621,v1:172.21.15.144:6809/2814586621]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi144", "root=default"]} : dispatch 2024-09-21T06:30:57.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:56 smithi018 ceph-mon[34477]: osdmap e34: 6 total, 5 up, 6 in 2024-09-21T06:30:57.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:56 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T06:30:57.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:56 smithi018 ceph-mon[34477]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi144", "root=default"]} : dispatch 2024-09-21T06:30:57.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:56 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:57.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:56 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:57.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:56 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T06:30:57.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:56 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T06:30:57.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:56 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:57.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:56 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:30:57.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:56 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:30:57.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:56 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:30:57.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:30:57.191+0000 7f25ccf01640 1 -- 172.21.15.7:0/33681887 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25c8102a60 msgr2=0x7f25c8102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:57.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:30:57.191+0000 7f25ccf01640 1 --2- 172.21.15.7:0/33681887 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25c8102a60 0x7f25c8102e70 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f25b8009ca0 tx=0x7f25b802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:30:57.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:30:57.191+0000 7f25ccf01640 1 -- 172.21.15.7:0/33681887 shutdown_connections 2024-09-21T06:30:57.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:30:57.191+0000 7f25ccf01640 1 --2- 172.21.15.7:0/33681887 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f25c8108cf0 0x7f25c810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:57.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:30:57.191+0000 7f25ccf01640 1 --2- 172.21.15.7:0/33681887 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25c81083a0 0x7f25c81087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:57.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:30:57.191+0000 7f25ccf01640 1 --2- 172.21.15.7:0/33681887 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25c8102a60 0x7f25c8102e70 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:57.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:30:57.191+0000 7f25ccf01640 1 -- 172.21.15.7:0/33681887 >> 172.21.15.7:0/33681887 conn(0x7f25c8079730 msgr2=0x7f25c8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:30:57.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:30:57.191+0000 7f25ccf01640 1 -- 172.21.15.7:0/33681887 shutdown_connections 2024-09-21T06:30:57.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:30:57.191+0000 7f25ccf01640 1 -- 172.21.15.7:0/33681887 wait complete. 2024-09-21T06:30:57.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:30:57.192+0000 7f25ccf01640 1 Processor -- start 2024-09-21T06:30:57.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:30:57.192+0000 7f25ccf01640 1 -- start start 2024-09-21T06:30:57.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:30:57.192+0000 7f25ccf01640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f25c8102a60 0x7f25c819a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:57.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:30:57.192+0000 7f25ccf01640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25c81083a0 0x7f25c819aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:57.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:30:57.192+0000 7f25ccf01640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25c8108cf0 0x7f25c819fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:57.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:30:57.192+0000 7f25ccf01640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f25c8112960 con 0x7f25c8108cf0 2024-09-21T06:30:57.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:30:57.192+0000 7f25ccf01640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f25c81127e0 con 0x7f25c81083a0 2024-09-21T06:30:57.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:30:57.192+0000 7f25ccf01640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f25c8112ae0 con 0x7f25c8102a60 2024-09-21T06:30:57.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:30:57.193+0000 7f25c659c640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f25c8102a60 0x7f25c819a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:57.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:30:57.193+0000 7f25c6d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25c8108cf0 0x7f25c819fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:57.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:30:57.193+0000 7f25c659c640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f25c8102a60 0x7f25c819a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.7:34280/0 (socket says 172.21.15.7:34280) 2024-09-21T06:30:57.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:30:57.193+0000 7f25c659c640 1 -- 172.21.15.7:0/3318162391 learned_addr learned my addr 172.21.15.7:0/3318162391 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:30:57.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:30:57.193+0000 7f25c5d9b640 1 --2- 172.21.15.7:0/3318162391 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25c81083a0 0x7f25c819aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:57.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:30:57.193+0000 7f25c6d9d640 1 -- 172.21.15.7:0/3318162391 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f25c8102a60 msgr2=0x7f25c819a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:57.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:30:57.193+0000 7f25c6d9d640 1 --2- 172.21.15.7:0/3318162391 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f25c8102a60 0x7f25c819a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:57.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:30:57.193+0000 7f25c6d9d640 1 -- 172.21.15.7:0/3318162391 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25c81083a0 msgr2=0x7f25c819aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:30:57.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:30:57.193+0000 7f25c6d9d640 1 --2- 172.21.15.7:0/3318162391 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25c81083a0 0x7f25c819aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:30:57.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:30:57.193+0000 7f25c6d9d640 1 -- 172.21.15.7:0/3318162391 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25c81a0470 con 0x7f25c8108cf0 2024-09-21T06:30:57.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:30:57.193+0000 7f25c659c640 1 --2- 172.21.15.7:0/3318162391 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f25c8102a60 0x7f25c819a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:30:57.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:30:57.193+0000 7f25c6d9d640 1 --2- 172.21.15.7:0/3318162391 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25c8108cf0 0x7f25c819fd40 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f25c000d680 tx=0x7f25c000db40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:57.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:30:57.193+0000 7f25b77fe640 1 -- 172.21.15.7:0/3318162391 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25c0017070 con 0x7f25c8108cf0 2024-09-21T06:30:57.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:30:57.193+0000 7f25b77fe640 1 -- 172.21.15.7:0/3318162391 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f25c0009820 con 0x7f25c8108cf0 2024-09-21T06:30:57.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:30:57.193+0000 7f25ccf01640 1 -- 172.21.15.7:0/3318162391 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25c81a0760 con 0x7f25c8108cf0 2024-09-21T06:30:57.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:30:57.193+0000 7f25b77fe640 1 -- 172.21.15.7:0/3318162391 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25c0004ce0 con 0x7f25c8108cf0 2024-09-21T06:30:57.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:30:57.194+0000 7f25ccf01640 1 -- 172.21.15.7:0/3318162391 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25c81a6ec0 con 0x7f25c8108cf0 2024-09-21T06:30:57.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:30:57.195+0000 7f25ccf01640 1 -- 172.21.15.7:0/3318162391 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25c8102e70 con 0x7f25c8108cf0 2024-09-21T06:30:57.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:30:57.196+0000 7f25b77fe640 1 -- 172.21.15.7:0/3318162391 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 21) ==== 154528+0+0 (secure 0 0 0) 0x7f25c00099d0 con 0x7f25c8108cf0 2024-09-21T06:30:57.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:30:57.197+0000 7f25b77fe640 1 --2- 172.21.15.7:0/3318162391 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f25b00b6560 0x7f25b00b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:30:57.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:30:57.198+0000 7f25c659c640 1 --2- 172.21.15.7:0/3318162391 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f25b00b6560 0x7f25b00b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:30:57.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:30:57.198+0000 7f25b77fe640 1 -- 172.21.15.7:0/3318162391 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4468+0+0 (secure 0 0 0) 0x7f25c00e5fa0 con 0x7f25c8108cf0 2024-09-21T06:30:57.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:30:57.198+0000 7f25c659c640 1 --2- 172.21.15.7:0/3318162391 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f25b00b6560 0x7f25b00b8a70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f25b8033040 tx=0x7f25b8032eb0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:30:57.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:30:57.201+0000 7f25b77fe640 1 -- 172.21.15.7:0/3318162391 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f25c00b1af0 con 0x7f25c8108cf0 2024-09-21T06:30:57.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:30:57.398+0000 7f25ccf01640 1 -- 172.21.15.7:0/3318162391 --> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f25c806aeb0 con 0x7f25b00b6560 2024-09-21T06:30:57.920 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:57 smithi007 ceph-mon[30983]: purged_snaps scrub starts 2024-09-21T06:30:57.920 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:57 smithi007 ceph-mon[30983]: purged_snaps scrub ok 2024-09-21T06:30:57.920 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:57 smithi007 ceph-mon[30983]: Detected new or changed devices on smithi144 2024-09-21T06:30:57.920 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:57 smithi007 ceph-mon[30983]: Adjusting osd_memory_target on smithi144 to 8544M 2024-09-21T06:30:57.920 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:57 smithi007 ceph-mon[30983]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]': finished 2024-09-21T06:30:57.920 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:57 smithi007 ceph-mon[30983]: osdmap e35: 6 total, 5 up, 6 in 2024-09-21T06:30:57.920 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:57 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T06:30:57.920 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:57 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T06:30:57.920 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:57 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:30:57.920 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:57 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:30:57.921 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:57 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:30:58.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:57 smithi144 ceph-mon[34653]: purged_snaps scrub starts 2024-09-21T06:30:58.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:57 smithi144 ceph-mon[34653]: purged_snaps scrub ok 2024-09-21T06:30:58.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:57 smithi144 ceph-mon[34653]: Detected new or changed devices on smithi144 2024-09-21T06:30:58.036 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:57 smithi144 ceph-mon[34653]: Adjusting osd_memory_target on smithi144 to 8544M 2024-09-21T06:30:58.036 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:57 smithi144 ceph-mon[34653]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]': finished 2024-09-21T06:30:58.036 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:57 smithi144 ceph-mon[34653]: osdmap e35: 6 total, 5 up, 6 in 2024-09-21T06:30:58.036 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:57 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T06:30:58.036 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:57 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T06:30:58.036 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:57 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:30:58.036 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:57 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:30:58.036 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:57 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:30:58.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:57 smithi018 ceph-mon[34477]: purged_snaps scrub starts 2024-09-21T06:30:58.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:57 smithi018 ceph-mon[34477]: purged_snaps scrub ok 2024-09-21T06:30:58.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:57 smithi018 ceph-mon[34477]: Detected new or changed devices on smithi144 2024-09-21T06:30:58.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:57 smithi018 ceph-mon[34477]: Adjusting osd_memory_target on smithi144 to 8544M 2024-09-21T06:30:58.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:57 smithi018 ceph-mon[34477]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]': finished 2024-09-21T06:30:58.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:57 smithi018 ceph-mon[34477]: osdmap e35: 6 total, 5 up, 6 in 2024-09-21T06:30:58.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:57 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T06:30:58.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:57 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T06:30:58.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:57 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:30:58.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:57 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:30:58.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:57 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:30:58.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:58 smithi007 ceph-mon[30983]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:30:58.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:58 smithi007 ceph-mon[30983]: from='client.14583 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:30:58.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:58 smithi007 ceph-mon[30983]: osd.5 [v2:172.21.15.144:6808/2814586621,v1:172.21.15.144:6809/2814586621] boot 2024-09-21T06:30:58.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:58 smithi007 ceph-mon[30983]: osdmap e36: 6 total, 6 up, 6 in 2024-09-21T06:30:58.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:58 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T06:30:58.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:58 smithi007 ceph-mon[30983]: osdmap e37: 6 total, 6 up, 6 in 2024-09-21T06:30:59.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:58 smithi144 ceph-mon[34653]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:30:59.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:58 smithi144 ceph-mon[34653]: from='client.14583 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:30:59.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:58 smithi144 ceph-mon[34653]: osd.5 [v2:172.21.15.144:6808/2814586621,v1:172.21.15.144:6809/2814586621] boot 2024-09-21T06:30:59.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:58 smithi144 ceph-mon[34653]: osdmap e36: 6 total, 6 up, 6 in 2024-09-21T06:30:59.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:58 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T06:30:59.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:58 smithi144 ceph-mon[34653]: osdmap e37: 6 total, 6 up, 6 in 2024-09-21T06:30:59.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:58 smithi018 ceph-mon[34477]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 154 MiB used, 447 GiB / 447 GiB avail 2024-09-21T06:30:59.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:58 smithi018 ceph-mon[34477]: from='client.14583 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:30:59.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:58 smithi018 ceph-mon[34477]: osd.5 [v2:172.21.15.144:6808/2814586621,v1:172.21.15.144:6809/2814586621] boot 2024-09-21T06:30:59.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:58 smithi018 ceph-mon[34477]: osdmap e36: 6 total, 6 up, 6 in 2024-09-21T06:30:59.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:58 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T06:30:59.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:58 smithi018 ceph-mon[34477]: osdmap e37: 6 total, 6 up, 6 in 2024-09-21T06:30:59.839 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:30:59 smithi007 ceph-mon[30983]: osdmap e38: 6 total, 6 up, 6 in 2024-09-21T06:31:00.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:30:59 smithi144 ceph-mon[34653]: osdmap e38: 6 total, 6 up, 6 in 2024-09-21T06:31:00.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:30:59 smithi018 ceph-mon[34477]: osdmap e38: 6 total, 6 up, 6 in 2024-09-21T06:31:00.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:00 smithi007 ceph-mon[30983]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:31:00.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:00 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/4242117630' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9145650c-e9b1-4e5a-ae6f-17c8960146e9"} : dispatch 2024-09-21T06:31:00.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:00 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/4242117630' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9145650c-e9b1-4e5a-ae6f-17c8960146e9"}]': finished 2024-09-21T06:31:00.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:00 smithi007 ceph-mon[30983]: osdmap e39: 7 total, 6 up, 7 in 2024-09-21T06:31:00.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:00 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:31:00.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:00 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/3222574652' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:31:01.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:00 smithi144 ceph-mon[34653]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:31:01.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:00 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/4242117630' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9145650c-e9b1-4e5a-ae6f-17c8960146e9"} : dispatch 2024-09-21T06:31:01.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:00 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/4242117630' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9145650c-e9b1-4e5a-ae6f-17c8960146e9"}]': finished 2024-09-21T06:31:01.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:00 smithi144 ceph-mon[34653]: osdmap e39: 7 total, 6 up, 7 in 2024-09-21T06:31:01.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:00 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:31:01.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:00 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/3222574652' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:31:01.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:00 smithi018 ceph-mon[34477]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:31:01.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:00 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/4242117630' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9145650c-e9b1-4e5a-ae6f-17c8960146e9"} : dispatch 2024-09-21T06:31:01.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:00 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/4242117630' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9145650c-e9b1-4e5a-ae6f-17c8960146e9"}]': finished 2024-09-21T06:31:01.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:00 smithi018 ceph-mon[34477]: osdmap e39: 7 total, 6 up, 7 in 2024-09-21T06:31:01.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:00 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:31:01.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:00 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/3222574652' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:31:03.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:02 smithi144 ceph-mon[34653]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:31:03.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:02 smithi007 ceph-mon[30983]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:31:03.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:02 smithi018 ceph-mon[34477]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:31:05.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:04 smithi144 ceph-mon[34653]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 106 KiB/s, 0 objects/s recovering 2024-09-21T06:31:05.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:04 smithi007 ceph-mon[30983]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 106 KiB/s, 0 objects/s recovering 2024-09-21T06:31:05.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:04 smithi018 ceph-mon[34477]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 106 KiB/s, 0 objects/s recovering 2024-09-21T06:31:06.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:06 smithi018 ceph-mon[34477]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-09-21T06:31:07.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:06 smithi144 ceph-mon[34653]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-09-21T06:31:07.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:06 smithi007 ceph-mon[30983]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-09-21T06:31:09.017 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:08 smithi007 ceph-mon[30983]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-09-21T06:31:09.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:08 smithi144 ceph-mon[34653]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-09-21T06:31:09.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:08 smithi018 ceph-mon[34477]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-09-21T06:31:09.698 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:09 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T06:31:09.699 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:09 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:31:10.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:09 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T06:31:10.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:09 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:31:10.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:09 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T06:31:10.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:09 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:31:10.776 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:10 smithi007 ceph-mon[30983]: Deploying daemon osd.6 on smithi007 2024-09-21T06:31:10.776 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:10 smithi007 ceph-mon[30983]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T06:31:11.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:10 smithi144 ceph-mon[34653]: Deploying daemon osd.6 on smithi007 2024-09-21T06:31:11.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:10 smithi144 ceph-mon[34653]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T06:31:11.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:10 smithi018 ceph-mon[34477]: Deploying daemon osd.6 on smithi007 2024-09-21T06:31:11.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:10 smithi018 ceph-mon[34477]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T06:31:12.789 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:12 smithi007 ceph-mon[30983]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-21T06:31:13.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:12 smithi144 ceph-mon[34653]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-21T06:31:13.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:12 smithi018 ceph-mon[34477]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-21T06:31:14.969 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:14 smithi007 ceph-mon[30983]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:31:15.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:14 smithi144 ceph-mon[34653]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:31:15.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:14 smithi018 ceph-mon[34477]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:31:16.000 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:15 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:31:16.000 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:15 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:31:16.000 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:15 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:31:16.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:15 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:31:16.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:15 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:31:16.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:15 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:31:16.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:15 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:31:16.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:15 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:31:16.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:15 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:31:17.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:16 smithi144 ceph-mon[34653]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:31:17.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:16 smithi007 ceph-mon[30983]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:31:17.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:16 smithi018 ceph-mon[34477]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:31:18.991 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:18 smithi007 ceph-mon[30983]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:31:18.991 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:18 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:31:18.992 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:18 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:31:18.992 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:18 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:31:18.992 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:18 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:31:18.992 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:18 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:31:19.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:18 smithi144 ceph-mon[34653]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:31:19.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:18 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:31:19.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:18 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:31:19.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:18 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:31:19.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:18 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:31:19.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:18 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:31:19.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:18 smithi018 ceph-mon[34477]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:31:19.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:18 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:31:19.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:18 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:31:19.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:18 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:31:19.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:18 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:31:19.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:18 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:31:19.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:31:19.441+0000 7f25b77fe640 1 -- 172.21.15.7:0/3318162391 <== mgr.14223 v2:172.21.15.7:6800/3442812985 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f25c806aeb0 con 0x7f25b00b6560 2024-09-21T06:31:19.444 INFO:teuthology.orchestra.run.smithi007.stdout:Created osd(s) 6 on host 'smithi007' 2024-09-21T06:31:19.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:31:19.444+0000 7f25ccf01640 1 -- 172.21.15.7:0/3318162391 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f25b00b6560 msgr2=0x7f25b00b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:19.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:31:19.444+0000 7f25ccf01640 1 --2- 172.21.15.7:0/3318162391 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f25b00b6560 0x7f25b00b8a70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f25b8033040 tx=0x7f25b8032eb0 comp rx=0 tx=0).stop 2024-09-21T06:31:19.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:31:19.444+0000 7f25ccf01640 1 -- 172.21.15.7:0/3318162391 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25c8108cf0 msgr2=0x7f25c819fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:19.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:31:19.444+0000 7f25ccf01640 1 --2- 172.21.15.7:0/3318162391 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25c8108cf0 0x7f25c819fd40 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f25c000d680 tx=0x7f25c000db40 comp rx=0 tx=0).stop 2024-09-21T06:31:19.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:31:19.444+0000 7f25ccf01640 1 -- 172.21.15.7:0/3318162391 shutdown_connections 2024-09-21T06:31:19.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:31:19.444+0000 7f25ccf01640 1 --2- 172.21.15.7:0/3318162391 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f25b00b6560 0x7f25b00b8a70 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:19.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:31:19.444+0000 7f25ccf01640 1 --2- 172.21.15.7:0/3318162391 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25c8108cf0 0x7f25c819fd40 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:19.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:31:19.444+0000 7f25ccf01640 1 --2- 172.21.15.7:0/3318162391 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25c81083a0 0x7f25c819aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:19.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:31:19.444+0000 7f25ccf01640 1 --2- 172.21.15.7:0/3318162391 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f25c8102a60 0x7f25c819a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:19.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:31:19.444+0000 7f25ccf01640 1 -- 172.21.15.7:0/3318162391 >> 172.21.15.7:0/3318162391 conn(0x7f25c8079730 msgr2=0x7f25c8101b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:31:19.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:31:19.444+0000 7f25ccf01640 1 -- 172.21.15.7:0/3318162391 shutdown_connections 2024-09-21T06:31:19.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:31:19.444+0000 7f25ccf01640 1 -- 172.21.15.7:0/3318162391 wait complete. 2024-09-21T06:31:20.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:19 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:31:20.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:19 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:31:20.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:19 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:31:20.056 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:19 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:31:20.056 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:19 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:31:20.056 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:19 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:31:20.084 DEBUG:teuthology.orchestra.run.smithi007:osd.6> sudo journalctl -f -n 0 -u ceph-347cb918-77e2-11ef-baf5-efdc52797490@osd.6.service 2024-09-21T06:31:20.086 INFO:tasks.cephadm:Deploying osd.7 on smithi018 with /dev/vg_nvme/lv_2... 2024-09-21T06:31:20.087 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T06:31:20.114 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:19 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:31:20.114 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:19 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:31:20.114 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:19 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:31:20.349 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T06:31:20.800 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:20 smithi018 ceph-mon[34477]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:31:21.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:20 smithi144 ceph-mon[34653]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:31:21.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:20 smithi007 ceph-mon[30983]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:31:21.590 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:31:21 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-6[60437]: 2024-09-21T06:31:21.185+0000 7f2a79c99640 -1 osd.6 0 log_to_monitors true 2024-09-21T06:31:21.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:21 smithi018 ceph-mon[34477]: from='osd.6 [v2:172.21.15.7:6818/3770978305,v1:172.21.15.7:6819/3770978305]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T06:31:21.879 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:21 smithi007 ceph-mon[30983]: from='osd.6 [v2:172.21.15.7:6818/3770978305,v1:172.21.15.7:6819/3770978305]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T06:31:22.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:21 smithi144 ceph-mon[34653]: from='osd.6 [v2:172.21.15.7:6818/3770978305,v1:172.21.15.7:6819/3770978305]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T06:31:22.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:22 smithi018 ceph-mon[34477]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:31:22.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:22 smithi018 ceph-mon[34477]: from='osd.6 [v2:172.21.15.7:6818/3770978305,v1:172.21.15.7:6819/3770978305]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T06:31:22.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:22 smithi018 ceph-mon[34477]: osdmap e40: 7 total, 6 up, 7 in 2024-09-21T06:31:22.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:22 smithi018 ceph-mon[34477]: from='osd.6 [v2:172.21.15.7:6818/3770978305,v1:172.21.15.7:6819/3770978305]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi007", "root=default"]} : dispatch 2024-09-21T06:31:22.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:22 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:31:23.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:22 smithi144 ceph-mon[34653]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:31:23.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:22 smithi144 ceph-mon[34653]: from='osd.6 [v2:172.21.15.7:6818/3770978305,v1:172.21.15.7:6819/3770978305]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T06:31:23.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:22 smithi144 ceph-mon[34653]: osdmap e40: 7 total, 6 up, 7 in 2024-09-21T06:31:23.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:22 smithi144 ceph-mon[34653]: from='osd.6 [v2:172.21.15.7:6818/3770978305,v1:172.21.15.7:6819/3770978305]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi007", "root=default"]} : dispatch 2024-09-21T06:31:23.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:22 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:31:23.083 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T06:31:23.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:22 smithi007 ceph-mon[30983]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:31:23.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:22 smithi007 ceph-mon[30983]: from='osd.6 [v2:172.21.15.7:6818/3770978305,v1:172.21.15.7:6819/3770978305]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T06:31:23.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:22 smithi007 ceph-mon[30983]: osdmap e40: 7 total, 6 up, 7 in 2024-09-21T06:31:23.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:22 smithi007 ceph-mon[30983]: from='osd.6 [v2:172.21.15.7:6818/3770978305,v1:172.21.15.7:6819/3770978305]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi007", "root=default"]} : dispatch 2024-09-21T06:31:23.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:22 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:31:23.108 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi018:vg_nvme/lv_2 2024-09-21T06:31:23.404 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T06:31:23.589 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:31:23 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-6[60437]: 2024-09-21T06:31:23.211+0000 7f2a75c1b640 -1 osd.6 0 waiting for initial osdmap 2024-09-21T06:31:23.590 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:31:23 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-6[60437]: 2024-09-21T06:31:23.221+0000 7f2a6da11640 -1 osd.6 41 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T06:31:23.783 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:23 smithi018 ceph-mon[34477]: from='osd.6 [v2:172.21.15.7:6818/3770978305,v1:172.21.15.7:6819/3770978305]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-09-21T06:31:23.783 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:23 smithi018 ceph-mon[34477]: osdmap e41: 7 total, 6 up, 7 in 2024-09-21T06:31:23.783 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:23 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:31:23.783 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:23 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:31:23.784 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:23 smithi018 ceph-mon[34477]: from='osd.6 [v2:172.21.15.7:6818/3770978305,v1:172.21.15.7:6819/3770978305]' entity='osd.6' 2024-09-21T06:31:23.784 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:23 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:31:23.784 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:23 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:31:23.784 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:23 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T06:31:23.784 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:23 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T06:31:23.784 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:23 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T06:31:23.784 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:23 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:31:23.784 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:23 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:31:23.784 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:23 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:31:23.784 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:23 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:31:23.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:31:23.875+0000 7f866091f640 1 -- 172.21.15.18:0/1922767008 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f865c108420 msgr2=0x7f865c108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:23.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:31:23.875+0000 7f866091f640 1 --2- 172.21.15.18:0/1922767008 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f865c108420 0x7f865c108830 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8644009900 tx=0x7f864402a3f0 comp rx=0 tx=0).stop 2024-09-21T06:31:23.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:31:23.876+0000 7f866091f640 1 -- 172.21.15.18:0/1922767008 shutdown_connections 2024-09-21T06:31:23.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:31:23.876+0000 7f866091f640 1 --2- 172.21.15.18:0/1922767008 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f865c108d70 0x7f865c10f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:23.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:31:23.876+0000 7f866091f640 1 --2- 172.21.15.18:0/1922767008 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f865c108420 0x7f865c108830 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:23.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:31:23.876+0000 7f866091f640 1 --2- 172.21.15.18:0/1922767008 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f865c102ae0 0x7f865c102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:23.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:31:23.876+0000 7f866091f640 1 -- 172.21.15.18:0/1922767008 >> 172.21.15.18:0/1922767008 conn(0x7f865c079770 msgr2=0x7f865c079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:31:23.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:31:23.876+0000 7f866091f640 1 -- 172.21.15.18:0/1922767008 shutdown_connections 2024-09-21T06:31:23.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:31:23.876+0000 7f866091f640 1 -- 172.21.15.18:0/1922767008 wait complete. 2024-09-21T06:31:23.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:31:23.877+0000 7f866091f640 1 Processor -- start 2024-09-21T06:31:23.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:31:23.877+0000 7f866091f640 1 -- start start 2024-09-21T06:31:23.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:31:23.877+0000 7f866091f640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f865c102ae0 0x7f865c199440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:23.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:31:23.877+0000 7f866091f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f865c108420 0x7f865c1999e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:23.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:31:23.877+0000 7f866091f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f865c108d70 0x7f865c19ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:23.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:31:23.877+0000 7f866091f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f865c112a50 con 0x7f865c108420 2024-09-21T06:31:23.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:31:23.877+0000 7f866091f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f865c1128d0 con 0x7f865c108d70 2024-09-21T06:31:23.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:31:23.877+0000 7f866091f640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f865c112bd0 con 0x7f865c102ae0 2024-09-21T06:31:23.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:31:23.877+0000 7f865ad9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f865c108d70 0x7f865c19ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:23.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:31:23.877+0000 7f865ad9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f865c108d70 0x7f865c19ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59264/0 (socket says 172.21.15.18:59264) 2024-09-21T06:31:23.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:31:23.877+0000 7f865ad9d640 1 -- 172.21.15.18:0/1782872512 learned_addr learned my addr 172.21.15.18:0/1782872512 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T06:31:23.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:31:23.877+0000 7f865a59c640 1 --2- 172.21.15.18:0/1782872512 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f865c102ae0 0x7f865c199440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:23.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:31:23.877+0000 7f8653fff640 1 --2- 172.21.15.18:0/1782872512 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f865c108420 0x7f865c1999e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:23.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:31:23.878+0000 7f865ad9d640 1 -- 172.21.15.18:0/1782872512 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f865c102ae0 msgr2=0x7f865c199440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:23.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:31:23.878+0000 7f865ad9d640 1 --2- 172.21.15.18:0/1782872512 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f865c102ae0 0x7f865c199440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:23.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:31:23.878+0000 7f865ad9d640 1 -- 172.21.15.18:0/1782872512 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f865c108420 msgr2=0x7f865c1999e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:23.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:31:23.878+0000 7f865ad9d640 1 --2- 172.21.15.18:0/1782872512 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f865c108420 0x7f865c1999e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:23.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:31:23.878+0000 7f865ad9d640 1 -- 172.21.15.18:0/1782872512 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f865c19f2f0 con 0x7f865c108d70 2024-09-21T06:31:23.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:31:23.878+0000 7f865ad9d640 1 --2- 172.21.15.18:0/1782872512 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f865c108d70 0x7f865c19ec80 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f865400b970 tx=0x7f865400bd70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:31:23.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:31:23.878+0000 7f86537fe640 1 -- 172.21.15.18:0/1782872512 <== mon.2 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8654019070 con 0x7f865c108d70 2024-09-21T06:31:23.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:31:23.878+0000 7f86537fe640 1 -- 172.21.15.18:0/1782872512 <== mon.2 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8654014440 con 0x7f865c108d70 2024-09-21T06:31:23.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:31:23.878+0000 7f866091f640 1 -- 172.21.15.18:0/1782872512 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f865c19f5e0 con 0x7f865c108d70 2024-09-21T06:31:23.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:31:23.878+0000 7f86537fe640 1 -- 172.21.15.18:0/1782872512 <== mon.2 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86540075d0 con 0x7f865c108d70 2024-09-21T06:31:23.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:31:23.878+0000 7f866091f640 1 -- 172.21.15.18:0/1782872512 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f865c19faa0 con 0x7f865c108d70 2024-09-21T06:31:23.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:31:23.879+0000 7f866091f640 1 -- 172.21.15.18:0/1782872512 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f865c103d60 con 0x7f865c108d70 2024-09-21T06:31:23.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:31:23.882+0000 7f86537fe640 1 -- 172.21.15.18:0/1782872512 <== mon.2 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 21) ==== 154528+0+0 (secure 0 0 0) 0x7f865401c070 con 0x7f865c108d70 2024-09-21T06:31:23.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:31:23.882+0000 7f86537fe640 1 --2- 172.21.15.18:0/1782872512 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f86480b6590 0x7f86480b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:23.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:31:23.882+0000 7f86537fe640 1 -- 172.21.15.18:0/1782872512 <== mon.2 v2:172.21.15.18:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4900+0+0 (secure 0 0 0) 0x7f86540e5ea0 con 0x7f865c108d70 2024-09-21T06:31:23.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:31:23.883+0000 7f865a59c640 1 --2- 172.21.15.18:0/1782872512 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f86480b6590 0x7f86480b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:23.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:31:23.883+0000 7f865a59c640 1 --2- 172.21.15.18:0/1782872512 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f86480b6590 0x7f86480b8aa0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f864c00abe0 tx=0x7f864c00a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:31:23.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:31:23.886+0000 7f86537fe640 1 -- 172.21.15.18:0/1782872512 <== mon.2 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f86540b1860 con 0x7f865c108d70 2024-09-21T06:31:24.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:23 smithi144 ceph-mon[34653]: from='osd.6 [v2:172.21.15.7:6818/3770978305,v1:172.21.15.7:6819/3770978305]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-09-21T06:31:24.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:23 smithi144 ceph-mon[34653]: osdmap e41: 7 total, 6 up, 7 in 2024-09-21T06:31:24.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:23 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:31:24.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:23 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:31:24.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:23 smithi144 ceph-mon[34653]: from='osd.6 [v2:172.21.15.7:6818/3770978305,v1:172.21.15.7:6819/3770978305]' entity='osd.6' 2024-09-21T06:31:24.036 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:23 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:31:24.036 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:23 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:31:24.036 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:23 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T06:31:24.036 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:23 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T06:31:24.036 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:23 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T06:31:24.036 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:23 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:31:24.036 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:23 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:31:24.036 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:23 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:31:24.036 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:23 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:31:24.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:31:24.085+0000 7f866091f640 1 -- 172.21.15.18:0/1782872512 --> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f865c063800 con 0x7f86480b6590 2024-09-21T06:31:24.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:23 smithi007 ceph-mon[30983]: from='osd.6 [v2:172.21.15.7:6818/3770978305,v1:172.21.15.7:6819/3770978305]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-09-21T06:31:24.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:23 smithi007 ceph-mon[30983]: osdmap e41: 7 total, 6 up, 7 in 2024-09-21T06:31:24.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:23 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:31:24.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:23 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:31:24.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:23 smithi007 ceph-mon[30983]: from='osd.6 [v2:172.21.15.7:6818/3770978305,v1:172.21.15.7:6819/3770978305]' entity='osd.6' 2024-09-21T06:31:24.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:23 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:31:24.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:23 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:31:24.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:23 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T06:31:24.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:23 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T06:31:24.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:23 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T06:31:24.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:23 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:31:24.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:23 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:31:24.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:23 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:31:24.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:23 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:31:25.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:24 smithi144 ceph-mon[34653]: purged_snaps scrub starts 2024-09-21T06:31:25.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:24 smithi144 ceph-mon[34653]: purged_snaps scrub ok 2024-09-21T06:31:25.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:24 smithi144 ceph-mon[34653]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:31:25.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:24 smithi144 ceph-mon[34653]: Detected new or changed devices on smithi007 2024-09-21T06:31:25.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:24 smithi144 ceph-mon[34653]: Adjusting osd_memory_target on smithi007 to 5697M 2024-09-21T06:31:25.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:24 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:31:25.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:24 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:31:25.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:24 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:31:25.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:24 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:31:25.036 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:24 smithi144 ceph-mon[34653]: osd.6 [v2:172.21.15.7:6818/3770978305,v1:172.21.15.7:6819/3770978305] boot 2024-09-21T06:31:25.036 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:24 smithi144 ceph-mon[34653]: osdmap e42: 7 total, 7 up, 7 in 2024-09-21T06:31:25.036 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:24 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:31:25.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:24 smithi007 ceph-mon[30983]: purged_snaps scrub starts 2024-09-21T06:31:25.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:24 smithi007 ceph-mon[30983]: purged_snaps scrub ok 2024-09-21T06:31:25.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:24 smithi007 ceph-mon[30983]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:31:25.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:24 smithi007 ceph-mon[30983]: Detected new or changed devices on smithi007 2024-09-21T06:31:25.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:24 smithi007 ceph-mon[30983]: Adjusting osd_memory_target on smithi007 to 5697M 2024-09-21T06:31:25.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:24 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:31:25.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:24 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:31:25.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:24 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:31:25.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:24 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:31:25.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:24 smithi007 ceph-mon[30983]: osd.6 [v2:172.21.15.7:6818/3770978305,v1:172.21.15.7:6819/3770978305] boot 2024-09-21T06:31:25.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:24 smithi007 ceph-mon[30983]: osdmap e42: 7 total, 7 up, 7 in 2024-09-21T06:31:25.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:24 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:31:25.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:24 smithi018 ceph-mon[34477]: purged_snaps scrub starts 2024-09-21T06:31:25.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:24 smithi018 ceph-mon[34477]: purged_snaps scrub ok 2024-09-21T06:31:25.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:24 smithi018 ceph-mon[34477]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 181 MiB used, 536 GiB / 536 GiB avail 2024-09-21T06:31:25.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:24 smithi018 ceph-mon[34477]: Detected new or changed devices on smithi007 2024-09-21T06:31:25.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:24 smithi018 ceph-mon[34477]: Adjusting osd_memory_target on smithi007 to 5697M 2024-09-21T06:31:25.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:24 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:31:25.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:24 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:31:25.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:24 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:31:25.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:24 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:31:25.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:24 smithi018 ceph-mon[34477]: osd.6 [v2:172.21.15.7:6818/3770978305,v1:172.21.15.7:6819/3770978305] boot 2024-09-21T06:31:25.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:24 smithi018 ceph-mon[34477]: osdmap e42: 7 total, 7 up, 7 in 2024-09-21T06:31:25.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:24 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T06:31:26.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:25 smithi144 ceph-mon[34653]: from='client.24476 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:31:26.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:25 smithi144 ceph-mon[34653]: osdmap e43: 7 total, 7 up, 7 in 2024-09-21T06:31:26.086 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:25 smithi018 ceph-mon[34477]: from='client.24476 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:31:26.086 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:25 smithi018 ceph-mon[34477]: osdmap e43: 7 total, 7 up, 7 in 2024-09-21T06:31:26.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:25 smithi007 ceph-mon[30983]: from='client.24476 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:31:26.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:25 smithi007 ceph-mon[30983]: osdmap e43: 7 total, 7 up, 7 in 2024-09-21T06:31:27.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:26 smithi144 ceph-mon[34653]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:31:27.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:26 smithi144 ceph-mon[34653]: from='client.? 172.21.15.18:0/3541826652' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ca658683-38f7-47ca-b32e-512fe4738ef1"} : dispatch 2024-09-21T06:31:27.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:26 smithi144 ceph-mon[34653]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ca658683-38f7-47ca-b32e-512fe4738ef1"} : dispatch 2024-09-21T06:31:27.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:26 smithi144 ceph-mon[34653]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ca658683-38f7-47ca-b32e-512fe4738ef1"}]': finished 2024-09-21T06:31:27.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:26 smithi144 ceph-mon[34653]: osdmap e44: 8 total, 7 up, 8 in 2024-09-21T06:31:27.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:26 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:31:27.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:26 smithi007 ceph-mon[30983]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:31:27.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:26 smithi007 ceph-mon[30983]: from='client.? 172.21.15.18:0/3541826652' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ca658683-38f7-47ca-b32e-512fe4738ef1"} : dispatch 2024-09-21T06:31:27.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:26 smithi007 ceph-mon[30983]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ca658683-38f7-47ca-b32e-512fe4738ef1"} : dispatch 2024-09-21T06:31:27.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:26 smithi007 ceph-mon[30983]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ca658683-38f7-47ca-b32e-512fe4738ef1"}]': finished 2024-09-21T06:31:27.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:26 smithi007 ceph-mon[30983]: osdmap e44: 8 total, 7 up, 8 in 2024-09-21T06:31:27.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:26 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:31:27.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:26 smithi018 ceph-mon[34477]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:31:27.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:26 smithi018 ceph-mon[34477]: from='client.? 172.21.15.18:0/3541826652' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ca658683-38f7-47ca-b32e-512fe4738ef1"} : dispatch 2024-09-21T06:31:27.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:26 smithi018 ceph-mon[34477]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ca658683-38f7-47ca-b32e-512fe4738ef1"} : dispatch 2024-09-21T06:31:27.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:26 smithi018 ceph-mon[34477]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ca658683-38f7-47ca-b32e-512fe4738ef1"}]': finished 2024-09-21T06:31:27.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:26 smithi018 ceph-mon[34477]: osdmap e44: 8 total, 7 up, 8 in 2024-09-21T06:31:27.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:26 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:31:28.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:27 smithi144 ceph-mon[34653]: from='client.? 172.21.15.18:0/2958953435' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:31:28.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:27 smithi007 ceph-mon[30983]: from='client.? 172.21.15.18:0/2958953435' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:31:28.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:27 smithi018 ceph-mon[34477]: from='client.? 172.21.15.18:0/2958953435' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:31:29.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:28 smithi144 ceph-mon[34653]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:31:29.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:28 smithi007 ceph-mon[30983]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:31:29.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:28 smithi018 ceph-mon[34477]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:31:31.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:30 smithi144 ceph-mon[34653]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:31:31.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:30 smithi007 ceph-mon[30983]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:31:31.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:30 smithi018 ceph-mon[34477]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:31:33.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:32 smithi144 ceph-mon[34653]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:31:33.077 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:32 smithi018 ceph-mon[34477]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:31:33.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:32 smithi007 ceph-mon[30983]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:31:34.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:34 smithi018 ceph-mon[34477]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:31:35.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:34 smithi144 ceph-mon[34653]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:31:35.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:34 smithi007 ceph-mon[30983]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:31:35.976 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:35 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T06:31:35.976 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:35 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:31:36.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:35 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T06:31:36.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:35 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:31:36.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:35 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T06:31:36.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:35 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:31:37.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:36 smithi144 ceph-mon[34653]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:31:37.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:36 smithi144 ceph-mon[34653]: Deploying daemon osd.7 on smithi018 2024-09-21T06:31:37.078 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:36 smithi018 ceph-mon[34477]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:31:37.078 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:36 smithi018 ceph-mon[34477]: Deploying daemon osd.7 on smithi018 2024-09-21T06:31:37.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:36 smithi007 ceph-mon[30983]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:31:37.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:36 smithi007 ceph-mon[30983]: Deploying daemon osd.7 on smithi018 2024-09-21T06:31:39.016 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:38 smithi018 ceph-mon[34477]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:31:39.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:38 smithi144 ceph-mon[34653]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:31:39.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:38 smithi007 ceph-mon[30983]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:31:41.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:40 smithi144 ceph-mon[34653]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:31:41.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:40 smithi007 ceph-mon[30983]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:31:41.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:40 smithi018 ceph-mon[34477]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:31:42.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:42 smithi018 ceph-mon[34477]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:31:42.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:42 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:31:42.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:42 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:31:42.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:42 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:31:43.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:42 smithi144 ceph-mon[34653]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:31:43.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:42 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:31:43.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:42 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:31:43.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:42 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:31:43.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:42 smithi007 ceph-mon[30983]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:31:43.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:42 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:31:43.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:42 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:31:43.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:42 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:31:45.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:44 smithi144 ceph-mon[34653]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:31:45.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:44 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:31:45.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:44 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:31:45.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:44 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:31:45.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:44 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:31:45.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:44 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:31:45.085 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:44 smithi018 ceph-mon[34477]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:31:45.086 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:44 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:31:45.086 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:44 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:31:45.086 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:44 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:31:45.086 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:44 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:31:45.086 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:44 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:31:45.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:44 smithi007 ceph-mon[30983]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:31:45.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:44 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:31:45.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:44 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:31:45.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:44 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:31:45.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:44 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:31:45.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:44 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:31:45.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:31:45.723+0000 7f86537fe640 1 -- 172.21.15.18:0/1782872512 <== mgr.14223 v2:172.21.15.7:6800/3442812985 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f865c063800 con 0x7f86480b6590 2024-09-21T06:31:45.726 INFO:teuthology.orchestra.run.smithi018.stdout:Created osd(s) 7 on host 'smithi018' 2024-09-21T06:31:45.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:31:45.726+0000 7f866091f640 1 -- 172.21.15.18:0/1782872512 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f86480b6590 msgr2=0x7f86480b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:45.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:31:45.726+0000 7f866091f640 1 --2- 172.21.15.18:0/1782872512 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f86480b6590 0x7f86480b8aa0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f864c00abe0 tx=0x7f864c00a2d0 comp rx=0 tx=0).stop 2024-09-21T06:31:45.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:31:45.726+0000 7f866091f640 1 -- 172.21.15.18:0/1782872512 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f865c108d70 msgr2=0x7f865c19ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:45.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:31:45.726+0000 7f866091f640 1 --2- 172.21.15.18:0/1782872512 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f865c108d70 0x7f865c19ec80 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f865400b970 tx=0x7f865400bd70 comp rx=0 tx=0).stop 2024-09-21T06:31:45.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:31:45.726+0000 7f866091f640 1 -- 172.21.15.18:0/1782872512 shutdown_connections 2024-09-21T06:31:45.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:31:45.726+0000 7f866091f640 1 --2- 172.21.15.18:0/1782872512 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f86480b6590 0x7f86480b8aa0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:45.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:31:45.726+0000 7f866091f640 1 --2- 172.21.15.18:0/1782872512 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f865c108d70 0x7f865c19ec80 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:45.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:31:45.726+0000 7f866091f640 1 --2- 172.21.15.18:0/1782872512 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f865c108420 0x7f865c1999e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:45.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:31:45.726+0000 7f866091f640 1 --2- 172.21.15.18:0/1782872512 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f865c102ae0 0x7f865c199440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:45.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:31:45.726+0000 7f866091f640 1 -- 172.21.15.18:0/1782872512 >> 172.21.15.18:0/1782872512 conn(0x7f865c079770 msgr2=0x7f865c1064b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:31:45.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:31:45.726+0000 7f866091f640 1 -- 172.21.15.18:0/1782872512 shutdown_connections 2024-09-21T06:31:45.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:31:45.726+0000 7f866091f640 1 -- 172.21.15.18:0/1782872512 wait complete. 2024-09-21T06:31:46.017 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:45 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:31:46.017 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:45 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:31:46.017 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:45 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:31:46.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:45 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:31:46.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:45 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:31:46.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:45 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:31:46.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:45 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:31:46.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:45 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:31:46.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:45 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:31:46.371 DEBUG:teuthology.orchestra.run.smithi018:osd.7> sudo journalctl -f -n 0 -u ceph-347cb918-77e2-11ef-baf5-efdc52797490@osd.7.service 2024-09-21T06:31:46.373 INFO:tasks.cephadm:Deploying osd.8 on smithi144 with /dev/vg_nvme/lv_2... 2024-09-21T06:31:46.373 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T06:31:46.631 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:31:47.032 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:46 smithi144 ceph-mon[34653]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:31:47.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:46 smithi007 ceph-mon[30983]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:31:47.096 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:46 smithi018 ceph-mon[34477]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:31:48.369 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 21 06:31:48 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-7[51832]: 2024-09-21T06:31:48.127+0000 7f8ec13d0640 -1 osd.7 0 log_to_monitors true 2024-09-21T06:31:49.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:48 smithi144 ceph-mon[34653]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:31:49.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:48 smithi144 ceph-mon[34653]: from='osd.7 [v2:172.21.15.18:6816/1322408496,v1:172.21.15.18:6817/1322408496]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T06:31:49.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:48 smithi144 ceph-mon[34653]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T06:31:49.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:48 smithi007 ceph-mon[30983]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:31:49.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:48 smithi007 ceph-mon[30983]: from='osd.7 [v2:172.21.15.18:6816/1322408496,v1:172.21.15.18:6817/1322408496]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T06:31:49.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:48 smithi007 ceph-mon[30983]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T06:31:49.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:48 smithi018 ceph-mon[34477]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:31:49.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:48 smithi018 ceph-mon[34477]: from='osd.7 [v2:172.21.15.18:6816/1322408496,v1:172.21.15.18:6817/1322408496]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T06:31:49.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:48 smithi018 ceph-mon[34477]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T06:31:49.180 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-21T06:31:49.208 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi144:vg_nvme/lv_2 2024-09-21T06:31:49.455 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:31:49.856 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:49 smithi144 ceph-mon[34653]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T06:31:49.856 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:49 smithi144 ceph-mon[34653]: from='osd.7 [v2:172.21.15.18:6816/1322408496,v1:172.21.15.18:6817/1322408496]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi018", "root=default"]} : dispatch 2024-09-21T06:31:49.857 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:49 smithi144 ceph-mon[34653]: osdmap e45: 8 total, 7 up, 8 in 2024-09-21T06:31:49.857 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:49 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:31:49.857 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:49 smithi144 ceph-mon[34653]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi018", "root=default"]} : dispatch 2024-09-21T06:31:49.857 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:49 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:31:49.857 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:49 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:31:49.857 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:49 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T06:31:49.857 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:49 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T06:31:49.857 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:49 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T06:31:49.857 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:49 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:31:49.857 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:49 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:31:49.857 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:49 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:31:49.857 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:49 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:31:49.857 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:49 smithi144 ceph-mon[34653]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-09-21T06:31:49.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:31:49.947+0000 7fd61fec8640 1 -- 172.21.15.144:0/331242900 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6181083c0 msgr2=0x7fd6181087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:49.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:31:49.947+0000 7fd61fec8640 1 --2- 172.21.15.144:0/331242900 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6181083c0 0x7fd6181087d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd608009900 tx=0x7fd60802a410 comp rx=0 tx=0).stop 2024-09-21T06:31:49.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:31:49.947+0000 7fd61fec8640 1 -- 172.21.15.144:0/331242900 shutdown_connections 2024-09-21T06:31:49.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:31:49.947+0000 7fd61fec8640 1 --2- 172.21.15.144:0/331242900 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd618108d10 0x7fd61810f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:49.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:31:49.947+0000 7fd61fec8640 1 --2- 172.21.15.144:0/331242900 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6181083c0 0x7fd6181087d0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:49.981 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:31:49.947+0000 7fd61fec8640 1 --2- 172.21.15.144:0/331242900 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd618102a80 0x7fd618102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:49.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:31:49.947+0000 7fd61fec8640 1 -- 172.21.15.144:0/331242900 >> 172.21.15.144:0/331242900 conn(0x7fd618079740 msgr2=0x7fd618079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:31:49.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:31:49.947+0000 7fd61fec8640 1 -- 172.21.15.144:0/331242900 shutdown_connections 2024-09-21T06:31:49.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:31:49.947+0000 7fd61fec8640 1 -- 172.21.15.144:0/331242900 wait complete. 2024-09-21T06:31:49.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:31:49.948+0000 7fd61fec8640 1 Processor -- start 2024-09-21T06:31:49.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:31:49.948+0000 7fd61fec8640 1 -- start start 2024-09-21T06:31:49.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:31:49.948+0000 7fd61fec8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd618102a80 0x7fd6180ff690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:49.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:31:49.948+0000 7fd61fec8640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6181083c0 0x7fd6180ffbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:49.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:31:49.948+0000 7fd61fec8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd618108d10 0x7fd618100110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:49.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:31:49.948+0000 7fd61fec8640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd618112980 con 0x7fd618108d10 2024-09-21T06:31:49.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:31:49.948+0000 7fd61fec8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd618112800 con 0x7fd618102a80 2024-09-21T06:31:49.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:31:49.948+0000 7fd61fec8640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd618112b00 con 0x7fd6181083c0 2024-09-21T06:31:49.982 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:31:49.948+0000 7fd61d463640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6181083c0 0x7fd6180ffbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:49.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:31:49.948+0000 7fd61d463640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6181083c0 0x7fd6180ffbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:51952/0 (socket says 172.21.15.144:51952) 2024-09-21T06:31:49.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:31:49.948+0000 7fd61d463640 1 -- 172.21.15.144:0/3582231497 learned_addr learned my addr 172.21.15.144:0/3582231497 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-21T06:31:49.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:31:49.949+0000 7fd61dc64640 1 --2- 172.21.15.144:0/3582231497 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd618102a80 0x7fd6180ff690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:49.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:31:49.949+0000 7fd61e465640 1 --2- 172.21.15.144:0/3582231497 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd618108d10 0x7fd618100110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:49.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:31:49.949+0000 7fd61d463640 1 -- 172.21.15.144:0/3582231497 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd618102a80 msgr2=0x7fd6180ff690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:49.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:31:49.949+0000 7fd61d463640 1 --2- 172.21.15.144:0/3582231497 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd618102a80 0x7fd6180ff690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:49.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:31:49.949+0000 7fd61d463640 1 -- 172.21.15.144:0/3582231497 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd618108d10 msgr2=0x7fd618100110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:31:49.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:31:49.949+0000 7fd61d463640 1 --2- 172.21.15.144:0/3582231497 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd618108d10 0x7fd618100110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:31:49.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:31:49.949+0000 7fd61d463640 1 -- 172.21.15.144:0/3582231497 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6181a8690 con 0x7fd6181083c0 2024-09-21T06:31:49.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:31:49.949+0000 7fd61d463640 1 --2- 172.21.15.144:0/3582231497 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6181083c0 0x7fd6180ffbd0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd608032fd0 tx=0x7fd608004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:31:49.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:31:49.949+0000 7fd60effd640 1 -- 172.21.15.144:0/3582231497 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd60803f030 con 0x7fd6181083c0 2024-09-21T06:31:49.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:31:49.949+0000 7fd60effd640 1 -- 172.21.15.144:0/3582231497 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd608004490 con 0x7fd6181083c0 2024-09-21T06:31:49.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:31:49.949+0000 7fd61fec8640 1 -- 172.21.15.144:0/3582231497 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6181a8920 con 0x7fd6181083c0 2024-09-21T06:31:49.983 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:31:49.949+0000 7fd60effd640 1 -- 172.21.15.144:0/3582231497 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd608035070 con 0x7fd6181083c0 2024-09-21T06:31:49.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:31:49.949+0000 7fd61fec8640 1 -- 172.21.15.144:0/3582231497 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6181a8e50 con 0x7fd6181083c0 2024-09-21T06:31:49.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:31:49.950+0000 7fd61fec8640 1 -- 172.21.15.144:0/3582231497 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd618102e90 con 0x7fd6181083c0 2024-09-21T06:31:49.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:31:49.952+0000 7fd60effd640 1 -- 172.21.15.144:0/3582231497 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 21) ==== 154528+0+0 (secure 0 0 0) 0x7fd608042030 con 0x7fd6181083c0 2024-09-21T06:31:49.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:31:49.953+0000 7fd60effd640 1 --2- 172.21.15.144:0/3582231497 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fd6040b65e0 0x7fd6040b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:31:49.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:31:49.953+0000 7fd60effd640 1 -- 172.21.15.144:0/3582231497 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5332+0+0 (secure 0 0 0) 0x7fd608107130 con 0x7fd6181083c0 2024-09-21T06:31:49.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:31:49.953+0000 7fd61dc64640 1 --2- 172.21.15.144:0/3582231497 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fd6040b65e0 0x7fd6040b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:31:49.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:31:49.954+0000 7fd61dc64640 1 --2- 172.21.15.144:0/3582231497 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fd6040b65e0 0x7fd6040b8af0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd6181010e0 tx=0x7fd61400b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:31:49.984 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:31:49.956+0000 7fd60effd640 1 -- 172.21.15.144:0/3582231497 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd6080ce4c0 con 0x7fd6181083c0 2024-09-21T06:31:50.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:49 smithi007 ceph-mon[30983]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T06:31:50.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:49 smithi007 ceph-mon[30983]: from='osd.7 [v2:172.21.15.18:6816/1322408496,v1:172.21.15.18:6817/1322408496]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi018", "root=default"]} : dispatch 2024-09-21T06:31:50.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:49 smithi007 ceph-mon[30983]: osdmap e45: 8 total, 7 up, 8 in 2024-09-21T06:31:50.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:49 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:31:50.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:49 smithi007 ceph-mon[30983]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi018", "root=default"]} : dispatch 2024-09-21T06:31:50.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:49 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:31:50.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:49 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:31:50.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:49 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T06:31:50.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:49 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T06:31:50.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:49 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T06:31:50.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:49 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:31:50.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:49 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:31:50.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:49 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:31:50.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:49 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:31:50.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:49 smithi007 ceph-mon[30983]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-09-21T06:31:50.119 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 21 06:31:49 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-7[51832]: 2024-09-21T06:31:49.797+0000 7f8ebd352640 -1 osd.7 0 waiting for initial osdmap 2024-09-21T06:31:50.119 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 21 06:31:49 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-7[51832]: 2024-09-21T06:31:49.808+0000 7f8eb9150640 -1 osd.7 46 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T06:31:50.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:49 smithi018 ceph-mon[34477]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T06:31:50.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:49 smithi018 ceph-mon[34477]: from='osd.7 [v2:172.21.15.18:6816/1322408496,v1:172.21.15.18:6817/1322408496]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi018", "root=default"]} : dispatch 2024-09-21T06:31:50.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:49 smithi018 ceph-mon[34477]: osdmap e45: 8 total, 7 up, 8 in 2024-09-21T06:31:50.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:49 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:31:50.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:49 smithi018 ceph-mon[34477]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi018", "root=default"]} : dispatch 2024-09-21T06:31:50.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:49 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:31:50.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:49 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:31:50.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:49 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T06:31:50.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:49 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T06:31:50.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:49 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T06:31:50.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:49 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:31:50.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:49 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:31:50.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:49 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:31:50.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:49 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:31:50.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:49 smithi018 ceph-mon[34477]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-09-21T06:31:50.144 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:31:50.143+0000 7fd61fec8640 1 -- 172.21.15.144:0/3582231497 --> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fd618063800 con 0x7fd6040b65e0 2024-09-21T06:31:51.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:50 smithi007 ceph-mon[30983]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:31:51.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:50 smithi007 ceph-mon[30983]: Detected new or changed devices on smithi018 2024-09-21T06:31:51.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:50 smithi007 ceph-mon[30983]: Adjusting osd_memory_target on smithi018 to 5697M 2024-09-21T06:31:51.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:50 smithi007 ceph-mon[30983]: osdmap e46: 8 total, 7 up, 8 in 2024-09-21T06:31:51.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:50 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:31:51.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:50 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:31:51.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:50 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:31:51.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:50 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:31:51.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:50 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:31:51.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:50 smithi007 ceph-mon[30983]: osd.7 [v2:172.21.15.18:6816/1322408496,v1:172.21.15.18:6817/1322408496] boot 2024-09-21T06:31:51.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:50 smithi007 ceph-mon[30983]: osdmap e47: 8 total, 8 up, 8 in 2024-09-21T06:31:51.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:50 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:31:51.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:50 smithi018 ceph-mon[34477]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:31:51.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:50 smithi018 ceph-mon[34477]: Detected new or changed devices on smithi018 2024-09-21T06:31:51.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:50 smithi018 ceph-mon[34477]: Adjusting osd_memory_target on smithi018 to 5697M 2024-09-21T06:31:51.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:50 smithi018 ceph-mon[34477]: osdmap e46: 8 total, 7 up, 8 in 2024-09-21T06:31:51.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:50 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:31:51.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:50 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:31:51.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:50 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:31:51.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:50 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:31:51.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:50 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:31:51.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:50 smithi018 ceph-mon[34477]: osd.7 [v2:172.21.15.18:6816/1322408496,v1:172.21.15.18:6817/1322408496] boot 2024-09-21T06:31:51.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:50 smithi018 ceph-mon[34477]: osdmap e47: 8 total, 8 up, 8 in 2024-09-21T06:31:51.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:50 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:31:51.220 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:50 smithi144 ceph-mon[34653]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 626 GiB / 626 GiB avail 2024-09-21T06:31:51.221 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:50 smithi144 ceph-mon[34653]: Detected new or changed devices on smithi018 2024-09-21T06:31:51.221 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:50 smithi144 ceph-mon[34653]: Adjusting osd_memory_target on smithi018 to 5697M 2024-09-21T06:31:51.221 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:50 smithi144 ceph-mon[34653]: osdmap e46: 8 total, 7 up, 8 in 2024-09-21T06:31:51.221 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:50 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:31:51.221 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:50 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:31:51.221 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:50 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:31:51.221 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:50 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:31:51.221 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:50 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:31:51.221 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:50 smithi144 ceph-mon[34653]: osd.7 [v2:172.21.15.18:6816/1322408496,v1:172.21.15.18:6817/1322408496] boot 2024-09-21T06:31:51.221 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:50 smithi144 ceph-mon[34653]: osdmap e47: 8 total, 8 up, 8 in 2024-09-21T06:31:51.221 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:50 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T06:31:52.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:51 smithi144 ceph-mon[34653]: purged_snaps scrub starts 2024-09-21T06:31:52.036 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:51 smithi144 ceph-mon[34653]: purged_snaps scrub ok 2024-09-21T06:31:52.036 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:51 smithi144 ceph-mon[34653]: from='client.24499 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:31:52.036 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:51 smithi144 ceph-mon[34653]: osdmap e48: 8 total, 8 up, 8 in 2024-09-21T06:31:52.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:51 smithi007 ceph-mon[30983]: purged_snaps scrub starts 2024-09-21T06:31:52.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:51 smithi007 ceph-mon[30983]: purged_snaps scrub ok 2024-09-21T06:31:52.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:51 smithi007 ceph-mon[30983]: from='client.24499 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:31:52.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:51 smithi007 ceph-mon[30983]: osdmap e48: 8 total, 8 up, 8 in 2024-09-21T06:31:52.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:51 smithi018 ceph-mon[34477]: purged_snaps scrub starts 2024-09-21T06:31:52.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:51 smithi018 ceph-mon[34477]: purged_snaps scrub ok 2024-09-21T06:31:52.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:51 smithi018 ceph-mon[34477]: from='client.24499 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:31:52.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:51 smithi018 ceph-mon[34477]: osdmap e48: 8 total, 8 up, 8 in 2024-09-21T06:31:53.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:52 smithi144 ceph-mon[34653]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:31:53.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:52 smithi144 ceph-mon[34653]: from='client.? 172.21.15.144:0/1745218371' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "40d1f37e-6fac-40b9-9319-78f4fc3a6f20"} : dispatch 2024-09-21T06:31:53.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:52 smithi144 ceph-mon[34653]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "40d1f37e-6fac-40b9-9319-78f4fc3a6f20"} : dispatch 2024-09-21T06:31:53.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:52 smithi144 ceph-mon[34653]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "40d1f37e-6fac-40b9-9319-78f4fc3a6f20"}]': finished 2024-09-21T06:31:53.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:52 smithi144 ceph-mon[34653]: osdmap e49: 9 total, 8 up, 9 in 2024-09-21T06:31:53.036 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:52 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:31:53.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:52 smithi007 ceph-mon[30983]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:31:53.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:52 smithi007 ceph-mon[30983]: from='client.? 172.21.15.144:0/1745218371' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "40d1f37e-6fac-40b9-9319-78f4fc3a6f20"} : dispatch 2024-09-21T06:31:53.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:52 smithi007 ceph-mon[30983]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "40d1f37e-6fac-40b9-9319-78f4fc3a6f20"} : dispatch 2024-09-21T06:31:53.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:52 smithi007 ceph-mon[30983]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "40d1f37e-6fac-40b9-9319-78f4fc3a6f20"}]': finished 2024-09-21T06:31:53.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:52 smithi007 ceph-mon[30983]: osdmap e49: 9 total, 8 up, 9 in 2024-09-21T06:31:53.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:52 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:31:53.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:52 smithi018 ceph-mon[34477]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:31:53.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:52 smithi018 ceph-mon[34477]: from='client.? 172.21.15.144:0/1745218371' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "40d1f37e-6fac-40b9-9319-78f4fc3a6f20"} : dispatch 2024-09-21T06:31:53.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:52 smithi018 ceph-mon[34477]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "40d1f37e-6fac-40b9-9319-78f4fc3a6f20"} : dispatch 2024-09-21T06:31:53.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:52 smithi018 ceph-mon[34477]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "40d1f37e-6fac-40b9-9319-78f4fc3a6f20"}]': finished 2024-09-21T06:31:53.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:52 smithi018 ceph-mon[34477]: osdmap e49: 9 total, 8 up, 9 in 2024-09-21T06:31:53.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:52 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:31:54.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:53 smithi007 ceph-mon[30983]: from='client.? 172.21.15.144:0/2684738530' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:31:54.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:53 smithi018 ceph-mon[34477]: from='client.? 172.21.15.144:0/2684738530' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:31:54.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:53 smithi144 ceph-mon[34653]: from='client.? 172.21.15.144:0/2684738530' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:31:55.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:54 smithi007 ceph-mon[30983]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:31:55.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:54 smithi018 ceph-mon[34477]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:31:55.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:54 smithi144 ceph-mon[34653]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:31:56.990 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:56 smithi144 ceph-mon[34653]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:31:57.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:56 smithi007 ceph-mon[30983]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:31:57.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:56 smithi018 ceph-mon[34477]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:31:58.990 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:31:58 smithi144 ceph-mon[34653]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-09-21T06:31:59.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:31:58 smithi007 ceph-mon[30983]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-09-21T06:31:59.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:31:58 smithi018 ceph-mon[34477]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 715 GiB / 715 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-09-21T06:32:00.987 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:00 smithi144 ceph-mon[34653]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T06:32:00.987 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:00 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-21T06:32:00.987 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:00 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:32:01.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:00 smithi007 ceph-mon[30983]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T06:32:01.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:00 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-21T06:32:01.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:00 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:32:01.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:00 smithi018 ceph-mon[34477]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T06:32:01.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:00 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-21T06:32:01.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:00 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:32:02.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:01 smithi144 ceph-mon[34653]: Deploying daemon osd.8 on smithi144 2024-09-21T06:32:02.116 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:01 smithi007 ceph-mon[30983]: Deploying daemon osd.8 on smithi144 2024-09-21T06:32:02.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:01 smithi018 ceph-mon[34477]: Deploying daemon osd.8 on smithi144 2024-09-21T06:32:02.954 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:02 smithi144 ceph-mon[34653]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-21T06:32:03.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:02 smithi007 ceph-mon[30983]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-21T06:32:03.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:02 smithi018 ceph-mon[34477]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-21T06:32:05.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:04 smithi007 ceph-mon[30983]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-21T06:32:05.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:04 smithi018 ceph-mon[34477]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-21T06:32:05.242 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:04 smithi144 ceph-mon[34653]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-21T06:32:07.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:06 smithi007 ceph-mon[30983]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:32:07.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:06 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:32:07.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:06 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:32:07.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:06 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:32:07.108 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:06 smithi144 ceph-mon[34653]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:32:07.108 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:06 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:32:07.108 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:06 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:32:07.108 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:06 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:32:07.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:06 smithi018 ceph-mon[34477]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:32:07.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:06 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:32:07.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:06 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:32:07.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:06 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:32:08.919 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:08 smithi144 ceph-mon[34653]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:32:09.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:08 smithi007 ceph-mon[30983]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:32:09.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:08 smithi018 ceph-mon[34477]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:32:10.462 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:10 smithi144 ceph-mon[34653]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:32:10.462 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:10 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:32:10.463 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:10 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:32:10.463 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:10 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:32:10.463 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:10 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:32:10.463 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:10 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:32:10.505 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:32:10.503+0000 7fd60effd640 1 -- 172.21.15.144:0/3582231497 <== mgr.14223 v2:172.21.15.7:6800/3442812985 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fd618063800 con 0x7fd6040b65e0 2024-09-21T06:32:10.505 INFO:teuthology.orchestra.run.smithi144.stdout:Created osd(s) 8 on host 'smithi144' 2024-09-21T06:32:10.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:32:10.505+0000 7fd61fec8640 1 -- 172.21.15.144:0/3582231497 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fd6040b65e0 msgr2=0x7fd6040b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:10.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:32:10.505+0000 7fd61fec8640 1 --2- 172.21.15.144:0/3582231497 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fd6040b65e0 0x7fd6040b8af0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd6181010e0 tx=0x7fd61400b390 comp rx=0 tx=0).stop 2024-09-21T06:32:10.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:32:10.505+0000 7fd61fec8640 1 -- 172.21.15.144:0/3582231497 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6181083c0 msgr2=0x7fd6180ffbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:10.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:32:10.505+0000 7fd61fec8640 1 --2- 172.21.15.144:0/3582231497 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6181083c0 0x7fd6180ffbd0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd608032fd0 tx=0x7fd608004270 comp rx=0 tx=0).stop 2024-09-21T06:32:10.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:32:10.505+0000 7fd61fec8640 1 -- 172.21.15.144:0/3582231497 shutdown_connections 2024-09-21T06:32:10.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:32:10.505+0000 7fd61fec8640 1 --2- 172.21.15.144:0/3582231497 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fd6040b65e0 0x7fd6040b8af0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:10.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:32:10.505+0000 7fd61fec8640 1 --2- 172.21.15.144:0/3582231497 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd618108d10 0x7fd618100110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:10.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:32:10.505+0000 7fd61fec8640 1 --2- 172.21.15.144:0/3582231497 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd6181083c0 0x7fd6180ffbd0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:10.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:32:10.505+0000 7fd61fec8640 1 --2- 172.21.15.144:0/3582231497 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd618102a80 0x7fd6180ff690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:10.507 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:32:10.505+0000 7fd61fec8640 1 -- 172.21.15.144:0/3582231497 >> 172.21.15.144:0/3582231497 conn(0x7fd618079740 msgr2=0x7fd61806bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:10.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:32:10.505+0000 7fd61fec8640 1 -- 172.21.15.144:0/3582231497 shutdown_connections 2024-09-21T06:32:10.508 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:32:10.505+0000 7fd61fec8640 1 -- 172.21.15.144:0/3582231497 wait complete. 2024-09-21T06:32:10.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:10 smithi007 ceph-mon[30983]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:32:10.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:10 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:32:10.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:10 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:32:10.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:10 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:32:10.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:10 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:32:10.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:10 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:32:10.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:10 smithi018 ceph-mon[34477]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:32:10.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:10 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:32:10.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:10 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:32:10.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:10 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:32:10.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:10 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:32:10.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:10 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:32:11.371 DEBUG:teuthology.orchestra.run.smithi144:osd.8> sudo journalctl -f -n 0 -u ceph-347cb918-77e2-11ef-baf5-efdc52797490@osd.8.service 2024-09-21T06:32:11.373 INFO:tasks.cephadm:Deploying osd.9 on smithi007 with /dev/vg_nvme/lv_1... 2024-09-21T06:32:11.373 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T06:32:11.589 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:11 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:32:11.589 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:11 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:32:11.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:11 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:32:11.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:11 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:32:11.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:11 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:32:11.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:11 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:32:11.642 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:32:11.689 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:11 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:32:11.689 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:11 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:32:11.689 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:11 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:32:12.784 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:12 smithi007 ceph-mon[30983]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:32:12.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:12 smithi144 ceph-mon[34653]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:32:12.785 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:32:12 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:32:12.640+0000 7f95d0968640 -1 osd.8 0 log_to_monitors true 2024-09-21T06:32:12.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:12 smithi018 ceph-mon[34477]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:32:13.578 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:13 smithi007 ceph-mon[30983]: from='osd.8 [v2:172.21.15.144:6816/1011657022,v1:172.21.15.144:6817/1011657022]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T06:32:13.578 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:13 smithi007 ceph-mon[30983]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T06:32:13.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:13 smithi144 ceph-mon[34653]: from='osd.8 [v2:172.21.15.144:6816/1011657022,v1:172.21.15.144:6817/1011657022]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T06:32:13.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:13 smithi144 ceph-mon[34653]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T06:32:13.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:13 smithi018 ceph-mon[34477]: from='osd.8 [v2:172.21.15.144:6816/1011657022,v1:172.21.15.144:6817/1011657022]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T06:32:13.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:13 smithi018 ceph-mon[34477]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T06:32:14.369 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:32:14.402 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi007:vg_nvme/lv_1 2024-09-21T06:32:14.675 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:32:14.706 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:14 smithi007 ceph-mon[30983]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:32:14.706 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:14 smithi007 ceph-mon[30983]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-21T06:32:14.706 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:14 smithi007 ceph-mon[30983]: osdmap e50: 9 total, 8 up, 9 in 2024-09-21T06:32:14.706 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:14 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:32:14.706 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:14 smithi007 ceph-mon[30983]: from='osd.8 [v2:172.21.15.144:6816/1011657022,v1:172.21.15.144:6817/1011657022]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi144", "root=default"]} : dispatch 2024-09-21T06:32:14.707 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:14 smithi007 ceph-mon[30983]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi144", "root=default"]} : dispatch 2024-09-21T06:32:14.707 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:14 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:32:14.707 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:14 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:32:14.707 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:14 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T06:32:14.707 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:14 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T06:32:14.707 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:14 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T06:32:14.707 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:14 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:32:14.707 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:14 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:32:14.707 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:14 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:32:14.707 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:14 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:32:14.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:14 smithi144 ceph-mon[34653]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:32:14.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:14 smithi144 ceph-mon[34653]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-21T06:32:14.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:14 smithi144 ceph-mon[34653]: osdmap e50: 9 total, 8 up, 9 in 2024-09-21T06:32:14.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:14 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:32:14.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:14 smithi144 ceph-mon[34653]: from='osd.8 [v2:172.21.15.144:6816/1011657022,v1:172.21.15.144:6817/1011657022]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi144", "root=default"]} : dispatch 2024-09-21T06:32:14.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:14 smithi144 ceph-mon[34653]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi144", "root=default"]} : dispatch 2024-09-21T06:32:14.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:14 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:32:14.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:14 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:32:14.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:14 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T06:32:14.786 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:14 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T06:32:14.786 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:14 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T06:32:14.786 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:14 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:32:14.786 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:14 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:32:14.786 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:14 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:32:14.786 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:14 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:32:14.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:14 smithi018 ceph-mon[34477]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:32:14.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:14 smithi018 ceph-mon[34477]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-21T06:32:14.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:14 smithi018 ceph-mon[34477]: osdmap e50: 9 total, 8 up, 9 in 2024-09-21T06:32:14.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:14 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:32:14.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:14 smithi018 ceph-mon[34477]: from='osd.8 [v2:172.21.15.144:6816/1011657022,v1:172.21.15.144:6817/1011657022]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi144", "root=default"]} : dispatch 2024-09-21T06:32:14.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:14 smithi018 ceph-mon[34477]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi144", "root=default"]} : dispatch 2024-09-21T06:32:14.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:14 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:32:14.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:14 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:32:14.870 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:14 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T06:32:14.870 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:14 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T06:32:14.870 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:14 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T06:32:14.870 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:14 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:32:14.870 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:14 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:32:14.870 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:14 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:32:14.870 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:14 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:32:15.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:32:15.157+0000 7f1f427a8640 1 -- 172.21.15.7:0/2271133193 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f3c1052a0 msgr2=0x7f1f3c10d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:15.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:32:15.157+0000 7f1f427a8640 1 --2- 172.21.15.7:0/2271133193 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f3c1052a0 0x7f1f3c10d930 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1f30009900 tx=0x7f1f3002a410 comp rx=0 tx=0).stop 2024-09-21T06:32:15.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:32:15.158+0000 7f1f427a8640 1 -- 172.21.15.7:0/2271133193 shutdown_connections 2024-09-21T06:32:15.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:32:15.158+0000 7f1f427a8640 1 --2- 172.21.15.7:0/2271133193 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1f3c10de70 0x7f1f3c110340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:15.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:32:15.158+0000 7f1f427a8640 1 --2- 172.21.15.7:0/2271133193 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f3c1052a0 0x7f1f3c10d930 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:15.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:32:15.158+0000 7f1f427a8640 1 --2- 172.21.15.7:0/2271133193 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f3c1048c0 0x7f1f3c104cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:15.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:32:15.158+0000 7f1f427a8640 1 -- 172.21.15.7:0/2271133193 >> 172.21.15.7:0/2271133193 conn(0x7f1f3c0797b0 msgr2=0x7f1f3c079bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:15.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:32:15.158+0000 7f1f427a8640 1 -- 172.21.15.7:0/2271133193 shutdown_connections 2024-09-21T06:32:15.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:32:15.158+0000 7f1f427a8640 1 -- 172.21.15.7:0/2271133193 wait complete. 2024-09-21T06:32:15.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:32:15.158+0000 7f1f427a8640 1 Processor -- start 2024-09-21T06:32:15.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:32:15.158+0000 7f1f427a8640 1 -- start start 2024-09-21T06:32:15.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:32:15.159+0000 7f1f427a8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f3c1048c0 0x7f1f3c19a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:15.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:32:15.159+0000 7f1f427a8640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1f3c1052a0 0x7f1f3c19a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:15.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:32:15.159+0000 7f1f427a8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f3c10de70 0x7f1f3c19fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:15.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:32:15.159+0000 7f1f427a8640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1f3c113ab0 con 0x7f1f3c10de70 2024-09-21T06:32:15.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:32:15.159+0000 7f1f427a8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1f3c113930 con 0x7f1f3c1048c0 2024-09-21T06:32:15.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:32:15.159+0000 7f1f427a8640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1f3c113c30 con 0x7f1f3c1052a0 2024-09-21T06:32:15.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:32:15.159+0000 7f1f40d45640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f3c10de70 0x7f1f3c19fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:15.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:32:15.159+0000 7f1f40d45640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f3c10de70 0x7f1f3c19fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51680/0 (socket says 172.21.15.7:51680) 2024-09-21T06:32:15.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:32:15.159+0000 7f1f40d45640 1 -- 172.21.15.7:0/1573978900 learned_addr learned my addr 172.21.15.7:0/1573978900 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:32:15.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:32:15.159+0000 7f1f3b7fe640 1 --2- 172.21.15.7:0/1573978900 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1f3c1052a0 0x7f1f3c19a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:15.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:32:15.159+0000 7f1f3bfff640 1 --2- 172.21.15.7:0/1573978900 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f3c1048c0 0x7f1f3c19a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:15.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:32:15.159+0000 7f1f40d45640 1 -- 172.21.15.7:0/1573978900 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1f3c1052a0 msgr2=0x7f1f3c19a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:15.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:32:15.159+0000 7f1f40d45640 1 --2- 172.21.15.7:0/1573978900 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1f3c1052a0 0x7f1f3c19a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:15.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:32:15.159+0000 7f1f40d45640 1 -- 172.21.15.7:0/1573978900 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f3c1048c0 msgr2=0x7f1f3c19a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:15.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:32:15.159+0000 7f1f40d45640 1 --2- 172.21.15.7:0/1573978900 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f3c1048c0 0x7f1f3c19a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:15.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:32:15.160+0000 7f1f40d45640 1 -- 172.21.15.7:0/1573978900 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f3c1a0270 con 0x7f1f3c10de70 2024-09-21T06:32:15.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:32:15.160+0000 7f1f40d45640 1 --2- 172.21.15.7:0/1573978900 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f3c10de70 0x7f1f3c19fc00 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1f3400cce0 tx=0x7f1f3400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:15.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:32:15.160+0000 7f1f397fa640 1 -- 172.21.15.7:0/1573978900 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f3400f450 con 0x7f1f3c10de70 2024-09-21T06:32:15.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:32:15.160+0000 7f1f427a8640 1 -- 172.21.15.7:0/1573978900 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f3c1a0560 con 0x7f1f3c10de70 2024-09-21T06:32:15.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:32:15.160+0000 7f1f397fa640 1 -- 172.21.15.7:0/1573978900 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1f3400faa0 con 0x7f1f3c10de70 2024-09-21T06:32:15.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:32:15.160+0000 7f1f397fa640 1 -- 172.21.15.7:0/1573978900 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f34018a80 con 0x7f1f3c10de70 2024-09-21T06:32:15.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:32:15.160+0000 7f1f427a8640 1 -- 172.21.15.7:0/1573978900 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f3c1a6d80 con 0x7f1f3c10de70 2024-09-21T06:32:15.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:32:15.161+0000 7f1f427a8640 1 -- 172.21.15.7:0/1573978900 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f3c104cd0 con 0x7f1f3c10de70 2024-09-21T06:32:15.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:32:15.163+0000 7f1f397fa640 1 -- 172.21.15.7:0/1573978900 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 21) ==== 154528+0+0 (secure 0 0 0) 0x7f1f3400fc50 con 0x7f1f3c10de70 2024-09-21T06:32:15.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:32:15.164+0000 7f1f397fa640 1 --2- 172.21.15.7:0/1573978900 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f1f240b6590 0x7f1f240b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:15.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:32:15.164+0000 7f1f3bfff640 1 --2- 172.21.15.7:0/1573978900 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f1f240b6590 0x7f1f240b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:15.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:32:15.165+0000 7f1f397fa640 1 -- 172.21.15.7:0/1573978900 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5764+0+0 (secure 0 0 0) 0x7f1f340e71d0 con 0x7f1f3c10de70 2024-09-21T06:32:15.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:32:15.165+0000 7f1f3bfff640 1 --2- 172.21.15.7:0/1573978900 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f1f240b6590 0x7f1f240b8aa0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c00abe0 tx=0x7f1f2c00a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:15.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:32:15.168+0000 7f1f397fa640 1 -- 172.21.15.7:0/1573978900 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1f34014030 con 0x7f1f3c10de70 2024-09-21T06:32:15.285 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:32:14 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:32:14.967+0000 7f95cc8ea640 -1 osd.8 0 waiting for initial osdmap 2024-09-21T06:32:15.285 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:32:14 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:32:14.976+0000 7f95c46e0640 -1 osd.8 51 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T06:32:15.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:32:15.370+0000 7f1f427a8640 1 -- 172.21.15.7:0/1573978900 --> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f1f3c100f00 con 0x7f1f240b6590 2024-09-21T06:32:15.736 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:15 smithi007 ceph-mon[30983]: Detected new or changed devices on smithi144 2024-09-21T06:32:15.736 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:15 smithi007 ceph-mon[30983]: Adjusting osd_memory_target on smithi144 to 5696M 2024-09-21T06:32:15.736 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:15 smithi007 ceph-mon[30983]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]': finished 2024-09-21T06:32:15.736 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:15 smithi007 ceph-mon[30983]: osdmap e51: 9 total, 8 up, 9 in 2024-09-21T06:32:15.736 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:15 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:32:15.736 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:15 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:32:15.736 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:15 smithi007 ceph-mon[30983]: from='osd.8 ' entity='osd.8' 2024-09-21T06:32:15.737 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:15 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:32:15.737 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:15 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:32:15.737 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:15 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:32:15.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:15 smithi144 ceph-mon[34653]: Detected new or changed devices on smithi144 2024-09-21T06:32:15.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:15 smithi144 ceph-mon[34653]: Adjusting osd_memory_target on smithi144 to 5696M 2024-09-21T06:32:15.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:15 smithi144 ceph-mon[34653]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]': finished 2024-09-21T06:32:15.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:15 smithi144 ceph-mon[34653]: osdmap e51: 9 total, 8 up, 9 in 2024-09-21T06:32:15.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:15 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:32:15.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:15 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:32:15.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:15 smithi144 ceph-mon[34653]: from='osd.8 ' entity='osd.8' 2024-09-21T06:32:15.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:15 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:32:15.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:15 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:32:15.786 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:15 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:32:15.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:15 smithi018 ceph-mon[34477]: Detected new or changed devices on smithi144 2024-09-21T06:32:15.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:15 smithi018 ceph-mon[34477]: Adjusting osd_memory_target on smithi144 to 5696M 2024-09-21T06:32:15.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:15 smithi018 ceph-mon[34477]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]': finished 2024-09-21T06:32:15.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:15 smithi018 ceph-mon[34477]: osdmap e51: 9 total, 8 up, 9 in 2024-09-21T06:32:15.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:15 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:32:15.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:15 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:32:15.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:15 smithi018 ceph-mon[34477]: from='osd.8 ' entity='osd.8' 2024-09-21T06:32:15.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:15 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:32:15.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:15 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:32:15.870 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:15 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:32:16.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:16 smithi144 ceph-mon[34653]: purged_snaps scrub starts 2024-09-21T06:32:16.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:16 smithi144 ceph-mon[34653]: purged_snaps scrub ok 2024-09-21T06:32:16.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:16 smithi144 ceph-mon[34653]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:32:16.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:16 smithi144 ceph-mon[34653]: from='client.14637 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:32:16.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:16 smithi144 ceph-mon[34653]: osd.8 [v2:172.21.15.144:6816/1011657022,v1:172.21.15.144:6817/1011657022] boot 2024-09-21T06:32:16.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:16 smithi144 ceph-mon[34653]: osdmap e52: 9 total, 9 up, 9 in 2024-09-21T06:32:16.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:16 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:32:16.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:16 smithi144 ceph-mon[34653]: osdmap e53: 9 total, 9 up, 9 in 2024-09-21T06:32:16.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:16 smithi007 ceph-mon[30983]: purged_snaps scrub starts 2024-09-21T06:32:16.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:16 smithi007 ceph-mon[30983]: purged_snaps scrub ok 2024-09-21T06:32:16.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:16 smithi007 ceph-mon[30983]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:32:16.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:16 smithi007 ceph-mon[30983]: from='client.14637 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:32:16.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:16 smithi007 ceph-mon[30983]: osd.8 [v2:172.21.15.144:6816/1011657022,v1:172.21.15.144:6817/1011657022] boot 2024-09-21T06:32:16.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:16 smithi007 ceph-mon[30983]: osdmap e52: 9 total, 9 up, 9 in 2024-09-21T06:32:16.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:16 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:32:16.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:16 smithi007 ceph-mon[30983]: osdmap e53: 9 total, 9 up, 9 in 2024-09-21T06:32:16.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:16 smithi018 ceph-mon[34477]: purged_snaps scrub starts 2024-09-21T06:32:16.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:16 smithi018 ceph-mon[34477]: purged_snaps scrub ok 2024-09-21T06:32:16.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:16 smithi018 ceph-mon[34477]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 715 GiB / 715 GiB avail 2024-09-21T06:32:16.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:16 smithi018 ceph-mon[34477]: from='client.14637 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi007:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:32:16.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:16 smithi018 ceph-mon[34477]: osd.8 [v2:172.21.15.144:6816/1011657022,v1:172.21.15.144:6817/1011657022] boot 2024-09-21T06:32:16.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:16 smithi018 ceph-mon[34477]: osdmap e52: 9 total, 9 up, 9 in 2024-09-21T06:32:16.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:16 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T06:32:16.870 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:16 smithi018 ceph-mon[34477]: osdmap e53: 9 total, 9 up, 9 in 2024-09-21T06:32:18.761 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:18 smithi007 ceph-mon[30983]: pgmap v178: 1 pgs: 1 remapped+peering; 577 KiB data, 295 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:32:18.762 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:18 smithi007 ceph-mon[30983]: osdmap e54: 9 total, 9 up, 9 in 2024-09-21T06:32:18.762 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:18 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2202699778' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ad12d6f7-fd21-49bd-a343-744f3cff4bbb"} : dispatch 2024-09-21T06:32:18.762 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:18 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2202699778' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ad12d6f7-fd21-49bd-a343-744f3cff4bbb"}]': finished 2024-09-21T06:32:18.762 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:18 smithi007 ceph-mon[30983]: osdmap e55: 10 total, 9 up, 10 in 2024-09-21T06:32:18.762 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:18 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:32:18.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:18 smithi144 ceph-mon[34653]: pgmap v178: 1 pgs: 1 remapped+peering; 577 KiB data, 295 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:32:18.786 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:18 smithi144 ceph-mon[34653]: osdmap e54: 9 total, 9 up, 9 in 2024-09-21T06:32:18.786 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:18 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/2202699778' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ad12d6f7-fd21-49bd-a343-744f3cff4bbb"} : dispatch 2024-09-21T06:32:18.786 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:18 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/2202699778' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ad12d6f7-fd21-49bd-a343-744f3cff4bbb"}]': finished 2024-09-21T06:32:18.786 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:18 smithi144 ceph-mon[34653]: osdmap e55: 10 total, 9 up, 10 in 2024-09-21T06:32:18.786 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:18 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:32:18.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:18 smithi018 ceph-mon[34477]: pgmap v178: 1 pgs: 1 remapped+peering; 577 KiB data, 295 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:32:18.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:18 smithi018 ceph-mon[34477]: osdmap e54: 9 total, 9 up, 9 in 2024-09-21T06:32:18.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:18 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/2202699778' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "ad12d6f7-fd21-49bd-a343-744f3cff4bbb"} : dispatch 2024-09-21T06:32:18.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:18 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/2202699778' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ad12d6f7-fd21-49bd-a343-744f3cff4bbb"}]': finished 2024-09-21T06:32:18.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:18 smithi018 ceph-mon[34477]: osdmap e55: 10 total, 9 up, 10 in 2024-09-21T06:32:18.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:18 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:32:19.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:19 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/1232671311' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:32:19.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:19 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/1232671311' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:32:19.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:19 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/1232671311' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:32:20.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:20 smithi144 ceph-mon[34653]: pgmap v181: 1 pgs: 1 remapped+peering; 577 KiB data, 295 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:32:20.839 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:20 smithi007 ceph-mon[30983]: pgmap v181: 1 pgs: 1 remapped+peering; 577 KiB data, 295 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:32:20.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:20 smithi018 ceph-mon[34477]: pgmap v181: 1 pgs: 1 remapped+peering; 577 KiB data, 295 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:32:22.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:22 smithi144 ceph-mon[34653]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail; 103 KiB/s, 0 objects/s recovering 2024-09-21T06:32:22.842 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:22 smithi007 ceph-mon[30983]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail; 103 KiB/s, 0 objects/s recovering 2024-09-21T06:32:22.870 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:22 smithi018 ceph-mon[34477]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail; 103 KiB/s, 0 objects/s recovering 2024-09-21T06:32:24.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:24 smithi144 ceph-mon[34653]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail; 87 KiB/s, 0 objects/s recovering 2024-09-21T06:32:24.808 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:24 smithi007 ceph-mon[30983]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail; 87 KiB/s, 0 objects/s recovering 2024-09-21T06:32:24.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:24 smithi018 ceph-mon[34477]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail; 87 KiB/s, 0 objects/s recovering 2024-09-21T06:32:26.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:26 smithi007 ceph-mon[30983]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T06:32:26.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:26 smithi018 ceph-mon[34477]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T06:32:27.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:26 smithi144 ceph-mon[34653]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T06:32:27.785 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:27 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-21T06:32:27.785 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:27 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:32:27.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:27 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-21T06:32:27.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:27 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:32:28.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:27 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-21T06:32:28.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:27 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:32:28.805 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:28 smithi007 ceph-mon[30983]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-21T06:32:28.806 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:28 smithi007 ceph-mon[30983]: Deploying daemon osd.9 on smithi007 2024-09-21T06:32:28.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:28 smithi018 ceph-mon[34477]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-21T06:32:28.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:28 smithi018 ceph-mon[34477]: Deploying daemon osd.9 on smithi007 2024-09-21T06:32:29.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:28 smithi144 ceph-mon[34653]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-09-21T06:32:29.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:28 smithi144 ceph-mon[34653]: Deploying daemon osd.9 on smithi007 2024-09-21T06:32:30.832 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:30 smithi007 ceph-mon[30983]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-21T06:32:30.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:30 smithi018 ceph-mon[34477]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-21T06:32:31.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:30 smithi144 ceph-mon[34653]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-21T06:32:32.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:32 smithi007 ceph-mon[30983]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:32:32.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:32 smithi018 ceph-mon[34477]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:32:33.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:32 smithi144 ceph-mon[34653]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T06:32:33.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:33 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:32:33.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:33 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:32:33.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:33 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:32:33.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:33 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:32:33.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:33 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:32:33.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:33 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:32:34.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:33 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:32:34.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:33 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:32:34.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:33 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:32:34.822 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:34 smithi007 ceph-mon[30983]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:32:34.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:34 smithi018 ceph-mon[34477]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:32:35.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:34 smithi144 ceph-mon[34653]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:32:36.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:36 smithi007 ceph-mon[30983]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:32:36.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:36 smithi018 ceph-mon[34477]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:32:36.948 INFO:teuthology.orchestra.run.smithi007.stdout:Created osd(s) 9 on host 'smithi007' 2024-09-21T06:32:36.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:32:36.945+0000 7f1f397fa640 1 -- 172.21.15.7:0/1573978900 <== mgr.14223 v2:172.21.15.7:6800/3442812985 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f1f3c100f00 con 0x7f1f240b6590 2024-09-21T06:32:36.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:32:36.948+0000 7f1f427a8640 1 -- 172.21.15.7:0/1573978900 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f1f240b6590 msgr2=0x7f1f240b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:36.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:32:36.948+0000 7f1f427a8640 1 --2- 172.21.15.7:0/1573978900 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f1f240b6590 0x7f1f240b8aa0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c00abe0 tx=0x7f1f2c00a2d0 comp rx=0 tx=0).stop 2024-09-21T06:32:36.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:32:36.948+0000 7f1f427a8640 1 -- 172.21.15.7:0/1573978900 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f3c10de70 msgr2=0x7f1f3c19fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:36.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:32:36.948+0000 7f1f427a8640 1 --2- 172.21.15.7:0/1573978900 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f3c10de70 0x7f1f3c19fc00 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1f3400cce0 tx=0x7f1f3400a620 comp rx=0 tx=0).stop 2024-09-21T06:32:36.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:32:36.949+0000 7f1f427a8640 1 -- 172.21.15.7:0/1573978900 shutdown_connections 2024-09-21T06:32:36.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:32:36.949+0000 7f1f427a8640 1 --2- 172.21.15.7:0/1573978900 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f1f240b6590 0x7f1f240b8aa0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:36.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:32:36.949+0000 7f1f427a8640 1 --2- 172.21.15.7:0/1573978900 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f3c10de70 0x7f1f3c19fc00 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:36.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:32:36.949+0000 7f1f427a8640 1 --2- 172.21.15.7:0/1573978900 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1f3c1052a0 0x7f1f3c19a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:36.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:32:36.949+0000 7f1f427a8640 1 --2- 172.21.15.7:0/1573978900 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f3c1048c0 0x7f1f3c19a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:36.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:32:36.949+0000 7f1f427a8640 1 -- 172.21.15.7:0/1573978900 >> 172.21.15.7:0/1573978900 conn(0x7f1f3c0797b0 msgr2=0x7f1f3c1007f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:36.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:32:36.949+0000 7f1f427a8640 1 -- 172.21.15.7:0/1573978900 shutdown_connections 2024-09-21T06:32:36.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:32:36.949+0000 7f1f427a8640 1 -- 172.21.15.7:0/1573978900 wait complete. 2024-09-21T06:32:37.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:36 smithi144 ceph-mon[34653]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:32:37.724 DEBUG:teuthology.orchestra.run.smithi007:osd.9> sudo journalctl -f -n 0 -u ceph-347cb918-77e2-11ef-baf5-efdc52797490@osd.9.service 2024-09-21T06:32:37.727 INFO:tasks.cephadm:Deploying osd.10 on smithi018 with /dev/vg_nvme/lv_1... 2024-09-21T06:32:37.727 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T06:32:37.993 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T06:32:38.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:37 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:32:38.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:37 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:32:38.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:37 smithi007 ceph-mon[30983]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:32:38.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:37 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:32:38.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:37 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:32:38.113 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:37 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:32:38.114 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:37 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:32:38.114 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:37 smithi018 ceph-mon[34477]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:32:38.114 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:37 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:32:38.114 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:37 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:32:38.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:37 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:32:38.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:37 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:32:38.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:37 smithi144 ceph-mon[34653]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:32:38.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:37 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:32:38.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:37 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:32:39.809 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:32:39 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:32:39.363+0000 7f3668a4a640 -1 osd.9 0 log_to_monitors true 2024-09-21T06:32:40.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:40 smithi018 ceph-mon[34477]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:32:40.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:40 smithi018 ceph-mon[34477]: from='osd.9 [v2:172.21.15.7:6826/256146339,v1:172.21.15.7:6827/256146339]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T06:32:40.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:40 smithi144 ceph-mon[34653]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:32:40.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:40 smithi144 ceph-mon[34653]: from='osd.9 [v2:172.21.15.7:6826/256146339,v1:172.21.15.7:6827/256146339]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T06:32:40.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:40 smithi007 ceph-mon[30983]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:32:40.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:40 smithi007 ceph-mon[30983]: from='osd.9 [v2:172.21.15.7:6826/256146339,v1:172.21.15.7:6827/256146339]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T06:32:40.834 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-21T06:32:40.862 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi018:vg_nvme/lv_1 2024-09-21T06:32:41.119 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T06:32:41.426 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:41 smithi018 ceph-mon[34477]: from='osd.9 [v2:172.21.15.7:6826/256146339,v1:172.21.15.7:6827/256146339]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-21T06:32:41.426 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:41 smithi018 ceph-mon[34477]: osdmap e56: 10 total, 9 up, 10 in 2024-09-21T06:32:41.426 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:41 smithi018 ceph-mon[34477]: from='osd.9 [v2:172.21.15.7:6826/256146339,v1:172.21.15.7:6827/256146339]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi007", "root=default"]} : dispatch 2024-09-21T06:32:41.426 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:41 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:32:41.485 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:41 smithi007 ceph-mon[30983]: from='osd.9 [v2:172.21.15.7:6826/256146339,v1:172.21.15.7:6827/256146339]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-21T06:32:41.486 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:41 smithi007 ceph-mon[30983]: osdmap e56: 10 total, 9 up, 10 in 2024-09-21T06:32:41.486 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:41 smithi007 ceph-mon[30983]: from='osd.9 [v2:172.21.15.7:6826/256146339,v1:172.21.15.7:6827/256146339]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi007", "root=default"]} : dispatch 2024-09-21T06:32:41.486 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:41 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:32:41.486 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:32:41 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:32:41.182+0000 7f36649cc640 -1 osd.9 0 waiting for initial osdmap 2024-09-21T06:32:41.486 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:32:41 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:32:41.192+0000 7f36607ca640 -1 osd.9 57 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T06:32:41.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:41 smithi144 ceph-mon[34653]: from='osd.9 [v2:172.21.15.7:6826/256146339,v1:172.21.15.7:6827/256146339]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-21T06:32:41.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:41 smithi144 ceph-mon[34653]: osdmap e56: 10 total, 9 up, 10 in 2024-09-21T06:32:41.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:41 smithi144 ceph-mon[34653]: from='osd.9 [v2:172.21.15.7:6826/256146339,v1:172.21.15.7:6827/256146339]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi007", "root=default"]} : dispatch 2024-09-21T06:32:41.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:41 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:32:41.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:32:41.625+0000 7fd2f7a6a640 1 -- 172.21.15.18:0/3901947868 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd2f0110200 msgr2=0x7fd2f0112620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:41.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:32:41.625+0000 7fd2f7a6a640 1 --2- 172.21.15.18:0/3901947868 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd2f0110200 0x7fd2f0112620 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd2e8009ca0 tx=0x7fd2e802a950 comp rx=0 tx=0).stop 2024-09-21T06:32:41.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:32:41.625+0000 7fd2f7a6a640 1 -- 172.21.15.18:0/3901947868 shutdown_connections 2024-09-21T06:32:41.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:32:41.625+0000 7fd2f7a6a640 1 --2- 172.21.15.18:0/3901947868 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd2f0110200 0x7fd2f0112620 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:41.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:32:41.625+0000 7fd2f7a6a640 1 --2- 172.21.15.18:0/3901947868 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2f0102fa0 0x7fd2f010fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:41.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:32:41.625+0000 7fd2f7a6a640 1 --2- 172.21.15.18:0/3901947868 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2f0102650 0x7fd2f0102a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:41.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:32:41.625+0000 7fd2f7a6a640 1 -- 172.21.15.18:0/3901947868 >> 172.21.15.18:0/3901947868 conn(0x7fd2f0079770 msgr2=0x7fd2f0079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:32:41.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:32:41.625+0000 7fd2f7a6a640 1 -- 172.21.15.18:0/3901947868 shutdown_connections 2024-09-21T06:32:41.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:32:41.625+0000 7fd2f7a6a640 1 -- 172.21.15.18:0/3901947868 wait complete. 2024-09-21T06:32:41.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:32:41.625+0000 7fd2f7a6a640 1 Processor -- start 2024-09-21T06:32:41.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:32:41.625+0000 7fd2f7a6a640 1 -- start start 2024-09-21T06:32:41.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:32:41.626+0000 7fd2f7a6a640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2f0102650 0x7fd2f019c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:41.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:32:41.626+0000 7fd2f7a6a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd2f0102fa0 0x7fd2f019cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:41.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:32:41.626+0000 7fd2f7a6a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2f0110200 0x7fd2f01a1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:41.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:32:41.626+0000 7fd2f7a6a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd2f0115d40 con 0x7fd2f0110200 2024-09-21T06:32:41.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:32:41.626+0000 7fd2f7a6a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd2f0115bc0 con 0x7fd2f0102fa0 2024-09-21T06:32:41.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:32:41.626+0000 7fd2f7a6a640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd2f0115ec0 con 0x7fd2f0102650 2024-09-21T06:32:41.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:32:41.626+0000 7fd2f5005640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd2f0102fa0 0x7fd2f019cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:41.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:32:41.626+0000 7fd2f5005640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd2f0102fa0 0x7fd2f019cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:37188/0 (socket says 172.21.15.18:37188) 2024-09-21T06:32:41.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:32:41.626+0000 7fd2f5005640 1 -- 172.21.15.18:0/3648844725 learned_addr learned my addr 172.21.15.18:0/3648844725 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-21T06:32:41.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:32:41.626+0000 7fd2f6007640 1 --2- 172.21.15.18:0/3648844725 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2f0110200 0x7fd2f01a1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:41.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:32:41.626+0000 7fd2f5806640 1 --2- 172.21.15.18:0/3648844725 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2f0102650 0x7fd2f019c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:41.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:32:41.626+0000 7fd2f5005640 1 -- 172.21.15.18:0/3648844725 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2f0102650 msgr2=0x7fd2f019c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:41.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:32:41.626+0000 7fd2f5005640 1 --2- 172.21.15.18:0/3648844725 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2f0102650 0x7fd2f019c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:41.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:32:41.626+0000 7fd2f5005640 1 -- 172.21.15.18:0/3648844725 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2f0110200 msgr2=0x7fd2f01a1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:32:41.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:32:41.626+0000 7fd2f5005640 1 --2- 172.21.15.18:0/3648844725 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2f0110200 0x7fd2f01a1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:32:41.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:32:41.626+0000 7fd2f5005640 1 -- 172.21.15.18:0/3648844725 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2f01a2600 con 0x7fd2f0102fa0 2024-09-21T06:32:41.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:32:41.626+0000 7fd2f6007640 1 --2- 172.21.15.18:0/3648844725 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2f0110200 0x7fd2f01a1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:32:41.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:32:41.627+0000 7fd2f5005640 1 --2- 172.21.15.18:0/3648844725 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd2f0102fa0 0x7fd2f019cc30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd2e000d950 tx=0x7fd2e000de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:41.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:32:41.627+0000 7fd2e6ffd640 1 -- 172.21.15.18:0/3648844725 <== mon.2 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e0017070 con 0x7fd2f0102fa0 2024-09-21T06:32:41.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:32:41.627+0000 7fd2e6ffd640 1 -- 172.21.15.18:0/3648844725 <== mon.2 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2e0009c30 con 0x7fd2f0102fa0 2024-09-21T06:32:41.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:32:41.627+0000 7fd2f7a6a640 1 -- 172.21.15.18:0/3648844725 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2f01a28f0 con 0x7fd2f0102fa0 2024-09-21T06:32:41.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:32:41.627+0000 7fd2e6ffd640 1 -- 172.21.15.18:0/3648844725 <== mon.2 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e000f620 con 0x7fd2f0102fa0 2024-09-21T06:32:41.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:32:41.627+0000 7fd2f7a6a640 1 -- 172.21.15.18:0/3648844725 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2f01a9050 con 0x7fd2f0102fa0 2024-09-21T06:32:41.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:32:41.628+0000 7fd2f7a6a640 1 -- 172.21.15.18:0/3648844725 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2f006c260 con 0x7fd2f0102fa0 2024-09-21T06:32:41.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:32:41.629+0000 7fd2e6ffd640 1 -- 172.21.15.18:0/3648844725 <== mon.2 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 21) ==== 154528+0+0 (secure 0 0 0) 0x7fd2e0005030 con 0x7fd2f0102fa0 2024-09-21T06:32:41.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:32:41.630+0000 7fd2e6ffd640 1 --2- 172.21.15.18:0/3648844725 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fd2dc0b6560 0x7fd2dc0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:32:41.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:32:41.630+0000 7fd2e6ffd640 1 -- 172.21.15.18:0/3648844725 <== mon.2 v2:172.21.15.18:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6196+0+0 (secure 0 0 0) 0x7fd2e00e6630 con 0x7fd2f0102fa0 2024-09-21T06:32:41.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:32:41.630+0000 7fd2f5806640 1 --2- 172.21.15.18:0/3648844725 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fd2dc0b6560 0x7fd2dc0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:32:41.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:32:41.631+0000 7fd2f5806640 1 --2- 172.21.15.18:0/3648844725 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fd2dc0b6560 0x7fd2dc0b8a70 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec009bd0 tx=0x7fd2ec005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:32:41.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:32:41.633+0000 7fd2e6ffd640 1 -- 172.21.15.18:0/3648844725 <== mon.2 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd2e0009de0 con 0x7fd2f0102fa0 2024-09-21T06:32:41.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:32:41.832+0000 7fd2f7a6a640 1 -- 172.21.15.18:0/3648844725 --> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fd2f0111bc0 con 0x7fd2dc0b6560 2024-09-21T06:32:42.505 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:42 smithi018 ceph-mon[34477]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:32:42.505 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:42 smithi018 ceph-mon[34477]: from='osd.9 [v2:172.21.15.7:6826/256146339,v1:172.21.15.7:6827/256146339]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-09-21T06:32:42.505 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:42 smithi018 ceph-mon[34477]: osdmap e57: 10 total, 9 up, 10 in 2024-09-21T06:32:42.505 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:42 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:32:42.505 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:42 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:32:42.506 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:42 smithi018 ceph-mon[34477]: Detected new or changed devices on smithi007 2024-09-21T06:32:42.506 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:42 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:32:42.506 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:42 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:32:42.506 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:42 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T06:32:42.506 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:42 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T06:32:42.506 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:42 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T06:32:42.506 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:42 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T06:32:42.506 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:42 smithi018 ceph-mon[34477]: Adjusting osd_memory_target on smithi007 to 4273M 2024-09-21T06:32:42.506 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:42 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:32:42.506 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:42 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:32:42.506 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:42 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:32:42.506 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:42 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:32:42.506 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:42 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:32:42.506 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:42 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:32:42.506 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:42 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:32:42.507 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:42 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:32:42.507 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:42 smithi018 ceph-mon[34477]: from='client.24539 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:32:42.507 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:42 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:32:42.507 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:42 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:32:42.507 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:42 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:32:42.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:42 smithi144 ceph-mon[34653]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:32:42.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:42 smithi144 ceph-mon[34653]: from='osd.9 [v2:172.21.15.7:6826/256146339,v1:172.21.15.7:6827/256146339]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-09-21T06:32:42.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:42 smithi144 ceph-mon[34653]: osdmap e57: 10 total, 9 up, 10 in 2024-09-21T06:32:42.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:42 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:32:42.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:42 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:32:42.536 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:42 smithi144 ceph-mon[34653]: Detected new or changed devices on smithi007 2024-09-21T06:32:42.536 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:42 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:32:42.536 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:42 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:32:42.536 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:42 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T06:32:42.536 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:42 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T06:32:42.536 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:42 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T06:32:42.536 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:42 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T06:32:42.536 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:42 smithi144 ceph-mon[34653]: Adjusting osd_memory_target on smithi007 to 4273M 2024-09-21T06:32:42.536 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:42 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:32:42.536 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:42 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:32:42.536 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:42 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:32:42.536 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:42 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:32:42.536 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:42 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:32:42.536 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:42 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:32:42.536 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:42 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:32:42.537 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:42 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:32:42.537 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:42 smithi144 ceph-mon[34653]: from='client.24539 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:32:42.537 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:42 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:32:42.537 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:42 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:32:42.537 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:42 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:32:42.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:42 smithi007 ceph-mon[30983]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 275 MiB used, 804 GiB / 805 GiB avail 2024-09-21T06:32:42.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:42 smithi007 ceph-mon[30983]: from='osd.9 [v2:172.21.15.7:6826/256146339,v1:172.21.15.7:6827/256146339]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi007", "root=default"]}]': finished 2024-09-21T06:32:42.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:42 smithi007 ceph-mon[30983]: osdmap e57: 10 total, 9 up, 10 in 2024-09-21T06:32:42.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:42 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:32:42.591 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:42 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:32:42.591 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:42 smithi007 ceph-mon[30983]: Detected new or changed devices on smithi007 2024-09-21T06:32:42.591 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:42 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:32:42.591 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:42 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:32:42.591 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:42 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T06:32:42.591 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:42 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T06:32:42.591 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:42 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T06:32:42.591 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:42 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T06:32:42.591 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:42 smithi007 ceph-mon[30983]: Adjusting osd_memory_target on smithi007 to 4273M 2024-09-21T06:32:42.591 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:42 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:32:42.591 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:42 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:32:42.591 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:42 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:32:42.591 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:42 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:32:42.592 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:42 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:32:42.592 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:42 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:32:42.592 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:42 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:32:42.592 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:42 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:32:42.592 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:42 smithi007 ceph-mon[30983]: from='client.24539 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi018:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:32:42.592 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:42 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:32:42.592 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:42 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:32:42.592 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:42 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:32:43.259 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:43 smithi018 ceph-mon[34477]: purged_snaps scrub starts 2024-09-21T06:32:43.259 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:43 smithi018 ceph-mon[34477]: purged_snaps scrub ok 2024-09-21T06:32:43.259 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:43 smithi018 ceph-mon[34477]: osd.9 [v2:172.21.15.7:6826/256146339,v1:172.21.15.7:6827/256146339] boot 2024-09-21T06:32:43.259 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:43 smithi018 ceph-mon[34477]: osdmap e58: 10 total, 10 up, 10 in 2024-09-21T06:32:43.259 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:43 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:32:43.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:43 smithi144 ceph-mon[34653]: purged_snaps scrub starts 2024-09-21T06:32:43.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:43 smithi144 ceph-mon[34653]: purged_snaps scrub ok 2024-09-21T06:32:43.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:43 smithi144 ceph-mon[34653]: osd.9 [v2:172.21.15.7:6826/256146339,v1:172.21.15.7:6827/256146339] boot 2024-09-21T06:32:43.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:43 smithi144 ceph-mon[34653]: osdmap e58: 10 total, 10 up, 10 in 2024-09-21T06:32:43.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:43 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:32:43.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:43 smithi007 ceph-mon[30983]: purged_snaps scrub starts 2024-09-21T06:32:43.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:43 smithi007 ceph-mon[30983]: purged_snaps scrub ok 2024-09-21T06:32:43.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:43 smithi007 ceph-mon[30983]: osd.9 [v2:172.21.15.7:6826/256146339,v1:172.21.15.7:6827/256146339] boot 2024-09-21T06:32:43.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:43 smithi007 ceph-mon[30983]: osdmap e58: 10 total, 10 up, 10 in 2024-09-21T06:32:43.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:43 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T06:32:44.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:44 smithi018 ceph-mon[34477]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 302 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:32:44.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:44 smithi018 ceph-mon[34477]: osdmap e59: 10 total, 10 up, 10 in 2024-09-21T06:32:44.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:44 smithi144 ceph-mon[34653]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 302 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:32:44.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:44 smithi144 ceph-mon[34653]: osdmap e59: 10 total, 10 up, 10 in 2024-09-21T06:32:44.589 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:44 smithi007 ceph-mon[30983]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 302 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:32:44.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:44 smithi007 ceph-mon[30983]: osdmap e59: 10 total, 10 up, 10 in 2024-09-21T06:32:45.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:45 smithi018 ceph-mon[34477]: from='client.? 172.21.15.18:0/2273421889' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1317a2ad-ec15-4096-b2da-689475b7cacc"} : dispatch 2024-09-21T06:32:45.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:45 smithi018 ceph-mon[34477]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1317a2ad-ec15-4096-b2da-689475b7cacc"} : dispatch 2024-09-21T06:32:45.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:45 smithi018 ceph-mon[34477]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1317a2ad-ec15-4096-b2da-689475b7cacc"}]': finished 2024-09-21T06:32:45.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:45 smithi018 ceph-mon[34477]: osdmap e60: 11 total, 10 up, 11 in 2024-09-21T06:32:45.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:45 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:32:45.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:45 smithi018 ceph-mon[34477]: from='client.? 172.21.15.18:0/3666712901' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:32:45.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:45 smithi144 ceph-mon[34653]: from='client.? 172.21.15.18:0/2273421889' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1317a2ad-ec15-4096-b2da-689475b7cacc"} : dispatch 2024-09-21T06:32:45.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:45 smithi144 ceph-mon[34653]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1317a2ad-ec15-4096-b2da-689475b7cacc"} : dispatch 2024-09-21T06:32:45.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:45 smithi144 ceph-mon[34653]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1317a2ad-ec15-4096-b2da-689475b7cacc"}]': finished 2024-09-21T06:32:45.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:45 smithi144 ceph-mon[34653]: osdmap e60: 11 total, 10 up, 11 in 2024-09-21T06:32:45.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:45 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:32:45.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:45 smithi144 ceph-mon[34653]: from='client.? 172.21.15.18:0/3666712901' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:32:45.589 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:45 smithi007 ceph-mon[30983]: from='client.? 172.21.15.18:0/2273421889' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1317a2ad-ec15-4096-b2da-689475b7cacc"} : dispatch 2024-09-21T06:32:45.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:45 smithi007 ceph-mon[30983]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1317a2ad-ec15-4096-b2da-689475b7cacc"} : dispatch 2024-09-21T06:32:45.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:45 smithi007 ceph-mon[30983]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1317a2ad-ec15-4096-b2da-689475b7cacc"}]': finished 2024-09-21T06:32:45.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:45 smithi007 ceph-mon[30983]: osdmap e60: 11 total, 10 up, 11 in 2024-09-21T06:32:45.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:45 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:32:45.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:45 smithi007 ceph-mon[30983]: from='client.? 172.21.15.18:0/3666712901' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:32:46.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:46 smithi018 ceph-mon[34477]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 302 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:32:46.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:46 smithi144 ceph-mon[34653]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 302 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:32:46.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:46 smithi007 ceph-mon[30983]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 302 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:32:48.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:48 smithi018 ceph-mon[34477]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 302 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:32:48.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:48 smithi144 ceph-mon[34653]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 302 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:32:48.839 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:48 smithi007 ceph-mon[30983]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 302 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:32:50.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:50 smithi018 ceph-mon[34477]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:32:50.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:50 smithi144 ceph-mon[34653]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:32:50.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:50 smithi007 ceph-mon[30983]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:32:52.488 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:52 smithi018 ceph-mon[34477]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:32:52.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:52 smithi144 ceph-mon[34653]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:32:52.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:52 smithi007 ceph-mon[30983]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:32:53.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:53 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-21T06:32:53.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:53 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:32:53.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:53 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-21T06:32:53.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:53 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:32:53.839 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:53 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-21T06:32:53.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:53 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:32:54.618 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:54 smithi018 ceph-mon[34477]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:32:54.618 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:54 smithi018 ceph-mon[34477]: Deploying daemon osd.10 on smithi018 2024-09-21T06:32:54.686 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:54 smithi144 ceph-mon[34653]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:32:54.686 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:54 smithi144 ceph-mon[34653]: Deploying daemon osd.10 on smithi018 2024-09-21T06:32:54.741 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:54 smithi007 ceph-mon[30983]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:32:54.741 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:54 smithi007 ceph-mon[30983]: Deploying daemon osd.10 on smithi018 2024-09-21T06:32:56.662 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:56 smithi018 ceph-mon[34477]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:32:56.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:56 smithi144 ceph-mon[34653]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:32:56.839 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:56 smithi007 ceph-mon[30983]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:32:58.595 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:58 smithi018 ceph-mon[34477]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:32:58.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:58 smithi144 ceph-mon[34653]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:32:58.839 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:58 smithi007 ceph-mon[30983]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:32:59.632 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:59 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:32:59.632 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:59 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:32:59.632 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:32:59 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:32:59.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:59 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:32:59.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:59 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:32:59.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:32:59 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:32:59.839 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:59 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:32:59.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:59 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:32:59.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:32:59 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:00.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:00 smithi018 ceph-mon[34477]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:33:00.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:00 smithi144 ceph-mon[34653]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:33:00.839 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:00 smithi007 ceph-mon[30983]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:33:02.768 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:02 smithi018 ceph-mon[34477]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:33:02.768 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:02 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:02.768 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:02 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:02.768 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:02 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:33:02.769 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:02 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:33:02.769 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:02 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:02.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:02 smithi144 ceph-mon[34653]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:33:02.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:02 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:02.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:02 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:02.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:02 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:33:02.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:02 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:33:02.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:02 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:02.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:33:02.813+0000 7fd2e6ffd640 1 -- 172.21.15.18:0/3648844725 <== mgr.14223 v2:172.21.15.7:6800/3442812985 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fd2f0111bc0 con 0x7fd2dc0b6560 2024-09-21T06:33:02.816 INFO:teuthology.orchestra.run.smithi018.stdout:Created osd(s) 10 on host 'smithi018' 2024-09-21T06:33:02.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:33:02.816+0000 7fd2f7a6a640 1 -- 172.21.15.18:0/3648844725 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fd2dc0b6560 msgr2=0x7fd2dc0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:02.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:33:02.816+0000 7fd2f7a6a640 1 --2- 172.21.15.18:0/3648844725 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fd2dc0b6560 0x7fd2dc0b8a70 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec009bd0 tx=0x7fd2ec005f90 comp rx=0 tx=0).stop 2024-09-21T06:33:02.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:33:02.816+0000 7fd2f7a6a640 1 -- 172.21.15.18:0/3648844725 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd2f0102fa0 msgr2=0x7fd2f019cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:02.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:33:02.816+0000 7fd2f7a6a640 1 --2- 172.21.15.18:0/3648844725 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd2f0102fa0 0x7fd2f019cc30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd2e000d950 tx=0x7fd2e000de10 comp rx=0 tx=0).stop 2024-09-21T06:33:02.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:33:02.816+0000 7fd2f7a6a640 1 -- 172.21.15.18:0/3648844725 shutdown_connections 2024-09-21T06:33:02.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:33:02.816+0000 7fd2f7a6a640 1 --2- 172.21.15.18:0/3648844725 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fd2dc0b6560 0x7fd2dc0b8a70 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:02.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:33:02.816+0000 7fd2f7a6a640 1 --2- 172.21.15.18:0/3648844725 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd2f0110200 0x7fd2f01a1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:02.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:33:02.816+0000 7fd2f7a6a640 1 --2- 172.21.15.18:0/3648844725 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd2f0102fa0 0x7fd2f019cc30 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:02.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:33:02.816+0000 7fd2f7a6a640 1 --2- 172.21.15.18:0/3648844725 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2f0102650 0x7fd2f019c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:02.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:33:02.816+0000 7fd2f7a6a640 1 -- 172.21.15.18:0/3648844725 >> 172.21.15.18:0/3648844725 conn(0x7fd2f0079770 msgr2=0x7fd2f01114b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:02.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:33:02.816+0000 7fd2f7a6a640 1 -- 172.21.15.18:0/3648844725 shutdown_connections 2024-09-21T06:33:02.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-21T06:33:02.816+0000 7fd2f7a6a640 1 -- 172.21.15.18:0/3648844725 wait complete. 2024-09-21T06:33:02.839 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:02 smithi007 ceph-mon[30983]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:33:02.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:02 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:02.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:02 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:02.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:02 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:33:02.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:02 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:33:02.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:02 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:03.506 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:03 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:33:03.506 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:03 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:03.506 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:03 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:03.533 DEBUG:teuthology.orchestra.run.smithi018:osd.10> sudo journalctl -f -n 0 -u ceph-347cb918-77e2-11ef-baf5-efdc52797490@osd.10.service 2024-09-21T06:33:03.535 INFO:tasks.cephadm:Deploying osd.11 on smithi144 with /dev/vg_nvme/lv_1... 2024-09-21T06:33:03.535 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T06:33:03.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:03 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:33:03.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:03 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:03.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:03 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:03.793 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:33:03.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:03 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:33:03.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:03 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:03.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:03 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:05.014 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:04 smithi018 ceph-mon[34477]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:33:05.029 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:04 smithi144 ceph-mon[34653]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:33:05.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:04 smithi007 ceph-mon[30983]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:33:05.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:33:05 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:33:05.011+0000 7f3d6f7b1640 -1 osd.10 0 log_to_monitors true 2024-09-21T06:33:06.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:05 smithi007 ceph-mon[30983]: from='osd.10 [v2:172.21.15.18:6824/2038885362,v1:172.21.15.18:6825/2038885362]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T06:33:06.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:05 smithi007 ceph-mon[30983]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T06:33:06.097 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:05 smithi018 ceph-mon[34477]: from='osd.10 [v2:172.21.15.18:6824/2038885362,v1:172.21.15.18:6825/2038885362]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T06:33:06.097 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:05 smithi018 ceph-mon[34477]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T06:33:06.216 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:05 smithi144 ceph-mon[34653]: from='osd.10 [v2:172.21.15.18:6824/2038885362,v1:172.21.15.18:6825/2038885362]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T06:33:06.217 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:05 smithi144 ceph-mon[34653]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T06:33:06.508 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-09-21T06:33:06.535 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi144:vg_nvme/lv_1 2024-09-21T06:33:06.787 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:33:07.073 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:06 smithi144 ceph-mon[34653]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:33:07.073 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:06 smithi144 ceph-mon[34653]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-21T06:33:07.073 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:06 smithi144 ceph-mon[34653]: from='osd.10 [v2:172.21.15.18:6824/2038885362,v1:172.21.15.18:6825/2038885362]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi018", "root=default"]} : dispatch 2024-09-21T06:33:07.073 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:06 smithi144 ceph-mon[34653]: osdmap e61: 11 total, 10 up, 11 in 2024-09-21T06:33:07.073 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:06 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:33:07.074 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:06 smithi144 ceph-mon[34653]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi018", "root=default"]} : dispatch 2024-09-21T06:33:07.074 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:06 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:07.074 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:06 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:07.074 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:06 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T06:33:07.074 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:06 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T06:33:07.074 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:06 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T06:33:07.074 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:06 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T06:33:07.074 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:06 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:07.074 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:06 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:33:07.074 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:06 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:33:07.074 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:06 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:07.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:06 smithi007 ceph-mon[30983]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:33:07.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:06 smithi007 ceph-mon[30983]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-21T06:33:07.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:06 smithi007 ceph-mon[30983]: from='osd.10 [v2:172.21.15.18:6824/2038885362,v1:172.21.15.18:6825/2038885362]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi018", "root=default"]} : dispatch 2024-09-21T06:33:07.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:06 smithi007 ceph-mon[30983]: osdmap e61: 11 total, 10 up, 11 in 2024-09-21T06:33:07.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:06 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:33:07.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:06 smithi007 ceph-mon[30983]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi018", "root=default"]} : dispatch 2024-09-21T06:33:07.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:06 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:07.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:06 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:07.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:06 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T06:33:07.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:06 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T06:33:07.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:06 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T06:33:07.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:06 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T06:33:07.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:06 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:07.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:06 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:33:07.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:06 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:33:07.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:06 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:07.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:33:06 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:33:06.827+0000 7f3d6b733640 -1 osd.10 0 waiting for initial osdmap 2024-09-21T06:33:07.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:33:06 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:33:06.839+0000 7f3d67531640 -1 osd.10 62 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T06:33:07.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:06 smithi018 ceph-mon[34477]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:33:07.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:06 smithi018 ceph-mon[34477]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-21T06:33:07.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:06 smithi018 ceph-mon[34477]: from='osd.10 [v2:172.21.15.18:6824/2038885362,v1:172.21.15.18:6825/2038885362]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi018", "root=default"]} : dispatch 2024-09-21T06:33:07.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:06 smithi018 ceph-mon[34477]: osdmap e61: 11 total, 10 up, 11 in 2024-09-21T06:33:07.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:06 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:33:07.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:06 smithi018 ceph-mon[34477]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi018", "root=default"]} : dispatch 2024-09-21T06:33:07.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:06 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:07.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:06 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:07.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:06 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T06:33:07.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:06 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T06:33:07.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:06 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T06:33:07.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:06 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T06:33:07.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:06 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:07.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:06 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:33:07.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:06 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:33:07.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:06 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:07.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:07.261+0000 7fa6a3d77640 1 -- 172.21.15.144:0/1386994217 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa69c102a60 msgr2=0x7fa69c102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:07.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:07.261+0000 7fa6a3d77640 1 --2- 172.21.15.144:0/1386994217 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa69c102a60 0x7fa69c102e70 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa698009900 tx=0x7fa69802a410 comp rx=0 tx=0).stop 2024-09-21T06:33:07.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:07.261+0000 7fa6a3d77640 1 -- 172.21.15.144:0/1386994217 shutdown_connections 2024-09-21T06:33:07.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:07.261+0000 7fa6a3d77640 1 --2- 172.21.15.144:0/1386994217 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa69c108cf0 0x7fa69c10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:07.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:07.261+0000 7fa6a3d77640 1 --2- 172.21.15.144:0/1386994217 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa69c1083a0 0x7fa69c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:07.263 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:07.261+0000 7fa6a3d77640 1 --2- 172.21.15.144:0/1386994217 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa69c102a60 0x7fa69c102e70 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:07.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:07.261+0000 7fa6a3d77640 1 -- 172.21.15.144:0/1386994217 >> 172.21.15.144:0/1386994217 conn(0x7fa69c079730 msgr2=0x7fa69c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:07.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:07.261+0000 7fa6a3d77640 1 -- 172.21.15.144:0/1386994217 shutdown_connections 2024-09-21T06:33:07.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:07.261+0000 7fa6a3d77640 1 -- 172.21.15.144:0/1386994217 wait complete. 2024-09-21T06:33:07.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:07.261+0000 7fa6a3d77640 1 Processor -- start 2024-09-21T06:33:07.264 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:07.261+0000 7fa6a3d77640 1 -- start start 2024-09-21T06:33:07.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:07.262+0000 7fa6a3d77640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa69c102a60 0x7fa69c199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:07.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:07.262+0000 7fa6a3d77640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa69c1083a0 0x7fa69c199930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:07.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:07.262+0000 7fa6a3d77640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa69c108cf0 0x7fa69c19ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:07.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:07.262+0000 7fa6a3d77640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa69c1129c0 con 0x7fa69c102a60 2024-09-21T06:33:07.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:07.262+0000 7fa6a3d77640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa69c112840 con 0x7fa69c108cf0 2024-09-21T06:33:07.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:07.262+0000 7fa6a3d77640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa69c112b40 con 0x7fa69c1083a0 2024-09-21T06:33:07.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:07.262+0000 7fa6a1312640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa69c1083a0 0x7fa69c199930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:07.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:07.262+0000 7fa6a1312640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa69c1083a0 0x7fa69c199930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:48378/0 (socket says 172.21.15.144:48378) 2024-09-21T06:33:07.266 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:07.262+0000 7fa6a1312640 1 -- 172.21.15.144:0/850540208 learned_addr learned my addr 172.21.15.144:0/850540208 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-21T06:33:07.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:07.262+0000 7fa6a1b13640 1 --2- 172.21.15.144:0/850540208 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa69c102a60 0x7fa69c199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:07.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:07.262+0000 7fa6a2314640 1 --2- 172.21.15.144:0/850540208 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa69c108cf0 0x7fa69c19ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:07.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:07.262+0000 7fa6a1312640 1 -- 172.21.15.144:0/850540208 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa69c108cf0 msgr2=0x7fa69c19ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:07.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:07.262+0000 7fa6a1312640 1 --2- 172.21.15.144:0/850540208 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa69c108cf0 0x7fa69c19ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:07.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:07.262+0000 7fa6a1312640 1 -- 172.21.15.144:0/850540208 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa69c102a60 msgr2=0x7fa69c199390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:07.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:07.262+0000 7fa6a1312640 1 --2- 172.21.15.144:0/850540208 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa69c102a60 0x7fa69c199390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:07.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:07.262+0000 7fa6a1312640 1 -- 172.21.15.144:0/850540208 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa69c19f240 con 0x7fa69c1083a0 2024-09-21T06:33:07.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:07.262+0000 7fa6a1312640 1 --2- 172.21.15.144:0/850540208 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa69c1083a0 0x7fa69c199930 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa68c00c970 tx=0x7fa68c00ce30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:07.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:07.263+0000 7fa692ffd640 1 -- 172.21.15.144:0/850540208 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa68c014070 con 0x7fa69c1083a0 2024-09-21T06:33:07.267 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:07.263+0000 7fa692ffd640 1 -- 172.21.15.144:0/850540208 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa68c004440 con 0x7fa69c1083a0 2024-09-21T06:33:07.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:07.263+0000 7fa6a3d77640 1 -- 172.21.15.144:0/850540208 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa69c19f530 con 0x7fa69c1083a0 2024-09-21T06:33:07.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:07.263+0000 7fa692ffd640 1 -- 172.21.15.144:0/850540208 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa68c003e50 con 0x7fa69c1083a0 2024-09-21T06:33:07.268 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:07.263+0000 7fa6a3d77640 1 -- 172.21.15.144:0/850540208 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa69c1a5d50 con 0x7fa69c1083a0 2024-09-21T06:33:07.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:07.265+0000 7fa6a3d77640 1 -- 172.21.15.144:0/850540208 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa69c102e70 con 0x7fa69c1083a0 2024-09-21T06:33:07.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:07.265+0000 7fa692ffd640 1 -- 172.21.15.144:0/850540208 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 21) ==== 154528+0+0 (secure 0 0 0) 0x7fa68c017070 con 0x7fa69c1083a0 2024-09-21T06:33:07.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:07.266+0000 7fa692ffd640 1 --2- 172.21.15.144:0/850540208 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa6880b6730 0x7fa6880b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:07.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:07.266+0000 7fa692ffd640 1 -- 172.21.15.144:0/850540208 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6629+0+0 (secure 0 0 0) 0x7fa68c0e67e0 con 0x7fa69c1083a0 2024-09-21T06:33:07.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:07.267+0000 7fa6a1b13640 1 --2- 172.21.15.144:0/850540208 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa6880b6730 0x7fa6880b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:07.269 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:07.267+0000 7fa6a1b13640 1 --2- 172.21.15.144:0/850540208 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa6880b6730 0x7fa6880b8c40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa698031440 tx=0x7fa698005e80 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:07.272 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:07.271+0000 7fa692ffd640 1 -- 172.21.15.144:0/850540208 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa68c01e030 con 0x7fa69c1083a0 2024-09-21T06:33:07.466 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:07.464+0000 7fa6a3d77640 1 -- 172.21.15.144:0/850540208 --> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fa69c063800 con 0x7fa6880b6730 2024-09-21T06:33:08.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:07 smithi007 ceph-mon[30983]: Detected new or changed devices on smithi018 2024-09-21T06:33:08.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:07 smithi007 ceph-mon[30983]: Adjusting osd_memory_target on smithi018 to 4273M 2024-09-21T06:33:08.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:07 smithi007 ceph-mon[30983]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-09-21T06:33:08.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:07 smithi007 ceph-mon[30983]: osdmap e62: 11 total, 10 up, 11 in 2024-09-21T06:33:08.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:07 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:33:08.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:07 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:33:08.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:07 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:33:08.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:07 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:33:08.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:07 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:33:08.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:07 smithi007 ceph-mon[30983]: osd.10 [v2:172.21.15.18:6824/2038885362,v1:172.21.15.18:6825/2038885362] boot 2024-09-21T06:33:08.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:07 smithi007 ceph-mon[30983]: osdmap e63: 11 total, 11 up, 11 in 2024-09-21T06:33:08.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:07 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:33:08.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:07 smithi018 ceph-mon[34477]: Detected new or changed devices on smithi018 2024-09-21T06:33:08.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:07 smithi018 ceph-mon[34477]: Adjusting osd_memory_target on smithi018 to 4273M 2024-09-21T06:33:08.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:07 smithi018 ceph-mon[34477]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-09-21T06:33:08.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:07 smithi018 ceph-mon[34477]: osdmap e62: 11 total, 10 up, 11 in 2024-09-21T06:33:08.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:07 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:33:08.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:07 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:33:08.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:07 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:33:08.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:07 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:33:08.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:07 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:33:08.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:07 smithi018 ceph-mon[34477]: osd.10 [v2:172.21.15.18:6824/2038885362,v1:172.21.15.18:6825/2038885362] boot 2024-09-21T06:33:08.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:07 smithi018 ceph-mon[34477]: osdmap e63: 11 total, 11 up, 11 in 2024-09-21T06:33:08.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:07 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:33:08.120 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:07 smithi144 ceph-mon[34653]: Detected new or changed devices on smithi018 2024-09-21T06:33:08.120 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:07 smithi144 ceph-mon[34653]: Adjusting osd_memory_target on smithi018 to 4273M 2024-09-21T06:33:08.120 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:07 smithi144 ceph-mon[34653]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi018", "root=default"]}]': finished 2024-09-21T06:33:08.121 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:07 smithi144 ceph-mon[34653]: osdmap e62: 11 total, 10 up, 11 in 2024-09-21T06:33:08.121 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:07 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:33:08.121 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:07 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:33:08.121 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:07 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T06:33:08.121 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:07 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T06:33:08.121 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:07 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:33:08.121 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:07 smithi144 ceph-mon[34653]: osd.10 [v2:172.21.15.18:6824/2038885362,v1:172.21.15.18:6825/2038885362] boot 2024-09-21T06:33:08.121 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:07 smithi144 ceph-mon[34653]: osdmap e63: 11 total, 11 up, 11 in 2024-09-21T06:33:08.121 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:07 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T06:33:09.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:08 smithi007 ceph-mon[30983]: purged_snaps scrub starts 2024-09-21T06:33:09.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:08 smithi007 ceph-mon[30983]: purged_snaps scrub ok 2024-09-21T06:33:09.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:08 smithi007 ceph-mon[30983]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:33:09.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:08 smithi007 ceph-mon[30983]: from='client.24559 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:33:09.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:08 smithi007 ceph-mon[30983]: osdmap e64: 11 total, 11 up, 11 in 2024-09-21T06:33:09.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:08 smithi018 ceph-mon[34477]: purged_snaps scrub starts 2024-09-21T06:33:09.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:08 smithi018 ceph-mon[34477]: purged_snaps scrub ok 2024-09-21T06:33:09.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:08 smithi018 ceph-mon[34477]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:33:09.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:08 smithi018 ceph-mon[34477]: from='client.24559 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:33:09.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:08 smithi018 ceph-mon[34477]: osdmap e64: 11 total, 11 up, 11 in 2024-09-21T06:33:09.172 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:08 smithi144 ceph-mon[34653]: purged_snaps scrub starts 2024-09-21T06:33:09.172 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:08 smithi144 ceph-mon[34653]: purged_snaps scrub ok 2024-09-21T06:33:09.172 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:08 smithi144 ceph-mon[34653]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 303 MiB used, 894 GiB / 894 GiB avail 2024-09-21T06:33:09.172 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:08 smithi144 ceph-mon[34653]: from='client.24559 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi144:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:33:09.172 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:08 smithi144 ceph-mon[34653]: osdmap e64: 11 total, 11 up, 11 in 2024-09-21T06:33:10.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:10 smithi144 ceph-mon[34653]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:33:10.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:10 smithi144 ceph-mon[34653]: osdmap e65: 11 total, 11 up, 11 in 2024-09-21T06:33:10.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:10 smithi144 ceph-mon[34653]: from='client.? 172.21.15.144:0/1857931100' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f9252acb-7290-4923-89f3-844c868d4b39"} : dispatch 2024-09-21T06:33:10.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:10 smithi144 ceph-mon[34653]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f9252acb-7290-4923-89f3-844c868d4b39"} : dispatch 2024-09-21T06:33:10.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:10 smithi144 ceph-mon[34653]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f9252acb-7290-4923-89f3-844c868d4b39"}]': finished 2024-09-21T06:33:10.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:10 smithi144 ceph-mon[34653]: osdmap e66: 12 total, 11 up, 12 in 2024-09-21T06:33:10.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:10 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:33:10.786 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:10 smithi144 ceph-mon[34653]: from='client.? 172.21.15.144:0/2805609642' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:33:11.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:10 smithi007 ceph-mon[30983]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:33:11.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:10 smithi007 ceph-mon[30983]: osdmap e65: 11 total, 11 up, 11 in 2024-09-21T06:33:11.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:10 smithi007 ceph-mon[30983]: from='client.? 172.21.15.144:0/1857931100' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f9252acb-7290-4923-89f3-844c868d4b39"} : dispatch 2024-09-21T06:33:11.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:10 smithi007 ceph-mon[30983]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f9252acb-7290-4923-89f3-844c868d4b39"} : dispatch 2024-09-21T06:33:11.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:10 smithi007 ceph-mon[30983]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f9252acb-7290-4923-89f3-844c868d4b39"}]': finished 2024-09-21T06:33:11.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:10 smithi007 ceph-mon[30983]: osdmap e66: 12 total, 11 up, 12 in 2024-09-21T06:33:11.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:10 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:33:11.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:10 smithi007 ceph-mon[30983]: from='client.? 172.21.15.144:0/2805609642' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:33:11.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:10 smithi018 ceph-mon[34477]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:33:11.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:10 smithi018 ceph-mon[34477]: osdmap e65: 11 total, 11 up, 11 in 2024-09-21T06:33:11.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:10 smithi018 ceph-mon[34477]: from='client.? 172.21.15.144:0/1857931100' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f9252acb-7290-4923-89f3-844c868d4b39"} : dispatch 2024-09-21T06:33:11.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:10 smithi018 ceph-mon[34477]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "f9252acb-7290-4923-89f3-844c868d4b39"} : dispatch 2024-09-21T06:33:11.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:10 smithi018 ceph-mon[34477]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f9252acb-7290-4923-89f3-844c868d4b39"}]': finished 2024-09-21T06:33:11.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:10 smithi018 ceph-mon[34477]: osdmap e66: 12 total, 11 up, 12 in 2024-09-21T06:33:11.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:10 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:33:11.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:10 smithi018 ceph-mon[34477]: from='client.? 172.21.15.144:0/2805609642' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T06:33:13.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:12 smithi144 ceph-mon[34653]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-21T06:33:13.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:12 smithi007 ceph-mon[30983]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-21T06:33:13.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:12 smithi018 ceph-mon[34477]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-21T06:33:14.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:14 smithi144 ceph-mon[34653]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 106 KiB/s, 0 objects/s recovering 2024-09-21T06:33:15.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:14 smithi007 ceph-mon[30983]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 106 KiB/s, 0 objects/s recovering 2024-09-21T06:33:15.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:14 smithi018 ceph-mon[34477]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 106 KiB/s, 0 objects/s recovering 2024-09-21T06:33:16.925 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:16 smithi144 ceph-mon[34653]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-09-21T06:33:17.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:16 smithi007 ceph-mon[30983]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-09-21T06:33:17.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:16 smithi018 ceph-mon[34477]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-09-21T06:33:18.931 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:18 smithi144 ceph-mon[34653]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T06:33:18.931 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:18 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-21T06:33:18.931 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:18 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:33:19.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:18 smithi007 ceph-mon[30983]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T06:33:19.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:18 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-21T06:33:19.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:18 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:33:19.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:18 smithi018 ceph-mon[34477]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T06:33:19.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:18 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-21T06:33:19.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:18 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:33:19.968 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:19 smithi144 ceph-mon[34653]: Deploying daemon osd.11 on smithi144 2024-09-21T06:33:20.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:19 smithi007 ceph-mon[30983]: Deploying daemon osd.11 on smithi144 2024-09-21T06:33:20.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:19 smithi018 ceph-mon[34477]: Deploying daemon osd.11 on smithi144 2024-09-21T06:33:20.899 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:20 smithi144 ceph-mon[34653]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-21T06:33:21.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:20 smithi007 ceph-mon[30983]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-21T06:33:21.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:20 smithi018 ceph-mon[34477]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-21T06:33:22.888 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:22 smithi144 ceph-mon[34653]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-21T06:33:23.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:22 smithi007 ceph-mon[30983]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-21T06:33:23.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:22 smithi018 ceph-mon[34477]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-21T06:33:24.858 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:24 smithi144 ceph-mon[34653]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:33:24.858 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:24 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:33:24.858 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:24 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:24.858 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:24 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:25.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:24 smithi007 ceph-mon[30983]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:33:25.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:24 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:33:25.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:24 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:25.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:24 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:25.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:24 smithi018 ceph-mon[34477]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:33:25.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:24 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:33:25.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:24 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:25.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:24 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:26.979 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:26 smithi144 ceph-mon[34653]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:33:27.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:26 smithi007 ceph-mon[30983]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:33:27.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:26 smithi018 ceph-mon[34477]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:33:27.676 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:27.674+0000 7fa692ffd640 1 -- 172.21.15.144:0/850540208 <== mgr.14223 v2:172.21.15.7:6800/3442812985 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fa69c063800 con 0x7fa6880b6730 2024-09-21T06:33:27.676 INFO:teuthology.orchestra.run.smithi144.stdout:Created osd(s) 11 on host 'smithi144' 2024-09-21T06:33:27.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:27.677+0000 7fa6a3d77640 1 -- 172.21.15.144:0/850540208 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa6880b6730 msgr2=0x7fa6880b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:27.678 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:27.677+0000 7fa6a3d77640 1 --2- 172.21.15.144:0/850540208 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa6880b6730 0x7fa6880b8c40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa698031440 tx=0x7fa698005e80 comp rx=0 tx=0).stop 2024-09-21T06:33:27.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:27.677+0000 7fa6a3d77640 1 -- 172.21.15.144:0/850540208 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa69c1083a0 msgr2=0x7fa69c199930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:27.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:27.677+0000 7fa6a3d77640 1 --2- 172.21.15.144:0/850540208 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa69c1083a0 0x7fa69c199930 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa68c00c970 tx=0x7fa68c00ce30 comp rx=0 tx=0).stop 2024-09-21T06:33:27.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:27.677+0000 7fa6a3d77640 1 -- 172.21.15.144:0/850540208 shutdown_connections 2024-09-21T06:33:27.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:27.677+0000 7fa6a3d77640 1 --2- 172.21.15.144:0/850540208 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa6880b6730 0x7fa6880b8c40 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:27.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:27.677+0000 7fa6a3d77640 1 --2- 172.21.15.144:0/850540208 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa69c108cf0 0x7fa69c19ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:27.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:27.677+0000 7fa6a3d77640 1 --2- 172.21.15.144:0/850540208 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa69c1083a0 0x7fa69c199930 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:27.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:27.677+0000 7fa6a3d77640 1 --2- 172.21.15.144:0/850540208 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa69c102a60 0x7fa69c199390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:27.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:27.677+0000 7fa6a3d77640 1 -- 172.21.15.144:0/850540208 >> 172.21.15.144:0/850540208 conn(0x7fa69c079730 msgr2=0x7fa69c1013d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:27.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:27.677+0000 7fa6a3d77640 1 -- 172.21.15.144:0/850540208 shutdown_connections 2024-09-21T06:33:27.679 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:27.677+0000 7fa6a3d77640 1 -- 172.21.15.144:0/850540208 wait complete. 2024-09-21T06:33:28.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:27 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:28.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:27 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:28.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:27 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:33:28.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:27 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:33:28.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:27 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:28.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:27 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:33:28.036 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:27 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:28.036 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:27 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:28.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:27 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:28.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:27 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:28.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:27 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:33:28.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:27 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:33:28.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:27 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:28.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:27 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:33:28.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:27 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:28.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:27 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:28.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:27 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:28.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:27 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:28.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:27 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:33:28.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:27 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:33:28.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:27 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:28.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:27 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:33:28.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:27 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:28.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:27 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:28.365 DEBUG:teuthology.orchestra.run.smithi144:osd.11> sudo journalctl -f -n 0 -u ceph-347cb918-77e2-11ef-baf5-efdc52797490@osd.11.service 2024-09-21T06:33:28.367 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-21T06:33:28.367 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-21T06:33:28.641 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:33:29.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:28 smithi144 ceph-mon[34653]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:33:29.054 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:28 smithi007 ceph-mon[30983]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:33:29.193 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:28 smithi018 ceph-mon[34477]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:33:29.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:29.146+0000 7f2743f10640 1 -- 172.21.15.7:0/440858908 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f273c1083d0 msgr2=0x7f273c1087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:29.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:29.146+0000 7f2743f10640 1 --2- 172.21.15.7:0/440858908 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f273c1083d0 0x7f273c1087e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f272c009900 tx=0x7f272c02a410 comp rx=0 tx=0).stop 2024-09-21T06:33:29.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:29.146+0000 7f2743f10640 1 -- 172.21.15.7:0/440858908 shutdown_connections 2024-09-21T06:33:29.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:29.146+0000 7f2743f10640 1 --2- 172.21.15.7:0/440858908 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f273c108d20 0x7f273c10f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:29.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:29.146+0000 7f2743f10640 1 --2- 172.21.15.7:0/440858908 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f273c1083d0 0x7f273c1087e0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:29.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:29.146+0000 7f2743f10640 1 --2- 172.21.15.7:0/440858908 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f273c102ae0 0x7f273c102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:29.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:29.146+0000 7f2743f10640 1 -- 172.21.15.7:0/440858908 >> 172.21.15.7:0/440858908 conn(0x7f273c0797b0 msgr2=0x7f273c079bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:29.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:29.146+0000 7f2743f10640 1 -- 172.21.15.7:0/440858908 shutdown_connections 2024-09-21T06:33:29.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:29.146+0000 7f2743f10640 1 -- 172.21.15.7:0/440858908 wait complete. 2024-09-21T06:33:29.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:29.147+0000 7f2743f10640 1 Processor -- start 2024-09-21T06:33:29.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:29.147+0000 7f2743f10640 1 -- start start 2024-09-21T06:33:29.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:29.148+0000 7f2743f10640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f273c102ae0 0x7f273c199180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:29.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:29.148+0000 7f2743f10640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f273c1083d0 0x7f273c1996c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:29.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:29.148+0000 7f2743f10640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f273c108d20 0x7f273c199c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:29.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:29.148+0000 7f2743f10640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f273c1129e0 con 0x7f273c102ae0 2024-09-21T06:33:29.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:29.148+0000 7f2743f10640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f273c112860 con 0x7f273c1083d0 2024-09-21T06:33:29.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:29.148+0000 7f2743f10640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f273c112b60 con 0x7f273c108d20 2024-09-21T06:33:29.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:29.148+0000 7f2741cac640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f273c102ae0 0x7f273c199180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:29.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:29.148+0000 7f2741cac640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f273c102ae0 0x7f273c199180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36724/0 (socket says 172.21.15.7:36724) 2024-09-21T06:33:29.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:29.148+0000 7f2741cac640 1 -- 172.21.15.7:0/3625507693 learned_addr learned my addr 172.21.15.7:0/3625507693 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:33:29.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:29.148+0000 7f27414ab640 1 --2- 172.21.15.7:0/3625507693 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f273c1083d0 0x7f273c1996c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:29.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:29.148+0000 7f27424ad640 1 --2- 172.21.15.7:0/3625507693 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f273c108d20 0x7f273c199c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:29.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:29.148+0000 7f2741cac640 1 -- 172.21.15.7:0/3625507693 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f273c108d20 msgr2=0x7f273c199c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:29.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:29.148+0000 7f2741cac640 1 --2- 172.21.15.7:0/3625507693 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f273c108d20 0x7f273c199c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:29.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:29.148+0000 7f2741cac640 1 -- 172.21.15.7:0/3625507693 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f273c1083d0 msgr2=0x7f273c1996c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:29.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:29.148+0000 7f2741cac640 1 --2- 172.21.15.7:0/3625507693 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f273c1083d0 0x7f273c1996c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:29.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:29.148+0000 7f2741cac640 1 -- 172.21.15.7:0/3625507693 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f273c1a8830 con 0x7f273c102ae0 2024-09-21T06:33:29.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:29.148+0000 7f2741cac640 1 --2- 172.21.15.7:0/3625507693 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f273c102ae0 0x7f273c199180 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f273800e9f0 tx=0x7f273800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:29.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:29.148+0000 7f2732ffd640 1 -- 172.21.15.7:0/3625507693 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f273800ccc0 con 0x7f273c102ae0 2024-09-21T06:33:29.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:29.148+0000 7f2732ffd640 1 -- 172.21.15.7:0/3625507693 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f273800ce60 con 0x7f273c102ae0 2024-09-21T06:33:29.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:29.148+0000 7f2732ffd640 1 -- 172.21.15.7:0/3625507693 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2738010430 con 0x7f273c102ae0 2024-09-21T06:33:29.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:29.148+0000 7f2743f10640 1 -- 172.21.15.7:0/3625507693 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f273c1a8b20 con 0x7f273c102ae0 2024-09-21T06:33:29.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:29.148+0000 7f2743f10640 1 -- 172.21.15.7:0/3625507693 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f273c1a8fe0 con 0x7f273c102ae0 2024-09-21T06:33:29.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:29.150+0000 7f2743f10640 1 -- 172.21.15.7:0/3625507693 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f273c102ef0 con 0x7f273c102ae0 2024-09-21T06:33:29.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:29.151+0000 7f2732ffd640 1 -- 172.21.15.7:0/3625507693 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 21) ==== 154528+0+0 (secure 0 0 0) 0x7f27380046c0 con 0x7f273c102ae0 2024-09-21T06:33:29.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:29.152+0000 7f2732ffd640 1 --2- 172.21.15.7:0/3625507693 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f27280b6560 0x7f27280b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:29.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:29.152+0000 7f27414ab640 1 --2- 172.21.15.7:0/3625507693 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f27280b6560 0x7f27280b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:29.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:29.152+0000 7f2732ffd640 1 -- 172.21.15.7:0/3625507693 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 7024+0+0 (secure 0 0 0) 0x7f27380e7230 con 0x7f273c102ae0 2024-09-21T06:33:29.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:29.152+0000 7f27414ab640 1 --2- 172.21.15.7:0/3625507693 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f27280b6560 0x7f27280b8a70 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f272c009230 tx=0x7f272c031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:29.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:29.156+0000 7f2732ffd640 1 -- 172.21.15.7:0/3625507693 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f27380adfd0 con 0x7f273c102ae0 2024-09-21T06:33:29.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:29.346+0000 7f2743f10640 1 -- 172.21.15.7:0/3625507693 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f273c06bc30 con 0x7f273c102ae0 2024-09-21T06:33:29.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:29.346+0000 7f2732ffd640 1 -- 172.21.15.7:0/3625507693 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v66) ==== 74+0+133 (secure 0 0 0) 0x7f273c06bc30 con 0x7f273c102ae0 2024-09-21T06:33:29.348 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:33:29.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:29.348+0000 7f2743f10640 1 -- 172.21.15.7:0/3625507693 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f27280b6560 msgr2=0x7f27280b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:29.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:29.348+0000 7f2743f10640 1 --2- 172.21.15.7:0/3625507693 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f27280b6560 0x7f27280b8a70 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f272c009230 tx=0x7f272c031400 comp rx=0 tx=0).stop 2024-09-21T06:33:29.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:29.348+0000 7f2743f10640 1 -- 172.21.15.7:0/3625507693 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f273c102ae0 msgr2=0x7f273c199180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:29.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:29.348+0000 7f2743f10640 1 --2- 172.21.15.7:0/3625507693 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f273c102ae0 0x7f273c199180 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f273800e9f0 tx=0x7f273800edf0 comp rx=0 tx=0).stop 2024-09-21T06:33:29.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:29.349+0000 7f2743f10640 1 -- 172.21.15.7:0/3625507693 shutdown_connections 2024-09-21T06:33:29.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:29.349+0000 7f2743f10640 1 --2- 172.21.15.7:0/3625507693 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f27280b6560 0x7f27280b8a70 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:29.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:29.349+0000 7f2743f10640 1 --2- 172.21.15.7:0/3625507693 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f273c108d20 0x7f273c199c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:29.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:29.349+0000 7f2743f10640 1 --2- 172.21.15.7:0/3625507693 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f273c1083d0 0x7f273c1996c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:29.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:29.349+0000 7f2743f10640 1 --2- 172.21.15.7:0/3625507693 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f273c102ae0 0x7f273c199180 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:29.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:29.349+0000 7f2743f10640 1 -- 172.21.15.7:0/3625507693 >> 172.21.15.7:0/3625507693 conn(0x7f273c0797b0 msgr2=0x7f273c1044a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:29.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:29.349+0000 7f2743f10640 1 -- 172.21.15.7:0/3625507693 shutdown_connections 2024-09-21T06:33:29.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:29.349+0000 7f2743f10640 1 -- 172.21.15.7:0/3625507693 wait complete. 2024-09-21T06:33:30.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:29 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/3625507693' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T06:33:30.134 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":66,"num_osds":12,"num_up_osds":11,"osd_up_since":1726900387,"num_in_osds":12,"osd_in_since":1726900389,"num_remapped_pgs":0} 2024-09-21T06:33:30.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:29 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/3625507693' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T06:33:30.285 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:33:29 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:33:29.990+0000 7fc4ab23f640 -1 osd.11 0 log_to_monitors true 2024-09-21T06:33:30.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:29 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/3625507693' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T06:33:31.135 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-21T06:33:31.164 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:30 smithi007 ceph-mon[30983]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:33:31.165 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:30 smithi007 ceph-mon[30983]: from='osd.11 [v2:172.21.15.144:6824/1047060848,v1:172.21.15.144:6825/1047060848]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T06:33:31.165 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:30 smithi007 ceph-mon[30983]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T06:33:31.247 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:30 smithi144 ceph-mon[34653]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:33:31.247 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:30 smithi144 ceph-mon[34653]: from='osd.11 [v2:172.21.15.144:6824/1047060848,v1:172.21.15.144:6825/1047060848]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T06:33:31.247 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:30 smithi144 ceph-mon[34653]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T06:33:31.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:30 smithi018 ceph-mon[34477]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:33:31.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:30 smithi018 ceph-mon[34477]: from='osd.11 [v2:172.21.15.144:6824/1047060848,v1:172.21.15.144:6825/1047060848]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T06:33:31.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:30 smithi018 ceph-mon[34477]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T06:33:31.408 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:33:31.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:31.893+0000 7f0063fb9640 1 -- 172.21.15.7:0/471465036 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f005c1030f0 msgr2=0x7f005c107620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:31.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:31.894+0000 7f0063fb9640 1 --2- 172.21.15.7:0/471465036 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f005c1030f0 0x7f005c107620 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f004c009930 tx=0x7f004c02a420 comp rx=0 tx=0).stop 2024-09-21T06:33:31.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:31.894+0000 7f0063fb9640 1 -- 172.21.15.7:0/471465036 shutdown_connections 2024-09-21T06:33:31.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:31.894+0000 7f0063fb9640 1 --2- 172.21.15.7:0/471465036 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f005c107be0 0x7f005c1080c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:31.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:31.894+0000 7f0063fb9640 1 --2- 172.21.15.7:0/471465036 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f005c1030f0 0x7f005c107620 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:31.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:31.894+0000 7f0063fb9640 1 --2- 172.21.15.7:0/471465036 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f005c1027a0 0x7f005c102bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:31.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:31.894+0000 7f0063fb9640 1 -- 172.21.15.7:0/471465036 >> 172.21.15.7:0/471465036 conn(0x7f005c079730 msgr2=0x7f005c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:31.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:31.894+0000 7f0063fb9640 1 -- 172.21.15.7:0/471465036 shutdown_connections 2024-09-21T06:33:31.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:31.894+0000 7f0063fb9640 1 -- 172.21.15.7:0/471465036 wait complete. 2024-09-21T06:33:31.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:31.894+0000 7f0063fb9640 1 Processor -- start 2024-09-21T06:33:31.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:31.895+0000 7f0063fb9640 1 -- start start 2024-09-21T06:33:31.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:31.895+0000 7f0063fb9640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f005c1027a0 0x7f005c1a0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:31.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:31.895+0000 7f0063fb9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f005c1030f0 0x7f005c1a1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:31.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:31.895+0000 7f0063fb9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f005c107be0 0x7f005c1a6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:31.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:31.895+0000 7f0063fb9640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f005c11a060 con 0x7f005c107be0 2024-09-21T06:33:31.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:31.895+0000 7f0063fb9640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f005c119ee0 con 0x7f005c1030f0 2024-09-21T06:33:31.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:31.895+0000 7f0063fb9640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f005c11a1e0 con 0x7f005c1027a0 2024-09-21T06:33:31.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:31.895+0000 7f0062556640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f005c107be0 0x7f005c1a6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:31.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:31.895+0000 7f0062556640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f005c107be0 0x7f005c1a6330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38018/0 (socket says 172.21.15.7:38018) 2024-09-21T06:33:31.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:31.895+0000 7f0062556640 1 -- 172.21.15.7:0/3596750833 learned_addr learned my addr 172.21.15.7:0/3596750833 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:33:31.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:31.895+0000 7f0061554640 1 --2- 172.21.15.7:0/3596750833 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f005c1030f0 0x7f005c1a1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:31.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:31.895+0000 7f0061d55640 1 --2- 172.21.15.7:0/3596750833 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f005c1027a0 0x7f005c1a0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:31.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:31.895+0000 7f0062556640 1 -- 172.21.15.7:0/3596750833 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f005c1027a0 msgr2=0x7f005c1a0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:31.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:31.895+0000 7f0062556640 1 --2- 172.21.15.7:0/3596750833 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f005c1027a0 0x7f005c1a0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:31.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:31.895+0000 7f0062556640 1 -- 172.21.15.7:0/3596750833 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f005c1030f0 msgr2=0x7f005c1a1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:31.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:31.895+0000 7f0062556640 1 --2- 172.21.15.7:0/3596750833 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f005c1030f0 0x7f005c1a1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:31.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:31.895+0000 7f0062556640 1 -- 172.21.15.7:0/3596750833 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f005c1a6a60 con 0x7f005c107be0 2024-09-21T06:33:31.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:31.895+0000 7f0061d55640 1 --2- 172.21.15.7:0/3596750833 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f005c1027a0 0x7f005c1a0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:33:31.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:31.896+0000 7f0062556640 1 --2- 172.21.15.7:0/3596750833 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f005c107be0 0x7f005c1a6330 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f005400eb10 tx=0x7f005400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:31.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:31.896+0000 7f0052ffd640 1 -- 172.21.15.7:0/3596750833 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0054004b20 con 0x7f005c107be0 2024-09-21T06:33:31.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:31.896+0000 7f0063fb9640 1 -- 172.21.15.7:0/3596750833 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f005c1a6d50 con 0x7f005c107be0 2024-09-21T06:33:31.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:31.896+0000 7f0052ffd640 1 -- 172.21.15.7:0/3596750833 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0054004cc0 con 0x7f005c107be0 2024-09-21T06:33:31.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:31.896+0000 7f0052ffd640 1 -- 172.21.15.7:0/3596750833 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0054010670 con 0x7f005c107be0 2024-09-21T06:33:31.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:31.896+0000 7f0063fb9640 1 -- 172.21.15.7:0/3596750833 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f005c1ad4b0 con 0x7f005c107be0 2024-09-21T06:33:31.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:31.897+0000 7f0063fb9640 1 -- 172.21.15.7:0/3596750833 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f005c107620 con 0x7f005c107be0 2024-09-21T06:33:31.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:31.898+0000 7f0052ffd640 1 -- 172.21.15.7:0/3596750833 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 21) ==== 154528+0+0 (secure 0 0 0) 0x7f0054005020 con 0x7f005c107be0 2024-09-21T06:33:31.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:31.899+0000 7f0052ffd640 1 --2- 172.21.15.7:0/3596750833 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f00480b6560 0x7f00480b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:31.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:31.900+0000 7f0061d55640 1 --2- 172.21.15.7:0/3596750833 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f00480b6560 0x7f00480b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:31.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:31.900+0000 7f0052ffd640 1 -- 172.21.15.7:0/3596750833 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 7062+0+0 (secure 0 0 0) 0x7f00540e7520 con 0x7f005c107be0 2024-09-21T06:33:31.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:31.900+0000 7f0061d55640 1 --2- 172.21.15.7:0/3596750833 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f00480b6560 0x7f00480b8a70 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f005c06bc60 tx=0x7f0058005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:31.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:31.904+0000 7f0052ffd640 1 -- 172.21.15.7:0/3596750833 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f00540ae1f0 con 0x7f005c107be0 2024-09-21T06:33:32.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:31 smithi007 ceph-mon[30983]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-21T06:33:32.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:31 smithi007 ceph-mon[30983]: osdmap e67: 12 total, 11 up, 12 in 2024-09-21T06:33:32.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:31 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:33:32.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:31 smithi007 ceph-mon[30983]: from='osd.11 [v2:172.21.15.144:6824/1047060848,v1:172.21.15.144:6825/1047060848]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi144", "root=default"]} : dispatch 2024-09-21T06:33:32.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:31 smithi007 ceph-mon[30983]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi144", "root=default"]} : dispatch 2024-09-21T06:33:32.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:31 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:32.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:31 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:32.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:31 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T06:33:32.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:31 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T06:33:32.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:31 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T06:33:32.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:31 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T06:33:32.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:31 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:32.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:31 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:33:32.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:31 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:33:32.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:31 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:32.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:32.094+0000 7f0063fb9640 1 -- 172.21.15.7:0/3596750833 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f005c1a1c20 con 0x7f005c107be0 2024-09-21T06:33:32.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:32.094+0000 7f0052ffd640 1 -- 172.21.15.7:0/3596750833 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v68) ==== 74+0+133 (secure 0 0 0) 0x7f00540b25d0 con 0x7f005c107be0 2024-09-21T06:33:32.096 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:33:32.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:32.097+0000 7f0063fb9640 1 -- 172.21.15.7:0/3596750833 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f00480b6560 msgr2=0x7f00480b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:32.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:32.097+0000 7f0063fb9640 1 --2- 172.21.15.7:0/3596750833 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f00480b6560 0x7f00480b8a70 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f005c06bc60 tx=0x7f0058005f90 comp rx=0 tx=0).stop 2024-09-21T06:33:32.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:32.097+0000 7f0063fb9640 1 -- 172.21.15.7:0/3596750833 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f005c107be0 msgr2=0x7f005c1a6330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:32.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:32.097+0000 7f0063fb9640 1 --2- 172.21.15.7:0/3596750833 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f005c107be0 0x7f005c1a6330 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f005400eb10 tx=0x7f005400c2d0 comp rx=0 tx=0).stop 2024-09-21T06:33:32.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:32.097+0000 7f0063fb9640 1 -- 172.21.15.7:0/3596750833 shutdown_connections 2024-09-21T06:33:32.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:32.097+0000 7f0063fb9640 1 --2- 172.21.15.7:0/3596750833 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f00480b6560 0x7f00480b8a70 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:32.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:32.097+0000 7f0063fb9640 1 --2- 172.21.15.7:0/3596750833 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f005c107be0 0x7f005c1a6330 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:32.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:32.097+0000 7f0063fb9640 1 --2- 172.21.15.7:0/3596750833 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f005c1030f0 0x7f005c1a1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:32.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:32.097+0000 7f0063fb9640 1 --2- 172.21.15.7:0/3596750833 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f005c1027a0 0x7f005c1a0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:32.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:32.097+0000 7f0063fb9640 1 -- 172.21.15.7:0/3596750833 >> 172.21.15.7:0/3596750833 conn(0x7f005c079730 msgr2=0x7f005c1055f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:32.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:32.097+0000 7f0063fb9640 1 -- 172.21.15.7:0/3596750833 shutdown_connections 2024-09-21T06:33:32.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:32.097+0000 7f0063fb9640 1 -- 172.21.15.7:0/3596750833 wait complete. 2024-09-21T06:33:32.285 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:33:31 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:33:31.892+0000 7fc4a71c1640 -1 osd.11 0 waiting for initial osdmap 2024-09-21T06:33:32.285 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:33:31 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:33:31.904+0000 7fc4a2fbf640 -1 osd.11 68 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T06:33:32.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:31 smithi144 ceph-mon[34653]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-21T06:33:32.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:31 smithi144 ceph-mon[34653]: osdmap e67: 12 total, 11 up, 12 in 2024-09-21T06:33:32.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:31 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:33:32.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:31 smithi144 ceph-mon[34653]: from='osd.11 [v2:172.21.15.144:6824/1047060848,v1:172.21.15.144:6825/1047060848]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi144", "root=default"]} : dispatch 2024-09-21T06:33:32.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:31 smithi144 ceph-mon[34653]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi144", "root=default"]} : dispatch 2024-09-21T06:33:32.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:31 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:32.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:31 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:32.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:31 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T06:33:32.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:31 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T06:33:32.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:31 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T06:33:32.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:31 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T06:33:32.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:31 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:32.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:31 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:33:32.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:31 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:33:32.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:31 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:32.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:31 smithi018 ceph-mon[34477]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-21T06:33:32.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:31 smithi018 ceph-mon[34477]: osdmap e67: 12 total, 11 up, 12 in 2024-09-21T06:33:32.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:31 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:33:32.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:31 smithi018 ceph-mon[34477]: from='osd.11 [v2:172.21.15.144:6824/1047060848,v1:172.21.15.144:6825/1047060848]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi144", "root=default"]} : dispatch 2024-09-21T06:33:32.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:31 smithi018 ceph-mon[34477]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi144", "root=default"]} : dispatch 2024-09-21T06:33:32.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:31 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:32.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:31 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:32.370 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:31 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T06:33:32.370 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:31 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T06:33:32.370 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:31 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T06:33:32.370 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:31 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T06:33:32.370 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:31 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:32.370 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:31 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:33:32.370 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:31 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:33:32.370 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:31 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:32.832 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":68,"num_osds":12,"num_up_osds":11,"osd_up_since":1726900387,"num_in_osds":12,"osd_in_since":1726900389,"num_remapped_pgs":0} 2024-09-21T06:33:33.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:32 smithi007 ceph-mon[30983]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:33:33.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:32 smithi007 ceph-mon[30983]: Detected new or changed devices on smithi144 2024-09-21T06:33:33.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:32 smithi007 ceph-mon[30983]: Adjusting osd_memory_target on smithi144 to 4272M 2024-09-21T06:33:33.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:32 smithi007 ceph-mon[30983]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]': finished 2024-09-21T06:33:33.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:32 smithi007 ceph-mon[30983]: osdmap e68: 12 total, 11 up, 12 in 2024-09-21T06:33:33.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:32 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:33:33.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:32 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:33:33.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:32 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/3596750833' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T06:33:33.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:32 smithi144 ceph-mon[34653]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:33:33.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:32 smithi144 ceph-mon[34653]: Detected new or changed devices on smithi144 2024-09-21T06:33:33.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:32 smithi144 ceph-mon[34653]: Adjusting osd_memory_target on smithi144 to 4272M 2024-09-21T06:33:33.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:32 smithi144 ceph-mon[34653]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]': finished 2024-09-21T06:33:33.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:32 smithi144 ceph-mon[34653]: osdmap e68: 12 total, 11 up, 12 in 2024-09-21T06:33:33.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:32 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:33:33.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:32 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:33:33.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:32 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/3596750833' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T06:33:33.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:32 smithi018 ceph-mon[34477]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:33:33.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:32 smithi018 ceph-mon[34477]: Detected new or changed devices on smithi144 2024-09-21T06:33:33.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:32 smithi018 ceph-mon[34477]: Adjusting osd_memory_target on smithi144 to 4272M 2024-09-21T06:33:33.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:32 smithi018 ceph-mon[34477]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi144", "root=default"]}]': finished 2024-09-21T06:33:33.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:32 smithi018 ceph-mon[34477]: osdmap e68: 12 total, 11 up, 12 in 2024-09-21T06:33:33.370 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:32 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:33:33.370 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:32 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:33:33.370 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:32 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/3596750833' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T06:33:33.833 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-21T06:33:34.101 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:33:34.223 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:33 smithi007 ceph-mon[30983]: purged_snaps scrub starts 2024-09-21T06:33:34.223 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:33 smithi007 ceph-mon[30983]: purged_snaps scrub ok 2024-09-21T06:33:34.223 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:33 smithi007 ceph-mon[30983]: osd.11 [v2:172.21.15.144:6824/1047060848,v1:172.21.15.144:6825/1047060848] boot 2024-09-21T06:33:34.223 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:33 smithi007 ceph-mon[30983]: osdmap e69: 12 total, 12 up, 12 in 2024-09-21T06:33:34.224 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:33 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:33:34.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:33 smithi144 ceph-mon[34653]: purged_snaps scrub starts 2024-09-21T06:33:34.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:33 smithi144 ceph-mon[34653]: purged_snaps scrub ok 2024-09-21T06:33:34.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:33 smithi144 ceph-mon[34653]: osd.11 [v2:172.21.15.144:6824/1047060848,v1:172.21.15.144:6825/1047060848] boot 2024-09-21T06:33:34.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:33 smithi144 ceph-mon[34653]: osdmap e69: 12 total, 12 up, 12 in 2024-09-21T06:33:34.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:33 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:33:34.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:33 smithi018 ceph-mon[34477]: purged_snaps scrub starts 2024-09-21T06:33:34.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:33 smithi018 ceph-mon[34477]: purged_snaps scrub ok 2024-09-21T06:33:34.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:33 smithi018 ceph-mon[34477]: osd.11 [v2:172.21.15.144:6824/1047060848,v1:172.21.15.144:6825/1047060848] boot 2024-09-21T06:33:34.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:33 smithi018 ceph-mon[34477]: osdmap e69: 12 total, 12 up, 12 in 2024-09-21T06:33:34.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:33 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T06:33:34.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:34.583+0000 7f1de2af9640 1 -- 172.21.15.7:0/2828795054 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ddc1083d0 msgr2=0x7f1ddc1087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:34.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:34.583+0000 7f1de2af9640 1 --2- 172.21.15.7:0/2828795054 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ddc1083d0 0x7f1ddc1087e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc009ca0 tx=0x7f1dcc02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:33:34.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:34.583+0000 7f1de2af9640 1 -- 172.21.15.7:0/2828795054 shutdown_connections 2024-09-21T06:33:34.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:34.583+0000 7f1de2af9640 1 --2- 172.21.15.7:0/2828795054 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ddc108d20 0x7f1ddc10f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:34.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:34.583+0000 7f1de2af9640 1 --2- 172.21.15.7:0/2828795054 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ddc1083d0 0x7f1ddc1087e0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:34.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:34.583+0000 7f1de2af9640 1 --2- 172.21.15.7:0/2828795054 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1ddc102ae0 0x7f1ddc102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:34.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:34.583+0000 7f1de2af9640 1 -- 172.21.15.7:0/2828795054 >> 172.21.15.7:0/2828795054 conn(0x7f1ddc079760 msgr2=0x7f1ddc079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:34.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:34.583+0000 7f1de2af9640 1 -- 172.21.15.7:0/2828795054 shutdown_connections 2024-09-21T06:33:34.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:34.583+0000 7f1de2af9640 1 -- 172.21.15.7:0/2828795054 wait complete. 2024-09-21T06:33:34.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:34.584+0000 7f1de2af9640 1 Processor -- start 2024-09-21T06:33:34.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:34.584+0000 7f1de2af9640 1 -- start start 2024-09-21T06:33:34.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:34.584+0000 7f1de2af9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1ddc102ae0 0x7f1ddc19a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:34.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:34.584+0000 7f1de2af9640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ddc1083d0 0x7f1ddc19aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:34.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:34.584+0000 7f1de2af9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ddc108d20 0x7f1ddc19fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:34.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:34.584+0000 7f1de2af9640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1ddc112990 con 0x7f1ddc108d20 2024-09-21T06:33:34.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:34.584+0000 7f1de2af9640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1ddc112810 con 0x7f1ddc102ae0 2024-09-21T06:33:34.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:34.584+0000 7f1de2af9640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1ddc112b10 con 0x7f1ddc1083d0 2024-09-21T06:33:34.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:34.584+0000 7f1de1096640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ddc108d20 0x7f1ddc19fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:34.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:34.584+0000 7f1de1096640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ddc108d20 0x7f1ddc19fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38040/0 (socket says 172.21.15.7:38040) 2024-09-21T06:33:34.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:34.584+0000 7f1de1096640 1 -- 172.21.15.7:0/2006974765 learned_addr learned my addr 172.21.15.7:0/2006974765 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:33:34.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:34.584+0000 7f1de0895640 1 --2- 172.21.15.7:0/2006974765 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1ddc102ae0 0x7f1ddc19a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:34.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:34.584+0000 7f1ddbfff640 1 --2- 172.21.15.7:0/2006974765 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ddc1083d0 0x7f1ddc19aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:34.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:34.584+0000 7f1de1096640 1 -- 172.21.15.7:0/2006974765 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ddc1083d0 msgr2=0x7f1ddc19aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:34.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:34.584+0000 7f1de1096640 1 --2- 172.21.15.7:0/2006974765 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ddc1083d0 0x7f1ddc19aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:34.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:34.584+0000 7f1de1096640 1 -- 172.21.15.7:0/2006974765 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1ddc102ae0 msgr2=0x7f1ddc19a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:34.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:34.584+0000 7f1de1096640 1 --2- 172.21.15.7:0/2006974765 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1ddc102ae0 0x7f1ddc19a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:34.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:34.584+0000 7f1de1096640 1 -- 172.21.15.7:0/2006974765 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ddc1a0360 con 0x7f1ddc108d20 2024-09-21T06:33:34.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:34.584+0000 7f1ddbfff640 1 --2- 172.21.15.7:0/2006974765 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ddc1083d0 0x7f1ddc19aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:33:34.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:34.585+0000 7f1de1096640 1 --2- 172.21.15.7:0/2006974765 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ddc108d20 0x7f1ddc19fcf0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1dd400d750 tx=0x7f1dd400db50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:34.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:34.585+0000 7f1dd9ffb640 1 -- 172.21.15.7:0/2006974765 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd4017070 con 0x7f1ddc108d20 2024-09-21T06:33:34.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:34.585+0000 7f1dd9ffb640 1 -- 172.21.15.7:0/2006974765 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1dd40097c0 con 0x7f1ddc108d20 2024-09-21T06:33:34.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:34.585+0000 7f1de2af9640 1 -- 172.21.15.7:0/2006974765 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ddc1a0650 con 0x7f1ddc108d20 2024-09-21T06:33:34.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:34.585+0000 7f1dd9ffb640 1 -- 172.21.15.7:0/2006974765 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dd4004ba0 con 0x7f1ddc108d20 2024-09-21T06:33:34.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:34.585+0000 7f1de2af9640 1 -- 172.21.15.7:0/2006974765 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ddc1a6e70 con 0x7f1ddc108d20 2024-09-21T06:33:34.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:34.586+0000 7f1de2af9640 1 -- 172.21.15.7:0/2006974765 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ddc103d10 con 0x7f1ddc108d20 2024-09-21T06:33:34.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:34.587+0000 7f1dd9ffb640 1 -- 172.21.15.7:0/2006974765 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 21) ==== 154528+0+0 (secure 0 0 0) 0x7f1dd4009c90 con 0x7f1ddc108d20 2024-09-21T06:33:34.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:34.588+0000 7f1dd9ffb640 1 --2- 172.21.15.7:0/2006974765 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f1dc80b6610 0x7f1dc80b8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:34.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:34.589+0000 7f1de0895640 1 --2- 172.21.15.7:0/2006974765 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f1dc80b6610 0x7f1dc80b8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:34.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:34.589+0000 7f1dd9ffb640 1 -- 172.21.15.7:0/2006974765 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f1dd40e69d0 con 0x7f1ddc108d20 2024-09-21T06:33:34.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:34.589+0000 7f1de0895640 1 --2- 172.21.15.7:0/2006974765 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f1dc80b6610 0x7f1dc80b8b20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1dc400abe0 tx=0x7f1dc400a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:34.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:34.593+0000 7f1dd9ffb640 1 -- 172.21.15.7:0/2006974765 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1dd40ad590 con 0x7f1ddc108d20 2024-09-21T06:33:34.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:34.783+0000 7f1de2af9640 1 -- 172.21.15.7:0/2006974765 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f1ddc10b590 con 0x7f1ddc108d20 2024-09-21T06:33:34.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:34.783+0000 7f1dd9ffb640 1 -- 172.21.15.7:0/2006974765 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v70) ==== 74+0+133 (secure 0 0 0) 0x7f1dd40b1970 con 0x7f1ddc108d20 2024-09-21T06:33:34.785 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:33:34.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:34.786+0000 7f1de2af9640 1 -- 172.21.15.7:0/2006974765 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f1dc80b6610 msgr2=0x7f1dc80b8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:34.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:34.786+0000 7f1de2af9640 1 --2- 172.21.15.7:0/2006974765 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f1dc80b6610 0x7f1dc80b8b20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1dc400abe0 tx=0x7f1dc400a2d0 comp rx=0 tx=0).stop 2024-09-21T06:33:34.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:34.786+0000 7f1de2af9640 1 -- 172.21.15.7:0/2006974765 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ddc108d20 msgr2=0x7f1ddc19fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:34.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:34.786+0000 7f1de2af9640 1 --2- 172.21.15.7:0/2006974765 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ddc108d20 0x7f1ddc19fcf0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1dd400d750 tx=0x7f1dd400db50 comp rx=0 tx=0).stop 2024-09-21T06:33:34.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:34.786+0000 7f1de2af9640 1 -- 172.21.15.7:0/2006974765 shutdown_connections 2024-09-21T06:33:34.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:34.786+0000 7f1de2af9640 1 --2- 172.21.15.7:0/2006974765 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f1dc80b6610 0x7f1dc80b8b20 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:34.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:34.786+0000 7f1de2af9640 1 --2- 172.21.15.7:0/2006974765 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1ddc108d20 0x7f1ddc19fcf0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:34.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:34.786+0000 7f1de2af9640 1 --2- 172.21.15.7:0/2006974765 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1ddc1083d0 0x7f1ddc19aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:34.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:34.786+0000 7f1de2af9640 1 --2- 172.21.15.7:0/2006974765 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1ddc102ae0 0x7f1ddc19a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:34.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:34.786+0000 7f1de2af9640 1 -- 172.21.15.7:0/2006974765 >> 172.21.15.7:0/2006974765 conn(0x7f1ddc079760 msgr2=0x7f1ddc06bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:34.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:34.786+0000 7f1de2af9640 1 -- 172.21.15.7:0/2006974765 shutdown_connections 2024-09-21T06:33:34.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:34.786+0000 7f1de2af9640 1 -- 172.21.15.7:0/2006974765 wait complete. 2024-09-21T06:33:35.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:34 smithi007 ceph-mon[30983]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:33:35.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:34 smithi007 ceph-mon[30983]: osdmap e70: 12 total, 12 up, 12 in 2024-09-21T06:33:35.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:34 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2006974765' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T06:33:35.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:34 smithi144 ceph-mon[34653]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:33:35.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:34 smithi144 ceph-mon[34653]: osdmap e70: 12 total, 12 up, 12 in 2024-09-21T06:33:35.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:34 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/2006974765' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T06:33:35.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:34 smithi018 ceph-mon[34477]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 330 MiB used, 983 GiB / 983 GiB avail 2024-09-21T06:33:35.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:34 smithi018 ceph-mon[34477]: osdmap e70: 12 total, 12 up, 12 in 2024-09-21T06:33:35.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:34 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/2006974765' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T06:33:35.654 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":70,"num_osds":12,"num_up_osds":12,"osd_up_since":1726900412,"num_in_osds":12,"osd_in_since":1726900389,"num_remapped_pgs":0} 2024-09-21T06:33:35.655 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T06:33:35.917 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:33:36.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:36.412+0000 7fb8fbd8e640 1 -- 172.21.15.7:0/953970830 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8f41052b0 msgr2=0x7fb8f410d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:36.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:36.412+0000 7fb8fbd8e640 1 --2- 172.21.15.7:0/953970830 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8f41052b0 0x7fb8f410d8f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb8e8009900 tx=0x7fb8e802a410 comp rx=0 tx=0).stop 2024-09-21T06:33:36.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:36.412+0000 7fb8fbd8e640 1 -- 172.21.15.7:0/953970830 shutdown_connections 2024-09-21T06:33:36.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:36.412+0000 7fb8fbd8e640 1 --2- 172.21.15.7:0/953970830 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8f410de30 0x7fb8f4110310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:36.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:36.412+0000 7fb8fbd8e640 1 --2- 172.21.15.7:0/953970830 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8f41052b0 0x7fb8f410d8f0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:36.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:36.412+0000 7fb8fbd8e640 1 --2- 172.21.15.7:0/953970830 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb8f4104880 0x7fb8f4104c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:36.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:36.412+0000 7fb8fbd8e640 1 -- 172.21.15.7:0/953970830 >> 172.21.15.7:0/953970830 conn(0x7fb8f4079740 msgr2=0x7fb8f4079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:36.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:36.412+0000 7fb8fbd8e640 1 -- 172.21.15.7:0/953970830 shutdown_connections 2024-09-21T06:33:36.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:36.412+0000 7fb8fbd8e640 1 -- 172.21.15.7:0/953970830 wait complete. 2024-09-21T06:33:36.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:36.412+0000 7fb8fbd8e640 1 Processor -- start 2024-09-21T06:33:36.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:36.412+0000 7fb8fbd8e640 1 -- start start 2024-09-21T06:33:36.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:36.413+0000 7fb8fbd8e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8f4104880 0x7fb8f4102790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:36.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:36.413+0000 7fb8fbd8e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8f41052b0 0x7fb8f4102cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:36.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:36.413+0000 7fb8fbd8e640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb8f410de30 0x7fb8f4103210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:36.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:36.413+0000 7fb8fbd8e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb8f4113a80 con 0x7fb8f4104880 2024-09-21T06:33:36.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:36.413+0000 7fb8fbd8e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb8f4113900 con 0x7fb8f41052b0 2024-09-21T06:33:36.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:36.413+0000 7fb8fbd8e640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb8f4113c00 con 0x7fb8f410de30 2024-09-21T06:33:36.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:36.413+0000 7fb8f9b2a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8f4104880 0x7fb8f4102790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:36.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:36.413+0000 7fb8f9b2a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8f4104880 0x7fb8f4102790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38066/0 (socket says 172.21.15.7:38066) 2024-09-21T06:33:36.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:36.413+0000 7fb8f9b2a640 1 -- 172.21.15.7:0/214742583 learned_addr learned my addr 172.21.15.7:0/214742583 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:33:36.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:36.413+0000 7fb8f9329640 1 --2- 172.21.15.7:0/214742583 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8f41052b0 0x7fb8f4102cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:36.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:36.413+0000 7fb8fa32b640 1 --2- 172.21.15.7:0/214742583 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb8f410de30 0x7fb8f4103210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:36.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:36.413+0000 7fb8f9b2a640 1 -- 172.21.15.7:0/214742583 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb8f410de30 msgr2=0x7fb8f4103210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:36.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:36.413+0000 7fb8f9b2a640 1 --2- 172.21.15.7:0/214742583 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb8f410de30 0x7fb8f4103210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:36.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:36.413+0000 7fb8f9b2a640 1 -- 172.21.15.7:0/214742583 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8f41052b0 msgr2=0x7fb8f4102cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:36.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:36.413+0000 7fb8f9b2a640 1 --2- 172.21.15.7:0/214742583 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8f41052b0 0x7fb8f4102cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:36.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:36.413+0000 7fb8f9b2a640 1 -- 172.21.15.7:0/214742583 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8f41a8750 con 0x7fb8f4104880 2024-09-21T06:33:36.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:36.414+0000 7fb8f9b2a640 1 --2- 172.21.15.7:0/214742583 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8f4104880 0x7fb8f4102790 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb8f000c970 tx=0x7fb8f000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:36.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:36.414+0000 7fb8e6ffd640 1 -- 172.21.15.7:0/214742583 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8f0007bb0 con 0x7fb8f4104880 2024-09-21T06:33:36.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:36.414+0000 7fb8fbd8e640 1 -- 172.21.15.7:0/214742583 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8f41a8a40 con 0x7fb8f4104880 2024-09-21T06:33:36.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:36.414+0000 7fb8e6ffd640 1 -- 172.21.15.7:0/214742583 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb8f0007d50 con 0x7fb8f4104880 2024-09-21T06:33:36.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:36.414+0000 7fb8e6ffd640 1 -- 172.21.15.7:0/214742583 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8f000f450 con 0x7fb8f4104880 2024-09-21T06:33:36.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:36.414+0000 7fb8fbd8e640 1 -- 172.21.15.7:0/214742583 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8f41a8f50 con 0x7fb8f4104880 2024-09-21T06:33:36.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:36.415+0000 7fb8fbd8e640 1 -- 172.21.15.7:0/214742583 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8f406c1c0 con 0x7fb8f4104880 2024-09-21T06:33:36.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:36.417+0000 7fb8e6ffd640 1 -- 172.21.15.7:0/214742583 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 21) ==== 154528+0+0 (secure 0 0 0) 0x7fb8f0004f00 con 0x7fb8f4104880 2024-09-21T06:33:36.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:36.417+0000 7fb8e6ffd640 1 --2- 172.21.15.7:0/214742583 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fb8e00b6560 0x7fb8e00b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:36.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:36.417+0000 7fb8f9329640 1 --2- 172.21.15.7:0/214742583 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fb8e00b6560 0x7fb8e00b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:36.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:36.418+0000 7fb8e6ffd640 1 -- 172.21.15.7:0/214742583 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7fb8f00e7090 con 0x7fb8f4104880 2024-09-21T06:33:36.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:36.418+0000 7fb8f9329640 1 --2- 172.21.15.7:0/214742583 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fb8e00b6560 0x7fb8e00b8a70 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb8e8009230 tx=0x7fb8e8031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:36.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:36.421+0000 7fb8e6ffd640 1 -- 172.21.15.7:0/214742583 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb8f0014030 con 0x7fb8f4104880 2024-09-21T06:33:36.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:36.609+0000 7fb8fbd8e640 1 -- 172.21.15.7:0/214742583 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb8f4104c90 con 0x7fb8f4104880 2024-09-21T06:33:36.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:36.610+0000 7fb8e6ffd640 1 -- 172.21.15.7:0/214742583 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) ==== 74+0+18697 (secure 0 0 0) 0x7fb8f4104c90 con 0x7fb8f4104880 2024-09-21T06:33:36.612 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:33:36.612 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":70,"fsid":"347cb918-77e2-11ef-baf5-efdc52797490","created":"2024-09-21T06:25:51.925032+0000","modified":"2024-09-21T06:33:33.896374+0000","last_up_change":"2024-09-21T06:33:32.888843+0000","last_in_change":"2024-09-21T06:33:09.926778+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:29:41.514179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1be5c4a4-3931-4d8b-95c7-c05f5b73fcfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":942632794},{"type":"v1","addr":"172.21.15.7:6803","nonce":942632794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":942632794},{"type":"v1","addr":"172.21.15.7:6805","nonce":942632794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":942632794},{"type":"v1","addr":"172.21.15.7:6809","nonce":942632794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":942632794},{"type":"v1","addr":"172.21.15.7:6807","nonce":942632794}]},"public_addr":"172.21.15.7:6803/942632794","cluster_addr":"172.21.15.7:6805/942632794","heartbeat_back_addr":"172.21.15.7:6809/942632794","heartbeat_front_addr":"172.21.15.7:6807/942632794","state":["exists","up"]},{"osd":1,"uuid":"7ae136a8-c614-47e5-b265-c6cfa857a7fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1839342931},{"type":"v1","addr":"172.21.15.18:6801","nonce":1839342931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1839342931},{"type":"v1","addr":"172.21.15.18:6803","nonce":1839342931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1839342931},{"type":"v1","addr":"172.21.15.18:6807","nonce":1839342931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1839342931},{"type":"v1","addr":"172.21.15.18:6805","nonce":1839342931}]},"public_addr":"172.21.15.18:6801/1839342931","cluster_addr":"172.21.15.18:6803/1839342931","heartbeat_back_addr":"172.21.15.18:6807/1839342931","heartbeat_front_addr":"172.21.15.18:6805/1839342931","state":["exists","up"]},{"osd":2,"uuid":"97b13994-4680-4573-9c2e-ac65ea740e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":1699582162},{"type":"v1","addr":"172.21.15.144:6801","nonce":1699582162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":1699582162},{"type":"v1","addr":"172.21.15.144:6803","nonce":1699582162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":1699582162},{"type":"v1","addr":"172.21.15.144:6807","nonce":1699582162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":1699582162},{"type":"v1","addr":"172.21.15.144:6805","nonce":1699582162}]},"public_addr":"172.21.15.144:6801/1699582162","cluster_addr":"172.21.15.144:6803/1699582162","heartbeat_back_addr":"172.21.15.144:6807/1699582162","heartbeat_front_addr":"172.21.15.144:6805/1699582162","state":["exists","up"]},{"osd":3,"uuid":"ddf70d51-404d-491d-a6a8-15fca4ef01db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":3202935163},{"type":"v1","addr":"172.21.15.7:6811","nonce":3202935163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":3202935163},{"type":"v1","addr":"172.21.15.7:6813","nonce":3202935163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":3202935163},{"type":"v1","addr":"172.21.15.7:6817","nonce":3202935163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":3202935163},{"type":"v1","addr":"172.21.15.7:6815","nonce":3202935163}]},"public_addr":"172.21.15.7:6811/3202935163","cluster_addr":"172.21.15.7:6813/3202935163","heartbeat_back_addr":"172.21.15.7:6817/3202935163","heartbeat_front_addr":"172.21.15.7:6815/3202935163","state":["exists","up"]},{"osd":4,"uuid":"f2ae4340-accf-4ac0-a4d3-c08302712ce1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1058105724},{"type":"v1","addr":"172.21.15.18:6809","nonce":1058105724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":1058105724},{"type":"v1","addr":"172.21.15.18:6811","nonce":1058105724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":1058105724},{"type":"v1","addr":"172.21.15.18:6815","nonce":1058105724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":1058105724},{"type":"v1","addr":"172.21.15.18:6813","nonce":1058105724}]},"public_addr":"172.21.15.18:6809/1058105724","cluster_addr":"172.21.15.18:6811/1058105724","heartbeat_back_addr":"172.21.15.18:6815/1058105724","heartbeat_front_addr":"172.21.15.18:6813/1058105724","state":["exists","up"]},{"osd":5,"uuid":"d56abc37-de6f-47a4-9f5e-67224da78f4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":2814586621},{"type":"v1","addr":"172.21.15.144:6809","nonce":2814586621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":2814586621},{"type":"v1","addr":"172.21.15.144:6811","nonce":2814586621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":2814586621},{"type":"v1","addr":"172.21.15.144:6815","nonce":2814586621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":2814586621},{"type":"v1","addr":"172.21.15.144:6813","nonce":2814586621}]},"public_addr":"172.21.15.144:6809/2814586621","cluster_addr":"172.21.15.144:6811/2814586621","heartbeat_back_addr":"172.21.15.144:6815/2814586621","heartbeat_front_addr":"172.21.15.144:6813/2814586621","state":["exists","up"]},{"osd":6,"uuid":"9145650c-e9b1-4e5a-ae6f-17c8960146e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":3770978305},{"type":"v1","addr":"172.21.15.7:6819","nonce":3770978305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":3770978305},{"type":"v1","addr":"172.21.15.7:6821","nonce":3770978305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3770978305},{"type":"v1","addr":"172.21.15.7:6825","nonce":3770978305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":3770978305},{"type":"v1","addr":"172.21.15.7:6823","nonce":3770978305}]},"public_addr":"172.21.15.7:6819/3770978305","cluster_addr":"172.21.15.7:6821/3770978305","heartbeat_back_addr":"172.21.15.7:6825/3770978305","heartbeat_front_addr":"172.21.15.7:6823/3770978305","state":["exists","up"]},{"osd":7,"uuid":"ca658683-38f7-47ca-b32e-512fe4738ef1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":1322408496},{"type":"v1","addr":"172.21.15.18:6817","nonce":1322408496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1322408496},{"type":"v1","addr":"172.21.15.18:6819","nonce":1322408496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1322408496},{"type":"v1","addr":"172.21.15.18:6823","nonce":1322408496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1322408496},{"type":"v1","addr":"172.21.15.18:6821","nonce":1322408496}]},"public_addr":"172.21.15.18:6817/1322408496","cluster_addr":"172.21.15.18:6819/1322408496","heartbeat_back_addr":"172.21.15.18:6823/1322408496","heartbeat_front_addr":"172.21.15.18:6821/1322408496","state":["exists","up"]},{"osd":8,"uuid":"40d1f37e-6fac-40b9-9319-78f4fc3a6f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1011657022},{"type":"v1","addr":"172.21.15.144:6817","nonce":1011657022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1011657022},{"type":"v1","addr":"172.21.15.144:6819","nonce":1011657022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1011657022},{"type":"v1","addr":"172.21.15.144:6823","nonce":1011657022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":1011657022},{"type":"v1","addr":"172.21.15.144:6821","nonce":1011657022}]},"public_addr":"172.21.15.144:6817/1011657022","cluster_addr":"172.21.15.144:6819/1011657022","heartbeat_back_addr":"172.21.15.144:6823/1011657022","heartbeat_front_addr":"172.21.15.144:6821/1011657022","state":["exists","up"]},{"osd":9,"uuid":"ad12d6f7-fd21-49bd-a343-744f3cff4bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":256146339},{"type":"v1","addr":"172.21.15.7:6827","nonce":256146339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":256146339},{"type":"v1","addr":"172.21.15.7:6829","nonce":256146339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":256146339},{"type":"v1","addr":"172.21.15.7:6833","nonce":256146339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":256146339},{"type":"v1","addr":"172.21.15.7:6831","nonce":256146339}]},"public_addr":"172.21.15.7:6827/256146339","cluster_addr":"172.21.15.7:6829/256146339","heartbeat_back_addr":"172.21.15.7:6833/256146339","heartbeat_front_addr":"172.21.15.7:6831/256146339","state":["exists","up"]},{"osd":10,"uuid":"1317a2ad-ec15-4096-b2da-689475b7cacc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":2038885362},{"type":"v1","addr":"172.21.15.18:6825","nonce":2038885362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2038885362},{"type":"v1","addr":"172.21.15.18:6827","nonce":2038885362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2038885362},{"type":"v1","addr":"172.21.15.18:6831","nonce":2038885362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2038885362},{"type":"v1","addr":"172.21.15.18:6829","nonce":2038885362}]},"public_addr":"172.21.15.18:6825/2038885362","cluster_addr":"172.21.15.18:6827/2038885362","heartbeat_back_addr":"172.21.15.18:6831/2038885362","heartbeat_front_addr":"172.21.15.18:6829/2038885362","state":["exists","up"]},{"osd":11,"uuid":"f9252acb-7290-4923-89f3-844c868d4b39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":1047060848},{"type":"v1","addr":"172.21.15.144:6825","nonce":1047060848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":1047060848},{"type":"v1","addr":"172.21.15.144:6827","nonce":1047060848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":1047060848},{"type":"v1","addr":"172.21.15.144:6831","nonce":1047060848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":1047060848},{"type":"v1","addr":"172.21.15.144:6829","nonce":1047060848}]},"public_addr":"172.21.15.144:6825/1047060848","cluster_addr":"172.21.15.144:6827/1047060848","heartbeat_back_addr":"172.21.15.144:6831/1047060848","heartbeat_front_addr":"172.21.15.144:6829/1047060848","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:28:48.842729+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:29:13.946624+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:29:38.589666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:30:05.116339+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:30:30.562090+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:30:55.586210+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:31:22.138457+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:31:49.178090+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:32:13.687830+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:32:40.408193+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:33:06.044578+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:33:30.988851+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/1296137341":"2024-09-22T06:27:43.044484+0000","172.21.15.7:6801/3879502931":"2024-09-22T06:27:43.044484+0000","172.21.15.7:0/1926706877":"2024-09-22T06:26:40.520265+0000","172.21.15.7:0/2034370456":"2024-09-22T06:26:14.181426+0000","172.21.15.7:6801/3339522713":"2024-09-22T06:26:14.181426+0000","172.21.15.7:6800/3339522713":"2024-09-22T06:26:14.181426+0000","172.21.15.7:0/3586807770":"2024-09-22T06:26:14.181426+0000","172.21.15.7:0/1814223919":"2024-09-22T06:27:43.044484+0000","172.21.15.7:0/601150037":"2024-09-22T06:26:40.520265+0000","172.21.15.7:6800/3876787626":"2024-09-22T06:26:40.520265+0000","172.21.15.7:0/186444636":"2024-09-22T06:26:14.181426+0000","172.21.15.7:0/2180184348":"2024-09-22T06:26:40.520265+0000","172.21.15.7:6801/3876787626":"2024-09-22T06:26:40.520265+0000","172.21.15.7:0/2931793461":"2024-09-22T06:27:43.044484+0000","172.21.15.7:6800/3879502931":"2024-09-22T06:27:43.044484+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:33:36.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:36.612+0000 7fb8fbd8e640 1 -- 172.21.15.7:0/214742583 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fb8e00b6560 msgr2=0x7fb8e00b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:36.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:36.612+0000 7fb8fbd8e640 1 --2- 172.21.15.7:0/214742583 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fb8e00b6560 0x7fb8e00b8a70 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb8e8009230 tx=0x7fb8e8031400 comp rx=0 tx=0).stop 2024-09-21T06:33:36.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:36.612+0000 7fb8fbd8e640 1 -- 172.21.15.7:0/214742583 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8f4104880 msgr2=0x7fb8f4102790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:36.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:36.612+0000 7fb8fbd8e640 1 --2- 172.21.15.7:0/214742583 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8f4104880 0x7fb8f4102790 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb8f000c970 tx=0x7fb8f000ce30 comp rx=0 tx=0).stop 2024-09-21T06:33:36.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:36.612+0000 7fb8fbd8e640 1 -- 172.21.15.7:0/214742583 shutdown_connections 2024-09-21T06:33:36.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:36.612+0000 7fb8fbd8e640 1 --2- 172.21.15.7:0/214742583 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fb8e00b6560 0x7fb8e00b8a70 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:36.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:36.612+0000 7fb8fbd8e640 1 --2- 172.21.15.7:0/214742583 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb8f410de30 0x7fb8f4103210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:36.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:36.612+0000 7fb8fbd8e640 1 --2- 172.21.15.7:0/214742583 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8f41052b0 0x7fb8f4102cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:36.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:36.612+0000 7fb8fbd8e640 1 --2- 172.21.15.7:0/214742583 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb8f4104880 0x7fb8f4102790 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:36.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:36.612+0000 7fb8fbd8e640 1 -- 172.21.15.7:0/214742583 >> 172.21.15.7:0/214742583 conn(0x7fb8f4079740 msgr2=0x7fb8f41008d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:36.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:36.612+0000 7fb8fbd8e640 1 -- 172.21.15.7:0/214742583 shutdown_connections 2024-09-21T06:33:36.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:36.613+0000 7fb8fbd8e640 1 -- 172.21.15.7:0/214742583 wait complete. 2024-09-21T06:33:37.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:36 smithi144 ceph-mon[34653]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:33:37.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:36 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/214742583' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:33:37.327 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:36 smithi007 ceph-mon[30983]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:33:37.327 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:36 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/214742583' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:33:37.358 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T06:29:41.514179+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T06:33:37.358 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph osd pool get .mgr pg_num 2024-09-21T06:33:37.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:36 smithi018 ceph-mon[34477]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:33:37.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:36 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/214742583' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:33:37.615 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:33:38.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:38.048+0000 7fc88c8d3640 1 -- 172.21.15.7:0/2612676137 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc88810de10 msgr2=0x7fc888110320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:38.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:38.048+0000 7fc88c8d3640 1 --2- 172.21.15.7:0/2612676137 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc88810de10 0x7fc888110320 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc878009900 tx=0x7fc87802a410 comp rx=0 tx=0).stop 2024-09-21T06:33:38.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:38.049+0000 7fc88c8d3640 1 -- 172.21.15.7:0/2612676137 shutdown_connections 2024-09-21T06:33:38.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:38.049+0000 7fc88c8d3640 1 --2- 172.21.15.7:0/2612676137 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc88810de10 0x7fc888110320 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:38.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:38.049+0000 7fc88c8d3640 1 --2- 172.21.15.7:0/2612676137 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc888105290 0x7fc88810d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:38.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:38.049+0000 7fc88c8d3640 1 --2- 172.21.15.7:0/2612676137 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc888104860 0x7fc888104c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:38.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:38.049+0000 7fc88c8d3640 1 -- 172.21.15.7:0/2612676137 >> 172.21.15.7:0/2612676137 conn(0x7fc888079740 msgr2=0x7fc888079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:38.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:38.049+0000 7fc88c8d3640 1 -- 172.21.15.7:0/2612676137 shutdown_connections 2024-09-21T06:33:38.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:38.049+0000 7fc88c8d3640 1 -- 172.21.15.7:0/2612676137 wait complete. 2024-09-21T06:33:38.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:38.050+0000 7fc88c8d3640 1 Processor -- start 2024-09-21T06:33:38.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:38.050+0000 7fc88c8d3640 1 -- start start 2024-09-21T06:33:38.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:38.050+0000 7fc88c8d3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc888104860 0x7fc88819a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:38.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:38.050+0000 7fc88c8d3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc888105290 0x7fc88819a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:38.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:38.050+0000 7fc88c8d3640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc88810de10 0x7fc88819fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:38.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:38.050+0000 7fc88c8d3640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc888113ab0 con 0x7fc888104860 2024-09-21T06:33:38.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:38.050+0000 7fc88c8d3640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc888113930 con 0x7fc888105290 2024-09-21T06:33:38.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:38.050+0000 7fc88c8d3640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc888113c30 con 0x7fc88810de10 2024-09-21T06:33:38.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:38.051+0000 7fc88659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc888104860 0x7fc88819a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:38.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:38.051+0000 7fc885d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc888105290 0x7fc88819a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:38.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:38.051+0000 7fc88659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc888104860 0x7fc88819a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38090/0 (socket says 172.21.15.7:38090) 2024-09-21T06:33:38.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:38.051+0000 7fc88659c640 1 -- 172.21.15.7:0/3769967334 learned_addr learned my addr 172.21.15.7:0/3769967334 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:33:38.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:38.051+0000 7fc886d9d640 1 --2- 172.21.15.7:0/3769967334 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc88810de10 0x7fc88819fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:38.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:38.051+0000 7fc88659c640 1 -- 172.21.15.7:0/3769967334 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc88810de10 msgr2=0x7fc88819fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:38.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:38.051+0000 7fc88659c640 1 --2- 172.21.15.7:0/3769967334 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc88810de10 0x7fc88819fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:38.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:38.051+0000 7fc88659c640 1 -- 172.21.15.7:0/3769967334 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc888105290 msgr2=0x7fc88819a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:38.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:38.051+0000 7fc88659c640 1 --2- 172.21.15.7:0/3769967334 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc888105290 0x7fc88819a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:38.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:38.051+0000 7fc88659c640 1 -- 172.21.15.7:0/3769967334 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8881a0390 con 0x7fc888104860 2024-09-21T06:33:38.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:38.051+0000 7fc886d9d640 1 --2- 172.21.15.7:0/3769967334 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc88810de10 0x7fc88819fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:33:38.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:38.051+0000 7fc885d9b640 1 --2- 172.21.15.7:0/3769967334 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc888105290 0x7fc88819a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:33:38.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:38.051+0000 7fc88659c640 1 --2- 172.21.15.7:0/3769967334 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc888104860 0x7fc88819a420 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc88000eaa0 tx=0x7fc88000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:38.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:38.051+0000 7fc87f7fe640 1 -- 172.21.15.7:0/3769967334 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc880016070 con 0x7fc888104860 2024-09-21T06:33:38.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:38.051+0000 7fc88c8d3640 1 -- 172.21.15.7:0/3769967334 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8881a0680 con 0x7fc888104860 2024-09-21T06:33:38.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:38.051+0000 7fc87f7fe640 1 -- 172.21.15.7:0/3769967334 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc880003e20 con 0x7fc888104860 2024-09-21T06:33:38.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:38.051+0000 7fc87f7fe640 1 -- 172.21.15.7:0/3769967334 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8800116d0 con 0x7fc888104860 2024-09-21T06:33:38.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:38.051+0000 7fc88c8d3640 1 -- 172.21.15.7:0/3769967334 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8881a6de0 con 0x7fc888104860 2024-09-21T06:33:38.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:38.052+0000 7fc88c8d3640 1 -- 172.21.15.7:0/3769967334 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc88806c1e0 con 0x7fc888104860 2024-09-21T06:33:38.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:38.054+0000 7fc87f7fe640 1 -- 172.21.15.7:0/3769967334 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 21) ==== 154528+0+0 (secure 0 0 0) 0x7fc880019070 con 0x7fc888104860 2024-09-21T06:33:38.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:38.055+0000 7fc87f7fe640 1 --2- 172.21.15.7:0/3769967334 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fc8740b6560 0x7fc8740b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:38.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:38.055+0000 7fc885d9b640 1 --2- 172.21.15.7:0/3769967334 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fc8740b6560 0x7fc8740b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:38.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:38.055+0000 7fc87f7fe640 1 -- 172.21.15.7:0/3769967334 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7fc8800e7420 con 0x7fc888104860 2024-09-21T06:33:38.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:38.056+0000 7fc885d9b640 1 --2- 172.21.15.7:0/3769967334 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fc8740b6560 0x7fc8740b8a70 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc88810fa60 tx=0x7fc87000b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:38.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:38.058+0000 7fc87f7fe640 1 -- 172.21.15.7:0/3769967334 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc8800ae080 con 0x7fc888104860 2024-09-21T06:33:38.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:38.243+0000 7fc88c8d3640 1 -- 172.21.15.7:0/3769967334 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc88819b550 con 0x7fc888104860 2024-09-21T06:33:38.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:38.244+0000 7fc87f7fe640 1 -- 172.21.15.7:0/3769967334 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v70) ==== 93+0+10 (secure 0 0 0) 0x7fc8800b2460 con 0x7fc888104860 2024-09-21T06:33:38.246 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-09-21T06:33:38.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:38.246+0000 7fc88c8d3640 1 -- 172.21.15.7:0/3769967334 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fc8740b6560 msgr2=0x7fc8740b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:38.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:38.246+0000 7fc88c8d3640 1 --2- 172.21.15.7:0/3769967334 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fc8740b6560 0x7fc8740b8a70 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc88810fa60 tx=0x7fc87000b410 comp rx=0 tx=0).stop 2024-09-21T06:33:38.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:38.246+0000 7fc88c8d3640 1 -- 172.21.15.7:0/3769967334 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc888104860 msgr2=0x7fc88819a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:38.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:38.246+0000 7fc88c8d3640 1 --2- 172.21.15.7:0/3769967334 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc888104860 0x7fc88819a420 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc88000eaa0 tx=0x7fc88000ef60 comp rx=0 tx=0).stop 2024-09-21T06:33:38.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:38.246+0000 7fc88c8d3640 1 -- 172.21.15.7:0/3769967334 shutdown_connections 2024-09-21T06:33:38.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:38.246+0000 7fc88c8d3640 1 --2- 172.21.15.7:0/3769967334 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fc8740b6560 0x7fc8740b8a70 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:38.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:38.246+0000 7fc88c8d3640 1 --2- 172.21.15.7:0/3769967334 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc88810de10 0x7fc88819fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:38.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:38.246+0000 7fc88c8d3640 1 --2- 172.21.15.7:0/3769967334 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc888105290 0x7fc88819a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:38.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:38.246+0000 7fc88c8d3640 1 --2- 172.21.15.7:0/3769967334 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc888104860 0x7fc88819a420 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:38.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:38.246+0000 7fc88c8d3640 1 -- 172.21.15.7:0/3769967334 >> 172.21.15.7:0/3769967334 conn(0x7fc888079740 msgr2=0x7fc8880ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:38.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:38.246+0000 7fc88c8d3640 1 -- 172.21.15.7:0/3769967334 shutdown_connections 2024-09-21T06:33:38.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:38.246+0000 7fc88c8d3640 1 -- 172.21.15.7:0/3769967334 wait complete. 2024-09-21T06:33:38.938 INFO:tasks.cephadm:Adding mds.a on smithi007 2024-09-21T06:33:38.938 INFO:tasks.cephadm:Adding mds.d on smithi007 2024-09-21T06:33:38.938 INFO:tasks.cephadm:Adding mds.g on smithi007 2024-09-21T06:33:38.938 INFO:tasks.cephadm:Adding mds.j on smithi007 2024-09-21T06:33:38.938 INFO:tasks.cephadm:Adding mds.b on smithi018 2024-09-21T06:33:38.938 INFO:tasks.cephadm:Adding mds.e on smithi018 2024-09-21T06:33:38.938 INFO:tasks.cephadm:Adding mds.h on smithi018 2024-09-21T06:33:38.938 INFO:tasks.cephadm:Adding mds.k on smithi018 2024-09-21T06:33:38.938 INFO:tasks.cephadm:Adding mds.c on smithi144 2024-09-21T06:33:38.938 INFO:tasks.cephadm:Adding mds.f on smithi144 2024-09-21T06:33:38.938 INFO:tasks.cephadm:Adding mds.i on smithi144 2024-09-21T06:33:38.939 INFO:tasks.cephadm:Adding mds.l on smithi144 2024-09-21T06:33:38.939 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph orch apply mds all '12;smithi007=a;smithi007=d;smithi007=g;smithi007=j;smithi018=b;smithi018=e;smithi018=h;smithi018=k;smithi144=c;smithi144=f;smithi144=i;smithi144=l' 2024-09-21T06:33:39.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:38 smithi007 ceph-mon[30983]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:33:39.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:38 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/3769967334' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T06:33:39.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:38 smithi018 ceph-mon[34477]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:33:39.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:38 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/3769967334' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T06:33:39.198 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:33:39.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:38 smithi144 ceph-mon[34653]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:33:39.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:38 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/3769967334' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T06:33:39.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:39.703+0000 7fcb80ec4640 1 -- 172.21.15.144:0/538312400 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb7c102a60 msgr2=0x7fcb7c102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:39.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:39.703+0000 7fcb80ec4640 1 --2- 172.21.15.144:0/538312400 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb7c102a60 0x7fcb7c102e70 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c009900 tx=0x7fcb6c02a410 comp rx=0 tx=0).stop 2024-09-21T06:33:39.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:39.703+0000 7fcb80ec4640 1 -- 172.21.15.144:0/538312400 shutdown_connections 2024-09-21T06:33:39.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:39.703+0000 7fcb80ec4640 1 --2- 172.21.15.144:0/538312400 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb7c108cf0 0x7fcb7c10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:39.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:39.703+0000 7fcb80ec4640 1 --2- 172.21.15.144:0/538312400 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcb7c1083a0 0x7fcb7c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:39.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:39.703+0000 7fcb80ec4640 1 --2- 172.21.15.144:0/538312400 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb7c102a60 0x7fcb7c102e70 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:39.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:39.703+0000 7fcb80ec4640 1 -- 172.21.15.144:0/538312400 >> 172.21.15.144:0/538312400 conn(0x7fcb7c079730 msgr2=0x7fcb7c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:39.709 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:39.703+0000 7fcb80ec4640 1 -- 172.21.15.144:0/538312400 shutdown_connections 2024-09-21T06:33:39.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:39.703+0000 7fcb80ec4640 1 -- 172.21.15.144:0/538312400 wait complete. 2024-09-21T06:33:39.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:39.704+0000 7fcb80ec4640 1 Processor -- start 2024-09-21T06:33:39.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:39.704+0000 7fcb80ec4640 1 -- start start 2024-09-21T06:33:39.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:39.704+0000 7fcb80ec4640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb7c102a60 0x7fcb7c19c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:39.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:39.704+0000 7fcb80ec4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb7c1083a0 0x7fcb7c19cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:39.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:39.704+0000 7fcb80ec4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcb7c108cf0 0x7fcb7c1a1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:39.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:39.704+0000 7fcb80ec4640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fcb7c112960 con 0x7fcb7c1083a0 2024-09-21T06:33:39.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:39.704+0000 7fcb80ec4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcb7c1127e0 con 0x7fcb7c108cf0 2024-09-21T06:33:39.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:39.704+0000 7fcb80ec4640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fcb7c112ae0 con 0x7fcb7c102a60 2024-09-21T06:33:39.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:39.704+0000 7fcb7a59c640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb7c102a60 0x7fcb7c19c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:39.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:39.704+0000 7fcb7a59c640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb7c102a60 0x7fcb7c19c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.144:48342/0 (socket says 172.21.15.144:48342) 2024-09-21T06:33:39.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:39.704+0000 7fcb7a59c640 1 -- 172.21.15.144:0/4005286988 learned_addr learned my addr 172.21.15.144:0/4005286988 (peer_addr_for_me v2:172.21.15.144:0/0) 2024-09-21T06:33:39.710 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:39.704+0000 7fcb79d9b640 1 --2- 172.21.15.144:0/4005286988 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb7c1083a0 0x7fcb7c19cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:39.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:39.704+0000 7fcb7ad9d640 1 --2- 172.21.15.144:0/4005286988 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcb7c108cf0 0x7fcb7c1a1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:39.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:39.704+0000 7fcb7a59c640 1 -- 172.21.15.144:0/4005286988 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcb7c108cf0 msgr2=0x7fcb7c1a1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:39.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:39.704+0000 7fcb7a59c640 1 --2- 172.21.15.144:0/4005286988 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcb7c108cf0 0x7fcb7c1a1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:39.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:39.704+0000 7fcb7a59c640 1 -- 172.21.15.144:0/4005286988 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb7c1083a0 msgr2=0x7fcb7c19cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:39.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:39.704+0000 7fcb7a59c640 1 --2- 172.21.15.144:0/4005286988 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb7c1083a0 0x7fcb7c19cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:39.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:39.705+0000 7fcb7a59c640 1 -- 172.21.15.144:0/4005286988 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb7c1a2640 con 0x7fcb7c102a60 2024-09-21T06:33:39.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:39.705+0000 7fcb7ad9d640 1 --2- 172.21.15.144:0/4005286988 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcb7c108cf0 0x7fcb7c1a1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:33:39.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:39.705+0000 7fcb7a59c640 1 --2- 172.21.15.144:0/4005286988 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb7c102a60 0x7fcb7c19c6d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c005940 tx=0x7fcb6c0042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:39.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:39.705+0000 7fcb6b7fe640 1 -- 172.21.15.144:0/4005286988 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb6c03f030 con 0x7fcb7c102a60 2024-09-21T06:33:39.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:39.705+0000 7fcb80ec4640 1 -- 172.21.15.144:0/4005286988 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb7c1a28d0 con 0x7fcb7c102a60 2024-09-21T06:33:39.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:39.705+0000 7fcb6b7fe640 1 -- 172.21.15.144:0/4005286988 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcb6c003cb0 con 0x7fcb7c102a60 2024-09-21T06:33:39.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:39.705+0000 7fcb6b7fe640 1 -- 172.21.15.144:0/4005286988 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb6c035070 con 0x7fcb7c102a60 2024-09-21T06:33:39.711 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:39.705+0000 7fcb80ec4640 1 -- 172.21.15.144:0/4005286988 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb7c1a9090 con 0x7fcb7c102a60 2024-09-21T06:33:39.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:39.706+0000 7fcb80ec4640 1 -- 172.21.15.144:0/4005286988 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb7c102e70 con 0x7fcb7c102a60 2024-09-21T06:33:39.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:39.709+0000 7fcb6b7fe640 1 -- 172.21.15.144:0/4005286988 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 21) ==== 154528+0+0 (secure 0 0 0) 0x7fcb6c042030 con 0x7fcb7c102a60 2024-09-21T06:33:39.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:39.709+0000 7fcb6b7fe640 1 --2- 172.21.15.144:0/4005286988 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fcb640b6560 0x7fcb640b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:39.712 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:39.710+0000 7fcb6b7fe640 1 -- 172.21.15.144:0/4005286988 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7fcb6c1078b0 con 0x7fcb7c102a60 2024-09-21T06:33:39.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:39.710+0000 7fcb79d9b640 1 --2- 172.21.15.144:0/4005286988 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fcb640b6560 0x7fcb640b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:39.713 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:39.710+0000 7fcb79d9b640 1 --2- 172.21.15.144:0/4005286988 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fcb640b6560 0x7fcb640b8a70 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c100d90 tx=0x7fcb7000b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:39.715 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:39.714+0000 7fcb6b7fe640 1 -- 172.21.15.144:0/4005286988 <== mon.1 v2:172.21.15.144:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcb6c0ce470 con 0x7fcb7c102a60 2024-09-21T06:33:39.913 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:39.911+0000 7fcb80ec4640 1 -- 172.21.15.144:0/4005286988 --> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi007=a;smithi007=d;smithi007=g;smithi007=j;smithi018=b;smithi018=e;smithi018=h;smithi018=k;smithi144=c;smithi144=f;smithi144=i;smithi144=l", "target": ["mon-mgr", ""]}) -- 0x7fcb7c06b7a0 con 0x7fcb640b6560 2024-09-21T06:33:39.921 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:39.919+0000 7fcb6b7fe640 1 -- 172.21.15.144:0/4005286988 <== mgr.14223 v2:172.21.15.7:6800/3442812985 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7fcb7c06b7a0 con 0x7fcb640b6560 2024-09-21T06:33:39.921 INFO:teuthology.orchestra.run.smithi144.stdout:Scheduled mds.all update... 2024-09-21T06:33:39.923 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:39.921+0000 7fcb80ec4640 1 -- 172.21.15.144:0/4005286988 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fcb640b6560 msgr2=0x7fcb640b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:39.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:39.921+0000 7fcb80ec4640 1 --2- 172.21.15.144:0/4005286988 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fcb640b6560 0x7fcb640b8a70 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c100d90 tx=0x7fcb7000b390 comp rx=0 tx=0).stop 2024-09-21T06:33:39.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:39.921+0000 7fcb80ec4640 1 -- 172.21.15.144:0/4005286988 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb7c102a60 msgr2=0x7fcb7c19c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:39.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:39.921+0000 7fcb80ec4640 1 --2- 172.21.15.144:0/4005286988 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb7c102a60 0x7fcb7c19c6d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c005940 tx=0x7fcb6c0042f0 comp rx=0 tx=0).stop 2024-09-21T06:33:39.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:39.921+0000 7fcb80ec4640 1 -- 172.21.15.144:0/4005286988 shutdown_connections 2024-09-21T06:33:39.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:39.922+0000 7fcb80ec4640 1 --2- 172.21.15.144:0/4005286988 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fcb640b6560 0x7fcb640b8a70 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:39.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:39.922+0000 7fcb80ec4640 1 --2- 172.21.15.144:0/4005286988 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcb7c108cf0 0x7fcb7c1a1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:39.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:39.922+0000 7fcb80ec4640 1 --2- 172.21.15.144:0/4005286988 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcb7c1083a0 0x7fcb7c19cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:39.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:39.922+0000 7fcb80ec4640 1 --2- 172.21.15.144:0/4005286988 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcb7c102a60 0x7fcb7c19c6d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:39.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:39.922+0000 7fcb80ec4640 1 -- 172.21.15.144:0/4005286988 >> 172.21.15.144:0/4005286988 conn(0x7fcb7c079730 msgr2=0x7fcb7c06af90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:39.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:39.922+0000 7fcb80ec4640 1 -- 172.21.15.144:0/4005286988 shutdown_connections 2024-09-21T06:33:39.924 INFO:teuthology.orchestra.run.smithi144.stderr:2024-09-21T06:33:39.922+0000 7fcb80ec4640 1 -- 172.21.15.144:0/4005286988 wait complete. 2024-09-21T06:33:40.671 DEBUG:teuthology.orchestra.run.smithi007:mds.a> sudo journalctl -f -n 0 -u ceph-347cb918-77e2-11ef-baf5-efdc52797490@mds.a.service 2024-09-21T06:33:40.674 DEBUG:teuthology.orchestra.run.smithi007:mds.d> sudo journalctl -f -n 0 -u ceph-347cb918-77e2-11ef-baf5-efdc52797490@mds.d.service 2024-09-21T06:33:40.720 DEBUG:teuthology.orchestra.run.smithi007:mds.g> sudo journalctl -f -n 0 -u ceph-347cb918-77e2-11ef-baf5-efdc52797490@mds.g.service 2024-09-21T06:33:40.765 DEBUG:teuthology.orchestra.run.smithi007:mds.j> sudo journalctl -f -n 0 -u ceph-347cb918-77e2-11ef-baf5-efdc52797490@mds.j.service 2024-09-21T06:33:40.809 DEBUG:teuthology.orchestra.run.smithi018:mds.b> sudo journalctl -f -n 0 -u ceph-347cb918-77e2-11ef-baf5-efdc52797490@mds.b.service 2024-09-21T06:33:40.812 DEBUG:teuthology.orchestra.run.smithi018:mds.e> sudo journalctl -f -n 0 -u ceph-347cb918-77e2-11ef-baf5-efdc52797490@mds.e.service 2024-09-21T06:33:40.858 DEBUG:teuthology.orchestra.run.smithi018:mds.h> sudo journalctl -f -n 0 -u ceph-347cb918-77e2-11ef-baf5-efdc52797490@mds.h.service 2024-09-21T06:33:40.902 DEBUG:teuthology.orchestra.run.smithi018:mds.k> sudo journalctl -f -n 0 -u ceph-347cb918-77e2-11ef-baf5-efdc52797490@mds.k.service 2024-09-21T06:33:40.946 DEBUG:teuthology.orchestra.run.smithi144:mds.c> sudo journalctl -f -n 0 -u ceph-347cb918-77e2-11ef-baf5-efdc52797490@mds.c.service 2024-09-21T06:33:40.949 DEBUG:teuthology.orchestra.run.smithi144:mds.f> sudo journalctl -f -n 0 -u ceph-347cb918-77e2-11ef-baf5-efdc52797490@mds.f.service 2024-09-21T06:33:40.994 DEBUG:teuthology.orchestra.run.smithi144:mds.i> sudo journalctl -f -n 0 -u ceph-347cb918-77e2-11ef-baf5-efdc52797490@mds.i.service 2024-09-21T06:33:41.040 DEBUG:teuthology.orchestra.run.smithi144:mds.l> sudo journalctl -f -n 0 -u ceph-347cb918-77e2-11ef-baf5-efdc52797490@mds.l.service 2024-09-21T06:33:41.084 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-21T06:33:41.084 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:33:41.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:40 smithi007 ceph-mon[30983]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:33:41.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:40 smithi007 ceph-mon[30983]: from='client.24613 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi007=a;smithi007=d;smithi007=g;smithi007=j;smithi018=b;smithi018=e;smithi018=h;smithi018=k;smithi144=c;smithi144=f;smithi144=i;smithi144=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:33:41.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:40 smithi007 ceph-mon[30983]: Saving service mds.all spec with placement smithi007=a;smithi007=d;smithi007=g;smithi007=j;smithi018=b;smithi018=e;smithi018=h;smithi018=k;smithi144=c;smithi144=f;smithi144=i;smithi144=l;count:12 2024-09-21T06:33:41.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:40 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:41.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:40 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:33:41.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:40 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:33:41.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:40 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:33:41.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:40 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:41.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:40 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:33:41.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:40 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:33:41.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:40 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:33:41.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:40 smithi018 ceph-mon[34477]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:33:41.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:40 smithi018 ceph-mon[34477]: from='client.24613 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi007=a;smithi007=d;smithi007=g;smithi007=j;smithi018=b;smithi018=e;smithi018=h;smithi018=k;smithi144=c;smithi144=f;smithi144=i;smithi144=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:33:41.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:40 smithi018 ceph-mon[34477]: Saving service mds.all spec with placement smithi007=a;smithi007=d;smithi007=g;smithi007=j;smithi018=b;smithi018=e;smithi018=h;smithi018=k;smithi144=c;smithi144=f;smithi144=i;smithi144=l;count:12 2024-09-21T06:33:41.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:40 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:41.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:40 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:33:41.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:40 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:33:41.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:40 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:33:41.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:40 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:41.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:40 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:33:41.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:40 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:33:41.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:40 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:33:41.176 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:40 smithi144 ceph-mon[34653]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:33:41.176 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:40 smithi144 ceph-mon[34653]: from='client.24613 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi007=a;smithi007=d;smithi007=g;smithi007=j;smithi018=b;smithi018=e;smithi018=h;smithi018=k;smithi144=c;smithi144=f;smithi144=i;smithi144=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:33:41.176 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:40 smithi144 ceph-mon[34653]: Saving service mds.all spec with placement smithi007=a;smithi007=d;smithi007=g;smithi007=j;smithi018=b;smithi018=e;smithi018=h;smithi018=k;smithi144=c;smithi144=f;smithi144=i;smithi144=l;count:12 2024-09-21T06:33:41.176 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:40 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:41.176 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:40 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:33:41.176 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:40 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:33:41.176 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:40 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:33:41.176 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:40 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:41.176 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:40 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:33:41.176 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:40 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:33:41.176 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:40 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:33:41.336 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:33:41.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:41.813+0000 7fc53a8d3640 1 -- 172.21.15.7:0/2046297973 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5341083c0 msgr2=0x7fc5341087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:41.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:41.813+0000 7fc53a8d3640 1 --2- 172.21.15.7:0/2046297973 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5341083c0 0x7fc5341087d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc51c009900 tx=0x7fc51c02a410 comp rx=0 tx=0).stop 2024-09-21T06:33:41.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:41.813+0000 7fc53a8d3640 1 -- 172.21.15.7:0/2046297973 shutdown_connections 2024-09-21T06:33:41.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:41.813+0000 7fc53a8d3640 1 --2- 172.21.15.7:0/2046297973 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc534108d10 0x7fc53410f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:41.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:41.813+0000 7fc53a8d3640 1 --2- 172.21.15.7:0/2046297973 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc5341083c0 0x7fc5341087d0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:41.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:41.813+0000 7fc53a8d3640 1 --2- 172.21.15.7:0/2046297973 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc534102a80 0x7fc534102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:41.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:41.813+0000 7fc53a8d3640 1 -- 172.21.15.7:0/2046297973 >> 172.21.15.7:0/2046297973 conn(0x7fc534079740 msgr2=0x7fc534079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:41.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:41.813+0000 7fc53a8d3640 1 -- 172.21.15.7:0/2046297973 shutdown_connections 2024-09-21T06:33:41.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:41.813+0000 7fc53a8d3640 1 -- 172.21.15.7:0/2046297973 wait complete. 2024-09-21T06:33:41.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:41.814+0000 7fc53a8d3640 1 Processor -- start 2024-09-21T06:33:41.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:41.814+0000 7fc53a8d3640 1 -- start start 2024-09-21T06:33:41.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:41.814+0000 7fc53a8d3640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc534102a80 0x7fc53419a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:41.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:41.814+0000 7fc53a8d3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc5341083c0 0x7fc53419aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:41.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:41.814+0000 7fc53a8d3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc534108d10 0x7fc53419fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:41.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:41.814+0000 7fc53a8d3640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc534112980 con 0x7fc534108d10 2024-09-21T06:33:41.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:41.814+0000 7fc53a8d3640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc534112800 con 0x7fc5341083c0 2024-09-21T06:33:41.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:41.814+0000 7fc53a8d3640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc534112b00 con 0x7fc534102a80 2024-09-21T06:33:41.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:41.814+0000 7fc538e70640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc534108d10 0x7fc53419fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:41.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:41.814+0000 7fc538e70640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc534108d10 0x7fc53419fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55136/0 (socket says 172.21.15.7:55136) 2024-09-21T06:33:41.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:41.814+0000 7fc538e70640 1 -- 172.21.15.7:0/3521132696 learned_addr learned my addr 172.21.15.7:0/3521132696 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:33:41.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:41.814+0000 7fc533fff640 1 --2- 172.21.15.7:0/3521132696 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc534102a80 0x7fc53419a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:41.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:41.814+0000 7fc52bfff640 1 --2- 172.21.15.7:0/3521132696 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc5341083c0 0x7fc53419aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:41.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:41.815+0000 7fc538e70640 1 -- 172.21.15.7:0/3521132696 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc534102a80 msgr2=0x7fc53419a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:41.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:41.815+0000 7fc538e70640 1 --2- 172.21.15.7:0/3521132696 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc534102a80 0x7fc53419a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:41.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:41.815+0000 7fc538e70640 1 -- 172.21.15.7:0/3521132696 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc5341083c0 msgr2=0x7fc53419aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:41.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:41.815+0000 7fc538e70640 1 --2- 172.21.15.7:0/3521132696 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc5341083c0 0x7fc53419aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:41.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:41.815+0000 7fc538e70640 1 -- 172.21.15.7:0/3521132696 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5341a03f0 con 0x7fc534108d10 2024-09-21T06:33:41.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:41.815+0000 7fc52bfff640 1 --2- 172.21.15.7:0/3521132696 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc5341083c0 0x7fc53419aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:33:41.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:41.815+0000 7fc538e70640 1 --2- 172.21.15.7:0/3521132696 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc534108d10 0x7fc53419fcc0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc52c00eb10 tx=0x7fc52c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:41.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:41.815+0000 7fc531ffb640 1 -- 172.21.15.7:0/3521132696 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc52c004b20 con 0x7fc534108d10 2024-09-21T06:33:41.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:41.815+0000 7fc531ffb640 1 -- 172.21.15.7:0/3521132696 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc52c004cc0 con 0x7fc534108d10 2024-09-21T06:33:41.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:41.815+0000 7fc53a8d3640 1 -- 172.21.15.7:0/3521132696 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5341a06e0 con 0x7fc534108d10 2024-09-21T06:33:41.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:41.815+0000 7fc531ffb640 1 -- 172.21.15.7:0/3521132696 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc52c010670 con 0x7fc534108d10 2024-09-21T06:33:41.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:41.815+0000 7fc53a8d3640 1 -- 172.21.15.7:0/3521132696 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5341a6e40 con 0x7fc534108d10 2024-09-21T06:33:41.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:41.816+0000 7fc53a8d3640 1 -- 172.21.15.7:0/3521132696 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc534103d00 con 0x7fc534108d10 2024-09-21T06:33:41.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:41.818+0000 7fc531ffb640 1 -- 172.21.15.7:0/3521132696 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 21) ==== 154528+0+0 (secure 0 0 0) 0x7fc52c005000 con 0x7fc534108d10 2024-09-21T06:33:41.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:41.819+0000 7fc531ffb640 1 --2- 172.21.15.7:0/3521132696 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fc5200b6560 0x7fc5200b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:41.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:41.819+0000 7fc533fff640 1 --2- 172.21.15.7:0/3521132696 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fc5200b6560 0x7fc5200b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:41.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:41.819+0000 7fc531ffb640 1 -- 172.21.15.7:0/3521132696 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7fc52c0e7860 con 0x7fc534108d10 2024-09-21T06:33:41.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:41.819+0000 7fc533fff640 1 --2- 172.21.15.7:0/3521132696 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fc5200b6560 0x7fc5200b8a70 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc52400bbe0 tx=0x7fc52400b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:41.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:41.822+0000 7fc531ffb640 1 -- 172.21.15.7:0/3521132696 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc52c056710 con 0x7fc534108d10 2024-09-21T06:33:42.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:42.046+0000 7fc53a8d3640 1 -- 172.21.15.7:0/3521132696 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc534102e90 con 0x7fc534108d10 2024-09-21T06:33:42.048 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:41 smithi007 ceph-mon[30983]: Deploying daemon mds.l on smithi144 2024-09-21T06:33:42.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:42.046+0000 7fc531ffb640 1 -- 172.21.15.7:0/3521132696 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7fc534102e90 con 0x7fc534108d10 2024-09-21T06:33:42.049 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:33:42.049 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":1,"btime":"2024-09-21T06:25:51:924836+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-21T06:33:42.049 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 1 2024-09-21T06:33:42.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:42.049+0000 7fc53a8d3640 1 -- 172.21.15.7:0/3521132696 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fc5200b6560 msgr2=0x7fc5200b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:42.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:42.049+0000 7fc53a8d3640 1 --2- 172.21.15.7:0/3521132696 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fc5200b6560 0x7fc5200b8a70 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc52400bbe0 tx=0x7fc52400b390 comp rx=0 tx=0).stop 2024-09-21T06:33:42.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:42.049+0000 7fc53a8d3640 1 -- 172.21.15.7:0/3521132696 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc534108d10 msgr2=0x7fc53419fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:42.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:42.049+0000 7fc53a8d3640 1 --2- 172.21.15.7:0/3521132696 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc534108d10 0x7fc53419fcc0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc52c00eb10 tx=0x7fc52c00c2d0 comp rx=0 tx=0).stop 2024-09-21T06:33:42.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:42.049+0000 7fc53a8d3640 1 -- 172.21.15.7:0/3521132696 shutdown_connections 2024-09-21T06:33:42.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:42.049+0000 7fc53a8d3640 1 --2- 172.21.15.7:0/3521132696 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fc5200b6560 0x7fc5200b8a70 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:42.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:42.049+0000 7fc53a8d3640 1 --2- 172.21.15.7:0/3521132696 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc534108d10 0x7fc53419fcc0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:42.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:42.049+0000 7fc53a8d3640 1 --2- 172.21.15.7:0/3521132696 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc5341083c0 0x7fc53419aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:42.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:42.049+0000 7fc53a8d3640 1 --2- 172.21.15.7:0/3521132696 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc534102a80 0x7fc53419a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:42.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:42.049+0000 7fc53a8d3640 1 -- 172.21.15.7:0/3521132696 >> 172.21.15.7:0/3521132696 conn(0x7fc534079740 msgr2=0x7fc53406bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:42.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:42.049+0000 7fc53a8d3640 1 -- 172.21.15.7:0/3521132696 shutdown_connections 2024-09-21T06:33:42.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:42.049+0000 7fc53a8d3640 1 -- 172.21.15.7:0/3521132696 wait complete. 2024-09-21T06:33:42.159 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:41 smithi144 ceph-mon[34653]: Deploying daemon mds.l on smithi144 2024-09-21T06:33:42.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:41 smithi018 ceph-mon[34477]: Deploying daemon mds.l on smithi144 2024-09-21T06:33:42.535 INFO:journalctl@ceph.mds.l.smithi144.stdout:Sep 21 06:33:42 smithi144 systemd[1]: Starting Ceph mds.l for 347cb918-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:33:42.823 INFO:journalctl@ceph.mds.l.smithi144.stdout:Sep 21 06:33:42 smithi144 podman[63490]: 2024-09-21 06:33:42.446252783 +0000 UTC m=+0.015638361 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:33:42.823 INFO:journalctl@ceph.mds.l.smithi144.stdout:Sep 21 06:33:42 smithi144 podman[63490]: 2024-09-21 06:33:42.56565957 +0000 UTC m=+0.135045138 container create ba23d0dfafca3c9350ea5c89e33a08a721b54977127d868b24ae24a55f421e1f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-l, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-21T06:33:42.823 INFO:journalctl@ceph.mds.l.smithi144.stdout:Sep 21 06:33:42 smithi144 podman[63490]: 2024-09-21 06:33:42.784962156 +0000 UTC m=+0.354347720 container init ba23d0dfafca3c9350ea5c89e33a08a721b54977127d868b24ae24a55f421e1f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-l, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:33:42.823 INFO:journalctl@ceph.mds.l.smithi144.stdout:Sep 21 06:33:42 smithi144 podman[63490]: 2024-09-21 06:33:42.78763741 +0000 UTC m=+0.357022975 container start ba23d0dfafca3c9350ea5c89e33a08a721b54977127d868b24ae24a55f421e1f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-l, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T06:33:42.823 INFO:journalctl@ceph.mds.l.smithi144.stdout:Sep 21 06:33:42 smithi144 ceph-mds[63509]: -- 172.21.15.144:0/2866220840 <== mon.1 v2:172.21.15.144:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e586c5d860 con 0x55e58ae05600 2024-09-21T06:33:43.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:42 smithi007 ceph-mon[30983]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:33:43.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:42 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/3521132696' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:33:43.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:42 smithi007 ceph-mon[30983]: mds.? [v2:172.21.15.144:6832/2751454345,v1:172.21.15.144:6833/2751454345] up:boot 2024-09-21T06:33:43.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:42 smithi007 ceph-mon[30983]: fsmap 1 up:standby 2024-09-21T06:33:43.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:42 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T06:33:43.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:42 smithi144 ceph-mon[34653]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:33:43.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:42 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/3521132696' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:33:43.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:42 smithi144 ceph-mon[34653]: mds.? [v2:172.21.15.144:6832/2751454345,v1:172.21.15.144:6833/2751454345] up:boot 2024-09-21T06:33:43.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:42 smithi144 ceph-mon[34653]: fsmap 1 up:standby 2024-09-21T06:33:43.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:42 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T06:33:43.286 INFO:journalctl@ceph.mds.l.smithi144.stdout:Sep 21 06:33:42 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-l[63505]: starting mds.l at 2024-09-21T06:33:43.286 INFO:journalctl@ceph.mds.l.smithi144.stdout:Sep 21 06:33:42 smithi144 bash[63490]: ba23d0dfafca3c9350ea5c89e33a08a721b54977127d868b24ae24a55f421e1f 2024-09-21T06:33:43.286 INFO:journalctl@ceph.mds.l.smithi144.stdout:Sep 21 06:33:42 smithi144 systemd[1]: Started Ceph mds.l for 347cb918-77e2-11ef-baf5-efdc52797490. 2024-09-21T06:33:43.359 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:42 smithi018 ceph-mon[34477]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:33:43.359 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:42 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/3521132696' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:33:43.359 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:42 smithi018 ceph-mon[34477]: mds.? [v2:172.21.15.144:6832/2751454345,v1:172.21.15.144:6833/2751454345] up:boot 2024-09-21T06:33:43.359 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:42 smithi018 ceph-mon[34477]: fsmap 1 up:standby 2024-09-21T06:33:43.359 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:42 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T06:33:44.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:43 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:44.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:43 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:44.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:43 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:44.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:43 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:33:44.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:43 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:33:44.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:43 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:33:44.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:43 smithi144 ceph-mon[34653]: Deploying daemon mds.k on smithi018 2024-09-21T06:33:44.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:43 smithi144 ceph-mon[34653]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:33:44.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:43 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:44.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:43 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:44.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:43 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:44.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:43 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:33:44.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:43 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:33:44.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:43 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:33:44.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:43 smithi007 ceph-mon[30983]: Deploying daemon mds.k on smithi018 2024-09-21T06:33:44.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:43 smithi007 ceph-mon[30983]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:33:44.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:43 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:44.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:43 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:44.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:43 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:44.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:43 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:33:44.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:43 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:33:44.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:43 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:33:44.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:43 smithi018 ceph-mon[34477]: Deploying daemon mds.k on smithi018 2024-09-21T06:33:44.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:43 smithi018 ceph-mon[34477]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:33:44.787 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:33:45.056 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:33:45.119 INFO:journalctl@ceph.mds.k.smithi018.stdout:Sep 21 06:33:45 smithi018 systemd[1]: Starting Ceph mds.k for 347cb918-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:33:45.493 INFO:journalctl@ceph.mds.k.smithi018.stdout:Sep 21 06:33:45 smithi018 podman[62508]: 2024-09-21 06:33:45.116045014 +0000 UTC m=+0.016291348 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:33:45.493 INFO:journalctl@ceph.mds.k.smithi018.stdout:Sep 21 06:33:45 smithi018 podman[62508]: 2024-09-21 06:33:45.239587123 +0000 UTC m=+0.139833441 container create 7795c07c94a025b61666446b90f159e420cc4c7dec207eb2032a2c08b6b4a593 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-k, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-21T06:33:45.493 INFO:journalctl@ceph.mds.k.smithi018.stdout:Sep 21 06:33:45 smithi018 podman[62508]: 2024-09-21 06:33:45.49244557 +0000 UTC m=+0.392691897 container init 7795c07c94a025b61666446b90f159e420cc4c7dec207eb2032a2c08b6b4a593 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-k, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T06:33:45.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:45.558+0000 7f933e554640 1 -- 172.21.15.7:0/2234403852 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f93381094c0 msgr2=0x7f93381098d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:45.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:45.558+0000 7f933e554640 1 --2- 172.21.15.7:0/2234403852 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f93381094c0 0x7f93381098d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9320009900 tx=0x7f932002a410 comp rx=0 tx=0).stop 2024-09-21T06:33:45.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:45.558+0000 7f933e554640 1 -- 172.21.15.7:0/2234403852 shutdown_connections 2024-09-21T06:33:45.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:45.558+0000 7f933e554640 1 --2- 172.21.15.7:0/2234403852 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9338109e10 0x7f9338110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:45.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:45.558+0000 7f933e554640 1 --2- 172.21.15.7:0/2234403852 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f93381094c0 0x7f93381098d0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:45.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:45.558+0000 7f933e554640 1 --2- 172.21.15.7:0/2234403852 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9338103b80 0x7f9338103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:45.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:45.558+0000 7f933e554640 1 -- 172.21.15.7:0/2234403852 >> 172.21.15.7:0/2234403852 conn(0x7f93380ff610 msgr2=0x7f9338101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:45.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:45.558+0000 7f933e554640 1 -- 172.21.15.7:0/2234403852 shutdown_connections 2024-09-21T06:33:45.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:45.558+0000 7f933e554640 1 -- 172.21.15.7:0/2234403852 wait complete. 2024-09-21T06:33:45.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:45.559+0000 7f933e554640 1 Processor -- start 2024-09-21T06:33:45.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:45.559+0000 7f933e554640 1 -- start start 2024-09-21T06:33:45.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:45.559+0000 7f933e554640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9338103b80 0x7f933819a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:45.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:45.559+0000 7f933e554640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f93381094c0 0x7f933819aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:45.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:45.559+0000 7f933e554640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9338109e10 0x7f933819fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:45.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:45.559+0000 7f933e554640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9338113ad0 con 0x7f9338103b80 2024-09-21T06:33:45.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:45.559+0000 7f933e554640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9338113950 con 0x7f9338109e10 2024-09-21T06:33:45.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:45.559+0000 7f933e554640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9338113c50 con 0x7f93381094c0 2024-09-21T06:33:45.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:45.560+0000 7f9337fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9338103b80 0x7f933819a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:45.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:45.560+0000 7f9337fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9338103b80 0x7f933819a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55146/0 (socket says 172.21.15.7:55146) 2024-09-21T06:33:45.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:45.560+0000 7f9337fff640 1 -- 172.21.15.7:0/2784311326 learned_addr learned my addr 172.21.15.7:0/2784311326 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:33:45.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:45.560+0000 7f933caf1640 1 --2- 172.21.15.7:0/2784311326 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9338109e10 0x7f933819fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:45.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:45.560+0000 7f932ffff640 1 --2- 172.21.15.7:0/2784311326 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f93381094c0 0x7f933819aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:45.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:45.560+0000 7f9337fff640 1 -- 172.21.15.7:0/2784311326 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f93381094c0 msgr2=0x7f933819aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:45.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:45.560+0000 7f9337fff640 1 --2- 172.21.15.7:0/2784311326 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f93381094c0 0x7f933819aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:45.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:45.560+0000 7f9337fff640 1 -- 172.21.15.7:0/2784311326 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9338109e10 msgr2=0x7f933819fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:45.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:45.560+0000 7f9337fff640 1 --2- 172.21.15.7:0/2784311326 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9338109e10 0x7f933819fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:45.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:45.560+0000 7f9337fff640 1 -- 172.21.15.7:0/2784311326 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93381a0430 con 0x7f9338103b80 2024-09-21T06:33:45.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:45.560+0000 7f9337fff640 1 --2- 172.21.15.7:0/2784311326 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9338103b80 0x7f933819a4c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f932800e9f0 tx=0x7f932800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:45.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:45.560+0000 7f9335ffb640 1 -- 172.21.15.7:0/2784311326 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f932800cd80 con 0x7f9338103b80 2024-09-21T06:33:45.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:45.560+0000 7f933e554640 1 -- 172.21.15.7:0/2784311326 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93381a0720 con 0x7f9338103b80 2024-09-21T06:33:45.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:45.560+0000 7f9335ffb640 1 -- 172.21.15.7:0/2784311326 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f93280108e0 con 0x7f9338103b80 2024-09-21T06:33:45.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:45.560+0000 7f9335ffb640 1 -- 172.21.15.7:0/2784311326 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9328018980 con 0x7f9338103b80 2024-09-21T06:33:45.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:45.560+0000 7f933e554640 1 -- 172.21.15.7:0/2784311326 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93381a6e80 con 0x7f9338103b80 2024-09-21T06:33:45.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:45.561+0000 7f933e554640 1 -- 172.21.15.7:0/2784311326 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9338104e00 con 0x7f9338103b80 2024-09-21T06:33:45.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:45.563+0000 7f9335ffb640 1 -- 172.21.15.7:0/2784311326 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 21) ==== 154528+0+0 (secure 0 0 0) 0x7f9328010430 con 0x7f9338103b80 2024-09-21T06:33:45.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:45.563+0000 7f9335ffb640 1 --2- 172.21.15.7:0/2784311326 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f93240b6560 0x7f93240b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:45.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:45.564+0000 7f932ffff640 1 --2- 172.21.15.7:0/2784311326 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f93240b6560 0x7f93240b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:45.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:45.564+0000 7f9335ffb640 1 -- 172.21.15.7:0/2784311326 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f93280e77e0 con 0x7f9338103b80 2024-09-21T06:33:45.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:45.564+0000 7f932ffff640 1 --2- 172.21.15.7:0/2784311326 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f93240b6560 0x7f93240b8a70 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9320009230 tx=0x7f9320031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:45.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:45.567+0000 7f9335ffb640 1 -- 172.21.15.7:0/2784311326 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f93280ae440 con 0x7f9338103b80 2024-09-21T06:33:45.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:45.801+0000 7f933e554640 1 -- 172.21.15.7:0/2784311326 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9338103f90 con 0x7f9338103b80 2024-09-21T06:33:45.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:45.802+0000 7f9335ffb640 1 -- 172.21.15.7:0/2784311326 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1438 (secure 0 0 0) 0x7f93280b2820 con 0x7f9338103b80 2024-09-21T06:33:45.804 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:33:45.804 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":2,"btime":"2024-09-21T06:33:42:826638+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/2751454345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":2751454345},{"type":"v1","addr":"172.21.15.144:6833","nonce":2751454345}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-21T06:33:45.804 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 2 2024-09-21T06:33:45.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:45.805+0000 7f933e554640 1 -- 172.21.15.7:0/2784311326 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f93240b6560 msgr2=0x7f93240b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:45.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:45.805+0000 7f933e554640 1 --2- 172.21.15.7:0/2784311326 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f93240b6560 0x7f93240b8a70 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9320009230 tx=0x7f9320031400 comp rx=0 tx=0).stop 2024-09-21T06:33:45.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:45.805+0000 7f933e554640 1 -- 172.21.15.7:0/2784311326 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9338103b80 msgr2=0x7f933819a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:45.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:45.805+0000 7f933e554640 1 --2- 172.21.15.7:0/2784311326 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9338103b80 0x7f933819a4c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f932800e9f0 tx=0x7f932800eeb0 comp rx=0 tx=0).stop 2024-09-21T06:33:45.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:45.805+0000 7f933e554640 1 -- 172.21.15.7:0/2784311326 shutdown_connections 2024-09-21T06:33:45.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:45.805+0000 7f933e554640 1 --2- 172.21.15.7:0/2784311326 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f93240b6560 0x7f93240b8a70 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:45.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:45.805+0000 7f933e554640 1 --2- 172.21.15.7:0/2784311326 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9338109e10 0x7f933819fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:45.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:45.805+0000 7f933e554640 1 --2- 172.21.15.7:0/2784311326 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f93381094c0 0x7f933819aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:45.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:45.805+0000 7f933e554640 1 --2- 172.21.15.7:0/2784311326 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9338103b80 0x7f933819a4c0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:45.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:45.805+0000 7f933e554640 1 -- 172.21.15.7:0/2784311326 >> 172.21.15.7:0/2784311326 conn(0x7f93380ff610 msgr2=0x7f9338101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:45.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:45.805+0000 7f933e554640 1 -- 172.21.15.7:0/2784311326 shutdown_connections 2024-09-21T06:33:45.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:45.805+0000 7f933e554640 1 -- 172.21.15.7:0/2784311326 wait complete. 2024-09-21T06:33:45.869 INFO:journalctl@ceph.mds.k.smithi018.stdout:Sep 21 06:33:45 smithi018 podman[62508]: 2024-09-21 06:33:45.495333216 +0000 UTC m=+0.395579542 container start 7795c07c94a025b61666446b90f159e420cc4c7dec207eb2032a2c08b6b4a593 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-k, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-21T06:33:45.869 INFO:journalctl@ceph.mds.k.smithi018.stdout:Sep 21 06:33:45 smithi018 ceph-mds[62526]: -- 172.21.15.18:0/3696406600 <== mon.2 v2:172.21.15.18:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556cda611860 con 0x556cde7b9600 2024-09-21T06:33:45.869 INFO:journalctl@ceph.mds.k.smithi018.stdout:Sep 21 06:33:45 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-k[62522]: starting mds.k at 2024-09-21T06:33:45.869 INFO:journalctl@ceph.mds.k.smithi018.stdout:Sep 21 06:33:45 smithi018 bash[62508]: 7795c07c94a025b61666446b90f159e420cc4c7dec207eb2032a2c08b6b4a593 2024-09-21T06:33:45.869 INFO:journalctl@ceph.mds.k.smithi018.stdout:Sep 21 06:33:45 smithi018 systemd[1]: Started Ceph mds.k for 347cb918-77e2-11ef-baf5-efdc52797490. 2024-09-21T06:33:46.811 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:46 smithi007 ceph-mon[30983]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:33:46.811 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:46 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:46.811 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:46 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:46.811 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:46 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:46.811 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:46 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:33:46.811 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:46 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:33:46.811 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:46 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:33:46.811 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:46 smithi007 ceph-mon[30983]: Deploying daemon mds.j on smithi007 2024-09-21T06:33:46.811 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:46 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2784311326' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:33:46.811 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:46 smithi007 ceph-mon[30983]: mds.? [v2:172.21.15.18:6832/1337382979,v1:172.21.15.18:6833/1337382979] up:boot 2024-09-21T06:33:46.812 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:46 smithi007 ceph-mon[30983]: fsmap 2 up:standby 2024-09-21T06:33:46.812 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:46 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T06:33:46.932 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:46 smithi018 ceph-mon[34477]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:33:46.933 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:46 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:46.933 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:46 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:46.933 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:46 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:46.933 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:46 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:33:46.933 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:46 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:33:46.933 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:46 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:33:46.933 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:46 smithi018 ceph-mon[34477]: Deploying daemon mds.j on smithi007 2024-09-21T06:33:46.933 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:46 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/2784311326' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:33:46.933 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:46 smithi018 ceph-mon[34477]: mds.? [v2:172.21.15.18:6832/1337382979,v1:172.21.15.18:6833/1337382979] up:boot 2024-09-21T06:33:46.933 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:46 smithi018 ceph-mon[34477]: fsmap 2 up:standby 2024-09-21T06:33:46.933 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:46 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T06:33:47.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:46 smithi144 ceph-mon[34653]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:33:47.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:46 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:47.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:46 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:47.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:46 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:47.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:46 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:33:47.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:46 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:33:47.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:46 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:33:47.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:46 smithi144 ceph-mon[34653]: Deploying daemon mds.j on smithi007 2024-09-21T06:33:47.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:46 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/2784311326' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:33:47.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:46 smithi144 ceph-mon[34653]: mds.? [v2:172.21.15.18:6832/1337382979,v1:172.21.15.18:6833/1337382979] up:boot 2024-09-21T06:33:47.036 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:46 smithi144 ceph-mon[34653]: fsmap 2 up:standby 2024-09-21T06:33:47.036 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:46 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T06:33:48.340 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 21 06:33:48 smithi007 systemd[1]: Starting Ceph mds.j for 347cb918-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:33:48.539 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:33:48.729 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:48 smithi007 ceph-mon[30983]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:33:48.729 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 21 06:33:48 smithi007 podman[71583]: 2024-09-21 06:33:48.369876417 +0000 UTC m=+0.016756732 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:33:48.729 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 21 06:33:48 smithi007 podman[71583]: 2024-09-21 06:33:48.483372824 +0000 UTC m=+0.130253122 container create 03424d6687b67a6ecfd31436512328cf89726b833d726080b5dc9e2b51a0c3da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-j, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-21T06:33:48.729 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 21 06:33:48 smithi007 podman[71583]: 2024-09-21 06:33:48.728206758 +0000 UTC m=+0.375087068 container init 03424d6687b67a6ecfd31436512328cf89726b833d726080b5dc9e2b51a0c3da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-j, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731) 2024-09-21T06:33:48.917 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:33:49.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:48 smithi144 ceph-mon[34653]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:33:49.039 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 21 06:33:48 smithi007 podman[71583]: 2024-09-21 06:33:48.73141298 +0000 UTC m=+0.378293279 container start 03424d6687b67a6ecfd31436512328cf89726b833d726080b5dc9e2b51a0c3da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-j, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux ) 2024-09-21T06:33:49.039 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 21 06:33:48 smithi007 ceph-mds[71627]: -- 172.21.15.7:0/4231864555 <== mon.0 v2:172.21.15.7:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d8d1aa9860 con 0x55d8d5c51a80 2024-09-21T06:33:49.039 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 21 06:33:48 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-j[71616]: starting mds.j at 2024-09-21T06:33:49.039 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 21 06:33:48 smithi007 bash[71583]: 03424d6687b67a6ecfd31436512328cf89726b833d726080b5dc9e2b51a0c3da 2024-09-21T06:33:49.040 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 21 06:33:48 smithi007 systemd[1]: Started Ceph mds.j for 347cb918-77e2-11ef-baf5-efdc52797490. 2024-09-21T06:33:49.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:48 smithi018 ceph-mon[34477]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:33:49.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:49.434+0000 7f9f16feb640 1 -- 172.21.15.7:0/3329219240 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f10108cf0 msgr2=0x7f9f1010f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:49.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:49.434+0000 7f9f16feb640 1 --2- 172.21.15.7:0/3329219240 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f10108cf0 0x7f9f1010f520 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9f08009ca0 tx=0x7f9f0802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:33:49.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:49.434+0000 7f9f16feb640 1 -- 172.21.15.7:0/3329219240 shutdown_connections 2024-09-21T06:33:49.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:49.434+0000 7f9f16feb640 1 --2- 172.21.15.7:0/3329219240 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f10108cf0 0x7f9f1010f520 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:49.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:49.434+0000 7f9f16feb640 1 --2- 172.21.15.7:0/3329219240 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f101083a0 0x7f9f101087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:49.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:49.434+0000 7f9f16feb640 1 --2- 172.21.15.7:0/3329219240 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f10102a60 0x7f9f10102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:49.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:49.434+0000 7f9f16feb640 1 -- 172.21.15.7:0/3329219240 >> 172.21.15.7:0/3329219240 conn(0x7f9f10079730 msgr2=0x7f9f10079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:49.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:49.434+0000 7f9f16feb640 1 -- 172.21.15.7:0/3329219240 shutdown_connections 2024-09-21T06:33:49.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:49.434+0000 7f9f16feb640 1 -- 172.21.15.7:0/3329219240 wait complete. 2024-09-21T06:33:49.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:49.435+0000 7f9f16feb640 1 Processor -- start 2024-09-21T06:33:49.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:49.435+0000 7f9f16feb640 1 -- start start 2024-09-21T06:33:49.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:49.435+0000 7f9f16feb640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f10102a60 0x7f9f1010ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:49.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:49.435+0000 7f9f16feb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f101083a0 0x7f9f101104f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:49.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:49.435+0000 7f9f16feb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f10108cf0 0x7f9f10110a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:49.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:49.435+0000 7f9f16feb640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9f10113a80 con 0x7f9f101083a0 2024-09-21T06:33:49.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:49.435+0000 7f9f16feb640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9f10113900 con 0x7f9f10108cf0 2024-09-21T06:33:49.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:49.435+0000 7f9f16feb640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9f10113c00 con 0x7f9f10102a60 2024-09-21T06:33:49.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:49.435+0000 7f9f0ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f101083a0 0x7f9f101104f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:49.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:49.435+0000 7f9f0ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f101083a0 0x7f9f101104f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:55182/0 (socket says 172.21.15.7:55182) 2024-09-21T06:33:49.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:49.435+0000 7f9f0ffff640 1 -- 172.21.15.7:0/352238476 learned_addr learned my addr 172.21.15.7:0/352238476 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:33:49.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:49.435+0000 7f9f14d87640 1 --2- 172.21.15.7:0/352238476 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f10102a60 0x7f9f1010ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:49.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:49.435+0000 7f9f15588640 1 --2- 172.21.15.7:0/352238476 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f10108cf0 0x7f9f10110a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:49.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:49.436+0000 7f9f0ffff640 1 -- 172.21.15.7:0/352238476 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f10102a60 msgr2=0x7f9f1010ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:49.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:49.436+0000 7f9f0ffff640 1 --2- 172.21.15.7:0/352238476 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f10102a60 0x7f9f1010ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:49.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:49.436+0000 7f9f0ffff640 1 -- 172.21.15.7:0/352238476 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f10108cf0 msgr2=0x7f9f10110a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:49.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:49.436+0000 7f9f0ffff640 1 --2- 172.21.15.7:0/352238476 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f10108cf0 0x7f9f10110a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:49.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:49.436+0000 7f9f0ffff640 1 -- 172.21.15.7:0/352238476 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f101a86d0 con 0x7f9f101083a0 2024-09-21T06:33:49.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:49.436+0000 7f9f15588640 1 --2- 172.21.15.7:0/352238476 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f10108cf0 0x7f9f10110a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:33:49.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:49.436+0000 7f9f0ffff640 1 --2- 172.21.15.7:0/352238476 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f101083a0 0x7f9f101104f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9f0400c970 tx=0x7f9f0400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:49.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:49.436+0000 7f9f0dffb640 1 -- 172.21.15.7:0/352238476 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f04007bb0 con 0x7f9f101083a0 2024-09-21T06:33:49.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:49.436+0000 7f9f16feb640 1 -- 172.21.15.7:0/352238476 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f101a89c0 con 0x7f9f101083a0 2024-09-21T06:33:49.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:49.436+0000 7f9f0dffb640 1 -- 172.21.15.7:0/352238476 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9f04007d50 con 0x7f9f101083a0 2024-09-21T06:33:49.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:49.436+0000 7f9f0dffb640 1 -- 172.21.15.7:0/352238476 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f04018730 con 0x7f9f101083a0 2024-09-21T06:33:49.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:49.436+0000 7f9f16feb640 1 -- 172.21.15.7:0/352238476 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f101a8eb0 con 0x7f9f101083a0 2024-09-21T06:33:49.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:49.437+0000 7f9f16feb640 1 -- 172.21.15.7:0/352238476 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f10102e70 con 0x7f9f101083a0 2024-09-21T06:33:49.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:49.439+0000 7f9f0dffb640 1 -- 172.21.15.7:0/352238476 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 21) ==== 154528+0+0 (secure 0 0 0) 0x7f9f0400f990 con 0x7f9f101083a0 2024-09-21T06:33:49.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:49.440+0000 7f9f0dffb640 1 --2- 172.21.15.7:0/352238476 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f9ef80b6560 0x7f9ef80b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:49.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:49.440+0000 7f9f14d87640 1 --2- 172.21.15.7:0/352238476 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f9ef80b6560 0x7f9ef80b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:49.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:49.440+0000 7f9f0dffb640 1 -- 172.21.15.7:0/352238476 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f9f040e7490 con 0x7f9f101083a0 2024-09-21T06:33:49.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:49.440+0000 7f9f14d87640 1 --2- 172.21.15.7:0/352238476 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f9ef80b6560 0x7f9ef80b8a70 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9f10111a00 tx=0x7f9f00005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:49.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:49.443+0000 7f9f0dffb640 1 -- 172.21.15.7:0/352238476 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9f04014030 con 0x7f9f101083a0 2024-09-21T06:33:49.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:49.674+0000 7f9f16feb640 1 -- 172.21.15.7:0/352238476 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9f101112b0 con 0x7f9f101083a0 2024-09-21T06:33:49.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:49.675+0000 7f9f0dffb640 1 -- 172.21.15.7:0/352238476 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2263 (secure 0 0 0) 0x7f9f040ae050 con 0x7f9f101083a0 2024-09-21T06:33:49.677 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:33:49.677 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":3,"btime":"2024-09-21T06:33:46:175728+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24623,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1337382979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1337382979},{"type":"v1","addr":"172.21.15.18:6833","nonce":1337382979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/2751454345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":2751454345},{"type":"v1","addr":"172.21.15.144:6833","nonce":2751454345}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-21T06:33:49.677 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 3 2024-09-21T06:33:49.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:49.677+0000 7f9f16feb640 1 -- 172.21.15.7:0/352238476 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f9ef80b6560 msgr2=0x7f9ef80b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:49.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:49.677+0000 7f9f16feb640 1 --2- 172.21.15.7:0/352238476 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f9ef80b6560 0x7f9ef80b8a70 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9f10111a00 tx=0x7f9f00005f90 comp rx=0 tx=0).stop 2024-09-21T06:33:49.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:49.677+0000 7f9f16feb640 1 -- 172.21.15.7:0/352238476 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f101083a0 msgr2=0x7f9f101104f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:49.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:49.677+0000 7f9f16feb640 1 --2- 172.21.15.7:0/352238476 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f101083a0 0x7f9f101104f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9f0400c970 tx=0x7f9f0400ce30 comp rx=0 tx=0).stop 2024-09-21T06:33:49.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:49.677+0000 7f9f16feb640 1 -- 172.21.15.7:0/352238476 shutdown_connections 2024-09-21T06:33:49.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:49.677+0000 7f9f16feb640 1 --2- 172.21.15.7:0/352238476 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f9ef80b6560 0x7f9ef80b8a70 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:49.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:49.677+0000 7f9f16feb640 1 --2- 172.21.15.7:0/352238476 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f10108cf0 0x7f9f10110a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:49.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:49.677+0000 7f9f16feb640 1 --2- 172.21.15.7:0/352238476 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f101083a0 0x7f9f101104f0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:49.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:49.677+0000 7f9f16feb640 1 --2- 172.21.15.7:0/352238476 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f10102a60 0x7f9f1010ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:49.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:49.677+0000 7f9f16feb640 1 -- 172.21.15.7:0/352238476 >> 172.21.15.7:0/352238476 conn(0x7f9f10079730 msgr2=0x7f9f10105240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:49.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:49.677+0000 7f9f16feb640 1 -- 172.21.15.7:0/352238476 shutdown_connections 2024-09-21T06:33:49.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:49.677+0000 7f9f16feb640 1 -- 172.21.15.7:0/352238476 wait complete. 2024-09-21T06:33:49.971 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:49 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:49.972 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:49 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:49.972 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:49 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:49.972 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:49 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:33:49.972 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:49 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:33:49.972 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:49 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:33:49.972 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:49 smithi007 ceph-mon[30983]: Deploying daemon mds.d on smithi007 2024-09-21T06:33:49.972 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:49 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/352238476' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:33:49.972 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:49 smithi007 ceph-mon[30983]: mds.? [v2:172.21.15.7:6834/2015971546,v1:172.21.15.7:6835/2015971546] up:boot 2024-09-21T06:33:49.972 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:49 smithi007 ceph-mon[30983]: fsmap 3 up:standby 2024-09-21T06:33:49.972 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:49 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-21T06:33:50.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:49 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:50.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:49 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:50.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:49 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:50.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:49 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:33:50.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:49 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:33:50.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:49 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:33:50.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:49 smithi144 ceph-mon[34653]: Deploying daemon mds.d on smithi007 2024-09-21T06:33:50.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:49 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/352238476' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:33:50.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:49 smithi144 ceph-mon[34653]: mds.? [v2:172.21.15.7:6834/2015971546,v1:172.21.15.7:6835/2015971546] up:boot 2024-09-21T06:33:50.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:49 smithi144 ceph-mon[34653]: fsmap 3 up:standby 2024-09-21T06:33:50.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:49 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-21T06:33:50.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:49 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:50.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:49 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:50.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:49 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:50.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:49 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:33:50.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:49 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:33:50.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:49 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:33:50.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:49 smithi018 ceph-mon[34477]: Deploying daemon mds.d on smithi007 2024-09-21T06:33:50.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:49 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/352238476' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:33:50.370 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:49 smithi018 ceph-mon[34477]: mds.? [v2:172.21.15.7:6834/2015971546,v1:172.21.15.7:6835/2015971546] up:boot 2024-09-21T06:33:50.370 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:49 smithi018 ceph-mon[34477]: fsmap 3 up:standby 2024-09-21T06:33:50.370 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:49 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-21T06:33:51.193 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:50 smithi007 ceph-mon[30983]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:33:51.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:50 smithi144 ceph-mon[34653]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:33:51.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:50 smithi018 ceph-mon[34477]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:33:52.340 INFO:journalctl@ceph.mds.d.smithi007.stdout:Sep 21 06:33:52 smithi007 podman[71967]: 2024-09-21 06:33:52.263154687 +0000 UTC m=+0.120432433 container create 6cc42bc4bf22a49d810fdc0154401ec9229bf7c5b4c016cb5ecee3dba09434bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-d, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-21T06:33:52.840 INFO:journalctl@ceph.mds.d.smithi007.stdout:Sep 21 06:33:52 smithi007 podman[71967]: 2024-09-21 06:33:52.491136679 +0000 UTC m=+0.348414433 container init 6cc42bc4bf22a49d810fdc0154401ec9229bf7c5b4c016cb5ecee3dba09434bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-d, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-21T06:33:52.840 INFO:journalctl@ceph.mds.d.smithi007.stdout:Sep 21 06:33:52 smithi007 podman[71967]: 2024-09-21 06:33:52.493971439 +0000 UTC m=+0.351249194 container start 6cc42bc4bf22a49d810fdc0154401ec9229bf7c5b4c016cb5ecee3dba09434bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-d, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-21T06:33:52.840 INFO:journalctl@ceph.mds.d.smithi007.stdout:Sep 21 06:33:52 smithi007 ceph-mds[71986]: -- 172.21.15.7:0/3579887622 <== mon.0 v2:172.21.15.7:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5612067bb860 con 0x56120a963180 2024-09-21T06:33:52.840 INFO:journalctl@ceph.mds.d.smithi007.stdout:Sep 21 06:33:52 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-d[71982]: starting mds.d at 2024-09-21T06:33:52.840 INFO:journalctl@ceph.mds.d.smithi007.stdout:Sep 21 06:33:52 smithi007 bash[71967]: 6cc42bc4bf22a49d810fdc0154401ec9229bf7c5b4c016cb5ecee3dba09434bd 2024-09-21T06:33:52.840 INFO:journalctl@ceph.mds.d.smithi007.stdout:Sep 21 06:33:52 smithi007 systemd[1]: Started Ceph mds.d for 347cb918-77e2-11ef-baf5-efdc52797490. 2024-09-21T06:33:53.057 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:33:53.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:52 smithi144 ceph-mon[34653]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:33:53.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:52 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:53.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:52 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:53.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:52 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:53.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:52 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:33:53.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:52 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:33:53.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:52 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:33:53.286 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:52 smithi018 ceph-mon[34477]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:33:53.286 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:52 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:53.286 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:52 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:53.286 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:52 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:53.286 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:52 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:33:53.287 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:52 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:33:53.287 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:52 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:33:53.321 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:33:53.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:52 smithi007 ceph-mon[30983]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:33:53.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:52 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:53.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:52 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:53.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:52 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:53.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:52 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:33:53.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:52 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:33:53.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:52 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:33:53.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:53.818+0000 7f9561abb640 1 -- 172.21.15.7:0/2870003438 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f955c108cf0 msgr2=0x7f955c10f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:53.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:53.818+0000 7f9561abb640 1 --2- 172.21.15.7:0/2870003438 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f955c108cf0 0x7f955c10f520 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f9554009ca0 tx=0x7f955402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:33:53.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:53.818+0000 7f9561abb640 1 -- 172.21.15.7:0/2870003438 shutdown_connections 2024-09-21T06:33:53.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:53.818+0000 7f9561abb640 1 --2- 172.21.15.7:0/2870003438 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f955c108cf0 0x7f955c10f520 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:53.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:53.818+0000 7f9561abb640 1 --2- 172.21.15.7:0/2870003438 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f955c1083a0 0x7f955c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:53.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:53.818+0000 7f9561abb640 1 --2- 172.21.15.7:0/2870003438 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f955c102a60 0x7f955c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:53.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:53.818+0000 7f9561abb640 1 -- 172.21.15.7:0/2870003438 >> 172.21.15.7:0/2870003438 conn(0x7f955c079730 msgr2=0x7f955c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:53.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:53.818+0000 7f9561abb640 1 -- 172.21.15.7:0/2870003438 shutdown_connections 2024-09-21T06:33:53.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:53.818+0000 7f9561abb640 1 -- 172.21.15.7:0/2870003438 wait complete. 2024-09-21T06:33:53.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:53.819+0000 7f9561abb640 1 Processor -- start 2024-09-21T06:33:53.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:53.819+0000 7f9561abb640 1 -- start start 2024-09-21T06:33:53.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:53.820+0000 7f9561abb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f955c102a60 0x7f955c19b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:53.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:53.820+0000 7f9561abb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f955c1083a0 0x7f955c19b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:53.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:53.820+0000 7f9561abb640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f955c108cf0 0x7f955c19bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:53.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:53.820+0000 7f9561abb640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f955c112960 con 0x7f955c102a60 2024-09-21T06:33:53.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:53.820+0000 7f9561abb640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f955c1127e0 con 0x7f955c1083a0 2024-09-21T06:33:53.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:53.820+0000 7f9561abb640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f955c112ae0 con 0x7f955c108cf0 2024-09-21T06:33:53.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:53.820+0000 7f955b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f955c102a60 0x7f955c19b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:53.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:53.820+0000 7f955b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f955c102a60 0x7f955c19b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33350/0 (socket says 172.21.15.7:33350) 2024-09-21T06:33:53.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:53.820+0000 7f955b7fe640 1 -- 172.21.15.7:0/962978442 learned_addr learned my addr 172.21.15.7:0/962978442 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:33:53.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:53.820+0000 7f9553fff640 1 --2- 172.21.15.7:0/962978442 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f955c1083a0 0x7f955c19b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:53.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:53.820+0000 7f955bfff640 1 --2- 172.21.15.7:0/962978442 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f955c108cf0 0x7f955c19bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:53.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:53.820+0000 7f955b7fe640 1 -- 172.21.15.7:0/962978442 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f955c108cf0 msgr2=0x7f955c19bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:53.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:53.820+0000 7f955b7fe640 1 --2- 172.21.15.7:0/962978442 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f955c108cf0 0x7f955c19bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:53.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:53.820+0000 7f955b7fe640 1 -- 172.21.15.7:0/962978442 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f955c1083a0 msgr2=0x7f955c19b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:53.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:53.820+0000 7f955b7fe640 1 --2- 172.21.15.7:0/962978442 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f955c1083a0 0x7f955c19b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:53.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:53.820+0000 7f955b7fe640 1 -- 172.21.15.7:0/962978442 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f955c1a64b0 con 0x7f955c102a60 2024-09-21T06:33:53.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:53.820+0000 7f955b7fe640 1 --2- 172.21.15.7:0/962978442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f955c102a60 0x7f955c19b1f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f954c00d950 tx=0x7f954c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:53.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:53.820+0000 7f95597fa640 1 -- 172.21.15.7:0/962978442 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f954c017070 con 0x7f955c102a60 2024-09-21T06:33:53.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:53.821+0000 7f95597fa640 1 -- 172.21.15.7:0/962978442 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f954c009c30 con 0x7f955c102a60 2024-09-21T06:33:53.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:53.821+0000 7f9561abb640 1 -- 172.21.15.7:0/962978442 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f955c1a67a0 con 0x7f955c102a60 2024-09-21T06:33:53.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:53.821+0000 7f95597fa640 1 -- 172.21.15.7:0/962978442 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f954c00f620 con 0x7f955c102a60 2024-09-21T06:33:53.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:53.821+0000 7f9561abb640 1 -- 172.21.15.7:0/962978442 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f955c1a6ce0 con 0x7f955c102a60 2024-09-21T06:33:53.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:53.822+0000 7f9561abb640 1 -- 172.21.15.7:0/962978442 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f955c102e70 con 0x7f955c102a60 2024-09-21T06:33:53.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:53.823+0000 7f95597fa640 1 -- 172.21.15.7:0/962978442 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 21) ==== 154528+0+0 (secure 0 0 0) 0x7f954c010460 con 0x7f955c102a60 2024-09-21T06:33:53.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:53.824+0000 7f95597fa640 1 --2- 172.21.15.7:0/962978442 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f95480b6560 0x7f95480b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:53.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:53.824+0000 7f9553fff640 1 --2- 172.21.15.7:0/962978442 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f95480b6560 0x7f95480b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:53.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:53.824+0000 7f95597fa640 1 -- 172.21.15.7:0/962978442 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f954c0e6b00 con 0x7f955c102a60 2024-09-21T06:33:53.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:53.825+0000 7f9553fff640 1 --2- 172.21.15.7:0/962978442 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f95480b6560 0x7f95480b8a70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f955c06a2b0 tx=0x7f954400b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:53.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:53.828+0000 7f95597fa640 1 -- 172.21.15.7:0/962978442 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f954c009de0 con 0x7f955c102a60 2024-09-21T06:33:54.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:54.060+0000 7f9561abb640 1 -- 172.21.15.7:0/962978442 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f955c02e640 con 0x7f955c102a60 2024-09-21T06:33:54.062 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:53 smithi007 ceph-mon[30983]: Deploying daemon mds.e on smithi018 2024-09-21T06:33:54.062 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:53 smithi007 ceph-mon[30983]: mds.? [v2:172.21.15.7:6836/2350816224,v1:172.21.15.7:6837/2350816224] up:boot 2024-09-21T06:33:54.063 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:53 smithi007 ceph-mon[30983]: fsmap 4 up:standby 2024-09-21T06:33:54.063 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:53 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-21T06:33:54.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:54.061+0000 7f95597fa640 1 -- 172.21.15.7:0/962978442 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3907 (secure 0 0 0) 0x7f954c0b1b40 con 0x7f955c102a60 2024-09-21T06:33:54.063 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:33:54.063 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":5,"btime":"2024-09-21T06:33:52:906658+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2015971546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2015971546},{"type":"v1","addr":"172.21.15.7:6835","nonce":2015971546}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/2350816224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":2350816224},{"type":"v1","addr":"172.21.15.7:6837","nonce":2350816224}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24623,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1337382979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1337382979},{"type":"v1","addr":"172.21.15.18:6833","nonce":1337382979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/2751454345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":2751454345},{"type":"v1","addr":"172.21.15.144:6833","nonce":2751454345}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-21T06:33:54.064 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 5 2024-09-21T06:33:54.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:54.064+0000 7f9561abb640 1 -- 172.21.15.7:0/962978442 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f95480b6560 msgr2=0x7f95480b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:54.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:54.064+0000 7f9561abb640 1 --2- 172.21.15.7:0/962978442 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f95480b6560 0x7f95480b8a70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f955c06a2b0 tx=0x7f954400b410 comp rx=0 tx=0).stop 2024-09-21T06:33:54.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:54.064+0000 7f9561abb640 1 -- 172.21.15.7:0/962978442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f955c102a60 msgr2=0x7f955c19b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:54.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:54.064+0000 7f9561abb640 1 --2- 172.21.15.7:0/962978442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f955c102a60 0x7f955c19b1f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f954c00d950 tx=0x7f954c00de10 comp rx=0 tx=0).stop 2024-09-21T06:33:54.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:54.064+0000 7f9561abb640 1 -- 172.21.15.7:0/962978442 shutdown_connections 2024-09-21T06:33:54.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:54.064+0000 7f9561abb640 1 --2- 172.21.15.7:0/962978442 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f95480b6560 0x7f95480b8a70 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:54.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:54.064+0000 7f9561abb640 1 --2- 172.21.15.7:0/962978442 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f955c108cf0 0x7f955c19bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:54.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:54.064+0000 7f9561abb640 1 --2- 172.21.15.7:0/962978442 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f955c1083a0 0x7f955c19b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:54.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:54.064+0000 7f9561abb640 1 --2- 172.21.15.7:0/962978442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f955c102a60 0x7f955c19b1f0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:54.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:54.064+0000 7f9561abb640 1 -- 172.21.15.7:0/962978442 >> 172.21.15.7:0/962978442 conn(0x7f955c079730 msgr2=0x7f955c1043b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:54.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:54.064+0000 7f9561abb640 1 -- 172.21.15.7:0/962978442 shutdown_connections 2024-09-21T06:33:54.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:54.064+0000 7f9561abb640 1 -- 172.21.15.7:0/962978442 wait complete. 2024-09-21T06:33:54.186 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:53 smithi144 ceph-mon[34653]: Deploying daemon mds.e on smithi018 2024-09-21T06:33:54.186 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:53 smithi144 ceph-mon[34653]: mds.? [v2:172.21.15.7:6836/2350816224,v1:172.21.15.7:6837/2350816224] up:boot 2024-09-21T06:33:54.186 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:53 smithi144 ceph-mon[34653]: fsmap 4 up:standby 2024-09-21T06:33:54.187 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:53 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-21T06:33:54.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:53 smithi018 ceph-mon[34477]: Deploying daemon mds.e on smithi018 2024-09-21T06:33:54.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:53 smithi018 ceph-mon[34477]: mds.? [v2:172.21.15.7:6836/2350816224,v1:172.21.15.7:6837/2350816224] up:boot 2024-09-21T06:33:54.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:53 smithi018 ceph-mon[34477]: fsmap 4 up:standby 2024-09-21T06:33:54.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:53 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-21T06:33:54.920 INFO:journalctl@ceph.mds.e.smithi018.stdout:Sep 21 06:33:54 smithi018 systemd[1]: Starting Ceph mds.e for 347cb918-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:33:55.244 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:54 smithi018 ceph-mon[34477]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:33:55.244 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:54 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/962978442' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:33:55.244 INFO:journalctl@ceph.mds.e.smithi018.stdout:Sep 21 06:33:55 smithi018 podman[62789]: 2024-09-21 06:33:54.952468882 +0000 UTC m=+0.016310609 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:33:55.245 INFO:journalctl@ceph.mds.e.smithi018.stdout:Sep 21 06:33:55 smithi018 podman[62789]: 2024-09-21 06:33:55.121122658 +0000 UTC m=+0.184964363 container create aa9eeb36ea325739646f6a56742add88423b7fefdc28941eb45f0a715aef7f99 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-e, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-21T06:33:55.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:54 smithi144 ceph-mon[34653]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:33:55.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:54 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/962978442' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:33:55.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:54 smithi007 ceph-mon[30983]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:33:55.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:54 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/962978442' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:33:55.619 INFO:journalctl@ceph.mds.e.smithi018.stdout:Sep 21 06:33:55 smithi018 podman[62789]: 2024-09-21 06:33:55.365350407 +0000 UTC m=+0.429192113 container init aa9eeb36ea325739646f6a56742add88423b7fefdc28941eb45f0a715aef7f99 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True) 2024-09-21T06:33:55.619 INFO:journalctl@ceph.mds.e.smithi018.stdout:Sep 21 06:33:55 smithi018 podman[62789]: 2024-09-21 06:33:55.368248219 +0000 UTC m=+0.432089934 container start aa9eeb36ea325739646f6a56742add88423b7fefdc28941eb45f0a715aef7f99 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-e, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True) 2024-09-21T06:33:55.619 INFO:journalctl@ceph.mds.e.smithi018.stdout:Sep 21 06:33:55 smithi018 ceph-mds[62809]: -- 172.21.15.18:0/2281965240 <== mon.2 v2:172.21.15.18:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ea6d891c20 con 0x55ea71a39a80 2024-09-21T06:33:55.619 INFO:journalctl@ceph.mds.e.smithi018.stdout:Sep 21 06:33:55 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-e[62805]: starting mds.e at 2024-09-21T06:33:55.619 INFO:journalctl@ceph.mds.e.smithi018.stdout:Sep 21 06:33:55 smithi018 bash[62789]: aa9eeb36ea325739646f6a56742add88423b7fefdc28941eb45f0a715aef7f99 2024-09-21T06:33:55.619 INFO:journalctl@ceph.mds.e.smithi018.stdout:Sep 21 06:33:55 smithi018 systemd[1]: Started Ceph mds.e for 347cb918-77e2-11ef-baf5-efdc52797490. 2024-09-21T06:33:56.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:56 smithi144 ceph-mon[34653]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:33:56.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:56 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:56.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:56 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:56.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:56 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:56.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:56 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:33:56.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:56 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:33:56.786 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:56 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:33:56.786 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:56 smithi144 ceph-mon[34653]: Deploying daemon mds.f on smithi144 2024-09-21T06:33:56.786 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:56 smithi144 ceph-mon[34653]: mds.? [v2:172.21.15.18:6834/158884796,v1:172.21.15.18:6835/158884796] up:boot 2024-09-21T06:33:56.786 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:56 smithi144 ceph-mon[34653]: fsmap 5 up:standby 2024-09-21T06:33:56.786 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:56 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T06:33:56.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:56 smithi007 ceph-mon[30983]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:33:56.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:56 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:56.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:56 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:56.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:56 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:56.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:56 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:33:56.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:56 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:33:56.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:56 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:33:56.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:56 smithi007 ceph-mon[30983]: Deploying daemon mds.f on smithi144 2024-09-21T06:33:56.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:56 smithi007 ceph-mon[30983]: mds.? [v2:172.21.15.18:6834/158884796,v1:172.21.15.18:6835/158884796] up:boot 2024-09-21T06:33:56.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:56 smithi007 ceph-mon[30983]: fsmap 5 up:standby 2024-09-21T06:33:56.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:56 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T06:33:56.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:56 smithi018 ceph-mon[34477]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:33:56.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:56 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:56.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:56 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:56.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:56 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:56.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:56 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:33:56.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:56 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:33:56.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:56 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:33:56.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:56 smithi018 ceph-mon[34477]: Deploying daemon mds.f on smithi144 2024-09-21T06:33:56.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:56 smithi018 ceph-mon[34477]: mds.? [v2:172.21.15.18:6834/158884796,v1:172.21.15.18:6835/158884796] up:boot 2024-09-21T06:33:56.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:56 smithi018 ceph-mon[34477]: fsmap 5 up:standby 2024-09-21T06:33:56.870 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:56 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T06:33:56.871 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:33:57.144 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:33:57.535 INFO:journalctl@ceph.mds.f.smithi144.stdout:Sep 21 06:33:57 smithi144 systemd[1]: Starting Ceph mds.f for 347cb918-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:33:57.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:57.678+0000 7f26040be640 1 -- 172.21.15.7:0/1750026344 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25fc1049c0 msgr2=0x7f25fc104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:57.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:57.678+0000 7f26040be640 1 --2- 172.21.15.7:0/1750026344 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25fc1049c0 0x7f25fc104dd0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f25f8009ca0 tx=0x7f25f802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:33:57.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:57.678+0000 7f26040be640 1 -- 172.21.15.7:0/1750026344 shutdown_connections 2024-09-21T06:33:57.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:57.678+0000 7f26040be640 1 --2- 172.21.15.7:0/1750026344 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25fc10de20 0x7f25fc110310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:57.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:57.678+0000 7f26040be640 1 --2- 172.21.15.7:0/1750026344 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f25fc105310 0x7f25fc10d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:57.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:57.678+0000 7f26040be640 1 --2- 172.21.15.7:0/1750026344 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25fc1049c0 0x7f25fc104dd0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:57.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:57.678+0000 7f26040be640 1 -- 172.21.15.7:0/1750026344 >> 172.21.15.7:0/1750026344 conn(0x7f25fc079710 msgr2=0x7f25fc079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:57.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:57.678+0000 7f26040be640 1 -- 172.21.15.7:0/1750026344 shutdown_connections 2024-09-21T06:33:57.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:57.678+0000 7f26040be640 1 -- 172.21.15.7:0/1750026344 wait complete. 2024-09-21T06:33:57.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:57.679+0000 7f26040be640 1 Processor -- start 2024-09-21T06:33:57.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:57.679+0000 7f26040be640 1 -- start start 2024-09-21T06:33:57.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:57.679+0000 7f26040be640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f25fc1049c0 0x7f25fc102700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:57.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:57.679+0000 7f26040be640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25fc105310 0x7f25fc102c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:57.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:57.679+0000 7f26040be640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25fc10de20 0x7f25fc103180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:57.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:57.679+0000 7f26040be640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f25fc113a80 con 0x7f25fc105310 2024-09-21T06:33:57.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:57.679+0000 7f26040be640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f25fc113900 con 0x7f25fc10de20 2024-09-21T06:33:57.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:57.679+0000 7f26040be640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f25fc113c00 con 0x7f25fc1049c0 2024-09-21T06:33:57.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:57.679+0000 7f2601659640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25fc105310 0x7f25fc102c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:57.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:57.679+0000 7f260265b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25fc10de20 0x7f25fc103180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:57.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:57.679+0000 7f2601659640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25fc105310 0x7f25fc102c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33372/0 (socket says 172.21.15.7:33372) 2024-09-21T06:33:57.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:57.679+0000 7f2601659640 1 -- 172.21.15.7:0/2044109872 learned_addr learned my addr 172.21.15.7:0/2044109872 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:33:57.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:57.679+0000 7f2601e5a640 1 --2- 172.21.15.7:0/2044109872 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f25fc1049c0 0x7f25fc102700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:57.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:57.680+0000 7f260265b640 1 -- 172.21.15.7:0/2044109872 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f25fc1049c0 msgr2=0x7f25fc102700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:57.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:57.680+0000 7f260265b640 1 --2- 172.21.15.7:0/2044109872 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f25fc1049c0 0x7f25fc102700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:57.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:57.680+0000 7f260265b640 1 -- 172.21.15.7:0/2044109872 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25fc105310 msgr2=0x7f25fc102c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:57.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:57.680+0000 7f260265b640 1 --2- 172.21.15.7:0/2044109872 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25fc105310 0x7f25fc102c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:57.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:57.680+0000 7f260265b640 1 -- 172.21.15.7:0/2044109872 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25fc1a8730 con 0x7f25fc10de20 2024-09-21T06:33:57.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:57.680+0000 7f2601659640 1 --2- 172.21.15.7:0/2044109872 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25fc105310 0x7f25fc102c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:33:57.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:57.680+0000 7f260265b640 1 --2- 172.21.15.7:0/2044109872 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25fc10de20 0x7f25fc103180 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f25f400e970 tx=0x7f25f400ee30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:57.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:57.680+0000 7f25f2ffd640 1 -- 172.21.15.7:0/2044109872 <== mon.2 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f400ccc0 con 0x7f25fc10de20 2024-09-21T06:33:57.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:57.680+0000 7f25f2ffd640 1 -- 172.21.15.7:0/2044109872 <== mon.2 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f25f4005020 con 0x7f25fc10de20 2024-09-21T06:33:57.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:57.680+0000 7f26040be640 1 -- 172.21.15.7:0/2044109872 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25fc1a8a20 con 0x7f25fc10de20 2024-09-21T06:33:57.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:57.680+0000 7f25f2ffd640 1 -- 172.21.15.7:0/2044109872 <== mon.2 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f4004a00 con 0x7f25fc10de20 2024-09-21T06:33:57.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:57.680+0000 7f26040be640 1 -- 172.21.15.7:0/2044109872 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25fc1a8f10 con 0x7f25fc10de20 2024-09-21T06:33:57.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:57.681+0000 7f26040be640 1 -- 172.21.15.7:0/2044109872 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25fc06c280 con 0x7f25fc10de20 2024-09-21T06:33:57.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:57.683+0000 7f25f2ffd640 1 -- 172.21.15.7:0/2044109872 <== mon.2 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 21) ==== 154528+0+0 (secure 0 0 0) 0x7f25f4004ba0 con 0x7f25fc10de20 2024-09-21T06:33:57.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:57.683+0000 7f25f2ffd640 1 --2- 172.21.15.7:0/2044109872 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f25e80b6560 0x7f25e80b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:33:57.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:57.683+0000 7f2601e5a640 1 --2- 172.21.15.7:0/2044109872 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f25e80b6560 0x7f25e80b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:33:57.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:57.683+0000 7f25f2ffd640 1 -- 172.21.15.7:0/2044109872 <== mon.2 v2:172.21.15.18:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f25f40e72b0 con 0x7f25fc10de20 2024-09-21T06:33:57.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:57.684+0000 7f2601e5a640 1 --2- 172.21.15.7:0/2044109872 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f25e80b6560 0x7f25e80b8a70 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f25f8005e30 tx=0x7f25f8009360 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:33:57.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:57.686+0000 7f25f2ffd640 1 -- 172.21.15.7:0/2044109872 <== mon.2 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f25f40adef0 con 0x7f25fc10de20 2024-09-21T06:33:57.905 INFO:journalctl@ceph.mds.f.smithi144.stdout:Sep 21 06:33:57 smithi144 podman[63769]: 2024-09-21 06:33:57.622483133 +0000 UTC m=+0.111743804 container create c116017ced5b380085612bc41d3b62c833da89969cf458655e979977573926d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-f, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2) 2024-09-21T06:33:57.905 INFO:journalctl@ceph.mds.f.smithi144.stdout:Sep 21 06:33:57 smithi144 podman[63769]: 2024-09-21 06:33:57.526722355 +0000 UTC m=+0.015982978 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:33:57.905 INFO:journalctl@ceph.mds.f.smithi144.stdout:Sep 21 06:33:57 smithi144 podman[63769]: 2024-09-21 06:33:57.867076295 +0000 UTC m=+0.356336904 container init c116017ced5b380085612bc41d3b62c833da89969cf458655e979977573926d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-f, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T06:33:57.905 INFO:journalctl@ceph.mds.f.smithi144.stdout:Sep 21 06:33:57 smithi144 podman[63769]: 2024-09-21 06:33:57.870047662 +0000 UTC m=+0.359308279 container start c116017ced5b380085612bc41d3b62c833da89969cf458655e979977573926d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-f, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-21T06:33:57.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:57.911+0000 7f26040be640 1 -- 172.21.15.7:0/2044109872 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f25fc104dd0 con 0x7f25fc10de20 2024-09-21T06:33:57.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:57.911+0000 7f25f2ffd640 1 -- 172.21.15.7:0/2044109872 <== mon.2 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4729 (secure 0 0 0) 0x7f25fc104dd0 con 0x7f25fc10de20 2024-09-21T06:33:57.913 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:33:57.914 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":6,"btime":"2024-09-21T06:33:55:919267+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2015971546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2015971546},{"type":"v1","addr":"172.21.15.7:6835","nonce":2015971546}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/2350816224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":2350816224},{"type":"v1","addr":"172.21.15.7:6837","nonce":2350816224}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24623,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1337382979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1337382979},{"type":"v1","addr":"172.21.15.18:6833","nonce":1337382979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/2751454345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":2751454345},{"type":"v1","addr":"172.21.15.144:6833","nonce":2751454345}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24656,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/158884796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":158884796},{"type":"v1","addr":"172.21.15.18:6835","nonce":158884796}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-21T06:33:57.914 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 6 2024-09-21T06:33:57.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:57.914+0000 7f26040be640 1 -- 172.21.15.7:0/2044109872 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f25e80b6560 msgr2=0x7f25e80b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:57.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:57.914+0000 7f26040be640 1 --2- 172.21.15.7:0/2044109872 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f25e80b6560 0x7f25e80b8a70 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f25f8005e30 tx=0x7f25f8009360 comp rx=0 tx=0).stop 2024-09-21T06:33:57.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:57.914+0000 7f26040be640 1 -- 172.21.15.7:0/2044109872 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25fc10de20 msgr2=0x7f25fc103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:33:57.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:57.914+0000 7f26040be640 1 --2- 172.21.15.7:0/2044109872 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25fc10de20 0x7f25fc103180 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f25f400e970 tx=0x7f25f400ee30 comp rx=0 tx=0).stop 2024-09-21T06:33:57.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:57.914+0000 7f26040be640 1 -- 172.21.15.7:0/2044109872 shutdown_connections 2024-09-21T06:33:57.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:57.914+0000 7f26040be640 1 --2- 172.21.15.7:0/2044109872 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f25e80b6560 0x7f25e80b8a70 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:57.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:57.914+0000 7f26040be640 1 --2- 172.21.15.7:0/2044109872 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25fc10de20 0x7f25fc103180 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:57.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:57.914+0000 7f26040be640 1 --2- 172.21.15.7:0/2044109872 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25fc105310 0x7f25fc102c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:57.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:57.914+0000 7f26040be640 1 --2- 172.21.15.7:0/2044109872 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f25fc1049c0 0x7f25fc102700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:33:57.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:57.914+0000 7f26040be640 1 -- 172.21.15.7:0/2044109872 >> 172.21.15.7:0/2044109872 conn(0x7f25fc079710 msgr2=0x7f25fc107940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:33:57.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:57.914+0000 7f26040be640 1 -- 172.21.15.7:0/2044109872 shutdown_connections 2024-09-21T06:33:57.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:33:57.914+0000 7f26040be640 1 -- 172.21.15.7:0/2044109872 wait complete. 2024-09-21T06:33:58.285 INFO:journalctl@ceph.mds.f.smithi144.stdout:Sep 21 06:33:57 smithi144 ceph-mds[63788]: -- 172.21.15.144:0/1790261857 <== mon.1 v2:172.21.15.144:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55bf6627b860 con 0x55bf6a423600 2024-09-21T06:33:58.285 INFO:journalctl@ceph.mds.f.smithi144.stdout:Sep 21 06:33:57 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-f[63784]: starting mds.f at 2024-09-21T06:33:58.285 INFO:journalctl@ceph.mds.f.smithi144.stdout:Sep 21 06:33:57 smithi144 bash[63769]: c116017ced5b380085612bc41d3b62c833da89969cf458655e979977573926d9 2024-09-21T06:33:58.285 INFO:journalctl@ceph.mds.f.smithi144.stdout:Sep 21 06:33:57 smithi144 systemd[1]: Started Ceph mds.f for 347cb918-77e2-11ef-baf5-efdc52797490. 2024-09-21T06:33:58.589 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:58 smithi007 ceph-mon[30983]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:33:58.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:58 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2044109872' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:33:58.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:58 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:58.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:58 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:58.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:58 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:58.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:58 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:33:58.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:58 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:33:58.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:58 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:33:58.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:58 smithi144 ceph-mon[34653]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:33:58.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:58 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/2044109872' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:33:58.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:58 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:58.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:58 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:58.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:58 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:58.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:58 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:33:58.672 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:58 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:33:58.673 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:58 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:33:58.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:58 smithi018 ceph-mon[34477]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:33:58.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:58 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/2044109872' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:33:58.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:58 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:58.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:58 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:58.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:58 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:33:58.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:58 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:33:58.870 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:58 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:33:58.870 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:58 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:33:59.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:59 smithi144 ceph-mon[34653]: Deploying daemon mds.c on smithi144 2024-09-21T06:33:59.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:59 smithi144 ceph-mon[34653]: mds.? [v2:172.21.15.144:6834/3636739922,v1:172.21.15.144:6835/3636739922] up:boot 2024-09-21T06:33:59.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:59 smithi144 ceph-mon[34653]: fsmap 6 up:standby 2024-09-21T06:33:59.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:33:59 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T06:33:59.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:59 smithi007 ceph-mon[30983]: Deploying daemon mds.c on smithi144 2024-09-21T06:33:59.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:59 smithi007 ceph-mon[30983]: mds.? [v2:172.21.15.144:6834/3636739922,v1:172.21.15.144:6835/3636739922] up:boot 2024-09-21T06:33:59.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:59 smithi007 ceph-mon[30983]: fsmap 6 up:standby 2024-09-21T06:33:59.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:33:59 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T06:33:59.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:59 smithi018 ceph-mon[34477]: Deploying daemon mds.c on smithi144 2024-09-21T06:33:59.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:59 smithi018 ceph-mon[34477]: mds.? [v2:172.21.15.144:6834/3636739922,v1:172.21.15.144:6835/3636739922] up:boot 2024-09-21T06:33:59.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:59 smithi018 ceph-mon[34477]: fsmap 6 up:standby 2024-09-21T06:33:59.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:33:59 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T06:34:00.212 INFO:journalctl@ceph.mds.c.smithi144.stdout:Sep 21 06:34:00 smithi144 systemd[1]: Starting Ceph mds.c for 347cb918-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:34:00.463 INFO:journalctl@ceph.mds.c.smithi144.stdout:Sep 21 06:34:00 smithi144 podman[64036]: 2024-09-21 06:34:00.113449026 +0000 UTC m=+0.015923965 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:34:00.463 INFO:journalctl@ceph.mds.c.smithi144.stdout:Sep 21 06:34:00 smithi144 podman[64036]: 2024-09-21 06:34:00.236167264 +0000 UTC m=+0.138642205 container create d7d0d7dcfb66c3236f70f64e8cd4f8cb34bda6482b004a6f22c992f623cafddc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-c, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-21T06:34:00.464 INFO:journalctl@ceph.mds.c.smithi144.stdout:Sep 21 06:34:00 smithi144 podman[64036]: 2024-09-21 06:34:00.459387332 +0000 UTC m=+0.361862276 container init d7d0d7dcfb66c3236f70f64e8cd4f8cb34bda6482b004a6f22c992f623cafddc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-c, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True) 2024-09-21T06:34:00.464 INFO:journalctl@ceph.mds.c.smithi144.stdout:Sep 21 06:34:00 smithi144 podman[64036]: 2024-09-21 06:34:00.462443677 +0000 UTC m=+0.364918616 container start d7d0d7dcfb66c3236f70f64e8cd4f8cb34bda6482b004a6f22c992f623cafddc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-c, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True) 2024-09-21T06:34:00.550 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:34:00.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:00 smithi144 ceph-mon[34653]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:00.785 INFO:journalctl@ceph.mds.c.smithi144.stdout:Sep 21 06:34:00 smithi144 ceph-mds[64055]: -- 172.21.15.144:0/3082735607 <== mon.1 v2:172.21.15.144:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a07d835860 con 0x55a0819dd180 2024-09-21T06:34:00.785 INFO:journalctl@ceph.mds.c.smithi144.stdout:Sep 21 06:34:00 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-c[64051]: starting mds.c at 2024-09-21T06:34:00.785 INFO:journalctl@ceph.mds.c.smithi144.stdout:Sep 21 06:34:00 smithi144 bash[64036]: d7d0d7dcfb66c3236f70f64e8cd4f8cb34bda6482b004a6f22c992f623cafddc 2024-09-21T06:34:00.785 INFO:journalctl@ceph.mds.c.smithi144.stdout:Sep 21 06:34:00 smithi144 systemd[1]: Started Ceph mds.c for 347cb918-77e2-11ef-baf5-efdc52797490. 2024-09-21T06:34:00.820 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:34:00.839 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:00 smithi007 ceph-mon[30983]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:00.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:00 smithi018 ceph-mon[34477]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:01.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:01.279+0000 7f26e5049640 1 -- 172.21.15.7:0/2012797856 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f26e0108d20 msgr2=0x7f26e010f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:01.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:01.279+0000 7f26e5049640 1 --2- 172.21.15.7:0/2012797856 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f26e0108d20 0x7f26e010f550 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f26d8009ca0 tx=0x7f26d802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:34:01.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:01.279+0000 7f26e5049640 1 -- 172.21.15.7:0/2012797856 shutdown_connections 2024-09-21T06:34:01.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:01.279+0000 7f26e5049640 1 --2- 172.21.15.7:0/2012797856 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f26e0108d20 0x7f26e010f550 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:01.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:01.279+0000 7f26e5049640 1 --2- 172.21.15.7:0/2012797856 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26e01083d0 0x7f26e01087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:01.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:01.279+0000 7f26e5049640 1 --2- 172.21.15.7:0/2012797856 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f26e0102ae0 0x7f26e0102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:01.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:01.279+0000 7f26e5049640 1 -- 172.21.15.7:0/2012797856 >> 172.21.15.7:0/2012797856 conn(0x7f26e0079760 msgr2=0x7f26e0079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:01.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:01.279+0000 7f26e5049640 1 -- 172.21.15.7:0/2012797856 shutdown_connections 2024-09-21T06:34:01.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:01.279+0000 7f26e5049640 1 -- 172.21.15.7:0/2012797856 wait complete. 2024-09-21T06:34:01.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:01.280+0000 7f26e5049640 1 Processor -- start 2024-09-21T06:34:01.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:01.280+0000 7f26e5049640 1 -- start start 2024-09-21T06:34:01.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:01.280+0000 7f26e5049640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26e0102ae0 0x7f26e019b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:01.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:01.280+0000 7f26e5049640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f26e01083d0 0x7f26e019b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:01.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:01.280+0000 7f26e5049640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f26e0108d20 0x7f26e019bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:01.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:01.280+0000 7f26e5049640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f26e0112990 con 0x7f26e0108d20 2024-09-21T06:34:01.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:01.280+0000 7f26e5049640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f26e0112810 con 0x7f26e01083d0 2024-09-21T06:34:01.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:01.280+0000 7f26e5049640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f26e0112b10 con 0x7f26e0102ae0 2024-09-21T06:34:01.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:01.280+0000 7f26df59e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f26e0108d20 0x7f26e019bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:01.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:01.280+0000 7f26df59e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f26e0108d20 0x7f26e019bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40000/0 (socket says 172.21.15.7:40000) 2024-09-21T06:34:01.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:01.280+0000 7f26df59e640 1 -- 172.21.15.7:0/1971127114 learned_addr learned my addr 172.21.15.7:0/1971127114 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:34:01.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:01.280+0000 7f26de59c640 1 --2- 172.21.15.7:0/1971127114 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f26e01083d0 0x7f26e019b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:01.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:01.281+0000 7f26ded9d640 1 --2- 172.21.15.7:0/1971127114 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26e0102ae0 0x7f26e019b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:01.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:01.281+0000 7f26df59e640 1 -- 172.21.15.7:0/1971127114 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26e0102ae0 msgr2=0x7f26e019b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:01.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:01.281+0000 7f26df59e640 1 --2- 172.21.15.7:0/1971127114 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26e0102ae0 0x7f26e019b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:01.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:01.281+0000 7f26df59e640 1 -- 172.21.15.7:0/1971127114 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f26e01083d0 msgr2=0x7f26e019b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:01.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:01.281+0000 7f26df59e640 1 --2- 172.21.15.7:0/1971127114 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f26e01083d0 0x7f26e019b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:01.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:01.281+0000 7f26df59e640 1 -- 172.21.15.7:0/1971127114 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26e01a64f0 con 0x7f26e0108d20 2024-09-21T06:34:01.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:01.281+0000 7f26de59c640 1 --2- 172.21.15.7:0/1971127114 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f26e01083d0 0x7f26e019b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:34:01.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:01.281+0000 7f26df59e640 1 --2- 172.21.15.7:0/1971127114 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f26e0108d20 0x7f26e019bce0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f26d8005cc0 tx=0x7f26d802f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:01.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:01.281+0000 7f26c7fff640 1 -- 172.21.15.7:0/1971127114 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26d8003bf0 con 0x7f26e0108d20 2024-09-21T06:34:01.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:01.281+0000 7f26c7fff640 1 -- 172.21.15.7:0/1971127114 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f26d8003d90 con 0x7f26e0108d20 2024-09-21T06:34:01.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:01.281+0000 7f26c7fff640 1 -- 172.21.15.7:0/1971127114 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26d802fbc0 con 0x7f26e0108d20 2024-09-21T06:34:01.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:01.281+0000 7f26e5049640 1 -- 172.21.15.7:0/1971127114 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26e01a6780 con 0x7f26e0108d20 2024-09-21T06:34:01.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:01.281+0000 7f26e5049640 1 -- 172.21.15.7:0/1971127114 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26e01a6cc0 con 0x7f26e0108d20 2024-09-21T06:34:01.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:01.282+0000 7f26e5049640 1 -- 172.21.15.7:0/1971127114 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26e0103d10 con 0x7f26e0108d20 2024-09-21T06:34:01.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:01.284+0000 7f26c7fff640 1 -- 172.21.15.7:0/1971127114 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 21) ==== 154528+0+0 (secure 0 0 0) 0x7f26d802fd60 con 0x7f26e0108d20 2024-09-21T06:34:01.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:01.285+0000 7f26c7fff640 1 --2- 172.21.15.7:0/1971127114 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f26c80b6590 0x7f26c80b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:01.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:01.285+0000 7f26ded9d640 1 --2- 172.21.15.7:0/1971127114 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f26c80b6590 0x7f26c80b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:01.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:01.285+0000 7f26c7fff640 1 -- 172.21.15.7:0/1971127114 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f26d8108380 con 0x7f26e0108d20 2024-09-21T06:34:01.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:01.285+0000 7f26ded9d640 1 --2- 172.21.15.7:0/1971127114 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f26c80b6590 0x7f26c80b8aa0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f26e006c6a0 tx=0x7f26d000b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:01.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:01.288+0000 7f26c7fff640 1 -- 172.21.15.7:0/1971127114 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f26d80cefe0 con 0x7f26e0108d20 2024-09-21T06:34:01.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:01.513+0000 7f26e5049640 1 -- 172.21.15.7:0/1971127114 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f26e0102ef0 con 0x7f26e0108d20 2024-09-21T06:34:01.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:01.514+0000 7f26c7fff640 1 -- 172.21.15.7:0/1971127114 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6385 (secure 0 0 0) 0x7f26d80098b0 con 0x7f26e0108d20 2024-09-21T06:34:01.516 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:34:01.516 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":8,"btime":"2024-09-21T06:34:00:528708+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2015971546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2015971546},{"type":"v1","addr":"172.21.15.7:6835","nonce":2015971546}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/2350816224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":2350816224},{"type":"v1","addr":"172.21.15.7:6837","nonce":2350816224}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24623,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1337382979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1337382979},{"type":"v1","addr":"172.21.15.18:6833","nonce":1337382979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/2751454345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":2751454345},{"type":"v1","addr":"172.21.15.144:6833","nonce":2751454345}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24656,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/158884796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":158884796},{"type":"v1","addr":"172.21.15.18:6835","nonce":158884796}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24667,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3636739922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3636739922},{"type":"v1","addr":"172.21.15.144:6835","nonce":3636739922}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24673,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/1126341753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":1126341753},{"type":"v1","addr":"172.21.15.144:6837","nonce":1126341753}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-21T06:34:01.516 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 8 2024-09-21T06:34:01.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:01.516+0000 7f26e5049640 1 -- 172.21.15.7:0/1971127114 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f26c80b6590 msgr2=0x7f26c80b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:01.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:01.516+0000 7f26e5049640 1 --2- 172.21.15.7:0/1971127114 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f26c80b6590 0x7f26c80b8aa0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f26e006c6a0 tx=0x7f26d000b390 comp rx=0 tx=0).stop 2024-09-21T06:34:01.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:01.516+0000 7f26e5049640 1 -- 172.21.15.7:0/1971127114 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f26e0108d20 msgr2=0x7f26e019bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:01.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:01.516+0000 7f26e5049640 1 --2- 172.21.15.7:0/1971127114 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f26e0108d20 0x7f26e019bce0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f26d8005cc0 tx=0x7f26d802f380 comp rx=0 tx=0).stop 2024-09-21T06:34:01.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:01.516+0000 7f26e5049640 1 -- 172.21.15.7:0/1971127114 shutdown_connections 2024-09-21T06:34:01.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:01.516+0000 7f26e5049640 1 --2- 172.21.15.7:0/1971127114 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f26c80b6590 0x7f26c80b8aa0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:01.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:01.516+0000 7f26e5049640 1 --2- 172.21.15.7:0/1971127114 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f26e0108d20 0x7f26e019bce0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:01.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:01.516+0000 7f26e5049640 1 --2- 172.21.15.7:0/1971127114 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f26e01083d0 0x7f26e019b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:01.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:01.516+0000 7f26e5049640 1 --2- 172.21.15.7:0/1971127114 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f26e0102ae0 0x7f26e019b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:01.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:01.516+0000 7f26e5049640 1 -- 172.21.15.7:0/1971127114 >> 172.21.15.7:0/1971127114 conn(0x7f26e0079760 msgr2=0x7f26e0104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:01.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:01.516+0000 7f26e5049640 1 -- 172.21.15.7:0/1971127114 shutdown_connections 2024-09-21T06:34:01.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:01.517+0000 7f26e5049640 1 -- 172.21.15.7:0/1971127114 wait complete. 2024-09-21T06:34:01.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:01 smithi018 ceph-mon[34477]: mds.? [v2:172.21.15.144:6836/1126341753,v1:172.21.15.144:6837/1126341753] up:boot 2024-09-21T06:34:01.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:01 smithi018 ceph-mon[34477]: fsmap 7 up:standby 2024-09-21T06:34:01.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:01 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T06:34:01.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:01 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:01.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:01 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:01.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:01 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:01.620 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:01 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:34:01.620 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:01 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:34:01.620 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:01 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:34:01.620 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:01 smithi018 ceph-mon[34477]: Deploying daemon mds.h on smithi018 2024-09-21T06:34:01.620 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:01 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/1971127114' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:34:01.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:01 smithi007 ceph-mon[30983]: mds.? [v2:172.21.15.144:6836/1126341753,v1:172.21.15.144:6837/1126341753] up:boot 2024-09-21T06:34:01.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:01 smithi007 ceph-mon[30983]: fsmap 7 up:standby 2024-09-21T06:34:01.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:01 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T06:34:01.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:01 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:01.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:01 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:01.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:01 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:01.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:01 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:34:01.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:01 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:34:01.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:01 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:34:01.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:01 smithi007 ceph-mon[30983]: Deploying daemon mds.h on smithi018 2024-09-21T06:34:01.841 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:01 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/1971127114' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:34:02.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:01 smithi144 ceph-mon[34653]: mds.? [v2:172.21.15.144:6836/1126341753,v1:172.21.15.144:6837/1126341753] up:boot 2024-09-21T06:34:02.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:01 smithi144 ceph-mon[34653]: fsmap 7 up:standby 2024-09-21T06:34:02.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:01 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T06:34:02.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:01 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:02.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:01 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:02.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:01 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:02.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:01 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:34:02.036 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:01 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:34:02.036 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:01 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:34:02.036 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:01 smithi144 ceph-mon[34653]: Deploying daemon mds.h on smithi018 2024-09-21T06:34:02.036 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:01 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/1971127114' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:34:02.868 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:02 smithi018 ceph-mon[34477]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:02.868 INFO:journalctl@ceph.mds.h.smithi018.stdout:Sep 21 06:34:02 smithi018 systemd[1]: Starting Ceph mds.h for 347cb918-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:34:03.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:02 smithi144 ceph-mon[34653]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:03.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:02 smithi007 ceph-mon[30983]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:03.119 INFO:journalctl@ceph.mds.h.smithi018.stdout:Sep 21 06:34:02 smithi018 podman[63064]: 2024-09-21 06:34:02.769468425 +0000 UTC m=+0.015902455 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:34:03.119 INFO:journalctl@ceph.mds.h.smithi018.stdout:Sep 21 06:34:02 smithi018 podman[63064]: 2024-09-21 06:34:02.884883946 +0000 UTC m=+0.131317975 container create 44ffd7432ba8335517b802797696a5215ffee011034cd90d5a65838456492cd0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-h, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-21T06:34:03.619 INFO:journalctl@ceph.mds.h.smithi018.stdout:Sep 21 06:34:03 smithi018 podman[63064]: 2024-09-21 06:34:03.137510064 +0000 UTC m=+0.383944094 container init 44ffd7432ba8335517b802797696a5215ffee011034cd90d5a65838456492cd0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-h, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-21T06:34:03.619 INFO:journalctl@ceph.mds.h.smithi018.stdout:Sep 21 06:34:03 smithi018 podman[63064]: 2024-09-21 06:34:03.1402281 +0000 UTC m=+0.386662127 container start 44ffd7432ba8335517b802797696a5215ffee011034cd90d5a65838456492cd0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-h, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-21T06:34:03.619 INFO:journalctl@ceph.mds.h.smithi018.stdout:Sep 21 06:34:03 smithi018 ceph-mds[63083]: -- 172.21.15.18:0/1454933725 <== mon.2 v2:172.21.15.18:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ccdd77d860 con 0x55cce1925180 2024-09-21T06:34:03.619 INFO:journalctl@ceph.mds.h.smithi018.stdout:Sep 21 06:34:03 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-h[63079]: starting mds.h at 2024-09-21T06:34:03.620 INFO:journalctl@ceph.mds.h.smithi018.stdout:Sep 21 06:34:03 smithi018 bash[63064]: 44ffd7432ba8335517b802797696a5215ffee011034cd90d5a65838456492cd0 2024-09-21T06:34:03.620 INFO:journalctl@ceph.mds.h.smithi018.stdout:Sep 21 06:34:03 smithi018 systemd[1]: Started Ceph mds.h for 347cb918-77e2-11ef-baf5-efdc52797490. 2024-09-21T06:34:04.192 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:34:04.464 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:34:04.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:04 smithi007 ceph-mon[30983]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:04.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:04 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:04.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:04 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:04.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:04 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:04.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:04 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:34:04.585 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:04 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:34:04.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:04 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:34:04.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:04 smithi007 ceph-mon[30983]: Deploying daemon mds.i on smithi144 2024-09-21T06:34:04.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:04 smithi007 ceph-mon[30983]: mds.? [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] up:boot 2024-09-21T06:34:04.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:04 smithi007 ceph-mon[30983]: fsmap 8 up:standby 2024-09-21T06:34:04.586 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:04 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T06:34:04.622 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:04 smithi018 ceph-mon[34477]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:04.622 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:04 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:04.622 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:04 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:04.622 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:04 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:04.622 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:04 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:34:04.622 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:04 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:34:04.622 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:04 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:34:04.622 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:04 smithi018 ceph-mon[34477]: Deploying daemon mds.i on smithi144 2024-09-21T06:34:04.622 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:04 smithi018 ceph-mon[34477]: mds.? [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] up:boot 2024-09-21T06:34:04.622 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:04 smithi018 ceph-mon[34477]: fsmap 8 up:standby 2024-09-21T06:34:04.623 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:04 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T06:34:04.698 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:04 smithi144 ceph-mon[34653]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:04.699 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:04 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:04.699 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:04 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:04.699 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:04 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:04.699 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:04 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:34:04.699 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:04 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:34:04.699 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:04 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:34:04.699 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:04 smithi144 ceph-mon[34653]: Deploying daemon mds.i on smithi144 2024-09-21T06:34:04.699 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:04 smithi144 ceph-mon[34653]: mds.? [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] up:boot 2024-09-21T06:34:04.699 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:04 smithi144 ceph-mon[34653]: fsmap 8 up:standby 2024-09-21T06:34:04.699 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:04 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T06:34:04.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:04.987+0000 7f2e03f95640 1 -- 172.21.15.7:0/2318723794 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2dfc109df0 msgr2=0x7f2dfc110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:04.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:04.987+0000 7f2e03f95640 1 --2- 172.21.15.7:0/2318723794 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2dfc109df0 0x7f2dfc110620 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2df4009ca0 tx=0x7f2df402a8e0 comp rx=0 tx=0).stop 2024-09-21T06:34:04.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:04.987+0000 7f2e03f95640 1 -- 172.21.15.7:0/2318723794 shutdown_connections 2024-09-21T06:34:04.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:04.987+0000 7f2e03f95640 1 --2- 172.21.15.7:0/2318723794 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2dfc109df0 0x7f2dfc110620 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:04.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:04.987+0000 7f2e03f95640 1 --2- 172.21.15.7:0/2318723794 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2dfc1094a0 0x7f2dfc1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:04.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:04.987+0000 7f2e03f95640 1 --2- 172.21.15.7:0/2318723794 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2dfc103b60 0x7f2dfc103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:04.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:04.987+0000 7f2e03f95640 1 -- 172.21.15.7:0/2318723794 >> 172.21.15.7:0/2318723794 conn(0x7f2dfc07b850 msgr2=0x7f2dfc07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:04.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:04.988+0000 7f2e03f95640 1 -- 172.21.15.7:0/2318723794 shutdown_connections 2024-09-21T06:34:04.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:04.988+0000 7f2e03f95640 1 -- 172.21.15.7:0/2318723794 wait complete. 2024-09-21T06:34:04.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:04.988+0000 7f2e03f95640 1 Processor -- start 2024-09-21T06:34:04.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:04.988+0000 7f2e03f95640 1 -- start start 2024-09-21T06:34:04.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:04.989+0000 7f2e03f95640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2dfc103b60 0x7f2dfc19a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:04.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:04.989+0000 7f2e03f95640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2dfc1094a0 0x7f2dfc19aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:04.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:04.989+0000 7f2e03f95640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2dfc109df0 0x7f2dfc19fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:04.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:04.989+0000 7f2e03f95640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2dfc113af0 con 0x7f2dfc1094a0 2024-09-21T06:34:04.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:04.989+0000 7f2e03f95640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2dfc113970 con 0x7f2dfc103b60 2024-09-21T06:34:04.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:04.989+0000 7f2e03f95640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2dfc113c70 con 0x7f2dfc109df0 2024-09-21T06:34:04.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:04.989+0000 7f2e01530640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2dfc1094a0 0x7f2dfc19aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:04.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:04.989+0000 7f2e01530640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2dfc1094a0 0x7f2dfc19aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40016/0 (socket says 172.21.15.7:40016) 2024-09-21T06:34:04.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:04.989+0000 7f2e01530640 1 -- 172.21.15.7:0/386211807 learned_addr learned my addr 172.21.15.7:0/386211807 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:34:04.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:04.989+0000 7f2e02532640 1 --2- 172.21.15.7:0/386211807 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2dfc109df0 0x7f2dfc19fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:04.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:04.989+0000 7f2e01d31640 1 --2- 172.21.15.7:0/386211807 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2dfc103b60 0x7f2dfc19a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:04.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:04.989+0000 7f2e01530640 1 -- 172.21.15.7:0/386211807 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2dfc109df0 msgr2=0x7f2dfc19fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:04.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:04.989+0000 7f2e01530640 1 --2- 172.21.15.7:0/386211807 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2dfc109df0 0x7f2dfc19fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:04.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:04.989+0000 7f2e01530640 1 -- 172.21.15.7:0/386211807 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2dfc103b60 msgr2=0x7f2dfc19a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:04.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:04.989+0000 7f2e01530640 1 --2- 172.21.15.7:0/386211807 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2dfc103b60 0x7f2dfc19a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:04.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:04.989+0000 7f2e01530640 1 -- 172.21.15.7:0/386211807 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dfc1a0410 con 0x7f2dfc1094a0 2024-09-21T06:34:04.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:04.989+0000 7f2e01530640 1 --2- 172.21.15.7:0/386211807 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2dfc1094a0 0x7f2dfc19aa40 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2dec006fd0 tx=0x7f2dec00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:04.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:04.990+0000 7f2df2ffd640 1 -- 172.21.15.7:0/386211807 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dec011830 con 0x7f2dfc1094a0 2024-09-21T06:34:04.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:04.990+0000 7f2df2ffd640 1 -- 172.21.15.7:0/386211807 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2dec016070 con 0x7f2dfc1094a0 2024-09-21T06:34:04.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:04.990+0000 7f2e03f95640 1 -- 172.21.15.7:0/386211807 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2dfc1a0700 con 0x7f2dfc1094a0 2024-09-21T06:34:04.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:04.990+0000 7f2df2ffd640 1 -- 172.21.15.7:0/386211807 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dec010e00 con 0x7f2dfc1094a0 2024-09-21T06:34:04.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:04.990+0000 7f2e03f95640 1 -- 172.21.15.7:0/386211807 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2dfc1a6e60 con 0x7f2dfc1094a0 2024-09-21T06:34:04.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:04.991+0000 7f2e03f95640 1 -- 172.21.15.7:0/386211807 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2dfc103f70 con 0x7f2dfc1094a0 2024-09-21T06:34:04.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:04.992+0000 7f2df2ffd640 1 -- 172.21.15.7:0/386211807 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 21) ==== 154528+0+0 (secure 0 0 0) 0x7f2dec0119d0 con 0x7f2dfc1094a0 2024-09-21T06:34:04.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:04.993+0000 7f2df2ffd640 1 --2- 172.21.15.7:0/386211807 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f2de80b65e0 0x7f2de80b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:04.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:04.993+0000 7f2e01d31640 1 --2- 172.21.15.7:0/386211807 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f2de80b65e0 0x7f2de80b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:04.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:04.993+0000 7f2df2ffd640 1 -- 172.21.15.7:0/386211807 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f2dec0e6ba0 con 0x7f2dfc1094a0 2024-09-21T06:34:04.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:04.994+0000 7f2e01d31640 1 --2- 172.21.15.7:0/386211807 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f2de80b65e0 0x7f2de80b8af0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2df80058c0 tx=0x7f2df800a4c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:04.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:04.997+0000 7f2df2ffd640 1 -- 172.21.15.7:0/386211807 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2dec0ad760 con 0x7f2dfc1094a0 2024-09-21T06:34:05.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:05.223+0000 7f2e03f95640 1 -- 172.21.15.7:0/386211807 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2dfc19b5d0 con 0x7f2dfc1094a0 2024-09-21T06:34:05.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:05.223+0000 7f2df2ffd640 1 -- 172.21.15.7:0/386211807 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7210 (secure 0 0 0) 0x7f2dfc19b5d0 con 0x7f2dfc1094a0 2024-09-21T06:34:05.226 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:34:05.226 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":9,"btime":"2024-09-21T06:34:03:624193+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2015971546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2015971546},{"type":"v1","addr":"172.21.15.7:6835","nonce":2015971546}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/2350816224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":2350816224},{"type":"v1","addr":"172.21.15.7:6837","nonce":2350816224}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24623,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1337382979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1337382979},{"type":"v1","addr":"172.21.15.18:6833","nonce":1337382979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/2751454345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":2751454345},{"type":"v1","addr":"172.21.15.144:6833","nonce":2751454345}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24656,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/158884796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":158884796},{"type":"v1","addr":"172.21.15.18:6835","nonce":158884796}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24667,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3636739922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3636739922},{"type":"v1","addr":"172.21.15.144:6835","nonce":3636739922}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24673,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/1126341753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":1126341753},{"type":"v1","addr":"172.21.15.144:6837","nonce":1126341753}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24686,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/1539670694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1539670694},{"type":"v1","addr":"172.21.15.18:6837","nonce":1539670694}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-21T06:34:05.227 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 9 2024-09-21T06:34:05.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:05.226+0000 7f2e03f95640 1 -- 172.21.15.7:0/386211807 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f2de80b65e0 msgr2=0x7f2de80b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:05.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:05.226+0000 7f2e03f95640 1 --2- 172.21.15.7:0/386211807 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f2de80b65e0 0x7f2de80b8af0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2df80058c0 tx=0x7f2df800a4c0 comp rx=0 tx=0).stop 2024-09-21T06:34:05.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:05.226+0000 7f2e03f95640 1 -- 172.21.15.7:0/386211807 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2dfc1094a0 msgr2=0x7f2dfc19aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:05.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:05.226+0000 7f2e03f95640 1 --2- 172.21.15.7:0/386211807 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2dfc1094a0 0x7f2dfc19aa40 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2dec006fd0 tx=0x7f2dec00b8e0 comp rx=0 tx=0).stop 2024-09-21T06:34:05.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:05.226+0000 7f2e03f95640 1 -- 172.21.15.7:0/386211807 shutdown_connections 2024-09-21T06:34:05.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:05.226+0000 7f2e03f95640 1 --2- 172.21.15.7:0/386211807 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f2de80b65e0 0x7f2de80b8af0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:05.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:05.226+0000 7f2e03f95640 1 --2- 172.21.15.7:0/386211807 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2dfc109df0 0x7f2dfc19fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:05.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:05.226+0000 7f2e03f95640 1 --2- 172.21.15.7:0/386211807 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2dfc1094a0 0x7f2dfc19aa40 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:05.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:05.226+0000 7f2e03f95640 1 --2- 172.21.15.7:0/386211807 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2dfc103b60 0x7f2dfc19a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:05.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:05.226+0000 7f2e03f95640 1 -- 172.21.15.7:0/386211807 >> 172.21.15.7:0/386211807 conn(0x7f2dfc07b850 msgr2=0x7f2dfc1074f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:05.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:05.226+0000 7f2e03f95640 1 -- 172.21.15.7:0/386211807 shutdown_connections 2024-09-21T06:34:05.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:05.226+0000 7f2e03f95640 1 -- 172.21.15.7:0/386211807 wait complete. 2024-09-21T06:34:05.285 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 21 06:34:05 smithi144 systemd[1]: Starting Ceph mds.i for 347cb918-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:34:05.589 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:05 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/386211807' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:34:05.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:05 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/386211807' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:34:05.669 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:05 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/386211807' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:34:05.670 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 21 06:34:05 smithi144 podman[64303]: 2024-09-21 06:34:05.286514515 +0000 UTC m=+0.016494528 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:34:05.670 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 21 06:34:05 smithi144 podman[64303]: 2024-09-21 06:34:05.399349866 +0000 UTC m=+0.129329865 container create d06ca82fd5543c00d57ad9b7f56b57448cb741a89aac035156a09a5a1f7b84a2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-i, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T06:34:05.670 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 21 06:34:05 smithi144 podman[64303]: 2024-09-21 06:34:05.669020575 +0000 UTC m=+0.399000581 container init d06ca82fd5543c00d57ad9b7f56b57448cb741a89aac035156a09a5a1f7b84a2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-i, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=) 2024-09-21T06:34:06.035 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 21 06:34:05 smithi144 podman[64303]: 2024-09-21 06:34:05.6718511 +0000 UTC m=+0.401831100 container start d06ca82fd5543c00d57ad9b7f56b57448cb741a89aac035156a09a5a1f7b84a2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-i, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-21T06:34:06.035 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 21 06:34:05 smithi144 ceph-mds[64322]: -- 172.21.15.144:0/287649814 <== mon.1 v2:172.21.15.144:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5638130b3860 con 0x56381725b180 2024-09-21T06:34:06.035 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 21 06:34:05 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-i[64318]: starting mds.i at 2024-09-21T06:34:06.035 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 21 06:34:05 smithi144 bash[64303]: d06ca82fd5543c00d57ad9b7f56b57448cb741a89aac035156a09a5a1f7b84a2 2024-09-21T06:34:06.035 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 21 06:34:05 smithi144 systemd[1]: Started Ceph mds.i for 347cb918-77e2-11ef-baf5-efdc52797490. 2024-09-21T06:34:07.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:06 smithi007 ceph-mon[30983]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:07.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:06 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:07.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:06 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:07.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:06 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:07.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:06 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:34:07.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:06 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:34:07.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:06 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:34:07.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:06 smithi007 ceph-mon[30983]: Deploying daemon mds.g on smithi007 2024-09-21T06:34:07.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:06 smithi007 ceph-mon[30983]: mds.? [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] up:boot 2024-09-21T06:34:07.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:06 smithi007 ceph-mon[30983]: fsmap 9 up:standby 2024-09-21T06:34:07.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:06 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T06:34:07.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:06 smithi018 ceph-mon[34477]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:07.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:06 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:07.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:06 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:07.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:06 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:07.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:06 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:34:07.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:06 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:34:07.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:06 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:34:07.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:06 smithi018 ceph-mon[34477]: Deploying daemon mds.g on smithi007 2024-09-21T06:34:07.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:06 smithi018 ceph-mon[34477]: mds.? [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] up:boot 2024-09-21T06:34:07.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:06 smithi018 ceph-mon[34477]: fsmap 9 up:standby 2024-09-21T06:34:07.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:06 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T06:34:07.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:06 smithi144 ceph-mon[34653]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:07.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:06 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:07.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:06 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:07.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:06 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:07.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:06 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:34:07.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:06 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:34:07.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:06 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:34:07.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:06 smithi144 ceph-mon[34653]: Deploying daemon mds.g on smithi007 2024-09-21T06:34:07.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:06 smithi144 ceph-mon[34653]: mds.? [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] up:boot 2024-09-21T06:34:07.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:06 smithi144 ceph-mon[34653]: fsmap 9 up:standby 2024-09-21T06:34:07.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:06 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T06:34:07.840 INFO:journalctl@ceph.mds.g.smithi007.stdout:Sep 21 06:34:07 smithi007 systemd[1]: Starting Ceph mds.g for 347cb918-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:34:07.950 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:34:08.274 INFO:journalctl@ceph.mds.g.smithi007.stdout:Sep 21 06:34:07 smithi007 podman[72702]: 2024-09-21 06:34:07.887224143 +0000 UTC m=+0.016522828 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:34:08.274 INFO:journalctl@ceph.mds.g.smithi007.stdout:Sep 21 06:34:08 smithi007 podman[72702]: 2024-09-21 06:34:08.025645904 +0000 UTC m=+0.154944580 container create edf98fb6a6ec235c73f6afde16ba2a82d83916d3a7e980674643bf155a1e247d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-g, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS) 2024-09-21T06:34:08.274 INFO:journalctl@ceph.mds.g.smithi007.stdout:Sep 21 06:34:08 smithi007 podman[72702]: 2024-09-21 06:34:08.272505836 +0000 UTC m=+0.401804519 container init edf98fb6a6ec235c73f6afde16ba2a82d83916d3a7e980674643bf155a1e247d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-g, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T06:34:08.459 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:34:08.583 INFO:journalctl@ceph.mds.g.smithi007.stdout:Sep 21 06:34:08 smithi007 podman[72702]: 2024-09-21 06:34:08.275896674 +0000 UTC m=+0.405195350 container start edf98fb6a6ec235c73f6afde16ba2a82d83916d3a7e980674643bf155a1e247d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-g, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD) 2024-09-21T06:34:08.583 INFO:journalctl@ceph.mds.g.smithi007.stdout:Sep 21 06:34:08 smithi007 ceph-mds[72763]: -- 172.21.15.7:0/1777010133 <== mon.0 v2:172.21.15.7:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b493c29860 con 0x55b497dd1600 2024-09-21T06:34:08.583 INFO:journalctl@ceph.mds.g.smithi007.stdout:Sep 21 06:34:08 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-g[72737]: starting mds.g at 2024-09-21T06:34:08.583 INFO:journalctl@ceph.mds.g.smithi007.stdout:Sep 21 06:34:08 smithi007 bash[72702]: edf98fb6a6ec235c73f6afde16ba2a82d83916d3a7e980674643bf155a1e247d 2024-09-21T06:34:08.583 INFO:journalctl@ceph.mds.g.smithi007.stdout:Sep 21 06:34:08 smithi007 systemd[1]: Started Ceph mds.g for 347cb918-77e2-11ef-baf5-efdc52797490. 2024-09-21T06:34:08.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:08 smithi007 ceph-mon[30983]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:08.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:08 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:08.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:08 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:08.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:08 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:08.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:08 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:34:08.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:08 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:34:08.836 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:08 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:34:08.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:08.927+0000 7f60c9102640 1 -- 172.21.15.7:0/166383110 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60c4102a80 msgr2=0x7f60c4102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:08.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:08.927+0000 7f60c9102640 1 --2- 172.21.15.7:0/166383110 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60c4102a80 0x7f60c4102e90 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f60b4009900 tx=0x7f60b402a410 comp rx=0 tx=0).stop 2024-09-21T06:34:08.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:08.927+0000 7f60c9102640 1 -- 172.21.15.7:0/166383110 shutdown_connections 2024-09-21T06:34:08.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:08.927+0000 7f60c9102640 1 --2- 172.21.15.7:0/166383110 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60c4108d10 0x7f60c410f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:08.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:08.927+0000 7f60c9102640 1 --2- 172.21.15.7:0/166383110 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f60c41083c0 0x7f60c41087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:08.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:08.927+0000 7f60c9102640 1 --2- 172.21.15.7:0/166383110 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60c4102a80 0x7f60c4102e90 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:08.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:08.927+0000 7f60c9102640 1 -- 172.21.15.7:0/166383110 >> 172.21.15.7:0/166383110 conn(0x7f60c4079740 msgr2=0x7f60c4079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:08.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:08.927+0000 7f60c9102640 1 -- 172.21.15.7:0/166383110 shutdown_connections 2024-09-21T06:34:08.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:08.927+0000 7f60c9102640 1 -- 172.21.15.7:0/166383110 wait complete. 2024-09-21T06:34:08.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:08.928+0000 7f60c9102640 1 Processor -- start 2024-09-21T06:34:08.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:08.928+0000 7f60c9102640 1 -- start start 2024-09-21T06:34:08.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:08.928+0000 7f60c9102640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60c4102a80 0x7f60c419a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:08.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:08.928+0000 7f60c9102640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f60c41083c0 0x7f60c419aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:08.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:08.928+0000 7f60c9102640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60c4108d10 0x7f60c419fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:08.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:08.928+0000 7f60c9102640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f60c41129e0 con 0x7f60c4102a80 2024-09-21T06:34:08.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:08.928+0000 7f60c9102640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f60c4112860 con 0x7f60c41083c0 2024-09-21T06:34:08.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:08.928+0000 7f60c9102640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f60c4112b60 con 0x7f60c4108d10 2024-09-21T06:34:08.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:08.928+0000 7f60c2d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60c4102a80 0x7f60c419a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:08.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:08.928+0000 7f60c2d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60c4102a80 0x7f60c419a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40052/0 (socket says 172.21.15.7:40052) 2024-09-21T06:34:08.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:08.928+0000 7f60c2d9d640 1 -- 172.21.15.7:0/3471391140 learned_addr learned my addr 172.21.15.7:0/3471391140 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:34:08.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:08.929+0000 7f60c359e640 1 --2- 172.21.15.7:0/3471391140 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60c4108d10 0x7f60c419fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:08.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:08.929+0000 7f60bbfff640 1 --2- 172.21.15.7:0/3471391140 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f60c41083c0 0x7f60c419aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:08.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:08.929+0000 7f60c2d9d640 1 -- 172.21.15.7:0/3471391140 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60c4108d10 msgr2=0x7f60c419fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:08.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:08.929+0000 7f60c2d9d640 1 --2- 172.21.15.7:0/3471391140 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60c4108d10 0x7f60c419fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:08.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:08.929+0000 7f60c2d9d640 1 -- 172.21.15.7:0/3471391140 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f60c41083c0 msgr2=0x7f60c419aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:08.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:08.929+0000 7f60c2d9d640 1 --2- 172.21.15.7:0/3471391140 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f60c41083c0 0x7f60c419aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:08.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:08.929+0000 7f60c2d9d640 1 -- 172.21.15.7:0/3471391140 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60c41a0470 con 0x7f60c4102a80 2024-09-21T06:34:08.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:08.929+0000 7f60bbfff640 1 --2- 172.21.15.7:0/3471391140 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f60c41083c0 0x7f60c419aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:34:08.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:08.929+0000 7f60c2d9d640 1 --2- 172.21.15.7:0/3471391140 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60c4102a80 0x7f60c419a500 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f60b4005940 tx=0x7f60b40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:08.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:08.929+0000 7f60c0d99640 1 -- 172.21.15.7:0/3471391140 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60b403f030 con 0x7f60c4102a80 2024-09-21T06:34:08.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:08.929+0000 7f60c0d99640 1 -- 172.21.15.7:0/3471391140 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f60b4003cb0 con 0x7f60c4102a80 2024-09-21T06:34:08.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:08.929+0000 7f60c9102640 1 -- 172.21.15.7:0/3471391140 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60c41a0700 con 0x7f60c4102a80 2024-09-21T06:34:08.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:08.929+0000 7f60c0d99640 1 -- 172.21.15.7:0/3471391140 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60b4035070 con 0x7f60c4102a80 2024-09-21T06:34:08.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:08.929+0000 7f60c9102640 1 -- 172.21.15.7:0/3471391140 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60c41a6ec0 con 0x7f60c4102a80 2024-09-21T06:34:08.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:08.930+0000 7f60c9102640 1 -- 172.21.15.7:0/3471391140 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60c4103d00 con 0x7f60c4102a80 2024-09-21T06:34:08.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:08.932+0000 7f60c0d99640 1 -- 172.21.15.7:0/3471391140 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 21) ==== 154528+0+0 (secure 0 0 0) 0x7f60b4042030 con 0x7f60c4102a80 2024-09-21T06:34:08.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:08.933+0000 7f60c0d99640 1 --2- 172.21.15.7:0/3471391140 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f60b00b6560 0x7f60b00b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:08.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:08.933+0000 7f60bbfff640 1 --2- 172.21.15.7:0/3471391140 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f60b00b6560 0x7f60b00b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:08.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:08.933+0000 7f60c0d99640 1 -- 172.21.15.7:0/3471391140 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f60b4107bd0 con 0x7f60c4102a80 2024-09-21T06:34:08.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:08.933+0000 7f60bbfff640 1 --2- 172.21.15.7:0/3471391140 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f60b00b6560 0x7f60b00b8a70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f60c4100c00 tx=0x7f60ac005e50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:08.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:08.936+0000 7f60c0d99640 1 -- 172.21.15.7:0/3471391140 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f60b40ce790 con 0x7f60c4102a80 2024-09-21T06:34:09.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:08 smithi018 ceph-mon[34477]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:09.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:08 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:09.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:08 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:09.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:08 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:09.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:08 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:34:09.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:08 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:34:09.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:08 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:34:09.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:09.174+0000 7f60c9102640 1 -- 172.21.15.7:0/3471391140 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f60c4102e90 con 0x7f60c4102a80 2024-09-21T06:34:09.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:09.175+0000 7f60c0d99640 1 -- 172.21.15.7:0/3471391140 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8863 (secure 0 0 0) 0x7f60b40d2b70 con 0x7f60c4102a80 2024-09-21T06:34:09.177 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:34:09.177 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":11,"btime":"2024-09-21T06:34:08:820839+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2015971546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2015971546},{"type":"v1","addr":"172.21.15.7:6835","nonce":2015971546}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/2350816224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":2350816224},{"type":"v1","addr":"172.21.15.7:6837","nonce":2350816224}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14823,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/1669980572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":1669980572},{"type":"v1","addr":"172.21.15.7:6839","nonce":1669980572}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24623,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1337382979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1337382979},{"type":"v1","addr":"172.21.15.18:6833","nonce":1337382979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/2751454345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":2751454345},{"type":"v1","addr":"172.21.15.144:6833","nonce":2751454345}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24656,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/158884796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":158884796},{"type":"v1","addr":"172.21.15.18:6835","nonce":158884796}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24667,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3636739922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3636739922},{"type":"v1","addr":"172.21.15.144:6835","nonce":3636739922}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24673,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/1126341753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":1126341753},{"type":"v1","addr":"172.21.15.144:6837","nonce":1126341753}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24686,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/1539670694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1539670694},{"type":"v1","addr":"172.21.15.18:6837","nonce":1539670694}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24688,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6839/4027821922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":4027821922},{"type":"v1","addr":"172.21.15.144:6839","nonce":4027821922}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-21T06:34:09.177 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 11 2024-09-21T06:34:09.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:09.177+0000 7f60c9102640 1 -- 172.21.15.7:0/3471391140 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f60b00b6560 msgr2=0x7f60b00b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:09.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:09.177+0000 7f60c9102640 1 --2- 172.21.15.7:0/3471391140 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f60b00b6560 0x7f60b00b8a70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f60c4100c00 tx=0x7f60ac005e50 comp rx=0 tx=0).stop 2024-09-21T06:34:09.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:09.177+0000 7f60c9102640 1 -- 172.21.15.7:0/3471391140 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60c4102a80 msgr2=0x7f60c419a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:09.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:09.177+0000 7f60c9102640 1 --2- 172.21.15.7:0/3471391140 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60c4102a80 0x7f60c419a500 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f60b4005940 tx=0x7f60b40042f0 comp rx=0 tx=0).stop 2024-09-21T06:34:09.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:09.177+0000 7f60c9102640 1 -- 172.21.15.7:0/3471391140 shutdown_connections 2024-09-21T06:34:09.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:09.177+0000 7f60c9102640 1 --2- 172.21.15.7:0/3471391140 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f60b00b6560 0x7f60b00b8a70 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:09.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:09.177+0000 7f60c9102640 1 --2- 172.21.15.7:0/3471391140 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60c4108d10 0x7f60c419fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:09.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:09.177+0000 7f60c9102640 1 --2- 172.21.15.7:0/3471391140 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f60c41083c0 0x7f60c419aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:09.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:09.177+0000 7f60c9102640 1 --2- 172.21.15.7:0/3471391140 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60c4102a80 0x7f60c419a500 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:09.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:09.177+0000 7f60c9102640 1 -- 172.21.15.7:0/3471391140 >> 172.21.15.7:0/3471391140 conn(0x7f60c4079740 msgr2=0x7f60c4101b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:09.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:09.177+0000 7f60c9102640 1 -- 172.21.15.7:0/3471391140 shutdown_connections 2024-09-21T06:34:09.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:09.177+0000 7f60c9102640 1 -- 172.21.15.7:0/3471391140 wait complete. 2024-09-21T06:34:09.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:08 smithi144 ceph-mon[34653]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:09.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:08 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:09.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:08 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:09.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:08 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:09.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:08 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:34:09.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:08 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:34:09.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:08 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:34:09.870 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:09 smithi007 ceph-mon[30983]: Deploying daemon mds.a on smithi007 2024-09-21T06:34:09.870 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:09 smithi007 ceph-mon[30983]: mds.? [v2:172.21.15.7:6838/1669980572,v1:172.21.15.7:6839/1669980572] up:boot 2024-09-21T06:34:09.870 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:09 smithi007 ceph-mon[30983]: fsmap 10 up:standby 2024-09-21T06:34:09.870 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:09 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T06:34:09.870 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:09 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/3471391140' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:34:10.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:09 smithi018 ceph-mon[34477]: Deploying daemon mds.a on smithi007 2024-09-21T06:34:10.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:09 smithi018 ceph-mon[34477]: mds.? [v2:172.21.15.7:6838/1669980572,v1:172.21.15.7:6839/1669980572] up:boot 2024-09-21T06:34:10.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:09 smithi018 ceph-mon[34477]: fsmap 10 up:standby 2024-09-21T06:34:10.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:09 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T06:34:10.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:09 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/3471391140' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:34:10.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:09 smithi144 ceph-mon[34653]: Deploying daemon mds.a on smithi007 2024-09-21T06:34:10.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:09 smithi144 ceph-mon[34653]: mds.? [v2:172.21.15.7:6838/1669980572,v1:172.21.15.7:6839/1669980572] up:boot 2024-09-21T06:34:10.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:09 smithi144 ceph-mon[34653]: fsmap 10 up:standby 2024-09-21T06:34:10.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:09 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T06:34:10.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:09 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/3471391140' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:34:11.059 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:10 smithi007 ceph-mon[30983]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:11.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:10 smithi018 ceph-mon[34477]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:11.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:10 smithi144 ceph-mon[34653]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:11.753 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 21 06:34:11 smithi007 podman[73084]: 2024-09-21 06:34:11.7174712 +0000 UTC m=+0.356792881 container start 5fb8c4bc6f7c75fa773249a9ef7b67fa098a71ad1982e6ee9241b5e0e63eb8c6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-a, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-21T06:34:11.900 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:34:12.090 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 21 06:34:11 smithi007 ceph-mds[73103]: -- 172.21.15.7:0/2256563417 <== mon.0 v2:172.21.15.7:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5584f4861860 con 0x5584f8a09180 2024-09-21T06:34:12.090 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 21 06:34:11 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-a[73099]: starting mds.a at 2024-09-21T06:34:12.090 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 21 06:34:11 smithi007 bash[73084]: 5fb8c4bc6f7c75fa773249a9ef7b67fa098a71ad1982e6ee9241b5e0e63eb8c6 2024-09-21T06:34:12.090 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 21 06:34:11 smithi007 systemd[1]: Started Ceph mds.a for 347cb918-77e2-11ef-baf5-efdc52797490. 2024-09-21T06:34:12.163 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:34:12.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:12.769+0000 7f1a74a77640 1 -- 172.21.15.7:0/249633310 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a7010de10 msgr2=0x7f1a70110320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:12.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:12.769+0000 7f1a74a77640 1 --2- 172.21.15.7:0/249633310 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a7010de10 0x7f1a70110320 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f1a68009ca0 tx=0x7f1a6802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:34:12.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:12.770+0000 7f1a74a77640 1 -- 172.21.15.7:0/249633310 shutdown_connections 2024-09-21T06:34:12.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:12.770+0000 7f1a74a77640 1 --2- 172.21.15.7:0/249633310 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a7010de10 0x7f1a70110320 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:12.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:12.770+0000 7f1a74a77640 1 --2- 172.21.15.7:0/249633310 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a70105290 0x7f1a7010d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:12.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:12.770+0000 7f1a74a77640 1 --2- 172.21.15.7:0/249633310 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a70104860 0x7f1a70104c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:12.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:12.770+0000 7f1a74a77640 1 -- 172.21.15.7:0/249633310 >> 172.21.15.7:0/249633310 conn(0x7f1a70079740 msgr2=0x7f1a70079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:12.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:12.770+0000 7f1a74a77640 1 -- 172.21.15.7:0/249633310 shutdown_connections 2024-09-21T06:34:12.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:12.770+0000 7f1a74a77640 1 -- 172.21.15.7:0/249633310 wait complete. 2024-09-21T06:34:12.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:12.771+0000 7f1a74a77640 1 Processor -- start 2024-09-21T06:34:12.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:12.771+0000 7f1a74a77640 1 -- start start 2024-09-21T06:34:12.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:12.771+0000 7f1a74a77640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a70104860 0x7f1a70102770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:12.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:12.771+0000 7f1a74a77640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a70105290 0x7f1a70102cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:12.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:12.771+0000 7f1a74a77640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a7010de10 0x7f1a701031f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:12.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:12.771+0000 7f1a74a77640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1a70113a90 con 0x7f1a7010de10 2024-09-21T06:34:12.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:12.771+0000 7f1a74a77640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1a70113910 con 0x7f1a70104860 2024-09-21T06:34:12.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:12.771+0000 7f1a74a77640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1a70113c10 con 0x7f1a70105290 2024-09-21T06:34:12.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:12.771+0000 7f1a6ed9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a7010de10 0x7f1a701031f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:12.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:12.771+0000 7f1a6ed9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a7010de10 0x7f1a701031f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51532/0 (socket says 172.21.15.7:51532) 2024-09-21T06:34:12.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:12.771+0000 7f1a6ed9d640 1 -- 172.21.15.7:0/3010747169 learned_addr learned my addr 172.21.15.7:0/3010747169 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:34:12.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:12.771+0000 7f1a6e59c640 1 --2- 172.21.15.7:0/3010747169 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a70104860 0x7f1a70102770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:12.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:12.771+0000 7f1a6dd9b640 1 --2- 172.21.15.7:0/3010747169 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a70105290 0x7f1a70102cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:12.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:12.772+0000 7f1a6ed9d640 1 -- 172.21.15.7:0/3010747169 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a70105290 msgr2=0x7f1a70102cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:12.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:12.772+0000 7f1a6ed9d640 1 --2- 172.21.15.7:0/3010747169 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a70105290 0x7f1a70102cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:12.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:12.772+0000 7f1a6ed9d640 1 -- 172.21.15.7:0/3010747169 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a70104860 msgr2=0x7f1a70102770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:12.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:12.772+0000 7f1a6ed9d640 1 --2- 172.21.15.7:0/3010747169 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a70104860 0x7f1a70102770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:12.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:12.772+0000 7f1a6ed9d640 1 -- 172.21.15.7:0/3010747169 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a701a8780 con 0x7f1a7010de10 2024-09-21T06:34:12.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:12.772+0000 7f1a6e59c640 1 --2- 172.21.15.7:0/3010747169 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a70104860 0x7f1a70102770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:34:12.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:12.772+0000 7f1a6ed9d640 1 --2- 172.21.15.7:0/3010747169 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a7010de10 0x7f1a701031f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1a680098d0 tx=0x7f1a680317b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:12.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:12.772+0000 7f1a5f7fe640 1 -- 172.21.15.7:0/3010747169 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a68003b70 con 0x7f1a7010de10 2024-09-21T06:34:12.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:12.772+0000 7f1a74a77640 1 -- 172.21.15.7:0/3010747169 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a701a8a10 con 0x7f1a7010de10 2024-09-21T06:34:12.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:12.772+0000 7f1a5f7fe640 1 -- 172.21.15.7:0/3010747169 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a68003d10 con 0x7f1a7010de10 2024-09-21T06:34:12.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:12.772+0000 7f1a5f7fe640 1 -- 172.21.15.7:0/3010747169 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a6802fa20 con 0x7f1a7010de10 2024-09-21T06:34:12.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:12.772+0000 7f1a74a77640 1 -- 172.21.15.7:0/3010747169 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a701a8fa0 con 0x7f1a7010de10 2024-09-21T06:34:12.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:12.773+0000 7f1a74a77640 1 -- 172.21.15.7:0/3010747169 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a7006c1e0 con 0x7f1a7010de10 2024-09-21T06:34:12.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:12.776+0000 7f1a5f7fe640 1 -- 172.21.15.7:0/3010747169 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 21) ==== 154528+0+0 (secure 0 0 0) 0x7f1a6802fbc0 con 0x7f1a7010de10 2024-09-21T06:34:12.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:12.776+0000 7f1a5f7fe640 1 --2- 172.21.15.7:0/3010747169 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f1a580b6560 0x7f1a580b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:12.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:12.776+0000 7f1a6e59c640 1 --2- 172.21.15.7:0/3010747169 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f1a580b6560 0x7f1a580b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:12.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:12.776+0000 7f1a5f7fe640 1 -- 172.21.15.7:0/3010747169 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f1a68108440 con 0x7f1a7010de10 2024-09-21T06:34:12.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:12.777+0000 7f1a6e59c640 1 --2- 172.21.15.7:0/3010747169 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f1a580b6560 0x7f1a580b8a70 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1a701041c0 tx=0x7f1a60005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:12.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:12.780+0000 7f1a5f7fe640 1 -- 172.21.15.7:0/3010747169 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1a680cf000 con 0x7f1a7010de10 2024-09-21T06:34:13.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:13.007+0000 7f1a74a77640 1 -- 172.21.15.7:0/3010747169 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1a70104c70 con 0x7f1a7010de10 2024-09-21T06:34:13.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:13.008+0000 7f1a5f7fe640 1 -- 172.21.15.7:0/3010747169 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9686 (secure 0 0 0) 0x7f1a680d33e0 con 0x7f1a7010de10 2024-09-21T06:34:13.010 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:34:13.010 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":12,"btime":"2024-09-21T06:34:11:836426+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2015971546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2015971546},{"type":"v1","addr":"172.21.15.7:6835","nonce":2015971546}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/2350816224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":2350816224},{"type":"v1","addr":"172.21.15.7:6837","nonce":2350816224}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14823,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/1669980572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":1669980572},{"type":"v1","addr":"172.21.15.7:6839","nonce":1669980572}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14835,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/2528308973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":2528308973},{"type":"v1","addr":"172.21.15.7:6841","nonce":2528308973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24623,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1337382979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1337382979},{"type":"v1","addr":"172.21.15.18:6833","nonce":1337382979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/2751454345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":2751454345},{"type":"v1","addr":"172.21.15.144:6833","nonce":2751454345}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24656,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/158884796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":158884796},{"type":"v1","addr":"172.21.15.18:6835","nonce":158884796}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24667,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3636739922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3636739922},{"type":"v1","addr":"172.21.15.144:6835","nonce":3636739922}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24673,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/1126341753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":1126341753},{"type":"v1","addr":"172.21.15.144:6837","nonce":1126341753}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24686,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/1539670694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1539670694},{"type":"v1","addr":"172.21.15.18:6837","nonce":1539670694}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24688,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6839/4027821922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":4027821922},{"type":"v1","addr":"172.21.15.144:6839","nonce":4027821922}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-21T06:34:13.010 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 12 2024-09-21T06:34:13.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:13.010+0000 7f1a74a77640 1 -- 172.21.15.7:0/3010747169 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f1a580b6560 msgr2=0x7f1a580b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:13.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:13.010+0000 7f1a74a77640 1 --2- 172.21.15.7:0/3010747169 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f1a580b6560 0x7f1a580b8a70 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1a701041c0 tx=0x7f1a60005f90 comp rx=0 tx=0).stop 2024-09-21T06:34:13.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:13.010+0000 7f1a74a77640 1 -- 172.21.15.7:0/3010747169 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a7010de10 msgr2=0x7f1a701031f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:13.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:13.010+0000 7f1a74a77640 1 --2- 172.21.15.7:0/3010747169 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a7010de10 0x7f1a701031f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1a680098d0 tx=0x7f1a680317b0 comp rx=0 tx=0).stop 2024-09-21T06:34:13.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:13.010+0000 7f1a74a77640 1 -- 172.21.15.7:0/3010747169 shutdown_connections 2024-09-21T06:34:13.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:13.010+0000 7f1a74a77640 1 --2- 172.21.15.7:0/3010747169 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f1a580b6560 0x7f1a580b8a70 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:13.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:13.010+0000 7f1a74a77640 1 --2- 172.21.15.7:0/3010747169 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a7010de10 0x7f1a701031f0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:13.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:13.010+0000 7f1a74a77640 1 --2- 172.21.15.7:0/3010747169 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a70105290 0x7f1a70102cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:13.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:13.010+0000 7f1a74a77640 1 --2- 172.21.15.7:0/3010747169 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a70104860 0x7f1a70102770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:13.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:13.011+0000 7f1a74a77640 1 -- 172.21.15.7:0/3010747169 >> 172.21.15.7:0/3010747169 conn(0x7f1a70079740 msgr2=0x7f1a700ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:13.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:13.011+0000 7f1a74a77640 1 -- 172.21.15.7:0/3010747169 shutdown_connections 2024-09-21T06:34:13.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:13.011+0000 7f1a74a77640 1 -- 172.21.15.7:0/3010747169 wait complete. 2024-09-21T06:34:13.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:12 smithi018 ceph-mon[34477]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:13.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:12 smithi018 ceph-mon[34477]: mds.? [v2:172.21.15.7:6840/2528308973,v1:172.21.15.7:6841/2528308973] up:boot 2024-09-21T06:34:13.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:12 smithi018 ceph-mon[34477]: fsmap 11 up:standby 2024-09-21T06:34:13.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:12 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T06:34:13.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:12 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:13.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:12 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:13.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:12 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:13.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:12 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:34:13.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:12 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:34:13.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:12 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:34:13.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:12 smithi018 ceph-mon[34477]: Deploying daemon mds.b on smithi018 2024-09-21T06:34:13.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:12 smithi144 ceph-mon[34653]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:13.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:12 smithi144 ceph-mon[34653]: mds.? [v2:172.21.15.7:6840/2528308973,v1:172.21.15.7:6841/2528308973] up:boot 2024-09-21T06:34:13.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:12 smithi144 ceph-mon[34653]: fsmap 11 up:standby 2024-09-21T06:34:13.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:12 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T06:34:13.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:12 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:13.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:12 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:13.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:12 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:13.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:12 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:34:13.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:12 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:34:13.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:12 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:34:13.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:12 smithi144 ceph-mon[34653]: Deploying daemon mds.b on smithi018 2024-09-21T06:34:13.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:12 smithi007 ceph-mon[30983]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:13.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:12 smithi007 ceph-mon[30983]: mds.? [v2:172.21.15.7:6840/2528308973,v1:172.21.15.7:6841/2528308973] up:boot 2024-09-21T06:34:13.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:12 smithi007 ceph-mon[30983]: fsmap 11 up:standby 2024-09-21T06:34:13.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:12 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T06:34:13.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:12 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:13.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:12 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:13.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:12 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:13.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:12 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T06:34:13.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:12 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T06:34:13.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:12 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:34:13.341 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:12 smithi007 ceph-mon[30983]: Deploying daemon mds.b on smithi018 2024-09-21T06:34:14.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:13 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/3010747169' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:34:14.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:13 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/3010747169' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:34:14.119 INFO:journalctl@ceph.mds.b.smithi018.stdout:Sep 21 06:34:13 smithi018 systemd[1]: Starting Ceph mds.b for 347cb918-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:34:14.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:13 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/3010747169' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:34:14.410 INFO:journalctl@ceph.mds.b.smithi018.stdout:Sep 21 06:34:14 smithi018 podman[63330]: 2024-09-21 06:34:14.033243961 +0000 UTC m=+0.016456146 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:34:14.410 INFO:journalctl@ceph.mds.b.smithi018.stdout:Sep 21 06:34:14 smithi018 podman[63330]: 2024-09-21 06:34:14.164954334 +0000 UTC m=+0.148166507 container create 3e5a1fe678c9785df320f37835685f4377cda6a21561883b46c3045f7b65bb4e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-b, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:34:14.411 INFO:journalctl@ceph.mds.b.smithi018.stdout:Sep 21 06:34:14 smithi018 podman[63330]: 2024-09-21 06:34:14.409552647 +0000 UTC m=+0.392764821 container init 3e5a1fe678c9785df320f37835685f4377cda6a21561883b46c3045f7b65bb4e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-b, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=) 2024-09-21T06:34:14.852 INFO:journalctl@ceph.mds.b.smithi018.stdout:Sep 21 06:34:14 smithi018 podman[63330]: 2024-09-21 06:34:14.412350587 +0000 UTC m=+0.395562756 container start 3e5a1fe678c9785df320f37835685f4377cda6a21561883b46c3045f7b65bb4e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-b, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-21T06:34:14.852 INFO:journalctl@ceph.mds.b.smithi018.stdout:Sep 21 06:34:14 smithi018 ceph-mds[63349]: -- 172.21.15.18:0/148019552 <== mon.2 v2:172.21.15.18:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5632bde9b860 con 0x5632c2043180 2024-09-21T06:34:14.852 INFO:journalctl@ceph.mds.b.smithi018.stdout:Sep 21 06:34:14 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-b[63345]: starting mds.b at 2024-09-21T06:34:14.852 INFO:journalctl@ceph.mds.b.smithi018.stdout:Sep 21 06:34:14 smithi018 bash[63330]: 3e5a1fe678c9785df320f37835685f4377cda6a21561883b46c3045f7b65bb4e 2024-09-21T06:34:14.852 INFO:journalctl@ceph.mds.b.smithi018.stdout:Sep 21 06:34:14 smithi018 systemd[1]: Started Ceph mds.b for 347cb918-77e2-11ef-baf5-efdc52797490. 2024-09-21T06:34:15.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:14 smithi018 ceph-mon[34477]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:15.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:14 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:15.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:14 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:15.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:14 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:15.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:14 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:15.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:14 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:15.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:14 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:34:15.225 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:14 smithi144 ceph-mon[34653]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:15.225 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:14 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:15.225 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:14 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:15.225 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:14 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:15.225 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:14 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:15.226 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:14 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:15.226 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:14 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:34:15.229 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:14 smithi007 ceph-mon[30983]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:15.230 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:14 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:15.230 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:14 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:15.230 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:14 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:15.230 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:14 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:15.230 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:14 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:15.230 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:14 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:34:15.716 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:34:15.993 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:34:16.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:15 smithi007 ceph-mon[30983]: mds.? [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] up:boot 2024-09-21T06:34:16.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:15 smithi007 ceph-mon[30983]: fsmap 12 up:standby 2024-09-21T06:34:16.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:15 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T06:34:16.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:15 smithi018 ceph-mon[34477]: mds.? [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] up:boot 2024-09-21T06:34:16.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:15 smithi018 ceph-mon[34477]: fsmap 12 up:standby 2024-09-21T06:34:16.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:15 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T06:34:16.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:15 smithi144 ceph-mon[34653]: mds.? [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] up:boot 2024-09-21T06:34:16.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:15 smithi144 ceph-mon[34653]: fsmap 12 up:standby 2024-09-21T06:34:16.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:15 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T06:34:16.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:16.486+0000 7f4038490640 1 -- 172.21.15.7:0/328302517 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40301094c0 msgr2=0x7f40301098d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:16.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:16.486+0000 7f4038490640 1 --2- 172.21.15.7:0/328302517 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40301094c0 0x7f40301098d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4020009860 tx=0x7f402002a340 comp rx=0 tx=0).stop 2024-09-21T06:34:16.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:16.486+0000 7f4038490640 1 -- 172.21.15.7:0/328302517 shutdown_connections 2024-09-21T06:34:16.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:16.486+0000 7f4038490640 1 --2- 172.21.15.7:0/328302517 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4030109e10 0x7f4030110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:16.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:16.486+0000 7f4038490640 1 --2- 172.21.15.7:0/328302517 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40301094c0 0x7f40301098d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:16.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:16.486+0000 7f4038490640 1 --2- 172.21.15.7:0/328302517 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4030103b80 0x7f4030103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:16.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:16.486+0000 7f4038490640 1 -- 172.21.15.7:0/328302517 >> 172.21.15.7:0/328302517 conn(0x7f40300ff610 msgr2=0x7f4030101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:16.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:16.486+0000 7f4038490640 1 -- 172.21.15.7:0/328302517 shutdown_connections 2024-09-21T06:34:16.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:16.486+0000 7f4038490640 1 -- 172.21.15.7:0/328302517 wait complete. 2024-09-21T06:34:16.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:16.487+0000 7f4038490640 1 Processor -- start 2024-09-21T06:34:16.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:16.487+0000 7f4038490640 1 -- start start 2024-09-21T06:34:16.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:16.487+0000 7f4038490640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4030103b80 0x7f4030075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:16.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:16.487+0000 7f4038490640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f40301094c0 0x7f4030075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:16.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:16.487+0000 7f4038490640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4030109e10 0x7f4030076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:16.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:16.487+0000 7f4038490640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4030113ad0 con 0x7f40301094c0 2024-09-21T06:34:16.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:16.487+0000 7f4038490640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4030113950 con 0x7f4030103b80 2024-09-21T06:34:16.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:16.487+0000 7f4038490640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4030113c50 con 0x7f4030109e10 2024-09-21T06:34:16.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:16.487+0000 7f403622c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4030103b80 0x7f4030075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:16.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:16.487+0000 7f4035a2b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f40301094c0 0x7f4030075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:16.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:16.487+0000 7f403622c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4030103b80 0x7f4030075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.7:53342/0 (socket says 172.21.15.7:53342) 2024-09-21T06:34:16.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:16.487+0000 7f403622c640 1 -- 172.21.15.7:0/3343097028 learned_addr learned my addr 172.21.15.7:0/3343097028 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:34:16.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:16.487+0000 7f4036a2d640 1 --2- 172.21.15.7:0/3343097028 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4030109e10 0x7f4030076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:16.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:16.488+0000 7f403622c640 1 -- 172.21.15.7:0/3343097028 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4030109e10 msgr2=0x7f4030076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:16.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:16.488+0000 7f403622c640 1 --2- 172.21.15.7:0/3343097028 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4030109e10 0x7f4030076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:16.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:16.488+0000 7f403622c640 1 -- 172.21.15.7:0/3343097028 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f40301094c0 msgr2=0x7f4030075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:16.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:16.488+0000 7f403622c640 1 --2- 172.21.15.7:0/3343097028 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f40301094c0 0x7f4030075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:16.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:16.488+0000 7f403622c640 1 -- 172.21.15.7:0/3343097028 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40301a8740 con 0x7f4030103b80 2024-09-21T06:34:16.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:16.488+0000 7f4036a2d640 1 --2- 172.21.15.7:0/3343097028 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4030109e10 0x7f4030076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:34:16.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:16.488+0000 7f403622c640 1 --2- 172.21.15.7:0/3343097028 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4030103b80 0x7f4030075710 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f402c00e9c0 tx=0x7f402c00ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:16.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:16.488+0000 7f40277fe640 1 -- 172.21.15.7:0/3343097028 <== mon.2 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f402c00cde0 con 0x7f4030103b80 2024-09-21T06:34:16.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:16.488+0000 7f4038490640 1 -- 172.21.15.7:0/3343097028 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40301a8a30 con 0x7f4030103b80 2024-09-21T06:34:16.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:16.488+0000 7f40277fe640 1 -- 172.21.15.7:0/3343097028 <== mon.2 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f402c0035f0 con 0x7f4030103b80 2024-09-21T06:34:16.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:16.488+0000 7f40277fe640 1 -- 172.21.15.7:0/3343097028 <== mon.2 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f402c010690 con 0x7f4030103b80 2024-09-21T06:34:16.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:16.488+0000 7f4038490640 1 -- 172.21.15.7:0/3343097028 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40301a8f40 con 0x7f4030103b80 2024-09-21T06:34:16.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:16.489+0000 7f4038490640 1 -- 172.21.15.7:0/3343097028 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4030104e00 con 0x7f4030103b80 2024-09-21T06:34:16.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:16.491+0000 7f40277fe640 1 -- 172.21.15.7:0/3343097028 <== mon.2 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 21) ==== 154528+0+0 (secure 0 0 0) 0x7f402c004000 con 0x7f4030103b80 2024-09-21T06:34:16.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:16.492+0000 7f40277fe640 1 --2- 172.21.15.7:0/3343097028 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f401c0b65e0 0x7f401c0b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:16.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:16.492+0000 7f4035a2b640 1 --2- 172.21.15.7:0/3343097028 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f401c0b65e0 0x7f401c0b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:16.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:16.492+0000 7f40277fe640 1 -- 172.21.15.7:0/3343097028 <== mon.2 v2:172.21.15.18:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f402c0e77d0 con 0x7f4030103b80 2024-09-21T06:34:16.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:16.492+0000 7f4035a2b640 1 --2- 172.21.15.7:0/3343097028 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f401c0b65e0 0x7f401c0b8af0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4020005940 tx=0x7f40200058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:16.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:16.499+0000 7f40277fe640 1 -- 172.21.15.7:0/3343097028 <== mon.2 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f402c0ae390 con 0x7f4030103b80 2024-09-21T06:34:16.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:16.736+0000 7f4038490640 1 -- 172.21.15.7:0/3343097028 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4030103f90 con 0x7f4030103b80 2024-09-21T06:34:16.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:16.737+0000 7f40277fe640 1 -- 172.21.15.7:0/3343097028 <== mon.2 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10512 (secure 0 0 0) 0x7f4030103f90 con 0x7f4030103b80 2024-09-21T06:34:16.739 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:34:16.739 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":13,"btime":"2024-09-21T06:34:14:850014+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2015971546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2015971546},{"type":"v1","addr":"172.21.15.7:6835","nonce":2015971546}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/2350816224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":2350816224},{"type":"v1","addr":"172.21.15.7:6837","nonce":2350816224}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14823,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/1669980572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":1669980572},{"type":"v1","addr":"172.21.15.7:6839","nonce":1669980572}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14835,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/2528308973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":2528308973},{"type":"v1","addr":"172.21.15.7:6841","nonce":2528308973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24623,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1337382979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1337382979},{"type":"v1","addr":"172.21.15.18:6833","nonce":1337382979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/2751454345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":2751454345},{"type":"v1","addr":"172.21.15.144:6833","nonce":2751454345}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24656,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/158884796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":158884796},{"type":"v1","addr":"172.21.15.18:6835","nonce":158884796}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24667,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6835/3636739922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3636739922},{"type":"v1","addr":"172.21.15.144:6835","nonce":3636739922}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24673,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6837/1126341753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":1126341753},{"type":"v1","addr":"172.21.15.144:6837","nonce":1126341753}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24686,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6837/1539670694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1539670694},{"type":"v1","addr":"172.21.15.18:6837","nonce":1539670694}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24688,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6839/4027821922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":4027821922},{"type":"v1","addr":"172.21.15.144:6839","nonce":4027821922}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24716,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6839/3798713532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":3798713532},{"type":"v1","addr":"172.21.15.18:6839","nonce":3798713532}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-09-21T06:34:16.740 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 13 2024-09-21T06:34:16.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:16.740+0000 7f4038490640 1 -- 172.21.15.7:0/3343097028 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f401c0b65e0 msgr2=0x7f401c0b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:16.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:16.740+0000 7f4038490640 1 --2- 172.21.15.7:0/3343097028 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f401c0b65e0 0x7f401c0b8af0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4020005940 tx=0x7f40200058d0 comp rx=0 tx=0).stop 2024-09-21T06:34:16.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:16.740+0000 7f4038490640 1 -- 172.21.15.7:0/3343097028 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4030103b80 msgr2=0x7f4030075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:16.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:16.740+0000 7f4038490640 1 --2- 172.21.15.7:0/3343097028 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4030103b80 0x7f4030075710 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f402c00e9c0 tx=0x7f402c00ee80 comp rx=0 tx=0).stop 2024-09-21T06:34:16.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:16.740+0000 7f4038490640 1 -- 172.21.15.7:0/3343097028 shutdown_connections 2024-09-21T06:34:16.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:16.740+0000 7f4038490640 1 --2- 172.21.15.7:0/3343097028 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f401c0b65e0 0x7f401c0b8af0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:16.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:16.740+0000 7f4038490640 1 --2- 172.21.15.7:0/3343097028 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4030109e10 0x7f4030076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:16.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:16.740+0000 7f4038490640 1 --2- 172.21.15.7:0/3343097028 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f40301094c0 0x7f4030075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:16.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:16.740+0000 7f4038490640 1 --2- 172.21.15.7:0/3343097028 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4030103b80 0x7f4030075710 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:16.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:16.740+0000 7f4038490640 1 -- 172.21.15.7:0/3343097028 >> 172.21.15.7:0/3343097028 conn(0x7f40300ff610 msgr2=0x7f4030108b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:16.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:16.740+0000 7f4038490640 1 -- 172.21.15.7:0/3343097028 shutdown_connections 2024-09-21T06:34:16.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:16.740+0000 7f4038490640 1 -- 172.21.15.7:0/3343097028 wait complete. 2024-09-21T06:34:17.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:16 smithi007 ceph-mon[30983]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:17.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:16 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:17.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:16 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:17.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:16 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:17.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:16 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:17.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:16 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:17.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:16 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:17.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:16 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:34:17.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:16 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:34:17.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:16 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:17.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:16 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:34:17.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:16 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/3343097028' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:34:17.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:16 smithi018 ceph-mon[34477]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:17.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:16 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:17.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:16 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:17.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:16 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:17.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:16 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:17.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:16 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:17.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:16 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:17.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:16 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:34:17.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:16 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:34:17.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:16 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:17.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:16 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:34:17.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:16 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/3343097028' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:34:17.186 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:16 smithi144 ceph-mon[34653]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:17.186 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:16 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:17.186 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:16 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:17.186 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:16 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:17.186 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:16 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:17.186 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:16 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:17.186 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:16 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:17.186 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:16 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:34:17.186 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:16 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:34:17.186 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:16 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:17.186 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:16 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:34:17.186 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:16 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/3343097028' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:34:17.752 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph --format=json-pretty osd lspools 2024-09-21T06:34:18.129 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:34:18.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:18.659+0000 7f85ad39a640 1 -- 172.21.15.7:0/3332186321 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f85a81094c0 msgr2=0x7f85a81098d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:18.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:18.659+0000 7f85ad39a640 1 --2- 172.21.15.7:0/3332186321 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f85a81094c0 0x7f85a81098d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8590009900 tx=0x7f859002a410 comp rx=0 tx=0).stop 2024-09-21T06:34:18.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:18.659+0000 7f85ad39a640 1 -- 172.21.15.7:0/3332186321 shutdown_connections 2024-09-21T06:34:18.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:18.659+0000 7f85ad39a640 1 --2- 172.21.15.7:0/3332186321 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f85a8109e10 0x7f85a8110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:18.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:18.659+0000 7f85ad39a640 1 --2- 172.21.15.7:0/3332186321 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f85a81094c0 0x7f85a81098d0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:18.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:18.659+0000 7f85ad39a640 1 --2- 172.21.15.7:0/3332186321 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f85a8103b80 0x7f85a8103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:18.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:18.659+0000 7f85ad39a640 1 -- 172.21.15.7:0/3332186321 >> 172.21.15.7:0/3332186321 conn(0x7f85a80ff610 msgr2=0x7f85a8101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:18.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:18.660+0000 7f85ad39a640 1 -- 172.21.15.7:0/3332186321 shutdown_connections 2024-09-21T06:34:18.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:18.660+0000 7f85ad39a640 1 -- 172.21.15.7:0/3332186321 wait complete. 2024-09-21T06:34:18.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:18.660+0000 7f85ad39a640 1 Processor -- start 2024-09-21T06:34:18.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:18.661+0000 7f85ad39a640 1 -- start start 2024-09-21T06:34:18.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:18.661+0000 7f85ad39a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f85a8103b80 0x7f85a819a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:18.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:18.661+0000 7f85ad39a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f85a81094c0 0x7f85a819aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:18.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:18.661+0000 7f85ad39a640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f85a8109e10 0x7f85a819fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:18.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:18.661+0000 7f85ad39a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f85a8113ad0 con 0x7f85a8103b80 2024-09-21T06:34:18.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:18.661+0000 7f85ad39a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f85a8113950 con 0x7f85a81094c0 2024-09-21T06:34:18.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:18.661+0000 7f85ad39a640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f85a8113c50 con 0x7f85a8109e10 2024-09-21T06:34:18.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:18.661+0000 7f85a6ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f85a8103b80 0x7f85a819a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:18.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:18.661+0000 7f85a6ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f85a8103b80 0x7f85a819a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51568/0 (socket says 172.21.15.7:51568) 2024-09-21T06:34:18.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:18.661+0000 7f85a6ffd640 1 -- 172.21.15.7:0/112569063 learned_addr learned my addr 172.21.15.7:0/112569063 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:34:18.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:18.661+0000 7f85a67fc640 1 --2- 172.21.15.7:0/112569063 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f85a81094c0 0x7f85a819aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:18.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:18.661+0000 7f85a77fe640 1 --2- 172.21.15.7:0/112569063 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f85a8109e10 0x7f85a819fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:18.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:18.662+0000 7f85a6ffd640 1 -- 172.21.15.7:0/112569063 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f85a8109e10 msgr2=0x7f85a819fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:18.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:18.662+0000 7f85a6ffd640 1 --2- 172.21.15.7:0/112569063 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f85a8109e10 0x7f85a819fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:18.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:18.662+0000 7f85a6ffd640 1 -- 172.21.15.7:0/112569063 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f85a81094c0 msgr2=0x7f85a819aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:18.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:18.662+0000 7f85a6ffd640 1 --2- 172.21.15.7:0/112569063 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f85a81094c0 0x7f85a819aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:18.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:18.662+0000 7f85a6ffd640 1 -- 172.21.15.7:0/112569063 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85a81a0390 con 0x7f85a8103b80 2024-09-21T06:34:18.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:18.662+0000 7f85a67fc640 1 --2- 172.21.15.7:0/112569063 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f85a81094c0 0x7f85a819aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:34:18.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:18.662+0000 7f85a6ffd640 1 --2- 172.21.15.7:0/112569063 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f85a8103b80 0x7f85a819a4e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f859800c920 tx=0x7f859800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:18.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:18.662+0000 7f859ffff640 1 -- 172.21.15.7:0/112569063 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f859801e070 con 0x7f85a8103b80 2024-09-21T06:34:18.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:18.662+0000 7f85ad39a640 1 -- 172.21.15.7:0/112569063 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85a81a0680 con 0x7f85a8103b80 2024-09-21T06:34:18.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:18.662+0000 7f859ffff640 1 -- 172.21.15.7:0/112569063 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8598007c70 con 0x7f85a8103b80 2024-09-21T06:34:18.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:18.662+0000 7f859ffff640 1 -- 172.21.15.7:0/112569063 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8598019960 con 0x7f85a8103b80 2024-09-21T06:34:18.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:18.662+0000 7f85ad39a640 1 -- 172.21.15.7:0/112569063 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85a80755f0 con 0x7f85a8103b80 2024-09-21T06:34:18.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:18.663+0000 7f85ad39a640 1 -- 172.21.15.7:0/112569063 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85a8104e00 con 0x7f85a8103b80 2024-09-21T06:34:18.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:18.666+0000 7f859ffff640 1 -- 172.21.15.7:0/112569063 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 21) ==== 154528+0+0 (secure 0 0 0) 0x7f8598019b00 con 0x7f85a8103b80 2024-09-21T06:34:18.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:18.667+0000 7f859ffff640 1 --2- 172.21.15.7:0/112569063 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f85940b6590 0x7f85940b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:18.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:18.668+0000 7f85a67fc640 1 --2- 172.21.15.7:0/112569063 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f85940b6590 0x7f85940b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:18.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:18.668+0000 7f859ffff640 1 -- 172.21.15.7:0/112569063 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f85980eabb0 con 0x7f85a8103b80 2024-09-21T06:34:18.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:18.668+0000 7f85a67fc640 1 --2- 172.21.15.7:0/112569063 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f85940b6590 0x7f85940b8aa0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8590009230 tx=0x7f8590031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:18.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:18.671+0000 7f859ffff640 1 -- 172.21.15.7:0/112569063 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8598027080 con 0x7f85a8103b80 2024-09-21T06:34:18.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:18 smithi007 ceph-mon[30983]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:18.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:18 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:18.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:18 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:18.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:18 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:18.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:18 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:18.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:18 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:18.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:18.876+0000 7f85ad39a640 1 -- 172.21.15.7:0/112569063 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f85a810bc00 con 0x7f85a8103b80 2024-09-21T06:34:18.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:18.876+0000 7f859ffff640 1 -- 172.21.15.7:0/112569063 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v70) ==== 84+0+65 (secure 0 0 0) 0x7f8598007e20 con 0x7f85a8103b80 2024-09-21T06:34:18.878 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:34:18.878 INFO:teuthology.orchestra.run.smithi007.stdout:[ 2024-09-21T06:34:18.878 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:34:18.878 INFO:teuthology.orchestra.run.smithi007.stdout: "poolnum": 1, 2024-09-21T06:34:18.879 INFO:teuthology.orchestra.run.smithi007.stdout: "poolname": ".mgr" 2024-09-21T06:34:18.879 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:34:18.879 INFO:teuthology.orchestra.run.smithi007.stdout:] 2024-09-21T06:34:18.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:18.879+0000 7f85ad39a640 1 -- 172.21.15.7:0/112569063 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f85940b6590 msgr2=0x7f85940b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:18.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:18.879+0000 7f85ad39a640 1 --2- 172.21.15.7:0/112569063 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f85940b6590 0x7f85940b8aa0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8590009230 tx=0x7f8590031400 comp rx=0 tx=0).stop 2024-09-21T06:34:18.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:18.879+0000 7f85ad39a640 1 -- 172.21.15.7:0/112569063 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f85a8103b80 msgr2=0x7f85a819a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:18.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:18.879+0000 7f85ad39a640 1 --2- 172.21.15.7:0/112569063 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f85a8103b80 0x7f85a819a4e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f859800c920 tx=0x7f859800cde0 comp rx=0 tx=0).stop 2024-09-21T06:34:18.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:18.879+0000 7f85ad39a640 1 -- 172.21.15.7:0/112569063 shutdown_connections 2024-09-21T06:34:18.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:18.879+0000 7f85ad39a640 1 --2- 172.21.15.7:0/112569063 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f85940b6590 0x7f85940b8aa0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:18.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:18.879+0000 7f85ad39a640 1 --2- 172.21.15.7:0/112569063 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f85a8109e10 0x7f85a819fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:18.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:18.879+0000 7f85ad39a640 1 --2- 172.21.15.7:0/112569063 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f85a81094c0 0x7f85a819aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:18.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:18.879+0000 7f85ad39a640 1 --2- 172.21.15.7:0/112569063 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f85a8103b80 0x7f85a819a4e0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:18.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:18.879+0000 7f85ad39a640 1 -- 172.21.15.7:0/112569063 >> 172.21.15.7:0/112569063 conn(0x7f85a80ff610 msgr2=0x7f85a8101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:18.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:18.879+0000 7f85ad39a640 1 -- 172.21.15.7:0/112569063 shutdown_connections 2024-09-21T06:34:18.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:18.879+0000 7f85ad39a640 1 -- 172.21.15.7:0/112569063 wait complete. 2024-09-21T06:34:19.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:18 smithi144 ceph-mon[34653]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:19.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:18 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:19.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:18 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:19.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:18 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:19.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:18 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:19.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:18 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:19.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:18 smithi018 ceph-mon[34477]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:19.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:18 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:19.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:18 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:19.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:18 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:19.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:18 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:19.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:18 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:19.569 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-21T06:34:19.570 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-21T06:34:19.827 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:34:20.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:19 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/112569063' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-21T06:34:20.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:19 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:20.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:19 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:20.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:19 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:34:20.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:19 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:34:20.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:19 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:20.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:19 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/112569063' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-21T06:34:20.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:19 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:20.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:19 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:20.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:19 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:34:20.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:19 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:34:20.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:19 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:20.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:19 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/112569063' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-21T06:34:20.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:19 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:20.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:19 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:20.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:19 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:34:20.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:19 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:34:20.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:19 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:34:20.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:20.329+0000 7f3ca0769640 1 -- 172.21.15.7:0/3649808248 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c98109e20 msgr2=0x7f3c98110650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:20.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:20.329+0000 7f3ca0769640 1 --2- 172.21.15.7:0/3649808248 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c98109e20 0x7f3c98110650 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3c90009ca0 tx=0x7f3c9002a8e0 comp rx=0 tx=0).stop 2024-09-21T06:34:20.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:20.329+0000 7f3ca0769640 1 -- 172.21.15.7:0/3649808248 shutdown_connections 2024-09-21T06:34:20.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:20.329+0000 7f3ca0769640 1 --2- 172.21.15.7:0/3649808248 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c98109e20 0x7f3c98110650 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:20.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:20.329+0000 7f3ca0769640 1 --2- 172.21.15.7:0/3649808248 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c981094d0 0x7f3c981098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:20.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:20.329+0000 7f3ca0769640 1 --2- 172.21.15.7:0/3649808248 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3c98103b90 0x7f3c98103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:20.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:20.329+0000 7f3ca0769640 1 -- 172.21.15.7:0/3649808248 >> 172.21.15.7:0/3649808248 conn(0x7f3c980ff600 msgr2=0x7f3c98101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:20.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:20.330+0000 7f3ca0769640 1 -- 172.21.15.7:0/3649808248 shutdown_connections 2024-09-21T06:34:20.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:20.330+0000 7f3ca0769640 1 -- 172.21.15.7:0/3649808248 wait complete. 2024-09-21T06:34:20.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:20.330+0000 7f3ca0769640 1 Processor -- start 2024-09-21T06:34:20.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:20.330+0000 7f3ca0769640 1 -- start start 2024-09-21T06:34:20.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:20.331+0000 7f3ca0769640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c98103b90 0x7f3c9819a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:20.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:20.331+0000 7f3ca0769640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3c981094d0 0x7f3c9819aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:20.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:20.331+0000 7f3ca0769640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c98109e20 0x7f3c9819fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:20.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:20.331+0000 7f3ca0769640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3c98113b70 con 0x7f3c98103b90 2024-09-21T06:34:20.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:20.331+0000 7f3ca0769640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3c981139f0 con 0x7f3c981094d0 2024-09-21T06:34:20.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:20.331+0000 7f3ca0769640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3c98113cf0 con 0x7f3c98109e20 2024-09-21T06:34:20.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:20.331+0000 7f3c9e505640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c98103b90 0x7f3c9819a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:20.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:20.331+0000 7f3c9e505640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c98103b90 0x7f3c9819a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51586/0 (socket says 172.21.15.7:51586) 2024-09-21T06:34:20.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:20.331+0000 7f3c9e505640 1 -- 172.21.15.7:0/1865027691 learned_addr learned my addr 172.21.15.7:0/1865027691 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:34:20.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:20.331+0000 7f3c9ed06640 1 --2- 172.21.15.7:0/1865027691 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c98109e20 0x7f3c9819fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:20.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:20.331+0000 7f3c9dd04640 1 --2- 172.21.15.7:0/1865027691 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3c981094d0 0x7f3c9819aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:20.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:20.331+0000 7f3c9e505640 1 -- 172.21.15.7:0/1865027691 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c98109e20 msgr2=0x7f3c9819fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:20.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:20.331+0000 7f3c9e505640 1 --2- 172.21.15.7:0/1865027691 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c98109e20 0x7f3c9819fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:20.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:20.331+0000 7f3c9e505640 1 -- 172.21.15.7:0/1865027691 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3c981094d0 msgr2=0x7f3c9819aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:20.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:20.331+0000 7f3c9e505640 1 --2- 172.21.15.7:0/1865027691 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3c981094d0 0x7f3c9819aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:20.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:20.331+0000 7f3c9e505640 1 -- 172.21.15.7:0/1865027691 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c981a03d0 con 0x7f3c98103b90 2024-09-21T06:34:20.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:20.331+0000 7f3c9e505640 1 --2- 172.21.15.7:0/1865027691 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c98103b90 0x7f3c9819a460 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f3c9400d950 tx=0x7f3c9400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:20.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:20.331+0000 7f3c8f7fe640 1 -- 172.21.15.7:0/1865027691 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c94017070 con 0x7f3c98103b90 2024-09-21T06:34:20.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:20.332+0000 7f3ca0769640 1 -- 172.21.15.7:0/1865027691 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c981a06c0 con 0x7f3c98103b90 2024-09-21T06:34:20.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:20.332+0000 7f3c8f7fe640 1 -- 172.21.15.7:0/1865027691 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3c94009c30 con 0x7f3c98103b90 2024-09-21T06:34:20.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:20.332+0000 7f3c8f7fe640 1 -- 172.21.15.7:0/1865027691 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c9400f620 con 0x7f3c98103b90 2024-09-21T06:34:20.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:20.332+0000 7f3ca0769640 1 -- 172.21.15.7:0/1865027691 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c981a6e20 con 0x7f3c98103b90 2024-09-21T06:34:20.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:20.333+0000 7f3ca0769640 1 -- 172.21.15.7:0/1865027691 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c98103fa0 con 0x7f3c98103b90 2024-09-21T06:34:20.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:20.334+0000 7f3c8f7fe640 1 -- 172.21.15.7:0/1865027691 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 21) ==== 154528+0+0 (secure 0 0 0) 0x7f3c94010460 con 0x7f3c98103b90 2024-09-21T06:34:20.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:20.335+0000 7f3c8f7fe640 1 --2- 172.21.15.7:0/1865027691 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f3c840b6560 0x7f3c840b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:20.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:20.335+0000 7f3c9dd04640 1 --2- 172.21.15.7:0/1865027691 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f3c840b6560 0x7f3c840b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:20.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:20.335+0000 7f3c8f7fe640 1 -- 172.21.15.7:0/1865027691 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 7342+0+0 (secure 0 0 0) 0x7f3c940e6c60 con 0x7f3c98103b90 2024-09-21T06:34:20.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:20.336+0000 7f3c9dd04640 1 --2- 172.21.15.7:0/1865027691 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f3c840b6560 0x7f3c840b8a70 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3c98102e10 tx=0x7f3c88008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:20.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:20.338+0000 7f3c8f7fe640 1 -- 172.21.15.7:0/1865027691 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3c940ad8c0 con 0x7f3c98103b90 2024-09-21T06:34:20.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:20.526+0000 7f3ca0769640 1 -- 172.21.15.7:0/1865027691 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f3c9819b590 con 0x7f3c98103b90 2024-09-21T06:34:20.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:20.920+0000 7f3c8f7fe640 1 -- 172.21.15.7:0/1865027691 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v71) ==== 138+0+0 (secure 0 0 0) 0x7f3c9819b590 con 0x7f3c98103b90 2024-09-21T06:34:20.922 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_metadata' created 2024-09-21T06:34:20.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:20.923+0000 7f3ca0769640 1 -- 172.21.15.7:0/1865027691 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f3c840b6560 msgr2=0x7f3c840b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:20.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:20.923+0000 7f3ca0769640 1 --2- 172.21.15.7:0/1865027691 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f3c840b6560 0x7f3c840b8a70 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3c98102e10 tx=0x7f3c88008040 comp rx=0 tx=0).stop 2024-09-21T06:34:20.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:20.923+0000 7f3ca0769640 1 -- 172.21.15.7:0/1865027691 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c98103b90 msgr2=0x7f3c9819a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:20.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:20.923+0000 7f3ca0769640 1 --2- 172.21.15.7:0/1865027691 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c98103b90 0x7f3c9819a460 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f3c9400d950 tx=0x7f3c9400de10 comp rx=0 tx=0).stop 2024-09-21T06:34:20.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:20.923+0000 7f3ca0769640 1 -- 172.21.15.7:0/1865027691 shutdown_connections 2024-09-21T06:34:20.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:20.923+0000 7f3ca0769640 1 --2- 172.21.15.7:0/1865027691 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f3c840b6560 0x7f3c840b8a70 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:20.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:20.923+0000 7f3ca0769640 1 --2- 172.21.15.7:0/1865027691 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c98109e20 0x7f3c9819fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:20.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:20.923+0000 7f3ca0769640 1 --2- 172.21.15.7:0/1865027691 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3c981094d0 0x7f3c9819aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:20.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:20.923+0000 7f3ca0769640 1 --2- 172.21.15.7:0/1865027691 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c98103b90 0x7f3c9819a460 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:20.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:20.923+0000 7f3ca0769640 1 -- 172.21.15.7:0/1865027691 >> 172.21.15.7:0/1865027691 conn(0x7f3c980ff600 msgr2=0x7f3c98108ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:20.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:20.923+0000 7f3ca0769640 1 -- 172.21.15.7:0/1865027691 shutdown_connections 2024-09-21T06:34:20.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:20.923+0000 7f3ca0769640 1 -- 172.21.15.7:0/1865027691 wait complete. 2024-09-21T06:34:21.248 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:20 smithi007 ceph-mon[30983]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:21.248 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:20 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/1865027691' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T06:34:21.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:20 smithi144 ceph-mon[34653]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:21.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:20 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/1865027691' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T06:34:21.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:20 smithi018 ceph-mon[34477]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:21.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:20 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/1865027691' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T06:34:21.577 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-21T06:34:21.842 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:34:22.252 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:21 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/1865027691' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-21T06:34:22.252 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:21 smithi007 ceph-mon[30983]: osdmap e71: 12 total, 12 up, 12 in 2024-09-21T06:34:22.252 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:21 smithi007 ceph-mon[30983]: osdmap e72: 12 total, 12 up, 12 in 2024-09-21T06:34:22.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:21 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/1865027691' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-21T06:34:22.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:21 smithi144 ceph-mon[34653]: osdmap e71: 12 total, 12 up, 12 in 2024-09-21T06:34:22.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:21 smithi144 ceph-mon[34653]: osdmap e72: 12 total, 12 up, 12 in 2024-09-21T06:34:22.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:22.349+0000 7fc269f8b640 1 -- 172.21.15.7:0/2519875230 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc264102ae0 msgr2=0x7fc264102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:22.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:22.349+0000 7fc269f8b640 1 --2- 172.21.15.7:0/2519875230 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc264102ae0 0x7fc264102ef0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc254009900 tx=0x7fc25402a410 comp rx=0 tx=0).stop 2024-09-21T06:34:22.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:22.349+0000 7fc269f8b640 1 -- 172.21.15.7:0/2519875230 shutdown_connections 2024-09-21T06:34:22.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:22.349+0000 7fc269f8b640 1 --2- 172.21.15.7:0/2519875230 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc264108d20 0x7fc26410f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:22.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:22.349+0000 7fc269f8b640 1 --2- 172.21.15.7:0/2519875230 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc2641083d0 0x7fc2641087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:22.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:22.349+0000 7fc269f8b640 1 --2- 172.21.15.7:0/2519875230 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc264102ae0 0x7fc264102ef0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:22.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:22.349+0000 7fc269f8b640 1 -- 172.21.15.7:0/2519875230 >> 172.21.15.7:0/2519875230 conn(0x7fc264079760 msgr2=0x7fc264079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:22.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:22.349+0000 7fc269f8b640 1 -- 172.21.15.7:0/2519875230 shutdown_connections 2024-09-21T06:34:22.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:22.349+0000 7fc269f8b640 1 -- 172.21.15.7:0/2519875230 wait complete. 2024-09-21T06:34:22.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:22.349+0000 7fc269f8b640 1 Processor -- start 2024-09-21T06:34:22.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:22.350+0000 7fc269f8b640 1 -- start start 2024-09-21T06:34:22.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:22.350+0000 7fc269f8b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc264102ae0 0x7fc26419b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:22.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:22.350+0000 7fc269f8b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc2641083d0 0x7fc26419b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:22.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:22.350+0000 7fc269f8b640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc264108d20 0x7fc26419bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:22.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:22.350+0000 7fc269f8b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc264112990 con 0x7fc264102ae0 2024-09-21T06:34:22.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:22.350+0000 7fc269f8b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc264112810 con 0x7fc2641083d0 2024-09-21T06:34:22.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:22.350+0000 7fc269f8b640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc264112b10 con 0x7fc264108d20 2024-09-21T06:34:22.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:22.350+0000 7fc2637fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc264102ae0 0x7fc26419b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:22.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:22.350+0000 7fc2637fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc264102ae0 0x7fc26419b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40580/0 (socket says 172.21.15.7:40580) 2024-09-21T06:34:22.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:22.350+0000 7fc2637fe640 1 -- 172.21.15.7:0/3316193252 learned_addr learned my addr 172.21.15.7:0/3316193252 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:34:22.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:22.350+0000 7fc262ffd640 1 --2- 172.21.15.7:0/3316193252 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc2641083d0 0x7fc26419b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:22.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:22.350+0000 7fc263fff640 1 --2- 172.21.15.7:0/3316193252 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc264108d20 0x7fc26419bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:22.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:22.350+0000 7fc262ffd640 1 -- 172.21.15.7:0/3316193252 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc264108d20 msgr2=0x7fc26419bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:22.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:22.351+0000 7fc262ffd640 1 --2- 172.21.15.7:0/3316193252 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc264108d20 0x7fc26419bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:22.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:22.351+0000 7fc262ffd640 1 -- 172.21.15.7:0/3316193252 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc264102ae0 msgr2=0x7fc26419b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:22.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:22.351+0000 7fc262ffd640 1 --2- 172.21.15.7:0/3316193252 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc264102ae0 0x7fc26419b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:22.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:22.351+0000 7fc262ffd640 1 -- 172.21.15.7:0/3316193252 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2641a6530 con 0x7fc2641083d0 2024-09-21T06:34:22.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:22.351+0000 7fc2637fe640 1 --2- 172.21.15.7:0/3316193252 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc264102ae0 0x7fc26419b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:34:22.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:22.351+0000 7fc263fff640 1 --2- 172.21.15.7:0/3316193252 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc264108d20 0x7fc26419bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:34:22.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:22.351+0000 7fc262ffd640 1 --2- 172.21.15.7:0/3316193252 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc2641083d0 0x7fc26419b760 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc24c00e9c0 tx=0x7fc24c00ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:22.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:22.351+0000 7fc260ff9640 1 -- 172.21.15.7:0/3316193252 <== mon.2 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc24c00ccc0 con 0x7fc2641083d0 2024-09-21T06:34:22.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:22.351+0000 7fc269f8b640 1 -- 172.21.15.7:0/3316193252 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2641a6820 con 0x7fc2641083d0 2024-09-21T06:34:22.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:22.351+0000 7fc260ff9640 1 -- 172.21.15.7:0/3316193252 <== mon.2 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc24c0108e0 con 0x7fc2641083d0 2024-09-21T06:34:22.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:22.351+0000 7fc260ff9640 1 -- 172.21.15.7:0/3316193252 <== mon.2 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc24c0187a0 con 0x7fc2641083d0 2024-09-21T06:34:22.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:22.351+0000 7fc269f8b640 1 -- 172.21.15.7:0/3316193252 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2641a6db0 con 0x7fc2641083d0 2024-09-21T06:34:22.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:22.352+0000 7fc269f8b640 1 -- 172.21.15.7:0/3316193252 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc264103d10 con 0x7fc2641083d0 2024-09-21T06:34:22.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:22.354+0000 7fc260ff9640 1 -- 172.21.15.7:0/3316193252 <== mon.2 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 21) ==== 154528+0+0 (secure 0 0 0) 0x7fc24c010430 con 0x7fc2641083d0 2024-09-21T06:34:22.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:22.355+0000 7fc260ff9640 1 --2- 172.21.15.7:0/3316193252 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fc2500b6560 0x7fc2500b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:22.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:22.355+0000 7fc2637fe640 1 --2- 172.21.15.7:0/3316193252 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fc2500b6560 0x7fc2500b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:22.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:22.355+0000 7fc260ff9640 1 -- 172.21.15.7:0/3316193252 <== mon.2 v2:172.21.15.18:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7712+0+0 (secure 0 0 0) 0x7fc24c0e79d0 con 0x7fc2641083d0 2024-09-21T06:34:22.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:22.355+0000 7fc2637fe640 1 --2- 172.21.15.7:0/3316193252 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fc2500b6560 0x7fc2500b8a70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc254009230 tx=0x7fc2540058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:22.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:22.358+0000 7fc260ff9640 1 -- 172.21.15.7:0/3316193252 <== mon.2 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc24c0ae440 con 0x7fc2641083d0 2024-09-21T06:34:22.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:21 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/1865027691' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-21T06:34:22.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:21 smithi018 ceph-mon[34477]: osdmap e71: 12 total, 12 up, 12 in 2024-09-21T06:34:22.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:21 smithi018 ceph-mon[34477]: osdmap e72: 12 total, 12 up, 12 in 2024-09-21T06:34:22.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:22.547+0000 7fc269f8b640 1 -- 172.21.15.7:0/3316193252 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fc26402e640 con 0x7fc2641083d0 2024-09-21T06:34:22.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:22.930+0000 7fc260ff9640 1 -- 172.21.15.7:0/3316193252 <== mon.2 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v73) ==== 170+0+0 (secure 0 0 0) 0x7fc24c0b2820 con 0x7fc2641083d0 2024-09-21T06:34:22.932 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data' created 2024-09-21T06:34:22.938 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:22.936+0000 7fc269f8b640 1 -- 172.21.15.7:0/3316193252 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fc2500b6560 msgr2=0x7fc2500b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:22.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:22.936+0000 7fc269f8b640 1 --2- 172.21.15.7:0/3316193252 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fc2500b6560 0x7fc2500b8a70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc254009230 tx=0x7fc2540058d0 comp rx=0 tx=0).stop 2024-09-21T06:34:22.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:22.936+0000 7fc269f8b640 1 -- 172.21.15.7:0/3316193252 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc2641083d0 msgr2=0x7fc26419b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:22.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:22.936+0000 7fc269f8b640 1 --2- 172.21.15.7:0/3316193252 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc2641083d0 0x7fc26419b760 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc24c00e9c0 tx=0x7fc24c00ee80 comp rx=0 tx=0).stop 2024-09-21T06:34:22.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:22.936+0000 7fc269f8b640 1 -- 172.21.15.7:0/3316193252 shutdown_connections 2024-09-21T06:34:22.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:22.936+0000 7fc269f8b640 1 --2- 172.21.15.7:0/3316193252 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fc2500b6560 0x7fc2500b8a70 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:22.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:22.936+0000 7fc269f8b640 1 --2- 172.21.15.7:0/3316193252 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc264108d20 0x7fc26419bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:22.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:22.936+0000 7fc269f8b640 1 --2- 172.21.15.7:0/3316193252 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc2641083d0 0x7fc26419b760 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:22.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:22.936+0000 7fc269f8b640 1 --2- 172.21.15.7:0/3316193252 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc264102ae0 0x7fc26419b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:22.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:22.936+0000 7fc269f8b640 1 -- 172.21.15.7:0/3316193252 >> 172.21.15.7:0/3316193252 conn(0x7fc264079760 msgr2=0x7fc264101550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:22.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:22.937+0000 7fc269f8b640 1 -- 172.21.15.7:0/3316193252 shutdown_connections 2024-09-21T06:34:22.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:22.937+0000 7fc269f8b640 1 -- 172.21.15.7:0/3316193252 wait complete. 2024-09-21T06:34:23.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:22 smithi144 ceph-mon[34653]: pgmap v258: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:23.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:22 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/3316193252' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T06:34:23.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:22 smithi144 ceph-mon[34653]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T06:34:23.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:22 smithi144 ceph-mon[34653]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-21T06:34:23.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:22 smithi144 ceph-mon[34653]: osdmap e73: 12 total, 12 up, 12 in 2024-09-21T06:34:23.289 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:22 smithi007 ceph-mon[30983]: pgmap v258: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:23.289 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:22 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/3316193252' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T06:34:23.290 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:22 smithi007 ceph-mon[30983]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T06:34:23.290 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:22 smithi007 ceph-mon[30983]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-21T06:34:23.290 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:22 smithi007 ceph-mon[30983]: osdmap e73: 12 total, 12 up, 12 in 2024-09-21T06:34:23.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:22 smithi018 ceph-mon[34477]: pgmap v258: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:23.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:22 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/3316193252' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T06:34:23.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:22 smithi018 ceph-mon[34477]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T06:34:23.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:22 smithi018 ceph-mon[34477]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-21T06:34:23.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:22 smithi018 ceph-mon[34477]: osdmap e73: 12 total, 12 up, 12 in 2024-09-21T06:34:23.635 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-21T06:34:23.899 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:34:24.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:24.383+0000 7f5bc7b6d640 1 -- 172.21.15.7:0/2324702809 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5bc01083a0 msgr2=0x7f5bc01087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:24.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:24.383+0000 7f5bc7b6d640 1 --2- 172.21.15.7:0/2324702809 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5bc01083a0 0x7f5bc01087b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f5bb4009900 tx=0x7f5bb402a3f0 comp rx=0 tx=0).stop 2024-09-21T06:34:24.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:24.383+0000 7f5bc7b6d640 1 -- 172.21.15.7:0/2324702809 shutdown_connections 2024-09-21T06:34:24.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:24.383+0000 7f5bc7b6d640 1 --2- 172.21.15.7:0/2324702809 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5bc0108cf0 0x7f5bc010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:24.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:24.383+0000 7f5bc7b6d640 1 --2- 172.21.15.7:0/2324702809 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5bc01083a0 0x7f5bc01087b0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:24.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:24.383+0000 7f5bc7b6d640 1 --2- 172.21.15.7:0/2324702809 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5bc0102a60 0x7f5bc0102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:24.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:24.383+0000 7f5bc7b6d640 1 -- 172.21.15.7:0/2324702809 >> 172.21.15.7:0/2324702809 conn(0x7f5bc0079730 msgr2=0x7f5bc0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:24.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:24.383+0000 7f5bc7b6d640 1 -- 172.21.15.7:0/2324702809 shutdown_connections 2024-09-21T06:34:24.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:24.383+0000 7f5bc7b6d640 1 -- 172.21.15.7:0/2324702809 wait complete. 2024-09-21T06:34:24.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:24.384+0000 7f5bc7b6d640 1 Processor -- start 2024-09-21T06:34:24.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:24.384+0000 7f5bc7b6d640 1 -- start start 2024-09-21T06:34:24.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:24.384+0000 7f5bc7b6d640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5bc0102a60 0x7f5bc019b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:24.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:24.385+0000 7f5bc7b6d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5bc01083a0 0x7f5bc019b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:24.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:24.385+0000 7f5bc7b6d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5bc0108cf0 0x7f5bc019bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:24.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:24.385+0000 7f5bc7b6d640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5bc0112960 con 0x7f5bc01083a0 2024-09-21T06:34:24.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:24.385+0000 7f5bc7b6d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5bc01127e0 con 0x7f5bc0108cf0 2024-09-21T06:34:24.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:24.385+0000 7f5bc7b6d640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5bc0112ae0 con 0x7f5bc0102a60 2024-09-21T06:34:24.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:24.385+0000 7f5bc5108640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5bc01083a0 0x7f5bc019b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:24.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:24.385+0000 7f5bc5108640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5bc01083a0 0x7f5bc019b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40600/0 (socket says 172.21.15.7:40600) 2024-09-21T06:34:24.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:24.385+0000 7f5bc5108640 1 -- 172.21.15.7:0/1530955134 learned_addr learned my addr 172.21.15.7:0/1530955134 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:34:24.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:24.385+0000 7f5bc5909640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5bc0102a60 0x7f5bc019b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:24.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:24.385+0000 7f5bc610a640 1 --2- 172.21.15.7:0/1530955134 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5bc0108cf0 0x7f5bc019bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:24.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:24.385+0000 7f5bc5108640 1 -- 172.21.15.7:0/1530955134 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5bc0102a60 msgr2=0x7f5bc019b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:24.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:24.385+0000 7f5bc5108640 1 --2- 172.21.15.7:0/1530955134 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5bc0102a60 0x7f5bc019b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:24.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:24.385+0000 7f5bc5108640 1 -- 172.21.15.7:0/1530955134 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5bc0108cf0 msgr2=0x7f5bc019bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:24.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:24.385+0000 7f5bc5108640 1 --2- 172.21.15.7:0/1530955134 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5bc0108cf0 0x7f5bc019bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:24.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:24.385+0000 7f5bc5108640 1 -- 172.21.15.7:0/1530955134 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bc01a6460 con 0x7f5bc01083a0 2024-09-21T06:34:24.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:24.385+0000 7f5bc5108640 1 --2- 172.21.15.7:0/1530955134 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5bc01083a0 0x7f5bc019b770 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5bb4031a90 tx=0x7f5bb4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:24.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:24.386+0000 7f5bb2ffd640 1 -- 172.21.15.7:0/1530955134 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bb403f030 con 0x7f5bc01083a0 2024-09-21T06:34:24.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:24.386+0000 7f5bb2ffd640 1 -- 172.21.15.7:0/1530955134 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5bb4004490 con 0x7f5bc01083a0 2024-09-21T06:34:24.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:24.386+0000 7f5bc7b6d640 1 -- 172.21.15.7:0/1530955134 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bc01a66f0 con 0x7f5bc01083a0 2024-09-21T06:34:24.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:24.386+0000 7f5bb2ffd640 1 -- 172.21.15.7:0/1530955134 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bb4035070 con 0x7f5bc01083a0 2024-09-21T06:34:24.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:24.386+0000 7f5bc7b6d640 1 -- 172.21.15.7:0/1530955134 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bc01a6bd0 con 0x7f5bc01083a0 2024-09-21T06:34:24.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:24.387+0000 7f5bc7b6d640 1 -- 172.21.15.7:0/1530955134 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bc0102e70 con 0x7f5bc01083a0 2024-09-21T06:34:24.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:24.390+0000 7f5bb2ffd640 1 -- 172.21.15.7:0/1530955134 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 21) ==== 154528+0+0 (secure 0 0 0) 0x7f5bb4042030 con 0x7f5bc01083a0 2024-09-21T06:34:24.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:24.390+0000 7f5bb2ffd640 1 --2- 172.21.15.7:0/1530955134 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f5bac0b6560 0x7f5bac0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:24.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:24.391+0000 7f5bc5909640 1 --2- 172.21.15.7:0/1530955134 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f5bac0b6560 0x7f5bac0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:24.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:24.391+0000 7f5bb2ffd640 1 -- 172.21.15.7:0/1530955134 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 8094+0+0 (secure 0 0 0) 0x7f5bb4107c50 con 0x7f5bc01083a0 2024-09-21T06:34:24.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:24.391+0000 7f5bc5909640 1 --2- 172.21.15.7:0/1530955134 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f5bac0b6560 0x7f5bac0b8a70 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5bc006b9e0 tx=0x7f5bbc00a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:24.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:24.393+0000 7f5bb2ffd640 1 -- 172.21.15.7:0/1530955134 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5bb40ce520 con 0x7f5bc01083a0 2024-09-21T06:34:24.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:24.625+0000 7f5bc7b6d640 1 -- 172.21.15.7:0/1530955134 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f5bc006b290 con 0x7f5bc01083a0 2024-09-21T06:34:24.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:24.946+0000 7f5bb2ffd640 1 -- 172.21.15.7:0/1530955134 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f5bc006b290 con 0x7f5bc01083a0 2024-09-21T06:34:24.948 INFO:teuthology.orchestra.run.smithi007.stderr:new fs with metadata pool 2 and data pool 3 2024-09-21T06:34:24.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:24.949+0000 7f5bc7b6d640 1 -- 172.21.15.7:0/1530955134 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f5bac0b6560 msgr2=0x7f5bac0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:24.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:24.949+0000 7f5bc7b6d640 1 --2- 172.21.15.7:0/1530955134 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f5bac0b6560 0x7f5bac0b8a70 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5bc006b9e0 tx=0x7f5bbc00a2d0 comp rx=0 tx=0).stop 2024-09-21T06:34:24.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:24.949+0000 7f5bc7b6d640 1 -- 172.21.15.7:0/1530955134 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5bc01083a0 msgr2=0x7f5bc019b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:24.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:24.949+0000 7f5bc7b6d640 1 --2- 172.21.15.7:0/1530955134 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5bc01083a0 0x7f5bc019b770 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5bb4031a90 tx=0x7f5bb4004270 comp rx=0 tx=0).stop 2024-09-21T06:34:24.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:24.949+0000 7f5bc7b6d640 1 -- 172.21.15.7:0/1530955134 shutdown_connections 2024-09-21T06:34:24.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:24.949+0000 7f5bc7b6d640 1 --2- 172.21.15.7:0/1530955134 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f5bac0b6560 0x7f5bac0b8a70 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:24.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:24.949+0000 7f5bc7b6d640 1 --2- 172.21.15.7:0/1530955134 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5bc0108cf0 0x7f5bc019bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:24.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:24.949+0000 7f5bc7b6d640 1 --2- 172.21.15.7:0/1530955134 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5bc01083a0 0x7f5bc019b770 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:24.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:24.949+0000 7f5bc7b6d640 1 --2- 172.21.15.7:0/1530955134 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5bc0102a60 0x7f5bc019b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:24.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:24.949+0000 7f5bc7b6d640 1 -- 172.21.15.7:0/1530955134 >> 172.21.15.7:0/1530955134 conn(0x7f5bc0079730 msgr2=0x7f5bc0104420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:24.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:24.949+0000 7f5bc7b6d640 1 -- 172.21.15.7:0/1530955134 shutdown_connections 2024-09-21T06:34:24.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:24.949+0000 7f5bc7b6d640 1 -- 172.21.15.7:0/1530955134 wait complete. 2024-09-21T06:34:25.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:24 smithi144 ceph-mon[34653]: pgmap v261: 97 pgs: 6 creating+peering, 76 unknown, 15 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:25.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:24 smithi144 ceph-mon[34653]: osdmap e74: 12 total, 12 up, 12 in 2024-09-21T06:34:25.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:24 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/1530955134' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T06:34:25.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:24 smithi144 ceph-mon[34653]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-21T06:34:25.298 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:24 smithi007 ceph-mon[30983]: pgmap v261: 97 pgs: 6 creating+peering, 76 unknown, 15 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:25.298 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:24 smithi007 ceph-mon[30983]: osdmap e74: 12 total, 12 up, 12 in 2024-09-21T06:34:25.298 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:24 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/1530955134' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T06:34:25.298 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:24 smithi007 ceph-mon[30983]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-21T06:34:25.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:24 smithi018 ceph-mon[34477]: pgmap v261: 97 pgs: 6 creating+peering, 76 unknown, 15 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:25.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:24 smithi018 ceph-mon[34477]: osdmap e74: 12 total, 12 up, 12 in 2024-09-21T06:34:25.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:24 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/1530955134' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T06:34:25.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:24 smithi018 ceph-mon[34477]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-21T06:34:25.686 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T06:34:25.931 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:25 smithi007 ceph-mon[30983]: osdmap e75: 12 total, 12 up, 12 in 2024-09-21T06:34:25.931 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:25 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/1530955134' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-21T06:34:25.931 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:25 smithi007 ceph-mon[30983]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-21T06:34:25.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:25 smithi007 ceph-mon[30983]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-21T06:34:25.944 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:34:26.270 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:25 smithi018 ceph-mon[34477]: osdmap e75: 12 total, 12 up, 12 in 2024-09-21T06:34:26.271 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:25 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/1530955134' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-21T06:34:26.271 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:25 smithi018 ceph-mon[34477]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-21T06:34:26.271 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:25 smithi018 ceph-mon[34477]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-21T06:34:26.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:25 smithi144 ceph-mon[34653]: osdmap e75: 12 total, 12 up, 12 in 2024-09-21T06:34:26.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:25 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/1530955134' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-21T06:34:26.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:25 smithi144 ceph-mon[34653]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-21T06:34:26.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:25 smithi144 ceph-mon[34653]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-21T06:34:26.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:26.527+0000 7f1046dd6640 1 -- 172.21.15.7:0/3794384057 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1040102a60 msgr2=0x7f1040102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:26.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:26.527+0000 7f1046dd6640 1 --2- 172.21.15.7:0/3794384057 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1040102a60 0x7f1040102e70 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1038009ca0 tx=0x7f103802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:34:26.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:26.527+0000 7f1046dd6640 1 -- 172.21.15.7:0/3794384057 shutdown_connections 2024-09-21T06:34:26.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:26.527+0000 7f1046dd6640 1 --2- 172.21.15.7:0/3794384057 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1040108cf0 0x7f104010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:26.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:26.527+0000 7f1046dd6640 1 --2- 172.21.15.7:0/3794384057 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10401083a0 0x7f10401087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:26.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:26.527+0000 7f1046dd6640 1 --2- 172.21.15.7:0/3794384057 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1040102a60 0x7f1040102e70 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:26.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:26.527+0000 7f1046dd6640 1 -- 172.21.15.7:0/3794384057 >> 172.21.15.7:0/3794384057 conn(0x7f1040079730 msgr2=0x7f1040079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:26.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:26.527+0000 7f1046dd6640 1 -- 172.21.15.7:0/3794384057 shutdown_connections 2024-09-21T06:34:26.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:26.527+0000 7f1046dd6640 1 -- 172.21.15.7:0/3794384057 wait complete. 2024-09-21T06:34:26.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:26.528+0000 7f1046dd6640 1 Processor -- start 2024-09-21T06:34:26.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:26.528+0000 7f1046dd6640 1 -- start start 2024-09-21T06:34:26.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:26.528+0000 7f1046dd6640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1040102a60 0x7f1040199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:26.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:26.529+0000 7f1046dd6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10401083a0 0x7f1040199910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:26.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:26.529+0000 7f1046dd6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1040108cf0 0x7f104019ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:26.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:26.529+0000 7f1046dd6640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1040112960 con 0x7f1040108cf0 2024-09-21T06:34:26.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:26.529+0000 7f1046dd6640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f10401127e0 con 0x7f10401083a0 2024-09-21T06:34:26.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:26.529+0000 7f1046dd6640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1040112ae0 con 0x7f1040102a60 2024-09-21T06:34:26.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:26.529+0000 7f1045373640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1040108cf0 0x7f104019ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:26.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:26.529+0000 7f1044b72640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1040102a60 0x7f1040199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:26.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:26.529+0000 7f1044b72640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1040102a60 0x7f1040199370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.7:43808/0 (socket says 172.21.15.7:43808) 2024-09-21T06:34:26.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:26.529+0000 7f1044b72640 1 -- 172.21.15.7:0/1785626579 learned_addr learned my addr 172.21.15.7:0/1785626579 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:34:26.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:26.529+0000 7f1045373640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1040108cf0 0x7f104019ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40606/0 (socket says 172.21.15.7:40606) 2024-09-21T06:34:26.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:26.529+0000 7f103ffff640 1 --2- 172.21.15.7:0/1785626579 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10401083a0 0x7f1040199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:26.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:26.529+0000 7f1045373640 1 -- 172.21.15.7:0/1785626579 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1040102a60 msgr2=0x7f1040199370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:26.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:26.529+0000 7f1045373640 1 --2- 172.21.15.7:0/1785626579 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1040102a60 0x7f1040199370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:26.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:26.529+0000 7f1045373640 1 -- 172.21.15.7:0/1785626579 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10401083a0 msgr2=0x7f1040199910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:26.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:26.529+0000 7f1045373640 1 --2- 172.21.15.7:0/1785626579 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10401083a0 0x7f1040199910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:26.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:26.529+0000 7f1045373640 1 -- 172.21.15.7:0/1785626579 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f104019f2e0 con 0x7f1040108cf0 2024-09-21T06:34:26.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:26.529+0000 7f1044b72640 1 --2- 172.21.15.7:0/1785626579 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1040102a60 0x7f1040199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:34:26.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:26.529+0000 7f1045373640 1 --2- 172.21.15.7:0/1785626579 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1040108cf0 0x7f104019ebb0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f103000e970 tx=0x7f103000ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:26.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:26.529+0000 7f103dffb640 1 -- 172.21.15.7:0/1785626579 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f103000ccc0 con 0x7f1040108cf0 2024-09-21T06:34:26.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:26.529+0000 7f103dffb640 1 -- 172.21.15.7:0/1785626579 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1030005020 con 0x7f1040108cf0 2024-09-21T06:34:26.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:26.530+0000 7f1046dd6640 1 -- 172.21.15.7:0/1785626579 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f104019f5d0 con 0x7f1040108cf0 2024-09-21T06:34:26.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:26.530+0000 7f103dffb640 1 -- 172.21.15.7:0/1785626579 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1030004a00 con 0x7f1040108cf0 2024-09-21T06:34:26.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:26.530+0000 7f1046dd6640 1 -- 172.21.15.7:0/1785626579 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10401a5d30 con 0x7f1040108cf0 2024-09-21T06:34:26.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:26.531+0000 7f1046dd6640 1 -- 172.21.15.7:0/1785626579 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1040102e70 con 0x7f1040108cf0 2024-09-21T06:34:26.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:26.533+0000 7f103dffb640 1 -- 172.21.15.7:0/1785626579 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 21) ==== 154528+0+0 (secure 0 0 0) 0x7f1030004ba0 con 0x7f1040108cf0 2024-09-21T06:34:26.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:26.534+0000 7f103dffb640 1 --2- 172.21.15.7:0/1785626579 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f102c0b65e0 0x7f102c0b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:26.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:26.534+0000 7f1044b72640 1 --2- 172.21.15.7:0/1785626579 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f102c0b65e0 0x7f102c0b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:26.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:26.534+0000 7f103dffb640 1 -- 172.21.15.7:0/1785626579 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7f10300e7290 con 0x7f1040108cf0 2024-09-21T06:34:26.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:26.535+0000 7f1044b72640 1 --2- 172.21.15.7:0/1785626579 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f102c0b65e0 0x7f102c0b8af0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1038033040 tx=0x7f1038032eb0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:26.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:26.537+0000 7f103dffb640 1 -- 172.21.15.7:0/1785626579 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f10300adbd0 con 0x7f1040108cf0 2024-09-21T06:34:26.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:26.727+0000 7f1046dd6640 1 -- 172.21.15.7:0/1785626579 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f104019a4a0 con 0x7f1040108cf0 2024-09-21T06:34:26.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:26.728+0000 7f103dffb640 1 -- 172.21.15.7:0/1785626579 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22508 (secure 0 0 0) 0x7f104019a4a0 con 0x7f1040108cf0 2024-09-21T06:34:26.730 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:34:26.730 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":75,"fsid":"347cb918-77e2-11ef-baf5-efdc52797490","created":"2024-09-21T06:25:51.925032+0000","modified":"2024-09-21T06:34:24.627214+0000","last_up_change":"2024-09-21T06:33:32.888843+0000","last_in_change":"2024-09-21T06:33:09.926778+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:29:41.514179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:34:20.531755+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T06:34:22.552541+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1be5c4a4-3931-4d8b-95c7-c05f5b73fcfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":942632794},{"type":"v1","addr":"172.21.15.7:6803","nonce":942632794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":942632794},{"type":"v1","addr":"172.21.15.7:6805","nonce":942632794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":942632794},{"type":"v1","addr":"172.21.15.7:6809","nonce":942632794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":942632794},{"type":"v1","addr":"172.21.15.7:6807","nonce":942632794}]},"public_addr":"172.21.15.7:6803/942632794","cluster_addr":"172.21.15.7:6805/942632794","heartbeat_back_addr":"172.21.15.7:6809/942632794","heartbeat_front_addr":"172.21.15.7:6807/942632794","state":["exists","up"]},{"osd":1,"uuid":"7ae136a8-c614-47e5-b265-c6cfa857a7fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1839342931},{"type":"v1","addr":"172.21.15.18:6801","nonce":1839342931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1839342931},{"type":"v1","addr":"172.21.15.18:6803","nonce":1839342931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1839342931},{"type":"v1","addr":"172.21.15.18:6807","nonce":1839342931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1839342931},{"type":"v1","addr":"172.21.15.18:6805","nonce":1839342931}]},"public_addr":"172.21.15.18:6801/1839342931","cluster_addr":"172.21.15.18:6803/1839342931","heartbeat_back_addr":"172.21.15.18:6807/1839342931","heartbeat_front_addr":"172.21.15.18:6805/1839342931","state":["exists","up"]},{"osd":2,"uuid":"97b13994-4680-4573-9c2e-ac65ea740e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":1699582162},{"type":"v1","addr":"172.21.15.144:6801","nonce":1699582162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":1699582162},{"type":"v1","addr":"172.21.15.144:6803","nonce":1699582162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":1699582162},{"type":"v1","addr":"172.21.15.144:6807","nonce":1699582162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":1699582162},{"type":"v1","addr":"172.21.15.144:6805","nonce":1699582162}]},"public_addr":"172.21.15.144:6801/1699582162","cluster_addr":"172.21.15.144:6803/1699582162","heartbeat_back_addr":"172.21.15.144:6807/1699582162","heartbeat_front_addr":"172.21.15.144:6805/1699582162","state":["exists","up"]},{"osd":3,"uuid":"ddf70d51-404d-491d-a6a8-15fca4ef01db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":3202935163},{"type":"v1","addr":"172.21.15.7:6811","nonce":3202935163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":3202935163},{"type":"v1","addr":"172.21.15.7:6813","nonce":3202935163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":3202935163},{"type":"v1","addr":"172.21.15.7:6817","nonce":3202935163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":3202935163},{"type":"v1","addr":"172.21.15.7:6815","nonce":3202935163}]},"public_addr":"172.21.15.7:6811/3202935163","cluster_addr":"172.21.15.7:6813/3202935163","heartbeat_back_addr":"172.21.15.7:6817/3202935163","heartbeat_front_addr":"172.21.15.7:6815/3202935163","state":["exists","up"]},{"osd":4,"uuid":"f2ae4340-accf-4ac0-a4d3-c08302712ce1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1058105724},{"type":"v1","addr":"172.21.15.18:6809","nonce":1058105724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":1058105724},{"type":"v1","addr":"172.21.15.18:6811","nonce":1058105724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":1058105724},{"type":"v1","addr":"172.21.15.18:6815","nonce":1058105724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":1058105724},{"type":"v1","addr":"172.21.15.18:6813","nonce":1058105724}]},"public_addr":"172.21.15.18:6809/1058105724","cluster_addr":"172.21.15.18:6811/1058105724","heartbeat_back_addr":"172.21.15.18:6815/1058105724","heartbeat_front_addr":"172.21.15.18:6813/1058105724","state":["exists","up"]},{"osd":5,"uuid":"d56abc37-de6f-47a4-9f5e-67224da78f4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":2814586621},{"type":"v1","addr":"172.21.15.144:6809","nonce":2814586621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":2814586621},{"type":"v1","addr":"172.21.15.144:6811","nonce":2814586621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":2814586621},{"type":"v1","addr":"172.21.15.144:6815","nonce":2814586621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":2814586621},{"type":"v1","addr":"172.21.15.144:6813","nonce":2814586621}]},"public_addr":"172.21.15.144:6809/2814586621","cluster_addr":"172.21.15.144:6811/2814586621","heartbeat_back_addr":"172.21.15.144:6815/2814586621","heartbeat_front_addr":"172.21.15.144:6813/2814586621","state":["exists","up"]},{"osd":6,"uuid":"9145650c-e9b1-4e5a-ae6f-17c8960146e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":3770978305},{"type":"v1","addr":"172.21.15.7:6819","nonce":3770978305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":3770978305},{"type":"v1","addr":"172.21.15.7:6821","nonce":3770978305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3770978305},{"type":"v1","addr":"172.21.15.7:6825","nonce":3770978305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":3770978305},{"type":"v1","addr":"172.21.15.7:6823","nonce":3770978305}]},"public_addr":"172.21.15.7:6819/3770978305","cluster_addr":"172.21.15.7:6821/3770978305","heartbeat_back_addr":"172.21.15.7:6825/3770978305","heartbeat_front_addr":"172.21.15.7:6823/3770978305","state":["exists","up"]},{"osd":7,"uuid":"ca658683-38f7-47ca-b32e-512fe4738ef1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":1322408496},{"type":"v1","addr":"172.21.15.18:6817","nonce":1322408496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1322408496},{"type":"v1","addr":"172.21.15.18:6819","nonce":1322408496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1322408496},{"type":"v1","addr":"172.21.15.18:6823","nonce":1322408496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1322408496},{"type":"v1","addr":"172.21.15.18:6821","nonce":1322408496}]},"public_addr":"172.21.15.18:6817/1322408496","cluster_addr":"172.21.15.18:6819/1322408496","heartbeat_back_addr":"172.21.15.18:6823/1322408496","heartbeat_front_addr":"172.21.15.18:6821/1322408496","state":["exists","up"]},{"osd":8,"uuid":"40d1f37e-6fac-40b9-9319-78f4fc3a6f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1011657022},{"type":"v1","addr":"172.21.15.144:6817","nonce":1011657022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1011657022},{"type":"v1","addr":"172.21.15.144:6819","nonce":1011657022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1011657022},{"type":"v1","addr":"172.21.15.144:6823","nonce":1011657022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":1011657022},{"type":"v1","addr":"172.21.15.144:6821","nonce":1011657022}]},"public_addr":"172.21.15.144:6817/1011657022","cluster_addr":"172.21.15.144:6819/1011657022","heartbeat_back_addr":"172.21.15.144:6823/1011657022","heartbeat_front_addr":"172.21.15.144:6821/1011657022","state":["exists","up"]},{"osd":9,"uuid":"ad12d6f7-fd21-49bd-a343-744f3cff4bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":256146339},{"type":"v1","addr":"172.21.15.7:6827","nonce":256146339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":256146339},{"type":"v1","addr":"172.21.15.7:6829","nonce":256146339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":256146339},{"type":"v1","addr":"172.21.15.7:6833","nonce":256146339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":256146339},{"type":"v1","addr":"172.21.15.7:6831","nonce":256146339}]},"public_addr":"172.21.15.7:6827/256146339","cluster_addr":"172.21.15.7:6829/256146339","heartbeat_back_addr":"172.21.15.7:6833/256146339","heartbeat_front_addr":"172.21.15.7:6831/256146339","state":["exists","up"]},{"osd":10,"uuid":"1317a2ad-ec15-4096-b2da-689475b7cacc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":2038885362},{"type":"v1","addr":"172.21.15.18:6825","nonce":2038885362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2038885362},{"type":"v1","addr":"172.21.15.18:6827","nonce":2038885362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2038885362},{"type":"v1","addr":"172.21.15.18:6831","nonce":2038885362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2038885362},{"type":"v1","addr":"172.21.15.18:6829","nonce":2038885362}]},"public_addr":"172.21.15.18:6825/2038885362","cluster_addr":"172.21.15.18:6827/2038885362","heartbeat_back_addr":"172.21.15.18:6831/2038885362","heartbeat_front_addr":"172.21.15.18:6829/2038885362","state":["exists","up"]},{"osd":11,"uuid":"f9252acb-7290-4923-89f3-844c868d4b39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":1047060848},{"type":"v1","addr":"172.21.15.144:6825","nonce":1047060848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":1047060848},{"type":"v1","addr":"172.21.15.144:6827","nonce":1047060848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":1047060848},{"type":"v1","addr":"172.21.15.144:6831","nonce":1047060848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":1047060848},{"type":"v1","addr":"172.21.15.144:6829","nonce":1047060848}]},"public_addr":"172.21.15.144:6825/1047060848","cluster_addr":"172.21.15.144:6827/1047060848","heartbeat_back_addr":"172.21.15.144:6831/1047060848","heartbeat_front_addr":"172.21.15.144:6829/1047060848","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:28:48.842729+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:29:13.946624+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:29:38.589666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:30:05.116339+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:30:30.562090+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:30:55.586210+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:31:22.138457+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:31:49.178090+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:32:13.687830+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:32:40.408193+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:33:06.044578+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:33:30.988851+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/1296137341":"2024-09-22T06:27:43.044484+0000","172.21.15.7:6801/3879502931":"2024-09-22T06:27:43.044484+0000","172.21.15.7:0/1926706877":"2024-09-22T06:26:40.520265+0000","172.21.15.7:0/2034370456":"2024-09-22T06:26:14.181426+0000","172.21.15.7:6801/3339522713":"2024-09-22T06:26:14.181426+0000","172.21.15.7:6800/3339522713":"2024-09-22T06:26:14.181426+0000","172.21.15.7:0/3586807770":"2024-09-22T06:26:14.181426+0000","172.21.15.7:0/1814223919":"2024-09-22T06:27:43.044484+0000","172.21.15.7:0/601150037":"2024-09-22T06:26:40.520265+0000","172.21.15.7:6800/3876787626":"2024-09-22T06:26:40.520265+0000","172.21.15.7:0/186444636":"2024-09-22T06:26:14.181426+0000","172.21.15.7:0/2180184348":"2024-09-22T06:26:40.520265+0000","172.21.15.7:6801/3876787626":"2024-09-22T06:26:40.520265+0000","172.21.15.7:0/2931793461":"2024-09-22T06:27:43.044484+0000","172.21.15.7:6800/3879502931":"2024-09-22T06:27:43.044484+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:34:26.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:26.731+0000 7f1046dd6640 1 -- 172.21.15.7:0/1785626579 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f102c0b65e0 msgr2=0x7f102c0b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:26.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:26.731+0000 7f1046dd6640 1 --2- 172.21.15.7:0/1785626579 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f102c0b65e0 0x7f102c0b8af0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1038033040 tx=0x7f1038032eb0 comp rx=0 tx=0).stop 2024-09-21T06:34:26.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:26.731+0000 7f1046dd6640 1 -- 172.21.15.7:0/1785626579 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1040108cf0 msgr2=0x7f104019ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:26.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:26.731+0000 7f1046dd6640 1 --2- 172.21.15.7:0/1785626579 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1040108cf0 0x7f104019ebb0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f103000e970 tx=0x7f103000ee30 comp rx=0 tx=0).stop 2024-09-21T06:34:26.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:26.731+0000 7f1046dd6640 1 -- 172.21.15.7:0/1785626579 shutdown_connections 2024-09-21T06:34:26.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:26.731+0000 7f1046dd6640 1 --2- 172.21.15.7:0/1785626579 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f102c0b65e0 0x7f102c0b8af0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:26.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:26.731+0000 7f1046dd6640 1 --2- 172.21.15.7:0/1785626579 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1040108cf0 0x7f104019ebb0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:26.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:26.731+0000 7f1046dd6640 1 --2- 172.21.15.7:0/1785626579 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10401083a0 0x7f1040199910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:26.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:26.731+0000 7f1046dd6640 1 --2- 172.21.15.7:0/1785626579 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1040102a60 0x7f1040199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:26.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:26.731+0000 7f1046dd6640 1 -- 172.21.15.7:0/1785626579 >> 172.21.15.7:0/1785626579 conn(0x7f1040079730 msgr2=0x7f1040101490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:26.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:26.731+0000 7f1046dd6640 1 -- 172.21.15.7:0/1785626579 shutdown_connections 2024-09-21T06:34:26.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:26.731+0000 7f1046dd6640 1 -- 172.21.15.7:0/1785626579 wait complete. 2024-09-21T06:34:27.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:26 smithi144 ceph-mon[34653]: pgmap v264: 97 pgs: 13 creating+peering, 60 unknown, 24 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:27.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:26 smithi144 ceph-mon[34653]: mds.? [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] up:active 2024-09-21T06:34:27.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:26 smithi144 ceph-mon[34653]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T06:34:27.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:26 smithi144 ceph-mon[34653]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T06:34:27.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:26 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/1785626579' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:34:27.291 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:26 smithi018 ceph-mon[34477]: pgmap v264: 97 pgs: 13 creating+peering, 60 unknown, 24 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:27.291 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:26 smithi018 ceph-mon[34477]: mds.? [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] up:active 2024-09-21T06:34:27.291 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:26 smithi018 ceph-mon[34477]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T06:34:27.291 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:26 smithi018 ceph-mon[34477]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T06:34:27.291 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:26 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/1785626579' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:34:27.325 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:26 smithi007 ceph-mon[30983]: pgmap v264: 97 pgs: 13 creating+peering, 60 unknown, 24 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:34:27.325 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:26 smithi007 ceph-mon[30983]: mds.? [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] up:active 2024-09-21T06:34:27.325 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:26 smithi007 ceph-mon[30983]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T06:34:27.325 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:26 smithi007 ceph-mon[30983]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T06:34:27.325 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:26 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/1785626579' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:34:27.353 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T06:34:27.609 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:34:28.004 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:27 smithi007 ceph-mon[30983]: pgmap v265: 97 pgs: 7 creating+peering, 13 unknown, 77 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 4 op/s 2024-09-21T06:34:28.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:28.093+0000 7f5898c87640 1 -- 172.21.15.7:0/345933601 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f58941083a0 msgr2=0x7f58941087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:28.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:28.093+0000 7f5898c87640 1 --2- 172.21.15.7:0/345933601 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f58941083a0 0x7f58941087b0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f5888009900 tx=0x7f588802a410 comp rx=0 tx=0).stop 2024-09-21T06:34:28.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:28.093+0000 7f5898c87640 1 -- 172.21.15.7:0/345933601 shutdown_connections 2024-09-21T06:34:28.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:28.093+0000 7f5898c87640 1 --2- 172.21.15.7:0/345933601 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5894108cf0 0x7f589410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:28.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:28.093+0000 7f5898c87640 1 --2- 172.21.15.7:0/345933601 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f58941083a0 0x7f58941087b0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:28.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:28.093+0000 7f5898c87640 1 --2- 172.21.15.7:0/345933601 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5894102a60 0x7f5894102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:28.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:28.093+0000 7f5898c87640 1 -- 172.21.15.7:0/345933601 >> 172.21.15.7:0/345933601 conn(0x7f5894079730 msgr2=0x7f5894079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:28.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:28.093+0000 7f5898c87640 1 -- 172.21.15.7:0/345933601 shutdown_connections 2024-09-21T06:34:28.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:28.093+0000 7f5898c87640 1 -- 172.21.15.7:0/345933601 wait complete. 2024-09-21T06:34:28.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:28.094+0000 7f5898c87640 1 Processor -- start 2024-09-21T06:34:28.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:28.094+0000 7f5898c87640 1 -- start start 2024-09-21T06:34:28.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:28.094+0000 7f5898c87640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5894102a60 0x7f589419a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:28.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:28.094+0000 7f5898c87640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58941083a0 0x7f589419aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:28.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:28.094+0000 7f5898c87640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5894108cf0 0x7f589419fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:28.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:28.094+0000 7f5898c87640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5894112960 con 0x7f5894102a60 2024-09-21T06:34:28.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:28.094+0000 7f5898c87640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f58941127e0 con 0x7f58941083a0 2024-09-21T06:34:28.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:28.094+0000 7f5898c87640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5894112ae0 con 0x7f5894108cf0 2024-09-21T06:34:28.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:28.095+0000 7f589259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5894102a60 0x7f589419a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:28.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:28.095+0000 7f589259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5894102a60 0x7f589419a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40614/0 (socket says 172.21.15.7:40614) 2024-09-21T06:34:28.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:28.095+0000 7f589259c640 1 -- 172.21.15.7:0/1567737217 learned_addr learned my addr 172.21.15.7:0/1567737217 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:34:28.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:28.095+0000 7f5891d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58941083a0 0x7f589419aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:28.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:28.095+0000 7f5892d9d640 1 --2- 172.21.15.7:0/1567737217 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5894108cf0 0x7f589419fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:28.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:28.095+0000 7f589259c640 1 -- 172.21.15.7:0/1567737217 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5894108cf0 msgr2=0x7f589419fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:28.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:28.095+0000 7f589259c640 1 --2- 172.21.15.7:0/1567737217 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5894108cf0 0x7f589419fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:28.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:28.095+0000 7f589259c640 1 -- 172.21.15.7:0/1567737217 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58941083a0 msgr2=0x7f589419aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:28.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:28.095+0000 7f589259c640 1 --2- 172.21.15.7:0/1567737217 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58941083a0 0x7f589419aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:28.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:28.095+0000 7f589259c640 1 -- 172.21.15.7:0/1567737217 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58941a03f0 con 0x7f5894102a60 2024-09-21T06:34:28.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:28.095+0000 7f5891d9b640 1 --2- 172.21.15.7:0/1567737217 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58941083a0 0x7f589419aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:34:28.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:28.095+0000 7f589259c640 1 --2- 172.21.15.7:0/1567737217 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5894102a60 0x7f589419a480 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f588400eab0 tx=0x7f588400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:28.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:28.095+0000 7f58837fe640 1 -- 172.21.15.7:0/1567737217 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f588400cd80 con 0x7f5894102a60 2024-09-21T06:34:28.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:28.095+0000 7f5898c87640 1 -- 172.21.15.7:0/1567737217 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58941a06e0 con 0x7f5894102a60 2024-09-21T06:34:28.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:28.095+0000 7f58837fe640 1 -- 172.21.15.7:0/1567737217 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5884011920 con 0x7f5894102a60 2024-09-21T06:34:28.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:28.095+0000 7f58837fe640 1 -- 172.21.15.7:0/1567737217 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5884010930 con 0x7f5894102a60 2024-09-21T06:34:28.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:28.095+0000 7f5898c87640 1 -- 172.21.15.7:0/1567737217 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58941a6e40 con 0x7f5894102a60 2024-09-21T06:34:28.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:28.096+0000 7f5898c87640 1 -- 172.21.15.7:0/1567737217 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5894102e70 con 0x7f5894102a60 2024-09-21T06:34:28.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:28.098+0000 7f58837fe640 1 -- 172.21.15.7:0/1567737217 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 21) ==== 154528+0+0 (secure 0 0 0) 0x7f5884011470 con 0x7f5894102a60 2024-09-21T06:34:28.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:28.099+0000 7f58837fe640 1 --2- 172.21.15.7:0/1567737217 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f587c0b6560 0x7f587c0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:28.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:28.099+0000 7f5891d9b640 1 --2- 172.21.15.7:0/1567737217 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f587c0b6560 0x7f587c0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:28.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:28.099+0000 7f58837fe640 1 -- 172.21.15.7:0/1567737217 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7f58840e7890 con 0x7f5894102a60 2024-09-21T06:34:28.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:28.099+0000 7f5891d9b640 1 --2- 172.21.15.7:0/1567737217 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f587c0b6560 0x7f587c0b8a70 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5888000c00 tx=0x7f5888031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:28.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:28.102+0000 7f58837fe640 1 -- 172.21.15.7:0/1567737217 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5884016030 con 0x7f5894102a60 2024-09-21T06:34:28.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:27 smithi144 ceph-mon[34653]: pgmap v265: 97 pgs: 7 creating+peering, 13 unknown, 77 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 4 op/s 2024-09-21T06:34:28.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:28.291+0000 7f5898c87640 1 -- 172.21.15.7:0/1567737217 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f589419b5b0 con 0x7f5894102a60 2024-09-21T06:34:28.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:28.292+0000 7f58837fe640 1 -- 172.21.15.7:0/1567737217 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+22508 (secure 0 0 0) 0x7f589419b5b0 con 0x7f5894102a60 2024-09-21T06:34:28.294 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:34:28.294 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":75,"fsid":"347cb918-77e2-11ef-baf5-efdc52797490","created":"2024-09-21T06:25:51.925032+0000","modified":"2024-09-21T06:34:24.627214+0000","last_up_change":"2024-09-21T06:33:32.888843+0000","last_in_change":"2024-09-21T06:33:09.926778+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:29:41.514179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:34:20.531755+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T06:34:22.552541+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1be5c4a4-3931-4d8b-95c7-c05f5b73fcfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":942632794},{"type":"v1","addr":"172.21.15.7:6803","nonce":942632794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":942632794},{"type":"v1","addr":"172.21.15.7:6805","nonce":942632794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":942632794},{"type":"v1","addr":"172.21.15.7:6809","nonce":942632794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":942632794},{"type":"v1","addr":"172.21.15.7:6807","nonce":942632794}]},"public_addr":"172.21.15.7:6803/942632794","cluster_addr":"172.21.15.7:6805/942632794","heartbeat_back_addr":"172.21.15.7:6809/942632794","heartbeat_front_addr":"172.21.15.7:6807/942632794","state":["exists","up"]},{"osd":1,"uuid":"7ae136a8-c614-47e5-b265-c6cfa857a7fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1839342931},{"type":"v1","addr":"172.21.15.18:6801","nonce":1839342931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1839342931},{"type":"v1","addr":"172.21.15.18:6803","nonce":1839342931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1839342931},{"type":"v1","addr":"172.21.15.18:6807","nonce":1839342931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1839342931},{"type":"v1","addr":"172.21.15.18:6805","nonce":1839342931}]},"public_addr":"172.21.15.18:6801/1839342931","cluster_addr":"172.21.15.18:6803/1839342931","heartbeat_back_addr":"172.21.15.18:6807/1839342931","heartbeat_front_addr":"172.21.15.18:6805/1839342931","state":["exists","up"]},{"osd":2,"uuid":"97b13994-4680-4573-9c2e-ac65ea740e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":1699582162},{"type":"v1","addr":"172.21.15.144:6801","nonce":1699582162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":1699582162},{"type":"v1","addr":"172.21.15.144:6803","nonce":1699582162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":1699582162},{"type":"v1","addr":"172.21.15.144:6807","nonce":1699582162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":1699582162},{"type":"v1","addr":"172.21.15.144:6805","nonce":1699582162}]},"public_addr":"172.21.15.144:6801/1699582162","cluster_addr":"172.21.15.144:6803/1699582162","heartbeat_back_addr":"172.21.15.144:6807/1699582162","heartbeat_front_addr":"172.21.15.144:6805/1699582162","state":["exists","up"]},{"osd":3,"uuid":"ddf70d51-404d-491d-a6a8-15fca4ef01db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":3202935163},{"type":"v1","addr":"172.21.15.7:6811","nonce":3202935163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":3202935163},{"type":"v1","addr":"172.21.15.7:6813","nonce":3202935163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":3202935163},{"type":"v1","addr":"172.21.15.7:6817","nonce":3202935163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":3202935163},{"type":"v1","addr":"172.21.15.7:6815","nonce":3202935163}]},"public_addr":"172.21.15.7:6811/3202935163","cluster_addr":"172.21.15.7:6813/3202935163","heartbeat_back_addr":"172.21.15.7:6817/3202935163","heartbeat_front_addr":"172.21.15.7:6815/3202935163","state":["exists","up"]},{"osd":4,"uuid":"f2ae4340-accf-4ac0-a4d3-c08302712ce1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1058105724},{"type":"v1","addr":"172.21.15.18:6809","nonce":1058105724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":1058105724},{"type":"v1","addr":"172.21.15.18:6811","nonce":1058105724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":1058105724},{"type":"v1","addr":"172.21.15.18:6815","nonce":1058105724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":1058105724},{"type":"v1","addr":"172.21.15.18:6813","nonce":1058105724}]},"public_addr":"172.21.15.18:6809/1058105724","cluster_addr":"172.21.15.18:6811/1058105724","heartbeat_back_addr":"172.21.15.18:6815/1058105724","heartbeat_front_addr":"172.21.15.18:6813/1058105724","state":["exists","up"]},{"osd":5,"uuid":"d56abc37-de6f-47a4-9f5e-67224da78f4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":2814586621},{"type":"v1","addr":"172.21.15.144:6809","nonce":2814586621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":2814586621},{"type":"v1","addr":"172.21.15.144:6811","nonce":2814586621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":2814586621},{"type":"v1","addr":"172.21.15.144:6815","nonce":2814586621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":2814586621},{"type":"v1","addr":"172.21.15.144:6813","nonce":2814586621}]},"public_addr":"172.21.15.144:6809/2814586621","cluster_addr":"172.21.15.144:6811/2814586621","heartbeat_back_addr":"172.21.15.144:6815/2814586621","heartbeat_front_addr":"172.21.15.144:6813/2814586621","state":["exists","up"]},{"osd":6,"uuid":"9145650c-e9b1-4e5a-ae6f-17c8960146e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":3770978305},{"type":"v1","addr":"172.21.15.7:6819","nonce":3770978305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":3770978305},{"type":"v1","addr":"172.21.15.7:6821","nonce":3770978305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3770978305},{"type":"v1","addr":"172.21.15.7:6825","nonce":3770978305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":3770978305},{"type":"v1","addr":"172.21.15.7:6823","nonce":3770978305}]},"public_addr":"172.21.15.7:6819/3770978305","cluster_addr":"172.21.15.7:6821/3770978305","heartbeat_back_addr":"172.21.15.7:6825/3770978305","heartbeat_front_addr":"172.21.15.7:6823/3770978305","state":["exists","up"]},{"osd":7,"uuid":"ca658683-38f7-47ca-b32e-512fe4738ef1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":1322408496},{"type":"v1","addr":"172.21.15.18:6817","nonce":1322408496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1322408496},{"type":"v1","addr":"172.21.15.18:6819","nonce":1322408496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1322408496},{"type":"v1","addr":"172.21.15.18:6823","nonce":1322408496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1322408496},{"type":"v1","addr":"172.21.15.18:6821","nonce":1322408496}]},"public_addr":"172.21.15.18:6817/1322408496","cluster_addr":"172.21.15.18:6819/1322408496","heartbeat_back_addr":"172.21.15.18:6823/1322408496","heartbeat_front_addr":"172.21.15.18:6821/1322408496","state":["exists","up"]},{"osd":8,"uuid":"40d1f37e-6fac-40b9-9319-78f4fc3a6f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1011657022},{"type":"v1","addr":"172.21.15.144:6817","nonce":1011657022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1011657022},{"type":"v1","addr":"172.21.15.144:6819","nonce":1011657022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1011657022},{"type":"v1","addr":"172.21.15.144:6823","nonce":1011657022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":1011657022},{"type":"v1","addr":"172.21.15.144:6821","nonce":1011657022}]},"public_addr":"172.21.15.144:6817/1011657022","cluster_addr":"172.21.15.144:6819/1011657022","heartbeat_back_addr":"172.21.15.144:6823/1011657022","heartbeat_front_addr":"172.21.15.144:6821/1011657022","state":["exists","up"]},{"osd":9,"uuid":"ad12d6f7-fd21-49bd-a343-744f3cff4bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":256146339},{"type":"v1","addr":"172.21.15.7:6827","nonce":256146339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":256146339},{"type":"v1","addr":"172.21.15.7:6829","nonce":256146339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":256146339},{"type":"v1","addr":"172.21.15.7:6833","nonce":256146339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":256146339},{"type":"v1","addr":"172.21.15.7:6831","nonce":256146339}]},"public_addr":"172.21.15.7:6827/256146339","cluster_addr":"172.21.15.7:6829/256146339","heartbeat_back_addr":"172.21.15.7:6833/256146339","heartbeat_front_addr":"172.21.15.7:6831/256146339","state":["exists","up"]},{"osd":10,"uuid":"1317a2ad-ec15-4096-b2da-689475b7cacc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":2038885362},{"type":"v1","addr":"172.21.15.18:6825","nonce":2038885362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2038885362},{"type":"v1","addr":"172.21.15.18:6827","nonce":2038885362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2038885362},{"type":"v1","addr":"172.21.15.18:6831","nonce":2038885362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2038885362},{"type":"v1","addr":"172.21.15.18:6829","nonce":2038885362}]},"public_addr":"172.21.15.18:6825/2038885362","cluster_addr":"172.21.15.18:6827/2038885362","heartbeat_back_addr":"172.21.15.18:6831/2038885362","heartbeat_front_addr":"172.21.15.18:6829/2038885362","state":["exists","up"]},{"osd":11,"uuid":"f9252acb-7290-4923-89f3-844c868d4b39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":1047060848},{"type":"v1","addr":"172.21.15.144:6825","nonce":1047060848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":1047060848},{"type":"v1","addr":"172.21.15.144:6827","nonce":1047060848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":1047060848},{"type":"v1","addr":"172.21.15.144:6831","nonce":1047060848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":1047060848},{"type":"v1","addr":"172.21.15.144:6829","nonce":1047060848}]},"public_addr":"172.21.15.144:6825/1047060848","cluster_addr":"172.21.15.144:6827/1047060848","heartbeat_back_addr":"172.21.15.144:6831/1047060848","heartbeat_front_addr":"172.21.15.144:6829/1047060848","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:28:48.842729+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:29:13.946624+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:29:38.589666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:30:05.116339+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:30:30.562090+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:30:55.586210+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:31:22.138457+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:31:49.178090+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:32:13.687830+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:32:40.408193+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:33:06.044578+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:33:30.988851+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/1296137341":"2024-09-22T06:27:43.044484+0000","172.21.15.7:6801/3879502931":"2024-09-22T06:27:43.044484+0000","172.21.15.7:0/1926706877":"2024-09-22T06:26:40.520265+0000","172.21.15.7:0/2034370456":"2024-09-22T06:26:14.181426+0000","172.21.15.7:6801/3339522713":"2024-09-22T06:26:14.181426+0000","172.21.15.7:6800/3339522713":"2024-09-22T06:26:14.181426+0000","172.21.15.7:0/3586807770":"2024-09-22T06:26:14.181426+0000","172.21.15.7:0/1814223919":"2024-09-22T06:27:43.044484+0000","172.21.15.7:0/601150037":"2024-09-22T06:26:40.520265+0000","172.21.15.7:6800/3876787626":"2024-09-22T06:26:40.520265+0000","172.21.15.7:0/186444636":"2024-09-22T06:26:14.181426+0000","172.21.15.7:0/2180184348":"2024-09-22T06:26:40.520265+0000","172.21.15.7:6801/3876787626":"2024-09-22T06:26:40.520265+0000","172.21.15.7:0/2931793461":"2024-09-22T06:27:43.044484+0000","172.21.15.7:6800/3879502931":"2024-09-22T06:27:43.044484+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:34:28.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:28.295+0000 7f5898c87640 1 -- 172.21.15.7:0/1567737217 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f587c0b6560 msgr2=0x7f587c0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:28.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:28.295+0000 7f5898c87640 1 --2- 172.21.15.7:0/1567737217 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f587c0b6560 0x7f587c0b8a70 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5888000c00 tx=0x7f5888031400 comp rx=0 tx=0).stop 2024-09-21T06:34:28.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:28.295+0000 7f5898c87640 1 -- 172.21.15.7:0/1567737217 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5894102a60 msgr2=0x7f589419a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:28.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:28.295+0000 7f5898c87640 1 --2- 172.21.15.7:0/1567737217 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5894102a60 0x7f589419a480 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f588400eab0 tx=0x7f588400eeb0 comp rx=0 tx=0).stop 2024-09-21T06:34:28.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:28.295+0000 7f5898c87640 1 -- 172.21.15.7:0/1567737217 shutdown_connections 2024-09-21T06:34:28.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:28.295+0000 7f5898c87640 1 --2- 172.21.15.7:0/1567737217 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f587c0b6560 0x7f587c0b8a70 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:28.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:28.295+0000 7f5898c87640 1 --2- 172.21.15.7:0/1567737217 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5894108cf0 0x7f589419fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:28.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:28.295+0000 7f5898c87640 1 --2- 172.21.15.7:0/1567737217 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58941083a0 0x7f589419aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:28.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:28.295+0000 7f5898c87640 1 --2- 172.21.15.7:0/1567737217 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5894102a60 0x7f589419a480 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:28.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:28.295+0000 7f5898c87640 1 -- 172.21.15.7:0/1567737217 >> 172.21.15.7:0/1567737217 conn(0x7f5894079730 msgr2=0x7f589406b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:28.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:28.295+0000 7f5898c87640 1 -- 172.21.15.7:0/1567737217 shutdown_connections 2024-09-21T06:34:28.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:28.295+0000 7f5898c87640 1 -- 172.21.15.7:0/1567737217 wait complete. 2024-09-21T06:34:28.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:27 smithi018 ceph-mon[34477]: pgmap v265: 97 pgs: 7 creating+peering, 13 unknown, 77 active+clean; 577 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 4 op/s 2024-09-21T06:34:28.888 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph fs set cephfs standby_count_wanted 0 2024-09-21T06:34:29.147 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:34:29.268 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:28 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/1567737217' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:34:29.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:28 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/1567737217' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:34:29.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:28 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/1567737217' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:34:29.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:29.638+0000 7fbd3f44c640 1 -- 172.21.15.7:0/2628569522 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd38102a60 msgr2=0x7fbd38102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:29.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:29.638+0000 7fbd3f44c640 1 --2- 172.21.15.7:0/2628569522 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd38102a60 0x7fbd38102e70 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fbd34009900 tx=0x7fbd3402a410 comp rx=0 tx=0).stop 2024-09-21T06:34:29.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:29.638+0000 7fbd3f44c640 1 -- 172.21.15.7:0/2628569522 shutdown_connections 2024-09-21T06:34:29.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:29.638+0000 7fbd3f44c640 1 --2- 172.21.15.7:0/2628569522 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbd38108cf0 0x7fbd3810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:29.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:29.638+0000 7fbd3f44c640 1 --2- 172.21.15.7:0/2628569522 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd381083a0 0x7fbd381087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:29.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:29.638+0000 7fbd3f44c640 1 --2- 172.21.15.7:0/2628569522 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd38102a60 0x7fbd38102e70 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:29.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:29.638+0000 7fbd3f44c640 1 -- 172.21.15.7:0/2628569522 >> 172.21.15.7:0/2628569522 conn(0x7fbd38079730 msgr2=0x7fbd38079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:29.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:29.638+0000 7fbd3f44c640 1 -- 172.21.15.7:0/2628569522 shutdown_connections 2024-09-21T06:34:29.641 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:29.638+0000 7fbd3f44c640 1 -- 172.21.15.7:0/2628569522 wait complete. 2024-09-21T06:34:29.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:29.639+0000 7fbd3f44c640 1 Processor -- start 2024-09-21T06:34:29.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:29.639+0000 7fbd3f44c640 1 -- start start 2024-09-21T06:34:29.642 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:29.639+0000 7fbd3f44c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd38102a60 0x7fbd3819c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:29.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:29.639+0000 7fbd3f44c640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbd381083a0 0x7fbd3819cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:29.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:29.639+0000 7fbd3f44c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd38108cf0 0x7fbd381a1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:29.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:29.639+0000 7fbd3f44c640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbd381118c0 con 0x7fbd38108cf0 2024-09-21T06:34:29.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:29.639+0000 7fbd3f44c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fbd38111740 con 0x7fbd38102a60 2024-09-21T06:34:29.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:29.639+0000 7fbd3f44c640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fbd38111a40 con 0x7fbd381083a0 2024-09-21T06:34:29.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:29.639+0000 7fbd3d9e9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd38108cf0 0x7fbd381a1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:29.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:29.639+0000 7fbd3d1e8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd38102a60 0x7fbd3819c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:29.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:29.639+0000 7fbd3d9e9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd38108cf0 0x7fbd381a1f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40636/0 (socket says 172.21.15.7:40636) 2024-09-21T06:34:29.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:29.639+0000 7fbd3d9e9640 1 -- 172.21.15.7:0/2681723150 learned_addr learned my addr 172.21.15.7:0/2681723150 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:34:29.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:29.639+0000 7fbd3c9e7640 1 --2- 172.21.15.7:0/2681723150 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbd381083a0 0x7fbd3819cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:29.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:29.640+0000 7fbd3d9e9640 1 -- 172.21.15.7:0/2681723150 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbd381083a0 msgr2=0x7fbd3819cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:29.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:29.640+0000 7fbd3d9e9640 1 --2- 172.21.15.7:0/2681723150 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbd381083a0 0x7fbd3819cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:29.643 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:29.640+0000 7fbd3d9e9640 1 -- 172.21.15.7:0/2681723150 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd38102a60 msgr2=0x7fbd3819c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:29.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:29.640+0000 7fbd3d9e9640 1 --2- 172.21.15.7:0/2681723150 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd38102a60 0x7fbd3819c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:29.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:29.640+0000 7fbd3d9e9640 1 -- 172.21.15.7:0/2681723150 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd381a2630 con 0x7fbd38108cf0 2024-09-21T06:34:29.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:29.640+0000 7fbd3d9e9640 1 --2- 172.21.15.7:0/2681723150 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd38108cf0 0x7fbd381a1f00 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fbd3000b970 tx=0x7fbd3000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:29.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:29.640+0000 7fbd2e7fc640 1 -- 172.21.15.7:0/2681723150 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd30019070 con 0x7fbd38108cf0 2024-09-21T06:34:29.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:29.640+0000 7fbd3f44c640 1 -- 172.21.15.7:0/2681723150 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd381a2920 con 0x7fbd38108cf0 2024-09-21T06:34:29.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:29.640+0000 7fbd2e7fc640 1 -- 172.21.15.7:0/2681723150 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd30014440 con 0x7fbd38108cf0 2024-09-21T06:34:29.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:29.640+0000 7fbd2e7fc640 1 -- 172.21.15.7:0/2681723150 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd300075d0 con 0x7fbd38108cf0 2024-09-21T06:34:29.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:29.640+0000 7fbd3f44c640 1 -- 172.21.15.7:0/2681723150 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd381a9080 con 0x7fbd38108cf0 2024-09-21T06:34:29.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:29.641+0000 7fbd3f44c640 1 -- 172.21.15.7:0/2681723150 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd38102e70 con 0x7fbd38108cf0 2024-09-21T06:34:29.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:29.643+0000 7fbd2e7fc640 1 -- 172.21.15.7:0/2681723150 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 21) ==== 154528+0+0 (secure 0 0 0) 0x7fbd3001c070 con 0x7fbd38108cf0 2024-09-21T06:34:29.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:29.644+0000 7fbd2e7fc640 1 --2- 172.21.15.7:0/2681723150 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fbd240b6560 0x7fbd240b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:29.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:29.644+0000 7fbd3d1e8640 1 --2- 172.21.15.7:0/2681723150 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fbd240b6560 0x7fbd240b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:29.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:29.644+0000 7fbd2e7fc640 1 -- 172.21.15.7:0/2681723150 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7fbd300e6cb0 con 0x7fbd38108cf0 2024-09-21T06:34:29.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:29.644+0000 7fbd3d1e8640 1 --2- 172.21.15.7:0/2681723150 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fbd240b6560 0x7fbd240b8a70 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fbd34031440 tx=0x7fbd34009560 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:29.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:29.647+0000 7fbd2e7fc640 1 -- 172.21.15.7:0/2681723150 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbd300b18e0 con 0x7fbd38108cf0 2024-09-21T06:34:29.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:29.873+0000 7fbd3f44c640 1 -- 172.21.15.7:0/2681723150 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fbd3819d7f0 con 0x7fbd38108cf0 2024-09-21T06:34:29.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:29.962+0000 7fbd2e7fc640 1 -- 172.21.15.7:0/2681723150 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7fbd3819d7f0 con 0x7fbd38108cf0 2024-09-21T06:34:29.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:29.965+0000 7fbd3f44c640 1 -- 172.21.15.7:0/2681723150 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fbd240b6560 msgr2=0x7fbd240b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:29.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:29.965+0000 7fbd3f44c640 1 --2- 172.21.15.7:0/2681723150 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fbd240b6560 0x7fbd240b8a70 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fbd34031440 tx=0x7fbd34009560 comp rx=0 tx=0).stop 2024-09-21T06:34:29.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:29.965+0000 7fbd3f44c640 1 -- 172.21.15.7:0/2681723150 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd38108cf0 msgr2=0x7fbd381a1f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:29.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:29.965+0000 7fbd3f44c640 1 --2- 172.21.15.7:0/2681723150 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd38108cf0 0x7fbd381a1f00 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fbd3000b970 tx=0x7fbd3000be30 comp rx=0 tx=0).stop 2024-09-21T06:34:29.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:29.965+0000 7fbd3f44c640 1 -- 172.21.15.7:0/2681723150 shutdown_connections 2024-09-21T06:34:29.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:29.965+0000 7fbd3f44c640 1 --2- 172.21.15.7:0/2681723150 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fbd240b6560 0x7fbd240b8a70 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:29.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:29.965+0000 7fbd3f44c640 1 --2- 172.21.15.7:0/2681723150 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd38108cf0 0x7fbd381a1f00 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:29.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:29.965+0000 7fbd3f44c640 1 --2- 172.21.15.7:0/2681723150 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbd381083a0 0x7fbd3819cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:29.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:29.965+0000 7fbd3f44c640 1 --2- 172.21.15.7:0/2681723150 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd38102a60 0x7fbd3819c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:29.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:29.965+0000 7fbd3f44c640 1 -- 172.21.15.7:0/2681723150 >> 172.21.15.7:0/2681723150 conn(0x7fbd38079730 msgr2=0x7fbd38101390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:29.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:29.965+0000 7fbd3f44c640 1 -- 172.21.15.7:0/2681723150 shutdown_connections 2024-09-21T06:34:29.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:29.965+0000 7fbd3f44c640 1 -- 172.21.15.7:0/2681723150 wait complete. 2024-09-21T06:34:30.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:29 smithi018 ceph-mon[34477]: pgmap v266: 97 pgs: 97 active+clean; 579 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 6 op/s 2024-09-21T06:34:30.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:29 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/2681723150' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T06:34:30.119 INFO:journalctl@ceph.mds.b.smithi018.stdout:Sep 21 06:34:29 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-b[63345]: 2024-09-21T06:34:29.864+0000 7f0ee99e9640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T06:34:30.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:29 smithi144 ceph-mon[34653]: pgmap v266: 97 pgs: 97 active+clean; 579 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 6 op/s 2024-09-21T06:34:30.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:29 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/2681723150' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T06:34:30.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:29 smithi007 ceph-mon[30983]: pgmap v266: 97 pgs: 97 active+clean; 579 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 6 op/s 2024-09-21T06:34:30.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:29 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2681723150' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T06:34:30.767 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-09-21T06:34:30.767 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph fs set cephfs max_mds 3 2024-09-21T06:34:31.029 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:34:31.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:30 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2681723150' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-21T06:34:31.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:30 smithi007 ceph-mon[30983]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T06:34:31.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:30 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/2681723150' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-21T06:34:31.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:30 smithi144 ceph-mon[34653]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T06:34:31.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:30 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/2681723150' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-21T06:34:31.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:30 smithi018 ceph-mon[34477]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T06:34:31.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:31.540+0000 7fc843349640 1 -- 172.21.15.7:0/2588010408 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc83c110200 msgr2=0x7fc83c112620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:31.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:31.540+0000 7fc843349640 1 --2- 172.21.15.7:0/2588010408 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc83c110200 0x7fc83c112620 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc82c009ca0 tx=0x7fc82c02a950 comp rx=0 tx=0).stop 2024-09-21T06:34:31.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:31.540+0000 7fc843349640 1 -- 172.21.15.7:0/2588010408 shutdown_connections 2024-09-21T06:34:31.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:31.540+0000 7fc843349640 1 --2- 172.21.15.7:0/2588010408 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc83c110200 0x7fc83c112620 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:31.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:31.540+0000 7fc843349640 1 --2- 172.21.15.7:0/2588010408 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc83c102fa0 0x7fc83c10fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:31.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:31.540+0000 7fc843349640 1 --2- 172.21.15.7:0/2588010408 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc83c102650 0x7fc83c102a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:31.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:31.540+0000 7fc843349640 1 -- 172.21.15.7:0/2588010408 >> 172.21.15.7:0/2588010408 conn(0x7fc83c079730 msgr2=0x7fc83c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:31.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:31.540+0000 7fc843349640 1 -- 172.21.15.7:0/2588010408 shutdown_connections 2024-09-21T06:34:31.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:31.540+0000 7fc843349640 1 -- 172.21.15.7:0/2588010408 wait complete. 2024-09-21T06:34:31.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:31.541+0000 7fc843349640 1 Processor -- start 2024-09-21T06:34:31.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:31.541+0000 7fc843349640 1 -- start start 2024-09-21T06:34:31.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:31.541+0000 7fc843349640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc83c102650 0x7fc83c19c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:31.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:31.541+0000 7fc843349640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc83c102fa0 0x7fc83c19cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:31.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:31.541+0000 7fc843349640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc83c110200 0x7fc83c1a1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:31.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:31.541+0000 7fc843349640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc83c115c70 con 0x7fc83c110200 2024-09-21T06:34:31.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:31.541+0000 7fc843349640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc83c115af0 con 0x7fc83c102fa0 2024-09-21T06:34:31.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:31.541+0000 7fc843349640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc83c115df0 con 0x7fc83c102650 2024-09-21T06:34:31.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:31.541+0000 7fc8418e6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc83c110200 0x7fc83c1a1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:31.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:31.541+0000 7fc8418e6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc83c110200 0x7fc83c1a1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49466/0 (socket says 172.21.15.7:49466) 2024-09-21T06:34:31.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:31.541+0000 7fc8418e6640 1 -- 172.21.15.7:0/3585715200 learned_addr learned my addr 172.21.15.7:0/3585715200 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:34:31.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:31.542+0000 7fc8408e4640 1 --2- 172.21.15.7:0/3585715200 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc83c102fa0 0x7fc83c19cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:31.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:31.542+0000 7fc8410e5640 1 --2- 172.21.15.7:0/3585715200 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc83c102650 0x7fc83c19c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:31.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:31.542+0000 7fc8418e6640 1 -- 172.21.15.7:0/3585715200 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc83c102650 msgr2=0x7fc83c19c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:31.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:31.542+0000 7fc8418e6640 1 --2- 172.21.15.7:0/3585715200 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc83c102650 0x7fc83c19c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:31.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:31.542+0000 7fc8418e6640 1 -- 172.21.15.7:0/3585715200 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc83c102fa0 msgr2=0x7fc83c19cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:31.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:31.542+0000 7fc8418e6640 1 --2- 172.21.15.7:0/3585715200 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc83c102fa0 0x7fc83c19cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:31.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:31.542+0000 7fc8418e6640 1 -- 172.21.15.7:0/3585715200 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc83c1a2550 con 0x7fc83c110200 2024-09-21T06:34:31.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:31.542+0000 7fc8410e5640 1 --2- 172.21.15.7:0/3585715200 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc83c102650 0x7fc83c19c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:34:31.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:31.542+0000 7fc8408e4640 1 --2- 172.21.15.7:0/3585715200 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc83c102fa0 0x7fc83c19cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:34:31.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:31.542+0000 7fc8418e6640 1 --2- 172.21.15.7:0/3585715200 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc83c110200 0x7fc83c1a1e20 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc82c02ae70 tx=0x7fc82c02f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:31.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:31.542+0000 7fc83a7fc640 1 -- 172.21.15.7:0/3585715200 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc82c034040 con 0x7fc83c110200 2024-09-21T06:34:31.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:31.542+0000 7fc843349640 1 -- 172.21.15.7:0/3585715200 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc83c1a27e0 con 0x7fc83c110200 2024-09-21T06:34:31.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:31.542+0000 7fc83a7fc640 1 -- 172.21.15.7:0/3585715200 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc82c0308f0 con 0x7fc83c110200 2024-09-21T06:34:31.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:31.542+0000 7fc83a7fc640 1 -- 172.21.15.7:0/3585715200 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc82c0047f0 con 0x7fc83c110200 2024-09-21T06:34:31.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:31.542+0000 7fc843349640 1 -- 172.21.15.7:0/3585715200 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc83c1a8fa0 con 0x7fc83c110200 2024-09-21T06:34:31.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:31.543+0000 7fc843349640 1 -- 172.21.15.7:0/3585715200 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc83c102a60 con 0x7fc83c110200 2024-09-21T06:34:31.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:31.546+0000 7fc83a7fc640 1 -- 172.21.15.7:0/3585715200 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 21) ==== 154528+0+0 (secure 0 0 0) 0x7fc82c037020 con 0x7fc83c110200 2024-09-21T06:34:31.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:31.546+0000 7fc83a7fc640 1 --2- 172.21.15.7:0/3585715200 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fc8240b6560 0x7fc8240b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:31.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:31.546+0000 7fc8410e5640 1 --2- 172.21.15.7:0/3585715200 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fc8240b6560 0x7fc8240b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:31.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:31.547+0000 7fc83a7fc640 1 -- 172.21.15.7:0/3585715200 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7fc82c1084d0 con 0x7fc83c110200 2024-09-21T06:34:31.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:31.547+0000 7fc8410e5640 1 --2- 172.21.15.7:0/3585715200 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fc8240b6560 0x7fc8240b8a70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc834009b40 tx=0x7fc834005e50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:31.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:31.549+0000 7fc83a7fc640 1 -- 172.21.15.7:0/3585715200 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc82c083710 con 0x7fc83c110200 2024-09-21T06:34:31.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:31.777+0000 7fc843349640 1 -- 172.21.15.7:0/3585715200 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7fc83c1a9170 con 0x7fc83c110200 2024-09-21T06:34:31.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:31.969+0000 7fc83a7fc640 1 -- 172.21.15.7:0/3585715200 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7fc82c0ced80 con 0x7fc83c110200 2024-09-21T06:34:31.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:31.971+0000 7fc843349640 1 -- 172.21.15.7:0/3585715200 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fc8240b6560 msgr2=0x7fc8240b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:31.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:31.971+0000 7fc843349640 1 --2- 172.21.15.7:0/3585715200 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fc8240b6560 0x7fc8240b8a70 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc834009b40 tx=0x7fc834005e50 comp rx=0 tx=0).stop 2024-09-21T06:34:31.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:31.971+0000 7fc843349640 1 -- 172.21.15.7:0/3585715200 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc83c110200 msgr2=0x7fc83c1a1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:31.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:31.971+0000 7fc843349640 1 --2- 172.21.15.7:0/3585715200 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc83c110200 0x7fc83c1a1e20 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc82c02ae70 tx=0x7fc82c02f5d0 comp rx=0 tx=0).stop 2024-09-21T06:34:31.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:31.971+0000 7fc843349640 1 -- 172.21.15.7:0/3585715200 shutdown_connections 2024-09-21T06:34:31.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:31.971+0000 7fc843349640 1 --2- 172.21.15.7:0/3585715200 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fc8240b6560 0x7fc8240b8a70 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:31.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:31.971+0000 7fc843349640 1 --2- 172.21.15.7:0/3585715200 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc83c110200 0x7fc83c1a1e20 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:31.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:31.971+0000 7fc843349640 1 --2- 172.21.15.7:0/3585715200 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc83c102fa0 0x7fc83c19cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:31.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:31.971+0000 7fc843349640 1 --2- 172.21.15.7:0/3585715200 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc83c102650 0x7fc83c19c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:31.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:31.971+0000 7fc843349640 1 -- 172.21.15.7:0/3585715200 >> 172.21.15.7:0/3585715200 conn(0x7fc83c079730 msgr2=0x7fc83c109da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:31.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:31.971+0000 7fc843349640 1 -- 172.21.15.7:0/3585715200 shutdown_connections 2024-09-21T06:34:31.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:31.971+0000 7fc843349640 1 -- 172.21.15.7:0/3585715200 wait complete. 2024-09-21T06:34:32.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:31 smithi007 ceph-mon[30983]: pgmap v267: 97 pgs: 97 active+clean; 579 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-21T06:34:32.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:31 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/3585715200' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} : dispatch 2024-09-21T06:34:32.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:31 smithi144 ceph-mon[34653]: pgmap v267: 97 pgs: 97 active+clean; 579 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-21T06:34:32.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:31 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/3585715200' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} : dispatch 2024-09-21T06:34:32.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:31 smithi018 ceph-mon[34477]: pgmap v267: 97 pgs: 97 active+clean; 579 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-21T06:34:32.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:31 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/3585715200' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} : dispatch 2024-09-21T06:34:32.650 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph fs set cephfs allow_standby_replay true 2024-09-21T06:34:32.911 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:34:33.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:32 smithi144 ceph-mon[34653]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-21T06:34:33.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:32 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/3585715200' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-21T06:34:33.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:32 smithi144 ceph-mon[34653]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-21T06:34:33.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:32 smithi144 ceph-mon[34653]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T06:34:33.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:32 smithi144 ceph-mon[34653]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-21T06:34:33.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:32 smithi144 ceph-mon[34653]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-21T06:34:33.330 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:32 smithi007 ceph-mon[30983]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-21T06:34:33.330 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:32 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/3585715200' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-21T06:34:33.330 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:32 smithi007 ceph-mon[30983]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-21T06:34:33.330 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:32 smithi007 ceph-mon[30983]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T06:34:33.330 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:32 smithi007 ceph-mon[30983]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-21T06:34:33.330 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:32 smithi007 ceph-mon[30983]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-21T06:34:33.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:32 smithi018 ceph-mon[34477]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-21T06:34:33.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:32 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/3585715200' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-21T06:34:33.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:32 smithi018 ceph-mon[34477]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-21T06:34:33.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:32 smithi018 ceph-mon[34477]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T06:34:33.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:32 smithi018 ceph-mon[34477]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-21T06:34:33.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:32 smithi018 ceph-mon[34477]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-21T06:34:33.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:33.424+0000 7f4e080ce640 1 -- 172.21.15.7:0/2209143479 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e00102a60 msgr2=0x7f4e00102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:33.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:33.424+0000 7f4e080ce640 1 --2- 172.21.15.7:0/2209143479 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e00102a60 0x7f4e00102e70 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc009900 tx=0x7f4dfc02a410 comp rx=0 tx=0).stop 2024-09-21T06:34:33.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:33.424+0000 7f4e080ce640 1 -- 172.21.15.7:0/2209143479 shutdown_connections 2024-09-21T06:34:33.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:33.424+0000 7f4e080ce640 1 --2- 172.21.15.7:0/2209143479 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e00108cf0 0x7f4e0010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:33.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:33.424+0000 7f4e080ce640 1 --2- 172.21.15.7:0/2209143479 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e001083a0 0x7f4e001087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:33.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:33.424+0000 7f4e080ce640 1 --2- 172.21.15.7:0/2209143479 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e00102a60 0x7f4e00102e70 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:33.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:33.424+0000 7f4e080ce640 1 -- 172.21.15.7:0/2209143479 >> 172.21.15.7:0/2209143479 conn(0x7f4e00079730 msgr2=0x7f4e00079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:33.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:33.424+0000 7f4e080ce640 1 -- 172.21.15.7:0/2209143479 shutdown_connections 2024-09-21T06:34:33.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:33.424+0000 7f4e080ce640 1 -- 172.21.15.7:0/2209143479 wait complete. 2024-09-21T06:34:33.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:33.425+0000 7f4e080ce640 1 Processor -- start 2024-09-21T06:34:33.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:33.425+0000 7f4e080ce640 1 -- start start 2024-09-21T06:34:33.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:33.425+0000 7f4e080ce640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e00102a60 0x7f4e0019a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:33.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:33.425+0000 7f4e080ce640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e001083a0 0x7f4e0019aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:33.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:33.425+0000 7f4e080ce640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e00108cf0 0x7f4e0019fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:33.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:33.425+0000 7f4e080ce640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4e001129c0 con 0x7f4e001083a0 2024-09-21T06:34:33.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:33.425+0000 7f4e080ce640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4e00112840 con 0x7f4e00108cf0 2024-09-21T06:34:33.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:33.425+0000 7f4e080ce640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4e00112b40 con 0x7f4e00102a60 2024-09-21T06:34:33.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:33.426+0000 7f4e05669640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e001083a0 0x7f4e0019aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:33.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:33.426+0000 7f4e05669640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e001083a0 0x7f4e0019aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49472/0 (socket says 172.21.15.7:49472) 2024-09-21T06:34:33.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:33.426+0000 7f4e05669640 1 -- 172.21.15.7:0/2203889666 learned_addr learned my addr 172.21.15.7:0/2203889666 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:34:33.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:33.426+0000 7f4e0666b640 1 --2- 172.21.15.7:0/2203889666 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e00108cf0 0x7f4e0019fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:33.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:33.426+0000 7f4e05e6a640 1 --2- 172.21.15.7:0/2203889666 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e00102a60 0x7f4e0019a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:33.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:33.426+0000 7f4e05669640 1 -- 172.21.15.7:0/2203889666 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e00102a60 msgr2=0x7f4e0019a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:33.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:33.426+0000 7f4e05669640 1 --2- 172.21.15.7:0/2203889666 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e00102a60 0x7f4e0019a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:33.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:33.426+0000 7f4e05669640 1 -- 172.21.15.7:0/2203889666 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e00108cf0 msgr2=0x7f4e0019fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:33.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:33.426+0000 7f4e05669640 1 --2- 172.21.15.7:0/2203889666 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e00108cf0 0x7f4e0019fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:33.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:33.426+0000 7f4e05669640 1 -- 172.21.15.7:0/2203889666 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e001a0410 con 0x7f4e001083a0 2024-09-21T06:34:33.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:33.426+0000 7f4e05669640 1 --2- 172.21.15.7:0/2203889666 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e001083a0 0x7f4e0019aa40 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4df400b450 tx=0x7f4df400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:33.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:33.426+0000 7f4df2ffd640 1 -- 172.21.15.7:0/2203889666 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4df4015020 con 0x7f4e001083a0 2024-09-21T06:34:33.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:33.426+0000 7f4df2ffd640 1 -- 172.21.15.7:0/2203889666 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4df4011d40 con 0x7f4e001083a0 2024-09-21T06:34:33.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:33.426+0000 7f4e080ce640 1 -- 172.21.15.7:0/2203889666 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e001a0700 con 0x7f4e001083a0 2024-09-21T06:34:33.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:33.426+0000 7f4df2ffd640 1 -- 172.21.15.7:0/2203889666 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4df400f340 con 0x7f4e001083a0 2024-09-21T06:34:33.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:33.426+0000 7f4e080ce640 1 -- 172.21.15.7:0/2203889666 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e001a6ee0 con 0x7f4e001083a0 2024-09-21T06:34:33.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:33.427+0000 7f4e080ce640 1 -- 172.21.15.7:0/2203889666 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e00102e70 con 0x7f4e001083a0 2024-09-21T06:34:33.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:33.429+0000 7f4df2ffd640 1 -- 172.21.15.7:0/2203889666 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 21) ==== 154528+0+0 (secure 0 0 0) 0x7f4df4018020 con 0x7f4e001083a0 2024-09-21T06:34:33.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:33.430+0000 7f4df2ffd640 1 --2- 172.21.15.7:0/2203889666 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f4dec0b65e0 0x7f4dec0b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:33.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:33.430+0000 7f4e05e6a640 1 --2- 172.21.15.7:0/2203889666 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f4dec0b65e0 0x7f4dec0b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:33.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:33.430+0000 7f4df2ffd640 1 -- 172.21.15.7:0/2203889666 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7f4df40e7170 con 0x7f4e001083a0 2024-09-21T06:34:33.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:33.431+0000 7f4e05e6a640 1 --2- 172.21.15.7:0/2203889666 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f4dec0b65e0 0x7f4dec0b8af0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc031440 tx=0x7f4dfc009560 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:33.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:33.433+0000 7f4df2ffd640 1 -- 172.21.15.7:0/2203889666 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4df401f020 con 0x7f4e001083a0 2024-09-21T06:34:33.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:33.663+0000 7f4e080ce640 1 -- 172.21.15.7:0/2203889666 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f4e0019b5d0 con 0x7f4e001083a0 2024-09-21T06:34:33.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:33.986+0000 7f4df2ffd640 1 -- 172.21.15.7:0/2203889666 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7f4e0019b5d0 con 0x7f4e001083a0 2024-09-21T06:34:33.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:33.988+0000 7f4e080ce640 1 -- 172.21.15.7:0/2203889666 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f4dec0b65e0 msgr2=0x7f4dec0b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:33.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:33.988+0000 7f4e080ce640 1 --2- 172.21.15.7:0/2203889666 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f4dec0b65e0 0x7f4dec0b8af0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc031440 tx=0x7f4dfc009560 comp rx=0 tx=0).stop 2024-09-21T06:34:33.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:33.988+0000 7f4e080ce640 1 -- 172.21.15.7:0/2203889666 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e001083a0 msgr2=0x7f4e0019aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:33.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:33.988+0000 7f4e080ce640 1 --2- 172.21.15.7:0/2203889666 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e001083a0 0x7f4e0019aa40 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4df400b450 tx=0x7f4df400b910 comp rx=0 tx=0).stop 2024-09-21T06:34:33.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:33.989+0000 7f4e080ce640 1 -- 172.21.15.7:0/2203889666 shutdown_connections 2024-09-21T06:34:33.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:33.989+0000 7f4e080ce640 1 --2- 172.21.15.7:0/2203889666 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f4dec0b65e0 0x7f4dec0b8af0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:33.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:33.989+0000 7f4e080ce640 1 --2- 172.21.15.7:0/2203889666 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e00108cf0 0x7f4e0019fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:33.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:33.989+0000 7f4e080ce640 1 --2- 172.21.15.7:0/2203889666 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4e001083a0 0x7f4e0019aa40 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:33.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:33.989+0000 7f4e080ce640 1 --2- 172.21.15.7:0/2203889666 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4e00102a60 0x7f4e0019a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:33.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:33.989+0000 7f4e080ce640 1 -- 172.21.15.7:0/2203889666 >> 172.21.15.7:0/2203889666 conn(0x7f4e00079730 msgr2=0x7f4e00101af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:33.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:33.989+0000 7f4e080ce640 1 -- 172.21.15.7:0/2203889666 shutdown_connections 2024-09-21T06:34:33.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:33.989+0000 7f4e080ce640 1 -- 172.21.15.7:0/2203889666 wait complete. 2024-09-21T06:34:34.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:33 smithi144 ceph-mon[34653]: mds.? [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] up:active 2024-09-21T06:34:34.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:33 smithi144 ceph-mon[34653]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-21T06:34:34.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:33 smithi144 ceph-mon[34653]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-21T06:34:34.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:33 smithi144 ceph-mon[34653]: Cluster is now healthy 2024-09-21T06:34:34.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:33 smithi144 ceph-mon[34653]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-21T06:34:34.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:33 smithi144 ceph-mon[34653]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-09-21T06:34:34.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:33 smithi144 ceph-mon[34653]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-21T06:34:34.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:33 smithi144 ceph-mon[34653]: pgmap v268: 97 pgs: 97 active+clean; 580 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s wr, 6 op/s 2024-09-21T06:34:34.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:33 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/2203889666' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T06:34:34.309 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:33 smithi007 ceph-mon[30983]: mds.? [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] up:active 2024-09-21T06:34:34.309 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:33 smithi007 ceph-mon[30983]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-21T06:34:34.309 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:33 smithi007 ceph-mon[30983]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-21T06:34:34.310 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:33 smithi007 ceph-mon[30983]: Cluster is now healthy 2024-09-21T06:34:34.310 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:33 smithi007 ceph-mon[30983]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-21T06:34:34.310 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:33 smithi007 ceph-mon[30983]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-09-21T06:34:34.310 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:33 smithi007 ceph-mon[30983]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-21T06:34:34.310 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:33 smithi007 ceph-mon[30983]: pgmap v268: 97 pgs: 97 active+clean; 580 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s wr, 6 op/s 2024-09-21T06:34:34.310 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:33 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2203889666' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T06:34:34.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:33 smithi018 ceph-mon[34477]: mds.? [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] up:active 2024-09-21T06:34:34.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:33 smithi018 ceph-mon[34477]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-21T06:34:34.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:33 smithi018 ceph-mon[34477]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-21T06:34:34.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:33 smithi018 ceph-mon[34477]: Cluster is now healthy 2024-09-21T06:34:34.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:33 smithi018 ceph-mon[34477]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-21T06:34:34.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:33 smithi018 ceph-mon[34477]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-09-21T06:34:34.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:33 smithi018 ceph-mon[34477]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-21T06:34:34.370 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:33 smithi018 ceph-mon[34477]: pgmap v268: 97 pgs: 97 active+clean; 580 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s wr, 6 op/s 2024-09-21T06:34:34.370 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:33 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/2203889666' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T06:34:34.662 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph fs set cephfs session_timeout 300 2024-09-21T06:34:34.924 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:34:35.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:34 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/2203889666' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-21T06:34:35.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:34 smithi018 ceph-mon[34477]: mds.? [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] up:active 2024-09-21T06:34:35.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:34 smithi018 ceph-mon[34477]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-09-21T06:34:35.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:34 smithi018 ceph-mon[34477]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:34:35.119 INFO:journalctl@ceph.mds.b.smithi018.stdout:Sep 21 06:34:34 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-b[63345]: 2024-09-21T06:34:34.865+0000 7f0ee99e9640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-21T06:34:35.120 INFO:journalctl@ceph.mds.b.smithi018.stdout:Sep 21 06:34:34 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-b[63345]: 2024-09-21T06:34:34.865+0000 7f0ee99e9640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-21T06:34:35.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:34 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/2203889666' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-21T06:34:35.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:34 smithi144 ceph-mon[34653]: mds.? [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] up:active 2024-09-21T06:34:35.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:34 smithi144 ceph-mon[34653]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-09-21T06:34:35.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:34 smithi144 ceph-mon[34653]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:34:35.331 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:34 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2203889666' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-21T06:34:35.331 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:34 smithi007 ceph-mon[30983]: mds.? [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] up:active 2024-09-21T06:34:35.331 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:34 smithi007 ceph-mon[30983]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-09-21T06:34:35.331 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:34 smithi007 ceph-mon[30983]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:34:35.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:35.423+0000 7f19fa9b1640 1 -- 172.21.15.7:0/2117704859 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19f4102080 msgr2=0x7f19f4102490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:35.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:35.423+0000 7f19fa9b1640 1 --2- 172.21.15.7:0/2117704859 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19f4102080 0x7f19f4102490 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f19e4009900 tx=0x7f19e402a3f0 comp rx=0 tx=0).stop 2024-09-21T06:34:35.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:35.424+0000 7f19fa9b1640 1 -- 172.21.15.7:0/2117704859 shutdown_connections 2024-09-21T06:34:35.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:35.424+0000 7f19fa9b1640 1 --2- 172.21.15.7:0/2117704859 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f19f4109eb0 0x7f19f41106e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:35.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:35.424+0000 7f19fa9b1640 1 --2- 172.21.15.7:0/2117704859 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19f4109560 0x7f19f4109970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:35.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:35.424+0000 7f19fa9b1640 1 --2- 172.21.15.7:0/2117704859 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19f4102080 0x7f19f4102490 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:35.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:35.424+0000 7f19fa9b1640 1 -- 172.21.15.7:0/2117704859 >> 172.21.15.7:0/2117704859 conn(0x7f19f4079ec0 msgr2=0x7f19f407a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:35.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:35.424+0000 7f19fa9b1640 1 -- 172.21.15.7:0/2117704859 shutdown_connections 2024-09-21T06:34:35.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:35.424+0000 7f19fa9b1640 1 -- 172.21.15.7:0/2117704859 wait complete. 2024-09-21T06:34:35.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:35.424+0000 7f19fa9b1640 1 Processor -- start 2024-09-21T06:34:35.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:35.424+0000 7f19fa9b1640 1 -- start start 2024-09-21T06:34:35.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:35.425+0000 7f19fa9b1640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19f4102080 0x7f19f419a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:35.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:35.425+0000 7f19fa9b1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19f4109560 0x7f19f419ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:35.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:35.425+0000 7f19fa9b1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f19f4109eb0 0x7f19f419fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:35.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:35.425+0000 7f19fa9b1640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f19f4113b70 con 0x7f19f4109560 2024-09-21T06:34:35.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:35.425+0000 7f19fa9b1640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f19f41139f0 con 0x7f19f4109eb0 2024-09-21T06:34:35.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:35.425+0000 7f19fa9b1640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f19f4113cf0 con 0x7f19f4102080 2024-09-21T06:34:35.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:35.425+0000 7f19f37fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19f4109560 0x7f19f419ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:35.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:35.425+0000 7f19f37fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19f4109560 0x7f19f419ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49482/0 (socket says 172.21.15.7:49482) 2024-09-21T06:34:35.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:35.425+0000 7f19f37fe640 1 -- 172.21.15.7:0/2119617619 learned_addr learned my addr 172.21.15.7:0/2119617619 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:34:35.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:35.425+0000 7f19f8f4e640 1 --2- 172.21.15.7:0/2119617619 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f19f4109eb0 0x7f19f419fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:35.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:35.425+0000 7f19f3fff640 1 --2- 172.21.15.7:0/2119617619 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19f4102080 0x7f19f419a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:35.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:35.425+0000 7f19f37fe640 1 -- 172.21.15.7:0/2119617619 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19f4102080 msgr2=0x7f19f419a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:35.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:35.425+0000 7f19f37fe640 1 --2- 172.21.15.7:0/2119617619 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19f4102080 0x7f19f419a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:35.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:35.425+0000 7f19f37fe640 1 -- 172.21.15.7:0/2119617619 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f19f4109eb0 msgr2=0x7f19f419fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:35.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:35.425+0000 7f19f37fe640 1 --2- 172.21.15.7:0/2119617619 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f19f4109eb0 0x7f19f419fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:35.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:35.425+0000 7f19f37fe640 1 -- 172.21.15.7:0/2119617619 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19f41a0410 con 0x7f19f4109560 2024-09-21T06:34:35.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:35.425+0000 7f19f3fff640 1 --2- 172.21.15.7:0/2119617619 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19f4102080 0x7f19f419a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:34:35.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:35.425+0000 7f19f8f4e640 1 --2- 172.21.15.7:0/2119617619 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f19f4109eb0 0x7f19f419fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:34:35.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:35.425+0000 7f19f37fe640 1 --2- 172.21.15.7:0/2119617619 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19f4109560 0x7f19f419ab00 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f19e800c8c0 tx=0x7f19e800cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:35.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:35.426+0000 7f19f17fa640 1 -- 172.21.15.7:0/2119617619 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19e8007bb0 con 0x7f19f4109560 2024-09-21T06:34:35.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:35.426+0000 7f19f17fa640 1 -- 172.21.15.7:0/2119617619 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f19e8007d50 con 0x7f19f4109560 2024-09-21T06:34:35.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:35.426+0000 7f19fa9b1640 1 -- 172.21.15.7:0/2119617619 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19f41a0700 con 0x7f19f4109560 2024-09-21T06:34:35.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:35.426+0000 7f19f17fa640 1 -- 172.21.15.7:0/2119617619 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19e80187c0 con 0x7f19f4109560 2024-09-21T06:34:35.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:35.426+0000 7f19fa9b1640 1 -- 172.21.15.7:0/2119617619 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19f41a6f20 con 0x7f19f4109560 2024-09-21T06:34:35.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:35.427+0000 7f19fa9b1640 1 -- 172.21.15.7:0/2119617619 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19f4102490 con 0x7f19f4109560 2024-09-21T06:34:35.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:35.428+0000 7f19f17fa640 1 -- 172.21.15.7:0/2119617619 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 21) ==== 154528+0+0 (secure 0 0 0) 0x7f19e800fa20 con 0x7f19f4109560 2024-09-21T06:34:35.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:35.429+0000 7f19f17fa640 1 --2- 172.21.15.7:0/2119617619 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f19dc0b6610 0x7f19dc0b8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:35.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:35.430+0000 7f19f3fff640 1 --2- 172.21.15.7:0/2119617619 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f19dc0b6610 0x7f19dc0b8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:35.434 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:35.430+0000 7f19f17fa640 1 -- 172.21.15.7:0/2119617619 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7f19e80e7760 con 0x7f19f4109560 2024-09-21T06:34:35.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:35.430+0000 7f19f3fff640 1 --2- 172.21.15.7:0/2119617619 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f19dc0b6610 0x7f19dc0b8b20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f19e40096c0 tx=0x7f19e4031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:35.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:35.433+0000 7f19f17fa640 1 -- 172.21.15.7:0/2119617619 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f19e8014030 con 0x7f19f4109560 2024-09-21T06:34:35.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:35.662+0000 7f19fa9b1640 1 -- 172.21.15.7:0/2119617619 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f19f419b690 con 0x7f19f4109560 2024-09-21T06:34:35.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:35.993+0000 7f19f17fa640 1 -- 172.21.15.7:0/2119617619 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v24) ==== 115+0+0 (secure 0 0 0) 0x7f19e80ae0c0 con 0x7f19f4109560 2024-09-21T06:34:35.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:35.997+0000 7f19fa9b1640 1 -- 172.21.15.7:0/2119617619 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f19dc0b6610 msgr2=0x7f19dc0b8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:35.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:35.997+0000 7f19fa9b1640 1 --2- 172.21.15.7:0/2119617619 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f19dc0b6610 0x7f19dc0b8b20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f19e40096c0 tx=0x7f19e4031400 comp rx=0 tx=0).stop 2024-09-21T06:34:35.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:35.997+0000 7f19fa9b1640 1 -- 172.21.15.7:0/2119617619 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19f4109560 msgr2=0x7f19f419ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:35.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:35.997+0000 7f19fa9b1640 1 --2- 172.21.15.7:0/2119617619 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19f4109560 0x7f19f419ab00 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f19e800c8c0 tx=0x7f19e800cd80 comp rx=0 tx=0).stop 2024-09-21T06:34:36.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:35.997+0000 7f19fa9b1640 1 -- 172.21.15.7:0/2119617619 shutdown_connections 2024-09-21T06:34:36.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:35.997+0000 7f19fa9b1640 1 --2- 172.21.15.7:0/2119617619 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f19dc0b6610 0x7f19dc0b8b20 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:36.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:35.997+0000 7f19fa9b1640 1 --2- 172.21.15.7:0/2119617619 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f19f4109eb0 0x7f19f419fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:36.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:35.997+0000 7f19fa9b1640 1 --2- 172.21.15.7:0/2119617619 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f19f4109560 0x7f19f419ab00 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:36.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:35.997+0000 7f19fa9b1640 1 --2- 172.21.15.7:0/2119617619 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f19f4102080 0x7f19f419a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:36.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:35.997+0000 7f19fa9b1640 1 -- 172.21.15.7:0/2119617619 >> 172.21.15.7:0/2119617619 conn(0x7f19f4079ec0 msgr2=0x7f19f41075f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:36.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:35.998+0000 7f19fa9b1640 1 -- 172.21.15.7:0/2119617619 shutdown_connections 2024-09-21T06:34:36.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:35.998+0000 7f19fa9b1640 1 -- 172.21.15.7:0/2119617619 wait complete. 2024-09-21T06:34:36.276 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:35 smithi007 ceph-mon[30983]: pgmap v269: 97 pgs: 97 active+clean; 580 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 100 B/s rd, 2.4 KiB/s wr, 7 op/s 2024-09-21T06:34:36.276 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:35 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2119617619' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T06:34:36.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:35 smithi144 ceph-mon[34653]: pgmap v269: 97 pgs: 97 active+clean; 580 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 100 B/s rd, 2.4 KiB/s wr, 7 op/s 2024-09-21T06:34:36.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:35 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/2119617619' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T06:34:36.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:35 smithi018 ceph-mon[34477]: pgmap v269: 97 pgs: 97 active+clean; 580 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 100 B/s rd, 2.4 KiB/s wr, 7 op/s 2024-09-21T06:34:36.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:35 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/2119617619' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T06:34:36.636 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated'} subvols for filesystem 'cephfs' 2024-09-21T06:34:36.636 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph fs subvolumegroup create cephfs qa 2024-09-21T06:34:36.898 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:34:37.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:36 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/2119617619' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-21T06:34:37.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:36 smithi144 ceph-mon[34653]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:34:37.331 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:36 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2119617619' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-21T06:34:37.331 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:36 smithi007 ceph-mon[30983]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:34:37.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:36 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/2119617619' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-21T06:34:37.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:36 smithi018 ceph-mon[34477]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:34:37.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:37.425+0000 7ff5b9153640 1 -- 172.21.15.7:0/3487694079 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5b41094a0 msgr2=0x7ff5b41098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:37.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:37.425+0000 7ff5b9153640 1 --2- 172.21.15.7:0/3487694079 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5b41094a0 0x7ff5b41098b0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff5a8009900 tx=0x7ff5a802a3f0 comp rx=0 tx=0).stop 2024-09-21T06:34:37.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:37.425+0000 7ff5b9153640 1 -- 172.21.15.7:0/3487694079 shutdown_connections 2024-09-21T06:34:37.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:37.425+0000 7ff5b9153640 1 --2- 172.21.15.7:0/3487694079 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5b4109df0 0x7ff5b4110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:37.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:37.425+0000 7ff5b9153640 1 --2- 172.21.15.7:0/3487694079 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5b41094a0 0x7ff5b41098b0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:37.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:37.425+0000 7ff5b9153640 1 --2- 172.21.15.7:0/3487694079 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5b4103b60 0x7ff5b4103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:37.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:37.425+0000 7ff5b9153640 1 -- 172.21.15.7:0/3487694079 >> 172.21.15.7:0/3487694079 conn(0x7ff5b407b850 msgr2=0x7ff5b407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:37.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:37.425+0000 7ff5b9153640 1 -- 172.21.15.7:0/3487694079 shutdown_connections 2024-09-21T06:34:37.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:37.425+0000 7ff5b9153640 1 -- 172.21.15.7:0/3487694079 wait complete. 2024-09-21T06:34:37.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:37.426+0000 7ff5b9153640 1 Processor -- start 2024-09-21T06:34:37.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:37.426+0000 7ff5b9153640 1 -- start start 2024-09-21T06:34:37.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:37.427+0000 7ff5b9153640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5b4103b60 0x7ff5b419a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:37.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:37.427+0000 7ff5b9153640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5b41094a0 0x7ff5b419aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:37.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:37.427+0000 7ff5b9153640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5b4109df0 0x7ff5b419fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:37.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:37.427+0000 7ff5b9153640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff5b4113ab0 con 0x7ff5b4109df0 2024-09-21T06:34:37.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:37.427+0000 7ff5b9153640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff5b4113930 con 0x7ff5b41094a0 2024-09-21T06:34:37.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:37.427+0000 7ff5b9153640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff5b4113c30 con 0x7ff5b4103b60 2024-09-21T06:34:37.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:37.427+0000 7ff5b359e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5b4109df0 0x7ff5b419fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:37.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:37.427+0000 7ff5b359e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5b4109df0 0x7ff5b419fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49496/0 (socket says 172.21.15.7:49496) 2024-09-21T06:34:37.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:37.427+0000 7ff5b359e640 1 -- 172.21.15.7:0/2128730568 learned_addr learned my addr 172.21.15.7:0/2128730568 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:34:37.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:37.427+0000 7ff5b2d9d640 1 --2- 172.21.15.7:0/2128730568 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5b4103b60 0x7ff5b419a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:37.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:37.427+0000 7ff5b259c640 1 --2- 172.21.15.7:0/2128730568 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5b41094a0 0x7ff5b419aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:37.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:37.427+0000 7ff5b359e640 1 -- 172.21.15.7:0/2128730568 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5b4103b60 msgr2=0x7ff5b419a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:37.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:37.427+0000 7ff5b359e640 1 --2- 172.21.15.7:0/2128730568 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5b4103b60 0x7ff5b419a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:37.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:37.427+0000 7ff5b359e640 1 -- 172.21.15.7:0/2128730568 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5b41094a0 msgr2=0x7ff5b419aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:37.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:37.427+0000 7ff5b359e640 1 --2- 172.21.15.7:0/2128730568 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5b41094a0 0x7ff5b419aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:37.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:37.427+0000 7ff5b359e640 1 -- 172.21.15.7:0/2128730568 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5b41a0370 con 0x7ff5b4109df0 2024-09-21T06:34:37.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:37.427+0000 7ff5b359e640 1 --2- 172.21.15.7:0/2128730568 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5b4109df0 0x7ff5b419fd00 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac00cad0 tx=0x7ff5ac00ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:37.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:37.428+0000 7ff59bfff640 1 -- 172.21.15.7:0/2128730568 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac00ad60 con 0x7ff5b4109df0 2024-09-21T06:34:37.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:37.428+0000 7ff5b9153640 1 -- 172.21.15.7:0/2128730568 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5b41a0660 con 0x7ff5b4109df0 2024-09-21T06:34:37.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:37.428+0000 7ff59bfff640 1 -- 172.21.15.7:0/2128730568 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff5ac005020 con 0x7ff5b4109df0 2024-09-21T06:34:37.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:37.428+0000 7ff59bfff640 1 -- 172.21.15.7:0/2128730568 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac00f6b0 con 0x7ff5b4109df0 2024-09-21T06:34:37.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:37.428+0000 7ff5b9153640 1 -- 172.21.15.7:0/2128730568 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5b41a0b20 con 0x7ff5b4109df0 2024-09-21T06:34:37.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:37.429+0000 7ff5b9153640 1 -- 172.21.15.7:0/2128730568 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5b4103f70 con 0x7ff5b4109df0 2024-09-21T06:34:37.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:37.430+0000 7ff59bfff640 1 -- 172.21.15.7:0/2128730568 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 21) ==== 154528+0+0 (secure 0 0 0) 0x7ff5ac0051d0 con 0x7ff5b4109df0 2024-09-21T06:34:37.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:37.431+0000 7ff59bfff640 1 --2- 172.21.15.7:0/2128730568 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7ff59c0b6590 0x7ff59c0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:37.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:37.431+0000 7ff5b2d9d640 1 --2- 172.21.15.7:0/2128730568 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7ff59c0b6590 0x7ff59c0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:37.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:37.431+0000 7ff59bfff640 1 -- 172.21.15.7:0/2128730568 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7ff5ac0e7690 con 0x7ff5b4109df0 2024-09-21T06:34:37.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:37.432+0000 7ff5b2d9d640 1 --2- 172.21.15.7:0/2128730568 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7ff59c0b6590 0x7ff59c0b8aa0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff5a400abe0 tx=0x7ff5a400a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:37.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:37.434+0000 7ff59bfff640 1 -- 172.21.15.7:0/2128730568 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff5ac014030 con 0x7ff5b4109df0 2024-09-21T06:34:37.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:37.646+0000 7ff5b9153640 1 -- 172.21.15.7:0/2128730568 --> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7ff5b4063800 con 0x7ff59c0b6590 2024-09-21T06:34:37.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:37.676+0000 7ff59bfff640 1 -- 172.21.15.7:0/2128730568 <== mgr.14223 v2:172.21.15.7:6800/3442812985 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7ff5b4063800 con 0x7ff59c0b6590 2024-09-21T06:34:37.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:37.678+0000 7ff5b9153640 1 -- 172.21.15.7:0/2128730568 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7ff59c0b6590 msgr2=0x7ff59c0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:37.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:37.678+0000 7ff5b9153640 1 --2- 172.21.15.7:0/2128730568 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7ff59c0b6590 0x7ff59c0b8aa0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff5a400abe0 tx=0x7ff5a400a2d0 comp rx=0 tx=0).stop 2024-09-21T06:34:37.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:37.678+0000 7ff5b9153640 1 -- 172.21.15.7:0/2128730568 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5b4109df0 msgr2=0x7ff5b419fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:37.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:37.678+0000 7ff5b9153640 1 --2- 172.21.15.7:0/2128730568 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5b4109df0 0x7ff5b419fd00 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac00cad0 tx=0x7ff5ac00ced0 comp rx=0 tx=0).stop 2024-09-21T06:34:37.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:37.678+0000 7ff5b9153640 1 -- 172.21.15.7:0/2128730568 shutdown_connections 2024-09-21T06:34:37.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:37.678+0000 7ff5b9153640 1 --2- 172.21.15.7:0/2128730568 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7ff59c0b6590 0x7ff59c0b8aa0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:37.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:37.678+0000 7ff5b9153640 1 --2- 172.21.15.7:0/2128730568 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff5b4109df0 0x7ff5b419fd00 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:37.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:37.678+0000 7ff5b9153640 1 --2- 172.21.15.7:0/2128730568 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5b41094a0 0x7ff5b419aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:37.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:37.678+0000 7ff5b9153640 1 --2- 172.21.15.7:0/2128730568 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff5b4103b60 0x7ff5b419a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:37.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:37.678+0000 7ff5b9153640 1 -- 172.21.15.7:0/2128730568 >> 172.21.15.7:0/2128730568 conn(0x7ff5b407b850 msgr2=0x7ff5b41075a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:37.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:37.678+0000 7ff5b9153640 1 -- 172.21.15.7:0/2128730568 shutdown_connections 2024-09-21T06:34:37.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:37.678+0000 7ff5b9153640 1 -- 172.21.15.7:0/2128730568 wait complete. 2024-09-21T06:34:37.995 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:34:37 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: 2024-09-21T06:34:37.651+0000 7fd5dc163640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T06:34:37.995 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:34:37 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: 2024-09-21T06:34:37.651+0000 7fd5dc163640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T06:34:37.995 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:34:37 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: 2024-09-21T06:34:37.651+0000 7fd5dc163640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T06:34:37.995 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:34:37 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: 2024-09-21T06:34:37.651+0000 7fd5dc163640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T06:34:37.995 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:34:37 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: 2024-09-21T06:34:37.651+0000 7fd5dc163640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T06:34:38.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:38 smithi144 ceph-mon[34653]: pgmap v270: 97 pgs: 97 active+clean; 581 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 682 B/s rd, 3.0 KiB/s wr, 9 op/s 2024-09-21T06:34:38.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:38 smithi144 ceph-mon[34653]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:34:38.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:38 smithi007 ceph-mon[30983]: pgmap v270: 97 pgs: 97 active+clean; 581 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 682 B/s rd, 3.0 KiB/s wr, 9 op/s 2024-09-21T06:34:38.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:38 smithi007 ceph-mon[30983]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:34:38.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:38 smithi018 ceph-mon[34477]: pgmap v270: 97 pgs: 97 active+clean; 581 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 682 B/s rd, 3.0 KiB/s wr, 9 op/s 2024-09-21T06:34:38.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:38 smithi018 ceph-mon[34477]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:34:38.409 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-21T06:34:38.669 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:34:39.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:39.162+0000 7fe9a9d38640 1 -- 172.21.15.7:0/2698742702 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9a4102ae0 msgr2=0x7fe9a4102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:39.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:39.162+0000 7fe9a9d38640 1 --2- 172.21.15.7:0/2698742702 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9a4102ae0 0x7fe9a4102ef0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe994009900 tx=0x7fe99402a410 comp rx=0 tx=0).stop 2024-09-21T06:34:39.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:39.162+0000 7fe9a9d38640 1 -- 172.21.15.7:0/2698742702 shutdown_connections 2024-09-21T06:34:39.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:39.162+0000 7fe9a9d38640 1 --2- 172.21.15.7:0/2698742702 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe9a4108d20 0x7fe9a410f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:39.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:39.162+0000 7fe9a9d38640 1 --2- 172.21.15.7:0/2698742702 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9a41083d0 0x7fe9a41087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:39.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:39.162+0000 7fe9a9d38640 1 --2- 172.21.15.7:0/2698742702 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9a4102ae0 0x7fe9a4102ef0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:39.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:39.162+0000 7fe9a9d38640 1 -- 172.21.15.7:0/2698742702 >> 172.21.15.7:0/2698742702 conn(0x7fe9a4079760 msgr2=0x7fe9a4079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:39.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:39.162+0000 7fe9a9d38640 1 -- 172.21.15.7:0/2698742702 shutdown_connections 2024-09-21T06:34:39.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:39.162+0000 7fe9a9d38640 1 -- 172.21.15.7:0/2698742702 wait complete. 2024-09-21T06:34:39.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:39.163+0000 7fe9a9d38640 1 Processor -- start 2024-09-21T06:34:39.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:39.163+0000 7fe9a9d38640 1 -- start start 2024-09-21T06:34:39.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:39.163+0000 7fe9a9d38640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe9a4102ae0 0x7fe9a419b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:39.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:39.163+0000 7fe9a9d38640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9a41083d0 0x7fe9a419b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:39.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:39.163+0000 7fe9a9d38640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9a4108d20 0x7fe9a419bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:39.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:39.163+0000 7fe9a9d38640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe9a4112990 con 0x7fe9a4108d20 2024-09-21T06:34:39.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:39.163+0000 7fe9a9d38640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe9a4112810 con 0x7fe9a4102ae0 2024-09-21T06:34:39.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:39.163+0000 7fe9a9d38640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe9a4112b10 con 0x7fe9a41083d0 2024-09-21T06:34:39.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:39.163+0000 7fe9a3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9a4108d20 0x7fe9a419bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:39.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:39.163+0000 7fe9a3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9a4108d20 0x7fe9a419bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49530/0 (socket says 172.21.15.7:49530) 2024-09-21T06:34:39.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:39.163+0000 7fe9a3fff640 1 -- 172.21.15.7:0/2591559952 learned_addr learned my addr 172.21.15.7:0/2591559952 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:34:39.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:39.163+0000 7fe9a2ffd640 1 --2- 172.21.15.7:0/2591559952 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9a41083d0 0x7fe9a419b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:39.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:39.163+0000 7fe9a37fe640 1 --2- 172.21.15.7:0/2591559952 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe9a4102ae0 0x7fe9a419b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:39.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:39.164+0000 7fe9a3fff640 1 -- 172.21.15.7:0/2591559952 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9a41083d0 msgr2=0x7fe9a419b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:39.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:39.164+0000 7fe9a3fff640 1 --2- 172.21.15.7:0/2591559952 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9a41083d0 0x7fe9a419b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:39.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:39.164+0000 7fe9a3fff640 1 -- 172.21.15.7:0/2591559952 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe9a4102ae0 msgr2=0x7fe9a419b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:39.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:39.164+0000 7fe9a3fff640 1 --2- 172.21.15.7:0/2591559952 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe9a4102ae0 0x7fe9a419b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:39.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:39.164+0000 7fe9a3fff640 1 -- 172.21.15.7:0/2591559952 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9a41a6510 con 0x7fe9a4108d20 2024-09-21T06:34:39.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:39.164+0000 7fe9a2ffd640 1 --2- 172.21.15.7:0/2591559952 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9a41083d0 0x7fe9a419b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:34:39.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:39.164+0000 7fe9a3fff640 1 --2- 172.21.15.7:0/2591559952 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9a4108d20 0x7fe9a419bd00 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fe99c009fd0 tx=0x7fe99c00b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:39.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:39.164+0000 7fe9a0ff9640 1 -- 172.21.15.7:0/2591559952 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe99c017070 con 0x7fe9a4108d20 2024-09-21T06:34:39.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:39.164+0000 7fe9a9d38640 1 -- 172.21.15.7:0/2591559952 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9a41a6800 con 0x7fe9a4108d20 2024-09-21T06:34:39.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:39.164+0000 7fe9a0ff9640 1 -- 172.21.15.7:0/2591559952 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe99c003e20 con 0x7fe9a4108d20 2024-09-21T06:34:39.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:39.164+0000 7fe9a0ff9640 1 -- 172.21.15.7:0/2591559952 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe99c010460 con 0x7fe9a4108d20 2024-09-21T06:34:39.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:39.164+0000 7fe9a9d38640 1 -- 172.21.15.7:0/2591559952 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9a41a6cf0 con 0x7fe9a4108d20 2024-09-21T06:34:39.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:39.165+0000 7fe9a9d38640 1 -- 172.21.15.7:0/2591559952 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9a4103d10 con 0x7fe9a4108d20 2024-09-21T06:34:39.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:39.167+0000 7fe9a0ff9640 1 -- 172.21.15.7:0/2591559952 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 21) ==== 154528+0+0 (secure 0 0 0) 0x7fe99c003970 con 0x7fe9a4108d20 2024-09-21T06:34:39.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:39.167+0000 7fe9a0ff9640 1 --2- 172.21.15.7:0/2591559952 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fe98c0b6590 0x7fe98c0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:39.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:39.168+0000 7fe9a37fe640 1 --2- 172.21.15.7:0/2591559952 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fe98c0b6590 0x7fe98c0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:39.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:39.168+0000 7fe9a0ff9640 1 -- 172.21.15.7:0/2591559952 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7fe99c0e6fa0 con 0x7fe9a4108d20 2024-09-21T06:34:39.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:39.168+0000 7fe9a37fe640 1 --2- 172.21.15.7:0/2591559952 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fe98c0b6590 0x7fe98c0b8aa0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe994000c00 tx=0x7fe994031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:39.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:39.171+0000 7fe9a0ff9640 1 -- 172.21.15.7:0/2591559952 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe99c0ad8f0 con 0x7fe9a4108d20 2024-09-21T06:34:39.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:39.388+0000 7fe9a9d38640 1 -- 172.21.15.7:0/2591559952 --> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fe9a4063800 con 0x7fe98c0b6590 2024-09-21T06:34:39.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:39.416+0000 7fe9a0ff9640 1 -- 172.21.15.7:0/2591559952 <== mgr.14223 v2:172.21.15.7:6800/3442812985 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fe9a4063800 con 0x7fe98c0b6590 2024-09-21T06:34:39.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:39.418+0000 7fe9a9d38640 1 -- 172.21.15.7:0/2591559952 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fe98c0b6590 msgr2=0x7fe98c0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:39.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:39.418+0000 7fe9a9d38640 1 --2- 172.21.15.7:0/2591559952 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fe98c0b6590 0x7fe98c0b8aa0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe994000c00 tx=0x7fe994031400 comp rx=0 tx=0).stop 2024-09-21T06:34:39.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:39.418+0000 7fe9a9d38640 1 -- 172.21.15.7:0/2591559952 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9a4108d20 msgr2=0x7fe9a419bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:39.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:39.418+0000 7fe9a9d38640 1 --2- 172.21.15.7:0/2591559952 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9a4108d20 0x7fe9a419bd00 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fe99c009fd0 tx=0x7fe99c00b260 comp rx=0 tx=0).stop 2024-09-21T06:34:39.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:39.418+0000 7fe9a9d38640 1 -- 172.21.15.7:0/2591559952 shutdown_connections 2024-09-21T06:34:39.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:39.418+0000 7fe9a9d38640 1 --2- 172.21.15.7:0/2591559952 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fe98c0b6590 0x7fe98c0b8aa0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:39.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:39.418+0000 7fe9a9d38640 1 --2- 172.21.15.7:0/2591559952 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9a4108d20 0x7fe9a419bd00 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:39.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:39.418+0000 7fe9a9d38640 1 --2- 172.21.15.7:0/2591559952 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9a41083d0 0x7fe9a419b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:39.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:39.418+0000 7fe9a9d38640 1 --2- 172.21.15.7:0/2591559952 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe9a4102ae0 0x7fe9a419b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:39.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:39.418+0000 7fe9a9d38640 1 -- 172.21.15.7:0/2591559952 >> 172.21.15.7:0/2591559952 conn(0x7fe9a4079760 msgr2=0x7fe9a4101580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:39.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:39.418+0000 7fe9a9d38640 1 -- 172.21.15.7:0/2591559952 shutdown_connections 2024-09-21T06:34:39.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:39.418+0000 7fe9a9d38640 1 -- 172.21.15.7:0/2591559952 wait complete. 2024-09-21T06:34:40.074 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-21T06:34:40.336 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:34:40.458 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:40 smithi007 ceph-mon[30983]: pgmap v271: 97 pgs: 97 active+clean; 589 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 3.3 KiB/s wr, 12 op/s 2024-09-21T06:34:40.458 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:40 smithi007 ceph-mon[30983]: from='client.14928 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:34:40.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:40 smithi144 ceph-mon[34653]: pgmap v271: 97 pgs: 97 active+clean; 589 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 3.3 KiB/s wr, 12 op/s 2024-09-21T06:34:40.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:40 smithi144 ceph-mon[34653]: from='client.14928 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:34:40.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:40 smithi018 ceph-mon[34477]: pgmap v271: 97 pgs: 97 active+clean; 589 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 3.3 KiB/s wr, 12 op/s 2024-09-21T06:34:40.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:40 smithi018 ceph-mon[34477]: from='client.14928 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:34:40.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:40.837+0000 7f7a18d2d640 1 -- 172.21.15.7:0/3601902189 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a14102140 msgr2=0x7f7a14102550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:40.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:40.837+0000 7f7a18d2d640 1 --2- 172.21.15.7:0/3601902189 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a14102140 0x7f7a14102550 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f7a04009900 tx=0x7f7a0402a410 comp rx=0 tx=0).stop 2024-09-21T06:34:40.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:40.837+0000 7f7a18d2d640 1 -- 172.21.15.7:0/3601902189 shutdown_connections 2024-09-21T06:34:40.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:40.837+0000 7f7a18d2d640 1 --2- 172.21.15.7:0/3601902189 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a14106c80 0x7f7a141106d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:40.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:40.837+0000 7f7a18d2d640 1 --2- 172.21.15.7:0/3601902189 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a14106330 0x7f7a14106740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:40.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:40.837+0000 7f7a18d2d640 1 --2- 172.21.15.7:0/3601902189 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a14102140 0x7f7a14102550 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:40.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:40.837+0000 7f7a18d2d640 1 -- 172.21.15.7:0/3601902189 >> 172.21.15.7:0/3601902189 conn(0x7f7a14079ea0 msgr2=0x7f7a1407a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:40.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:40.837+0000 7f7a18d2d640 1 -- 172.21.15.7:0/3601902189 shutdown_connections 2024-09-21T06:34:40.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:40.837+0000 7f7a18d2d640 1 -- 172.21.15.7:0/3601902189 wait complete. 2024-09-21T06:34:40.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:40.838+0000 7f7a18d2d640 1 Processor -- start 2024-09-21T06:34:40.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:40.838+0000 7f7a18d2d640 1 -- start start 2024-09-21T06:34:40.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:40.838+0000 7f7a18d2d640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a14102140 0x7f7a141030e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:40.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:40.838+0000 7f7a18d2d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a14106330 0x7f7a14103620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:40.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:40.838+0000 7f7a18d2d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a14106c80 0x7f7a14103b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:40.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:40.838+0000 7f7a18d2d640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7a14113b20 con 0x7f7a14106330 2024-09-21T06:34:40.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:40.838+0000 7f7a18d2d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7a141139a0 con 0x7f7a14106c80 2024-09-21T06:34:40.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:40.838+0000 7f7a18d2d640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7a14113ca0 con 0x7f7a14102140 2024-09-21T06:34:40.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:40.838+0000 7f7a11d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a14106330 0x7f7a14103620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:40.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:40.838+0000 7f7a11d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a14106330 0x7f7a14103620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38072/0 (socket says 172.21.15.7:38072) 2024-09-21T06:34:40.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:40.838+0000 7f7a11d9b640 1 -- 172.21.15.7:0/1648246322 learned_addr learned my addr 172.21.15.7:0/1648246322 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:34:40.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:40.838+0000 7f7a1259c640 1 --2- 172.21.15.7:0/1648246322 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a14102140 0x7f7a141030e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:40.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:40.838+0000 7f7a12d9d640 1 --2- 172.21.15.7:0/1648246322 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a14106c80 0x7f7a14103b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:40.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:40.839+0000 7f7a11d9b640 1 -- 172.21.15.7:0/1648246322 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a14102140 msgr2=0x7f7a141030e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:40.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:40.839+0000 7f7a11d9b640 1 --2- 172.21.15.7:0/1648246322 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a14102140 0x7f7a141030e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:40.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:40.839+0000 7f7a11d9b640 1 -- 172.21.15.7:0/1648246322 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a14106c80 msgr2=0x7f7a14103b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:40.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:40.839+0000 7f7a11d9b640 1 --2- 172.21.15.7:0/1648246322 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a14106c80 0x7f7a14103b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:40.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:40.839+0000 7f7a11d9b640 1 -- 172.21.15.7:0/1648246322 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a141a8870 con 0x7f7a14106330 2024-09-21T06:34:40.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:40.839+0000 7f7a11d9b640 1 --2- 172.21.15.7:0/1648246322 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a14106330 0x7f7a14103620 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f7a0800e9c0 tx=0x7f7a0800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:40.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:40.839+0000 7f7a037fe640 1 -- 172.21.15.7:0/1648246322 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a0800cd80 con 0x7f7a14106330 2024-09-21T06:34:40.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:40.839+0000 7f7a037fe640 1 -- 172.21.15.7:0/1648246322 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7a080054d0 con 0x7f7a14106330 2024-09-21T06:34:40.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:40.839+0000 7f7a18d2d640 1 -- 172.21.15.7:0/1648246322 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a141a8b60 con 0x7f7a14106330 2024-09-21T06:34:40.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:40.839+0000 7f7a037fe640 1 -- 172.21.15.7:0/1648246322 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a08010430 con 0x7f7a14106330 2024-09-21T06:34:40.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:40.839+0000 7f7a18d2d640 1 -- 172.21.15.7:0/1648246322 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a141a90a0 con 0x7f7a14106330 2024-09-21T06:34:40.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:40.840+0000 7f7a18d2d640 1 -- 172.21.15.7:0/1648246322 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a14102550 con 0x7f7a14106330 2024-09-21T06:34:40.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:40.842+0000 7f7a037fe640 1 -- 172.21.15.7:0/1648246322 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154579+0+0 (secure 0 0 0) 0x7f7a08004fd0 con 0x7f7a14106330 2024-09-21T06:34:40.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:40.843+0000 7f7a037fe640 1 --2- 172.21.15.7:0/1648246322 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f79fc0b65f0 0x7f79fc0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:40.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:40.843+0000 7f7a1259c640 1 --2- 172.21.15.7:0/1648246322 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f79fc0b65f0 0x7f79fc0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:40.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:40.843+0000 7f7a037fe640 1 -- 172.21.15.7:0/1648246322 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7f7a080e7950 con 0x7f7a14106330 2024-09-21T06:34:40.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:40.844+0000 7f7a1259c640 1 --2- 172.21.15.7:0/1648246322 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f79fc0b65f0 0x7f79fc0b8b00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7a04000c00 tx=0x7f7a04031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:40.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:40.848+0000 7f7a037fe640 1 -- 172.21.15.7:0/1648246322 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7a080ae040 con 0x7f7a14106330 2024-09-21T06:34:41.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:41.066+0000 7f7a18d2d640 1 -- 172.21.15.7:0/1648246322 --> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f7a14063800 con 0x7f79fc0b65f0 2024-09-21T06:34:41.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:41.072+0000 7f7a037fe640 1 -- 172.21.15.7:0/1648246322 <== mgr.14223 v2:172.21.15.7:6800/3442812985 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f7a14063800 con 0x7f79fc0b65f0 2024-09-21T06:34:41.074 INFO:teuthology.orchestra.run.smithi007.stdout:/volumes/qa/sv_0/2c05106f-a914-468b-9c66-ed22b6367bd5 2024-09-21T06:34:41.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:41.075+0000 7f7a18d2d640 1 -- 172.21.15.7:0/1648246322 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f79fc0b65f0 msgr2=0x7f79fc0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:41.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:41.075+0000 7f7a18d2d640 1 --2- 172.21.15.7:0/1648246322 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f79fc0b65f0 0x7f79fc0b8b00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7a04000c00 tx=0x7f7a04031400 comp rx=0 tx=0).stop 2024-09-21T06:34:41.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:41.075+0000 7f7a18d2d640 1 -- 172.21.15.7:0/1648246322 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a14106330 msgr2=0x7f7a14103620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:41.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:41.075+0000 7f7a18d2d640 1 --2- 172.21.15.7:0/1648246322 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a14106330 0x7f7a14103620 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f7a0800e9c0 tx=0x7f7a0800ee80 comp rx=0 tx=0).stop 2024-09-21T06:34:41.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:41.075+0000 7f7a18d2d640 1 -- 172.21.15.7:0/1648246322 shutdown_connections 2024-09-21T06:34:41.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:41.075+0000 7f7a18d2d640 1 --2- 172.21.15.7:0/1648246322 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f79fc0b65f0 0x7f79fc0b8b00 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:41.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:41.075+0000 7f7a18d2d640 1 --2- 172.21.15.7:0/1648246322 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a14106c80 0x7f7a14103b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:41.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:41.075+0000 7f7a18d2d640 1 --2- 172.21.15.7:0/1648246322 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7a14106330 0x7f7a14103620 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:41.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:41.075+0000 7f7a18d2d640 1 --2- 172.21.15.7:0/1648246322 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7a14102140 0x7f7a141030e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:41.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:41.075+0000 7f7a18d2d640 1 -- 172.21.15.7:0/1648246322 >> 172.21.15.7:0/1648246322 conn(0x7f7a14079ea0 msgr2=0x7f7a141081f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:41.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:41.075+0000 7f7a18d2d640 1 -- 172.21.15.7:0/1648246322 shutdown_connections 2024-09-21T06:34:41.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:41.075+0000 7f7a18d2d640 1 -- 172.21.15.7:0/1648246322 wait complete. 2024-09-21T06:34:41.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:41 smithi007 ceph-mon[30983]: mgrmap e22: x(active, since 6m), standbys: z, y 2024-09-21T06:34:41.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:41 smithi144 ceph-mon[34653]: mgrmap e22: x(active, since 6m), standbys: z, y 2024-09-21T06:34:41.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:41 smithi018 ceph-mon[34477]: mgrmap e22: x(active, since 6m), standbys: z, y 2024-09-21T06:34:41.844 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-21T06:34:42.119 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:34:42.392 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:42 smithi007 ceph-mon[30983]: from='client.14934 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:34:42.392 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:42 smithi007 ceph-mon[30983]: pgmap v272: 97 pgs: 97 active+clean; 589 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 2.8 KiB/s wr, 11 op/s 2024-09-21T06:34:42.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:42 smithi144 ceph-mon[34653]: from='client.14934 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:34:42.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:42 smithi144 ceph-mon[34653]: pgmap v272: 97 pgs: 97 active+clean; 589 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 2.8 KiB/s wr, 11 op/s 2024-09-21T06:34:42.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:42 smithi018 ceph-mon[34477]: from='client.14934 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:34:42.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:42 smithi018 ceph-mon[34477]: pgmap v272: 97 pgs: 97 active+clean; 589 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 2.8 KiB/s wr, 11 op/s 2024-09-21T06:34:42.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:42.622+0000 7f58768e2640 1 -- 172.21.15.7:0/1588095575 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5870108d30 msgr2=0x7f587010f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:42.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:42.622+0000 7f58768e2640 1 --2- 172.21.15.7:0/1588095575 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5870108d30 0x7f587010f560 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f5868009ca0 tx=0x7f586802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:34:42.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:42.622+0000 7f58768e2640 1 -- 172.21.15.7:0/1588095575 shutdown_connections 2024-09-21T06:34:42.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:42.622+0000 7f58768e2640 1 --2- 172.21.15.7:0/1588095575 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5870108d30 0x7f587010f560 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:42.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:42.622+0000 7f58768e2640 1 --2- 172.21.15.7:0/1588095575 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f58701083e0 0x7f58701087f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:42.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:42.622+0000 7f58768e2640 1 --2- 172.21.15.7:0/1588095575 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5870102aa0 0x7f5870102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:42.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:42.622+0000 7f58768e2640 1 -- 172.21.15.7:0/1588095575 >> 172.21.15.7:0/1588095575 conn(0x7f5870079750 msgr2=0x7f5870079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:42.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:42.622+0000 7f58768e2640 1 -- 172.21.15.7:0/1588095575 shutdown_connections 2024-09-21T06:34:42.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:42.622+0000 7f58768e2640 1 -- 172.21.15.7:0/1588095575 wait complete. 2024-09-21T06:34:42.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:42.622+0000 7f58768e2640 1 Processor -- start 2024-09-21T06:34:42.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:42.623+0000 7f58768e2640 1 -- start start 2024-09-21T06:34:42.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:42.623+0000 7f58768e2640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5870102aa0 0x7f587010fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:42.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:42.623+0000 7f58768e2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58701083e0 0x7f5870110400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:42.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:42.623+0000 7f58768e2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5870108d30 0x7f5870110940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:42.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:42.623+0000 7f58768e2640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5870113ae0 con 0x7f5870108d30 2024-09-21T06:34:42.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:42.623+0000 7f58768e2640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5870113960 con 0x7f58701083e0 2024-09-21T06:34:42.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:42.623+0000 7f58768e2640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5870113c60 con 0x7f5870102aa0 2024-09-21T06:34:42.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:42.623+0000 7f5874e7f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5870108d30 0x7f5870110940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:42.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:42.623+0000 7f5874e7f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5870108d30 0x7f5870110940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38088/0 (socket says 172.21.15.7:38088) 2024-09-21T06:34:42.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:42.623+0000 7f5874e7f640 1 -- 172.21.15.7:0/98584629 learned_addr learned my addr 172.21.15.7:0/98584629 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:34:42.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:42.623+0000 7f5867fff640 1 --2- 172.21.15.7:0/98584629 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58701083e0 0x7f5870110400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:42.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:42.623+0000 7f586ffff640 1 --2- 172.21.15.7:0/98584629 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5870102aa0 0x7f587010fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:42.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:42.623+0000 7f5874e7f640 1 -- 172.21.15.7:0/98584629 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5870102aa0 msgr2=0x7f587010fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:42.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:42.623+0000 7f5874e7f640 1 --2- 172.21.15.7:0/98584629 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5870102aa0 0x7f587010fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:42.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:42.623+0000 7f5874e7f640 1 -- 172.21.15.7:0/98584629 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58701083e0 msgr2=0x7f5870110400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:42.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:42.623+0000 7f5874e7f640 1 --2- 172.21.15.7:0/98584629 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58701083e0 0x7f5870110400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:42.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:42.623+0000 7f5874e7f640 1 -- 172.21.15.7:0/98584629 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58701a8710 con 0x7f5870108d30 2024-09-21T06:34:42.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:42.624+0000 7f5874e7f640 1 --2- 172.21.15.7:0/98584629 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5870108d30 0x7f5870110940 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f5868005cc0 tx=0x7f586802f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:42.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:42.624+0000 7f586dffb640 1 -- 172.21.15.7:0/98584629 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5868003bf0 con 0x7f5870108d30 2024-09-21T06:34:42.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:42.624+0000 7f586dffb640 1 -- 172.21.15.7:0/98584629 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5868003d90 con 0x7f5870108d30 2024-09-21T06:34:42.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:42.624+0000 7f58768e2640 1 -- 172.21.15.7:0/98584629 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58701a89a0 con 0x7f5870108d30 2024-09-21T06:34:42.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:42.624+0000 7f586dffb640 1 -- 172.21.15.7:0/98584629 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f586802fbc0 con 0x7f5870108d30 2024-09-21T06:34:42.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:42.624+0000 7f58768e2640 1 -- 172.21.15.7:0/98584629 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58701a8f30 con 0x7f5870108d30 2024-09-21T06:34:42.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:42.625+0000 7f58768e2640 1 -- 172.21.15.7:0/98584629 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5870103d20 con 0x7f5870108d30 2024-09-21T06:34:42.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:42.626+0000 7f586dffb640 1 -- 172.21.15.7:0/98584629 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154579+0+0 (secure 0 0 0) 0x7f586802fd60 con 0x7f5870108d30 2024-09-21T06:34:42.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:42.627+0000 7f586dffb640 1 --2- 172.21.15.7:0/98584629 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f585c0b6670 0x7f585c0b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:42.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:42.628+0000 7f586ffff640 1 --2- 172.21.15.7:0/98584629 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f585c0b6670 0x7f585c0b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:42.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:42.628+0000 7f586dffb640 1 -- 172.21.15.7:0/98584629 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8194+0+0 (secure 0 0 0) 0x7f5868108ad0 con 0x7f5870108d30 2024-09-21T06:34:42.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:42.628+0000 7f586ffff640 1 --2- 172.21.15.7:0/98584629 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f585c0b6670 0x7f585c0b8b80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5860005fd0 tx=0x7f5860005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:42.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:42.631+0000 7f586dffb640 1 -- 172.21.15.7:0/98584629 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f58680cf220 con 0x7f5870108d30 2024-09-21T06:34:42.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:42.846+0000 7f58768e2640 1 -- 172.21.15.7:0/98584629 --> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f5870063800 con 0x7f585c0b6670 2024-09-21T06:34:42.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:42.876+0000 7f586dffb640 1 -- 172.21.15.7:0/98584629 <== mgr.14223 v2:172.21.15.7:6800/3442812985 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f5870063800 con 0x7f585c0b6670 2024-09-21T06:34:42.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:42.878+0000 7f58768e2640 1 -- 172.21.15.7:0/98584629 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f585c0b6670 msgr2=0x7f585c0b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:42.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:42.878+0000 7f58768e2640 1 --2- 172.21.15.7:0/98584629 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f585c0b6670 0x7f585c0b8b80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5860005fd0 tx=0x7f5860005850 comp rx=0 tx=0).stop 2024-09-21T06:34:42.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:42.878+0000 7f58768e2640 1 -- 172.21.15.7:0/98584629 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5870108d30 msgr2=0x7f5870110940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:42.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:42.878+0000 7f58768e2640 1 --2- 172.21.15.7:0/98584629 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5870108d30 0x7f5870110940 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f5868005cc0 tx=0x7f586802f380 comp rx=0 tx=0).stop 2024-09-21T06:34:42.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:42.878+0000 7f58768e2640 1 -- 172.21.15.7:0/98584629 shutdown_connections 2024-09-21T06:34:42.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:42.878+0000 7f58768e2640 1 --2- 172.21.15.7:0/98584629 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f585c0b6670 0x7f585c0b8b80 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:42.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:42.878+0000 7f58768e2640 1 --2- 172.21.15.7:0/98584629 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5870108d30 0x7f5870110940 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:42.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:42.878+0000 7f58768e2640 1 --2- 172.21.15.7:0/98584629 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58701083e0 0x7f5870110400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:42.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:42.878+0000 7f58768e2640 1 --2- 172.21.15.7:0/98584629 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5870102aa0 0x7f587010fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:42.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:42.878+0000 7f58768e2640 1 -- 172.21.15.7:0/98584629 >> 172.21.15.7:0/98584629 conn(0x7f5870079750 msgr2=0x7f5870104370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:42.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:42.879+0000 7f58768e2640 1 -- 172.21.15.7:0/98584629 shutdown_connections 2024-09-21T06:34:42.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:42.879+0000 7f58768e2640 1 -- 172.21.15.7:0/98584629 wait complete. 2024-09-21T06:34:43.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:43 smithi144 ceph-mon[34653]: from='client.14940 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:34:43.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:43 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]} : dispatch 2024-09-21T06:34:43.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:43 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]} : dispatch 2024-09-21T06:34:43.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:43 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]} : dispatch 2024-09-21T06:34:43.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:43 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]} : dispatch 2024-09-21T06:34:43.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:43 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]} : dispatch 2024-09-21T06:34:43.536 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:43 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]} : dispatch 2024-09-21T06:34:43.540 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:43 smithi007 ceph-mon[30983]: from='client.14940 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:34:43.540 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:43 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]} : dispatch 2024-09-21T06:34:43.540 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:43 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]} : dispatch 2024-09-21T06:34:43.540 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:43 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]} : dispatch 2024-09-21T06:34:43.540 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:43 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]} : dispatch 2024-09-21T06:34:43.540 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:43 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]} : dispatch 2024-09-21T06:34:43.540 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:43 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]} : dispatch 2024-09-21T06:34:43.568 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-21T06:34:43.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:43 smithi018 ceph-mon[34477]: from='client.14940 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:34:43.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:43 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]} : dispatch 2024-09-21T06:34:43.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:43 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]} : dispatch 2024-09-21T06:34:43.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:43 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]} : dispatch 2024-09-21T06:34:43.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:43 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]} : dispatch 2024-09-21T06:34:43.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:43 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]} : dispatch 2024-09-21T06:34:43.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:43 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]} : dispatch 2024-09-21T06:34:43.824 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:34:44.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:44.329+0000 7f83a57b5640 1 -- 172.21.15.7:0/2566595719 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83a010de60 msgr2=0x7f83a0110330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:44.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:44.329+0000 7f83a57b5640 1 --2- 172.21.15.7:0/2566595719 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83a010de60 0x7f83a0110330 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f8398009ca0 tx=0x7f839802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:34:44.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:44.329+0000 7f83a57b5640 1 -- 172.21.15.7:0/2566595719 shutdown_connections 2024-09-21T06:34:44.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:44.329+0000 7f83a57b5640 1 --2- 172.21.15.7:0/2566595719 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83a010de60 0x7f83a0110330 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:44.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:44.329+0000 7f83a57b5640 1 --2- 172.21.15.7:0/2566595719 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f83a0105380 0x7f83a010d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:44.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:44.329+0000 7f83a57b5640 1 --2- 172.21.15.7:0/2566595719 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f83a0104a30 0x7f83a0104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:44.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:44.329+0000 7f83a57b5640 1 -- 172.21.15.7:0/2566595719 >> 172.21.15.7:0/2566595719 conn(0x7f83a0079760 msgr2=0x7f83a0079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:44.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:44.329+0000 7f83a57b5640 1 -- 172.21.15.7:0/2566595719 shutdown_connections 2024-09-21T06:34:44.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:44.329+0000 7f83a57b5640 1 -- 172.21.15.7:0/2566595719 wait complete. 2024-09-21T06:34:44.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:44.330+0000 7f83a57b5640 1 Processor -- start 2024-09-21T06:34:44.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:44.330+0000 7f83a57b5640 1 -- start start 2024-09-21T06:34:44.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:44.330+0000 7f83a57b5640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f83a0104a30 0x7f83a019a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:44.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:44.330+0000 7f83a57b5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f83a0105380 0x7f83a019a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:44.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:44.330+0000 7f83a57b5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83a010de60 0x7f83a019fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:44.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:44.330+0000 7f83a57b5640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f83a0113aa0 con 0x7f83a010de60 2024-09-21T06:34:44.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:44.330+0000 7f83a57b5640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f83a0113920 con 0x7f83a0105380 2024-09-21T06:34:44.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:44.330+0000 7f83a57b5640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f83a0113c20 con 0x7f83a0104a30 2024-09-21T06:34:44.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:44.330+0000 7f839f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83a010de60 0x7f83a019fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:44.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:44.330+0000 7f839f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83a010de60 0x7f83a019fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38108/0 (socket says 172.21.15.7:38108) 2024-09-21T06:34:44.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:44.330+0000 7f839f7fe640 1 -- 172.21.15.7:0/1906384417 learned_addr learned my addr 172.21.15.7:0/1906384417 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:34:44.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:44.330+0000 7f839e7fc640 1 --2- 172.21.15.7:0/1906384417 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f83a0105380 0x7f83a019a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:44.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:44.331+0000 7f839effd640 1 --2- 172.21.15.7:0/1906384417 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f83a0104a30 0x7f83a019a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:44.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:44.331+0000 7f839f7fe640 1 -- 172.21.15.7:0/1906384417 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f83a0104a30 msgr2=0x7f83a019a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:44.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:44.331+0000 7f839f7fe640 1 --2- 172.21.15.7:0/1906384417 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f83a0104a30 0x7f83a019a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:44.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:44.331+0000 7f839f7fe640 1 -- 172.21.15.7:0/1906384417 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f83a0105380 msgr2=0x7f83a019a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:44.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:44.331+0000 7f839f7fe640 1 --2- 172.21.15.7:0/1906384417 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f83a0105380 0x7f83a019a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:44.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:44.331+0000 7f839f7fe640 1 -- 172.21.15.7:0/1906384417 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83a01a02e0 con 0x7f83a010de60 2024-09-21T06:34:44.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:44.331+0000 7f839f7fe640 1 --2- 172.21.15.7:0/1906384417 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83a010de60 0x7f83a019fc70 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f8398005cc0 tx=0x7f839802f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:44.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:44.331+0000 7f8387fff640 1 -- 172.21.15.7:0/1906384417 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8398003bf0 con 0x7f83a010de60 2024-09-21T06:34:44.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:44.331+0000 7f8387fff640 1 -- 172.21.15.7:0/1906384417 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8398003d90 con 0x7f83a010de60 2024-09-21T06:34:44.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:44.331+0000 7f83a57b5640 1 -- 172.21.15.7:0/1906384417 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83a01a0570 con 0x7f83a010de60 2024-09-21T06:34:44.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:44.331+0000 7f8387fff640 1 -- 172.21.15.7:0/1906384417 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f839802fb20 con 0x7f83a010de60 2024-09-21T06:34:44.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:44.331+0000 7f83a57b5640 1 -- 172.21.15.7:0/1906384417 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83a01a6df0 con 0x7f83a010de60 2024-09-21T06:34:44.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:44.332+0000 7f83a57b5640 1 -- 172.21.15.7:0/1906384417 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83a006c1f0 con 0x7f83a010de60 2024-09-21T06:34:44.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:44.335+0000 7f8387fff640 1 -- 172.21.15.7:0/1906384417 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154579+0+0 (secure 0 0 0) 0x7f8398004580 con 0x7f83a010de60 2024-09-21T06:34:44.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:44.335+0000 7f8387fff640 1 --2- 172.21.15.7:0/1906384417 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f83880b66a0 0x7f83880b8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:44.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:44.335+0000 7f839effd640 1 --2- 172.21.15.7:0/1906384417 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f83880b66a0 0x7f83880b8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:44.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:44.335+0000 7f8387fff640 1 -- 172.21.15.7:0/1906384417 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f8398108a20 con 0x7f83a010de60 2024-09-21T06:34:44.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:44.336+0000 7f839effd640 1 --2- 172.21.15.7:0/1906384417 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f83880b66a0 0x7f83880b8bb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8390005d00 tx=0x7f8390005c50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:44.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:44.339+0000 7f8387fff640 1 -- 172.21.15.7:0/1906384417 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f83980098b0 con 0x7f83a010de60 2024-09-21T06:34:44.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:44 smithi144 ceph-mon[34653]: pgmap v273: 97 pgs: 97 active+clean; 609 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.9 KiB/s wr, 14 op/s 2024-09-21T06:34:44.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:44 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2024-09-21T06:34:44.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:44 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2024-09-21T06:34:44.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:44 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]': finished 2024-09-21T06:34:44.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:44 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]': finished 2024-09-21T06:34:44.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:44 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2024-09-21T06:34:44.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:44 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]': finished 2024-09-21T06:34:44.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:44 smithi144 ceph-mon[34653]: osdmap e76: 12 total, 12 up, 12 in 2024-09-21T06:34:44.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:44.555+0000 7f83a57b5640 1 -- 172.21.15.7:0/1906384417 --> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f83a0108070 con 0x7f83880b66a0 2024-09-21T06:34:44.557 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:44 smithi007 ceph-mon[30983]: pgmap v273: 97 pgs: 97 active+clean; 609 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.9 KiB/s wr, 14 op/s 2024-09-21T06:34:44.557 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:44 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2024-09-21T06:34:44.557 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:44 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2024-09-21T06:34:44.557 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:44 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]': finished 2024-09-21T06:34:44.557 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:44 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]': finished 2024-09-21T06:34:44.557 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:44 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2024-09-21T06:34:44.557 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:44 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]': finished 2024-09-21T06:34:44.558 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:44 smithi007 ceph-mon[30983]: osdmap e76: 12 total, 12 up, 12 in 2024-09-21T06:34:44.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:44.561+0000 7f8387fff640 1 -- 172.21.15.7:0/1906384417 <== mgr.14223 v2:172.21.15.7:6800/3442812985 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f83a0108070 con 0x7f83880b66a0 2024-09-21T06:34:44.563 INFO:teuthology.orchestra.run.smithi007.stdout:/volumes/qa/sv_1/f0400eba-4fa3-4e83-a9cc-ae7f20332bca 2024-09-21T06:34:44.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:44.563+0000 7f83a57b5640 1 -- 172.21.15.7:0/1906384417 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f83880b66a0 msgr2=0x7f83880b8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:44.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:44.563+0000 7f83a57b5640 1 --2- 172.21.15.7:0/1906384417 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f83880b66a0 0x7f83880b8bb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8390005d00 tx=0x7f8390005c50 comp rx=0 tx=0).stop 2024-09-21T06:34:44.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:44.563+0000 7f83a57b5640 1 -- 172.21.15.7:0/1906384417 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83a010de60 msgr2=0x7f83a019fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:44.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:44.563+0000 7f83a57b5640 1 --2- 172.21.15.7:0/1906384417 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83a010de60 0x7f83a019fc70 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f8398005cc0 tx=0x7f839802f380 comp rx=0 tx=0).stop 2024-09-21T06:34:44.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:44.563+0000 7f83a57b5640 1 -- 172.21.15.7:0/1906384417 shutdown_connections 2024-09-21T06:34:44.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:44.563+0000 7f83a57b5640 1 --2- 172.21.15.7:0/1906384417 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f83880b66a0 0x7f83880b8bb0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:44.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:44.563+0000 7f83a57b5640 1 --2- 172.21.15.7:0/1906384417 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f83a010de60 0x7f83a019fc70 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:44.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:44.563+0000 7f83a57b5640 1 --2- 172.21.15.7:0/1906384417 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f83a0105380 0x7f83a019a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:44.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:44.563+0000 7f83a57b5640 1 --2- 172.21.15.7:0/1906384417 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f83a0104a30 0x7f83a019a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:44.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:44.563+0000 7f83a57b5640 1 -- 172.21.15.7:0/1906384417 >> 172.21.15.7:0/1906384417 conn(0x7f83a0079760 msgr2=0x7f83a0107960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:44.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:44.563+0000 7f83a57b5640 1 -- 172.21.15.7:0/1906384417 shutdown_connections 2024-09-21T06:34:44.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:44.563+0000 7f83a57b5640 1 -- 172.21.15.7:0/1906384417 wait complete. 2024-09-21T06:34:44.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:44 smithi018 ceph-mon[34477]: pgmap v273: 97 pgs: 97 active+clean; 609 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.9 KiB/s wr, 14 op/s 2024-09-21T06:34:44.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:44 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2024-09-21T06:34:44.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:44 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2024-09-21T06:34:44.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:44 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]': finished 2024-09-21T06:34:44.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:44 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]': finished 2024-09-21T06:34:44.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:44 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2024-09-21T06:34:44.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:44 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]': finished 2024-09-21T06:34:44.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:44 smithi018 ceph-mon[34477]: osdmap e76: 12 total, 12 up, 12 in 2024-09-21T06:34:45.224 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:34:45.481 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:34:45.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:45 smithi144 ceph-mon[34653]: osdmap e77: 12 total, 12 up, 12 in 2024-09-21T06:34:45.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:45 smithi144 ceph-mon[34653]: from='client.14946 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:34:45.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:45 smithi007 ceph-mon[30983]: osdmap e77: 12 total, 12 up, 12 in 2024-09-21T06:34:45.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:45 smithi007 ceph-mon[30983]: from='client.14946 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:34:45.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:45 smithi018 ceph-mon[34477]: osdmap e77: 12 total, 12 up, 12 in 2024-09-21T06:34:45.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:45 smithi018 ceph-mon[34477]: from='client.14946 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:34:46.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:46.019+0000 7f5b06093640 1 -- 172.21.15.7:0/3876082564 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b001083a0 msgr2=0x7f5b001087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:46.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:46.019+0000 7f5b06093640 1 --2- 172.21.15.7:0/3876082564 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b001083a0 0x7f5b001087b0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f5af4009900 tx=0x7f5af402a410 comp rx=0 tx=0).stop 2024-09-21T06:34:46.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:46.019+0000 7f5b06093640 1 -- 172.21.15.7:0/3876082564 shutdown_connections 2024-09-21T06:34:46.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:46.019+0000 7f5b06093640 1 --2- 172.21.15.7:0/3876082564 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5b00108cf0 0x7f5b0010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:46.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:46.019+0000 7f5b06093640 1 --2- 172.21.15.7:0/3876082564 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b001083a0 0x7f5b001087b0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:46.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:46.019+0000 7f5b06093640 1 --2- 172.21.15.7:0/3876082564 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b00102a60 0x7f5b00102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:46.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:46.019+0000 7f5b06093640 1 -- 172.21.15.7:0/3876082564 >> 172.21.15.7:0/3876082564 conn(0x7f5b00079730 msgr2=0x7f5b00079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:46.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:46.019+0000 7f5b06093640 1 -- 172.21.15.7:0/3876082564 shutdown_connections 2024-09-21T06:34:46.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:46.019+0000 7f5b06093640 1 -- 172.21.15.7:0/3876082564 wait complete. 2024-09-21T06:34:46.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:46.020+0000 7f5b06093640 1 Processor -- start 2024-09-21T06:34:46.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:46.020+0000 7f5b06093640 1 -- start start 2024-09-21T06:34:46.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:46.020+0000 7f5b06093640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b00102a60 0x7f5b0019b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:46.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:46.020+0000 7f5b06093640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5b001083a0 0x7f5b0019b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:46.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:46.020+0000 7f5b06093640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b00108cf0 0x7f5b0019bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:46.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:46.020+0000 7f5b06093640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5b00112960 con 0x7f5b00108cf0 2024-09-21T06:34:46.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:46.020+0000 7f5b06093640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5b001127e0 con 0x7f5b001083a0 2024-09-21T06:34:46.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:46.020+0000 7f5b06093640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5b00112ae0 con 0x7f5b00102a60 2024-09-21T06:34:46.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:46.020+0000 7f5afffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b00108cf0 0x7f5b0019bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:46.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:46.021+0000 7f5afeffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5b001083a0 0x7f5b0019b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:46.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:46.021+0000 7f5afffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b00108cf0 0x7f5b0019bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38126/0 (socket says 172.21.15.7:38126) 2024-09-21T06:34:46.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:46.021+0000 7f5afeffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5b001083a0 0x7f5b0019b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.7:38064/0 (socket says 172.21.15.7:38064) 2024-09-21T06:34:46.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:46.021+0000 7f5afffff640 1 -- 172.21.15.7:0/2159200073 learned_addr learned my addr 172.21.15.7:0/2159200073 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:34:46.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:46.021+0000 7f5aff7fe640 1 --2- 172.21.15.7:0/2159200073 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b00102a60 0x7f5b0019b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:46.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:46.021+0000 7f5afffff640 1 -- 172.21.15.7:0/2159200073 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b00102a60 msgr2=0x7f5b0019b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:46.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:46.021+0000 7f5afffff640 1 --2- 172.21.15.7:0/2159200073 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b00102a60 0x7f5b0019b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:46.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:46.021+0000 7f5afffff640 1 -- 172.21.15.7:0/2159200073 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5b001083a0 msgr2=0x7f5b0019b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:46.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:46.021+0000 7f5afffff640 1 --2- 172.21.15.7:0/2159200073 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5b001083a0 0x7f5b0019b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:46.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:46.021+0000 7f5afffff640 1 -- 172.21.15.7:0/2159200073 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b001a6530 con 0x7f5b00108cf0 2024-09-21T06:34:46.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:46.021+0000 7f5afffff640 1 --2- 172.21.15.7:0/2159200073 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b00108cf0 0x7f5b0019bdb0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f5af8009fd0 tx=0x7f5af800def0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:46.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:46.021+0000 7f5afcff9640 1 -- 172.21.15.7:0/2159200073 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5af8017070 con 0x7f5b00108cf0 2024-09-21T06:34:46.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:46.021+0000 7f5b06093640 1 -- 172.21.15.7:0/2159200073 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b001a6820 con 0x7f5b00108cf0 2024-09-21T06:34:46.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:46.021+0000 7f5afcff9640 1 -- 172.21.15.7:0/2159200073 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5af8003e20 con 0x7f5b00108cf0 2024-09-21T06:34:46.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:46.021+0000 7f5afcff9640 1 -- 172.21.15.7:0/2159200073 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5af8010460 con 0x7f5b00108cf0 2024-09-21T06:34:46.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:46.021+0000 7f5b06093640 1 -- 172.21.15.7:0/2159200073 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b001a6ce0 con 0x7f5b00108cf0 2024-09-21T06:34:46.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:46.023+0000 7f5b06093640 1 -- 172.21.15.7:0/2159200073 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b00103ce0 con 0x7f5b00108cf0 2024-09-21T06:34:46.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:46.025+0000 7f5afcff9640 1 -- 172.21.15.7:0/2159200073 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154579+0+0 (secure 0 0 0) 0x7f5af8003fd0 con 0x7f5b00108cf0 2024-09-21T06:34:46.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:46.026+0000 7f5afcff9640 1 --2- 172.21.15.7:0/2159200073 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f5ae80b6620 0x7f5ae80b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:46.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:46.026+0000 7f5aff7fe640 1 --2- 172.21.15.7:0/2159200073 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f5ae80b6620 0x7f5ae80b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:46.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:46.026+0000 7f5afcff9640 1 -- 172.21.15.7:0/2159200073 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f5af80e71c0 con 0x7f5b00108cf0 2024-09-21T06:34:46.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:46.027+0000 7f5aff7fe640 1 --2- 172.21.15.7:0/2159200073 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f5ae80b6620 0x7f5ae80b8b30 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5b0006b9c0 tx=0x7f5af000a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:46.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:46.029+0000 7f5afcff9640 1 -- 172.21.15.7:0/2159200073 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5af80ad870 con 0x7f5b00108cf0 2024-09-21T06:34:46.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:46.257+0000 7f5b06093640 1 -- 172.21.15.7:0/2159200073 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5b00102e70 con 0x7f5b00108cf0 2024-09-21T06:34:46.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:46.257+0000 7f5afcff9640 1 -- 172.21.15.7:0/2159200073 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11899 (secure 0 0 0) 0x7f5af80b1c50 con 0x7f5b00108cf0 2024-09-21T06:34:46.259 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:34:46.259 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":24,"btime":"2024-09-21T06:34:35:988361+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2015971546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2015971546},{"type":"v1","addr":"172.21.15.7:6835","nonce":2015971546}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/2350816224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":2350816224},{"type":"v1","addr":"172.21.15.7:6837","nonce":2350816224}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14823,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/1669980572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":1669980572},{"type":"v1","addr":"172.21.15.7:6839","nonce":1669980572}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14835,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/2528308973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":2528308973},{"type":"v1","addr":"172.21.15.7:6841","nonce":2528308973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24623,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1337382979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1337382979},{"type":"v1","addr":"172.21.15.18:6833","nonce":1337382979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/2751454345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":2751454345},{"type":"v1","addr":"172.21.15.144:6833","nonce":2751454345}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:34:24.627168+0000","modified":"2024-09-21T06:34:35.664086+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24716,"mds_1":24688,"mds_2":24686},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24656":{"gid":24656,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6835/158884796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":158884796},{"type":"v1","addr":"172.21.15.18:6835","nonce":158884796}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6835/3636739922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3636739922},{"type":"v1","addr":"172.21.15.144:6835","nonce":3636739922}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24673":{"gid":24673,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6837/1126341753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":1126341753},{"type":"v1","addr":"172.21.15.144:6837","nonce":1126341753}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.18:6837/1539670694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1539670694},{"type":"v1","addr":"172.21.15.18:6837","nonce":1539670694}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24688":{"gid":24688,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.144:6839/4027821922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":4027821922},{"type":"v1","addr":"172.21.15.144:6839","nonce":4027821922}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24716":{"gid":24716,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.18:6839/3798713532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":3798713532},{"type":"v1","addr":"172.21.15.18:6839","nonce":3798713532}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24716,"qdb_cluster":[24686,24688,24716]},"id":1}]} 2024-09-21T06:34:46.260 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 24 2024-09-21T06:34:46.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:46.259+0000 7f5b06093640 1 -- 172.21.15.7:0/2159200073 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f5ae80b6620 msgr2=0x7f5ae80b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:46.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:46.259+0000 7f5b06093640 1 --2- 172.21.15.7:0/2159200073 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f5ae80b6620 0x7f5ae80b8b30 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5b0006b9c0 tx=0x7f5af000a2d0 comp rx=0 tx=0).stop 2024-09-21T06:34:46.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:46.259+0000 7f5b06093640 1 -- 172.21.15.7:0/2159200073 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b00108cf0 msgr2=0x7f5b0019bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:46.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:46.259+0000 7f5b06093640 1 --2- 172.21.15.7:0/2159200073 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b00108cf0 0x7f5b0019bdb0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f5af8009fd0 tx=0x7f5af800def0 comp rx=0 tx=0).stop 2024-09-21T06:34:46.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:46.259+0000 7f5b06093640 1 -- 172.21.15.7:0/2159200073 shutdown_connections 2024-09-21T06:34:46.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:46.259+0000 7f5b06093640 1 --2- 172.21.15.7:0/2159200073 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f5ae80b6620 0x7f5ae80b8b30 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:46.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:46.259+0000 7f5b06093640 1 --2- 172.21.15.7:0/2159200073 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b00108cf0 0x7f5b0019bdb0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:46.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:46.259+0000 7f5b06093640 1 --2- 172.21.15.7:0/2159200073 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5b001083a0 0x7f5b0019b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:46.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:46.259+0000 7f5b06093640 1 --2- 172.21.15.7:0/2159200073 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b00102a60 0x7f5b0019b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:46.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:46.260+0000 7f5b06093640 1 -- 172.21.15.7:0/2159200073 >> 172.21.15.7:0/2159200073 conn(0x7f5b00079730 msgr2=0x7f5b001044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:46.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:46.260+0000 7f5b06093640 1 -- 172.21.15.7:0/2159200073 shutdown_connections 2024-09-21T06:34:46.262 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:46.260+0000 7f5b06093640 1 -- 172.21.15.7:0/2159200073 wait complete. 2024-09-21T06:34:46.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:46 smithi144 ceph-mon[34653]: pgmap v276: 97 pgs: 1 peering, 96 active+clean; 609 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 4.6 KiB/s wr, 12 op/s 2024-09-21T06:34:46.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:46 smithi007 ceph-mon[30983]: pgmap v276: 97 pgs: 1 peering, 96 active+clean; 609 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 4.6 KiB/s wr, 12 op/s 2024-09-21T06:34:46.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:46 smithi018 ceph-mon[34477]: pgmap v276: 97 pgs: 1 peering, 96 active+clean; 609 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 4.6 KiB/s wr, 12 op/s 2024-09-21T06:34:46.981 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T06:34:47.247 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:34:47.509 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:47 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2159200073' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:34:47.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:47 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/2159200073' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:34:47.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:47 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/2159200073' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:34:47.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:47.711+0000 7fdb87bdb640 1 -- 172.21.15.7:0/319803004 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb80114430 msgr2=0x7fdb80116900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:47.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:47.711+0000 7fdb87bdb640 1 --2- 172.21.15.7:0/319803004 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb80114430 0x7fdb80116900 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fdb78009ca0 tx=0x7fdb7802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:34:47.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:47.712+0000 7fdb87bdb640 1 -- 172.21.15.7:0/319803004 shutdown_connections 2024-09-21T06:34:47.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:47.712+0000 7fdb87bdb640 1 --2- 172.21.15.7:0/319803004 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb80114430 0x7fdb80116900 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:47.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:47.712+0000 7fdb87bdb640 1 --2- 172.21.15.7:0/319803004 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdb80075dd0 0x7fdb800761e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:47.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:47.712+0000 7fdb87bdb640 1 --2- 172.21.15.7:0/319803004 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb80077380 0x7fdb800757b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:47.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:47.712+0000 7fdb87bdb640 1 -- 172.21.15.7:0/319803004 >> 172.21.15.7:0/319803004 conn(0x7fdb8007b850 msgr2=0x7fdb8007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:47.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:47.712+0000 7fdb87bdb640 1 -- 172.21.15.7:0/319803004 shutdown_connections 2024-09-21T06:34:47.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:47.712+0000 7fdb87bdb640 1 -- 172.21.15.7:0/319803004 wait complete. 2024-09-21T06:34:47.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:47.712+0000 7fdb87bdb640 1 Processor -- start 2024-09-21T06:34:47.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:47.712+0000 7fdb87bdb640 1 -- start start 2024-09-21T06:34:47.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:47.713+0000 7fdb87bdb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb80075dd0 0x7fdb801a0a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:47.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:47.713+0000 7fdb87bdb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb80077380 0x7fdb801a0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:47.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:47.713+0000 7fdb87bdb640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdb80114430 0x7fdb801a6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:47.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:47.713+0000 7fdb87bdb640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fdb8011a060 con 0x7fdb80075dd0 2024-09-21T06:34:47.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:47.713+0000 7fdb87bdb640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fdb80119ee0 con 0x7fdb80077380 2024-09-21T06:34:47.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:47.713+0000 7fdb87bdb640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fdb8011a1e0 con 0x7fdb80114430 2024-09-21T06:34:47.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:47.713+0000 7fdb85977640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb80075dd0 0x7fdb801a0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:47.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:47.713+0000 7fdb85977640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb80075dd0 0x7fdb801a0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38138/0 (socket says 172.21.15.7:38138) 2024-09-21T06:34:47.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:47.713+0000 7fdb85977640 1 -- 172.21.15.7:0/2883485502 learned_addr learned my addr 172.21.15.7:0/2883485502 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:34:47.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:47.713+0000 7fdb85176640 1 --2- 172.21.15.7:0/2883485502 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb80077380 0x7fdb801a0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:47.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:47.713+0000 7fdb86178640 1 --2- 172.21.15.7:0/2883485502 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdb80114430 0x7fdb801a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:47.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:47.713+0000 7fdb85977640 1 -- 172.21.15.7:0/2883485502 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdb80114430 msgr2=0x7fdb801a6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:47.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:47.713+0000 7fdb85977640 1 --2- 172.21.15.7:0/2883485502 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdb80114430 0x7fdb801a6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:47.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:47.713+0000 7fdb85977640 1 -- 172.21.15.7:0/2883485502 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb80077380 msgr2=0x7fdb801a0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:47.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:47.713+0000 7fdb85977640 1 --2- 172.21.15.7:0/2883485502 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb80077380 0x7fdb801a0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:47.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:47.713+0000 7fdb85977640 1 -- 172.21.15.7:0/2883485502 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb801a6980 con 0x7fdb80075dd0 2024-09-21T06:34:47.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:47.713+0000 7fdb86178640 1 --2- 172.21.15.7:0/2883485502 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdb80114430 0x7fdb801a6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:34:47.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:47.713+0000 7fdb85977640 1 --2- 172.21.15.7:0/2883485502 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb80075dd0 0x7fdb801a0a10 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c00e9f0 tx=0x7fdb7c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:47.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:47.714+0000 7fdb76ffd640 1 -- 172.21.15.7:0/2883485502 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb7c00cd80 con 0x7fdb80075dd0 2024-09-21T06:34:47.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:47.714+0000 7fdb76ffd640 1 -- 172.21.15.7:0/2883485502 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdb7c0108e0 con 0x7fdb80075dd0 2024-09-21T06:34:47.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:47.714+0000 7fdb76ffd640 1 -- 172.21.15.7:0/2883485502 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb7c018980 con 0x7fdb80075dd0 2024-09-21T06:34:47.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:47.714+0000 7fdb87bdb640 1 -- 172.21.15.7:0/2883485502 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb801a6c70 con 0x7fdb80075dd0 2024-09-21T06:34:47.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:47.714+0000 7fdb87bdb640 1 -- 172.21.15.7:0/2883485502 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb801ad3d0 con 0x7fdb80075dd0 2024-09-21T06:34:47.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:47.715+0000 7fdb87bdb640 1 -- 172.21.15.7:0/2883485502 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb800761e0 con 0x7fdb80075dd0 2024-09-21T06:34:47.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:47.716+0000 7fdb76ffd640 1 -- 172.21.15.7:0/2883485502 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154579+0+0 (secure 0 0 0) 0x7fdb7c010430 con 0x7fdb80075dd0 2024-09-21T06:34:47.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:47.717+0000 7fdb76ffd640 1 --2- 172.21.15.7:0/2883485502 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fdb6c0b6670 0x7fdb6c0b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:47.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:47.717+0000 7fdb85176640 1 --2- 172.21.15.7:0/2883485502 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fdb6c0b6670 0x7fdb6c0b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:47.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:47.717+0000 7fdb76ffd640 1 -- 172.21.15.7:0/2883485502 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fdb7c0e7d60 con 0x7fdb80075dd0 2024-09-21T06:34:47.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:47.718+0000 7fdb85176640 1 --2- 172.21.15.7:0/2883485502 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fdb6c0b6670 0x7fdb6c0b8b80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fdb80115770 tx=0x7fdb70005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:47.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:47.720+0000 7fdb76ffd640 1 -- 172.21.15.7:0/2883485502 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdb7c0ae410 con 0x7fdb80075dd0 2024-09-21T06:34:47.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:47.912+0000 7fdb87bdb640 1 -- 172.21.15.7:0/2883485502 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdb801a1b40 con 0x7fdb80075dd0 2024-09-21T06:34:47.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:47.913+0000 7fdb76ffd640 1 -- 172.21.15.7:0/2883485502 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+22791 (secure 0 0 0) 0x7fdb7c0b27f0 con 0x7fdb80075dd0 2024-09-21T06:34:47.915 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:34:47.915 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":77,"fsid":"347cb918-77e2-11ef-baf5-efdc52797490","created":"2024-09-21T06:25:51.925032+0000","modified":"2024-09-21T06:34:44.220989+0000","last_up_change":"2024-09-21T06:33:32.888843+0000","last_in_change":"2024-09-21T06:33:09.926778+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:29:41.514179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:34:20.531755+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T06:34:22.552541+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1be5c4a4-3931-4d8b-95c7-c05f5b73fcfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":942632794},{"type":"v1","addr":"172.21.15.7:6803","nonce":942632794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":942632794},{"type":"v1","addr":"172.21.15.7:6805","nonce":942632794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":942632794},{"type":"v1","addr":"172.21.15.7:6809","nonce":942632794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":942632794},{"type":"v1","addr":"172.21.15.7:6807","nonce":942632794}]},"public_addr":"172.21.15.7:6803/942632794","cluster_addr":"172.21.15.7:6805/942632794","heartbeat_back_addr":"172.21.15.7:6809/942632794","heartbeat_front_addr":"172.21.15.7:6807/942632794","state":["exists","up"]},{"osd":1,"uuid":"7ae136a8-c614-47e5-b265-c6cfa857a7fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1839342931},{"type":"v1","addr":"172.21.15.18:6801","nonce":1839342931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1839342931},{"type":"v1","addr":"172.21.15.18:6803","nonce":1839342931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1839342931},{"type":"v1","addr":"172.21.15.18:6807","nonce":1839342931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1839342931},{"type":"v1","addr":"172.21.15.18:6805","nonce":1839342931}]},"public_addr":"172.21.15.18:6801/1839342931","cluster_addr":"172.21.15.18:6803/1839342931","heartbeat_back_addr":"172.21.15.18:6807/1839342931","heartbeat_front_addr":"172.21.15.18:6805/1839342931","state":["exists","up"]},{"osd":2,"uuid":"97b13994-4680-4573-9c2e-ac65ea740e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":1699582162},{"type":"v1","addr":"172.21.15.144:6801","nonce":1699582162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":1699582162},{"type":"v1","addr":"172.21.15.144:6803","nonce":1699582162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":1699582162},{"type":"v1","addr":"172.21.15.144:6807","nonce":1699582162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":1699582162},{"type":"v1","addr":"172.21.15.144:6805","nonce":1699582162}]},"public_addr":"172.21.15.144:6801/1699582162","cluster_addr":"172.21.15.144:6803/1699582162","heartbeat_back_addr":"172.21.15.144:6807/1699582162","heartbeat_front_addr":"172.21.15.144:6805/1699582162","state":["exists","up"]},{"osd":3,"uuid":"ddf70d51-404d-491d-a6a8-15fca4ef01db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":3202935163},{"type":"v1","addr":"172.21.15.7:6811","nonce":3202935163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":3202935163},{"type":"v1","addr":"172.21.15.7:6813","nonce":3202935163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":3202935163},{"type":"v1","addr":"172.21.15.7:6817","nonce":3202935163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":3202935163},{"type":"v1","addr":"172.21.15.7:6815","nonce":3202935163}]},"public_addr":"172.21.15.7:6811/3202935163","cluster_addr":"172.21.15.7:6813/3202935163","heartbeat_back_addr":"172.21.15.7:6817/3202935163","heartbeat_front_addr":"172.21.15.7:6815/3202935163","state":["exists","up"]},{"osd":4,"uuid":"f2ae4340-accf-4ac0-a4d3-c08302712ce1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1058105724},{"type":"v1","addr":"172.21.15.18:6809","nonce":1058105724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":1058105724},{"type":"v1","addr":"172.21.15.18:6811","nonce":1058105724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":1058105724},{"type":"v1","addr":"172.21.15.18:6815","nonce":1058105724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":1058105724},{"type":"v1","addr":"172.21.15.18:6813","nonce":1058105724}]},"public_addr":"172.21.15.18:6809/1058105724","cluster_addr":"172.21.15.18:6811/1058105724","heartbeat_back_addr":"172.21.15.18:6815/1058105724","heartbeat_front_addr":"172.21.15.18:6813/1058105724","state":["exists","up"]},{"osd":5,"uuid":"d56abc37-de6f-47a4-9f5e-67224da78f4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":2814586621},{"type":"v1","addr":"172.21.15.144:6809","nonce":2814586621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":2814586621},{"type":"v1","addr":"172.21.15.144:6811","nonce":2814586621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":2814586621},{"type":"v1","addr":"172.21.15.144:6815","nonce":2814586621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":2814586621},{"type":"v1","addr":"172.21.15.144:6813","nonce":2814586621}]},"public_addr":"172.21.15.144:6809/2814586621","cluster_addr":"172.21.15.144:6811/2814586621","heartbeat_back_addr":"172.21.15.144:6815/2814586621","heartbeat_front_addr":"172.21.15.144:6813/2814586621","state":["exists","up"]},{"osd":6,"uuid":"9145650c-e9b1-4e5a-ae6f-17c8960146e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":3770978305},{"type":"v1","addr":"172.21.15.7:6819","nonce":3770978305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":3770978305},{"type":"v1","addr":"172.21.15.7:6821","nonce":3770978305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3770978305},{"type":"v1","addr":"172.21.15.7:6825","nonce":3770978305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":3770978305},{"type":"v1","addr":"172.21.15.7:6823","nonce":3770978305}]},"public_addr":"172.21.15.7:6819/3770978305","cluster_addr":"172.21.15.7:6821/3770978305","heartbeat_back_addr":"172.21.15.7:6825/3770978305","heartbeat_front_addr":"172.21.15.7:6823/3770978305","state":["exists","up"]},{"osd":7,"uuid":"ca658683-38f7-47ca-b32e-512fe4738ef1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":1322408496},{"type":"v1","addr":"172.21.15.18:6817","nonce":1322408496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1322408496},{"type":"v1","addr":"172.21.15.18:6819","nonce":1322408496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1322408496},{"type":"v1","addr":"172.21.15.18:6823","nonce":1322408496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1322408496},{"type":"v1","addr":"172.21.15.18:6821","nonce":1322408496}]},"public_addr":"172.21.15.18:6817/1322408496","cluster_addr":"172.21.15.18:6819/1322408496","heartbeat_back_addr":"172.21.15.18:6823/1322408496","heartbeat_front_addr":"172.21.15.18:6821/1322408496","state":["exists","up"]},{"osd":8,"uuid":"40d1f37e-6fac-40b9-9319-78f4fc3a6f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1011657022},{"type":"v1","addr":"172.21.15.144:6817","nonce":1011657022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1011657022},{"type":"v1","addr":"172.21.15.144:6819","nonce":1011657022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1011657022},{"type":"v1","addr":"172.21.15.144:6823","nonce":1011657022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":1011657022},{"type":"v1","addr":"172.21.15.144:6821","nonce":1011657022}]},"public_addr":"172.21.15.144:6817/1011657022","cluster_addr":"172.21.15.144:6819/1011657022","heartbeat_back_addr":"172.21.15.144:6823/1011657022","heartbeat_front_addr":"172.21.15.144:6821/1011657022","state":["exists","up"]},{"osd":9,"uuid":"ad12d6f7-fd21-49bd-a343-744f3cff4bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":256146339},{"type":"v1","addr":"172.21.15.7:6827","nonce":256146339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":256146339},{"type":"v1","addr":"172.21.15.7:6829","nonce":256146339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":256146339},{"type":"v1","addr":"172.21.15.7:6833","nonce":256146339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":256146339},{"type":"v1","addr":"172.21.15.7:6831","nonce":256146339}]},"public_addr":"172.21.15.7:6827/256146339","cluster_addr":"172.21.15.7:6829/256146339","heartbeat_back_addr":"172.21.15.7:6833/256146339","heartbeat_front_addr":"172.21.15.7:6831/256146339","state":["exists","up"]},{"osd":10,"uuid":"1317a2ad-ec15-4096-b2da-689475b7cacc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":2038885362},{"type":"v1","addr":"172.21.15.18:6825","nonce":2038885362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2038885362},{"type":"v1","addr":"172.21.15.18:6827","nonce":2038885362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2038885362},{"type":"v1","addr":"172.21.15.18:6831","nonce":2038885362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2038885362},{"type":"v1","addr":"172.21.15.18:6829","nonce":2038885362}]},"public_addr":"172.21.15.18:6825/2038885362","cluster_addr":"172.21.15.18:6827/2038885362","heartbeat_back_addr":"172.21.15.18:6831/2038885362","heartbeat_front_addr":"172.21.15.18:6829/2038885362","state":["exists","up"]},{"osd":11,"uuid":"f9252acb-7290-4923-89f3-844c868d4b39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":1047060848},{"type":"v1","addr":"172.21.15.144:6825","nonce":1047060848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":1047060848},{"type":"v1","addr":"172.21.15.144:6827","nonce":1047060848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":1047060848},{"type":"v1","addr":"172.21.15.144:6831","nonce":1047060848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":1047060848},{"type":"v1","addr":"172.21.15.144:6829","nonce":1047060848}]},"public_addr":"172.21.15.144:6825/1047060848","cluster_addr":"172.21.15.144:6827/1047060848","heartbeat_back_addr":"172.21.15.144:6831/1047060848","heartbeat_front_addr":"172.21.15.144:6829/1047060848","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:28:48.842729+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:29:13.946624+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:29:38.589666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:30:05.116339+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:30:30.562090+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:30:55.586210+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:31:22.138457+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:31:49.178090+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:32:13.687830+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:32:40.408193+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:33:06.044578+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:33:30.988851+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/1296137341":"2024-09-22T06:27:43.044484+0000","172.21.15.7:6801/3879502931":"2024-09-22T06:27:43.044484+0000","172.21.15.7:0/1926706877":"2024-09-22T06:26:40.520265+0000","172.21.15.7:0/2034370456":"2024-09-22T06:26:14.181426+0000","172.21.15.7:6801/3339522713":"2024-09-22T06:26:14.181426+0000","172.21.15.7:6800/3339522713":"2024-09-22T06:26:14.181426+0000","172.21.15.7:0/3586807770":"2024-09-22T06:26:14.181426+0000","172.21.15.7:0/1814223919":"2024-09-22T06:27:43.044484+0000","172.21.15.7:0/601150037":"2024-09-22T06:26:40.520265+0000","172.21.15.7:6800/3876787626":"2024-09-22T06:26:40.520265+0000","172.21.15.7:0/186444636":"2024-09-22T06:26:14.181426+0000","172.21.15.7:0/2180184348":"2024-09-22T06:26:40.520265+0000","172.21.15.7:6801/3876787626":"2024-09-22T06:26:40.520265+0000","172.21.15.7:0/2931793461":"2024-09-22T06:27:43.044484+0000","172.21.15.7:6800/3879502931":"2024-09-22T06:27:43.044484+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:34:47.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:47.916+0000 7fdb87bdb640 1 -- 172.21.15.7:0/2883485502 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fdb6c0b6670 msgr2=0x7fdb6c0b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:47.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:47.916+0000 7fdb87bdb640 1 --2- 172.21.15.7:0/2883485502 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fdb6c0b6670 0x7fdb6c0b8b80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fdb80115770 tx=0x7fdb70005f90 comp rx=0 tx=0).stop 2024-09-21T06:34:47.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:47.916+0000 7fdb87bdb640 1 -- 172.21.15.7:0/2883485502 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb80075dd0 msgr2=0x7fdb801a0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:47.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:47.916+0000 7fdb87bdb640 1 --2- 172.21.15.7:0/2883485502 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb80075dd0 0x7fdb801a0a10 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c00e9f0 tx=0x7fdb7c00eeb0 comp rx=0 tx=0).stop 2024-09-21T06:34:47.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:47.916+0000 7fdb87bdb640 1 -- 172.21.15.7:0/2883485502 shutdown_connections 2024-09-21T06:34:47.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:47.916+0000 7fdb87bdb640 1 --2- 172.21.15.7:0/2883485502 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fdb6c0b6670 0x7fdb6c0b8b80 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:47.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:47.916+0000 7fdb87bdb640 1 --2- 172.21.15.7:0/2883485502 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdb80114430 0x7fdb801a6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:47.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:47.916+0000 7fdb87bdb640 1 --2- 172.21.15.7:0/2883485502 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb80077380 0x7fdb801a0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:47.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:47.916+0000 7fdb87bdb640 1 --2- 172.21.15.7:0/2883485502 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdb80075dd0 0x7fdb801a0a10 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:47.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:47.916+0000 7fdb87bdb640 1 -- 172.21.15.7:0/2883485502 >> 172.21.15.7:0/2883485502 conn(0x7fdb8007b850 msgr2=0x7fdb80113040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:47.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:47.916+0000 7fdb87bdb640 1 -- 172.21.15.7:0/2883485502 shutdown_connections 2024-09-21T06:34:47.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:47.916+0000 7fdb87bdb640 1 -- 172.21.15.7:0/2883485502 wait complete. 2024-09-21T06:34:48.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:48 smithi144 ceph-mon[34653]: pgmap v277: 97 pgs: 1 peering, 96 active+clean; 609 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.2 KiB/s wr, 6 op/s 2024-09-21T06:34:48.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:48 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/2883485502' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:34:48.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:48 smithi007 ceph-mon[30983]: pgmap v277: 97 pgs: 1 peering, 96 active+clean; 609 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.2 KiB/s wr, 6 op/s 2024-09-21T06:34:48.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:48 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2883485502' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:34:48.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:48 smithi018 ceph-mon[34477]: pgmap v277: 97 pgs: 1 peering, 96 active+clean; 609 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.2 KiB/s wr, 6 op/s 2024-09-21T06:34:48.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:48 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/2883485502' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:34:48.628 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-21T06:34:48.628 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T06:34:48.891 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:34:49.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:49.413+0000 7fb90fde9640 1 -- 172.21.15.7:0/2691727816 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb908109e10 msgr2=0x7fb908110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:49.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:49.413+0000 7fb90fde9640 1 --2- 172.21.15.7:0/2691727816 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb908109e10 0x7fb908110640 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fb900009ca0 tx=0x7fb90002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:34:49.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:49.413+0000 7fb90fde9640 1 -- 172.21.15.7:0/2691727816 shutdown_connections 2024-09-21T06:34:49.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:49.413+0000 7fb90fde9640 1 --2- 172.21.15.7:0/2691727816 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb908109e10 0x7fb908110640 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:49.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:49.413+0000 7fb90fde9640 1 --2- 172.21.15.7:0/2691727816 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9081094c0 0x7fb9081098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:49.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:49.413+0000 7fb90fde9640 1 --2- 172.21.15.7:0/2691727816 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb908103b80 0x7fb908103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:49.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:49.413+0000 7fb90fde9640 1 -- 172.21.15.7:0/2691727816 >> 172.21.15.7:0/2691727816 conn(0x7fb9080ff5d0 msgr2=0x7fb908101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:49.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:49.413+0000 7fb90fde9640 1 -- 172.21.15.7:0/2691727816 shutdown_connections 2024-09-21T06:34:49.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:49.413+0000 7fb90fde9640 1 -- 172.21.15.7:0/2691727816 wait complete. 2024-09-21T06:34:49.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:49.413+0000 7fb90fde9640 1 Processor -- start 2024-09-21T06:34:49.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:49.414+0000 7fb90fde9640 1 -- start start 2024-09-21T06:34:49.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:49.414+0000 7fb90fde9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb908103b80 0x7fb90819a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:49.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:49.414+0000 7fb90fde9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb9081094c0 0x7fb90819a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:49.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:49.414+0000 7fb90fde9640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb908109e10 0x7fb90819fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:49.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:49.414+0000 7fb90fde9640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb908113ad0 con 0x7fb9081094c0 2024-09-21T06:34:49.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:49.414+0000 7fb90fde9640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb908113950 con 0x7fb908103b80 2024-09-21T06:34:49.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:49.414+0000 7fb90fde9640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb908113c50 con 0x7fb908109e10 2024-09-21T06:34:49.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:49.414+0000 7fb90d384640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb9081094c0 0x7fb90819a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:49.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:49.414+0000 7fb90d384640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb9081094c0 0x7fb90819a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38148/0 (socket says 172.21.15.7:38148) 2024-09-21T06:34:49.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:49.414+0000 7fb90d384640 1 -- 172.21.15.7:0/3812447543 learned_addr learned my addr 172.21.15.7:0/3812447543 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:34:49.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:49.414+0000 7fb90db85640 1 --2- 172.21.15.7:0/3812447543 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb908103b80 0x7fb90819a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:49.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:49.414+0000 7fb90d384640 1 -- 172.21.15.7:0/3812447543 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb908109e10 msgr2=0x7fb90819fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:49.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:49.414+0000 7fb90e386640 1 --2- 172.21.15.7:0/3812447543 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb908109e10 0x7fb90819fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:49.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:49.414+0000 7fb90d384640 1 --2- 172.21.15.7:0/3812447543 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb908109e10 0x7fb90819fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:49.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:49.414+0000 7fb90d384640 1 -- 172.21.15.7:0/3812447543 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb908103b80 msgr2=0x7fb90819a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:49.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:49.414+0000 7fb90d384640 1 --2- 172.21.15.7:0/3812447543 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb908103b80 0x7fb90819a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:49.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:49.414+0000 7fb90d384640 1 -- 172.21.15.7:0/3812447543 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9081a03b0 con 0x7fb9081094c0 2024-09-21T06:34:49.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:49.414+0000 7fb90d384640 1 --2- 172.21.15.7:0/3812447543 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb9081094c0 0x7fb90819a9e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fb8f800e9f0 tx=0x7fb8f800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:49.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:49.415+0000 7fb8feffd640 1 -- 172.21.15.7:0/3812447543 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8f800ccc0 con 0x7fb9081094c0 2024-09-21T06:34:49.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:49.415+0000 7fb8feffd640 1 -- 172.21.15.7:0/3812447543 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb8f80108e0 con 0x7fb9081094c0 2024-09-21T06:34:49.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:49.415+0000 7fb90fde9640 1 -- 172.21.15.7:0/3812447543 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9081a06a0 con 0x7fb9081094c0 2024-09-21T06:34:49.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:49.415+0000 7fb8feffd640 1 -- 172.21.15.7:0/3812447543 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8f8018860 con 0x7fb9081094c0 2024-09-21T06:34:49.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:49.415+0000 7fb90fde9640 1 -- 172.21.15.7:0/3812447543 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9081a6e00 con 0x7fb9081094c0 2024-09-21T06:34:49.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:49.416+0000 7fb90fde9640 1 -- 172.21.15.7:0/3812447543 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb908103f90 con 0x7fb9081094c0 2024-09-21T06:34:49.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:49.417+0000 7fb8feffd640 1 -- 172.21.15.7:0/3812447543 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154579+0+0 (secure 0 0 0) 0x7fb8f8010430 con 0x7fb9081094c0 2024-09-21T06:34:49.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:49.418+0000 7fb8feffd640 1 --2- 172.21.15.7:0/3812447543 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fb8f40b65f0 0x7fb8f40b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:49.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:49.418+0000 7fb90db85640 1 --2- 172.21.15.7:0/3812447543 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fb8f40b65f0 0x7fb8f40b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:49.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:49.418+0000 7fb8feffd640 1 -- 172.21.15.7:0/3812447543 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fb8f80e7dc0 con 0x7fb9081094c0 2024-09-21T06:34:49.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:49.419+0000 7fb90db85640 1 --2- 172.21.15.7:0/3812447543 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fb8f40b65f0 0x7fb8f40b8b00 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb904009bd0 tx=0x7fb904005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:49.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:49.421+0000 7fb8feffd640 1 -- 172.21.15.7:0/3812447543 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb8f80ae430 con 0x7fb9081094c0 2024-09-21T06:34:49.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:49.604+0000 7fb90fde9640 1 -- 172.21.15.7:0/3812447543 --> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb908063800 con 0x7fb8f40b65f0 2024-09-21T06:34:49.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:49.608+0000 7fb8feffd640 1 -- 172.21.15.7:0/3812447543 <== mgr.14223 v2:172.21.15.7:6800/3442812985 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258943 (secure 0 0 0) 0x7fb908063800 con 0x7fb8f40b65f0 2024-09-21T06:34:49.612 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:34:49.613 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-09-21T06:34:49.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:49.613+0000 7fb90fde9640 1 -- 172.21.15.7:0/3812447543 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fb8f40b65f0 msgr2=0x7fb8f40b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:49.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:49.613+0000 7fb90fde9640 1 --2- 172.21.15.7:0/3812447543 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fb8f40b65f0 0x7fb8f40b8b00 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb904009bd0 tx=0x7fb904005f90 comp rx=0 tx=0).stop 2024-09-21T06:34:49.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:49.613+0000 7fb90fde9640 1 -- 172.21.15.7:0/3812447543 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb9081094c0 msgr2=0x7fb90819a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:49.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:49.613+0000 7fb90fde9640 1 --2- 172.21.15.7:0/3812447543 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb9081094c0 0x7fb90819a9e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fb8f800e9f0 tx=0x7fb8f800eeb0 comp rx=0 tx=0).stop 2024-09-21T06:34:49.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:49.613+0000 7fb90fde9640 1 -- 172.21.15.7:0/3812447543 shutdown_connections 2024-09-21T06:34:49.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:49.613+0000 7fb90fde9640 1 --2- 172.21.15.7:0/3812447543 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fb8f40b65f0 0x7fb8f40b8b00 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:49.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:49.613+0000 7fb90fde9640 1 --2- 172.21.15.7:0/3812447543 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb908109e10 0x7fb90819fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:49.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:49.613+0000 7fb90fde9640 1 --2- 172.21.15.7:0/3812447543 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb9081094c0 0x7fb90819a9e0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:49.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:49.613+0000 7fb90fde9640 1 --2- 172.21.15.7:0/3812447543 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb908103b80 0x7fb90819a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:49.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:49.613+0000 7fb90fde9640 1 -- 172.21.15.7:0/3812447543 >> 172.21.15.7:0/3812447543 conn(0x7fb9080ff5d0 msgr2=0x7fb9081019f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:49.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:49.613+0000 7fb90fde9640 1 -- 172.21.15.7:0/3812447543 shutdown_connections 2024-09-21T06:34:49.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:49.613+0000 7fb90fde9640 1 -- 172.21.15.7:0/3812447543 wait complete. 2024-09-21T06:34:50.406 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":278,"stamp":"2024-09-21T06:34:49.139176+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":649244,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":188,"num_read_kb":183,"num_write":280,"num_write_kb":2255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":2951840,"num_keys_recovered":11,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":294,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":367920,"kb_used_data":10284,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124573904,"statfs":{"total":1151940427776,"available":1151563677696,"internally_reserved":0,"allocated":10530816,"data_stored":6929218,"data_compressed":171589,"data_compressed_allocated":225280,"data_compressed_original":1949696,"omap_allocated":19143,"internal_metadata":365933881},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":46272,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":61,"num_read_kb":80,"num_write":27,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002357"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.225546+0000","last_change":"2024-09-21T06:34:23.958146+0000","last_active":"2024-09-21T06:34:44.225546+0000","last_peered":"2024-09-21T06:34:44.225546+0000","last_clean":"2024-09-21T06:34:44.225546+0000","last_became_active":"2024-09-21T06:34:23.957580+0000","last_became_peered":"2024-09-21T06:34:23.957580+0000","last_unstale":"2024-09-21T06:34:44.225546+0000","last_undegraded":"2024-09-21T06:34:44.225546+0000","last_fullsized":"2024-09-21T06:34:44.225546+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:33:05.975310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265758+0000","last_change":"2024-09-21T06:34:23.948439+0000","last_active":"2024-09-21T06:34:44.265758+0000","last_peered":"2024-09-21T06:34:44.265758+0000","last_clean":"2024-09-21T06:34:44.265758+0000","last_became_active":"2024-09-21T06:34:23.947511+0000","last_became_peered":"2024-09-21T06:34:23.947511+0000","last_unstale":"2024-09-21T06:34:44.265758+0000","last_undegraded":"2024-09-21T06:34:44.265758+0000","last_fullsized":"2024-09-21T06:34:44.265758+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:13:53.589979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.264949+0000","last_change":"2024-09-21T06:34:23.950752+0000","last_active":"2024-09-21T06:34:44.264949+0000","last_peered":"2024-09-21T06:34:44.264949+0000","last_clean":"2024-09-21T06:34:44.264949+0000","last_became_active":"2024-09-21T06:34:23.950373+0000","last_became_peered":"2024-09-21T06:34:23.950373+0000","last_unstale":"2024-09-21T06:34:44.264949+0000","last_undegraded":"2024-09-21T06:34:44.264949+0000","last_fullsized":"2024-09-21T06:34:44.264949+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:01:29.183426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.267740+0000","last_change":"2024-09-21T06:34:44.267265+0000","last_active":"2024-09-21T06:34:44.267740+0000","last_peered":"2024-09-21T06:34:44.267740+0000","last_clean":"2024-09-21T06:34:44.267740+0000","last_became_active":"2024-09-21T06:34:44.266829+0000","last_became_peered":"2024-09-21T06:34:44.266829+0000","last_unstale":"2024-09-21T06:34:44.267740+0000","last_undegraded":"2024-09-21T06:34:44.267740+0000","last_fullsized":"2024-09-21T06:34:44.267740+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:47:57.873167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.229953+0000","last_change":"2024-09-21T06:34:23.947578+0000","last_active":"2024-09-21T06:34:44.229953+0000","last_peered":"2024-09-21T06:34:44.229953+0000","last_clean":"2024-09-21T06:34:44.229953+0000","last_became_active":"2024-09-21T06:34:23.947201+0000","last_became_peered":"2024-09-21T06:34:23.947201+0000","last_unstale":"2024-09-21T06:34:44.229953+0000","last_undegraded":"2024-09-21T06:34:44.229953+0000","last_fullsized":"2024-09-21T06:34:44.229953+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:48:32.279999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.227142+0000","last_change":"2024-09-21T06:34:23.946191+0000","last_active":"2024-09-21T06:34:44.227142+0000","last_peered":"2024-09-21T06:34:44.227142+0000","last_clean":"2024-09-21T06:34:44.227142+0000","last_became_active":"2024-09-21T06:34:23.945817+0000","last_became_peered":"2024-09-21T06:34:23.945817+0000","last_unstale":"2024-09-21T06:34:44.227142+0000","last_undegraded":"2024-09-21T06:34:44.227142+0000","last_fullsized":"2024-09-21T06:34:44.227142+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:29.443444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265435+0000","last_change":"2024-09-21T06:34:23.943433+0000","last_active":"2024-09-21T06:34:44.265435+0000","last_peered":"2024-09-21T06:34:44.265435+0000","last_clean":"2024-09-21T06:34:44.265435+0000","last_became_active":"2024-09-21T06:34:23.943001+0000","last_became_peered":"2024-09-21T06:34:23.943001+0000","last_unstale":"2024-09-21T06:34:44.265435+0000","last_undegraded":"2024-09-21T06:34:44.265435+0000","last_fullsized":"2024-09-21T06:34:44.265435+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:05:10.695083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.223932+0000","last_change":"2024-09-21T06:34:23.954397+0000","last_active":"2024-09-21T06:34:44.223932+0000","last_peered":"2024-09-21T06:34:44.223932+0000","last_clean":"2024-09-21T06:34:44.223932+0000","last_became_active":"2024-09-21T06:34:23.954008+0000","last_became_peered":"2024-09-21T06:34:23.954008+0000","last_unstale":"2024-09-21T06:34:44.223932+0000","last_undegraded":"2024-09-21T06:34:44.223932+0000","last_fullsized":"2024-09-21T06:34:44.223932+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:10:03.764400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.266422+0000","last_change":"2024-09-21T06:34:23.953371+0000","last_active":"2024-09-21T06:34:44.266422+0000","last_peered":"2024-09-21T06:34:44.266422+0000","last_clean":"2024-09-21T06:34:44.266422+0000","last_became_active":"2024-09-21T06:34:23.952864+0000","last_became_peered":"2024-09-21T06:34:23.952864+0000","last_unstale":"2024-09-21T06:34:44.266422+0000","last_undegraded":"2024-09-21T06:34:44.266422+0000","last_fullsized":"2024-09-21T06:34:44.266422+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:44:23.691372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.267477+0000","last_change":"2024-09-21T06:34:44.267366+0000","last_active":"2024-09-21T06:34:44.267477+0000","last_peered":"2024-09-21T06:34:44.267477+0000","last_clean":"2024-09-21T06:34:44.267477+0000","last_became_active":"2024-09-21T06:34:44.266937+0000","last_became_peered":"2024-09-21T06:34:44.266937+0000","last_unstale":"2024-09-21T06:34:44.267477+0000","last_undegraded":"2024-09-21T06:34:44.267477+0000","last_fullsized":"2024-09-21T06:34:44.267477+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:40:00.904219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.266545+0000","last_change":"2024-09-21T06:34:23.958191+0000","last_active":"2024-09-21T06:34:44.266545+0000","last_peered":"2024-09-21T06:34:44.266545+0000","last_clean":"2024-09-21T06:34:44.266545+0000","last_became_active":"2024-09-21T06:34:23.957836+0000","last_became_peered":"2024-09-21T06:34:23.957836+0000","last_unstale":"2024-09-21T06:34:44.266545+0000","last_undegraded":"2024-09-21T06:34:44.266545+0000","last_fullsized":"2024-09-21T06:34:44.266545+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:31:10.201245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.225421+0000","last_change":"2024-09-21T06:34:23.947256+0000","last_active":"2024-09-21T06:34:44.225421+0000","last_peered":"2024-09-21T06:34:44.225421+0000","last_clean":"2024-09-21T06:34:44.225421+0000","last_became_active":"2024-09-21T06:34:23.946029+0000","last_became_peered":"2024-09-21T06:34:23.946029+0000","last_unstale":"2024-09-21T06:34:44.225421+0000","last_undegraded":"2024-09-21T06:34:44.225421+0000","last_fullsized":"2024-09-21T06:34:44.225421+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:47:19.850700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265129+0000","last_change":"2024-09-21T06:34:23.940661+0000","last_active":"2024-09-21T06:34:44.265129+0000","last_peered":"2024-09-21T06:34:44.265129+0000","last_clean":"2024-09-21T06:34:44.265129+0000","last_became_active":"2024-09-21T06:34:23.940306+0000","last_became_peered":"2024-09-21T06:34:23.940306+0000","last_unstale":"2024-09-21T06:34:44.265129+0000","last_undegraded":"2024-09-21T06:34:44.265129+0000","last_fullsized":"2024-09-21T06:34:44.265129+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:19.062435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265265+0000","last_change":"2024-09-21T06:34:23.941906+0000","last_active":"2024-09-21T06:34:44.265265+0000","last_peered":"2024-09-21T06:34:44.265265+0000","last_clean":"2024-09-21T06:34:44.265265+0000","last_became_active":"2024-09-21T06:34:23.941522+0000","last_became_peered":"2024-09-21T06:34:23.941522+0000","last_unstale":"2024-09-21T06:34:44.265265+0000","last_undegraded":"2024-09-21T06:34:44.265265+0000","last_fullsized":"2024-09-21T06:34:44.265265+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:57:12.557051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.264948+0000","last_change":"2024-09-21T06:34:23.957181+0000","last_active":"2024-09-21T06:34:44.264948+0000","last_peered":"2024-09-21T06:34:44.264948+0000","last_clean":"2024-09-21T06:34:44.264948+0000","last_became_active":"2024-09-21T06:34:23.956269+0000","last_became_peered":"2024-09-21T06:34:23.956269+0000","last_unstale":"2024-09-21T06:34:44.264948+0000","last_undegraded":"2024-09-21T06:34:44.264948+0000","last_fullsized":"2024-09-21T06:34:44.264948+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:33:24.989570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265721+0000","last_change":"2024-09-21T06:34:23.951771+0000","last_active":"2024-09-21T06:34:44.265721+0000","last_peered":"2024-09-21T06:34:44.265721+0000","last_clean":"2024-09-21T06:34:44.265721+0000","last_became_active":"2024-09-21T06:34:23.951381+0000","last_became_peered":"2024-09-21T06:34:23.951381+0000","last_unstale":"2024-09-21T06:34:44.265721+0000","last_undegraded":"2024-09-21T06:34:44.265721+0000","last_fullsized":"2024-09-21T06:34:44.265721+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:26:16.049343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.225612+0000","last_change":"2024-09-21T06:34:23.959425+0000","last_active":"2024-09-21T06:34:44.225612+0000","last_peered":"2024-09-21T06:34:44.225612+0000","last_clean":"2024-09-21T06:34:44.225612+0000","last_became_active":"2024-09-21T06:34:23.959022+0000","last_became_peered":"2024-09-21T06:34:23.959022+0000","last_unstale":"2024-09-21T06:34:44.225612+0000","last_undegraded":"2024-09-21T06:34:44.225612+0000","last_fullsized":"2024-09-21T06:34:44.225612+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:19:45.203639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.226736+0000","last_change":"2024-09-21T06:34:23.950510+0000","last_active":"2024-09-21T06:34:44.226736+0000","last_peered":"2024-09-21T06:34:44.226736+0000","last_clean":"2024-09-21T06:34:44.226736+0000","last_became_active":"2024-09-21T06:34:23.950027+0000","last_became_peered":"2024-09-21T06:34:23.950027+0000","last_unstale":"2024-09-21T06:34:44.226736+0000","last_undegraded":"2024-09-21T06:34:44.226736+0000","last_fullsized":"2024-09-21T06:34:44.226736+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:22:23.093554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265658+0000","last_change":"2024-09-21T06:34:23.948824+0000","last_active":"2024-09-21T06:34:44.265658+0000","last_peered":"2024-09-21T06:34:44.265658+0000","last_clean":"2024-09-21T06:34:44.265658+0000","last_became_active":"2024-09-21T06:34:23.948441+0000","last_became_peered":"2024-09-21T06:34:23.948441+0000","last_unstale":"2024-09-21T06:34:44.265658+0000","last_undegraded":"2024-09-21T06:34:44.265658+0000","last_fullsized":"2024-09-21T06:34:44.265658+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:28.498876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.225240+0000","last_change":"2024-09-21T06:34:23.960278+0000","last_active":"2024-09-21T06:34:44.225240+0000","last_peered":"2024-09-21T06:34:44.225240+0000","last_clean":"2024-09-21T06:34:44.225240+0000","last_became_active":"2024-09-21T06:34:23.959737+0000","last_became_peered":"2024-09-21T06:34:23.959737+0000","last_unstale":"2024-09-21T06:34:44.225240+0000","last_undegraded":"2024-09-21T06:34:44.225240+0000","last_fullsized":"2024-09-21T06:34:44.225240+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:50.097954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265247+0000","last_change":"2024-09-21T06:34:23.942797+0000","last_active":"2024-09-21T06:34:44.265247+0000","last_peered":"2024-09-21T06:34:44.265247+0000","last_clean":"2024-09-21T06:34:44.265247+0000","last_became_active":"2024-09-21T06:34:23.942441+0000","last_became_peered":"2024-09-21T06:34:23.942441+0000","last_unstale":"2024-09-21T06:34:44.265247+0000","last_undegraded":"2024-09-21T06:34:44.265247+0000","last_fullsized":"2024-09-21T06:34:44.265247+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:57:30.552583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265998+0000","last_change":"2024-09-21T06:34:23.957433+0000","last_active":"2024-09-21T06:34:44.265998+0000","last_peered":"2024-09-21T06:34:44.265998+0000","last_clean":"2024-09-21T06:34:44.265998+0000","last_became_active":"2024-09-21T06:34:23.957035+0000","last_became_peered":"2024-09-21T06:34:23.957035+0000","last_unstale":"2024-09-21T06:34:44.265998+0000","last_undegraded":"2024-09-21T06:34:44.265998+0000","last_fullsized":"2024-09-21T06:34:44.265998+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:40:18.418705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.224015+0000","last_change":"2024-09-21T06:34:23.950308+0000","last_active":"2024-09-21T06:34:44.224015+0000","last_peered":"2024-09-21T06:34:44.224015+0000","last_clean":"2024-09-21T06:34:44.224015+0000","last_became_active":"2024-09-21T06:34:23.948417+0000","last_became_peered":"2024-09-21T06:34:23.948417+0000","last_unstale":"2024-09-21T06:34:44.224015+0000","last_undegraded":"2024-09-21T06:34:44.224015+0000","last_fullsized":"2024-09-21T06:34:44.224015+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:47.233504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.226437+0000","last_change":"2024-09-21T06:34:23.949369+0000","last_active":"2024-09-21T06:34:44.226437+0000","last_peered":"2024-09-21T06:34:44.226437+0000","last_clean":"2024-09-21T06:34:44.226437+0000","last_became_active":"2024-09-21T06:34:23.948713+0000","last_became_peered":"2024-09-21T06:34:23.948713+0000","last_unstale":"2024-09-21T06:34:44.226437+0000","last_undegraded":"2024-09-21T06:34:44.226437+0000","last_fullsized":"2024-09-21T06:34:44.226437+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:57:06.915379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.224467+0000","last_change":"2024-09-21T06:34:23.959315+0000","last_active":"2024-09-21T06:34:44.224467+0000","last_peered":"2024-09-21T06:34:44.224467+0000","last_clean":"2024-09-21T06:34:44.224467+0000","last_became_active":"2024-09-21T06:34:23.958904+0000","last_became_peered":"2024-09-21T06:34:23.958904+0000","last_unstale":"2024-09-21T06:34:44.224467+0000","last_undegraded":"2024-09-21T06:34:44.224467+0000","last_fullsized":"2024-09-21T06:34:44.224467+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:31:35.486369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265718+0000","last_change":"2024-09-21T06:34:23.952074+0000","last_active":"2024-09-21T06:34:44.265718+0000","last_peered":"2024-09-21T06:34:44.265718+0000","last_clean":"2024-09-21T06:34:44.265718+0000","last_became_active":"2024-09-21T06:34:23.951692+0000","last_became_peered":"2024-09-21T06:34:23.951692+0000","last_unstale":"2024-09-21T06:34:44.265718+0000","last_undegraded":"2024-09-21T06:34:44.265718+0000","last_fullsized":"2024-09-21T06:34:44.265718+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:15:06.300781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.225420+0000","last_change":"2024-09-21T06:34:23.947296+0000","last_active":"2024-09-21T06:34:44.225420+0000","last_peered":"2024-09-21T06:34:44.225420+0000","last_clean":"2024-09-21T06:34:44.225420+0000","last_became_active":"2024-09-21T06:34:23.946392+0000","last_became_peered":"2024-09-21T06:34:23.946392+0000","last_unstale":"2024-09-21T06:34:44.225420+0000","last_undegraded":"2024-09-21T06:34:44.225420+0000","last_fullsized":"2024-09-21T06:34:44.225420+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:05:27.597890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265035+0000","last_change":"2024-09-21T06:34:23.953161+0000","last_active":"2024-09-21T06:34:44.265035+0000","last_peered":"2024-09-21T06:34:44.265035+0000","last_clean":"2024-09-21T06:34:44.265035+0000","last_became_active":"2024-09-21T06:34:23.952811+0000","last_became_peered":"2024-09-21T06:34:23.952811+0000","last_unstale":"2024-09-21T06:34:44.265035+0000","last_undegraded":"2024-09-21T06:34:44.265035+0000","last_fullsized":"2024-09-21T06:34:44.265035+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:04.431094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265586+0000","last_change":"2024-09-21T06:34:23.959880+0000","last_active":"2024-09-21T06:34:44.265586+0000","last_peered":"2024-09-21T06:34:44.265586+0000","last_clean":"2024-09-21T06:34:44.265586+0000","last_became_active":"2024-09-21T06:34:23.959573+0000","last_became_peered":"2024-09-21T06:34:23.959573+0000","last_unstale":"2024-09-21T06:34:44.265586+0000","last_undegraded":"2024-09-21T06:34:44.265586+0000","last_fullsized":"2024-09-21T06:34:44.265586+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:21.921956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265362+0000","last_change":"2024-09-21T06:34:23.947209+0000","last_active":"2024-09-21T06:34:44.265362+0000","last_peered":"2024-09-21T06:34:44.265362+0000","last_clean":"2024-09-21T06:34:44.265362+0000","last_became_active":"2024-09-21T06:34:23.946763+0000","last_became_peered":"2024-09-21T06:34:23.946763+0000","last_unstale":"2024-09-21T06:34:44.265362+0000","last_undegraded":"2024-09-21T06:34:44.265362+0000","last_fullsized":"2024-09-21T06:34:44.265362+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:04:54.050980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265396+0000","last_change":"2024-09-21T06:34:23.955064+0000","last_active":"2024-09-21T06:34:44.265396+0000","last_peered":"2024-09-21T06:34:44.265396+0000","last_clean":"2024-09-21T06:34:44.265396+0000","last_became_active":"2024-09-21T06:34:23.954622+0000","last_became_peered":"2024-09-21T06:34:23.954622+0000","last_unstale":"2024-09-21T06:34:44.265396+0000","last_undegraded":"2024-09-21T06:34:44.265396+0000","last_fullsized":"2024-09-21T06:34:44.265396+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:04:59.056398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.224979+0000","last_change":"2024-09-21T06:34:23.947015+0000","last_active":"2024-09-21T06:34:44.224979+0000","last_peered":"2024-09-21T06:34:44.224979+0000","last_clean":"2024-09-21T06:34:44.224979+0000","last_became_active":"2024-09-21T06:34:23.946569+0000","last_became_peered":"2024-09-21T06:34:23.946569+0000","last_unstale":"2024-09-21T06:34:44.224979+0000","last_undegraded":"2024-09-21T06:34:44.224979+0000","last_fullsized":"2024-09-21T06:34:44.224979+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:50:35.935533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.230155+0000","last_change":"2024-09-21T06:34:23.951126+0000","last_active":"2024-09-21T06:34:44.230155+0000","last_peered":"2024-09-21T06:34:44.230155+0000","last_clean":"2024-09-21T06:34:44.230155+0000","last_became_active":"2024-09-21T06:34:23.950739+0000","last_became_peered":"2024-09-21T06:34:23.950739+0000","last_unstale":"2024-09-21T06:34:44.230155+0000","last_undegraded":"2024-09-21T06:34:44.230155+0000","last_fullsized":"2024-09-21T06:34:44.230155+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:52:43.201135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'6","reported_seq":46,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:46.022298+0000","last_change":"2024-09-21T06:34:21.939584+0000","last_active":"2024-09-21T06:34:46.022298+0000","last_peered":"2024-09-21T06:34:46.022298+0000","last_clean":"2024-09-21T06:34:46.022298+0000","last_became_active":"2024-09-21T06:34:21.939233+0000","last_became_peered":"2024-09-21T06:34:21.939233+0000","last_unstale":"2024-09-21T06:34:46.022298+0000","last_undegraded":"2024-09-21T06:34:46.022298+0000","last_fullsized":"2024-09-21T06:34:46.022298+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:54.701803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.232102+0000","last_change":"2024-09-21T06:34:44.232010+0000","last_active":"2024-09-21T06:34:44.232102+0000","last_peered":"2024-09-21T06:34:44.232102+0000","last_clean":"2024-09-21T06:34:44.232102+0000","last_became_active":"2024-09-21T06:34:44.231590+0000","last_became_peered":"2024-09-21T06:34:44.231590+0000","last_unstale":"2024-09-21T06:34:44.232102+0000","last_undegraded":"2024-09-21T06:34:44.232102+0000","last_fullsized":"2024-09-21T06:34:44.232102+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:33:02.751794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.227410+0000","last_change":"2024-09-21T06:34:21.937418+0000","last_active":"2024-09-21T06:34:44.227410+0000","last_peered":"2024-09-21T06:34:44.227410+0000","last_clean":"2024-09-21T06:34:44.227410+0000","last_became_active":"2024-09-21T06:34:21.937048+0000","last_became_peered":"2024-09-21T06:34:21.937048+0000","last_unstale":"2024-09-21T06:34:44.227410+0000","last_undegraded":"2024-09-21T06:34:44.227410+0000","last_fullsized":"2024-09-21T06:34:44.227410+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:33:38.731444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.264973+0000","last_change":"2024-09-21T06:34:21.932970+0000","last_active":"2024-09-21T06:34:44.264973+0000","last_peered":"2024-09-21T06:34:44.264973+0000","last_clean":"2024-09-21T06:34:44.264973+0000","last_became_active":"2024-09-21T06:34:21.932616+0000","last_became_peered":"2024-09-21T06:34:21.932616+0000","last_unstale":"2024-09-21T06:34:44.264973+0000","last_undegraded":"2024-09-21T06:34:44.264973+0000","last_fullsized":"2024-09-21T06:34:44.264973+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:33:20.611023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.224042+0000","last_change":"2024-09-21T06:34:23.950798+0000","last_active":"2024-09-21T06:34:44.224042+0000","last_peered":"2024-09-21T06:34:44.224042+0000","last_clean":"2024-09-21T06:34:44.224042+0000","last_became_active":"2024-09-21T06:34:23.950475+0000","last_became_peered":"2024-09-21T06:34:23.950475+0000","last_unstale":"2024-09-21T06:34:44.224042+0000","last_undegraded":"2024-09-21T06:34:44.224042+0000","last_fullsized":"2024-09-21T06:34:44.224042+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:43:23.177775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.226659+0000","last_change":"2024-09-21T06:34:21.937860+0000","last_active":"2024-09-21T06:34:44.226659+0000","last_peered":"2024-09-21T06:34:44.226659+0000","last_clean":"2024-09-21T06:34:44.226659+0000","last_became_active":"2024-09-21T06:34:21.937476+0000","last_became_peered":"2024-09-21T06:34:21.937476+0000","last_unstale":"2024-09-21T06:34:44.226659+0000","last_undegraded":"2024-09-21T06:34:44.226659+0000","last_fullsized":"2024-09-21T06:34:44.226659+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:49:06.069197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.226096+0000","last_change":"2024-09-21T06:34:23.944559+0000","last_active":"2024-09-21T06:34:44.226096+0000","last_peered":"2024-09-21T06:34:44.226096+0000","last_clean":"2024-09-21T06:34:44.226096+0000","last_became_active":"2024-09-21T06:34:23.944166+0000","last_became_peered":"2024-09-21T06:34:23.944166+0000","last_unstale":"2024-09-21T06:34:44.226096+0000","last_undegraded":"2024-09-21T06:34:44.226096+0000","last_fullsized":"2024-09-21T06:34:44.226096+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:01:56.532854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"75'3","reported_seq":40,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:46.021415+0000","last_change":"2024-09-21T06:34:21.936531+0000","last_active":"2024-09-21T06:34:46.021415+0000","last_peered":"2024-09-21T06:34:46.021415+0000","last_clean":"2024-09-21T06:34:46.021415+0000","last_became_active":"2024-09-21T06:34:21.936087+0000","last_became_peered":"2024-09-21T06:34:21.936087+0000","last_unstale":"2024-09-21T06:34:46.021415+0000","last_undegraded":"2024-09-21T06:34:46.021415+0000","last_fullsized":"2024-09-21T06:34:46.021415+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:27:12.370722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.266303+0000","last_change":"2024-09-21T06:34:23.954894+0000","last_active":"2024-09-21T06:34:44.266303+0000","last_peered":"2024-09-21T06:34:44.266303+0000","last_clean":"2024-09-21T06:34:44.266303+0000","last_became_active":"2024-09-21T06:34:23.954186+0000","last_became_peered":"2024-09-21T06:34:23.954186+0000","last_unstale":"2024-09-21T06:34:44.266303+0000","last_undegraded":"2024-09-21T06:34:44.266303+0000","last_fullsized":"2024-09-21T06:34:44.266303+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:18:49.623338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265585+0000","last_change":"2024-09-21T06:34:21.934989+0000","last_active":"2024-09-21T06:34:44.265585+0000","last_peered":"2024-09-21T06:34:44.265585+0000","last_clean":"2024-09-21T06:34:44.265585+0000","last_became_active":"2024-09-21T06:34:21.934550+0000","last_became_peered":"2024-09-21T06:34:21.934550+0000","last_unstale":"2024-09-21T06:34:44.265585+0000","last_undegraded":"2024-09-21T06:34:44.265585+0000","last_fullsized":"2024-09-21T06:34:44.265585+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:59:17.849338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265984+0000","last_change":"2024-09-21T06:34:23.956190+0000","last_active":"2024-09-21T06:34:44.265984+0000","last_peered":"2024-09-21T06:34:44.265984+0000","last_clean":"2024-09-21T06:34:44.265984+0000","last_became_active":"2024-09-21T06:34:23.955815+0000","last_became_peered":"2024-09-21T06:34:23.955815+0000","last_unstale":"2024-09-21T06:34:44.265984+0000","last_undegraded":"2024-09-21T06:34:44.265984+0000","last_fullsized":"2024-09-21T06:34:44.265984+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:14:56.165350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'4","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.227080+0000","last_change":"2024-09-21T06:34:22.096480+0000","last_active":"2024-09-21T06:34:44.227080+0000","last_peered":"2024-09-21T06:34:44.227080+0000","last_clean":"2024-09-21T06:34:44.227080+0000","last_became_active":"2024-09-21T06:34:22.095921+0000","last_became_peered":"2024-09-21T06:34:22.095921+0000","last_unstale":"2024-09-21T06:34:44.227080+0000","last_undegraded":"2024-09-21T06:34:44.227080+0000","last_fullsized":"2024-09-21T06:34:44.227080+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:19:30.006811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265960+0000","last_change":"2024-09-21T06:34:23.961840+0000","last_active":"2024-09-21T06:34:44.265960+0000","last_peered":"2024-09-21T06:34:44.265960+0000","last_clean":"2024-09-21T06:34:44.265960+0000","last_became_active":"2024-09-21T06:34:23.961313+0000","last_became_peered":"2024-09-21T06:34:23.961313+0000","last_unstale":"2024-09-21T06:34:44.265960+0000","last_undegraded":"2024-09-21T06:34:44.265960+0000","last_fullsized":"2024-09-21T06:34:44.265960+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:29:04.308598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"77'25","reported_seq":82,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:47.025110+0000","last_change":"2024-09-21T06:34:21.937326+0000","last_active":"2024-09-21T06:34:47.025110+0000","last_peered":"2024-09-21T06:34:47.025110+0000","last_clean":"2024-09-21T06:34:47.025110+0000","last_became_active":"2024-09-21T06:34:21.936940+0000","last_became_peered":"2024-09-21T06:34:21.936940+0000","last_unstale":"2024-09-21T06:34:47.025110+0000","last_undegraded":"2024-09-21T06:34:47.025110+0000","last_fullsized":"2024-09-21T06:34:47.025110+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:47:12.988306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54250,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":69,"num_write":26,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.230328+0000","last_change":"2024-09-21T06:34:23.950167+0000","last_active":"2024-09-21T06:34:44.230328+0000","last_peered":"2024-09-21T06:34:44.230328+0000","last_clean":"2024-09-21T06:34:44.230328+0000","last_became_active":"2024-09-21T06:34:23.949697+0000","last_became_peered":"2024-09-21T06:34:23.949697+0000","last_unstale":"2024-09-21T06:34:44.230328+0000","last_undegraded":"2024-09-21T06:34:44.230328+0000","last_fullsized":"2024-09-21T06:34:44.230328+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:37:48.882644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'6","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265516+0000","last_change":"2024-09-21T06:34:21.937366+0000","last_active":"2024-09-21T06:34:44.265516+0000","last_peered":"2024-09-21T06:34:44.265516+0000","last_clean":"2024-09-21T06:34:44.265516+0000","last_became_active":"2024-09-21T06:34:21.936988+0000","last_became_peered":"2024-09-21T06:34:21.936988+0000","last_unstale":"2024-09-21T06:34:44.265516+0000","last_undegraded":"2024-09-21T06:34:44.265516+0000","last_fullsized":"2024-09-21T06:34:44.265516+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:48:06.318645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265352+0000","last_change":"2024-09-21T06:34:23.947523+0000","last_active":"2024-09-21T06:34:44.265352+0000","last_peered":"2024-09-21T06:34:44.265352+0000","last_clean":"2024-09-21T06:34:44.265352+0000","last_became_active":"2024-09-21T06:34:23.947150+0000","last_became_peered":"2024-09-21T06:34:23.947150+0000","last_unstale":"2024-09-21T06:34:44.265352+0000","last_undegraded":"2024-09-21T06:34:44.265352+0000","last_fullsized":"2024-09-21T06:34:44.265352+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:18:50.417153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.226854+0000","last_change":"2024-09-21T06:34:21.938631+0000","last_active":"2024-09-21T06:34:44.226854+0000","last_peered":"2024-09-21T06:34:44.226854+0000","last_clean":"2024-09-21T06:34:44.226854+0000","last_became_active":"2024-09-21T06:34:21.938242+0000","last_became_peered":"2024-09-21T06:34:21.938242+0000","last_unstale":"2024-09-21T06:34:44.226854+0000","last_undegraded":"2024-09-21T06:34:44.226854+0000","last_fullsized":"2024-09-21T06:34:44.226854+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:40:02.056812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265725+0000","last_change":"2024-09-21T06:34:23.945276+0000","last_active":"2024-09-21T06:34:44.265725+0000","last_peered":"2024-09-21T06:34:44.265725+0000","last_clean":"2024-09-21T06:34:44.265725+0000","last_became_active":"2024-09-21T06:34:23.944914+0000","last_became_peered":"2024-09-21T06:34:23.944914+0000","last_unstale":"2024-09-21T06:34:44.265725+0000","last_undegraded":"2024-09-21T06:34:44.265725+0000","last_fullsized":"2024-09-21T06:34:44.265725+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:15:23.650908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"75'4","reported_seq":44,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:46.023676+0000","last_change":"2024-09-21T06:34:21.937593+0000","last_active":"2024-09-21T06:34:46.023676+0000","last_peered":"2024-09-21T06:34:46.023676+0000","last_clean":"2024-09-21T06:34:46.023676+0000","last_became_active":"2024-09-21T06:34:21.936851+0000","last_became_peered":"2024-09-21T06:34:21.936851+0000","last_unstale":"2024-09-21T06:34:46.023676+0000","last_undegraded":"2024-09-21T06:34:46.023676+0000","last_fullsized":"2024-09-21T06:34:46.023676+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:25:36.161431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265345+0000","last_change":"2024-09-21T06:34:23.945573+0000","last_active":"2024-09-21T06:34:44.265345+0000","last_peered":"2024-09-21T06:34:44.265345+0000","last_clean":"2024-09-21T06:34:44.265345+0000","last_became_active":"2024-09-21T06:34:23.944410+0000","last_became_peered":"2024-09-21T06:34:23.944410+0000","last_unstale":"2024-09-21T06:34:44.265345+0000","last_undegraded":"2024-09-21T06:34:44.265345+0000","last_fullsized":"2024-09-21T06:34:44.265345+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:33:54.613524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'15","reported_seq":39,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.229900+0000","last_change":"2024-09-21T06:34:22.096539+0000","last_active":"2024-09-21T06:34:44.229900+0000","last_peered":"2024-09-21T06:34:44.229900+0000","last_clean":"2024-09-21T06:34:44.229900+0000","last_became_active":"2024-09-21T06:34:22.096013+0000","last_became_peered":"2024-09-21T06:34:22.096013+0000","last_unstale":"2024-09-21T06:34:44.229900+0000","last_undegraded":"2024-09-21T06:34:44.229900+0000","last_fullsized":"2024-09-21T06:34:44.229900+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:30:59.414325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.226688+0000","last_change":"2024-09-21T06:34:23.958381+0000","last_active":"2024-09-21T06:34:44.226688+0000","last_peered":"2024-09-21T06:34:44.226688+0000","last_clean":"2024-09-21T06:34:44.226688+0000","last_became_active":"2024-09-21T06:34:23.957965+0000","last_became_peered":"2024-09-21T06:34:23.957965+0000","last_unstale":"2024-09-21T06:34:44.226688+0000","last_undegraded":"2024-09-21T06:34:44.226688+0000","last_fullsized":"2024-09-21T06:34:44.226688+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:37:43.474777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'2","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.230733+0000","last_change":"2024-09-21T06:34:21.937612+0000","last_active":"2024-09-21T06:34:44.230733+0000","last_peered":"2024-09-21T06:34:44.230733+0000","last_clean":"2024-09-21T06:34:44.230733+0000","last_became_active":"2024-09-21T06:34:21.936859+0000","last_became_peered":"2024-09-21T06:34:21.936859+0000","last_unstale":"2024-09-21T06:34:44.230733+0000","last_undegraded":"2024-09-21T06:34:44.230733+0000","last_fullsized":"2024-09-21T06:34:44.230733+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:40.957217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.229139+0000","last_change":"2024-09-21T06:34:44.228991+0000","last_active":"2024-09-21T06:34:44.229139+0000","last_peered":"2024-09-21T06:34:44.229139+0000","last_clean":"2024-09-21T06:34:44.229139+0000","last_became_active":"2024-09-21T06:34:44.228428+0000","last_became_peered":"2024-09-21T06:34:44.228428+0000","last_unstale":"2024-09-21T06:34:44.229139+0000","last_undegraded":"2024-09-21T06:34:44.229139+0000","last_fullsized":"2024-09-21T06:34:44.229139+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:21.719532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265523+0000","last_change":"2024-09-21T06:34:21.933392+0000","last_active":"2024-09-21T06:34:44.265523+0000","last_peered":"2024-09-21T06:34:44.265523+0000","last_clean":"2024-09-21T06:34:44.265523+0000","last_became_active":"2024-09-21T06:34:21.932999+0000","last_became_peered":"2024-09-21T06:34:21.932999+0000","last_unstale":"2024-09-21T06:34:44.265523+0000","last_undegraded":"2024-09-21T06:34:44.265523+0000","last_fullsized":"2024-09-21T06:34:44.265523+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:05:20.631755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.266194+0000","last_change":"2024-09-21T06:34:23.944675+0000","last_active":"2024-09-21T06:34:44.266194+0000","last_peered":"2024-09-21T06:34:44.266194+0000","last_clean":"2024-09-21T06:34:44.266194+0000","last_became_active":"2024-09-21T06:34:23.944258+0000","last_became_peered":"2024-09-21T06:34:23.944258+0000","last_unstale":"2024-09-21T06:34:44.266194+0000","last_undegraded":"2024-09-21T06:34:44.266194+0000","last_fullsized":"2024-09-21T06:34:44.266194+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:26:40.661840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'1","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.227259+0000","last_change":"2024-09-21T06:34:21.941064+0000","last_active":"2024-09-21T06:34:44.227259+0000","last_peered":"2024-09-21T06:34:44.227259+0000","last_clean":"2024-09-21T06:34:44.227259+0000","last_became_active":"2024-09-21T06:34:21.940667+0000","last_became_peered":"2024-09-21T06:34:21.940667+0000","last_unstale":"2024-09-21T06:34:44.227259+0000","last_undegraded":"2024-09-21T06:34:44.227259+0000","last_fullsized":"2024-09-21T06:34:44.227259+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:20:14.721719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'1","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.266571+0000","last_change":"2024-09-21T06:34:23.943503+0000","last_active":"2024-09-21T06:34:44.266571+0000","last_peered":"2024-09-21T06:34:44.266571+0000","last_clean":"2024-09-21T06:34:44.266571+0000","last_became_active":"2024-09-21T06:34:23.943097+0000","last_became_peered":"2024-09-21T06:34:23.943097+0000","last_unstale":"2024-09-21T06:34:44.266571+0000","last_undegraded":"2024-09-21T06:34:44.266571+0000","last_fullsized":"2024-09-21T06:34:44.266571+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:08:04.641273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"75'3","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265879+0000","last_change":"2024-09-21T06:34:22.096274+0000","last_active":"2024-09-21T06:34:44.265879+0000","last_peered":"2024-09-21T06:34:44.265879+0000","last_clean":"2024-09-21T06:34:44.265879+0000","last_became_active":"2024-09-21T06:34:22.095861+0000","last_became_peered":"2024-09-21T06:34:22.095861+0000","last_unstale":"2024-09-21T06:34:44.265879+0000","last_undegraded":"2024-09-21T06:34:44.265879+0000","last_fullsized":"2024-09-21T06:34:44.265879+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:22:47.807488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.266601+0000","last_change":"2024-09-21T06:34:23.953503+0000","last_active":"2024-09-21T06:34:44.266601+0000","last_peered":"2024-09-21T06:34:44.266601+0000","last_clean":"2024-09-21T06:34:44.266601+0000","last_became_active":"2024-09-21T06:34:23.952880+0000","last_became_peered":"2024-09-21T06:34:23.952880+0000","last_unstale":"2024-09-21T06:34:44.266601+0000","last_undegraded":"2024-09-21T06:34:44.266601+0000","last_fullsized":"2024-09-21T06:34:44.266601+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:29:47.746678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":97,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265543+0000","last_change":"2024-09-21T06:33:09.908154+0000","last_active":"2024-09-21T06:34:44.265543+0000","last_peered":"2024-09-21T06:34:44.265543+0000","last_clean":"2024-09-21T06:34:44.265543+0000","last_became_active":"2024-09-21T06:33:09.902397+0000","last_became_peered":"2024-09-21T06:33:09.902397+0000","last_unstale":"2024-09-21T06:34:44.265543+0000","last_undegraded":"2024-09-21T06:34:44.265543+0000","last_fullsized":"2024-09-21T06:34:44.265543+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:29:42.295555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:29:42.295555+0000","last_clean_scrub_stamp":"2024-09-21T06:29:42.295555+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:15:17.111178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"75'3","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.225389+0000","last_change":"2024-09-21T06:34:21.932618+0000","last_active":"2024-09-21T06:34:44.225389+0000","last_peered":"2024-09-21T06:34:44.225389+0000","last_clean":"2024-09-21T06:34:44.225389+0000","last_became_active":"2024-09-21T06:34:21.932187+0000","last_became_peered":"2024-09-21T06:34:21.932187+0000","last_unstale":"2024-09-21T06:34:44.225389+0000","last_undegraded":"2024-09-21T06:34:44.225389+0000","last_fullsized":"2024-09-21T06:34:44.225389+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:19:06.780448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.224167+0000","last_change":"2024-09-21T06:34:23.953580+0000","last_active":"2024-09-21T06:34:44.224167+0000","last_peered":"2024-09-21T06:34:44.224167+0000","last_clean":"2024-09-21T06:34:44.224167+0000","last_became_active":"2024-09-21T06:34:23.952222+0000","last_became_peered":"2024-09-21T06:34:23.952222+0000","last_unstale":"2024-09-21T06:34:44.224167+0000","last_undegraded":"2024-09-21T06:34:44.224167+0000","last_fullsized":"2024-09-21T06:34:44.224167+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:19.759042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265531+0000","last_change":"2024-09-21T06:34:21.939178+0000","last_active":"2024-09-21T06:34:44.265531+0000","last_peered":"2024-09-21T06:34:44.265531+0000","last_clean":"2024-09-21T06:34:44.265531+0000","last_became_active":"2024-09-21T06:34:21.938755+0000","last_became_peered":"2024-09-21T06:34:21.938755+0000","last_unstale":"2024-09-21T06:34:44.265531+0000","last_undegraded":"2024-09-21T06:34:44.265531+0000","last_fullsized":"2024-09-21T06:34:44.265531+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:10.474432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.264822+0000","last_change":"2024-09-21T06:34:23.954196+0000","last_active":"2024-09-21T06:34:44.264822+0000","last_peered":"2024-09-21T06:34:44.264822+0000","last_clean":"2024-09-21T06:34:44.264822+0000","last_became_active":"2024-09-21T06:34:23.953843+0000","last_became_peered":"2024-09-21T06:34:23.953843+0000","last_unstale":"2024-09-21T06:34:44.264822+0000","last_undegraded":"2024-09-21T06:34:44.264822+0000","last_fullsized":"2024-09-21T06:34:44.264822+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:41:02.896704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"75'4","reported_seq":38,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265105+0000","last_change":"2024-09-21T06:34:22.095920+0000","last_active":"2024-09-21T06:34:44.265105+0000","last_peered":"2024-09-21T06:34:44.265105+0000","last_clean":"2024-09-21T06:34:44.265105+0000","last_became_active":"2024-09-21T06:34:22.095376+0000","last_became_peered":"2024-09-21T06:34:22.095376+0000","last_unstale":"2024-09-21T06:34:44.265105+0000","last_undegraded":"2024-09-21T06:34:44.265105+0000","last_fullsized":"2024-09-21T06:34:44.265105+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:40:44.400566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.226479+0000","last_change":"2024-09-21T06:34:23.956541+0000","last_active":"2024-09-21T06:34:44.226479+0000","last_peered":"2024-09-21T06:34:44.226479+0000","last_clean":"2024-09-21T06:34:44.226479+0000","last_became_active":"2024-09-21T06:34:23.956150+0000","last_became_peered":"2024-09-21T06:34:23.956150+0000","last_unstale":"2024-09-21T06:34:44.226479+0000","last_undegraded":"2024-09-21T06:34:44.226479+0000","last_fullsized":"2024-09-21T06:34:44.226479+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:09:32.432391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.266674+0000","last_change":"2024-09-21T06:34:21.942244+0000","last_active":"2024-09-21T06:34:44.266674+0000","last_peered":"2024-09-21T06:34:44.266674+0000","last_clean":"2024-09-21T06:34:44.266674+0000","last_became_active":"2024-09-21T06:34:21.941761+0000","last_became_peered":"2024-09-21T06:34:21.941761+0000","last_unstale":"2024-09-21T06:34:44.266674+0000","last_undegraded":"2024-09-21T06:34:44.266674+0000","last_fullsized":"2024-09-21T06:34:44.266674+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:10.507103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.227647+0000","last_change":"2024-09-21T06:34:23.951250+0000","last_active":"2024-09-21T06:34:44.227647+0000","last_peered":"2024-09-21T06:34:44.227647+0000","last_clean":"2024-09-21T06:34:44.227647+0000","last_became_active":"2024-09-21T06:34:23.950015+0000","last_became_peered":"2024-09-21T06:34:23.950015+0000","last_unstale":"2024-09-21T06:34:44.227647+0000","last_undegraded":"2024-09-21T06:34:44.227647+0000","last_fullsized":"2024-09-21T06:34:44.227647+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:53:22.884049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.266799+0000","last_change":"2024-09-21T06:34:44.266717+0000","last_active":"2024-09-21T06:34:44.266799+0000","last_peered":"2024-09-21T06:34:44.266799+0000","last_clean":"2024-09-21T06:34:44.266799+0000","last_became_active":"2024-09-21T06:34:44.266256+0000","last_became_peered":"2024-09-21T06:34:44.266256+0000","last_unstale":"2024-09-21T06:34:44.266799+0000","last_undegraded":"2024-09-21T06:34:44.266799+0000","last_fullsized":"2024-09-21T06:34:44.266799+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:38:04.674592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'1","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.227589+0000","last_change":"2024-09-21T06:34:23.947823+0000","last_active":"2024-09-21T06:34:44.227589+0000","last_peered":"2024-09-21T06:34:44.227589+0000","last_clean":"2024-09-21T06:34:44.227589+0000","last_became_active":"2024-09-21T06:34:23.947362+0000","last_became_peered":"2024-09-21T06:34:23.947362+0000","last_unstale":"2024-09-21T06:34:44.227589+0000","last_undegraded":"2024-09-21T06:34:44.227589+0000","last_fullsized":"2024-09-21T06:34:44.227589+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:32:22.401819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"75'1","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.230506+0000","last_change":"2024-09-21T06:34:22.096537+0000","last_active":"2024-09-21T06:34:44.230506+0000","last_peered":"2024-09-21T06:34:44.230506+0000","last_clean":"2024-09-21T06:34:44.230506+0000","last_became_active":"2024-09-21T06:34:22.095875+0000","last_became_peered":"2024-09-21T06:34:22.095875+0000","last_unstale":"2024-09-21T06:34:44.230506+0000","last_undegraded":"2024-09-21T06:34:44.230506+0000","last_fullsized":"2024-09-21T06:34:44.230506+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:11:44.955531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265151+0000","last_change":"2024-09-21T06:34:23.938784+0000","last_active":"2024-09-21T06:34:44.265151+0000","last_peered":"2024-09-21T06:34:44.265151+0000","last_clean":"2024-09-21T06:34:44.265151+0000","last_became_active":"2024-09-21T06:34:23.938400+0000","last_became_peered":"2024-09-21T06:34:23.938400+0000","last_unstale":"2024-09-21T06:34:44.265151+0000","last_undegraded":"2024-09-21T06:34:44.265151+0000","last_fullsized":"2024-09-21T06:34:44.265151+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:00:13.210874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"77'8","reported_seq":44,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.957580+0000","last_change":"2024-09-21T06:34:44.235532+0000","last_active":"2024-09-21T06:34:44.957580+0000","last_peered":"2024-09-21T06:34:44.957580+0000","last_clean":"2024-09-21T06:34:44.957580+0000","last_became_active":"2024-09-21T06:34:44.230220+0000","last_became_peered":"2024-09-21T06:34:44.230220+0000","last_unstale":"2024-09-21T06:34:44.957580+0000","last_undegraded":"2024-09-21T06:34:44.957580+0000","last_fullsized":"2024-09-21T06:34:44.957580+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:07:23.398177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":11,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.224475+0000","last_change":"2024-09-21T06:34:23.953477+0000","last_active":"2024-09-21T06:34:44.224475+0000","last_peered":"2024-09-21T06:34:44.224475+0000","last_clean":"2024-09-21T06:34:44.224475+0000","last_became_active":"2024-09-21T06:34:23.951404+0000","last_became_peered":"2024-09-21T06:34:23.951404+0000","last_unstale":"2024-09-21T06:34:44.224475+0000","last_undegraded":"2024-09-21T06:34:44.224475+0000","last_fullsized":"2024-09-21T06:34:44.224475+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:13:17.126680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'4","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.225262+0000","last_change":"2024-09-21T06:34:22.031837+0000","last_active":"2024-09-21T06:34:44.225262+0000","last_peered":"2024-09-21T06:34:44.225262+0000","last_clean":"2024-09-21T06:34:44.225262+0000","last_became_active":"2024-09-21T06:34:22.031377+0000","last_became_peered":"2024-09-21T06:34:22.031377+0000","last_unstale":"2024-09-21T06:34:44.225262+0000","last_undegraded":"2024-09-21T06:34:44.225262+0000","last_fullsized":"2024-09-21T06:34:44.225262+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:14:32.536634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265835+0000","last_change":"2024-09-21T06:34:23.955321+0000","last_active":"2024-09-21T06:34:44.265835+0000","last_peered":"2024-09-21T06:34:44.265835+0000","last_clean":"2024-09-21T06:34:44.265835+0000","last_became_active":"2024-09-21T06:34:23.954906+0000","last_became_peered":"2024-09-21T06:34:23.954906+0000","last_unstale":"2024-09-21T06:34:44.265835+0000","last_undegraded":"2024-09-21T06:34:44.265835+0000","last_fullsized":"2024-09-21T06:34:44.265835+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:59:07.771268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265823+0000","last_change":"2024-09-21T06:34:22.096135+0000","last_active":"2024-09-21T06:34:44.265823+0000","last_peered":"2024-09-21T06:34:44.265823+0000","last_clean":"2024-09-21T06:34:44.265823+0000","last_became_active":"2024-09-21T06:34:22.095721+0000","last_became_peered":"2024-09-21T06:34:22.095721+0000","last_unstale":"2024-09-21T06:34:44.265823+0000","last_undegraded":"2024-09-21T06:34:44.265823+0000","last_fullsized":"2024-09-21T06:34:44.265823+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:28.994324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.229717+0000","last_change":"2024-09-21T06:34:23.951769+0000","last_active":"2024-09-21T06:34:44.229717+0000","last_peered":"2024-09-21T06:34:44.229717+0000","last_clean":"2024-09-21T06:34:44.229717+0000","last_became_active":"2024-09-21T06:34:23.951377+0000","last_became_peered":"2024-09-21T06:34:23.951377+0000","last_unstale":"2024-09-21T06:34:44.229717+0000","last_undegraded":"2024-09-21T06:34:44.229717+0000","last_fullsized":"2024-09-21T06:34:44.229717+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:49:44.291714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.224147+0000","last_change":"2024-09-21T06:34:21.933909+0000","last_active":"2024-09-21T06:34:44.224147+0000","last_peered":"2024-09-21T06:34:44.224147+0000","last_clean":"2024-09-21T06:34:44.224147+0000","last_became_active":"2024-09-21T06:34:21.933524+0000","last_became_peered":"2024-09-21T06:34:21.933524+0000","last_unstale":"2024-09-21T06:34:44.224147+0000","last_undegraded":"2024-09-21T06:34:44.224147+0000","last_fullsized":"2024-09-21T06:34:44.224147+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:58.110444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.225073+0000","last_change":"2024-09-21T06:34:23.948586+0000","last_active":"2024-09-21T06:34:44.225073+0000","last_peered":"2024-09-21T06:34:44.225073+0000","last_clean":"2024-09-21T06:34:44.225073+0000","last_became_active":"2024-09-21T06:34:23.948225+0000","last_became_peered":"2024-09-21T06:34:23.948225+0000","last_unstale":"2024-09-21T06:34:44.225073+0000","last_undegraded":"2024-09-21T06:34:44.225073+0000","last_fullsized":"2024-09-21T06:34:44.225073+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:28:24.272712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265358+0000","last_change":"2024-09-21T06:34:21.935617+0000","last_active":"2024-09-21T06:34:44.265358+0000","last_peered":"2024-09-21T06:34:44.265358+0000","last_clean":"2024-09-21T06:34:44.265358+0000","last_became_active":"2024-09-21T06:34:21.934601+0000","last_became_peered":"2024-09-21T06:34:21.934601+0000","last_unstale":"2024-09-21T06:34:44.265358+0000","last_undegraded":"2024-09-21T06:34:44.265358+0000","last_fullsized":"2024-09-21T06:34:44.265358+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:30.836070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.224206+0000","last_change":"2024-09-21T06:34:23.947661+0000","last_active":"2024-09-21T06:34:44.224206+0000","last_peered":"2024-09-21T06:34:44.224206+0000","last_clean":"2024-09-21T06:34:44.224206+0000","last_became_active":"2024-09-21T06:34:23.947307+0000","last_became_peered":"2024-09-21T06:34:23.947307+0000","last_unstale":"2024-09-21T06:34:44.224206+0000","last_undegraded":"2024-09-21T06:34:44.224206+0000","last_fullsized":"2024-09-21T06:34:44.224206+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:08.045291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'4","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.230116+0000","last_change":"2024-09-21T06:34:21.942749+0000","last_active":"2024-09-21T06:34:44.230116+0000","last_peered":"2024-09-21T06:34:44.230116+0000","last_clean":"2024-09-21T06:34:44.230116+0000","last_became_active":"2024-09-21T06:34:21.942283+0000","last_became_peered":"2024-09-21T06:34:21.942283+0000","last_unstale":"2024-09-21T06:34:44.230116+0000","last_undegraded":"2024-09-21T06:34:44.230116+0000","last_fullsized":"2024-09-21T06:34:44.230116+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:47.477956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.266544+0000","last_change":"2024-09-21T06:34:23.957389+0000","last_active":"2024-09-21T06:34:44.266544+0000","last_peered":"2024-09-21T06:34:44.266544+0000","last_clean":"2024-09-21T06:34:44.266544+0000","last_became_active":"2024-09-21T06:34:23.957032+0000","last_became_peered":"2024-09-21T06:34:23.957032+0000","last_unstale":"2024-09-21T06:34:44.266544+0000","last_undegraded":"2024-09-21T06:34:44.266544+0000","last_fullsized":"2024-09-21T06:34:44.266544+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:00:53.932062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.227302+0000","last_change":"2024-09-21T06:34:23.957304+0000","last_active":"2024-09-21T06:34:44.227302+0000","last_peered":"2024-09-21T06:34:44.227302+0000","last_clean":"2024-09-21T06:34:44.227302+0000","last_became_active":"2024-09-21T06:34:23.956931+0000","last_became_peered":"2024-09-21T06:34:23.956931+0000","last_unstale":"2024-09-21T06:34:44.227302+0000","last_undegraded":"2024-09-21T06:34:44.227302+0000","last_fullsized":"2024-09-21T06:34:44.227302+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:14:12.240686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.230138+0000","last_change":"2024-09-21T06:34:21.937150+0000","last_active":"2024-09-21T06:34:44.230138+0000","last_peered":"2024-09-21T06:34:44.230138+0000","last_clean":"2024-09-21T06:34:44.230138+0000","last_became_active":"2024-09-21T06:34:21.936037+0000","last_became_peered":"2024-09-21T06:34:21.936037+0000","last_unstale":"2024-09-21T06:34:44.230138+0000","last_undegraded":"2024-09-21T06:34:44.230138+0000","last_fullsized":"2024-09-21T06:34:44.230138+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:24:44.821346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265815+0000","last_change":"2024-09-21T06:34:23.955585+0000","last_active":"2024-09-21T06:34:44.265815+0000","last_peered":"2024-09-21T06:34:44.265815+0000","last_clean":"2024-09-21T06:34:44.265815+0000","last_became_active":"2024-09-21T06:34:23.955225+0000","last_became_peered":"2024-09-21T06:34:23.955225+0000","last_unstale":"2024-09-21T06:34:44.265815+0000","last_undegraded":"2024-09-21T06:34:44.265815+0000","last_fullsized":"2024-09-21T06:34:44.265815+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:07:56.735854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'4","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.230684+0000","last_change":"2024-09-21T06:34:21.941804+0000","last_active":"2024-09-21T06:34:44.230684+0000","last_peered":"2024-09-21T06:34:44.230684+0000","last_clean":"2024-09-21T06:34:44.230684+0000","last_became_active":"2024-09-21T06:34:21.941387+0000","last_became_peered":"2024-09-21T06:34:21.941387+0000","last_unstale":"2024-09-21T06:34:44.230684+0000","last_undegraded":"2024-09-21T06:34:44.230684+0000","last_fullsized":"2024-09-21T06:34:44.230684+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:34:51.217549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265988+0000","last_change":"2024-09-21T06:34:23.957429+0000","last_active":"2024-09-21T06:34:44.265988+0000","last_peered":"2024-09-21T06:34:44.265988+0000","last_clean":"2024-09-21T06:34:44.265988+0000","last_became_active":"2024-09-21T06:34:23.956471+0000","last_became_peered":"2024-09-21T06:34:23.956471+0000","last_unstale":"2024-09-21T06:34:44.265988+0000","last_undegraded":"2024-09-21T06:34:44.265988+0000","last_fullsized":"2024-09-21T06:34:44.265988+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:46:26.770549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.224539+0000","last_change":"2024-09-21T06:34:22.096267+0000","last_active":"2024-09-21T06:34:44.224539+0000","last_peered":"2024-09-21T06:34:44.224539+0000","last_clean":"2024-09-21T06:34:44.224539+0000","last_became_active":"2024-09-21T06:34:22.095799+0000","last_became_peered":"2024-09-21T06:34:22.095799+0000","last_unstale":"2024-09-21T06:34:44.224539+0000","last_undegraded":"2024-09-21T06:34:44.224539+0000","last_fullsized":"2024-09-21T06:34:44.224539+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:29:00.075016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.224392+0000","last_change":"2024-09-21T06:34:23.952294+0000","last_active":"2024-09-21T06:34:44.224392+0000","last_peered":"2024-09-21T06:34:44.224392+0000","last_clean":"2024-09-21T06:34:44.224392+0000","last_became_active":"2024-09-21T06:34:23.951919+0000","last_became_peered":"2024-09-21T06:34:23.951919+0000","last_unstale":"2024-09-21T06:34:44.224392+0000","last_undegraded":"2024-09-21T06:34:44.224392+0000","last_fullsized":"2024-09-21T06:34:44.224392+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:30:28.039754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'9","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.226566+0000","last_change":"2024-09-21T06:34:21.934818+0000","last_active":"2024-09-21T06:34:44.226566+0000","last_peered":"2024-09-21T06:34:44.226566+0000","last_clean":"2024-09-21T06:34:44.226566+0000","last_became_active":"2024-09-21T06:34:21.934415+0000","last_became_peered":"2024-09-21T06:34:21.934415+0000","last_unstale":"2024-09-21T06:34:44.226566+0000","last_undegraded":"2024-09-21T06:34:44.226566+0000","last_fullsized":"2024-09-21T06:34:44.226566+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:25:48.460699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":58642,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":107,"num_read_kb":114,"num_write":155,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":11,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":175926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":133,"ondisk_log_size":133,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282715,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743442,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27848,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717304,"statfs":{"total":95995035648,"available":95966519296,"internally_reserved":0,"allocated":835584,"data_stored":417151,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939669,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":983040,"data_stored":1063273,"data_compressed":41743,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103195,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27864,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717288,"statfs":{"total":95995035648,"available":95966502912,"internally_reserved":0,"allocated":851968,"data_stored":417387,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299424,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32024,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713128,"statfs":{"total":95995035648,"available":95962243072,"internally_reserved":0,"allocated":851968,"data_stored":417307,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462949,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":901120,"data_stored":1009628,"data_compressed":41743,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626474,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36140,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93709012,"statfs":{"total":95995035648,"available":95958028288,"internally_reserved":0,"allocated":815104,"data_stored":399434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822704,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":913408,"data_stored":1008921,"data_compressed":41743,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986230,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36168,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708984,"statfs":{"total":95995035648,"available":95957999616,"internally_reserved":0,"allocated":843776,"data_stored":417604,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182458,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36188,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708964,"statfs":{"total":95995035648,"available":95957979136,"internally_reserved":0,"allocated":856064,"data_stored":417087,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378688,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32092,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713060,"statfs":{"total":95995035648,"available":95962173440,"internally_reserved":0,"allocated":921600,"data_stored":472560,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542213,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":897024,"data_stored":470819,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705737,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27872,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717280,"statfs":{"total":95995035648,"available":95966494720,"internally_reserved":0,"allocated":860160,"data_stored":418047,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34325,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34325,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34325,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":54250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":55991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":56219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T06:34:50.411 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T06:34:50.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:50 smithi144 ceph-mon[34653]: pgmap v278: 97 pgs: 97 active+clean; 634 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.1 KiB/s wr, 10 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-09-21T06:34:50.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:50 smithi144 ceph-mon[34653]: from='client.14964 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:34:50.589 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:50 smithi007 ceph-mon[30983]: pgmap v278: 97 pgs: 97 active+clean; 634 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.1 KiB/s wr, 10 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-09-21T06:34:50.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:50 smithi007 ceph-mon[30983]: from='client.14964 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:34:50.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:50 smithi018 ceph-mon[34477]: pgmap v278: 97 pgs: 97 active+clean; 634 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.1 KiB/s wr, 10 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-09-21T06:34:50.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:50 smithi018 ceph-mon[34477]: from='client.14964 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:34:50.674 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:34:51.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:51.179+0000 7f71b46cd640 1 -- 172.21.15.7:0/926977940 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71ac102a80 msgr2=0x7f71ac102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:51.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:51.179+0000 7f71b46cd640 1 --2- 172.21.15.7:0/926977940 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71ac102a80 0x7f71ac102e90 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f71a8009ca0 tx=0x7f71a802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:34:51.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:51.179+0000 7f71b46cd640 1 -- 172.21.15.7:0/926977940 shutdown_connections 2024-09-21T06:34:51.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:51.179+0000 7f71b46cd640 1 --2- 172.21.15.7:0/926977940 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f71ac108d10 0x7f71ac10f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:51.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:51.179+0000 7f71b46cd640 1 --2- 172.21.15.7:0/926977940 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71ac1083c0 0x7f71ac1087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:51.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:51.179+0000 7f71b46cd640 1 --2- 172.21.15.7:0/926977940 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71ac102a80 0x7f71ac102e90 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:51.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:51.179+0000 7f71b46cd640 1 -- 172.21.15.7:0/926977940 >> 172.21.15.7:0/926977940 conn(0x7f71ac079740 msgr2=0x7f71ac079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:51.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:51.179+0000 7f71b46cd640 1 -- 172.21.15.7:0/926977940 shutdown_connections 2024-09-21T06:34:51.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:51.179+0000 7f71b46cd640 1 -- 172.21.15.7:0/926977940 wait complete. 2024-09-21T06:34:51.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:51.180+0000 7f71b46cd640 1 Processor -- start 2024-09-21T06:34:51.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:51.180+0000 7f71b46cd640 1 -- start start 2024-09-21T06:34:51.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:51.180+0000 7f71b46cd640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71ac102a80 0x7f71ac19c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:51.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:51.180+0000 7f71b46cd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71ac1083c0 0x7f71ac19cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:51.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:51.180+0000 7f71b46cd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f71ac108d10 0x7f71ac1a1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:51.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:51.180+0000 7f71b46cd640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f71ac112980 con 0x7f71ac1083c0 2024-09-21T06:34:51.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:51.180+0000 7f71b46cd640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f71ac112800 con 0x7f71ac108d10 2024-09-21T06:34:51.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:51.180+0000 7f71b46cd640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f71ac112b00 con 0x7f71ac102a80 2024-09-21T06:34:51.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:51.180+0000 7f71b1c68640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71ac1083c0 0x7f71ac19cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:51.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:51.180+0000 7f71b1c68640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71ac1083c0 0x7f71ac19cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47966/0 (socket says 172.21.15.7:47966) 2024-09-21T06:34:51.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:51.180+0000 7f71b1c68640 1 -- 172.21.15.7:0/3146782869 learned_addr learned my addr 172.21.15.7:0/3146782869 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:34:51.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:51.180+0000 7f71b2469640 1 --2- 172.21.15.7:0/3146782869 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71ac102a80 0x7f71ac19c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:51.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:51.181+0000 7f71b2c6a640 1 --2- 172.21.15.7:0/3146782869 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f71ac108d10 0x7f71ac1a1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:51.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:51.181+0000 7f71b1c68640 1 -- 172.21.15.7:0/3146782869 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71ac102a80 msgr2=0x7f71ac19c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:51.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:51.181+0000 7f71b1c68640 1 --2- 172.21.15.7:0/3146782869 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71ac102a80 0x7f71ac19c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:51.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:51.181+0000 7f71b1c68640 1 -- 172.21.15.7:0/3146782869 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f71ac108d10 msgr2=0x7f71ac1a1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:51.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:51.181+0000 7f71b1c68640 1 --2- 172.21.15.7:0/3146782869 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f71ac108d10 0x7f71ac1a1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:51.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:51.181+0000 7f71b1c68640 1 -- 172.21.15.7:0/3146782869 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71ac1a2670 con 0x7f71ac1083c0 2024-09-21T06:34:51.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:51.181+0000 7f71b1c68640 1 --2- 172.21.15.7:0/3146782869 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71ac1083c0 0x7f71ac19cca0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f71a000d770 tx=0x7f71a000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:51.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:51.181+0000 7f719f7fe640 1 -- 172.21.15.7:0/3146782869 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a0017070 con 0x7f71ac1083c0 2024-09-21T06:34:51.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:51.181+0000 7f71b46cd640 1 -- 172.21.15.7:0/3146782869 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71ac1a2960 con 0x7f71ac1083c0 2024-09-21T06:34:51.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:51.181+0000 7f719f7fe640 1 -- 172.21.15.7:0/3146782869 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f71a0009c30 con 0x7f71ac1083c0 2024-09-21T06:34:51.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:51.181+0000 7f719f7fe640 1 -- 172.21.15.7:0/3146782869 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a000f620 con 0x7f71ac1083c0 2024-09-21T06:34:51.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:51.181+0000 7f71b46cd640 1 -- 172.21.15.7:0/3146782869 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71ac1a90c0 con 0x7f71ac1083c0 2024-09-21T06:34:51.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:51.182+0000 7f71b46cd640 1 -- 172.21.15.7:0/3146782869 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71ac103d00 con 0x7f71ac1083c0 2024-09-21T06:34:51.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:51.184+0000 7f719f7fe640 1 -- 172.21.15.7:0/3146782869 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154579+0+0 (secure 0 0 0) 0x7f71a001a070 con 0x7f71ac1083c0 2024-09-21T06:34:51.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:51.185+0000 7f719f7fe640 1 --2- 172.21.15.7:0/3146782869 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f71980b65f0 0x7f71980b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:51.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:51.185+0000 7f71b2469640 1 --2- 172.21.15.7:0/3146782869 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f71980b65f0 0x7f71980b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:51.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:51.185+0000 7f719f7fe640 1 -- 172.21.15.7:0/3146782869 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f71a00e6fb0 con 0x7f71ac1083c0 2024-09-21T06:34:51.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:51.185+0000 7f71b2469640 1 --2- 172.21.15.7:0/3146782869 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f71980b65f0 0x7f71980b8b00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f71a8005e30 tx=0x7f71a8009360 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:51.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:51.188+0000 7f719f7fe640 1 -- 172.21.15.7:0/3146782869 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f71a0009de0 con 0x7f71ac1083c0 2024-09-21T06:34:51.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:51.376+0000 7f71b46cd640 1 -- 172.21.15.7:0/3146782869 --> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f71ac06c2e0 con 0x7f71980b65f0 2024-09-21T06:34:51.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:51.380+0000 7f719f7fe640 1 -- 172.21.15.7:0/3146782869 <== mgr.14223 v2:172.21.15.7:6800/3442812985 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258953 (secure 0 0 0) 0x7f71ac06c2e0 con 0x7f71980b65f0 2024-09-21T06:34:51.384 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:34:51.385 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-09-21T06:34:51.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:51.383+0000 7f71b46cd640 1 -- 172.21.15.7:0/3146782869 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f71980b65f0 msgr2=0x7f71980b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:51.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:51.383+0000 7f71b46cd640 1 --2- 172.21.15.7:0/3146782869 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f71980b65f0 0x7f71980b8b00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f71a8005e30 tx=0x7f71a8009360 comp rx=0 tx=0).stop 2024-09-21T06:34:51.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:51.383+0000 7f71b46cd640 1 -- 172.21.15.7:0/3146782869 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71ac1083c0 msgr2=0x7f71ac19cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:51.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:51.383+0000 7f71b46cd640 1 --2- 172.21.15.7:0/3146782869 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71ac1083c0 0x7f71ac19cca0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f71a000d770 tx=0x7f71a000dc30 comp rx=0 tx=0).stop 2024-09-21T06:34:51.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:51.383+0000 7f71b46cd640 1 -- 172.21.15.7:0/3146782869 shutdown_connections 2024-09-21T06:34:51.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:51.383+0000 7f71b46cd640 1 --2- 172.21.15.7:0/3146782869 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f71980b65f0 0x7f71980b8b00 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:51.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:51.383+0000 7f71b46cd640 1 --2- 172.21.15.7:0/3146782869 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f71ac108d10 0x7f71ac1a1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:51.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:51.383+0000 7f71b46cd640 1 --2- 172.21.15.7:0/3146782869 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f71ac1083c0 0x7f71ac19cca0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:51.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:51.383+0000 7f71b46cd640 1 --2- 172.21.15.7:0/3146782869 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71ac102a80 0x7f71ac19c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:51.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:51.384+0000 7f71b46cd640 1 -- 172.21.15.7:0/3146782869 >> 172.21.15.7:0/3146782869 conn(0x7f71ac079740 msgr2=0x7f71ac06bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:51.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:51.384+0000 7f71b46cd640 1 -- 172.21.15.7:0/3146782869 shutdown_connections 2024-09-21T06:34:51.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:51.384+0000 7f71b46cd640 1 -- 172.21.15.7:0/3146782869 wait complete. 2024-09-21T06:34:52.036 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":279,"stamp":"2024-09-21T06:34:51.139739+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":649244,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":193,"num_read_kb":188,"num_write":280,"num_write_kb":2255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":2951840,"num_keys_recovered":11,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":294,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":367952,"kb_used_data":10308,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124573872,"statfs":{"total":1151940427776,"available":1151563644928,"internally_reserved":0,"allocated":10555392,"data_stored":6946560,"data_compressed":177384,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":19143,"internal_metadata":365933881},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25352,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":37,"num_read_kb":45,"num_write":17,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":11,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002362"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.225546+0000","last_change":"2024-09-21T06:34:23.958146+0000","last_active":"2024-09-21T06:34:44.225546+0000","last_peered":"2024-09-21T06:34:44.225546+0000","last_clean":"2024-09-21T06:34:44.225546+0000","last_became_active":"2024-09-21T06:34:23.957580+0000","last_became_peered":"2024-09-21T06:34:23.957580+0000","last_unstale":"2024-09-21T06:34:44.225546+0000","last_undegraded":"2024-09-21T06:34:44.225546+0000","last_fullsized":"2024-09-21T06:34:44.225546+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:33:05.975310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265758+0000","last_change":"2024-09-21T06:34:23.948439+0000","last_active":"2024-09-21T06:34:44.265758+0000","last_peered":"2024-09-21T06:34:44.265758+0000","last_clean":"2024-09-21T06:34:44.265758+0000","last_became_active":"2024-09-21T06:34:23.947511+0000","last_became_peered":"2024-09-21T06:34:23.947511+0000","last_unstale":"2024-09-21T06:34:44.265758+0000","last_undegraded":"2024-09-21T06:34:44.265758+0000","last_fullsized":"2024-09-21T06:34:44.265758+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:13:53.589979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.264949+0000","last_change":"2024-09-21T06:34:23.950752+0000","last_active":"2024-09-21T06:34:44.264949+0000","last_peered":"2024-09-21T06:34:44.264949+0000","last_clean":"2024-09-21T06:34:44.264949+0000","last_became_active":"2024-09-21T06:34:23.950373+0000","last_became_peered":"2024-09-21T06:34:23.950373+0000","last_unstale":"2024-09-21T06:34:44.264949+0000","last_undegraded":"2024-09-21T06:34:44.264949+0000","last_fullsized":"2024-09-21T06:34:44.264949+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:01:29.183426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.267740+0000","last_change":"2024-09-21T06:34:44.267265+0000","last_active":"2024-09-21T06:34:44.267740+0000","last_peered":"2024-09-21T06:34:44.267740+0000","last_clean":"2024-09-21T06:34:44.267740+0000","last_became_active":"2024-09-21T06:34:44.266829+0000","last_became_peered":"2024-09-21T06:34:44.266829+0000","last_unstale":"2024-09-21T06:34:44.267740+0000","last_undegraded":"2024-09-21T06:34:44.267740+0000","last_fullsized":"2024-09-21T06:34:44.267740+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:47:57.873167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.229953+0000","last_change":"2024-09-21T06:34:23.947578+0000","last_active":"2024-09-21T06:34:44.229953+0000","last_peered":"2024-09-21T06:34:44.229953+0000","last_clean":"2024-09-21T06:34:44.229953+0000","last_became_active":"2024-09-21T06:34:23.947201+0000","last_became_peered":"2024-09-21T06:34:23.947201+0000","last_unstale":"2024-09-21T06:34:44.229953+0000","last_undegraded":"2024-09-21T06:34:44.229953+0000","last_fullsized":"2024-09-21T06:34:44.229953+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:48:32.279999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.227142+0000","last_change":"2024-09-21T06:34:23.946191+0000","last_active":"2024-09-21T06:34:44.227142+0000","last_peered":"2024-09-21T06:34:44.227142+0000","last_clean":"2024-09-21T06:34:44.227142+0000","last_became_active":"2024-09-21T06:34:23.945817+0000","last_became_peered":"2024-09-21T06:34:23.945817+0000","last_unstale":"2024-09-21T06:34:44.227142+0000","last_undegraded":"2024-09-21T06:34:44.227142+0000","last_fullsized":"2024-09-21T06:34:44.227142+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:29.443444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265435+0000","last_change":"2024-09-21T06:34:23.943433+0000","last_active":"2024-09-21T06:34:44.265435+0000","last_peered":"2024-09-21T06:34:44.265435+0000","last_clean":"2024-09-21T06:34:44.265435+0000","last_became_active":"2024-09-21T06:34:23.943001+0000","last_became_peered":"2024-09-21T06:34:23.943001+0000","last_unstale":"2024-09-21T06:34:44.265435+0000","last_undegraded":"2024-09-21T06:34:44.265435+0000","last_fullsized":"2024-09-21T06:34:44.265435+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:05:10.695083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.223932+0000","last_change":"2024-09-21T06:34:23.954397+0000","last_active":"2024-09-21T06:34:44.223932+0000","last_peered":"2024-09-21T06:34:44.223932+0000","last_clean":"2024-09-21T06:34:44.223932+0000","last_became_active":"2024-09-21T06:34:23.954008+0000","last_became_peered":"2024-09-21T06:34:23.954008+0000","last_unstale":"2024-09-21T06:34:44.223932+0000","last_undegraded":"2024-09-21T06:34:44.223932+0000","last_fullsized":"2024-09-21T06:34:44.223932+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:10:03.764400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.266422+0000","last_change":"2024-09-21T06:34:23.953371+0000","last_active":"2024-09-21T06:34:44.266422+0000","last_peered":"2024-09-21T06:34:44.266422+0000","last_clean":"2024-09-21T06:34:44.266422+0000","last_became_active":"2024-09-21T06:34:23.952864+0000","last_became_peered":"2024-09-21T06:34:23.952864+0000","last_unstale":"2024-09-21T06:34:44.266422+0000","last_undegraded":"2024-09-21T06:34:44.266422+0000","last_fullsized":"2024-09-21T06:34:44.266422+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:44:23.691372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.267477+0000","last_change":"2024-09-21T06:34:44.267366+0000","last_active":"2024-09-21T06:34:44.267477+0000","last_peered":"2024-09-21T06:34:44.267477+0000","last_clean":"2024-09-21T06:34:44.267477+0000","last_became_active":"2024-09-21T06:34:44.266937+0000","last_became_peered":"2024-09-21T06:34:44.266937+0000","last_unstale":"2024-09-21T06:34:44.267477+0000","last_undegraded":"2024-09-21T06:34:44.267477+0000","last_fullsized":"2024-09-21T06:34:44.267477+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:40:00.904219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.266545+0000","last_change":"2024-09-21T06:34:23.958191+0000","last_active":"2024-09-21T06:34:44.266545+0000","last_peered":"2024-09-21T06:34:44.266545+0000","last_clean":"2024-09-21T06:34:44.266545+0000","last_became_active":"2024-09-21T06:34:23.957836+0000","last_became_peered":"2024-09-21T06:34:23.957836+0000","last_unstale":"2024-09-21T06:34:44.266545+0000","last_undegraded":"2024-09-21T06:34:44.266545+0000","last_fullsized":"2024-09-21T06:34:44.266545+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:31:10.201245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.225421+0000","last_change":"2024-09-21T06:34:23.947256+0000","last_active":"2024-09-21T06:34:44.225421+0000","last_peered":"2024-09-21T06:34:44.225421+0000","last_clean":"2024-09-21T06:34:44.225421+0000","last_became_active":"2024-09-21T06:34:23.946029+0000","last_became_peered":"2024-09-21T06:34:23.946029+0000","last_unstale":"2024-09-21T06:34:44.225421+0000","last_undegraded":"2024-09-21T06:34:44.225421+0000","last_fullsized":"2024-09-21T06:34:44.225421+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:47:19.850700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265129+0000","last_change":"2024-09-21T06:34:23.940661+0000","last_active":"2024-09-21T06:34:44.265129+0000","last_peered":"2024-09-21T06:34:44.265129+0000","last_clean":"2024-09-21T06:34:44.265129+0000","last_became_active":"2024-09-21T06:34:23.940306+0000","last_became_peered":"2024-09-21T06:34:23.940306+0000","last_unstale":"2024-09-21T06:34:44.265129+0000","last_undegraded":"2024-09-21T06:34:44.265129+0000","last_fullsized":"2024-09-21T06:34:44.265129+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:19.062435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265265+0000","last_change":"2024-09-21T06:34:23.941906+0000","last_active":"2024-09-21T06:34:44.265265+0000","last_peered":"2024-09-21T06:34:44.265265+0000","last_clean":"2024-09-21T06:34:44.265265+0000","last_became_active":"2024-09-21T06:34:23.941522+0000","last_became_peered":"2024-09-21T06:34:23.941522+0000","last_unstale":"2024-09-21T06:34:44.265265+0000","last_undegraded":"2024-09-21T06:34:44.265265+0000","last_fullsized":"2024-09-21T06:34:44.265265+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:57:12.557051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.264948+0000","last_change":"2024-09-21T06:34:23.957181+0000","last_active":"2024-09-21T06:34:44.264948+0000","last_peered":"2024-09-21T06:34:44.264948+0000","last_clean":"2024-09-21T06:34:44.264948+0000","last_became_active":"2024-09-21T06:34:23.956269+0000","last_became_peered":"2024-09-21T06:34:23.956269+0000","last_unstale":"2024-09-21T06:34:44.264948+0000","last_undegraded":"2024-09-21T06:34:44.264948+0000","last_fullsized":"2024-09-21T06:34:44.264948+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:33:24.989570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265721+0000","last_change":"2024-09-21T06:34:23.951771+0000","last_active":"2024-09-21T06:34:44.265721+0000","last_peered":"2024-09-21T06:34:44.265721+0000","last_clean":"2024-09-21T06:34:44.265721+0000","last_became_active":"2024-09-21T06:34:23.951381+0000","last_became_peered":"2024-09-21T06:34:23.951381+0000","last_unstale":"2024-09-21T06:34:44.265721+0000","last_undegraded":"2024-09-21T06:34:44.265721+0000","last_fullsized":"2024-09-21T06:34:44.265721+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:26:16.049343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.225612+0000","last_change":"2024-09-21T06:34:23.959425+0000","last_active":"2024-09-21T06:34:44.225612+0000","last_peered":"2024-09-21T06:34:44.225612+0000","last_clean":"2024-09-21T06:34:44.225612+0000","last_became_active":"2024-09-21T06:34:23.959022+0000","last_became_peered":"2024-09-21T06:34:23.959022+0000","last_unstale":"2024-09-21T06:34:44.225612+0000","last_undegraded":"2024-09-21T06:34:44.225612+0000","last_fullsized":"2024-09-21T06:34:44.225612+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:19:45.203639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.226736+0000","last_change":"2024-09-21T06:34:23.950510+0000","last_active":"2024-09-21T06:34:44.226736+0000","last_peered":"2024-09-21T06:34:44.226736+0000","last_clean":"2024-09-21T06:34:44.226736+0000","last_became_active":"2024-09-21T06:34:23.950027+0000","last_became_peered":"2024-09-21T06:34:23.950027+0000","last_unstale":"2024-09-21T06:34:44.226736+0000","last_undegraded":"2024-09-21T06:34:44.226736+0000","last_fullsized":"2024-09-21T06:34:44.226736+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:22:23.093554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265658+0000","last_change":"2024-09-21T06:34:23.948824+0000","last_active":"2024-09-21T06:34:44.265658+0000","last_peered":"2024-09-21T06:34:44.265658+0000","last_clean":"2024-09-21T06:34:44.265658+0000","last_became_active":"2024-09-21T06:34:23.948441+0000","last_became_peered":"2024-09-21T06:34:23.948441+0000","last_unstale":"2024-09-21T06:34:44.265658+0000","last_undegraded":"2024-09-21T06:34:44.265658+0000","last_fullsized":"2024-09-21T06:34:44.265658+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:28.498876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.225240+0000","last_change":"2024-09-21T06:34:23.960278+0000","last_active":"2024-09-21T06:34:44.225240+0000","last_peered":"2024-09-21T06:34:44.225240+0000","last_clean":"2024-09-21T06:34:44.225240+0000","last_became_active":"2024-09-21T06:34:23.959737+0000","last_became_peered":"2024-09-21T06:34:23.959737+0000","last_unstale":"2024-09-21T06:34:44.225240+0000","last_undegraded":"2024-09-21T06:34:44.225240+0000","last_fullsized":"2024-09-21T06:34:44.225240+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:50.097954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265247+0000","last_change":"2024-09-21T06:34:23.942797+0000","last_active":"2024-09-21T06:34:44.265247+0000","last_peered":"2024-09-21T06:34:44.265247+0000","last_clean":"2024-09-21T06:34:44.265247+0000","last_became_active":"2024-09-21T06:34:23.942441+0000","last_became_peered":"2024-09-21T06:34:23.942441+0000","last_unstale":"2024-09-21T06:34:44.265247+0000","last_undegraded":"2024-09-21T06:34:44.265247+0000","last_fullsized":"2024-09-21T06:34:44.265247+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:57:30.552583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265998+0000","last_change":"2024-09-21T06:34:23.957433+0000","last_active":"2024-09-21T06:34:44.265998+0000","last_peered":"2024-09-21T06:34:44.265998+0000","last_clean":"2024-09-21T06:34:44.265998+0000","last_became_active":"2024-09-21T06:34:23.957035+0000","last_became_peered":"2024-09-21T06:34:23.957035+0000","last_unstale":"2024-09-21T06:34:44.265998+0000","last_undegraded":"2024-09-21T06:34:44.265998+0000","last_fullsized":"2024-09-21T06:34:44.265998+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:40:18.418705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.224015+0000","last_change":"2024-09-21T06:34:23.950308+0000","last_active":"2024-09-21T06:34:44.224015+0000","last_peered":"2024-09-21T06:34:44.224015+0000","last_clean":"2024-09-21T06:34:44.224015+0000","last_became_active":"2024-09-21T06:34:23.948417+0000","last_became_peered":"2024-09-21T06:34:23.948417+0000","last_unstale":"2024-09-21T06:34:44.224015+0000","last_undegraded":"2024-09-21T06:34:44.224015+0000","last_fullsized":"2024-09-21T06:34:44.224015+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:47.233504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.226437+0000","last_change":"2024-09-21T06:34:23.949369+0000","last_active":"2024-09-21T06:34:44.226437+0000","last_peered":"2024-09-21T06:34:44.226437+0000","last_clean":"2024-09-21T06:34:44.226437+0000","last_became_active":"2024-09-21T06:34:23.948713+0000","last_became_peered":"2024-09-21T06:34:23.948713+0000","last_unstale":"2024-09-21T06:34:44.226437+0000","last_undegraded":"2024-09-21T06:34:44.226437+0000","last_fullsized":"2024-09-21T06:34:44.226437+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:57:06.915379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.224467+0000","last_change":"2024-09-21T06:34:23.959315+0000","last_active":"2024-09-21T06:34:44.224467+0000","last_peered":"2024-09-21T06:34:44.224467+0000","last_clean":"2024-09-21T06:34:44.224467+0000","last_became_active":"2024-09-21T06:34:23.958904+0000","last_became_peered":"2024-09-21T06:34:23.958904+0000","last_unstale":"2024-09-21T06:34:44.224467+0000","last_undegraded":"2024-09-21T06:34:44.224467+0000","last_fullsized":"2024-09-21T06:34:44.224467+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:31:35.486369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265718+0000","last_change":"2024-09-21T06:34:23.952074+0000","last_active":"2024-09-21T06:34:44.265718+0000","last_peered":"2024-09-21T06:34:44.265718+0000","last_clean":"2024-09-21T06:34:44.265718+0000","last_became_active":"2024-09-21T06:34:23.951692+0000","last_became_peered":"2024-09-21T06:34:23.951692+0000","last_unstale":"2024-09-21T06:34:44.265718+0000","last_undegraded":"2024-09-21T06:34:44.265718+0000","last_fullsized":"2024-09-21T06:34:44.265718+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:15:06.300781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.225420+0000","last_change":"2024-09-21T06:34:23.947296+0000","last_active":"2024-09-21T06:34:44.225420+0000","last_peered":"2024-09-21T06:34:44.225420+0000","last_clean":"2024-09-21T06:34:44.225420+0000","last_became_active":"2024-09-21T06:34:23.946392+0000","last_became_peered":"2024-09-21T06:34:23.946392+0000","last_unstale":"2024-09-21T06:34:44.225420+0000","last_undegraded":"2024-09-21T06:34:44.225420+0000","last_fullsized":"2024-09-21T06:34:44.225420+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:05:27.597890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265035+0000","last_change":"2024-09-21T06:34:23.953161+0000","last_active":"2024-09-21T06:34:44.265035+0000","last_peered":"2024-09-21T06:34:44.265035+0000","last_clean":"2024-09-21T06:34:44.265035+0000","last_became_active":"2024-09-21T06:34:23.952811+0000","last_became_peered":"2024-09-21T06:34:23.952811+0000","last_unstale":"2024-09-21T06:34:44.265035+0000","last_undegraded":"2024-09-21T06:34:44.265035+0000","last_fullsized":"2024-09-21T06:34:44.265035+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:04.431094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265586+0000","last_change":"2024-09-21T06:34:23.959880+0000","last_active":"2024-09-21T06:34:44.265586+0000","last_peered":"2024-09-21T06:34:44.265586+0000","last_clean":"2024-09-21T06:34:44.265586+0000","last_became_active":"2024-09-21T06:34:23.959573+0000","last_became_peered":"2024-09-21T06:34:23.959573+0000","last_unstale":"2024-09-21T06:34:44.265586+0000","last_undegraded":"2024-09-21T06:34:44.265586+0000","last_fullsized":"2024-09-21T06:34:44.265586+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:21.921956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265362+0000","last_change":"2024-09-21T06:34:23.947209+0000","last_active":"2024-09-21T06:34:44.265362+0000","last_peered":"2024-09-21T06:34:44.265362+0000","last_clean":"2024-09-21T06:34:44.265362+0000","last_became_active":"2024-09-21T06:34:23.946763+0000","last_became_peered":"2024-09-21T06:34:23.946763+0000","last_unstale":"2024-09-21T06:34:44.265362+0000","last_undegraded":"2024-09-21T06:34:44.265362+0000","last_fullsized":"2024-09-21T06:34:44.265362+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:04:54.050980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265396+0000","last_change":"2024-09-21T06:34:23.955064+0000","last_active":"2024-09-21T06:34:44.265396+0000","last_peered":"2024-09-21T06:34:44.265396+0000","last_clean":"2024-09-21T06:34:44.265396+0000","last_became_active":"2024-09-21T06:34:23.954622+0000","last_became_peered":"2024-09-21T06:34:23.954622+0000","last_unstale":"2024-09-21T06:34:44.265396+0000","last_undegraded":"2024-09-21T06:34:44.265396+0000","last_fullsized":"2024-09-21T06:34:44.265396+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:04:59.056398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.224979+0000","last_change":"2024-09-21T06:34:23.947015+0000","last_active":"2024-09-21T06:34:44.224979+0000","last_peered":"2024-09-21T06:34:44.224979+0000","last_clean":"2024-09-21T06:34:44.224979+0000","last_became_active":"2024-09-21T06:34:23.946569+0000","last_became_peered":"2024-09-21T06:34:23.946569+0000","last_unstale":"2024-09-21T06:34:44.224979+0000","last_undegraded":"2024-09-21T06:34:44.224979+0000","last_fullsized":"2024-09-21T06:34:44.224979+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:50:35.935533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.230155+0000","last_change":"2024-09-21T06:34:23.951126+0000","last_active":"2024-09-21T06:34:44.230155+0000","last_peered":"2024-09-21T06:34:44.230155+0000","last_clean":"2024-09-21T06:34:44.230155+0000","last_became_active":"2024-09-21T06:34:23.950739+0000","last_became_peered":"2024-09-21T06:34:23.950739+0000","last_unstale":"2024-09-21T06:34:44.230155+0000","last_undegraded":"2024-09-21T06:34:44.230155+0000","last_fullsized":"2024-09-21T06:34:44.230155+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:52:43.201135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'6","reported_seq":46,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:46.022298+0000","last_change":"2024-09-21T06:34:21.939584+0000","last_active":"2024-09-21T06:34:46.022298+0000","last_peered":"2024-09-21T06:34:46.022298+0000","last_clean":"2024-09-21T06:34:46.022298+0000","last_became_active":"2024-09-21T06:34:21.939233+0000","last_became_peered":"2024-09-21T06:34:21.939233+0000","last_unstale":"2024-09-21T06:34:46.022298+0000","last_undegraded":"2024-09-21T06:34:46.022298+0000","last_fullsized":"2024-09-21T06:34:46.022298+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:54.701803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.232102+0000","last_change":"2024-09-21T06:34:44.232010+0000","last_active":"2024-09-21T06:34:44.232102+0000","last_peered":"2024-09-21T06:34:44.232102+0000","last_clean":"2024-09-21T06:34:44.232102+0000","last_became_active":"2024-09-21T06:34:44.231590+0000","last_became_peered":"2024-09-21T06:34:44.231590+0000","last_unstale":"2024-09-21T06:34:44.232102+0000","last_undegraded":"2024-09-21T06:34:44.232102+0000","last_fullsized":"2024-09-21T06:34:44.232102+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:33:02.751794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.227410+0000","last_change":"2024-09-21T06:34:21.937418+0000","last_active":"2024-09-21T06:34:44.227410+0000","last_peered":"2024-09-21T06:34:44.227410+0000","last_clean":"2024-09-21T06:34:44.227410+0000","last_became_active":"2024-09-21T06:34:21.937048+0000","last_became_peered":"2024-09-21T06:34:21.937048+0000","last_unstale":"2024-09-21T06:34:44.227410+0000","last_undegraded":"2024-09-21T06:34:44.227410+0000","last_fullsized":"2024-09-21T06:34:44.227410+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:33:38.731444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.264973+0000","last_change":"2024-09-21T06:34:21.932970+0000","last_active":"2024-09-21T06:34:44.264973+0000","last_peered":"2024-09-21T06:34:44.264973+0000","last_clean":"2024-09-21T06:34:44.264973+0000","last_became_active":"2024-09-21T06:34:21.932616+0000","last_became_peered":"2024-09-21T06:34:21.932616+0000","last_unstale":"2024-09-21T06:34:44.264973+0000","last_undegraded":"2024-09-21T06:34:44.264973+0000","last_fullsized":"2024-09-21T06:34:44.264973+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:33:20.611023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.224042+0000","last_change":"2024-09-21T06:34:23.950798+0000","last_active":"2024-09-21T06:34:44.224042+0000","last_peered":"2024-09-21T06:34:44.224042+0000","last_clean":"2024-09-21T06:34:44.224042+0000","last_became_active":"2024-09-21T06:34:23.950475+0000","last_became_peered":"2024-09-21T06:34:23.950475+0000","last_unstale":"2024-09-21T06:34:44.224042+0000","last_undegraded":"2024-09-21T06:34:44.224042+0000","last_fullsized":"2024-09-21T06:34:44.224042+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:43:23.177775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.226659+0000","last_change":"2024-09-21T06:34:21.937860+0000","last_active":"2024-09-21T06:34:44.226659+0000","last_peered":"2024-09-21T06:34:44.226659+0000","last_clean":"2024-09-21T06:34:44.226659+0000","last_became_active":"2024-09-21T06:34:21.937476+0000","last_became_peered":"2024-09-21T06:34:21.937476+0000","last_unstale":"2024-09-21T06:34:44.226659+0000","last_undegraded":"2024-09-21T06:34:44.226659+0000","last_fullsized":"2024-09-21T06:34:44.226659+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:49:06.069197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.226096+0000","last_change":"2024-09-21T06:34:23.944559+0000","last_active":"2024-09-21T06:34:44.226096+0000","last_peered":"2024-09-21T06:34:44.226096+0000","last_clean":"2024-09-21T06:34:44.226096+0000","last_became_active":"2024-09-21T06:34:23.944166+0000","last_became_peered":"2024-09-21T06:34:23.944166+0000","last_unstale":"2024-09-21T06:34:44.226096+0000","last_undegraded":"2024-09-21T06:34:44.226096+0000","last_fullsized":"2024-09-21T06:34:44.226096+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:01:56.532854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"75'3","reported_seq":40,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:46.021415+0000","last_change":"2024-09-21T06:34:21.936531+0000","last_active":"2024-09-21T06:34:46.021415+0000","last_peered":"2024-09-21T06:34:46.021415+0000","last_clean":"2024-09-21T06:34:46.021415+0000","last_became_active":"2024-09-21T06:34:21.936087+0000","last_became_peered":"2024-09-21T06:34:21.936087+0000","last_unstale":"2024-09-21T06:34:46.021415+0000","last_undegraded":"2024-09-21T06:34:46.021415+0000","last_fullsized":"2024-09-21T06:34:46.021415+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:27:12.370722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.266303+0000","last_change":"2024-09-21T06:34:23.954894+0000","last_active":"2024-09-21T06:34:44.266303+0000","last_peered":"2024-09-21T06:34:44.266303+0000","last_clean":"2024-09-21T06:34:44.266303+0000","last_became_active":"2024-09-21T06:34:23.954186+0000","last_became_peered":"2024-09-21T06:34:23.954186+0000","last_unstale":"2024-09-21T06:34:44.266303+0000","last_undegraded":"2024-09-21T06:34:44.266303+0000","last_fullsized":"2024-09-21T06:34:44.266303+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:18:49.623338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265585+0000","last_change":"2024-09-21T06:34:21.934989+0000","last_active":"2024-09-21T06:34:44.265585+0000","last_peered":"2024-09-21T06:34:44.265585+0000","last_clean":"2024-09-21T06:34:44.265585+0000","last_became_active":"2024-09-21T06:34:21.934550+0000","last_became_peered":"2024-09-21T06:34:21.934550+0000","last_unstale":"2024-09-21T06:34:44.265585+0000","last_undegraded":"2024-09-21T06:34:44.265585+0000","last_fullsized":"2024-09-21T06:34:44.265585+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:59:17.849338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265984+0000","last_change":"2024-09-21T06:34:23.956190+0000","last_active":"2024-09-21T06:34:44.265984+0000","last_peered":"2024-09-21T06:34:44.265984+0000","last_clean":"2024-09-21T06:34:44.265984+0000","last_became_active":"2024-09-21T06:34:23.955815+0000","last_became_peered":"2024-09-21T06:34:23.955815+0000","last_unstale":"2024-09-21T06:34:44.265984+0000","last_undegraded":"2024-09-21T06:34:44.265984+0000","last_fullsized":"2024-09-21T06:34:44.265984+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:14:56.165350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'4","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.227080+0000","last_change":"2024-09-21T06:34:22.096480+0000","last_active":"2024-09-21T06:34:44.227080+0000","last_peered":"2024-09-21T06:34:44.227080+0000","last_clean":"2024-09-21T06:34:44.227080+0000","last_became_active":"2024-09-21T06:34:22.095921+0000","last_became_peered":"2024-09-21T06:34:22.095921+0000","last_unstale":"2024-09-21T06:34:44.227080+0000","last_undegraded":"2024-09-21T06:34:44.227080+0000","last_fullsized":"2024-09-21T06:34:44.227080+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:19:30.006811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265960+0000","last_change":"2024-09-21T06:34:23.961840+0000","last_active":"2024-09-21T06:34:44.265960+0000","last_peered":"2024-09-21T06:34:44.265960+0000","last_clean":"2024-09-21T06:34:44.265960+0000","last_became_active":"2024-09-21T06:34:23.961313+0000","last_became_peered":"2024-09-21T06:34:23.961313+0000","last_unstale":"2024-09-21T06:34:44.265960+0000","last_undegraded":"2024-09-21T06:34:44.265960+0000","last_fullsized":"2024-09-21T06:34:44.265960+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:29:04.308598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"77'25","reported_seq":82,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:47.025110+0000","last_change":"2024-09-21T06:34:21.937326+0000","last_active":"2024-09-21T06:34:47.025110+0000","last_peered":"2024-09-21T06:34:47.025110+0000","last_clean":"2024-09-21T06:34:47.025110+0000","last_became_active":"2024-09-21T06:34:21.936940+0000","last_became_peered":"2024-09-21T06:34:21.936940+0000","last_unstale":"2024-09-21T06:34:47.025110+0000","last_undegraded":"2024-09-21T06:34:47.025110+0000","last_fullsized":"2024-09-21T06:34:47.025110+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:47:12.988306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54250,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":69,"num_write":26,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.230328+0000","last_change":"2024-09-21T06:34:23.950167+0000","last_active":"2024-09-21T06:34:44.230328+0000","last_peered":"2024-09-21T06:34:44.230328+0000","last_clean":"2024-09-21T06:34:44.230328+0000","last_became_active":"2024-09-21T06:34:23.949697+0000","last_became_peered":"2024-09-21T06:34:23.949697+0000","last_unstale":"2024-09-21T06:34:44.230328+0000","last_undegraded":"2024-09-21T06:34:44.230328+0000","last_fullsized":"2024-09-21T06:34:44.230328+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:37:48.882644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'6","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265516+0000","last_change":"2024-09-21T06:34:21.937366+0000","last_active":"2024-09-21T06:34:44.265516+0000","last_peered":"2024-09-21T06:34:44.265516+0000","last_clean":"2024-09-21T06:34:44.265516+0000","last_became_active":"2024-09-21T06:34:21.936988+0000","last_became_peered":"2024-09-21T06:34:21.936988+0000","last_unstale":"2024-09-21T06:34:44.265516+0000","last_undegraded":"2024-09-21T06:34:44.265516+0000","last_fullsized":"2024-09-21T06:34:44.265516+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:48:06.318645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265352+0000","last_change":"2024-09-21T06:34:23.947523+0000","last_active":"2024-09-21T06:34:44.265352+0000","last_peered":"2024-09-21T06:34:44.265352+0000","last_clean":"2024-09-21T06:34:44.265352+0000","last_became_active":"2024-09-21T06:34:23.947150+0000","last_became_peered":"2024-09-21T06:34:23.947150+0000","last_unstale":"2024-09-21T06:34:44.265352+0000","last_undegraded":"2024-09-21T06:34:44.265352+0000","last_fullsized":"2024-09-21T06:34:44.265352+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:18:50.417153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.226854+0000","last_change":"2024-09-21T06:34:21.938631+0000","last_active":"2024-09-21T06:34:44.226854+0000","last_peered":"2024-09-21T06:34:44.226854+0000","last_clean":"2024-09-21T06:34:44.226854+0000","last_became_active":"2024-09-21T06:34:21.938242+0000","last_became_peered":"2024-09-21T06:34:21.938242+0000","last_unstale":"2024-09-21T06:34:44.226854+0000","last_undegraded":"2024-09-21T06:34:44.226854+0000","last_fullsized":"2024-09-21T06:34:44.226854+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:40:02.056812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265725+0000","last_change":"2024-09-21T06:34:23.945276+0000","last_active":"2024-09-21T06:34:44.265725+0000","last_peered":"2024-09-21T06:34:44.265725+0000","last_clean":"2024-09-21T06:34:44.265725+0000","last_became_active":"2024-09-21T06:34:23.944914+0000","last_became_peered":"2024-09-21T06:34:23.944914+0000","last_unstale":"2024-09-21T06:34:44.265725+0000","last_undegraded":"2024-09-21T06:34:44.265725+0000","last_fullsized":"2024-09-21T06:34:44.265725+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:15:23.650908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"75'4","reported_seq":44,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:46.023676+0000","last_change":"2024-09-21T06:34:21.937593+0000","last_active":"2024-09-21T06:34:46.023676+0000","last_peered":"2024-09-21T06:34:46.023676+0000","last_clean":"2024-09-21T06:34:46.023676+0000","last_became_active":"2024-09-21T06:34:21.936851+0000","last_became_peered":"2024-09-21T06:34:21.936851+0000","last_unstale":"2024-09-21T06:34:46.023676+0000","last_undegraded":"2024-09-21T06:34:46.023676+0000","last_fullsized":"2024-09-21T06:34:46.023676+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:25:36.161431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265345+0000","last_change":"2024-09-21T06:34:23.945573+0000","last_active":"2024-09-21T06:34:44.265345+0000","last_peered":"2024-09-21T06:34:44.265345+0000","last_clean":"2024-09-21T06:34:44.265345+0000","last_became_active":"2024-09-21T06:34:23.944410+0000","last_became_peered":"2024-09-21T06:34:23.944410+0000","last_unstale":"2024-09-21T06:34:44.265345+0000","last_undegraded":"2024-09-21T06:34:44.265345+0000","last_fullsized":"2024-09-21T06:34:44.265345+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:33:54.613524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'15","reported_seq":39,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.229900+0000","last_change":"2024-09-21T06:34:22.096539+0000","last_active":"2024-09-21T06:34:44.229900+0000","last_peered":"2024-09-21T06:34:44.229900+0000","last_clean":"2024-09-21T06:34:44.229900+0000","last_became_active":"2024-09-21T06:34:22.096013+0000","last_became_peered":"2024-09-21T06:34:22.096013+0000","last_unstale":"2024-09-21T06:34:44.229900+0000","last_undegraded":"2024-09-21T06:34:44.229900+0000","last_fullsized":"2024-09-21T06:34:44.229900+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:30:59.414325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.226688+0000","last_change":"2024-09-21T06:34:23.958381+0000","last_active":"2024-09-21T06:34:44.226688+0000","last_peered":"2024-09-21T06:34:44.226688+0000","last_clean":"2024-09-21T06:34:44.226688+0000","last_became_active":"2024-09-21T06:34:23.957965+0000","last_became_peered":"2024-09-21T06:34:23.957965+0000","last_unstale":"2024-09-21T06:34:44.226688+0000","last_undegraded":"2024-09-21T06:34:44.226688+0000","last_fullsized":"2024-09-21T06:34:44.226688+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:37:43.474777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'2","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.230733+0000","last_change":"2024-09-21T06:34:21.937612+0000","last_active":"2024-09-21T06:34:44.230733+0000","last_peered":"2024-09-21T06:34:44.230733+0000","last_clean":"2024-09-21T06:34:44.230733+0000","last_became_active":"2024-09-21T06:34:21.936859+0000","last_became_peered":"2024-09-21T06:34:21.936859+0000","last_unstale":"2024-09-21T06:34:44.230733+0000","last_undegraded":"2024-09-21T06:34:44.230733+0000","last_fullsized":"2024-09-21T06:34:44.230733+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:40.957217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.229139+0000","last_change":"2024-09-21T06:34:44.228991+0000","last_active":"2024-09-21T06:34:44.229139+0000","last_peered":"2024-09-21T06:34:44.229139+0000","last_clean":"2024-09-21T06:34:44.229139+0000","last_became_active":"2024-09-21T06:34:44.228428+0000","last_became_peered":"2024-09-21T06:34:44.228428+0000","last_unstale":"2024-09-21T06:34:44.229139+0000","last_undegraded":"2024-09-21T06:34:44.229139+0000","last_fullsized":"2024-09-21T06:34:44.229139+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:21.719532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265523+0000","last_change":"2024-09-21T06:34:21.933392+0000","last_active":"2024-09-21T06:34:44.265523+0000","last_peered":"2024-09-21T06:34:44.265523+0000","last_clean":"2024-09-21T06:34:44.265523+0000","last_became_active":"2024-09-21T06:34:21.932999+0000","last_became_peered":"2024-09-21T06:34:21.932999+0000","last_unstale":"2024-09-21T06:34:44.265523+0000","last_undegraded":"2024-09-21T06:34:44.265523+0000","last_fullsized":"2024-09-21T06:34:44.265523+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:05:20.631755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.266194+0000","last_change":"2024-09-21T06:34:23.944675+0000","last_active":"2024-09-21T06:34:44.266194+0000","last_peered":"2024-09-21T06:34:44.266194+0000","last_clean":"2024-09-21T06:34:44.266194+0000","last_became_active":"2024-09-21T06:34:23.944258+0000","last_became_peered":"2024-09-21T06:34:23.944258+0000","last_unstale":"2024-09-21T06:34:44.266194+0000","last_undegraded":"2024-09-21T06:34:44.266194+0000","last_fullsized":"2024-09-21T06:34:44.266194+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:26:40.661840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'1","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.227259+0000","last_change":"2024-09-21T06:34:21.941064+0000","last_active":"2024-09-21T06:34:44.227259+0000","last_peered":"2024-09-21T06:34:44.227259+0000","last_clean":"2024-09-21T06:34:44.227259+0000","last_became_active":"2024-09-21T06:34:21.940667+0000","last_became_peered":"2024-09-21T06:34:21.940667+0000","last_unstale":"2024-09-21T06:34:44.227259+0000","last_undegraded":"2024-09-21T06:34:44.227259+0000","last_fullsized":"2024-09-21T06:34:44.227259+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:20:14.721719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'1","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.266571+0000","last_change":"2024-09-21T06:34:23.943503+0000","last_active":"2024-09-21T06:34:44.266571+0000","last_peered":"2024-09-21T06:34:44.266571+0000","last_clean":"2024-09-21T06:34:44.266571+0000","last_became_active":"2024-09-21T06:34:23.943097+0000","last_became_peered":"2024-09-21T06:34:23.943097+0000","last_unstale":"2024-09-21T06:34:44.266571+0000","last_undegraded":"2024-09-21T06:34:44.266571+0000","last_fullsized":"2024-09-21T06:34:44.266571+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:08:04.641273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"75'3","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265879+0000","last_change":"2024-09-21T06:34:22.096274+0000","last_active":"2024-09-21T06:34:44.265879+0000","last_peered":"2024-09-21T06:34:44.265879+0000","last_clean":"2024-09-21T06:34:44.265879+0000","last_became_active":"2024-09-21T06:34:22.095861+0000","last_became_peered":"2024-09-21T06:34:22.095861+0000","last_unstale":"2024-09-21T06:34:44.265879+0000","last_undegraded":"2024-09-21T06:34:44.265879+0000","last_fullsized":"2024-09-21T06:34:44.265879+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:22:47.807488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.266601+0000","last_change":"2024-09-21T06:34:23.953503+0000","last_active":"2024-09-21T06:34:44.266601+0000","last_peered":"2024-09-21T06:34:44.266601+0000","last_clean":"2024-09-21T06:34:44.266601+0000","last_became_active":"2024-09-21T06:34:23.952880+0000","last_became_peered":"2024-09-21T06:34:23.952880+0000","last_unstale":"2024-09-21T06:34:44.266601+0000","last_undegraded":"2024-09-21T06:34:44.266601+0000","last_fullsized":"2024-09-21T06:34:44.266601+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:29:47.746678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":97,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265543+0000","last_change":"2024-09-21T06:33:09.908154+0000","last_active":"2024-09-21T06:34:44.265543+0000","last_peered":"2024-09-21T06:34:44.265543+0000","last_clean":"2024-09-21T06:34:44.265543+0000","last_became_active":"2024-09-21T06:33:09.902397+0000","last_became_peered":"2024-09-21T06:33:09.902397+0000","last_unstale":"2024-09-21T06:34:44.265543+0000","last_undegraded":"2024-09-21T06:34:44.265543+0000","last_fullsized":"2024-09-21T06:34:44.265543+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:29:42.295555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:29:42.295555+0000","last_clean_scrub_stamp":"2024-09-21T06:29:42.295555+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:15:17.111178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"75'3","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.225389+0000","last_change":"2024-09-21T06:34:21.932618+0000","last_active":"2024-09-21T06:34:44.225389+0000","last_peered":"2024-09-21T06:34:44.225389+0000","last_clean":"2024-09-21T06:34:44.225389+0000","last_became_active":"2024-09-21T06:34:21.932187+0000","last_became_peered":"2024-09-21T06:34:21.932187+0000","last_unstale":"2024-09-21T06:34:44.225389+0000","last_undegraded":"2024-09-21T06:34:44.225389+0000","last_fullsized":"2024-09-21T06:34:44.225389+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:19:06.780448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.224167+0000","last_change":"2024-09-21T06:34:23.953580+0000","last_active":"2024-09-21T06:34:44.224167+0000","last_peered":"2024-09-21T06:34:44.224167+0000","last_clean":"2024-09-21T06:34:44.224167+0000","last_became_active":"2024-09-21T06:34:23.952222+0000","last_became_peered":"2024-09-21T06:34:23.952222+0000","last_unstale":"2024-09-21T06:34:44.224167+0000","last_undegraded":"2024-09-21T06:34:44.224167+0000","last_fullsized":"2024-09-21T06:34:44.224167+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:19.759042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265531+0000","last_change":"2024-09-21T06:34:21.939178+0000","last_active":"2024-09-21T06:34:44.265531+0000","last_peered":"2024-09-21T06:34:44.265531+0000","last_clean":"2024-09-21T06:34:44.265531+0000","last_became_active":"2024-09-21T06:34:21.938755+0000","last_became_peered":"2024-09-21T06:34:21.938755+0000","last_unstale":"2024-09-21T06:34:44.265531+0000","last_undegraded":"2024-09-21T06:34:44.265531+0000","last_fullsized":"2024-09-21T06:34:44.265531+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:10.474432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.264822+0000","last_change":"2024-09-21T06:34:23.954196+0000","last_active":"2024-09-21T06:34:44.264822+0000","last_peered":"2024-09-21T06:34:44.264822+0000","last_clean":"2024-09-21T06:34:44.264822+0000","last_became_active":"2024-09-21T06:34:23.953843+0000","last_became_peered":"2024-09-21T06:34:23.953843+0000","last_unstale":"2024-09-21T06:34:44.264822+0000","last_undegraded":"2024-09-21T06:34:44.264822+0000","last_fullsized":"2024-09-21T06:34:44.264822+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:41:02.896704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"75'4","reported_seq":43,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:48.025972+0000","last_change":"2024-09-21T06:34:22.095920+0000","last_active":"2024-09-21T06:34:48.025972+0000","last_peered":"2024-09-21T06:34:48.025972+0000","last_clean":"2024-09-21T06:34:48.025972+0000","last_became_active":"2024-09-21T06:34:22.095376+0000","last_became_peered":"2024-09-21T06:34:22.095376+0000","last_unstale":"2024-09-21T06:34:48.025972+0000","last_undegraded":"2024-09-21T06:34:48.025972+0000","last_fullsized":"2024-09-21T06:34:48.025972+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:40:44.400566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.226479+0000","last_change":"2024-09-21T06:34:23.956541+0000","last_active":"2024-09-21T06:34:44.226479+0000","last_peered":"2024-09-21T06:34:44.226479+0000","last_clean":"2024-09-21T06:34:44.226479+0000","last_became_active":"2024-09-21T06:34:23.956150+0000","last_became_peered":"2024-09-21T06:34:23.956150+0000","last_unstale":"2024-09-21T06:34:44.226479+0000","last_undegraded":"2024-09-21T06:34:44.226479+0000","last_fullsized":"2024-09-21T06:34:44.226479+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:09:32.432391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.266674+0000","last_change":"2024-09-21T06:34:21.942244+0000","last_active":"2024-09-21T06:34:44.266674+0000","last_peered":"2024-09-21T06:34:44.266674+0000","last_clean":"2024-09-21T06:34:44.266674+0000","last_became_active":"2024-09-21T06:34:21.941761+0000","last_became_peered":"2024-09-21T06:34:21.941761+0000","last_unstale":"2024-09-21T06:34:44.266674+0000","last_undegraded":"2024-09-21T06:34:44.266674+0000","last_fullsized":"2024-09-21T06:34:44.266674+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:10.507103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.227647+0000","last_change":"2024-09-21T06:34:23.951250+0000","last_active":"2024-09-21T06:34:44.227647+0000","last_peered":"2024-09-21T06:34:44.227647+0000","last_clean":"2024-09-21T06:34:44.227647+0000","last_became_active":"2024-09-21T06:34:23.950015+0000","last_became_peered":"2024-09-21T06:34:23.950015+0000","last_unstale":"2024-09-21T06:34:44.227647+0000","last_undegraded":"2024-09-21T06:34:44.227647+0000","last_fullsized":"2024-09-21T06:34:44.227647+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:53:22.884049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.266799+0000","last_change":"2024-09-21T06:34:44.266717+0000","last_active":"2024-09-21T06:34:44.266799+0000","last_peered":"2024-09-21T06:34:44.266799+0000","last_clean":"2024-09-21T06:34:44.266799+0000","last_became_active":"2024-09-21T06:34:44.266256+0000","last_became_peered":"2024-09-21T06:34:44.266256+0000","last_unstale":"2024-09-21T06:34:44.266799+0000","last_undegraded":"2024-09-21T06:34:44.266799+0000","last_fullsized":"2024-09-21T06:34:44.266799+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:38:04.674592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'1","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.227589+0000","last_change":"2024-09-21T06:34:23.947823+0000","last_active":"2024-09-21T06:34:44.227589+0000","last_peered":"2024-09-21T06:34:44.227589+0000","last_clean":"2024-09-21T06:34:44.227589+0000","last_became_active":"2024-09-21T06:34:23.947362+0000","last_became_peered":"2024-09-21T06:34:23.947362+0000","last_unstale":"2024-09-21T06:34:44.227589+0000","last_undegraded":"2024-09-21T06:34:44.227589+0000","last_fullsized":"2024-09-21T06:34:44.227589+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:32:22.401819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"75'1","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.230506+0000","last_change":"2024-09-21T06:34:22.096537+0000","last_active":"2024-09-21T06:34:44.230506+0000","last_peered":"2024-09-21T06:34:44.230506+0000","last_clean":"2024-09-21T06:34:44.230506+0000","last_became_active":"2024-09-21T06:34:22.095875+0000","last_became_peered":"2024-09-21T06:34:22.095875+0000","last_unstale":"2024-09-21T06:34:44.230506+0000","last_undegraded":"2024-09-21T06:34:44.230506+0000","last_fullsized":"2024-09-21T06:34:44.230506+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:11:44.955531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265151+0000","last_change":"2024-09-21T06:34:23.938784+0000","last_active":"2024-09-21T06:34:44.265151+0000","last_peered":"2024-09-21T06:34:44.265151+0000","last_clean":"2024-09-21T06:34:44.265151+0000","last_became_active":"2024-09-21T06:34:23.938400+0000","last_became_peered":"2024-09-21T06:34:23.938400+0000","last_unstale":"2024-09-21T06:34:44.265151+0000","last_undegraded":"2024-09-21T06:34:44.265151+0000","last_fullsized":"2024-09-21T06:34:44.265151+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:00:13.210874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"77'8","reported_seq":44,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.957580+0000","last_change":"2024-09-21T06:34:44.235532+0000","last_active":"2024-09-21T06:34:44.957580+0000","last_peered":"2024-09-21T06:34:44.957580+0000","last_clean":"2024-09-21T06:34:44.957580+0000","last_became_active":"2024-09-21T06:34:44.230220+0000","last_became_peered":"2024-09-21T06:34:44.230220+0000","last_unstale":"2024-09-21T06:34:44.957580+0000","last_undegraded":"2024-09-21T06:34:44.957580+0000","last_fullsized":"2024-09-21T06:34:44.957580+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:07:23.398177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":11,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.224475+0000","last_change":"2024-09-21T06:34:23.953477+0000","last_active":"2024-09-21T06:34:44.224475+0000","last_peered":"2024-09-21T06:34:44.224475+0000","last_clean":"2024-09-21T06:34:44.224475+0000","last_became_active":"2024-09-21T06:34:23.951404+0000","last_became_peered":"2024-09-21T06:34:23.951404+0000","last_unstale":"2024-09-21T06:34:44.224475+0000","last_undegraded":"2024-09-21T06:34:44.224475+0000","last_fullsized":"2024-09-21T06:34:44.224475+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:13:17.126680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'4","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.225262+0000","last_change":"2024-09-21T06:34:22.031837+0000","last_active":"2024-09-21T06:34:44.225262+0000","last_peered":"2024-09-21T06:34:44.225262+0000","last_clean":"2024-09-21T06:34:44.225262+0000","last_became_active":"2024-09-21T06:34:22.031377+0000","last_became_peered":"2024-09-21T06:34:22.031377+0000","last_unstale":"2024-09-21T06:34:44.225262+0000","last_undegraded":"2024-09-21T06:34:44.225262+0000","last_fullsized":"2024-09-21T06:34:44.225262+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:14:32.536634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265835+0000","last_change":"2024-09-21T06:34:23.955321+0000","last_active":"2024-09-21T06:34:44.265835+0000","last_peered":"2024-09-21T06:34:44.265835+0000","last_clean":"2024-09-21T06:34:44.265835+0000","last_became_active":"2024-09-21T06:34:23.954906+0000","last_became_peered":"2024-09-21T06:34:23.954906+0000","last_unstale":"2024-09-21T06:34:44.265835+0000","last_undegraded":"2024-09-21T06:34:44.265835+0000","last_fullsized":"2024-09-21T06:34:44.265835+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:59:07.771268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265823+0000","last_change":"2024-09-21T06:34:22.096135+0000","last_active":"2024-09-21T06:34:44.265823+0000","last_peered":"2024-09-21T06:34:44.265823+0000","last_clean":"2024-09-21T06:34:44.265823+0000","last_became_active":"2024-09-21T06:34:22.095721+0000","last_became_peered":"2024-09-21T06:34:22.095721+0000","last_unstale":"2024-09-21T06:34:44.265823+0000","last_undegraded":"2024-09-21T06:34:44.265823+0000","last_fullsized":"2024-09-21T06:34:44.265823+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:28.994324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.229717+0000","last_change":"2024-09-21T06:34:23.951769+0000","last_active":"2024-09-21T06:34:44.229717+0000","last_peered":"2024-09-21T06:34:44.229717+0000","last_clean":"2024-09-21T06:34:44.229717+0000","last_became_active":"2024-09-21T06:34:23.951377+0000","last_became_peered":"2024-09-21T06:34:23.951377+0000","last_unstale":"2024-09-21T06:34:44.229717+0000","last_undegraded":"2024-09-21T06:34:44.229717+0000","last_fullsized":"2024-09-21T06:34:44.229717+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:49:44.291714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.224147+0000","last_change":"2024-09-21T06:34:21.933909+0000","last_active":"2024-09-21T06:34:44.224147+0000","last_peered":"2024-09-21T06:34:44.224147+0000","last_clean":"2024-09-21T06:34:44.224147+0000","last_became_active":"2024-09-21T06:34:21.933524+0000","last_became_peered":"2024-09-21T06:34:21.933524+0000","last_unstale":"2024-09-21T06:34:44.224147+0000","last_undegraded":"2024-09-21T06:34:44.224147+0000","last_fullsized":"2024-09-21T06:34:44.224147+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:58.110444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.225073+0000","last_change":"2024-09-21T06:34:23.948586+0000","last_active":"2024-09-21T06:34:44.225073+0000","last_peered":"2024-09-21T06:34:44.225073+0000","last_clean":"2024-09-21T06:34:44.225073+0000","last_became_active":"2024-09-21T06:34:23.948225+0000","last_became_peered":"2024-09-21T06:34:23.948225+0000","last_unstale":"2024-09-21T06:34:44.225073+0000","last_undegraded":"2024-09-21T06:34:44.225073+0000","last_fullsized":"2024-09-21T06:34:44.225073+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:28:24.272712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265358+0000","last_change":"2024-09-21T06:34:21.935617+0000","last_active":"2024-09-21T06:34:44.265358+0000","last_peered":"2024-09-21T06:34:44.265358+0000","last_clean":"2024-09-21T06:34:44.265358+0000","last_became_active":"2024-09-21T06:34:21.934601+0000","last_became_peered":"2024-09-21T06:34:21.934601+0000","last_unstale":"2024-09-21T06:34:44.265358+0000","last_undegraded":"2024-09-21T06:34:44.265358+0000","last_fullsized":"2024-09-21T06:34:44.265358+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:30.836070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.224206+0000","last_change":"2024-09-21T06:34:23.947661+0000","last_active":"2024-09-21T06:34:44.224206+0000","last_peered":"2024-09-21T06:34:44.224206+0000","last_clean":"2024-09-21T06:34:44.224206+0000","last_became_active":"2024-09-21T06:34:23.947307+0000","last_became_peered":"2024-09-21T06:34:23.947307+0000","last_unstale":"2024-09-21T06:34:44.224206+0000","last_undegraded":"2024-09-21T06:34:44.224206+0000","last_fullsized":"2024-09-21T06:34:44.224206+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:08.045291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'4","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.230116+0000","last_change":"2024-09-21T06:34:21.942749+0000","last_active":"2024-09-21T06:34:44.230116+0000","last_peered":"2024-09-21T06:34:44.230116+0000","last_clean":"2024-09-21T06:34:44.230116+0000","last_became_active":"2024-09-21T06:34:21.942283+0000","last_became_peered":"2024-09-21T06:34:21.942283+0000","last_unstale":"2024-09-21T06:34:44.230116+0000","last_undegraded":"2024-09-21T06:34:44.230116+0000","last_fullsized":"2024-09-21T06:34:44.230116+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:47.477956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.266544+0000","last_change":"2024-09-21T06:34:23.957389+0000","last_active":"2024-09-21T06:34:44.266544+0000","last_peered":"2024-09-21T06:34:44.266544+0000","last_clean":"2024-09-21T06:34:44.266544+0000","last_became_active":"2024-09-21T06:34:23.957032+0000","last_became_peered":"2024-09-21T06:34:23.957032+0000","last_unstale":"2024-09-21T06:34:44.266544+0000","last_undegraded":"2024-09-21T06:34:44.266544+0000","last_fullsized":"2024-09-21T06:34:44.266544+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:00:53.932062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.227302+0000","last_change":"2024-09-21T06:34:23.957304+0000","last_active":"2024-09-21T06:34:44.227302+0000","last_peered":"2024-09-21T06:34:44.227302+0000","last_clean":"2024-09-21T06:34:44.227302+0000","last_became_active":"2024-09-21T06:34:23.956931+0000","last_became_peered":"2024-09-21T06:34:23.956931+0000","last_unstale":"2024-09-21T06:34:44.227302+0000","last_undegraded":"2024-09-21T06:34:44.227302+0000","last_fullsized":"2024-09-21T06:34:44.227302+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:14:12.240686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.230138+0000","last_change":"2024-09-21T06:34:21.937150+0000","last_active":"2024-09-21T06:34:44.230138+0000","last_peered":"2024-09-21T06:34:44.230138+0000","last_clean":"2024-09-21T06:34:44.230138+0000","last_became_active":"2024-09-21T06:34:21.936037+0000","last_became_peered":"2024-09-21T06:34:21.936037+0000","last_unstale":"2024-09-21T06:34:44.230138+0000","last_undegraded":"2024-09-21T06:34:44.230138+0000","last_fullsized":"2024-09-21T06:34:44.230138+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:24:44.821346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265815+0000","last_change":"2024-09-21T06:34:23.955585+0000","last_active":"2024-09-21T06:34:44.265815+0000","last_peered":"2024-09-21T06:34:44.265815+0000","last_clean":"2024-09-21T06:34:44.265815+0000","last_became_active":"2024-09-21T06:34:23.955225+0000","last_became_peered":"2024-09-21T06:34:23.955225+0000","last_unstale":"2024-09-21T06:34:44.265815+0000","last_undegraded":"2024-09-21T06:34:44.265815+0000","last_fullsized":"2024-09-21T06:34:44.265815+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:07:56.735854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'4","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.230684+0000","last_change":"2024-09-21T06:34:21.941804+0000","last_active":"2024-09-21T06:34:44.230684+0000","last_peered":"2024-09-21T06:34:44.230684+0000","last_clean":"2024-09-21T06:34:44.230684+0000","last_became_active":"2024-09-21T06:34:21.941387+0000","last_became_peered":"2024-09-21T06:34:21.941387+0000","last_unstale":"2024-09-21T06:34:44.230684+0000","last_undegraded":"2024-09-21T06:34:44.230684+0000","last_fullsized":"2024-09-21T06:34:44.230684+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:34:51.217549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265988+0000","last_change":"2024-09-21T06:34:23.957429+0000","last_active":"2024-09-21T06:34:44.265988+0000","last_peered":"2024-09-21T06:34:44.265988+0000","last_clean":"2024-09-21T06:34:44.265988+0000","last_became_active":"2024-09-21T06:34:23.956471+0000","last_became_peered":"2024-09-21T06:34:23.956471+0000","last_unstale":"2024-09-21T06:34:44.265988+0000","last_undegraded":"2024-09-21T06:34:44.265988+0000","last_fullsized":"2024-09-21T06:34:44.265988+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:46:26.770549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.224539+0000","last_change":"2024-09-21T06:34:22.096267+0000","last_active":"2024-09-21T06:34:44.224539+0000","last_peered":"2024-09-21T06:34:44.224539+0000","last_clean":"2024-09-21T06:34:44.224539+0000","last_became_active":"2024-09-21T06:34:22.095799+0000","last_became_peered":"2024-09-21T06:34:22.095799+0000","last_unstale":"2024-09-21T06:34:44.224539+0000","last_undegraded":"2024-09-21T06:34:44.224539+0000","last_fullsized":"2024-09-21T06:34:44.224539+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:29:00.075016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.224392+0000","last_change":"2024-09-21T06:34:23.952294+0000","last_active":"2024-09-21T06:34:44.224392+0000","last_peered":"2024-09-21T06:34:44.224392+0000","last_clean":"2024-09-21T06:34:44.224392+0000","last_became_active":"2024-09-21T06:34:23.951919+0000","last_became_peered":"2024-09-21T06:34:23.951919+0000","last_unstale":"2024-09-21T06:34:44.224392+0000","last_undegraded":"2024-09-21T06:34:44.224392+0000","last_fullsized":"2024-09-21T06:34:44.224392+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:30:28.039754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'9","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.226566+0000","last_change":"2024-09-21T06:34:21.934818+0000","last_active":"2024-09-21T06:34:44.226566+0000","last_peered":"2024-09-21T06:34:44.226566+0000","last_clean":"2024-09-21T06:34:44.226566+0000","last_became_active":"2024-09-21T06:34:21.934415+0000","last_became_peered":"2024-09-21T06:34:21.934415+0000","last_unstale":"2024-09-21T06:34:44.226566+0000","last_undegraded":"2024-09-21T06:34:44.226566+0000","last_fullsized":"2024-09-21T06:34:44.226566+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:25:48.460699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":58642,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":112,"num_read_kb":119,"num_write":155,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":11,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":175926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":133,"ondisk_log_size":133,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282715,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743442,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27848,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717304,"statfs":{"total":95995035648,"available":95966519296,"internally_reserved":0,"allocated":835584,"data_stored":417151,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939669,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":983040,"data_stored":1063273,"data_compressed":41743,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103195,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27864,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717288,"statfs":{"total":95995035648,"available":95966502912,"internally_reserved":0,"allocated":851968,"data_stored":417387,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299425,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32024,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713128,"statfs":{"total":95995035648,"available":95962243072,"internally_reserved":0,"allocated":851968,"data_stored":417307,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462950,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":901120,"data_stored":1009628,"data_compressed":41743,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626475,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36172,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708980,"statfs":{"total":95995035648,"available":95957995520,"internally_reserved":0,"allocated":839680,"data_stored":416776,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822704,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":913408,"data_stored":1008921,"data_compressed":41743,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986230,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36168,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708984,"statfs":{"total":95995035648,"available":95957999616,"internally_reserved":0,"allocated":843776,"data_stored":417604,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182458,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36188,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708964,"statfs":{"total":95995035648,"available":95957979136,"internally_reserved":0,"allocated":856064,"data_stored":417087,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378688,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32092,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713060,"statfs":{"total":95995035648,"available":95962173440,"internally_reserved":0,"allocated":921600,"data_stored":472560,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542213,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":897024,"data_stored":470819,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705737,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27872,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717280,"statfs":{"total":95995035648,"available":95966494720,"internally_reserved":0,"allocated":860160,"data_stored":418047,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34325,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34325,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34325,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":54250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":55991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":56219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T06:34:52.040 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-21T06:34:52.041 INFO:tasks.cephadm:Setting up client nodes... 2024-09-21T06:34:52.041 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-21T06:34:52.302 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:34:52.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:52 smithi007 ceph-mon[30983]: pgmap v279: 97 pgs: 97 active+clean; 634 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 4.0 KiB/s wr, 6 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-09-21T06:34:52.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:52 smithi007 ceph-mon[30983]: from='client.14970 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:34:52.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:52 smithi144 ceph-mon[34653]: pgmap v279: 97 pgs: 97 active+clean; 634 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 4.0 KiB/s wr, 6 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-09-21T06:34:52.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:52 smithi144 ceph-mon[34653]: from='client.14970 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:34:52.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:52 smithi018 ceph-mon[34477]: pgmap v279: 97 pgs: 97 active+clean; 634 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 4.0 KiB/s wr, 6 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-09-21T06:34:52.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:52 smithi018 ceph-mon[34477]: from='client.14970 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:34:52.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:52.803+0000 7fa3f6055640 1 -- 172.21.15.7:0/3960064946 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3f01031d0 msgr2=0x7fa3f01035e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:52.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:52.803+0000 7fa3f6055640 1 --2- 172.21.15.7:0/3960064946 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3f01031d0 0x7fa3f01035e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fa3e0009900 tx=0x7fa3e002a410 comp rx=0 tx=0).stop 2024-09-21T06:34:52.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:52.803+0000 7fa3f6055640 1 -- 172.21.15.7:0/3960064946 shutdown_connections 2024-09-21T06:34:52.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:52.803+0000 7fa3f6055640 1 --2- 172.21.15.7:0/3960064946 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3f0108d50 0x7fa3f010f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:52.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:52.803+0000 7fa3f6055640 1 --2- 172.21.15.7:0/3960064946 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa3f0108400 0x7fa3f0108810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:52.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:52.803+0000 7fa3f6055640 1 --2- 172.21.15.7:0/3960064946 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3f01031d0 0x7fa3f01035e0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:52.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:52.803+0000 7fa3f6055640 1 -- 172.21.15.7:0/3960064946 >> 172.21.15.7:0/3960064946 conn(0x7fa3f0079dc0 msgr2=0x7fa3f007a220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:52.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:52.803+0000 7fa3f6055640 1 -- 172.21.15.7:0/3960064946 shutdown_connections 2024-09-21T06:34:52.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:52.803+0000 7fa3f6055640 1 -- 172.21.15.7:0/3960064946 wait complete. 2024-09-21T06:34:52.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:52.804+0000 7fa3f6055640 1 Processor -- start 2024-09-21T06:34:52.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:52.804+0000 7fa3f6055640 1 -- start start 2024-09-21T06:34:52.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:52.804+0000 7fa3f6055640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa3f01031d0 0x7fa3f019a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:52.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:52.804+0000 7fa3f6055640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3f0108400 0x7fa3f019aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:52.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:52.804+0000 7fa3f6055640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3f0108d50 0x7fa3f019fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:52.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:52.804+0000 7fa3f6055640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa3f0112a10 con 0x7fa3f0108400 2024-09-21T06:34:52.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:52.804+0000 7fa3f6055640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa3f0112890 con 0x7fa3f0108d50 2024-09-21T06:34:52.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:52.804+0000 7fa3f6055640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa3f0112b90 con 0x7fa3f01031d0 2024-09-21T06:34:52.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:52.804+0000 7fa3eeffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3f0108400 0x7fa3f019aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:52.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:52.804+0000 7fa3eeffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3f0108400 0x7fa3f019aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47982/0 (socket says 172.21.15.7:47982) 2024-09-21T06:34:52.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:52.804+0000 7fa3eeffd640 1 -- 172.21.15.7:0/742818257 learned_addr learned my addr 172.21.15.7:0/742818257 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:34:52.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:52.804+0000 7fa3ef7fe640 1 --2- 172.21.15.7:0/742818257 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa3f01031d0 0x7fa3f019a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:52.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:52.804+0000 7fa3effff640 1 --2- 172.21.15.7:0/742818257 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3f0108d50 0x7fa3f019fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:52.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:52.805+0000 7fa3eeffd640 1 -- 172.21.15.7:0/742818257 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa3f01031d0 msgr2=0x7fa3f019a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:52.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:52.805+0000 7fa3eeffd640 1 --2- 172.21.15.7:0/742818257 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa3f01031d0 0x7fa3f019a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:52.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:52.805+0000 7fa3eeffd640 1 -- 172.21.15.7:0/742818257 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3f0108d50 msgr2=0x7fa3f019fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:52.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:52.805+0000 7fa3eeffd640 1 --2- 172.21.15.7:0/742818257 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3f0108d50 0x7fa3f019fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:52.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:52.805+0000 7fa3eeffd640 1 -- 172.21.15.7:0/742818257 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3f01a0460 con 0x7fa3f0108400 2024-09-21T06:34:52.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:52.805+0000 7fa3eeffd640 1 --2- 172.21.15.7:0/742818257 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3f0108400 0x7fa3f019aa90 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa3e400d750 tx=0x7fa3e400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:52.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:52.805+0000 7fa3ecff9640 1 -- 172.21.15.7:0/742818257 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3e4017070 con 0x7fa3f0108400 2024-09-21T06:34:52.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:52.805+0000 7fa3ecff9640 1 -- 172.21.15.7:0/742818257 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3e40054d0 con 0x7fa3f0108400 2024-09-21T06:34:52.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:52.805+0000 7fa3f6055640 1 -- 172.21.15.7:0/742818257 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3f01a0750 con 0x7fa3f0108400 2024-09-21T06:34:52.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:52.805+0000 7fa3ecff9640 1 -- 172.21.15.7:0/742818257 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3e4004c30 con 0x7fa3f0108400 2024-09-21T06:34:52.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:52.805+0000 7fa3f6055640 1 -- 172.21.15.7:0/742818257 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3f01a6eb0 con 0x7fa3f0108400 2024-09-21T06:34:52.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:52.806+0000 7fa3f6055640 1 -- 172.21.15.7:0/742818257 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3f01035e0 con 0x7fa3f0108400 2024-09-21T06:34:52.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:52.808+0000 7fa3ecff9640 1 -- 172.21.15.7:0/742818257 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154579+0+0 (secure 0 0 0) 0x7fa3e4004dd0 con 0x7fa3f0108400 2024-09-21T06:34:52.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:52.808+0000 7fa3ecff9640 1 --2- 172.21.15.7:0/742818257 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa3d80b6670 0x7fa3d80b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:52.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:52.809+0000 7fa3ef7fe640 1 --2- 172.21.15.7:0/742818257 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa3d80b6670 0x7fa3d80b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:52.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:52.809+0000 7fa3ecff9640 1 -- 172.21.15.7:0/742818257 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fa3e40e72d0 con 0x7fa3f0108400 2024-09-21T06:34:52.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:52.809+0000 7fa3ef7fe640 1 --2- 172.21.15.7:0/742818257 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa3d80b6670 0x7fa3d80b8b80 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa3e0031440 tx=0x7fa3e0009560 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:52.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:52.812+0000 7fa3ecff9640 1 -- 172.21.15.7:0/742818257 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa3e40ada00 con 0x7fa3f0108400 2024-09-21T06:34:53.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:53.072+0000 7fa3f6055640 1 -- 172.21.15.7:0/742818257 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7fa3f019b620 con 0x7fa3f0108400 2024-09-21T06:34:53.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:53.076+0000 7fa3ecff9640 1 -- 172.21.15.7:0/742818257 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7fa3f019b620 con 0x7fa3f0108400 2024-09-21T06:34:53.077 INFO:teuthology.orchestra.run.smithi007.stdout:[client.0] 2024-09-21T06:34:53.077 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQANae5mSnNwBBAA/aUuNObWYFAWuGLfsDq+XQ== 2024-09-21T06:34:53.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:53.078+0000 7fa3f6055640 1 -- 172.21.15.7:0/742818257 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa3d80b6670 msgr2=0x7fa3d80b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:53.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:53.078+0000 7fa3f6055640 1 --2- 172.21.15.7:0/742818257 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa3d80b6670 0x7fa3d80b8b80 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa3e0031440 tx=0x7fa3e0009560 comp rx=0 tx=0).stop 2024-09-21T06:34:53.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:53.078+0000 7fa3f6055640 1 -- 172.21.15.7:0/742818257 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3f0108400 msgr2=0x7fa3f019aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:53.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:53.078+0000 7fa3f6055640 1 --2- 172.21.15.7:0/742818257 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3f0108400 0x7fa3f019aa90 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa3e400d750 tx=0x7fa3e400dc10 comp rx=0 tx=0).stop 2024-09-21T06:34:53.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:53.078+0000 7fa3f6055640 1 -- 172.21.15.7:0/742818257 shutdown_connections 2024-09-21T06:34:53.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:53.078+0000 7fa3f6055640 1 --2- 172.21.15.7:0/742818257 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa3d80b6670 0x7fa3d80b8b80 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:53.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:53.078+0000 7fa3f6055640 1 --2- 172.21.15.7:0/742818257 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3f0108d50 0x7fa3f019fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:53.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:53.078+0000 7fa3f6055640 1 --2- 172.21.15.7:0/742818257 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3f0108400 0x7fa3f019aa90 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:53.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:53.078+0000 7fa3f6055640 1 --2- 172.21.15.7:0/742818257 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa3f01031d0 0x7fa3f019a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:53.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:53.078+0000 7fa3f6055640 1 -- 172.21.15.7:0/742818257 >> 172.21.15.7:0/742818257 conn(0x7fa3f0079dc0 msgr2=0x7fa3f0101270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:53.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:53.078+0000 7fa3f6055640 1 -- 172.21.15.7:0/742818257 shutdown_connections 2024-09-21T06:34:53.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:53.078+0000 7fa3f6055640 1 -- 172.21.15.7:0/742818257 wait complete. 2024-09-21T06:34:53.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:53 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/742818257' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T06:34:53.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:53 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/742818257' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T06:34:53.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:53 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/742818257' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T06:34:53.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:53 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/742818257' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T06:34:53.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:53 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/742818257' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T06:34:53.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:53 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/742818257' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T06:34:53.979 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-21T06:34:53.979 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-21T06:34:53.979 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-21T06:34:54.020 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph config log 1 --format=json 2024-09-21T06:34:54.321 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:34:54.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:54 smithi144 ceph-mon[34653]: pgmap v280: 97 pgs: 97 active+clean; 638 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 3.7 KiB/s wr, 8 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-09-21T06:34:54.582 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:54 smithi007 ceph-mon[30983]: pgmap v280: 97 pgs: 97 active+clean; 638 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 3.7 KiB/s wr, 8 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-09-21T06:34:54.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:54 smithi018 ceph-mon[34477]: pgmap v280: 97 pgs: 97 active+clean; 638 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 3.7 KiB/s wr, 8 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-09-21T06:34:54.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:54.796+0000 7fd04c8b6640 1 -- 172.21.15.7:0/3394081490 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd048105290 msgr2=0x7fd04810d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:54.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:54.796+0000 7fd04c8b6640 1 --2- 172.21.15.7:0/3394081490 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd048105290 0x7fd04810d8d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fd030009900 tx=0x7fd03002a3f0 comp rx=0 tx=0).stop 2024-09-21T06:34:54.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:54.796+0000 7fd04c8b6640 1 -- 172.21.15.7:0/3394081490 shutdown_connections 2024-09-21T06:34:54.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:54.796+0000 7fd04c8b6640 1 --2- 172.21.15.7:0/3394081490 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd04810de10 0x7fd048110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:54.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:54.796+0000 7fd04c8b6640 1 --2- 172.21.15.7:0/3394081490 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd048105290 0x7fd04810d8d0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:54.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:54.796+0000 7fd04c8b6640 1 --2- 172.21.15.7:0/3394081490 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd048104860 0x7fd048104c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:54.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:54.796+0000 7fd04c8b6640 1 -- 172.21.15.7:0/3394081490 >> 172.21.15.7:0/3394081490 conn(0x7fd048079740 msgr2=0x7fd048079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:54.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:54.796+0000 7fd04c8b6640 1 -- 172.21.15.7:0/3394081490 shutdown_connections 2024-09-21T06:34:54.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:54.796+0000 7fd04c8b6640 1 -- 172.21.15.7:0/3394081490 wait complete. 2024-09-21T06:34:54.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:54.797+0000 7fd04c8b6640 1 Processor -- start 2024-09-21T06:34:54.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:54.797+0000 7fd04c8b6640 1 -- start start 2024-09-21T06:34:54.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:54.798+0000 7fd04c8b6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd048104860 0x7fd04819a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:54.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:54.798+0000 7fd04c8b6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd048105290 0x7fd04819aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:54.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:54.798+0000 7fd04c8b6640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd04810de10 0x7fd04819fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:54.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:54.798+0000 7fd04c8b6640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd048113a90 con 0x7fd048104860 2024-09-21T06:34:54.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:54.798+0000 7fd04c8b6640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd048113910 con 0x7fd048105290 2024-09-21T06:34:54.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:54.798+0000 7fd04c8b6640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd048113c10 con 0x7fd04810de10 2024-09-21T06:34:54.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:54.798+0000 7fd04659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd048104860 0x7fd04819a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:54.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:54.798+0000 7fd04659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd048104860 0x7fd04819a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48000/0 (socket says 172.21.15.7:48000) 2024-09-21T06:34:54.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:54.798+0000 7fd04659c640 1 -- 172.21.15.7:0/3308912564 learned_addr learned my addr 172.21.15.7:0/3308912564 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:34:54.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:54.798+0000 7fd03dd9b640 1 --2- 172.21.15.7:0/3308912564 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd048105290 0x7fd04819aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:54.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:54.798+0000 7fd046d9d640 1 --2- 172.21.15.7:0/3308912564 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd04810de10 0x7fd04819fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:54.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:54.798+0000 7fd04659c640 1 -- 172.21.15.7:0/3308912564 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd04810de10 msgr2=0x7fd04819fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:54.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:54.798+0000 7fd04659c640 1 --2- 172.21.15.7:0/3308912564 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd04810de10 0x7fd04819fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:54.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:54.798+0000 7fd04659c640 1 -- 172.21.15.7:0/3308912564 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd048105290 msgr2=0x7fd04819aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:54.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:54.798+0000 7fd04659c640 1 --2- 172.21.15.7:0/3308912564 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd048105290 0x7fd04819aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:54.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:54.798+0000 7fd04659c640 1 -- 172.21.15.7:0/3308912564 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0481a0330 con 0x7fd048104860 2024-09-21T06:34:54.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:54.798+0000 7fd04659c640 1 --2- 172.21.15.7:0/3308912564 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd048104860 0x7fd04819a480 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fd03800c970 tx=0x7fd03800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:54.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:54.799+0000 7fd03ffff640 1 -- 172.21.15.7:0/3308912564 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd038007c10 con 0x7fd048104860 2024-09-21T06:34:54.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:54.799+0000 7fd03ffff640 1 -- 172.21.15.7:0/3308912564 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd038007db0 con 0x7fd048104860 2024-09-21T06:34:54.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:54.799+0000 7fd04c8b6640 1 -- 172.21.15.7:0/3308912564 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0481a0620 con 0x7fd048104860 2024-09-21T06:34:54.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:54.799+0000 7fd03ffff640 1 -- 172.21.15.7:0/3308912564 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd03800f870 con 0x7fd048104860 2024-09-21T06:34:54.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:54.799+0000 7fd04c8b6640 1 -- 172.21.15.7:0/3308912564 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0481a6e40 con 0x7fd048104860 2024-09-21T06:34:54.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:54.800+0000 7fd04c8b6640 1 -- 172.21.15.7:0/3308912564 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd04806c1e0 con 0x7fd048104860 2024-09-21T06:34:54.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:54.801+0000 7fd03ffff640 1 -- 172.21.15.7:0/3308912564 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154579+0+0 (secure 0 0 0) 0x7fd03800fa10 con 0x7fd048104860 2024-09-21T06:34:54.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:54.802+0000 7fd03ffff640 1 --2- 172.21.15.7:0/3308912564 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fd0340b66a0 0x7fd0340b8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:54.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:54.802+0000 7fd03dd9b640 1 --2- 172.21.15.7:0/3308912564 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fd0340b66a0 0x7fd0340b8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:54.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:54.802+0000 7fd03ffff640 1 -- 172.21.15.7:0/3308912564 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fd0380e7a00 con 0x7fd048104860 2024-09-21T06:34:54.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:54.803+0000 7fd03dd9b640 1 --2- 172.21.15.7:0/3308912564 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fd0340b66a0 0x7fd0340b8bb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd030009230 tx=0x7fd030031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:54.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:54.805+0000 7fd03ffff640 1 -- 172.21.15.7:0/3308912564 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd0380ae1d0 con 0x7fd048104860 2024-09-21T06:34:54.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:54.993+0000 7fd04c8b6640 1 -- 172.21.15.7:0/3308912564 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7fd048104c70 con 0x7fd048104860 2024-09-21T06:34:54.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:54.994+0000 7fd03ffff640 1 -- 172.21.15.7:0/3308912564 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v55) ==== 86+0+133 (secure 0 0 0) 0x7fd0380b25b0 con 0x7fd048104860 2024-09-21T06:34:54.996 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:34:54.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:54.996+0000 7fd04c8b6640 1 -- 172.21.15.7:0/3308912564 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fd0340b66a0 msgr2=0x7fd0340b8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:54.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:54.996+0000 7fd04c8b6640 1 --2- 172.21.15.7:0/3308912564 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fd0340b66a0 0x7fd0340b8bb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd030009230 tx=0x7fd030031400 comp rx=0 tx=0).stop 2024-09-21T06:34:54.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:54.996+0000 7fd04c8b6640 1 -- 172.21.15.7:0/3308912564 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd048104860 msgr2=0x7fd04819a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:54.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:54.996+0000 7fd04c8b6640 1 --2- 172.21.15.7:0/3308912564 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd048104860 0x7fd04819a480 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fd03800c970 tx=0x7fd03800ce30 comp rx=0 tx=0).stop 2024-09-21T06:34:54.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:54.996+0000 7fd04c8b6640 1 -- 172.21.15.7:0/3308912564 shutdown_connections 2024-09-21T06:34:54.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:54.996+0000 7fd04c8b6640 1 --2- 172.21.15.7:0/3308912564 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fd0340b66a0 0x7fd0340b8bb0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:54.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:54.996+0000 7fd04c8b6640 1 --2- 172.21.15.7:0/3308912564 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd04810de10 0x7fd04819fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:54.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:54.996+0000 7fd04c8b6640 1 --2- 172.21.15.7:0/3308912564 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd048105290 0x7fd04819aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:54.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:54.996+0000 7fd04c8b6640 1 --2- 172.21.15.7:0/3308912564 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd048104860 0x7fd04819a480 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:54.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:54.996+0000 7fd04c8b6640 1 -- 172.21.15.7:0/3308912564 >> 172.21.15.7:0/3308912564 conn(0x7fd048079740 msgr2=0x7fd048100840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:54.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:54.996+0000 7fd04c8b6640 1 -- 172.21.15.7:0/3308912564 shutdown_connections 2024-09-21T06:34:54.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:54.996+0000 7fd04c8b6640 1 -- 172.21.15.7:0/3308912564 wait complete. 2024-09-21T06:34:55.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:55 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/3308912564' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T06:34:55.589 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:55 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/3308912564' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T06:34:55.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:55 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/3308912564' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T06:34:55.651 INFO:teuthology.orchestra.run.smithi007.stdout:[{"version":55,"timestamp":"2024-09-21T06:34:14.573619+0000","name":"","changes":[{"name":"mds.all/mds_join_fs","new_value":"all"}]}] 2024-09-21T06:34:55.651 INFO:tasks.ceph_manager:config epoch is 55 2024-09-21T06:34:55.651 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-21T06:34:55.651 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-21T06:34:55.651 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph mgr dump --format=json 2024-09-21T06:34:55.951 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:34:56.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:56 smithi007 ceph-mon[30983]: pgmap v281: 97 pgs: 97 active+clean; 638 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 3.4 KiB/s wr, 8 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-09-21T06:34:56.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:56.484+0000 7f9d684b6640 1 -- 172.21.15.7:0/2668928119 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d60102a60 msgr2=0x7f9d60102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:56.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:56.484+0000 7f9d684b6640 1 --2- 172.21.15.7:0/2668928119 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d60102a60 0x7f9d60102e70 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c009900 tx=0x7f9d5c02a410 comp rx=0 tx=0).stop 2024-09-21T06:34:56.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:56.484+0000 7f9d684b6640 1 -- 172.21.15.7:0/2668928119 shutdown_connections 2024-09-21T06:34:56.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:56.484+0000 7f9d684b6640 1 --2- 172.21.15.7:0/2668928119 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d60108cf0 0x7f9d6010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:56.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:56.484+0000 7f9d684b6640 1 --2- 172.21.15.7:0/2668928119 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d601083a0 0x7f9d601087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:56.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:56.484+0000 7f9d684b6640 1 --2- 172.21.15.7:0/2668928119 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d60102a60 0x7f9d60102e70 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:56.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:56.484+0000 7f9d684b6640 1 -- 172.21.15.7:0/2668928119 >> 172.21.15.7:0/2668928119 conn(0x7f9d60079730 msgr2=0x7f9d60079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:56.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:56.484+0000 7f9d684b6640 1 -- 172.21.15.7:0/2668928119 shutdown_connections 2024-09-21T06:34:56.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:56.484+0000 7f9d684b6640 1 -- 172.21.15.7:0/2668928119 wait complete. 2024-09-21T06:34:56.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:56.485+0000 7f9d684b6640 1 Processor -- start 2024-09-21T06:34:56.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:56.485+0000 7f9d684b6640 1 -- start start 2024-09-21T06:34:56.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:56.485+0000 7f9d684b6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d60102a60 0x7f9d6019c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:56.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:56.485+0000 7f9d684b6640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d601083a0 0x7f9d6019cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:56.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:56.485+0000 7f9d684b6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d60108cf0 0x7f9d601a1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:56.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:56.485+0000 7f9d684b6640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9d60112960 con 0x7f9d60102a60 2024-09-21T06:34:56.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:56.485+0000 7f9d684b6640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9d601127e0 con 0x7f9d60108cf0 2024-09-21T06:34:56.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:56.485+0000 7f9d684b6640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9d60112ae0 con 0x7f9d601083a0 2024-09-21T06:34:56.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:56.485+0000 7f9d66252640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d60102a60 0x7f9d6019c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:56.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:56.485+0000 7f9d66252640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d60102a60 0x7f9d6019c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48032/0 (socket says 172.21.15.7:48032) 2024-09-21T06:34:56.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:56.485+0000 7f9d66252640 1 -- 172.21.15.7:0/4162465738 learned_addr learned my addr 172.21.15.7:0/4162465738 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:34:56.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:56.486+0000 7f9d66252640 1 -- 172.21.15.7:0/4162465738 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d601083a0 msgr2=0x7f9d6019cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:56.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:56.486+0000 7f9d66252640 1 --2- 172.21.15.7:0/4162465738 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d601083a0 0x7f9d6019cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:56.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:56.486+0000 7f9d66252640 1 -- 172.21.15.7:0/4162465738 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d60108cf0 msgr2=0x7f9d601a1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:56.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:56.485+0000 7f9d66a53640 1 --2- 172.21.15.7:0/4162465738 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d60108cf0 0x7f9d601a1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:56.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:56.486+0000 7f9d66252640 1 --2- 172.21.15.7:0/4162465738 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d60108cf0 0x7f9d601a1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:56.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:56.486+0000 7f9d66252640 1 -- 172.21.15.7:0/4162465738 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d601a2620 con 0x7f9d60102a60 2024-09-21T06:34:56.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:56.486+0000 7f9d66a53640 1 --2- 172.21.15.7:0/4162465738 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d60108cf0 0x7f9d601a1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:34:56.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:56.486+0000 7f9d66252640 1 --2- 172.21.15.7:0/4162465738 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d60102a60 0x7f9d6019c6b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c005940 tx=0x7f9d5c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:56.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:56.486+0000 7f9d577fe640 1 -- 172.21.15.7:0/4162465738 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d5c03f030 con 0x7f9d60102a60 2024-09-21T06:34:56.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:56.486+0000 7f9d684b6640 1 -- 172.21.15.7:0/4162465738 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d601a28b0 con 0x7f9d60102a60 2024-09-21T06:34:56.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:56.486+0000 7f9d577fe640 1 -- 172.21.15.7:0/4162465738 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9d5c003cb0 con 0x7f9d60102a60 2024-09-21T06:34:56.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:56.486+0000 7f9d577fe640 1 -- 172.21.15.7:0/4162465738 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d5c035070 con 0x7f9d60102a60 2024-09-21T06:34:56.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:56.486+0000 7f9d684b6640 1 -- 172.21.15.7:0/4162465738 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d601a9070 con 0x7f9d60102a60 2024-09-21T06:34:56.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:56.487+0000 7f9d684b6640 1 -- 172.21.15.7:0/4162465738 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d60102e70 con 0x7f9d60102a60 2024-09-21T06:34:56.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:56.489+0000 7f9d577fe640 1 -- 172.21.15.7:0/4162465738 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154579+0+0 (secure 0 0 0) 0x7f9d5c042030 con 0x7f9d60102a60 2024-09-21T06:34:56.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:56.490+0000 7f9d577fe640 1 --2- 172.21.15.7:0/4162465738 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f9d4c0b65f0 0x7f9d4c0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:56.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:56.490+0000 7f9d65a51640 1 --2- 172.21.15.7:0/4162465738 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f9d4c0b65f0 0x7f9d4c0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:56.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:56.490+0000 7f9d577fe640 1 -- 172.21.15.7:0/4162465738 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f9d5c108140 con 0x7f9d60102a60 2024-09-21T06:34:56.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:56.490+0000 7f9d65a51640 1 --2- 172.21.15.7:0/4162465738 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f9d4c0b65f0 0x7f9d4c0b8b00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9d50005fd0 tx=0x7f9d50005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:56.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:56.494+0000 7f9d577fe640 1 -- 172.21.15.7:0/4162465738 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9d5c0ce7f0 con 0x7f9d60102a60 2024-09-21T06:34:56.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:56 smithi144 ceph-mon[34653]: pgmap v281: 97 pgs: 97 active+clean; 638 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 3.4 KiB/s wr, 8 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-09-21T06:34:56.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:56 smithi018 ceph-mon[34477]: pgmap v281: 97 pgs: 97 active+clean; 638 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 3.4 KiB/s wr, 8 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-09-21T06:34:56.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:56.734+0000 7f9d684b6640 1 -- 172.21.15.7:0/4162465738 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f9d601a9330 con 0x7f9d60102a60 2024-09-21T06:34:56.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:56.739+0000 7f9d577fe640 1 -- 172.21.15.7:0/4162465738 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v22) ==== 74+0+296443 (secure 0 0 0) 0x7f9d5c0d2bd0 con 0x7f9d60102a60 2024-09-21T06:34:56.745 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:34:56.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:56.743+0000 7f9d684b6640 1 -- 172.21.15.7:0/4162465738 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f9d4c0b65f0 msgr2=0x7f9d4c0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:56.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:56.743+0000 7f9d684b6640 1 --2- 172.21.15.7:0/4162465738 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f9d4c0b65f0 0x7f9d4c0b8b00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9d50005fd0 tx=0x7f9d50005850 comp rx=0 tx=0).stop 2024-09-21T06:34:56.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:56.743+0000 7f9d684b6640 1 -- 172.21.15.7:0/4162465738 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d60102a60 msgr2=0x7f9d6019c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:56.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:56.743+0000 7f9d684b6640 1 --2- 172.21.15.7:0/4162465738 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d60102a60 0x7f9d6019c6b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c005940 tx=0x7f9d5c0042f0 comp rx=0 tx=0).stop 2024-09-21T06:34:56.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:56.743+0000 7f9d684b6640 1 -- 172.21.15.7:0/4162465738 shutdown_connections 2024-09-21T06:34:56.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:56.743+0000 7f9d684b6640 1 --2- 172.21.15.7:0/4162465738 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f9d4c0b65f0 0x7f9d4c0b8b00 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:56.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:56.743+0000 7f9d684b6640 1 --2- 172.21.15.7:0/4162465738 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d60108cf0 0x7f9d601a1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:56.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:56.743+0000 7f9d684b6640 1 --2- 172.21.15.7:0/4162465738 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d601083a0 0x7f9d6019cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:56.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:56.743+0000 7f9d684b6640 1 --2- 172.21.15.7:0/4162465738 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d60102a60 0x7f9d6019c6b0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:56.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:56.743+0000 7f9d684b6640 1 -- 172.21.15.7:0/4162465738 >> 172.21.15.7:0/4162465738 conn(0x7f9d60079730 msgr2=0x7f9d6006af10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:56.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:56.743+0000 7f9d684b6640 1 -- 172.21.15.7:0/4162465738 shutdown_connections 2024-09-21T06:34:56.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:56.743+0000 7f9d684b6640 1 -- 172.21.15.7:0/4162465738 wait complete. 2024-09-21T06:34:57.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:57 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/4162465738' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T06:34:57.466 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":22,"flags":0,"active_gid":14223,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":3442812985},{"type":"v1","addr":"172.21.15.7:6801","nonce":3442812985}]},"active_addr":"172.21.15.7:6801/3442812985","active_change":"2024-09-21T06:27:43.044611+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":24142,"name":"z","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24155,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful","snap_schedule"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.7:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.7:0","nonce":4110781505}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.7:0","nonce":3308293059}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.7:0","nonce":136165045}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.7:0","nonce":2256955414}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.7:0","nonce":556998522}]}]} 2024-09-21T06:34:57.472 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-21T06:34:57.472 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-21T06:34:57.473 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T06:34:57.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:57 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/4162465738' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T06:34:57.735 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:34:57.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:57 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/4162465738' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T06:34:58.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:58.215+0000 7effbb029640 1 -- 172.21.15.7:0/2205247108 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effb41048c0 msgr2=0x7effb4104cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:58.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:58.215+0000 7effbb029640 1 --2- 172.21.15.7:0/2205247108 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effb41048c0 0x7effb4104cd0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7effb0009900 tx=0x7effb002a410 comp rx=0 tx=0).stop 2024-09-21T06:34:58.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:58.215+0000 7effbb029640 1 -- 172.21.15.7:0/2205247108 shutdown_connections 2024-09-21T06:34:58.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:58.215+0000 7effbb029640 1 --2- 172.21.15.7:0/2205247108 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7effb410de70 0x7effb4110340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:58.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:58.215+0000 7effbb029640 1 --2- 172.21.15.7:0/2205247108 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7effb41052a0 0x7effb410d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:58.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:58.215+0000 7effbb029640 1 --2- 172.21.15.7:0/2205247108 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effb41048c0 0x7effb4104cd0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:58.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:58.215+0000 7effbb029640 1 -- 172.21.15.7:0/2205247108 >> 172.21.15.7:0/2205247108 conn(0x7effb4079760 msgr2=0x7effb4079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:58.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:58.215+0000 7effbb029640 1 -- 172.21.15.7:0/2205247108 shutdown_connections 2024-09-21T06:34:58.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:58.215+0000 7effbb029640 1 -- 172.21.15.7:0/2205247108 wait complete. 2024-09-21T06:34:58.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:58.215+0000 7effbb029640 1 Processor -- start 2024-09-21T06:34:58.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:58.215+0000 7effbb029640 1 -- start start 2024-09-21T06:34:58.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:58.216+0000 7effbb029640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7effb41048c0 0x7effb419a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:58.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:58.216+0000 7effbb029640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7effb41052a0 0x7effb419aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:58.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:58.216+0000 7effbb029640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effb410de70 0x7effb419fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:58.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:58.216+0000 7effbb029640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7effb4113ad0 con 0x7effb410de70 2024-09-21T06:34:58.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:58.216+0000 7effbb029640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7effb4113950 con 0x7effb41052a0 2024-09-21T06:34:58.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:58.216+0000 7effbb029640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7effb4113c50 con 0x7effb41048c0 2024-09-21T06:34:58.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:58.216+0000 7effb95c6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effb410de70 0x7effb419fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:58.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:58.216+0000 7effb95c6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effb410de70 0x7effb419fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48042/0 (socket says 172.21.15.7:48042) 2024-09-21T06:34:58.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:58.216+0000 7effb95c6640 1 -- 172.21.15.7:0/456690754 learned_addr learned my addr 172.21.15.7:0/456690754 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:34:58.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:58.216+0000 7effb8dc5640 1 --2- 172.21.15.7:0/456690754 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7effb41048c0 0x7effb419a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:58.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:58.216+0000 7effabfff640 1 --2- 172.21.15.7:0/456690754 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7effb41052a0 0x7effb419aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:58.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:58.216+0000 7effb95c6640 1 -- 172.21.15.7:0/456690754 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7effb41048c0 msgr2=0x7effb419a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:58.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:58.216+0000 7effb95c6640 1 --2- 172.21.15.7:0/456690754 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7effb41048c0 0x7effb419a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:58.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:58.216+0000 7effb95c6640 1 -- 172.21.15.7:0/456690754 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7effb41052a0 msgr2=0x7effb419aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:58.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:58.216+0000 7effb95c6640 1 --2- 172.21.15.7:0/456690754 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7effb41052a0 0x7effb419aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:58.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:58.216+0000 7effb95c6640 1 -- 172.21.15.7:0/456690754 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effb41a0450 con 0x7effb410de70 2024-09-21T06:34:58.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:58.216+0000 7effabfff640 1 --2- 172.21.15.7:0/456690754 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7effb41052a0 0x7effb419aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:34:58.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:58.216+0000 7effb95c6640 1 --2- 172.21.15.7:0/456690754 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effb410de70 0x7effb419fd20 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7effac00eaa0 tx=0x7effac00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:58.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:58.216+0000 7effa9ffb640 1 -- 172.21.15.7:0/456690754 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effac00cdb0 con 0x7effb410de70 2024-09-21T06:34:58.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:58.217+0000 7effbb029640 1 -- 172.21.15.7:0/456690754 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effb41a0740 con 0x7effb410de70 2024-09-21T06:34:58.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:58.217+0000 7effa9ffb640 1 -- 172.21.15.7:0/456690754 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7effac005020 con 0x7effb410de70 2024-09-21T06:34:58.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:58.217+0000 7effa9ffb640 1 -- 172.21.15.7:0/456690754 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effac0116d0 con 0x7effb410de70 2024-09-21T06:34:58.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:58.217+0000 7effbb029640 1 -- 172.21.15.7:0/456690754 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effb41a6ea0 con 0x7effb410de70 2024-09-21T06:34:58.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:58.218+0000 7effbb029640 1 -- 172.21.15.7:0/456690754 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effb406c190 con 0x7effb410de70 2024-09-21T06:34:58.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:58.219+0000 7effa9ffb640 1 -- 172.21.15.7:0/456690754 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154579+0+0 (secure 0 0 0) 0x7effac0054a0 con 0x7effb410de70 2024-09-21T06:34:58.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:58.220+0000 7effa9ffb640 1 --2- 172.21.15.7:0/456690754 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7eff9c0b65f0 0x7eff9c0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:34:58.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:58.220+0000 7effb8dc5640 1 --2- 172.21.15.7:0/456690754 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7eff9c0b65f0 0x7eff9c0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:34:58.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:58.220+0000 7effa9ffb640 1 -- 172.21.15.7:0/456690754 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7effac0e77c0 con 0x7effb410de70 2024-09-21T06:34:58.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:58.220+0000 7effb8dc5640 1 --2- 172.21.15.7:0/456690754 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7eff9c0b65f0 0x7eff9c0b8b00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7effb0000c00 tx=0x7effb0031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:34:58.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:58.225+0000 7effa9ffb640 1 -- 172.21.15.7:0/456690754 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7effac016030 con 0x7effb410de70 2024-09-21T06:34:58.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:58.415+0000 7effbb029640 1 -- 172.21.15.7:0/456690754 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7effb419b610 con 0x7effb410de70 2024-09-21T06:34:58.418 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:58 smithi007 ceph-mon[30983]: pgmap v282: 97 pgs: 97 active+clean; 638 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 3.1 KiB/s wr, 7 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-21T06:34:58.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:58.417+0000 7effa9ffb640 1 -- 172.21.15.7:0/456690754 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+22791 (secure 0 0 0) 0x7effac0ade30 con 0x7effb410de70 2024-09-21T06:34:58.419 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:34:58.419 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":77,"fsid":"347cb918-77e2-11ef-baf5-efdc52797490","created":"2024-09-21T06:25:51.925032+0000","modified":"2024-09-21T06:34:44.220989+0000","last_up_change":"2024-09-21T06:33:32.888843+0000","last_in_change":"2024-09-21T06:33:09.926778+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:29:41.514179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:34:20.531755+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T06:34:22.552541+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1be5c4a4-3931-4d8b-95c7-c05f5b73fcfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":942632794},{"type":"v1","addr":"172.21.15.7:6803","nonce":942632794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":942632794},{"type":"v1","addr":"172.21.15.7:6805","nonce":942632794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":942632794},{"type":"v1","addr":"172.21.15.7:6809","nonce":942632794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":942632794},{"type":"v1","addr":"172.21.15.7:6807","nonce":942632794}]},"public_addr":"172.21.15.7:6803/942632794","cluster_addr":"172.21.15.7:6805/942632794","heartbeat_back_addr":"172.21.15.7:6809/942632794","heartbeat_front_addr":"172.21.15.7:6807/942632794","state":["exists","up"]},{"osd":1,"uuid":"7ae136a8-c614-47e5-b265-c6cfa857a7fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1839342931},{"type":"v1","addr":"172.21.15.18:6801","nonce":1839342931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1839342931},{"type":"v1","addr":"172.21.15.18:6803","nonce":1839342931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1839342931},{"type":"v1","addr":"172.21.15.18:6807","nonce":1839342931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1839342931},{"type":"v1","addr":"172.21.15.18:6805","nonce":1839342931}]},"public_addr":"172.21.15.18:6801/1839342931","cluster_addr":"172.21.15.18:6803/1839342931","heartbeat_back_addr":"172.21.15.18:6807/1839342931","heartbeat_front_addr":"172.21.15.18:6805/1839342931","state":["exists","up"]},{"osd":2,"uuid":"97b13994-4680-4573-9c2e-ac65ea740e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":1699582162},{"type":"v1","addr":"172.21.15.144:6801","nonce":1699582162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":1699582162},{"type":"v1","addr":"172.21.15.144:6803","nonce":1699582162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":1699582162},{"type":"v1","addr":"172.21.15.144:6807","nonce":1699582162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":1699582162},{"type":"v1","addr":"172.21.15.144:6805","nonce":1699582162}]},"public_addr":"172.21.15.144:6801/1699582162","cluster_addr":"172.21.15.144:6803/1699582162","heartbeat_back_addr":"172.21.15.144:6807/1699582162","heartbeat_front_addr":"172.21.15.144:6805/1699582162","state":["exists","up"]},{"osd":3,"uuid":"ddf70d51-404d-491d-a6a8-15fca4ef01db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":3202935163},{"type":"v1","addr":"172.21.15.7:6811","nonce":3202935163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":3202935163},{"type":"v1","addr":"172.21.15.7:6813","nonce":3202935163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":3202935163},{"type":"v1","addr":"172.21.15.7:6817","nonce":3202935163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":3202935163},{"type":"v1","addr":"172.21.15.7:6815","nonce":3202935163}]},"public_addr":"172.21.15.7:6811/3202935163","cluster_addr":"172.21.15.7:6813/3202935163","heartbeat_back_addr":"172.21.15.7:6817/3202935163","heartbeat_front_addr":"172.21.15.7:6815/3202935163","state":["exists","up"]},{"osd":4,"uuid":"f2ae4340-accf-4ac0-a4d3-c08302712ce1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1058105724},{"type":"v1","addr":"172.21.15.18:6809","nonce":1058105724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":1058105724},{"type":"v1","addr":"172.21.15.18:6811","nonce":1058105724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":1058105724},{"type":"v1","addr":"172.21.15.18:6815","nonce":1058105724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":1058105724},{"type":"v1","addr":"172.21.15.18:6813","nonce":1058105724}]},"public_addr":"172.21.15.18:6809/1058105724","cluster_addr":"172.21.15.18:6811/1058105724","heartbeat_back_addr":"172.21.15.18:6815/1058105724","heartbeat_front_addr":"172.21.15.18:6813/1058105724","state":["exists","up"]},{"osd":5,"uuid":"d56abc37-de6f-47a4-9f5e-67224da78f4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":2814586621},{"type":"v1","addr":"172.21.15.144:6809","nonce":2814586621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":2814586621},{"type":"v1","addr":"172.21.15.144:6811","nonce":2814586621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":2814586621},{"type":"v1","addr":"172.21.15.144:6815","nonce":2814586621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":2814586621},{"type":"v1","addr":"172.21.15.144:6813","nonce":2814586621}]},"public_addr":"172.21.15.144:6809/2814586621","cluster_addr":"172.21.15.144:6811/2814586621","heartbeat_back_addr":"172.21.15.144:6815/2814586621","heartbeat_front_addr":"172.21.15.144:6813/2814586621","state":["exists","up"]},{"osd":6,"uuid":"9145650c-e9b1-4e5a-ae6f-17c8960146e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":3770978305},{"type":"v1","addr":"172.21.15.7:6819","nonce":3770978305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":3770978305},{"type":"v1","addr":"172.21.15.7:6821","nonce":3770978305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3770978305},{"type":"v1","addr":"172.21.15.7:6825","nonce":3770978305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":3770978305},{"type":"v1","addr":"172.21.15.7:6823","nonce":3770978305}]},"public_addr":"172.21.15.7:6819/3770978305","cluster_addr":"172.21.15.7:6821/3770978305","heartbeat_back_addr":"172.21.15.7:6825/3770978305","heartbeat_front_addr":"172.21.15.7:6823/3770978305","state":["exists","up"]},{"osd":7,"uuid":"ca658683-38f7-47ca-b32e-512fe4738ef1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":1322408496},{"type":"v1","addr":"172.21.15.18:6817","nonce":1322408496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1322408496},{"type":"v1","addr":"172.21.15.18:6819","nonce":1322408496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1322408496},{"type":"v1","addr":"172.21.15.18:6823","nonce":1322408496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1322408496},{"type":"v1","addr":"172.21.15.18:6821","nonce":1322408496}]},"public_addr":"172.21.15.18:6817/1322408496","cluster_addr":"172.21.15.18:6819/1322408496","heartbeat_back_addr":"172.21.15.18:6823/1322408496","heartbeat_front_addr":"172.21.15.18:6821/1322408496","state":["exists","up"]},{"osd":8,"uuid":"40d1f37e-6fac-40b9-9319-78f4fc3a6f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1011657022},{"type":"v1","addr":"172.21.15.144:6817","nonce":1011657022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1011657022},{"type":"v1","addr":"172.21.15.144:6819","nonce":1011657022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1011657022},{"type":"v1","addr":"172.21.15.144:6823","nonce":1011657022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":1011657022},{"type":"v1","addr":"172.21.15.144:6821","nonce":1011657022}]},"public_addr":"172.21.15.144:6817/1011657022","cluster_addr":"172.21.15.144:6819/1011657022","heartbeat_back_addr":"172.21.15.144:6823/1011657022","heartbeat_front_addr":"172.21.15.144:6821/1011657022","state":["exists","up"]},{"osd":9,"uuid":"ad12d6f7-fd21-49bd-a343-744f3cff4bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":256146339},{"type":"v1","addr":"172.21.15.7:6827","nonce":256146339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":256146339},{"type":"v1","addr":"172.21.15.7:6829","nonce":256146339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":256146339},{"type":"v1","addr":"172.21.15.7:6833","nonce":256146339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":256146339},{"type":"v1","addr":"172.21.15.7:6831","nonce":256146339}]},"public_addr":"172.21.15.7:6827/256146339","cluster_addr":"172.21.15.7:6829/256146339","heartbeat_back_addr":"172.21.15.7:6833/256146339","heartbeat_front_addr":"172.21.15.7:6831/256146339","state":["exists","up"]},{"osd":10,"uuid":"1317a2ad-ec15-4096-b2da-689475b7cacc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":2038885362},{"type":"v1","addr":"172.21.15.18:6825","nonce":2038885362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2038885362},{"type":"v1","addr":"172.21.15.18:6827","nonce":2038885362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2038885362},{"type":"v1","addr":"172.21.15.18:6831","nonce":2038885362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2038885362},{"type":"v1","addr":"172.21.15.18:6829","nonce":2038885362}]},"public_addr":"172.21.15.18:6825/2038885362","cluster_addr":"172.21.15.18:6827/2038885362","heartbeat_back_addr":"172.21.15.18:6831/2038885362","heartbeat_front_addr":"172.21.15.18:6829/2038885362","state":["exists","up"]},{"osd":11,"uuid":"f9252acb-7290-4923-89f3-844c868d4b39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":1047060848},{"type":"v1","addr":"172.21.15.144:6825","nonce":1047060848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":1047060848},{"type":"v1","addr":"172.21.15.144:6827","nonce":1047060848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":1047060848},{"type":"v1","addr":"172.21.15.144:6831","nonce":1047060848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":1047060848},{"type":"v1","addr":"172.21.15.144:6829","nonce":1047060848}]},"public_addr":"172.21.15.144:6825/1047060848","cluster_addr":"172.21.15.144:6827/1047060848","heartbeat_back_addr":"172.21.15.144:6831/1047060848","heartbeat_front_addr":"172.21.15.144:6829/1047060848","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:28:48.842729+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:29:13.946624+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:29:38.589666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:30:05.116339+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:30:30.562090+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:30:55.586210+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:31:22.138457+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:31:49.178090+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:32:13.687830+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:32:40.408193+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:33:06.044578+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:33:30.988851+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/1296137341":"2024-09-22T06:27:43.044484+0000","172.21.15.7:6801/3879502931":"2024-09-22T06:27:43.044484+0000","172.21.15.7:0/1926706877":"2024-09-22T06:26:40.520265+0000","172.21.15.7:0/2034370456":"2024-09-22T06:26:14.181426+0000","172.21.15.7:6801/3339522713":"2024-09-22T06:26:14.181426+0000","172.21.15.7:6800/3339522713":"2024-09-22T06:26:14.181426+0000","172.21.15.7:0/3586807770":"2024-09-22T06:26:14.181426+0000","172.21.15.7:0/1814223919":"2024-09-22T06:27:43.044484+0000","172.21.15.7:0/601150037":"2024-09-22T06:26:40.520265+0000","172.21.15.7:6800/3876787626":"2024-09-22T06:26:40.520265+0000","172.21.15.7:0/186444636":"2024-09-22T06:26:14.181426+0000","172.21.15.7:0/2180184348":"2024-09-22T06:26:40.520265+0000","172.21.15.7:6801/3876787626":"2024-09-22T06:26:40.520265+0000","172.21.15.7:0/2931793461":"2024-09-22T06:27:43.044484+0000","172.21.15.7:6800/3879502931":"2024-09-22T06:27:43.044484+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:34:58.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:58.419+0000 7effbb029640 1 -- 172.21.15.7:0/456690754 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7eff9c0b65f0 msgr2=0x7eff9c0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:58.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:58.419+0000 7effbb029640 1 --2- 172.21.15.7:0/456690754 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7eff9c0b65f0 0x7eff9c0b8b00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7effb0000c00 tx=0x7effb0031400 comp rx=0 tx=0).stop 2024-09-21T06:34:58.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:58.419+0000 7effbb029640 1 -- 172.21.15.7:0/456690754 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effb410de70 msgr2=0x7effb419fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:34:58.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:58.419+0000 7effbb029640 1 --2- 172.21.15.7:0/456690754 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effb410de70 0x7effb419fd20 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7effac00eaa0 tx=0x7effac00ef60 comp rx=0 tx=0).stop 2024-09-21T06:34:58.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:58.419+0000 7effbb029640 1 -- 172.21.15.7:0/456690754 shutdown_connections 2024-09-21T06:34:58.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:58.419+0000 7effbb029640 1 --2- 172.21.15.7:0/456690754 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7eff9c0b65f0 0x7eff9c0b8b00 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:58.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:58.419+0000 7effbb029640 1 --2- 172.21.15.7:0/456690754 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effb410de70 0x7effb419fd20 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:58.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:58.419+0000 7effbb029640 1 --2- 172.21.15.7:0/456690754 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7effb41052a0 0x7effb419aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:58.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:58.419+0000 7effbb029640 1 --2- 172.21.15.7:0/456690754 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7effb41048c0 0x7effb419a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:34:58.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:58.419+0000 7effbb029640 1 -- 172.21.15.7:0/456690754 >> 172.21.15.7:0/456690754 conn(0x7effb4079760 msgr2=0x7effb4100890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:34:58.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:58.420+0000 7effbb029640 1 -- 172.21.15.7:0/456690754 shutdown_connections 2024-09-21T06:34:58.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:34:58.420+0000 7effbb029640 1 -- 172.21.15.7:0/456690754 wait complete. 2024-09-21T06:34:58.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:58 smithi018 ceph-mon[34477]: pgmap v282: 97 pgs: 97 active+clean; 638 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 3.1 KiB/s wr, 7 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-21T06:34:58.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:58 smithi144 ceph-mon[34653]: pgmap v282: 97 pgs: 97 active+clean; 638 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 3.1 KiB/s wr, 7 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-21T06:34:59.224 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-21T06:34:59.224 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T06:34:59.486 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:34:59.589 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:34:59 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/456690754' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:34:59.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:34:59 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/456690754' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:34:59.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:34:59 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/456690754' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:35:00.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:00.002+0000 7f3027c45640 1 -- 172.21.15.7:0/1492011882 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3020102a80 msgr2=0x7f3020102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:00.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:00.002+0000 7f3027c45640 1 --2- 172.21.15.7:0/1492011882 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3020102a80 0x7f3020102e90 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f301c009900 tx=0x7f301c02a410 comp rx=0 tx=0).stop 2024-09-21T06:35:00.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:00.002+0000 7f3027c45640 1 -- 172.21.15.7:0/1492011882 shutdown_connections 2024-09-21T06:35:00.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:00.002+0000 7f3027c45640 1 --2- 172.21.15.7:0/1492011882 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3020108d10 0x7f302010f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:00.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:00.002+0000 7f3027c45640 1 --2- 172.21.15.7:0/1492011882 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30201083c0 0x7f30201087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:00.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:00.002+0000 7f3027c45640 1 --2- 172.21.15.7:0/1492011882 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3020102a80 0x7f3020102e90 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:00.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:00.002+0000 7f3027c45640 1 -- 172.21.15.7:0/1492011882 >> 172.21.15.7:0/1492011882 conn(0x7f3020079740 msgr2=0x7f3020079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:00.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:00.002+0000 7f3027c45640 1 -- 172.21.15.7:0/1492011882 shutdown_connections 2024-09-21T06:35:00.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:00.002+0000 7f3027c45640 1 -- 172.21.15.7:0/1492011882 wait complete. 2024-09-21T06:35:00.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:00.002+0000 7f3027c45640 1 Processor -- start 2024-09-21T06:35:00.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:00.003+0000 7f3027c45640 1 -- start start 2024-09-21T06:35:00.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:00.003+0000 7f3027c45640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3020102a80 0x7f302019a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:00.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:00.003+0000 7f3027c45640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30201083c0 0x7f302019aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:00.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:00.003+0000 7f3027c45640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3020108d10 0x7f302019fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:00.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:00.003+0000 7f3027c45640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3020112a30 con 0x7f3020102a80 2024-09-21T06:35:00.006 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:00.003+0000 7f3027c45640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f30201128b0 con 0x7f3020108d10 2024-09-21T06:35:00.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:00.003+0000 7f3027c45640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3020112bb0 con 0x7f30201083c0 2024-09-21T06:35:00.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:00.003+0000 7f30259e1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3020102a80 0x7f302019a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:00.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:00.003+0000 7f30259e1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3020102a80 0x7f302019a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48048/0 (socket says 172.21.15.7:48048) 2024-09-21T06:35:00.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:00.003+0000 7f30259e1640 1 -- 172.21.15.7:0/3329913765 learned_addr learned my addr 172.21.15.7:0/3329913765 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:35:00.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:00.003+0000 7f30251e0640 1 --2- 172.21.15.7:0/3329913765 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30201083c0 0x7f302019aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:00.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:00.003+0000 7f30261e2640 1 --2- 172.21.15.7:0/3329913765 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3020108d10 0x7f302019fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:00.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:00.003+0000 7f30259e1640 1 -- 172.21.15.7:0/3329913765 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30201083c0 msgr2=0x7f302019aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:00.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:00.003+0000 7f30259e1640 1 --2- 172.21.15.7:0/3329913765 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30201083c0 0x7f302019aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:00.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:00.003+0000 7f30259e1640 1 -- 172.21.15.7:0/3329913765 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3020108d10 msgr2=0x7f302019fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:00.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:00.003+0000 7f30259e1640 1 --2- 172.21.15.7:0/3329913765 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3020108d10 0x7f302019fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:00.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:00.003+0000 7f30259e1640 1 -- 172.21.15.7:0/3329913765 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30201a0460 con 0x7f3020102a80 2024-09-21T06:35:00.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:00.004+0000 7f30259e1640 1 --2- 172.21.15.7:0/3329913765 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3020102a80 0x7f302019a4f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f301c005ab0 tx=0x7f301c003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:00.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:00.004+0000 7f3016ffd640 1 -- 172.21.15.7:0/3329913765 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f301c03f070 con 0x7f3020102a80 2024-09-21T06:35:00.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:00.004+0000 7f3016ffd640 1 -- 172.21.15.7:0/3329913765 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f301c031d60 con 0x7f3020102a80 2024-09-21T06:35:00.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:00.004+0000 7f3027c45640 1 -- 172.21.15.7:0/3329913765 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30201a06f0 con 0x7f3020102a80 2024-09-21T06:35:00.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:00.004+0000 7f3016ffd640 1 -- 172.21.15.7:0/3329913765 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f301c035030 con 0x7f3020102a80 2024-09-21T06:35:00.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:00.004+0000 7f3027c45640 1 -- 172.21.15.7:0/3329913765 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30201a6eb0 con 0x7f3020102a80 2024-09-21T06:35:00.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:00.005+0000 7f3027c45640 1 -- 172.21.15.7:0/3329913765 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3020103d00 con 0x7f3020102a80 2024-09-21T06:35:00.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:00.007+0000 7f3016ffd640 1 -- 172.21.15.7:0/3329913765 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154579+0+0 (secure 0 0 0) 0x7f301c042070 con 0x7f3020102a80 2024-09-21T06:35:00.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:00.007+0000 7f3016ffd640 1 --2- 172.21.15.7:0/3329913765 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f300c0b65f0 0x7f300c0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:00.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:00.008+0000 7f30251e0640 1 --2- 172.21.15.7:0/3329913765 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f300c0b65f0 0x7f300c0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:00.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:00.008+0000 7f3016ffd640 1 -- 172.21.15.7:0/3329913765 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f301c1083e0 con 0x7f3020102a80 2024-09-21T06:35:00.010 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:00.008+0000 7f30251e0640 1 --2- 172.21.15.7:0/3329913765 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f300c0b65f0 0x7f300c0b8b00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3020100ce0 tx=0x7f3010009110 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:00.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:00.011+0000 7f3016ffd640 1 -- 172.21.15.7:0/3329913765 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f301c0cea90 con 0x7f3020102a80 2024-09-21T06:35:00.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:00.198+0000 7f3027c45640 1 -- 172.21.15.7:0/3329913765 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f30201a70b0 con 0x7f3020102a80 2024-09-21T06:35:00.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:00.200+0000 7f3016ffd640 1 -- 172.21.15.7:0/3329913765 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+22791 (secure 0 0 0) 0x7f301c0d2e70 con 0x7f3020102a80 2024-09-21T06:35:00.202 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:35:00.202 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":77,"fsid":"347cb918-77e2-11ef-baf5-efdc52797490","created":"2024-09-21T06:25:51.925032+0000","modified":"2024-09-21T06:34:44.220989+0000","last_up_change":"2024-09-21T06:33:32.888843+0000","last_in_change":"2024-09-21T06:33:09.926778+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:29:41.514179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:34:20.531755+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T06:34:22.552541+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1be5c4a4-3931-4d8b-95c7-c05f5b73fcfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":942632794},{"type":"v1","addr":"172.21.15.7:6803","nonce":942632794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":942632794},{"type":"v1","addr":"172.21.15.7:6805","nonce":942632794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":942632794},{"type":"v1","addr":"172.21.15.7:6809","nonce":942632794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":942632794},{"type":"v1","addr":"172.21.15.7:6807","nonce":942632794}]},"public_addr":"172.21.15.7:6803/942632794","cluster_addr":"172.21.15.7:6805/942632794","heartbeat_back_addr":"172.21.15.7:6809/942632794","heartbeat_front_addr":"172.21.15.7:6807/942632794","state":["exists","up"]},{"osd":1,"uuid":"7ae136a8-c614-47e5-b265-c6cfa857a7fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1839342931},{"type":"v1","addr":"172.21.15.18:6801","nonce":1839342931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1839342931},{"type":"v1","addr":"172.21.15.18:6803","nonce":1839342931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1839342931},{"type":"v1","addr":"172.21.15.18:6807","nonce":1839342931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1839342931},{"type":"v1","addr":"172.21.15.18:6805","nonce":1839342931}]},"public_addr":"172.21.15.18:6801/1839342931","cluster_addr":"172.21.15.18:6803/1839342931","heartbeat_back_addr":"172.21.15.18:6807/1839342931","heartbeat_front_addr":"172.21.15.18:6805/1839342931","state":["exists","up"]},{"osd":2,"uuid":"97b13994-4680-4573-9c2e-ac65ea740e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":1699582162},{"type":"v1","addr":"172.21.15.144:6801","nonce":1699582162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":1699582162},{"type":"v1","addr":"172.21.15.144:6803","nonce":1699582162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":1699582162},{"type":"v1","addr":"172.21.15.144:6807","nonce":1699582162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":1699582162},{"type":"v1","addr":"172.21.15.144:6805","nonce":1699582162}]},"public_addr":"172.21.15.144:6801/1699582162","cluster_addr":"172.21.15.144:6803/1699582162","heartbeat_back_addr":"172.21.15.144:6807/1699582162","heartbeat_front_addr":"172.21.15.144:6805/1699582162","state":["exists","up"]},{"osd":3,"uuid":"ddf70d51-404d-491d-a6a8-15fca4ef01db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":3202935163},{"type":"v1","addr":"172.21.15.7:6811","nonce":3202935163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":3202935163},{"type":"v1","addr":"172.21.15.7:6813","nonce":3202935163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":3202935163},{"type":"v1","addr":"172.21.15.7:6817","nonce":3202935163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":3202935163},{"type":"v1","addr":"172.21.15.7:6815","nonce":3202935163}]},"public_addr":"172.21.15.7:6811/3202935163","cluster_addr":"172.21.15.7:6813/3202935163","heartbeat_back_addr":"172.21.15.7:6817/3202935163","heartbeat_front_addr":"172.21.15.7:6815/3202935163","state":["exists","up"]},{"osd":4,"uuid":"f2ae4340-accf-4ac0-a4d3-c08302712ce1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1058105724},{"type":"v1","addr":"172.21.15.18:6809","nonce":1058105724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":1058105724},{"type":"v1","addr":"172.21.15.18:6811","nonce":1058105724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":1058105724},{"type":"v1","addr":"172.21.15.18:6815","nonce":1058105724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":1058105724},{"type":"v1","addr":"172.21.15.18:6813","nonce":1058105724}]},"public_addr":"172.21.15.18:6809/1058105724","cluster_addr":"172.21.15.18:6811/1058105724","heartbeat_back_addr":"172.21.15.18:6815/1058105724","heartbeat_front_addr":"172.21.15.18:6813/1058105724","state":["exists","up"]},{"osd":5,"uuid":"d56abc37-de6f-47a4-9f5e-67224da78f4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":2814586621},{"type":"v1","addr":"172.21.15.144:6809","nonce":2814586621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":2814586621},{"type":"v1","addr":"172.21.15.144:6811","nonce":2814586621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":2814586621},{"type":"v1","addr":"172.21.15.144:6815","nonce":2814586621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":2814586621},{"type":"v1","addr":"172.21.15.144:6813","nonce":2814586621}]},"public_addr":"172.21.15.144:6809/2814586621","cluster_addr":"172.21.15.144:6811/2814586621","heartbeat_back_addr":"172.21.15.144:6815/2814586621","heartbeat_front_addr":"172.21.15.144:6813/2814586621","state":["exists","up"]},{"osd":6,"uuid":"9145650c-e9b1-4e5a-ae6f-17c8960146e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":3770978305},{"type":"v1","addr":"172.21.15.7:6819","nonce":3770978305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":3770978305},{"type":"v1","addr":"172.21.15.7:6821","nonce":3770978305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3770978305},{"type":"v1","addr":"172.21.15.7:6825","nonce":3770978305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":3770978305},{"type":"v1","addr":"172.21.15.7:6823","nonce":3770978305}]},"public_addr":"172.21.15.7:6819/3770978305","cluster_addr":"172.21.15.7:6821/3770978305","heartbeat_back_addr":"172.21.15.7:6825/3770978305","heartbeat_front_addr":"172.21.15.7:6823/3770978305","state":["exists","up"]},{"osd":7,"uuid":"ca658683-38f7-47ca-b32e-512fe4738ef1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":1322408496},{"type":"v1","addr":"172.21.15.18:6817","nonce":1322408496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1322408496},{"type":"v1","addr":"172.21.15.18:6819","nonce":1322408496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1322408496},{"type":"v1","addr":"172.21.15.18:6823","nonce":1322408496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1322408496},{"type":"v1","addr":"172.21.15.18:6821","nonce":1322408496}]},"public_addr":"172.21.15.18:6817/1322408496","cluster_addr":"172.21.15.18:6819/1322408496","heartbeat_back_addr":"172.21.15.18:6823/1322408496","heartbeat_front_addr":"172.21.15.18:6821/1322408496","state":["exists","up"]},{"osd":8,"uuid":"40d1f37e-6fac-40b9-9319-78f4fc3a6f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1011657022},{"type":"v1","addr":"172.21.15.144:6817","nonce":1011657022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1011657022},{"type":"v1","addr":"172.21.15.144:6819","nonce":1011657022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1011657022},{"type":"v1","addr":"172.21.15.144:6823","nonce":1011657022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":1011657022},{"type":"v1","addr":"172.21.15.144:6821","nonce":1011657022}]},"public_addr":"172.21.15.144:6817/1011657022","cluster_addr":"172.21.15.144:6819/1011657022","heartbeat_back_addr":"172.21.15.144:6823/1011657022","heartbeat_front_addr":"172.21.15.144:6821/1011657022","state":["exists","up"]},{"osd":9,"uuid":"ad12d6f7-fd21-49bd-a343-744f3cff4bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":256146339},{"type":"v1","addr":"172.21.15.7:6827","nonce":256146339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":256146339},{"type":"v1","addr":"172.21.15.7:6829","nonce":256146339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":256146339},{"type":"v1","addr":"172.21.15.7:6833","nonce":256146339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":256146339},{"type":"v1","addr":"172.21.15.7:6831","nonce":256146339}]},"public_addr":"172.21.15.7:6827/256146339","cluster_addr":"172.21.15.7:6829/256146339","heartbeat_back_addr":"172.21.15.7:6833/256146339","heartbeat_front_addr":"172.21.15.7:6831/256146339","state":["exists","up"]},{"osd":10,"uuid":"1317a2ad-ec15-4096-b2da-689475b7cacc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":2038885362},{"type":"v1","addr":"172.21.15.18:6825","nonce":2038885362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2038885362},{"type":"v1","addr":"172.21.15.18:6827","nonce":2038885362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2038885362},{"type":"v1","addr":"172.21.15.18:6831","nonce":2038885362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2038885362},{"type":"v1","addr":"172.21.15.18:6829","nonce":2038885362}]},"public_addr":"172.21.15.18:6825/2038885362","cluster_addr":"172.21.15.18:6827/2038885362","heartbeat_back_addr":"172.21.15.18:6831/2038885362","heartbeat_front_addr":"172.21.15.18:6829/2038885362","state":["exists","up"]},{"osd":11,"uuid":"f9252acb-7290-4923-89f3-844c868d4b39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":1047060848},{"type":"v1","addr":"172.21.15.144:6825","nonce":1047060848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":1047060848},{"type":"v1","addr":"172.21.15.144:6827","nonce":1047060848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":1047060848},{"type":"v1","addr":"172.21.15.144:6831","nonce":1047060848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":1047060848},{"type":"v1","addr":"172.21.15.144:6829","nonce":1047060848}]},"public_addr":"172.21.15.144:6825/1047060848","cluster_addr":"172.21.15.144:6827/1047060848","heartbeat_back_addr":"172.21.15.144:6831/1047060848","heartbeat_front_addr":"172.21.15.144:6829/1047060848","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:28:48.842729+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:29:13.946624+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:29:38.589666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:30:05.116339+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:30:30.562090+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:30:55.586210+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:31:22.138457+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:31:49.178090+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:32:13.687830+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:32:40.408193+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:33:06.044578+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:33:30.988851+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/1296137341":"2024-09-22T06:27:43.044484+0000","172.21.15.7:6801/3879502931":"2024-09-22T06:27:43.044484+0000","172.21.15.7:0/1926706877":"2024-09-22T06:26:40.520265+0000","172.21.15.7:0/2034370456":"2024-09-22T06:26:14.181426+0000","172.21.15.7:6801/3339522713":"2024-09-22T06:26:14.181426+0000","172.21.15.7:6800/3339522713":"2024-09-22T06:26:14.181426+0000","172.21.15.7:0/3586807770":"2024-09-22T06:26:14.181426+0000","172.21.15.7:0/1814223919":"2024-09-22T06:27:43.044484+0000","172.21.15.7:0/601150037":"2024-09-22T06:26:40.520265+0000","172.21.15.7:6800/3876787626":"2024-09-22T06:26:40.520265+0000","172.21.15.7:0/186444636":"2024-09-22T06:26:14.181426+0000","172.21.15.7:0/2180184348":"2024-09-22T06:26:40.520265+0000","172.21.15.7:6801/3876787626":"2024-09-22T06:26:40.520265+0000","172.21.15.7:0/2931793461":"2024-09-22T06:27:43.044484+0000","172.21.15.7:6800/3879502931":"2024-09-22T06:27:43.044484+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:35:00.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:00.202+0000 7f3027c45640 1 -- 172.21.15.7:0/3329913765 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f300c0b65f0 msgr2=0x7f300c0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:00.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:00.202+0000 7f3027c45640 1 --2- 172.21.15.7:0/3329913765 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f300c0b65f0 0x7f300c0b8b00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3020100ce0 tx=0x7f3010009110 comp rx=0 tx=0).stop 2024-09-21T06:35:00.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:00.202+0000 7f3027c45640 1 -- 172.21.15.7:0/3329913765 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3020102a80 msgr2=0x7f302019a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:00.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:00.202+0000 7f3027c45640 1 --2- 172.21.15.7:0/3329913765 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3020102a80 0x7f302019a4f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f301c005ab0 tx=0x7f301c003cd0 comp rx=0 tx=0).stop 2024-09-21T06:35:00.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:00.202+0000 7f3027c45640 1 -- 172.21.15.7:0/3329913765 shutdown_connections 2024-09-21T06:35:00.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:00.202+0000 7f3027c45640 1 --2- 172.21.15.7:0/3329913765 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f300c0b65f0 0x7f300c0b8b00 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:00.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:00.202+0000 7f3027c45640 1 --2- 172.21.15.7:0/3329913765 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3020108d10 0x7f302019fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:00.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:00.202+0000 7f3027c45640 1 --2- 172.21.15.7:0/3329913765 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f30201083c0 0x7f302019aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:00.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:00.202+0000 7f3027c45640 1 --2- 172.21.15.7:0/3329913765 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3020102a80 0x7f302019a4f0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:00.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:00.202+0000 7f3027c45640 1 -- 172.21.15.7:0/3329913765 >> 172.21.15.7:0/3329913765 conn(0x7f3020079740 msgr2=0x7f3020101980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:00.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:00.203+0000 7f3027c45640 1 -- 172.21.15.7:0/3329913765 shutdown_connections 2024-09-21T06:35:00.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:00.203+0000 7f3027c45640 1 -- 172.21.15.7:0/3329913765 wait complete. 2024-09-21T06:35:00.564 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:35:00 smithi007 ceph-mon[30983]: pgmap v283: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 3.6 KiB/s wr, 9 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-21T06:35:00.565 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:35:00 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/3329913765' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:35:00.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:35:00 smithi018 ceph-mon[34477]: pgmap v283: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 3.6 KiB/s wr, 9 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-21T06:35:00.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:35:00 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/3329913765' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:35:00.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:35:00 smithi144 ceph-mon[34653]: pgmap v283: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 3.6 KiB/s wr, 9 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-21T06:35:00.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:35:00 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/3329913765' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:35:00.899 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell osd.0 flush_pg_stats 2024-09-21T06:35:00.899 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell osd.1 flush_pg_stats 2024-09-21T06:35:00.900 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell osd.2 flush_pg_stats 2024-09-21T06:35:00.900 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell osd.3 flush_pg_stats 2024-09-21T06:35:00.900 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell osd.4 flush_pg_stats 2024-09-21T06:35:00.901 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell osd.5 flush_pg_stats 2024-09-21T06:35:00.901 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell osd.6 flush_pg_stats 2024-09-21T06:35:00.902 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell osd.7 flush_pg_stats 2024-09-21T06:35:00.902 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell osd.8 flush_pg_stats 2024-09-21T06:35:00.902 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell osd.9 flush_pg_stats 2024-09-21T06:35:00.903 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell osd.10 flush_pg_stats 2024-09-21T06:35:00.903 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell osd.11 flush_pg_stats 2024-09-21T06:35:01.613 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:01.615 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:01.615 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:01.636 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:01.731 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:01.733 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:01.734 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:01.736 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:01.738 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:01.739 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:01.753 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:02.562 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:35:02 smithi007 ceph-mon[30983]: pgmap v284: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1023 B/s wr, 6 op/s 2024-09-21T06:35:02.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:35:02 smithi018 ceph-mon[34477]: pgmap v284: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1023 B/s wr, 6 op/s 2024-09-21T06:35:02.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:35:02 smithi144 ceph-mon[34653]: pgmap v284: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1023 B/s wr, 6 op/s 2024-09-21T06:35:02.923 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:03.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.866+0000 7f98dd842640 1 -- 172.21.15.7:0/505437879 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98d8107630 msgr2=0x7f98d8107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:03.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.866+0000 7f98dd842640 1 --2- 172.21.15.7:0/505437879 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98d8107630 0x7f98d8107a40 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f98c8009900 tx=0x7f98c802a410 comp rx=0 tx=0).stop 2024-09-21T06:35:03.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.866+0000 7f98dd842640 1 -- 172.21.15.7:0/505437879 shutdown_connections 2024-09-21T06:35:03.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.866+0000 7f98dd842640 1 --2- 172.21.15.7:0/505437879 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98d81038f0 0x7f98d810f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:03.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.866+0000 7f98dd842640 1 --2- 172.21.15.7:0/505437879 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f98d8102fa0 0x7f98d81033b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:03.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.866+0000 7f98dd842640 1 --2- 172.21.15.7:0/505437879 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98d8107630 0x7f98d8107a40 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:03.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.866+0000 7f98dd842640 1 -- 172.21.15.7:0/505437879 >> 172.21.15.7:0/505437879 conn(0x7f98d8079e40 msgr2=0x7f98d807a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:03.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.866+0000 7f98dd842640 1 -- 172.21.15.7:0/505437879 shutdown_connections 2024-09-21T06:35:03.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.866+0000 7f98dd842640 1 -- 172.21.15.7:0/505437879 wait complete. 2024-09-21T06:35:03.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.867+0000 7f98dd842640 1 Processor -- start 2024-09-21T06:35:03.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.867+0000 7f98dd842640 1 -- start start 2024-09-21T06:35:03.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.868+0000 7f98dd842640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98d8102fa0 0x7f98d8110030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:03.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.868+0000 7f98dd842640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f98d81038f0 0x7f98d8110570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:03.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.868+0000 7f98dd842640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98d8107630 0x7f98d8110ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:03.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.868+0000 7f98dd842640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f98d8113b00 con 0x7f98d8107630 2024-09-21T06:35:03.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.868+0000 7f98dd842640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f98d8113980 con 0x7f98d8102fa0 2024-09-21T06:35:03.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.868+0000 7f98dd842640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f98d8113c80 con 0x7f98d81038f0 2024-09-21T06:35:03.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.868+0000 7f98d77fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98d8107630 0x7f98d8110ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:03.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.868+0000 7f98d77fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98d8107630 0x7f98d8110ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35066/0 (socket says 172.21.15.7:35066) 2024-09-21T06:35:03.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.868+0000 7f98d77fe640 1 -- 172.21.15.7:0/1884926481 learned_addr learned my addr 172.21.15.7:0/1884926481 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:35:03.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.868+0000 7f98d6ffd640 1 --2- 172.21.15.7:0/1884926481 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98d8102fa0 0x7f98d8110030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:03.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.868+0000 7f98d67fc640 1 --2- 172.21.15.7:0/1884926481 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f98d81038f0 0x7f98d8110570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:03.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.868+0000 7f98d77fe640 1 -- 172.21.15.7:0/1884926481 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f98d81038f0 msgr2=0x7f98d8110570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:03.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.868+0000 7f98d77fe640 1 --2- 172.21.15.7:0/1884926481 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f98d81038f0 0x7f98d8110570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:03.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.868+0000 7f98d77fe640 1 -- 172.21.15.7:0/1884926481 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98d8102fa0 msgr2=0x7f98d8110030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:03.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.868+0000 7f98d77fe640 1 --2- 172.21.15.7:0/1884926481 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98d8102fa0 0x7f98d8110030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:03.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.868+0000 7f98d77fe640 1 -- 172.21.15.7:0/1884926481 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98d81a8850 con 0x7f98d8107630 2024-09-21T06:35:03.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.868+0000 7f98d6ffd640 1 --2- 172.21.15.7:0/1884926481 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f98d8102fa0 0x7f98d8110030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:35:03.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.868+0000 7f98d77fe640 1 --2- 172.21.15.7:0/1884926481 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98d8107630 0x7f98d8110ab0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f98d000d950 tx=0x7f98d000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:03.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.868+0000 7f98dc840640 1 -- 172.21.15.7:0/1884926481 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98d0017030 con 0x7f98d8107630 2024-09-21T06:35:03.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.868+0000 7f98dc840640 1 -- 172.21.15.7:0/1884926481 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f98d0004020 con 0x7f98d8107630 2024-09-21T06:35:03.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.869+0000 7f98dd842640 1 -- 172.21.15.7:0/1884926481 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98d81a8b40 con 0x7f98d8107630 2024-09-21T06:35:03.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.869+0000 7f98dc840640 1 -- 172.21.15.7:0/1884926481 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98d0003b50 con 0x7f98d8107630 2024-09-21T06:35:03.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.869+0000 7f98dd842640 1 -- 172.21.15.7:0/1884926481 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98d81a9080 con 0x7f98d8107630 2024-09-21T06:35:03.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.869+0000 7f98dd842640 1 -- 172.21.15.7:0/1884926481 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f98d8063b50 con 0x7f98d8107630 2024-09-21T06:35:03.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.871+0000 7f98dc840640 1 -- 172.21.15.7:0/1884926481 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154579+0+0 (secure 0 0 0) 0x7f98d001a070 con 0x7f98d8107630 2024-09-21T06:35:03.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.872+0000 7f98dc840640 1 --2- 172.21.15.7:0/1884926481 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f98c40b6670 0x7f98c40b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:03.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.872+0000 7f98d6ffd640 1 --2- 172.21.15.7:0/1884926481 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f98c40b6670 0x7f98c40b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:03.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.872+0000 7f98dc840640 1 -- 172.21.15.7:0/1884926481 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f98d00e7360 con 0x7f98d8107630 2024-09-21T06:35:03.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.872+0000 7f98dc840640 1 --2- 172.21.15.7:0/1884926481 >> [v2:172.21.15.144:6816/1011657022,v1:172.21.15.144:6817/1011657022] conn(0x7f98c40c02e0 0x7f98c40c27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:03.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.872+0000 7f98dc840640 1 -- 172.21.15.7:0/1884926481 --> [v2:172.21.15.144:6816/1011657022,v1:172.21.15.144:6817/1011657022] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f98c40c2ea0 con 0x7f98c40c02e0 2024-09-21T06:35:03.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.872+0000 7f98dc840640 1 -- 172.21.15.7:0/1884926481 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f98d00e7790 con 0x7f98d8107630 2024-09-21T06:35:03.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.872+0000 7f98d6ffd640 1 --2- 172.21.15.7:0/1884926481 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f98c40b6670 0x7f98c40b8b80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f98c8000c00 tx=0x7f98c8009680 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:03.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.873+0000 7f98d67fc640 1 --2- 172.21.15.7:0/1884926481 >> [v2:172.21.15.144:6816/1011657022,v1:172.21.15.144:6817/1011657022] conn(0x7f98c40c02e0 0x7f98c40c27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:03.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.873+0000 7f98d67fc640 1 --2- 172.21.15.7:0/1884926481 >> [v2:172.21.15.144:6816/1011657022,v1:172.21.15.144:6817/1011657022] conn(0x7f98c40c02e0 0x7f98c40c27d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:03.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.874+0000 7f98dc840640 1 -- 172.21.15.7:0/1884926481 <== osd.8 v2:172.21.15.144:6816/1011657022 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f98c40c2ea0 con 0x7f98c40c02e0 2024-09-21T06:35:03.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.888+0000 7f98dd842640 1 -- 172.21.15.7:0/1884926481 --> [v2:172.21.15.144:6816/1011657022,v1:172.21.15.144:6817/1011657022] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f98d8063fd0 con 0x7f98c40c02e0 2024-09-21T06:35:03.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.888+0000 7f98dc840640 1 -- 172.21.15.7:0/1884926481 <== osd.8 v2:172.21.15.144:6816/1011657022 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f98d8063fd0 con 0x7f98c40c02e0 2024-09-21T06:35:03.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.888+0000 7f98dd842640 1 -- 172.21.15.7:0/1884926481 >> [v2:172.21.15.144:6816/1011657022,v1:172.21.15.144:6817/1011657022] conn(0x7f98c40c02e0 msgr2=0x7f98c40c27d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:03.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.888+0000 7f98dd842640 1 --2- 172.21.15.7:0/1884926481 >> [v2:172.21.15.144:6816/1011657022,v1:172.21.15.144:6817/1011657022] conn(0x7f98c40c02e0 0x7f98c40c27d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:03.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.889+0000 7f98dd842640 1 -- 172.21.15.7:0/1884926481 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f98c40b6670 msgr2=0x7f98c40b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:03.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.889+0000 7f98dd842640 1 --2- 172.21.15.7:0/1884926481 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f98c40b6670 0x7f98c40b8b80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f98c8000c00 tx=0x7f98c8009680 comp rx=0 tx=0).stop 2024-09-21T06:35:03.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.889+0000 7f98dd842640 1 -- 172.21.15.7:0/1884926481 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98d8107630 msgr2=0x7f98d8110ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:03.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.889+0000 7f98dd842640 1 --2- 172.21.15.7:0/1884926481 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f98d8107630 0x7f98d8110ab0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f98d000d950 tx=0x7f98d000de10 comp rx=0 tx=0).stop 2024-09-21T06:35:03.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.889+0000 7f98d77fe640 1 -- 172.21.15.7:0/1884926481 reap_dead start 2024-09-21T06:35:03.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.889+0000 7f98dd842640 1 -- 172.21.15.7:0/1884926481 shutdown_connections 2024-09-21T06:35:03.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.889+0000 7f98dd842640 1 -- 172.21.15.7:0/1884926481 >> 172.21.15.7:0/1884926481 conn(0x7f98d8079e40 msgr2=0x7f98d81064b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:03.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.889+0000 7f98dd842640 1 -- 172.21.15.7:0/1884926481 shutdown_connections 2024-09-21T06:35:03.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.889+0000 7f98dd842640 1 -- 172.21.15.7:0/1884926481 wait complete. 2024-09-21T06:35:03.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.141+0000 7fcf9b5bb640 1 -- 172.21.15.7:0/2193780932 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf94102000 msgr2=0x7fcf94102410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:03.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.141+0000 7fcf9b5bb640 1 --2- 172.21.15.7:0/2193780932 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf94102000 0x7fcf94102410 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fcf90009900 tx=0x7fcf9002a410 comp rx=0 tx=0).stop 2024-09-21T06:35:03.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.141+0000 7fcf9b5bb640 1 -- 172.21.15.7:0/2193780932 shutdown_connections 2024-09-21T06:35:03.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.141+0000 7fcf9b5bb640 1 --2- 172.21.15.7:0/2193780932 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf94106c30 0x7fcf94110680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:03.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.141+0000 7fcf9b5bb640 1 --2- 172.21.15.7:0/2193780932 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf941062e0 0x7fcf941066f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:03.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.141+0000 7fcf9b5bb640 1 --2- 172.21.15.7:0/2193780932 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf94102000 0x7fcf94102410 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:03.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.141+0000 7fcf9b5bb640 1 -- 172.21.15.7:0/2193780932 >> 172.21.15.7:0/2193780932 conn(0x7fcf94079e40 msgr2=0x7fcf9407a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:03.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.141+0000 7fcf9b5bb640 1 -- 172.21.15.7:0/2193780932 shutdown_connections 2024-09-21T06:35:03.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.141+0000 7fcf9b5bb640 1 -- 172.21.15.7:0/2193780932 wait complete. 2024-09-21T06:35:03.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.142+0000 7fcf9b5bb640 1 Processor -- start 2024-09-21T06:35:03.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.142+0000 7fcf9b5bb640 1 -- start start 2024-09-21T06:35:03.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.142+0000 7fcf9b5bb640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf94102000 0x7fcf9419a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:03.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.142+0000 7fcf9b5bb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf941062e0 0x7fcf9419aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:03.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.142+0000 7fcf9b5bb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf94106c30 0x7fcf9419fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:03.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.142+0000 7fcf9b5bb640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fcf94113ad0 con 0x7fcf941062e0 2024-09-21T06:35:03.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.142+0000 7fcf9b5bb640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcf94113950 con 0x7fcf94106c30 2024-09-21T06:35:03.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.142+0000 7fcf9b5bb640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fcf94113c50 con 0x7fcf94102000 2024-09-21T06:35:03.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.143+0000 7fcf98b56640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf941062e0 0x7fcf9419aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:03.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.143+0000 7fcf98b56640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf941062e0 0x7fcf9419aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35050/0 (socket says 172.21.15.7:35050) 2024-09-21T06:35:03.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.143+0000 7fcf98b56640 1 -- 172.21.15.7:0/3516551154 learned_addr learned my addr 172.21.15.7:0/3516551154 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:35:03.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.143+0000 7fcf99357640 1 --2- 172.21.15.7:0/3516551154 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf94102000 0x7fcf9419a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:03.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.143+0000 7fcf99b58640 1 --2- 172.21.15.7:0/3516551154 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf94106c30 0x7fcf9419fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:03.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.143+0000 7fcf98b56640 1 -- 172.21.15.7:0/3516551154 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf94102000 msgr2=0x7fcf9419a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:03.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.143+0000 7fcf98b56640 1 --2- 172.21.15.7:0/3516551154 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf94102000 0x7fcf9419a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:03.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.143+0000 7fcf98b56640 1 -- 172.21.15.7:0/3516551154 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf94106c30 msgr2=0x7fcf9419fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:03.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.143+0000 7fcf98b56640 1 --2- 172.21.15.7:0/3516551154 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf94106c30 0x7fcf9419fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:03.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.143+0000 7fcf98b56640 1 -- 172.21.15.7:0/3516551154 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf941a0470 con 0x7fcf941062e0 2024-09-21T06:35:03.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.143+0000 7fcf99357640 1 --2- 172.21.15.7:0/3516551154 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcf94102000 0x7fcf9419a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:35:03.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.143+0000 7fcf99b58640 1 --2- 172.21.15.7:0/3516551154 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf94106c30 0x7fcf9419fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:35:03.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.143+0000 7fcf98b56640 1 --2- 172.21.15.7:0/3516551154 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf941062e0 0x7fcf9419aaa0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fcf8400e9c0 tx=0x7fcf8400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:03.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.143+0000 7fcf8a7fc640 1 -- 172.21.15.7:0/3516551154 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf8400cd80 con 0x7fcf941062e0 2024-09-21T06:35:03.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.143+0000 7fcf8a7fc640 1 -- 172.21.15.7:0/3516551154 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcf840054d0 con 0x7fcf941062e0 2024-09-21T06:35:03.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.143+0000 7fcf9b5bb640 1 -- 172.21.15.7:0/3516551154 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf941a0760 con 0x7fcf941062e0 2024-09-21T06:35:03.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.143+0000 7fcf8a7fc640 1 -- 172.21.15.7:0/3516551154 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf84010430 con 0x7fcf941062e0 2024-09-21T06:35:03.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.143+0000 7fcf9b5bb640 1 -- 172.21.15.7:0/3516551154 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf94102e80 con 0x7fcf941062e0 2024-09-21T06:35:03.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.144+0000 7fcf9b5bb640 1 -- 172.21.15.7:0/3516551154 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcf94063b10 con 0x7fcf941062e0 2024-09-21T06:35:03.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.146+0000 7fcf8a7fc640 1 -- 172.21.15.7:0/3516551154 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154579+0+0 (secure 0 0 0) 0x7fcf84004fb0 con 0x7fcf941062e0 2024-09-21T06:35:03.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.147+0000 7fcf8a7fc640 1 --2- 172.21.15.7:0/3516551154 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fcf800b6670 0x7fcf800b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:03.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.147+0000 7fcf99357640 1 --2- 172.21.15.7:0/3516551154 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fcf800b6670 0x7fcf800b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:03.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.147+0000 7fcf8a7fc640 1 -- 172.21.15.7:0/3516551154 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fcf840e7ef0 con 0x7fcf941062e0 2024-09-21T06:35:03.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.147+0000 7fcf8a7fc640 1 --2- 172.21.15.7:0/3516551154 >> [v2:172.21.15.18:6800/1839342931,v1:172.21.15.18:6801/1839342931] conn(0x7fcf800c02e0 0x7fcf800c27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:03.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.147+0000 7fcf8a7fc640 1 -- 172.21.15.7:0/3516551154 --> [v2:172.21.15.18:6800/1839342931,v1:172.21.15.18:6801/1839342931] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcf84015e80 con 0x7fcf800c02e0 2024-09-21T06:35:03.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.147+0000 7fcf8a7fc640 1 -- 172.21.15.7:0/3516551154 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7fcf840e82a0 con 0x7fcf941062e0 2024-09-21T06:35:03.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.147+0000 7fcf99b58640 1 --2- 172.21.15.7:0/3516551154 >> [v2:172.21.15.18:6800/1839342931,v1:172.21.15.18:6801/1839342931] conn(0x7fcf800c02e0 0x7fcf800c27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:03.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.147+0000 7fcf99357640 1 --2- 172.21.15.7:0/3516551154 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fcf800b6670 0x7fcf800b8b80 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fcf90031440 tx=0x7fcf90009680 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:03.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.148+0000 7fcf99b58640 1 --2- 172.21.15.7:0/3516551154 >> [v2:172.21.15.18:6800/1839342931,v1:172.21.15.18:6801/1839342931] conn(0x7fcf800c02e0 0x7fcf800c27d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:03.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.149+0000 7fcf8a7fc640 1 -- 172.21.15.7:0/3516551154 <== osd.1 v2:172.21.15.18:6800/1839342931 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcf84015e80 con 0x7fcf800c02e0 2024-09-21T06:35:03.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.162+0000 7fcf9b5bb640 1 -- 172.21.15.7:0/3516551154 --> [v2:172.21.15.18:6800/1839342931,v1:172.21.15.18:6801/1839342931] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fcf94063f10 con 0x7fcf800c02e0 2024-09-21T06:35:03.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.163+0000 7fcf8a7fc640 1 -- 172.21.15.7:0/3516551154 <== osd.1 v2:172.21.15.18:6800/1839342931 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fcf94063f10 con 0x7fcf800c02e0 2024-09-21T06:35:03.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.163+0000 7fcf9b5bb640 1 -- 172.21.15.7:0/3516551154 >> [v2:172.21.15.18:6800/1839342931,v1:172.21.15.18:6801/1839342931] conn(0x7fcf800c02e0 msgr2=0x7fcf800c27d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:03.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.163+0000 7fcf9b5bb640 1 --2- 172.21.15.7:0/3516551154 >> [v2:172.21.15.18:6800/1839342931,v1:172.21.15.18:6801/1839342931] conn(0x7fcf800c02e0 0x7fcf800c27d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:03.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.163+0000 7fcf9b5bb640 1 -- 172.21.15.7:0/3516551154 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fcf800b6670 msgr2=0x7fcf800b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:03.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.163+0000 7fcf9b5bb640 1 --2- 172.21.15.7:0/3516551154 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fcf800b6670 0x7fcf800b8b80 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fcf90031440 tx=0x7fcf90009680 comp rx=0 tx=0).stop 2024-09-21T06:35:03.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.163+0000 7fcf9b5bb640 1 -- 172.21.15.7:0/3516551154 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf941062e0 msgr2=0x7fcf9419aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:03.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.163+0000 7fcf9b5bb640 1 --2- 172.21.15.7:0/3516551154 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcf941062e0 0x7fcf9419aaa0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fcf8400e9c0 tx=0x7fcf8400ee80 comp rx=0 tx=0).stop 2024-09-21T06:35:03.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.163+0000 7fcf99b58640 1 -- 172.21.15.7:0/3516551154 reap_dead start 2024-09-21T06:35:03.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.163+0000 7fcf9b5bb640 1 -- 172.21.15.7:0/3516551154 shutdown_connections 2024-09-21T06:35:03.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.163+0000 7fcf9b5bb640 1 -- 172.21.15.7:0/3516551154 >> 172.21.15.7:0/3516551154 conn(0x7fcf94079e40 msgr2=0x7fcf941080e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:03.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.163+0000 7fcf9b5bb640 1 -- 172.21.15.7:0/3516551154 shutdown_connections 2024-09-21T06:35:03.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:03.163+0000 7fcf9b5bb640 1 -- 172.21.15.7:0/3516551154 wait complete. 2024-09-21T06:35:04.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.464+0000 7f134d799640 1 -- 172.21.15.7:0/4132936630 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1348108d20 msgr2=0x7f134810f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:04.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.464+0000 7f134d799640 1 --2- 172.21.15.7:0/4132936630 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1348108d20 0x7f134810f550 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f1340009ca0 tx=0x7f134002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:35:04.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.464+0000 7f134d799640 1 -- 172.21.15.7:0/4132936630 shutdown_connections 2024-09-21T06:35:04.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.464+0000 7f134d799640 1 --2- 172.21.15.7:0/4132936630 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1348108d20 0x7f134810f550 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:04.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.464+0000 7f134d799640 1 --2- 172.21.15.7:0/4132936630 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13481083d0 0x7f13481087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:04.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.464+0000 7f134d799640 1 --2- 172.21.15.7:0/4132936630 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1348102ae0 0x7f1348102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:04.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.464+0000 7f134d799640 1 -- 172.21.15.7:0/4132936630 >> 172.21.15.7:0/4132936630 conn(0x7f1348079790 msgr2=0x7f1348079ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:04.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.464+0000 7f134d799640 1 -- 172.21.15.7:0/4132936630 shutdown_connections 2024-09-21T06:35:04.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.464+0000 7f134d799640 1 -- 172.21.15.7:0/4132936630 wait complete. 2024-09-21T06:35:04.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.465+0000 7f134d799640 1 Processor -- start 2024-09-21T06:35:04.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.465+0000 7f134d799640 1 -- start start 2024-09-21T06:35:04.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.465+0000 7f134d799640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1348102ae0 0x7f13480ff670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:04.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.465+0000 7f134d799640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13481083d0 0x7f13480ffbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:04.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.465+0000 7f134d799640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1348108d20 0x7f13481000f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:04.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.465+0000 7f134d799640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f13481129e0 con 0x7f1348102ae0 2024-09-21T06:35:04.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.465+0000 7f134d799640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1348112860 con 0x7f13481083d0 2024-09-21T06:35:04.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.465+0000 7f134d799640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1348112b60 con 0x7f1348108d20 2024-09-21T06:35:04.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.465+0000 7f1346ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1348102ae0 0x7f13480ff670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:04.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.465+0000 7f1346ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1348102ae0 0x7f13480ff670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35084/0 (socket says 172.21.15.7:35084) 2024-09-21T06:35:04.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.465+0000 7f1346ffd640 1 -- 172.21.15.7:0/1408725357 learned_addr learned my addr 172.21.15.7:0/1408725357 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:35:04.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.465+0000 7f13467fc640 1 --2- 172.21.15.7:0/1408725357 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13481083d0 0x7f13480ffbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:04.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.465+0000 7f13477fe640 1 --2- 172.21.15.7:0/1408725357 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1348108d20 0x7f13481000f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:04.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.466+0000 7f1346ffd640 1 -- 172.21.15.7:0/1408725357 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1348108d20 msgr2=0x7f13481000f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:04.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.466+0000 7f1346ffd640 1 --2- 172.21.15.7:0/1408725357 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1348108d20 0x7f13481000f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:04.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.466+0000 7f1346ffd640 1 -- 172.21.15.7:0/1408725357 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13481083d0 msgr2=0x7f13480ffbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:04.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.466+0000 7f1346ffd640 1 --2- 172.21.15.7:0/1408725357 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13481083d0 0x7f13480ffbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:04.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.466+0000 7f1346ffd640 1 -- 172.21.15.7:0/1408725357 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13481a86c0 con 0x7f1348102ae0 2024-09-21T06:35:04.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.466+0000 7f1346ffd640 1 --2- 172.21.15.7:0/1408725357 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1348102ae0 0x7f13480ff670 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f133800c890 tx=0x7f133800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:04.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.466+0000 7f133ffff640 1 -- 172.21.15.7:0/1408725357 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1338004220 con 0x7f1348102ae0 2024-09-21T06:35:04.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.466+0000 7f133ffff640 1 -- 172.21.15.7:0/1408725357 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f13380043c0 con 0x7f1348102ae0 2024-09-21T06:35:04.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.466+0000 7f134d799640 1 -- 172.21.15.7:0/1408725357 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13481a89b0 con 0x7f1348102ae0 2024-09-21T06:35:04.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.466+0000 7f133ffff640 1 -- 172.21.15.7:0/1408725357 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1338004a00 con 0x7f1348102ae0 2024-09-21T06:35:04.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.466+0000 7f134d799640 1 -- 172.21.15.7:0/1408725357 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13481a8ef0 con 0x7f1348102ae0 2024-09-21T06:35:04.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.467+0000 7f134d799640 1 -- 172.21.15.7:0/1408725357 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f13481044b0 con 0x7f1348102ae0 2024-09-21T06:35:04.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.469+0000 7f133ffff640 1 -- 172.21.15.7:0/1408725357 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154579+0+0 (secure 0 0 0) 0x7f13380079b0 con 0x7f1348102ae0 2024-09-21T06:35:04.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.469+0000 7f133ffff640 1 --2- 172.21.15.7:0/1408725357 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f13340b65f0 0x7f13340b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:04.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.470+0000 7f13467fc640 1 --2- 172.21.15.7:0/1408725357 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f13340b65f0 0x7f13340b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:04.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.470+0000 7f133ffff640 1 -- 172.21.15.7:0/1408725357 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f13380e7710 con 0x7f1348102ae0 2024-09-21T06:35:04.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.470+0000 7f133ffff640 1 --2- 172.21.15.7:0/1408725357 >> [v2:172.21.15.144:6824/1047060848,v1:172.21.15.144:6825/1047060848] conn(0x7f13340c0250 0x7f13340c2740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:04.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.470+0000 7f133ffff640 1 -- 172.21.15.7:0/1408725357 --> [v2:172.21.15.144:6824/1047060848,v1:172.21.15.144:6825/1047060848] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f13340c2e10 con 0x7f13340c0250 2024-09-21T06:35:04.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.470+0000 7f133ffff640 1 -- 172.21.15.7:0/1408725357 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f13380e7ac0 con 0x7f1348102ae0 2024-09-21T06:35:04.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.470+0000 7f13467fc640 1 --2- 172.21.15.7:0/1408725357 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f13340b65f0 0x7f13340b8b00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1348079d90 tx=0x7f133000b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:04.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.470+0000 7f13477fe640 1 --2- 172.21.15.7:0/1408725357 >> [v2:172.21.15.144:6824/1047060848,v1:172.21.15.144:6825/1047060848] conn(0x7f13340c0250 0x7f13340c2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:04.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.471+0000 7f13477fe640 1 --2- 172.21.15.7:0/1408725357 >> [v2:172.21.15.144:6824/1047060848,v1:172.21.15.144:6825/1047060848] conn(0x7f13340c0250 0x7f13340c2740 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:04.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.472+0000 7f133ffff640 1 -- 172.21.15.7:0/1408725357 <== osd.11 v2:172.21.15.144:6824/1047060848 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f13340c2e10 con 0x7f13340c0250 2024-09-21T06:35:04.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.485+0000 7f134d799640 1 -- 172.21.15.7:0/1408725357 --> [v2:172.21.15.144:6824/1047060848,v1:172.21.15.144:6825/1047060848] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1348103d10 con 0x7f13340c0250 2024-09-21T06:35:04.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.486+0000 7f133ffff640 1 -- 172.21.15.7:0/1408725357 <== osd.11 v2:172.21.15.144:6824/1047060848 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f1348103d10 con 0x7f13340c0250 2024-09-21T06:35:04.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.486+0000 7f134d799640 1 -- 172.21.15.7:0/1408725357 >> [v2:172.21.15.144:6824/1047060848,v1:172.21.15.144:6825/1047060848] conn(0x7f13340c0250 msgr2=0x7f13340c2740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:04.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.486+0000 7f134d799640 1 --2- 172.21.15.7:0/1408725357 >> [v2:172.21.15.144:6824/1047060848,v1:172.21.15.144:6825/1047060848] conn(0x7f13340c0250 0x7f13340c2740 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:04.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.486+0000 7f134d799640 1 -- 172.21.15.7:0/1408725357 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f13340b65f0 msgr2=0x7f13340b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:04.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.486+0000 7f134d799640 1 --2- 172.21.15.7:0/1408725357 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f13340b65f0 0x7f13340b8b00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1348079d90 tx=0x7f133000b390 comp rx=0 tx=0).stop 2024-09-21T06:35:04.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.486+0000 7f134d799640 1 -- 172.21.15.7:0/1408725357 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1348102ae0 msgr2=0x7f13480ff670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:04.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.486+0000 7f134d799640 1 --2- 172.21.15.7:0/1408725357 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1348102ae0 0x7f13480ff670 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f133800c890 tx=0x7f133800cd50 comp rx=0 tx=0).stop 2024-09-21T06:35:04.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.486+0000 7f13477fe640 1 -- 172.21.15.7:0/1408725357 reap_dead start 2024-09-21T06:35:04.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.486+0000 7f134d799640 1 -- 172.21.15.7:0/1408725357 shutdown_connections 2024-09-21T06:35:04.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.486+0000 7f134d799640 1 -- 172.21.15.7:0/1408725357 >> 172.21.15.7:0/1408725357 conn(0x7f1348079790 msgr2=0x7f13481018a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:04.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.486+0000 7f134d799640 1 -- 172.21.15.7:0/1408725357 shutdown_connections 2024-09-21T06:35:04.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.486+0000 7f134d799640 1 -- 172.21.15.7:0/1408725357 wait complete. 2024-09-21T06:35:04.573 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:35:04 smithi007 ceph-mon[30983]: pgmap v285: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1023 B/s wr, 7 op/s 2024-09-21T06:35:04.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:35:04 smithi018 ceph-mon[34477]: pgmap v285: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1023 B/s wr, 7 op/s 2024-09-21T06:35:04.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:35:04 smithi144 ceph-mon[34653]: pgmap v285: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1023 B/s wr, 7 op/s 2024-09-21T06:35:04.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.994+0000 7f8c0fe69640 1 -- 172.21.15.7:0/1312338881 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c08108cf0 msgr2=0x7f8c0810f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:04.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.994+0000 7f8c0fe69640 1 --2- 172.21.15.7:0/1312338881 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c08108cf0 0x7f8c0810f520 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f8bf8009ca0 tx=0x7f8bf802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:35:04.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.994+0000 7f8c0fe69640 1 -- 172.21.15.7:0/1312338881 shutdown_connections 2024-09-21T06:35:04.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.994+0000 7f8c0fe69640 1 --2- 172.21.15.7:0/1312338881 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c08108cf0 0x7f8c0810f520 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:04.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.994+0000 7f8c0fe69640 1 --2- 172.21.15.7:0/1312338881 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c081083a0 0x7f8c081087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:04.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.994+0000 7f8c0fe69640 1 --2- 172.21.15.7:0/1312338881 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c08102a60 0x7f8c08102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:04.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.994+0000 7f8c0fe69640 1 -- 172.21.15.7:0/1312338881 >> 172.21.15.7:0/1312338881 conn(0x7f8c08079730 msgr2=0x7f8c08079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:04.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.994+0000 7f8c0fe69640 1 -- 172.21.15.7:0/1312338881 shutdown_connections 2024-09-21T06:35:04.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.994+0000 7f8c0fe69640 1 -- 172.21.15.7:0/1312338881 wait complete. 2024-09-21T06:35:04.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.995+0000 7f8c0fe69640 1 Processor -- start 2024-09-21T06:35:04.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.995+0000 7f8c0fe69640 1 -- start start 2024-09-21T06:35:04.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.995+0000 7f8c0fe69640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c08102a60 0x7f8c0819a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:04.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.995+0000 7f8c0fe69640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c081083a0 0x7f8c0819aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:04.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.995+0000 7f8c0fe69640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c08108cf0 0x7f8c0819fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:04.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.995+0000 7f8c0fe69640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8c08112960 con 0x7f8c08108cf0 2024-09-21T06:35:04.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.995+0000 7f8c0fe69640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8c081127e0 con 0x7f8c081083a0 2024-09-21T06:35:04.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.995+0000 7f8c0fe69640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8c08112ae0 con 0x7f8c08102a60 2024-09-21T06:35:04.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.995+0000 7f8c0e406640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c08108cf0 0x7f8c0819fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:04.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.995+0000 7f8c0e406640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c08108cf0 0x7f8c0819fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35104/0 (socket says 172.21.15.7:35104) 2024-09-21T06:35:04.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.995+0000 7f8c0e406640 1 -- 172.21.15.7:0/3067894844 learned_addr learned my addr 172.21.15.7:0/3067894844 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:35:04.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.995+0000 7f8c0d404640 1 --2- 172.21.15.7:0/3067894844 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c081083a0 0x7f8c0819aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:04.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.996+0000 7f8c0dc05640 1 --2- 172.21.15.7:0/3067894844 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c08102a60 0x7f8c0819a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:04.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.996+0000 7f8c0e406640 1 -- 172.21.15.7:0/3067894844 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c08102a60 msgr2=0x7f8c0819a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:04.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.996+0000 7f8c0e406640 1 --2- 172.21.15.7:0/3067894844 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8c08102a60 0x7f8c0819a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:04.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.996+0000 7f8c0e406640 1 -- 172.21.15.7:0/3067894844 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c081083a0 msgr2=0x7f8c0819aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:05.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.996+0000 7f8c0e406640 1 --2- 172.21.15.7:0/3067894844 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c081083a0 0x7f8c0819aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:05.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.996+0000 7f8c0e406640 1 -- 172.21.15.7:0/3067894844 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c081a03f0 con 0x7f8c08108cf0 2024-09-21T06:35:05.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.996+0000 7f8c0e406640 1 --2- 172.21.15.7:0/3067894844 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c08108cf0 0x7f8c0819fcc0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8bf8005cc0 tx=0x7f8bf802f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:05.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.996+0000 7f8c06ffd640 1 -- 172.21.15.7:0/3067894844 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf8003bf0 con 0x7f8c08108cf0 2024-09-21T06:35:05.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.996+0000 7f8c06ffd640 1 -- 172.21.15.7:0/3067894844 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8bf8003d90 con 0x7f8c08108cf0 2024-09-21T06:35:05.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.996+0000 7f8c0fe69640 1 -- 172.21.15.7:0/3067894844 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c081a0680 con 0x7f8c08108cf0 2024-09-21T06:35:05.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.996+0000 7f8c06ffd640 1 -- 172.21.15.7:0/3067894844 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf802fbc0 con 0x7f8c08108cf0 2024-09-21T06:35:05.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.996+0000 7f8c0fe69640 1 -- 172.21.15.7:0/3067894844 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c081a6e40 con 0x7f8c08108cf0 2024-09-21T06:35:05.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.997+0000 7f8c0fe69640 1 -- 172.21.15.7:0/3067894844 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8c08063b50 con 0x7f8c08108cf0 2024-09-21T06:35:05.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:04.999+0000 7f8c06ffd640 1 -- 172.21.15.7:0/3067894844 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154579+0+0 (secure 0 0 0) 0x7f8bf802fd60 con 0x7f8c08108cf0 2024-09-21T06:35:05.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:05.000+0000 7f8c06ffd640 1 --2- 172.21.15.7:0/3067894844 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f8bf00b65f0 0x7f8bf00b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:05.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:05.000+0000 7f8c0dc05640 1 --2- 172.21.15.7:0/3067894844 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f8bf00b65f0 0x7f8bf00b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:05.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:05.000+0000 7f8c06ffd640 1 -- 172.21.15.7:0/3067894844 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f8bf8108b70 con 0x7f8c08108cf0 2024-09-21T06:35:05.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:05.000+0000 7f8c06ffd640 1 --2- 172.21.15.7:0/3067894844 >> [v2:172.21.15.7:6826/256146339,v1:172.21.15.7:6827/256146339] conn(0x7f8bf00c0260 0x7f8bf00c2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:05.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:05.000+0000 7f8c06ffd640 1 -- 172.21.15.7:0/3067894844 --> [v2:172.21.15.7:6826/256146339,v1:172.21.15.7:6827/256146339] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8bf00c2e20 con 0x7f8bf00c0260 2024-09-21T06:35:05.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:05.000+0000 7f8c06ffd640 1 -- 172.21.15.7:0/3067894844 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f8bf8108fa0 con 0x7f8c08108cf0 2024-09-21T06:35:05.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:05.000+0000 7f8c0d404640 1 --2- 172.21.15.7:0/3067894844 >> [v2:172.21.15.7:6826/256146339,v1:172.21.15.7:6827/256146339] conn(0x7f8bf00c0260 0x7f8bf00c2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:05.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:05.000+0000 7f8c0dc05640 1 --2- 172.21.15.7:0/3067894844 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f8bf00b65f0 0x7f8bf00b8b00 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8c000058c0 tx=0x7f8c0000a250 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:05.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:05.001+0000 7f8c0d404640 1 --2- 172.21.15.7:0/3067894844 >> [v2:172.21.15.7:6826/256146339,v1:172.21.15.7:6827/256146339] conn(0x7f8bf00c0260 0x7f8bf00c2750 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:05.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:05.001+0000 7f8c06ffd640 1 -- 172.21.15.7:0/3067894844 <== osd.9 v2:172.21.15.7:6826/256146339 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8bf00c2e20 con 0x7f8bf00c0260 2024-09-21T06:35:05.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:05.015+0000 7f8c0fe69640 1 -- 172.21.15.7:0/3067894844 --> [v2:172.21.15.7:6826/256146339,v1:172.21.15.7:6827/256146339] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8c08063fd0 con 0x7f8bf00c0260 2024-09-21T06:35:05.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:05.015+0000 7f8c06ffd640 1 -- 172.21.15.7:0/3067894844 <== osd.9 v2:172.21.15.7:6826/256146339 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f8c08063fd0 con 0x7f8bf00c0260 2024-09-21T06:35:05.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:05.016+0000 7f8c0fe69640 1 -- 172.21.15.7:0/3067894844 >> [v2:172.21.15.7:6826/256146339,v1:172.21.15.7:6827/256146339] conn(0x7f8bf00c0260 msgr2=0x7f8bf00c2750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:05.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:05.016+0000 7f8c0fe69640 1 --2- 172.21.15.7:0/3067894844 >> [v2:172.21.15.7:6826/256146339,v1:172.21.15.7:6827/256146339] conn(0x7f8bf00c0260 0x7f8bf00c2750 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:05.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:05.016+0000 7f8c0fe69640 1 -- 172.21.15.7:0/3067894844 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f8bf00b65f0 msgr2=0x7f8bf00b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:05.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:05.016+0000 7f8c0fe69640 1 --2- 172.21.15.7:0/3067894844 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f8bf00b65f0 0x7f8bf00b8b00 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8c000058c0 tx=0x7f8c0000a250 comp rx=0 tx=0).stop 2024-09-21T06:35:05.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:05.016+0000 7f8c0fe69640 1 -- 172.21.15.7:0/3067894844 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c08108cf0 msgr2=0x7f8c0819fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:05.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:05.016+0000 7f8c0fe69640 1 --2- 172.21.15.7:0/3067894844 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8c08108cf0 0x7f8c0819fcc0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8bf8005cc0 tx=0x7f8bf802f380 comp rx=0 tx=0).stop 2024-09-21T06:35:05.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:05.016+0000 7f8c0e406640 1 -- 172.21.15.7:0/3067894844 reap_dead start 2024-09-21T06:35:05.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:05.016+0000 7f8c0fe69640 1 -- 172.21.15.7:0/3067894844 shutdown_connections 2024-09-21T06:35:05.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:05.016+0000 7f8c0fe69640 1 -- 172.21.15.7:0/3067894844 >> 172.21.15.7:0/3067894844 conn(0x7f8c08079730 msgr2=0x7f8c0806b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:05.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:05.016+0000 7f8c0fe69640 1 -- 172.21.15.7:0/3067894844 shutdown_connections 2024-09-21T06:35:05.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:05.016+0000 7f8c0fe69640 1 -- 172.21.15.7:0/3067894844 wait complete. 2024-09-21T06:35:05.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:05.179+0000 7f11af32a640 1 -- 172.21.15.7:0/1893660132 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11a8102fa0 msgr2=0x7f11a810fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:05.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:05.179+0000 7f11af32a640 1 --2- 172.21.15.7:0/1893660132 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11a8102fa0 0x7f11a810fcc0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f1198009900 tx=0x7f119802a480 comp rx=0 tx=0).stop 2024-09-21T06:35:05.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:05.179+0000 7f11af32a640 1 -- 172.21.15.7:0/1893660132 shutdown_connections 2024-09-21T06:35:05.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:05.179+0000 7f11af32a640 1 --2- 172.21.15.7:0/1893660132 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11a8110200 0x7f11a8112620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:05.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:05.179+0000 7f11af32a640 1 --2- 172.21.15.7:0/1893660132 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11a8102fa0 0x7f11a810fcc0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:05.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:05.179+0000 7f11af32a640 1 --2- 172.21.15.7:0/1893660132 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f11a8102650 0x7f11a8102a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:05.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:05.179+0000 7f11af32a640 1 -- 172.21.15.7:0/1893660132 >> 172.21.15.7:0/1893660132 conn(0x7f11a8079760 msgr2=0x7f11a8079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:05.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:05.179+0000 7f11af32a640 1 -- 172.21.15.7:0/1893660132 shutdown_connections 2024-09-21T06:35:05.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:05.179+0000 7f11af32a640 1 -- 172.21.15.7:0/1893660132 wait complete. 2024-09-21T06:35:05.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:05.180+0000 7f11af32a640 1 Processor -- start 2024-09-21T06:35:05.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:05.180+0000 7f11af32a640 1 -- start start 2024-09-21T06:35:05.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:05.180+0000 7f11af32a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f11a8102650 0x7f11a819c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:05.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:05.180+0000 7f11af32a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11a8102fa0 0x7f11a819cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:05.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:05.180+0000 7f11af32a640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11a8110200 0x7f11a81a1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:05.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:05.180+0000 7f11af32a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f11a8115ca0 con 0x7f11a8102fa0 2024-09-21T06:35:05.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:05.180+0000 7f11af32a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f11a8115b20 con 0x7f11a8102650 2024-09-21T06:35:05.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:05.180+0000 7f11af32a640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f11a8115e20 con 0x7f11a8110200 2024-09-21T06:35:05.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:05.180+0000 7f11ac8c5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11a8102fa0 0x7f11a819cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:05.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:05.180+0000 7f11ac8c5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11a8102fa0 0x7f11a819cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35124/0 (socket says 172.21.15.7:35124) 2024-09-21T06:35:05.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:05.180+0000 7f11ac8c5640 1 -- 172.21.15.7:0/1790291242 learned_addr learned my addr 172.21.15.7:0/1790291242 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:35:05.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:05.180+0000 7f11ad0c6640 1 --2- 172.21.15.7:0/1790291242 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f11a8102650 0x7f11a819c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:05.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:05.180+0000 7f11ad8c7640 1 --2- 172.21.15.7:0/1790291242 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11a8110200 0x7f11a81a1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:05.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:05.180+0000 7f11ac8c5640 1 -- 172.21.15.7:0/1790291242 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11a8110200 msgr2=0x7f11a81a1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:05.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:05.180+0000 7f11ac8c5640 1 --2- 172.21.15.7:0/1790291242 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f11a8110200 0x7f11a81a1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:05.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:05.180+0000 7f11ac8c5640 1 -- 172.21.15.7:0/1790291242 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f11a8102650 msgr2=0x7f11a819c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:05.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:05.180+0000 7f11ac8c5640 1 --2- 172.21.15.7:0/1790291242 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f11a8102650 0x7f11a819c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:05.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:05.180+0000 7f11ac8c5640 1 -- 172.21.15.7:0/1790291242 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11a81a2620 con 0x7f11a8102fa0 2024-09-21T06:35:05.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:05.181+0000 7f11ac8c5640 1 --2- 172.21.15.7:0/1790291242 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11a8102fa0 0x7f11a819cc50 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f1198005940 tx=0x7f11980042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:05.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:05.181+0000 7f119e7fc640 1 -- 172.21.15.7:0/1790291242 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f119803f030 con 0x7f11a8102fa0 2024-09-21T06:35:05.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:05.181+0000 7f11af32a640 1 -- 172.21.15.7:0/1790291242 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11a81a28b0 con 0x7f11a8102fa0 2024-09-21T06:35:05.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:05.181+0000 7f119e7fc640 1 -- 172.21.15.7:0/1790291242 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1198003cb0 con 0x7f11a8102fa0 2024-09-21T06:35:05.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:05.181+0000 7f119e7fc640 1 -- 172.21.15.7:0/1790291242 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1198035070 con 0x7f11a8102fa0 2024-09-21T06:35:05.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:05.181+0000 7f11af32a640 1 -- 172.21.15.7:0/1790291242 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11a81a9070 con 0x7f11a8102fa0 2024-09-21T06:35:05.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:05.182+0000 7f11af32a640 1 -- 172.21.15.7:0/1790291242 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f11a81096d0 con 0x7f11a8102fa0 2024-09-21T06:35:05.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:05.183+0000 7f119e7fc640 1 -- 172.21.15.7:0/1790291242 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154579+0+0 (secure 0 0 0) 0x7f1198042030 con 0x7f11a8102fa0 2024-09-21T06:35:05.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:05.184+0000 7f119e7fc640 1 --2- 172.21.15.7:0/1790291242 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f11940b65f0 0x7f11940b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:05.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:05.184+0000 7f11ad0c6640 1 --2- 172.21.15.7:0/1790291242 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f11940b65f0 0x7f11940b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:05.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:05.184+0000 7f119e7fc640 1 -- 172.21.15.7:0/1790291242 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f1198108000 con 0x7f11a8102fa0 2024-09-21T06:35:05.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:05.185+0000 7f119e7fc640 1 --2- 172.21.15.7:0/1790291242 >> [v2:172.21.15.144:6800/1699582162,v1:172.21.15.144:6801/1699582162] conn(0x7f11940c0260 0x7f11940c2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:05.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:05.185+0000 7f119e7fc640 1 -- 172.21.15.7:0/1790291242 --> [v2:172.21.15.144:6800/1699582162,v1:172.21.15.144:6801/1699582162] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f11940c2e20 con 0x7f11940c0260 2024-09-21T06:35:05.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:05.185+0000 7f119e7fc640 1 -- 172.21.15.7:0/1790291242 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f1198108430 con 0x7f11a8102fa0 2024-09-21T06:35:05.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:05.185+0000 7f11ad0c6640 1 --2- 172.21.15.7:0/1790291242 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f11940b65f0 0x7f11940b8b00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f11a4005d00 tx=0x7f11a400b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:05.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:05.185+0000 7f11ad8c7640 1 --2- 172.21.15.7:0/1790291242 >> [v2:172.21.15.144:6800/1699582162,v1:172.21.15.144:6801/1699582162] conn(0x7f11940c0260 0x7f11940c2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:05.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:05.185+0000 7f11ad8c7640 1 --2- 172.21.15.7:0/1790291242 >> [v2:172.21.15.144:6800/1699582162,v1:172.21.15.144:6801/1699582162] conn(0x7f11940c0260 0x7f11940c2750 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:05.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:05.186+0000 7f119e7fc640 1 -- 172.21.15.7:0/1790291242 <== osd.2 v2:172.21.15.144:6800/1699582162 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f11940c2e20 con 0x7f11940c0260 2024-09-21T06:35:05.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:05.200+0000 7f11af32a640 1 -- 172.21.15.7:0/1790291242 --> [v2:172.21.15.144:6800/1699582162,v1:172.21.15.144:6801/1699582162] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f11a806b350 con 0x7f11940c0260 2024-09-21T06:35:05.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:05.201+0000 7f119e7fc640 1 -- 172.21.15.7:0/1790291242 <== osd.2 v2:172.21.15.144:6800/1699582162 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f11a806b350 con 0x7f11940c0260 2024-09-21T06:35:05.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:05.201+0000 7f11af32a640 1 -- 172.21.15.7:0/1790291242 >> [v2:172.21.15.144:6800/1699582162,v1:172.21.15.144:6801/1699582162] conn(0x7f11940c0260 msgr2=0x7f11940c2750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:05.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:05.201+0000 7f11af32a640 1 --2- 172.21.15.7:0/1790291242 >> [v2:172.21.15.144:6800/1699582162,v1:172.21.15.144:6801/1699582162] conn(0x7f11940c0260 0x7f11940c2750 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:05.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:05.201+0000 7f11af32a640 1 -- 172.21.15.7:0/1790291242 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f11940b65f0 msgr2=0x7f11940b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:05.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:05.201+0000 7f11af32a640 1 --2- 172.21.15.7:0/1790291242 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f11940b65f0 0x7f11940b8b00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f11a4005d00 tx=0x7f11a400b410 comp rx=0 tx=0).stop 2024-09-21T06:35:05.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:05.201+0000 7f11af32a640 1 -- 172.21.15.7:0/1790291242 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11a8102fa0 msgr2=0x7f11a819cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:05.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:05.201+0000 7f11af32a640 1 --2- 172.21.15.7:0/1790291242 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f11a8102fa0 0x7f11a819cc50 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f1198005940 tx=0x7f11980042f0 comp rx=0 tx=0).stop 2024-09-21T06:35:05.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:05.201+0000 7f11ad8c7640 1 -- 172.21.15.7:0/1790291242 reap_dead start 2024-09-21T06:35:05.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:05.201+0000 7f11af32a640 1 -- 172.21.15.7:0/1790291242 shutdown_connections 2024-09-21T06:35:05.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:05.201+0000 7f11af32a640 1 -- 172.21.15.7:0/1790291242 >> 172.21.15.7:0/1790291242 conn(0x7f11a8079760 msgr2=0x7f11a8108c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:05.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:05.201+0000 7f11af32a640 1 -- 172.21.15.7:0/1790291242 shutdown_connections 2024-09-21T06:35:05.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:05.201+0000 7f11af32a640 1 -- 172.21.15.7:0/1790291242 wait complete. 2024-09-21T06:35:05.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:02.560+0000 7f474863f640 1 -- 172.21.15.7:0/1916281063 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4740106c80 msgr2=0x7f47401106d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:05.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:02.560+0000 7f474863f640 1 --2- 172.21.15.7:0/1916281063 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4740106c80 0x7f47401106d0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f4738009ca0 tx=0x7f473802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:35:05.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:02.560+0000 7f474863f640 1 -- 172.21.15.7:0/1916281063 shutdown_connections 2024-09-21T06:35:05.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:02.560+0000 7f474863f640 1 --2- 172.21.15.7:0/1916281063 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4740106c80 0x7f47401106d0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:05.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:02.560+0000 7f474863f640 1 --2- 172.21.15.7:0/1916281063 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4740106330 0x7f4740106740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:05.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:02.560+0000 7f474863f640 1 --2- 172.21.15.7:0/1916281063 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4740102140 0x7f4740102550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:05.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:02.560+0000 7f474863f640 1 -- 172.21.15.7:0/1916281063 >> 172.21.15.7:0/1916281063 conn(0x7f4740079ea0 msgr2=0x7f474007a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:05.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:02.560+0000 7f474863f640 1 -- 172.21.15.7:0/1916281063 shutdown_connections 2024-09-21T06:35:05.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:02.560+0000 7f474863f640 1 -- 172.21.15.7:0/1916281063 wait complete. 2024-09-21T06:35:05.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:02.561+0000 7f474863f640 1 Processor -- start 2024-09-21T06:35:05.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:02.561+0000 7f474863f640 1 -- start start 2024-09-21T06:35:05.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:02.561+0000 7f474863f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4740102140 0x7f47401030e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:05.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:02.561+0000 7f474863f640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4740106330 0x7f4740103620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:05.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:02.561+0000 7f474863f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4740106c80 0x7f4740103b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:05.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:02.561+0000 7f474863f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4740113b20 con 0x7f4740106c80 2024-09-21T06:35:05.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:02.561+0000 7f474863f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f47401139a0 con 0x7f4740102140 2024-09-21T06:35:05.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:02.561+0000 7f474863f640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4740113ca0 con 0x7f4740106330 2024-09-21T06:35:05.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:02.561+0000 7f4746bdc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4740106c80 0x7f4740103b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:05.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:02.561+0000 7f4746bdc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4740106c80 0x7f4740103b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35034/0 (socket says 172.21.15.7:35034) 2024-09-21T06:35:05.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:02.561+0000 7f4746bdc640 1 -- 172.21.15.7:0/3105006367 learned_addr learned my addr 172.21.15.7:0/3105006367 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:35:05.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:02.561+0000 7f47463db640 1 --2- 172.21.15.7:0/3105006367 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4740102140 0x7f47401030e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:05.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:02.562+0000 7f4745bda640 1 --2- 172.21.15.7:0/3105006367 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4740106330 0x7f4740103620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:05.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:02.562+0000 7f4746bdc640 1 -- 172.21.15.7:0/3105006367 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4740106330 msgr2=0x7f4740103620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:05.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:02.562+0000 7f4746bdc640 1 --2- 172.21.15.7:0/3105006367 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4740106330 0x7f4740103620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:05.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:02.562+0000 7f4746bdc640 1 -- 172.21.15.7:0/3105006367 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4740102140 msgr2=0x7f47401030e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:05.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:02.562+0000 7f4746bdc640 1 --2- 172.21.15.7:0/3105006367 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4740102140 0x7f47401030e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:05.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:02.562+0000 7f4746bdc640 1 -- 172.21.15.7:0/3105006367 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47401a86a0 con 0x7f4740106c80 2024-09-21T06:35:05.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:02.562+0000 7f4745bda640 1 --2- 172.21.15.7:0/3105006367 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4740106330 0x7f4740103620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:35:05.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:02.562+0000 7f4746bdc640 1 --2- 172.21.15.7:0/3105006367 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4740106c80 0x7f4740103b60 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4738005cc0 tx=0x7f473802f470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:05.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:02.562+0000 7f47377fe640 1 -- 172.21.15.7:0/3105006367 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4738003cf0 con 0x7f4740106c80 2024-09-21T06:35:05.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:02.562+0000 7f47377fe640 1 -- 172.21.15.7:0/3105006367 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f47380044f0 con 0x7f4740106c80 2024-09-21T06:35:05.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:02.562+0000 7f474863f640 1 -- 172.21.15.7:0/3105006367 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47401a8930 con 0x7f4740106c80 2024-09-21T06:35:05.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:02.562+0000 7f47377fe640 1 -- 172.21.15.7:0/3105006367 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f473802fc30 con 0x7f4740106c80 2024-09-21T06:35:05.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:02.562+0000 7f474863f640 1 -- 172.21.15.7:0/3105006367 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47401a8e70 con 0x7f4740106c80 2024-09-21T06:35:05.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:02.563+0000 7f474863f640 1 -- 172.21.15.7:0/3105006367 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4740063ad0 con 0x7f4740106c80 2024-09-21T06:35:05.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:02.565+0000 7f47377fe640 1 -- 172.21.15.7:0/3105006367 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154579+0+0 (secure 0 0 0) 0x7f47380046a0 con 0x7f4740106c80 2024-09-21T06:35:05.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:02.565+0000 7f47377fe640 1 --2- 172.21.15.7:0/3105006367 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f472c0b65f0 0x7f472c0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:05.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:02.565+0000 7f47463db640 1 --2- 172.21.15.7:0/3105006367 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f472c0b65f0 0x7f472c0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:05.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:02.566+0000 7f47377fe640 1 -- 172.21.15.7:0/3105006367 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f4738108ce0 con 0x7f4740106c80 2024-09-21T06:35:05.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:02.566+0000 7f47377fe640 1 --2- 172.21.15.7:0/3105006367 >> [v2:172.21.15.144:6808/2814586621,v1:172.21.15.144:6809/2814586621] conn(0x7f472c0c0260 0x7f472c0c2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:05.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:02.566+0000 7f47377fe640 1 -- 172.21.15.7:0/3105006367 --> [v2:172.21.15.144:6808/2814586621,v1:172.21.15.144:6809/2814586621] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f473803be90 con 0x7f472c0c0260 2024-09-21T06:35:05.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:02.566+0000 7f47377fe640 1 -- 172.21.15.7:0/3105006367 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f4738109110 con 0x7f4740106c80 2024-09-21T06:35:05.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:02.566+0000 7f47463db640 1 --2- 172.21.15.7:0/3105006367 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f472c0b65f0 0x7f472c0b8b00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f4740104b30 tx=0x7f473c00a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:05.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:02.566+0000 7f4745bda640 1 --2- 172.21.15.7:0/3105006367 >> [v2:172.21.15.144:6808/2814586621,v1:172.21.15.144:6809/2814586621] conn(0x7f472c0c0260 0x7f472c0c2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:05.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:02.566+0000 7f4745bda640 1 --2- 172.21.15.7:0/3105006367 >> [v2:172.21.15.144:6808/2814586621,v1:172.21.15.144:6809/2814586621] conn(0x7f472c0c0260 0x7f472c0c2750 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:05.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:02.568+0000 7f47377fe640 1 -- 172.21.15.7:0/3105006367 <== osd.5 v2:172.21.15.144:6808/2814586621 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f473803be90 con 0x7f472c0c0260 2024-09-21T06:35:05.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:02.582+0000 7f474863f640 1 -- 172.21.15.7:0/3105006367 --> [v2:172.21.15.144:6808/2814586621,v1:172.21.15.144:6809/2814586621] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4740063f50 con 0x7f472c0c0260 2024-09-21T06:35:05.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:02.582+0000 7f47377fe640 1 -- 172.21.15.7:0/3105006367 <== osd.5 v2:172.21.15.144:6808/2814586621 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f4740063f50 con 0x7f472c0c0260 2024-09-21T06:35:05.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:02.583+0000 7f474863f640 1 -- 172.21.15.7:0/3105006367 >> [v2:172.21.15.144:6808/2814586621,v1:172.21.15.144:6809/2814586621] conn(0x7f472c0c0260 msgr2=0x7f472c0c2750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:05.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:02.583+0000 7f474863f640 1 --2- 172.21.15.7:0/3105006367 >> [v2:172.21.15.144:6808/2814586621,v1:172.21.15.144:6809/2814586621] conn(0x7f472c0c0260 0x7f472c0c2750 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:05.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:02.583+0000 7f474863f640 1 -- 172.21.15.7:0/3105006367 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f472c0b65f0 msgr2=0x7f472c0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:05.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:02.583+0000 7f474863f640 1 --2- 172.21.15.7:0/3105006367 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f472c0b65f0 0x7f472c0b8b00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f4740104b30 tx=0x7f473c00a2d0 comp rx=0 tx=0).stop 2024-09-21T06:35:05.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:02.583+0000 7f474863f640 1 -- 172.21.15.7:0/3105006367 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4740106c80 msgr2=0x7f4740103b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:05.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:02.583+0000 7f474863f640 1 --2- 172.21.15.7:0/3105006367 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4740106c80 0x7f4740103b60 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4738005cc0 tx=0x7f473802f470 comp rx=0 tx=0).stop 2024-09-21T06:35:05.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:02.583+0000 7f4746bdc640 1 -- 172.21.15.7:0/3105006367 reap_dead start 2024-09-21T06:35:05.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:02.583+0000 7f474863f640 1 -- 172.21.15.7:0/3105006367 shutdown_connections 2024-09-21T06:35:05.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:02.583+0000 7f474863f640 1 -- 172.21.15.7:0/3105006367 >> 172.21.15.7:0/3105006367 conn(0x7f4740079ea0 msgr2=0x7f4740107540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:05.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:02.583+0000 7f474863f640 1 -- 172.21.15.7:0/3105006367 shutdown_connections 2024-09-21T06:35:05.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:02.583+0000 7f474863f640 1 -- 172.21.15.7:0/3105006367 wait complete. 2024-09-21T06:35:06.124 INFO:teuthology.orchestra.run.smithi007.stdout:154618822707 2024-09-21T06:35:06.124 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.5 2024-09-21T06:35:06.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:06.292+0000 7f27dadc1640 1 -- 172.21.15.7:0/2431322179 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27d41083a0 msgr2=0x7f27d41087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:06.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:06.292+0000 7f27dadc1640 1 --2- 172.21.15.7:0/2431322179 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27d41083a0 0x7f27d41087b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f27c0009900 tx=0x7f27c002a410 comp rx=0 tx=0).stop 2024-09-21T06:35:06.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:06.292+0000 7f27dadc1640 1 -- 172.21.15.7:0/2431322179 shutdown_connections 2024-09-21T06:35:06.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:06.292+0000 7f27dadc1640 1 --2- 172.21.15.7:0/2431322179 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27d4108cf0 0x7f27d410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:06.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:06.292+0000 7f27dadc1640 1 --2- 172.21.15.7:0/2431322179 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27d41083a0 0x7f27d41087b0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:06.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:06.292+0000 7f27dadc1640 1 --2- 172.21.15.7:0/2431322179 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f27d4102a60 0x7f27d4102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:06.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:06.292+0000 7f27dadc1640 1 -- 172.21.15.7:0/2431322179 >> 172.21.15.7:0/2431322179 conn(0x7f27d4079730 msgr2=0x7f27d4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:06.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:06.292+0000 7f27dadc1640 1 -- 172.21.15.7:0/2431322179 shutdown_connections 2024-09-21T06:35:06.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:06.292+0000 7f27dadc1640 1 -- 172.21.15.7:0/2431322179 wait complete. 2024-09-21T06:35:06.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:06.292+0000 7f27dadc1640 1 Processor -- start 2024-09-21T06:35:06.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:06.292+0000 7f27dadc1640 1 -- start start 2024-09-21T06:35:06.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:06.293+0000 7f27dadc1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27d4102a60 0x7f27d40ff670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:06.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:06.293+0000 7f27dadc1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27d41083a0 0x7f27d40ffbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:06.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:06.293+0000 7f27dadc1640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f27d4108cf0 0x7f27d41000f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:06.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:06.293+0000 7f27dadc1640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f27d4112960 con 0x7f27d4102a60 2024-09-21T06:35:06.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:06.293+0000 7f27dadc1640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f27d41127e0 con 0x7f27d41083a0 2024-09-21T06:35:06.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:06.293+0000 7f27dadc1640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f27d4112ae0 con 0x7f27d4108cf0 2024-09-21T06:35:06.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:06.293+0000 7f27d8b5d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27d4102a60 0x7f27d40ff670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:06.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:06.293+0000 7f27d8b5d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27d4102a60 0x7f27d40ff670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35146/0 (socket says 172.21.15.7:35146) 2024-09-21T06:35:06.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:06.293+0000 7f27d8b5d640 1 -- 172.21.15.7:0/191438336 learned_addr learned my addr 172.21.15.7:0/191438336 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:35:06.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:06.293+0000 7f27d3fff640 1 --2- 172.21.15.7:0/191438336 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27d41083a0 0x7f27d40ffbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:06.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:06.293+0000 7f27d935e640 1 --2- 172.21.15.7:0/191438336 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f27d4108cf0 0x7f27d41000f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:06.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:06.293+0000 7f27d8b5d640 1 -- 172.21.15.7:0/191438336 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f27d4108cf0 msgr2=0x7f27d41000f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:06.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:06.293+0000 7f27d8b5d640 1 --2- 172.21.15.7:0/191438336 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f27d4108cf0 0x7f27d41000f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:06.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:06.293+0000 7f27d8b5d640 1 -- 172.21.15.7:0/191438336 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27d41083a0 msgr2=0x7f27d40ffbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:06.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:06.293+0000 7f27d8b5d640 1 --2- 172.21.15.7:0/191438336 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27d41083a0 0x7f27d40ffbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:06.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:06.293+0000 7f27d8b5d640 1 -- 172.21.15.7:0/191438336 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27d41a8740 con 0x7f27d4102a60 2024-09-21T06:35:06.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:06.294+0000 7f27d8b5d640 1 --2- 172.21.15.7:0/191438336 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27d4102a60 0x7f27d40ff670 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f27c800e9f0 tx=0x7f27c800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:06.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:06.294+0000 7f27d1ffb640 1 -- 172.21.15.7:0/191438336 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27c800cd80 con 0x7f27d4102a60 2024-09-21T06:35:06.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:06.294+0000 7f27dadc1640 1 -- 172.21.15.7:0/191438336 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27d41a8a30 con 0x7f27d4102a60 2024-09-21T06:35:06.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:06.294+0000 7f27d1ffb640 1 -- 172.21.15.7:0/191438336 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27c80054d0 con 0x7f27d4102a60 2024-09-21T06:35:06.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:06.294+0000 7f27d1ffb640 1 -- 172.21.15.7:0/191438336 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27c8010690 con 0x7f27d4102a60 2024-09-21T06:35:06.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:06.294+0000 7f27dadc1640 1 -- 172.21.15.7:0/191438336 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27d41a8f40 con 0x7f27d4102a60 2024-09-21T06:35:06.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:06.295+0000 7f27dadc1640 1 -- 172.21.15.7:0/191438336 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f27d4063b10 con 0x7f27d4102a60 2024-09-21T06:35:06.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:06.297+0000 7f27d1ffb640 1 -- 172.21.15.7:0/191438336 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154579+0+0 (secure 0 0 0) 0x7f27c8004e90 con 0x7f27d4102a60 2024-09-21T06:35:06.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:06.297+0000 7f27d1ffb640 1 --2- 172.21.15.7:0/191438336 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f27c40b6670 0x7f27c40b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:06.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:06.298+0000 7f27d3fff640 1 --2- 172.21.15.7:0/191438336 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f27c40b6670 0x7f27c40b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:06.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:06.298+0000 7f27d1ffb640 1 -- 172.21.15.7:0/191438336 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f27c80e79a0 con 0x7f27d4102a60 2024-09-21T06:35:06.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:06.298+0000 7f27d1ffb640 1 --2- 172.21.15.7:0/191438336 >> [v2:172.21.15.7:6802/942632794,v1:172.21.15.7:6803/942632794] conn(0x7f27c40c02e0 0x7f27c40c27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:06.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:06.298+0000 7f27d1ffb640 1 -- 172.21.15.7:0/191438336 --> [v2:172.21.15.7:6802/942632794,v1:172.21.15.7:6803/942632794] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f27c8005320 con 0x7f27c40c02e0 2024-09-21T06:35:06.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:06.298+0000 7f27d1ffb640 1 -- 172.21.15.7:0/191438336 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f27c80ec2a0 con 0x7f27d4102a60 2024-09-21T06:35:06.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:06.298+0000 7f27d935e640 1 --2- 172.21.15.7:0/191438336 >> [v2:172.21.15.7:6802/942632794,v1:172.21.15.7:6803/942632794] conn(0x7f27c40c02e0 0x7f27c40c27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:06.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:06.298+0000 7f27d3fff640 1 --2- 172.21.15.7:0/191438336 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f27c40b6670 0x7f27c40b8b80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f27c0000c00 tx=0x7f27c0031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:06.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:06.298+0000 7f27d935e640 1 --2- 172.21.15.7:0/191438336 >> [v2:172.21.15.7:6802/942632794,v1:172.21.15.7:6803/942632794] conn(0x7f27c40c02e0 0x7f27c40c27d0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:06.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:06.299+0000 7f27d1ffb640 1 -- 172.21.15.7:0/191438336 <== osd.0 v2:172.21.15.7:6802/942632794 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f27c8005320 con 0x7f27c40c02e0 2024-09-21T06:35:06.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:06.314+0000 7f27dadc1640 1 -- 172.21.15.7:0/191438336 --> [v2:172.21.15.7:6802/942632794,v1:172.21.15.7:6803/942632794] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f27d4063fc0 con 0x7f27c40c02e0 2024-09-21T06:35:06.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:06.315+0000 7f27d1ffb640 1 -- 172.21.15.7:0/191438336 <== osd.0 v2:172.21.15.7:6802/942632794 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f27d4063fc0 con 0x7f27c40c02e0 2024-09-21T06:35:06.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:06.315+0000 7f27dadc1640 1 -- 172.21.15.7:0/191438336 >> [v2:172.21.15.7:6802/942632794,v1:172.21.15.7:6803/942632794] conn(0x7f27c40c02e0 msgr2=0x7f27c40c27d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:06.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:06.315+0000 7f27dadc1640 1 --2- 172.21.15.7:0/191438336 >> [v2:172.21.15.7:6802/942632794,v1:172.21.15.7:6803/942632794] conn(0x7f27c40c02e0 0x7f27c40c27d0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:06.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:06.315+0000 7f27dadc1640 1 -- 172.21.15.7:0/191438336 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f27c40b6670 msgr2=0x7f27c40b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:06.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:06.315+0000 7f27dadc1640 1 --2- 172.21.15.7:0/191438336 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f27c40b6670 0x7f27c40b8b80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f27c0000c00 tx=0x7f27c0031400 comp rx=0 tx=0).stop 2024-09-21T06:35:06.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:06.315+0000 7f27dadc1640 1 -- 172.21.15.7:0/191438336 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27d4102a60 msgr2=0x7f27d40ff670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:06.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:06.315+0000 7f27dadc1640 1 --2- 172.21.15.7:0/191438336 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f27d4102a60 0x7f27d40ff670 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f27c800e9f0 tx=0x7f27c800edf0 comp rx=0 tx=0).stop 2024-09-21T06:35:06.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:06.315+0000 7f27d935e640 1 -- 172.21.15.7:0/191438336 reap_dead start 2024-09-21T06:35:06.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:06.315+0000 7f27dadc1640 1 -- 172.21.15.7:0/191438336 shutdown_connections 2024-09-21T06:35:06.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:06.315+0000 7f27dadc1640 1 -- 172.21.15.7:0/191438336 >> 172.21.15.7:0/191438336 conn(0x7f27d4079730 msgr2=0x7f27d406b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:06.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:06.316+0000 7f27dadc1640 1 -- 172.21.15.7:0/191438336 shutdown_connections 2024-09-21T06:35:06.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:06.316+0000 7f27dadc1640 1 -- 172.21.15.7:0/191438336 wait complete. 2024-09-21T06:35:06.405 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:35:06 smithi007 ceph-mon[30983]: pgmap v286: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-21T06:35:06.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:35:06 smithi018 ceph-mon[34477]: pgmap v286: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-21T06:35:06.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:35:06 smithi144 ceph-mon[34653]: pgmap v286: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-21T06:35:07.110 INFO:teuthology.orchestra.run.smithi007.stdout:223338299428 2024-09-21T06:35:07.111 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.8 2024-09-21T06:35:07.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:07.308+0000 7f9e98769640 1 -- 172.21.15.7:0/1095833788 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e901094a0 msgr2=0x7f9e901098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:07.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:07.308+0000 7f9e98769640 1 --2- 172.21.15.7:0/1095833788 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e901094a0 0x7f9e901098b0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f9e80009900 tx=0x7f9e8002a410 comp rx=0 tx=0).stop 2024-09-21T06:35:07.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:07.308+0000 7f9e98769640 1 -- 172.21.15.7:0/1095833788 shutdown_connections 2024-09-21T06:35:07.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:07.308+0000 7f9e98769640 1 --2- 172.21.15.7:0/1095833788 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9e90109df0 0x7f9e90110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:07.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:07.308+0000 7f9e98769640 1 --2- 172.21.15.7:0/1095833788 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e901094a0 0x7f9e901098b0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:07.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:07.308+0000 7f9e98769640 1 --2- 172.21.15.7:0/1095833788 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e90103b60 0x7f9e90103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:07.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:07.308+0000 7f9e98769640 1 -- 172.21.15.7:0/1095833788 >> 172.21.15.7:0/1095833788 conn(0x7f9e9007b850 msgr2=0x7f9e9007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:07.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:07.308+0000 7f9e98769640 1 -- 172.21.15.7:0/1095833788 shutdown_connections 2024-09-21T06:35:07.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:07.308+0000 7f9e98769640 1 -- 172.21.15.7:0/1095833788 wait complete. 2024-09-21T06:35:07.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:07.309+0000 7f9e98769640 1 Processor -- start 2024-09-21T06:35:07.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:07.309+0000 7f9e98769640 1 -- start start 2024-09-21T06:35:07.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:07.309+0000 7f9e98769640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e90103b60 0x7f9e90075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:07.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:07.309+0000 7f9e98769640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e901094a0 0x7f9e90075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:07.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:07.309+0000 7f9e98769640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9e90109df0 0x7f9e90076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:07.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:07.309+0000 7f9e98769640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9e90113b00 con 0x7f9e90103b60 2024-09-21T06:35:07.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:07.309+0000 7f9e98769640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9e90113980 con 0x7f9e901094a0 2024-09-21T06:35:07.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:07.309+0000 7f9e98769640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9e90113c80 con 0x7f9e90109df0 2024-09-21T06:35:07.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:07.309+0000 7f9e96505640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e90103b60 0x7f9e90075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:07.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:07.309+0000 7f9e96505640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e90103b60 0x7f9e90075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35160/0 (socket says 172.21.15.7:35160) 2024-09-21T06:35:07.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:07.309+0000 7f9e96505640 1 -- 172.21.15.7:0/3648723526 learned_addr learned my addr 172.21.15.7:0/3648723526 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:35:07.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:07.310+0000 7f9e95d04640 1 --2- 172.21.15.7:0/3648723526 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e901094a0 0x7f9e90075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:07.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:07.310+0000 7f9e96d06640 1 --2- 172.21.15.7:0/3648723526 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9e90109df0 0x7f9e90076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:07.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:07.310+0000 7f9e96505640 1 -- 172.21.15.7:0/3648723526 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9e90109df0 msgr2=0x7f9e90076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:07.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:07.310+0000 7f9e96505640 1 --2- 172.21.15.7:0/3648723526 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9e90109df0 0x7f9e90076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:07.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:07.310+0000 7f9e96505640 1 -- 172.21.15.7:0/3648723526 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e901094a0 msgr2=0x7f9e90075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:07.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:07.310+0000 7f9e96505640 1 --2- 172.21.15.7:0/3648723526 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e901094a0 0x7f9e90075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:07.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:07.310+0000 7f9e96505640 1 -- 172.21.15.7:0/3648723526 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e901a87b0 con 0x7f9e90103b60 2024-09-21T06:35:07.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:07.310+0000 7f9e96505640 1 --2- 172.21.15.7:0/3648723526 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e90103b60 0x7f9e90075710 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c00e9f0 tx=0x7f9e8c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:07.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:07.310+0000 7f9e877fe640 1 -- 172.21.15.7:0/3648723526 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e8c00cd80 con 0x7f9e90103b60 2024-09-21T06:35:07.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:07.310+0000 7f9e98769640 1 -- 172.21.15.7:0/3648723526 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e901a8aa0 con 0x7f9e90103b60 2024-09-21T06:35:07.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:07.310+0000 7f9e877fe640 1 -- 172.21.15.7:0/3648723526 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e8c0108e0 con 0x7f9e90103b60 2024-09-21T06:35:07.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:07.310+0000 7f9e877fe640 1 -- 172.21.15.7:0/3648723526 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e8c018980 con 0x7f9e90103b60 2024-09-21T06:35:07.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:07.310+0000 7f9e98769640 1 -- 172.21.15.7:0/3648723526 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e901a9000 con 0x7f9e90103b60 2024-09-21T06:35:07.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:07.312+0000 7f9e98769640 1 -- 172.21.15.7:0/3648723526 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9e90063b50 con 0x7f9e90103b60 2024-09-21T06:35:07.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:07.314+0000 7f9e877fe640 1 -- 172.21.15.7:0/3648723526 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154579+0+0 (secure 0 0 0) 0x7f9e8c010430 con 0x7f9e90103b60 2024-09-21T06:35:07.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:07.314+0000 7f9e877fe640 1 --2- 172.21.15.7:0/3648723526 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f9e7c0b6670 0x7f9e7c0b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:07.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:07.314+0000 7f9e95d04640 1 --2- 172.21.15.7:0/3648723526 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f9e7c0b6670 0x7f9e7c0b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:07.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:07.314+0000 7f9e877fe640 1 -- 172.21.15.7:0/3648723526 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f9e8c0e7ff0 con 0x7f9e90103b60 2024-09-21T06:35:07.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:07.315+0000 7f9e877fe640 1 --2- 172.21.15.7:0/3648723526 >> [v2:172.21.15.18:6816/1322408496,v1:172.21.15.18:6817/1322408496] conn(0x7f9e7c0c02e0 0x7f9e7c0c27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:07.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:07.315+0000 7f9e877fe640 1 -- 172.21.15.7:0/3648723526 --> [v2:172.21.15.18:6816/1322408496,v1:172.21.15.18:6817/1322408496] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9e8c01ce70 con 0x7f9e7c0c02e0 2024-09-21T06:35:07.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:07.315+0000 7f9e877fe640 1 -- 172.21.15.7:0/3648723526 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f9e8c0e83e0 con 0x7f9e90103b60 2024-09-21T06:35:07.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:07.315+0000 7f9e95d04640 1 --2- 172.21.15.7:0/3648723526 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f9e7c0b6670 0x7f9e7c0b8b80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9e8002aa00 tx=0x7f9e80005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:07.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:07.315+0000 7f9e96d06640 1 --2- 172.21.15.7:0/3648723526 >> [v2:172.21.15.18:6816/1322408496,v1:172.21.15.18:6817/1322408496] conn(0x7f9e7c0c02e0 0x7f9e7c0c27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:07.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:07.316+0000 7f9e96d06640 1 --2- 172.21.15.7:0/3648723526 >> [v2:172.21.15.18:6816/1322408496,v1:172.21.15.18:6817/1322408496] conn(0x7f9e7c0c02e0 0x7f9e7c0c27d0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:07.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:07.316+0000 7f9e877fe640 1 -- 172.21.15.7:0/3648723526 <== osd.7 v2:172.21.15.18:6816/1322408496 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9e8c01ce70 con 0x7f9e7c0c02e0 2024-09-21T06:35:07.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:07.331+0000 7f9e98769640 1 -- 172.21.15.7:0/3648723526 --> [v2:172.21.15.18:6816/1322408496,v1:172.21.15.18:6817/1322408496] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9e90064000 con 0x7f9e7c0c02e0 2024-09-21T06:35:07.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:07.331+0000 7f9e877fe640 1 -- 172.21.15.7:0/3648723526 <== osd.7 v2:172.21.15.18:6816/1322408496 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f9e90064000 con 0x7f9e7c0c02e0 2024-09-21T06:35:07.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:07.332+0000 7f9e98769640 1 -- 172.21.15.7:0/3648723526 >> [v2:172.21.15.18:6816/1322408496,v1:172.21.15.18:6817/1322408496] conn(0x7f9e7c0c02e0 msgr2=0x7f9e7c0c27d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:07.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:07.332+0000 7f9e98769640 1 --2- 172.21.15.7:0/3648723526 >> [v2:172.21.15.18:6816/1322408496,v1:172.21.15.18:6817/1322408496] conn(0x7f9e7c0c02e0 0x7f9e7c0c27d0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:07.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:07.332+0000 7f9e98769640 1 -- 172.21.15.7:0/3648723526 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f9e7c0b6670 msgr2=0x7f9e7c0b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:07.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:07.332+0000 7f9e98769640 1 --2- 172.21.15.7:0/3648723526 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f9e7c0b6670 0x7f9e7c0b8b80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9e8002aa00 tx=0x7f9e80005a20 comp rx=0 tx=0).stop 2024-09-21T06:35:07.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:07.332+0000 7f9e98769640 1 -- 172.21.15.7:0/3648723526 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e90103b60 msgr2=0x7f9e90075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:07.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:07.332+0000 7f9e98769640 1 --2- 172.21.15.7:0/3648723526 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9e90103b60 0x7f9e90075710 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c00e9f0 tx=0x7f9e8c00eeb0 comp rx=0 tx=0).stop 2024-09-21T06:35:07.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:07.332+0000 7f9e96d06640 1 -- 172.21.15.7:0/3648723526 reap_dead start 2024-09-21T06:35:07.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:07.332+0000 7f9e98769640 1 -- 172.21.15.7:0/3648723526 shutdown_connections 2024-09-21T06:35:07.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:07.332+0000 7f9e98769640 1 -- 172.21.15.7:0/3648723526 >> 172.21.15.7:0/3648723526 conn(0x7f9e9007b850 msgr2=0x7f9e90107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:07.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:07.332+0000 7f9e98769640 1 -- 172.21.15.7:0/3648723526 shutdown_connections 2024-09-21T06:35:07.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:07.332+0000 7f9e98769640 1 -- 172.21.15.7:0/3648723526 wait complete. 2024-09-21T06:35:08.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:35:08 smithi007 ceph-mon[30983]: pgmap v287: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-21T06:35:08.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:35:08 smithi018 ceph-mon[34477]: pgmap v287: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-21T06:35:08.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:35:08 smithi144 ceph-mon[34653]: pgmap v287: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 597 B/s wr, 5 op/s 2024-09-21T06:35:08.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.861+0000 7f9331833640 1 -- 172.21.15.7:0/1913386735 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f932c108d10 msgr2=0x7f932c10f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:08.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.861+0000 7f9331833640 1 --2- 172.21.15.7:0/1913386735 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f932c108d10 0x7f932c10f540 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f9324009ca0 tx=0x7f932402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:35:08.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.861+0000 7f9331833640 1 -- 172.21.15.7:0/1913386735 shutdown_connections 2024-09-21T06:35:08.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.861+0000 7f9331833640 1 --2- 172.21.15.7:0/1913386735 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f932c108d10 0x7f932c10f540 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:08.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.861+0000 7f9331833640 1 --2- 172.21.15.7:0/1913386735 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f932c1083c0 0x7f932c1087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:08.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.861+0000 7f9331833640 1 --2- 172.21.15.7:0/1913386735 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f932c102a80 0x7f932c102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:08.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.861+0000 7f9331833640 1 -- 172.21.15.7:0/1913386735 >> 172.21.15.7:0/1913386735 conn(0x7f932c079740 msgr2=0x7f932c079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:08.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.861+0000 7f9331833640 1 -- 172.21.15.7:0/1913386735 shutdown_connections 2024-09-21T06:35:08.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.861+0000 7f9331833640 1 -- 172.21.15.7:0/1913386735 wait complete. 2024-09-21T06:35:08.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.862+0000 7f9331833640 1 Processor -- start 2024-09-21T06:35:08.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.862+0000 7f9331833640 1 -- start start 2024-09-21T06:35:08.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.862+0000 7f9331833640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f932c102a80 0x7f932c199420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:08.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.862+0000 7f9331833640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f932c1083c0 0x7f932c1999c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:08.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.862+0000 7f9331833640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f932c108d10 0x7f932c19ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:08.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.862+0000 7f9331833640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f932c1129d0 con 0x7f932c102a80 2024-09-21T06:35:08.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.862+0000 7f9331833640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f932c112850 con 0x7f932c108d10 2024-09-21T06:35:08.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.862+0000 7f9331833640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f932c112b50 con 0x7f932c1083c0 2024-09-21T06:35:08.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.862+0000 7f932affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f932c102a80 0x7f932c199420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:08.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.862+0000 7f932affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f932c102a80 0x7f932c199420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35202/0 (socket says 172.21.15.7:35202) 2024-09-21T06:35:08.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.863+0000 7f932affd640 1 -- 172.21.15.7:0/1728516365 learned_addr learned my addr 172.21.15.7:0/1728516365 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:35:08.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.863+0000 7f932b7fe640 1 --2- 172.21.15.7:0/1728516365 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f932c108d10 0x7f932c19ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:08.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.863+0000 7f932a7fc640 1 --2- 172.21.15.7:0/1728516365 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f932c1083c0 0x7f932c1999c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:08.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.863+0000 7f932affd640 1 -- 172.21.15.7:0/1728516365 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f932c1083c0 msgr2=0x7f932c1999c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:08.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.863+0000 7f932affd640 1 --2- 172.21.15.7:0/1728516365 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f932c1083c0 0x7f932c1999c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:08.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.863+0000 7f932affd640 1 -- 172.21.15.7:0/1728516365 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f932c108d10 msgr2=0x7f932c19ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:08.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.863+0000 7f932affd640 1 --2- 172.21.15.7:0/1728516365 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f932c108d10 0x7f932c19ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:08.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.863+0000 7f932affd640 1 -- 172.21.15.7:0/1728516365 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f932c19f2d0 con 0x7f932c102a80 2024-09-21T06:35:08.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.863+0000 7f932affd640 1 --2- 172.21.15.7:0/1728516365 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f932c102a80 0x7f932c199420 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f931c00e9f0 tx=0x7f931c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:08.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.863+0000 7f9330831640 1 -- 172.21.15.7:0/1728516365 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f931c00cd80 con 0x7f932c102a80 2024-09-21T06:35:08.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.863+0000 7f9331833640 1 -- 172.21.15.7:0/1728516365 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f932c19f5c0 con 0x7f932c102a80 2024-09-21T06:35:08.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.863+0000 7f9330831640 1 -- 172.21.15.7:0/1728516365 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f931c0108e0 con 0x7f932c102a80 2024-09-21T06:35:08.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.863+0000 7f9330831640 1 -- 172.21.15.7:0/1728516365 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f931c018980 con 0x7f932c102a80 2024-09-21T06:35:08.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.863+0000 7f9331833640 1 -- 172.21.15.7:0/1728516365 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f932c1a5de0 con 0x7f932c102a80 2024-09-21T06:35:08.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.864+0000 7f9331833640 1 -- 172.21.15.7:0/1728516365 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f932c063ad0 con 0x7f932c102a80 2024-09-21T06:35:08.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.866+0000 7f9330831640 1 -- 172.21.15.7:0/1728516365 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154579+0+0 (secure 0 0 0) 0x7f931c010430 con 0x7f932c102a80 2024-09-21T06:35:08.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.867+0000 7f9330831640 1 --2- 172.21.15.7:0/1728516365 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f93140b6620 0x7f93140b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:08.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.867+0000 7f932a7fc640 1 --2- 172.21.15.7:0/1728516365 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f93140b6620 0x7f93140b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:08.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.867+0000 7f9330831640 1 -- 172.21.15.7:0/1728516365 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f931c0e80a0 con 0x7f932c102a80 2024-09-21T06:35:08.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.867+0000 7f9330831640 1 --2- 172.21.15.7:0/1728516365 >> [v2:172.21.15.18:6808/1058105724,v1:172.21.15.18:6809/1058105724] conn(0x7f93140c0290 0x7f93140c2780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:08.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.867+0000 7f9330831640 1 -- 172.21.15.7:0/1728516365 --> [v2:172.21.15.18:6808/1058105724,v1:172.21.15.18:6809/1058105724] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f931c00ae50 con 0x7f93140c0290 2024-09-21T06:35:08.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.867+0000 7f9330831640 1 -- 172.21.15.7:0/1728516365 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f931c0e8450 con 0x7f932c102a80 2024-09-21T06:35:08.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.867+0000 7f932a7fc640 1 --2- 172.21.15.7:0/1728516365 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f93140b6620 0x7f93140b8b30 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f932c06b1f0 tx=0x7f932000c4a0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:08.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.867+0000 7f932b7fe640 1 --2- 172.21.15.7:0/1728516365 >> [v2:172.21.15.18:6808/1058105724,v1:172.21.15.18:6809/1058105724] conn(0x7f93140c0290 0x7f93140c2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:08.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.868+0000 7f932b7fe640 1 --2- 172.21.15.7:0/1728516365 >> [v2:172.21.15.18:6808/1058105724,v1:172.21.15.18:6809/1058105724] conn(0x7f93140c0290 0x7f93140c2780 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:08.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.869+0000 7f9330831640 1 -- 172.21.15.7:0/1728516365 <== osd.4 v2:172.21.15.18:6808/1058105724 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f931c00ae50 con 0x7f93140c0290 2024-09-21T06:35:08.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.883+0000 7f9331833640 1 -- 172.21.15.7:0/1728516365 --> [v2:172.21.15.18:6808/1058105724,v1:172.21.15.18:6809/1058105724] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f932c063f00 con 0x7f93140c0290 2024-09-21T06:35:08.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.883+0000 7f9330831640 1 -- 172.21.15.7:0/1728516365 <== osd.4 v2:172.21.15.18:6808/1058105724 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f932c063f00 con 0x7f93140c0290 2024-09-21T06:35:08.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.883+0000 7f9331833640 1 -- 172.21.15.7:0/1728516365 >> [v2:172.21.15.18:6808/1058105724,v1:172.21.15.18:6809/1058105724] conn(0x7f93140c0290 msgr2=0x7f93140c2780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:08.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.883+0000 7f9331833640 1 --2- 172.21.15.7:0/1728516365 >> [v2:172.21.15.18:6808/1058105724,v1:172.21.15.18:6809/1058105724] conn(0x7f93140c0290 0x7f93140c2780 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:08.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.883+0000 7f9331833640 1 -- 172.21.15.7:0/1728516365 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f93140b6620 msgr2=0x7f93140b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:08.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.883+0000 7f9331833640 1 --2- 172.21.15.7:0/1728516365 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f93140b6620 0x7f93140b8b30 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f932c06b1f0 tx=0x7f932000c4a0 comp rx=0 tx=0).stop 2024-09-21T06:35:08.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.883+0000 7f9331833640 1 -- 172.21.15.7:0/1728516365 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f932c102a80 msgr2=0x7f932c199420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:08.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.884+0000 7f9331833640 1 --2- 172.21.15.7:0/1728516365 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f932c102a80 0x7f932c199420 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f931c00e9f0 tx=0x7f931c00eeb0 comp rx=0 tx=0).stop 2024-09-21T06:35:08.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.884+0000 7f932b7fe640 1 -- 172.21.15.7:0/1728516365 reap_dead start 2024-09-21T06:35:08.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.884+0000 7f9331833640 1 -- 172.21.15.7:0/1728516365 shutdown_connections 2024-09-21T06:35:08.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.884+0000 7f9331833640 1 -- 172.21.15.7:0/1728516365 >> 172.21.15.7:0/1728516365 conn(0x7f932c079740 msgr2=0x7f932c104430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:08.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.884+0000 7f9331833640 1 -- 172.21.15.7:0/1728516365 shutdown_connections 2024-09-21T06:35:08.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.884+0000 7f9331833640 1 -- 172.21.15.7:0/1728516365 wait complete. 2024-09-21T06:35:09.312 INFO:teuthology.orchestra.run.smithi007.stdout:249108103199 2024-09-21T06:35:09.313 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.9 2024-09-21T06:35:09.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:09.494+0000 7f152ac63640 1 -- 172.21.15.7:0/4032339619 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1524103b80 msgr2=0x7f1524103f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:09.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:09.494+0000 7f152ac63640 1 --2- 172.21.15.7:0/4032339619 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1524103b80 0x7f1524103f90 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f1518009900 tx=0x7f151802a410 comp rx=0 tx=0).stop 2024-09-21T06:35:09.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:09.494+0000 7f152ac63640 1 -- 172.21.15.7:0/4032339619 shutdown_connections 2024-09-21T06:35:09.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:09.494+0000 7f152ac63640 1 --2- 172.21.15.7:0/4032339619 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1524109e10 0x7f1524110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:09.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:09.494+0000 7f152ac63640 1 --2- 172.21.15.7:0/4032339619 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15241094c0 0x7f15241098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:09.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:09.494+0000 7f152ac63640 1 --2- 172.21.15.7:0/4032339619 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1524103b80 0x7f1524103f90 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:09.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:09.494+0000 7f152ac63640 1 -- 172.21.15.7:0/4032339619 >> 172.21.15.7:0/4032339619 conn(0x7f15240ff610 msgr2=0x7f1524101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:09.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:09.494+0000 7f152ac63640 1 -- 172.21.15.7:0/4032339619 shutdown_connections 2024-09-21T06:35:09.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:09.494+0000 7f152ac63640 1 -- 172.21.15.7:0/4032339619 wait complete. 2024-09-21T06:35:09.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:09.495+0000 7f152ac63640 1 Processor -- start 2024-09-21T06:35:09.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:09.495+0000 7f152ac63640 1 -- start start 2024-09-21T06:35:09.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:09.495+0000 7f152ac63640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1524103b80 0x7f152419a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:09.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:09.496+0000 7f152ac63640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f15241094c0 0x7f152419aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:09.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:09.496+0000 7f152ac63640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1524109e10 0x7f152419fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:09.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:09.496+0000 7f152ac63640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1524113ad0 con 0x7f15241094c0 2024-09-21T06:35:09.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:09.496+0000 7f152ac63640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1524113950 con 0x7f1524109e10 2024-09-21T06:35:09.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:09.496+0000 7f152ac63640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1524113c50 con 0x7f1524103b80 2024-09-21T06:35:09.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:09.496+0000 7f1523fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f15241094c0 0x7f152419aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:09.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:09.496+0000 7f1523fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f15241094c0 0x7f152419aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35222/0 (socket says 172.21.15.7:35222) 2024-09-21T06:35:09.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:09.496+0000 7f1523fff640 1 -- 172.21.15.7:0/4229361567 learned_addr learned my addr 172.21.15.7:0/4229361567 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:35:09.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:09.496+0000 7f15289ff640 1 --2- 172.21.15.7:0/4229361567 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1524103b80 0x7f152419a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:09.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:09.496+0000 7f1529200640 1 --2- 172.21.15.7:0/4229361567 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1524109e10 0x7f152419fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:09.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:09.496+0000 7f1523fff640 1 -- 172.21.15.7:0/4229361567 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1524103b80 msgr2=0x7f152419a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:09.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:09.496+0000 7f1523fff640 1 --2- 172.21.15.7:0/4229361567 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1524103b80 0x7f152419a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:09.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:09.496+0000 7f1523fff640 1 -- 172.21.15.7:0/4229361567 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1524109e10 msgr2=0x7f152419fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:09.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:09.496+0000 7f1523fff640 1 --2- 172.21.15.7:0/4229361567 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1524109e10 0x7f152419fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:09.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:09.496+0000 7f1523fff640 1 -- 172.21.15.7:0/4229361567 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15241a0430 con 0x7f15241094c0 2024-09-21T06:35:09.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:09.496+0000 7f1523fff640 1 --2- 172.21.15.7:0/4229361567 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f15241094c0 0x7f152419aa60 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f151000d950 tx=0x7f151000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:09.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:09.497+0000 7f1521ffb640 1 -- 172.21.15.7:0/4229361567 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1510017070 con 0x7f15241094c0 2024-09-21T06:35:09.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:09.497+0000 7f1521ffb640 1 -- 172.21.15.7:0/4229361567 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1510009c30 con 0x7f15241094c0 2024-09-21T06:35:09.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:09.497+0000 7f152ac63640 1 -- 172.21.15.7:0/4229361567 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15241a0720 con 0x7f15241094c0 2024-09-21T06:35:09.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:09.497+0000 7f1521ffb640 1 -- 172.21.15.7:0/4229361567 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15100047a0 con 0x7f15241094c0 2024-09-21T06:35:09.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:09.497+0000 7f152ac63640 1 -- 172.21.15.7:0/4229361567 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15241a6e80 con 0x7f15241094c0 2024-09-21T06:35:09.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:09.498+0000 7f152ac63640 1 -- 172.21.15.7:0/4229361567 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1524063b50 con 0x7f15241094c0 2024-09-21T06:35:09.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:09.500+0000 7f1521ffb640 1 -- 172.21.15.7:0/4229361567 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154579+0+0 (secure 0 0 0) 0x7f1510004020 con 0x7f15241094c0 2024-09-21T06:35:09.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:09.500+0000 7f1521ffb640 1 --2- 172.21.15.7:0/4229361567 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f15140b65f0 0x7f15140b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:09.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:09.501+0000 7f15289ff640 1 --2- 172.21.15.7:0/4229361567 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f15140b65f0 0x7f15140b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:09.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:09.501+0000 7f1521ffb640 1 -- 172.21.15.7:0/4229361567 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f15100e7770 con 0x7f15241094c0 2024-09-21T06:35:09.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:09.501+0000 7f1521ffb640 1 --2- 172.21.15.7:0/4229361567 >> [v2:172.21.15.7:6818/3770978305,v1:172.21.15.7:6819/3770978305] conn(0x7f15140c0260 0x7f15140c2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:09.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:09.501+0000 7f1521ffb640 1 -- 172.21.15.7:0/4229361567 --> [v2:172.21.15.7:6818/3770978305,v1:172.21.15.7:6819/3770978305] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f15140c2e20 con 0x7f15140c0260 2024-09-21T06:35:09.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:09.501+0000 7f1521ffb640 1 -- 172.21.15.7:0/4229361567 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f15100e7ba0 con 0x7f15241094c0 2024-09-21T06:35:09.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:09.501+0000 7f1529200640 1 --2- 172.21.15.7:0/4229361567 >> [v2:172.21.15.7:6818/3770978305,v1:172.21.15.7:6819/3770978305] conn(0x7f15140c0260 0x7f15140c2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:09.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:09.501+0000 7f15289ff640 1 --2- 172.21.15.7:0/4229361567 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f15140b65f0 0x7f15140b8b00 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1518031440 tx=0x7f1518009560 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:09.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:09.501+0000 7f1529200640 1 --2- 172.21.15.7:0/4229361567 >> [v2:172.21.15.7:6818/3770978305,v1:172.21.15.7:6819/3770978305] conn(0x7f15140c0260 0x7f15140c2750 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:09.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:09.502+0000 7f1521ffb640 1 -- 172.21.15.7:0/4229361567 <== osd.6 v2:172.21.15.7:6818/3770978305 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f15140c2e20 con 0x7f15140c0260 2024-09-21T06:35:09.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:09.517+0000 7f152ac63640 1 -- 172.21.15.7:0/4229361567 --> [v2:172.21.15.7:6818/3770978305,v1:172.21.15.7:6819/3770978305] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1524063fd0 con 0x7f15140c0260 2024-09-21T06:35:09.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:09.517+0000 7f1521ffb640 1 -- 172.21.15.7:0/4229361567 <== osd.6 v2:172.21.15.7:6818/3770978305 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f1524063fd0 con 0x7f15140c0260 2024-09-21T06:35:09.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:09.517+0000 7f152ac63640 1 -- 172.21.15.7:0/4229361567 >> [v2:172.21.15.7:6818/3770978305,v1:172.21.15.7:6819/3770978305] conn(0x7f15140c0260 msgr2=0x7f15140c2750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:09.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:09.517+0000 7f152ac63640 1 --2- 172.21.15.7:0/4229361567 >> [v2:172.21.15.7:6818/3770978305,v1:172.21.15.7:6819/3770978305] conn(0x7f15140c0260 0x7f15140c2750 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:09.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:09.517+0000 7f152ac63640 1 -- 172.21.15.7:0/4229361567 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f15140b65f0 msgr2=0x7f15140b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:09.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:09.517+0000 7f152ac63640 1 --2- 172.21.15.7:0/4229361567 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f15140b65f0 0x7f15140b8b00 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1518031440 tx=0x7f1518009560 comp rx=0 tx=0).stop 2024-09-21T06:35:09.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:09.517+0000 7f152ac63640 1 -- 172.21.15.7:0/4229361567 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f15241094c0 msgr2=0x7f152419aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:09.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:09.517+0000 7f152ac63640 1 --2- 172.21.15.7:0/4229361567 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f15241094c0 0x7f152419aa60 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f151000d950 tx=0x7f151000de10 comp rx=0 tx=0).stop 2024-09-21T06:35:09.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:09.517+0000 7f1529200640 1 -- 172.21.15.7:0/4229361567 reap_dead start 2024-09-21T06:35:09.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:09.518+0000 7f152ac63640 1 -- 172.21.15.7:0/4229361567 shutdown_connections 2024-09-21T06:35:09.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:09.518+0000 7f152ac63640 1 -- 172.21.15.7:0/4229361567 >> 172.21.15.7:0/4229361567 conn(0x7f15240ff610 msgr2=0x7f1524101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:09.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:09.518+0000 7f152ac63640 1 -- 172.21.15.7:0/4229361567 shutdown_connections 2024-09-21T06:35:09.521 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:09.518+0000 7f152ac63640 1 -- 172.21.15.7:0/4229361567 wait complete. 2024-09-21T06:35:09.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.155+0000 7fd51759c640 1 -- 172.21.15.7:0/2528434278 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd510108d70 msgr2=0x7fd51010f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:09.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.155+0000 7fd51759c640 1 --2- 172.21.15.7:0/2528434278 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd510108d70 0x7fd51010f5a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fd508009ca0 tx=0x7fd50802a8e0 comp rx=0 tx=0).stop 2024-09-21T06:35:09.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.155+0000 7fd51759c640 1 -- 172.21.15.7:0/2528434278 shutdown_connections 2024-09-21T06:35:09.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.155+0000 7fd51759c640 1 --2- 172.21.15.7:0/2528434278 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd510108d70 0x7fd51010f5a0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:09.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.155+0000 7fd51759c640 1 --2- 172.21.15.7:0/2528434278 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd510108420 0x7fd510108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:09.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.155+0000 7fd51759c640 1 --2- 172.21.15.7:0/2528434278 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd510102ae0 0x7fd510102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:09.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.155+0000 7fd51759c640 1 -- 172.21.15.7:0/2528434278 >> 172.21.15.7:0/2528434278 conn(0x7fd510079770 msgr2=0x7fd510079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:09.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.155+0000 7fd51759c640 1 -- 172.21.15.7:0/2528434278 shutdown_connections 2024-09-21T06:35:09.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.155+0000 7fd51759c640 1 -- 172.21.15.7:0/2528434278 wait complete. 2024-09-21T06:35:09.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.156+0000 7fd51759c640 1 Processor -- start 2024-09-21T06:35:09.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.156+0000 7fd51759c640 1 -- start start 2024-09-21T06:35:09.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.157+0000 7fd51759c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd510102ae0 0x7fd51019c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:09.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.157+0000 7fd51759c640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd510108420 0x7fd51019cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:09.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.157+0000 7fd51759c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd510108d70 0x7fd5101a2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:09.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.157+0000 7fd51759c640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd510112a70 con 0x7fd510108d70 2024-09-21T06:35:09.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.157+0000 7fd51759c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd5101128f0 con 0x7fd510102ae0 2024-09-21T06:35:09.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.157+0000 7fd51759c640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd510112bf0 con 0x7fd510108420 2024-09-21T06:35:09.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.157+0000 7fd515b39640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd510108d70 0x7fd5101a2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:09.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.157+0000 7fd515b39640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd510108d70 0x7fd5101a2030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35182/0 (socket says 172.21.15.7:35182) 2024-09-21T06:35:09.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.157+0000 7fd515b39640 1 -- 172.21.15.7:0/3792339241 learned_addr learned my addr 172.21.15.7:0/3792339241 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:35:09.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.157+0000 7fd515338640 1 --2- 172.21.15.7:0/3792339241 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd510102ae0 0x7fd51019c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:09.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.157+0000 7fd514b37640 1 --2- 172.21.15.7:0/3792339241 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd510108420 0x7fd51019cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:09.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.157+0000 7fd515b39640 1 -- 172.21.15.7:0/3792339241 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd510108420 msgr2=0x7fd51019cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:09.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.157+0000 7fd515b39640 1 --2- 172.21.15.7:0/3792339241 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd510108420 0x7fd51019cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:09.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.157+0000 7fd515b39640 1 -- 172.21.15.7:0/3792339241 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd510102ae0 msgr2=0x7fd51019c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:09.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.157+0000 7fd515b39640 1 --2- 172.21.15.7:0/3792339241 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd510102ae0 0x7fd51019c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:09.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.157+0000 7fd515b39640 1 -- 172.21.15.7:0/3792339241 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5101a2760 con 0x7fd510108d70 2024-09-21T06:35:09.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.158+0000 7fd515b39640 1 --2- 172.21.15.7:0/3792339241 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd510108d70 0x7fd5101a2030 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fd508005cc0 tx=0x7fd508003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:09.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.158+0000 7fd5067fc640 1 -- 172.21.15.7:0/3792339241 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd508004040 con 0x7fd510108d70 2024-09-21T06:35:09.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.158+0000 7fd51759c640 1 -- 172.21.15.7:0/3792339241 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5101a29f0 con 0x7fd510108d70 2024-09-21T06:35:09.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.158+0000 7fd5067fc640 1 -- 172.21.15.7:0/3792339241 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd508004690 con 0x7fd510108d70 2024-09-21T06:35:09.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.158+0000 7fd5067fc640 1 -- 172.21.15.7:0/3792339241 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd508030d90 con 0x7fd510108d70 2024-09-21T06:35:09.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.158+0000 7fd51759c640 1 -- 172.21.15.7:0/3792339241 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5101a91b0 con 0x7fd510108d70 2024-09-21T06:35:09.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.159+0000 7fd51759c640 1 -- 172.21.15.7:0/3792339241 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd51006c5f0 con 0x7fd510108d70 2024-09-21T06:35:09.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.161+0000 7fd5067fc640 1 -- 172.21.15.7:0/3792339241 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154579+0+0 (secure 0 0 0) 0x7fd5080041e0 con 0x7fd510108d70 2024-09-21T06:35:09.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.162+0000 7fd5067fc640 1 --2- 172.21.15.7:0/3792339241 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fd4fc0b65f0 0x7fd4fc0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:09.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.162+0000 7fd515338640 1 --2- 172.21.15.7:0/3792339241 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fd4fc0b65f0 0x7fd4fc0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:09.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.162+0000 7fd5067fc640 1 -- 172.21.15.7:0/3792339241 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fd508108b00 con 0x7fd510108d70 2024-09-21T06:35:09.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.162+0000 7fd5067fc640 1 --2- 172.21.15.7:0/3792339241 >> [v2:172.21.15.18:6824/2038885362,v1:172.21.15.18:6825/2038885362] conn(0x7fd4fc0c0260 0x7fd4fc0c2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:09.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.162+0000 7fd5067fc640 1 -- 172.21.15.7:0/3792339241 --> [v2:172.21.15.18:6824/2038885362,v1:172.21.15.18:6825/2038885362] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd4fc0c2e20 con 0x7fd4fc0c0260 2024-09-21T06:35:09.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.162+0000 7fd5067fc640 1 -- 172.21.15.7:0/3792339241 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7fd508108f30 con 0x7fd510108d70 2024-09-21T06:35:09.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.163+0000 7fd515338640 1 --2- 172.21.15.7:0/3792339241 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fd4fc0b65f0 0x7fd4fc0b8b00 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd50c0058c0 tx=0x7fd50c00a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:09.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.163+0000 7fd514b37640 1 --2- 172.21.15.7:0/3792339241 >> [v2:172.21.15.18:6824/2038885362,v1:172.21.15.18:6825/2038885362] conn(0x7fd4fc0c0260 0x7fd4fc0c2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:09.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.163+0000 7fd514b37640 1 --2- 172.21.15.7:0/3792339241 >> [v2:172.21.15.18:6824/2038885362,v1:172.21.15.18:6825/2038885362] conn(0x7fd4fc0c0260 0x7fd4fc0c2750 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:09.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.164+0000 7fd5067fc640 1 -- 172.21.15.7:0/3792339241 <== osd.10 v2:172.21.15.18:6824/2038885362 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd4fc0c2e20 con 0x7fd4fc0c0260 2024-09-21T06:35:09.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.178+0000 7fd51759c640 1 -- 172.21.15.7:0/3792339241 --> [v2:172.21.15.18:6824/2038885362,v1:172.21.15.18:6825/2038885362] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd51006b390 con 0x7fd4fc0c0260 2024-09-21T06:35:09.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.178+0000 7fd5067fc640 1 -- 172.21.15.7:0/3792339241 <== osd.10 v2:172.21.15.18:6824/2038885362 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fd51006b390 con 0x7fd4fc0c0260 2024-09-21T06:35:09.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.179+0000 7fd51759c640 1 -- 172.21.15.7:0/3792339241 >> [v2:172.21.15.18:6824/2038885362,v1:172.21.15.18:6825/2038885362] conn(0x7fd4fc0c0260 msgr2=0x7fd4fc0c2750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:09.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.179+0000 7fd51759c640 1 --2- 172.21.15.7:0/3792339241 >> [v2:172.21.15.18:6824/2038885362,v1:172.21.15.18:6825/2038885362] conn(0x7fd4fc0c0260 0x7fd4fc0c2750 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:09.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.179+0000 7fd51759c640 1 -- 172.21.15.7:0/3792339241 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fd4fc0b65f0 msgr2=0x7fd4fc0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:09.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.179+0000 7fd51759c640 1 --2- 172.21.15.7:0/3792339241 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fd4fc0b65f0 0x7fd4fc0b8b00 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd50c0058c0 tx=0x7fd50c00a2d0 comp rx=0 tx=0).stop 2024-09-21T06:35:09.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.179+0000 7fd51759c640 1 -- 172.21.15.7:0/3792339241 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd510108d70 msgr2=0x7fd5101a2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:09.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.179+0000 7fd51759c640 1 --2- 172.21.15.7:0/3792339241 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd510108d70 0x7fd5101a2030 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fd508005cc0 tx=0x7fd508003ba0 comp rx=0 tx=0).stop 2024-09-21T06:35:09.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.179+0000 7fd515b39640 1 -- 172.21.15.7:0/3792339241 reap_dead start 2024-09-21T06:35:09.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.179+0000 7fd51759c640 1 -- 172.21.15.7:0/3792339241 shutdown_connections 2024-09-21T06:35:09.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.179+0000 7fd51759c640 1 -- 172.21.15.7:0/3792339241 >> 172.21.15.7:0/3792339241 conn(0x7fd510079770 msgr2=0x7fd51006bc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:09.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.179+0000 7fd51759c640 1 -- 172.21.15.7:0/3792339241 shutdown_connections 2024-09-21T06:35:09.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:08.179+0000 7fd51759c640 1 -- 172.21.15.7:0/3792339241 wait complete. 2024-09-21T06:35:10.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:35:10 smithi007 ceph-mon[30983]: pgmap v288: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-21T06:35:10.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:35:10 smithi018 ceph-mon[34477]: pgmap v288: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-21T06:35:10.676 INFO:teuthology.orchestra.run.smithi007.stdout:296352743446 2024-09-21T06:35:10.676 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.11 2024-09-21T06:35:10.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:35:10 smithi144 ceph-mon[34653]: pgmap v288: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-21T06:35:11.278 INFO:teuthology.orchestra.run.smithi007.stdout:81604378692 2024-09-21T06:35:11.278 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.2 2024-09-21T06:35:11.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:11.618+0000 7f8783d98640 1 -- 172.21.15.7:0/667266827 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f877c1094d0 msgr2=0x7f877c1098e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:11.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:11.618+0000 7f8783d98640 1 --2- 172.21.15.7:0/667266827 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f877c1094d0 0x7f877c1098e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f8770009900 tx=0x7f877002a410 comp rx=0 tx=0).stop 2024-09-21T06:35:11.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:11.618+0000 7f8783d98640 1 -- 172.21.15.7:0/667266827 shutdown_connections 2024-09-21T06:35:11.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:11.618+0000 7f8783d98640 1 --2- 172.21.15.7:0/667266827 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f877c109e20 0x7f877c110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:11.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:11.618+0000 7f8783d98640 1 --2- 172.21.15.7:0/667266827 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f877c1094d0 0x7f877c1098e0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:11.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:11.618+0000 7f8783d98640 1 --2- 172.21.15.7:0/667266827 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f877c103b90 0x7f877c103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:11.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:11.618+0000 7f8783d98640 1 -- 172.21.15.7:0/667266827 >> 172.21.15.7:0/667266827 conn(0x7f877c0ff600 msgr2=0x7f877c101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:11.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:11.618+0000 7f8783d98640 1 -- 172.21.15.7:0/667266827 shutdown_connections 2024-09-21T06:35:11.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:11.618+0000 7f8783d98640 1 -- 172.21.15.7:0/667266827 wait complete. 2024-09-21T06:35:11.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:11.619+0000 7f8783d98640 1 Processor -- start 2024-09-21T06:35:11.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:11.619+0000 7f8783d98640 1 -- start start 2024-09-21T06:35:11.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:11.619+0000 7f8783d98640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f877c103b90 0x7f877c19a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:11.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:11.619+0000 7f8783d98640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f877c1094d0 0x7f877c19aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:11.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:11.619+0000 7f8783d98640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f877c109e20 0x7f877c19fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:11.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:11.619+0000 7f8783d98640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f877c113b30 con 0x7f877c109e20 2024-09-21T06:35:11.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:11.619+0000 7f8783d98640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f877c1139b0 con 0x7f877c1094d0 2024-09-21T06:35:11.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:11.619+0000 7f8783d98640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f877c113cb0 con 0x7f877c103b90 2024-09-21T06:35:11.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:11.619+0000 7f8782335640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f877c109e20 0x7f877c19fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:11.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:11.619+0000 7f8782335640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f877c109e20 0x7f877c19fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36090/0 (socket says 172.21.15.7:36090) 2024-09-21T06:35:11.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:11.619+0000 7f8782335640 1 -- 172.21.15.7:0/631750727 learned_addr learned my addr 172.21.15.7:0/631750727 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:35:11.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:11.619+0000 7f8781b34640 1 --2- 172.21.15.7:0/631750727 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f877c103b90 0x7f877c19a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:11.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:11.619+0000 7f8781333640 1 --2- 172.21.15.7:0/631750727 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f877c1094d0 0x7f877c19aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:11.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:11.619+0000 7f8782335640 1 -- 172.21.15.7:0/631750727 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f877c103b90 msgr2=0x7f877c19a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:11.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:11.619+0000 7f8782335640 1 --2- 172.21.15.7:0/631750727 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f877c103b90 0x7f877c19a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:11.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:11.619+0000 7f8782335640 1 -- 172.21.15.7:0/631750727 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f877c1094d0 msgr2=0x7f877c19aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:11.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:11.619+0000 7f8782335640 1 --2- 172.21.15.7:0/631750727 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f877c1094d0 0x7f877c19aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:11.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:11.619+0000 7f8782335640 1 -- 172.21.15.7:0/631750727 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f877c1a0430 con 0x7f877c109e20 2024-09-21T06:35:11.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:11.619+0000 7f8781333640 1 --2- 172.21.15.7:0/631750727 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f877c1094d0 0x7f877c19aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:35:11.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:11.620+0000 7f8782335640 1 --2- 172.21.15.7:0/631750727 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f877c109e20 0x7f877c19fd00 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f877400e9b0 tx=0x7f877400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:11.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:11.620+0000 7f877affd640 1 -- 172.21.15.7:0/631750727 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f877400cd80 con 0x7f877c109e20 2024-09-21T06:35:11.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:11.620+0000 7f877affd640 1 -- 172.21.15.7:0/631750727 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f87740035f0 con 0x7f877c109e20 2024-09-21T06:35:11.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:11.620+0000 7f8783d98640 1 -- 172.21.15.7:0/631750727 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f877c1a0720 con 0x7f877c109e20 2024-09-21T06:35:11.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:11.620+0000 7f877affd640 1 -- 172.21.15.7:0/631750727 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8774010690 con 0x7f877c109e20 2024-09-21T06:35:11.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:11.620+0000 7f8783d98640 1 -- 172.21.15.7:0/631750727 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f877c1a6e80 con 0x7f877c109e20 2024-09-21T06:35:11.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:11.621+0000 7f8783d98640 1 -- 172.21.15.7:0/631750727 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f877c063b50 con 0x7f877c109e20 2024-09-21T06:35:11.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:11.623+0000 7f877affd640 1 -- 172.21.15.7:0/631750727 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154579+0+0 (secure 0 0 0) 0x7f8774004020 con 0x7f877c109e20 2024-09-21T06:35:11.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:11.624+0000 7f877affd640 1 --2- 172.21.15.7:0/631750727 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f87640b6670 0x7f87640b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:11.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:11.624+0000 7f877affd640 1 -- 172.21.15.7:0/631750727 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f87740e7b50 con 0x7f877c109e20 2024-09-21T06:35:11.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:11.624+0000 7f8781b34640 1 --2- 172.21.15.7:0/631750727 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f87640b6670 0x7f87640b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:11.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:11.624+0000 7f877affd640 1 --2- 172.21.15.7:0/631750727 >> [v2:172.21.15.7:6810/3202935163,v1:172.21.15.7:6811/3202935163] conn(0x7f87640c02e0 0x7f87640c27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:11.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:11.624+0000 7f877affd640 1 -- 172.21.15.7:0/631750727 --> [v2:172.21.15.7:6810/3202935163,v1:172.21.15.7:6811/3202935163] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f877401ee50 con 0x7f87640c02e0 2024-09-21T06:35:11.627 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:11.624+0000 7f877affd640 1 -- 172.21.15.7:0/631750727 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f87740e7f80 con 0x7f877c109e20 2024-09-21T06:35:11.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:11.624+0000 7f8781333640 1 --2- 172.21.15.7:0/631750727 >> [v2:172.21.15.7:6810/3202935163,v1:172.21.15.7:6811/3202935163] conn(0x7f87640c02e0 0x7f87640c27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:11.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:11.625+0000 7f8781b34640 1 --2- 172.21.15.7:0/631750727 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f87640b6670 0x7f87640b8b80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f876c005fd0 tx=0x7f876c009500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:11.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:11.625+0000 7f8781333640 1 --2- 172.21.15.7:0/631750727 >> [v2:172.21.15.7:6810/3202935163,v1:172.21.15.7:6811/3202935163] conn(0x7f87640c02e0 0x7f87640c27d0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:11.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:11.626+0000 7f877affd640 1 -- 172.21.15.7:0/631750727 <== osd.3 v2:172.21.15.7:6810/3202935163 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f877401ee50 con 0x7f87640c02e0 2024-09-21T06:35:11.644 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:11.642+0000 7f8783d98640 1 -- 172.21.15.7:0/631750727 --> [v2:172.21.15.7:6810/3202935163,v1:172.21.15.7:6811/3202935163] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f877c063de0 con 0x7f87640c02e0 2024-09-21T06:35:11.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:11.642+0000 7f877affd640 1 -- 172.21.15.7:0/631750727 <== osd.3 v2:172.21.15.7:6810/3202935163 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f877c063de0 con 0x7f87640c02e0 2024-09-21T06:35:11.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:11.642+0000 7f8783d98640 1 -- 172.21.15.7:0/631750727 >> [v2:172.21.15.7:6810/3202935163,v1:172.21.15.7:6811/3202935163] conn(0x7f87640c02e0 msgr2=0x7f87640c27d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:11.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:11.642+0000 7f8783d98640 1 --2- 172.21.15.7:0/631750727 >> [v2:172.21.15.7:6810/3202935163,v1:172.21.15.7:6811/3202935163] conn(0x7f87640c02e0 0x7f87640c27d0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:11.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:11.643+0000 7f8783d98640 1 -- 172.21.15.7:0/631750727 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f87640b6670 msgr2=0x7f87640b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:11.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:11.643+0000 7f8783d98640 1 --2- 172.21.15.7:0/631750727 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f87640b6670 0x7f87640b8b80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f876c005fd0 tx=0x7f876c009500 comp rx=0 tx=0).stop 2024-09-21T06:35:11.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:11.643+0000 7f8783d98640 1 -- 172.21.15.7:0/631750727 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f877c109e20 msgr2=0x7f877c19fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:11.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:11.643+0000 7f8783d98640 1 --2- 172.21.15.7:0/631750727 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f877c109e20 0x7f877c19fd00 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f877400e9b0 tx=0x7f877400ee70 comp rx=0 tx=0).stop 2024-09-21T06:35:11.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:11.643+0000 7f8782335640 1 -- 172.21.15.7:0/631750727 reap_dead start 2024-09-21T06:35:11.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:11.643+0000 7f8783d98640 1 -- 172.21.15.7:0/631750727 shutdown_connections 2024-09-21T06:35:11.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:11.643+0000 7f8783d98640 1 -- 172.21.15.7:0/631750727 >> 172.21.15.7:0/631750727 conn(0x7f877c0ff600 msgr2=0x7f877c101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:11.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:11.643+0000 7f8783d98640 1 -- 172.21.15.7:0/631750727 shutdown_connections 2024-09-21T06:35:11.646 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:11.643+0000 7f8783d98640 1 -- 172.21.15.7:0/631750727 wait complete. 2024-09-21T06:35:12.442 INFO:teuthology.orchestra.run.smithi007.stdout:107374182463 2024-09-21T06:35:12.442 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.3 2024-09-21T06:35:12.568 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:35:12 smithi007 ceph-mon[30983]: pgmap v289: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-09-21T06:35:12.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:35:12 smithi018 ceph-mon[34477]: pgmap v289: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-09-21T06:35:12.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:35:12 smithi144 ceph-mon[34653]: pgmap v289: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 5 op/s 2024-09-21T06:35:12.905 INFO:teuthology.orchestra.run.smithi007.stdout:60129542217 2024-09-21T06:35:12.906 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.1 2024-09-21T06:35:13.279 INFO:teuthology.orchestra.run.smithi007.stdout:38654705742 2024-09-21T06:35:13.279 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.0 2024-09-21T06:35:13.688 INFO:teuthology.orchestra.run.smithi007.stdout:180388626479 2024-09-21T06:35:13.688 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.6 2024-09-21T06:35:14.149 INFO:teuthology.orchestra.run.smithi007.stdout:270582939674 2024-09-21T06:35:14.149 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.10 2024-09-21T06:35:14.584 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:35:14 smithi007 ceph-mon[30983]: pgmap v290: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T06:35:14.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:35:14 smithi018 ceph-mon[34477]: pgmap v290: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T06:35:14.634 INFO:teuthology.orchestra.run.smithi007.stdout:133143986235 2024-09-21T06:35:14.635 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.4 2024-09-21T06:35:14.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:35:14 smithi144 ceph-mon[34653]: pgmap v290: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T06:35:15.053 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:15.054 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:15.054 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:15.056 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:15.056 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:15.117 INFO:teuthology.orchestra.run.smithi007.stdout:201863462954 2024-09-21T06:35:15.118 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.7 2024-09-21T06:35:15.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:15.862+0000 7fb289b0f640 1 -- 172.21.15.7:0/1350814929 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2841083d0 msgr2=0x7fb2841087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:15.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:15.862+0000 7fb289b0f640 1 --2- 172.21.15.7:0/1350814929 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2841083d0 0x7fb2841087e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fb278009900 tx=0x7fb27802a410 comp rx=0 tx=0).stop 2024-09-21T06:35:15.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:15.862+0000 7fb289b0f640 1 -- 172.21.15.7:0/1350814929 shutdown_connections 2024-09-21T06:35:15.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:15.862+0000 7fb289b0f640 1 --2- 172.21.15.7:0/1350814929 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb284108d20 0x7fb28410f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:15.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:15.862+0000 7fb289b0f640 1 --2- 172.21.15.7:0/1350814929 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb2841083d0 0x7fb2841087e0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:15.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:15.862+0000 7fb289b0f640 1 --2- 172.21.15.7:0/1350814929 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb284102ae0 0x7fb284102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:15.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:15.862+0000 7fb289b0f640 1 -- 172.21.15.7:0/1350814929 >> 172.21.15.7:0/1350814929 conn(0x7fb284079760 msgr2=0x7fb284079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:15.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:15.862+0000 7fb289b0f640 1 -- 172.21.15.7:0/1350814929 shutdown_connections 2024-09-21T06:35:15.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:15.862+0000 7fb289b0f640 1 -- 172.21.15.7:0/1350814929 wait complete. 2024-09-21T06:35:15.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:15.863+0000 7fb289b0f640 1 Processor -- start 2024-09-21T06:35:15.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:15.863+0000 7fb289b0f640 1 -- start start 2024-09-21T06:35:15.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:15.864+0000 7fb289b0f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb284102ae0 0x7fb284199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:15.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:15.864+0000 7fb289b0f640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb2841083d0 0x7fb284199900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:15.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:15.864+0000 7fb289b0f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb284108d20 0x7fb28419eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:15.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:15.864+0000 7fb289b0f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb284112990 con 0x7fb284108d20 2024-09-21T06:35:15.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:15.864+0000 7fb289b0f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb284112810 con 0x7fb284102ae0 2024-09-21T06:35:15.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:15.864+0000 7fb289b0f640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb284112b10 con 0x7fb2841083d0 2024-09-21T06:35:15.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:15.864+0000 7fb283fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb284108d20 0x7fb28419eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:15.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:15.864+0000 7fb283fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb284108d20 0x7fb28419eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36100/0 (socket says 172.21.15.7:36100) 2024-09-21T06:35:15.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:15.864+0000 7fb283fff640 1 -- 172.21.15.7:0/2541633599 learned_addr learned my addr 172.21.15.7:0/2541633599 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:35:15.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:15.864+0000 7fb282ffd640 1 --2- 172.21.15.7:0/2541633599 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb2841083d0 0x7fb284199900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:15.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:15.864+0000 7fb2837fe640 1 --2- 172.21.15.7:0/2541633599 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb284102ae0 0x7fb284199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:15.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:15.864+0000 7fb283fff640 1 -- 172.21.15.7:0/2541633599 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb2841083d0 msgr2=0x7fb284199900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:15.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:15.864+0000 7fb283fff640 1 --2- 172.21.15.7:0/2541633599 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb2841083d0 0x7fb284199900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:15.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:15.864+0000 7fb283fff640 1 -- 172.21.15.7:0/2541633599 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb284102ae0 msgr2=0x7fb284199360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:15.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:15.864+0000 7fb283fff640 1 --2- 172.21.15.7:0/2541633599 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb284102ae0 0x7fb284199360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:15.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:15.864+0000 7fb283fff640 1 -- 172.21.15.7:0/2541633599 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb28419f210 con 0x7fb284108d20 2024-09-21T06:35:15.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:15.864+0000 7fb283fff640 1 --2- 172.21.15.7:0/2541633599 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb284108d20 0x7fb28419eba0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fb27c00eaa0 tx=0x7fb27c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:15.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:15.864+0000 7fb280ff9640 1 -- 172.21.15.7:0/2541633599 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb27c00cdb0 con 0x7fb284108d20 2024-09-21T06:35:15.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:15.864+0000 7fb289b0f640 1 -- 172.21.15.7:0/2541633599 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb28419f500 con 0x7fb284108d20 2024-09-21T06:35:15.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:15.864+0000 7fb280ff9640 1 -- 172.21.15.7:0/2541633599 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb27c005020 con 0x7fb284108d20 2024-09-21T06:35:15.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:15.864+0000 7fb280ff9640 1 -- 172.21.15.7:0/2541633599 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb27c0116d0 con 0x7fb284108d20 2024-09-21T06:35:15.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:15.864+0000 7fb289b0f640 1 -- 172.21.15.7:0/2541633599 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2841a5d20 con 0x7fb284108d20 2024-09-21T06:35:15.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:15.866+0000 7fb26a7fc640 1 -- 172.21.15.7:0/2541633599 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb284103d10 con 0x7fb284108d20 2024-09-21T06:35:15.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:15.867+0000 7fb280ff9640 1 -- 172.21.15.7:0/2541633599 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154579+0+0 (secure 0 0 0) 0x7fb27c0051d0 con 0x7fb284108d20 2024-09-21T06:35:15.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:15.868+0000 7fb280ff9640 1 --2- 172.21.15.7:0/2541633599 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fb26c0b6620 0x7fb26c0b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:15.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:15.868+0000 7fb2837fe640 1 --2- 172.21.15.7:0/2541633599 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fb26c0b6620 0x7fb26c0b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:15.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:15.868+0000 7fb280ff9640 1 -- 172.21.15.7:0/2541633599 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fb27c0e7c00 con 0x7fb284108d20 2024-09-21T06:35:15.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:15.869+0000 7fb2837fe640 1 --2- 172.21.15.7:0/2541633599 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fb26c0b6620 0x7fb26c0b8b30 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb274005e10 tx=0x7fb274005da0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:15.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:15.871+0000 7fb280ff9640 1 -- 172.21.15.7:0/2541633599 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb27c016030 con 0x7fb284108d20 2024-09-21T06:35:15.947 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:15.947 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:15.954 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:15.954 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:16.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:16.087+0000 7fb26a7fc640 1 -- 172.21.15.7:0/2541633599 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fb284102ef0 con 0x7fb284108d20 2024-09-21T06:35:16.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:16.087+0000 7fb280ff9640 1 -- 172.21.15.7:0/2541633599 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb27c0ae270 con 0x7fb284108d20 2024-09-21T06:35:16.089 INFO:teuthology.orchestra.run.smithi007.stdout:60129542219 2024-09-21T06:35:16.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:16.090+0000 7fb26a7fc640 1 -- 172.21.15.7:0/2541633599 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fb26c0b6620 msgr2=0x7fb26c0b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:16.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:16.090+0000 7fb26a7fc640 1 --2- 172.21.15.7:0/2541633599 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fb26c0b6620 0x7fb26c0b8b30 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb274005e10 tx=0x7fb274005da0 comp rx=0 tx=0).stop 2024-09-21T06:35:16.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:16.090+0000 7fb26a7fc640 1 -- 172.21.15.7:0/2541633599 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb284108d20 msgr2=0x7fb28419eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:16.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:16.090+0000 7fb26a7fc640 1 --2- 172.21.15.7:0/2541633599 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb284108d20 0x7fb28419eba0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fb27c00eaa0 tx=0x7fb27c00ef60 comp rx=0 tx=0).stop 2024-09-21T06:35:16.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:16.090+0000 7fb26a7fc640 1 -- 172.21.15.7:0/2541633599 shutdown_connections 2024-09-21T06:35:16.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:16.090+0000 7fb26a7fc640 1 --2- 172.21.15.7:0/2541633599 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fb26c0b6620 0x7fb26c0b8b30 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:16.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:16.090+0000 7fb26a7fc640 1 --2- 172.21.15.7:0/2541633599 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb284108d20 0x7fb28419eba0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:16.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:16.090+0000 7fb26a7fc640 1 --2- 172.21.15.7:0/2541633599 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb2841083d0 0x7fb284199900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:16.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:16.090+0000 7fb26a7fc640 1 --2- 172.21.15.7:0/2541633599 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb284102ae0 0x7fb284199360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:16.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:16.090+0000 7fb26a7fc640 1 -- 172.21.15.7:0/2541633599 >> 172.21.15.7:0/2541633599 conn(0x7fb284079760 msgr2=0x7fb284104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:16.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:16.090+0000 7fb26a7fc640 1 -- 172.21.15.7:0/2541633599 shutdown_connections 2024-09-21T06:35:16.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:16.090+0000 7fb26a7fc640 1 -- 172.21.15.7:0/2541633599 wait complete. 2024-09-21T06:35:16.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:16.148+0000 7f1335607640 1 -- 172.21.15.7:0/488350947 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1330108cf0 msgr2=0x7f133010f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:16.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:16.148+0000 7f1335607640 1 --2- 172.21.15.7:0/488350947 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1330108cf0 0x7f133010f520 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f1328009ca0 tx=0x7f132802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:35:16.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:16.148+0000 7f1335607640 1 -- 172.21.15.7:0/488350947 shutdown_connections 2024-09-21T06:35:16.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:16.148+0000 7f1335607640 1 --2- 172.21.15.7:0/488350947 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1330108cf0 0x7f133010f520 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:16.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:16.148+0000 7f1335607640 1 --2- 172.21.15.7:0/488350947 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13301083a0 0x7f13301087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:16.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:16.148+0000 7f1335607640 1 --2- 172.21.15.7:0/488350947 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1330102a60 0x7f1330102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:16.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:16.148+0000 7f1335607640 1 -- 172.21.15.7:0/488350947 >> 172.21.15.7:0/488350947 conn(0x7f1330079730 msgr2=0x7f1330079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:16.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:16.148+0000 7f1335607640 1 -- 172.21.15.7:0/488350947 shutdown_connections 2024-09-21T06:35:16.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:16.148+0000 7f1335607640 1 -- 172.21.15.7:0/488350947 wait complete. 2024-09-21T06:35:16.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:16.149+0000 7f1335607640 1 Processor -- start 2024-09-21T06:35:16.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:16.149+0000 7f1335607640 1 -- start start 2024-09-21T06:35:16.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:16.150+0000 7f1335607640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1330102a60 0x7f13300ff670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:16.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:16.150+0000 7f1335607640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f13301083a0 0x7f13300ffbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:16.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:16.150+0000 7f1335607640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1330108cf0 0x7f13301000f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:16.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:16.150+0000 7f1335607640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1330112960 con 0x7f13301083a0 2024-09-21T06:35:16.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:16.150+0000 7f1335607640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f13301127e0 con 0x7f1330108cf0 2024-09-21T06:35:16.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:16.150+0000 7f1335607640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1330112ae0 con 0x7f1330102a60 2024-09-21T06:35:16.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:16.150+0000 7f132e7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f13301083a0 0x7f13300ffbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:16.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:16.150+0000 7f132e7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f13301083a0 0x7f13300ffbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36124/0 (socket says 172.21.15.7:36124) 2024-09-21T06:35:16.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:16.150+0000 7f132e7fc640 1 -- 172.21.15.7:0/2353924206 learned_addr learned my addr 172.21.15.7:0/2353924206 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:35:16.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:16.150+0000 7f132effd640 1 --2- 172.21.15.7:0/2353924206 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1330102a60 0x7f13300ff670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:16.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:16.150+0000 7f132f7fe640 1 --2- 172.21.15.7:0/2353924206 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1330108cf0 0x7f13301000f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:16.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:16.150+0000 7f132e7fc640 1 -- 172.21.15.7:0/2353924206 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1330102a60 msgr2=0x7f13300ff670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:16.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:16.150+0000 7f132e7fc640 1 --2- 172.21.15.7:0/2353924206 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1330102a60 0x7f13300ff670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:16.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:16.150+0000 7f132e7fc640 1 -- 172.21.15.7:0/2353924206 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1330108cf0 msgr2=0x7f13301000f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:16.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:16.150+0000 7f132e7fc640 1 --2- 172.21.15.7:0/2353924206 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1330108cf0 0x7f13301000f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:16.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:16.150+0000 7f132e7fc640 1 -- 172.21.15.7:0/2353924206 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13301a86c0 con 0x7f13301083a0 2024-09-21T06:35:16.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:16.150+0000 7f132f7fe640 1 --2- 172.21.15.7:0/2353924206 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1330108cf0 0x7f13301000f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:35:16.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:16.150+0000 7f132e7fc640 1 --2- 172.21.15.7:0/2353924206 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f13301083a0 0x7f13300ffbb0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f132400d740 tx=0x7f132400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:16.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:16.150+0000 7f1317fff640 1 -- 172.21.15.7:0/2353924206 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1324017070 con 0x7f13301083a0 2024-09-21T06:35:16.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:16.151+0000 7f1335607640 1 -- 172.21.15.7:0/2353924206 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13301a89b0 con 0x7f13301083a0 2024-09-21T06:35:16.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:16.151+0000 7f1317fff640 1 -- 172.21.15.7:0/2353924206 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f132400de50 con 0x7f13301083a0 2024-09-21T06:35:16.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:16.151+0000 7f1317fff640 1 -- 172.21.15.7:0/2353924206 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1324004ce0 con 0x7f13301083a0 2024-09-21T06:35:16.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:16.151+0000 7f1335607640 1 -- 172.21.15.7:0/2353924206 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13301a8ea0 con 0x7f13301083a0 2024-09-21T06:35:16.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:16.152+0000 7f1335607640 1 -- 172.21.15.7:0/2353924206 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1330103ce0 con 0x7f13301083a0 2024-09-21T06:35:16.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:16.154+0000 7f1317fff640 1 -- 172.21.15.7:0/2353924206 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154579+0+0 (secure 0 0 0) 0x7f1324004e80 con 0x7f13301083a0 2024-09-21T06:35:16.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:16.155+0000 7f1317fff640 1 --2- 172.21.15.7:0/2353924206 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f13180b65f0 0x7f13180b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:16.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:16.155+0000 7f132effd640 1 --2- 172.21.15.7:0/2353924206 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f13180b65f0 0x7f13180b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:16.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:16.155+0000 7f1317fff640 1 -- 172.21.15.7:0/2353924206 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f13240e7340 con 0x7f13301083a0 2024-09-21T06:35:16.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:16.155+0000 7f132effd640 1 --2- 172.21.15.7:0/2353924206 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f13180b65f0 0x7f13180b8b00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f13301010c0 tx=0x7f1320005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:16.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:16.158+0000 7f1317fff640 1 -- 172.21.15.7:0/2353924206 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f13240ad9f0 con 0x7f13301083a0 2024-09-21T06:35:16.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:16.349+0000 7f1335607640 1 -- 172.21.15.7:0/2353924206 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f133010bb20 con 0x7f13301083a0 2024-09-21T06:35:16.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:16.350+0000 7f1317fff640 1 -- 172.21.15.7:0/2353924206 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f13240b1dd0 con 0x7f13301083a0 2024-09-21T06:35:16.352 INFO:teuthology.orchestra.run.smithi007.stdout:223338299430 2024-09-21T06:35:16.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:16.352+0000 7f1335607640 1 -- 172.21.15.7:0/2353924206 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f13180b65f0 msgr2=0x7f13180b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:16.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:16.352+0000 7f1335607640 1 --2- 172.21.15.7:0/2353924206 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f13180b65f0 0x7f13180b8b00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f13301010c0 tx=0x7f1320005f90 comp rx=0 tx=0).stop 2024-09-21T06:35:16.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:16.352+0000 7f1335607640 1 -- 172.21.15.7:0/2353924206 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f13301083a0 msgr2=0x7f13300ffbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:16.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:16.352+0000 7f1335607640 1 --2- 172.21.15.7:0/2353924206 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f13301083a0 0x7f13300ffbb0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f132400d740 tx=0x7f132400dc00 comp rx=0 tx=0).stop 2024-09-21T06:35:16.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:16.352+0000 7f1335607640 1 -- 172.21.15.7:0/2353924206 shutdown_connections 2024-09-21T06:35:16.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:16.352+0000 7f1335607640 1 --2- 172.21.15.7:0/2353924206 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f13180b65f0 0x7f13180b8b00 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:16.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:16.352+0000 7f1335607640 1 --2- 172.21.15.7:0/2353924206 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1330108cf0 0x7f13301000f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:16.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:16.352+0000 7f1335607640 1 --2- 172.21.15.7:0/2353924206 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f13301083a0 0x7f13300ffbb0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:16.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:16.352+0000 7f1335607640 1 --2- 172.21.15.7:0/2353924206 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1330102a60 0x7f13300ff670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:16.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:16.352+0000 7f1335607640 1 -- 172.21.15.7:0/2353924206 >> 172.21.15.7:0/2353924206 conn(0x7f1330079730 msgr2=0x7f133006bf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:16.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:16.352+0000 7f1335607640 1 -- 172.21.15.7:0/2353924206 shutdown_connections 2024-09-21T06:35:16.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:16.352+0000 7f1335607640 1 -- 172.21.15.7:0/2353924206 wait complete. 2024-09-21T06:35:16.589 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:35:16 smithi007 ceph-mon[30983]: pgmap v291: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:35:16.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:35:16 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2541633599' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T06:35:16.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:35:16 smithi018 ceph-mon[34477]: pgmap v291: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:35:16.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:35:16 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/2541633599' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T06:35:16.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:35:16 smithi144 ceph-mon[34653]: pgmap v291: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:35:16.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:35:16 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/2541633599' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T06:35:17.536 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:35:17 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2353924206' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-21T06:35:17.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:35:17 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/2353924206' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-21T06:35:17.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:35:17 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/2353924206' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-21T06:35:17.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:17.970+0000 7f3a149a0640 1 -- 172.21.15.7:0/3729994537 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a101094e0 msgr2=0x7f3a101098f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:17.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:17.970+0000 7f3a149a0640 1 --2- 172.21.15.7:0/3729994537 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a101094e0 0x7f3a101098f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f39f8009900 tx=0x7f39f802a410 comp rx=0 tx=0).stop 2024-09-21T06:35:17.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:17.970+0000 7f3a149a0640 1 -- 172.21.15.7:0/3729994537 shutdown_connections 2024-09-21T06:35:17.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:17.970+0000 7f3a149a0640 1 --2- 172.21.15.7:0/3729994537 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a10109e30 0x7f3a10110660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:17.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:17.970+0000 7f3a149a0640 1 --2- 172.21.15.7:0/3729994537 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a101094e0 0x7f3a101098f0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:17.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:17.970+0000 7f3a149a0640 1 --2- 172.21.15.7:0/3729994537 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a10103ba0 0x7f3a10103fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:17.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:17.970+0000 7f3a149a0640 1 -- 172.21.15.7:0/3729994537 >> 172.21.15.7:0/3729994537 conn(0x7f3a100ff630 msgr2=0x7f3a10101a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:17.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:17.970+0000 7f3a149a0640 1 -- 172.21.15.7:0/3729994537 shutdown_connections 2024-09-21T06:35:17.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:17.970+0000 7f3a149a0640 1 -- 172.21.15.7:0/3729994537 wait complete. 2024-09-21T06:35:17.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:17.971+0000 7f3a149a0640 1 Processor -- start 2024-09-21T06:35:17.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:17.971+0000 7f3a149a0640 1 -- start start 2024-09-21T06:35:17.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:17.972+0000 7f3a149a0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a10103ba0 0x7f3a1019a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:17.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:17.972+0000 7f3a149a0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a101094e0 0x7f3a1019aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:17.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:17.972+0000 7f3a149a0640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a10109e30 0x7f3a1019fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:17.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:17.972+0000 7f3a149a0640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3a10113af0 con 0x7f3a101094e0 2024-09-21T06:35:17.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:17.972+0000 7f3a149a0640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3a10113970 con 0x7f3a10103ba0 2024-09-21T06:35:17.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:17.972+0000 7f3a149a0640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3a10113c70 con 0x7f3a10109e30 2024-09-21T06:35:17.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:17.972+0000 7f3a0dd9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a101094e0 0x7f3a1019aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:17.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:17.972+0000 7f3a0dd9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a101094e0 0x7f3a1019aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36150/0 (socket says 172.21.15.7:36150) 2024-09-21T06:35:17.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:17.972+0000 7f3a0dd9b640 1 -- 172.21.15.7:0/4099340697 learned_addr learned my addr 172.21.15.7:0/4099340697 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:35:17.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:17.972+0000 7f3a0ed9d640 1 --2- 172.21.15.7:0/4099340697 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a10109e30 0x7f3a1019fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:17.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:17.972+0000 7f3a0e59c640 1 --2- 172.21.15.7:0/4099340697 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a10103ba0 0x7f3a1019a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:17.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:17.972+0000 7f3a0dd9b640 1 -- 172.21.15.7:0/4099340697 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a10109e30 msgr2=0x7f3a1019fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:17.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:17.972+0000 7f3a0dd9b640 1 --2- 172.21.15.7:0/4099340697 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a10109e30 0x7f3a1019fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:17.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:17.972+0000 7f3a0dd9b640 1 -- 172.21.15.7:0/4099340697 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a10103ba0 msgr2=0x7f3a1019a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:17.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:17.972+0000 7f3a0dd9b640 1 --2- 172.21.15.7:0/4099340697 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a10103ba0 0x7f3a1019a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:17.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:17.972+0000 7f3a0dd9b640 1 -- 172.21.15.7:0/4099340697 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a101a0430 con 0x7f3a101094e0 2024-09-21T06:35:17.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:17.972+0000 7f3a0e59c640 1 --2- 172.21.15.7:0/4099340697 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a10103ba0 0x7f3a1019a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:35:17.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:17.973+0000 7f3a0dd9b640 1 --2- 172.21.15.7:0/4099340697 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a101094e0 0x7f3a1019aa60 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f39f802a930 tx=0x7f39f8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:17.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:17.973+0000 7f3a077fe640 1 -- 172.21.15.7:0/4099340697 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f803f030 con 0x7f3a101094e0 2024-09-21T06:35:17.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:17.973+0000 7f3a149a0640 1 -- 172.21.15.7:0/4099340697 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a101a06c0 con 0x7f3a101094e0 2024-09-21T06:35:17.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:17.973+0000 7f3a077fe640 1 -- 172.21.15.7:0/4099340697 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f39f8003aa0 con 0x7f3a101094e0 2024-09-21T06:35:17.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:17.973+0000 7f3a077fe640 1 -- 172.21.15.7:0/4099340697 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f8035070 con 0x7f3a101094e0 2024-09-21T06:35:17.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:17.973+0000 7f3a149a0640 1 -- 172.21.15.7:0/4099340697 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a101a6e80 con 0x7f3a101094e0 2024-09-21T06:35:17.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:17.974+0000 7f3a149a0640 1 -- 172.21.15.7:0/4099340697 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a10104e20 con 0x7f3a101094e0 2024-09-21T06:35:17.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:17.975+0000 7f3a077fe640 1 -- 172.21.15.7:0/4099340697 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154579+0+0 (secure 0 0 0) 0x7f39f8042030 con 0x7f3a101094e0 2024-09-21T06:35:17.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:17.976+0000 7f3a077fe640 1 --2- 172.21.15.7:0/4099340697 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f39fc0b65f0 0x7f39fc0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:17.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:17.977+0000 7f3a0e59c640 1 --2- 172.21.15.7:0/4099340697 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f39fc0b65f0 0x7f39fc0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:17.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:17.977+0000 7f3a077fe640 1 -- 172.21.15.7:0/4099340697 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f39f81080b0 con 0x7f3a101094e0 2024-09-21T06:35:17.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:17.977+0000 7f3a0e59c640 1 --2- 172.21.15.7:0/4099340697 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f39fc0b65f0 0x7f39fc0b8b00 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3a000058c0 tx=0x7f3a00005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:17.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:17.979+0000 7f3a077fe640 1 -- 172.21.15.7:0/4099340697 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f39f80ce760 con 0x7f3a101094e0 2024-09-21T06:35:18.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:18.142+0000 7f3218bd0640 1 -- 172.21.15.7:0/2144655918 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3214102a60 msgr2=0x7f3214102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:18.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:18.142+0000 7f3218bd0640 1 --2- 172.21.15.7:0/2144655918 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3214102a60 0x7f3214102e70 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f3204009900 tx=0x7f320402a410 comp rx=0 tx=0).stop 2024-09-21T06:35:18.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:18.142+0000 7f3218bd0640 1 -- 172.21.15.7:0/2144655918 shutdown_connections 2024-09-21T06:35:18.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:18.142+0000 7f3218bd0640 1 --2- 172.21.15.7:0/2144655918 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3214108cf0 0x7f321410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:18.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:18.142+0000 7f3218bd0640 1 --2- 172.21.15.7:0/2144655918 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f32141083a0 0x7f32141087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:18.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:18.142+0000 7f3218bd0640 1 --2- 172.21.15.7:0/2144655918 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3214102a60 0x7f3214102e70 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:18.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:18.142+0000 7f3218bd0640 1 -- 172.21.15.7:0/2144655918 >> 172.21.15.7:0/2144655918 conn(0x7f3214079730 msgr2=0x7f3214079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:18.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:18.142+0000 7f3218bd0640 1 -- 172.21.15.7:0/2144655918 shutdown_connections 2024-09-21T06:35:18.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:18.142+0000 7f3218bd0640 1 -- 172.21.15.7:0/2144655918 wait complete. 2024-09-21T06:35:18.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:18.143+0000 7f3218bd0640 1 Processor -- start 2024-09-21T06:35:18.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:18.143+0000 7f3218bd0640 1 -- start start 2024-09-21T06:35:18.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:18.143+0000 7f3218bd0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3214102a60 0x7f3214199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:18.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:18.143+0000 7f3218bd0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32141083a0 0x7f32141998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:18.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:18.143+0000 7f3218bd0640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3214108cf0 0x7f321419eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:18.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:18.143+0000 7f3218bd0640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3214112960 con 0x7f32141083a0 2024-09-21T06:35:18.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:18.143+0000 7f3218bd0640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f32141127e0 con 0x7f3214102a60 2024-09-21T06:35:18.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:18.144+0000 7f3218bd0640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3214112ae0 con 0x7f3214108cf0 2024-09-21T06:35:18.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:18.144+0000 7f3211d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32141083a0 0x7f32141998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:18.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:18.144+0000 7f3211d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32141083a0 0x7f32141998b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36160/0 (socket says 172.21.15.7:36160) 2024-09-21T06:35:18.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:18.144+0000 7f3211d9b640 1 -- 172.21.15.7:0/1301839422 learned_addr learned my addr 172.21.15.7:0/1301839422 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:35:18.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:18.144+0000 7f3212d9d640 1 --2- 172.21.15.7:0/1301839422 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3214108cf0 0x7f321419eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:18.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:18.144+0000 7f321259c640 1 --2- 172.21.15.7:0/1301839422 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3214102a60 0x7f3214199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:18.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:18.144+0000 7f3211d9b640 1 -- 172.21.15.7:0/1301839422 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3214108cf0 msgr2=0x7f321419eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:18.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:18.144+0000 7f3211d9b640 1 --2- 172.21.15.7:0/1301839422 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3214108cf0 0x7f321419eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:18.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:18.144+0000 7f3211d9b640 1 -- 172.21.15.7:0/1301839422 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3214102a60 msgr2=0x7f3214199310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:18.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:18.144+0000 7f3211d9b640 1 --2- 172.21.15.7:0/1301839422 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3214102a60 0x7f3214199310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:18.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:18.144+0000 7f3211d9b640 1 -- 172.21.15.7:0/1301839422 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f321419f1c0 con 0x7f32141083a0 2024-09-21T06:35:18.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:18.144+0000 7f3212d9d640 1 --2- 172.21.15.7:0/1301839422 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3214108cf0 0x7f321419eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:35:18.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:18.144+0000 7f3211d9b640 1 --2- 172.21.15.7:0/1301839422 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32141083a0 0x7f32141998b0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f31fc00c970 tx=0x7f31fc00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:18.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:18.145+0000 7f320b7fe640 1 -- 172.21.15.7:0/1301839422 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31fc014070 con 0x7f32141083a0 2024-09-21T06:35:18.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:18.145+0000 7f3218bd0640 1 -- 172.21.15.7:0/1301839422 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f321419f4b0 con 0x7f32141083a0 2024-09-21T06:35:18.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:18.145+0000 7f320b7fe640 1 -- 172.21.15.7:0/1301839422 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f31fc004440 con 0x7f32141083a0 2024-09-21T06:35:18.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:18.145+0000 7f320b7fe640 1 -- 172.21.15.7:0/1301839422 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31fc003e50 con 0x7f32141083a0 2024-09-21T06:35:18.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:18.145+0000 7f3218bd0640 1 -- 172.21.15.7:0/1301839422 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32141a5cd0 con 0x7f32141083a0 2024-09-21T06:35:18.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:18.146+0000 7f3218bd0640 1 -- 172.21.15.7:0/1301839422 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3214102e70 con 0x7f32141083a0 2024-09-21T06:35:18.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:18.148+0000 7f320b7fe640 1 -- 172.21.15.7:0/1301839422 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154579+0+0 (secure 0 0 0) 0x7f31fc017070 con 0x7f32141083a0 2024-09-21T06:35:18.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:18.148+0000 7f320b7fe640 1 --2- 172.21.15.7:0/1301839422 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f32000b67c0 0x7f32000b8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:18.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:18.148+0000 7f321259c640 1 --2- 172.21.15.7:0/1301839422 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f32000b67c0 0x7f32000b8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:18.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:18.148+0000 7f320b7fe640 1 -- 172.21.15.7:0/1301839422 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f31fc0e7760 con 0x7f32141083a0 2024-09-21T06:35:18.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:18.149+0000 7f321259c640 1 --2- 172.21.15.7:0/1301839422 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f32000b67c0 0x7f32000b8cd0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3204031440 tx=0x7f3204009560 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:18.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:18.152+0000 7f320b7fe640 1 -- 172.21.15.7:0/1301839422 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f31fc01e020 con 0x7f32141083a0 2024-09-21T06:35:18.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:18.178+0000 7f3a149a0640 1 -- 172.21.15.7:0/4099340697 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f3a1010bc20 con 0x7f3a101094e0 2024-09-21T06:35:18.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:18.178+0000 7f3a077fe640 1 -- 172.21.15.7:0/4099340697 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f39f80d2b40 con 0x7f3a101094e0 2024-09-21T06:35:18.180 INFO:teuthology.orchestra.run.smithi007.stdout:296352743448 2024-09-21T06:35:18.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:18.180+0000 7f3a149a0640 1 -- 172.21.15.7:0/4099340697 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f39fc0b65f0 msgr2=0x7f39fc0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:18.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:18.180+0000 7f3a149a0640 1 --2- 172.21.15.7:0/4099340697 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f39fc0b65f0 0x7f39fc0b8b00 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3a000058c0 tx=0x7f3a00005850 comp rx=0 tx=0).stop 2024-09-21T06:35:18.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:18.180+0000 7f3a149a0640 1 -- 172.21.15.7:0/4099340697 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a101094e0 msgr2=0x7f3a1019aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:18.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:18.180+0000 7f3a149a0640 1 --2- 172.21.15.7:0/4099340697 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a101094e0 0x7f3a1019aa60 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f39f802a930 tx=0x7f39f8004270 comp rx=0 tx=0).stop 2024-09-21T06:35:18.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:18.180+0000 7f3a149a0640 1 -- 172.21.15.7:0/4099340697 shutdown_connections 2024-09-21T06:35:18.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:18.180+0000 7f3a149a0640 1 --2- 172.21.15.7:0/4099340697 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f39fc0b65f0 0x7f39fc0b8b00 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:18.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:18.180+0000 7f3a149a0640 1 --2- 172.21.15.7:0/4099340697 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3a10109e30 0x7f3a1019fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:18.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:18.180+0000 7f3a149a0640 1 --2- 172.21.15.7:0/4099340697 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3a101094e0 0x7f3a1019aa60 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:18.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:18.180+0000 7f3a149a0640 1 --2- 172.21.15.7:0/4099340697 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a10103ba0 0x7f3a1019a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:18.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:18.180+0000 7f3a149a0640 1 -- 172.21.15.7:0/4099340697 >> 172.21.15.7:0/4099340697 conn(0x7f3a100ff630 msgr2=0x7f3a10101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:18.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:18.180+0000 7f3a149a0640 1 -- 172.21.15.7:0/4099340697 shutdown_connections 2024-09-21T06:35:18.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:18.180+0000 7f3a149a0640 1 -- 172.21.15.7:0/4099340697 wait complete. 2024-09-21T06:35:18.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:18.347+0000 7f3218bd0640 1 -- 172.21.15.7:0/1301839422 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f321419a440 con 0x7f32141083a0 2024-09-21T06:35:18.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:18.347+0000 7f320b7fe640 1 -- 172.21.15.7:0/1301839422 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f321419a440 con 0x7f32141083a0 2024-09-21T06:35:18.349 INFO:teuthology.orchestra.run.smithi007.stdout:270582939675 2024-09-21T06:35:18.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:18.349+0000 7f3218bd0640 1 -- 172.21.15.7:0/1301839422 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f32000b67c0 msgr2=0x7f32000b8cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:18.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:18.349+0000 7f3218bd0640 1 --2- 172.21.15.7:0/1301839422 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f32000b67c0 0x7f32000b8cd0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3204031440 tx=0x7f3204009560 comp rx=0 tx=0).stop 2024-09-21T06:35:18.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:18.349+0000 7f3218bd0640 1 -- 172.21.15.7:0/1301839422 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32141083a0 msgr2=0x7f32141998b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:18.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:18.349+0000 7f3218bd0640 1 --2- 172.21.15.7:0/1301839422 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32141083a0 0x7f32141998b0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f31fc00c970 tx=0x7f31fc00ce30 comp rx=0 tx=0).stop 2024-09-21T06:35:18.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:18.349+0000 7f3218bd0640 1 -- 172.21.15.7:0/1301839422 shutdown_connections 2024-09-21T06:35:18.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:18.349+0000 7f3218bd0640 1 --2- 172.21.15.7:0/1301839422 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f32000b67c0 0x7f32000b8cd0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:18.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:18.349+0000 7f3218bd0640 1 --2- 172.21.15.7:0/1301839422 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3214108cf0 0x7f321419eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:18.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:18.349+0000 7f3218bd0640 1 --2- 172.21.15.7:0/1301839422 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f32141083a0 0x7f32141998b0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:18.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:18.349+0000 7f3218bd0640 1 --2- 172.21.15.7:0/1301839422 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3214102a60 0x7f3214199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:18.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:18.349+0000 7f3218bd0640 1 -- 172.21.15.7:0/1301839422 >> 172.21.15.7:0/1301839422 conn(0x7f3214079730 msgr2=0x7f32141013f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:18.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:18.349+0000 7f3218bd0640 1 -- 172.21.15.7:0/1301839422 shutdown_connections 2024-09-21T06:35:18.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:18.349+0000 7f3218bd0640 1 -- 172.21.15.7:0/1301839422 wait complete. 2024-09-21T06:35:18.544 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:35:18 smithi007 ceph-mon[30983]: pgmap v292: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:35:18.544 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:35:18 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/4099340697' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-21T06:35:18.571 INFO:tasks.cephadm.ceph_manager.ceph:need seq 223338299428 got 223338299430 for osd.8 2024-09-21T06:35:18.572 DEBUG:teuthology.parallel:result is None 2024-09-21T06:35:18.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:35:18 smithi018 ceph-mon[34477]: pgmap v292: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:35:18.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:35:18 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/4099340697' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-21T06:35:18.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:35:18 smithi144 ceph-mon[34653]: pgmap v292: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:35:18.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:35:18 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/4099340697' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-21T06:35:19.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:35:19 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/1301839422' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-21T06:35:19.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:35:19 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:35:19.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:35:19 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/1301839422' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-21T06:35:19.620 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:35:19 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:35:19.692 INFO:tasks.cephadm.ceph_manager.ceph:need seq 296352743446 got 296352743448 for osd.11 2024-09-21T06:35:19.692 DEBUG:teuthology.parallel:result is None 2024-09-21T06:35:19.702 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:35:19 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/1301839422' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-21T06:35:19.702 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:35:19 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:35:19.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:19.884+0000 7f5ee8452640 1 -- 172.21.15.7:0/143483051 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5ee0102a90 msgr2=0x7f5ee0102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:19.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:19.884+0000 7f5ee8452640 1 --2- 172.21.15.7:0/143483051 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5ee0102a90 0x7f5ee0102ea0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f5ed0009900 tx=0x7f5ed002a410 comp rx=0 tx=0).stop 2024-09-21T06:35:19.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:19.884+0000 7f5ee8452640 1 -- 172.21.15.7:0/143483051 shutdown_connections 2024-09-21T06:35:19.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:19.884+0000 7f5ee8452640 1 --2- 172.21.15.7:0/143483051 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5ee0108d20 0x7f5ee010f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:19.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:19.884+0000 7f5ee8452640 1 --2- 172.21.15.7:0/143483051 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ee01083d0 0x7f5ee01087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:19.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:19.884+0000 7f5ee8452640 1 --2- 172.21.15.7:0/143483051 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5ee0102a90 0x7f5ee0102ea0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:19.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:19.884+0000 7f5ee8452640 1 -- 172.21.15.7:0/143483051 >> 172.21.15.7:0/143483051 conn(0x7f5ee0079730 msgr2=0x7f5ee0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:19.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:19.884+0000 7f5ee8452640 1 -- 172.21.15.7:0/143483051 shutdown_connections 2024-09-21T06:35:19.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:19.884+0000 7f5ee8452640 1 -- 172.21.15.7:0/143483051 wait complete. 2024-09-21T06:35:19.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:19.885+0000 7f5ee8452640 1 Processor -- start 2024-09-21T06:35:19.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:19.885+0000 7f5ee8452640 1 -- start start 2024-09-21T06:35:19.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:19.886+0000 7f5ee8452640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5ee0102a90 0x7f5ee019b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:19.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:19.886+0000 7f5ee8452640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ee01083d0 0x7f5ee019b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:19.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:19.886+0000 7f5ee8452640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5ee0108d20 0x7f5ee019bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:19.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:19.886+0000 7f5ee8452640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee01129e0 con 0x7f5ee0108d20 2024-09-21T06:35:19.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:19.886+0000 7f5ee8452640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee0112860 con 0x7f5ee01083d0 2024-09-21T06:35:19.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:19.886+0000 7f5ee8452640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee0112b60 con 0x7f5ee0102a90 2024-09-21T06:35:19.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:19.886+0000 7f5ee61ee640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5ee0102a90 0x7f5ee019b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:19.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:19.886+0000 7f5ee69ef640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5ee0108d20 0x7f5ee019bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:19.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:19.886+0000 7f5ee61ee640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5ee0102a90 0x7f5ee019b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.7:33188/0 (socket says 172.21.15.7:33188) 2024-09-21T06:35:19.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:19.886+0000 7f5ee61ee640 1 -- 172.21.15.7:0/3155020154 learned_addr learned my addr 172.21.15.7:0/3155020154 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:35:19.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:19.886+0000 7f5ee59ed640 1 --2- 172.21.15.7:0/3155020154 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ee01083d0 0x7f5ee019b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:19.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:19.886+0000 7f5ee69ef640 1 -- 172.21.15.7:0/3155020154 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5ee0102a90 msgr2=0x7f5ee019b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:19.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:19.886+0000 7f5ee69ef640 1 --2- 172.21.15.7:0/3155020154 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5ee0102a90 0x7f5ee019b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:19.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:19.886+0000 7f5ee69ef640 1 -- 172.21.15.7:0/3155020154 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ee01083d0 msgr2=0x7f5ee019b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:19.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:19.886+0000 7f5ee69ef640 1 --2- 172.21.15.7:0/3155020154 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ee01083d0 0x7f5ee019b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:19.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:19.886+0000 7f5ee69ef640 1 -- 172.21.15.7:0/3155020154 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ee01a65a0 con 0x7f5ee0108d20 2024-09-21T06:35:19.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:19.886+0000 7f5ee61ee640 1 --2- 172.21.15.7:0/3155020154 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5ee0102a90 0x7f5ee019b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:35:19.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:19.886+0000 7f5ee59ed640 1 --2- 172.21.15.7:0/3155020154 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ee01083d0 0x7f5ee019b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:35:19.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:19.886+0000 7f5ee69ef640 1 --2- 172.21.15.7:0/3155020154 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5ee0108d20 0x7f5ee019bd90 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f5ed800e970 tx=0x7f5ed800ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:19.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:19.886+0000 7f5edf7fe640 1 -- 172.21.15.7:0/3155020154 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ed800ccc0 con 0x7f5ee0108d20 2024-09-21T06:35:19.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:19.886+0000 7f5edf7fe640 1 -- 172.21.15.7:0/3155020154 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5ed8005020 con 0x7f5ee0108d20 2024-09-21T06:35:19.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:19.886+0000 7f5edf7fe640 1 -- 172.21.15.7:0/3155020154 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ed8004a00 con 0x7f5ee0108d20 2024-09-21T06:35:19.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:19.886+0000 7f5ee8452640 1 -- 172.21.15.7:0/3155020154 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ee01a6890 con 0x7f5ee0108d20 2024-09-21T06:35:19.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:19.887+0000 7f5ee8452640 1 -- 172.21.15.7:0/3155020154 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ee01a6dd0 con 0x7f5ee0108d20 2024-09-21T06:35:19.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:19.888+0000 7f5ee8452640 1 -- 172.21.15.7:0/3155020154 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ee0103d10 con 0x7f5ee0108d20 2024-09-21T06:35:19.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:19.890+0000 7f5edf7fe640 1 -- 172.21.15.7:0/3155020154 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154579+0+0 (secure 0 0 0) 0x7f5ed8004ba0 con 0x7f5ee0108d20 2024-09-21T06:35:19.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:19.891+0000 7f5edf7fe640 1 --2- 172.21.15.7:0/3155020154 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f5ec80b6620 0x7f5ec80b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:19.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:19.891+0000 7f5ee61ee640 1 --2- 172.21.15.7:0/3155020154 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f5ec80b6620 0x7f5ec80b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:19.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:19.891+0000 7f5edf7fe640 1 -- 172.21.15.7:0/3155020154 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f5ed80e7570 con 0x7f5ee0108d20 2024-09-21T06:35:19.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:19.891+0000 7f5ee61ee640 1 --2- 172.21.15.7:0/3155020154 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f5ec80b6620 0x7f5ec80b8b30 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5ed0009230 tx=0x7f5ed00058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:19.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:19.894+0000 7f5edf7fe640 1 -- 172.21.15.7:0/3155020154 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5ed80adcb0 con 0x7f5ee0108d20 2024-09-21T06:35:20.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.087+0000 7f5ee8452640 1 -- 172.21.15.7:0/3155020154 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f5ee0102ea0 con 0x7f5ee0108d20 2024-09-21T06:35:20.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.087+0000 7f5edf7fe640 1 -- 172.21.15.7:0/3155020154 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5ee0102ea0 con 0x7f5ee0108d20 2024-09-21T06:35:20.089 INFO:teuthology.orchestra.run.smithi007.stdout:81604378695 2024-09-21T06:35:20.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.090+0000 7f5ee8452640 1 -- 172.21.15.7:0/3155020154 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f5ec80b6620 msgr2=0x7f5ec80b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:20.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.090+0000 7f5ee8452640 1 --2- 172.21.15.7:0/3155020154 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f5ec80b6620 0x7f5ec80b8b30 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5ed0009230 tx=0x7f5ed00058d0 comp rx=0 tx=0).stop 2024-09-21T06:35:20.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.090+0000 7f5ee8452640 1 -- 172.21.15.7:0/3155020154 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5ee0108d20 msgr2=0x7f5ee019bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:20.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.090+0000 7f5ee8452640 1 --2- 172.21.15.7:0/3155020154 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5ee0108d20 0x7f5ee019bd90 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f5ed800e970 tx=0x7f5ed800ee30 comp rx=0 tx=0).stop 2024-09-21T06:35:20.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.090+0000 7f5ee8452640 1 -- 172.21.15.7:0/3155020154 shutdown_connections 2024-09-21T06:35:20.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.090+0000 7f5ee8452640 1 --2- 172.21.15.7:0/3155020154 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f5ec80b6620 0x7f5ec80b8b30 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:20.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.090+0000 7f5ee8452640 1 --2- 172.21.15.7:0/3155020154 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5ee0108d20 0x7f5ee019bd90 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:20.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.090+0000 7f5ee8452640 1 --2- 172.21.15.7:0/3155020154 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ee01083d0 0x7f5ee019b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:20.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.090+0000 7f5ee8452640 1 --2- 172.21.15.7:0/3155020154 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5ee0102a90 0x7f5ee019b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:20.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.090+0000 7f5ee8452640 1 -- 172.21.15.7:0/3155020154 >> 172.21.15.7:0/3155020154 conn(0x7f5ee0079730 msgr2=0x7f5ee0106460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:20.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.090+0000 7f5ee8452640 1 -- 172.21.15.7:0/3155020154 shutdown_connections 2024-09-21T06:35:20.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.090+0000 7f5ee8452640 1 -- 172.21.15.7:0/3155020154 wait complete. 2024-09-21T06:35:20.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.107+0000 7f7182dcd640 1 -- 172.21.15.7:0/713622651 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f717c109ec0 msgr2=0x7f717c1106f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:20.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.107+0000 7f7182dcd640 1 --2- 172.21.15.7:0/713622651 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f717c109ec0 0x7f717c1106f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f7174009ca0 tx=0x7f717402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:35:20.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.107+0000 7f7182dcd640 1 -- 172.21.15.7:0/713622651 shutdown_connections 2024-09-21T06:35:20.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.107+0000 7f7182dcd640 1 --2- 172.21.15.7:0/713622651 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f717c109ec0 0x7f717c1106f0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:20.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.107+0000 7f7182dcd640 1 --2- 172.21.15.7:0/713622651 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f717c109570 0x7f717c109980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:20.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.107+0000 7f7182dcd640 1 --2- 172.21.15.7:0/713622651 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f717c103c30 0x7f717c104040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:20.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.107+0000 7f7182dcd640 1 -- 172.21.15.7:0/713622651 >> 172.21.15.7:0/713622651 conn(0x7f717c07b8d0 msgr2=0x7f717c07bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:20.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.107+0000 7f7182dcd640 1 -- 172.21.15.7:0/713622651 shutdown_connections 2024-09-21T06:35:20.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.107+0000 7f7182dcd640 1 -- 172.21.15.7:0/713622651 wait complete. 2024-09-21T06:35:20.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.108+0000 7f7182dcd640 1 Processor -- start 2024-09-21T06:35:20.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.108+0000 7f7182dcd640 1 -- start start 2024-09-21T06:35:20.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.108+0000 7f7182dcd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f717c103c30 0x7f717c19a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:20.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.109+0000 7f7182dcd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f717c109570 0x7f717c19a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:20.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.109+0000 7f7182dcd640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f717c109ec0 0x7f717c19fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:20.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.109+0000 7f7182dcd640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f717c113ae0 con 0x7f717c109570 2024-09-21T06:35:20.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.109+0000 7f7182dcd640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f717c113960 con 0x7f717c103c30 2024-09-21T06:35:20.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.109+0000 7f7182dcd640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f717c113c60 con 0x7f717c109ec0 2024-09-21T06:35:20.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.109+0000 7f717bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f717c109570 0x7f717c19a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:20.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.109+0000 7f717bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f717c109570 0x7f717c19a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36190/0 (socket says 172.21.15.7:36190) 2024-09-21T06:35:20.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.109+0000 7f717bfff640 1 -- 172.21.15.7:0/765582520 learned_addr learned my addr 172.21.15.7:0/765582520 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:35:20.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.109+0000 7f718136a640 1 --2- 172.21.15.7:0/765582520 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f717c109ec0 0x7f717c19fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:20.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.109+0000 7f7180b69640 1 --2- 172.21.15.7:0/765582520 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f717c103c30 0x7f717c19a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:20.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.109+0000 7f717bfff640 1 -- 172.21.15.7:0/765582520 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f717c109ec0 msgr2=0x7f717c19fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:20.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.109+0000 7f717bfff640 1 --2- 172.21.15.7:0/765582520 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f717c109ec0 0x7f717c19fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:20.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.109+0000 7f717bfff640 1 -- 172.21.15.7:0/765582520 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f717c103c30 msgr2=0x7f717c19a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:20.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.109+0000 7f717bfff640 1 --2- 172.21.15.7:0/765582520 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f717c103c30 0x7f717c19a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:20.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.109+0000 7f717bfff640 1 -- 172.21.15.7:0/765582520 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f717c1a0360 con 0x7f717c109570 2024-09-21T06:35:20.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.109+0000 7f717bfff640 1 --2- 172.21.15.7:0/765582520 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f717c109570 0x7f717c19a990 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f716800e9f0 tx=0x7f716800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:20.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.110+0000 7f7179ffb640 1 -- 172.21.15.7:0/765582520 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f716800ccc0 con 0x7f717c109570 2024-09-21T06:35:20.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.110+0000 7f7182dcd640 1 -- 172.21.15.7:0/765582520 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f717c1a0650 con 0x7f717c109570 2024-09-21T06:35:20.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.110+0000 7f7179ffb640 1 -- 172.21.15.7:0/765582520 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f71680108e0 con 0x7f717c109570 2024-09-21T06:35:20.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.110+0000 7f7179ffb640 1 -- 172.21.15.7:0/765582520 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7168018860 con 0x7f717c109570 2024-09-21T06:35:20.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.110+0000 7f7182dcd640 1 -- 172.21.15.7:0/765582520 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f717c1a6db0 con 0x7f717c109570 2024-09-21T06:35:20.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.111+0000 7f7182dcd640 1 -- 172.21.15.7:0/765582520 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f717c104040 con 0x7f717c109570 2024-09-21T06:35:20.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.112+0000 7f7179ffb640 1 -- 172.21.15.7:0/765582520 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154579+0+0 (secure 0 0 0) 0x7f7168010430 con 0x7f717c109570 2024-09-21T06:35:20.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.113+0000 7f7179ffb640 1 --2- 172.21.15.7:0/765582520 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f716c0b6670 0x7f716c0b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:20.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.114+0000 7f7180b69640 1 --2- 172.21.15.7:0/765582520 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f716c0b6670 0x7f716c0b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:20.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.114+0000 7f7179ffb640 1 -- 172.21.15.7:0/765582520 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f71680e77a0 con 0x7f717c109570 2024-09-21T06:35:20.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.114+0000 7f7180b69640 1 --2- 172.21.15.7:0/765582520 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f716c0b6670 0x7f716c0b8b80 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7170009bd0 tx=0x7f7170005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:20.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.119+0000 7f7179ffb640 1 -- 172.21.15.7:0/765582520 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f71680b2230 con 0x7f717c109570 2024-09-21T06:35:20.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.309+0000 7f7182dcd640 1 -- 172.21.15.7:0/765582520 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f717c02e640 con 0x7f717c109570 2024-09-21T06:35:20.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.309+0000 7f7179ffb640 1 -- 172.21.15.7:0/765582520 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f71680b7170 con 0x7f717c109570 2024-09-21T06:35:20.311 INFO:teuthology.orchestra.run.smithi007.stdout:107374182465 2024-09-21T06:35:20.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.311+0000 7f7182dcd640 1 -- 172.21.15.7:0/765582520 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f716c0b6670 msgr2=0x7f716c0b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:20.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.311+0000 7f7182dcd640 1 --2- 172.21.15.7:0/765582520 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f716c0b6670 0x7f716c0b8b80 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7170009bd0 tx=0x7f7170005f90 comp rx=0 tx=0).stop 2024-09-21T06:35:20.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.311+0000 7f7182dcd640 1 -- 172.21.15.7:0/765582520 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f717c109570 msgr2=0x7f717c19a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:20.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.311+0000 7f7182dcd640 1 --2- 172.21.15.7:0/765582520 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f717c109570 0x7f717c19a990 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f716800e9f0 tx=0x7f716800eeb0 comp rx=0 tx=0).stop 2024-09-21T06:35:20.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.311+0000 7f7182dcd640 1 -- 172.21.15.7:0/765582520 shutdown_connections 2024-09-21T06:35:20.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.311+0000 7f7182dcd640 1 --2- 172.21.15.7:0/765582520 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f716c0b6670 0x7f716c0b8b80 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:20.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.311+0000 7f7182dcd640 1 --2- 172.21.15.7:0/765582520 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f717c109ec0 0x7f717c19fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:20.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.311+0000 7f7182dcd640 1 --2- 172.21.15.7:0/765582520 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f717c109570 0x7f717c19a990 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:20.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.311+0000 7f7182dcd640 1 --2- 172.21.15.7:0/765582520 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f717c103c30 0x7f717c19a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:20.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.311+0000 7f7182dcd640 1 -- 172.21.15.7:0/765582520 >> 172.21.15.7:0/765582520 conn(0x7f717c07b8d0 msgr2=0x7f717c107560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:20.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.311+0000 7f7182dcd640 1 -- 172.21.15.7:0/765582520 shutdown_connections 2024-09-21T06:35:20.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.311+0000 7f7182dcd640 1 -- 172.21.15.7:0/765582520 wait complete. 2024-09-21T06:35:20.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:35:20 smithi007 ceph-mon[30983]: pgmap v293: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T06:35:20.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:35:20 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/3155020154' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T06:35:20.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:35:20 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/765582520' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T06:35:20.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:35:20 smithi018 ceph-mon[34477]: pgmap v293: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T06:35:20.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:35:20 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/3155020154' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T06:35:20.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:35:20 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/765582520' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T06:35:20.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.745+0000 7f40f2cf8640 1 -- 172.21.15.7:0/2112197325 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f40ec102a60 msgr2=0x7f40ec102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:20.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.745+0000 7f40f2cf8640 1 --2- 172.21.15.7:0/2112197325 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f40ec102a60 0x7f40ec102e70 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f40e0009900 tx=0x7f40e002a410 comp rx=0 tx=0).stop 2024-09-21T06:35:20.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.745+0000 7f40f2cf8640 1 -- 172.21.15.7:0/2112197325 shutdown_connections 2024-09-21T06:35:20.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.745+0000 7f40f2cf8640 1 --2- 172.21.15.7:0/2112197325 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f40ec108cf0 0x7f40ec10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:20.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.745+0000 7f40f2cf8640 1 --2- 172.21.15.7:0/2112197325 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40ec1083a0 0x7f40ec1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:20.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.745+0000 7f40f2cf8640 1 --2- 172.21.15.7:0/2112197325 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f40ec102a60 0x7f40ec102e70 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:20.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.745+0000 7f40f2cf8640 1 -- 172.21.15.7:0/2112197325 >> 172.21.15.7:0/2112197325 conn(0x7f40ec079730 msgr2=0x7f40ec079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:20.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.745+0000 7f40f2cf8640 1 -- 172.21.15.7:0/2112197325 shutdown_connections 2024-09-21T06:35:20.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.745+0000 7f40f2cf8640 1 -- 172.21.15.7:0/2112197325 wait complete. 2024-09-21T06:35:20.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.746+0000 7f40f2cf8640 1 Processor -- start 2024-09-21T06:35:20.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.746+0000 7f40f2cf8640 1 -- start start 2024-09-21T06:35:20.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.746+0000 7f40f2cf8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f40ec102a60 0x7f40ec199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:20.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.746+0000 7f40f2cf8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40ec1083a0 0x7f40ec1998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:20.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.746+0000 7f40f2cf8640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f40ec108cf0 0x7f40ec19eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:20.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.746+0000 7f40f2cf8640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f40ec112960 con 0x7f40ec102a60 2024-09-21T06:35:20.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.746+0000 7f40f2cf8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f40ec1127e0 con 0x7f40ec1083a0 2024-09-21T06:35:20.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.746+0000 7f40f2cf8640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f40ec112ae0 con 0x7f40ec108cf0 2024-09-21T06:35:20.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.746+0000 7f40f0a94640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f40ec102a60 0x7f40ec199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:20.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.746+0000 7f40f0a94640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f40ec102a60 0x7f40ec199310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58434/0 (socket says 172.21.15.7:58434) 2024-09-21T06:35:20.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.746+0000 7f40f0a94640 1 -- 172.21.15.7:0/3971092709 learned_addr learned my addr 172.21.15.7:0/3971092709 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:35:20.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.746+0000 7f40ebfff640 1 --2- 172.21.15.7:0/3971092709 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40ec1083a0 0x7f40ec1998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:20.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.746+0000 7f40f1295640 1 --2- 172.21.15.7:0/3971092709 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f40ec108cf0 0x7f40ec19eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:20.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.747+0000 7f40f0a94640 1 -- 172.21.15.7:0/3971092709 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f40ec108cf0 msgr2=0x7f40ec19eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:20.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.747+0000 7f40f0a94640 1 --2- 172.21.15.7:0/3971092709 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f40ec108cf0 0x7f40ec19eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:20.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.747+0000 7f40f0a94640 1 -- 172.21.15.7:0/3971092709 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40ec1083a0 msgr2=0x7f40ec1998b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:20.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.747+0000 7f40f0a94640 1 --2- 172.21.15.7:0/3971092709 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40ec1083a0 0x7f40ec1998b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:20.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.747+0000 7f40f0a94640 1 -- 172.21.15.7:0/3971092709 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40ec19f280 con 0x7f40ec102a60 2024-09-21T06:35:20.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.747+0000 7f40ebfff640 1 --2- 172.21.15.7:0/3971092709 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40ec1083a0 0x7f40ec1998b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:35:20.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.747+0000 7f40f0a94640 1 --2- 172.21.15.7:0/3971092709 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f40ec102a60 0x7f40ec199310 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f40e0005940 tx=0x7f40e0004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:20.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.747+0000 7f40e9ffb640 1 -- 172.21.15.7:0/3971092709 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40e0046070 con 0x7f40ec102a60 2024-09-21T06:35:20.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.747+0000 7f40e9ffb640 1 -- 172.21.15.7:0/3971092709 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f40e0004440 con 0x7f40ec102a60 2024-09-21T06:35:20.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.747+0000 7f40f2cf8640 1 -- 172.21.15.7:0/3971092709 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40ec19f510 con 0x7f40ec102a60 2024-09-21T06:35:20.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.747+0000 7f40e9ffb640 1 -- 172.21.15.7:0/3971092709 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40e0035050 con 0x7f40ec102a60 2024-09-21T06:35:20.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.747+0000 7f40f2cf8640 1 -- 172.21.15.7:0/3971092709 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40ec06ae60 con 0x7f40ec102a60 2024-09-21T06:35:20.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.749+0000 7f40f2cf8640 1 -- 172.21.15.7:0/3971092709 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40ec103ce0 con 0x7f40ec102a60 2024-09-21T06:35:20.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.751+0000 7f40e9ffb640 1 -- 172.21.15.7:0/3971092709 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154579+0+0 (secure 0 0 0) 0x7f40e0049070 con 0x7f40ec102a60 2024-09-21T06:35:20.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.751+0000 7f40e9ffb640 1 --2- 172.21.15.7:0/3971092709 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f40dc0b6670 0x7f40dc0b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:20.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.752+0000 7f40ebfff640 1 --2- 172.21.15.7:0/3971092709 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f40dc0b6670 0x7f40dc0b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:20.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.752+0000 7f40e9ffb640 1 -- 172.21.15.7:0/3971092709 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f40e0109190 con 0x7f40ec102a60 2024-09-21T06:35:20.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.752+0000 7f40ebfff640 1 --2- 172.21.15.7:0/3971092709 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f40dc0b6670 0x7f40dc0b8b80 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f40ec100b70 tx=0x7f40d8005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:20.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.758+0000 7f40e9ffb640 1 -- 172.21.15.7:0/3971092709 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f40e00d3c20 con 0x7f40ec102a60 2024-09-21T06:35:20.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:35:20 smithi144 ceph-mon[34653]: pgmap v293: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T06:35:20.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:35:20 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/3155020154' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T06:35:20.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:35:20 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/765582520' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T06:35:20.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.950+0000 7f40f2cf8640 1 -- 172.21.15.7:0/3971092709 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f40ec06b8e0 con 0x7f40ec102a60 2024-09-21T06:35:20.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.950+0000 7f40e9ffb640 1 -- 172.21.15.7:0/3971092709 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f40e00d8b60 con 0x7f40ec102a60 2024-09-21T06:35:20.952 INFO:teuthology.orchestra.run.smithi007.stdout:249108103202 2024-09-21T06:35:20.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.953+0000 7f40f2cf8640 1 -- 172.21.15.7:0/3971092709 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f40dc0b6670 msgr2=0x7f40dc0b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:20.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.953+0000 7f40f2cf8640 1 --2- 172.21.15.7:0/3971092709 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f40dc0b6670 0x7f40dc0b8b80 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f40ec100b70 tx=0x7f40d8005f90 comp rx=0 tx=0).stop 2024-09-21T06:35:20.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.953+0000 7f40f2cf8640 1 -- 172.21.15.7:0/3971092709 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f40ec102a60 msgr2=0x7f40ec199310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:20.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.953+0000 7f40f2cf8640 1 --2- 172.21.15.7:0/3971092709 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f40ec102a60 0x7f40ec199310 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f40e0005940 tx=0x7f40e0004040 comp rx=0 tx=0).stop 2024-09-21T06:35:20.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.953+0000 7f40f2cf8640 1 -- 172.21.15.7:0/3971092709 shutdown_connections 2024-09-21T06:35:20.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.953+0000 7f40f2cf8640 1 --2- 172.21.15.7:0/3971092709 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f40dc0b6670 0x7f40dc0b8b80 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:20.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.953+0000 7f40f2cf8640 1 --2- 172.21.15.7:0/3971092709 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f40ec108cf0 0x7f40ec19eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:20.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.953+0000 7f40f2cf8640 1 --2- 172.21.15.7:0/3971092709 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f40ec1083a0 0x7f40ec1998b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:20.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.953+0000 7f40f2cf8640 1 --2- 172.21.15.7:0/3971092709 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f40ec102a60 0x7f40ec199310 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:20.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.953+0000 7f40f2cf8640 1 -- 172.21.15.7:0/3971092709 >> 172.21.15.7:0/3971092709 conn(0x7f40ec079730 msgr2=0x7f40ec101410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:20.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.953+0000 7f40f2cf8640 1 -- 172.21.15.7:0/3971092709 shutdown_connections 2024-09-21T06:35:20.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:20.953+0000 7f40f2cf8640 1 -- 172.21.15.7:0/3971092709 wait complete. 2024-09-21T06:35:21.587 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:35:21 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:35:21.587 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:35:21 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:35:21.587 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:35:21 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:35:21.587 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:35:21 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:35:21.587 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:35:21 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/3971092709' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-21T06:35:21.615 INFO:tasks.cephadm.ceph_manager.ceph:need seq 270582939674 got 270582939675 for osd.10 2024-09-21T06:35:21.615 DEBUG:teuthology.parallel:result is None 2024-09-21T06:35:21.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:35:21 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:35:21.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:35:21 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:35:21.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:35:21 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:35:21.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:35:21 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:35:21.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:35:21 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/3971092709' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-21T06:35:21.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:35:21 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:35:21.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:35:21 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:35:21.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:35:21 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:35:21.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:35:21 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:35:21.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:35:21 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/3971092709' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-21T06:35:22.011 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378692 got 81604378695 for osd.2 2024-09-21T06:35:22.011 DEBUG:teuthology.parallel:result is None 2024-09-21T06:35:22.274 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:22.274 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:22.807 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:35:22 smithi007 ceph-mon[30983]: pgmap v294: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-21T06:35:22.808 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542217 got 60129542219 for osd.1 2024-09-21T06:35:22.808 DEBUG:teuthology.parallel:result is None 2024-09-21T06:35:22.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:35:22 smithi018 ceph-mon[34477]: pgmap v294: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-21T06:35:22.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:22.460+0000 7fddcfd24640 1 -- 172.21.15.7:0/4076779744 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fddc8103b60 msgr2=0x7fddc8103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:22.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:22.460+0000 7fddcfd24640 1 --2- 172.21.15.7:0/4076779744 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fddc8103b60 0x7fddc8103f70 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fddc4009900 tx=0x7fddc402a410 comp rx=0 tx=0).stop 2024-09-21T06:35:22.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:22.460+0000 7fddcfd24640 1 -- 172.21.15.7:0/4076779744 shutdown_connections 2024-09-21T06:35:22.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:22.460+0000 7fddcfd24640 1 --2- 172.21.15.7:0/4076779744 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddc8109df0 0x7fddc8110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:22.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:22.460+0000 7fddcfd24640 1 --2- 172.21.15.7:0/4076779744 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fddc81094a0 0x7fddc81098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:22.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:22.460+0000 7fddcfd24640 1 --2- 172.21.15.7:0/4076779744 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fddc8103b60 0x7fddc8103f70 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:22.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:22.460+0000 7fddcfd24640 1 -- 172.21.15.7:0/4076779744 >> 172.21.15.7:0/4076779744 conn(0x7fddc807b850 msgr2=0x7fddc807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:22.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:22.460+0000 7fddcfd24640 1 -- 172.21.15.7:0/4076779744 shutdown_connections 2024-09-21T06:35:22.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:22.460+0000 7fddcfd24640 1 -- 172.21.15.7:0/4076779744 wait complete. 2024-09-21T06:35:22.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:22.461+0000 7fddcfd24640 1 Processor -- start 2024-09-21T06:35:22.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:22.461+0000 7fddcfd24640 1 -- start start 2024-09-21T06:35:22.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:22.461+0000 7fddcfd24640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddc8103b60 0x7fddc8075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:22.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:22.461+0000 7fddcfd24640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fddc81094a0 0x7fddc8075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:22.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:22.461+0000 7fddcfd24640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fddc8109df0 0x7fddc8076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:22.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:22.461+0000 7fddcfd24640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fddc8113ab0 con 0x7fddc81094a0 2024-09-21T06:35:22.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:22.461+0000 7fddcfd24640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fddc8113930 con 0x7fddc8109df0 2024-09-21T06:35:22.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:22.461+0000 7fddcfd24640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fddc8113c30 con 0x7fddc8103b60 2024-09-21T06:35:22.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:22.461+0000 7fddcd2bf640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fddc81094a0 0x7fddc8075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:22.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:22.461+0000 7fddcd2bf640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fddc81094a0 0x7fddc8075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58440/0 (socket says 172.21.15.7:58440) 2024-09-21T06:35:22.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:22.461+0000 7fddcd2bf640 1 -- 172.21.15.7:0/3637982954 learned_addr learned my addr 172.21.15.7:0/3637982954 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:35:22.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:22.461+0000 7fddce2c1640 1 --2- 172.21.15.7:0/3637982954 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fddc8109df0 0x7fddc8076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:22.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:22.461+0000 7fddcdac0640 1 --2- 172.21.15.7:0/3637982954 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddc8103b60 0x7fddc8075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:22.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:22.462+0000 7fddcd2bf640 1 -- 172.21.15.7:0/3637982954 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddc8103b60 msgr2=0x7fddc8075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:22.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:22.462+0000 7fddcd2bf640 1 --2- 172.21.15.7:0/3637982954 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddc8103b60 0x7fddc8075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:22.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:22.462+0000 7fddcd2bf640 1 -- 172.21.15.7:0/3637982954 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fddc8109df0 msgr2=0x7fddc8076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:22.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:22.462+0000 7fddcd2bf640 1 --2- 172.21.15.7:0/3637982954 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fddc8109df0 0x7fddc8076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:22.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:22.462+0000 7fddcd2bf640 1 -- 172.21.15.7:0/3637982954 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddc81a87e0 con 0x7fddc81094a0 2024-09-21T06:35:22.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:22.462+0000 7fddce2c1640 1 --2- 172.21.15.7:0/3637982954 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fddc8109df0 0x7fddc8076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:35:22.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:22.462+0000 7fddcd2bf640 1 --2- 172.21.15.7:0/3637982954 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fddc81094a0 0x7fddc8075c50 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fddb800d950 tx=0x7fddb800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:22.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:22.462+0000 7fddbeffd640 1 -- 172.21.15.7:0/3637982954 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddb8017070 con 0x7fddc81094a0 2024-09-21T06:35:22.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:22.462+0000 7fddbeffd640 1 -- 172.21.15.7:0/3637982954 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fddb8009c30 con 0x7fddc81094a0 2024-09-21T06:35:22.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:22.462+0000 7fddbeffd640 1 -- 172.21.15.7:0/3637982954 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddb80047a0 con 0x7fddc81094a0 2024-09-21T06:35:22.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:22.462+0000 7fddcfd24640 1 -- 172.21.15.7:0/3637982954 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddc81a8ad0 con 0x7fddc81094a0 2024-09-21T06:35:22.900 INFO:teuthology.orchestra.run.smithi007.stdout:38654705744 2024-09-21T06:35:22.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:22.462+0000 7fddcfd24640 1 -- 172.21.15.7:0/3637982954 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddc81a9060 con 0x7fddc81094a0 2024-09-21T06:35:22.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:22.463+0000 7fddcfd24640 1 -- 172.21.15.7:0/3637982954 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddc8103f70 con 0x7fddc81094a0 2024-09-21T06:35:22.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:22.465+0000 7fddbeffd640 1 -- 172.21.15.7:0/3637982954 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154579+0+0 (secure 0 0 0) 0x7fddb8004020 con 0x7fddc81094a0 2024-09-21T06:35:22.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:22.465+0000 7fddbeffd640 1 --2- 172.21.15.7:0/3637982954 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fddb40b6670 0x7fddb40b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:22.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:22.465+0000 7fddcdac0640 1 --2- 172.21.15.7:0/3637982954 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fddb40b6670 0x7fddb40b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:22.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:22.466+0000 7fddbeffd640 1 -- 172.21.15.7:0/3637982954 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fddb80e7690 con 0x7fddc81094a0 2024-09-21T06:35:22.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:22.466+0000 7fddcdac0640 1 --2- 172.21.15.7:0/3637982954 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fddb40b6670 0x7fddb40b8b80 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fddc4000c00 tx=0x7fddc4031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:22.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:22.469+0000 7fddbeffd640 1 -- 172.21.15.7:0/3637982954 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fddb8020020 con 0x7fddc81094a0 2024-09-21T06:35:22.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:22.659+0000 7fddcfd24640 1 -- 172.21.15.7:0/3637982954 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fddc802e640 con 0x7fddc81094a0 2024-09-21T06:35:22.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:22.659+0000 7fddbeffd640 1 -- 172.21.15.7:0/3637982954 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fddb80addc0 con 0x7fddc81094a0 2024-09-21T06:35:22.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:22.661+0000 7fddcfd24640 1 -- 172.21.15.7:0/3637982954 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fddb40b6670 msgr2=0x7fddb40b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:22.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:22.661+0000 7fddcfd24640 1 --2- 172.21.15.7:0/3637982954 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fddb40b6670 0x7fddb40b8b80 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fddc4000c00 tx=0x7fddc4031400 comp rx=0 tx=0).stop 2024-09-21T06:35:22.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:22.661+0000 7fddcfd24640 1 -- 172.21.15.7:0/3637982954 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fddc81094a0 msgr2=0x7fddc8075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:22.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:22.661+0000 7fddcfd24640 1 --2- 172.21.15.7:0/3637982954 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fddc81094a0 0x7fddc8075c50 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fddb800d950 tx=0x7fddb800de10 comp rx=0 tx=0).stop 2024-09-21T06:35:22.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:22.661+0000 7fddcfd24640 1 -- 172.21.15.7:0/3637982954 shutdown_connections 2024-09-21T06:35:22.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:22.661+0000 7fddcfd24640 1 --2- 172.21.15.7:0/3637982954 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fddb40b6670 0x7fddb40b8b80 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:22.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:22.661+0000 7fddcfd24640 1 --2- 172.21.15.7:0/3637982954 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fddc8109df0 0x7fddc8076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:22.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:22.661+0000 7fddcfd24640 1 --2- 172.21.15.7:0/3637982954 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fddc81094a0 0x7fddc8075c50 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:22.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:22.661+0000 7fddcfd24640 1 --2- 172.21.15.7:0/3637982954 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddc8103b60 0x7fddc8075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:22.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:22.661+0000 7fddcfd24640 1 -- 172.21.15.7:0/3637982954 >> 172.21.15.7:0/3637982954 conn(0x7fddc807b850 msgr2=0x7fddc8107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:22.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:22.661+0000 7fddcfd24640 1 -- 172.21.15.7:0/3637982954 shutdown_connections 2024-09-21T06:35:22.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:22.661+0000 7fddcfd24640 1 -- 172.21.15.7:0/3637982954 wait complete. 2024-09-21T06:35:23.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:35:22 smithi144 ceph-mon[34653]: pgmap v294: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-21T06:35:23.509 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705742 got 38654705744 for osd.0 2024-09-21T06:35:23.509 DEBUG:teuthology.parallel:result is None 2024-09-21T06:35:23.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:23.715+0000 7fcbd1f54640 1 -- 172.21.15.7:0/3424089057 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcbcc109df0 msgr2=0x7fcbcc110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:23.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:23.715+0000 7fcbd1f54640 1 --2- 172.21.15.7:0/3424089057 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcbcc109df0 0x7fcbcc110620 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fcbc4009ca0 tx=0x7fcbc402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:35:23.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:23.715+0000 7fcbd1f54640 1 -- 172.21.15.7:0/3424089057 shutdown_connections 2024-09-21T06:35:23.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:23.715+0000 7fcbd1f54640 1 --2- 172.21.15.7:0/3424089057 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcbcc109df0 0x7fcbcc110620 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:23.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:23.715+0000 7fcbd1f54640 1 --2- 172.21.15.7:0/3424089057 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcbcc1094a0 0x7fcbcc1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:23.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:23.715+0000 7fcbd1f54640 1 --2- 172.21.15.7:0/3424089057 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcbcc103b60 0x7fcbcc103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:23.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:23.715+0000 7fcbd1f54640 1 -- 172.21.15.7:0/3424089057 >> 172.21.15.7:0/3424089057 conn(0x7fcbcc07b850 msgr2=0x7fcbcc07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:23.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:23.715+0000 7fcbd1f54640 1 -- 172.21.15.7:0/3424089057 shutdown_connections 2024-09-21T06:35:23.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:23.716+0000 7fcbd1f54640 1 -- 172.21.15.7:0/3424089057 wait complete. 2024-09-21T06:35:23.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:23.716+0000 7fcbd1f54640 1 Processor -- start 2024-09-21T06:35:23.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:23.716+0000 7fcbd1f54640 1 -- start start 2024-09-21T06:35:23.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:23.716+0000 7fcbd1f54640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcbcc103b60 0x7fcbcc19a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:23.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:23.716+0000 7fcbd1f54640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcbcc1094a0 0x7fcbcc19a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:23.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:23.717+0000 7fcbd1f54640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcbcc109df0 0x7fcbcc19fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:23.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:23.717+0000 7fcbd1f54640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fcbcc113b00 con 0x7fcbcc109df0 2024-09-21T06:35:23.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:23.717+0000 7fcbd1f54640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcbcc113980 con 0x7fcbcc1094a0 2024-09-21T06:35:23.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:23.717+0000 7fcbd1f54640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fcbcc113c80 con 0x7fcbcc103b60 2024-09-21T06:35:23.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:23.717+0000 7fcbcbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcbcc109df0 0x7fcbcc19fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:23.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:23.717+0000 7fcbcb7fe640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcbcc103b60 0x7fcbcc19a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:23.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:23.717+0000 7fcbcb7fe640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcbcc103b60 0x7fcbcc19a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.7:42548/0 (socket says 172.21.15.7:42548) 2024-09-21T06:35:23.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:23.717+0000 7fcbcbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcbcc109df0 0x7fcbcc19fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58458/0 (socket says 172.21.15.7:58458) 2024-09-21T06:35:23.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:23.717+0000 7fcbcb7fe640 1 -- 172.21.15.7:0/2253327405 learned_addr learned my addr 172.21.15.7:0/2253327405 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:35:23.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:23.717+0000 7fcbc3fff640 1 --2- 172.21.15.7:0/2253327405 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcbcc1094a0 0x7fcbcc19a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:23.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:23.717+0000 7fcbcbfff640 1 -- 172.21.15.7:0/2253327405 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcbcc103b60 msgr2=0x7fcbcc19a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:23.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:23.717+0000 7fcbcbfff640 1 --2- 172.21.15.7:0/2253327405 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcbcc103b60 0x7fcbcc19a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:23.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:23.717+0000 7fcbcbfff640 1 -- 172.21.15.7:0/2253327405 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcbcc1094a0 msgr2=0x7fcbcc19a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:23.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:23.717+0000 7fcbcbfff640 1 --2- 172.21.15.7:0/2253327405 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcbcc1094a0 0x7fcbcc19a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:23.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:23.717+0000 7fcbcbfff640 1 -- 172.21.15.7:0/2253327405 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbcc1a03c0 con 0x7fcbcc109df0 2024-09-21T06:35:23.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:23.717+0000 7fcbc3fff640 1 --2- 172.21.15.7:0/2253327405 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcbcc1094a0 0x7fcbcc19a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:35:23.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:23.717+0000 7fcbcbfff640 1 --2- 172.21.15.7:0/2253327405 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcbcc109df0 0x7fcbcc19fc90 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fcbc4005e30 tx=0x7fcbc40319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:23.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:23.718+0000 7fcbc97fa640 1 -- 172.21.15.7:0/2253327405 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbc4003bf0 con 0x7fcbcc109df0 2024-09-21T06:35:23.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:23.718+0000 7fcbd1f54640 1 -- 172.21.15.7:0/2253327405 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbcc1a0650 con 0x7fcbcc109df0 2024-09-21T06:35:23.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:23.718+0000 7fcbc97fa640 1 -- 172.21.15.7:0/2253327405 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcbc4003d90 con 0x7fcbcc109df0 2024-09-21T06:35:23.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:23.718+0000 7fcbd1f54640 1 -- 172.21.15.7:0/2253327405 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbcc1a6e10 con 0x7fcbcc109df0 2024-09-21T06:35:23.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:23.718+0000 7fcbc97fa640 1 -- 172.21.15.7:0/2253327405 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbc402fba0 con 0x7fcbcc109df0 2024-09-21T06:35:23.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:23.719+0000 7fcbd1f54640 1 -- 172.21.15.7:0/2253327405 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbcc103f70 con 0x7fcbcc109df0 2024-09-21T06:35:23.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:23.721+0000 7fcbc97fa640 1 -- 172.21.15.7:0/2253327405 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154579+0+0 (secure 0 0 0) 0x7fcbc40046a0 con 0x7fcbcc109df0 2024-09-21T06:35:23.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:23.722+0000 7fcbc97fa640 1 --2- 172.21.15.7:0/2253327405 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fcbb80b65f0 0x7fcbb80b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:23.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:23.722+0000 7fcbcb7fe640 1 --2- 172.21.15.7:0/2253327405 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fcbb80b65f0 0x7fcbb80b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:23.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:23.722+0000 7fcbc97fa640 1 -- 172.21.15.7:0/2253327405 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fcbc4108bf0 con 0x7fcbcc109df0 2024-09-21T06:35:23.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:23.723+0000 7fcbcb7fe640 1 --2- 172.21.15.7:0/2253327405 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fcbb80b65f0 0x7fcbb80b8b00 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fcbbc00bca0 tx=0x7fcbbc00b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:23.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:23.726+0000 7fcbc97fa640 1 -- 172.21.15.7:0/2253327405 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcbc4083710 con 0x7fcbcc109df0 2024-09-21T06:35:23.727 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:35:23 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/3637982954' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T06:35:23.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:35:23 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/3637982954' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T06:35:23.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:23.916+0000 7fcbd1f54640 1 -- 172.21.15.7:0/2253327405 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fcbcc19b580 con 0x7fcbcc109df0 2024-09-21T06:35:23.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:23.917+0000 7fcbc97fa640 1 -- 172.21.15.7:0/2253327405 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fcbcc19b580 con 0x7fcbcc109df0 2024-09-21T06:35:23.919 INFO:teuthology.orchestra.run.smithi007.stdout:154618822712 2024-09-21T06:35:23.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:23.919+0000 7fcbd1f54640 1 -- 172.21.15.7:0/2253327405 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fcbb80b65f0 msgr2=0x7fcbb80b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:23.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:23.919+0000 7fcbd1f54640 1 --2- 172.21.15.7:0/2253327405 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fcbb80b65f0 0x7fcbb80b8b00 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fcbbc00bca0 tx=0x7fcbbc00b410 comp rx=0 tx=0).stop 2024-09-21T06:35:23.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:23.919+0000 7fcbd1f54640 1 -- 172.21.15.7:0/2253327405 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcbcc109df0 msgr2=0x7fcbcc19fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:23.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:23.919+0000 7fcbd1f54640 1 --2- 172.21.15.7:0/2253327405 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcbcc109df0 0x7fcbcc19fc90 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fcbc4005e30 tx=0x7fcbc40319f0 comp rx=0 tx=0).stop 2024-09-21T06:35:23.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:23.919+0000 7fcbd1f54640 1 -- 172.21.15.7:0/2253327405 shutdown_connections 2024-09-21T06:35:23.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:23.919+0000 7fcbd1f54640 1 --2- 172.21.15.7:0/2253327405 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fcbb80b65f0 0x7fcbb80b8b00 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:23.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:23.919+0000 7fcbd1f54640 1 --2- 172.21.15.7:0/2253327405 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcbcc109df0 0x7fcbcc19fc90 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:23.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:23.919+0000 7fcbd1f54640 1 --2- 172.21.15.7:0/2253327405 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcbcc1094a0 0x7fcbcc19a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:23.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:23.919+0000 7fcbd1f54640 1 --2- 172.21.15.7:0/2253327405 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcbcc103b60 0x7fcbcc19a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:23.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:23.919+0000 7fcbd1f54640 1 -- 172.21.15.7:0/2253327405 >> 172.21.15.7:0/2253327405 conn(0x7fcbcc07b850 msgr2=0x7fcbcc105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:23.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:23.919+0000 7fcbd1f54640 1 -- 172.21.15.7:0/2253327405 shutdown_connections 2024-09-21T06:35:23.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:23.919+0000 7fcbd1f54640 1 -- 172.21.15.7:0/2253327405 wait complete. 2024-09-21T06:35:24.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:35:23 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/3637982954' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T06:35:24.311 INFO:tasks.cephadm.ceph_manager.ceph:need seq 249108103199 got 249108103202 for osd.9 2024-09-21T06:35:24.312 DEBUG:teuthology.parallel:result is None 2024-09-21T06:35:24.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:35:24 smithi007 ceph-mon[30983]: pgmap v295: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-21T06:35:24.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:35:24 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2253327405' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T06:35:24.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:35:24 smithi018 ceph-mon[34477]: pgmap v295: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-21T06:35:24.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:35:24 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/2253327405' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T06:35:24.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:24.956+0000 7f6e1d9ed640 1 -- 172.21.15.7:0/248604631 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e181049b0 msgr2=0x7f6e18104dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:24.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:24.956+0000 7f6e1d9ed640 1 --2- 172.21.15.7:0/248604631 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e181049b0 0x7f6e18104dc0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f6e10009900 tx=0x7f6e1002a410 comp rx=0 tx=0).stop 2024-09-21T06:35:24.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:24.956+0000 7f6e1d9ed640 1 -- 172.21.15.7:0/248604631 shutdown_connections 2024-09-21T06:35:24.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:24.956+0000 7f6e1d9ed640 1 --2- 172.21.15.7:0/248604631 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e1810de10 0x7f6e18110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:24.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:24.956+0000 7f6e1d9ed640 1 --2- 172.21.15.7:0/248604631 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6e18105300 0x7f6e1810d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:24.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:24.956+0000 7f6e1d9ed640 1 --2- 172.21.15.7:0/248604631 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e181049b0 0x7f6e18104dc0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:24.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:24.956+0000 7f6e1d9ed640 1 -- 172.21.15.7:0/248604631 >> 172.21.15.7:0/248604631 conn(0x7f6e18079730 msgr2=0x7f6e18079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:24.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:24.956+0000 7f6e1d9ed640 1 -- 172.21.15.7:0/248604631 shutdown_connections 2024-09-21T06:35:24.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:24.956+0000 7f6e1d9ed640 1 -- 172.21.15.7:0/248604631 wait complete. 2024-09-21T06:35:24.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:24.957+0000 7f6e1d9ed640 1 Processor -- start 2024-09-21T06:35:24.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:24.957+0000 7f6e1d9ed640 1 -- start start 2024-09-21T06:35:24.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:24.957+0000 7f6e1d9ed640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e181049b0 0x7f6e1819a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:24.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:24.957+0000 7f6e1d9ed640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e18105300 0x7f6e1819aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:24.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:24.957+0000 7f6e1d9ed640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6e1810de10 0x7f6e1819fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:24.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:24.957+0000 7f6e1d9ed640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6e18113af0 con 0x7f6e18105300 2024-09-21T06:35:24.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:24.957+0000 7f6e1d9ed640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6e18113970 con 0x7f6e1810de10 2024-09-21T06:35:24.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:24.957+0000 7f6e1d9ed640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6e18113c70 con 0x7f6e181049b0 2024-09-21T06:35:24.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:24.957+0000 7f6e167fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e18105300 0x7f6e1819aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:24.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:24.957+0000 7f6e167fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e18105300 0x7f6e1819aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58486/0 (socket says 172.21.15.7:58486) 2024-09-21T06:35:24.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:24.957+0000 7f6e167fc640 1 -- 172.21.15.7:0/1658502509 learned_addr learned my addr 172.21.15.7:0/1658502509 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:35:24.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:24.957+0000 7f6e177fe640 1 --2- 172.21.15.7:0/1658502509 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6e1810de10 0x7f6e1819fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:24.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:24.958+0000 7f6e16ffd640 1 --2- 172.21.15.7:0/1658502509 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e181049b0 0x7f6e1819a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:24.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:24.958+0000 7f6e167fc640 1 -- 172.21.15.7:0/1658502509 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e181049b0 msgr2=0x7f6e1819a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:24.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:24.958+0000 7f6e167fc640 1 --2- 172.21.15.7:0/1658502509 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e181049b0 0x7f6e1819a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:24.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:24.958+0000 7f6e167fc640 1 -- 172.21.15.7:0/1658502509 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6e1810de10 msgr2=0x7f6e1819fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:24.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:24.958+0000 7f6e167fc640 1 --2- 172.21.15.7:0/1658502509 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6e1810de10 0x7f6e1819fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:24.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:24.958+0000 7f6e167fc640 1 -- 172.21.15.7:0/1658502509 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e181a0490 con 0x7f6e18105300 2024-09-21T06:35:24.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:24.958+0000 7f6e167fc640 1 --2- 172.21.15.7:0/1658502509 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e18105300 0x7f6e1819aac0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f6e0000e9f0 tx=0x7f6e0000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:24.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:24.958+0000 7f6e1c9eb640 1 -- 172.21.15.7:0/1658502509 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e0000ccc0 con 0x7f6e18105300 2024-09-21T06:35:24.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:24.958+0000 7f6e1c9eb640 1 -- 172.21.15.7:0/1658502509 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6e000108e0 con 0x7f6e18105300 2024-09-21T06:35:24.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:24.958+0000 7f6e1d9ed640 1 -- 172.21.15.7:0/1658502509 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e181a0780 con 0x7f6e18105300 2024-09-21T06:35:24.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:24.958+0000 7f6e1c9eb640 1 -- 172.21.15.7:0/1658502509 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e00018860 con 0x7f6e18105300 2024-09-21T06:35:24.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:24.958+0000 7f6e1d9ed640 1 -- 172.21.15.7:0/1658502509 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e181a6ee0 con 0x7f6e18105300 2024-09-21T06:35:24.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:24.959+0000 7f6e1d9ed640 1 -- 172.21.15.7:0/1658502509 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e18104dc0 con 0x7f6e18105300 2024-09-21T06:35:24.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:24.961+0000 7f6e1c9eb640 1 -- 172.21.15.7:0/1658502509 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154579+0+0 (secure 0 0 0) 0x7f6e00010430 con 0x7f6e18105300 2024-09-21T06:35:24.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:24.962+0000 7f6e1c9eb640 1 --2- 172.21.15.7:0/1658502509 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f6e040b65f0 0x7f6e040b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:24.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:24.962+0000 7f6e16ffd640 1 --2- 172.21.15.7:0/1658502509 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f6e040b65f0 0x7f6e040b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:24.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:24.962+0000 7f6e1c9eb640 1 -- 172.21.15.7:0/1658502509 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f6e000e7d80 con 0x7f6e18105300 2024-09-21T06:35:24.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:24.962+0000 7f6e16ffd640 1 --2- 172.21.15.7:0/1658502509 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f6e040b65f0 0x7f6e040b8b00 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6e10000c00 tx=0x7f6e10031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:24.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:24.965+0000 7f6e1c9eb640 1 -- 172.21.15.7:0/1658502509 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6e000ae430 con 0x7f6e18105300 2024-09-21T06:35:25.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:35:24 smithi144 ceph-mon[34653]: pgmap v295: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-21T06:35:25.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:35:24 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/2253327405' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T06:35:25.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:25.158+0000 7f6e1d9ed640 1 -- 172.21.15.7:0/1658502509 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f6e181a71e0 con 0x7f6e18105300 2024-09-21T06:35:25.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:25.158+0000 7f6e1c9eb640 1 -- 172.21.15.7:0/1658502509 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f6e000b2810 con 0x7f6e18105300 2024-09-21T06:35:25.160 INFO:teuthology.orchestra.run.smithi007.stdout:180388626482 2024-09-21T06:35:25.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:25.161+0000 7f6e1d9ed640 1 -- 172.21.15.7:0/1658502509 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f6e040b65f0 msgr2=0x7f6e040b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:25.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:25.161+0000 7f6e1d9ed640 1 --2- 172.21.15.7:0/1658502509 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f6e040b65f0 0x7f6e040b8b00 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6e10000c00 tx=0x7f6e10031400 comp rx=0 tx=0).stop 2024-09-21T06:35:25.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:25.161+0000 7f6e1d9ed640 1 -- 172.21.15.7:0/1658502509 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e18105300 msgr2=0x7f6e1819aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:25.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:25.161+0000 7f6e1d9ed640 1 --2- 172.21.15.7:0/1658502509 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e18105300 0x7f6e1819aac0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f6e0000e9f0 tx=0x7f6e0000eeb0 comp rx=0 tx=0).stop 2024-09-21T06:35:25.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:25.161+0000 7f6e1d9ed640 1 -- 172.21.15.7:0/1658502509 shutdown_connections 2024-09-21T06:35:25.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:25.161+0000 7f6e1d9ed640 1 --2- 172.21.15.7:0/1658502509 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f6e040b65f0 0x7f6e040b8b00 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:25.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:25.161+0000 7f6e1d9ed640 1 --2- 172.21.15.7:0/1658502509 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6e1810de10 0x7f6e1819fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:25.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:25.161+0000 7f6e1d9ed640 1 --2- 172.21.15.7:0/1658502509 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6e18105300 0x7f6e1819aac0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:25.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:25.161+0000 7f6e1d9ed640 1 --2- 172.21.15.7:0/1658502509 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6e181049b0 0x7f6e1819a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:25.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:25.161+0000 7f6e1d9ed640 1 -- 172.21.15.7:0/1658502509 >> 172.21.15.7:0/1658502509 conn(0x7f6e18079730 msgr2=0x7f6e180ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:25.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:25.161+0000 7f6e1d9ed640 1 -- 172.21.15.7:0/1658502509 shutdown_connections 2024-09-21T06:35:25.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:25.161+0000 7f6e1d9ed640 1 -- 172.21.15.7:0/1658502509 wait complete. 2024-09-21T06:35:25.392 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:25.427 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182463 got 107374182465 for osd.3 2024-09-21T06:35:25.427 DEBUG:teuthology.parallel:result is None 2024-09-21T06:35:25.689 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:35:25 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/1658502509' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T06:35:25.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:35:25 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/1658502509' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T06:35:25.936 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:35:25 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/1658502509' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T06:35:26.042 INFO:tasks.cephadm.ceph_manager.ceph:need seq 154618822707 got 154618822712 for osd.5 2024-09-21T06:35:26.042 DEBUG:teuthology.parallel:result is None 2024-09-21T06:35:26.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:26.532+0000 7f6ffa25d640 1 -- 172.21.15.7:0/3405193641 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ff4109e20 msgr2=0x7f6ff4110650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:26.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:26.532+0000 7f6ffa25d640 1 --2- 172.21.15.7:0/3405193641 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ff4109e20 0x7f6ff4110650 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f6fec009ca0 tx=0x7f6fec02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:35:26.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:26.532+0000 7f6ffa25d640 1 -- 172.21.15.7:0/3405193641 shutdown_connections 2024-09-21T06:35:26.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:26.532+0000 7f6ffa25d640 1 --2- 172.21.15.7:0/3405193641 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ff4109e20 0x7f6ff4110650 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:26.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:26.532+0000 7f6ffa25d640 1 --2- 172.21.15.7:0/3405193641 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ff41094d0 0x7f6ff41098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:26.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:26.532+0000 7f6ffa25d640 1 --2- 172.21.15.7:0/3405193641 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ff4103b90 0x7f6ff4103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:26.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:26.532+0000 7f6ffa25d640 1 -- 172.21.15.7:0/3405193641 >> 172.21.15.7:0/3405193641 conn(0x7f6ff40ff600 msgr2=0x7f6ff4101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:26.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:26.532+0000 7f6ffa25d640 1 -- 172.21.15.7:0/3405193641 shutdown_connections 2024-09-21T06:35:26.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:26.532+0000 7f6ffa25d640 1 -- 172.21.15.7:0/3405193641 wait complete. 2024-09-21T06:35:26.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:26.533+0000 7f6ffa25d640 1 Processor -- start 2024-09-21T06:35:26.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:26.533+0000 7f6ffa25d640 1 -- start start 2024-09-21T06:35:26.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:26.533+0000 7f6ffa25d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ff4103b90 0x7f6ff4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:26.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:26.533+0000 7f6ffa25d640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ff41094d0 0x7f6ff4075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:26.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:26.533+0000 7f6ffa25d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ff4109e20 0x7f6ff4076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:26.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:26.533+0000 7f6ffa25d640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff4113ae0 con 0x7f6ff4109e20 2024-09-21T06:35:26.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:26.533+0000 7f6ffa25d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff4113960 con 0x7f6ff4103b90 2024-09-21T06:35:26.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:26.533+0000 7f6ffa25d640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff4113c60 con 0x7f6ff41094d0 2024-09-21T06:35:26.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:26.533+0000 7f6ff3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ff4109e20 0x7f6ff4076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:26.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:26.533+0000 7f6ff3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ff4109e20 0x7f6ff4076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58492/0 (socket says 172.21.15.7:58492) 2024-09-21T06:35:26.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:26.533+0000 7f6ff3fff640 1 -- 172.21.15.7:0/2002796429 learned_addr learned my addr 172.21.15.7:0/2002796429 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:35:26.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:26.533+0000 7f6ff37fe640 1 --2- 172.21.15.7:0/2002796429 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ff4103b90 0x7f6ff4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:26.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:26.533+0000 7f6febfff640 1 --2- 172.21.15.7:0/2002796429 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ff41094d0 0x7f6ff4075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:26.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:26.533+0000 7f6ff3fff640 1 -- 172.21.15.7:0/2002796429 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ff41094d0 msgr2=0x7f6ff4075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:26.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:26.533+0000 7f6ff3fff640 1 --2- 172.21.15.7:0/2002796429 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ff41094d0 0x7f6ff4075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:26.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:26.533+0000 7f6ff3fff640 1 -- 172.21.15.7:0/2002796429 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ff4103b90 msgr2=0x7f6ff4075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:26.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:26.533+0000 7f6ff3fff640 1 --2- 172.21.15.7:0/2002796429 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ff4103b90 0x7f6ff4075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:26.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:26.533+0000 7f6ff3fff640 1 -- 172.21.15.7:0/2002796429 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ff41a8710 con 0x7f6ff4109e20 2024-09-21T06:35:26.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:26.534+0000 7f6ff3fff640 1 --2- 172.21.15.7:0/2002796429 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ff4109e20 0x7f6ff4076190 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6fec005cc0 tx=0x7f6fec02f470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:26.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:26.534+0000 7f6ff17fa640 1 -- 172.21.15.7:0/2002796429 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fec003cf0 con 0x7f6ff4109e20 2024-09-21T06:35:26.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:26.534+0000 7f6ff17fa640 1 -- 172.21.15.7:0/2002796429 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6fec0044f0 con 0x7f6ff4109e20 2024-09-21T06:35:26.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:26.534+0000 7f6ffa25d640 1 -- 172.21.15.7:0/2002796429 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ff41a89a0 con 0x7f6ff4109e20 2024-09-21T06:35:26.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:26.534+0000 7f6ff17fa640 1 -- 172.21.15.7:0/2002796429 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fec02fd10 con 0x7f6ff4109e20 2024-09-21T06:35:26.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:26.534+0000 7f6ffa25d640 1 -- 172.21.15.7:0/2002796429 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ff41a8ee0 con 0x7f6ff4109e20 2024-09-21T06:35:26.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:26.535+0000 7f6ffa25d640 1 -- 172.21.15.7:0/2002796429 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ff4104e10 con 0x7f6ff4109e20 2024-09-21T06:35:26.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:26.536+0000 7f6ff17fa640 1 -- 172.21.15.7:0/2002796429 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154579+0+0 (secure 0 0 0) 0x7f6fec004040 con 0x7f6ff4109e20 2024-09-21T06:35:26.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:26.537+0000 7f6ff17fa640 1 --2- 172.21.15.7:0/2002796429 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f6fe00b65f0 0x7f6fe00b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:26.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:26.537+0000 7f6ff37fe640 1 --2- 172.21.15.7:0/2002796429 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f6fe00b65f0 0x7f6fe00b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:26.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:26.537+0000 7f6ff17fa640 1 -- 172.21.15.7:0/2002796429 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f6fec108be0 con 0x7f6ff4109e20 2024-09-21T06:35:26.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:26.538+0000 7f6ff37fe640 1 --2- 172.21.15.7:0/2002796429 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f6fe00b65f0 0x7f6fe00b8b00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6fe40058c0 tx=0x7f6fe400a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:26.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:26.542+0000 7f6ff17fa640 1 -- 172.21.15.7:0/2002796429 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6fec0cf250 con 0x7f6ff4109e20 2024-09-21T06:35:26.567 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:35:26 smithi007 ceph-mon[30983]: pgmap v296: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:35:26.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:26.735+0000 7f6ffa25d640 1 -- 172.21.15.7:0/2002796429 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f6ff4076a10 con 0x7f6ff4109e20 2024-09-21T06:35:26.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:26.735+0000 7f6ff17fa640 1 -- 172.21.15.7:0/2002796429 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f6fec0d3630 con 0x7f6ff4109e20 2024-09-21T06:35:26.737 INFO:teuthology.orchestra.run.smithi007.stdout:133143986238 2024-09-21T06:35:26.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:26.738+0000 7f6ffa25d640 1 -- 172.21.15.7:0/2002796429 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f6fe00b65f0 msgr2=0x7f6fe00b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:26.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:26.738+0000 7f6ffa25d640 1 --2- 172.21.15.7:0/2002796429 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f6fe00b65f0 0x7f6fe00b8b00 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6fe40058c0 tx=0x7f6fe400a2d0 comp rx=0 tx=0).stop 2024-09-21T06:35:26.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:26.738+0000 7f6ffa25d640 1 -- 172.21.15.7:0/2002796429 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ff4109e20 msgr2=0x7f6ff4076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:26.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:26.738+0000 7f6ffa25d640 1 --2- 172.21.15.7:0/2002796429 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ff4109e20 0x7f6ff4076190 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6fec005cc0 tx=0x7f6fec02f470 comp rx=0 tx=0).stop 2024-09-21T06:35:26.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:26.738+0000 7f6ffa25d640 1 -- 172.21.15.7:0/2002796429 shutdown_connections 2024-09-21T06:35:26.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:26.738+0000 7f6ffa25d640 1 --2- 172.21.15.7:0/2002796429 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f6fe00b65f0 0x7f6fe00b8b00 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:26.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:26.738+0000 7f6ffa25d640 1 --2- 172.21.15.7:0/2002796429 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ff4109e20 0x7f6ff4076190 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:26.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:26.738+0000 7f6ffa25d640 1 --2- 172.21.15.7:0/2002796429 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ff41094d0 0x7f6ff4075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:26.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:26.738+0000 7f6ffa25d640 1 --2- 172.21.15.7:0/2002796429 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ff4103b90 0x7f6ff4075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:26.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:26.738+0000 7f6ffa25d640 1 -- 172.21.15.7:0/2002796429 >> 172.21.15.7:0/2002796429 conn(0x7f6ff40ff600 msgr2=0x7f6ff4108b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:26.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:26.738+0000 7f6ffa25d640 1 -- 172.21.15.7:0/2002796429 shutdown_connections 2024-09-21T06:35:26.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:26.738+0000 7f6ffa25d640 1 -- 172.21.15.7:0/2002796429 wait complete. 2024-09-21T06:35:26.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:35:26 smithi018 ceph-mon[34477]: pgmap v296: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:35:26.974 INFO:tasks.cephadm.ceph_manager.ceph:need seq 180388626479 got 180388626482 for osd.6 2024-09-21T06:35:26.974 DEBUG:teuthology.parallel:result is None 2024-09-21T06:35:27.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:35:26 smithi144 ceph-mon[34653]: pgmap v296: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:35:27.839 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:35:27 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2002796429' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T06:35:27.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:35:27 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/2002796429' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T06:35:27.899 INFO:tasks.cephadm.ceph_manager.ceph:need seq 133143986235 got 133143986238 for osd.4 2024-09-21T06:35:27.899 DEBUG:teuthology.parallel:result is None 2024-09-21T06:35:28.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:35:27 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/2002796429' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T06:35:28.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:28.128+0000 7fc3212ad640 1 -- 172.21.15.7:0/4031115440 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc31c1094a0 msgr2=0x7fc31c1098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:28.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:28.128+0000 7fc3212ad640 1 --2- 172.21.15.7:0/4031115440 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc31c1094a0 0x7fc31c1098b0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fc310009900 tx=0x7fc31002a410 comp rx=0 tx=0).stop 2024-09-21T06:35:28.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:28.128+0000 7fc3212ad640 1 -- 172.21.15.7:0/4031115440 shutdown_connections 2024-09-21T06:35:28.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:28.128+0000 7fc3212ad640 1 --2- 172.21.15.7:0/4031115440 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc31c109df0 0x7fc31c110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:28.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:28.128+0000 7fc3212ad640 1 --2- 172.21.15.7:0/4031115440 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc31c1094a0 0x7fc31c1098b0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:28.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:28.128+0000 7fc3212ad640 1 --2- 172.21.15.7:0/4031115440 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc31c103b60 0x7fc31c103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:28.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:28.128+0000 7fc3212ad640 1 -- 172.21.15.7:0/4031115440 >> 172.21.15.7:0/4031115440 conn(0x7fc31c07b850 msgr2=0x7fc31c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:28.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:28.128+0000 7fc3212ad640 1 -- 172.21.15.7:0/4031115440 shutdown_connections 2024-09-21T06:35:28.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:28.129+0000 7fc3212ad640 1 -- 172.21.15.7:0/4031115440 wait complete. 2024-09-21T06:35:28.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:28.129+0000 7fc3212ad640 1 Processor -- start 2024-09-21T06:35:28.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:28.129+0000 7fc3212ad640 1 -- start start 2024-09-21T06:35:28.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:28.130+0000 7fc3212ad640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc31c103b60 0x7fc31c19c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:28.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:28.130+0000 7fc3212ad640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc31c1094a0 0x7fc31c19cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:28.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:28.130+0000 7fc3212ad640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc31c109df0 0x7fc31c1a1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:28.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:28.130+0000 7fc3212ad640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc31c113b00 con 0x7fc31c103b60 2024-09-21T06:35:28.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:28.130+0000 7fc3212ad640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc31c113980 con 0x7fc31c1094a0 2024-09-21T06:35:28.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:28.130+0000 7fc3212ad640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc31c113c80 con 0x7fc31c109df0 2024-09-21T06:35:28.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:28.130+0000 7fc31affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc31c103b60 0x7fc31c19c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:28.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:28.130+0000 7fc31affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc31c103b60 0x7fc31c19c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58518/0 (socket says 172.21.15.7:58518) 2024-09-21T06:35:28.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:28.130+0000 7fc31affd640 1 -- 172.21.15.7:0/3917336264 learned_addr learned my addr 172.21.15.7:0/3917336264 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:35:28.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:28.130+0000 7fc31b7fe640 1 --2- 172.21.15.7:0/3917336264 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc31c109df0 0x7fc31c1a1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:28.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:28.130+0000 7fc31a7fc640 1 --2- 172.21.15.7:0/3917336264 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc31c1094a0 0x7fc31c19cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:28.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:28.130+0000 7fc31affd640 1 -- 172.21.15.7:0/3917336264 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc31c109df0 msgr2=0x7fc31c1a1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:28.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:28.130+0000 7fc31affd640 1 --2- 172.21.15.7:0/3917336264 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc31c109df0 0x7fc31c1a1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:28.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:28.130+0000 7fc31affd640 1 -- 172.21.15.7:0/3917336264 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc31c1094a0 msgr2=0x7fc31c19cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:28.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:28.130+0000 7fc31affd640 1 --2- 172.21.15.7:0/3917336264 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc31c1094a0 0x7fc31c19cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:28.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:28.130+0000 7fc31affd640 1 -- 172.21.15.7:0/3917336264 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc31c1a2700 con 0x7fc31c103b60 2024-09-21T06:35:28.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:28.130+0000 7fc31b7fe640 1 --2- 172.21.15.7:0/3917336264 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc31c109df0 0x7fc31c1a1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:35:28.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:28.130+0000 7fc31a7fc640 1 --2- 172.21.15.7:0/3917336264 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc31c1094a0 0x7fc31c19cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:35:28.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:28.130+0000 7fc31affd640 1 --2- 172.21.15.7:0/3917336264 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc31c103b60 0x7fc31c19c790 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fc30c00d950 tx=0x7fc30c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:28.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:28.130+0000 7fc303fff640 1 -- 172.21.15.7:0/3917336264 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc30c017070 con 0x7fc31c103b60 2024-09-21T06:35:28.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:28.130+0000 7fc303fff640 1 -- 172.21.15.7:0/3917336264 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc30c009c30 con 0x7fc31c103b60 2024-09-21T06:35:28.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:28.131+0000 7fc303fff640 1 -- 172.21.15.7:0/3917336264 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc30c00f620 con 0x7fc31c103b60 2024-09-21T06:35:28.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:28.131+0000 7fc3212ad640 1 -- 172.21.15.7:0/3917336264 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc31c1a29f0 con 0x7fc31c103b60 2024-09-21T06:35:28.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:28.131+0000 7fc3212ad640 1 -- 172.21.15.7:0/3917336264 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc31c1a9150 con 0x7fc31c103b60 2024-09-21T06:35:28.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:28.132+0000 7fc3212ad640 1 -- 172.21.15.7:0/3917336264 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc31c103f70 con 0x7fc31c103b60 2024-09-21T06:35:28.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:28.133+0000 7fc303fff640 1 -- 172.21.15.7:0/3917336264 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154579+0+0 (secure 0 0 0) 0x7fc30c005030 con 0x7fc31c103b60 2024-09-21T06:35:28.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:28.134+0000 7fc303fff640 1 --2- 172.21.15.7:0/3917336264 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fc3040b65f0 0x7fc3040b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:28.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:28.134+0000 7fc31a7fc640 1 --2- 172.21.15.7:0/3917336264 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fc3040b65f0 0x7fc3040b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:28.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:28.134+0000 7fc303fff640 1 -- 172.21.15.7:0/3917336264 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fc30c0e7220 con 0x7fc31c103b60 2024-09-21T06:35:28.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:28.134+0000 7fc31a7fc640 1 --2- 172.21.15.7:0/3917336264 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fc3040b65f0 0x7fc3040b8b00 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc310005ab0 tx=0x7fc310005fd0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:28.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:28.137+0000 7fc303fff640 1 -- 172.21.15.7:0/3917336264 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc30c0ad8d0 con 0x7fc31c103b60 2024-09-21T06:35:28.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:28.328+0000 7fc3212ad640 1 -- 172.21.15.7:0/3917336264 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fc31c1a93f0 con 0x7fc31c103b60 2024-09-21T06:35:28.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:28.328+0000 7fc303fff640 1 -- 172.21.15.7:0/3917336264 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fc30c009de0 con 0x7fc31c103b60 2024-09-21T06:35:28.330 INFO:teuthology.orchestra.run.smithi007.stdout:201863462958 2024-09-21T06:35:28.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:28.330+0000 7fc3212ad640 1 -- 172.21.15.7:0/3917336264 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fc3040b65f0 msgr2=0x7fc3040b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:28.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:28.330+0000 7fc3212ad640 1 --2- 172.21.15.7:0/3917336264 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fc3040b65f0 0x7fc3040b8b00 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc310005ab0 tx=0x7fc310005fd0 comp rx=0 tx=0).stop 2024-09-21T06:35:28.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:28.330+0000 7fc3212ad640 1 -- 172.21.15.7:0/3917336264 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc31c103b60 msgr2=0x7fc31c19c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:28.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:28.330+0000 7fc3212ad640 1 --2- 172.21.15.7:0/3917336264 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc31c103b60 0x7fc31c19c790 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fc30c00d950 tx=0x7fc30c00de10 comp rx=0 tx=0).stop 2024-09-21T06:35:28.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:28.330+0000 7fc3212ad640 1 -- 172.21.15.7:0/3917336264 shutdown_connections 2024-09-21T06:35:28.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:28.330+0000 7fc3212ad640 1 --2- 172.21.15.7:0/3917336264 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fc3040b65f0 0x7fc3040b8b00 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:28.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:28.330+0000 7fc3212ad640 1 --2- 172.21.15.7:0/3917336264 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc31c109df0 0x7fc31c1a1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:28.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:28.330+0000 7fc3212ad640 1 --2- 172.21.15.7:0/3917336264 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc31c1094a0 0x7fc31c19cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:28.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:28.330+0000 7fc3212ad640 1 --2- 172.21.15.7:0/3917336264 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc31c103b60 0x7fc31c19c790 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:28.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:28.330+0000 7fc3212ad640 1 -- 172.21.15.7:0/3917336264 >> 172.21.15.7:0/3917336264 conn(0x7fc31c07b850 msgr2=0x7fc31c105230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:28.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:28.330+0000 7fc3212ad640 1 -- 172.21.15.7:0/3917336264 shutdown_connections 2024-09-21T06:35:28.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:28.330+0000 7fc3212ad640 1 -- 172.21.15.7:0/3917336264 wait complete. 2024-09-21T06:35:28.708 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:35:28 smithi007 ceph-mon[30983]: pgmap v297: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:35:28.709 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:35:28 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/3917336264' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T06:35:28.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:35:28 smithi018 ceph-mon[34477]: pgmap v297: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:35:28.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:35:28 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/3917336264' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T06:35:29.030 INFO:tasks.cephadm.ceph_manager.ceph:need seq 201863462954 got 201863462958 for osd.7 2024-09-21T06:35:29.030 DEBUG:teuthology.parallel:result is None 2024-09-21T06:35:29.031 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-21T06:35:29.031 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T06:35:29.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:35:28 smithi144 ceph-mon[34653]: pgmap v297: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:35:29.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:35:28 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/3917336264' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T06:35:29.532 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:30.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:30.024+0000 7fdfe22ab640 1 -- 172.21.15.7:0/1351731037 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdfdc108d10 msgr2=0x7fdfdc10f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:30.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:30.024+0000 7fdfe22ab640 1 --2- 172.21.15.7:0/1351731037 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdfdc108d10 0x7fdfdc10f540 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fdfd4009ca0 tx=0x7fdfd402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:35:30.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:30.024+0000 7fdfe22ab640 1 -- 172.21.15.7:0/1351731037 shutdown_connections 2024-09-21T06:35:30.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:30.024+0000 7fdfe22ab640 1 --2- 172.21.15.7:0/1351731037 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdfdc108d10 0x7fdfdc10f540 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:30.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:30.024+0000 7fdfe22ab640 1 --2- 172.21.15.7:0/1351731037 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdfdc1083c0 0x7fdfdc1087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:30.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:30.024+0000 7fdfe22ab640 1 --2- 172.21.15.7:0/1351731037 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdfdc102a80 0x7fdfdc102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:30.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:30.024+0000 7fdfe22ab640 1 -- 172.21.15.7:0/1351731037 >> 172.21.15.7:0/1351731037 conn(0x7fdfdc079740 msgr2=0x7fdfdc079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:30.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:30.024+0000 7fdfe22ab640 1 -- 172.21.15.7:0/1351731037 shutdown_connections 2024-09-21T06:35:30.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:30.024+0000 7fdfe22ab640 1 -- 172.21.15.7:0/1351731037 wait complete. 2024-09-21T06:35:30.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:30.025+0000 7fdfe22ab640 1 Processor -- start 2024-09-21T06:35:30.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:30.025+0000 7fdfe22ab640 1 -- start start 2024-09-21T06:35:30.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:30.025+0000 7fdfe22ab640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdfdc102a80 0x7fdfdc19a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:30.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:30.025+0000 7fdfe22ab640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdfdc1083c0 0x7fdfdc19aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:30.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:30.025+0000 7fdfe22ab640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdfdc108d10 0x7fdfdc19fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:30.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:30.025+0000 7fdfe22ab640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fdfdc112980 con 0x7fdfdc108d10 2024-09-21T06:35:30.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:30.025+0000 7fdfe22ab640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fdfdc112800 con 0x7fdfdc102a80 2024-09-21T06:35:30.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:30.025+0000 7fdfe22ab640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fdfdc112b00 con 0x7fdfdc1083c0 2024-09-21T06:35:30.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:30.025+0000 7fdfe0848640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdfdc108d10 0x7fdfdc19fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:30.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:30.025+0000 7fdfe0848640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdfdc108d10 0x7fdfdc19fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58538/0 (socket says 172.21.15.7:58538) 2024-09-21T06:35:30.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:30.025+0000 7fdfe0848640 1 -- 172.21.15.7:0/380873750 learned_addr learned my addr 172.21.15.7:0/380873750 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:35:30.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:30.025+0000 7fdfdbfff640 1 --2- 172.21.15.7:0/380873750 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdfdc102a80 0x7fdfdc19a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:30.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:30.025+0000 7fdfdb7fe640 1 --2- 172.21.15.7:0/380873750 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdfdc1083c0 0x7fdfdc19aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:30.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:30.026+0000 7fdfe0848640 1 -- 172.21.15.7:0/380873750 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdfdc1083c0 msgr2=0x7fdfdc19aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:30.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:30.026+0000 7fdfe0848640 1 --2- 172.21.15.7:0/380873750 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdfdc1083c0 0x7fdfdc19aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:30.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:30.026+0000 7fdfe0848640 1 -- 172.21.15.7:0/380873750 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdfdc102a80 msgr2=0x7fdfdc19a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:30.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:30.026+0000 7fdfe0848640 1 --2- 172.21.15.7:0/380873750 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdfdc102a80 0x7fdfdc19a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:30.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:30.026+0000 7fdfe0848640 1 -- 172.21.15.7:0/380873750 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfdc1a0330 con 0x7fdfdc108d10 2024-09-21T06:35:30.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:30.026+0000 7fdfdbfff640 1 --2- 172.21.15.7:0/380873750 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdfdc102a80 0x7fdfdc19a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:35:30.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:30.026+0000 7fdfdb7fe640 1 --2- 172.21.15.7:0/380873750 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdfdc1083c0 0x7fdfdc19aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:35:30.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:30.026+0000 7fdfe0848640 1 --2- 172.21.15.7:0/380873750 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdfdc108d10 0x7fdfdc19fcc0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fdfd4005cc0 tx=0x7fdfd402f470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:30.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:30.026+0000 7fdfd97fa640 1 -- 172.21.15.7:0/380873750 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfd4003cf0 con 0x7fdfdc108d10 2024-09-21T06:35:30.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:30.026+0000 7fdfe22ab640 1 -- 172.21.15.7:0/380873750 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfdc1a05c0 con 0x7fdfdc108d10 2024-09-21T06:35:30.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:30.026+0000 7fdfd97fa640 1 -- 172.21.15.7:0/380873750 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdfd40044f0 con 0x7fdfdc108d10 2024-09-21T06:35:30.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:30.026+0000 7fdfd97fa640 1 -- 172.21.15.7:0/380873750 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfd402fd10 con 0x7fdfdc108d10 2024-09-21T06:35:30.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:30.026+0000 7fdfe22ab640 1 -- 172.21.15.7:0/380873750 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfdc1a6e40 con 0x7fdfdc108d10 2024-09-21T06:35:30.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:30.027+0000 7fdfe22ab640 1 -- 172.21.15.7:0/380873750 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfdc103d00 con 0x7fdfdc108d10 2024-09-21T06:35:30.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:30.029+0000 7fdfd97fa640 1 -- 172.21.15.7:0/380873750 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154579+0+0 (secure 0 0 0) 0x7fdfd4004040 con 0x7fdfdc108d10 2024-09-21T06:35:30.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:30.029+0000 7fdfd97fa640 1 --2- 172.21.15.7:0/380873750 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fdfc40b6620 0x7fdfc40b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:30.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:30.029+0000 7fdfdbfff640 1 --2- 172.21.15.7:0/380873750 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fdfc40b6620 0x7fdfc40b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:30.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:30.029+0000 7fdfd97fa640 1 -- 172.21.15.7:0/380873750 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fdfd4108af0 con 0x7fdfdc108d10 2024-09-21T06:35:30.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:30.030+0000 7fdfdbfff640 1 --2- 172.21.15.7:0/380873750 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fdfc40b6620 0x7fdfc40b8b30 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc0058c0 tx=0x7fdfcc005ec0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:30.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:30.034+0000 7fdfd97fa640 1 -- 172.21.15.7:0/380873750 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdfd40cf1a0 con 0x7fdfdc108d10 2024-09-21T06:35:30.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:30.242+0000 7fdfe22ab640 1 -- 172.21.15.7:0/380873750 --> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdfdc063800 con 0x7fdfc40b6620 2024-09-21T06:35:30.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:30.247+0000 7fdfd97fa640 1 -- 172.21.15.7:0/380873750 <== mgr.14223 v2:172.21.15.7:6800/3442812985 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258954 (secure 0 0 0) 0x7fdfdc063800 con 0x7fdfc40b6620 2024-09-21T06:35:30.252 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:35:30.254 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-09-21T06:35:30.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:30.251+0000 7fdfe22ab640 1 -- 172.21.15.7:0/380873750 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fdfc40b6620 msgr2=0x7fdfc40b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:30.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:30.251+0000 7fdfe22ab640 1 --2- 172.21.15.7:0/380873750 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fdfc40b6620 0x7fdfc40b8b30 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc0058c0 tx=0x7fdfcc005ec0 comp rx=0 tx=0).stop 2024-09-21T06:35:30.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:30.251+0000 7fdfe22ab640 1 -- 172.21.15.7:0/380873750 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdfdc108d10 msgr2=0x7fdfdc19fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:30.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:30.251+0000 7fdfe22ab640 1 --2- 172.21.15.7:0/380873750 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdfdc108d10 0x7fdfdc19fcc0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fdfd4005cc0 tx=0x7fdfd402f470 comp rx=0 tx=0).stop 2024-09-21T06:35:30.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:30.251+0000 7fdfe22ab640 1 -- 172.21.15.7:0/380873750 shutdown_connections 2024-09-21T06:35:30.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:30.251+0000 7fdfe22ab640 1 --2- 172.21.15.7:0/380873750 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fdfc40b6620 0x7fdfc40b8b30 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:30.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:30.251+0000 7fdfe22ab640 1 --2- 172.21.15.7:0/380873750 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdfdc108d10 0x7fdfdc19fcc0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:30.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:30.251+0000 7fdfe22ab640 1 --2- 172.21.15.7:0/380873750 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdfdc1083c0 0x7fdfdc19aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:30.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:30.251+0000 7fdfe22ab640 1 --2- 172.21.15.7:0/380873750 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdfdc102a80 0x7fdfdc19a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:30.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:30.251+0000 7fdfe22ab640 1 -- 172.21.15.7:0/380873750 >> 172.21.15.7:0/380873750 conn(0x7fdfdc079740 msgr2=0x7fdfdc06be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:30.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:30.251+0000 7fdfe22ab640 1 -- 172.21.15.7:0/380873750 shutdown_connections 2024-09-21T06:35:30.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:30.251+0000 7fdfe22ab640 1 -- 172.21.15.7:0/380873750 wait complete. 2024-09-21T06:35:30.839 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:35:30 smithi007 ceph-mon[30983]: pgmap v298: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T06:35:30.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:35:30 smithi018 ceph-mon[34477]: pgmap v298: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T06:35:30.976 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":298,"stamp":"2024-09-21T06:35:29.150501+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658896,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":430,"num_read_kb":314,"num_write":287,"num_write_kb":2267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":2951840,"num_keys_recovered":11,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":232,"ondisk_log_size":232,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":367936,"kb_used_data":10332,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124573888,"statfs":{"total":1151940427776,"available":1151563661312,"internally_reserved":0,"allocated":10579968,"data_stored":6975516,"data_compressed":177384,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":19143,"internal_metadata":365933881},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":40,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003312"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.225546+0000","last_change":"2024-09-21T06:34:23.958146+0000","last_active":"2024-09-21T06:34:44.225546+0000","last_peered":"2024-09-21T06:34:44.225546+0000","last_clean":"2024-09-21T06:34:44.225546+0000","last_became_active":"2024-09-21T06:34:23.957580+0000","last_became_peered":"2024-09-21T06:34:23.957580+0000","last_unstale":"2024-09-21T06:34:44.225546+0000","last_undegraded":"2024-09-21T06:34:44.225546+0000","last_fullsized":"2024-09-21T06:34:44.225546+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:33:05.975310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265758+0000","last_change":"2024-09-21T06:34:23.948439+0000","last_active":"2024-09-21T06:34:44.265758+0000","last_peered":"2024-09-21T06:34:44.265758+0000","last_clean":"2024-09-21T06:34:44.265758+0000","last_became_active":"2024-09-21T06:34:23.947511+0000","last_became_peered":"2024-09-21T06:34:23.947511+0000","last_unstale":"2024-09-21T06:34:44.265758+0000","last_undegraded":"2024-09-21T06:34:44.265758+0000","last_fullsized":"2024-09-21T06:34:44.265758+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:13:53.589979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.264949+0000","last_change":"2024-09-21T06:34:23.950752+0000","last_active":"2024-09-21T06:34:44.264949+0000","last_peered":"2024-09-21T06:34:44.264949+0000","last_clean":"2024-09-21T06:34:44.264949+0000","last_became_active":"2024-09-21T06:34:23.950373+0000","last_became_peered":"2024-09-21T06:34:23.950373+0000","last_unstale":"2024-09-21T06:34:44.264949+0000","last_undegraded":"2024-09-21T06:34:44.264949+0000","last_fullsized":"2024-09-21T06:34:44.264949+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:01:29.183426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.267740+0000","last_change":"2024-09-21T06:34:44.267265+0000","last_active":"2024-09-21T06:34:44.267740+0000","last_peered":"2024-09-21T06:34:44.267740+0000","last_clean":"2024-09-21T06:34:44.267740+0000","last_became_active":"2024-09-21T06:34:44.266829+0000","last_became_peered":"2024-09-21T06:34:44.266829+0000","last_unstale":"2024-09-21T06:34:44.267740+0000","last_undegraded":"2024-09-21T06:34:44.267740+0000","last_fullsized":"2024-09-21T06:34:44.267740+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:47:57.873167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.229953+0000","last_change":"2024-09-21T06:34:23.947578+0000","last_active":"2024-09-21T06:34:44.229953+0000","last_peered":"2024-09-21T06:34:44.229953+0000","last_clean":"2024-09-21T06:34:44.229953+0000","last_became_active":"2024-09-21T06:34:23.947201+0000","last_became_peered":"2024-09-21T06:34:23.947201+0000","last_unstale":"2024-09-21T06:34:44.229953+0000","last_undegraded":"2024-09-21T06:34:44.229953+0000","last_fullsized":"2024-09-21T06:34:44.229953+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:48:32.279999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.227142+0000","last_change":"2024-09-21T06:34:23.946191+0000","last_active":"2024-09-21T06:34:44.227142+0000","last_peered":"2024-09-21T06:34:44.227142+0000","last_clean":"2024-09-21T06:34:44.227142+0000","last_became_active":"2024-09-21T06:34:23.945817+0000","last_became_peered":"2024-09-21T06:34:23.945817+0000","last_unstale":"2024-09-21T06:34:44.227142+0000","last_undegraded":"2024-09-21T06:34:44.227142+0000","last_fullsized":"2024-09-21T06:34:44.227142+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:29.443444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265435+0000","last_change":"2024-09-21T06:34:23.943433+0000","last_active":"2024-09-21T06:34:44.265435+0000","last_peered":"2024-09-21T06:34:44.265435+0000","last_clean":"2024-09-21T06:34:44.265435+0000","last_became_active":"2024-09-21T06:34:23.943001+0000","last_became_peered":"2024-09-21T06:34:23.943001+0000","last_unstale":"2024-09-21T06:34:44.265435+0000","last_undegraded":"2024-09-21T06:34:44.265435+0000","last_fullsized":"2024-09-21T06:34:44.265435+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:05:10.695083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.223932+0000","last_change":"2024-09-21T06:34:23.954397+0000","last_active":"2024-09-21T06:34:44.223932+0000","last_peered":"2024-09-21T06:34:44.223932+0000","last_clean":"2024-09-21T06:34:44.223932+0000","last_became_active":"2024-09-21T06:34:23.954008+0000","last_became_peered":"2024-09-21T06:34:23.954008+0000","last_unstale":"2024-09-21T06:34:44.223932+0000","last_undegraded":"2024-09-21T06:34:44.223932+0000","last_fullsized":"2024-09-21T06:34:44.223932+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:10:03.764400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.266422+0000","last_change":"2024-09-21T06:34:23.953371+0000","last_active":"2024-09-21T06:34:44.266422+0000","last_peered":"2024-09-21T06:34:44.266422+0000","last_clean":"2024-09-21T06:34:44.266422+0000","last_became_active":"2024-09-21T06:34:23.952864+0000","last_became_peered":"2024-09-21T06:34:23.952864+0000","last_unstale":"2024-09-21T06:34:44.266422+0000","last_undegraded":"2024-09-21T06:34:44.266422+0000","last_fullsized":"2024-09-21T06:34:44.266422+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:44:23.691372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.267477+0000","last_change":"2024-09-21T06:34:44.267366+0000","last_active":"2024-09-21T06:34:44.267477+0000","last_peered":"2024-09-21T06:34:44.267477+0000","last_clean":"2024-09-21T06:34:44.267477+0000","last_became_active":"2024-09-21T06:34:44.266937+0000","last_became_peered":"2024-09-21T06:34:44.266937+0000","last_unstale":"2024-09-21T06:34:44.267477+0000","last_undegraded":"2024-09-21T06:34:44.267477+0000","last_fullsized":"2024-09-21T06:34:44.267477+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:40:00.904219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.266545+0000","last_change":"2024-09-21T06:34:23.958191+0000","last_active":"2024-09-21T06:34:44.266545+0000","last_peered":"2024-09-21T06:34:44.266545+0000","last_clean":"2024-09-21T06:34:44.266545+0000","last_became_active":"2024-09-21T06:34:23.957836+0000","last_became_peered":"2024-09-21T06:34:23.957836+0000","last_unstale":"2024-09-21T06:34:44.266545+0000","last_undegraded":"2024-09-21T06:34:44.266545+0000","last_fullsized":"2024-09-21T06:34:44.266545+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:31:10.201245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.225421+0000","last_change":"2024-09-21T06:34:23.947256+0000","last_active":"2024-09-21T06:34:44.225421+0000","last_peered":"2024-09-21T06:34:44.225421+0000","last_clean":"2024-09-21T06:34:44.225421+0000","last_became_active":"2024-09-21T06:34:23.946029+0000","last_became_peered":"2024-09-21T06:34:23.946029+0000","last_unstale":"2024-09-21T06:34:44.225421+0000","last_undegraded":"2024-09-21T06:34:44.225421+0000","last_fullsized":"2024-09-21T06:34:44.225421+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:47:19.850700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265129+0000","last_change":"2024-09-21T06:34:23.940661+0000","last_active":"2024-09-21T06:34:44.265129+0000","last_peered":"2024-09-21T06:34:44.265129+0000","last_clean":"2024-09-21T06:34:44.265129+0000","last_became_active":"2024-09-21T06:34:23.940306+0000","last_became_peered":"2024-09-21T06:34:23.940306+0000","last_unstale":"2024-09-21T06:34:44.265129+0000","last_undegraded":"2024-09-21T06:34:44.265129+0000","last_fullsized":"2024-09-21T06:34:44.265129+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:19.062435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265265+0000","last_change":"2024-09-21T06:34:23.941906+0000","last_active":"2024-09-21T06:34:44.265265+0000","last_peered":"2024-09-21T06:34:44.265265+0000","last_clean":"2024-09-21T06:34:44.265265+0000","last_became_active":"2024-09-21T06:34:23.941522+0000","last_became_peered":"2024-09-21T06:34:23.941522+0000","last_unstale":"2024-09-21T06:34:44.265265+0000","last_undegraded":"2024-09-21T06:34:44.265265+0000","last_fullsized":"2024-09-21T06:34:44.265265+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:57:12.557051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.264948+0000","last_change":"2024-09-21T06:34:23.957181+0000","last_active":"2024-09-21T06:34:44.264948+0000","last_peered":"2024-09-21T06:34:44.264948+0000","last_clean":"2024-09-21T06:34:44.264948+0000","last_became_active":"2024-09-21T06:34:23.956269+0000","last_became_peered":"2024-09-21T06:34:23.956269+0000","last_unstale":"2024-09-21T06:34:44.264948+0000","last_undegraded":"2024-09-21T06:34:44.264948+0000","last_fullsized":"2024-09-21T06:34:44.264948+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:33:24.989570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265721+0000","last_change":"2024-09-21T06:34:23.951771+0000","last_active":"2024-09-21T06:34:44.265721+0000","last_peered":"2024-09-21T06:34:44.265721+0000","last_clean":"2024-09-21T06:34:44.265721+0000","last_became_active":"2024-09-21T06:34:23.951381+0000","last_became_peered":"2024-09-21T06:34:23.951381+0000","last_unstale":"2024-09-21T06:34:44.265721+0000","last_undegraded":"2024-09-21T06:34:44.265721+0000","last_fullsized":"2024-09-21T06:34:44.265721+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:26:16.049343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.225612+0000","last_change":"2024-09-21T06:34:23.959425+0000","last_active":"2024-09-21T06:34:44.225612+0000","last_peered":"2024-09-21T06:34:44.225612+0000","last_clean":"2024-09-21T06:34:44.225612+0000","last_became_active":"2024-09-21T06:34:23.959022+0000","last_became_peered":"2024-09-21T06:34:23.959022+0000","last_unstale":"2024-09-21T06:34:44.225612+0000","last_undegraded":"2024-09-21T06:34:44.225612+0000","last_fullsized":"2024-09-21T06:34:44.225612+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:19:45.203639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.226736+0000","last_change":"2024-09-21T06:34:23.950510+0000","last_active":"2024-09-21T06:34:44.226736+0000","last_peered":"2024-09-21T06:34:44.226736+0000","last_clean":"2024-09-21T06:34:44.226736+0000","last_became_active":"2024-09-21T06:34:23.950027+0000","last_became_peered":"2024-09-21T06:34:23.950027+0000","last_unstale":"2024-09-21T06:34:44.226736+0000","last_undegraded":"2024-09-21T06:34:44.226736+0000","last_fullsized":"2024-09-21T06:34:44.226736+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:22:23.093554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265658+0000","last_change":"2024-09-21T06:34:23.948824+0000","last_active":"2024-09-21T06:34:44.265658+0000","last_peered":"2024-09-21T06:34:44.265658+0000","last_clean":"2024-09-21T06:34:44.265658+0000","last_became_active":"2024-09-21T06:34:23.948441+0000","last_became_peered":"2024-09-21T06:34:23.948441+0000","last_unstale":"2024-09-21T06:34:44.265658+0000","last_undegraded":"2024-09-21T06:34:44.265658+0000","last_fullsized":"2024-09-21T06:34:44.265658+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:28.498876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.225240+0000","last_change":"2024-09-21T06:34:23.960278+0000","last_active":"2024-09-21T06:34:44.225240+0000","last_peered":"2024-09-21T06:34:44.225240+0000","last_clean":"2024-09-21T06:34:44.225240+0000","last_became_active":"2024-09-21T06:34:23.959737+0000","last_became_peered":"2024-09-21T06:34:23.959737+0000","last_unstale":"2024-09-21T06:34:44.225240+0000","last_undegraded":"2024-09-21T06:34:44.225240+0000","last_fullsized":"2024-09-21T06:34:44.225240+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:50.097954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265247+0000","last_change":"2024-09-21T06:34:23.942797+0000","last_active":"2024-09-21T06:34:44.265247+0000","last_peered":"2024-09-21T06:34:44.265247+0000","last_clean":"2024-09-21T06:34:44.265247+0000","last_became_active":"2024-09-21T06:34:23.942441+0000","last_became_peered":"2024-09-21T06:34:23.942441+0000","last_unstale":"2024-09-21T06:34:44.265247+0000","last_undegraded":"2024-09-21T06:34:44.265247+0000","last_fullsized":"2024-09-21T06:34:44.265247+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:57:30.552583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265998+0000","last_change":"2024-09-21T06:34:23.957433+0000","last_active":"2024-09-21T06:34:44.265998+0000","last_peered":"2024-09-21T06:34:44.265998+0000","last_clean":"2024-09-21T06:34:44.265998+0000","last_became_active":"2024-09-21T06:34:23.957035+0000","last_became_peered":"2024-09-21T06:34:23.957035+0000","last_unstale":"2024-09-21T06:34:44.265998+0000","last_undegraded":"2024-09-21T06:34:44.265998+0000","last_fullsized":"2024-09-21T06:34:44.265998+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:40:18.418705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.224015+0000","last_change":"2024-09-21T06:34:23.950308+0000","last_active":"2024-09-21T06:34:44.224015+0000","last_peered":"2024-09-21T06:34:44.224015+0000","last_clean":"2024-09-21T06:34:44.224015+0000","last_became_active":"2024-09-21T06:34:23.948417+0000","last_became_peered":"2024-09-21T06:34:23.948417+0000","last_unstale":"2024-09-21T06:34:44.224015+0000","last_undegraded":"2024-09-21T06:34:44.224015+0000","last_fullsized":"2024-09-21T06:34:44.224015+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:47.233504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.226437+0000","last_change":"2024-09-21T06:34:23.949369+0000","last_active":"2024-09-21T06:34:44.226437+0000","last_peered":"2024-09-21T06:34:44.226437+0000","last_clean":"2024-09-21T06:34:44.226437+0000","last_became_active":"2024-09-21T06:34:23.948713+0000","last_became_peered":"2024-09-21T06:34:23.948713+0000","last_unstale":"2024-09-21T06:34:44.226437+0000","last_undegraded":"2024-09-21T06:34:44.226437+0000","last_fullsized":"2024-09-21T06:34:44.226437+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:57:06.915379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.224467+0000","last_change":"2024-09-21T06:34:23.959315+0000","last_active":"2024-09-21T06:34:44.224467+0000","last_peered":"2024-09-21T06:34:44.224467+0000","last_clean":"2024-09-21T06:34:44.224467+0000","last_became_active":"2024-09-21T06:34:23.958904+0000","last_became_peered":"2024-09-21T06:34:23.958904+0000","last_unstale":"2024-09-21T06:34:44.224467+0000","last_undegraded":"2024-09-21T06:34:44.224467+0000","last_fullsized":"2024-09-21T06:34:44.224467+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:31:35.486369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265718+0000","last_change":"2024-09-21T06:34:23.952074+0000","last_active":"2024-09-21T06:34:44.265718+0000","last_peered":"2024-09-21T06:34:44.265718+0000","last_clean":"2024-09-21T06:34:44.265718+0000","last_became_active":"2024-09-21T06:34:23.951692+0000","last_became_peered":"2024-09-21T06:34:23.951692+0000","last_unstale":"2024-09-21T06:34:44.265718+0000","last_undegraded":"2024-09-21T06:34:44.265718+0000","last_fullsized":"2024-09-21T06:34:44.265718+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:15:06.300781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.225420+0000","last_change":"2024-09-21T06:34:23.947296+0000","last_active":"2024-09-21T06:34:44.225420+0000","last_peered":"2024-09-21T06:34:44.225420+0000","last_clean":"2024-09-21T06:34:44.225420+0000","last_became_active":"2024-09-21T06:34:23.946392+0000","last_became_peered":"2024-09-21T06:34:23.946392+0000","last_unstale":"2024-09-21T06:34:44.225420+0000","last_undegraded":"2024-09-21T06:34:44.225420+0000","last_fullsized":"2024-09-21T06:34:44.225420+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:05:27.597890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265035+0000","last_change":"2024-09-21T06:34:23.953161+0000","last_active":"2024-09-21T06:34:44.265035+0000","last_peered":"2024-09-21T06:34:44.265035+0000","last_clean":"2024-09-21T06:34:44.265035+0000","last_became_active":"2024-09-21T06:34:23.952811+0000","last_became_peered":"2024-09-21T06:34:23.952811+0000","last_unstale":"2024-09-21T06:34:44.265035+0000","last_undegraded":"2024-09-21T06:34:44.265035+0000","last_fullsized":"2024-09-21T06:34:44.265035+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:04.431094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265586+0000","last_change":"2024-09-21T06:34:23.959880+0000","last_active":"2024-09-21T06:34:44.265586+0000","last_peered":"2024-09-21T06:34:44.265586+0000","last_clean":"2024-09-21T06:34:44.265586+0000","last_became_active":"2024-09-21T06:34:23.959573+0000","last_became_peered":"2024-09-21T06:34:23.959573+0000","last_unstale":"2024-09-21T06:34:44.265586+0000","last_undegraded":"2024-09-21T06:34:44.265586+0000","last_fullsized":"2024-09-21T06:34:44.265586+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:21.921956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265362+0000","last_change":"2024-09-21T06:34:23.947209+0000","last_active":"2024-09-21T06:34:44.265362+0000","last_peered":"2024-09-21T06:34:44.265362+0000","last_clean":"2024-09-21T06:34:44.265362+0000","last_became_active":"2024-09-21T06:34:23.946763+0000","last_became_peered":"2024-09-21T06:34:23.946763+0000","last_unstale":"2024-09-21T06:34:44.265362+0000","last_undegraded":"2024-09-21T06:34:44.265362+0000","last_fullsized":"2024-09-21T06:34:44.265362+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:04:54.050980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265396+0000","last_change":"2024-09-21T06:34:23.955064+0000","last_active":"2024-09-21T06:34:44.265396+0000","last_peered":"2024-09-21T06:34:44.265396+0000","last_clean":"2024-09-21T06:34:44.265396+0000","last_became_active":"2024-09-21T06:34:23.954622+0000","last_became_peered":"2024-09-21T06:34:23.954622+0000","last_unstale":"2024-09-21T06:34:44.265396+0000","last_undegraded":"2024-09-21T06:34:44.265396+0000","last_fullsized":"2024-09-21T06:34:44.265396+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:04:59.056398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.224979+0000","last_change":"2024-09-21T06:34:23.947015+0000","last_active":"2024-09-21T06:34:44.224979+0000","last_peered":"2024-09-21T06:34:44.224979+0000","last_clean":"2024-09-21T06:34:44.224979+0000","last_became_active":"2024-09-21T06:34:23.946569+0000","last_became_peered":"2024-09-21T06:34:23.946569+0000","last_unstale":"2024-09-21T06:34:44.224979+0000","last_undegraded":"2024-09-21T06:34:44.224979+0000","last_fullsized":"2024-09-21T06:34:44.224979+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:50:35.935533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.230155+0000","last_change":"2024-09-21T06:34:23.951126+0000","last_active":"2024-09-21T06:34:44.230155+0000","last_peered":"2024-09-21T06:34:44.230155+0000","last_clean":"2024-09-21T06:34:44.230155+0000","last_became_active":"2024-09-21T06:34:23.950739+0000","last_became_peered":"2024-09-21T06:34:23.950739+0000","last_unstale":"2024-09-21T06:34:44.230155+0000","last_undegraded":"2024-09-21T06:34:44.230155+0000","last_fullsized":"2024-09-21T06:34:44.230155+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:52:43.201135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'6","reported_seq":86,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:35:26.088727+0000","last_change":"2024-09-21T06:34:21.939584+0000","last_active":"2024-09-21T06:35:26.088727+0000","last_peered":"2024-09-21T06:35:26.088727+0000","last_clean":"2024-09-21T06:35:26.088727+0000","last_became_active":"2024-09-21T06:34:21.939233+0000","last_became_peered":"2024-09-21T06:34:21.939233+0000","last_unstale":"2024-09-21T06:35:26.088727+0000","last_undegraded":"2024-09-21T06:35:26.088727+0000","last_fullsized":"2024-09-21T06:35:26.088727+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:54.701803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":57,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.232102+0000","last_change":"2024-09-21T06:34:44.232010+0000","last_active":"2024-09-21T06:34:44.232102+0000","last_peered":"2024-09-21T06:34:44.232102+0000","last_clean":"2024-09-21T06:34:44.232102+0000","last_became_active":"2024-09-21T06:34:44.231590+0000","last_became_peered":"2024-09-21T06:34:44.231590+0000","last_unstale":"2024-09-21T06:34:44.232102+0000","last_undegraded":"2024-09-21T06:34:44.232102+0000","last_fullsized":"2024-09-21T06:34:44.232102+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:33:02.751794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.227410+0000","last_change":"2024-09-21T06:34:21.937418+0000","last_active":"2024-09-21T06:34:44.227410+0000","last_peered":"2024-09-21T06:34:44.227410+0000","last_clean":"2024-09-21T06:34:44.227410+0000","last_became_active":"2024-09-21T06:34:21.937048+0000","last_became_peered":"2024-09-21T06:34:21.937048+0000","last_unstale":"2024-09-21T06:34:44.227410+0000","last_undegraded":"2024-09-21T06:34:44.227410+0000","last_fullsized":"2024-09-21T06:34:44.227410+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:33:38.731444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.264973+0000","last_change":"2024-09-21T06:34:21.932970+0000","last_active":"2024-09-21T06:34:44.264973+0000","last_peered":"2024-09-21T06:34:44.264973+0000","last_clean":"2024-09-21T06:34:44.264973+0000","last_became_active":"2024-09-21T06:34:21.932616+0000","last_became_peered":"2024-09-21T06:34:21.932616+0000","last_unstale":"2024-09-21T06:34:44.264973+0000","last_undegraded":"2024-09-21T06:34:44.264973+0000","last_fullsized":"2024-09-21T06:34:44.264973+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:33:20.611023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.224042+0000","last_change":"2024-09-21T06:34:23.950798+0000","last_active":"2024-09-21T06:34:44.224042+0000","last_peered":"2024-09-21T06:34:44.224042+0000","last_clean":"2024-09-21T06:34:44.224042+0000","last_became_active":"2024-09-21T06:34:23.950475+0000","last_became_peered":"2024-09-21T06:34:23.950475+0000","last_unstale":"2024-09-21T06:34:44.224042+0000","last_undegraded":"2024-09-21T06:34:44.224042+0000","last_fullsized":"2024-09-21T06:34:44.224042+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:43:23.177775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.226659+0000","last_change":"2024-09-21T06:34:21.937860+0000","last_active":"2024-09-21T06:34:44.226659+0000","last_peered":"2024-09-21T06:34:44.226659+0000","last_clean":"2024-09-21T06:34:44.226659+0000","last_became_active":"2024-09-21T06:34:21.937476+0000","last_became_peered":"2024-09-21T06:34:21.937476+0000","last_unstale":"2024-09-21T06:34:44.226659+0000","last_undegraded":"2024-09-21T06:34:44.226659+0000","last_fullsized":"2024-09-21T06:34:44.226659+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:49:06.069197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.226096+0000","last_change":"2024-09-21T06:34:23.944559+0000","last_active":"2024-09-21T06:34:44.226096+0000","last_peered":"2024-09-21T06:34:44.226096+0000","last_clean":"2024-09-21T06:34:44.226096+0000","last_became_active":"2024-09-21T06:34:23.944166+0000","last_became_peered":"2024-09-21T06:34:23.944166+0000","last_unstale":"2024-09-21T06:34:44.226096+0000","last_undegraded":"2024-09-21T06:34:44.226096+0000","last_fullsized":"2024-09-21T06:34:44.226096+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:01:56.532854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"75'3","reported_seq":80,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:35:26.087911+0000","last_change":"2024-09-21T06:34:21.936531+0000","last_active":"2024-09-21T06:35:26.087911+0000","last_peered":"2024-09-21T06:35:26.087911+0000","last_clean":"2024-09-21T06:35:26.087911+0000","last_became_active":"2024-09-21T06:34:21.936087+0000","last_became_peered":"2024-09-21T06:34:21.936087+0000","last_unstale":"2024-09-21T06:35:26.087911+0000","last_undegraded":"2024-09-21T06:35:26.087911+0000","last_fullsized":"2024-09-21T06:35:26.087911+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:27:12.370722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.266303+0000","last_change":"2024-09-21T06:34:23.954894+0000","last_active":"2024-09-21T06:34:44.266303+0000","last_peered":"2024-09-21T06:34:44.266303+0000","last_clean":"2024-09-21T06:34:44.266303+0000","last_became_active":"2024-09-21T06:34:23.954186+0000","last_became_peered":"2024-09-21T06:34:23.954186+0000","last_unstale":"2024-09-21T06:34:44.266303+0000","last_undegraded":"2024-09-21T06:34:44.266303+0000","last_fullsized":"2024-09-21T06:34:44.266303+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:18:49.623338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265585+0000","last_change":"2024-09-21T06:34:21.934989+0000","last_active":"2024-09-21T06:34:44.265585+0000","last_peered":"2024-09-21T06:34:44.265585+0000","last_clean":"2024-09-21T06:34:44.265585+0000","last_became_active":"2024-09-21T06:34:21.934550+0000","last_became_peered":"2024-09-21T06:34:21.934550+0000","last_unstale":"2024-09-21T06:34:44.265585+0000","last_undegraded":"2024-09-21T06:34:44.265585+0000","last_fullsized":"2024-09-21T06:34:44.265585+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:59:17.849338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265984+0000","last_change":"2024-09-21T06:34:23.956190+0000","last_active":"2024-09-21T06:34:44.265984+0000","last_peered":"2024-09-21T06:34:44.265984+0000","last_clean":"2024-09-21T06:34:44.265984+0000","last_became_active":"2024-09-21T06:34:23.955815+0000","last_became_peered":"2024-09-21T06:34:23.955815+0000","last_unstale":"2024-09-21T06:34:44.265984+0000","last_undegraded":"2024-09-21T06:34:44.265984+0000","last_fullsized":"2024-09-21T06:34:44.265984+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:14:56.165350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'4","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.227080+0000","last_change":"2024-09-21T06:34:22.096480+0000","last_active":"2024-09-21T06:34:44.227080+0000","last_peered":"2024-09-21T06:34:44.227080+0000","last_clean":"2024-09-21T06:34:44.227080+0000","last_became_active":"2024-09-21T06:34:22.095921+0000","last_became_peered":"2024-09-21T06:34:22.095921+0000","last_unstale":"2024-09-21T06:34:44.227080+0000","last_undegraded":"2024-09-21T06:34:44.227080+0000","last_fullsized":"2024-09-21T06:34:44.227080+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:19:30.006811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265960+0000","last_change":"2024-09-21T06:34:23.961840+0000","last_active":"2024-09-21T06:34:44.265960+0000","last_peered":"2024-09-21T06:34:44.265960+0000","last_clean":"2024-09-21T06:34:44.265960+0000","last_became_active":"2024-09-21T06:34:23.961313+0000","last_became_peered":"2024-09-21T06:34:23.961313+0000","last_unstale":"2024-09-21T06:34:44.265960+0000","last_undegraded":"2024-09-21T06:34:44.265960+0000","last_fullsized":"2024-09-21T06:34:44.265960+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:29:04.308598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"77'28","reported_seq":167,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:35:27.089750+0000","last_change":"2024-09-21T06:34:21.937326+0000","last_active":"2024-09-21T06:35:27.089750+0000","last_peered":"2024-09-21T06:35:27.089750+0000","last_clean":"2024-09-21T06:35:27.089750+0000","last_became_active":"2024-09-21T06:34:21.936940+0000","last_became_peered":"2024-09-21T06:34:21.936940+0000","last_unstale":"2024-09-21T06:35:27.089750+0000","last_undegraded":"2024-09-21T06:35:27.089750+0000","last_fullsized":"2024-09-21T06:35:27.089750+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:47:12.988306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63902,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":116,"num_read_kb":120,"num_write":29,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.230328+0000","last_change":"2024-09-21T06:34:23.950167+0000","last_active":"2024-09-21T06:34:44.230328+0000","last_peered":"2024-09-21T06:34:44.230328+0000","last_clean":"2024-09-21T06:34:44.230328+0000","last_became_active":"2024-09-21T06:34:23.949697+0000","last_became_peered":"2024-09-21T06:34:23.949697+0000","last_unstale":"2024-09-21T06:34:44.230328+0000","last_undegraded":"2024-09-21T06:34:44.230328+0000","last_fullsized":"2024-09-21T06:34:44.230328+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:37:48.882644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'6","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265516+0000","last_change":"2024-09-21T06:34:21.937366+0000","last_active":"2024-09-21T06:34:44.265516+0000","last_peered":"2024-09-21T06:34:44.265516+0000","last_clean":"2024-09-21T06:34:44.265516+0000","last_became_active":"2024-09-21T06:34:21.936988+0000","last_became_peered":"2024-09-21T06:34:21.936988+0000","last_unstale":"2024-09-21T06:34:44.265516+0000","last_undegraded":"2024-09-21T06:34:44.265516+0000","last_fullsized":"2024-09-21T06:34:44.265516+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:48:06.318645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265352+0000","last_change":"2024-09-21T06:34:23.947523+0000","last_active":"2024-09-21T06:34:44.265352+0000","last_peered":"2024-09-21T06:34:44.265352+0000","last_clean":"2024-09-21T06:34:44.265352+0000","last_became_active":"2024-09-21T06:34:23.947150+0000","last_became_peered":"2024-09-21T06:34:23.947150+0000","last_unstale":"2024-09-21T06:34:44.265352+0000","last_undegraded":"2024-09-21T06:34:44.265352+0000","last_fullsized":"2024-09-21T06:34:44.265352+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:18:50.417153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.226854+0000","last_change":"2024-09-21T06:34:21.938631+0000","last_active":"2024-09-21T06:34:44.226854+0000","last_peered":"2024-09-21T06:34:44.226854+0000","last_clean":"2024-09-21T06:34:44.226854+0000","last_became_active":"2024-09-21T06:34:21.938242+0000","last_became_peered":"2024-09-21T06:34:21.938242+0000","last_unstale":"2024-09-21T06:34:44.226854+0000","last_undegraded":"2024-09-21T06:34:44.226854+0000","last_fullsized":"2024-09-21T06:34:44.226854+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:40:02.056812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265725+0000","last_change":"2024-09-21T06:34:23.945276+0000","last_active":"2024-09-21T06:34:44.265725+0000","last_peered":"2024-09-21T06:34:44.265725+0000","last_clean":"2024-09-21T06:34:44.265725+0000","last_became_active":"2024-09-21T06:34:23.944914+0000","last_became_peered":"2024-09-21T06:34:23.944914+0000","last_unstale":"2024-09-21T06:34:44.265725+0000","last_undegraded":"2024-09-21T06:34:44.265725+0000","last_fullsized":"2024-09-21T06:34:44.265725+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:15:23.650908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"75'4","reported_seq":84,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:35:26.087962+0000","last_change":"2024-09-21T06:34:21.937593+0000","last_active":"2024-09-21T06:35:26.087962+0000","last_peered":"2024-09-21T06:35:26.087962+0000","last_clean":"2024-09-21T06:35:26.087962+0000","last_became_active":"2024-09-21T06:34:21.936851+0000","last_became_peered":"2024-09-21T06:34:21.936851+0000","last_unstale":"2024-09-21T06:35:26.087962+0000","last_undegraded":"2024-09-21T06:35:26.087962+0000","last_fullsized":"2024-09-21T06:35:26.087962+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:25:36.161431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":58,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265345+0000","last_change":"2024-09-21T06:34:23.945573+0000","last_active":"2024-09-21T06:34:44.265345+0000","last_peered":"2024-09-21T06:34:44.265345+0000","last_clean":"2024-09-21T06:34:44.265345+0000","last_became_active":"2024-09-21T06:34:23.944410+0000","last_became_peered":"2024-09-21T06:34:23.944410+0000","last_unstale":"2024-09-21T06:34:44.265345+0000","last_undegraded":"2024-09-21T06:34:44.265345+0000","last_fullsized":"2024-09-21T06:34:44.265345+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:33:54.613524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'15","reported_seq":39,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.229900+0000","last_change":"2024-09-21T06:34:22.096539+0000","last_active":"2024-09-21T06:34:44.229900+0000","last_peered":"2024-09-21T06:34:44.229900+0000","last_clean":"2024-09-21T06:34:44.229900+0000","last_became_active":"2024-09-21T06:34:22.096013+0000","last_became_peered":"2024-09-21T06:34:22.096013+0000","last_unstale":"2024-09-21T06:34:44.229900+0000","last_undegraded":"2024-09-21T06:34:44.229900+0000","last_fullsized":"2024-09-21T06:34:44.229900+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:30:59.414325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.226688+0000","last_change":"2024-09-21T06:34:23.958381+0000","last_active":"2024-09-21T06:34:44.226688+0000","last_peered":"2024-09-21T06:34:44.226688+0000","last_clean":"2024-09-21T06:34:44.226688+0000","last_became_active":"2024-09-21T06:34:23.957965+0000","last_became_peered":"2024-09-21T06:34:23.957965+0000","last_unstale":"2024-09-21T06:34:44.226688+0000","last_undegraded":"2024-09-21T06:34:44.226688+0000","last_fullsized":"2024-09-21T06:34:44.226688+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:37:43.474777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'2","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.230733+0000","last_change":"2024-09-21T06:34:21.937612+0000","last_active":"2024-09-21T06:34:44.230733+0000","last_peered":"2024-09-21T06:34:44.230733+0000","last_clean":"2024-09-21T06:34:44.230733+0000","last_became_active":"2024-09-21T06:34:21.936859+0000","last_became_peered":"2024-09-21T06:34:21.936859+0000","last_unstale":"2024-09-21T06:34:44.230733+0000","last_undegraded":"2024-09-21T06:34:44.230733+0000","last_fullsized":"2024-09-21T06:34:44.230733+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:40.957217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.229139+0000","last_change":"2024-09-21T06:34:44.228991+0000","last_active":"2024-09-21T06:34:44.229139+0000","last_peered":"2024-09-21T06:34:44.229139+0000","last_clean":"2024-09-21T06:34:44.229139+0000","last_became_active":"2024-09-21T06:34:44.228428+0000","last_became_peered":"2024-09-21T06:34:44.228428+0000","last_unstale":"2024-09-21T06:34:44.229139+0000","last_undegraded":"2024-09-21T06:34:44.229139+0000","last_fullsized":"2024-09-21T06:34:44.229139+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:21.719532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265523+0000","last_change":"2024-09-21T06:34:21.933392+0000","last_active":"2024-09-21T06:34:44.265523+0000","last_peered":"2024-09-21T06:34:44.265523+0000","last_clean":"2024-09-21T06:34:44.265523+0000","last_became_active":"2024-09-21T06:34:21.932999+0000","last_became_peered":"2024-09-21T06:34:21.932999+0000","last_unstale":"2024-09-21T06:34:44.265523+0000","last_undegraded":"2024-09-21T06:34:44.265523+0000","last_fullsized":"2024-09-21T06:34:44.265523+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:05:20.631755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.266194+0000","last_change":"2024-09-21T06:34:23.944675+0000","last_active":"2024-09-21T06:34:44.266194+0000","last_peered":"2024-09-21T06:34:44.266194+0000","last_clean":"2024-09-21T06:34:44.266194+0000","last_became_active":"2024-09-21T06:34:23.944258+0000","last_became_peered":"2024-09-21T06:34:23.944258+0000","last_unstale":"2024-09-21T06:34:44.266194+0000","last_undegraded":"2024-09-21T06:34:44.266194+0000","last_fullsized":"2024-09-21T06:34:44.266194+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:26:40.661840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'1","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.227259+0000","last_change":"2024-09-21T06:34:21.941064+0000","last_active":"2024-09-21T06:34:44.227259+0000","last_peered":"2024-09-21T06:34:44.227259+0000","last_clean":"2024-09-21T06:34:44.227259+0000","last_became_active":"2024-09-21T06:34:21.940667+0000","last_became_peered":"2024-09-21T06:34:21.940667+0000","last_unstale":"2024-09-21T06:34:44.227259+0000","last_undegraded":"2024-09-21T06:34:44.227259+0000","last_fullsized":"2024-09-21T06:34:44.227259+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:20:14.721719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'1","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.266571+0000","last_change":"2024-09-21T06:34:23.943503+0000","last_active":"2024-09-21T06:34:44.266571+0000","last_peered":"2024-09-21T06:34:44.266571+0000","last_clean":"2024-09-21T06:34:44.266571+0000","last_became_active":"2024-09-21T06:34:23.943097+0000","last_became_peered":"2024-09-21T06:34:23.943097+0000","last_unstale":"2024-09-21T06:34:44.266571+0000","last_undegraded":"2024-09-21T06:34:44.266571+0000","last_fullsized":"2024-09-21T06:34:44.266571+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:08:04.641273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"75'3","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265879+0000","last_change":"2024-09-21T06:34:22.096274+0000","last_active":"2024-09-21T06:34:44.265879+0000","last_peered":"2024-09-21T06:34:44.265879+0000","last_clean":"2024-09-21T06:34:44.265879+0000","last_became_active":"2024-09-21T06:34:22.095861+0000","last_became_peered":"2024-09-21T06:34:22.095861+0000","last_unstale":"2024-09-21T06:34:44.265879+0000","last_undegraded":"2024-09-21T06:34:44.265879+0000","last_fullsized":"2024-09-21T06:34:44.265879+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:22:47.807488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.266601+0000","last_change":"2024-09-21T06:34:23.953503+0000","last_active":"2024-09-21T06:34:44.266601+0000","last_peered":"2024-09-21T06:34:44.266601+0000","last_clean":"2024-09-21T06:34:44.266601+0000","last_became_active":"2024-09-21T06:34:23.952880+0000","last_became_peered":"2024-09-21T06:34:23.952880+0000","last_unstale":"2024-09-21T06:34:44.266601+0000","last_undegraded":"2024-09-21T06:34:44.266601+0000","last_fullsized":"2024-09-21T06:34:44.266601+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:29:47.746678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":97,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265543+0000","last_change":"2024-09-21T06:33:09.908154+0000","last_active":"2024-09-21T06:34:44.265543+0000","last_peered":"2024-09-21T06:34:44.265543+0000","last_clean":"2024-09-21T06:34:44.265543+0000","last_became_active":"2024-09-21T06:33:09.902397+0000","last_became_peered":"2024-09-21T06:33:09.902397+0000","last_unstale":"2024-09-21T06:34:44.265543+0000","last_undegraded":"2024-09-21T06:34:44.265543+0000","last_fullsized":"2024-09-21T06:34:44.265543+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:29:42.295555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:29:42.295555+0000","last_clean_scrub_stamp":"2024-09-21T06:29:42.295555+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:15:17.111178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"75'3","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.225389+0000","last_change":"2024-09-21T06:34:21.932618+0000","last_active":"2024-09-21T06:34:44.225389+0000","last_peered":"2024-09-21T06:34:44.225389+0000","last_clean":"2024-09-21T06:34:44.225389+0000","last_became_active":"2024-09-21T06:34:21.932187+0000","last_became_peered":"2024-09-21T06:34:21.932187+0000","last_unstale":"2024-09-21T06:34:44.225389+0000","last_undegraded":"2024-09-21T06:34:44.225389+0000","last_fullsized":"2024-09-21T06:34:44.225389+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:19:06.780448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.224167+0000","last_change":"2024-09-21T06:34:23.953580+0000","last_active":"2024-09-21T06:34:44.224167+0000","last_peered":"2024-09-21T06:34:44.224167+0000","last_clean":"2024-09-21T06:34:44.224167+0000","last_became_active":"2024-09-21T06:34:23.952222+0000","last_became_peered":"2024-09-21T06:34:23.952222+0000","last_unstale":"2024-09-21T06:34:44.224167+0000","last_undegraded":"2024-09-21T06:34:44.224167+0000","last_fullsized":"2024-09-21T06:34:44.224167+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:19.759042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265531+0000","last_change":"2024-09-21T06:34:21.939178+0000","last_active":"2024-09-21T06:34:44.265531+0000","last_peered":"2024-09-21T06:34:44.265531+0000","last_clean":"2024-09-21T06:34:44.265531+0000","last_became_active":"2024-09-21T06:34:21.938755+0000","last_became_peered":"2024-09-21T06:34:21.938755+0000","last_unstale":"2024-09-21T06:34:44.265531+0000","last_undegraded":"2024-09-21T06:34:44.265531+0000","last_fullsized":"2024-09-21T06:34:44.265531+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:10.474432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.264822+0000","last_change":"2024-09-21T06:34:23.954196+0000","last_active":"2024-09-21T06:34:44.264822+0000","last_peered":"2024-09-21T06:34:44.264822+0000","last_clean":"2024-09-21T06:34:44.264822+0000","last_became_active":"2024-09-21T06:34:23.953843+0000","last_became_peered":"2024-09-21T06:34:23.953843+0000","last_unstale":"2024-09-21T06:34:44.264822+0000","last_undegraded":"2024-09-21T06:34:44.264822+0000","last_fullsized":"2024-09-21T06:34:44.264822+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:41:02.896704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"75'4","reported_seq":78,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:35:23.082570+0000","last_change":"2024-09-21T06:34:22.095920+0000","last_active":"2024-09-21T06:35:23.082570+0000","last_peered":"2024-09-21T06:35:23.082570+0000","last_clean":"2024-09-21T06:35:23.082570+0000","last_became_active":"2024-09-21T06:34:22.095376+0000","last_became_peered":"2024-09-21T06:34:22.095376+0000","last_unstale":"2024-09-21T06:35:23.082570+0000","last_undegraded":"2024-09-21T06:35:23.082570+0000","last_fullsized":"2024-09-21T06:35:23.082570+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:40:44.400566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.226479+0000","last_change":"2024-09-21T06:34:23.956541+0000","last_active":"2024-09-21T06:34:44.226479+0000","last_peered":"2024-09-21T06:34:44.226479+0000","last_clean":"2024-09-21T06:34:44.226479+0000","last_became_active":"2024-09-21T06:34:23.956150+0000","last_became_peered":"2024-09-21T06:34:23.956150+0000","last_unstale":"2024-09-21T06:34:44.226479+0000","last_undegraded":"2024-09-21T06:34:44.226479+0000","last_fullsized":"2024-09-21T06:34:44.226479+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:09:32.432391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.266674+0000","last_change":"2024-09-21T06:34:21.942244+0000","last_active":"2024-09-21T06:34:44.266674+0000","last_peered":"2024-09-21T06:34:44.266674+0000","last_clean":"2024-09-21T06:34:44.266674+0000","last_became_active":"2024-09-21T06:34:21.941761+0000","last_became_peered":"2024-09-21T06:34:21.941761+0000","last_unstale":"2024-09-21T06:34:44.266674+0000","last_undegraded":"2024-09-21T06:34:44.266674+0000","last_fullsized":"2024-09-21T06:34:44.266674+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:10.507103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.227647+0000","last_change":"2024-09-21T06:34:23.951250+0000","last_active":"2024-09-21T06:34:44.227647+0000","last_peered":"2024-09-21T06:34:44.227647+0000","last_clean":"2024-09-21T06:34:44.227647+0000","last_became_active":"2024-09-21T06:34:23.950015+0000","last_became_peered":"2024-09-21T06:34:23.950015+0000","last_unstale":"2024-09-21T06:34:44.227647+0000","last_undegraded":"2024-09-21T06:34:44.227647+0000","last_fullsized":"2024-09-21T06:34:44.227647+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:53:22.884049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.266799+0000","last_change":"2024-09-21T06:34:44.266717+0000","last_active":"2024-09-21T06:34:44.266799+0000","last_peered":"2024-09-21T06:34:44.266799+0000","last_clean":"2024-09-21T06:34:44.266799+0000","last_became_active":"2024-09-21T06:34:44.266256+0000","last_became_peered":"2024-09-21T06:34:44.266256+0000","last_unstale":"2024-09-21T06:34:44.266799+0000","last_undegraded":"2024-09-21T06:34:44.266799+0000","last_fullsized":"2024-09-21T06:34:44.266799+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:38:04.674592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'1","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.227589+0000","last_change":"2024-09-21T06:34:23.947823+0000","last_active":"2024-09-21T06:34:44.227589+0000","last_peered":"2024-09-21T06:34:44.227589+0000","last_clean":"2024-09-21T06:34:44.227589+0000","last_became_active":"2024-09-21T06:34:23.947362+0000","last_became_peered":"2024-09-21T06:34:23.947362+0000","last_unstale":"2024-09-21T06:34:44.227589+0000","last_undegraded":"2024-09-21T06:34:44.227589+0000","last_fullsized":"2024-09-21T06:34:44.227589+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:32:22.401819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"75'1","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.230506+0000","last_change":"2024-09-21T06:34:22.096537+0000","last_active":"2024-09-21T06:34:44.230506+0000","last_peered":"2024-09-21T06:34:44.230506+0000","last_clean":"2024-09-21T06:34:44.230506+0000","last_became_active":"2024-09-21T06:34:22.095875+0000","last_became_peered":"2024-09-21T06:34:22.095875+0000","last_unstale":"2024-09-21T06:34:44.230506+0000","last_undegraded":"2024-09-21T06:34:44.230506+0000","last_fullsized":"2024-09-21T06:34:44.230506+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:11:44.955531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265151+0000","last_change":"2024-09-21T06:34:23.938784+0000","last_active":"2024-09-21T06:34:44.265151+0000","last_peered":"2024-09-21T06:34:44.265151+0000","last_clean":"2024-09-21T06:34:44.265151+0000","last_became_active":"2024-09-21T06:34:23.938400+0000","last_became_peered":"2024-09-21T06:34:23.938400+0000","last_unstale":"2024-09-21T06:34:44.265151+0000","last_undegraded":"2024-09-21T06:34:44.265151+0000","last_fullsized":"2024-09-21T06:34:44.265151+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:00:13.210874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"77'10","reported_seq":46,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:48.958566+0000","last_change":"2024-09-21T06:34:44.235532+0000","last_active":"2024-09-21T06:34:48.958566+0000","last_peered":"2024-09-21T06:34:48.958566+0000","last_clean":"2024-09-21T06:34:48.958566+0000","last_became_active":"2024-09-21T06:34:44.230220+0000","last_became_peered":"2024-09-21T06:34:44.230220+0000","last_unstale":"2024-09-21T06:34:48.958566+0000","last_undegraded":"2024-09-21T06:34:48.958566+0000","last_fullsized":"2024-09-21T06:34:48.958566+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:07:23.398177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":11,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.224475+0000","last_change":"2024-09-21T06:34:23.953477+0000","last_active":"2024-09-21T06:34:44.224475+0000","last_peered":"2024-09-21T06:34:44.224475+0000","last_clean":"2024-09-21T06:34:44.224475+0000","last_became_active":"2024-09-21T06:34:23.951404+0000","last_became_peered":"2024-09-21T06:34:23.951404+0000","last_unstale":"2024-09-21T06:34:44.224475+0000","last_undegraded":"2024-09-21T06:34:44.224475+0000","last_fullsized":"2024-09-21T06:34:44.224475+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:13:17.126680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'4","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.225262+0000","last_change":"2024-09-21T06:34:22.031837+0000","last_active":"2024-09-21T06:34:44.225262+0000","last_peered":"2024-09-21T06:34:44.225262+0000","last_clean":"2024-09-21T06:34:44.225262+0000","last_became_active":"2024-09-21T06:34:22.031377+0000","last_became_peered":"2024-09-21T06:34:22.031377+0000","last_unstale":"2024-09-21T06:34:44.225262+0000","last_undegraded":"2024-09-21T06:34:44.225262+0000","last_fullsized":"2024-09-21T06:34:44.225262+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:14:32.536634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265835+0000","last_change":"2024-09-21T06:34:23.955321+0000","last_active":"2024-09-21T06:34:44.265835+0000","last_peered":"2024-09-21T06:34:44.265835+0000","last_clean":"2024-09-21T06:34:44.265835+0000","last_became_active":"2024-09-21T06:34:23.954906+0000","last_became_peered":"2024-09-21T06:34:23.954906+0000","last_unstale":"2024-09-21T06:34:44.265835+0000","last_undegraded":"2024-09-21T06:34:44.265835+0000","last_fullsized":"2024-09-21T06:34:44.265835+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:59:07.771268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265823+0000","last_change":"2024-09-21T06:34:22.096135+0000","last_active":"2024-09-21T06:34:44.265823+0000","last_peered":"2024-09-21T06:34:44.265823+0000","last_clean":"2024-09-21T06:34:44.265823+0000","last_became_active":"2024-09-21T06:34:22.095721+0000","last_became_peered":"2024-09-21T06:34:22.095721+0000","last_unstale":"2024-09-21T06:34:44.265823+0000","last_undegraded":"2024-09-21T06:34:44.265823+0000","last_fullsized":"2024-09-21T06:34:44.265823+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:28.994324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.229717+0000","last_change":"2024-09-21T06:34:23.951769+0000","last_active":"2024-09-21T06:34:44.229717+0000","last_peered":"2024-09-21T06:34:44.229717+0000","last_clean":"2024-09-21T06:34:44.229717+0000","last_became_active":"2024-09-21T06:34:23.951377+0000","last_became_peered":"2024-09-21T06:34:23.951377+0000","last_unstale":"2024-09-21T06:34:44.229717+0000","last_undegraded":"2024-09-21T06:34:44.229717+0000","last_fullsized":"2024-09-21T06:34:44.229717+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:49:44.291714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.224147+0000","last_change":"2024-09-21T06:34:21.933909+0000","last_active":"2024-09-21T06:34:44.224147+0000","last_peered":"2024-09-21T06:34:44.224147+0000","last_clean":"2024-09-21T06:34:44.224147+0000","last_became_active":"2024-09-21T06:34:21.933524+0000","last_became_peered":"2024-09-21T06:34:21.933524+0000","last_unstale":"2024-09-21T06:34:44.224147+0000","last_undegraded":"2024-09-21T06:34:44.224147+0000","last_fullsized":"2024-09-21T06:34:44.224147+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:58.110444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.225073+0000","last_change":"2024-09-21T06:34:23.948586+0000","last_active":"2024-09-21T06:34:44.225073+0000","last_peered":"2024-09-21T06:34:44.225073+0000","last_clean":"2024-09-21T06:34:44.225073+0000","last_became_active":"2024-09-21T06:34:23.948225+0000","last_became_peered":"2024-09-21T06:34:23.948225+0000","last_unstale":"2024-09-21T06:34:44.225073+0000","last_undegraded":"2024-09-21T06:34:44.225073+0000","last_fullsized":"2024-09-21T06:34:44.225073+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:28:24.272712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265358+0000","last_change":"2024-09-21T06:34:21.935617+0000","last_active":"2024-09-21T06:34:44.265358+0000","last_peered":"2024-09-21T06:34:44.265358+0000","last_clean":"2024-09-21T06:34:44.265358+0000","last_became_active":"2024-09-21T06:34:21.934601+0000","last_became_peered":"2024-09-21T06:34:21.934601+0000","last_unstale":"2024-09-21T06:34:44.265358+0000","last_undegraded":"2024-09-21T06:34:44.265358+0000","last_fullsized":"2024-09-21T06:34:44.265358+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:30.836070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.224206+0000","last_change":"2024-09-21T06:34:23.947661+0000","last_active":"2024-09-21T06:34:44.224206+0000","last_peered":"2024-09-21T06:34:44.224206+0000","last_clean":"2024-09-21T06:34:44.224206+0000","last_became_active":"2024-09-21T06:34:23.947307+0000","last_became_peered":"2024-09-21T06:34:23.947307+0000","last_unstale":"2024-09-21T06:34:44.224206+0000","last_undegraded":"2024-09-21T06:34:44.224206+0000","last_fullsized":"2024-09-21T06:34:44.224206+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:08.045291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'4","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.230116+0000","last_change":"2024-09-21T06:34:21.942749+0000","last_active":"2024-09-21T06:34:44.230116+0000","last_peered":"2024-09-21T06:34:44.230116+0000","last_clean":"2024-09-21T06:34:44.230116+0000","last_became_active":"2024-09-21T06:34:21.942283+0000","last_became_peered":"2024-09-21T06:34:21.942283+0000","last_unstale":"2024-09-21T06:34:44.230116+0000","last_undegraded":"2024-09-21T06:34:44.230116+0000","last_fullsized":"2024-09-21T06:34:44.230116+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:47.477956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.266544+0000","last_change":"2024-09-21T06:34:23.957389+0000","last_active":"2024-09-21T06:34:44.266544+0000","last_peered":"2024-09-21T06:34:44.266544+0000","last_clean":"2024-09-21T06:34:44.266544+0000","last_became_active":"2024-09-21T06:34:23.957032+0000","last_became_peered":"2024-09-21T06:34:23.957032+0000","last_unstale":"2024-09-21T06:34:44.266544+0000","last_undegraded":"2024-09-21T06:34:44.266544+0000","last_fullsized":"2024-09-21T06:34:44.266544+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:00:53.932062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.227302+0000","last_change":"2024-09-21T06:34:23.957304+0000","last_active":"2024-09-21T06:34:44.227302+0000","last_peered":"2024-09-21T06:34:44.227302+0000","last_clean":"2024-09-21T06:34:44.227302+0000","last_became_active":"2024-09-21T06:34:23.956931+0000","last_became_peered":"2024-09-21T06:34:23.956931+0000","last_unstale":"2024-09-21T06:34:44.227302+0000","last_undegraded":"2024-09-21T06:34:44.227302+0000","last_fullsized":"2024-09-21T06:34:44.227302+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:14:12.240686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.230138+0000","last_change":"2024-09-21T06:34:21.937150+0000","last_active":"2024-09-21T06:34:44.230138+0000","last_peered":"2024-09-21T06:34:44.230138+0000","last_clean":"2024-09-21T06:34:44.230138+0000","last_became_active":"2024-09-21T06:34:21.936037+0000","last_became_peered":"2024-09-21T06:34:21.936037+0000","last_unstale":"2024-09-21T06:34:44.230138+0000","last_undegraded":"2024-09-21T06:34:44.230138+0000","last_fullsized":"2024-09-21T06:34:44.230138+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:24:44.821346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265815+0000","last_change":"2024-09-21T06:34:23.955585+0000","last_active":"2024-09-21T06:34:44.265815+0000","last_peered":"2024-09-21T06:34:44.265815+0000","last_clean":"2024-09-21T06:34:44.265815+0000","last_became_active":"2024-09-21T06:34:23.955225+0000","last_became_peered":"2024-09-21T06:34:23.955225+0000","last_unstale":"2024-09-21T06:34:44.265815+0000","last_undegraded":"2024-09-21T06:34:44.265815+0000","last_fullsized":"2024-09-21T06:34:44.265815+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:07:56.735854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'4","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.230684+0000","last_change":"2024-09-21T06:34:21.941804+0000","last_active":"2024-09-21T06:34:44.230684+0000","last_peered":"2024-09-21T06:34:44.230684+0000","last_clean":"2024-09-21T06:34:44.230684+0000","last_became_active":"2024-09-21T06:34:21.941387+0000","last_became_peered":"2024-09-21T06:34:21.941387+0000","last_unstale":"2024-09-21T06:34:44.230684+0000","last_undegraded":"2024-09-21T06:34:44.230684+0000","last_fullsized":"2024-09-21T06:34:44.230684+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:34:51.217549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265988+0000","last_change":"2024-09-21T06:34:23.957429+0000","last_active":"2024-09-21T06:34:44.265988+0000","last_peered":"2024-09-21T06:34:44.265988+0000","last_clean":"2024-09-21T06:34:44.265988+0000","last_became_active":"2024-09-21T06:34:23.956471+0000","last_became_peered":"2024-09-21T06:34:23.956471+0000","last_unstale":"2024-09-21T06:34:44.265988+0000","last_undegraded":"2024-09-21T06:34:44.265988+0000","last_fullsized":"2024-09-21T06:34:44.265988+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:46:26.770549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.224539+0000","last_change":"2024-09-21T06:34:22.096267+0000","last_active":"2024-09-21T06:34:44.224539+0000","last_peered":"2024-09-21T06:34:44.224539+0000","last_clean":"2024-09-21T06:34:44.224539+0000","last_became_active":"2024-09-21T06:34:22.095799+0000","last_became_peered":"2024-09-21T06:34:22.095799+0000","last_unstale":"2024-09-21T06:34:44.224539+0000","last_undegraded":"2024-09-21T06:34:44.224539+0000","last_fullsized":"2024-09-21T06:34:44.224539+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:29:00.075016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.224392+0000","last_change":"2024-09-21T06:34:23.952294+0000","last_active":"2024-09-21T06:34:44.224392+0000","last_peered":"2024-09-21T06:34:44.224392+0000","last_clean":"2024-09-21T06:34:44.224392+0000","last_became_active":"2024-09-21T06:34:23.951919+0000","last_became_peered":"2024-09-21T06:34:23.951919+0000","last_unstale":"2024-09-21T06:34:44.224392+0000","last_undegraded":"2024-09-21T06:34:44.224392+0000","last_fullsized":"2024-09-21T06:34:44.224392+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:30:28.039754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'9","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.226566+0000","last_change":"2024-09-21T06:34:21.934818+0000","last_active":"2024-09-21T06:34:44.226566+0000","last_peered":"2024-09-21T06:34:44.226566+0000","last_clean":"2024-09-21T06:34:44.226566+0000","last_became_active":"2024-09-21T06:34:21.934415+0000","last_became_peered":"2024-09-21T06:34:21.934415+0000","last_unstale":"2024-09-21T06:34:44.226566+0000","last_undegraded":"2024-09-21T06:34:44.226566+0000","last_fullsized":"2024-09-21T06:34:44.226566+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:25:48.460699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68294,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":349,"num_read_kb":245,"num_write":162,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":11,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":204882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":138,"ondisk_log_size":138,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282715,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743451,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27840,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717312,"statfs":{"total":95995035648,"available":95966527488,"internally_reserved":0,"allocated":835584,"data_stored":417151,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939678,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":991232,"data_stored":1072925,"data_compressed":41743,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103204,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27856,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717296,"statfs":{"total":95995035648,"available":95966511104,"internally_reserved":0,"allocated":851968,"data_stored":417387,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299433,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32024,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713128,"statfs":{"total":95995035648,"available":95962243072,"internally_reserved":0,"allocated":851968,"data_stored":417307,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462958,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":901120,"data_stored":1009628,"data_compressed":41743,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626483,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36172,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708980,"statfs":{"total":95995035648,"available":95957995520,"internally_reserved":0,"allocated":839680,"data_stored":416776,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822713,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":913408,"data_stored":1008921,"data_compressed":41743,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986239,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36168,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708984,"statfs":{"total":95995035648,"available":95957999616,"internally_reserved":0,"allocated":843776,"data_stored":417604,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182467,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36180,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708972,"statfs":{"total":95995035648,"available":95957987328,"internally_reserved":0,"allocated":856064,"data_stored":417087,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378697,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32092,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713060,"statfs":{"total":95995035648,"available":95962173440,"internally_reserved":0,"allocated":929792,"data_stored":482212,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542222,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":480471,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705746,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27872,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717280,"statfs":{"total":95995035648,"available":95966494720,"internally_reserved":0,"allocated":860160,"data_stored":418047,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34325,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34325,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34325,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":63902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":65643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":65871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T06:35:30.980 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T06:35:31.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:35:30 smithi144 ceph-mon[34653]: pgmap v298: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T06:35:31.257 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:31.669 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:35:31 smithi007 ceph-mon[30983]: from='client.15150 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:35:31.669 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:35:31 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:35:31.669 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:35:31 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:35:31.670 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:35:31 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:35:31.670 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:35:31 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:35:31.670 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:35:31 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:35:31.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:31.760+0000 7f7fa9eae640 1 -- 172.21.15.7:0/1487172299 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7fa41094c0 msgr2=0x7f7fa41098d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:31.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:31.760+0000 7f7fa9eae640 1 --2- 172.21.15.7:0/1487172299 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7fa41094c0 0x7f7fa41098d0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c009900 tx=0x7f7f8c02a410 comp rx=0 tx=0).stop 2024-09-21T06:35:31.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:31.760+0000 7f7fa9eae640 1 -- 172.21.15.7:0/1487172299 shutdown_connections 2024-09-21T06:35:31.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:31.760+0000 7f7fa9eae640 1 --2- 172.21.15.7:0/1487172299 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7fa4109e10 0x7f7fa4110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:31.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:31.760+0000 7f7fa9eae640 1 --2- 172.21.15.7:0/1487172299 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7fa41094c0 0x7f7fa41098d0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:31.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:31.760+0000 7f7fa9eae640 1 --2- 172.21.15.7:0/1487172299 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fa4101fe0 0x7f7fa41023f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:31.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:31.760+0000 7f7fa9eae640 1 -- 172.21.15.7:0/1487172299 >> 172.21.15.7:0/1487172299 conn(0x7f7fa4077bc0 msgr2=0x7f7fa4078000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:31.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:31.760+0000 7f7fa9eae640 1 -- 172.21.15.7:0/1487172299 shutdown_connections 2024-09-21T06:35:31.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:31.760+0000 7f7fa9eae640 1 -- 172.21.15.7:0/1487172299 wait complete. 2024-09-21T06:35:31.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:31.761+0000 7f7fa9eae640 1 Processor -- start 2024-09-21T06:35:31.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:31.761+0000 7f7fa9eae640 1 -- start start 2024-09-21T06:35:31.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:31.762+0000 7f7fa9eae640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7fa4101fe0 0x7f7fa419a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:31.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:31.762+0000 7f7fa9eae640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7fa41094c0 0x7f7fa419aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:31.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:31.762+0000 7f7fa9eae640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fa4109e10 0x7f7fa419fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:31.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:31.762+0000 7f7fa9eae640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa4113a80 con 0x7f7fa41094c0 2024-09-21T06:35:31.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:31.762+0000 7f7fa9eae640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa4113900 con 0x7f7fa4109e10 2024-09-21T06:35:31.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:31.762+0000 7f7fa9eae640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa4113c00 con 0x7f7fa4101fe0 2024-09-21T06:35:31.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:31.762+0000 7f7f9bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7fa41094c0 0x7f7fa419aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:31.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:31.762+0000 7f7f9bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7fa41094c0 0x7f7fa419aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56018/0 (socket says 172.21.15.7:56018) 2024-09-21T06:35:31.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:31.762+0000 7f7f9bfff640 1 -- 172.21.15.7:0/1361961290 learned_addr learned my addr 172.21.15.7:0/1361961290 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:35:31.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:31.762+0000 7f7fa37fe640 1 --2- 172.21.15.7:0/1361961290 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7fa4101fe0 0x7f7fa419a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:31.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:31.762+0000 7f7fa3fff640 1 --2- 172.21.15.7:0/1361961290 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fa4109e10 0x7f7fa419fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:31.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:31.762+0000 7f7f9bfff640 1 -- 172.21.15.7:0/1361961290 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7fa4101fe0 msgr2=0x7f7fa419a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:31.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:31.762+0000 7f7f9bfff640 1 --2- 172.21.15.7:0/1361961290 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7fa4101fe0 0x7f7fa419a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:31.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:31.762+0000 7f7f9bfff640 1 -- 172.21.15.7:0/1361961290 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fa4109e10 msgr2=0x7f7fa419fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:31.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:31.762+0000 7f7f9bfff640 1 --2- 172.21.15.7:0/1361961290 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fa4109e10 0x7f7fa419fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:31.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:31.762+0000 7f7f9bfff640 1 -- 172.21.15.7:0/1361961290 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fa41a04a0 con 0x7f7fa41094c0 2024-09-21T06:35:31.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:31.762+0000 7f7fa3fff640 1 --2- 172.21.15.7:0/1361961290 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fa4109e10 0x7f7fa419fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:35:31.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:31.762+0000 7f7f9bfff640 1 --2- 172.21.15.7:0/1361961290 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7fa41094c0 0x7f7fa419aad0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c006010 tx=0x7f7f8c004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:31.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:31.763+0000 7f7fa17fa640 1 -- 172.21.15.7:0/1361961290 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f8c03f030 con 0x7f7fa41094c0 2024-09-21T06:35:31.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:31.763+0000 7f7fa9eae640 1 -- 172.21.15.7:0/1361961290 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fa41a0730 con 0x7f7fa41094c0 2024-09-21T06:35:31.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:31.763+0000 7f7fa17fa640 1 -- 172.21.15.7:0/1361961290 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7f8c003aa0 con 0x7f7fa41094c0 2024-09-21T06:35:31.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:31.763+0000 7f7fa17fa640 1 -- 172.21.15.7:0/1361961290 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f8c035070 con 0x7f7fa41094c0 2024-09-21T06:35:31.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:31.763+0000 7f7fa9eae640 1 -- 172.21.15.7:0/1361961290 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fa41a6ef0 con 0x7f7fa41094c0 2024-09-21T06:35:31.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:31.764+0000 7f7fa9eae640 1 -- 172.21.15.7:0/1361961290 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fa41023f0 con 0x7f7fa41094c0 2024-09-21T06:35:31.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:31.766+0000 7f7fa17fa640 1 -- 172.21.15.7:0/1361961290 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154579+0+0 (secure 0 0 0) 0x7f7f8c042030 con 0x7f7fa41094c0 2024-09-21T06:35:31.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:31.767+0000 7f7fa17fa640 1 --2- 172.21.15.7:0/1361961290 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f7f900b65f0 0x7f7f900b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:31.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:31.767+0000 7f7fa37fe640 1 --2- 172.21.15.7:0/1361961290 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f7f900b65f0 0x7f7f900b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:31.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:31.767+0000 7f7fa17fa640 1 -- 172.21.15.7:0/1361961290 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f7f8c107f10 con 0x7f7fa41094c0 2024-09-21T06:35:31.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:31.767+0000 7f7fa37fe640 1 --2- 172.21.15.7:0/1361961290 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f7f900b65f0 0x7f7f900b8b00 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7f94009b60 tx=0x7f7f94005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:31.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:31.770+0000 7f7fa17fa640 1 -- 172.21.15.7:0/1361961290 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7f8c0ce5c0 con 0x7f7fa41094c0 2024-09-21T06:35:31.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:35:31 smithi018 ceph-mon[34477]: from='client.15150 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:35:31.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:35:31 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:35:31.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:35:31 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:35:31.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:35:31 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:35:31.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:35:31 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:35:31.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:35:31 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:35:31.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:31.954+0000 7f7fa9eae640 1 -- 172.21.15.7:0/1361961290 --> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7fa410bcf0 con 0x7f7f900b65f0 2024-09-21T06:35:31.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:31.958+0000 7f7fa17fa640 1 -- 172.21.15.7:0/1361961290 <== mgr.14223 v2:172.21.15.7:6800/3442812985 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258954 (secure 0 0 0) 0x7f7fa410bcf0 con 0x7f7f900b65f0 2024-09-21T06:35:31.963 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:35:31.965 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-09-21T06:35:31.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:31.961+0000 7f7fa9eae640 1 -- 172.21.15.7:0/1361961290 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f7f900b65f0 msgr2=0x7f7f900b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:31.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:31.961+0000 7f7fa9eae640 1 --2- 172.21.15.7:0/1361961290 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f7f900b65f0 0x7f7f900b8b00 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7f94009b60 tx=0x7f7f94005f90 comp rx=0 tx=0).stop 2024-09-21T06:35:31.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:31.961+0000 7f7fa9eae640 1 -- 172.21.15.7:0/1361961290 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7fa41094c0 msgr2=0x7f7fa419aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:31.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:31.961+0000 7f7fa9eae640 1 --2- 172.21.15.7:0/1361961290 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7fa41094c0 0x7f7fa419aad0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c006010 tx=0x7f7f8c004060 comp rx=0 tx=0).stop 2024-09-21T06:35:31.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:31.961+0000 7f7fa9eae640 1 -- 172.21.15.7:0/1361961290 shutdown_connections 2024-09-21T06:35:31.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:31.961+0000 7f7fa9eae640 1 --2- 172.21.15.7:0/1361961290 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f7f900b65f0 0x7f7f900b8b00 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:31.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:31.961+0000 7f7fa9eae640 1 --2- 172.21.15.7:0/1361961290 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fa4109e10 0x7f7fa419fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:31.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:31.961+0000 7f7fa9eae640 1 --2- 172.21.15.7:0/1361961290 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7fa41094c0 0x7f7fa419aad0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:31.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:31.961+0000 7f7fa9eae640 1 --2- 172.21.15.7:0/1361961290 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7fa4101fe0 0x7f7fa419a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:31.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:31.961+0000 7f7fa9eae640 1 -- 172.21.15.7:0/1361961290 >> 172.21.15.7:0/1361961290 conn(0x7f7fa4077bc0 msgr2=0x7f7fa4105530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:31.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:31.961+0000 7f7fa9eae640 1 -- 172.21.15.7:0/1361961290 shutdown_connections 2024-09-21T06:35:31.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:31.961+0000 7f7fa9eae640 1 -- 172.21.15.7:0/1361961290 wait complete. 2024-09-21T06:35:32.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:35:31 smithi144 ceph-mon[34653]: from='client.15150 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:35:32.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:35:31 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:35:32.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:35:31 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:35:32.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:35:31 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:35:32.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:35:31 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:35:32.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:35:31 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:35:32.596 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:35:32 smithi007 ceph-mon[30983]: pgmap v299: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:35:32.596 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:35:32 smithi007 ceph-mon[30983]: from='client.15156 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:35:32.597 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":299,"stamp":"2024-09-21T06:35:31.151129+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658896,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":435,"num_read_kb":319,"num_write":287,"num_write_kb":2267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":2951840,"num_keys_recovered":11,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":232,"ondisk_log_size":232,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":367936,"kb_used_data":10332,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124573888,"statfs":{"total":1151940427776,"available":1151563661312,"internally_reserved":0,"allocated":10579968,"data_stored":6975516,"data_compressed":177384,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":19143,"internal_metadata":365933881},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":35,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003442"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.225546+0000","last_change":"2024-09-21T06:34:23.958146+0000","last_active":"2024-09-21T06:34:44.225546+0000","last_peered":"2024-09-21T06:34:44.225546+0000","last_clean":"2024-09-21T06:34:44.225546+0000","last_became_active":"2024-09-21T06:34:23.957580+0000","last_became_peered":"2024-09-21T06:34:23.957580+0000","last_unstale":"2024-09-21T06:34:44.225546+0000","last_undegraded":"2024-09-21T06:34:44.225546+0000","last_fullsized":"2024-09-21T06:34:44.225546+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:33:05.975310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265758+0000","last_change":"2024-09-21T06:34:23.948439+0000","last_active":"2024-09-21T06:34:44.265758+0000","last_peered":"2024-09-21T06:34:44.265758+0000","last_clean":"2024-09-21T06:34:44.265758+0000","last_became_active":"2024-09-21T06:34:23.947511+0000","last_became_peered":"2024-09-21T06:34:23.947511+0000","last_unstale":"2024-09-21T06:34:44.265758+0000","last_undegraded":"2024-09-21T06:34:44.265758+0000","last_fullsized":"2024-09-21T06:34:44.265758+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:13:53.589979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.264949+0000","last_change":"2024-09-21T06:34:23.950752+0000","last_active":"2024-09-21T06:34:44.264949+0000","last_peered":"2024-09-21T06:34:44.264949+0000","last_clean":"2024-09-21T06:34:44.264949+0000","last_became_active":"2024-09-21T06:34:23.950373+0000","last_became_peered":"2024-09-21T06:34:23.950373+0000","last_unstale":"2024-09-21T06:34:44.264949+0000","last_undegraded":"2024-09-21T06:34:44.264949+0000","last_fullsized":"2024-09-21T06:34:44.264949+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:01:29.183426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.267740+0000","last_change":"2024-09-21T06:34:44.267265+0000","last_active":"2024-09-21T06:34:44.267740+0000","last_peered":"2024-09-21T06:34:44.267740+0000","last_clean":"2024-09-21T06:34:44.267740+0000","last_became_active":"2024-09-21T06:34:44.266829+0000","last_became_peered":"2024-09-21T06:34:44.266829+0000","last_unstale":"2024-09-21T06:34:44.267740+0000","last_undegraded":"2024-09-21T06:34:44.267740+0000","last_fullsized":"2024-09-21T06:34:44.267740+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:47:57.873167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.229953+0000","last_change":"2024-09-21T06:34:23.947578+0000","last_active":"2024-09-21T06:34:44.229953+0000","last_peered":"2024-09-21T06:34:44.229953+0000","last_clean":"2024-09-21T06:34:44.229953+0000","last_became_active":"2024-09-21T06:34:23.947201+0000","last_became_peered":"2024-09-21T06:34:23.947201+0000","last_unstale":"2024-09-21T06:34:44.229953+0000","last_undegraded":"2024-09-21T06:34:44.229953+0000","last_fullsized":"2024-09-21T06:34:44.229953+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:48:32.279999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.227142+0000","last_change":"2024-09-21T06:34:23.946191+0000","last_active":"2024-09-21T06:34:44.227142+0000","last_peered":"2024-09-21T06:34:44.227142+0000","last_clean":"2024-09-21T06:34:44.227142+0000","last_became_active":"2024-09-21T06:34:23.945817+0000","last_became_peered":"2024-09-21T06:34:23.945817+0000","last_unstale":"2024-09-21T06:34:44.227142+0000","last_undegraded":"2024-09-21T06:34:44.227142+0000","last_fullsized":"2024-09-21T06:34:44.227142+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:29.443444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265435+0000","last_change":"2024-09-21T06:34:23.943433+0000","last_active":"2024-09-21T06:34:44.265435+0000","last_peered":"2024-09-21T06:34:44.265435+0000","last_clean":"2024-09-21T06:34:44.265435+0000","last_became_active":"2024-09-21T06:34:23.943001+0000","last_became_peered":"2024-09-21T06:34:23.943001+0000","last_unstale":"2024-09-21T06:34:44.265435+0000","last_undegraded":"2024-09-21T06:34:44.265435+0000","last_fullsized":"2024-09-21T06:34:44.265435+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:05:10.695083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.223932+0000","last_change":"2024-09-21T06:34:23.954397+0000","last_active":"2024-09-21T06:34:44.223932+0000","last_peered":"2024-09-21T06:34:44.223932+0000","last_clean":"2024-09-21T06:34:44.223932+0000","last_became_active":"2024-09-21T06:34:23.954008+0000","last_became_peered":"2024-09-21T06:34:23.954008+0000","last_unstale":"2024-09-21T06:34:44.223932+0000","last_undegraded":"2024-09-21T06:34:44.223932+0000","last_fullsized":"2024-09-21T06:34:44.223932+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:10:03.764400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.266422+0000","last_change":"2024-09-21T06:34:23.953371+0000","last_active":"2024-09-21T06:34:44.266422+0000","last_peered":"2024-09-21T06:34:44.266422+0000","last_clean":"2024-09-21T06:34:44.266422+0000","last_became_active":"2024-09-21T06:34:23.952864+0000","last_became_peered":"2024-09-21T06:34:23.952864+0000","last_unstale":"2024-09-21T06:34:44.266422+0000","last_undegraded":"2024-09-21T06:34:44.266422+0000","last_fullsized":"2024-09-21T06:34:44.266422+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:44:23.691372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.267477+0000","last_change":"2024-09-21T06:34:44.267366+0000","last_active":"2024-09-21T06:34:44.267477+0000","last_peered":"2024-09-21T06:34:44.267477+0000","last_clean":"2024-09-21T06:34:44.267477+0000","last_became_active":"2024-09-21T06:34:44.266937+0000","last_became_peered":"2024-09-21T06:34:44.266937+0000","last_unstale":"2024-09-21T06:34:44.267477+0000","last_undegraded":"2024-09-21T06:34:44.267477+0000","last_fullsized":"2024-09-21T06:34:44.267477+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:40:00.904219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.266545+0000","last_change":"2024-09-21T06:34:23.958191+0000","last_active":"2024-09-21T06:34:44.266545+0000","last_peered":"2024-09-21T06:34:44.266545+0000","last_clean":"2024-09-21T06:34:44.266545+0000","last_became_active":"2024-09-21T06:34:23.957836+0000","last_became_peered":"2024-09-21T06:34:23.957836+0000","last_unstale":"2024-09-21T06:34:44.266545+0000","last_undegraded":"2024-09-21T06:34:44.266545+0000","last_fullsized":"2024-09-21T06:34:44.266545+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:31:10.201245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.225421+0000","last_change":"2024-09-21T06:34:23.947256+0000","last_active":"2024-09-21T06:34:44.225421+0000","last_peered":"2024-09-21T06:34:44.225421+0000","last_clean":"2024-09-21T06:34:44.225421+0000","last_became_active":"2024-09-21T06:34:23.946029+0000","last_became_peered":"2024-09-21T06:34:23.946029+0000","last_unstale":"2024-09-21T06:34:44.225421+0000","last_undegraded":"2024-09-21T06:34:44.225421+0000","last_fullsized":"2024-09-21T06:34:44.225421+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:47:19.850700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265129+0000","last_change":"2024-09-21T06:34:23.940661+0000","last_active":"2024-09-21T06:34:44.265129+0000","last_peered":"2024-09-21T06:34:44.265129+0000","last_clean":"2024-09-21T06:34:44.265129+0000","last_became_active":"2024-09-21T06:34:23.940306+0000","last_became_peered":"2024-09-21T06:34:23.940306+0000","last_unstale":"2024-09-21T06:34:44.265129+0000","last_undegraded":"2024-09-21T06:34:44.265129+0000","last_fullsized":"2024-09-21T06:34:44.265129+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:19.062435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265265+0000","last_change":"2024-09-21T06:34:23.941906+0000","last_active":"2024-09-21T06:34:44.265265+0000","last_peered":"2024-09-21T06:34:44.265265+0000","last_clean":"2024-09-21T06:34:44.265265+0000","last_became_active":"2024-09-21T06:34:23.941522+0000","last_became_peered":"2024-09-21T06:34:23.941522+0000","last_unstale":"2024-09-21T06:34:44.265265+0000","last_undegraded":"2024-09-21T06:34:44.265265+0000","last_fullsized":"2024-09-21T06:34:44.265265+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:57:12.557051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.264948+0000","last_change":"2024-09-21T06:34:23.957181+0000","last_active":"2024-09-21T06:34:44.264948+0000","last_peered":"2024-09-21T06:34:44.264948+0000","last_clean":"2024-09-21T06:34:44.264948+0000","last_became_active":"2024-09-21T06:34:23.956269+0000","last_became_peered":"2024-09-21T06:34:23.956269+0000","last_unstale":"2024-09-21T06:34:44.264948+0000","last_undegraded":"2024-09-21T06:34:44.264948+0000","last_fullsized":"2024-09-21T06:34:44.264948+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:33:24.989570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265721+0000","last_change":"2024-09-21T06:34:23.951771+0000","last_active":"2024-09-21T06:34:44.265721+0000","last_peered":"2024-09-21T06:34:44.265721+0000","last_clean":"2024-09-21T06:34:44.265721+0000","last_became_active":"2024-09-21T06:34:23.951381+0000","last_became_peered":"2024-09-21T06:34:23.951381+0000","last_unstale":"2024-09-21T06:34:44.265721+0000","last_undegraded":"2024-09-21T06:34:44.265721+0000","last_fullsized":"2024-09-21T06:34:44.265721+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:26:16.049343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.225612+0000","last_change":"2024-09-21T06:34:23.959425+0000","last_active":"2024-09-21T06:34:44.225612+0000","last_peered":"2024-09-21T06:34:44.225612+0000","last_clean":"2024-09-21T06:34:44.225612+0000","last_became_active":"2024-09-21T06:34:23.959022+0000","last_became_peered":"2024-09-21T06:34:23.959022+0000","last_unstale":"2024-09-21T06:34:44.225612+0000","last_undegraded":"2024-09-21T06:34:44.225612+0000","last_fullsized":"2024-09-21T06:34:44.225612+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:19:45.203639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.226736+0000","last_change":"2024-09-21T06:34:23.950510+0000","last_active":"2024-09-21T06:34:44.226736+0000","last_peered":"2024-09-21T06:34:44.226736+0000","last_clean":"2024-09-21T06:34:44.226736+0000","last_became_active":"2024-09-21T06:34:23.950027+0000","last_became_peered":"2024-09-21T06:34:23.950027+0000","last_unstale":"2024-09-21T06:34:44.226736+0000","last_undegraded":"2024-09-21T06:34:44.226736+0000","last_fullsized":"2024-09-21T06:34:44.226736+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:22:23.093554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265658+0000","last_change":"2024-09-21T06:34:23.948824+0000","last_active":"2024-09-21T06:34:44.265658+0000","last_peered":"2024-09-21T06:34:44.265658+0000","last_clean":"2024-09-21T06:34:44.265658+0000","last_became_active":"2024-09-21T06:34:23.948441+0000","last_became_peered":"2024-09-21T06:34:23.948441+0000","last_unstale":"2024-09-21T06:34:44.265658+0000","last_undegraded":"2024-09-21T06:34:44.265658+0000","last_fullsized":"2024-09-21T06:34:44.265658+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:28.498876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.225240+0000","last_change":"2024-09-21T06:34:23.960278+0000","last_active":"2024-09-21T06:34:44.225240+0000","last_peered":"2024-09-21T06:34:44.225240+0000","last_clean":"2024-09-21T06:34:44.225240+0000","last_became_active":"2024-09-21T06:34:23.959737+0000","last_became_peered":"2024-09-21T06:34:23.959737+0000","last_unstale":"2024-09-21T06:34:44.225240+0000","last_undegraded":"2024-09-21T06:34:44.225240+0000","last_fullsized":"2024-09-21T06:34:44.225240+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:50.097954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265247+0000","last_change":"2024-09-21T06:34:23.942797+0000","last_active":"2024-09-21T06:34:44.265247+0000","last_peered":"2024-09-21T06:34:44.265247+0000","last_clean":"2024-09-21T06:34:44.265247+0000","last_became_active":"2024-09-21T06:34:23.942441+0000","last_became_peered":"2024-09-21T06:34:23.942441+0000","last_unstale":"2024-09-21T06:34:44.265247+0000","last_undegraded":"2024-09-21T06:34:44.265247+0000","last_fullsized":"2024-09-21T06:34:44.265247+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:57:30.552583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265998+0000","last_change":"2024-09-21T06:34:23.957433+0000","last_active":"2024-09-21T06:34:44.265998+0000","last_peered":"2024-09-21T06:34:44.265998+0000","last_clean":"2024-09-21T06:34:44.265998+0000","last_became_active":"2024-09-21T06:34:23.957035+0000","last_became_peered":"2024-09-21T06:34:23.957035+0000","last_unstale":"2024-09-21T06:34:44.265998+0000","last_undegraded":"2024-09-21T06:34:44.265998+0000","last_fullsized":"2024-09-21T06:34:44.265998+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:40:18.418705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.224015+0000","last_change":"2024-09-21T06:34:23.950308+0000","last_active":"2024-09-21T06:34:44.224015+0000","last_peered":"2024-09-21T06:34:44.224015+0000","last_clean":"2024-09-21T06:34:44.224015+0000","last_became_active":"2024-09-21T06:34:23.948417+0000","last_became_peered":"2024-09-21T06:34:23.948417+0000","last_unstale":"2024-09-21T06:34:44.224015+0000","last_undegraded":"2024-09-21T06:34:44.224015+0000","last_fullsized":"2024-09-21T06:34:44.224015+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:47.233504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.226437+0000","last_change":"2024-09-21T06:34:23.949369+0000","last_active":"2024-09-21T06:34:44.226437+0000","last_peered":"2024-09-21T06:34:44.226437+0000","last_clean":"2024-09-21T06:34:44.226437+0000","last_became_active":"2024-09-21T06:34:23.948713+0000","last_became_peered":"2024-09-21T06:34:23.948713+0000","last_unstale":"2024-09-21T06:34:44.226437+0000","last_undegraded":"2024-09-21T06:34:44.226437+0000","last_fullsized":"2024-09-21T06:34:44.226437+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:57:06.915379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.224467+0000","last_change":"2024-09-21T06:34:23.959315+0000","last_active":"2024-09-21T06:34:44.224467+0000","last_peered":"2024-09-21T06:34:44.224467+0000","last_clean":"2024-09-21T06:34:44.224467+0000","last_became_active":"2024-09-21T06:34:23.958904+0000","last_became_peered":"2024-09-21T06:34:23.958904+0000","last_unstale":"2024-09-21T06:34:44.224467+0000","last_undegraded":"2024-09-21T06:34:44.224467+0000","last_fullsized":"2024-09-21T06:34:44.224467+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:31:35.486369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265718+0000","last_change":"2024-09-21T06:34:23.952074+0000","last_active":"2024-09-21T06:34:44.265718+0000","last_peered":"2024-09-21T06:34:44.265718+0000","last_clean":"2024-09-21T06:34:44.265718+0000","last_became_active":"2024-09-21T06:34:23.951692+0000","last_became_peered":"2024-09-21T06:34:23.951692+0000","last_unstale":"2024-09-21T06:34:44.265718+0000","last_undegraded":"2024-09-21T06:34:44.265718+0000","last_fullsized":"2024-09-21T06:34:44.265718+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:15:06.300781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.225420+0000","last_change":"2024-09-21T06:34:23.947296+0000","last_active":"2024-09-21T06:34:44.225420+0000","last_peered":"2024-09-21T06:34:44.225420+0000","last_clean":"2024-09-21T06:34:44.225420+0000","last_became_active":"2024-09-21T06:34:23.946392+0000","last_became_peered":"2024-09-21T06:34:23.946392+0000","last_unstale":"2024-09-21T06:34:44.225420+0000","last_undegraded":"2024-09-21T06:34:44.225420+0000","last_fullsized":"2024-09-21T06:34:44.225420+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:05:27.597890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265035+0000","last_change":"2024-09-21T06:34:23.953161+0000","last_active":"2024-09-21T06:34:44.265035+0000","last_peered":"2024-09-21T06:34:44.265035+0000","last_clean":"2024-09-21T06:34:44.265035+0000","last_became_active":"2024-09-21T06:34:23.952811+0000","last_became_peered":"2024-09-21T06:34:23.952811+0000","last_unstale":"2024-09-21T06:34:44.265035+0000","last_undegraded":"2024-09-21T06:34:44.265035+0000","last_fullsized":"2024-09-21T06:34:44.265035+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:04.431094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265586+0000","last_change":"2024-09-21T06:34:23.959880+0000","last_active":"2024-09-21T06:34:44.265586+0000","last_peered":"2024-09-21T06:34:44.265586+0000","last_clean":"2024-09-21T06:34:44.265586+0000","last_became_active":"2024-09-21T06:34:23.959573+0000","last_became_peered":"2024-09-21T06:34:23.959573+0000","last_unstale":"2024-09-21T06:34:44.265586+0000","last_undegraded":"2024-09-21T06:34:44.265586+0000","last_fullsized":"2024-09-21T06:34:44.265586+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:21.921956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265362+0000","last_change":"2024-09-21T06:34:23.947209+0000","last_active":"2024-09-21T06:34:44.265362+0000","last_peered":"2024-09-21T06:34:44.265362+0000","last_clean":"2024-09-21T06:34:44.265362+0000","last_became_active":"2024-09-21T06:34:23.946763+0000","last_became_peered":"2024-09-21T06:34:23.946763+0000","last_unstale":"2024-09-21T06:34:44.265362+0000","last_undegraded":"2024-09-21T06:34:44.265362+0000","last_fullsized":"2024-09-21T06:34:44.265362+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:04:54.050980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265396+0000","last_change":"2024-09-21T06:34:23.955064+0000","last_active":"2024-09-21T06:34:44.265396+0000","last_peered":"2024-09-21T06:34:44.265396+0000","last_clean":"2024-09-21T06:34:44.265396+0000","last_became_active":"2024-09-21T06:34:23.954622+0000","last_became_peered":"2024-09-21T06:34:23.954622+0000","last_unstale":"2024-09-21T06:34:44.265396+0000","last_undegraded":"2024-09-21T06:34:44.265396+0000","last_fullsized":"2024-09-21T06:34:44.265396+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:04:59.056398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.224979+0000","last_change":"2024-09-21T06:34:23.947015+0000","last_active":"2024-09-21T06:34:44.224979+0000","last_peered":"2024-09-21T06:34:44.224979+0000","last_clean":"2024-09-21T06:34:44.224979+0000","last_became_active":"2024-09-21T06:34:23.946569+0000","last_became_peered":"2024-09-21T06:34:23.946569+0000","last_unstale":"2024-09-21T06:34:44.224979+0000","last_undegraded":"2024-09-21T06:34:44.224979+0000","last_fullsized":"2024-09-21T06:34:44.224979+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:50:35.935533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.230155+0000","last_change":"2024-09-21T06:34:23.951126+0000","last_active":"2024-09-21T06:34:44.230155+0000","last_peered":"2024-09-21T06:34:44.230155+0000","last_clean":"2024-09-21T06:34:44.230155+0000","last_became_active":"2024-09-21T06:34:23.950739+0000","last_became_peered":"2024-09-21T06:34:23.950739+0000","last_unstale":"2024-09-21T06:34:44.230155+0000","last_undegraded":"2024-09-21T06:34:44.230155+0000","last_fullsized":"2024-09-21T06:34:44.230155+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:52:43.201135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'6","reported_seq":86,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:35:26.088727+0000","last_change":"2024-09-21T06:34:21.939584+0000","last_active":"2024-09-21T06:35:26.088727+0000","last_peered":"2024-09-21T06:35:26.088727+0000","last_clean":"2024-09-21T06:35:26.088727+0000","last_became_active":"2024-09-21T06:34:21.939233+0000","last_became_peered":"2024-09-21T06:34:21.939233+0000","last_unstale":"2024-09-21T06:35:26.088727+0000","last_undegraded":"2024-09-21T06:35:26.088727+0000","last_fullsized":"2024-09-21T06:35:26.088727+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:54.701803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":57,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.232102+0000","last_change":"2024-09-21T06:34:44.232010+0000","last_active":"2024-09-21T06:34:44.232102+0000","last_peered":"2024-09-21T06:34:44.232102+0000","last_clean":"2024-09-21T06:34:44.232102+0000","last_became_active":"2024-09-21T06:34:44.231590+0000","last_became_peered":"2024-09-21T06:34:44.231590+0000","last_unstale":"2024-09-21T06:34:44.232102+0000","last_undegraded":"2024-09-21T06:34:44.232102+0000","last_fullsized":"2024-09-21T06:34:44.232102+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:33:02.751794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.227410+0000","last_change":"2024-09-21T06:34:21.937418+0000","last_active":"2024-09-21T06:34:44.227410+0000","last_peered":"2024-09-21T06:34:44.227410+0000","last_clean":"2024-09-21T06:34:44.227410+0000","last_became_active":"2024-09-21T06:34:21.937048+0000","last_became_peered":"2024-09-21T06:34:21.937048+0000","last_unstale":"2024-09-21T06:34:44.227410+0000","last_undegraded":"2024-09-21T06:34:44.227410+0000","last_fullsized":"2024-09-21T06:34:44.227410+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:33:38.731444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.264973+0000","last_change":"2024-09-21T06:34:21.932970+0000","last_active":"2024-09-21T06:34:44.264973+0000","last_peered":"2024-09-21T06:34:44.264973+0000","last_clean":"2024-09-21T06:34:44.264973+0000","last_became_active":"2024-09-21T06:34:21.932616+0000","last_became_peered":"2024-09-21T06:34:21.932616+0000","last_unstale":"2024-09-21T06:34:44.264973+0000","last_undegraded":"2024-09-21T06:34:44.264973+0000","last_fullsized":"2024-09-21T06:34:44.264973+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:33:20.611023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.224042+0000","last_change":"2024-09-21T06:34:23.950798+0000","last_active":"2024-09-21T06:34:44.224042+0000","last_peered":"2024-09-21T06:34:44.224042+0000","last_clean":"2024-09-21T06:34:44.224042+0000","last_became_active":"2024-09-21T06:34:23.950475+0000","last_became_peered":"2024-09-21T06:34:23.950475+0000","last_unstale":"2024-09-21T06:34:44.224042+0000","last_undegraded":"2024-09-21T06:34:44.224042+0000","last_fullsized":"2024-09-21T06:34:44.224042+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:43:23.177775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.226659+0000","last_change":"2024-09-21T06:34:21.937860+0000","last_active":"2024-09-21T06:34:44.226659+0000","last_peered":"2024-09-21T06:34:44.226659+0000","last_clean":"2024-09-21T06:34:44.226659+0000","last_became_active":"2024-09-21T06:34:21.937476+0000","last_became_peered":"2024-09-21T06:34:21.937476+0000","last_unstale":"2024-09-21T06:34:44.226659+0000","last_undegraded":"2024-09-21T06:34:44.226659+0000","last_fullsized":"2024-09-21T06:34:44.226659+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:49:06.069197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.226096+0000","last_change":"2024-09-21T06:34:23.944559+0000","last_active":"2024-09-21T06:34:44.226096+0000","last_peered":"2024-09-21T06:34:44.226096+0000","last_clean":"2024-09-21T06:34:44.226096+0000","last_became_active":"2024-09-21T06:34:23.944166+0000","last_became_peered":"2024-09-21T06:34:23.944166+0000","last_unstale":"2024-09-21T06:34:44.226096+0000","last_undegraded":"2024-09-21T06:34:44.226096+0000","last_fullsized":"2024-09-21T06:34:44.226096+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:01:56.532854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"75'3","reported_seq":80,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:35:26.087911+0000","last_change":"2024-09-21T06:34:21.936531+0000","last_active":"2024-09-21T06:35:26.087911+0000","last_peered":"2024-09-21T06:35:26.087911+0000","last_clean":"2024-09-21T06:35:26.087911+0000","last_became_active":"2024-09-21T06:34:21.936087+0000","last_became_peered":"2024-09-21T06:34:21.936087+0000","last_unstale":"2024-09-21T06:35:26.087911+0000","last_undegraded":"2024-09-21T06:35:26.087911+0000","last_fullsized":"2024-09-21T06:35:26.087911+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:27:12.370722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.266303+0000","last_change":"2024-09-21T06:34:23.954894+0000","last_active":"2024-09-21T06:34:44.266303+0000","last_peered":"2024-09-21T06:34:44.266303+0000","last_clean":"2024-09-21T06:34:44.266303+0000","last_became_active":"2024-09-21T06:34:23.954186+0000","last_became_peered":"2024-09-21T06:34:23.954186+0000","last_unstale":"2024-09-21T06:34:44.266303+0000","last_undegraded":"2024-09-21T06:34:44.266303+0000","last_fullsized":"2024-09-21T06:34:44.266303+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:18:49.623338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265585+0000","last_change":"2024-09-21T06:34:21.934989+0000","last_active":"2024-09-21T06:34:44.265585+0000","last_peered":"2024-09-21T06:34:44.265585+0000","last_clean":"2024-09-21T06:34:44.265585+0000","last_became_active":"2024-09-21T06:34:21.934550+0000","last_became_peered":"2024-09-21T06:34:21.934550+0000","last_unstale":"2024-09-21T06:34:44.265585+0000","last_undegraded":"2024-09-21T06:34:44.265585+0000","last_fullsized":"2024-09-21T06:34:44.265585+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:59:17.849338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265984+0000","last_change":"2024-09-21T06:34:23.956190+0000","last_active":"2024-09-21T06:34:44.265984+0000","last_peered":"2024-09-21T06:34:44.265984+0000","last_clean":"2024-09-21T06:34:44.265984+0000","last_became_active":"2024-09-21T06:34:23.955815+0000","last_became_peered":"2024-09-21T06:34:23.955815+0000","last_unstale":"2024-09-21T06:34:44.265984+0000","last_undegraded":"2024-09-21T06:34:44.265984+0000","last_fullsized":"2024-09-21T06:34:44.265984+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:14:56.165350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'4","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.227080+0000","last_change":"2024-09-21T06:34:22.096480+0000","last_active":"2024-09-21T06:34:44.227080+0000","last_peered":"2024-09-21T06:34:44.227080+0000","last_clean":"2024-09-21T06:34:44.227080+0000","last_became_active":"2024-09-21T06:34:22.095921+0000","last_became_peered":"2024-09-21T06:34:22.095921+0000","last_unstale":"2024-09-21T06:34:44.227080+0000","last_undegraded":"2024-09-21T06:34:44.227080+0000","last_fullsized":"2024-09-21T06:34:44.227080+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:19:30.006811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265960+0000","last_change":"2024-09-21T06:34:23.961840+0000","last_active":"2024-09-21T06:34:44.265960+0000","last_peered":"2024-09-21T06:34:44.265960+0000","last_clean":"2024-09-21T06:34:44.265960+0000","last_became_active":"2024-09-21T06:34:23.961313+0000","last_became_peered":"2024-09-21T06:34:23.961313+0000","last_unstale":"2024-09-21T06:34:44.265960+0000","last_undegraded":"2024-09-21T06:34:44.265960+0000","last_fullsized":"2024-09-21T06:34:44.265960+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:29:04.308598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"77'28","reported_seq":167,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:35:27.089750+0000","last_change":"2024-09-21T06:34:21.937326+0000","last_active":"2024-09-21T06:35:27.089750+0000","last_peered":"2024-09-21T06:35:27.089750+0000","last_clean":"2024-09-21T06:35:27.089750+0000","last_became_active":"2024-09-21T06:34:21.936940+0000","last_became_peered":"2024-09-21T06:34:21.936940+0000","last_unstale":"2024-09-21T06:35:27.089750+0000","last_undegraded":"2024-09-21T06:35:27.089750+0000","last_fullsized":"2024-09-21T06:35:27.089750+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:47:12.988306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63902,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":116,"num_read_kb":120,"num_write":29,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.230328+0000","last_change":"2024-09-21T06:34:23.950167+0000","last_active":"2024-09-21T06:34:44.230328+0000","last_peered":"2024-09-21T06:34:44.230328+0000","last_clean":"2024-09-21T06:34:44.230328+0000","last_became_active":"2024-09-21T06:34:23.949697+0000","last_became_peered":"2024-09-21T06:34:23.949697+0000","last_unstale":"2024-09-21T06:34:44.230328+0000","last_undegraded":"2024-09-21T06:34:44.230328+0000","last_fullsized":"2024-09-21T06:34:44.230328+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:37:48.882644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'6","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265516+0000","last_change":"2024-09-21T06:34:21.937366+0000","last_active":"2024-09-21T06:34:44.265516+0000","last_peered":"2024-09-21T06:34:44.265516+0000","last_clean":"2024-09-21T06:34:44.265516+0000","last_became_active":"2024-09-21T06:34:21.936988+0000","last_became_peered":"2024-09-21T06:34:21.936988+0000","last_unstale":"2024-09-21T06:34:44.265516+0000","last_undegraded":"2024-09-21T06:34:44.265516+0000","last_fullsized":"2024-09-21T06:34:44.265516+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:48:06.318645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265352+0000","last_change":"2024-09-21T06:34:23.947523+0000","last_active":"2024-09-21T06:34:44.265352+0000","last_peered":"2024-09-21T06:34:44.265352+0000","last_clean":"2024-09-21T06:34:44.265352+0000","last_became_active":"2024-09-21T06:34:23.947150+0000","last_became_peered":"2024-09-21T06:34:23.947150+0000","last_unstale":"2024-09-21T06:34:44.265352+0000","last_undegraded":"2024-09-21T06:34:44.265352+0000","last_fullsized":"2024-09-21T06:34:44.265352+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:18:50.417153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.226854+0000","last_change":"2024-09-21T06:34:21.938631+0000","last_active":"2024-09-21T06:34:44.226854+0000","last_peered":"2024-09-21T06:34:44.226854+0000","last_clean":"2024-09-21T06:34:44.226854+0000","last_became_active":"2024-09-21T06:34:21.938242+0000","last_became_peered":"2024-09-21T06:34:21.938242+0000","last_unstale":"2024-09-21T06:34:44.226854+0000","last_undegraded":"2024-09-21T06:34:44.226854+0000","last_fullsized":"2024-09-21T06:34:44.226854+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:40:02.056812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265725+0000","last_change":"2024-09-21T06:34:23.945276+0000","last_active":"2024-09-21T06:34:44.265725+0000","last_peered":"2024-09-21T06:34:44.265725+0000","last_clean":"2024-09-21T06:34:44.265725+0000","last_became_active":"2024-09-21T06:34:23.944914+0000","last_became_peered":"2024-09-21T06:34:23.944914+0000","last_unstale":"2024-09-21T06:34:44.265725+0000","last_undegraded":"2024-09-21T06:34:44.265725+0000","last_fullsized":"2024-09-21T06:34:44.265725+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:15:23.650908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"75'4","reported_seq":84,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:35:26.087962+0000","last_change":"2024-09-21T06:34:21.937593+0000","last_active":"2024-09-21T06:35:26.087962+0000","last_peered":"2024-09-21T06:35:26.087962+0000","last_clean":"2024-09-21T06:35:26.087962+0000","last_became_active":"2024-09-21T06:34:21.936851+0000","last_became_peered":"2024-09-21T06:34:21.936851+0000","last_unstale":"2024-09-21T06:35:26.087962+0000","last_undegraded":"2024-09-21T06:35:26.087962+0000","last_fullsized":"2024-09-21T06:35:26.087962+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:25:36.161431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":58,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265345+0000","last_change":"2024-09-21T06:34:23.945573+0000","last_active":"2024-09-21T06:34:44.265345+0000","last_peered":"2024-09-21T06:34:44.265345+0000","last_clean":"2024-09-21T06:34:44.265345+0000","last_became_active":"2024-09-21T06:34:23.944410+0000","last_became_peered":"2024-09-21T06:34:23.944410+0000","last_unstale":"2024-09-21T06:34:44.265345+0000","last_undegraded":"2024-09-21T06:34:44.265345+0000","last_fullsized":"2024-09-21T06:34:44.265345+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:33:54.613524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'15","reported_seq":39,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.229900+0000","last_change":"2024-09-21T06:34:22.096539+0000","last_active":"2024-09-21T06:34:44.229900+0000","last_peered":"2024-09-21T06:34:44.229900+0000","last_clean":"2024-09-21T06:34:44.229900+0000","last_became_active":"2024-09-21T06:34:22.096013+0000","last_became_peered":"2024-09-21T06:34:22.096013+0000","last_unstale":"2024-09-21T06:34:44.229900+0000","last_undegraded":"2024-09-21T06:34:44.229900+0000","last_fullsized":"2024-09-21T06:34:44.229900+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:30:59.414325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.226688+0000","last_change":"2024-09-21T06:34:23.958381+0000","last_active":"2024-09-21T06:34:44.226688+0000","last_peered":"2024-09-21T06:34:44.226688+0000","last_clean":"2024-09-21T06:34:44.226688+0000","last_became_active":"2024-09-21T06:34:23.957965+0000","last_became_peered":"2024-09-21T06:34:23.957965+0000","last_unstale":"2024-09-21T06:34:44.226688+0000","last_undegraded":"2024-09-21T06:34:44.226688+0000","last_fullsized":"2024-09-21T06:34:44.226688+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:37:43.474777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'2","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.230733+0000","last_change":"2024-09-21T06:34:21.937612+0000","last_active":"2024-09-21T06:34:44.230733+0000","last_peered":"2024-09-21T06:34:44.230733+0000","last_clean":"2024-09-21T06:34:44.230733+0000","last_became_active":"2024-09-21T06:34:21.936859+0000","last_became_peered":"2024-09-21T06:34:21.936859+0000","last_unstale":"2024-09-21T06:34:44.230733+0000","last_undegraded":"2024-09-21T06:34:44.230733+0000","last_fullsized":"2024-09-21T06:34:44.230733+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:40.957217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.229139+0000","last_change":"2024-09-21T06:34:44.228991+0000","last_active":"2024-09-21T06:34:44.229139+0000","last_peered":"2024-09-21T06:34:44.229139+0000","last_clean":"2024-09-21T06:34:44.229139+0000","last_became_active":"2024-09-21T06:34:44.228428+0000","last_became_peered":"2024-09-21T06:34:44.228428+0000","last_unstale":"2024-09-21T06:34:44.229139+0000","last_undegraded":"2024-09-21T06:34:44.229139+0000","last_fullsized":"2024-09-21T06:34:44.229139+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:21.719532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265523+0000","last_change":"2024-09-21T06:34:21.933392+0000","last_active":"2024-09-21T06:34:44.265523+0000","last_peered":"2024-09-21T06:34:44.265523+0000","last_clean":"2024-09-21T06:34:44.265523+0000","last_became_active":"2024-09-21T06:34:21.932999+0000","last_became_peered":"2024-09-21T06:34:21.932999+0000","last_unstale":"2024-09-21T06:34:44.265523+0000","last_undegraded":"2024-09-21T06:34:44.265523+0000","last_fullsized":"2024-09-21T06:34:44.265523+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:05:20.631755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.266194+0000","last_change":"2024-09-21T06:34:23.944675+0000","last_active":"2024-09-21T06:34:44.266194+0000","last_peered":"2024-09-21T06:34:44.266194+0000","last_clean":"2024-09-21T06:34:44.266194+0000","last_became_active":"2024-09-21T06:34:23.944258+0000","last_became_peered":"2024-09-21T06:34:23.944258+0000","last_unstale":"2024-09-21T06:34:44.266194+0000","last_undegraded":"2024-09-21T06:34:44.266194+0000","last_fullsized":"2024-09-21T06:34:44.266194+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:26:40.661840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'1","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.227259+0000","last_change":"2024-09-21T06:34:21.941064+0000","last_active":"2024-09-21T06:34:44.227259+0000","last_peered":"2024-09-21T06:34:44.227259+0000","last_clean":"2024-09-21T06:34:44.227259+0000","last_became_active":"2024-09-21T06:34:21.940667+0000","last_became_peered":"2024-09-21T06:34:21.940667+0000","last_unstale":"2024-09-21T06:34:44.227259+0000","last_undegraded":"2024-09-21T06:34:44.227259+0000","last_fullsized":"2024-09-21T06:34:44.227259+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:20:14.721719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'1","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.266571+0000","last_change":"2024-09-21T06:34:23.943503+0000","last_active":"2024-09-21T06:34:44.266571+0000","last_peered":"2024-09-21T06:34:44.266571+0000","last_clean":"2024-09-21T06:34:44.266571+0000","last_became_active":"2024-09-21T06:34:23.943097+0000","last_became_peered":"2024-09-21T06:34:23.943097+0000","last_unstale":"2024-09-21T06:34:44.266571+0000","last_undegraded":"2024-09-21T06:34:44.266571+0000","last_fullsized":"2024-09-21T06:34:44.266571+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:08:04.641273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"75'3","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265879+0000","last_change":"2024-09-21T06:34:22.096274+0000","last_active":"2024-09-21T06:34:44.265879+0000","last_peered":"2024-09-21T06:34:44.265879+0000","last_clean":"2024-09-21T06:34:44.265879+0000","last_became_active":"2024-09-21T06:34:22.095861+0000","last_became_peered":"2024-09-21T06:34:22.095861+0000","last_unstale":"2024-09-21T06:34:44.265879+0000","last_undegraded":"2024-09-21T06:34:44.265879+0000","last_fullsized":"2024-09-21T06:34:44.265879+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:22:47.807488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.266601+0000","last_change":"2024-09-21T06:34:23.953503+0000","last_active":"2024-09-21T06:34:44.266601+0000","last_peered":"2024-09-21T06:34:44.266601+0000","last_clean":"2024-09-21T06:34:44.266601+0000","last_became_active":"2024-09-21T06:34:23.952880+0000","last_became_peered":"2024-09-21T06:34:23.952880+0000","last_unstale":"2024-09-21T06:34:44.266601+0000","last_undegraded":"2024-09-21T06:34:44.266601+0000","last_fullsized":"2024-09-21T06:34:44.266601+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:29:47.746678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":97,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265543+0000","last_change":"2024-09-21T06:33:09.908154+0000","last_active":"2024-09-21T06:34:44.265543+0000","last_peered":"2024-09-21T06:34:44.265543+0000","last_clean":"2024-09-21T06:34:44.265543+0000","last_became_active":"2024-09-21T06:33:09.902397+0000","last_became_peered":"2024-09-21T06:33:09.902397+0000","last_unstale":"2024-09-21T06:34:44.265543+0000","last_undegraded":"2024-09-21T06:34:44.265543+0000","last_fullsized":"2024-09-21T06:34:44.265543+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:29:42.295555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:29:42.295555+0000","last_clean_scrub_stamp":"2024-09-21T06:29:42.295555+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:15:17.111178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"75'3","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.225389+0000","last_change":"2024-09-21T06:34:21.932618+0000","last_active":"2024-09-21T06:34:44.225389+0000","last_peered":"2024-09-21T06:34:44.225389+0000","last_clean":"2024-09-21T06:34:44.225389+0000","last_became_active":"2024-09-21T06:34:21.932187+0000","last_became_peered":"2024-09-21T06:34:21.932187+0000","last_unstale":"2024-09-21T06:34:44.225389+0000","last_undegraded":"2024-09-21T06:34:44.225389+0000","last_fullsized":"2024-09-21T06:34:44.225389+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:19:06.780448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.224167+0000","last_change":"2024-09-21T06:34:23.953580+0000","last_active":"2024-09-21T06:34:44.224167+0000","last_peered":"2024-09-21T06:34:44.224167+0000","last_clean":"2024-09-21T06:34:44.224167+0000","last_became_active":"2024-09-21T06:34:23.952222+0000","last_became_peered":"2024-09-21T06:34:23.952222+0000","last_unstale":"2024-09-21T06:34:44.224167+0000","last_undegraded":"2024-09-21T06:34:44.224167+0000","last_fullsized":"2024-09-21T06:34:44.224167+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:19.759042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265531+0000","last_change":"2024-09-21T06:34:21.939178+0000","last_active":"2024-09-21T06:34:44.265531+0000","last_peered":"2024-09-21T06:34:44.265531+0000","last_clean":"2024-09-21T06:34:44.265531+0000","last_became_active":"2024-09-21T06:34:21.938755+0000","last_became_peered":"2024-09-21T06:34:21.938755+0000","last_unstale":"2024-09-21T06:34:44.265531+0000","last_undegraded":"2024-09-21T06:34:44.265531+0000","last_fullsized":"2024-09-21T06:34:44.265531+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:10.474432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.264822+0000","last_change":"2024-09-21T06:34:23.954196+0000","last_active":"2024-09-21T06:34:44.264822+0000","last_peered":"2024-09-21T06:34:44.264822+0000","last_clean":"2024-09-21T06:34:44.264822+0000","last_became_active":"2024-09-21T06:34:23.953843+0000","last_became_peered":"2024-09-21T06:34:23.953843+0000","last_unstale":"2024-09-21T06:34:44.264822+0000","last_undegraded":"2024-09-21T06:34:44.264822+0000","last_fullsized":"2024-09-21T06:34:44.264822+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:41:02.896704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"75'4","reported_seq":83,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:35:28.090898+0000","last_change":"2024-09-21T06:34:22.095920+0000","last_active":"2024-09-21T06:35:28.090898+0000","last_peered":"2024-09-21T06:35:28.090898+0000","last_clean":"2024-09-21T06:35:28.090898+0000","last_became_active":"2024-09-21T06:34:22.095376+0000","last_became_peered":"2024-09-21T06:34:22.095376+0000","last_unstale":"2024-09-21T06:35:28.090898+0000","last_undegraded":"2024-09-21T06:35:28.090898+0000","last_fullsized":"2024-09-21T06:35:28.090898+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:40:44.400566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":56,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.226479+0000","last_change":"2024-09-21T06:34:23.956541+0000","last_active":"2024-09-21T06:34:44.226479+0000","last_peered":"2024-09-21T06:34:44.226479+0000","last_clean":"2024-09-21T06:34:44.226479+0000","last_became_active":"2024-09-21T06:34:23.956150+0000","last_became_peered":"2024-09-21T06:34:23.956150+0000","last_unstale":"2024-09-21T06:34:44.226479+0000","last_undegraded":"2024-09-21T06:34:44.226479+0000","last_fullsized":"2024-09-21T06:34:44.226479+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:09:32.432391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.266674+0000","last_change":"2024-09-21T06:34:21.942244+0000","last_active":"2024-09-21T06:34:44.266674+0000","last_peered":"2024-09-21T06:34:44.266674+0000","last_clean":"2024-09-21T06:34:44.266674+0000","last_became_active":"2024-09-21T06:34:21.941761+0000","last_became_peered":"2024-09-21T06:34:21.941761+0000","last_unstale":"2024-09-21T06:34:44.266674+0000","last_undegraded":"2024-09-21T06:34:44.266674+0000","last_fullsized":"2024-09-21T06:34:44.266674+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:10.507103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.227647+0000","last_change":"2024-09-21T06:34:23.951250+0000","last_active":"2024-09-21T06:34:44.227647+0000","last_peered":"2024-09-21T06:34:44.227647+0000","last_clean":"2024-09-21T06:34:44.227647+0000","last_became_active":"2024-09-21T06:34:23.950015+0000","last_became_peered":"2024-09-21T06:34:23.950015+0000","last_unstale":"2024-09-21T06:34:44.227647+0000","last_undegraded":"2024-09-21T06:34:44.227647+0000","last_fullsized":"2024-09-21T06:34:44.227647+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:53:22.884049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.266799+0000","last_change":"2024-09-21T06:34:44.266717+0000","last_active":"2024-09-21T06:34:44.266799+0000","last_peered":"2024-09-21T06:34:44.266799+0000","last_clean":"2024-09-21T06:34:44.266799+0000","last_became_active":"2024-09-21T06:34:44.266256+0000","last_became_peered":"2024-09-21T06:34:44.266256+0000","last_unstale":"2024-09-21T06:34:44.266799+0000","last_undegraded":"2024-09-21T06:34:44.266799+0000","last_fullsized":"2024-09-21T06:34:44.266799+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:38:04.674592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'1","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.227589+0000","last_change":"2024-09-21T06:34:23.947823+0000","last_active":"2024-09-21T06:34:44.227589+0000","last_peered":"2024-09-21T06:34:44.227589+0000","last_clean":"2024-09-21T06:34:44.227589+0000","last_became_active":"2024-09-21T06:34:23.947362+0000","last_became_peered":"2024-09-21T06:34:23.947362+0000","last_unstale":"2024-09-21T06:34:44.227589+0000","last_undegraded":"2024-09-21T06:34:44.227589+0000","last_fullsized":"2024-09-21T06:34:44.227589+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:32:22.401819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"75'1","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.230506+0000","last_change":"2024-09-21T06:34:22.096537+0000","last_active":"2024-09-21T06:34:44.230506+0000","last_peered":"2024-09-21T06:34:44.230506+0000","last_clean":"2024-09-21T06:34:44.230506+0000","last_became_active":"2024-09-21T06:34:22.095875+0000","last_became_peered":"2024-09-21T06:34:22.095875+0000","last_unstale":"2024-09-21T06:34:44.230506+0000","last_undegraded":"2024-09-21T06:34:44.230506+0000","last_fullsized":"2024-09-21T06:34:44.230506+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:11:44.955531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265151+0000","last_change":"2024-09-21T06:34:23.938784+0000","last_active":"2024-09-21T06:34:44.265151+0000","last_peered":"2024-09-21T06:34:44.265151+0000","last_clean":"2024-09-21T06:34:44.265151+0000","last_became_active":"2024-09-21T06:34:23.938400+0000","last_became_peered":"2024-09-21T06:34:23.938400+0000","last_unstale":"2024-09-21T06:34:44.265151+0000","last_undegraded":"2024-09-21T06:34:44.265151+0000","last_fullsized":"2024-09-21T06:34:44.265151+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:00:13.210874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"77'10","reported_seq":46,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:48.958566+0000","last_change":"2024-09-21T06:34:44.235532+0000","last_active":"2024-09-21T06:34:48.958566+0000","last_peered":"2024-09-21T06:34:48.958566+0000","last_clean":"2024-09-21T06:34:48.958566+0000","last_became_active":"2024-09-21T06:34:44.230220+0000","last_became_peered":"2024-09-21T06:34:44.230220+0000","last_unstale":"2024-09-21T06:34:48.958566+0000","last_undegraded":"2024-09-21T06:34:48.958566+0000","last_fullsized":"2024-09-21T06:34:48.958566+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:07:23.398177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":11,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.224475+0000","last_change":"2024-09-21T06:34:23.953477+0000","last_active":"2024-09-21T06:34:44.224475+0000","last_peered":"2024-09-21T06:34:44.224475+0000","last_clean":"2024-09-21T06:34:44.224475+0000","last_became_active":"2024-09-21T06:34:23.951404+0000","last_became_peered":"2024-09-21T06:34:23.951404+0000","last_unstale":"2024-09-21T06:34:44.224475+0000","last_undegraded":"2024-09-21T06:34:44.224475+0000","last_fullsized":"2024-09-21T06:34:44.224475+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:13:17.126680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'4","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.225262+0000","last_change":"2024-09-21T06:34:22.031837+0000","last_active":"2024-09-21T06:34:44.225262+0000","last_peered":"2024-09-21T06:34:44.225262+0000","last_clean":"2024-09-21T06:34:44.225262+0000","last_became_active":"2024-09-21T06:34:22.031377+0000","last_became_peered":"2024-09-21T06:34:22.031377+0000","last_unstale":"2024-09-21T06:34:44.225262+0000","last_undegraded":"2024-09-21T06:34:44.225262+0000","last_fullsized":"2024-09-21T06:34:44.225262+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:14:32.536634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265835+0000","last_change":"2024-09-21T06:34:23.955321+0000","last_active":"2024-09-21T06:34:44.265835+0000","last_peered":"2024-09-21T06:34:44.265835+0000","last_clean":"2024-09-21T06:34:44.265835+0000","last_became_active":"2024-09-21T06:34:23.954906+0000","last_became_peered":"2024-09-21T06:34:23.954906+0000","last_unstale":"2024-09-21T06:34:44.265835+0000","last_undegraded":"2024-09-21T06:34:44.265835+0000","last_fullsized":"2024-09-21T06:34:44.265835+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:59:07.771268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265823+0000","last_change":"2024-09-21T06:34:22.096135+0000","last_active":"2024-09-21T06:34:44.265823+0000","last_peered":"2024-09-21T06:34:44.265823+0000","last_clean":"2024-09-21T06:34:44.265823+0000","last_became_active":"2024-09-21T06:34:22.095721+0000","last_became_peered":"2024-09-21T06:34:22.095721+0000","last_unstale":"2024-09-21T06:34:44.265823+0000","last_undegraded":"2024-09-21T06:34:44.265823+0000","last_fullsized":"2024-09-21T06:34:44.265823+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:28.994324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.229717+0000","last_change":"2024-09-21T06:34:23.951769+0000","last_active":"2024-09-21T06:34:44.229717+0000","last_peered":"2024-09-21T06:34:44.229717+0000","last_clean":"2024-09-21T06:34:44.229717+0000","last_became_active":"2024-09-21T06:34:23.951377+0000","last_became_peered":"2024-09-21T06:34:23.951377+0000","last_unstale":"2024-09-21T06:34:44.229717+0000","last_undegraded":"2024-09-21T06:34:44.229717+0000","last_fullsized":"2024-09-21T06:34:44.229717+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:49:44.291714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.224147+0000","last_change":"2024-09-21T06:34:21.933909+0000","last_active":"2024-09-21T06:34:44.224147+0000","last_peered":"2024-09-21T06:34:44.224147+0000","last_clean":"2024-09-21T06:34:44.224147+0000","last_became_active":"2024-09-21T06:34:21.933524+0000","last_became_peered":"2024-09-21T06:34:21.933524+0000","last_unstale":"2024-09-21T06:34:44.224147+0000","last_undegraded":"2024-09-21T06:34:44.224147+0000","last_fullsized":"2024-09-21T06:34:44.224147+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:58.110444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.225073+0000","last_change":"2024-09-21T06:34:23.948586+0000","last_active":"2024-09-21T06:34:44.225073+0000","last_peered":"2024-09-21T06:34:44.225073+0000","last_clean":"2024-09-21T06:34:44.225073+0000","last_became_active":"2024-09-21T06:34:23.948225+0000","last_became_peered":"2024-09-21T06:34:23.948225+0000","last_unstale":"2024-09-21T06:34:44.225073+0000","last_undegraded":"2024-09-21T06:34:44.225073+0000","last_fullsized":"2024-09-21T06:34:44.225073+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:28:24.272712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265358+0000","last_change":"2024-09-21T06:34:21.935617+0000","last_active":"2024-09-21T06:34:44.265358+0000","last_peered":"2024-09-21T06:34:44.265358+0000","last_clean":"2024-09-21T06:34:44.265358+0000","last_became_active":"2024-09-21T06:34:21.934601+0000","last_became_peered":"2024-09-21T06:34:21.934601+0000","last_unstale":"2024-09-21T06:34:44.265358+0000","last_undegraded":"2024-09-21T06:34:44.265358+0000","last_fullsized":"2024-09-21T06:34:44.265358+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:30.836070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.224206+0000","last_change":"2024-09-21T06:34:23.947661+0000","last_active":"2024-09-21T06:34:44.224206+0000","last_peered":"2024-09-21T06:34:44.224206+0000","last_clean":"2024-09-21T06:34:44.224206+0000","last_became_active":"2024-09-21T06:34:23.947307+0000","last_became_peered":"2024-09-21T06:34:23.947307+0000","last_unstale":"2024-09-21T06:34:44.224206+0000","last_undegraded":"2024-09-21T06:34:44.224206+0000","last_fullsized":"2024-09-21T06:34:44.224206+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:08.045291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'4","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.230116+0000","last_change":"2024-09-21T06:34:21.942749+0000","last_active":"2024-09-21T06:34:44.230116+0000","last_peered":"2024-09-21T06:34:44.230116+0000","last_clean":"2024-09-21T06:34:44.230116+0000","last_became_active":"2024-09-21T06:34:21.942283+0000","last_became_peered":"2024-09-21T06:34:21.942283+0000","last_unstale":"2024-09-21T06:34:44.230116+0000","last_undegraded":"2024-09-21T06:34:44.230116+0000","last_fullsized":"2024-09-21T06:34:44.230116+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:47.477956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.266544+0000","last_change":"2024-09-21T06:34:23.957389+0000","last_active":"2024-09-21T06:34:44.266544+0000","last_peered":"2024-09-21T06:34:44.266544+0000","last_clean":"2024-09-21T06:34:44.266544+0000","last_became_active":"2024-09-21T06:34:23.957032+0000","last_became_peered":"2024-09-21T06:34:23.957032+0000","last_unstale":"2024-09-21T06:34:44.266544+0000","last_undegraded":"2024-09-21T06:34:44.266544+0000","last_fullsized":"2024-09-21T06:34:44.266544+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:00:53.932062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.227302+0000","last_change":"2024-09-21T06:34:23.957304+0000","last_active":"2024-09-21T06:34:44.227302+0000","last_peered":"2024-09-21T06:34:44.227302+0000","last_clean":"2024-09-21T06:34:44.227302+0000","last_became_active":"2024-09-21T06:34:23.956931+0000","last_became_peered":"2024-09-21T06:34:23.956931+0000","last_unstale":"2024-09-21T06:34:44.227302+0000","last_undegraded":"2024-09-21T06:34:44.227302+0000","last_fullsized":"2024-09-21T06:34:44.227302+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:14:12.240686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.230138+0000","last_change":"2024-09-21T06:34:21.937150+0000","last_active":"2024-09-21T06:34:44.230138+0000","last_peered":"2024-09-21T06:34:44.230138+0000","last_clean":"2024-09-21T06:34:44.230138+0000","last_became_active":"2024-09-21T06:34:21.936037+0000","last_became_peered":"2024-09-21T06:34:21.936037+0000","last_unstale":"2024-09-21T06:34:44.230138+0000","last_undegraded":"2024-09-21T06:34:44.230138+0000","last_fullsized":"2024-09-21T06:34:44.230138+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:24:44.821346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265815+0000","last_change":"2024-09-21T06:34:23.955585+0000","last_active":"2024-09-21T06:34:44.265815+0000","last_peered":"2024-09-21T06:34:44.265815+0000","last_clean":"2024-09-21T06:34:44.265815+0000","last_became_active":"2024-09-21T06:34:23.955225+0000","last_became_peered":"2024-09-21T06:34:23.955225+0000","last_unstale":"2024-09-21T06:34:44.265815+0000","last_undegraded":"2024-09-21T06:34:44.265815+0000","last_fullsized":"2024-09-21T06:34:44.265815+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:07:56.735854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'4","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.230684+0000","last_change":"2024-09-21T06:34:21.941804+0000","last_active":"2024-09-21T06:34:44.230684+0000","last_peered":"2024-09-21T06:34:44.230684+0000","last_clean":"2024-09-21T06:34:44.230684+0000","last_became_active":"2024-09-21T06:34:21.941387+0000","last_became_peered":"2024-09-21T06:34:21.941387+0000","last_unstale":"2024-09-21T06:34:44.230684+0000","last_undegraded":"2024-09-21T06:34:44.230684+0000","last_fullsized":"2024-09-21T06:34:44.230684+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:34:51.217549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265988+0000","last_change":"2024-09-21T06:34:23.957429+0000","last_active":"2024-09-21T06:34:44.265988+0000","last_peered":"2024-09-21T06:34:44.265988+0000","last_clean":"2024-09-21T06:34:44.265988+0000","last_became_active":"2024-09-21T06:34:23.956471+0000","last_became_peered":"2024-09-21T06:34:23.956471+0000","last_unstale":"2024-09-21T06:34:44.265988+0000","last_undegraded":"2024-09-21T06:34:44.265988+0000","last_fullsized":"2024-09-21T06:34:44.265988+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:46:26.770549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.224539+0000","last_change":"2024-09-21T06:34:22.096267+0000","last_active":"2024-09-21T06:34:44.224539+0000","last_peered":"2024-09-21T06:34:44.224539+0000","last_clean":"2024-09-21T06:34:44.224539+0000","last_became_active":"2024-09-21T06:34:22.095799+0000","last_became_peered":"2024-09-21T06:34:22.095799+0000","last_unstale":"2024-09-21T06:34:44.224539+0000","last_undegraded":"2024-09-21T06:34:44.224539+0000","last_fullsized":"2024-09-21T06:34:44.224539+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:29:00.075016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.224392+0000","last_change":"2024-09-21T06:34:23.952294+0000","last_active":"2024-09-21T06:34:44.224392+0000","last_peered":"2024-09-21T06:34:44.224392+0000","last_clean":"2024-09-21T06:34:44.224392+0000","last_became_active":"2024-09-21T06:34:23.951919+0000","last_became_peered":"2024-09-21T06:34:23.951919+0000","last_unstale":"2024-09-21T06:34:44.224392+0000","last_undegraded":"2024-09-21T06:34:44.224392+0000","last_fullsized":"2024-09-21T06:34:44.224392+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:30:28.039754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'9","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.226566+0000","last_change":"2024-09-21T06:34:21.934818+0000","last_active":"2024-09-21T06:34:44.226566+0000","last_peered":"2024-09-21T06:34:44.226566+0000","last_clean":"2024-09-21T06:34:44.226566+0000","last_became_active":"2024-09-21T06:34:21.934415+0000","last_became_peered":"2024-09-21T06:34:21.934415+0000","last_unstale":"2024-09-21T06:34:44.226566+0000","last_undegraded":"2024-09-21T06:34:44.226566+0000","last_fullsized":"2024-09-21T06:34:44.226566+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:25:48.460699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68294,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":354,"num_read_kb":250,"num_write":162,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":11,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":204882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":138,"ondisk_log_size":138,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282715,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743451,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27840,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717312,"statfs":{"total":95995035648,"available":95966527488,"internally_reserved":0,"allocated":835584,"data_stored":417151,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939678,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":991232,"data_stored":1072925,"data_compressed":41743,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103204,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27856,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717296,"statfs":{"total":95995035648,"available":95966511104,"internally_reserved":0,"allocated":851968,"data_stored":417387,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299434,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32024,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713128,"statfs":{"total":95995035648,"available":95962243072,"internally_reserved":0,"allocated":851968,"data_stored":417307,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462959,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":901120,"data_stored":1009628,"data_compressed":41743,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626484,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36172,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708980,"statfs":{"total":95995035648,"available":95957995520,"internally_reserved":0,"allocated":839680,"data_stored":416776,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822713,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":913408,"data_stored":1008921,"data_compressed":41743,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986239,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36168,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708984,"statfs":{"total":95995035648,"available":95957999616,"internally_reserved":0,"allocated":843776,"data_stored":417604,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182467,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36180,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708972,"statfs":{"total":95995035648,"available":95957987328,"internally_reserved":0,"allocated":856064,"data_stored":417087,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378697,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32092,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713060,"statfs":{"total":95995035648,"available":95962173440,"internally_reserved":0,"allocated":929792,"data_stored":482212,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542222,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":480471,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705746,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27872,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717280,"statfs":{"total":95995035648,"available":95966494720,"internally_reserved":0,"allocated":860160,"data_stored":418047,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34325,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34325,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34325,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":63902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":65643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":65871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T06:35:32.601 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-21T06:35:32.602 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-21T06:35:32.602 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-21T06:35:32.602 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph health --format=json 2024-09-21T06:35:32.860 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:32.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:35:32 smithi018 ceph-mon[34477]: pgmap v299: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:35:32.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:35:32 smithi018 ceph-mon[34477]: from='client.15156 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:35:33.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:35:32 smithi144 ceph-mon[34653]: pgmap v299: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:35:33.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:35:32 smithi144 ceph-mon[34653]: from='client.15156 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:35:33.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:33.343+0000 7f2007fc5640 1 -- 172.21.15.7:0/1125059899 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20001101a0 msgr2=0x7f20001125c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:33.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:33.343+0000 7f2007fc5640 1 --2- 172.21.15.7:0/1125059899 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20001101a0 0x7f20001125c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f1ff8009ca0 tx=0x7f1ff802a950 comp rx=0 tx=0).stop 2024-09-21T06:35:33.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:33.343+0000 7f2007fc5640 1 -- 172.21.15.7:0/1125059899 shutdown_connections 2024-09-21T06:35:33.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:33.343+0000 7f2007fc5640 1 --2- 172.21.15.7:0/1125059899 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20001101a0 0x7f20001125c0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:33.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:33.343+0000 7f2007fc5640 1 --2- 172.21.15.7:0/1125059899 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2000102f40 0x7f200010fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:33.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:33.343+0000 7f2007fc5640 1 --2- 172.21.15.7:0/1125059899 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f20001025f0 0x7f2000102a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:33.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:33.343+0000 7f2007fc5640 1 -- 172.21.15.7:0/1125059899 >> 172.21.15.7:0/1125059899 conn(0x7f2000079740 msgr2=0x7f2000079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:33.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:33.344+0000 7f2007fc5640 1 -- 172.21.15.7:0/1125059899 shutdown_connections 2024-09-21T06:35:33.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:33.344+0000 7f2007fc5640 1 -- 172.21.15.7:0/1125059899 wait complete. 2024-09-21T06:35:33.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:33.344+0000 7f2007fc5640 1 Processor -- start 2024-09-21T06:35:33.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:33.344+0000 7f2007fc5640 1 -- start start 2024-09-21T06:35:33.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:33.345+0000 7f2007fc5640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20001025f0 0x7f200019c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:33.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:33.345+0000 7f2007fc5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2000102f40 0x7f200019cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:33.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:33.345+0000 7f2007fc5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20001101a0 0x7f20001a1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:33.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:33.345+0000 7f2007fc5640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2000115c90 con 0x7f20001101a0 2024-09-21T06:35:33.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:33.345+0000 7f2007fc5640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2000115b10 con 0x7f2000102f40 2024-09-21T06:35:33.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:33.345+0000 7f2007fc5640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2000115e10 con 0x7f20001025f0 2024-09-21T06:35:33.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:33.345+0000 7f2006562640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20001101a0 0x7f20001a1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:33.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:33.345+0000 7f2006562640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20001101a0 0x7f20001a1e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56044/0 (socket says 172.21.15.7:56044) 2024-09-21T06:35:33.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:33.345+0000 7f2006562640 1 -- 172.21.15.7:0/3639082696 learned_addr learned my addr 172.21.15.7:0/3639082696 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:35:33.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:33.345+0000 7f2005560640 1 --2- 172.21.15.7:0/3639082696 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2000102f40 0x7f200019cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:33.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:33.345+0000 7f2005d61640 1 --2- 172.21.15.7:0/3639082696 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20001025f0 0x7f200019c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:33.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:33.345+0000 7f2006562640 1 -- 172.21.15.7:0/3639082696 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20001025f0 msgr2=0x7f200019c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:33.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:33.345+0000 7f2006562640 1 --2- 172.21.15.7:0/3639082696 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20001025f0 0x7f200019c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:33.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:33.345+0000 7f2006562640 1 -- 172.21.15.7:0/3639082696 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2000102f40 msgr2=0x7f200019cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:33.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:33.345+0000 7f2006562640 1 --2- 172.21.15.7:0/3639082696 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2000102f40 0x7f200019cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:33.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:33.345+0000 7f2006562640 1 -- 172.21.15.7:0/3639082696 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20001a2570 con 0x7f20001101a0 2024-09-21T06:35:33.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:33.345+0000 7f2006562640 1 --2- 172.21.15.7:0/3639082696 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20001101a0 0x7f20001a1e40 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f1ff8004af0 tx=0x7f1ff802f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:33.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:33.346+0000 7f1ff2ffd640 1 -- 172.21.15.7:0/3639082696 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ff8034040 con 0x7f20001101a0 2024-09-21T06:35:33.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:33.346+0000 7f1ff2ffd640 1 -- 172.21.15.7:0/3639082696 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1ff802fe80 con 0x7f20001101a0 2024-09-21T06:35:33.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:33.346+0000 7f2007fc5640 1 -- 172.21.15.7:0/3639082696 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20001a2800 con 0x7f20001101a0 2024-09-21T06:35:33.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:33.346+0000 7f1ff2ffd640 1 -- 172.21.15.7:0/3639082696 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ff80046a0 con 0x7f20001101a0 2024-09-21T06:35:33.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:33.346+0000 7f2007fc5640 1 -- 172.21.15.7:0/3639082696 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20001a8fc0 con 0x7f20001101a0 2024-09-21T06:35:33.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:33.347+0000 7f2007fc5640 1 -- 172.21.15.7:0/3639082696 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f200006c240 con 0x7f20001101a0 2024-09-21T06:35:33.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:33.348+0000 7f1ff2ffd640 1 -- 172.21.15.7:0/3639082696 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154579+0+0 (secure 0 0 0) 0x7f1ff8037020 con 0x7f20001101a0 2024-09-21T06:35:33.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:33.349+0000 7f1ff2ffd640 1 --2- 172.21.15.7:0/3639082696 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f1fec0b65f0 0x7f1fec0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:33.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:33.349+0000 7f2005d61640 1 --2- 172.21.15.7:0/3639082696 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f1fec0b65f0 0x7f1fec0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:33.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:33.349+0000 7f1ff2ffd640 1 -- 172.21.15.7:0/3639082696 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f1ff8108420 con 0x7f20001101a0 2024-09-21T06:35:33.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:33.350+0000 7f2005d61640 1 --2- 172.21.15.7:0/3639082696 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f1fec0b65f0 0x7f1fec0b8b00 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc009aa0 tx=0x7f1ffc005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:33.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:33.353+0000 7f1ff2ffd640 1 -- 172.21.15.7:0/3639082696 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1ff80ceb20 con 0x7f20001101a0 2024-09-21T06:35:33.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:33.580+0000 7f2007fc5640 1 -- 172.21.15.7:0/3639082696 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f2000102a00 con 0x7f20001101a0 2024-09-21T06:35:33.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:33.580+0000 7f1ff2ffd640 1 -- 172.21.15.7:0/3639082696 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f1ff80d2f00 con 0x7f20001101a0 2024-09-21T06:35:33.582 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:35:33.582 INFO:teuthology.orchestra.run.smithi007.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-21T06:35:33.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:33.583+0000 7f2007fc5640 1 -- 172.21.15.7:0/3639082696 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f1fec0b65f0 msgr2=0x7f1fec0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:33.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:33.583+0000 7f2007fc5640 1 --2- 172.21.15.7:0/3639082696 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f1fec0b65f0 0x7f1fec0b8b00 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc009aa0 tx=0x7f1ffc005f90 comp rx=0 tx=0).stop 2024-09-21T06:35:33.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:33.583+0000 7f2007fc5640 1 -- 172.21.15.7:0/3639082696 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20001101a0 msgr2=0x7f20001a1e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:33.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:33.583+0000 7f2007fc5640 1 --2- 172.21.15.7:0/3639082696 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20001101a0 0x7f20001a1e40 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f1ff8004af0 tx=0x7f1ff802f5d0 comp rx=0 tx=0).stop 2024-09-21T06:35:33.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:33.583+0000 7f2007fc5640 1 -- 172.21.15.7:0/3639082696 shutdown_connections 2024-09-21T06:35:33.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:33.583+0000 7f2007fc5640 1 --2- 172.21.15.7:0/3639082696 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f1fec0b65f0 0x7f1fec0b8b00 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:33.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:33.583+0000 7f2007fc5640 1 --2- 172.21.15.7:0/3639082696 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f20001101a0 0x7f20001a1e40 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:33.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:33.583+0000 7f2007fc5640 1 --2- 172.21.15.7:0/3639082696 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2000102f40 0x7f200019cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:33.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:33.583+0000 7f2007fc5640 1 --2- 172.21.15.7:0/3639082696 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f20001025f0 0x7f200019c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:33.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:33.583+0000 7f2007fc5640 1 -- 172.21.15.7:0/3639082696 >> 172.21.15.7:0/3639082696 conn(0x7f2000079740 msgr2=0x7f2000109d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:33.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:33.583+0000 7f2007fc5640 1 -- 172.21.15.7:0/3639082696 shutdown_connections 2024-09-21T06:35:33.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:33.583+0000 7f2007fc5640 1 -- 172.21.15.7:0/3639082696 wait complete. 2024-09-21T06:35:34.269 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-21T06:35:34.269 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:35:34.530 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:34.829 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:35:34 smithi007 ceph-mon[30983]: pgmap v300: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T06:35:34.829 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:35:34 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/3639082696' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T06:35:34.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:35:34 smithi018 ceph-mon[34477]: pgmap v300: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T06:35:34.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:35:34 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/3639082696' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T06:35:35.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:35:34 smithi144 ceph-mon[34653]: pgmap v300: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T06:35:35.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:35:34 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/3639082696' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T06:35:35.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:35.074+0000 7f10a2cae640 1 -- 172.21.15.7:0/381812855 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f109c1094b0 msgr2=0x7f109c1098c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:35.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:35.074+0000 7f10a2cae640 1 --2- 172.21.15.7:0/381812855 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f109c1094b0 0x7f109c1098c0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f108c009900 tx=0x7f108c02a410 comp rx=0 tx=0).stop 2024-09-21T06:35:35.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:35.074+0000 7f10a2cae640 1 -- 172.21.15.7:0/381812855 shutdown_connections 2024-09-21T06:35:35.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:35.074+0000 7f10a2cae640 1 --2- 172.21.15.7:0/381812855 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f109c109e00 0x7f109c110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:35.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:35.074+0000 7f10a2cae640 1 --2- 172.21.15.7:0/381812855 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f109c1094b0 0x7f109c1098c0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:35.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:35.074+0000 7f10a2cae640 1 --2- 172.21.15.7:0/381812855 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f109c103bc0 0x7f109c103fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:35.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:35.074+0000 7f10a2cae640 1 -- 172.21.15.7:0/381812855 >> 172.21.15.7:0/381812855 conn(0x7f109c07b910 msgr2=0x7f109c07bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:35.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:35.074+0000 7f10a2cae640 1 -- 172.21.15.7:0/381812855 shutdown_connections 2024-09-21T06:35:35.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:35.074+0000 7f10a2cae640 1 -- 172.21.15.7:0/381812855 wait complete. 2024-09-21T06:35:35.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:35.074+0000 7f10a2cae640 1 Processor -- start 2024-09-21T06:35:35.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:35.074+0000 7f10a2cae640 1 -- start start 2024-09-21T06:35:35.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:35.075+0000 7f10a2cae640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f109c103bc0 0x7f109c19a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:35.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:35.075+0000 7f10a2cae640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f109c1094b0 0x7f109c19aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:35.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:35.075+0000 7f10a2cae640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f109c109e00 0x7f109c19fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:35.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:35.075+0000 7f10a2cae640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f109c113ac0 con 0x7f109c103bc0 2024-09-21T06:35:35.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:35.075+0000 7f10a2cae640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f109c113940 con 0x7f109c109e00 2024-09-21T06:35:35.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:35.075+0000 7f10a2cae640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f109c113c40 con 0x7f109c1094b0 2024-09-21T06:35:35.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:35.075+0000 7f10a0a4a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f109c103bc0 0x7f109c19a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:35.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:35.075+0000 7f10a0a4a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f109c103bc0 0x7f109c19a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56056/0 (socket says 172.21.15.7:56056) 2024-09-21T06:35:35.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:35.075+0000 7f10a0a4a640 1 -- 172.21.15.7:0/1164910866 learned_addr learned my addr 172.21.15.7:0/1164910866 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:35:35.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:35.075+0000 7f10a124b640 1 --2- 172.21.15.7:0/1164910866 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f109c109e00 0x7f109c19fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:35.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:35.075+0000 7f1093fff640 1 --2- 172.21.15.7:0/1164910866 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f109c1094b0 0x7f109c19aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:35.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:35.075+0000 7f10a0a4a640 1 -- 172.21.15.7:0/1164910866 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f109c1094b0 msgr2=0x7f109c19aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:35.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:35.075+0000 7f10a0a4a640 1 --2- 172.21.15.7:0/1164910866 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f109c1094b0 0x7f109c19aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:35.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:35.075+0000 7f10a0a4a640 1 -- 172.21.15.7:0/1164910866 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f109c109e00 msgr2=0x7f109c19fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:35.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:35.075+0000 7f10a0a4a640 1 --2- 172.21.15.7:0/1164910866 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f109c109e00 0x7f109c19fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:35.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:35.075+0000 7f10a0a4a640 1 -- 172.21.15.7:0/1164910866 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f109c1a03e0 con 0x7f109c103bc0 2024-09-21T06:35:35.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:35.075+0000 7f10a0a4a640 1 --2- 172.21.15.7:0/1164910866 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f109c103bc0 0x7f109c19a470 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f109800d770 tx=0x7f109800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:35.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:35.076+0000 7f1091ffb640 1 -- 172.21.15.7:0/1164910866 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1098017070 con 0x7f109c103bc0 2024-09-21T06:35:35.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:35.076+0000 7f10a2cae640 1 -- 172.21.15.7:0/1164910866 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f109c1a06d0 con 0x7f109c103bc0 2024-09-21T06:35:35.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:35.076+0000 7f1091ffb640 1 -- 172.21.15.7:0/1164910866 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f10980054d0 con 0x7f109c103bc0 2024-09-21T06:35:35.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:35.076+0000 7f1091ffb640 1 -- 172.21.15.7:0/1164910866 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1098004c30 con 0x7f109c103bc0 2024-09-21T06:35:35.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:35.076+0000 7f10a2cae640 1 -- 172.21.15.7:0/1164910866 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f109c1a6e30 con 0x7f109c103bc0 2024-09-21T06:35:35.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:35.077+0000 7f10a2cae640 1 -- 172.21.15.7:0/1164910866 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f109c103fd0 con 0x7f109c103bc0 2024-09-21T06:35:35.080 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:35.078+0000 7f1091ffb640 1 -- 172.21.15.7:0/1164910866 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154579+0+0 (secure 0 0 0) 0x7f1098004e10 con 0x7f109c103bc0 2024-09-21T06:35:35.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:35.079+0000 7f1091ffb640 1 --2- 172.21.15.7:0/1164910866 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f10840b65f0 0x7f10840b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:35.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:35.079+0000 7f1093fff640 1 --2- 172.21.15.7:0/1164910866 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f10840b65f0 0x7f10840b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:35.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:35.079+0000 7f1091ffb640 1 -- 172.21.15.7:0/1164910866 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f10980e70d0 con 0x7f109c103bc0 2024-09-21T06:35:35.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:35.080+0000 7f1093fff640 1 --2- 172.21.15.7:0/1164910866 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f10840b65f0 0x7f10840b8b00 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f108c006010 tx=0x7f108c000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:35.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:35.084+0000 7f1091ffb640 1 -- 172.21.15.7:0/1164910866 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f10980ad740 con 0x7f109c103bc0 2024-09-21T06:35:35.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:35.310+0000 7f10a2cae640 1 -- 172.21.15.7:0/1164910866 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f109c02e640 con 0x7f109c103bc0 2024-09-21T06:35:35.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:35.311+0000 7f1091ffb640 1 -- 172.21.15.7:0/1164910866 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11899 (secure 0 0 0) 0x7f10980b1b20 con 0x7f109c103bc0 2024-09-21T06:35:35.313 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:35:35.313 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":24,"btime":"2024-09-21T06:34:35:988361+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2015971546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2015971546},{"type":"v1","addr":"172.21.15.7:6835","nonce":2015971546}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/2350816224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":2350816224},{"type":"v1","addr":"172.21.15.7:6837","nonce":2350816224}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14823,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/1669980572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":1669980572},{"type":"v1","addr":"172.21.15.7:6839","nonce":1669980572}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14835,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/2528308973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":2528308973},{"type":"v1","addr":"172.21.15.7:6841","nonce":2528308973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24623,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1337382979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1337382979},{"type":"v1","addr":"172.21.15.18:6833","nonce":1337382979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/2751454345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":2751454345},{"type":"v1","addr":"172.21.15.144:6833","nonce":2751454345}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:34:24.627168+0000","modified":"2024-09-21T06:34:35.664086+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24716,"mds_1":24688,"mds_2":24686},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24656":{"gid":24656,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6835/158884796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":158884796},{"type":"v1","addr":"172.21.15.18:6835","nonce":158884796}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6835/3636739922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3636739922},{"type":"v1","addr":"172.21.15.144:6835","nonce":3636739922}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24673":{"gid":24673,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6837/1126341753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":1126341753},{"type":"v1","addr":"172.21.15.144:6837","nonce":1126341753}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.18:6837/1539670694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1539670694},{"type":"v1","addr":"172.21.15.18:6837","nonce":1539670694}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24688":{"gid":24688,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.144:6839/4027821922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":4027821922},{"type":"v1","addr":"172.21.15.144:6839","nonce":4027821922}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24716":{"gid":24716,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.18:6839/3798713532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":3798713532},{"type":"v1","addr":"172.21.15.18:6839","nonce":3798713532}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24716,"qdb_cluster":[24686,24688,24716]},"id":1}]} 2024-09-21T06:35:35.313 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 24 2024-09-21T06:35:35.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:35.313+0000 7f10a2cae640 1 -- 172.21.15.7:0/1164910866 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f10840b65f0 msgr2=0x7f10840b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:35.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:35.313+0000 7f10a2cae640 1 --2- 172.21.15.7:0/1164910866 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f10840b65f0 0x7f10840b8b00 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f108c006010 tx=0x7f108c000bc0 comp rx=0 tx=0).stop 2024-09-21T06:35:35.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:35.313+0000 7f10a2cae640 1 -- 172.21.15.7:0/1164910866 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f109c103bc0 msgr2=0x7f109c19a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:35.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:35.313+0000 7f10a2cae640 1 --2- 172.21.15.7:0/1164910866 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f109c103bc0 0x7f109c19a470 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f109800d770 tx=0x7f109800dc30 comp rx=0 tx=0).stop 2024-09-21T06:35:35.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:35.313+0000 7f10a2cae640 1 -- 172.21.15.7:0/1164910866 shutdown_connections 2024-09-21T06:35:35.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:35.313+0000 7f10a2cae640 1 --2- 172.21.15.7:0/1164910866 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f10840b65f0 0x7f10840b8b00 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:35.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:35.313+0000 7f10a2cae640 1 --2- 172.21.15.7:0/1164910866 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f109c109e00 0x7f109c19fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:35.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:35.313+0000 7f10a2cae640 1 --2- 172.21.15.7:0/1164910866 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f109c1094b0 0x7f109c19aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:35.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:35.313+0000 7f10a2cae640 1 --2- 172.21.15.7:0/1164910866 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f109c103bc0 0x7f109c19a470 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:35.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:35.313+0000 7f10a2cae640 1 -- 172.21.15.7:0/1164910866 >> 172.21.15.7:0/1164910866 conn(0x7f109c07b910 msgr2=0x7f109c105520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:35.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:35.313+0000 7f10a2cae640 1 -- 172.21.15.7:0/1164910866 shutdown_connections 2024-09-21T06:35:35.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:35.313+0000 7f10a2cae640 1 -- 172.21.15.7:0/1164910866 wait complete. 2024-09-21T06:35:35.624 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:35:35 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/1164910866' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:35:35.871 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:35:35 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/1164910866' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:35:35.949 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:35:36.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:35:35 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/1164910866' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:35:36.210 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:36.589 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:35:36 smithi007 ceph-mon[30983]: pgmap v301: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:35:36.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:36.707+0000 7fc1aed6a640 1 -- 172.21.15.7:0/2292767608 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1a810de60 msgr2=0x7fc1a8110330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:36.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:36.707+0000 7fc1aed6a640 1 --2- 172.21.15.7:0/2292767608 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1a810de60 0x7fc1a8110330 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fc1a0009ca0 tx=0x7fc1a002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:35:36.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:36.707+0000 7fc1aed6a640 1 -- 172.21.15.7:0/2292767608 shutdown_connections 2024-09-21T06:35:36.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:36.707+0000 7fc1aed6a640 1 --2- 172.21.15.7:0/2292767608 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1a810de60 0x7fc1a8110330 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:36.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:36.707+0000 7fc1aed6a640 1 --2- 172.21.15.7:0/2292767608 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1a8105380 0x7fc1a810d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:36.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:36.707+0000 7fc1aed6a640 1 --2- 172.21.15.7:0/2292767608 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1a8104a30 0x7fc1a8104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:36.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:36.707+0000 7fc1aed6a640 1 -- 172.21.15.7:0/2292767608 >> 172.21.15.7:0/2292767608 conn(0x7fc1a8079760 msgr2=0x7fc1a8079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:36.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:36.707+0000 7fc1aed6a640 1 -- 172.21.15.7:0/2292767608 shutdown_connections 2024-09-21T06:35:36.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:36.707+0000 7fc1aed6a640 1 -- 172.21.15.7:0/2292767608 wait complete. 2024-09-21T06:35:36.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:36.708+0000 7fc1aed6a640 1 Processor -- start 2024-09-21T06:35:36.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:36.708+0000 7fc1aed6a640 1 -- start start 2024-09-21T06:35:36.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:36.708+0000 7fc1aed6a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1a8104a30 0x7fc1a819a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:36.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:36.708+0000 7fc1aed6a640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1a8105380 0x7fc1a819a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:36.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:36.708+0000 7fc1aed6a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1a810de60 0x7fc1a819fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:36.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:36.708+0000 7fc1aed6a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc1a8113aa0 con 0x7fc1a8104a30 2024-09-21T06:35:36.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:36.708+0000 7fc1aed6a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc1a8113920 con 0x7fc1a810de60 2024-09-21T06:35:36.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:36.708+0000 7fc1aed6a640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc1a8113c20 con 0x7fc1a8105380 2024-09-21T06:35:36.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:36.708+0000 7fc1acb06640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1a8104a30 0x7fc1a819a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:36.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:36.708+0000 7fc1acb06640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1a8104a30 0x7fc1a819a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56076/0 (socket says 172.21.15.7:56076) 2024-09-21T06:35:36.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:36.708+0000 7fc1acb06640 1 -- 172.21.15.7:0/4019957081 learned_addr learned my addr 172.21.15.7:0/4019957081 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:35:36.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:36.708+0000 7fc1ad307640 1 --2- 172.21.15.7:0/4019957081 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1a810de60 0x7fc1a819fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:36.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:36.708+0000 7fc1a7fff640 1 --2- 172.21.15.7:0/4019957081 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1a8105380 0x7fc1a819a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:36.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:36.709+0000 7fc1acb06640 1 -- 172.21.15.7:0/4019957081 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1a8105380 msgr2=0x7fc1a819a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:36.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:36.709+0000 7fc1acb06640 1 --2- 172.21.15.7:0/4019957081 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1a8105380 0x7fc1a819a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:36.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:36.709+0000 7fc1acb06640 1 -- 172.21.15.7:0/4019957081 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1a810de60 msgr2=0x7fc1a819fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:36.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:36.709+0000 7fc1acb06640 1 --2- 172.21.15.7:0/4019957081 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1a810de60 0x7fc1a819fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:36.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:36.709+0000 7fc1acb06640 1 -- 172.21.15.7:0/4019957081 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1a81a0380 con 0x7fc1a8104a30 2024-09-21T06:35:36.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:36.709+0000 7fc1acb06640 1 --2- 172.21.15.7:0/4019957081 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1a8104a30 0x7fc1a819a410 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fc19800e9c0 tx=0x7fc19800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:36.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:36.709+0000 7fc1a5ffb640 1 -- 172.21.15.7:0/4019957081 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc19800cd80 con 0x7fc1a8104a30 2024-09-21T06:35:36.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:36.709+0000 7fc1aed6a640 1 -- 172.21.15.7:0/4019957081 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1a81a0670 con 0x7fc1a8104a30 2024-09-21T06:35:36.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:36.709+0000 7fc1a5ffb640 1 -- 172.21.15.7:0/4019957081 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc1980035f0 con 0x7fc1a8104a30 2024-09-21T06:35:36.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:36.709+0000 7fc1a5ffb640 1 -- 172.21.15.7:0/4019957081 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc198010690 con 0x7fc1a8104a30 2024-09-21T06:35:36.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:36.709+0000 7fc1aed6a640 1 -- 172.21.15.7:0/4019957081 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1a81a6dd0 con 0x7fc1a8104a30 2024-09-21T06:35:36.726 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:36.710+0000 7fc1aed6a640 1 -- 172.21.15.7:0/4019957081 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1a806c1f0 con 0x7fc1a8104a30 2024-09-21T06:35:36.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:36.711+0000 7fc1a5ffb640 1 -- 172.21.15.7:0/4019957081 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154579+0+0 (secure 0 0 0) 0x7fc1980037a0 con 0x7fc1a8104a30 2024-09-21T06:35:36.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:36.712+0000 7fc1a5ffb640 1 --2- 172.21.15.7:0/4019957081 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fc1900b65f0 0x7fc1900b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:36.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:36.712+0000 7fc1a7fff640 1 --2- 172.21.15.7:0/4019957081 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fc1900b65f0 0x7fc1900b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:36.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:36.712+0000 7fc1a5ffb640 1 -- 172.21.15.7:0/4019957081 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fc1980e78d0 con 0x7fc1a8104a30 2024-09-21T06:35:36.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:36.713+0000 7fc1a7fff640 1 --2- 172.21.15.7:0/4019957081 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fc1900b65f0 0x7fc1900b8b00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc1a810fc40 tx=0x7fc19c005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:36.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:36.717+0000 7fc1a5ffb640 1 -- 172.21.15.7:0/4019957081 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc1980adf80 con 0x7fc1a8104a30 2024-09-21T06:35:36.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:35:36 smithi018 ceph-mon[34477]: pgmap v301: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:35:36.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:36.943+0000 7fc1aed6a640 1 -- 172.21.15.7:0/4019957081 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc1a81a7090 con 0x7fc1a8104a30 2024-09-21T06:35:36.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:36.944+0000 7fc1a5ffb640 1 -- 172.21.15.7:0/4019957081 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11899 (secure 0 0 0) 0x7fc1980b2360 con 0x7fc1a8104a30 2024-09-21T06:35:36.946 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:35:36.946 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":24,"btime":"2024-09-21T06:34:35:988361+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2015971546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2015971546},{"type":"v1","addr":"172.21.15.7:6835","nonce":2015971546}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/2350816224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":2350816224},{"type":"v1","addr":"172.21.15.7:6837","nonce":2350816224}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14823,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/1669980572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":1669980572},{"type":"v1","addr":"172.21.15.7:6839","nonce":1669980572}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14835,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/2528308973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":2528308973},{"type":"v1","addr":"172.21.15.7:6841","nonce":2528308973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24623,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1337382979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1337382979},{"type":"v1","addr":"172.21.15.18:6833","nonce":1337382979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/2751454345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":2751454345},{"type":"v1","addr":"172.21.15.144:6833","nonce":2751454345}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:34:24.627168+0000","modified":"2024-09-21T06:34:35.664086+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24716,"mds_1":24688,"mds_2":24686},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24656":{"gid":24656,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6835/158884796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":158884796},{"type":"v1","addr":"172.21.15.18:6835","nonce":158884796}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6835/3636739922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3636739922},{"type":"v1","addr":"172.21.15.144:6835","nonce":3636739922}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24673":{"gid":24673,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6837/1126341753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":1126341753},{"type":"v1","addr":"172.21.15.144:6837","nonce":1126341753}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.18:6837/1539670694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1539670694},{"type":"v1","addr":"172.21.15.18:6837","nonce":1539670694}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24688":{"gid":24688,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.144:6839/4027821922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":4027821922},{"type":"v1","addr":"172.21.15.144:6839","nonce":4027821922}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24716":{"gid":24716,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.18:6839/3798713532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":3798713532},{"type":"v1","addr":"172.21.15.18:6839","nonce":3798713532}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24716,"qdb_cluster":[24686,24688,24716]},"id":1}]} 2024-09-21T06:35:36.946 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 24 2024-09-21T06:35:36.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:36.946+0000 7fc1aed6a640 1 -- 172.21.15.7:0/4019957081 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fc1900b65f0 msgr2=0x7fc1900b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:36.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:36.946+0000 7fc1aed6a640 1 --2- 172.21.15.7:0/4019957081 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fc1900b65f0 0x7fc1900b8b00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc1a810fc40 tx=0x7fc19c005f90 comp rx=0 tx=0).stop 2024-09-21T06:35:36.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:36.946+0000 7fc1aed6a640 1 -- 172.21.15.7:0/4019957081 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1a8104a30 msgr2=0x7fc1a819a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:36.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:36.946+0000 7fc1aed6a640 1 --2- 172.21.15.7:0/4019957081 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1a8104a30 0x7fc1a819a410 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fc19800e9c0 tx=0x7fc19800ee80 comp rx=0 tx=0).stop 2024-09-21T06:35:36.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:36.946+0000 7fc1aed6a640 1 -- 172.21.15.7:0/4019957081 shutdown_connections 2024-09-21T06:35:36.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:36.946+0000 7fc1aed6a640 1 --2- 172.21.15.7:0/4019957081 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fc1900b65f0 0x7fc1900b8b00 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:36.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:36.946+0000 7fc1aed6a640 1 --2- 172.21.15.7:0/4019957081 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1a810de60 0x7fc1a819fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:36.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:36.946+0000 7fc1aed6a640 1 --2- 172.21.15.7:0/4019957081 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc1a8105380 0x7fc1a819a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:36.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:36.946+0000 7fc1aed6a640 1 --2- 172.21.15.7:0/4019957081 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc1a8104a30 0x7fc1a819a410 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:36.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:36.946+0000 7fc1aed6a640 1 -- 172.21.15.7:0/4019957081 >> 172.21.15.7:0/4019957081 conn(0x7fc1a8079760 msgr2=0x7fc1a8105850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:36.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:36.946+0000 7fc1aed6a640 1 -- 172.21.15.7:0/4019957081 shutdown_connections 2024-09-21T06:35:36.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:36.946+0000 7fc1aed6a640 1 -- 172.21.15.7:0/4019957081 wait complete. 2024-09-21T06:35:37.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:35:36 smithi144 ceph-mon[34653]: pgmap v301: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:35:37.543 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T06:35:37.804 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:37.839 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:35:37 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/4019957081' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:35:37.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:35:37 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/4019957081' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:35:38.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:35:37 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/4019957081' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:35:38.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:38.276+0000 7f21d4176640 1 -- 172.21.15.7:0/1093277931 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21cc106c30 msgr2=0x7f21cc110680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:38.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:38.276+0000 7f21d4176640 1 --2- 172.21.15.7:0/1093277931 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21cc106c30 0x7f21cc110680 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f21c4009ca0 tx=0x7f21c402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:35:38.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:38.276+0000 7f21d4176640 1 -- 172.21.15.7:0/1093277931 shutdown_connections 2024-09-21T06:35:38.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:38.276+0000 7f21d4176640 1 --2- 172.21.15.7:0/1093277931 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21cc106c30 0x7f21cc110680 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:38.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:38.276+0000 7f21d4176640 1 --2- 172.21.15.7:0/1093277931 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21cc1062e0 0x7f21cc1066f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:38.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:38.276+0000 7f21d4176640 1 --2- 172.21.15.7:0/1093277931 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21cc102000 0x7f21cc102410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:38.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:38.276+0000 7f21d4176640 1 -- 172.21.15.7:0/1093277931 >> 172.21.15.7:0/1093277931 conn(0x7f21cc079e40 msgr2=0x7f21cc07a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:38.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:38.276+0000 7f21d4176640 1 -- 172.21.15.7:0/1093277931 shutdown_connections 2024-09-21T06:35:38.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:38.276+0000 7f21d4176640 1 -- 172.21.15.7:0/1093277931 wait complete. 2024-09-21T06:35:38.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:38.277+0000 7f21d4176640 1 Processor -- start 2024-09-21T06:35:38.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:38.277+0000 7f21d4176640 1 -- start start 2024-09-21T06:35:38.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:38.277+0000 7f21d4176640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21cc102000 0x7f21cc19a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:38.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:38.277+0000 7f21d4176640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21cc1062e0 0x7f21cc19a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:38.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:38.277+0000 7f21d4176640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21cc106c30 0x7f21cc19fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:38.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:38.277+0000 7f21d4176640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f21cc113ad0 con 0x7f21cc106c30 2024-09-21T06:35:38.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:38.277+0000 7f21d4176640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f21cc113950 con 0x7f21cc1062e0 2024-09-21T06:35:38.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:38.277+0000 7f21d4176640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f21cc113c50 con 0x7f21cc102000 2024-09-21T06:35:38.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:38.277+0000 7f21d1711640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21cc1062e0 0x7f21cc19a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:38.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:38.277+0000 7f21d1711640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21cc1062e0 0x7f21cc19a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.7:36784/0 (socket says 172.21.15.7:36784) 2024-09-21T06:35:38.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:38.277+0000 7f21d1711640 1 -- 172.21.15.7:0/3921216535 learned_addr learned my addr 172.21.15.7:0/3921216535 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:35:38.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:38.277+0000 7f21d2713640 1 --2- 172.21.15.7:0/3921216535 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21cc106c30 0x7f21cc19fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:38.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:38.277+0000 7f21d1f12640 1 --2- 172.21.15.7:0/3921216535 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21cc102000 0x7f21cc19a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:38.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:38.278+0000 7f21d1711640 1 -- 172.21.15.7:0/3921216535 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21cc102000 msgr2=0x7f21cc19a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:38.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:38.278+0000 7f21d1711640 1 --2- 172.21.15.7:0/3921216535 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21cc102000 0x7f21cc19a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:38.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:38.278+0000 7f21d1711640 1 -- 172.21.15.7:0/3921216535 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21cc106c30 msgr2=0x7f21cc19fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:38.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:38.278+0000 7f21d1711640 1 --2- 172.21.15.7:0/3921216535 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21cc106c30 0x7f21cc19fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:38.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:38.278+0000 7f21d1711640 1 -- 172.21.15.7:0/3921216535 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21cc1a0350 con 0x7f21cc1062e0 2024-09-21T06:35:38.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:38.278+0000 7f21d1711640 1 --2- 172.21.15.7:0/3921216535 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21cc1062e0 0x7f21cc19a980 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f21bc00e9c0 tx=0x7f21bc00ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:38.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:38.278+0000 7f21c2ffd640 1 -- 172.21.15.7:0/3921216535 <== mon.2 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21bc00cd80 con 0x7f21cc1062e0 2024-09-21T06:35:38.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:38.278+0000 7f21d4176640 1 -- 172.21.15.7:0/3921216535 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21cc1a0640 con 0x7f21cc1062e0 2024-09-21T06:35:38.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:38.278+0000 7f21d4176640 1 -- 172.21.15.7:0/3921216535 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21cc1a6da0 con 0x7f21cc1062e0 2024-09-21T06:35:38.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:38.278+0000 7f21c2ffd640 1 -- 172.21.15.7:0/3921216535 <== mon.2 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f21bc0054d0 con 0x7f21cc1062e0 2024-09-21T06:35:38.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:38.278+0000 7f21c2ffd640 1 -- 172.21.15.7:0/3921216535 <== mon.2 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21bc004e60 con 0x7f21cc1062e0 2024-09-21T06:35:38.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:38.279+0000 7f21d4176640 1 -- 172.21.15.7:0/3921216535 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21b00052c0 con 0x7f21cc1062e0 2024-09-21T06:35:38.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:38.281+0000 7f21c2ffd640 1 -- 172.21.15.7:0/3921216535 <== mon.2 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 22) ==== 154579+0+0 (secure 0 0 0) 0x7f21bc0046c0 con 0x7f21cc1062e0 2024-09-21T06:35:38.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:38.282+0000 7f21c2ffd640 1 --2- 172.21.15.7:0/3921216535 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f21b80b65f0 0x7f21b80b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:38.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:38.282+0000 7f21d1f12640 1 --2- 172.21.15.7:0/3921216535 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f21b80b65f0 0x7f21b80b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:38.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:38.282+0000 7f21c2ffd640 1 -- 172.21.15.7:0/3921216535 <== mon.2 v2:172.21.15.18:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f21bc0e7a80 con 0x7f21cc1062e0 2024-09-21T06:35:38.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:38.282+0000 7f21d1f12640 1 --2- 172.21.15.7:0/3921216535 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f21b80b65f0 0x7f21b80b8b00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f21c8005fd0 tx=0x7f21c8005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:38.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:38.285+0000 7f21c2ffd640 1 -- 172.21.15.7:0/3921216535 <== mon.2 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f21bc056710 con 0x7f21cc1062e0 2024-09-21T06:35:38.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:38.475+0000 7f21d4176640 1 -- 172.21.15.7:0/3921216535 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f21b0005880 con 0x7f21cc1062e0 2024-09-21T06:35:38.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:38.477+0000 7f21c2ffd640 1 -- 172.21.15.7:0/3921216535 <== mon.2 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+22791 (secure 0 0 0) 0x7f21bc0ae0f0 con 0x7f21cc1062e0 2024-09-21T06:35:38.479 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:35:38.479 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":77,"fsid":"347cb918-77e2-11ef-baf5-efdc52797490","created":"2024-09-21T06:25:51.925032+0000","modified":"2024-09-21T06:34:44.220989+0000","last_up_change":"2024-09-21T06:33:32.888843+0000","last_in_change":"2024-09-21T06:33:09.926778+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:29:41.514179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:34:20.531755+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T06:34:22.552541+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1be5c4a4-3931-4d8b-95c7-c05f5b73fcfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":942632794},{"type":"v1","addr":"172.21.15.7:6803","nonce":942632794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":942632794},{"type":"v1","addr":"172.21.15.7:6805","nonce":942632794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":942632794},{"type":"v1","addr":"172.21.15.7:6809","nonce":942632794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":942632794},{"type":"v1","addr":"172.21.15.7:6807","nonce":942632794}]},"public_addr":"172.21.15.7:6803/942632794","cluster_addr":"172.21.15.7:6805/942632794","heartbeat_back_addr":"172.21.15.7:6809/942632794","heartbeat_front_addr":"172.21.15.7:6807/942632794","state":["exists","up"]},{"osd":1,"uuid":"7ae136a8-c614-47e5-b265-c6cfa857a7fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1839342931},{"type":"v1","addr":"172.21.15.18:6801","nonce":1839342931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1839342931},{"type":"v1","addr":"172.21.15.18:6803","nonce":1839342931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1839342931},{"type":"v1","addr":"172.21.15.18:6807","nonce":1839342931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1839342931},{"type":"v1","addr":"172.21.15.18:6805","nonce":1839342931}]},"public_addr":"172.21.15.18:6801/1839342931","cluster_addr":"172.21.15.18:6803/1839342931","heartbeat_back_addr":"172.21.15.18:6807/1839342931","heartbeat_front_addr":"172.21.15.18:6805/1839342931","state":["exists","up"]},{"osd":2,"uuid":"97b13994-4680-4573-9c2e-ac65ea740e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":1699582162},{"type":"v1","addr":"172.21.15.144:6801","nonce":1699582162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":1699582162},{"type":"v1","addr":"172.21.15.144:6803","nonce":1699582162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":1699582162},{"type":"v1","addr":"172.21.15.144:6807","nonce":1699582162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":1699582162},{"type":"v1","addr":"172.21.15.144:6805","nonce":1699582162}]},"public_addr":"172.21.15.144:6801/1699582162","cluster_addr":"172.21.15.144:6803/1699582162","heartbeat_back_addr":"172.21.15.144:6807/1699582162","heartbeat_front_addr":"172.21.15.144:6805/1699582162","state":["exists","up"]},{"osd":3,"uuid":"ddf70d51-404d-491d-a6a8-15fca4ef01db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":3202935163},{"type":"v1","addr":"172.21.15.7:6811","nonce":3202935163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":3202935163},{"type":"v1","addr":"172.21.15.7:6813","nonce":3202935163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":3202935163},{"type":"v1","addr":"172.21.15.7:6817","nonce":3202935163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":3202935163},{"type":"v1","addr":"172.21.15.7:6815","nonce":3202935163}]},"public_addr":"172.21.15.7:6811/3202935163","cluster_addr":"172.21.15.7:6813/3202935163","heartbeat_back_addr":"172.21.15.7:6817/3202935163","heartbeat_front_addr":"172.21.15.7:6815/3202935163","state":["exists","up"]},{"osd":4,"uuid":"f2ae4340-accf-4ac0-a4d3-c08302712ce1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1058105724},{"type":"v1","addr":"172.21.15.18:6809","nonce":1058105724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":1058105724},{"type":"v1","addr":"172.21.15.18:6811","nonce":1058105724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":1058105724},{"type":"v1","addr":"172.21.15.18:6815","nonce":1058105724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":1058105724},{"type":"v1","addr":"172.21.15.18:6813","nonce":1058105724}]},"public_addr":"172.21.15.18:6809/1058105724","cluster_addr":"172.21.15.18:6811/1058105724","heartbeat_back_addr":"172.21.15.18:6815/1058105724","heartbeat_front_addr":"172.21.15.18:6813/1058105724","state":["exists","up"]},{"osd":5,"uuid":"d56abc37-de6f-47a4-9f5e-67224da78f4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":2814586621},{"type":"v1","addr":"172.21.15.144:6809","nonce":2814586621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":2814586621},{"type":"v1","addr":"172.21.15.144:6811","nonce":2814586621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":2814586621},{"type":"v1","addr":"172.21.15.144:6815","nonce":2814586621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":2814586621},{"type":"v1","addr":"172.21.15.144:6813","nonce":2814586621}]},"public_addr":"172.21.15.144:6809/2814586621","cluster_addr":"172.21.15.144:6811/2814586621","heartbeat_back_addr":"172.21.15.144:6815/2814586621","heartbeat_front_addr":"172.21.15.144:6813/2814586621","state":["exists","up"]},{"osd":6,"uuid":"9145650c-e9b1-4e5a-ae6f-17c8960146e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":3770978305},{"type":"v1","addr":"172.21.15.7:6819","nonce":3770978305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":3770978305},{"type":"v1","addr":"172.21.15.7:6821","nonce":3770978305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3770978305},{"type":"v1","addr":"172.21.15.7:6825","nonce":3770978305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":3770978305},{"type":"v1","addr":"172.21.15.7:6823","nonce":3770978305}]},"public_addr":"172.21.15.7:6819/3770978305","cluster_addr":"172.21.15.7:6821/3770978305","heartbeat_back_addr":"172.21.15.7:6825/3770978305","heartbeat_front_addr":"172.21.15.7:6823/3770978305","state":["exists","up"]},{"osd":7,"uuid":"ca658683-38f7-47ca-b32e-512fe4738ef1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":1322408496},{"type":"v1","addr":"172.21.15.18:6817","nonce":1322408496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1322408496},{"type":"v1","addr":"172.21.15.18:6819","nonce":1322408496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1322408496},{"type":"v1","addr":"172.21.15.18:6823","nonce":1322408496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1322408496},{"type":"v1","addr":"172.21.15.18:6821","nonce":1322408496}]},"public_addr":"172.21.15.18:6817/1322408496","cluster_addr":"172.21.15.18:6819/1322408496","heartbeat_back_addr":"172.21.15.18:6823/1322408496","heartbeat_front_addr":"172.21.15.18:6821/1322408496","state":["exists","up"]},{"osd":8,"uuid":"40d1f37e-6fac-40b9-9319-78f4fc3a6f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1011657022},{"type":"v1","addr":"172.21.15.144:6817","nonce":1011657022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1011657022},{"type":"v1","addr":"172.21.15.144:6819","nonce":1011657022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1011657022},{"type":"v1","addr":"172.21.15.144:6823","nonce":1011657022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":1011657022},{"type":"v1","addr":"172.21.15.144:6821","nonce":1011657022}]},"public_addr":"172.21.15.144:6817/1011657022","cluster_addr":"172.21.15.144:6819/1011657022","heartbeat_back_addr":"172.21.15.144:6823/1011657022","heartbeat_front_addr":"172.21.15.144:6821/1011657022","state":["exists","up"]},{"osd":9,"uuid":"ad12d6f7-fd21-49bd-a343-744f3cff4bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":256146339},{"type":"v1","addr":"172.21.15.7:6827","nonce":256146339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":256146339},{"type":"v1","addr":"172.21.15.7:6829","nonce":256146339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":256146339},{"type":"v1","addr":"172.21.15.7:6833","nonce":256146339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":256146339},{"type":"v1","addr":"172.21.15.7:6831","nonce":256146339}]},"public_addr":"172.21.15.7:6827/256146339","cluster_addr":"172.21.15.7:6829/256146339","heartbeat_back_addr":"172.21.15.7:6833/256146339","heartbeat_front_addr":"172.21.15.7:6831/256146339","state":["exists","up"]},{"osd":10,"uuid":"1317a2ad-ec15-4096-b2da-689475b7cacc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":2038885362},{"type":"v1","addr":"172.21.15.18:6825","nonce":2038885362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2038885362},{"type":"v1","addr":"172.21.15.18:6827","nonce":2038885362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2038885362},{"type":"v1","addr":"172.21.15.18:6831","nonce":2038885362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2038885362},{"type":"v1","addr":"172.21.15.18:6829","nonce":2038885362}]},"public_addr":"172.21.15.18:6825/2038885362","cluster_addr":"172.21.15.18:6827/2038885362","heartbeat_back_addr":"172.21.15.18:6831/2038885362","heartbeat_front_addr":"172.21.15.18:6829/2038885362","state":["exists","up"]},{"osd":11,"uuid":"f9252acb-7290-4923-89f3-844c868d4b39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":1047060848},{"type":"v1","addr":"172.21.15.144:6825","nonce":1047060848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":1047060848},{"type":"v1","addr":"172.21.15.144:6827","nonce":1047060848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":1047060848},{"type":"v1","addr":"172.21.15.144:6831","nonce":1047060848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":1047060848},{"type":"v1","addr":"172.21.15.144:6829","nonce":1047060848}]},"public_addr":"172.21.15.144:6825/1047060848","cluster_addr":"172.21.15.144:6827/1047060848","heartbeat_back_addr":"172.21.15.144:6831/1047060848","heartbeat_front_addr":"172.21.15.144:6829/1047060848","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:28:48.842729+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:29:13.946624+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:29:38.589666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:30:05.116339+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:30:30.562090+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:30:55.586210+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:31:22.138457+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:31:49.178090+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:32:13.687830+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:32:40.408193+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:33:06.044578+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:33:30.988851+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/1296137341":"2024-09-22T06:27:43.044484+0000","172.21.15.7:6801/3879502931":"2024-09-22T06:27:43.044484+0000","172.21.15.7:0/1926706877":"2024-09-22T06:26:40.520265+0000","172.21.15.7:0/2034370456":"2024-09-22T06:26:14.181426+0000","172.21.15.7:6801/3339522713":"2024-09-22T06:26:14.181426+0000","172.21.15.7:6800/3339522713":"2024-09-22T06:26:14.181426+0000","172.21.15.7:0/3586807770":"2024-09-22T06:26:14.181426+0000","172.21.15.7:0/1814223919":"2024-09-22T06:27:43.044484+0000","172.21.15.7:0/601150037":"2024-09-22T06:26:40.520265+0000","172.21.15.7:6800/3876787626":"2024-09-22T06:26:40.520265+0000","172.21.15.7:0/186444636":"2024-09-22T06:26:14.181426+0000","172.21.15.7:0/2180184348":"2024-09-22T06:26:40.520265+0000","172.21.15.7:6801/3876787626":"2024-09-22T06:26:40.520265+0000","172.21.15.7:0/2931793461":"2024-09-22T06:27:43.044484+0000","172.21.15.7:6800/3879502931":"2024-09-22T06:27:43.044484+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:35:38.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:38.480+0000 7f21d4176640 1 -- 172.21.15.7:0/3921216535 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f21b80b65f0 msgr2=0x7f21b80b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:38.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:38.480+0000 7f21d4176640 1 --2- 172.21.15.7:0/3921216535 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f21b80b65f0 0x7f21b80b8b00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f21c8005fd0 tx=0x7f21c8005850 comp rx=0 tx=0).stop 2024-09-21T06:35:38.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:38.480+0000 7f21d4176640 1 -- 172.21.15.7:0/3921216535 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21cc1062e0 msgr2=0x7f21cc19a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:38.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:38.480+0000 7f21d4176640 1 --2- 172.21.15.7:0/3921216535 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21cc1062e0 0x7f21cc19a980 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f21bc00e9c0 tx=0x7f21bc00ee80 comp rx=0 tx=0).stop 2024-09-21T06:35:38.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:38.480+0000 7f21d4176640 1 -- 172.21.15.7:0/3921216535 shutdown_connections 2024-09-21T06:35:38.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:38.480+0000 7f21d4176640 1 --2- 172.21.15.7:0/3921216535 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f21b80b65f0 0x7f21b80b8b00 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:38.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:38.480+0000 7f21d4176640 1 --2- 172.21.15.7:0/3921216535 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21cc106c30 0x7f21cc19fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:38.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:38.480+0000 7f21d4176640 1 --2- 172.21.15.7:0/3921216535 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21cc1062e0 0x7f21cc19a980 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:38.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:38.480+0000 7f21d4176640 1 --2- 172.21.15.7:0/3921216535 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21cc102000 0x7f21cc19a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:38.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:38.480+0000 7f21d4176640 1 -- 172.21.15.7:0/3921216535 >> 172.21.15.7:0/3921216535 conn(0x7f21cc079e40 msgr2=0x7f21cc1074f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:38.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:38.480+0000 7f21d4176640 1 -- 172.21.15.7:0/3921216535 shutdown_connections 2024-09-21T06:35:38.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:38.480+0000 7f21d4176640 1 -- 172.21.15.7:0/3921216535 wait complete. 2024-09-21T06:35:38.798 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:35:38 smithi007 ceph-mon[30983]: pgmap v302: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:35:38.798 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:35:38 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/3921216535' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:35:38.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:35:38 smithi018 ceph-mon[34477]: pgmap v302: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:35:38.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:35:38 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/3921216535' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:35:39.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:35:38 smithi144 ceph-mon[34653]: pgmap v302: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:35:39.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:35:38 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/3921216535' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:35:39.128 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:35:39.387 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:39.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:39.888+0000 7f646cc9d640 1 -- 172.21.15.7:0/204104974 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6468109df0 msgr2=0x7f6468110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:39.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:39.888+0000 7f646cc9d640 1 --2- 172.21.15.7:0/204104974 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6468109df0 0x7f6468110620 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f6460009ca0 tx=0x7f646002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:35:39.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:39.888+0000 7f646cc9d640 1 -- 172.21.15.7:0/204104974 shutdown_connections 2024-09-21T06:35:39.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:39.888+0000 7f646cc9d640 1 --2- 172.21.15.7:0/204104974 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6468109df0 0x7f6468110620 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:39.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:39.888+0000 7f646cc9d640 1 --2- 172.21.15.7:0/204104974 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f64681094a0 0x7f64681098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:39.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:39.888+0000 7f646cc9d640 1 --2- 172.21.15.7:0/204104974 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6468103b60 0x7f6468103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:39.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:39.888+0000 7f646cc9d640 1 -- 172.21.15.7:0/204104974 >> 172.21.15.7:0/204104974 conn(0x7f646807b850 msgr2=0x7f646807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:39.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:39.888+0000 7f646cc9d640 1 -- 172.21.15.7:0/204104974 shutdown_connections 2024-09-21T06:35:39.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:39.888+0000 7f646cc9d640 1 -- 172.21.15.7:0/204104974 wait complete. 2024-09-21T06:35:39.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:39.889+0000 7f646cc9d640 1 Processor -- start 2024-09-21T06:35:39.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:39.889+0000 7f646cc9d640 1 -- start start 2024-09-21T06:35:39.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:39.889+0000 7f646cc9d640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6468103b60 0x7f6468075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:39.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:39.889+0000 7f646cc9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64681094a0 0x7f6468075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:39.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:39.890+0000 7f646cc9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6468109df0 0x7f6468076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:39.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:39.890+0000 7f646cc9d640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6468113ab0 con 0x7f64681094a0 2024-09-21T06:35:39.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:39.890+0000 7f646cc9d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6468113930 con 0x7f6468109df0 2024-09-21T06:35:39.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:39.890+0000 7f646cc9d640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6468113c30 con 0x7f6468103b60 2024-09-21T06:35:39.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:39.890+0000 7f6465d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64681094a0 0x7f6468075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:39.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:39.890+0000 7f6465d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64681094a0 0x7f6468075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56114/0 (socket says 172.21.15.7:56114) 2024-09-21T06:35:39.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:39.890+0000 7f6465d9b640 1 -- 172.21.15.7:0/459751639 learned_addr learned my addr 172.21.15.7:0/459751639 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:35:39.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:39.890+0000 7f646659c640 1 --2- 172.21.15.7:0/459751639 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6468103b60 0x7f6468075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:39.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:39.890+0000 7f6466d9d640 1 --2- 172.21.15.7:0/459751639 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6468109df0 0x7f6468076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:39.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:39.890+0000 7f6465d9b640 1 -- 172.21.15.7:0/459751639 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6468103b60 msgr2=0x7f6468075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:39.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:39.890+0000 7f6465d9b640 1 --2- 172.21.15.7:0/459751639 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6468103b60 0x7f6468075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:39.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:39.890+0000 7f6465d9b640 1 -- 172.21.15.7:0/459751639 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6468109df0 msgr2=0x7f6468076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:39.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:39.890+0000 7f6465d9b640 1 --2- 172.21.15.7:0/459751639 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6468109df0 0x7f6468076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:39.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:39.890+0000 7f6465d9b640 1 -- 172.21.15.7:0/459751639 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64681a8720 con 0x7f64681094a0 2024-09-21T06:35:39.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:39.890+0000 7f6465d9b640 1 --2- 172.21.15.7:0/459751639 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64681094a0 0x7f6468075c50 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f645c00d750 tx=0x7f645c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:39.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:39.890+0000 7f64577fe640 1 -- 172.21.15.7:0/459751639 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f645c017070 con 0x7f64681094a0 2024-09-21T06:35:39.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:39.890+0000 7f646cc9d640 1 -- 172.21.15.7:0/459751639 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64681a8a10 con 0x7f64681094a0 2024-09-21T06:35:39.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:39.890+0000 7f64577fe640 1 -- 172.21.15.7:0/459751639 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f645c0054d0 con 0x7f64681094a0 2024-09-21T06:35:39.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:39.890+0000 7f64577fe640 1 -- 172.21.15.7:0/459751639 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f645c004c30 con 0x7f64681094a0 2024-09-21T06:35:39.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:39.891+0000 7f646cc9d640 1 -- 172.21.15.7:0/459751639 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64681a8f00 con 0x7f64681094a0 2024-09-21T06:35:39.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:39.892+0000 7f646cc9d640 1 -- 172.21.15.7:0/459751639 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6468103f70 con 0x7f64681094a0 2024-09-21T06:35:39.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:39.894+0000 7f64577fe640 1 -- 172.21.15.7:0/459751639 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154579+0+0 (secure 0 0 0) 0x7f645c004dd0 con 0x7f64681094a0 2024-09-21T06:35:39.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:39.895+0000 7f64577fe640 1 --2- 172.21.15.7:0/459751639 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f64500b65f0 0x7f64500b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:39.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:39.895+0000 7f646659c640 1 --2- 172.21.15.7:0/459751639 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f64500b65f0 0x7f64500b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:39.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:39.895+0000 7f64577fe640 1 -- 172.21.15.7:0/459751639 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f645c0e73e0 con 0x7f64681094a0 2024-09-21T06:35:39.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:39.896+0000 7f646659c640 1 --2- 172.21.15.7:0/459751639 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f64500b65f0 0x7f64500b8b00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6468077160 tx=0x7f6458005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:39.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:39.899+0000 7f64577fe640 1 -- 172.21.15.7:0/459751639 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f645c0ada50 con 0x7f64681094a0 2024-09-21T06:35:40.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:40.123+0000 7f646cc9d640 1 -- 172.21.15.7:0/459751639 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f646802e640 con 0x7f64681094a0 2024-09-21T06:35:40.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:40.124+0000 7f64577fe640 1 -- 172.21.15.7:0/459751639 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11899 (secure 0 0 0) 0x7f645c0b6020 con 0x7f64681094a0 2024-09-21T06:35:40.126 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:35:40.126 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":24,"btime":"2024-09-21T06:34:35:988361+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2015971546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2015971546},{"type":"v1","addr":"172.21.15.7:6835","nonce":2015971546}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/2350816224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":2350816224},{"type":"v1","addr":"172.21.15.7:6837","nonce":2350816224}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14823,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/1669980572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":1669980572},{"type":"v1","addr":"172.21.15.7:6839","nonce":1669980572}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14835,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/2528308973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":2528308973},{"type":"v1","addr":"172.21.15.7:6841","nonce":2528308973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24623,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1337382979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1337382979},{"type":"v1","addr":"172.21.15.18:6833","nonce":1337382979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/2751454345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":2751454345},{"type":"v1","addr":"172.21.15.144:6833","nonce":2751454345}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:34:24.627168+0000","modified":"2024-09-21T06:34:35.664086+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24716,"mds_1":24688,"mds_2":24686},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24656":{"gid":24656,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6835/158884796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":158884796},{"type":"v1","addr":"172.21.15.18:6835","nonce":158884796}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6835/3636739922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3636739922},{"type":"v1","addr":"172.21.15.144:6835","nonce":3636739922}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24673":{"gid":24673,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6837/1126341753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":1126341753},{"type":"v1","addr":"172.21.15.144:6837","nonce":1126341753}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.18:6837/1539670694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1539670694},{"type":"v1","addr":"172.21.15.18:6837","nonce":1539670694}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24688":{"gid":24688,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.144:6839/4027821922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":4027821922},{"type":"v1","addr":"172.21.15.144:6839","nonce":4027821922}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24716":{"gid":24716,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.18:6839/3798713532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":3798713532},{"type":"v1","addr":"172.21.15.18:6839","nonce":3798713532}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24716,"qdb_cluster":[24686,24688,24716]},"id":1}]} 2024-09-21T06:35:40.126 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 24 2024-09-21T06:35:40.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:40.126+0000 7f646cc9d640 1 -- 172.21.15.7:0/459751639 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f64500b65f0 msgr2=0x7f64500b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:40.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:40.126+0000 7f646cc9d640 1 --2- 172.21.15.7:0/459751639 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f64500b65f0 0x7f64500b8b00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6468077160 tx=0x7f6458005f90 comp rx=0 tx=0).stop 2024-09-21T06:35:40.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:40.126+0000 7f646cc9d640 1 -- 172.21.15.7:0/459751639 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64681094a0 msgr2=0x7f6468075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:40.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:40.126+0000 7f646cc9d640 1 --2- 172.21.15.7:0/459751639 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64681094a0 0x7f6468075c50 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f645c00d750 tx=0x7f645c00dc10 comp rx=0 tx=0).stop 2024-09-21T06:35:40.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:40.126+0000 7f646cc9d640 1 -- 172.21.15.7:0/459751639 shutdown_connections 2024-09-21T06:35:40.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:40.126+0000 7f646cc9d640 1 --2- 172.21.15.7:0/459751639 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f64500b65f0 0x7f64500b8b00 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:40.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:40.126+0000 7f646cc9d640 1 --2- 172.21.15.7:0/459751639 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6468109df0 0x7f6468076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:40.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:40.126+0000 7f646cc9d640 1 --2- 172.21.15.7:0/459751639 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f64681094a0 0x7f6468075c50 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:40.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:40.126+0000 7f646cc9d640 1 --2- 172.21.15.7:0/459751639 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6468103b60 0x7f6468075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:40.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:40.126+0000 7f646cc9d640 1 -- 172.21.15.7:0/459751639 >> 172.21.15.7:0/459751639 conn(0x7f646807b850 msgr2=0x7f64681074f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:40.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:40.126+0000 7f646cc9d640 1 -- 172.21.15.7:0/459751639 shutdown_connections 2024-09-21T06:35:40.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:40.126+0000 7f646cc9d640 1 -- 172.21.15.7:0/459751639 wait complete. 2024-09-21T06:35:40.754 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:35:40 smithi007 ceph-mon[30983]: pgmap v303: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T06:35:40.754 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:35:40 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/459751639' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:35:40.784 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-21T06:34:24.627168+0000', 'modified': '2024-09-21T06:34:35.664086+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24716, 'mds_1': 24688, 'mds_2': 24686}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24656': {'gid': 24656, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.18:6835/158884796', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6834', 'nonce': 158884796}, {'type': 'v1', 'addr': '172.21.15.18:6835', 'nonce': 158884796}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24667': {'gid': 24667, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.144:6835/3636739922', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6834', 'nonce': 3636739922}, {'type': 'v1', 'addr': '172.21.15.144:6835', 'nonce': 3636739922}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24673': {'gid': 24673, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.144:6837/1126341753', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6836', 'nonce': 1126341753}, {'type': 'v1', 'addr': '172.21.15.144:6837', 'nonce': 1126341753}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24686': {'gid': 24686, 'name': 'h', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.18:6837/1539670694', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6836', 'nonce': 1539670694}, {'type': 'v1', 'addr': '172.21.15.18:6837', 'nonce': 1539670694}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24688': {'gid': 24688, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.144:6839/4027821922', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6838', 'nonce': 4027821922}, {'type': 'v1', 'addr': '172.21.15.144:6839', 'nonce': 4027821922}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24716': {'gid': 24716, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.18:6839/3798713532', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6838', 'nonce': 3798713532}, {'type': 'v1', 'addr': '172.21.15.18:6839', 'nonce': 3798713532}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24716, 'qdb_cluster': [24686, 24688, 24716]} 2024-09-21T06:35:40.784 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-21T06:35:40.784 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.h status 2024-09-21T06:35:40.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:35:40 smithi018 ceph-mon[34477]: pgmap v303: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T06:35:40.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:35:40 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/459751639' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:35:41.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:35:40 smithi144 ceph-mon[34653]: pgmap v303: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T06:35:41.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:35:40 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/459751639' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:35:41.042 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:41.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.524+0000 7f73a42c9640 1 -- 172.21.15.7:0/1275753677 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f739c108d20 msgr2=0x7f739c10f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:41.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.524+0000 7f73a42c9640 1 --2- 172.21.15.7:0/1275753677 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f739c108d20 0x7f739c10f550 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f7394009ca0 tx=0x7f739402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:35:41.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.524+0000 7f73a42c9640 1 -- 172.21.15.7:0/1275753677 shutdown_connections 2024-09-21T06:35:41.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.524+0000 7f73a42c9640 1 --2- 172.21.15.7:0/1275753677 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f739c108d20 0x7f739c10f550 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:41.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.524+0000 7f73a42c9640 1 --2- 172.21.15.7:0/1275753677 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f739c1083d0 0x7f739c1087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:41.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.524+0000 7f73a42c9640 1 --2- 172.21.15.7:0/1275753677 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f739c102a90 0x7f739c102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:41.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.524+0000 7f73a42c9640 1 -- 172.21.15.7:0/1275753677 >> 172.21.15.7:0/1275753677 conn(0x7f739c079750 msgr2=0x7f739c079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:41.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.524+0000 7f73a42c9640 1 -- 172.21.15.7:0/1275753677 shutdown_connections 2024-09-21T06:35:41.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.524+0000 7f73a42c9640 1 -- 172.21.15.7:0/1275753677 wait complete. 2024-09-21T06:35:41.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.525+0000 7f73a42c9640 1 Processor -- start 2024-09-21T06:35:41.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.525+0000 7f73a42c9640 1 -- start start 2024-09-21T06:35:41.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.525+0000 7f73a42c9640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f739c102a90 0x7f739c19a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:41.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.525+0000 7f73a42c9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f739c1083d0 0x7f739c19a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:41.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.525+0000 7f73a42c9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f739c108d20 0x7f739c19fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:41.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.525+0000 7f73a42c9640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f739c113ae0 con 0x7f739c1083d0 2024-09-21T06:35:41.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.525+0000 7f73a42c9640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f739c113960 con 0x7f739c108d20 2024-09-21T06:35:41.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.525+0000 7f73a42c9640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f739c113c60 con 0x7f739c102a90 2024-09-21T06:35:41.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.525+0000 7f73a1864640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f739c1083d0 0x7f739c19a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:41.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.525+0000 7f73a1864640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f739c1083d0 0x7f739c19a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40900/0 (socket says 172.21.15.7:40900) 2024-09-21T06:35:41.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.525+0000 7f73a1864640 1 -- 172.21.15.7:0/1406527754 learned_addr learned my addr 172.21.15.7:0/1406527754 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:35:41.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.525+0000 7f73a2866640 1 --2- 172.21.15.7:0/1406527754 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f739c108d20 0x7f739c19fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:41.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.525+0000 7f73a2065640 1 --2- 172.21.15.7:0/1406527754 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f739c102a90 0x7f739c19a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:41.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.526+0000 7f73a1864640 1 -- 172.21.15.7:0/1406527754 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f739c102a90 msgr2=0x7f739c19a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:41.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.526+0000 7f73a1864640 1 --2- 172.21.15.7:0/1406527754 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f739c102a90 0x7f739c19a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:41.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.526+0000 7f73a1864640 1 -- 172.21.15.7:0/1406527754 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f739c108d20 msgr2=0x7f739c19fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:41.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.526+0000 7f73a1864640 1 --2- 172.21.15.7:0/1406527754 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f739c108d20 0x7f739c19fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:41.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.526+0000 7f73a1864640 1 -- 172.21.15.7:0/1406527754 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f739c1a0360 con 0x7f739c1083d0 2024-09-21T06:35:41.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.526+0000 7f73a1864640 1 --2- 172.21.15.7:0/1406527754 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f739c1083d0 0x7f739c19a990 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f738c00d770 tx=0x7f738c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:41.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.526+0000 7f73937fe640 1 -- 172.21.15.7:0/1406527754 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f738c017070 con 0x7f739c1083d0 2024-09-21T06:35:41.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.526+0000 7f73a42c9640 1 -- 172.21.15.7:0/1406527754 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f739c1a0650 con 0x7f739c1083d0 2024-09-21T06:35:41.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.526+0000 7f73937fe640 1 -- 172.21.15.7:0/1406527754 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f738c009c30 con 0x7f739c1083d0 2024-09-21T06:35:41.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.526+0000 7f73937fe640 1 -- 172.21.15.7:0/1406527754 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f738c00f620 con 0x7f739c1083d0 2024-09-21T06:35:41.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.526+0000 7f73a42c9640 1 -- 172.21.15.7:0/1406527754 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f739c1a6db0 con 0x7f739c1083d0 2024-09-21T06:35:41.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.529+0000 7f73937fe640 1 -- 172.21.15.7:0/1406527754 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154579+0+0 (secure 0 0 0) 0x7f738c01a070 con 0x7f739c1083d0 2024-09-21T06:35:41.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.529+0000 7f73aa83d740 1 Processor -- start 2024-09-21T06:35:41.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.529+0000 7f73aa83d740 1 -- start start 2024-09-21T06:35:41.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.529+0000 7f73aa83d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5578715c7f60 0x55787196df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:41.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.529+0000 7f73aa83d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55787159f0a0 0x55787196e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:41.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.529+0000 7f73aa83d740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5578715a7280 0x55787196e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:41.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.529+0000 7f73aa83d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5578718e5c10 con 0x55787159f0a0 2024-09-21T06:35:41.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.529+0000 7f73aa83d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5578718d5040 con 0x5578715c7f60 2024-09-21T06:35:41.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.529+0000 7f73aa83d740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5578718d8e50 con 0x5578715a7280 2024-09-21T06:35:41.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.530+0000 7f73a2065640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55787159f0a0 0x55787196e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:41.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.530+0000 7f73a2065640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55787159f0a0 0x55787196e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40914/0 (socket says 172.21.15.7:40914) 2024-09-21T06:35:41.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.530+0000 7f73a2065640 1 -- 172.21.15.7:0/915232615 learned_addr learned my addr 172.21.15.7:0/915232615 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:35:41.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.530+0000 7f73a2866640 1 --2- 172.21.15.7:0/915232615 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5578715c7f60 0x55787196df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:41.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.530+0000 7f73a1864640 1 --2- 172.21.15.7:0/915232615 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5578715a7280 0x55787196e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:41.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.530+0000 7f73937fe640 1 --2- 172.21.15.7:0/1406527754 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f73880b65f0 0x7f73880b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:41.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.530+0000 7f73a2065640 1 -- 172.21.15.7:0/915232615 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5578715a7280 msgr2=0x55787196e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:41.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.530+0000 7f73a2065640 1 --2- 172.21.15.7:0/915232615 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5578715a7280 0x55787196e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:41.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.530+0000 7f73a2065640 1 -- 172.21.15.7:0/915232615 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5578715c7f60 msgr2=0x55787196df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:41.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.530+0000 7f73a2065640 1 --2- 172.21.15.7:0/915232615 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5578715c7f60 0x55787196df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:41.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.530+0000 7f73a2065640 1 -- 172.21.15.7:0/915232615 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557871633540 con 0x55787159f0a0 2024-09-21T06:35:41.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.530+0000 7f73a2866640 1 --2- 172.21.15.7:0/915232615 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5578715c7f60 0x55787196df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:35:41.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.530+0000 7f73a1864640 1 --2- 172.21.15.7:0/915232615 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5578715a7280 0x55787196e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:35:41.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.530+0000 7f73a2866640 1 --2- 172.21.15.7:0/1406527754 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f73880b65f0 0x7f73880b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:41.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.530+0000 7f73937fe640 1 -- 172.21.15.7:0/1406527754 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f738c0e7010 con 0x7f739c1083d0 2024-09-21T06:35:41.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.530+0000 7f73a2065640 1 --2- 172.21.15.7:0/915232615 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55787159f0a0 0x55787196e440 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f739800b790 tx=0x7f739800bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e04f25e25747518c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:41.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.531+0000 7f7390d9a640 1 -- 172.21.15.7:0/915232615 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7398003dd0 con 0x55787159f0a0 2024-09-21T06:35:41.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.531+0000 7f7390d9a640 1 -- 172.21.15.7:0/915232615 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7398015070 con 0x55787159f0a0 2024-09-21T06:35:41.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.531+0000 7f7390d9a640 1 -- 172.21.15.7:0/915232615 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7398004e10 con 0x55787159f0a0 2024-09-21T06:35:41.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.532+0000 7f73a2866640 1 --2- 172.21.15.7:0/1406527754 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f73880b65f0 0x7f73880b8b00 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7394006010 tx=0x7f73940095c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:41.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.532+0000 7f73aa83d740 1 -- 172.21.15.7:0/915232615 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55787159f0a0 msgr2=0x55787196e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:41.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.532+0000 7f73aa83d740 1 --2- 172.21.15.7:0/915232615 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55787159f0a0 0x55787196e440 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f739800b790 tx=0x7f739800bc50 comp rx=0 tx=0).stop 2024-09-21T06:35:41.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.532+0000 7f73aa83d740 1 -- 172.21.15.7:0/915232615 shutdown_connections 2024-09-21T06:35:41.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.532+0000 7f73aa83d740 1 --2- 172.21.15.7:0/915232615 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5578715a7280 0x55787196e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:41.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.532+0000 7f73aa83d740 1 --2- 172.21.15.7:0/915232615 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55787159f0a0 0x55787196e440 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:41.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.532+0000 7f73aa83d740 1 --2- 172.21.15.7:0/915232615 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5578715c7f60 0x55787196df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:41.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.532+0000 7f73aa83d740 1 -- 172.21.15.7:0/915232615 >> 172.21.15.7:0/915232615 conn(0x5578715bc350 msgr2=0x55787196bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:41.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.532+0000 7f73aa83d740 1 -- 172.21.15.7:0/915232615 shutdown_connections 2024-09-21T06:35:41.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.532+0000 7f73aa83d740 1 -- 172.21.15.7:0/915232615 wait complete. 2024-09-21T06:35:41.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.532+0000 7f73aa83d740 1 -- start start 2024-09-21T06:35:41.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.532+0000 7f73aa83d740 1 Processor -- start 2024-09-21T06:35:41.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.533+0000 7f73aa83d740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55787159f0a0 0x55787197db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:41.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.533+0000 7f73aa83d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5578715a7280 0x55787197e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:41.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.533+0000 7f73aa83d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578715c7f60 0x557871989d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:41.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.533+0000 7f73aa83d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5578717365f0 con 0x5578715c7f60 2024-09-21T06:35:41.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.533+0000 7f73aa83d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x557871870010 con 0x5578715a7280 2024-09-21T06:35:41.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.533+0000 7f73aa83d740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x557871980a10 con 0x55787159f0a0 2024-09-21T06:35:41.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.533+0000 7f73aa83d740 10 client.0 _ll_register_callbacks cb 0x5578718cf340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:35:41.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.533+0000 7f73a2866640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578715c7f60 0x557871989d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:41.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.533+0000 7f73a2065640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55787159f0a0 0x55787197db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:41.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.533+0000 7f73a2866640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578715c7f60 0x557871989d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40930/0 (socket says 172.21.15.7:40930) 2024-09-21T06:35:41.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.533+0000 7f73a2866640 1 -- 172.21.15.7:0/3069327856 learned_addr learned my addr 172.21.15.7:0/3069327856 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:35:41.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.533+0000 7f73a1864640 1 --2- 172.21.15.7:0/3069327856 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5578715a7280 0x55787197e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:41.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.533+0000 7f73a2065640 1 -- 172.21.15.7:0/3069327856 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5578715a7280 msgr2=0x55787197e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:41.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.533+0000 7f73a2065640 1 --2- 172.21.15.7:0/3069327856 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5578715a7280 0x55787197e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:41.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.533+0000 7f73a2065640 1 -- 172.21.15.7:0/3069327856 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578715c7f60 msgr2=0x557871989d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:41.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.533+0000 7f73a2065640 1 --2- 172.21.15.7:0/3069327856 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578715c7f60 0x557871989d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:41.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.533+0000 7f73a2065640 1 -- 172.21.15.7:0/3069327856 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55787189da00 con 0x55787159f0a0 2024-09-21T06:35:41.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.533+0000 7f73a2866640 1 --2- 172.21.15.7:0/3069327856 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578715c7f60 0x557871989d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:35:41.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.533+0000 7f73a2065640 1 --2- 172.21.15.7:0/3069327856 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55787159f0a0 0x55787197db80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f739800b760 tx=0x7f7398004440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=caa7133b9326620f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:41.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.533+0000 7f7385ffb640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-21T06:35:41.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.534+0000 7f7385ffb640 1 -- 172.21.15.7:0/3069327856 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7398003ea0 con 0x55787159f0a0 2024-09-21T06:35:41.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.534+0000 7f73aa83d740 1 -- 172.21.15.7:0/3069327856 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7398015070 con 0x55787159f0a0 2024-09-21T06:35:41.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.534+0000 7f7385ffb640 1 -- 172.21.15.7:0/3069327856 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f7398011440 con 0x55787159f0a0 2024-09-21T06:35:41.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.534+0000 7f7385ffb640 1 -- 172.21.15.7:0/3069327856 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f7398029020 con 0x55787159f0a0 2024-09-21T06:35:41.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.534+0000 7f73aa83d740 10 client.24958 fetch_fsmap learned FSMap version 24 2024-09-21T06:35:41.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.534+0000 7f73aa83d740 1 -- 172.21.15.7:0/3069327856 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55787198c940 con 0x55787159f0a0 2024-09-21T06:35:41.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.534+0000 7f7385ffb640 1 -- 172.21.15.7:0/3069327856 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7398015070 con 0x55787159f0a0 2024-09-21T06:35:41.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.534+0000 7f7385ffb640 1 -- 172.21.15.7:0/3069327856 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f739802e790 con 0x55787159f0a0 2024-09-21T06:35:41.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.534+0000 7f73aa83d740 10 client.24958 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T06:35:41.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.534+0000 7f73aa83d740 10 client.24958 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-21T06:35:41.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.534+0000 7f73aa83d740 20 client.24958 populate_metadata read hostname 'smithi007' 2024-09-21T06:35:41.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.535+0000 7f73aa83d740 1 --2- 172.21.15.7:0/3069327856 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x5578715868e0 0x55787198ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:41.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.535+0000 7f73aa83d740 4 client.24958 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:35:41.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.535+0000 7f73aa83d740 1 -- 172.21.15.7:0/3069327856 --> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5578718e7b60 con 0x5578715868e0 2024-09-21T06:35:41.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.535+0000 7f73a1864640 1 --2- 172.21.15.7:0/3069327856 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x5578715868e0 0x55787198ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:41.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.535+0000 7f73a1864640 1 --2- 172.21.15.7:0/3069327856 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x5578715868e0 0x55787198ffb0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=588053ff401567bc server_cookie=a3dbdc125f2d8878 in_seq=0 out_seq=0 2024-09-21T06:35:41.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.535+0000 7f7385ffb640 10 client.24958 ms_handle_connect on v2:172.21.15.18:6836/1539670694 2024-09-21T06:35:41.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.536+0000 7f7385ffb640 1 -- 172.21.15.7:0/3069327856 <== mds.2 v2:172.21.15.18:6836/1539670694 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5578718e7b60 con 0x5578715868e0 2024-09-21T06:35:41.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.536+0000 7f7385ffb640 10 client.24958 handle_command_reply: tid=0 2024-09-21T06:35:41.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.536+0000 7f73aa83d740 1 client.24958 shutdown 2024-09-21T06:35:41.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.537+0000 7f73aa83d740 1 -- 172.21.15.7:0/3069327856 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55787159f0a0 msgr2=0x55787197db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:41.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.537+0000 7f73aa83d740 1 --2- 172.21.15.7:0/3069327856 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55787159f0a0 0x55787197db80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f739800b760 tx=0x7f7398004440 comp rx=0 tx=0).stop 2024-09-21T06:35:41.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.537+0000 7f73aa83d740 1 -- 172.21.15.7:0/3069327856 shutdown_connections 2024-09-21T06:35:41.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.537+0000 7f73aa83d740 1 --2- 172.21.15.7:0/3069327856 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x5578715868e0 0x55787198ffb0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:41.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.537+0000 7f73aa83d740 1 --2- 172.21.15.7:0/3069327856 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578715c7f60 0x557871989d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:41.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.537+0000 7f73aa83d740 1 --2- 172.21.15.7:0/3069327856 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5578715a7280 0x55787197e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:41.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.537+0000 7f73aa83d740 1 --2- 172.21.15.7:0/3069327856 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55787159f0a0 0x55787197db80 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:41.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.537+0000 7f7385ffb640 0 client.24958 ms_handle_reset on v2:172.21.15.18:6836/1539670694 2024-09-21T06:35:41.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.537+0000 7f73aa83d740 1 -- 172.21.15.7:0/3069327856 >> 172.21.15.7:0/3069327856 conn(0x5578715bc350 msgr2=0x557871971090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:41.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.537+0000 7f73aa83d740 1 -- 172.21.15.7:0/3069327856 shutdown_connections 2024-09-21T06:35:41.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.537+0000 7f73aa83d740 1 -- 172.21.15.7:0/3069327856 wait complete. 2024-09-21T06:35:41.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.537+0000 7f73aa83d740 20 client.24958 trim_cache size 0 max 16384 2024-09-21T06:35:41.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.555+0000 7f73aa83d740 1 Processor -- start 2024-09-21T06:35:41.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.555+0000 7f73aa83d740 1 -- start start 2024-09-21T06:35:41.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.555+0000 7f73aa83d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55787159f0a0 0x55787196bd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:41.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.555+0000 7f73aa83d740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5578715a7280 0x557871989ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:41.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.555+0000 7f73aa83d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578715c7f60 0x55787198a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:41.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.555+0000 7f73aa83d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55787198e2f0 con 0x5578715c7f60 2024-09-21T06:35:41.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.555+0000 7f73aa83d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55787198e9c0 con 0x55787159f0a0 2024-09-21T06:35:41.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.555+0000 7f73aa83d740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55787198f090 con 0x5578715a7280 2024-09-21T06:35:41.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.555+0000 7f73a2866640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578715c7f60 0x55787198a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:41.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.555+0000 7f73a2866640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578715c7f60 0x55787198a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40936/0 (socket says 172.21.15.7:40936) 2024-09-21T06:35:41.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.555+0000 7f73a2866640 1 -- 172.21.15.7:0/3635468055 learned_addr learned my addr 172.21.15.7:0/3635468055 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:35:41.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.556+0000 7f73a2065640 1 --2- 172.21.15.7:0/3635468055 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55787159f0a0 0x55787196bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:41.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.556+0000 7f73a1864640 1 --2- 172.21.15.7:0/3635468055 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5578715a7280 0x557871989ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:41.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.556+0000 7f73a2866640 1 -- 172.21.15.7:0/3635468055 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5578715a7280 msgr2=0x557871989ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:41.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.556+0000 7f73a2866640 1 --2- 172.21.15.7:0/3635468055 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5578715a7280 0x557871989ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:41.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.556+0000 7f73a2866640 1 -- 172.21.15.7:0/3635468055 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55787159f0a0 msgr2=0x55787196bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:41.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.556+0000 7f73a2866640 1 --2- 172.21.15.7:0/3635468055 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55787159f0a0 0x55787196bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:41.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.556+0000 7f73a2866640 1 -- 172.21.15.7:0/3635468055 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55787197ee40 con 0x5578715c7f60 2024-09-21T06:35:41.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.556+0000 7f73a1864640 1 --2- 172.21.15.7:0/3635468055 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5578715a7280 0x557871989ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:35:41.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.556+0000 7f73a2866640 1 --2- 172.21.15.7:0/3635468055 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578715c7f60 0x55787198a220 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f7394009690 tx=0x7f739403e030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b4f9b184160cca9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:41.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.556+0000 7f7387fff640 1 -- 172.21.15.7:0/3635468055 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7394057070 con 0x5578715c7f60 2024-09-21T06:35:41.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.556+0000 7f7387fff640 1 -- 172.21.15.7:0/3635468055 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7394036040 con 0x5578715c7f60 2024-09-21T06:35:41.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.556+0000 7f7387fff640 1 -- 172.21.15.7:0/3635468055 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7394030ca0 con 0x5578715c7f60 2024-09-21T06:35:41.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.557+0000 7f73aa83d740 1 -- 172.21.15.7:0/3635468055 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578715c7f60 msgr2=0x55787198a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:41.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.557+0000 7f73aa83d740 1 --2- 172.21.15.7:0/3635468055 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578715c7f60 0x55787198a220 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f7394009690 tx=0x7f739403e030 comp rx=0 tx=0).stop 2024-09-21T06:35:41.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.557+0000 7f73aa83d740 1 -- 172.21.15.7:0/3635468055 shutdown_connections 2024-09-21T06:35:41.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.557+0000 7f73aa83d740 1 --2- 172.21.15.7:0/3635468055 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5578715c7f60 0x55787198a220 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:41.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.557+0000 7f73aa83d740 1 --2- 172.21.15.7:0/3635468055 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5578715a7280 0x557871989ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:41.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.557+0000 7f73aa83d740 1 --2- 172.21.15.7:0/3635468055 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55787159f0a0 0x55787196bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:41.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.557+0000 7f73aa83d740 1 -- 172.21.15.7:0/3635468055 >> 172.21.15.7:0/3635468055 conn(0x5578715bc350 msgr2=0x55787196b600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:41.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.557+0000 7f73aa83d740 1 -- 172.21.15.7:0/3635468055 shutdown_connections 2024-09-21T06:35:41.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.557+0000 7f73aa83d740 1 -- 172.21.15.7:0/3635468055 wait complete. 2024-09-21T06:35:41.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.557+0000 7f73aa83d740 1 -- start start 2024-09-21T06:35:41.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.557+0000 7f73aa83d740 1 Processor -- start 2024-09-21T06:35:41.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.558+0000 7f73aa83d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55787159f0a0 0x557871998820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:41.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.558+0000 7f73aa83d740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5578715a7280 0x557871991cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:41.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.558+0000 7f73aa83d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5578715c7f60 0x557871992210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:41.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.558+0000 7f73aa83d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55787198fe30 con 0x55787159f0a0 2024-09-21T06:35:41.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.558+0000 7f73aa83d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55787198f760 con 0x5578715c7f60 2024-09-21T06:35:41.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.558+0000 7f73aa83d740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x557871990500 con 0x5578715a7280 2024-09-21T06:35:41.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.558+0000 7f73aa83d740 10 client.0 _ll_register_callbacks cb 0x7f7394009360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:35:41.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.558+0000 7f73a2065640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55787159f0a0 0x557871998820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:41.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.558+0000 7f73a2065640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55787159f0a0 0x557871998820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40942/0 (socket says 172.21.15.7:40942) 2024-09-21T06:35:41.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.558+0000 7f73a2065640 1 -- 172.21.15.7:0/3161036995 learned_addr learned my addr 172.21.15.7:0/3161036995 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:35:41.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.558+0000 7f73a2866640 1 --2- 172.21.15.7:0/3161036995 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5578715c7f60 0x557871992210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:41.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.558+0000 7f73a1864640 1 --2- 172.21.15.7:0/3161036995 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5578715a7280 0x557871991cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:41.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.558+0000 7f73a2065640 1 -- 172.21.15.7:0/3161036995 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5578715a7280 msgr2=0x557871991cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:41.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.558+0000 7f73a2065640 1 --2- 172.21.15.7:0/3161036995 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5578715a7280 0x557871991cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:41.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.558+0000 7f73a2065640 1 -- 172.21.15.7:0/3161036995 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5578715c7f60 msgr2=0x557871992210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:41.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.558+0000 7f73a2065640 1 --2- 172.21.15.7:0/3161036995 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5578715c7f60 0x557871992210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:41.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.558+0000 7f73a2065640 1 -- 172.21.15.7:0/3161036995 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557871992780 con 0x55787159f0a0 2024-09-21T06:35:41.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.558+0000 7f73a1864640 1 --2- 172.21.15.7:0/3161036995 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5578715a7280 0x557871991cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:35:41.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.558+0000 7f73a2065640 1 --2- 172.21.15.7:0/3161036995 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55787159f0a0 0x557871998820 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f739800b520 tx=0x7f7398004120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b125a64e78ff0117 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:41.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.558+0000 7f7385ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:35:41.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.559+0000 7f7385ffb640 1 -- 172.21.15.7:0/3161036995 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7398034070 con 0x55787159f0a0 2024-09-21T06:35:41.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.559+0000 7f7385ffb640 1 -- 172.21.15.7:0/3161036995 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f739802e640 con 0x55787159f0a0 2024-09-21T06:35:41.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.559+0000 7f73aa83d740 1 -- 172.21.15.7:0/3161036995 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7394036040 con 0x55787159f0a0 2024-09-21T06:35:41.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.559+0000 7f7385ffb640 1 -- 172.21.15.7:0/3161036995 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f739803d020 con 0x55787159f0a0 2024-09-21T06:35:41.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.559+0000 7f73aa83d740 10 client.15204 fetch_fsmap learned FSMap version 24 2024-09-21T06:35:41.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.559+0000 7f73aa83d740 1 -- 172.21.15.7:0/3161036995 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x557871998140 con 0x55787159f0a0 2024-09-21T06:35:41.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.559+0000 7f7385ffb640 1 -- 172.21.15.7:0/3161036995 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7394036040 con 0x55787159f0a0 2024-09-21T06:35:41.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.559+0000 7f7385ffb640 1 -- 172.21.15.7:0/3161036995 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f7398011440 con 0x55787159f0a0 2024-09-21T06:35:41.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.559+0000 7f73aa83d740 10 client.15204 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T06:35:41.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.559+0000 7f73aa83d740 10 client.15204 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-21T06:35:41.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.559+0000 7f73aa83d740 20 client.15204 populate_metadata read hostname 'smithi007' 2024-09-21T06:35:41.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.559+0000 7f73aa83d740 1 --2- 172.21.15.7:0/3161036995 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x55787155bc90 0x5578719fe880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:41.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.559+0000 7f73aa83d740 4 client.15204 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T06:35:41.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.559+0000 7f73aa83d740 1 -- 172.21.15.7:0/3161036995 --> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] -- command(tid 0: {"prefix": "status"}) -- 0x5578718e3610 con 0x55787155bc90 2024-09-21T06:35:41.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.560+0000 7f73a1864640 1 --2- 172.21.15.7:0/3161036995 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x55787155bc90 0x5578719fe880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:41.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.560+0000 7f7385ffb640 10 client.15204 ms_handle_connect on v2:172.21.15.18:6836/1539670694 2024-09-21T06:35:41.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.560+0000 7f73a1864640 1 --2- 172.21.15.7:0/3161036995 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x55787155bc90 0x5578719fe880 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1d29f540e6a1875b server_cookie=2cc65d4ff3179a5a in_seq=0 out_seq=0 2024-09-21T06:35:41.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.560+0000 7f7385ffb640 1 -- 172.21.15.7:0/3161036995 <== mds.2 v2:172.21.15.18:6836/1539670694 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5578718e3610 con 0x55787155bc90 2024-09-21T06:35:41.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.560+0000 7f7385ffb640 10 client.15204 handle_command_reply: tid=0 2024-09-21T06:35:41.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.560+0000 7f73aa83d740 1 client.15204 shutdown 2024-09-21T06:35:41.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.560+0000 7f73aa83d740 1 -- 172.21.15.7:0/3161036995 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55787159f0a0 msgr2=0x557871998820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:41.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.560+0000 7f73aa83d740 1 --2- 172.21.15.7:0/3161036995 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55787159f0a0 0x557871998820 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f739800b520 tx=0x7f7398004120 comp rx=0 tx=0).stop 2024-09-21T06:35:41.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.560+0000 7f73aa83d740 1 -- 172.21.15.7:0/3161036995 shutdown_connections 2024-09-21T06:35:41.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.560+0000 7f73aa83d740 1 --2- 172.21.15.7:0/3161036995 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x55787155bc90 0x5578719fe880 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:41.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.560+0000 7f73aa83d740 1 --2- 172.21.15.7:0/3161036995 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5578715c7f60 0x557871992210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:41.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.560+0000 7f73aa83d740 1 --2- 172.21.15.7:0/3161036995 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5578715a7280 0x557871991cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:41.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.560+0000 7f7385ffb640 0 client.15204 ms_handle_reset on v2:172.21.15.18:6836/1539670694 2024-09-21T06:35:41.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.560+0000 7f73aa83d740 1 --2- 172.21.15.7:0/3161036995 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55787159f0a0 0x557871998820 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:41.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.560+0000 7f73aa83d740 1 -- 172.21.15.7:0/3161036995 >> 172.21.15.7:0/3161036995 conn(0x5578715bc350 msgr2=0x55787197d930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:41.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.561+0000 7f73aa83d740 1 -- 172.21.15.7:0/3161036995 shutdown_connections 2024-09-21T06:35:41.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.561+0000 7f73aa83d740 1 -- 172.21.15.7:0/3161036995 wait complete. 2024-09-21T06:35:41.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.561+0000 7f73aa83d740 20 client.15204 trim_cache size 0 max 16384 2024-09-21T06:35:41.568 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:35:41.568 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "347cb918-77e2-11ef-baf5-efdc52797490", 2024-09-21T06:35:41.568 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 2, 2024-09-21T06:35:41.568 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 24686, 2024-09-21T06:35:41.568 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-09-21T06:35:41.568 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-09-21T06:35:41.569 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-09-21T06:35:41.569 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 68.579167128999998, 2024-09-21T06:35:41.569 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 24, 2024-09-21T06:35:41.569 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 77, 2024-09-21T06:35:41.569 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 75, 2024-09-21T06:35:41.569 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 98.385255916999995 2024-09-21T06:35:41.569 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:35:41.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.561+0000 7f73a42c9640 1 -- 172.21.15.7:0/1406527754 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f73880b65f0 msgr2=0x7f73880b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:41.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.561+0000 7f73a42c9640 1 --2- 172.21.15.7:0/1406527754 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f73880b65f0 0x7f73880b8b00 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7394006010 tx=0x7f73940095c0 comp rx=0 tx=0).stop 2024-09-21T06:35:41.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.561+0000 7f73a42c9640 1 -- 172.21.15.7:0/1406527754 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f739c1083d0 msgr2=0x7f739c19a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:41.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.561+0000 7f73a42c9640 1 --2- 172.21.15.7:0/1406527754 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f739c1083d0 0x7f739c19a990 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f738c00d770 tx=0x7f738c00dc30 comp rx=0 tx=0).stop 2024-09-21T06:35:41.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.561+0000 7f73a42c9640 1 -- 172.21.15.7:0/1406527754 shutdown_connections 2024-09-21T06:35:41.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.561+0000 7f73a42c9640 1 --2- 172.21.15.7:0/1406527754 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f73880b65f0 0x7f73880b8b00 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:41.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.561+0000 7f73a42c9640 1 --2- 172.21.15.7:0/1406527754 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f739c108d20 0x7f739c19fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:41.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.561+0000 7f73a42c9640 1 --2- 172.21.15.7:0/1406527754 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f739c1083d0 0x7f739c19a990 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:41.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.561+0000 7f73a42c9640 1 --2- 172.21.15.7:0/1406527754 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f739c102a90 0x7f739c19a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:41.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.561+0000 7f73a42c9640 1 -- 172.21.15.7:0/1406527754 >> 172.21.15.7:0/1406527754 conn(0x7f739c079750 msgr2=0x7f739c104340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:41.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.561+0000 7f73a42c9640 1 -- 172.21.15.7:0/1406527754 shutdown_connections 2024-09-21T06:35:41.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:41.561+0000 7f73a42c9640 1 -- 172.21.15.7:0/1406527754 wait complete. 2024-09-21T06:35:42.292 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.i status 2024-09-21T06:35:42.547 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:42.852 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:35:42 smithi007 ceph-mon[30983]: pgmap v304: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:35:42.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:35:42 smithi018 ceph-mon[34477]: pgmap v304: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:35:43.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:35:42 smithi144 ceph-mon[34653]: pgmap v304: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:35:43.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.069+0000 7ff6292e9640 1 -- 172.21.15.7:0/501619024 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff624108d20 msgr2=0x7ff62410f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:43.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.069+0000 7ff6292e9640 1 --2- 172.21.15.7:0/501619024 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff624108d20 0x7ff62410f550 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ff61c009ca0 tx=0x7ff61c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:35:43.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.069+0000 7ff6292e9640 1 -- 172.21.15.7:0/501619024 shutdown_connections 2024-09-21T06:35:43.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.069+0000 7ff6292e9640 1 --2- 172.21.15.7:0/501619024 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff624108d20 0x7ff62410f550 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:43.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.069+0000 7ff6292e9640 1 --2- 172.21.15.7:0/501619024 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6241083d0 0x7ff6241087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:43.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.069+0000 7ff6292e9640 1 --2- 172.21.15.7:0/501619024 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff624102ae0 0x7ff624102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:43.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.069+0000 7ff6292e9640 1 -- 172.21.15.7:0/501619024 >> 172.21.15.7:0/501619024 conn(0x7ff624079760 msgr2=0x7ff624079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:43.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.069+0000 7ff6292e9640 1 -- 172.21.15.7:0/501619024 shutdown_connections 2024-09-21T06:35:43.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.069+0000 7ff6292e9640 1 -- 172.21.15.7:0/501619024 wait complete. 2024-09-21T06:35:43.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.070+0000 7ff6292e9640 1 Processor -- start 2024-09-21T06:35:43.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.070+0000 7ff6292e9640 1 -- start start 2024-09-21T06:35:43.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.070+0000 7ff6292e9640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff624102ae0 0x7ff62419c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:43.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.070+0000 7ff6292e9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff6241083d0 0x7ff62419cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:43.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.070+0000 7ff6292e9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff624108d20 0x7ff6241a1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:43.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.070+0000 7ff6292e9640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff6241129e0 con 0x7ff624108d20 2024-09-21T06:35:43.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.070+0000 7ff6292e9640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff624112860 con 0x7ff6241083d0 2024-09-21T06:35:43.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.070+0000 7ff6292e9640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff624112b60 con 0x7ff624102ae0 2024-09-21T06:35:43.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.070+0000 7ff6237fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff624108d20 0x7ff6241a1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:43.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.070+0000 7ff6237fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff624108d20 0x7ff6241a1e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40962/0 (socket says 172.21.15.7:40962) 2024-09-21T06:35:43.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.070+0000 7ff6237fe640 1 -- 172.21.15.7:0/1058865748 learned_addr learned my addr 172.21.15.7:0/1058865748 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:35:43.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.070+0000 7ff6227fc640 1 --2- 172.21.15.7:0/1058865748 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff6241083d0 0x7ff62419cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:43.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.071+0000 7ff6237fe640 1 -- 172.21.15.7:0/1058865748 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff624102ae0 msgr2=0x7ff62419c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:43.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.071+0000 7ff6237fe640 1 --2- 172.21.15.7:0/1058865748 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff624102ae0 0x7ff62419c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:43.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.071+0000 7ff6237fe640 1 -- 172.21.15.7:0/1058865748 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff6241083d0 msgr2=0x7ff62419cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:43.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.071+0000 7ff6237fe640 1 --2- 172.21.15.7:0/1058865748 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff6241083d0 0x7ff62419cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:43.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.071+0000 7ff6237fe640 1 -- 172.21.15.7:0/1058865748 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6241a2570 con 0x7ff624108d20 2024-09-21T06:35:43.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.071+0000 7ff6237fe640 1 --2- 172.21.15.7:0/1058865748 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff624108d20 0x7ff6241a1e40 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7ff61c031a20 tx=0x7ff61c031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:43.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.071+0000 7ff60bfff640 1 -- 172.21.15.7:0/1058865748 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff61c003d30 con 0x7ff624108d20 2024-09-21T06:35:43.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.071+0000 7ff60bfff640 1 -- 172.21.15.7:0/1058865748 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff61c0044f0 con 0x7ff624108d20 2024-09-21T06:35:43.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.071+0000 7ff6292e9640 1 -- 172.21.15.7:0/1058865748 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6241a2800 con 0x7ff624108d20 2024-09-21T06:35:43.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.071+0000 7ff60bfff640 1 -- 172.21.15.7:0/1058865748 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff61c02fd90 con 0x7ff624108d20 2024-09-21T06:35:43.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.071+0000 7ff6292e9640 1 -- 172.21.15.7:0/1058865748 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6241a8fc0 con 0x7ff624108d20 2024-09-21T06:35:43.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.074+0000 7ff62f85d740 1 Processor -- start 2024-09-21T06:35:43.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.074+0000 7ff60bfff640 1 -- 172.21.15.7:0/1058865748 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154579+0+0 (secure 0 0 0) 0x7ff61c004040 con 0x7ff624108d20 2024-09-21T06:35:43.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.074+0000 7ff62f85d740 1 -- start start 2024-09-21T06:35:43.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.074+0000 7ff62f85d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55880f50df60 0x55880f8b3f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:43.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.074+0000 7ff62f85d740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55880f4e50a0 0x55880f8b4440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:43.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.074+0000 7ff62f85d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55880f4ed280 0x55880f8b4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:43.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.074+0000 7ff62f85d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55880f82bc10 con 0x55880f4ed280 2024-09-21T06:35:43.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.074+0000 7ff62f85d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55880f81b040 con 0x55880f50df60 2024-09-21T06:35:43.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.074+0000 7ff62f85d740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55880f81ee50 con 0x55880f4e50a0 2024-09-21T06:35:43.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.074+0000 7ff6227fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55880f4ed280 0x55880f8b4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:43.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.074+0000 7ff6227fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55880f4ed280 0x55880f8b4980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40976/0 (socket says 172.21.15.7:40976) 2024-09-21T06:35:43.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.074+0000 7ff6227fc640 1 -- 172.21.15.7:0/3812982744 learned_addr learned my addr 172.21.15.7:0/3812982744 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:35:43.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.075+0000 7ff622ffd640 1 --2- 172.21.15.7:0/3812982744 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55880f4e50a0 0x55880f8b4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:43.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.075+0000 7ff6227fc640 1 --2- 172.21.15.7:0/3812982744 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55880f50df60 0x55880f8b3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:43.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.075+0000 7ff6227fc640 1 -- 172.21.15.7:0/3812982744 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55880f4e50a0 msgr2=0x55880f8b4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:43.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.075+0000 7ff6227fc640 1 --2- 172.21.15.7:0/3812982744 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55880f4e50a0 0x55880f8b4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:43.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.075+0000 7ff6227fc640 1 -- 172.21.15.7:0/3812982744 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55880f50df60 msgr2=0x55880f8b3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:43.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.075+0000 7ff6227fc640 1 --2- 172.21.15.7:0/3812982744 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55880f50df60 0x55880f8b3f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:43.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.075+0000 7ff60bfff640 1 --2- 172.21.15.7:0/1058865748 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7ff60c0b65f0 0x7ff60c0b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:43.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.075+0000 7ff6227fc640 1 -- 172.21.15.7:0/3812982744 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55880f579540 con 0x55880f4ed280 2024-09-21T06:35:43.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.075+0000 7ff6237fe640 1 --2- 172.21.15.7:0/1058865748 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7ff60c0b65f0 0x7ff60c0b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:43.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.075+0000 7ff6227fc640 1 --2- 172.21.15.7:0/3812982744 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55880f4ed280 0x55880f8b4980 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7ff618011700 tx=0x7ff61800a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59d67772371f8159 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:43.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.075+0000 7ff60bfff640 1 -- 172.21.15.7:0/1058865748 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7ff61c108c20 con 0x7ff624108d20 2024-09-21T06:35:43.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.075+0000 7ff6097fa640 1 -- 172.21.15.7:0/3812982744 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff618004020 con 0x55880f4ed280 2024-09-21T06:35:43.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.075+0000 7ff6097fa640 1 -- 172.21.15.7:0/3812982744 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff6180054d0 con 0x55880f4ed280 2024-09-21T06:35:43.079 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.075+0000 7ff6097fa640 1 -- 172.21.15.7:0/3812982744 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff618004a30 con 0x55880f4ed280 2024-09-21T06:35:43.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.076+0000 7ff6237fe640 1 --2- 172.21.15.7:0/1058865748 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7ff60c0b65f0 0x7ff60c0b8b00 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff61c0cbed0 tx=0x7ff61c09ba20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:43.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.076+0000 7ff62f85d740 1 -- 172.21.15.7:0/3812982744 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55880f4ed280 msgr2=0x55880f8b4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:43.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.076+0000 7ff62f85d740 1 --2- 172.21.15.7:0/3812982744 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55880f4ed280 0x55880f8b4980 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7ff618011700 tx=0x7ff61800a680 comp rx=0 tx=0).stop 2024-09-21T06:35:43.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.076+0000 7ff62f85d740 1 -- 172.21.15.7:0/3812982744 shutdown_connections 2024-09-21T06:35:43.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.076+0000 7ff62f85d740 1 --2- 172.21.15.7:0/3812982744 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55880f4ed280 0x55880f8b4980 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:43.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.076+0000 7ff62f85d740 1 --2- 172.21.15.7:0/3812982744 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55880f4e50a0 0x55880f8b4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:43.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.076+0000 7ff62f85d740 1 --2- 172.21.15.7:0/3812982744 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55880f50df60 0x55880f8b3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:43.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.076+0000 7ff62f85d740 1 -- 172.21.15.7:0/3812982744 >> 172.21.15.7:0/3812982744 conn(0x55880f502350 msgr2=0x55880f8b1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:43.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.076+0000 7ff62f85d740 1 -- 172.21.15.7:0/3812982744 shutdown_connections 2024-09-21T06:35:43.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.076+0000 7ff62f85d740 1 -- 172.21.15.7:0/3812982744 wait complete. 2024-09-21T06:35:43.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.077+0000 7ff62f85d740 1 -- start start 2024-09-21T06:35:43.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.077+0000 7ff62f85d740 1 Processor -- start 2024-09-21T06:35:43.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.077+0000 7ff62f85d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55880f4e50a0 0x55880f8bf990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:43.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.077+0000 7ff62f85d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55880f4ed280 0x55880f8bfed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:43.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.077+0000 7ff62f85d740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55880f50df60 0x55880f8cba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:43.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.077+0000 7ff62f85d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55880f67c5f0 con 0x55880f4ed280 2024-09-21T06:35:43.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.077+0000 7ff62f85d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55880f7b6010 con 0x55880f4e50a0 2024-09-21T06:35:43.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.077+0000 7ff62f85d740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55880f8c26e0 con 0x55880f50df60 2024-09-21T06:35:43.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.077+0000 7ff62f85d740 10 client.0 _ll_register_callbacks cb 0x55880f815340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:35:43.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.077+0000 7ff622ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55880f4ed280 0x55880f8bfed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:43.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.077+0000 7ff6227fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55880f4e50a0 0x55880f8bf990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:43.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.077+0000 7ff622ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55880f4ed280 0x55880f8bfed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40992/0 (socket says 172.21.15.7:40992) 2024-09-21T06:35:43.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.077+0000 7ff622ffd640 1 -- 172.21.15.7:0/1630754679 learned_addr learned my addr 172.21.15.7:0/1630754679 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:35:43.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.077+0000 7ff6227fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55880f4e50a0 0x55880f8bf990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.7:48470/0 (socket says 172.21.15.7:48470) 2024-09-21T06:35:43.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.078+0000 7ff6227fc640 1 --2- 172.21.15.7:0/1630754679 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55880f50df60 0x55880f8cba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:43.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.078+0000 7ff622ffd640 1 -- 172.21.15.7:0/1630754679 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55880f50df60 msgr2=0x55880f8cba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:43.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.078+0000 7ff622ffd640 1 --2- 172.21.15.7:0/1630754679 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55880f50df60 0x55880f8cba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:43.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.078+0000 7ff622ffd640 1 -- 172.21.15.7:0/1630754679 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55880f4e50a0 msgr2=0x55880f8bf990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:43.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.078+0000 7ff622ffd640 1 --2- 172.21.15.7:0/1630754679 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55880f4e50a0 0x55880f8bf990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:43.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.078+0000 7ff622ffd640 1 -- 172.21.15.7:0/1630754679 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55880f7e3a00 con 0x55880f4ed280 2024-09-21T06:35:43.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.078+0000 7ff6227fc640 1 --2- 172.21.15.7:0/1630754679 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55880f4e50a0 0x55880f8bf990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:35:43.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.078+0000 7ff622ffd640 1 --2- 172.21.15.7:0/1630754679 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55880f4ed280 0x55880f8bfed0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7ff61400f640 tx=0x7ff61400af90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6dd1c05414456fa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:43.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.078+0000 7ff606ff5640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:35:43.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.078+0000 7ff606ff5640 1 -- 172.21.15.7:0/1630754679 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff614004220 con 0x55880f4ed280 2024-09-21T06:35:43.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.078+0000 7ff606ff5640 1 -- 172.21.15.7:0/1630754679 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7ff6140043c0 con 0x55880f4ed280 2024-09-21T06:35:43.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.078+0000 7ff62f85d740 1 -- 172.21.15.7:0/1630754679 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff6180054d0 con 0x55880f4ed280 2024-09-21T06:35:43.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.078+0000 7ff606ff5640 1 -- 172.21.15.7:0/1630754679 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff61400d850 con 0x55880f4ed280 2024-09-21T06:35:43.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.078+0000 7ff62f85d740 10 client.15216 fetch_fsmap learned FSMap version 24 2024-09-21T06:35:43.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.078+0000 7ff62f85d740 1 -- 172.21.15.7:0/1630754679 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55880f8ce640 con 0x55880f4ed280 2024-09-21T06:35:43.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.079+0000 7ff606ff5640 1 -- 172.21.15.7:0/1630754679 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff6180054d0 con 0x55880f4ed280 2024-09-21T06:35:43.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.079+0000 7ff606ff5640 1 -- 172.21.15.7:0/1630754679 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7ff614005020 con 0x55880f4ed280 2024-09-21T06:35:43.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.079+0000 7ff62f85d740 10 client.15216 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T06:35:43.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.079+0000 7ff62f85d740 10 client.15216 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T06:35:43.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.079+0000 7ff62f85d740 20 client.15216 populate_metadata read hostname 'smithi007' 2024-09-21T06:35:43.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.079+0000 7ff62f85d740 1 --2- 172.21.15.7:0/1630754679 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x55880f4cc8e0 0x55880f8d2150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:43.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.079+0000 7ff62f85d740 4 client.15216 mds_command: new command op to 24688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:35:43.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.079+0000 7ff62f85d740 1 -- 172.21.15.7:0/1630754679 --> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55880f82db60 con 0x55880f4cc8e0 2024-09-21T06:35:43.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.079+0000 7ff6227fc640 1 --2- 172.21.15.7:0/1630754679 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x55880f4cc8e0 0x55880f8d2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:43.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.080+0000 7ff6227fc640 1 --2- 172.21.15.7:0/1630754679 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x55880f4cc8e0 0x55880f8d2150 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e6abed8ba844cb92 server_cookie=90557cd6779a3919 in_seq=0 out_seq=0 2024-09-21T06:35:43.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.080+0000 7ff606ff5640 10 client.15216 ms_handle_connect on v2:172.21.15.144:6838/4027821922 2024-09-21T06:35:43.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.081+0000 7ff606ff5640 1 -- 172.21.15.7:0/1630754679 <== mds.1 v2:172.21.15.144:6838/4027821922 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55880f82db60 con 0x55880f4cc8e0 2024-09-21T06:35:43.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.081+0000 7ff606ff5640 10 client.15216 handle_command_reply: tid=0 2024-09-21T06:35:43.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.081+0000 7ff62f85d740 1 client.15216 shutdown 2024-09-21T06:35:43.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.081+0000 7ff62f85d740 1 -- 172.21.15.7:0/1630754679 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55880f4ed280 msgr2=0x55880f8bfed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:43.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.081+0000 7ff62f85d740 1 --2- 172.21.15.7:0/1630754679 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55880f4ed280 0x55880f8bfed0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7ff61400f640 tx=0x7ff61400af90 comp rx=0 tx=0).stop 2024-09-21T06:35:43.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.081+0000 7ff62f85d740 1 -- 172.21.15.7:0/1630754679 shutdown_connections 2024-09-21T06:35:43.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.081+0000 7ff62f85d740 1 --2- 172.21.15.7:0/1630754679 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x55880f4cc8e0 0x55880f8d2150 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:43.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.081+0000 7ff62f85d740 1 --2- 172.21.15.7:0/1630754679 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55880f50df60 0x55880f8cba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:43.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.081+0000 7ff62f85d740 1 --2- 172.21.15.7:0/1630754679 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55880f4ed280 0x55880f8bfed0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:43.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.081+0000 7ff62f85d740 1 --2- 172.21.15.7:0/1630754679 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55880f4e50a0 0x55880f8bf990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:43.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.081+0000 7ff62f85d740 1 -- 172.21.15.7:0/1630754679 >> 172.21.15.7:0/1630754679 conn(0x55880f502350 msgr2=0x55880f8b7090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:43.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.081+0000 7ff606ff5640 0 client.15216 ms_handle_reset on v2:172.21.15.144:6838/4027821922 2024-09-21T06:35:43.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.081+0000 7ff62f85d740 1 -- 172.21.15.7:0/1630754679 shutdown_connections 2024-09-21T06:35:43.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.081+0000 7ff62f85d740 1 -- 172.21.15.7:0/1630754679 wait complete. 2024-09-21T06:35:43.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.081+0000 7ff62f85d740 20 client.15216 trim_cache size 0 max 16384 2024-09-21T06:35:43.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.099+0000 7ff62f85d740 1 Processor -- start 2024-09-21T06:35:43.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.099+0000 7ff62f85d740 1 -- start start 2024-09-21T06:35:43.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.100+0000 7ff62f85d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55880f4e50a0 0x55880f8ba020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:43.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.100+0000 7ff62f85d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55880f4ed280 0x55880f8cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:43.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.100+0000 7ff62f85d740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55880f50df60 0x55880f8cbeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:43.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.100+0000 7ff62f85d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55880f8d0490 con 0x55880f4e50a0 2024-09-21T06:35:43.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.100+0000 7ff62f85d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55880f8d0b60 con 0x55880f4ed280 2024-09-21T06:35:43.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.100+0000 7ff62f85d740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55880f8d1230 con 0x55880f50df60 2024-09-21T06:35:43.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.100+0000 7ff6227fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55880f4e50a0 0x55880f8ba020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:43.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.100+0000 7ff6227fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55880f4e50a0 0x55880f8ba020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41006/0 (socket says 172.21.15.7:41006) 2024-09-21T06:35:43.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.100+0000 7ff6227fc640 1 -- 172.21.15.7:0/1070366300 learned_addr learned my addr 172.21.15.7:0/1070366300 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:35:43.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.100+0000 7ff622ffd640 1 --2- 172.21.15.7:0/1070366300 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55880f4ed280 0x55880f8cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:43.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.100+0000 7ff6227fc640 1 -- 172.21.15.7:0/1070366300 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55880f50df60 msgr2=0x55880f8cbeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:43.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.100+0000 7ff6227fc640 1 --2- 172.21.15.7:0/1070366300 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55880f50df60 0x55880f8cbeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:43.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.100+0000 7ff6227fc640 1 -- 172.21.15.7:0/1070366300 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55880f4ed280 msgr2=0x55880f8cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:43.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.100+0000 7ff6227fc640 1 --2- 172.21.15.7:0/1070366300 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55880f4ed280 0x55880f8cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:43.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.100+0000 7ff6227fc640 1 -- 172.21.15.7:0/1070366300 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55880f8b26e0 con 0x55880f4e50a0 2024-09-21T06:35:43.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.100+0000 7ff622ffd640 1 --2- 172.21.15.7:0/1070366300 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55880f4ed280 0x55880f8cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:35:43.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.100+0000 7ff6227fc640 1 --2- 172.21.15.7:0/1070366300 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55880f4e50a0 0x55880f8ba020 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ff618004500 tx=0x7ff6180045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e870992acefc0ee server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:43.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.100+0000 7ff608ff9640 1 -- 172.21.15.7:0/1070366300 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff618004660 con 0x55880f4e50a0 2024-09-21T06:35:43.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.100+0000 7ff608ff9640 1 -- 172.21.15.7:0/1070366300 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff61800fd90 con 0x55880f4e50a0 2024-09-21T06:35:43.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.100+0000 7ff608ff9640 1 -- 172.21.15.7:0/1070366300 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff618030800 con 0x55880f4e50a0 2024-09-21T06:35:43.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.101+0000 7ff62f85d740 1 -- 172.21.15.7:0/1070366300 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55880f4e50a0 msgr2=0x55880f8ba020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:43.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.101+0000 7ff62f85d740 1 --2- 172.21.15.7:0/1070366300 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55880f4e50a0 0x55880f8ba020 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ff618004500 tx=0x7ff6180045d0 comp rx=0 tx=0).stop 2024-09-21T06:35:43.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.101+0000 7ff62f85d740 1 -- 172.21.15.7:0/1070366300 shutdown_connections 2024-09-21T06:35:43.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.101+0000 7ff62f85d740 1 --2- 172.21.15.7:0/1070366300 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55880f50df60 0x55880f8cbeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:43.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.101+0000 7ff62f85d740 1 --2- 172.21.15.7:0/1070366300 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55880f4ed280 0x55880f8cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:43.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.101+0000 7ff62f85d740 1 --2- 172.21.15.7:0/1070366300 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55880f4e50a0 0x55880f8ba020 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:43.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.101+0000 7ff62f85d740 1 -- 172.21.15.7:0/1070366300 >> 172.21.15.7:0/1070366300 conn(0x55880f502350 msgr2=0x55880f8cfb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:43.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.101+0000 7ff62f85d740 1 -- 172.21.15.7:0/1070366300 shutdown_connections 2024-09-21T06:35:43.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.101+0000 7ff62f85d740 1 -- 172.21.15.7:0/1070366300 wait complete. 2024-09-21T06:35:43.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.102+0000 7ff62f85d740 1 -- start start 2024-09-21T06:35:43.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.102+0000 7ff62f85d740 1 Processor -- start 2024-09-21T06:35:43.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.102+0000 7ff62f85d740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55880f4e50a0 0x55880f8dadd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:43.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.102+0000 7ff62f85d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55880f4ed280 0x55880f8d3350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:43.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.102+0000 7ff62f85d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55880f50df60 0x55880f8d3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:43.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.102+0000 7ff62f85d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55880f8d1fd0 con 0x55880f4ed280 2024-09-21T06:35:43.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.102+0000 7ff62f85d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55880f8d1900 con 0x55880f50df60 2024-09-21T06:35:43.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.102+0000 7ff62f85d740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55880f8d26a0 con 0x55880f4e50a0 2024-09-21T06:35:43.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.102+0000 7ff62f85d740 10 client.0 _ll_register_callbacks cb 0x7ff61400a550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:35:43.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.102+0000 7ff622ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55880f4ed280 0x55880f8d3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:43.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.102+0000 7ff622ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55880f4ed280 0x55880f8d3350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41022/0 (socket says 172.21.15.7:41022) 2024-09-21T06:35:43.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.102+0000 7ff622ffd640 1 -- 172.21.15.7:0/1479548253 learned_addr learned my addr 172.21.15.7:0/1479548253 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:35:43.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.102+0000 7ff6227fc640 1 --2- 172.21.15.7:0/1479548253 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55880f50df60 0x55880f8d3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:43.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.102+0000 7ff6227fc640 1 --2- 172.21.15.7:0/1479548253 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55880f4e50a0 0x55880f8dadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:43.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.102+0000 7ff622ffd640 1 -- 172.21.15.7:0/1479548253 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55880f4e50a0 msgr2=0x55880f8dadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:43.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.102+0000 7ff622ffd640 1 --2- 172.21.15.7:0/1479548253 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55880f4e50a0 0x55880f8dadd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:43.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.102+0000 7ff622ffd640 1 -- 172.21.15.7:0/1479548253 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55880f50df60 msgr2=0x55880f8d3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:43.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.102+0000 7ff622ffd640 1 --2- 172.21.15.7:0/1479548253 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55880f50df60 0x55880f8d3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:43.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.103+0000 7ff622ffd640 1 -- 172.21.15.7:0/1479548253 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55880f93b610 con 0x55880f4ed280 2024-09-21T06:35:43.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.103+0000 7ff6227fc640 1 --2- 172.21.15.7:0/1479548253 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55880f4e50a0 0x55880f8dadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:35:43.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.103+0000 7ff622ffd640 1 --2- 172.21.15.7:0/1479548253 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55880f4ed280 0x55880f8d3350 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ff614005510 tx=0x7ff61400dd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23e9b8f2fb347761 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:43.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.103+0000 7ff606ff5640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:35:43.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.103+0000 7ff606ff5640 1 -- 172.21.15.7:0/1479548253 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff614030060 con 0x55880f4ed280 2024-09-21T06:35:43.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.103+0000 7ff606ff5640 1 -- 172.21.15.7:0/1479548253 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7ff614004bf0 con 0x55880f4ed280 2024-09-21T06:35:43.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.103+0000 7ff62f85d740 1 -- 172.21.15.7:0/1479548253 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff61800fd90 con 0x55880f4ed280 2024-09-21T06:35:43.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.103+0000 7ff606ff5640 1 -- 172.21.15.7:0/1479548253 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff614026070 con 0x55880f4ed280 2024-09-21T06:35:43.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.103+0000 7ff62f85d740 10 client.15222 fetch_fsmap learned FSMap version 24 2024-09-21T06:35:43.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.103+0000 7ff62f85d740 1 -- 172.21.15.7:0/1479548253 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55880f93c6a0 con 0x55880f4ed280 2024-09-21T06:35:43.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.103+0000 7ff606ff5640 1 -- 172.21.15.7:0/1479548253 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff61800fd90 con 0x55880f4ed280 2024-09-21T06:35:43.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.103+0000 7ff606ff5640 1 -- 172.21.15.7:0/1479548253 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7ff6140188f0 con 0x55880f4ed280 2024-09-21T06:35:43.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.103+0000 7ff62f85d740 10 client.15222 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T06:35:43.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.104+0000 7ff62f85d740 10 client.15222 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T06:35:43.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.104+0000 7ff62f85d740 20 client.15222 populate_metadata read hostname 'smithi007' 2024-09-21T06:35:43.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.104+0000 7ff62f85d740 1 --2- 172.21.15.7:0/1479548253 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x55880f4a1c90 0x55880f93ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:43.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.104+0000 7ff62f85d740 4 client.15222 mds_command: new command op to 24688 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T06:35:43.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.104+0000 7ff62f85d740 1 -- 172.21.15.7:0/1479548253 --> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] -- command(tid 0: {"prefix": "status"}) -- 0x55880f829610 con 0x55880f4a1c90 2024-09-21T06:35:43.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.104+0000 7ff6227fc640 1 --2- 172.21.15.7:0/1479548253 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x55880f4a1c90 0x55880f93ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:43.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.104+0000 7ff606ff5640 10 client.15222 ms_handle_connect on v2:172.21.15.144:6838/4027821922 2024-09-21T06:35:43.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.104+0000 7ff6227fc640 1 --2- 172.21.15.7:0/1479548253 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x55880f4a1c90 0x55880f93ffc0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f0faf9461620f87 server_cookie=753e878ae3710fb0 in_seq=0 out_seq=0 2024-09-21T06:35:43.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.105+0000 7ff606ff5640 1 -- 172.21.15.7:0/1479548253 <== mds.1 v2:172.21.15.144:6838/4027821922 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55880f829610 con 0x55880f4a1c90 2024-09-21T06:35:43.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.105+0000 7ff606ff5640 10 client.15222 handle_command_reply: tid=0 2024-09-21T06:35:43.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.105+0000 7ff62f85d740 1 client.15222 shutdown 2024-09-21T06:35:43.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.105+0000 7ff62f85d740 1 -- 172.21.15.7:0/1479548253 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55880f4ed280 msgr2=0x55880f8d3350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:43.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.105+0000 7ff62f85d740 1 --2- 172.21.15.7:0/1479548253 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55880f4ed280 0x55880f8d3350 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ff614005510 tx=0x7ff61400dd20 comp rx=0 tx=0).stop 2024-09-21T06:35:43.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.105+0000 7ff62f85d740 1 -- 172.21.15.7:0/1479548253 shutdown_connections 2024-09-21T06:35:43.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.105+0000 7ff62f85d740 1 --2- 172.21.15.7:0/1479548253 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x55880f4a1c90 0x55880f93ffc0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:43.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.105+0000 7ff62f85d740 1 --2- 172.21.15.7:0/1479548253 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55880f50df60 0x55880f8d3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:43.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.105+0000 7ff62f85d740 1 --2- 172.21.15.7:0/1479548253 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55880f4ed280 0x55880f8d3350 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:43.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.105+0000 7ff62f85d740 1 --2- 172.21.15.7:0/1479548253 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55880f4e50a0 0x55880f8dadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:43.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.105+0000 7ff62f85d740 1 -- 172.21.15.7:0/1479548253 >> 172.21.15.7:0/1479548253 conn(0x55880f502350 msgr2=0x55880f8bf970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:43.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.105+0000 7ff606ff5640 0 client.15222 ms_handle_reset on v2:172.21.15.144:6838/4027821922 2024-09-21T06:35:43.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.105+0000 7ff62f85d740 1 -- 172.21.15.7:0/1479548253 shutdown_connections 2024-09-21T06:35:43.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.105+0000 7ff62f85d740 1 -- 172.21.15.7:0/1479548253 wait complete. 2024-09-21T06:35:43.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.105+0000 7ff62f85d740 20 client.15222 trim_cache size 0 max 16384 2024-09-21T06:35:43.113 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:35:43.113 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "347cb918-77e2-11ef-baf5-efdc52797490", 2024-09-21T06:35:43.113 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 1, 2024-09-21T06:35:43.113 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 24688, 2024-09-21T06:35:43.113 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-09-21T06:35:43.113 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-09-21T06:35:43.113 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-09-21T06:35:43.113 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 71.129079185999998, 2024-09-21T06:35:43.113 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 24, 2024-09-21T06:35:43.113 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 77, 2024-09-21T06:35:43.113 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 75, 2024-09-21T06:35:43.114 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 97.397112292000003 2024-09-21T06:35:43.114 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:35:43.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.105+0000 7ff6292e9640 1 -- 172.21.15.7:0/1058865748 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7ff60c0b65f0 msgr2=0x7ff60c0b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:43.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.105+0000 7ff6292e9640 1 --2- 172.21.15.7:0/1058865748 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7ff60c0b65f0 0x7ff60c0b8b00 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff61c0cbed0 tx=0x7ff61c09ba20 comp rx=0 tx=0).stop 2024-09-21T06:35:43.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.106+0000 7ff6292e9640 1 -- 172.21.15.7:0/1058865748 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff624108d20 msgr2=0x7ff6241a1e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:43.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.106+0000 7ff6292e9640 1 --2- 172.21.15.7:0/1058865748 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff624108d20 0x7ff6241a1e40 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7ff61c031a20 tx=0x7ff61c031a50 comp rx=0 tx=0).stop 2024-09-21T06:35:43.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.106+0000 7ff6292e9640 1 -- 172.21.15.7:0/1058865748 shutdown_connections 2024-09-21T06:35:43.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.106+0000 7ff6292e9640 1 --2- 172.21.15.7:0/1058865748 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7ff60c0b65f0 0x7ff60c0b8b00 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:43.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.106+0000 7ff6292e9640 1 --2- 172.21.15.7:0/1058865748 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff624108d20 0x7ff6241a1e40 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:43.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.106+0000 7ff6292e9640 1 --2- 172.21.15.7:0/1058865748 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff6241083d0 0x7ff62419cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:43.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.106+0000 7ff6292e9640 1 --2- 172.21.15.7:0/1058865748 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff624102ae0 0x7ff62419c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:43.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.106+0000 7ff6292e9640 1 -- 172.21.15.7:0/1058865748 >> 172.21.15.7:0/1058865748 conn(0x7ff624079760 msgr2=0x7ff6241042a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:43.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.106+0000 7ff6292e9640 1 -- 172.21.15.7:0/1058865748 shutdown_connections 2024-09-21T06:35:43.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:43.106+0000 7ff6292e9640 1 -- 172.21.15.7:0/1058865748 wait complete. 2024-09-21T06:35:43.796 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.b status 2024-09-21T06:35:44.055 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:44.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.545+0000 7fe2ba464640 1 -- 172.21.15.7:0/2464714803 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2b4102a70 msgr2=0x7fe2b4102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:44.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.545+0000 7fe2ba464640 1 --2- 172.21.15.7:0/2464714803 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2b4102a70 0x7fe2b4102e80 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fe2a4009900 tx=0x7fe2a402a410 comp rx=0 tx=0).stop 2024-09-21T06:35:44.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.545+0000 7fe2ba464640 1 -- 172.21.15.7:0/2464714803 shutdown_connections 2024-09-21T06:35:44.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.545+0000 7fe2ba464640 1 --2- 172.21.15.7:0/2464714803 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2b4108d00 0x7fe2b410f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:44.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.545+0000 7fe2ba464640 1 --2- 172.21.15.7:0/2464714803 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2b41083b0 0x7fe2b41087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:44.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.545+0000 7fe2ba464640 1 --2- 172.21.15.7:0/2464714803 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2b4102a70 0x7fe2b4102e80 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:44.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.545+0000 7fe2ba464640 1 -- 172.21.15.7:0/2464714803 >> 172.21.15.7:0/2464714803 conn(0x7fe2b4079710 msgr2=0x7fe2b4079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:44.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.545+0000 7fe2ba464640 1 -- 172.21.15.7:0/2464714803 shutdown_connections 2024-09-21T06:35:44.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.545+0000 7fe2ba464640 1 -- 172.21.15.7:0/2464714803 wait complete. 2024-09-21T06:35:44.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.546+0000 7fe2ba464640 1 Processor -- start 2024-09-21T06:35:44.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.546+0000 7fe2ba464640 1 -- start start 2024-09-21T06:35:44.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.546+0000 7fe2ba464640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2b4102a70 0x7fe2b419a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:44.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.546+0000 7fe2ba464640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2b41083b0 0x7fe2b419aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:44.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.546+0000 7fe2ba464640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2b4108d00 0x7fe2b419fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:44.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.546+0000 7fe2ba464640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b4113ae0 con 0x7fe2b4108d00 2024-09-21T06:35:44.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.546+0000 7fe2ba464640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b4113960 con 0x7fe2b4102a70 2024-09-21T06:35:44.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.546+0000 7fe2ba464640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b4113c60 con 0x7fe2b41083b0 2024-09-21T06:35:44.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.546+0000 7fe2b8a01640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2b4108d00 0x7fe2b419fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:44.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.546+0000 7fe2b3fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2b4102a70 0x7fe2b419a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:44.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.546+0000 7fe2b8a01640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2b4108d00 0x7fe2b419fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41044/0 (socket says 172.21.15.7:41044) 2024-09-21T06:35:44.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.546+0000 7fe2b3fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2b4102a70 0x7fe2b419a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.7:48498/0 (socket says 172.21.15.7:48498) 2024-09-21T06:35:44.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.546+0000 7fe2b8a01640 1 -- 172.21.15.7:0/2739150871 learned_addr learned my addr 172.21.15.7:0/2739150871 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:35:44.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.546+0000 7fe2abfff640 1 --2- 172.21.15.7:0/2739150871 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2b41083b0 0x7fe2b419aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:44.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.547+0000 7fe2b8a01640 1 -- 172.21.15.7:0/2739150871 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2b41083b0 msgr2=0x7fe2b419aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:44.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.547+0000 7fe2b8a01640 1 --2- 172.21.15.7:0/2739150871 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2b41083b0 0x7fe2b419aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:44.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.547+0000 7fe2b8a01640 1 -- 172.21.15.7:0/2739150871 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2b4102a70 msgr2=0x7fe2b419a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:44.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.547+0000 7fe2b8a01640 1 --2- 172.21.15.7:0/2739150871 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2b4102a70 0x7fe2b419a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:44.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.547+0000 7fe2b8a01640 1 -- 172.21.15.7:0/2739150871 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2b41a0420 con 0x7fe2b4108d00 2024-09-21T06:35:44.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.547+0000 7fe2b8a01640 1 --2- 172.21.15.7:0/2739150871 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2b4108d00 0x7fe2b419fcf0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac00cad0 tx=0x7fe2ac00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:44.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.547+0000 7fe2b1ffb640 1 -- 172.21.15.7:0/2739150871 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac00ae20 con 0x7fe2b4108d00 2024-09-21T06:35:44.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.547+0000 7fe2b1ffb640 1 -- 172.21.15.7:0/2739150871 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe2ac005020 con 0x7fe2b4108d00 2024-09-21T06:35:44.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.547+0000 7fe2ba464640 1 -- 172.21.15.7:0/2739150871 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2b41a0710 con 0x7fe2b4108d00 2024-09-21T06:35:44.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.547+0000 7fe2b1ffb640 1 -- 172.21.15.7:0/2739150871 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac00f6b0 con 0x7fe2b4108d00 2024-09-21T06:35:44.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.547+0000 7fe2ba464640 1 -- 172.21.15.7:0/2739150871 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2b41a6e70 con 0x7fe2b4108d00 2024-09-21T06:35:44.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.550+0000 7fe2b1ffb640 1 -- 172.21.15.7:0/2739150871 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154579+0+0 (secure 0 0 0) 0x7fe2ac0051d0 con 0x7fe2b4108d00 2024-09-21T06:35:44.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.550+0000 7fe2c09d8740 1 Processor -- start 2024-09-21T06:35:44.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.550+0000 7fe2c09d8740 1 -- start start 2024-09-21T06:35:44.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.550+0000 7fe2c09d8740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55624ffd6f60 0x55625037cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:44.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.550+0000 7fe2c09d8740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55624ffae0a0 0x55625037d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:44.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.550+0000 7fe2c09d8740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55624ffb6280 0x55625037d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:44.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.550+0000 7fe2c09d8740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5562502f4c10 con 0x55624ffae0a0 2024-09-21T06:35:44.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.550+0000 7fe2c09d8740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5562502e4040 con 0x55624ffb6280 2024-09-21T06:35:44.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.550+0000 7fe2c09d8740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5562502e7e50 con 0x55624ffd6f60 2024-09-21T06:35:44.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.550+0000 7fe2b3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55624ffae0a0 0x55625037d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:44.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.550+0000 7fe2b3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55624ffae0a0 0x55625037d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41060/0 (socket says 172.21.15.7:41060) 2024-09-21T06:35:44.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.550+0000 7fe2b3fff640 1 -- 172.21.15.7:0/4212734879 learned_addr learned my addr 172.21.15.7:0/4212734879 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:35:44.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.551+0000 7fe2abfff640 1 --2- 172.21.15.7:0/4212734879 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55624ffb6280 0x55625037d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:44.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.551+0000 7fe2abfff640 1 --2- 172.21.15.7:0/4212734879 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55624ffd6f60 0x55625037cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:44.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.551+0000 7fe2b3fff640 1 -- 172.21.15.7:0/4212734879 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55624ffd6f60 msgr2=0x55625037cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:44.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.551+0000 7fe2b3fff640 1 --2- 172.21.15.7:0/4212734879 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55624ffd6f60 0x55625037cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:44.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.551+0000 7fe2b3fff640 1 -- 172.21.15.7:0/4212734879 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55624ffb6280 msgr2=0x55625037d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:44.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.551+0000 7fe2b3fff640 1 --2- 172.21.15.7:0/4212734879 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55624ffb6280 0x55625037d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:44.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.551+0000 7fe2b3fff640 1 -- 172.21.15.7:0/4212734879 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556250042540 con 0x55624ffae0a0 2024-09-21T06:35:44.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.551+0000 7fe2abfff640 1 --2- 172.21.15.7:0/4212734879 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55624ffb6280 0x55625037d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:35:44.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.551+0000 7fe2b3fff640 1 --2- 172.21.15.7:0/4212734879 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55624ffae0a0 0x55625037d440 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fe2a4009900 tx=0x7fe2a4032e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe611768b70f566b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:44.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.551+0000 7fe2b1ffb640 1 --2- 172.21.15.7:0/2739150871 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fe2a00b65f0 0x7fe2a00b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:44.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.551+0000 7fe2abfff640 1 --2- 172.21.15.7:0/2739150871 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fe2a00b65f0 0x7fe2a00b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:44.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.551+0000 7fe2aa7fc640 1 -- 172.21.15.7:0/4212734879 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a4040070 con 0x55624ffae0a0 2024-09-21T06:35:44.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.551+0000 7fe2aa7fc640 1 -- 172.21.15.7:0/4212734879 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe2a40316a0 con 0x55624ffae0a0 2024-09-21T06:35:44.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.551+0000 7fe2aa7fc640 1 -- 172.21.15.7:0/4212734879 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a4035040 con 0x55624ffae0a0 2024-09-21T06:35:44.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.551+0000 7fe2b1ffb640 1 -- 172.21.15.7:0/2739150871 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fe2ac0e74e0 con 0x7fe2b4108d00 2024-09-21T06:35:44.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.552+0000 7fe2c09d8740 1 -- 172.21.15.7:0/4212734879 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55624ffae0a0 msgr2=0x55625037d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:44.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.552+0000 7fe2c09d8740 1 --2- 172.21.15.7:0/4212734879 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55624ffae0a0 0x55625037d440 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fe2a4009900 tx=0x7fe2a4032e60 comp rx=0 tx=0).stop 2024-09-21T06:35:44.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.552+0000 7fe2abfff640 1 --2- 172.21.15.7:0/2739150871 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fe2a00b65f0 0x7fe2a00b8b00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe29c00b6c0 tx=0x7fe29c014040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:44.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.552+0000 7fe2c09d8740 1 -- 172.21.15.7:0/4212734879 shutdown_connections 2024-09-21T06:35:44.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.552+0000 7fe2c09d8740 1 --2- 172.21.15.7:0/4212734879 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55624ffb6280 0x55625037d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:44.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.552+0000 7fe2c09d8740 1 --2- 172.21.15.7:0/4212734879 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55624ffae0a0 0x55625037d440 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:44.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.552+0000 7fe2c09d8740 1 --2- 172.21.15.7:0/4212734879 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55624ffd6f60 0x55625037cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:44.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.552+0000 7fe2c09d8740 1 -- 172.21.15.7:0/4212734879 >> 172.21.15.7:0/4212734879 conn(0x55624ffcb350 msgr2=0x55625037adf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:44.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.552+0000 7fe2c09d8740 1 -- 172.21.15.7:0/4212734879 shutdown_connections 2024-09-21T06:35:44.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.552+0000 7fe2c09d8740 1 -- 172.21.15.7:0/4212734879 wait complete. 2024-09-21T06:35:44.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.553+0000 7fe2c09d8740 1 -- start start 2024-09-21T06:35:44.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.553+0000 7fe2c09d8740 1 Processor -- start 2024-09-21T06:35:44.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.553+0000 7fe2c09d8740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55624ffae0a0 0x55625038cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:44.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.553+0000 7fe2c09d8740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55624ffb6280 0x55625038d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:44.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.553+0000 7fe2c09d8740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55624ffd6f60 0x556250398d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:44.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.553+0000 7fe2c09d8740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5562501455f0 con 0x55624ffae0a0 2024-09-21T06:35:44.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.553+0000 7fe2c09d8740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55625027f010 con 0x55624ffd6f60 2024-09-21T06:35:44.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.553+0000 7fe2c09d8740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55625038f9b0 con 0x55624ffb6280 2024-09-21T06:35:44.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.553+0000 7fe2c09d8740 10 client.0 _ll_register_callbacks cb 0x5562502de340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:35:44.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.553+0000 7fe2b3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55624ffae0a0 0x55625038cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:44.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.553+0000 7fe2b3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55624ffae0a0 0x55625038cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41064/0 (socket says 172.21.15.7:41064) 2024-09-21T06:35:44.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.553+0000 7fe2b3fff640 1 -- 172.21.15.7:0/3225059699 learned_addr learned my addr 172.21.15.7:0/3225059699 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:35:44.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.553+0000 7fe2b8a01640 1 --2- 172.21.15.7:0/3225059699 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55624ffd6f60 0x556250398d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:44.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.553+0000 7fe2abfff640 1 --2- 172.21.15.7:0/3225059699 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55624ffb6280 0x55625038d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:44.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.554+0000 7fe2b3fff640 1 -- 172.21.15.7:0/3225059699 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55624ffb6280 msgr2=0x55625038d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:44.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.554+0000 7fe2b3fff640 1 --2- 172.21.15.7:0/3225059699 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55624ffb6280 0x55625038d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:44.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.554+0000 7fe2b3fff640 1 -- 172.21.15.7:0/3225059699 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55624ffd6f60 msgr2=0x556250398d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:44.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.554+0000 7fe2b3fff640 1 --2- 172.21.15.7:0/3225059699 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55624ffd6f60 0x556250398d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:44.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.554+0000 7fe2b3fff640 1 -- 172.21.15.7:0/3225059699 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562502aca00 con 0x55624ffae0a0 2024-09-21T06:35:44.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.554+0000 7fe2b3fff640 1 --2- 172.21.15.7:0/3225059699 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55624ffae0a0 0x55625038cb80 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe2a402a930 tx=0x7fe2a40052a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c41843c619b542de server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:44.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.554+0000 7fe2937fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:35:44.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.554+0000 7fe2937fe640 1 -- 172.21.15.7:0/3225059699 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a4035070 con 0x55624ffae0a0 2024-09-21T06:35:44.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.554+0000 7fe2937fe640 1 -- 172.21.15.7:0/3225059699 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fe2a4004020 con 0x55624ffae0a0 2024-09-21T06:35:44.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.554+0000 7fe2c09d8740 1 -- 172.21.15.7:0/3225059699 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe2a40316a0 con 0x55624ffae0a0 2024-09-21T06:35:44.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.554+0000 7fe2937fe640 1 -- 172.21.15.7:0/3225059699 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fe2a4040040 con 0x55624ffae0a0 2024-09-21T06:35:44.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.554+0000 7fe2c09d8740 10 client.15234 fetch_fsmap learned FSMap version 24 2024-09-21T06:35:44.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.554+0000 7fe2c09d8740 1 -- 172.21.15.7:0/3225059699 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55625039b8e0 con 0x55624ffae0a0 2024-09-21T06:35:44.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.554+0000 7fe2937fe640 1 -- 172.21.15.7:0/3225059699 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe2a40316a0 con 0x55624ffae0a0 2024-09-21T06:35:44.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.555+0000 7fe2937fe640 1 -- 172.21.15.7:0/3225059699 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fe2a4004750 con 0x55624ffae0a0 2024-09-21T06:35:44.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.555+0000 7fe2c09d8740 10 client.15234 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T06:35:44.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.555+0000 7fe2c09d8740 10 client.15234 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T06:35:44.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.555+0000 7fe2c09d8740 20 client.15234 populate_metadata read hostname 'smithi007' 2024-09-21T06:35:44.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.555+0000 7fe2c09d8740 1 --2- 172.21.15.7:0/3225059699 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55624ff958e0 0x55625039eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:44.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.555+0000 7fe2c09d8740 4 client.15234 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:35:44.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.555+0000 7fe2c09d8740 1 -- 172.21.15.7:0/3225059699 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5562502f6b60 con 0x55624ff958e0 2024-09-21T06:35:44.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.555+0000 7fe2abfff640 1 --2- 172.21.15.7:0/3225059699 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55624ff958e0 0x55625039eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:44.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.555+0000 7fe2abfff640 1 --2- 172.21.15.7:0/3225059699 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55624ff958e0 0x55625039eee0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86aae0b9de6637cc server_cookie=bdf8e43d46c397d in_seq=0 out_seq=0 2024-09-21T06:35:44.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.556+0000 7fe2937fe640 10 client.15234 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:35:44.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.556+0000 7fe2937fe640 1 -- 172.21.15.7:0/3225059699 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5562502f6b60 con 0x55624ff958e0 2024-09-21T06:35:44.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.556+0000 7fe2937fe640 10 client.15234 handle_command_reply: tid=0 2024-09-21T06:35:44.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.556+0000 7fe2c09d8740 1 client.15234 shutdown 2024-09-21T06:35:44.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.557+0000 7fe2c09d8740 1 -- 172.21.15.7:0/3225059699 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55624ffae0a0 msgr2=0x55625038cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:44.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.557+0000 7fe2c09d8740 1 --2- 172.21.15.7:0/3225059699 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55624ffae0a0 0x55625038cb80 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe2a402a930 tx=0x7fe2a40052a0 comp rx=0 tx=0).stop 2024-09-21T06:35:44.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.557+0000 7fe2c09d8740 1 -- 172.21.15.7:0/3225059699 shutdown_connections 2024-09-21T06:35:44.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.557+0000 7fe2c09d8740 1 --2- 172.21.15.7:0/3225059699 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55624ff958e0 0x55625039eee0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:44.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.557+0000 7fe2c09d8740 1 --2- 172.21.15.7:0/3225059699 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55624ffd6f60 0x556250398d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:44.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.557+0000 7fe2c09d8740 1 --2- 172.21.15.7:0/3225059699 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55624ffb6280 0x55625038d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:44.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.557+0000 7fe2c09d8740 1 --2- 172.21.15.7:0/3225059699 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55624ffae0a0 0x55625038cb80 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:44.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.557+0000 7fe2937fe640 0 client.15234 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:35:44.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.557+0000 7fe2c09d8740 1 -- 172.21.15.7:0/3225059699 >> 172.21.15.7:0/3225059699 conn(0x55624ffcb350 msgr2=0x5562503793b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:44.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.557+0000 7fe2c09d8740 1 -- 172.21.15.7:0/3225059699 shutdown_connections 2024-09-21T06:35:44.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.557+0000 7fe2c09d8740 1 -- 172.21.15.7:0/3225059699 wait complete. 2024-09-21T06:35:44.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.557+0000 7fe2c09d8740 20 client.15234 trim_cache size 0 max 16384 2024-09-21T06:35:44.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.575+0000 7fe2c09d8740 1 Processor -- start 2024-09-21T06:35:44.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.575+0000 7fe2c09d8740 1 -- start start 2024-09-21T06:35:44.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.575+0000 7fe2c09d8740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55624ffae0a0 0x55625039da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:44.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.575+0000 7fe2c09d8740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55624ffb6280 0x556250398c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:44.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.575+0000 7fe2c09d8740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55624ffd6f60 0x5562503991c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:44.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.575+0000 7fe2c09d8740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55625039d220 con 0x55624ffd6f60 2024-09-21T06:35:44.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.575+0000 7fe2c09d8740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55625039d8f0 con 0x55624ffae0a0 2024-09-21T06:35:44.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.575+0000 7fe2c09d8740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55625039dfc0 con 0x55624ffb6280 2024-09-21T06:35:44.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.575+0000 7fe2b8a01640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55624ffd6f60 0x5562503991c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:44.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.576+0000 7fe2b8a01640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55624ffd6f60 0x5562503991c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41070/0 (socket says 172.21.15.7:41070) 2024-09-21T06:35:44.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.576+0000 7fe2b8a01640 1 -- 172.21.15.7:0/1490989125 learned_addr learned my addr 172.21.15.7:0/1490989125 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:35:44.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.576+0000 7fe2abfff640 1 --2- 172.21.15.7:0/1490989125 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55624ffb6280 0x556250398c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:44.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.576+0000 7fe2b3fff640 1 --2- 172.21.15.7:0/1490989125 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55624ffae0a0 0x55625039da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:44.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.576+0000 7fe2b8a01640 1 -- 172.21.15.7:0/1490989125 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55624ffb6280 msgr2=0x556250398c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:44.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.576+0000 7fe2b8a01640 1 --2- 172.21.15.7:0/1490989125 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55624ffb6280 0x556250398c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:44.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.576+0000 7fe2b8a01640 1 -- 172.21.15.7:0/1490989125 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55624ffae0a0 msgr2=0x55625039da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:44.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.576+0000 7fe2b8a01640 1 --2- 172.21.15.7:0/1490989125 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55624ffae0a0 0x55625039da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:44.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.576+0000 7fe2b8a01640 1 -- 172.21.15.7:0/1490989125 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55625038de40 con 0x55624ffd6f60 2024-09-21T06:35:44.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.576+0000 7fe2b8a01640 1 --2- 172.21.15.7:0/1490989125 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55624ffd6f60 0x5562503991c0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac00a6e0 tx=0x7fe2ac0a9cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15a63fed54c55b03 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:44.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.576+0000 7fe2a9ffb640 1 -- 172.21.15.7:0/1490989125 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac01d040 con 0x55624ffd6f60 2024-09-21T06:35:44.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.576+0000 7fe2a9ffb640 1 -- 172.21.15.7:0/1490989125 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe2ac0054f0 con 0x55624ffd6f60 2024-09-21T06:35:44.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.576+0000 7fe2a9ffb640 1 -- 172.21.15.7:0/1490989125 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac0ac470 con 0x55624ffd6f60 2024-09-21T06:35:44.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.577+0000 7fe2c09d8740 1 -- 172.21.15.7:0/1490989125 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55624ffd6f60 msgr2=0x5562503991c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:44.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.577+0000 7fe2c09d8740 1 --2- 172.21.15.7:0/1490989125 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55624ffd6f60 0x5562503991c0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac00a6e0 tx=0x7fe2ac0a9cc0 comp rx=0 tx=0).stop 2024-09-21T06:35:44.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.577+0000 7fe2c09d8740 1 -- 172.21.15.7:0/1490989125 shutdown_connections 2024-09-21T06:35:44.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.577+0000 7fe2c09d8740 1 --2- 172.21.15.7:0/1490989125 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55624ffd6f60 0x5562503991c0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:44.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.577+0000 7fe2c09d8740 1 --2- 172.21.15.7:0/1490989125 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55624ffb6280 0x556250398c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:44.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.577+0000 7fe2c09d8740 1 --2- 172.21.15.7:0/1490989125 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55624ffae0a0 0x55625039da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:44.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.577+0000 7fe2c09d8740 1 -- 172.21.15.7:0/1490989125 >> 172.21.15.7:0/1490989125 conn(0x55624ffcb350 msgr2=0x55625038c930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:44.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.577+0000 7fe2c09d8740 1 -- 172.21.15.7:0/1490989125 shutdown_connections 2024-09-21T06:35:44.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.577+0000 7fe2c09d8740 1 -- 172.21.15.7:0/1490989125 wait complete. 2024-09-21T06:35:44.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.577+0000 7fe2c09d8740 1 -- start start 2024-09-21T06:35:44.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.578+0000 7fe2c09d8740 1 Processor -- start 2024-09-21T06:35:44.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.578+0000 7fe2c09d8740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55624ffae0a0 0x5562503a77d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:44.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.578+0000 7fe2c09d8740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55624ffb6280 0x5562503a0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:44.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.578+0000 7fe2c09d8740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55624ffd6f60 0x5562503a11c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:44.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.578+0000 7fe2c09d8740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55625039ed60 con 0x55624ffd6f60 2024-09-21T06:35:44.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.578+0000 7fe2c09d8740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55625039e690 con 0x55624ffb6280 2024-09-21T06:35:44.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.578+0000 7fe2c09d8740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55625039f430 con 0x55624ffae0a0 2024-09-21T06:35:44.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.578+0000 7fe2c09d8740 10 client.0 _ll_register_callbacks cb 0x7fe2a4032db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:35:44.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.578+0000 7fe2b8a01640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55624ffd6f60 0x5562503a11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:44.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.578+0000 7fe2b8a01640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55624ffd6f60 0x5562503a11c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41080/0 (socket says 172.21.15.7:41080) 2024-09-21T06:35:44.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.578+0000 7fe2b8a01640 1 -- 172.21.15.7:0/1923454764 learned_addr learned my addr 172.21.15.7:0/1923454764 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:35:44.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.578+0000 7fe2abfff640 1 --2- 172.21.15.7:0/1923454764 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55624ffb6280 0x5562503a0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:44.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.578+0000 7fe2b3fff640 1 --2- 172.21.15.7:0/1923454764 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55624ffae0a0 0x5562503a77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:44.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.578+0000 7fe2b8a01640 1 -- 172.21.15.7:0/1923454764 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55624ffae0a0 msgr2=0x5562503a77d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:44.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.579+0000 7fe2b8a01640 1 --2- 172.21.15.7:0/1923454764 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55624ffae0a0 0x5562503a77d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:44.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.579+0000 7fe2b8a01640 1 -- 172.21.15.7:0/1923454764 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55624ffb6280 msgr2=0x5562503a0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:35:44.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.579+0000 7fe2b8a01640 1 --2- 172.21.15.7:0/1923454764 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55624ffb6280 0x5562503a0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:44.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.579+0000 7fe2b8a01640 1 -- 172.21.15.7:0/1923454764 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562503a17b0 con 0x55624ffd6f60 2024-09-21T06:35:44.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.579+0000 7fe2b3fff640 1 --2- 172.21.15.7:0/1923454764 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55624ffae0a0 0x5562503a77d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:35:44.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.579+0000 7fe2b8a01640 1 --2- 172.21.15.7:0/1923454764 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55624ffd6f60 0x5562503a11c0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac00caa0 tx=0x7fe2ac0a90c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48a424b57e3cce13 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:44.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.579+0000 7fe2937fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:35:44.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.579+0000 7fe2937fe640 1 -- 172.21.15.7:0/1923454764 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac0d4020 con 0x55624ffd6f60 2024-09-21T06:35:44.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.579+0000 7fe2937fe640 1 -- 172.21.15.7:0/1923454764 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fe2ac0ac210 con 0x55624ffd6f60 2024-09-21T06:35:44.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.579+0000 7fe2c09d8740 1 -- 172.21.15.7:0/1923454764 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe2ac0054f0 con 0x55624ffd6f60 2024-09-21T06:35:44.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.579+0000 7fe2937fe640 1 -- 172.21.15.7:0/1923454764 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fe2ac01d070 con 0x55624ffd6f60 2024-09-21T06:35:44.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.579+0000 7fe2c09d8740 10 client.15240 fetch_fsmap learned FSMap version 24 2024-09-21T06:35:44.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.579+0000 7fe2c09d8740 1 -- 172.21.15.7:0/1923454764 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5562503a71b0 con 0x55624ffd6f60 2024-09-21T06:35:44.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.579+0000 7fe2937fe640 1 -- 172.21.15.7:0/1923454764 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe2ac0054f0 con 0x55624ffd6f60 2024-09-21T06:35:44.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.579+0000 7fe2937fe640 1 -- 172.21.15.7:0/1923454764 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fe2ac004a40 con 0x55624ffd6f60 2024-09-21T06:35:44.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.579+0000 7fe2c09d8740 10 client.15240 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T06:35:44.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.580+0000 7fe2c09d8740 10 client.15240 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T06:35:44.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.580+0000 7fe2c09d8740 20 client.15240 populate_metadata read hostname 'smithi007' 2024-09-21T06:35:44.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.580+0000 7fe2c09d8740 1 --2- 172.21.15.7:0/1923454764 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55624ff6ac90 0x55625040d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:44.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.580+0000 7fe2c09d8740 4 client.15240 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T06:35:44.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.580+0000 7fe2c09d8740 1 -- 172.21.15.7:0/1923454764 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "status"}) -- 0x5562502f2610 con 0x55624ff6ac90 2024-09-21T06:35:44.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.580+0000 7fe2b3fff640 1 --2- 172.21.15.7:0/1923454764 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55624ff6ac90 0x55625040d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:44.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.580+0000 7fe2b3fff640 1 --2- 172.21.15.7:0/1923454764 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55624ff6ac90 0x55625040d5c0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=70667166e9a63850 server_cookie=3005d2685c5b0044 in_seq=0 out_seq=0 2024-09-21T06:35:44.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.580+0000 7fe2937fe640 10 client.15240 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:35:44.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.581+0000 7fe2937fe640 1 -- 172.21.15.7:0/1923454764 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5562502f2610 con 0x55624ff6ac90 2024-09-21T06:35:44.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.581+0000 7fe2937fe640 10 client.15240 handle_command_reply: tid=0 2024-09-21T06:35:44.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.581+0000 7fe2c09d8740 1 client.15240 shutdown 2024-09-21T06:35:44.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.581+0000 7fe2c09d8740 1 -- 172.21.15.7:0/1923454764 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55624ffd6f60 msgr2=0x5562503a11c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:44.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.581+0000 7fe2c09d8740 1 --2- 172.21.15.7:0/1923454764 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55624ffd6f60 0x5562503a11c0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac00caa0 tx=0x7fe2ac0a90c0 comp rx=0 tx=0).stop 2024-09-21T06:35:44.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.581+0000 7fe2c09d8740 1 -- 172.21.15.7:0/1923454764 shutdown_connections 2024-09-21T06:35:44.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.581+0000 7fe2c09d8740 1 --2- 172.21.15.7:0/1923454764 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55624ff6ac90 0x55625040d5c0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:44.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.581+0000 7fe2c09d8740 1 --2- 172.21.15.7:0/1923454764 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55624ffd6f60 0x5562503a11c0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:44.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.581+0000 7fe2c09d8740 1 --2- 172.21.15.7:0/1923454764 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55624ffb6280 0x5562503a0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:44.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.581+0000 7fe2937fe640 0 client.15240 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:35:44.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.581+0000 7fe2c09d8740 1 --2- 172.21.15.7:0/1923454764 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55624ffae0a0 0x5562503a77d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:44.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.581+0000 7fe2c09d8740 1 -- 172.21.15.7:0/1923454764 >> 172.21.15.7:0/1923454764 conn(0x55624ffcb350 msgr2=0x556250387cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:44.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.581+0000 7fe2c09d8740 1 -- 172.21.15.7:0/1923454764 shutdown_connections 2024-09-21T06:35:44.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.581+0000 7fe2c09d8740 1 -- 172.21.15.7:0/1923454764 wait complete. 2024-09-21T06:35:44.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.581+0000 7fe2c09d8740 20 client.15240 trim_cache size 0 max 16384 2024-09-21T06:35:44.588 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:35:44.588 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "347cb918-77e2-11ef-baf5-efdc52797490", 2024-09-21T06:35:44.588 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 0, 2024-09-21T06:35:44.589 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 24716, 2024-09-21T06:35:44.589 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-09-21T06:35:44.589 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-09-21T06:35:44.589 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-09-21T06:35:44.589 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 79.632631091999997, 2024-09-21T06:35:44.589 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 24, 2024-09-21T06:35:44.589 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 77, 2024-09-21T06:35:44.589 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 75, 2024-09-21T06:35:44.589 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 90.133426380000003 2024-09-21T06:35:44.589 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:35:44.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.582+0000 7fe2ba464640 1 -- 172.21.15.7:0/2739150871 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fe2a00b65f0 msgr2=0x7fe2a00b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:44.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.582+0000 7fe2ba464640 1 --2- 172.21.15.7:0/2739150871 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fe2a00b65f0 0x7fe2a00b8b00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe29c00b6c0 tx=0x7fe29c014040 comp rx=0 tx=0).stop 2024-09-21T06:35:44.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.582+0000 7fe2ba464640 1 -- 172.21.15.7:0/2739150871 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2b4108d00 msgr2=0x7fe2b419fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:44.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.582+0000 7fe2ba464640 1 --2- 172.21.15.7:0/2739150871 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2b4108d00 0x7fe2b419fcf0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac00cad0 tx=0x7fe2ac00cf90 comp rx=0 tx=0).stop 2024-09-21T06:35:44.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.582+0000 7fe2ba464640 1 -- 172.21.15.7:0/2739150871 shutdown_connections 2024-09-21T06:35:44.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.582+0000 7fe2ba464640 1 --2- 172.21.15.7:0/2739150871 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fe2a00b65f0 0x7fe2a00b8b00 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:44.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.582+0000 7fe2ba464640 1 --2- 172.21.15.7:0/2739150871 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2b4108d00 0x7fe2b419fcf0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:44.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.582+0000 7fe2ba464640 1 --2- 172.21.15.7:0/2739150871 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2b41083b0 0x7fe2b419aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:44.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.582+0000 7fe2ba464640 1 --2- 172.21.15.7:0/2739150871 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2b4102a70 0x7fe2b419a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:44.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.582+0000 7fe2ba464640 1 -- 172.21.15.7:0/2739150871 >> 172.21.15.7:0/2739150871 conn(0x7fe2b4079710 msgr2=0x7fe2b41064a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:44.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.582+0000 7fe2ba464640 1 -- 172.21.15.7:0/2739150871 shutdown_connections 2024-09-21T06:35:44.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:44.582+0000 7fe2ba464640 1 -- 172.21.15.7:0/2739150871 wait complete. 2024-09-21T06:35:44.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:35:44 smithi007 ceph-mon[30983]: pgmap v305: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T06:35:44.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:35:44 smithi018 ceph-mon[34477]: pgmap v305: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T06:35:45.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:35:44 smithi144 ceph-mon[34653]: pgmap v305: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T06:35:45.239 INFO:tasks.cephadm:Setup complete, yielding 2024-09-21T06:35:45.240 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T06:35:45.250 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi007.front.sepia.ceph.com 2024-09-21T06:35:45.250 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- bash -c 'ceph orch status' 2024-09-21T06:35:45.507 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:45.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:45.981+0000 7f716192e640 1 -- 172.21.15.7:0/927860645 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f715c108d20 msgr2=0x7f715c10f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:45.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:45.981+0000 7f716192e640 1 --2- 172.21.15.7:0/927860645 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f715c108d20 0x7f715c10f550 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f7154009ca0 tx=0x7f715402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:35:45.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:45.981+0000 7f716192e640 1 -- 172.21.15.7:0/927860645 shutdown_connections 2024-09-21T06:35:45.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:45.981+0000 7f716192e640 1 --2- 172.21.15.7:0/927860645 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f715c108d20 0x7f715c10f550 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:45.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:45.981+0000 7f716192e640 1 --2- 172.21.15.7:0/927860645 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f715c1083d0 0x7f715c1087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:45.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:45.981+0000 7f716192e640 1 --2- 172.21.15.7:0/927860645 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f715c102ae0 0x7f715c102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:45.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:45.981+0000 7f716192e640 1 -- 172.21.15.7:0/927860645 >> 172.21.15.7:0/927860645 conn(0x7f715c079760 msgr2=0x7f715c079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:45.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:45.981+0000 7f716192e640 1 -- 172.21.15.7:0/927860645 shutdown_connections 2024-09-21T06:35:45.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:45.981+0000 7f716192e640 1 -- 172.21.15.7:0/927860645 wait complete. 2024-09-21T06:35:45.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:45.982+0000 7f716192e640 1 Processor -- start 2024-09-21T06:35:45.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:45.982+0000 7f716192e640 1 -- start start 2024-09-21T06:35:45.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:45.982+0000 7f716192e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f715c102ae0 0x7f715c19a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:45.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:45.982+0000 7f716192e640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f715c1083d0 0x7f715c19a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:45.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:45.982+0000 7f716192e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f715c108d20 0x7f715c19fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:45.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:45.982+0000 7f716192e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f715c113ab0 con 0x7f715c108d20 2024-09-21T06:35:45.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:45.982+0000 7f716192e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f715c113930 con 0x7f715c102ae0 2024-09-21T06:35:45.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:45.982+0000 7f716192e640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f715c113c30 con 0x7f715c1083d0 2024-09-21T06:35:45.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:45.982+0000 7f715b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f715c108d20 0x7f715c19fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:45.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:45.982+0000 7f715b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f715c108d20 0x7f715c19fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41098/0 (socket says 172.21.15.7:41098) 2024-09-21T06:35:45.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:45.983+0000 7f715b7fe640 1 -- 172.21.15.7:0/2327194562 learned_addr learned my addr 172.21.15.7:0/2327194562 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:35:45.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:45.982+0000 7f715affd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f715c102ae0 0x7f715c19a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:45.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:45.983+0000 7f715a7fc640 1 --2- 172.21.15.7:0/2327194562 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f715c1083d0 0x7f715c19a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:45.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:45.983+0000 7f715b7fe640 1 -- 172.21.15.7:0/2327194562 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f715c1083d0 msgr2=0x7f715c19a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:45.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:45.983+0000 7f715b7fe640 1 --2- 172.21.15.7:0/2327194562 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f715c1083d0 0x7f715c19a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:45.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:45.983+0000 7f715b7fe640 1 -- 172.21.15.7:0/2327194562 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f715c102ae0 msgr2=0x7f715c19a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:45.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:45.983+0000 7f715b7fe640 1 --2- 172.21.15.7:0/2327194562 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f715c102ae0 0x7f715c19a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:45.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:45.983+0000 7f715b7fe640 1 -- 172.21.15.7:0/2327194562 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f715c1a0290 con 0x7f715c108d20 2024-09-21T06:35:45.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:45.983+0000 7f715a7fc640 1 --2- 172.21.15.7:0/2327194562 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f715c1083d0 0x7f715c19a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:35:46.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:45.983+0000 7f715b7fe640 1 --2- 172.21.15.7:0/2327194562 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f715c108d20 0x7f715c19fc20 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f7154005cc0 tx=0x7f715402f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:46.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:45.983+0000 7f716092c640 1 -- 172.21.15.7:0/2327194562 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7154003bf0 con 0x7f715c108d20 2024-09-21T06:35:46.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:45.983+0000 7f716092c640 1 -- 172.21.15.7:0/2327194562 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7154003d90 con 0x7f715c108d20 2024-09-21T06:35:46.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:45.983+0000 7f716192e640 1 -- 172.21.15.7:0/2327194562 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f715c1a0520 con 0x7f715c108d20 2024-09-21T06:35:46.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:45.983+0000 7f716092c640 1 -- 172.21.15.7:0/2327194562 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f715402fbc0 con 0x7f715c108d20 2024-09-21T06:35:46.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:45.983+0000 7f716192e640 1 -- 172.21.15.7:0/2327194562 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f715c1a0a60 con 0x7f715c108d20 2024-09-21T06:35:46.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:45.984+0000 7f716192e640 1 -- 172.21.15.7:0/2327194562 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f715c103d10 con 0x7f715c108d20 2024-09-21T06:35:46.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:45.986+0000 7f716092c640 1 -- 172.21.15.7:0/2327194562 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154579+0+0 (secure 0 0 0) 0x7f715402fd60 con 0x7f715c108d20 2024-09-21T06:35:46.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:45.986+0000 7f716092c640 1 --2- 172.21.15.7:0/2327194562 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f71440b6620 0x7f71440b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:46.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:45.987+0000 7f715affd640 1 --2- 172.21.15.7:0/2327194562 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f71440b6620 0x7f71440b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:46.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:45.987+0000 7f716092c640 1 -- 172.21.15.7:0/2327194562 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f7154108a10 con 0x7f715c108d20 2024-09-21T06:35:46.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:45.987+0000 7f715affd640 1 --2- 172.21.15.7:0/2327194562 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f71440b6620 0x7f71440b8b30 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f714c005fd0 tx=0x7f714c00b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:46.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:45.990+0000 7f716092c640 1 -- 172.21.15.7:0/2327194562 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f71540cf0c0 con 0x7f715c108d20 2024-09-21T06:35:46.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:46.195+0000 7f716192e640 1 -- 172.21.15.7:0/2327194562 --> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f715c10ab20 con 0x7f71440b6620 2024-09-21T06:35:46.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:46.197+0000 7f716092c640 1 -- 172.21.15.7:0/2327194562 <== mgr.14223 v2:172.21.15.7:6800/3442812985 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f715c10ab20 con 0x7f71440b6620 2024-09-21T06:35:46.198 INFO:teuthology.orchestra.run.smithi007.stdout:Backend: cephadm 2024-09-21T06:35:46.198 INFO:teuthology.orchestra.run.smithi007.stdout:Available: Yes 2024-09-21T06:35:46.199 INFO:teuthology.orchestra.run.smithi007.stdout:Paused: No 2024-09-21T06:35:46.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:46.199+0000 7f716192e640 1 -- 172.21.15.7:0/2327194562 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f71440b6620 msgr2=0x7f71440b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:46.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:46.199+0000 7f716192e640 1 --2- 172.21.15.7:0/2327194562 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f71440b6620 0x7f71440b8b30 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f714c005fd0 tx=0x7f714c00b390 comp rx=0 tx=0).stop 2024-09-21T06:35:46.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:46.199+0000 7f716192e640 1 -- 172.21.15.7:0/2327194562 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f715c108d20 msgr2=0x7f715c19fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:46.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:46.199+0000 7f716192e640 1 --2- 172.21.15.7:0/2327194562 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f715c108d20 0x7f715c19fc20 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f7154005cc0 tx=0x7f715402f380 comp rx=0 tx=0).stop 2024-09-21T06:35:46.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:46.199+0000 7f716192e640 1 -- 172.21.15.7:0/2327194562 shutdown_connections 2024-09-21T06:35:46.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:46.199+0000 7f716192e640 1 --2- 172.21.15.7:0/2327194562 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f71440b6620 0x7f71440b8b30 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:46.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:46.199+0000 7f716192e640 1 --2- 172.21.15.7:0/2327194562 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f715c108d20 0x7f715c19fc20 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:46.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:46.199+0000 7f716192e640 1 --2- 172.21.15.7:0/2327194562 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f715c1083d0 0x7f715c19a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:46.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:46.199+0000 7f716192e640 1 --2- 172.21.15.7:0/2327194562 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f715c102ae0 0x7f715c19a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:46.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:46.199+0000 7f716192e640 1 -- 172.21.15.7:0/2327194562 >> 172.21.15.7:0/2327194562 conn(0x7f715c079760 msgr2=0x7f715c1043a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:46.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:46.199+0000 7f716192e640 1 -- 172.21.15.7:0/2327194562 shutdown_connections 2024-09-21T06:35:46.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:46.199+0000 7f716192e640 1 -- 172.21.15.7:0/2327194562 wait complete. 2024-09-21T06:35:46.833 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- bash -c 'ceph orch ps' 2024-09-21T06:35:46.857 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:35:46 smithi007 ceph-mon[30983]: pgmap v306: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:35:46.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:35:46 smithi018 ceph-mon[34477]: pgmap v306: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:35:47.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:35:46 smithi144 ceph-mon[34653]: pgmap v306: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:35:47.092 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:47.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:47.540+0000 7f5d947fa640 1 -- 172.21.15.7:0/4142997126 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d8c1049b0 msgr2=0x7f5d8c104dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:47.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:47.540+0000 7f5d947fa640 1 --2- 172.21.15.7:0/4142997126 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d8c1049b0 0x7f5d8c104dc0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f5d88009ca0 tx=0x7f5d8802a8e0 comp rx=0 tx=0).stop 2024-09-21T06:35:47.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:47.540+0000 7f5d947fa640 1 -- 172.21.15.7:0/4142997126 shutdown_connections 2024-09-21T06:35:47.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:47.540+0000 7f5d947fa640 1 --2- 172.21.15.7:0/4142997126 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d8c10de10 0x7f5d8c110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:47.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:47.540+0000 7f5d947fa640 1 --2- 172.21.15.7:0/4142997126 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d8c105300 0x7f5d8c10d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:47.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:47.540+0000 7f5d947fa640 1 --2- 172.21.15.7:0/4142997126 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d8c1049b0 0x7f5d8c104dc0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:47.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:47.540+0000 7f5d947fa640 1 -- 172.21.15.7:0/4142997126 >> 172.21.15.7:0/4142997126 conn(0x7f5d8c079730 msgr2=0x7f5d8c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:47.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:47.540+0000 7f5d947fa640 1 -- 172.21.15.7:0/4142997126 shutdown_connections 2024-09-21T06:35:47.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:47.540+0000 7f5d947fa640 1 -- 172.21.15.7:0/4142997126 wait complete. 2024-09-21T06:35:47.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:47.541+0000 7f5d947fa640 1 Processor -- start 2024-09-21T06:35:47.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:47.541+0000 7f5d947fa640 1 -- start start 2024-09-21T06:35:47.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:47.541+0000 7f5d947fa640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d8c1049b0 0x7f5d8c1026f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:47.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:47.541+0000 7f5d947fa640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d8c105300 0x7f5d8c102c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:47.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:47.541+0000 7f5d947fa640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d8c10de10 0x7f5d8c103170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:47.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:47.541+0000 7f5d947fa640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5d8c113ad0 con 0x7f5d8c1049b0 2024-09-21T06:35:47.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:47.541+0000 7f5d947fa640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5d8c113950 con 0x7f5d8c10de10 2024-09-21T06:35:47.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:47.541+0000 7f5d947fa640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5d8c113c50 con 0x7f5d8c105300 2024-09-21T06:35:47.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:47.541+0000 7f5d92596640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d8c1049b0 0x7f5d8c1026f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:47.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:47.541+0000 7f5d92596640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d8c1049b0 0x7f5d8c1026f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41116/0 (socket says 172.21.15.7:41116) 2024-09-21T06:35:47.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:47.541+0000 7f5d92596640 1 -- 172.21.15.7:0/2779934361 learned_addr learned my addr 172.21.15.7:0/2779934361 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:35:47.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:47.541+0000 7f5d92d97640 1 --2- 172.21.15.7:0/2779934361 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d8c10de10 0x7f5d8c103170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:47.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:47.541+0000 7f5d92596640 1 -- 172.21.15.7:0/2779934361 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d8c105300 msgr2=0x7f5d8c102c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:47.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:47.541+0000 7f5d92596640 1 --2- 172.21.15.7:0/2779934361 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d8c105300 0x7f5d8c102c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:47.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:47.542+0000 7f5d92596640 1 -- 172.21.15.7:0/2779934361 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d8c10de10 msgr2=0x7f5d8c103170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:47.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:47.542+0000 7f5d92596640 1 --2- 172.21.15.7:0/2779934361 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d8c10de10 0x7f5d8c103170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:47.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:47.542+0000 7f5d92596640 1 -- 172.21.15.7:0/2779934361 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d8c1a88c0 con 0x7f5d8c1049b0 2024-09-21T06:35:47.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:47.542+0000 7f5d92596640 1 --2- 172.21.15.7:0/2779934361 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d8c1049b0 0x7f5d8c1026f0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f5d88006010 tx=0x7f5d88003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:47.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:47.542+0000 7f5d837fe640 1 -- 172.21.15.7:0/2779934361 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d88004040 con 0x7f5d8c1049b0 2024-09-21T06:35:47.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:47.542+0000 7f5d837fe640 1 -- 172.21.15.7:0/2779934361 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5d88004690 con 0x7f5d8c1049b0 2024-09-21T06:35:47.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:47.542+0000 7f5d947fa640 1 -- 172.21.15.7:0/2779934361 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d8c1a8b50 con 0x7f5d8c1049b0 2024-09-21T06:35:47.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:47.542+0000 7f5d837fe640 1 -- 172.21.15.7:0/2779934361 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d88030db0 con 0x7f5d8c1049b0 2024-09-21T06:35:47.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:47.542+0000 7f5d947fa640 1 -- 172.21.15.7:0/2779934361 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d8c1a9090 con 0x7f5d8c1049b0 2024-09-21T06:35:47.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:47.543+0000 7f5d947fa640 1 -- 172.21.15.7:0/2779934361 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d8c104dc0 con 0x7f5d8c1049b0 2024-09-21T06:35:47.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:47.545+0000 7f5d837fe640 1 -- 172.21.15.7:0/2779934361 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154579+0+0 (secure 0 0 0) 0x7f5d880305e0 con 0x7f5d8c1049b0 2024-09-21T06:35:47.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:47.546+0000 7f5d837fe640 1 --2- 172.21.15.7:0/2779934361 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f5d780b65f0 0x7f5d780b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:47.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:47.546+0000 7f5d91d95640 1 --2- 172.21.15.7:0/2779934361 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f5d780b65f0 0x7f5d780b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:47.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:47.546+0000 7f5d837fe640 1 -- 172.21.15.7:0/2779934361 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f5d881089a0 con 0x7f5d8c1049b0 2024-09-21T06:35:47.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:47.546+0000 7f5d91d95640 1 --2- 172.21.15.7:0/2779934361 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f5d780b65f0 0x7f5d780b8b00 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c102400 tx=0x7f5d7c006c90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:47.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:47.549+0000 7f5d837fe640 1 -- 172.21.15.7:0/2779934361 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5d880cf0e0 con 0x7f5d8c1049b0 2024-09-21T06:35:47.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:47.748+0000 7f5d947fa640 1 -- 172.21.15.7:0/2779934361 --> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f5d8c063800 con 0x7f5d780b65f0 2024-09-21T06:35:47.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:47.760+0000 7f5d837fe640 1 -- 172.21.15.7:0/2779934361 <== mgr.14223 v2:172.21.15.7:6800/3442812985 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4185 (secure 0 0 0) 0x7f5d8c063800 con 0x7f5d780b65f0 2024-09-21T06:35:47.762 INFO:teuthology.orchestra.run.smithi007.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T06:35:47.762 INFO:teuthology.orchestra.run.smithi007.stdout:mds.a smithi007 running (96s) 16s ago 95s 82.0M - 19.3.0-5120-g18432218 ddce307e1f32 5fb8c4bc6f7c 2024-09-21T06:35:47.762 INFO:teuthology.orchestra.run.smithi007.stdout:mds.b smithi018 running (93s) 27s ago 93s 93.5M - 19.3.0-5120-g18432218 ddce307e1f32 3e5a1fe678c9 2024-09-21T06:35:47.762 INFO:teuthology.orchestra.run.smithi007.stdout:mds.c smithi144 running (107s) 27s ago 107s 87.9M - 19.3.0-5120-g18432218 ddce307e1f32 d7d0d7dcfb66 2024-09-21T06:35:47.763 INFO:teuthology.orchestra.run.smithi007.stdout:mds.d smithi007 running (115s) 16s ago 115s 82.1M - 19.3.0-5120-g18432218 ddce307e1f32 6cc42bc4bf22 2024-09-21T06:35:47.763 INFO:teuthology.orchestra.run.smithi007.stdout:mds.e smithi018 running (112s) 27s ago 112s 84.3M - 19.3.0-5120-g18432218 ddce307e1f32 aa9eeb36ea32 2024-09-21T06:35:47.763 INFO:teuthology.orchestra.run.smithi007.stdout:mds.f smithi144 running (110s) 27s ago 109s 84.4M - 19.3.0-5120-g18432218 ddce307e1f32 c116017ced5b 2024-09-21T06:35:47.763 INFO:teuthology.orchestra.run.smithi007.stdout:mds.g smithi007 running (99s) 16s ago 99s 82.0M - 19.3.0-5120-g18432218 ddce307e1f32 edf98fb6a6ec 2024-09-21T06:35:47.763 INFO:teuthology.orchestra.run.smithi007.stdout:mds.h smithi018 running (104s) 27s ago 104s 86.0M - 19.3.0-5120-g18432218 ddce307e1f32 44ffd7432ba8 2024-09-21T06:35:47.763 INFO:teuthology.orchestra.run.smithi007.stdout:mds.i smithi144 running (102s) 27s ago 101s 85.6M - 19.3.0-5120-g18432218 ddce307e1f32 d06ca82fd554 2024-09-21T06:35:47.763 INFO:teuthology.orchestra.run.smithi007.stdout:mds.j smithi007 running (119s) 16s ago 118s 81.6M - 19.3.0-5120-g18432218 ddce307e1f32 03424d6687b6 2024-09-21T06:35:47.763 INFO:teuthology.orchestra.run.smithi007.stdout:mds.k smithi018 running (2m) 27s ago 2m 84.4M - 19.3.0-5120-g18432218 ddce307e1f32 7795c07c94a0 2024-09-21T06:35:47.763 INFO:teuthology.orchestra.run.smithi007.stdout:mds.l smithi144 running (2m) 27s ago 2m 81.9M - 19.3.0-5120-g18432218 ddce307e1f32 ba23d0dfafca 2024-09-21T06:35:47.763 INFO:teuthology.orchestra.run.smithi007.stdout:mgr.x smithi007 *:9283,8765 running (9m) 16s ago 9m 585M - 19.3.0-5120-g18432218 ddce307e1f32 57ee5d7cdfd5 2024-09-21T06:35:47.763 INFO:teuthology.orchestra.run.smithi007.stdout:mgr.y smithi018 *:8443,8765 running (7m) 27s ago 7m 524M - 19.3.0-5120-g18432218 ddce307e1f32 d6428692c416 2024-09-21T06:35:47.763 INFO:teuthology.orchestra.run.smithi007.stdout:mgr.z smithi144 *:8443,8765 running (7m) 27s ago 7m 526M - 19.3.0-5120-g18432218 ddce307e1f32 ee87c85254f1 2024-09-21T06:35:47.763 INFO:teuthology.orchestra.run.smithi007.stdout:mon.a smithi007 running (9m) 16s ago 9m 122M 2048M 19.3.0-5120-g18432218 ddce307e1f32 bb65e9bcd000 2024-09-21T06:35:47.763 INFO:teuthology.orchestra.run.smithi007.stdout:mon.b smithi018 running (8m) 27s ago 8m 109M 2048M 19.3.0-5120-g18432218 ddce307e1f32 94a21ea7d425 2024-09-21T06:35:47.764 INFO:teuthology.orchestra.run.smithi007.stdout:mon.c smithi144 running (8m) 27s ago 8m 109M 2048M 19.3.0-5120-g18432218 ddce307e1f32 a6ea9d24ccb3 2024-09-21T06:35:47.764 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0 smithi007 running (7m) 16s ago 7m 111M 4273M 19.3.0-5120-g18432218 ddce307e1f32 e634e7e7dbbd 2024-09-21T06:35:47.764 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1 smithi018 running (6m) 27s ago 6m 115M 4273M 19.3.0-5120-g18432218 ddce307e1f32 0e35f0c95310 2024-09-21T06:35:47.764 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2 smithi144 running (6m) 27s ago 6m 123M 4272M 19.3.0-5120-g18432218 ddce307e1f32 27245d4381c7 2024-09-21T06:35:47.764 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3 smithi007 running (5m) 16s ago 5m 120M 4273M 19.3.0-5120-g18432218 ddce307e1f32 5d4370a5018a 2024-09-21T06:35:47.764 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4 smithi018 running (5m) 27s ago 5m 119M 4273M 19.3.0-5120-g18432218 ddce307e1f32 7c3c07f61565 2024-09-21T06:35:47.764 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5 smithi144 running (4m) 27s ago 4m 110M 4272M 19.3.0-5120-g18432218 ddce307e1f32 86fe110027d2 2024-09-21T06:35:47.764 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6 smithi007 running (4m) 16s ago 4m 116M 4273M 19.3.0-5120-g18432218 ddce307e1f32 8357f51d35e4 2024-09-21T06:35:47.764 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7 smithi018 running (4m) 27s ago 4m 111M 4273M 19.3.0-5120-g18432218 ddce307e1f32 7e40a1d7b593 2024-09-21T06:35:47.764 INFO:teuthology.orchestra.run.smithi007.stdout:osd.8 smithi144 running (3m) 27s ago 3m 120M 4272M 19.3.0-5120-g18432218 ddce307e1f32 d22015ba1f14 2024-09-21T06:35:47.764 INFO:teuthology.orchestra.run.smithi007.stdout:osd.9 smithi007 running (3m) 16s ago 3m 109M 4273M 19.3.0-5120-g18432218 ddce307e1f32 74acc268ebec 2024-09-21T06:35:47.764 INFO:teuthology.orchestra.run.smithi007.stdout:osd.10 smithi018 running (2m) 27s ago 2m 111M 4273M 19.3.0-5120-g18432218 ddce307e1f32 7227115ebccb 2024-09-21T06:35:47.764 INFO:teuthology.orchestra.run.smithi007.stdout:osd.11 smithi144 running (2m) 27s ago 2m 109M 4272M 19.3.0-5120-g18432218 ddce307e1f32 ce808055bfbe 2024-09-21T06:35:47.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:47.762+0000 7f5d947fa640 1 -- 172.21.15.7:0/2779934361 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f5d780b65f0 msgr2=0x7f5d780b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:47.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:47.762+0000 7f5d947fa640 1 --2- 172.21.15.7:0/2779934361 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f5d780b65f0 0x7f5d780b8b00 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c102400 tx=0x7f5d7c006c90 comp rx=0 tx=0).stop 2024-09-21T06:35:47.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:47.762+0000 7f5d947fa640 1 -- 172.21.15.7:0/2779934361 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d8c1049b0 msgr2=0x7f5d8c1026f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:47.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:47.762+0000 7f5d947fa640 1 --2- 172.21.15.7:0/2779934361 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d8c1049b0 0x7f5d8c1026f0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f5d88006010 tx=0x7f5d88003ba0 comp rx=0 tx=0).stop 2024-09-21T06:35:47.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:47.762+0000 7f5d947fa640 1 -- 172.21.15.7:0/2779934361 shutdown_connections 2024-09-21T06:35:47.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:47.762+0000 7f5d947fa640 1 --2- 172.21.15.7:0/2779934361 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f5d780b65f0 0x7f5d780b8b00 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:47.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:47.762+0000 7f5d947fa640 1 --2- 172.21.15.7:0/2779934361 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d8c10de10 0x7f5d8c103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:47.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:47.762+0000 7f5d947fa640 1 --2- 172.21.15.7:0/2779934361 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d8c105300 0x7f5d8c102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:47.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:47.762+0000 7f5d947fa640 1 --2- 172.21.15.7:0/2779934361 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d8c1049b0 0x7f5d8c1026f0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:47.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:47.762+0000 7f5d947fa640 1 -- 172.21.15.7:0/2779934361 >> 172.21.15.7:0/2779934361 conn(0x7f5d8c079730 msgr2=0x7f5d8c1008c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:47.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:47.763+0000 7f5d947fa640 1 -- 172.21.15.7:0/2779934361 shutdown_connections 2024-09-21T06:35:47.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:47.763+0000 7f5d947fa640 1 -- 172.21.15.7:0/2779934361 wait complete. 2024-09-21T06:35:47.774 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:35:47 smithi007 ceph-mon[30983]: from='client.15246 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:35:47.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:35:47 smithi018 ceph-mon[34477]: from='client.15246 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:35:48.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:35:47 smithi144 ceph-mon[34653]: from='client.15246 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:35:48.473 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- bash -c 'ceph orch ls' 2024-09-21T06:35:48.782 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:48.839 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:35:48 smithi007 ceph-mon[30983]: pgmap v307: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:35:48.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:35:48 smithi007 ceph-mon[30983]: from='client.15252 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:35:48.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:35:48 smithi018 ceph-mon[34477]: pgmap v307: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:35:48.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:35:48 smithi018 ceph-mon[34477]: from='client.15252 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:35:49.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:35:48 smithi144 ceph-mon[34653]: pgmap v307: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:35:49.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:35:48 smithi144 ceph-mon[34653]: from='client.15252 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:35:49.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:49.283+0000 7f091e31b640 1 -- 172.21.15.7:0/1022427003 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0918109e00 msgr2=0x7f0918110630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:49.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:49.283+0000 7f091e31b640 1 --2- 172.21.15.7:0/1022427003 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0918109e00 0x7f0918110630 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f0910009ca0 tx=0x7f091002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:35:49.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:49.283+0000 7f091e31b640 1 -- 172.21.15.7:0/1022427003 shutdown_connections 2024-09-21T06:35:49.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:49.283+0000 7f091e31b640 1 --2- 172.21.15.7:0/1022427003 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0918109e00 0x7f0918110630 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:49.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:49.283+0000 7f091e31b640 1 --2- 172.21.15.7:0/1022427003 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f09181094b0 0x7f09181098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:49.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:49.283+0000 7f091e31b640 1 --2- 172.21.15.7:0/1022427003 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0918103bc0 0x7f0918103fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:49.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:49.283+0000 7f091e31b640 1 -- 172.21.15.7:0/1022427003 >> 172.21.15.7:0/1022427003 conn(0x7f091807b910 msgr2=0x7f091807bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:49.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:49.283+0000 7f091e31b640 1 -- 172.21.15.7:0/1022427003 shutdown_connections 2024-09-21T06:35:49.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:49.283+0000 7f091e31b640 1 -- 172.21.15.7:0/1022427003 wait complete. 2024-09-21T06:35:49.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:49.284+0000 7f091e31b640 1 Processor -- start 2024-09-21T06:35:49.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:49.284+0000 7f091e31b640 1 -- start start 2024-09-21T06:35:49.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:49.284+0000 7f091e31b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0918103bc0 0x7f091819a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:49.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:49.284+0000 7f091e31b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09181094b0 0x7f091819aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:49.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:49.284+0000 7f091e31b640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0918109e00 0x7f091819fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:49.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:49.284+0000 7f091e31b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0918113ac0 con 0x7f09181094b0 2024-09-21T06:35:49.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:49.284+0000 7f091e31b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0918113940 con 0x7f0918103bc0 2024-09-21T06:35:49.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:49.284+0000 7f091e31b640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0918113c40 con 0x7f0918109e00 2024-09-21T06:35:49.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:49.284+0000 7f090ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09181094b0 0x7f091819aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:49.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:49.284+0000 7f090ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09181094b0 0x7f091819aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41134/0 (socket says 172.21.15.7:41134) 2024-09-21T06:35:49.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:49.284+0000 7f090ffff640 1 -- 172.21.15.7:0/477319697 learned_addr learned my addr 172.21.15.7:0/477319697 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:35:49.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:49.284+0000 7f0917fff640 1 --2- 172.21.15.7:0/477319697 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0918103bc0 0x7f091819a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:49.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:49.284+0000 7f091c8b8640 1 --2- 172.21.15.7:0/477319697 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0918109e00 0x7f091819fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:49.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:49.285+0000 7f090ffff640 1 -- 172.21.15.7:0/477319697 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0918109e00 msgr2=0x7f091819fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:49.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:49.285+0000 7f090ffff640 1 --2- 172.21.15.7:0/477319697 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0918109e00 0x7f091819fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:49.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:49.285+0000 7f090ffff640 1 -- 172.21.15.7:0/477319697 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0918103bc0 msgr2=0x7f091819a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:49.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:49.285+0000 7f090ffff640 1 --2- 172.21.15.7:0/477319697 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0918103bc0 0x7f091819a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:49.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:49.285+0000 7f090ffff640 1 -- 172.21.15.7:0/477319697 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09181a0380 con 0x7f09181094b0 2024-09-21T06:35:49.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:49.285+0000 7f091c8b8640 1 --2- 172.21.15.7:0/477319697 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0918109e00 0x7f091819fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:35:49.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:49.285+0000 7f090ffff640 1 --2- 172.21.15.7:0/477319697 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09181094b0 0x7f091819aa70 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f090000c8c0 tx=0x7f090000cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:49.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:49.285+0000 7f0915ffb640 1 -- 172.21.15.7:0/477319697 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0900007bb0 con 0x7f09181094b0 2024-09-21T06:35:49.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:49.285+0000 7f091e31b640 1 -- 172.21.15.7:0/477319697 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09181a0670 con 0x7f09181094b0 2024-09-21T06:35:49.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:49.285+0000 7f0915ffb640 1 -- 172.21.15.7:0/477319697 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0900007d50 con 0x7f09181094b0 2024-09-21T06:35:49.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:49.285+0000 7f0915ffb640 1 -- 172.21.15.7:0/477319697 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09000187c0 con 0x7f09181094b0 2024-09-21T06:35:49.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:49.285+0000 7f091e31b640 1 -- 172.21.15.7:0/477319697 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09181a6e90 con 0x7f09181094b0 2024-09-21T06:35:49.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:49.286+0000 7f091e31b640 1 -- 172.21.15.7:0/477319697 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0918103fd0 con 0x7f09181094b0 2024-09-21T06:35:49.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:49.288+0000 7f0915ffb640 1 -- 172.21.15.7:0/477319697 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154579+0+0 (secure 0 0 0) 0x7f090000fa20 con 0x7f09181094b0 2024-09-21T06:35:49.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:49.288+0000 7f0915ffb640 1 --2- 172.21.15.7:0/477319697 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f09040b6620 0x7f09040b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:49.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:49.289+0000 7f0917fff640 1 --2- 172.21.15.7:0/477319697 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f09040b6620 0x7f09040b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:49.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:49.289+0000 7f0915ffb640 1 -- 172.21.15.7:0/477319697 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f09000e7850 con 0x7f09181094b0 2024-09-21T06:35:49.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:49.289+0000 7f0917fff640 1 --2- 172.21.15.7:0/477319697 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f09040b6620 0x7f09040b8b30 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0908005d00 tx=0x7f090800b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:49.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:49.292+0000 7f0915ffb640 1 -- 172.21.15.7:0/477319697 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0900014030 con 0x7f09181094b0 2024-09-21T06:35:49.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:49.490+0000 7f091e31b640 1 -- 172.21.15.7:0/477319697 --> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f0918063800 con 0x7f09040b6620 2024-09-21T06:35:49.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:49.496+0000 7f0915ffb640 1 -- 172.21.15.7:0/477319697 <== mgr.14223 v2:172.21.15.7:6800/3442812985 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f0918063800 con 0x7f09040b6620 2024-09-21T06:35:49.498 INFO:teuthology.orchestra.run.smithi007.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-21T06:35:49.498 INFO:teuthology.orchestra.run.smithi007.stdout:mds.all 12/12 29s ago 2m smithi007=a;smithi007=d;smithi007=g;smithi007=j;smithi018=b;smithi018=e;smithi018=h;smithi018=k;smithi144=c;smithi144=f;smithi144=i;smithi144=l;count:12 2024-09-21T06:35:49.498 INFO:teuthology.orchestra.run.smithi007.stdout:mgr 3/3 29s ago 8m smithi007=x;smithi018=y;smithi144=z;count:3 2024-09-21T06:35:49.498 INFO:teuthology.orchestra.run.smithi007.stdout:mon 3/3 29s ago 8m smithi007:172.21.15.7=a;smithi018:172.21.15.18=b;smithi144:172.21.15.144=c;count:3 2024-09-21T06:35:49.498 INFO:teuthology.orchestra.run.smithi007.stdout:osd 12 29s ago - 2024-09-21T06:35:49.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:49.498+0000 7f091e31b640 1 -- 172.21.15.7:0/477319697 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f09040b6620 msgr2=0x7f09040b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:49.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:49.498+0000 7f091e31b640 1 --2- 172.21.15.7:0/477319697 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f09040b6620 0x7f09040b8b30 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0908005d00 tx=0x7f090800b410 comp rx=0 tx=0).stop 2024-09-21T06:35:49.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:49.498+0000 7f091e31b640 1 -- 172.21.15.7:0/477319697 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09181094b0 msgr2=0x7f091819aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:49.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:49.498+0000 7f091e31b640 1 --2- 172.21.15.7:0/477319697 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09181094b0 0x7f091819aa70 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f090000c8c0 tx=0x7f090000cd80 comp rx=0 tx=0).stop 2024-09-21T06:35:49.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:49.498+0000 7f091e31b640 1 -- 172.21.15.7:0/477319697 shutdown_connections 2024-09-21T06:35:49.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:49.498+0000 7f091e31b640 1 --2- 172.21.15.7:0/477319697 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f09040b6620 0x7f09040b8b30 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:49.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:49.499+0000 7f091e31b640 1 --2- 172.21.15.7:0/477319697 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0918109e00 0x7f091819fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:49.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:49.499+0000 7f091e31b640 1 --2- 172.21.15.7:0/477319697 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f09181094b0 0x7f091819aa70 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:49.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:49.499+0000 7f091e31b640 1 --2- 172.21.15.7:0/477319697 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0918103bc0 0x7f091819a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:49.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:49.499+0000 7f091e31b640 1 -- 172.21.15.7:0/477319697 >> 172.21.15.7:0/477319697 conn(0x7f091807b910 msgr2=0x7f0918107560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:49.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:49.499+0000 7f091e31b640 1 -- 172.21.15.7:0/477319697 shutdown_connections 2024-09-21T06:35:49.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:49.499+0000 7f091e31b640 1 -- 172.21.15.7:0/477319697 wait complete. 2024-09-21T06:35:50.221 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- bash -c 'ceph orch host ls' 2024-09-21T06:35:50.480 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:50.868 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:35:50 smithi007 ceph-mon[30983]: pgmap v308: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T06:35:50.868 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:35:50 smithi007 ceph-mon[30983]: from='client.15258 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:35:50.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:35:50 smithi018 ceph-mon[34477]: pgmap v308: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T06:35:50.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:35:50 smithi018 ceph-mon[34477]: from='client.15258 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:35:50.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:50.960+0000 7fad49e79640 1 -- 172.21.15.7:0/3818399370 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad44107630 msgr2=0x7fad44107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:50.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:50.960+0000 7fad49e79640 1 --2- 172.21.15.7:0/3818399370 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad44107630 0x7fad44107a40 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fad34009900 tx=0x7fad3402a410 comp rx=0 tx=0).stop 2024-09-21T06:35:50.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:50.960+0000 7fad49e79640 1 -- 172.21.15.7:0/3818399370 shutdown_connections 2024-09-21T06:35:50.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:50.960+0000 7fad49e79640 1 --2- 172.21.15.7:0/3818399370 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad441038f0 0x7fad4410f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:50.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:50.960+0000 7fad49e79640 1 --2- 172.21.15.7:0/3818399370 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad44102fa0 0x7fad441033b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:50.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:50.960+0000 7fad49e79640 1 --2- 172.21.15.7:0/3818399370 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad44107630 0x7fad44107a40 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:50.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:50.960+0000 7fad49e79640 1 -- 172.21.15.7:0/3818399370 >> 172.21.15.7:0/3818399370 conn(0x7fad44079e40 msgr2=0x7fad4407a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:50.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:50.960+0000 7fad49e79640 1 -- 172.21.15.7:0/3818399370 shutdown_connections 2024-09-21T06:35:50.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:50.960+0000 7fad49e79640 1 -- 172.21.15.7:0/3818399370 wait complete. 2024-09-21T06:35:50.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:50.961+0000 7fad49e79640 1 Processor -- start 2024-09-21T06:35:50.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:50.961+0000 7fad49e79640 1 -- start start 2024-09-21T06:35:50.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:50.961+0000 7fad49e79640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad44102fa0 0x7fad4419b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:50.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:50.961+0000 7fad49e79640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad441038f0 0x7fad4419b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:50.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:50.961+0000 7fad49e79640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad44107630 0x7fad4419bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:50.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:50.961+0000 7fad49e79640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fad441129e0 con 0x7fad441038f0 2024-09-21T06:35:50.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:50.961+0000 7fad49e79640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fad44112860 con 0x7fad44102fa0 2024-09-21T06:35:50.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:50.961+0000 7fad49e79640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fad44112b60 con 0x7fad44107630 2024-09-21T06:35:50.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:50.961+0000 7fad42ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad441038f0 0x7fad4419b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:50.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:50.961+0000 7fad42ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad441038f0 0x7fad4419b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47090/0 (socket says 172.21.15.7:47090) 2024-09-21T06:35:50.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:50.961+0000 7fad42ffd640 1 -- 172.21.15.7:0/1989650802 learned_addr learned my addr 172.21.15.7:0/1989650802 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:35:50.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:50.961+0000 7fad437fe640 1 --2- 172.21.15.7:0/1989650802 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad44102fa0 0x7fad4419b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:50.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:50.961+0000 7fad42ffd640 1 -- 172.21.15.7:0/1989650802 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad44107630 msgr2=0x7fad4419bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:50.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:50.962+0000 7fad43fff640 1 --2- 172.21.15.7:0/1989650802 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad44107630 0x7fad4419bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:50.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:50.962+0000 7fad42ffd640 1 --2- 172.21.15.7:0/1989650802 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad44107630 0x7fad4419bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:50.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:50.962+0000 7fad42ffd640 1 -- 172.21.15.7:0/1989650802 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad44102fa0 msgr2=0x7fad4419b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:50.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:50.962+0000 7fad42ffd640 1 --2- 172.21.15.7:0/1989650802 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad44102fa0 0x7fad4419b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:50.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:50.962+0000 7fad42ffd640 1 -- 172.21.15.7:0/1989650802 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad441a65e0 con 0x7fad441038f0 2024-09-21T06:35:50.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:50.962+0000 7fad437fe640 1 --2- 172.21.15.7:0/1989650802 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad44102fa0 0x7fad4419b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:35:50.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:50.962+0000 7fad42ffd640 1 --2- 172.21.15.7:0/1989650802 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad441038f0 0x7fad4419b890 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fad3800d740 tx=0x7fad3800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:50.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:50.962+0000 7fad40ff9640 1 -- 172.21.15.7:0/1989650802 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad38017070 con 0x7fad441038f0 2024-09-21T06:35:50.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:50.962+0000 7fad49e79640 1 -- 172.21.15.7:0/1989650802 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad441a68d0 con 0x7fad441038f0 2024-09-21T06:35:50.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:50.962+0000 7fad40ff9640 1 -- 172.21.15.7:0/1989650802 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fad3800de50 con 0x7fad441038f0 2024-09-21T06:35:50.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:50.962+0000 7fad40ff9640 1 -- 172.21.15.7:0/1989650802 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad38003c30 con 0x7fad441038f0 2024-09-21T06:35:50.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:50.962+0000 7fad49e79640 1 -- 172.21.15.7:0/1989650802 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad441a6e10 con 0x7fad441038f0 2024-09-21T06:35:50.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:50.963+0000 7fad49e79640 1 -- 172.21.15.7:0/1989650802 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad441033b0 con 0x7fad441038f0 2024-09-21T06:35:50.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:50.965+0000 7fad40ff9640 1 -- 172.21.15.7:0/1989650802 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154579+0+0 (secure 0 0 0) 0x7fad38003dd0 con 0x7fad441038f0 2024-09-21T06:35:50.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:50.965+0000 7fad40ff9640 1 --2- 172.21.15.7:0/1989650802 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fad2c0b6620 0x7fad2c0b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:50.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:50.966+0000 7fad437fe640 1 --2- 172.21.15.7:0/1989650802 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fad2c0b6620 0x7fad2c0b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:50.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:50.966+0000 7fad40ff9640 1 -- 172.21.15.7:0/1989650802 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fad380e7470 con 0x7fad441038f0 2024-09-21T06:35:50.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:50.966+0000 7fad437fe640 1 --2- 172.21.15.7:0/1989650802 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fad2c0b6620 0x7fad2c0b8b30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fad34000c00 tx=0x7fad34009680 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:50.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:50.969+0000 7fad40ff9640 1 -- 172.21.15.7:0/1989650802 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fad380adb20 con 0x7fad441038f0 2024-09-21T06:35:51.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:35:50 smithi144 ceph-mon[34653]: pgmap v308: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T06:35:51.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:35:50 smithi144 ceph-mon[34653]: from='client.15258 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:35:51.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:51.163+0000 7fad49e79640 1 -- 172.21.15.7:0/1989650802 --> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7fad44063800 con 0x7fad2c0b6620 2024-09-21T06:35:51.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:51.164+0000 7fad40ff9640 1 -- 172.21.15.7:0/1989650802 <== mgr.14223 v2:172.21.15.7:6800/3442812985 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7fad44063800 con 0x7fad2c0b6620 2024-09-21T06:35:51.166 INFO:teuthology.orchestra.run.smithi007.stdout:HOST ADDR LABELS STATUS 2024-09-21T06:35:51.166 INFO:teuthology.orchestra.run.smithi007.stdout:smithi007 172.21.15.7 2024-09-21T06:35:51.166 INFO:teuthology.orchestra.run.smithi007.stdout:smithi018 172.21.15.18 2024-09-21T06:35:51.166 INFO:teuthology.orchestra.run.smithi007.stdout:smithi144 172.21.15.144 2024-09-21T06:35:51.166 INFO:teuthology.orchestra.run.smithi007.stdout:3 hosts in cluster 2024-09-21T06:35:51.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:51.166+0000 7fad49e79640 1 -- 172.21.15.7:0/1989650802 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fad2c0b6620 msgr2=0x7fad2c0b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:51.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:51.166+0000 7fad49e79640 1 --2- 172.21.15.7:0/1989650802 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fad2c0b6620 0x7fad2c0b8b30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fad34000c00 tx=0x7fad34009680 comp rx=0 tx=0).stop 2024-09-21T06:35:51.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:51.166+0000 7fad49e79640 1 -- 172.21.15.7:0/1989650802 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad441038f0 msgr2=0x7fad4419b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:51.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:51.166+0000 7fad49e79640 1 --2- 172.21.15.7:0/1989650802 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad441038f0 0x7fad4419b890 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fad3800d740 tx=0x7fad3800dc00 comp rx=0 tx=0).stop 2024-09-21T06:35:51.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:51.167+0000 7fad49e79640 1 -- 172.21.15.7:0/1989650802 shutdown_connections 2024-09-21T06:35:51.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:51.167+0000 7fad49e79640 1 --2- 172.21.15.7:0/1989650802 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fad2c0b6620 0x7fad2c0b8b30 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:51.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:51.167+0000 7fad49e79640 1 --2- 172.21.15.7:0/1989650802 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad44107630 0x7fad4419bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:51.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:51.167+0000 7fad49e79640 1 --2- 172.21.15.7:0/1989650802 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad441038f0 0x7fad4419b890 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:51.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:51.167+0000 7fad49e79640 1 --2- 172.21.15.7:0/1989650802 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad44102fa0 0x7fad4419b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:51.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:51.167+0000 7fad49e79640 1 -- 172.21.15.7:0/1989650802 >> 172.21.15.7:0/1989650802 conn(0x7fad44079e40 msgr2=0x7fad441063f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:51.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:51.167+0000 7fad49e79640 1 -- 172.21.15.7:0/1989650802 shutdown_connections 2024-09-21T06:35:51.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:51.167+0000 7fad49e79640 1 -- 172.21.15.7:0/1989650802 wait complete. 2024-09-21T06:35:51.841 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- bash -c 'ceph orch device ls' 2024-09-21T06:35:52.106 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:52.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:52.604+0000 7f4bd982e640 1 -- 172.21.15.7:0/22596919 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bd4107be0 msgr2=0x7f4bd4107ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:52.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:52.604+0000 7f4bd982e640 1 --2- 172.21.15.7:0/22596919 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bd4107be0 0x7f4bd4107ff0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc009900 tx=0x7f4bbc02a410 comp rx=0 tx=0).stop 2024-09-21T06:35:52.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:52.605+0000 7f4bd982e640 1 -- 172.21.15.7:0/22596919 shutdown_connections 2024-09-21T06:35:52.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:52.605+0000 7f4bd982e640 1 --2- 172.21.15.7:0/22596919 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4bd4108530 0x7f4bd410ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:52.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:52.605+0000 7f4bd982e640 1 --2- 172.21.15.7:0/22596919 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bd4107be0 0x7f4bd4107ff0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:52.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:52.605+0000 7f4bd982e640 1 --2- 172.21.15.7:0/22596919 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4bd41022a0 0x7f4bd41026b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:52.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:52.605+0000 7f4bd982e640 1 -- 172.21.15.7:0/22596919 >> 172.21.15.7:0/22596919 conn(0x7f4bd4079ec0 msgr2=0x7f4bd407a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:52.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:52.605+0000 7f4bd982e640 1 -- 172.21.15.7:0/22596919 shutdown_connections 2024-09-21T06:35:52.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:52.605+0000 7f4bd982e640 1 -- 172.21.15.7:0/22596919 wait complete. 2024-09-21T06:35:52.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:52.605+0000 7f4bd982e640 1 Processor -- start 2024-09-21T06:35:52.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:52.605+0000 7f4bd982e640 1 -- start start 2024-09-21T06:35:52.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:52.606+0000 7f4bd982e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bd41022a0 0x7f4bd419a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:52.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:52.606+0000 7f4bd982e640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4bd4107be0 0x7f4bd419ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:52.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:52.606+0000 7f4bd982e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4bd4108530 0x7f4bd419fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:52.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:52.606+0000 7f4bd982e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4bd41121a0 con 0x7f4bd41022a0 2024-09-21T06:35:52.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:52.606+0000 7f4bd982e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4bd4112020 con 0x7f4bd4108530 2024-09-21T06:35:52.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:52.606+0000 7f4bd982e640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4bd4112320 con 0x7f4bd4107be0 2024-09-21T06:35:52.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:52.606+0000 7f4bd2ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bd41022a0 0x7f4bd419a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:52.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:52.606+0000 7f4bd2ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bd41022a0 0x7f4bd419a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47108/0 (socket says 172.21.15.7:47108) 2024-09-21T06:35:52.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:52.606+0000 7f4bd2ffd640 1 -- 172.21.15.7:0/719278632 learned_addr learned my addr 172.21.15.7:0/719278632 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:35:52.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:52.606+0000 7f4bd37fe640 1 --2- 172.21.15.7:0/719278632 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4bd4108530 0x7f4bd419fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:52.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:52.606+0000 7f4bcbfff640 1 --2- 172.21.15.7:0/719278632 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4bd4107be0 0x7f4bd419ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:52.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:52.606+0000 7f4bd2ffd640 1 -- 172.21.15.7:0/719278632 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4bd4107be0 msgr2=0x7f4bd419ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:52.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:52.606+0000 7f4bd2ffd640 1 --2- 172.21.15.7:0/719278632 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4bd4107be0 0x7f4bd419ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:52.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:52.606+0000 7f4bd2ffd640 1 -- 172.21.15.7:0/719278632 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4bd4108530 msgr2=0x7f4bd419fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:52.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:52.606+0000 7f4bd2ffd640 1 --2- 172.21.15.7:0/719278632 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4bd4108530 0x7f4bd419fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:52.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:52.606+0000 7f4bd2ffd640 1 -- 172.21.15.7:0/719278632 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bd41a0540 con 0x7f4bd41022a0 2024-09-21T06:35:52.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:52.606+0000 7f4bcbfff640 1 --2- 172.21.15.7:0/719278632 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4bd4107be0 0x7f4bd419ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:35:52.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:52.606+0000 7f4bd2ffd640 1 --2- 172.21.15.7:0/719278632 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bd41022a0 0x7f4bd419a5d0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f4bc400d950 tx=0x7f4bc400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:52.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:52.606+0000 7f4bd882c640 1 -- 172.21.15.7:0/719278632 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bc4017030 con 0x7f4bd41022a0 2024-09-21T06:35:52.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:52.606+0000 7f4bd882c640 1 -- 172.21.15.7:0/719278632 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4bc4004020 con 0x7f4bd41022a0 2024-09-21T06:35:52.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:52.606+0000 7f4bd982e640 1 -- 172.21.15.7:0/719278632 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bd41a0830 con 0x7f4bd41022a0 2024-09-21T06:35:52.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:52.606+0000 7f4bd882c640 1 -- 172.21.15.7:0/719278632 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bc40047a0 con 0x7f4bd41022a0 2024-09-21T06:35:52.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:52.606+0000 7f4bd982e640 1 -- 172.21.15.7:0/719278632 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bd41a6f90 con 0x7f4bd41022a0 2024-09-21T06:35:52.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:52.607+0000 7f4bd982e640 1 -- 172.21.15.7:0/719278632 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bd41026b0 con 0x7f4bd41022a0 2024-09-21T06:35:52.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:52.609+0000 7f4bd882c640 1 -- 172.21.15.7:0/719278632 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154579+0+0 (secure 0 0 0) 0x7f4bc4009a30 con 0x7f4bd41022a0 2024-09-21T06:35:52.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:52.610+0000 7f4bd882c640 1 --2- 172.21.15.7:0/719278632 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f4bc00b65f0 0x7f4bc00b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:52.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:52.610+0000 7f4bcbfff640 1 --2- 172.21.15.7:0/719278632 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f4bc00b65f0 0x7f4bc00b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:52.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:52.610+0000 7f4bd882c640 1 -- 172.21.15.7:0/719278632 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f4bc40e7700 con 0x7f4bd41022a0 2024-09-21T06:35:52.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:52.610+0000 7f4bcbfff640 1 --2- 172.21.15.7:0/719278632 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f4bc00b65f0 0x7f4bc00b8b00 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc000c00 tx=0x7f4bbc031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:52.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:52.613+0000 7f4bd882c640 1 -- 172.21.15.7:0/719278632 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4bc40addb0 con 0x7f4bd41022a0 2024-09-21T06:35:52.810 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:35:52 smithi007 ceph-mon[30983]: pgmap v309: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:35:52.810 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:35:52 smithi007 ceph-mon[30983]: from='client.15264 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:35:52.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:52.808+0000 7f4bd982e640 1 -- 172.21.15.7:0/719278632 --> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f4bd4063800 con 0x7f4bc00b65f0 2024-09-21T06:35:52.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:52.810+0000 7f4bd882c640 1 -- 172.21.15.7:0/719278632 <== mgr.14223 v2:172.21.15.7:6800/3442812985 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f4bd4063800 con 0x7f4bc00b65f0 2024-09-21T06:35:52.812 INFO:teuthology.orchestra.run.smithi007.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-21T06:35:52.812 INFO:teuthology.orchestra.run.smithi007.stdout:smithi007 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB751300GE480DGN 447G No 3m ago Has a FileSystem, LVM detected 2024-09-21T06:35:52.812 INFO:teuthology.orchestra.run.smithi007.stdout:smithi018 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB75120091480DGN 447G No 2m ago Has a FileSystem, LVM detected 2024-09-21T06:35:52.812 INFO:teuthology.orchestra.run.smithi007.stdout:smithi144 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT62050085400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-21T06:35:52.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:52.812+0000 7f4bd982e640 1 -- 172.21.15.7:0/719278632 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f4bc00b65f0 msgr2=0x7f4bc00b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:52.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:52.812+0000 7f4bd982e640 1 --2- 172.21.15.7:0/719278632 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f4bc00b65f0 0x7f4bc00b8b00 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc000c00 tx=0x7f4bbc031400 comp rx=0 tx=0).stop 2024-09-21T06:35:52.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:52.812+0000 7f4bd982e640 1 -- 172.21.15.7:0/719278632 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bd41022a0 msgr2=0x7f4bd419a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:52.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:52.812+0000 7f4bd982e640 1 --2- 172.21.15.7:0/719278632 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bd41022a0 0x7f4bd419a5d0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f4bc400d950 tx=0x7f4bc400de10 comp rx=0 tx=0).stop 2024-09-21T06:35:52.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:52.812+0000 7f4bd982e640 1 -- 172.21.15.7:0/719278632 shutdown_connections 2024-09-21T06:35:52.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:52.812+0000 7f4bd982e640 1 --2- 172.21.15.7:0/719278632 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f4bc00b65f0 0x7f4bc00b8b00 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:52.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:52.812+0000 7f4bd982e640 1 --2- 172.21.15.7:0/719278632 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4bd4108530 0x7f4bd419fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:52.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:52.812+0000 7f4bd982e640 1 --2- 172.21.15.7:0/719278632 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4bd4107be0 0x7f4bd419ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:52.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:52.812+0000 7f4bd982e640 1 --2- 172.21.15.7:0/719278632 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4bd41022a0 0x7f4bd419a5d0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:52.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:52.812+0000 7f4bd982e640 1 -- 172.21.15.7:0/719278632 >> 172.21.15.7:0/719278632 conn(0x7f4bd4079ec0 msgr2=0x7f4bd4108c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:52.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:52.812+0000 7f4bd982e640 1 -- 172.21.15.7:0/719278632 shutdown_connections 2024-09-21T06:35:52.815 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:52.812+0000 7f4bd982e640 1 -- 172.21.15.7:0/719278632 wait complete. 2024-09-21T06:35:52.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:35:52 smithi018 ceph-mon[34477]: pgmap v309: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:35:52.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:35:52 smithi018 ceph-mon[34477]: from='client.15264 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:35:53.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:35:52 smithi144 ceph-mon[34653]: pgmap v309: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:35:53.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:35:52 smithi144 ceph-mon[34653]: from='client.15264 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:35:53.570 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T06:35:53.579 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi007.front.sepia.ceph.com 2024-09-21T06:35:53.579 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- bash -c 'ceph fs dump' 2024-09-21T06:35:53.839 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:35:53 smithi007 ceph-mon[30983]: from='client.15270 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:35:53.843 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:54.039 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:35:53 smithi144 ceph-mon[34653]: from='client.15270 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:35:54.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:35:53 smithi018 ceph-mon[34477]: from='client.15270 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:35:54.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:54.316+0000 7f9956f60640 1 -- 172.21.15.7:0/768964149 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f99501094d0 msgr2=0x7f99501098e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:54.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:54.316+0000 7f9956f60640 1 --2- 172.21.15.7:0/768964149 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f99501094d0 0x7f99501098e0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f9940009900 tx=0x7f994002a410 comp rx=0 tx=0).stop 2024-09-21T06:35:54.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:54.316+0000 7f9956f60640 1 -- 172.21.15.7:0/768964149 shutdown_connections 2024-09-21T06:35:54.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:54.316+0000 7f9956f60640 1 --2- 172.21.15.7:0/768964149 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9950109e20 0x7f9950110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:54.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:54.316+0000 7f9956f60640 1 --2- 172.21.15.7:0/768964149 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f99501094d0 0x7f99501098e0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:54.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:54.316+0000 7f9956f60640 1 --2- 172.21.15.7:0/768964149 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9950103b90 0x7f9950103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:54.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:54.316+0000 7f9956f60640 1 -- 172.21.15.7:0/768964149 >> 172.21.15.7:0/768964149 conn(0x7f99500ff600 msgr2=0x7f9950101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:54.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:54.316+0000 7f9956f60640 1 -- 172.21.15.7:0/768964149 shutdown_connections 2024-09-21T06:35:54.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:54.316+0000 7f9956f60640 1 -- 172.21.15.7:0/768964149 wait complete. 2024-09-21T06:35:54.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:54.317+0000 7f9956f60640 1 Processor -- start 2024-09-21T06:35:54.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:54.317+0000 7f9956f60640 1 -- start start 2024-09-21T06:35:54.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:54.317+0000 7f9956f60640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9950103b90 0x7f995019a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:54.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:54.317+0000 7f9956f60640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f99501094d0 0x7f995019a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:54.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:54.317+0000 7f9956f60640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9950109e20 0x7f995019fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:54.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:54.317+0000 7f9956f60640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9950113ae0 con 0x7f9950103b90 2024-09-21T06:35:54.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:54.317+0000 7f9956f60640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9950113960 con 0x7f9950109e20 2024-09-21T06:35:54.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:54.317+0000 7f9956f60640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9950113c60 con 0x7f99501094d0 2024-09-21T06:35:54.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:54.317+0000 7f9954cfc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9950103b90 0x7f995019a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:54.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:54.317+0000 7f9954cfc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9950103b90 0x7f995019a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47132/0 (socket says 172.21.15.7:47132) 2024-09-21T06:35:54.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:54.317+0000 7f9954cfc640 1 -- 172.21.15.7:0/2207489939 learned_addr learned my addr 172.21.15.7:0/2207489939 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:35:54.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:54.317+0000 7f9947fff640 1 --2- 172.21.15.7:0/2207489939 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f99501094d0 0x7f995019a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:54.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:54.317+0000 7f99554fd640 1 --2- 172.21.15.7:0/2207489939 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9950109e20 0x7f995019fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:54.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:54.318+0000 7f9954cfc640 1 -- 172.21.15.7:0/2207489939 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f99501094d0 msgr2=0x7f995019a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:54.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:54.318+0000 7f9954cfc640 1 --2- 172.21.15.7:0/2207489939 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f99501094d0 0x7f995019a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:54.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:54.318+0000 7f9954cfc640 1 -- 172.21.15.7:0/2207489939 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9950109e20 msgr2=0x7f995019fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:54.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:54.318+0000 7f9954cfc640 1 --2- 172.21.15.7:0/2207489939 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9950109e20 0x7f995019fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:54.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:54.318+0000 7f9954cfc640 1 -- 172.21.15.7:0/2207489939 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99501a0300 con 0x7f9950103b90 2024-09-21T06:35:54.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:54.318+0000 7f9954cfc640 1 --2- 172.21.15.7:0/2207489939 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9950103b90 0x7f995019a450 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f994c00c920 tx=0x7f994c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:54.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:54.318+0000 7f9945ffb640 1 -- 172.21.15.7:0/2207489939 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f994c007c70 con 0x7f9950103b90 2024-09-21T06:35:54.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:54.318+0000 7f9956f60640 1 -- 172.21.15.7:0/2207489939 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99501a05f0 con 0x7f9950103b90 2024-09-21T06:35:54.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:54.318+0000 7f9945ffb640 1 -- 172.21.15.7:0/2207489939 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f994c007e10 con 0x7f9950103b90 2024-09-21T06:35:54.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:54.318+0000 7f9945ffb640 1 -- 172.21.15.7:0/2207489939 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f994c018820 con 0x7f9950103b90 2024-09-21T06:35:54.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:54.318+0000 7f9956f60640 1 -- 172.21.15.7:0/2207489939 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99501a6e10 con 0x7f9950103b90 2024-09-21T06:35:54.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:54.319+0000 7f9956f60640 1 -- 172.21.15.7:0/2207489939 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9950103fa0 con 0x7f9950103b90 2024-09-21T06:35:54.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:54.321+0000 7f9945ffb640 1 -- 172.21.15.7:0/2207489939 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154579+0+0 (secure 0 0 0) 0x7f994c00f450 con 0x7f9950103b90 2024-09-21T06:35:54.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:54.322+0000 7f9945ffb640 1 --2- 172.21.15.7:0/2207489939 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f99380b6620 0x7f99380b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:54.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:54.322+0000 7f9947fff640 1 --2- 172.21.15.7:0/2207489939 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f99380b6620 0x7f99380b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:54.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:54.322+0000 7f9945ffb640 1 -- 172.21.15.7:0/2207489939 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f994c0e7a10 con 0x7f9950103b90 2024-09-21T06:35:54.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:54.322+0000 7f9947fff640 1 --2- 172.21.15.7:0/2207489939 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f99380b6620 0x7f99380b8b30 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9940009230 tx=0x7f9940031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:54.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:54.325+0000 7f9945ffb640 1 -- 172.21.15.7:0/2207489939 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f994c014030 con 0x7f9950103b90 2024-09-21T06:35:54.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:54.553+0000 7f9956f60640 1 -- 172.21.15.7:0/2207489939 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f995019b580 con 0x7f9950103b90 2024-09-21T06:35:54.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:54.553+0000 7f9945ffb640 1 -- 172.21.15.7:0/2207489939 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) ==== 76+0+3078 (secure 0 0 0) 0x7f994c0ae150 con 0x7f9950103b90 2024-09-21T06:35:54.555 INFO:teuthology.orchestra.run.smithi007.stdout:e24 2024-09-21T06:35:54.556 INFO:teuthology.orchestra.run.smithi007.stdout:btime 2024-09-21T06:34:35:988361+0000 2024-09-21T06:35:54.556 INFO:teuthology.orchestra.run.smithi007.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T06:35:54.556 INFO:teuthology.orchestra.run.smithi007.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T06:35:54.556 INFO:teuthology.orchestra.run.smithi007.stdout:legacy client fscid: 1 2024-09-21T06:35:54.556 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:35:54.556 INFO:teuthology.orchestra.run.smithi007.stdout:Filesystem 'cephfs' (1) 2024-09-21T06:35:54.556 INFO:teuthology.orchestra.run.smithi007.stdout:fs_name cephfs 2024-09-21T06:35:54.556 INFO:teuthology.orchestra.run.smithi007.stdout:epoch 24 2024-09-21T06:35:54.556 INFO:teuthology.orchestra.run.smithi007.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-21T06:35:54.556 INFO:teuthology.orchestra.run.smithi007.stdout:created 2024-09-21T06:34:24.627168+0000 2024-09-21T06:35:54.556 INFO:teuthology.orchestra.run.smithi007.stdout:modified 2024-09-21T06:34:35.664086+0000 2024-09-21T06:35:54.557 INFO:teuthology.orchestra.run.smithi007.stdout:tableserver 0 2024-09-21T06:35:54.557 INFO:teuthology.orchestra.run.smithi007.stdout:root 0 2024-09-21T06:35:54.557 INFO:teuthology.orchestra.run.smithi007.stdout:session_timeout 300 2024-09-21T06:35:54.557 INFO:teuthology.orchestra.run.smithi007.stdout:session_autoclose 300 2024-09-21T06:35:54.557 INFO:teuthology.orchestra.run.smithi007.stdout:max_file_size 1099511627776 2024-09-21T06:35:54.557 INFO:teuthology.orchestra.run.smithi007.stdout:max_xattr_size 65536 2024-09-21T06:35:54.557 INFO:teuthology.orchestra.run.smithi007.stdout:required_client_features {} 2024-09-21T06:35:54.557 INFO:teuthology.orchestra.run.smithi007.stdout:last_failure 0 2024-09-21T06:35:54.557 INFO:teuthology.orchestra.run.smithi007.stdout:last_failure_osd_epoch 0 2024-09-21T06:35:54.557 INFO:teuthology.orchestra.run.smithi007.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T06:35:54.557 INFO:teuthology.orchestra.run.smithi007.stdout:max_mds 3 2024-09-21T06:35:54.557 INFO:teuthology.orchestra.run.smithi007.stdout:in 0,1,2 2024-09-21T06:35:54.557 INFO:teuthology.orchestra.run.smithi007.stdout:up {0=24716,1=24688,2=24686} 2024-09-21T06:35:54.557 INFO:teuthology.orchestra.run.smithi007.stdout:failed 2024-09-21T06:35:54.557 INFO:teuthology.orchestra.run.smithi007.stdout:damaged 2024-09-21T06:35:54.558 INFO:teuthology.orchestra.run.smithi007.stdout:stopped 2024-09-21T06:35:54.558 INFO:teuthology.orchestra.run.smithi007.stdout:data_pools [3] 2024-09-21T06:35:54.558 INFO:teuthology.orchestra.run.smithi007.stdout:metadata_pool 2 2024-09-21T06:35:54.558 INFO:teuthology.orchestra.run.smithi007.stdout:inline_data disabled 2024-09-21T06:35:54.558 INFO:teuthology.orchestra.run.smithi007.stdout:balancer 2024-09-21T06:35:54.558 INFO:teuthology.orchestra.run.smithi007.stdout:bal_rank_mask -1 2024-09-21T06:35:54.558 INFO:teuthology.orchestra.run.smithi007.stdout:standby_count_wanted 0 2024-09-21T06:35:54.558 INFO:teuthology.orchestra.run.smithi007.stdout:qdb_cluster leader: 24716 members: 24686,24688,24716 2024-09-21T06:35:54.558 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.b{0:24716} state up:active seq 4 addr [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T06:35:54.558 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.c{0:24673} state up:standby-replay seq 1 addr [v2:172.21.15.144:6836/1126341753,v1:172.21.15.144:6837/1126341753] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T06:35:54.558 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.i{1:24688} state up:active seq 8 addr [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T06:35:54.558 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.f{1:24667} state up:standby-replay seq 1 addr [v2:172.21.15.144:6834/3636739922,v1:172.21.15.144:6835/3636739922] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T06:35:54.558 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.h{2:24686} state up:active seq 9 addr [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T06:35:54.559 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.e{2:24656} state up:standby-replay seq 1 addr [v2:172.21.15.18:6834/158884796,v1:172.21.15.18:6835/158884796] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T06:35:54.559 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:35:54.559 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:35:54.559 INFO:teuthology.orchestra.run.smithi007.stdout:Standby daemons: 2024-09-21T06:35:54.559 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:35:54.559 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.j{-1:14760} state up:standby seq 1 addr [v2:172.21.15.7:6834/2015971546,v1:172.21.15.7:6835/2015971546] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T06:35:54.559 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.d{-1:14772} state up:standby seq 1 addr [v2:172.21.15.7:6836/2350816224,v1:172.21.15.7:6837/2350816224] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T06:35:54.559 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.g{-1:14823} state up:standby seq 1 addr [v2:172.21.15.7:6838/1669980572,v1:172.21.15.7:6839/1669980572] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T06:35:54.559 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.a{-1:14835} state up:standby seq 1 addr [v2:172.21.15.7:6840/2528308973,v1:172.21.15.7:6841/2528308973] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T06:35:54.559 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.k{-1:24623} state up:standby seq 1 addr [v2:172.21.15.18:6832/1337382979,v1:172.21.15.18:6833/1337382979] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T06:35:54.559 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.l{-1:24625} state up:standby seq 1 addr [v2:172.21.15.144:6832/2751454345,v1:172.21.15.144:6833/2751454345] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T06:35:54.560 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 24 2024-09-21T06:35:54.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:54.556+0000 7f9956f60640 1 -- 172.21.15.7:0/2207489939 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f99380b6620 msgr2=0x7f99380b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:54.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:54.556+0000 7f9956f60640 1 --2- 172.21.15.7:0/2207489939 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f99380b6620 0x7f99380b8b30 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9940009230 tx=0x7f9940031400 comp rx=0 tx=0).stop 2024-09-21T06:35:54.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:54.556+0000 7f9956f60640 1 -- 172.21.15.7:0/2207489939 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9950103b90 msgr2=0x7f995019a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:54.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:54.556+0000 7f9956f60640 1 --2- 172.21.15.7:0/2207489939 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9950103b90 0x7f995019a450 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f994c00c920 tx=0x7f994c00cde0 comp rx=0 tx=0).stop 2024-09-21T06:35:54.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:54.556+0000 7f9956f60640 1 -- 172.21.15.7:0/2207489939 shutdown_connections 2024-09-21T06:35:54.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:54.556+0000 7f9956f60640 1 --2- 172.21.15.7:0/2207489939 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f99380b6620 0x7f99380b8b30 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:54.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:54.556+0000 7f9956f60640 1 --2- 172.21.15.7:0/2207489939 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9950109e20 0x7f995019fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:54.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:54.556+0000 7f9956f60640 1 --2- 172.21.15.7:0/2207489939 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f99501094d0 0x7f995019a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:54.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:54.556+0000 7f9956f60640 1 --2- 172.21.15.7:0/2207489939 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9950103b90 0x7f995019a450 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:54.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:54.556+0000 7f9956f60640 1 -- 172.21.15.7:0/2207489939 >> 172.21.15.7:0/2207489939 conn(0x7f99500ff600 msgr2=0x7f9950101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:54.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:54.556+0000 7f9956f60640 1 -- 172.21.15.7:0/2207489939 shutdown_connections 2024-09-21T06:35:54.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:54.556+0000 7f9956f60640 1 -- 172.21.15.7:0/2207489939 wait complete. 2024-09-21T06:35:54.839 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:35:54 smithi007 ceph-mon[30983]: pgmap v310: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T06:35:54.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:35:54 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2207489939' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T06:35:55.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:35:54 smithi144 ceph-mon[34653]: pgmap v310: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T06:35:55.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:35:54 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/2207489939' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T06:35:55.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:35:54 smithi018 ceph-mon[34477]: pgmap v310: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T06:35:55.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:35:54 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/2207489939' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T06:35:55.433 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- bash -c 'ceph osd dump' 2024-09-21T06:35:55.694 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:56.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:56.200+0000 7f2d15252640 1 -- 172.21.15.7:0/2013456693 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d10102a70 msgr2=0x7f2d10102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:56.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:56.200+0000 7f2d15252640 1 --2- 172.21.15.7:0/2013456693 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d10102a70 0x7f2d10102e80 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f2d00009900 tx=0x7f2d0002a410 comp rx=0 tx=0).stop 2024-09-21T06:35:56.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:56.200+0000 7f2d15252640 1 -- 172.21.15.7:0/2013456693 shutdown_connections 2024-09-21T06:35:56.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:56.200+0000 7f2d15252640 1 --2- 172.21.15.7:0/2013456693 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2d10108d00 0x7f2d1010f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:56.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:56.200+0000 7f2d15252640 1 --2- 172.21.15.7:0/2013456693 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d101083b0 0x7f2d101087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:56.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:56.200+0000 7f2d15252640 1 --2- 172.21.15.7:0/2013456693 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d10102a70 0x7f2d10102e80 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:56.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:56.200+0000 7f2d15252640 1 -- 172.21.15.7:0/2013456693 >> 172.21.15.7:0/2013456693 conn(0x7f2d10079730 msgr2=0x7f2d10079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:56.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:56.200+0000 7f2d15252640 1 -- 172.21.15.7:0/2013456693 shutdown_connections 2024-09-21T06:35:56.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:56.200+0000 7f2d15252640 1 -- 172.21.15.7:0/2013456693 wait complete. 2024-09-21T06:35:56.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:56.201+0000 7f2d15252640 1 Processor -- start 2024-09-21T06:35:56.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:56.201+0000 7f2d15252640 1 -- start start 2024-09-21T06:35:56.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:56.201+0000 7f2d15252640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d10102a70 0x7f2d1019b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:56.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:56.201+0000 7f2d15252640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d101083b0 0x7f2d1019b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:56.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:56.201+0000 7f2d15252640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2d10108d00 0x7f2d1019bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:56.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:56.201+0000 7f2d15252640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2d101129d0 con 0x7f2d101083b0 2024-09-21T06:35:56.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:56.201+0000 7f2d15252640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2d10112850 con 0x7f2d10102a70 2024-09-21T06:35:56.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:56.201+0000 7f2d15252640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2d10112b50 con 0x7f2d10108d00 2024-09-21T06:35:56.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:56.201+0000 7f2d0e59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d101083b0 0x7f2d1019b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:56.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:56.201+0000 7f2d0e59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d101083b0 0x7f2d1019b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47142/0 (socket says 172.21.15.7:47142) 2024-09-21T06:35:56.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:56.201+0000 7f2d0e59c640 1 -- 172.21.15.7:0/3616272017 learned_addr learned my addr 172.21.15.7:0/3616272017 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:35:56.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:56.201+0000 7f2d0ed9d640 1 --2- 172.21.15.7:0/3616272017 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d10102a70 0x7f2d1019b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:56.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:56.202+0000 7f2d0f59e640 1 --2- 172.21.15.7:0/3616272017 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2d10108d00 0x7f2d1019bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:56.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:56.202+0000 7f2d0e59c640 1 -- 172.21.15.7:0/3616272017 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2d10108d00 msgr2=0x7f2d1019bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:56.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:56.202+0000 7f2d0e59c640 1 --2- 172.21.15.7:0/3616272017 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2d10108d00 0x7f2d1019bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:56.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:56.202+0000 7f2d0e59c640 1 -- 172.21.15.7:0/3616272017 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d10102a70 msgr2=0x7f2d1019b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:56.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:56.202+0000 7f2d0e59c640 1 --2- 172.21.15.7:0/3616272017 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d10102a70 0x7f2d1019b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:56.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:56.202+0000 7f2d0e59c640 1 -- 172.21.15.7:0/3616272017 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d101a65b0 con 0x7f2d101083b0 2024-09-21T06:35:56.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:56.202+0000 7f2d0f59e640 1 --2- 172.21.15.7:0/3616272017 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2d10108d00 0x7f2d1019bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:35:56.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:56.202+0000 7f2d0e59c640 1 --2- 172.21.15.7:0/3616272017 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d101083b0 0x7f2d1019b860 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f2cf800d770 tx=0x7f2cf800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:56.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:56.202+0000 7f2d07fff640 1 -- 172.21.15.7:0/3616272017 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cf8017070 con 0x7f2d101083b0 2024-09-21T06:35:56.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:56.202+0000 7f2d15252640 1 -- 172.21.15.7:0/3616272017 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d101a68a0 con 0x7f2d101083b0 2024-09-21T06:35:56.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:56.202+0000 7f2d07fff640 1 -- 172.21.15.7:0/3616272017 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2cf8009c30 con 0x7f2d101083b0 2024-09-21T06:35:56.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:56.202+0000 7f2d07fff640 1 -- 172.21.15.7:0/3616272017 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cf800f620 con 0x7f2d101083b0 2024-09-21T06:35:56.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:56.202+0000 7f2d15252640 1 -- 172.21.15.7:0/3616272017 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d101a6eb0 con 0x7f2d101083b0 2024-09-21T06:35:56.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:56.203+0000 7f2d15252640 1 -- 172.21.15.7:0/3616272017 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d10103cf0 con 0x7f2d101083b0 2024-09-21T06:35:56.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:56.205+0000 7f2d07fff640 1 -- 172.21.15.7:0/3616272017 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154579+0+0 (secure 0 0 0) 0x7f2cf801a070 con 0x7f2d101083b0 2024-09-21T06:35:56.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:56.206+0000 7f2d07fff640 1 --2- 172.21.15.7:0/3616272017 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f2cfc0b6620 0x7f2cfc0b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:56.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:56.206+0000 7f2d0ed9d640 1 --2- 172.21.15.7:0/3616272017 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f2cfc0b6620 0x7f2cfc0b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:56.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:56.206+0000 7f2d07fff640 1 -- 172.21.15.7:0/3616272017 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f2cf80e70c0 con 0x7f2d101083b0 2024-09-21T06:35:56.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:56.206+0000 7f2d0ed9d640 1 --2- 172.21.15.7:0/3616272017 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f2cfc0b6620 0x7f2cfc0b8b30 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2d00000c00 tx=0x7f2d00031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:56.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:56.209+0000 7f2d07fff640 1 -- 172.21.15.7:0/3616272017 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2cf80ad730 con 0x7f2d101083b0 2024-09-21T06:35:56.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:56.398+0000 7f2d15252640 1 -- 172.21.15.7:0/3616272017 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f2d10102e80 con 0x7f2d101083b0 2024-09-21T06:35:56.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:56.399+0000 7f2d07fff640 1 -- 172.21.15.7:0/3616272017 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v77) ==== 56+0+5574 (secure 0 0 0) 0x7f2cf80b1b10 con 0x7f2d101083b0 2024-09-21T06:35:56.401 INFO:teuthology.orchestra.run.smithi007.stdout:epoch 77 2024-09-21T06:35:56.401 INFO:teuthology.orchestra.run.smithi007.stdout:fsid 347cb918-77e2-11ef-baf5-efdc52797490 2024-09-21T06:35:56.401 INFO:teuthology.orchestra.run.smithi007.stdout:created 2024-09-21T06:25:51.925032+0000 2024-09-21T06:35:56.401 INFO:teuthology.orchestra.run.smithi007.stdout:modified 2024-09-21T06:34:44.220989+0000 2024-09-21T06:35:56.401 INFO:teuthology.orchestra.run.smithi007.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-21T06:35:56.401 INFO:teuthology.orchestra.run.smithi007.stdout:crush_version 26 2024-09-21T06:35:56.402 INFO:teuthology.orchestra.run.smithi007.stdout:full_ratio 0.95 2024-09-21T06:35:56.402 INFO:teuthology.orchestra.run.smithi007.stdout:backfillfull_ratio 0.9 2024-09-21T06:35:56.402 INFO:teuthology.orchestra.run.smithi007.stdout:nearfull_ratio 0.85 2024-09-21T06:35:56.402 INFO:teuthology.orchestra.run.smithi007.stdout:require_min_compat_client luminous 2024-09-21T06:35:56.402 INFO:teuthology.orchestra.run.smithi007.stdout:min_compat_client luminous 2024-09-21T06:35:56.402 INFO:teuthology.orchestra.run.smithi007.stdout:require_osd_release squid 2024-09-21T06:35:56.402 INFO:teuthology.orchestra.run.smithi007.stdout:stretch_mode_enabled false 2024-09-21T06:35:56.402 INFO:teuthology.orchestra.run.smithi007.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-21T06:35:56.402 INFO:teuthology.orchestra.run.smithi007.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 75 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 2.25 2024-09-21T06:35:56.402 INFO:teuthology.orchestra.run.smithi007.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 75 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-09-21T06:35:56.402 INFO:teuthology.orchestra.run.smithi007.stdout:max_osd 12 2024-09-21T06:35:56.402 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0 up in weight 1 up_from 9 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:172.21.15.7:6802/942632794,v1:172.21.15.7:6803/942632794] [v2:172.21.15.7:6804/942632794,v1:172.21.15.7:6805/942632794] exists,up 1be5c4a4-3931-4d8b-95c7-c05f5b73fcfb 2024-09-21T06:35:56.402 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1 up in weight 1 up_from 14 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:172.21.15.18:6800/1839342931,v1:172.21.15.18:6801/1839342931] [v2:172.21.15.18:6802/1839342931,v1:172.21.15.18:6803/1839342931] exists,up 7ae136a8-c614-47e5-b265-c6cfa857a7fa 2024-09-21T06:35:56.402 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2 up in weight 1 up_from 19 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:172.21.15.144:6800/1699582162,v1:172.21.15.144:6801/1699582162] [v2:172.21.15.144:6802/1699582162,v1:172.21.15.144:6803/1699582162] exists,up 97b13994-4680-4573-9c2e-ac65ea740e78 2024-09-21T06:35:56.403 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3 up in weight 1 up_from 25 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:172.21.15.7:6810/3202935163,v1:172.21.15.7:6811/3202935163] [v2:172.21.15.7:6812/3202935163,v1:172.21.15.7:6813/3202935163] exists,up ddf70d51-404d-491d-a6a8-15fca4ef01db 2024-09-21T06:35:56.403 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4 up in weight 1 up_from 31 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:172.21.15.18:6808/1058105724,v1:172.21.15.18:6809/1058105724] [v2:172.21.15.18:6810/1058105724,v1:172.21.15.18:6811/1058105724] exists,up f2ae4340-accf-4ac0-a4d3-c08302712ce1 2024-09-21T06:35:56.403 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5 up in weight 1 up_from 36 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.144:6808/2814586621,v1:172.21.15.144:6809/2814586621] [v2:172.21.15.144:6810/2814586621,v1:172.21.15.144:6811/2814586621] exists,up d56abc37-de6f-47a4-9f5e-67224da78f4c 2024-09-21T06:35:56.403 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6 up in weight 1 up_from 42 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:172.21.15.7:6818/3770978305,v1:172.21.15.7:6819/3770978305] [v2:172.21.15.7:6820/3770978305,v1:172.21.15.7:6821/3770978305] exists,up 9145650c-e9b1-4e5a-ae6f-17c8960146e9 2024-09-21T06:35:56.403 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7 up in weight 1 up_from 47 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:172.21.15.18:6816/1322408496,v1:172.21.15.18:6817/1322408496] [v2:172.21.15.18:6818/1322408496,v1:172.21.15.18:6819/1322408496] exists,up ca658683-38f7-47ca-b32e-512fe4738ef1 2024-09-21T06:35:56.403 INFO:teuthology.orchestra.run.smithi007.stdout:osd.8 up in weight 1 up_from 52 up_thru 73 down_at 0 last_clean_interval [0,0) [v2:172.21.15.144:6816/1011657022,v1:172.21.15.144:6817/1011657022] [v2:172.21.15.144:6818/1011657022,v1:172.21.15.144:6819/1011657022] exists,up 40d1f37e-6fac-40b9-9319-78f4fc3a6f20 2024-09-21T06:35:56.403 INFO:teuthology.orchestra.run.smithi007.stdout:osd.9 up in weight 1 up_from 58 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.7:6826/256146339,v1:172.21.15.7:6827/256146339] [v2:172.21.15.7:6828/256146339,v1:172.21.15.7:6829/256146339] exists,up ad12d6f7-fd21-49bd-a343-744f3cff4bbb 2024-09-21T06:35:56.403 INFO:teuthology.orchestra.run.smithi007.stdout:osd.10 up in weight 1 up_from 63 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.18:6824/2038885362,v1:172.21.15.18:6825/2038885362] [v2:172.21.15.18:6826/2038885362,v1:172.21.15.18:6827/2038885362] exists,up 1317a2ad-ec15-4096-b2da-689475b7cacc 2024-09-21T06:35:56.403 INFO:teuthology.orchestra.run.smithi007.stdout:osd.11 up in weight 1 up_from 69 up_thru 76 down_at 0 last_clean_interval [0,0) [v2:172.21.15.144:6824/1047060848,v1:172.21.15.144:6825/1047060848] [v2:172.21.15.144:6826/1047060848,v1:172.21.15.144:6827/1047060848] exists,up f9252acb-7290-4923-89f3-844c868d4b39 2024-09-21T06:35:56.403 INFO:teuthology.orchestra.run.smithi007.stdout:pg_upmap_items 2.4 [2,11] 2024-09-21T06:35:56.403 INFO:teuthology.orchestra.run.smithi007.stdout:pg_upmap_items 2.6 [8,11] 2024-09-21T06:35:56.404 INFO:teuthology.orchestra.run.smithi007.stdout:pg_upmap_items 3.e [5,9] 2024-09-21T06:35:56.404 INFO:teuthology.orchestra.run.smithi007.stdout:pg_upmap_items 3.1b [4,8] 2024-09-21T06:35:56.404 INFO:teuthology.orchestra.run.smithi007.stdout:pg_upmap_items 3.36 [4,9] 2024-09-21T06:35:56.404 INFO:teuthology.orchestra.run.smithi007.stdout:pg_upmap_items 3.3c [4,9] 2024-09-21T06:35:56.404 INFO:teuthology.orchestra.run.smithi007.stdout:blocklist 172.21.15.7:0/1296137341 expires 2024-09-22T06:27:43.044484+0000 2024-09-21T06:35:56.404 INFO:teuthology.orchestra.run.smithi007.stdout:blocklist 172.21.15.7:6801/3879502931 expires 2024-09-22T06:27:43.044484+0000 2024-09-21T06:35:56.404 INFO:teuthology.orchestra.run.smithi007.stdout:blocklist 172.21.15.7:0/1926706877 expires 2024-09-22T06:26:40.520265+0000 2024-09-21T06:35:56.404 INFO:teuthology.orchestra.run.smithi007.stdout:blocklist 172.21.15.7:0/2034370456 expires 2024-09-22T06:26:14.181426+0000 2024-09-21T06:35:56.404 INFO:teuthology.orchestra.run.smithi007.stdout:blocklist 172.21.15.7:6801/3339522713 expires 2024-09-22T06:26:14.181426+0000 2024-09-21T06:35:56.404 INFO:teuthology.orchestra.run.smithi007.stdout:blocklist 172.21.15.7:6800/3339522713 expires 2024-09-22T06:26:14.181426+0000 2024-09-21T06:35:56.404 INFO:teuthology.orchestra.run.smithi007.stdout:blocklist 172.21.15.7:0/3586807770 expires 2024-09-22T06:26:14.181426+0000 2024-09-21T06:35:56.404 INFO:teuthology.orchestra.run.smithi007.stdout:blocklist 172.21.15.7:0/1814223919 expires 2024-09-22T06:27:43.044484+0000 2024-09-21T06:35:56.404 INFO:teuthology.orchestra.run.smithi007.stdout:blocklist 172.21.15.7:0/601150037 expires 2024-09-22T06:26:40.520265+0000 2024-09-21T06:35:56.404 INFO:teuthology.orchestra.run.smithi007.stdout:blocklist 172.21.15.7:6800/3876787626 expires 2024-09-22T06:26:40.520265+0000 2024-09-21T06:35:56.405 INFO:teuthology.orchestra.run.smithi007.stdout:blocklist 172.21.15.7:0/186444636 expires 2024-09-22T06:26:14.181426+0000 2024-09-21T06:35:56.405 INFO:teuthology.orchestra.run.smithi007.stdout:blocklist 172.21.15.7:0/2180184348 expires 2024-09-22T06:26:40.520265+0000 2024-09-21T06:35:56.405 INFO:teuthology.orchestra.run.smithi007.stdout:blocklist 172.21.15.7:6801/3876787626 expires 2024-09-22T06:26:40.520265+0000 2024-09-21T06:35:56.405 INFO:teuthology.orchestra.run.smithi007.stdout:blocklist 172.21.15.7:0/2931793461 expires 2024-09-22T06:27:43.044484+0000 2024-09-21T06:35:56.405 INFO:teuthology.orchestra.run.smithi007.stdout:blocklist 172.21.15.7:6800/3879502931 expires 2024-09-22T06:27:43.044484+0000 2024-09-21T06:35:56.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:56.401+0000 7f2d15252640 1 -- 172.21.15.7:0/3616272017 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f2cfc0b6620 msgr2=0x7f2cfc0b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:56.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:56.401+0000 7f2d15252640 1 --2- 172.21.15.7:0/3616272017 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f2cfc0b6620 0x7f2cfc0b8b30 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2d00000c00 tx=0x7f2d00031400 comp rx=0 tx=0).stop 2024-09-21T06:35:56.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:56.401+0000 7f2d15252640 1 -- 172.21.15.7:0/3616272017 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d101083b0 msgr2=0x7f2d1019b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:56.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:56.401+0000 7f2d15252640 1 --2- 172.21.15.7:0/3616272017 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d101083b0 0x7f2d1019b860 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f2cf800d770 tx=0x7f2cf800dc30 comp rx=0 tx=0).stop 2024-09-21T06:35:56.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:56.401+0000 7f2d15252640 1 -- 172.21.15.7:0/3616272017 shutdown_connections 2024-09-21T06:35:56.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:56.401+0000 7f2d15252640 1 --2- 172.21.15.7:0/3616272017 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f2cfc0b6620 0x7f2cfc0b8b30 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:56.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:56.401+0000 7f2d15252640 1 --2- 172.21.15.7:0/3616272017 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2d10108d00 0x7f2d1019bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:56.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:56.401+0000 7f2d15252640 1 --2- 172.21.15.7:0/3616272017 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d101083b0 0x7f2d1019b860 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:56.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:56.401+0000 7f2d15252640 1 --2- 172.21.15.7:0/3616272017 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d10102a70 0x7f2d1019b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:56.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:56.401+0000 7f2d15252640 1 -- 172.21.15.7:0/3616272017 >> 172.21.15.7:0/3616272017 conn(0x7f2d10079730 msgr2=0x7f2d101014c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:56.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:56.402+0000 7f2d15252640 1 -- 172.21.15.7:0/3616272017 shutdown_connections 2024-09-21T06:35:56.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:56.402+0000 7f2d15252640 1 -- 172.21.15.7:0/3616272017 wait complete. 2024-09-21T06:35:56.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:35:56 smithi007 ceph-mon[30983]: pgmap v311: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:35:56.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:35:56 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/3616272017' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T06:35:56.921 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:35:56 smithi018 ceph-mon[34477]: pgmap v311: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:35:56.921 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:35:56 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/3616272017' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T06:35:57.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:35:56 smithi144 ceph-mon[34653]: pgmap v311: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:35:57.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:35:56 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/3616272017' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T06:35:57.042 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-21T06:35:57.059 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:35:57.319 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:57.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:57.871+0000 7fd95eebf640 1 -- 172.21.15.7:0/3838243941 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd958102a80 msgr2=0x7fd958102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:57.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:57.871+0000 7fd95eebf640 1 --2- 172.21.15.7:0/3838243941 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd958102a80 0x7fd958102e90 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fd948009900 tx=0x7fd94802a410 comp rx=0 tx=0).stop 2024-09-21T06:35:57.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:57.871+0000 7fd95eebf640 1 -- 172.21.15.7:0/3838243941 shutdown_connections 2024-09-21T06:35:57.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:57.871+0000 7fd95eebf640 1 --2- 172.21.15.7:0/3838243941 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd958108d10 0x7fd95810f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:57.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:57.871+0000 7fd95eebf640 1 --2- 172.21.15.7:0/3838243941 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd9581083c0 0x7fd9581087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:57.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:57.871+0000 7fd95eebf640 1 --2- 172.21.15.7:0/3838243941 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd958102a80 0x7fd958102e90 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:57.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:57.871+0000 7fd95eebf640 1 -- 172.21.15.7:0/3838243941 >> 172.21.15.7:0/3838243941 conn(0x7fd958079740 msgr2=0x7fd958079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:57.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:57.871+0000 7fd95eebf640 1 -- 172.21.15.7:0/3838243941 shutdown_connections 2024-09-21T06:35:57.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:57.871+0000 7fd95eebf640 1 -- 172.21.15.7:0/3838243941 wait complete. 2024-09-21T06:35:57.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:57.872+0000 7fd95eebf640 1 Processor -- start 2024-09-21T06:35:57.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:57.872+0000 7fd95eebf640 1 -- start start 2024-09-21T06:35:57.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:57.872+0000 7fd95eebf640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd958102a80 0x7fd9581990e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:57.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:57.872+0000 7fd95eebf640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9581083c0 0x7fd958199620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:57.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:57.872+0000 7fd95eebf640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd958108d10 0x7fd958199b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:57.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:57.872+0000 7fd95eebf640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd958112980 con 0x7fd9581083c0 2024-09-21T06:35:57.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:57.872+0000 7fd95eebf640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd958112800 con 0x7fd958102a80 2024-09-21T06:35:57.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:57.872+0000 7fd95eebf640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd958112b00 con 0x7fd958108d10 2024-09-21T06:35:57.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:57.872+0000 7fd957fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9581083c0 0x7fd958199620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:57.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:57.872+0000 7fd957fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9581083c0 0x7fd958199620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47156/0 (socket says 172.21.15.7:47156) 2024-09-21T06:35:57.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:57.872+0000 7fd957fff640 1 -- 172.21.15.7:0/2938529174 learned_addr learned my addr 172.21.15.7:0/2938529174 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:35:57.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:57.872+0000 7fd95cc5b640 1 --2- 172.21.15.7:0/2938529174 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd958102a80 0x7fd9581990e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:57.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:57.872+0000 7fd95d45c640 1 --2- 172.21.15.7:0/2938529174 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd958108d10 0x7fd958199b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:57.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:57.872+0000 7fd957fff640 1 -- 172.21.15.7:0/2938529174 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd958108d10 msgr2=0x7fd958199b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:57.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:57.872+0000 7fd957fff640 1 --2- 172.21.15.7:0/2938529174 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd958108d10 0x7fd958199b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:57.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:57.872+0000 7fd957fff640 1 -- 172.21.15.7:0/2938529174 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd958102a80 msgr2=0x7fd9581990e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:57.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:57.872+0000 7fd957fff640 1 --2- 172.21.15.7:0/2938529174 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd958102a80 0x7fd9581990e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:57.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:57.872+0000 7fd957fff640 1 -- 172.21.15.7:0/2938529174 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9581a8760 con 0x7fd9581083c0 2024-09-21T06:35:57.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:57.873+0000 7fd957fff640 1 --2- 172.21.15.7:0/2938529174 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9581083c0 0x7fd958199620 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fd94000c970 tx=0x7fd94000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:57.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:57.873+0000 7fd955ffb640 1 -- 172.21.15.7:0/2938529174 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd940014070 con 0x7fd9581083c0 2024-09-21T06:35:57.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:57.873+0000 7fd95eebf640 1 -- 172.21.15.7:0/2938529174 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9581a89f0 con 0x7fd9581083c0 2024-09-21T06:35:57.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:57.873+0000 7fd955ffb640 1 -- 172.21.15.7:0/2938529174 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd940004440 con 0x7fd9581083c0 2024-09-21T06:35:57.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:57.873+0000 7fd955ffb640 1 -- 172.21.15.7:0/2938529174 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd940003e50 con 0x7fd9581083c0 2024-09-21T06:35:57.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:57.873+0000 7fd95eebf640 1 -- 172.21.15.7:0/2938529174 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9581a8f80 con 0x7fd9581083c0 2024-09-21T06:35:57.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:57.874+0000 7fd95eebf640 1 -- 172.21.15.7:0/2938529174 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd958103d00 con 0x7fd9581083c0 2024-09-21T06:35:57.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:57.875+0000 7fd955ffb640 1 -- 172.21.15.7:0/2938529174 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154579+0+0 (secure 0 0 0) 0x7fd940017070 con 0x7fd9581083c0 2024-09-21T06:35:57.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:57.876+0000 7fd955ffb640 1 --2- 172.21.15.7:0/2938529174 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fd9440b6810 0x7fd9440b8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:57.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:57.876+0000 7fd95cc5b640 1 --2- 172.21.15.7:0/2938529174 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fd9440b6810 0x7fd9440b8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:57.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:57.876+0000 7fd955ffb640 1 -- 172.21.15.7:0/2938529174 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fd9400e7400 con 0x7fd9581083c0 2024-09-21T06:35:57.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:57.877+0000 7fd95cc5b640 1 --2- 172.21.15.7:0/2938529174 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fd9440b6810 0x7fd9440b8d20 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd948000c00 tx=0x7fd948031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:57.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:57.881+0000 7fd955ffb640 1 -- 172.21.15.7:0/2938529174 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd94001e020 con 0x7fd9581083c0 2024-09-21T06:35:58.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:58.109+0000 7fd95eebf640 1 -- 172.21.15.7:0/2938529174 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd95806bf50 con 0x7fd9581083c0 2024-09-21T06:35:58.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:58.109+0000 7fd955ffb640 1 -- 172.21.15.7:0/2938529174 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11899 (secure 0 0 0) 0x7fd9400ada70 con 0x7fd9581083c0 2024-09-21T06:35:58.111 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:35:58.112 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":24,"btime":"2024-09-21T06:34:35:988361+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2015971546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2015971546},{"type":"v1","addr":"172.21.15.7:6835","nonce":2015971546}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/2350816224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":2350816224},{"type":"v1","addr":"172.21.15.7:6837","nonce":2350816224}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14823,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/1669980572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":1669980572},{"type":"v1","addr":"172.21.15.7:6839","nonce":1669980572}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14835,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/2528308973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":2528308973},{"type":"v1","addr":"172.21.15.7:6841","nonce":2528308973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24623,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1337382979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1337382979},{"type":"v1","addr":"172.21.15.18:6833","nonce":1337382979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/2751454345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":2751454345},{"type":"v1","addr":"172.21.15.144:6833","nonce":2751454345}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:34:24.627168+0000","modified":"2024-09-21T06:34:35.664086+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24716,"mds_1":24688,"mds_2":24686},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24656":{"gid":24656,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6835/158884796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":158884796},{"type":"v1","addr":"172.21.15.18:6835","nonce":158884796}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6835/3636739922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3636739922},{"type":"v1","addr":"172.21.15.144:6835","nonce":3636739922}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24673":{"gid":24673,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6837/1126341753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":1126341753},{"type":"v1","addr":"172.21.15.144:6837","nonce":1126341753}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.18:6837/1539670694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1539670694},{"type":"v1","addr":"172.21.15.18:6837","nonce":1539670694}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24688":{"gid":24688,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.144:6839/4027821922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":4027821922},{"type":"v1","addr":"172.21.15.144:6839","nonce":4027821922}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24716":{"gid":24716,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.18:6839/3798713532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":3798713532},{"type":"v1","addr":"172.21.15.18:6839","nonce":3798713532}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24716,"qdb_cluster":[24686,24688,24716]},"id":1}]} 2024-09-21T06:35:58.112 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 24 2024-09-21T06:35:58.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:58.111+0000 7fd95eebf640 1 -- 172.21.15.7:0/2938529174 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fd9440b6810 msgr2=0x7fd9440b8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:58.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:58.111+0000 7fd95eebf640 1 --2- 172.21.15.7:0/2938529174 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fd9440b6810 0x7fd9440b8d20 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd948000c00 tx=0x7fd948031400 comp rx=0 tx=0).stop 2024-09-21T06:35:58.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:58.111+0000 7fd95eebf640 1 -- 172.21.15.7:0/2938529174 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9581083c0 msgr2=0x7fd958199620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:58.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:58.111+0000 7fd95eebf640 1 --2- 172.21.15.7:0/2938529174 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9581083c0 0x7fd958199620 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fd94000c970 tx=0x7fd94000ce30 comp rx=0 tx=0).stop 2024-09-21T06:35:58.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:58.111+0000 7fd95eebf640 1 -- 172.21.15.7:0/2938529174 shutdown_connections 2024-09-21T06:35:58.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:58.111+0000 7fd95eebf640 1 --2- 172.21.15.7:0/2938529174 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fd9440b6810 0x7fd9440b8d20 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:58.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:58.111+0000 7fd95eebf640 1 --2- 172.21.15.7:0/2938529174 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd958108d10 0x7fd958199b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:58.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:58.111+0000 7fd95eebf640 1 --2- 172.21.15.7:0/2938529174 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9581083c0 0x7fd958199620 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:58.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:58.111+0000 7fd95eebf640 1 --2- 172.21.15.7:0/2938529174 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd958102a80 0x7fd9581990e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:58.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:58.112+0000 7fd95eebf640 1 -- 172.21.15.7:0/2938529174 >> 172.21.15.7:0/2938529174 conn(0x7fd958079740 msgr2=0x7fd9581014d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:58.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:58.112+0000 7fd95eebf640 1 -- 172.21.15.7:0/2938529174 shutdown_connections 2024-09-21T06:35:58.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:58.112+0000 7fd95eebf640 1 -- 172.21.15.7:0/2938529174 wait complete. 2024-09-21T06:35:58.839 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:35:58 smithi007 ceph-mon[30983]: pgmap v312: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:35:58.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:35:58 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2938529174' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:35:58.922 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:35:59.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:35:58 smithi144 ceph-mon[34653]: pgmap v312: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:35:59.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:35:58 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/2938529174' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:35:59.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:35:58 smithi018 ceph-mon[34477]: pgmap v312: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:35:59.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:35:58 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/2938529174' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:35:59.183 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:35:59.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:59.657+0000 7ff3cfdd7640 1 -- 172.21.15.7:0/3039272476 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff3c8108d00 msgr2=0x7ff3c810f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:59.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:59.657+0000 7ff3cfdd7640 1 --2- 172.21.15.7:0/3039272476 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff3c8108d00 0x7ff3c810f530 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7ff3c0009ca0 tx=0x7ff3c002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:35:59.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:59.657+0000 7ff3cfdd7640 1 -- 172.21.15.7:0/3039272476 shutdown_connections 2024-09-21T06:35:59.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:59.657+0000 7ff3cfdd7640 1 --2- 172.21.15.7:0/3039272476 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff3c8108d00 0x7ff3c810f530 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:59.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:59.657+0000 7ff3cfdd7640 1 --2- 172.21.15.7:0/3039272476 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3c81083b0 0x7ff3c81087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:59.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:59.657+0000 7ff3cfdd7640 1 --2- 172.21.15.7:0/3039272476 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff3c8102a70 0x7ff3c8102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:59.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:59.657+0000 7ff3cfdd7640 1 -- 172.21.15.7:0/3039272476 >> 172.21.15.7:0/3039272476 conn(0x7ff3c8079710 msgr2=0x7ff3c8079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:59.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:59.657+0000 7ff3cfdd7640 1 -- 172.21.15.7:0/3039272476 shutdown_connections 2024-09-21T06:35:59.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:59.658+0000 7ff3cfdd7640 1 -- 172.21.15.7:0/3039272476 wait complete. 2024-09-21T06:35:59.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:59.659+0000 7ff3cfdd7640 1 Processor -- start 2024-09-21T06:35:59.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:59.659+0000 7ff3cfdd7640 1 -- start start 2024-09-21T06:35:59.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:59.659+0000 7ff3cfdd7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff3c8102a70 0x7ff3c80ff5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:59.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:59.659+0000 7ff3cfdd7640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff3c81083b0 0x7ff3c80ffb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:59.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:59.659+0000 7ff3cfdd7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3c8108d00 0x7ff3c8100070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:59.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:59.659+0000 7ff3cfdd7640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c81129c0 con 0x7ff3c8102a70 2024-09-21T06:35:59.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:59.659+0000 7ff3cfdd7640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c8112840 con 0x7ff3c8108d00 2024-09-21T06:35:59.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:59.659+0000 7ff3cfdd7640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c8112b40 con 0x7ff3c81083b0 2024-09-21T06:35:59.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:59.659+0000 7ff3cdb73640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff3c8102a70 0x7ff3c80ff5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:59.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:59.659+0000 7ff3cdb73640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff3c8102a70 0x7ff3c80ff5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47176/0 (socket says 172.21.15.7:47176) 2024-09-21T06:35:59.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:59.659+0000 7ff3cdb73640 1 -- 172.21.15.7:0/4150751874 learned_addr learned my addr 172.21.15.7:0/4150751874 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:35:59.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:59.660+0000 7ff3ce374640 1 --2- 172.21.15.7:0/4150751874 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3c8108d00 0x7ff3c8100070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:59.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:59.660+0000 7ff3cd372640 1 --2- 172.21.15.7:0/4150751874 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff3c81083b0 0x7ff3c80ffb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:59.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:59.660+0000 7ff3cdb73640 1 -- 172.21.15.7:0/4150751874 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff3c81083b0 msgr2=0x7ff3c80ffb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:59.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:59.660+0000 7ff3cdb73640 1 --2- 172.21.15.7:0/4150751874 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff3c81083b0 0x7ff3c80ffb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:59.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:59.660+0000 7ff3cdb73640 1 -- 172.21.15.7:0/4150751874 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3c8108d00 msgr2=0x7ff3c8100070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:59.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:59.660+0000 7ff3cdb73640 1 --2- 172.21.15.7:0/4150751874 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3c8108d00 0x7ff3c8100070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:59.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:59.660+0000 7ff3cdb73640 1 -- 172.21.15.7:0/4150751874 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3c81a8700 con 0x7ff3c8102a70 2024-09-21T06:35:59.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:59.660+0000 7ff3cdb73640 1 --2- 172.21.15.7:0/4150751874 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff3c8102a70 0x7ff3c80ff5f0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7ff3c400c970 tx=0x7ff3c400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:59.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:59.660+0000 7ff3beffd640 1 -- 172.21.15.7:0/4150751874 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c4007bb0 con 0x7ff3c8102a70 2024-09-21T06:35:59.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:59.660+0000 7ff3cfdd7640 1 -- 172.21.15.7:0/4150751874 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3c81a89f0 con 0x7ff3c8102a70 2024-09-21T06:35:59.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:59.660+0000 7ff3beffd640 1 -- 172.21.15.7:0/4150751874 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff3c4007d50 con 0x7ff3c8102a70 2024-09-21T06:35:59.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:59.660+0000 7ff3beffd640 1 -- 172.21.15.7:0/4150751874 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c400f450 con 0x7ff3c8102a70 2024-09-21T06:35:59.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:59.660+0000 7ff3cfdd7640 1 -- 172.21.15.7:0/4150751874 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3c81a8f30 con 0x7ff3c8102a70 2024-09-21T06:35:59.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:59.661+0000 7ff3cfdd7640 1 -- 172.21.15.7:0/4150751874 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3c8103cf0 con 0x7ff3c8102a70 2024-09-21T06:35:59.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:59.663+0000 7ff3beffd640 1 -- 172.21.15.7:0/4150751874 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154579+0+0 (secure 0 0 0) 0x7ff3c4004f00 con 0x7ff3c8102a70 2024-09-21T06:35:59.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:59.664+0000 7ff3beffd640 1 --2- 172.21.15.7:0/4150751874 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7ff3b40b65f0 0x7ff3b40b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:35:59.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:59.664+0000 7ff3cd372640 1 --2- 172.21.15.7:0/4150751874 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7ff3b40b65f0 0x7ff3b40b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:35:59.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:59.664+0000 7ff3beffd640 1 -- 172.21.15.7:0/4150751874 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7ff3c40e7720 con 0x7ff3c8102a70 2024-09-21T06:35:59.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:59.664+0000 7ff3cd372640 1 --2- 172.21.15.7:0/4150751874 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7ff3b40b65f0 0x7ff3b40b8b00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff3b8005fd0 tx=0x7ff3b8005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:35:59.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:59.667+0000 7ff3beffd640 1 -- 172.21.15.7:0/4150751874 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff3c4014030 con 0x7ff3c8102a70 2024-09-21T06:35:59.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:59.892+0000 7ff3cfdd7640 1 -- 172.21.15.7:0/4150751874 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff3c8102e80 con 0x7ff3c8102a70 2024-09-21T06:35:59.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:59.893+0000 7ff3beffd640 1 -- 172.21.15.7:0/4150751874 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11899 (secure 0 0 0) 0x7ff3c40addd0 con 0x7ff3c8102a70 2024-09-21T06:35:59.895 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:35:59.895 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":24,"btime":"2024-09-21T06:34:35:988361+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2015971546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2015971546},{"type":"v1","addr":"172.21.15.7:6835","nonce":2015971546}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/2350816224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":2350816224},{"type":"v1","addr":"172.21.15.7:6837","nonce":2350816224}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14823,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/1669980572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":1669980572},{"type":"v1","addr":"172.21.15.7:6839","nonce":1669980572}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14835,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/2528308973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":2528308973},{"type":"v1","addr":"172.21.15.7:6841","nonce":2528308973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24623,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1337382979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1337382979},{"type":"v1","addr":"172.21.15.18:6833","nonce":1337382979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/2751454345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":2751454345},{"type":"v1","addr":"172.21.15.144:6833","nonce":2751454345}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:34:24.627168+0000","modified":"2024-09-21T06:34:35.664086+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24716,"mds_1":24688,"mds_2":24686},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24656":{"gid":24656,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6835/158884796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":158884796},{"type":"v1","addr":"172.21.15.18:6835","nonce":158884796}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6835/3636739922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3636739922},{"type":"v1","addr":"172.21.15.144:6835","nonce":3636739922}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24673":{"gid":24673,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6837/1126341753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":1126341753},{"type":"v1","addr":"172.21.15.144:6837","nonce":1126341753}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.18:6837/1539670694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1539670694},{"type":"v1","addr":"172.21.15.18:6837","nonce":1539670694}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24688":{"gid":24688,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.144:6839/4027821922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":4027821922},{"type":"v1","addr":"172.21.15.144:6839","nonce":4027821922}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24716":{"gid":24716,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.18:6839/3798713532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":3798713532},{"type":"v1","addr":"172.21.15.18:6839","nonce":3798713532}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24716,"qdb_cluster":[24686,24688,24716]},"id":1}]} 2024-09-21T06:35:59.895 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 24 2024-09-21T06:35:59.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:59.895+0000 7ff3cfdd7640 1 -- 172.21.15.7:0/4150751874 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7ff3b40b65f0 msgr2=0x7ff3b40b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:59.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:59.895+0000 7ff3cfdd7640 1 --2- 172.21.15.7:0/4150751874 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7ff3b40b65f0 0x7ff3b40b8b00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff3b8005fd0 tx=0x7ff3b8005850 comp rx=0 tx=0).stop 2024-09-21T06:35:59.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:59.895+0000 7ff3cfdd7640 1 -- 172.21.15.7:0/4150751874 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff3c8102a70 msgr2=0x7ff3c80ff5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:35:59.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:59.895+0000 7ff3cfdd7640 1 --2- 172.21.15.7:0/4150751874 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff3c8102a70 0x7ff3c80ff5f0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7ff3c400c970 tx=0x7ff3c400ce30 comp rx=0 tx=0).stop 2024-09-21T06:35:59.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:59.895+0000 7ff3cfdd7640 1 -- 172.21.15.7:0/4150751874 shutdown_connections 2024-09-21T06:35:59.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:59.895+0000 7ff3cfdd7640 1 --2- 172.21.15.7:0/4150751874 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7ff3b40b65f0 0x7ff3b40b8b00 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:59.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:59.895+0000 7ff3cfdd7640 1 --2- 172.21.15.7:0/4150751874 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff3c8108d00 0x7ff3c8100070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:59.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:59.895+0000 7ff3cfdd7640 1 --2- 172.21.15.7:0/4150751874 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff3c81083b0 0x7ff3c80ffb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:59.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:59.895+0000 7ff3cfdd7640 1 --2- 172.21.15.7:0/4150751874 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff3c8102a70 0x7ff3c80ff5f0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:35:59.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:59.895+0000 7ff3cfdd7640 1 -- 172.21.15.7:0/4150751874 >> 172.21.15.7:0/4150751874 conn(0x7ff3c8079710 msgr2=0x7ff3c8101880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:35:59.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:59.895+0000 7ff3cfdd7640 1 -- 172.21.15.7:0/4150751874 shutdown_connections 2024-09-21T06:35:59.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:35:59.895+0000 7ff3cfdd7640 1 -- 172.21.15.7:0/4150751874 wait complete. 2024-09-21T06:36:00.553 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T06:36:00.811 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:36:00.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:36:00 smithi007 ceph-mon[30983]: pgmap v313: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T06:36:00.932 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:36:00 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/4150751874' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:36:01.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:36:00 smithi144 ceph-mon[34653]: pgmap v313: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T06:36:01.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:36:00 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/4150751874' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:36:01.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:36:00 smithi018 ceph-mon[34477]: pgmap v313: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T06:36:01.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:36:00 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/4150751874' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:36:01.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:01.300+0000 7ff7d84e3640 1 -- 172.21.15.7:0/2675759543 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7d0103b60 msgr2=0x7ff7d0103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:01.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:01.300+0000 7ff7d84e3640 1 --2- 172.21.15.7:0/2675759543 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7d0103b60 0x7ff7d0103f70 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc009900 tx=0x7ff7cc02a410 comp rx=0 tx=0).stop 2024-09-21T06:36:01.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:01.300+0000 7ff7d84e3640 1 -- 172.21.15.7:0/2675759543 shutdown_connections 2024-09-21T06:36:01.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:01.300+0000 7ff7d84e3640 1 --2- 172.21.15.7:0/2675759543 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7d0109df0 0x7ff7d0110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:01.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:01.300+0000 7ff7d84e3640 1 --2- 172.21.15.7:0/2675759543 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7d01094a0 0x7ff7d01098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:01.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:01.300+0000 7ff7d84e3640 1 --2- 172.21.15.7:0/2675759543 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7d0103b60 0x7ff7d0103f70 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:01.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:01.300+0000 7ff7d84e3640 1 -- 172.21.15.7:0/2675759543 >> 172.21.15.7:0/2675759543 conn(0x7ff7d007b850 msgr2=0x7ff7d007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:01.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:01.300+0000 7ff7d84e3640 1 -- 172.21.15.7:0/2675759543 shutdown_connections 2024-09-21T06:36:01.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:01.300+0000 7ff7d84e3640 1 -- 172.21.15.7:0/2675759543 wait complete. 2024-09-21T06:36:01.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:01.300+0000 7ff7d84e3640 1 Processor -- start 2024-09-21T06:36:01.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:01.300+0000 7ff7d84e3640 1 -- start start 2024-09-21T06:36:01.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:01.301+0000 7ff7d84e3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7d0103b60 0x7ff7d019a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:01.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:01.301+0000 7ff7d84e3640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7d01094a0 0x7ff7d019aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:01.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:01.301+0000 7ff7d84e3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7d0109df0 0x7ff7d019fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:01.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:01.301+0000 7ff7d84e3640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff7d0113b10 con 0x7ff7d0103b60 2024-09-21T06:36:01.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:01.301+0000 7ff7d84e3640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff7d0113990 con 0x7ff7d0109df0 2024-09-21T06:36:01.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:01.301+0000 7ff7d84e3640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff7d0113c90 con 0x7ff7d01094a0 2024-09-21T06:36:01.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:01.301+0000 7ff7d627f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7d0103b60 0x7ff7d019a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:01.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:01.301+0000 7ff7d627f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7d0103b60 0x7ff7d019a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56356/0 (socket says 172.21.15.7:56356) 2024-09-21T06:36:01.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:01.301+0000 7ff7d627f640 1 -- 172.21.15.7:0/726137031 learned_addr learned my addr 172.21.15.7:0/726137031 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:36:01.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:01.301+0000 7ff7d6a80640 1 --2- 172.21.15.7:0/726137031 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7d0109df0 0x7ff7d019fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:01.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:01.301+0000 7ff7d627f640 1 -- 172.21.15.7:0/726137031 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7d01094a0 msgr2=0x7ff7d019aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:01.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:01.301+0000 7ff7d5a7e640 1 --2- 172.21.15.7:0/726137031 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7d01094a0 0x7ff7d019aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:01.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:01.301+0000 7ff7d627f640 1 --2- 172.21.15.7:0/726137031 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7d01094a0 0x7ff7d019aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:01.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:01.301+0000 7ff7d627f640 1 -- 172.21.15.7:0/726137031 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7d0109df0 msgr2=0x7ff7d019fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:01.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:01.301+0000 7ff7d627f640 1 --2- 172.21.15.7:0/726137031 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7d0109df0 0x7ff7d019fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:01.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:01.301+0000 7ff7d627f640 1 -- 172.21.15.7:0/726137031 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7d01a03b0 con 0x7ff7d0103b60 2024-09-21T06:36:01.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:01.301+0000 7ff7d6a80640 1 --2- 172.21.15.7:0/726137031 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7d0109df0 0x7ff7d019fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:36:01.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:01.301+0000 7ff7d5a7e640 1 --2- 172.21.15.7:0/726137031 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7d01094a0 0x7ff7d019aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:36:01.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:01.301+0000 7ff7d627f640 1 --2- 172.21.15.7:0/726137031 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7d0103b60 0x7ff7d019a500 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc006010 tx=0x7ff7cc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:01.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:01.302+0000 7ff7c77fe640 1 -- 172.21.15.7:0/726137031 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7cc03f030 con 0x7ff7d0103b60 2024-09-21T06:36:01.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:01.302+0000 7ff7d84e3640 1 -- 172.21.15.7:0/726137031 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7d01a0640 con 0x7ff7d0103b60 2024-09-21T06:36:01.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:01.302+0000 7ff7c77fe640 1 -- 172.21.15.7:0/726137031 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff7cc003800 con 0x7ff7d0103b60 2024-09-21T06:36:01.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:01.302+0000 7ff7c77fe640 1 -- 172.21.15.7:0/726137031 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7cc035070 con 0x7ff7d0103b60 2024-09-21T06:36:01.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:01.302+0000 7ff7d84e3640 1 -- 172.21.15.7:0/726137031 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7d01a6ec0 con 0x7ff7d0103b60 2024-09-21T06:36:01.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:01.303+0000 7ff7d84e3640 1 -- 172.21.15.7:0/726137031 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7d0104de0 con 0x7ff7d0103b60 2024-09-21T06:36:01.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:01.304+0000 7ff7c77fe640 1 -- 172.21.15.7:0/726137031 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154579+0+0 (secure 0 0 0) 0x7ff7cc003cb0 con 0x7ff7d0103b60 2024-09-21T06:36:01.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:01.305+0000 7ff7c77fe640 1 --2- 172.21.15.7:0/726137031 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7ff7bc0b6620 0x7ff7bc0b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:01.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:01.305+0000 7ff7d5a7e640 1 --2- 172.21.15.7:0/726137031 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7ff7bc0b6620 0x7ff7bc0b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:01.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:01.305+0000 7ff7c77fe640 1 -- 172.21.15.7:0/726137031 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7ff7cc1081c0 con 0x7ff7d0103b60 2024-09-21T06:36:01.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:01.306+0000 7ff7d5a7e640 1 --2- 172.21.15.7:0/726137031 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7ff7bc0b6620 0x7ff7bc0b8b30 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff7d01091a0 tx=0x7ff7c0005d90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:01.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:01.308+0000 7ff7c77fe640 1 -- 172.21.15.7:0/726137031 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff7cc0ce870 con 0x7ff7d0103b60 2024-09-21T06:36:01.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:01.495+0000 7ff7d84e3640 1 -- 172.21.15.7:0/726137031 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff7d0103f70 con 0x7ff7d0103b60 2024-09-21T06:36:01.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:01.497+0000 7ff7c77fe640 1 -- 172.21.15.7:0/726137031 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+22791 (secure 0 0 0) 0x7ff7cc0d2c50 con 0x7ff7d0103b60 2024-09-21T06:36:01.499 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:36:01.499 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":77,"fsid":"347cb918-77e2-11ef-baf5-efdc52797490","created":"2024-09-21T06:25:51.925032+0000","modified":"2024-09-21T06:34:44.220989+0000","last_up_change":"2024-09-21T06:33:32.888843+0000","last_in_change":"2024-09-21T06:33:09.926778+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:29:41.514179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:34:20.531755+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T06:34:22.552541+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1be5c4a4-3931-4d8b-95c7-c05f5b73fcfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":942632794},{"type":"v1","addr":"172.21.15.7:6803","nonce":942632794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":942632794},{"type":"v1","addr":"172.21.15.7:6805","nonce":942632794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":942632794},{"type":"v1","addr":"172.21.15.7:6809","nonce":942632794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":942632794},{"type":"v1","addr":"172.21.15.7:6807","nonce":942632794}]},"public_addr":"172.21.15.7:6803/942632794","cluster_addr":"172.21.15.7:6805/942632794","heartbeat_back_addr":"172.21.15.7:6809/942632794","heartbeat_front_addr":"172.21.15.7:6807/942632794","state":["exists","up"]},{"osd":1,"uuid":"7ae136a8-c614-47e5-b265-c6cfa857a7fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1839342931},{"type":"v1","addr":"172.21.15.18:6801","nonce":1839342931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1839342931},{"type":"v1","addr":"172.21.15.18:6803","nonce":1839342931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1839342931},{"type":"v1","addr":"172.21.15.18:6807","nonce":1839342931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1839342931},{"type":"v1","addr":"172.21.15.18:6805","nonce":1839342931}]},"public_addr":"172.21.15.18:6801/1839342931","cluster_addr":"172.21.15.18:6803/1839342931","heartbeat_back_addr":"172.21.15.18:6807/1839342931","heartbeat_front_addr":"172.21.15.18:6805/1839342931","state":["exists","up"]},{"osd":2,"uuid":"97b13994-4680-4573-9c2e-ac65ea740e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":1699582162},{"type":"v1","addr":"172.21.15.144:6801","nonce":1699582162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":1699582162},{"type":"v1","addr":"172.21.15.144:6803","nonce":1699582162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":1699582162},{"type":"v1","addr":"172.21.15.144:6807","nonce":1699582162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":1699582162},{"type":"v1","addr":"172.21.15.144:6805","nonce":1699582162}]},"public_addr":"172.21.15.144:6801/1699582162","cluster_addr":"172.21.15.144:6803/1699582162","heartbeat_back_addr":"172.21.15.144:6807/1699582162","heartbeat_front_addr":"172.21.15.144:6805/1699582162","state":["exists","up"]},{"osd":3,"uuid":"ddf70d51-404d-491d-a6a8-15fca4ef01db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":3202935163},{"type":"v1","addr":"172.21.15.7:6811","nonce":3202935163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":3202935163},{"type":"v1","addr":"172.21.15.7:6813","nonce":3202935163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":3202935163},{"type":"v1","addr":"172.21.15.7:6817","nonce":3202935163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":3202935163},{"type":"v1","addr":"172.21.15.7:6815","nonce":3202935163}]},"public_addr":"172.21.15.7:6811/3202935163","cluster_addr":"172.21.15.7:6813/3202935163","heartbeat_back_addr":"172.21.15.7:6817/3202935163","heartbeat_front_addr":"172.21.15.7:6815/3202935163","state":["exists","up"]},{"osd":4,"uuid":"f2ae4340-accf-4ac0-a4d3-c08302712ce1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1058105724},{"type":"v1","addr":"172.21.15.18:6809","nonce":1058105724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":1058105724},{"type":"v1","addr":"172.21.15.18:6811","nonce":1058105724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":1058105724},{"type":"v1","addr":"172.21.15.18:6815","nonce":1058105724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":1058105724},{"type":"v1","addr":"172.21.15.18:6813","nonce":1058105724}]},"public_addr":"172.21.15.18:6809/1058105724","cluster_addr":"172.21.15.18:6811/1058105724","heartbeat_back_addr":"172.21.15.18:6815/1058105724","heartbeat_front_addr":"172.21.15.18:6813/1058105724","state":["exists","up"]},{"osd":5,"uuid":"d56abc37-de6f-47a4-9f5e-67224da78f4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":2814586621},{"type":"v1","addr":"172.21.15.144:6809","nonce":2814586621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":2814586621},{"type":"v1","addr":"172.21.15.144:6811","nonce":2814586621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":2814586621},{"type":"v1","addr":"172.21.15.144:6815","nonce":2814586621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":2814586621},{"type":"v1","addr":"172.21.15.144:6813","nonce":2814586621}]},"public_addr":"172.21.15.144:6809/2814586621","cluster_addr":"172.21.15.144:6811/2814586621","heartbeat_back_addr":"172.21.15.144:6815/2814586621","heartbeat_front_addr":"172.21.15.144:6813/2814586621","state":["exists","up"]},{"osd":6,"uuid":"9145650c-e9b1-4e5a-ae6f-17c8960146e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":3770978305},{"type":"v1","addr":"172.21.15.7:6819","nonce":3770978305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":3770978305},{"type":"v1","addr":"172.21.15.7:6821","nonce":3770978305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3770978305},{"type":"v1","addr":"172.21.15.7:6825","nonce":3770978305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":3770978305},{"type":"v1","addr":"172.21.15.7:6823","nonce":3770978305}]},"public_addr":"172.21.15.7:6819/3770978305","cluster_addr":"172.21.15.7:6821/3770978305","heartbeat_back_addr":"172.21.15.7:6825/3770978305","heartbeat_front_addr":"172.21.15.7:6823/3770978305","state":["exists","up"]},{"osd":7,"uuid":"ca658683-38f7-47ca-b32e-512fe4738ef1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":1322408496},{"type":"v1","addr":"172.21.15.18:6817","nonce":1322408496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1322408496},{"type":"v1","addr":"172.21.15.18:6819","nonce":1322408496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1322408496},{"type":"v1","addr":"172.21.15.18:6823","nonce":1322408496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1322408496},{"type":"v1","addr":"172.21.15.18:6821","nonce":1322408496}]},"public_addr":"172.21.15.18:6817/1322408496","cluster_addr":"172.21.15.18:6819/1322408496","heartbeat_back_addr":"172.21.15.18:6823/1322408496","heartbeat_front_addr":"172.21.15.18:6821/1322408496","state":["exists","up"]},{"osd":8,"uuid":"40d1f37e-6fac-40b9-9319-78f4fc3a6f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1011657022},{"type":"v1","addr":"172.21.15.144:6817","nonce":1011657022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1011657022},{"type":"v1","addr":"172.21.15.144:6819","nonce":1011657022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1011657022},{"type":"v1","addr":"172.21.15.144:6823","nonce":1011657022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":1011657022},{"type":"v1","addr":"172.21.15.144:6821","nonce":1011657022}]},"public_addr":"172.21.15.144:6817/1011657022","cluster_addr":"172.21.15.144:6819/1011657022","heartbeat_back_addr":"172.21.15.144:6823/1011657022","heartbeat_front_addr":"172.21.15.144:6821/1011657022","state":["exists","up"]},{"osd":9,"uuid":"ad12d6f7-fd21-49bd-a343-744f3cff4bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":256146339},{"type":"v1","addr":"172.21.15.7:6827","nonce":256146339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":256146339},{"type":"v1","addr":"172.21.15.7:6829","nonce":256146339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":256146339},{"type":"v1","addr":"172.21.15.7:6833","nonce":256146339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":256146339},{"type":"v1","addr":"172.21.15.7:6831","nonce":256146339}]},"public_addr":"172.21.15.7:6827/256146339","cluster_addr":"172.21.15.7:6829/256146339","heartbeat_back_addr":"172.21.15.7:6833/256146339","heartbeat_front_addr":"172.21.15.7:6831/256146339","state":["exists","up"]},{"osd":10,"uuid":"1317a2ad-ec15-4096-b2da-689475b7cacc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":2038885362},{"type":"v1","addr":"172.21.15.18:6825","nonce":2038885362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2038885362},{"type":"v1","addr":"172.21.15.18:6827","nonce":2038885362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2038885362},{"type":"v1","addr":"172.21.15.18:6831","nonce":2038885362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2038885362},{"type":"v1","addr":"172.21.15.18:6829","nonce":2038885362}]},"public_addr":"172.21.15.18:6825/2038885362","cluster_addr":"172.21.15.18:6827/2038885362","heartbeat_back_addr":"172.21.15.18:6831/2038885362","heartbeat_front_addr":"172.21.15.18:6829/2038885362","state":["exists","up"]},{"osd":11,"uuid":"f9252acb-7290-4923-89f3-844c868d4b39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":1047060848},{"type":"v1","addr":"172.21.15.144:6825","nonce":1047060848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":1047060848},{"type":"v1","addr":"172.21.15.144:6827","nonce":1047060848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":1047060848},{"type":"v1","addr":"172.21.15.144:6831","nonce":1047060848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":1047060848},{"type":"v1","addr":"172.21.15.144:6829","nonce":1047060848}]},"public_addr":"172.21.15.144:6825/1047060848","cluster_addr":"172.21.15.144:6827/1047060848","heartbeat_back_addr":"172.21.15.144:6831/1047060848","heartbeat_front_addr":"172.21.15.144:6829/1047060848","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:28:48.842729+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:29:13.946624+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:29:38.589666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:30:05.116339+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:30:30.562090+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:30:55.586210+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:31:22.138457+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:31:49.178090+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:32:13.687830+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:32:40.408193+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:33:06.044578+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:33:30.988851+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/1296137341":"2024-09-22T06:27:43.044484+0000","172.21.15.7:6801/3879502931":"2024-09-22T06:27:43.044484+0000","172.21.15.7:0/1926706877":"2024-09-22T06:26:40.520265+0000","172.21.15.7:0/2034370456":"2024-09-22T06:26:14.181426+0000","172.21.15.7:6801/3339522713":"2024-09-22T06:26:14.181426+0000","172.21.15.7:6800/3339522713":"2024-09-22T06:26:14.181426+0000","172.21.15.7:0/3586807770":"2024-09-22T06:26:14.181426+0000","172.21.15.7:0/1814223919":"2024-09-22T06:27:43.044484+0000","172.21.15.7:0/601150037":"2024-09-22T06:26:40.520265+0000","172.21.15.7:6800/3876787626":"2024-09-22T06:26:40.520265+0000","172.21.15.7:0/186444636":"2024-09-22T06:26:14.181426+0000","172.21.15.7:0/2180184348":"2024-09-22T06:26:40.520265+0000","172.21.15.7:6801/3876787626":"2024-09-22T06:26:40.520265+0000","172.21.15.7:0/2931793461":"2024-09-22T06:27:43.044484+0000","172.21.15.7:6800/3879502931":"2024-09-22T06:27:43.044484+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:36:01.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:01.499+0000 7ff7d84e3640 1 -- 172.21.15.7:0/726137031 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7ff7bc0b6620 msgr2=0x7ff7bc0b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:01.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:01.499+0000 7ff7d84e3640 1 --2- 172.21.15.7:0/726137031 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7ff7bc0b6620 0x7ff7bc0b8b30 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff7d01091a0 tx=0x7ff7c0005d90 comp rx=0 tx=0).stop 2024-09-21T06:36:01.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:01.499+0000 7ff7d84e3640 1 -- 172.21.15.7:0/726137031 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7d0103b60 msgr2=0x7ff7d019a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:01.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:01.499+0000 7ff7d84e3640 1 --2- 172.21.15.7:0/726137031 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7d0103b60 0x7ff7d019a500 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc006010 tx=0x7ff7cc0042f0 comp rx=0 tx=0).stop 2024-09-21T06:36:01.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:01.499+0000 7ff7d84e3640 1 -- 172.21.15.7:0/726137031 shutdown_connections 2024-09-21T06:36:01.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:01.499+0000 7ff7d84e3640 1 --2- 172.21.15.7:0/726137031 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7ff7bc0b6620 0x7ff7bc0b8b30 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:01.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:01.499+0000 7ff7d84e3640 1 --2- 172.21.15.7:0/726137031 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7d0109df0 0x7ff7d019fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:01.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:01.499+0000 7ff7d84e3640 1 --2- 172.21.15.7:0/726137031 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff7d01094a0 0x7ff7d019aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:01.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:01.499+0000 7ff7d84e3640 1 --2- 172.21.15.7:0/726137031 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff7d0103b60 0x7ff7d019a500 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:01.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:01.500+0000 7ff7d84e3640 1 -- 172.21.15.7:0/726137031 >> 172.21.15.7:0/726137031 conn(0x7ff7d007b850 msgr2=0x7ff7d0107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:01.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:01.500+0000 7ff7d84e3640 1 -- 172.21.15.7:0/726137031 shutdown_connections 2024-09-21T06:36:01.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:01.500+0000 7ff7d84e3640 1 -- 172.21.15.7:0/726137031 wait complete. 2024-09-21T06:36:01.839 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:36:01 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/726137031' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:36:02.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:36:01 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/726137031' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:36:02.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:36:01 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/726137031' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:36:02.168 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-21T06:34:24.627168+0000', 'modified': '2024-09-21T06:34:35.664086+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24716, 'mds_1': 24688, 'mds_2': 24686}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24656': {'gid': 24656, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.18:6835/158884796', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6834', 'nonce': 158884796}, {'type': 'v1', 'addr': '172.21.15.18:6835', 'nonce': 158884796}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24667': {'gid': 24667, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.144:6835/3636739922', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6834', 'nonce': 3636739922}, {'type': 'v1', 'addr': '172.21.15.144:6835', 'nonce': 3636739922}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24673': {'gid': 24673, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.144:6837/1126341753', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6836', 'nonce': 1126341753}, {'type': 'v1', 'addr': '172.21.15.144:6837', 'nonce': 1126341753}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24686': {'gid': 24686, 'name': 'h', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.18:6837/1539670694', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6836', 'nonce': 1539670694}, {'type': 'v1', 'addr': '172.21.15.18:6837', 'nonce': 1539670694}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24688': {'gid': 24688, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.144:6839/4027821922', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6838', 'nonce': 4027821922}, {'type': 'v1', 'addr': '172.21.15.144:6839', 'nonce': 4027821922}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24716': {'gid': 24716, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.18:6839/3798713532', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6838', 'nonce': 3798713532}, {'type': 'v1', 'addr': '172.21.15.18:6839', 'nonce': 3798713532}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24716, 'qdb_cluster': [24686, 24688, 24716]} 2024-09-21T06:36:02.168 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-21T06:36:02.168 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.h status 2024-09-21T06:36:02.432 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:36:02.819 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:36:02 smithi007 ceph-mon[30983]: pgmap v314: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:36:02.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.910+0000 7f43cfb46640 1 -- 172.21.15.7:0/4271598338 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43c81094f0 msgr2=0x7f43c8109900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:02.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.910+0000 7f43cfb46640 1 --2- 172.21.15.7:0/4271598338 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43c81094f0 0x7f43c8109900 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f43b8009900 tx=0x7f43b802a410 comp rx=0 tx=0).stop 2024-09-21T06:36:02.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.911+0000 7f43cfb46640 1 -- 172.21.15.7:0/4271598338 shutdown_connections 2024-09-21T06:36:02.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.911+0000 7f43cfb46640 1 --2- 172.21.15.7:0/4271598338 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f43c8109e40 0x7f43c8110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:02.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.911+0000 7f43cfb46640 1 --2- 172.21.15.7:0/4271598338 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43c81094f0 0x7f43c8109900 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:02.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.911+0000 7f43cfb46640 1 --2- 172.21.15.7:0/4271598338 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f43c8103bb0 0x7f43c8103fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:02.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.911+0000 7f43cfb46640 1 -- 172.21.15.7:0/4271598338 >> 172.21.15.7:0/4271598338 conn(0x7f43c80ff600 msgr2=0x7f43c8101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:02.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.911+0000 7f43cfb46640 1 -- 172.21.15.7:0/4271598338 shutdown_connections 2024-09-21T06:36:02.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.911+0000 7f43cfb46640 1 -- 172.21.15.7:0/4271598338 wait complete. 2024-09-21T06:36:02.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.912+0000 7f43cfb46640 1 Processor -- start 2024-09-21T06:36:02.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.912+0000 7f43cfb46640 1 -- start start 2024-09-21T06:36:02.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.912+0000 7f43cfb46640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f43c8103bb0 0x7f43c819a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:02.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.912+0000 7f43cfb46640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43c81094f0 0x7f43c819aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:02.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.912+0000 7f43cfb46640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f43c8109e40 0x7f43c819fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:02.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.912+0000 7f43cfb46640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f43c8113b00 con 0x7f43c81094f0 2024-09-21T06:36:02.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.912+0000 7f43cfb46640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f43c8113980 con 0x7f43c8103bb0 2024-09-21T06:36:02.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.912+0000 7f43cfb46640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f43c8113c80 con 0x7f43c8109e40 2024-09-21T06:36:02.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.912+0000 7f43cd0e1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43c81094f0 0x7f43c819aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:02.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.912+0000 7f43cd0e1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43c81094f0 0x7f43c819aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56382/0 (socket says 172.21.15.7:56382) 2024-09-21T06:36:02.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.912+0000 7f43cd0e1640 1 -- 172.21.15.7:0/3113501588 learned_addr learned my addr 172.21.15.7:0/3113501588 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:36:02.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.912+0000 7f43cd8e2640 1 --2- 172.21.15.7:0/3113501588 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f43c8103bb0 0x7f43c819a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:02.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.912+0000 7f43ce0e3640 1 --2- 172.21.15.7:0/3113501588 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f43c8109e40 0x7f43c819fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:02.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.912+0000 7f43cd0e1640 1 -- 172.21.15.7:0/3113501588 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f43c8109e40 msgr2=0x7f43c819fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:02.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.912+0000 7f43cd0e1640 1 --2- 172.21.15.7:0/3113501588 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f43c8109e40 0x7f43c819fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:02.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.912+0000 7f43cd0e1640 1 -- 172.21.15.7:0/3113501588 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f43c8103bb0 msgr2=0x7f43c819a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:02.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.912+0000 7f43cd0e1640 1 --2- 172.21.15.7:0/3113501588 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f43c8103bb0 0x7f43c819a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:02.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.913+0000 7f43cd0e1640 1 -- 172.21.15.7:0/3113501588 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43c81a0460 con 0x7f43c81094f0 2024-09-21T06:36:02.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.913+0000 7f43cd0e1640 1 --2- 172.21.15.7:0/3113501588 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43c81094f0 0x7f43c819aa90 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f43b802a930 tx=0x7f43b8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:02.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.913+0000 7f43beffd640 1 -- 172.21.15.7:0/3113501588 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43b803f030 con 0x7f43c81094f0 2024-09-21T06:36:02.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.913+0000 7f43cfb46640 1 -- 172.21.15.7:0/3113501588 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43c81a06f0 con 0x7f43c81094f0 2024-09-21T06:36:02.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.913+0000 7f43beffd640 1 -- 172.21.15.7:0/3113501588 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f43b8003aa0 con 0x7f43c81094f0 2024-09-21T06:36:02.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.913+0000 7f43beffd640 1 -- 172.21.15.7:0/3113501588 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43b8035070 con 0x7f43c81094f0 2024-09-21T06:36:02.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.913+0000 7f43cfb46640 1 -- 172.21.15.7:0/3113501588 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43c81a6eb0 con 0x7f43c81094f0 2024-09-21T06:36:02.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.916+0000 7f43beffd640 1 -- 172.21.15.7:0/3113501588 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154579+0+0 (secure 0 0 0) 0x7f43b8042030 con 0x7f43c81094f0 2024-09-21T06:36:02.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.916+0000 7f43d60ba740 1 Processor -- start 2024-09-21T06:36:02.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.916+0000 7f43d60ba740 1 -- start start 2024-09-21T06:36:02.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.916+0000 7f43d60ba740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f6f019f60 0x556f6f3bff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:02.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.916+0000 7f43d60ba740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556f6eff10a0 0x556f6f3c0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:02.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.916+0000 7f43d60ba740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556f6eff9280 0x556f6f3c0980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:02.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.916+0000 7f43d60ba740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x556f6f337c10 con 0x556f6eff9280 2024-09-21T06:36:02.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.916+0000 7f43d60ba740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x556f6f327040 con 0x556f6eff10a0 2024-09-21T06:36:02.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.916+0000 7f43d60ba740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x556f6f32ae50 con 0x556f6f019f60 2024-09-21T06:36:02.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.916+0000 7f43cd0e1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556f6eff9280 0x556f6f3c0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:02.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.916+0000 7f43cd0e1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556f6eff9280 0x556f6f3c0980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56392/0 (socket says 172.21.15.7:56392) 2024-09-21T06:36:02.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.916+0000 7f43cd0e1640 1 -- 172.21.15.7:0/883406980 learned_addr learned my addr 172.21.15.7:0/883406980 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:36:02.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.917+0000 7f43ce0e3640 1 --2- 172.21.15.7:0/883406980 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f6f019f60 0x556f6f3bff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:02.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.917+0000 7f43cd8e2640 1 --2- 172.21.15.7:0/883406980 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556f6eff10a0 0x556f6f3c0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:02.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.917+0000 7f43beffd640 1 --2- 172.21.15.7:0/3113501588 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f43b40b65f0 0x7f43b40b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:02.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.917+0000 7f43cd0e1640 1 -- 172.21.15.7:0/883406980 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f6f019f60 msgr2=0x556f6f3bff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:02.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.917+0000 7f43cd0e1640 1 --2- 172.21.15.7:0/883406980 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f6f019f60 0x556f6f3bff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:02.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.917+0000 7f43cd0e1640 1 -- 172.21.15.7:0/883406980 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556f6eff10a0 msgr2=0x556f6f3c0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:02.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.917+0000 7f43cd0e1640 1 --2- 172.21.15.7:0/883406980 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556f6eff10a0 0x556f6f3c0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:02.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.917+0000 7f43cd0e1640 1 -- 172.21.15.7:0/883406980 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f6f085540 con 0x556f6eff9280 2024-09-21T06:36:02.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.917+0000 7f43cd8e2640 1 --2- 172.21.15.7:0/883406980 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556f6eff10a0 0x556f6f3c0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:36:02.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.917+0000 7f43ce0e3640 1 --2- 172.21.15.7:0/3113501588 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f43b40b65f0 0x7f43b40b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:02.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.917+0000 7f43cd0e1640 1 --2- 172.21.15.7:0/883406980 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556f6eff9280 0x556f6f3c0980 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f43b8105450 tx=0x7f43b80cde30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8325b168b2b013c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:02.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.917+0000 7f43beffd640 1 -- 172.21.15.7:0/3113501588 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f43b8107be0 con 0x7f43c81094f0 2024-09-21T06:36:02.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.917+0000 7f43b3fff640 1 -- 172.21.15.7:0/883406980 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43b8049020 con 0x556f6eff9280 2024-09-21T06:36:02.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.917+0000 7f43b3fff640 1 -- 172.21.15.7:0/883406980 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f43b80cd750 con 0x556f6eff9280 2024-09-21T06:36:02.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.917+0000 7f43b3fff640 1 -- 172.21.15.7:0/883406980 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43b80cda10 con 0x556f6eff9280 2024-09-21T06:36:02.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.918+0000 7f43d60ba740 1 -- 172.21.15.7:0/883406980 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556f6eff9280 msgr2=0x556f6f3c0980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:02.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.918+0000 7f43ce0e3640 1 --2- 172.21.15.7:0/3113501588 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f43b40b65f0 0x7f43b40b8b00 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f43c0005fd0 tx=0x7f43c0004a40 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:02.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.918+0000 7f43d60ba740 1 --2- 172.21.15.7:0/883406980 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556f6eff9280 0x556f6f3c0980 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f43b8105450 tx=0x7f43b80cde30 comp rx=0 tx=0).stop 2024-09-21T06:36:02.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.918+0000 7f43d60ba740 1 -- 172.21.15.7:0/883406980 shutdown_connections 2024-09-21T06:36:02.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.918+0000 7f43d60ba740 1 --2- 172.21.15.7:0/883406980 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556f6eff9280 0x556f6f3c0980 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:02.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.918+0000 7f43d60ba740 1 --2- 172.21.15.7:0/883406980 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556f6eff10a0 0x556f6f3c0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:02.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.918+0000 7f43d60ba740 1 --2- 172.21.15.7:0/883406980 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f6f019f60 0x556f6f3bff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:02.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.918+0000 7f43d60ba740 1 -- 172.21.15.7:0/883406980 >> 172.21.15.7:0/883406980 conn(0x556f6f00e350 msgr2=0x556f6f3bddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:02.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.919+0000 7f43d60ba740 1 -- 172.21.15.7:0/883406980 shutdown_connections 2024-09-21T06:36:02.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.919+0000 7f43d60ba740 1 -- 172.21.15.7:0/883406980 wait complete. 2024-09-21T06:36:02.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.919+0000 7f43d60ba740 1 -- start start 2024-09-21T06:36:02.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.919+0000 7f43d60ba740 1 Processor -- start 2024-09-21T06:36:02.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.919+0000 7f43d60ba740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f6eff10a0 0x556f6f3cb9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:02.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.919+0000 7f43d60ba740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556f6eff9280 0x556f6f3cbf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:02.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.920+0000 7f43d60ba740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556f6f019f60 0x556f6f3dbb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:02.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.920+0000 7f43d60ba740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x556f6f1885f0 con 0x556f6f019f60 2024-09-21T06:36:02.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.920+0000 7f43d60ba740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x556f6f2c2010 con 0x556f6eff9280 2024-09-21T06:36:02.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.920+0000 7f43d60ba740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x556f6f3d28b0 con 0x556f6eff10a0 2024-09-21T06:36:02.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.920+0000 7f43d60ba740 10 client.0 _ll_register_callbacks cb 0x556f6f321340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:36:02.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.920+0000 7f43ce0e3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556f6f019f60 0x556f6f3dbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:02.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.920+0000 7f43cd8e2640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f6eff10a0 0x556f6f3cb9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:02.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.920+0000 7f43ce0e3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556f6f019f60 0x556f6f3dbb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56400/0 (socket says 172.21.15.7:56400) 2024-09-21T06:36:02.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.920+0000 7f43cd8e2640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f6eff10a0 0x556f6f3cb9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.7:55722/0 (socket says 172.21.15.7:55722) 2024-09-21T06:36:02.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.920+0000 7f43ce0e3640 1 -- 172.21.15.7:0/3114543402 learned_addr learned my addr 172.21.15.7:0/3114543402 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:36:02.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.920+0000 7f43cd0e1640 1 --2- 172.21.15.7:0/3114543402 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556f6eff9280 0x556f6f3cbf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:02.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.920+0000 7f43ce0e3640 1 -- 172.21.15.7:0/3114543402 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f6eff10a0 msgr2=0x556f6f3cb9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:02.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.920+0000 7f43ce0e3640 1 --2- 172.21.15.7:0/3114543402 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f6eff10a0 0x556f6f3cb9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:02.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.920+0000 7f43ce0e3640 1 -- 172.21.15.7:0/3114543402 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556f6eff9280 msgr2=0x556f6f3cbf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:02.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.920+0000 7f43ce0e3640 1 --2- 172.21.15.7:0/3114543402 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556f6eff9280 0x556f6f3cbf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:02.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.920+0000 7f43ce0e3640 1 -- 172.21.15.7:0/3114543402 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f6f2efa00 con 0x556f6f019f60 2024-09-21T06:36:02.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.920+0000 7f43cd0e1640 1 --2- 172.21.15.7:0/3114543402 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556f6eff9280 0x556f6f3cbf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:36:02.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.920+0000 7f43cd8e2640 1 --2- 172.21.15.7:0/3114543402 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f6eff10a0 0x556f6f3cb9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:36:02.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.920+0000 7f43ce0e3640 1 --2- 172.21.15.7:0/3114543402 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556f6f019f60 0x556f6f3dbb10 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f43c00126f0 tx=0x7f43c0004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a22136375c5a8464 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:02.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.920+0000 7f43b17fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:36:02.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.920+0000 7f43b17fa640 1 -- 172.21.15.7:0/3114543402 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43c0010850 con 0x556f6f019f60 2024-09-21T06:36:02.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.920+0000 7f43b17fa640 1 -- 172.21.15.7:0/3114543402 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f43c00109f0 con 0x556f6f019f60 2024-09-21T06:36:02.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.920+0000 7f43d60ba740 1 -- 172.21.15.7:0/3114543402 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f43b80cd750 con 0x556f6f019f60 2024-09-21T06:36:02.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.921+0000 7f43b17fa640 1 -- 172.21.15.7:0/3114543402 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f43c0010bf0 con 0x556f6f019f60 2024-09-21T06:36:02.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.921+0000 7f43d60ba740 10 client.15312 fetch_fsmap learned FSMap version 24 2024-09-21T06:36:02.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.921+0000 7f43d60ba740 1 -- 172.21.15.7:0/3114543402 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x556f6f3de7a0 con 0x556f6f019f60 2024-09-21T06:36:02.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.921+0000 7f43b17fa640 1 -- 172.21.15.7:0/3114543402 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f43b80cd750 con 0x556f6f019f60 2024-09-21T06:36:02.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.921+0000 7f43b17fa640 1 -- 172.21.15.7:0/3114543402 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f43c000f040 con 0x556f6f019f60 2024-09-21T06:36:02.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.921+0000 7f43d60ba740 10 client.15312 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T06:36:02.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.921+0000 7f43d60ba740 10 client.15312 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-21T06:36:02.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.921+0000 7f43d60ba740 20 client.15312 populate_metadata read hostname 'smithi007' 2024-09-21T06:36:02.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.921+0000 7f43d60ba740 1 --2- 172.21.15.7:0/3114543402 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x556f6efd88e0 0x556f6f3e2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:02.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.921+0000 7f43d60ba740 4 client.15312 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:36:02.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.921+0000 7f43d60ba740 1 -- 172.21.15.7:0/3114543402 --> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556f6f339b60 con 0x556f6efd88e0 2024-09-21T06:36:02.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.922+0000 7f43cd8e2640 1 --2- 172.21.15.7:0/3114543402 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x556f6efd88e0 0x556f6f3e2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:02.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.922+0000 7f43b17fa640 10 client.15312 ms_handle_connect on v2:172.21.15.18:6836/1539670694 2024-09-21T06:36:02.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.922+0000 7f43cd8e2640 1 --2- 172.21.15.7:0/3114543402 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x556f6efd88e0 0x556f6f3e2230 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=11e55bb10a38682c server_cookie=f1938bae552475e0 in_seq=0 out_seq=0 2024-09-21T06:36:02.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.923+0000 7f43b17fa640 1 -- 172.21.15.7:0/3114543402 <== mds.2 v2:172.21.15.18:6836/1539670694 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556f6f339b60 con 0x556f6efd88e0 2024-09-21T06:36:02.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.923+0000 7f43b17fa640 10 client.15312 handle_command_reply: tid=0 2024-09-21T06:36:02.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.923+0000 7f43d60ba740 1 client.15312 shutdown 2024-09-21T06:36:02.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.923+0000 7f43d60ba740 1 -- 172.21.15.7:0/3114543402 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556f6f019f60 msgr2=0x556f6f3dbb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:02.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.923+0000 7f43d60ba740 1 --2- 172.21.15.7:0/3114543402 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556f6f019f60 0x556f6f3dbb10 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f43c00126f0 tx=0x7f43c0004ab0 comp rx=0 tx=0).stop 2024-09-21T06:36:02.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.923+0000 7f43d60ba740 1 -- 172.21.15.7:0/3114543402 shutdown_connections 2024-09-21T06:36:02.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.923+0000 7f43d60ba740 1 --2- 172.21.15.7:0/3114543402 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x556f6efd88e0 0x556f6f3e2230 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:02.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.923+0000 7f43d60ba740 1 --2- 172.21.15.7:0/3114543402 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556f6f019f60 0x556f6f3dbb10 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:02.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.923+0000 7f43d60ba740 1 --2- 172.21.15.7:0/3114543402 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556f6eff9280 0x556f6f3cbf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:02.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.923+0000 7f43d60ba740 1 --2- 172.21.15.7:0/3114543402 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f6eff10a0 0x556f6f3cb9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:02.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.923+0000 7f43b17fa640 0 client.15312 ms_handle_reset on v2:172.21.15.18:6836/1539670694 2024-09-21T06:36:02.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.923+0000 7f43d60ba740 1 -- 172.21.15.7:0/3114543402 >> 172.21.15.7:0/3114543402 conn(0x556f6f00e350 msgr2=0x556f6f3c3090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:02.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.923+0000 7f43d60ba740 1 -- 172.21.15.7:0/3114543402 shutdown_connections 2024-09-21T06:36:02.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.923+0000 7f43d60ba740 1 -- 172.21.15.7:0/3114543402 wait complete. 2024-09-21T06:36:02.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.923+0000 7f43d60ba740 20 client.15312 trim_cache size 0 max 16384 2024-09-21T06:36:02.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.941+0000 7f43d60ba740 1 Processor -- start 2024-09-21T06:36:02.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.941+0000 7f43d60ba740 1 -- start start 2024-09-21T06:36:02.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.942+0000 7f43d60ba740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556f6eff10a0 0x556f6f3db900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:02.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.942+0000 7f43d60ba740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556f6eff9280 0x556f6f3dbe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:02.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.942+0000 7f43d60ba740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f6f019f60 0x556f6f3bd600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:02.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.942+0000 7f43d60ba740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x556f6f3e0570 con 0x556f6eff10a0 2024-09-21T06:36:02.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.942+0000 7f43d60ba740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x556f6f3e0c40 con 0x556f6eff9280 2024-09-21T06:36:02.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.942+0000 7f43d60ba740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x556f6f3e1310 con 0x556f6f019f60 2024-09-21T06:36:02.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.942+0000 7f43cd8e2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556f6eff10a0 0x556f6f3db900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:02.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.942+0000 7f43cd8e2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556f6eff10a0 0x556f6f3db900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56416/0 (socket says 172.21.15.7:56416) 2024-09-21T06:36:02.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.942+0000 7f43cd8e2640 1 -- 172.21.15.7:0/39309100 learned_addr learned my addr 172.21.15.7:0/39309100 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:36:02.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.942+0000 7f43cd0e1640 1 --2- 172.21.15.7:0/39309100 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556f6eff9280 0x556f6f3dbe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:02.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.942+0000 7f43ce0e3640 1 --2- 172.21.15.7:0/39309100 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f6f019f60 0x556f6f3bd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:02.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.942+0000 7f43cd8e2640 1 -- 172.21.15.7:0/39309100 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f6f019f60 msgr2=0x556f6f3bd600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:02.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.942+0000 7f43cd8e2640 1 --2- 172.21.15.7:0/39309100 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f6f019f60 0x556f6f3bd600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:02.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.942+0000 7f43cd8e2640 1 -- 172.21.15.7:0/39309100 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556f6eff9280 msgr2=0x556f6f3dbe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:02.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.942+0000 7f43cd8e2640 1 --2- 172.21.15.7:0/39309100 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556f6eff9280 0x556f6f3dbe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:02.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.942+0000 7f43cd8e2640 1 -- 172.21.15.7:0/39309100 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f6f3c9cd0 con 0x556f6eff10a0 2024-09-21T06:36:02.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.942+0000 7f43cd0e1640 1 --2- 172.21.15.7:0/39309100 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556f6eff9280 0x556f6f3dbe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:36:02.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.942+0000 7f43cd8e2640 1 --2- 172.21.15.7:0/39309100 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556f6eff10a0 0x556f6f3db900 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x556f6f3beb80 tx=0x7f43c400bd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f58eb108ffe07b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:02.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.942+0000 7f43b37fe640 1 -- 172.21.15.7:0/39309100 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43c4003b80 con 0x556f6eff10a0 2024-09-21T06:36:02.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.942+0000 7f43b37fe640 1 -- 172.21.15.7:0/39309100 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f43c4003d20 con 0x556f6eff10a0 2024-09-21T06:36:02.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.942+0000 7f43b37fe640 1 -- 172.21.15.7:0/39309100 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43c4004d60 con 0x556f6eff10a0 2024-09-21T06:36:02.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.943+0000 7f43d60ba740 1 -- 172.21.15.7:0/39309100 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556f6eff10a0 msgr2=0x556f6f3db900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:02.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.943+0000 7f43d60ba740 1 --2- 172.21.15.7:0/39309100 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556f6eff10a0 0x556f6f3db900 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x556f6f3beb80 tx=0x7f43c400bd00 comp rx=0 tx=0).stop 2024-09-21T06:36:02.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.943+0000 7f43d60ba740 1 -- 172.21.15.7:0/39309100 shutdown_connections 2024-09-21T06:36:02.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.943+0000 7f43d60ba740 1 --2- 172.21.15.7:0/39309100 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f6f019f60 0x556f6f3bd600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:02.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.943+0000 7f43d60ba740 1 --2- 172.21.15.7:0/39309100 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556f6eff9280 0x556f6f3dbe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:02.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.943+0000 7f43d60ba740 1 --2- 172.21.15.7:0/39309100 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556f6eff10a0 0x556f6f3db900 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:02.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.943+0000 7f43d60ba740 1 -- 172.21.15.7:0/39309100 >> 172.21.15.7:0/39309100 conn(0x556f6f00e350 msgr2=0x556f6f3ca050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:02.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.943+0000 7f43d60ba740 1 -- 172.21.15.7:0/39309100 shutdown_connections 2024-09-21T06:36:02.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.943+0000 7f43d60ba740 1 -- 172.21.15.7:0/39309100 wait complete. 2024-09-21T06:36:02.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.944+0000 7f43d60ba740 1 -- start start 2024-09-21T06:36:02.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.944+0000 7f43d60ba740 1 Processor -- start 2024-09-21T06:36:02.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.944+0000 7f43d60ba740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f6eff10a0 0x556f6f3e4660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:02.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.944+0000 7f43d60ba740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556f6eff9280 0x556f6f3e4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:02.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.944+0000 7f43d60ba740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556f6f019f60 0x556f6f3e50e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:02.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.944+0000 7f43d60ba740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x556f6f3e20b0 con 0x556f6eff9280 2024-09-21T06:36:02.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.944+0000 7f43d60ba740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x556f6f3e19e0 con 0x556f6f019f60 2024-09-21T06:36:02.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.944+0000 7f43d60ba740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x556f6f3e2780 con 0x556f6eff10a0 2024-09-21T06:36:02.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.944+0000 7f43d60ba740 10 client.0 _ll_register_callbacks cb 0x7f43c0009e20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:36:02.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.944+0000 7f43cd0e1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556f6eff9280 0x556f6f3e4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:02.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.944+0000 7f43cd0e1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556f6eff9280 0x556f6f3e4ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56426/0 (socket says 172.21.15.7:56426) 2024-09-21T06:36:02.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.944+0000 7f43cd0e1640 1 -- 172.21.15.7:0/891402120 learned_addr learned my addr 172.21.15.7:0/891402120 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:36:02.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.945+0000 7f43cd8e2640 1 --2- 172.21.15.7:0/891402120 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f6eff10a0 0x556f6f3e4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:02.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.945+0000 7f43ce0e3640 1 --2- 172.21.15.7:0/891402120 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556f6f019f60 0x556f6f3e50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:02.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.945+0000 7f43cd0e1640 1 -- 172.21.15.7:0/891402120 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f6eff10a0 msgr2=0x556f6f3e4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:02.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.945+0000 7f43cd0e1640 1 --2- 172.21.15.7:0/891402120 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f6eff10a0 0x556f6f3e4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:02.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.945+0000 7f43cd0e1640 1 -- 172.21.15.7:0/891402120 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556f6f019f60 msgr2=0x556f6f3e50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:02.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.945+0000 7f43cd0e1640 1 --2- 172.21.15.7:0/891402120 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556f6f019f60 0x556f6f3e50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:02.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.945+0000 7f43cd0e1640 1 -- 172.21.15.7:0/891402120 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f6f3e9fa0 con 0x556f6eff9280 2024-09-21T06:36:02.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.945+0000 7f43cd0e1640 1 --2- 172.21.15.7:0/891402120 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556f6eff9280 0x556f6f3e4ba0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f43b8105450 tx=0x7f43b802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4946d406ecfa30c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:02.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.945+0000 7f43b17fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:36:02.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.945+0000 7f43b17fa640 1 -- 172.21.15.7:0/891402120 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43b8049050 con 0x556f6eff9280 2024-09-21T06:36:02.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.945+0000 7f43b17fa640 1 -- 172.21.15.7:0/891402120 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f43b80f1110 con 0x556f6eff9280 2024-09-21T06:36:02.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.945+0000 7f43d60ba740 1 -- 172.21.15.7:0/891402120 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f43c4003d20 con 0x556f6eff9280 2024-09-21T06:36:02.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.945+0000 7f43b17fa640 1 -- 172.21.15.7:0/891402120 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f43b80e71e0 con 0x556f6eff9280 2024-09-21T06:36:02.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.945+0000 7f43d60ba740 10 client.15318 fetch_fsmap learned FSMap version 24 2024-09-21T06:36:02.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.945+0000 7f43d60ba740 1 -- 172.21.15.7:0/891402120 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x556f6f44db60 con 0x556f6eff9280 2024-09-21T06:36:02.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.946+0000 7f43b17fa640 1 -- 172.21.15.7:0/891402120 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f43c4003d20 con 0x556f6eff9280 2024-09-21T06:36:02.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.946+0000 7f43b17fa640 1 -- 172.21.15.7:0/891402120 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f43b80c9eb0 con 0x556f6eff9280 2024-09-21T06:36:02.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.946+0000 7f43d60ba740 10 client.15318 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T06:36:02.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.946+0000 7f43d60ba740 10 client.15318 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-21T06:36:02.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.946+0000 7f43d60ba740 20 client.15318 populate_metadata read hostname 'smithi007' 2024-09-21T06:36:02.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.946+0000 7f43d60ba740 1 --2- 172.21.15.7:0/891402120 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x556f6efadc90 0x556f6f4511c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:02.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.946+0000 7f43d60ba740 4 client.15318 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T06:36:02.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.946+0000 7f43d60ba740 1 -- 172.21.15.7:0/891402120 --> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] -- command(tid 0: {"prefix": "status"}) -- 0x556f6f335610 con 0x556f6efadc90 2024-09-21T06:36:02.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.946+0000 7f43cd8e2640 1 --2- 172.21.15.7:0/891402120 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x556f6efadc90 0x556f6f4511c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:02.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.946+0000 7f43b17fa640 10 client.15318 ms_handle_connect on v2:172.21.15.18:6836/1539670694 2024-09-21T06:36:02.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.946+0000 7f43cd8e2640 1 --2- 172.21.15.7:0/891402120 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x556f6efadc90 0x556f6f4511c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e8eaadcfeacb6f2d server_cookie=3c23ab84231522ca in_seq=0 out_seq=0 2024-09-21T06:36:02.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.947+0000 7f43b17fa640 1 -- 172.21.15.7:0/891402120 <== mds.2 v2:172.21.15.18:6836/1539670694 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x556f6f335610 con 0x556f6efadc90 2024-09-21T06:36:02.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.947+0000 7f43b17fa640 10 client.15318 handle_command_reply: tid=0 2024-09-21T06:36:02.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.947+0000 7f43d60ba740 1 client.15318 shutdown 2024-09-21T06:36:02.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.947+0000 7f43d60ba740 1 -- 172.21.15.7:0/891402120 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556f6eff9280 msgr2=0x556f6f3e4ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:02.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.947+0000 7f43d60ba740 1 --2- 172.21.15.7:0/891402120 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556f6eff9280 0x556f6f3e4ba0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f43b8105450 tx=0x7f43b802a410 comp rx=0 tx=0).stop 2024-09-21T06:36:02.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.947+0000 7f43d60ba740 1 -- 172.21.15.7:0/891402120 shutdown_connections 2024-09-21T06:36:02.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.947+0000 7f43d60ba740 1 --2- 172.21.15.7:0/891402120 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x556f6efadc90 0x556f6f4511c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:02.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.947+0000 7f43d60ba740 1 --2- 172.21.15.7:0/891402120 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556f6f019f60 0x556f6f3e50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:02.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.947+0000 7f43d60ba740 1 --2- 172.21.15.7:0/891402120 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556f6eff9280 0x556f6f3e4ba0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:02.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.947+0000 7f43d60ba740 1 --2- 172.21.15.7:0/891402120 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556f6eff10a0 0x556f6f3e4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:02.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.947+0000 7f43b17fa640 0 client.15318 ms_handle_reset on v2:172.21.15.18:6836/1539670694 2024-09-21T06:36:02.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.947+0000 7f43d60ba740 1 -- 172.21.15.7:0/891402120 >> 172.21.15.7:0/891402120 conn(0x556f6f00e350 msgr2=0x556f6f3bd600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:02.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.947+0000 7f43d60ba740 1 -- 172.21.15.7:0/891402120 shutdown_connections 2024-09-21T06:36:02.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.947+0000 7f43d60ba740 1 -- 172.21.15.7:0/891402120 wait complete. 2024-09-21T06:36:02.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.947+0000 7f43d60ba740 20 client.15318 trim_cache size 0 max 16384 2024-09-21T06:36:02.957 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:36:02.957 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "347cb918-77e2-11ef-baf5-efdc52797490", 2024-09-21T06:36:02.957 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 2, 2024-09-21T06:36:02.957 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 24686, 2024-09-21T06:36:02.957 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-09-21T06:36:02.957 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-09-21T06:36:02.957 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-09-21T06:36:02.957 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 89.965613274000006, 2024-09-21T06:36:02.958 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 24, 2024-09-21T06:36:02.958 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 77, 2024-09-21T06:36:02.958 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 75, 2024-09-21T06:36:02.958 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 119.77170299700001 2024-09-21T06:36:02.958 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:36:02.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.948+0000 7f43cfb46640 1 -- 172.21.15.7:0/3113501588 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f43b40b65f0 msgr2=0x7f43b40b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:02.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.948+0000 7f43cfb46640 1 --2- 172.21.15.7:0/3113501588 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f43b40b65f0 0x7f43b40b8b00 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f43c0005fd0 tx=0x7f43c0004a40 comp rx=0 tx=0).stop 2024-09-21T06:36:02.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.948+0000 7f43cfb46640 1 -- 172.21.15.7:0/3113501588 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43c81094f0 msgr2=0x7f43c819aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:02.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.948+0000 7f43cfb46640 1 --2- 172.21.15.7:0/3113501588 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43c81094f0 0x7f43c819aa90 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f43b802a930 tx=0x7f43b8004270 comp rx=0 tx=0).stop 2024-09-21T06:36:02.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.948+0000 7f43cfb46640 1 -- 172.21.15.7:0/3113501588 shutdown_connections 2024-09-21T06:36:02.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.948+0000 7f43cfb46640 1 --2- 172.21.15.7:0/3113501588 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f43b40b65f0 0x7f43b40b8b00 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:02.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.948+0000 7f43cfb46640 1 --2- 172.21.15.7:0/3113501588 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f43c8109e40 0x7f43c819fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:02.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.948+0000 7f43cfb46640 1 --2- 172.21.15.7:0/3113501588 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f43c81094f0 0x7f43c819aa90 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:02.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.948+0000 7f43cfb46640 1 --2- 172.21.15.7:0/3113501588 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f43c8103bb0 0x7f43c819a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:02.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.948+0000 7f43cfb46640 1 -- 172.21.15.7:0/3113501588 >> 172.21.15.7:0/3113501588 conn(0x7f43c80ff600 msgr2=0x7f43c8101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:02.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.948+0000 7f43cfb46640 1 -- 172.21.15.7:0/3113501588 shutdown_connections 2024-09-21T06:36:02.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:02.948+0000 7f43cfb46640 1 -- 172.21.15.7:0/3113501588 wait complete. 2024-09-21T06:36:03.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:36:02 smithi144 ceph-mon[34653]: pgmap v314: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:36:03.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:36:02 smithi018 ceph-mon[34477]: pgmap v314: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:36:03.621 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.i status 2024-09-21T06:36:03.879 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:36:04.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.354+0000 7f9023409640 1 -- 172.21.15.7:0/1876166856 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f901c102fa0 msgr2=0x7f901c10fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:04.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.354+0000 7f9023409640 1 --2- 172.21.15.7:0/1876166856 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f901c102fa0 0x7f901c10fcc0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f900c009900 tx=0x7f900c02a480 comp rx=0 tx=0).stop 2024-09-21T06:36:04.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.354+0000 7f9023409640 1 -- 172.21.15.7:0/1876166856 shutdown_connections 2024-09-21T06:36:04.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.354+0000 7f9023409640 1 --2- 172.21.15.7:0/1876166856 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f901c110200 0x7f901c112620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:04.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.354+0000 7f9023409640 1 --2- 172.21.15.7:0/1876166856 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f901c102fa0 0x7f901c10fcc0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:04.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.354+0000 7f9023409640 1 --2- 172.21.15.7:0/1876166856 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f901c102650 0x7f901c102a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:04.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.354+0000 7f9023409640 1 -- 172.21.15.7:0/1876166856 >> 172.21.15.7:0/1876166856 conn(0x7f901c079760 msgr2=0x7f901c079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:04.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.354+0000 7f9023409640 1 -- 172.21.15.7:0/1876166856 shutdown_connections 2024-09-21T06:36:04.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.354+0000 7f9023409640 1 -- 172.21.15.7:0/1876166856 wait complete. 2024-09-21T06:36:04.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.355+0000 7f9023409640 1 Processor -- start 2024-09-21T06:36:04.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.355+0000 7f9023409640 1 -- start start 2024-09-21T06:36:04.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.355+0000 7f9023409640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f901c102650 0x7f901c19c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:04.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.355+0000 7f9023409640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f901c102fa0 0x7f901c19cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:04.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.355+0000 7f9023409640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f901c110200 0x7f901c1a1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:04.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.355+0000 7f9023409640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f901c115ca0 con 0x7f901c102650 2024-09-21T06:36:04.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.355+0000 7f9023409640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f901c115b20 con 0x7f901c102fa0 2024-09-21T06:36:04.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.355+0000 7f9023409640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f901c115e20 con 0x7f901c110200 2024-09-21T06:36:04.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.355+0000 7f90211a5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f901c102650 0x7f901c19c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:04.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.355+0000 7f90211a5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f901c102650 0x7f901c19c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56436/0 (socket says 172.21.15.7:56436) 2024-09-21T06:36:04.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.355+0000 7f90211a5640 1 -- 172.21.15.7:0/875881203 learned_addr learned my addr 172.21.15.7:0/875881203 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:36:04.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.355+0000 7f90209a4640 1 --2- 172.21.15.7:0/875881203 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f901c102fa0 0x7f901c19cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:04.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.355+0000 7f90211a5640 1 -- 172.21.15.7:0/875881203 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f901c110200 msgr2=0x7f901c1a1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:04.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.355+0000 7f90211a5640 1 --2- 172.21.15.7:0/875881203 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f901c110200 0x7f901c1a1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:04.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.355+0000 7f90211a5640 1 -- 172.21.15.7:0/875881203 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f901c102fa0 msgr2=0x7f901c19cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:04.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.355+0000 7f90211a5640 1 --2- 172.21.15.7:0/875881203 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f901c102fa0 0x7f901c19cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:04.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.355+0000 7f90211a5640 1 -- 172.21.15.7:0/875881203 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f901c1a25e0 con 0x7f901c102650 2024-09-21T06:36:04.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.356+0000 7f90211a5640 1 --2- 172.21.15.7:0/875881203 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f901c102650 0x7f901c19c670 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f901800e9f0 tx=0x7f901800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:04.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.356+0000 7f90127fc640 1 -- 172.21.15.7:0/875881203 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f901800cd80 con 0x7f901c102650 2024-09-21T06:36:04.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.356+0000 7f9023409640 1 -- 172.21.15.7:0/875881203 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f901c1a28d0 con 0x7f901c102650 2024-09-21T06:36:04.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.356+0000 7f90127fc640 1 -- 172.21.15.7:0/875881203 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f90180108e0 con 0x7f901c102650 2024-09-21T06:36:04.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.356+0000 7f90127fc640 1 -- 172.21.15.7:0/875881203 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9018018980 con 0x7f901c102650 2024-09-21T06:36:04.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.356+0000 7f9023409640 1 -- 172.21.15.7:0/875881203 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f901c1a9030 con 0x7f901c102650 2024-09-21T06:36:04.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.358+0000 7f902997d740 1 Processor -- start 2024-09-21T06:36:04.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.359+0000 7f902997d740 1 -- start start 2024-09-21T06:36:04.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.359+0000 7f90127fc640 1 -- 172.21.15.7:0/875881203 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154579+0+0 (secure 0 0 0) 0x7f9018010430 con 0x7f901c102650 2024-09-21T06:36:04.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.359+0000 7f902997d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644dad1bf60 0x5644db0c1f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:04.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.359+0000 7f902997d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644dacf30a0 0x5644db0c2440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:04.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.359+0000 7f902997d740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5644dacfb280 0x5644db0c2980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:04.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.359+0000 7f902997d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5644db039c10 con 0x5644dacf30a0 2024-09-21T06:36:04.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.359+0000 7f902997d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5644db029040 con 0x5644dad1bf60 2024-09-21T06:36:04.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.359+0000 7f902997d740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5644db02ce50 con 0x5644dacfb280 2024-09-21T06:36:04.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.359+0000 7f90211a5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644dacf30a0 0x5644db0c2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:04.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.359+0000 7f90211a5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644dacf30a0 0x5644db0c2440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56448/0 (socket says 172.21.15.7:56448) 2024-09-21T06:36:04.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.359+0000 7f90211a5640 1 -- 172.21.15.7:0/3326160937 learned_addr learned my addr 172.21.15.7:0/3326160937 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:36:04.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.359+0000 7f90219a6640 1 --2- 172.21.15.7:0/3326160937 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644dad1bf60 0x5644db0c1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:04.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.359+0000 7f90209a4640 1 --2- 172.21.15.7:0/3326160937 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5644dacfb280 0x5644db0c2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:04.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.359+0000 7f90219a6640 1 -- 172.21.15.7:0/3326160937 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5644dacfb280 msgr2=0x5644db0c2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:04.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.359+0000 7f90219a6640 1 --2- 172.21.15.7:0/3326160937 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5644dacfb280 0x5644db0c2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:04.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.359+0000 7f90219a6640 1 -- 172.21.15.7:0/3326160937 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644dacf30a0 msgr2=0x5644db0c2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:04.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.360+0000 7f90219a6640 1 --2- 172.21.15.7:0/3326160937 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644dacf30a0 0x5644db0c2440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:04.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.360+0000 7f90219a6640 1 -- 172.21.15.7:0/3326160937 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644dad87540 con 0x5644dad1bf60 2024-09-21T06:36:04.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.360+0000 7f90211a5640 1 --2- 172.21.15.7:0/3326160937 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644dacf30a0 0x5644db0c2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:36:04.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.360+0000 7f90127fc640 1 --2- 172.21.15.7:0/875881203 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f90080b65f0 0x7f90080b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:04.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.360+0000 7f90219a6640 1 --2- 172.21.15.7:0/3326160937 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644dad1bf60 0x5644db0c1f00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9014009cc0 tx=0x7f901400e6c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aba5cbe075438da7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:04.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.360+0000 7f90211a5640 1 --2- 172.21.15.7:0/875881203 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f90080b65f0 0x7f90080b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:04.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.360+0000 7f90127fc640 1 -- 172.21.15.7:0/875881203 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f90180e7960 con 0x7f901c102650 2024-09-21T06:36:04.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.360+0000 7f90077fe640 1 -- 172.21.15.7:0/3326160937 <== mon.2 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9014016070 con 0x5644dad1bf60 2024-09-21T06:36:04.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.360+0000 7f90077fe640 1 -- 172.21.15.7:0/3326160937 <== mon.2 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9014005020 con 0x5644dad1bf60 2024-09-21T06:36:04.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.360+0000 7f90077fe640 1 -- 172.21.15.7:0/3326160937 <== mon.2 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90140116d0 con 0x5644dad1bf60 2024-09-21T06:36:04.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.361+0000 7f902997d740 1 -- 172.21.15.7:0/3326160937 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644dad1bf60 msgr2=0x5644db0c1f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:04.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.361+0000 7f90211a5640 1 --2- 172.21.15.7:0/875881203 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f90080b65f0 0x7f90080b8b00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f90180a9ee0 tx=0x7f90180ed530 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:04.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.361+0000 7f902997d740 1 --2- 172.21.15.7:0/3326160937 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644dad1bf60 0x5644db0c1f00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9014009cc0 tx=0x7f901400e6c0 comp rx=0 tx=0).stop 2024-09-21T06:36:04.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.361+0000 7f902997d740 1 -- 172.21.15.7:0/3326160937 shutdown_connections 2024-09-21T06:36:04.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.361+0000 7f902997d740 1 --2- 172.21.15.7:0/3326160937 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5644dacfb280 0x5644db0c2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:04.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.361+0000 7f902997d740 1 --2- 172.21.15.7:0/3326160937 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644dacf30a0 0x5644db0c2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:04.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.361+0000 7f902997d740 1 --2- 172.21.15.7:0/3326160937 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644dad1bf60 0x5644db0c1f00 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:04.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.361+0000 7f902997d740 1 -- 172.21.15.7:0/3326160937 >> 172.21.15.7:0/3326160937 conn(0x5644dad10350 msgr2=0x5644db0bfdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:04.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.362+0000 7f902997d740 1 -- 172.21.15.7:0/3326160937 shutdown_connections 2024-09-21T06:36:04.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.362+0000 7f902997d740 1 -- 172.21.15.7:0/3326160937 wait complete. 2024-09-21T06:36:04.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.362+0000 7f902997d740 1 -- start start 2024-09-21T06:36:04.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.362+0000 7f902997d740 1 Processor -- start 2024-09-21T06:36:04.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.363+0000 7f902997d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644dacf30a0 0x5644db0cd820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:04.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.363+0000 7f902997d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644dacfb280 0x5644db0cde00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:04.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.363+0000 7f902997d740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5644dad1bf60 0x5644db0d9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:04.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.363+0000 7f902997d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5644dae8a5f0 con 0x5644dacfb280 2024-09-21T06:36:04.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.363+0000 7f902997d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5644dafc4010 con 0x5644dacf30a0 2024-09-21T06:36:04.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.363+0000 7f902997d740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5644db0d06e0 con 0x5644dad1bf60 2024-09-21T06:36:04.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.363+0000 7f90209a4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644dacfb280 0x5644db0cde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:04.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.363+0000 7f902997d740 10 client.0 _ll_register_callbacks cb 0x5644db023340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:36:04.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.363+0000 7f90209a4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644dacfb280 0x5644db0cde00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56452/0 (socket says 172.21.15.7:56452) 2024-09-21T06:36:04.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.363+0000 7f90209a4640 1 -- 172.21.15.7:0/92580861 learned_addr learned my addr 172.21.15.7:0/92580861 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:36:04.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.363+0000 7f90219a6640 1 --2- 172.21.15.7:0/92580861 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644dacf30a0 0x5644db0cd820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:04.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.363+0000 7f90219a6640 1 --2- 172.21.15.7:0/92580861 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5644dad1bf60 0x5644db0d9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:04.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.363+0000 7f90209a4640 1 -- 172.21.15.7:0/92580861 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5644dad1bf60 msgr2=0x5644db0d9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:04.384 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.363+0000 7f90209a4640 1 --2- 172.21.15.7:0/92580861 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5644dad1bf60 0x5644db0d9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:04.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.363+0000 7f90209a4640 1 -- 172.21.15.7:0/92580861 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644dacf30a0 msgr2=0x5644db0cd820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:04.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.363+0000 7f90209a4640 1 --2- 172.21.15.7:0/92580861 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644dacf30a0 0x5644db0cd820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:04.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.363+0000 7f90209a4640 1 -- 172.21.15.7:0/92580861 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644daff1a00 con 0x5644dacfb280 2024-09-21T06:36:04.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.363+0000 7f90219a6640 1 --2- 172.21.15.7:0/92580861 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644dacf30a0 0x5644db0cd820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:36:04.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.363+0000 7f90209a4640 1 --2- 172.21.15.7:0/92580861 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644dacfb280 0x5644db0cde00 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f900c009900 tx=0x7f900c032f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1df8c408f639a5ff server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:04.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.363+0000 7f9004ff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:36:04.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.364+0000 7f9004ff9640 1 -- 172.21.15.7:0/92580861 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f900c035040 con 0x5644dacfb280 2024-09-21T06:36:04.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.364+0000 7f902997d740 1 -- 172.21.15.7:0/92580861 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9014005020 con 0x5644dacfb280 2024-09-21T06:36:04.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.364+0000 7f9004ff9640 1 -- 172.21.15.7:0/92580861 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f900c031720 con 0x5644dacfb280 2024-09-21T06:36:04.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.364+0000 7f9004ff9640 1 -- 172.21.15.7:0/92580861 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f900c04a020 con 0x5644dacfb280 2024-09-21T06:36:04.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.364+0000 7f902997d740 10 client.15330 fetch_fsmap learned FSMap version 24 2024-09-21T06:36:04.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.364+0000 7f902997d740 1 -- 172.21.15.7:0/92580861 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5644db0dc620 con 0x5644dacfb280 2024-09-21T06:36:04.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.364+0000 7f9004ff9640 1 -- 172.21.15.7:0/92580861 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9014005020 con 0x5644dacfb280 2024-09-21T06:36:04.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.364+0000 7f9004ff9640 1 -- 172.21.15.7:0/92580861 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f900c004750 con 0x5644dacfb280 2024-09-21T06:36:04.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.364+0000 7f902997d740 10 client.15330 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T06:36:04.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.364+0000 7f902997d740 10 client.15330 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T06:36:04.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.364+0000 7f902997d740 20 client.15330 populate_metadata read hostname 'smithi007' 2024-09-21T06:36:04.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.364+0000 7f902997d740 1 --2- 172.21.15.7:0/92580861 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x5644dacda8e0 0x5644db0e0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:04.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.364+0000 7f902997d740 4 client.15330 mds_command: new command op to 24688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:36:04.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.364+0000 7f902997d740 1 -- 172.21.15.7:0/92580861 --> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5644db03bb60 con 0x5644dacda8e0 2024-09-21T06:36:04.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.365+0000 7f90219a6640 1 --2- 172.21.15.7:0/92580861 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x5644dacda8e0 0x5644db0e0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:04.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.365+0000 7f9004ff9640 10 client.15330 ms_handle_connect on v2:172.21.15.144:6838/4027821922 2024-09-21T06:36:04.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.365+0000 7f90219a6640 1 --2- 172.21.15.7:0/92580861 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x5644dacda8e0 0x5644db0e0020 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=df7780d2bf7aabb4 server_cookie=33d19c533d96a317 in_seq=0 out_seq=0 2024-09-21T06:36:04.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.366+0000 7f9004ff9640 1 -- 172.21.15.7:0/92580861 <== mds.1 v2:172.21.15.144:6838/4027821922 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5644db03bb60 con 0x5644dacda8e0 2024-09-21T06:36:04.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.366+0000 7f9004ff9640 10 client.15330 handle_command_reply: tid=0 2024-09-21T06:36:04.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.366+0000 7f902997d740 1 client.15330 shutdown 2024-09-21T06:36:04.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.366+0000 7f902997d740 1 -- 172.21.15.7:0/92580861 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644dacfb280 msgr2=0x5644db0cde00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:04.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.366+0000 7f902997d740 1 --2- 172.21.15.7:0/92580861 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644dacfb280 0x5644db0cde00 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f900c009900 tx=0x7f900c032f20 comp rx=0 tx=0).stop 2024-09-21T06:36:04.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.366+0000 7f902997d740 1 -- 172.21.15.7:0/92580861 shutdown_connections 2024-09-21T06:36:04.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.366+0000 7f902997d740 1 --2- 172.21.15.7:0/92580861 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x5644dacda8e0 0x5644db0e0020 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:04.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.366+0000 7f902997d740 1 --2- 172.21.15.7:0/92580861 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5644dad1bf60 0x5644db0d9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:04.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.366+0000 7f902997d740 1 --2- 172.21.15.7:0/92580861 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644dacfb280 0x5644db0cde00 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:04.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.366+0000 7f902997d740 1 --2- 172.21.15.7:0/92580861 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644dacf30a0 0x5644db0cd820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:04.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.366+0000 7f9004ff9640 0 client.15330 ms_handle_reset on v2:172.21.15.144:6838/4027821922 2024-09-21T06:36:04.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.366+0000 7f902997d740 1 -- 172.21.15.7:0/92580861 >> 172.21.15.7:0/92580861 conn(0x5644dad10350 msgr2=0x5644db0c5090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:04.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.366+0000 7f902997d740 1 -- 172.21.15.7:0/92580861 shutdown_connections 2024-09-21T06:36:04.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.366+0000 7f902997d740 1 -- 172.21.15.7:0/92580861 wait complete. 2024-09-21T06:36:04.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.367+0000 7f902997d740 20 client.15330 trim_cache size 0 max 16384 2024-09-21T06:36:04.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.385+0000 7f902997d740 1 Processor -- start 2024-09-21T06:36:04.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.385+0000 7f902997d740 1 -- start start 2024-09-21T06:36:04.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.385+0000 7f902997d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644dacf30a0 0x5644db0ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:04.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.385+0000 7f902997d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644dacfb280 0x5644db0d9970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:04.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.385+0000 7f902997d740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5644dad1bf60 0x5644db0d9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:04.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.385+0000 7f902997d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5644db0de360 con 0x5644dacfb280 2024-09-21T06:36:04.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.385+0000 7f902997d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5644db0dea30 con 0x5644dacf30a0 2024-09-21T06:36:04.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.385+0000 7f902997d740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5644db0df100 con 0x5644dad1bf60 2024-09-21T06:36:04.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.385+0000 7f90209a4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644dacfb280 0x5644db0d9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:04.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.385+0000 7f90209a4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644dacfb280 0x5644db0d9970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56460/0 (socket says 172.21.15.7:56460) 2024-09-21T06:36:04.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.385+0000 7f90209a4640 1 -- 172.21.15.7:0/1179813060 learned_addr learned my addr 172.21.15.7:0/1179813060 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:36:04.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.385+0000 7f90219a6640 1 --2- 172.21.15.7:0/1179813060 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5644dad1bf60 0x5644db0d9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:04.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.385+0000 7f90219a6640 1 --2- 172.21.15.7:0/1179813060 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644dacf30a0 0x5644db0ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:04.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.385+0000 7f90209a4640 1 -- 172.21.15.7:0/1179813060 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5644dad1bf60 msgr2=0x5644db0d9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:04.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.385+0000 7f90209a4640 1 --2- 172.21.15.7:0/1179813060 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5644dad1bf60 0x5644db0d9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:04.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.385+0000 7f90209a4640 1 -- 172.21.15.7:0/1179813060 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644dacf30a0 msgr2=0x5644db0ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:04.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.385+0000 7f90209a4640 1 --2- 172.21.15.7:0/1179813060 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644dacf30a0 0x5644db0ccd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:04.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.385+0000 7f90209a4640 1 -- 172.21.15.7:0/1179813060 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644db0ba080 con 0x5644dacfb280 2024-09-21T06:36:04.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.385+0000 7f90219a6640 1 --2- 172.21.15.7:0/1179813060 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5644dad1bf60 0x5644db0d9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:36:04.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.385+0000 7f90209a4640 1 --2- 172.21.15.7:0/1179813060 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644dacfb280 0x5644db0d9970 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f900c02a9a0 tx=0x7f900c02a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea12442a822d3605 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:04.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.386+0000 7f9006ffd640 1 -- 172.21.15.7:0/1179813060 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f900c000e60 con 0x5644dacfb280 2024-09-21T06:36:04.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.386+0000 7f9006ffd640 1 -- 172.21.15.7:0/1179813060 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f900c004030 con 0x5644dacfb280 2024-09-21T06:36:04.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.386+0000 7f9006ffd640 1 -- 172.21.15.7:0/1179813060 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f900c035070 con 0x5644dacfb280 2024-09-21T06:36:04.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.386+0000 7f902997d740 1 -- 172.21.15.7:0/1179813060 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644dacfb280 msgr2=0x5644db0d9970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:04.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.386+0000 7f902997d740 1 --2- 172.21.15.7:0/1179813060 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644dacfb280 0x5644db0d9970 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f900c02a9a0 tx=0x7f900c02a480 comp rx=0 tx=0).stop 2024-09-21T06:36:04.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.386+0000 7f902997d740 1 -- 172.21.15.7:0/1179813060 shutdown_connections 2024-09-21T06:36:04.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.386+0000 7f902997d740 1 --2- 172.21.15.7:0/1179813060 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5644dad1bf60 0x5644db0d9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:04.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.386+0000 7f902997d740 1 --2- 172.21.15.7:0/1179813060 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644dacfb280 0x5644db0d9970 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:04.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.386+0000 7f902997d740 1 --2- 172.21.15.7:0/1179813060 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644dacf30a0 0x5644db0ccd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:04.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.386+0000 7f902997d740 1 -- 172.21.15.7:0/1179813060 >> 172.21.15.7:0/1179813060 conn(0x5644dad10350 msgr2=0x5644db0c89d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:04.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.387+0000 7f902997d740 1 -- 172.21.15.7:0/1179813060 shutdown_connections 2024-09-21T06:36:04.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.387+0000 7f902997d740 1 -- 172.21.15.7:0/1179813060 wait complete. 2024-09-21T06:36:04.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.387+0000 7f902997d740 1 -- start start 2024-09-21T06:36:04.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.387+0000 7f902997d740 1 Processor -- start 2024-09-21T06:36:04.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.387+0000 7f902997d740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5644dacf30a0 0x5644db0e19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:04.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.387+0000 7f902997d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644dacfb280 0x5644db0e1f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:04.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.387+0000 7f902997d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644dad1bf60 0x5644db0e6e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:04.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.387+0000 7f902997d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5644db0dfea0 con 0x5644dacfb280 2024-09-21T06:36:04.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.388+0000 7f902997d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5644db0df7d0 con 0x5644dad1bf60 2024-09-21T06:36:04.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.388+0000 7f902997d740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5644db0e0570 con 0x5644dacf30a0 2024-09-21T06:36:04.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.388+0000 7f902997d740 10 client.0 _ll_register_callbacks cb 0x7f900c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:36:04.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.388+0000 7f90209a4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644dacfb280 0x5644db0e1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:04.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.388+0000 7f90209a4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644dacfb280 0x5644db0e1f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56474/0 (socket says 172.21.15.7:56474) 2024-09-21T06:36:04.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.388+0000 7f90209a4640 1 -- 172.21.15.7:0/3812116011 learned_addr learned my addr 172.21.15.7:0/3812116011 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:36:04.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.388+0000 7f90219a6640 1 --2- 172.21.15.7:0/3812116011 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5644dacf30a0 0x5644db0e19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:04.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.388+0000 7f90219a6640 1 --2- 172.21.15.7:0/3812116011 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644dad1bf60 0x5644db0e6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:04.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.388+0000 7f90209a4640 1 -- 172.21.15.7:0/3812116011 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5644dacf30a0 msgr2=0x5644db0e19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:04.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.388+0000 7f90209a4640 1 --2- 172.21.15.7:0/3812116011 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5644dacf30a0 0x5644db0e19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:04.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.388+0000 7f90209a4640 1 -- 172.21.15.7:0/3812116011 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644dad1bf60 msgr2=0x5644db0e6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:04.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.388+0000 7f90209a4640 1 --2- 172.21.15.7:0/3812116011 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644dad1bf60 0x5644db0e6e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:04.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.388+0000 7f90209a4640 1 -- 172.21.15.7:0/3812116011 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644db0e74c0 con 0x5644dacfb280 2024-09-21T06:36:04.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.388+0000 7f90219a6640 1 --2- 172.21.15.7:0/3812116011 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5644dacf30a0 0x5644db0e19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:36:04.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.388+0000 7f90209a4640 1 --2- 172.21.15.7:0/3812116011 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644dacfb280 0x5644db0e1f60 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f900c009900 tx=0x7f900c004ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a05c74602a49756e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:04.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.388+0000 7f9004ff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:36:04.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.388+0000 7f9004ff9640 1 -- 172.21.15.7:0/3812116011 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f900c035040 con 0x5644dacfb280 2024-09-21T06:36:04.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.388+0000 7f902997d740 1 -- 172.21.15.7:0/3812116011 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f900c004030 con 0x5644dacfb280 2024-09-21T06:36:04.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.388+0000 7f9004ff9640 1 -- 172.21.15.7:0/3812116011 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f900c0318b0 con 0x5644dacfb280 2024-09-21T06:36:04.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.389+0000 7f9004ff9640 1 -- 172.21.15.7:0/3812116011 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f900c004e10 con 0x5644dacfb280 2024-09-21T06:36:04.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.389+0000 7f902997d740 10 client.15336 fetch_fsmap learned FSMap version 24 2024-09-21T06:36:04.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.389+0000 7f902997d740 1 -- 172.21.15.7:0/3812116011 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5644db0e88a0 con 0x5644dacfb280 2024-09-21T06:36:04.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.389+0000 7f9004ff9640 1 -- 172.21.15.7:0/3812116011 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f900c004030 con 0x5644dacfb280 2024-09-21T06:36:04.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.389+0000 7f9004ff9640 1 -- 172.21.15.7:0/3812116011 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f900c003b20 con 0x5644dacfb280 2024-09-21T06:36:04.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.389+0000 7f902997d740 10 client.15336 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T06:36:04.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.389+0000 7f902997d740 10 client.15336 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T06:36:04.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.389+0000 7f902997d740 20 client.15336 populate_metadata read hostname 'smithi007' 2024-09-21T06:36:04.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.389+0000 7f902997d740 1 --2- 172.21.15.7:0/3812116011 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x5644dacafc90 0x5644db14e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:04.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.389+0000 7f902997d740 4 client.15336 mds_command: new command op to 24688 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T06:36:04.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.389+0000 7f902997d740 1 -- 172.21.15.7:0/3812116011 --> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] -- command(tid 0: {"prefix": "status"}) -- 0x5644db037610 con 0x5644dacafc90 2024-09-21T06:36:04.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.389+0000 7f90219a6640 1 --2- 172.21.15.7:0/3812116011 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x5644dacafc90 0x5644db14e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:04.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.390+0000 7f9004ff9640 10 client.15336 ms_handle_connect on v2:172.21.15.144:6838/4027821922 2024-09-21T06:36:04.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.390+0000 7f90219a6640 1 --2- 172.21.15.7:0/3812116011 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x5644dacafc90 0x5644db14e0b0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3a1fa2577d3872b6 server_cookie=19455a864b5f59f4 in_seq=0 out_seq=0 2024-09-21T06:36:04.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.390+0000 7f9004ff9640 1 -- 172.21.15.7:0/3812116011 <== mds.1 v2:172.21.15.144:6838/4027821922 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5644db037610 con 0x5644dacafc90 2024-09-21T06:36:04.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.390+0000 7f9004ff9640 10 client.15336 handle_command_reply: tid=0 2024-09-21T06:36:04.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.390+0000 7f902997d740 1 client.15336 shutdown 2024-09-21T06:36:04.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.390+0000 7f902997d740 1 -- 172.21.15.7:0/3812116011 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644dacfb280 msgr2=0x5644db0e1f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:04.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.390+0000 7f902997d740 1 --2- 172.21.15.7:0/3812116011 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644dacfb280 0x5644db0e1f60 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f900c009900 tx=0x7f900c004ba0 comp rx=0 tx=0).stop 2024-09-21T06:36:04.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.390+0000 7f902997d740 1 -- 172.21.15.7:0/3812116011 shutdown_connections 2024-09-21T06:36:04.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.390+0000 7f902997d740 1 --2- 172.21.15.7:0/3812116011 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x5644dacafc90 0x5644db14e0b0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:04.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.390+0000 7f902997d740 1 --2- 172.21.15.7:0/3812116011 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644dad1bf60 0x5644db0e6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:04.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.390+0000 7f902997d740 1 --2- 172.21.15.7:0/3812116011 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644dacfb280 0x5644db0e1f60 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:04.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.390+0000 7f902997d740 1 --2- 172.21.15.7:0/3812116011 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5644dacf30a0 0x5644db0e19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:04.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.390+0000 7f902997d740 1 -- 172.21.15.7:0/3812116011 >> 172.21.15.7:0/3812116011 conn(0x5644dad10350 msgr2=0x5644db0bf600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:04.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.390+0000 7f9004ff9640 0 client.15336 ms_handle_reset on v2:172.21.15.144:6838/4027821922 2024-09-21T06:36:04.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.390+0000 7f902997d740 1 -- 172.21.15.7:0/3812116011 shutdown_connections 2024-09-21T06:36:04.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.390+0000 7f902997d740 1 -- 172.21.15.7:0/3812116011 wait complete. 2024-09-21T06:36:04.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.391+0000 7f902997d740 20 client.15336 trim_cache size 0 max 16384 2024-09-21T06:36:04.417 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:36:04.417 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "347cb918-77e2-11ef-baf5-efdc52797490", 2024-09-21T06:36:04.418 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 1, 2024-09-21T06:36:04.418 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 24688, 2024-09-21T06:36:04.418 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-09-21T06:36:04.418 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-09-21T06:36:04.418 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-09-21T06:36:04.418 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 92.414538734999994, 2024-09-21T06:36:04.418 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 24, 2024-09-21T06:36:04.418 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 77, 2024-09-21T06:36:04.418 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 75, 2024-09-21T06:36:04.418 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 118.68257199599999 2024-09-21T06:36:04.418 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:36:04.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.391+0000 7f9023409640 1 -- 172.21.15.7:0/875881203 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f90080b65f0 msgr2=0x7f90080b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:04.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.391+0000 7f9023409640 1 --2- 172.21.15.7:0/875881203 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f90080b65f0 0x7f90080b8b00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f90180a9ee0 tx=0x7f90180ed530 comp rx=0 tx=0).stop 2024-09-21T06:36:04.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.391+0000 7f9023409640 1 -- 172.21.15.7:0/875881203 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f901c102650 msgr2=0x7f901c19c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:04.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.391+0000 7f9023409640 1 --2- 172.21.15.7:0/875881203 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f901c102650 0x7f901c19c670 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f901800e9f0 tx=0x7f901800eeb0 comp rx=0 tx=0).stop 2024-09-21T06:36:04.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.391+0000 7f9023409640 1 -- 172.21.15.7:0/875881203 shutdown_connections 2024-09-21T06:36:04.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.391+0000 7f9023409640 1 --2- 172.21.15.7:0/875881203 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f90080b65f0 0x7f90080b8b00 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:04.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.391+0000 7f9023409640 1 --2- 172.21.15.7:0/875881203 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f901c110200 0x7f901c1a1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:04.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.391+0000 7f9023409640 1 --2- 172.21.15.7:0/875881203 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f901c102fa0 0x7f901c19cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:04.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.391+0000 7f9023409640 1 --2- 172.21.15.7:0/875881203 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f901c102650 0x7f901c19c670 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:04.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.391+0000 7f9023409640 1 -- 172.21.15.7:0/875881203 >> 172.21.15.7:0/875881203 conn(0x7f901c079760 msgr2=0x7f901c108c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:04.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.391+0000 7f9023409640 1 -- 172.21.15.7:0/875881203 shutdown_connections 2024-09-21T06:36:04.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:04.391+0000 7f9023409640 1 -- 172.21.15.7:0/875881203 wait complete. 2024-09-21T06:36:05.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:36:04 smithi144 ceph-mon[34653]: pgmap v315: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T06:36:05.059 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:36:04 smithi007 ceph-mon[30983]: pgmap v315: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T06:36:05.091 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.b status 2024-09-21T06:36:05.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:36:04 smithi018 ceph-mon[34477]: pgmap v315: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T06:36:05.350 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:36:05.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.787+0000 7fe9eb1c7640 1 -- 172.21.15.7:0/238788633 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9e4107b70 msgr2=0x7fe9e4107f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:05.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.788+0000 7fe9eb1c7640 1 --2- 172.21.15.7:0/238788633 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9e4107b70 0x7fe9e4107f80 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fe9d8009900 tx=0x7fe9d802a410 comp rx=0 tx=0).stop 2024-09-21T06:36:05.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.788+0000 7fe9eb1c7640 1 -- 172.21.15.7:0/238788633 shutdown_connections 2024-09-21T06:36:05.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.788+0000 7fe9eb1c7640 1 --2- 172.21.15.7:0/238788633 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9e41084c0 0x7fe9e410ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:05.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.788+0000 7fe9eb1c7640 1 --2- 172.21.15.7:0/238788633 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9e4107b70 0x7fe9e4107f80 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:05.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.788+0000 7fe9eb1c7640 1 --2- 172.21.15.7:0/238788633 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe9e4102230 0x7fe9e4102640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:05.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.788+0000 7fe9eb1c7640 1 -- 172.21.15.7:0/238788633 >> 172.21.15.7:0/238788633 conn(0x7fe9e4079e40 msgr2=0x7fe9e407a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:05.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.788+0000 7fe9eb1c7640 1 -- 172.21.15.7:0/238788633 shutdown_connections 2024-09-21T06:36:05.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.788+0000 7fe9eb1c7640 1 -- 172.21.15.7:0/238788633 wait complete. 2024-09-21T06:36:05.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.788+0000 7fe9eb1c7640 1 Processor -- start 2024-09-21T06:36:05.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.788+0000 7fe9eb1c7640 1 -- start start 2024-09-21T06:36:05.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.789+0000 7fe9eb1c7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe9e4102230 0x7fe9e419b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:05.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.789+0000 7fe9eb1c7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9e4107b70 0x7fe9e419b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:05.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.789+0000 7fe9eb1c7640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9e41084c0 0x7fe9e419bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:05.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.789+0000 7fe9eb1c7640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e4112a00 con 0x7fe9e4107b70 2024-09-21T06:36:05.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.789+0000 7fe9eb1c7640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e4112880 con 0x7fe9e4102230 2024-09-21T06:36:05.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.789+0000 7fe9eb1c7640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe9e4112b80 con 0x7fe9e41084c0 2024-09-21T06:36:05.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.789+0000 7fe9e3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9e4107b70 0x7fe9e419b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:05.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.789+0000 7fe9e3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9e4107b70 0x7fe9e419b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56498/0 (socket says 172.21.15.7:56498) 2024-09-21T06:36:05.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.789+0000 7fe9e3fff640 1 -- 172.21.15.7:0/373723681 learned_addr learned my addr 172.21.15.7:0/373723681 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:36:05.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.789+0000 7fe9e9764640 1 --2- 172.21.15.7:0/373723681 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9e41084c0 0x7fe9e419bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:05.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.789+0000 7fe9e8f63640 1 --2- 172.21.15.7:0/373723681 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe9e4102230 0x7fe9e419b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:05.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.789+0000 7fe9e3fff640 1 -- 172.21.15.7:0/373723681 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9e41084c0 msgr2=0x7fe9e419bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:05.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.789+0000 7fe9e3fff640 1 --2- 172.21.15.7:0/373723681 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9e41084c0 0x7fe9e419bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:05.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.789+0000 7fe9e3fff640 1 -- 172.21.15.7:0/373723681 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe9e4102230 msgr2=0x7fe9e419b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:05.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.789+0000 7fe9e3fff640 1 --2- 172.21.15.7:0/373723681 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe9e4102230 0x7fe9e419b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:05.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.789+0000 7fe9e3fff640 1 -- 172.21.15.7:0/373723681 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9e41a6540 con 0x7fe9e4107b70 2024-09-21T06:36:05.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.789+0000 7fe9e8f63640 1 --2- 172.21.15.7:0/373723681 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe9e4102230 0x7fe9e419b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:36:05.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.789+0000 7fe9e3fff640 1 --2- 172.21.15.7:0/373723681 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9e4107b70 0x7fe9e419b770 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fe9d8006010 tx=0x7fe9d8004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:05.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.789+0000 7fe9e1ffb640 1 -- 172.21.15.7:0/373723681 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d803f030 con 0x7fe9e4107b70 2024-09-21T06:36:05.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.789+0000 7fe9e1ffb640 1 -- 172.21.15.7:0/373723681 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe9d8003aa0 con 0x7fe9e4107b70 2024-09-21T06:36:05.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.790+0000 7fe9eb1c7640 1 -- 172.21.15.7:0/373723681 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9e41a67d0 con 0x7fe9e4107b70 2024-09-21T06:36:05.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.790+0000 7fe9e1ffb640 1 -- 172.21.15.7:0/373723681 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d8035070 con 0x7fe9e4107b70 2024-09-21T06:36:05.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.790+0000 7fe9eb1c7640 1 -- 172.21.15.7:0/373723681 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9e41a6d00 con 0x7fe9e4107b70 2024-09-21T06:36:05.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.793+0000 7fe9e1ffb640 1 -- 172.21.15.7:0/373723681 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154579+0+0 (secure 0 0 0) 0x7fe9d8042030 con 0x7fe9e4107b70 2024-09-21T06:36:05.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.793+0000 7fe9f173b740 1 Processor -- start 2024-09-21T06:36:05.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.793+0000 7fe9f173b740 1 -- start start 2024-09-21T06:36:05.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.793+0000 7fe9f173b740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559259c11f60 0x559259fb7f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:05.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.793+0000 7fe9f173b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559259be90a0 0x559259fb8440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:05.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.793+0000 7fe9f173b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559259bf1280 0x559259fb8980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:05.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.793+0000 7fe9f173b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x559259f2fc10 con 0x559259bf1280 2024-09-21T06:36:05.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.793+0000 7fe9f173b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559259f1f040 con 0x559259be90a0 2024-09-21T06:36:05.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.793+0000 7fe9f173b740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x559259f22e50 con 0x559259c11f60 2024-09-21T06:36:05.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.793+0000 7fe9e3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559259bf1280 0x559259fb8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:05.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.793+0000 7fe9e3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559259bf1280 0x559259fb8980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56502/0 (socket says 172.21.15.7:56502) 2024-09-21T06:36:05.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.793+0000 7fe9e3fff640 1 -- 172.21.15.7:0/3493773771 learned_addr learned my addr 172.21.15.7:0/3493773771 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:36:05.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.793+0000 7fe9e9764640 1 --2- 172.21.15.7:0/3493773771 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559259c11f60 0x559259fb7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:05.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.793+0000 7fe9e8f63640 1 --2- 172.21.15.7:0/3493773771 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559259be90a0 0x559259fb8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:05.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.794+0000 7fe9e3fff640 1 -- 172.21.15.7:0/3493773771 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559259c11f60 msgr2=0x559259fb7f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:05.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.794+0000 7fe9e3fff640 1 --2- 172.21.15.7:0/3493773771 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559259c11f60 0x559259fb7f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:05.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.794+0000 7fe9e3fff640 1 -- 172.21.15.7:0/3493773771 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559259be90a0 msgr2=0x559259fb8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:05.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.794+0000 7fe9e3fff640 1 --2- 172.21.15.7:0/3493773771 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559259be90a0 0x559259fb8440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:05.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.794+0000 7fe9e1ffb640 1 --2- 172.21.15.7:0/373723681 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fe9cc0b6670 0x7fe9cc0b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:05.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.794+0000 7fe9e3fff640 1 -- 172.21.15.7:0/3493773771 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559259c7d540 con 0x559259bf1280 2024-09-21T06:36:05.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.794+0000 7fe9e8f63640 1 --2- 172.21.15.7:0/3493773771 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559259be90a0 0x559259fb8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:36:05.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.794+0000 7fe9e9764640 1 --2- 172.21.15.7:0/373723681 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fe9cc0b6670 0x7fe9cc0b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:05.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.794+0000 7fe9e3fff640 1 --2- 172.21.15.7:0/3493773771 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559259bf1280 0x559259fb8980 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fe9d8105370 tx=0x7fe9d80ca1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5e35eef4d517c07 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:05.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.794+0000 7fe9e1ffb640 1 -- 172.21.15.7:0/373723681 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fe9d8107b00 con 0x7fe9e4107b70 2024-09-21T06:36:05.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.794+0000 7fe9caffd640 1 -- 172.21.15.7:0/3493773771 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d80cd880 con 0x559259bf1280 2024-09-21T06:36:05.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.794+0000 7fe9caffd640 1 -- 172.21.15.7:0/3493773771 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe9d80d74d0 con 0x559259bf1280 2024-09-21T06:36:05.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.794+0000 7fe9caffd640 1 -- 172.21.15.7:0/3493773771 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d80d7040 con 0x559259bf1280 2024-09-21T06:36:05.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.794+0000 7fe9e9764640 1 --2- 172.21.15.7:0/373723681 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fe9cc0b6670 0x7fe9cc0b8b80 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe9e4110790 tx=0x7fe9dc009640 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:05.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.795+0000 7fe9f173b740 1 -- 172.21.15.7:0/3493773771 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559259bf1280 msgr2=0x559259fb8980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:05.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.795+0000 7fe9f173b740 1 --2- 172.21.15.7:0/3493773771 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559259bf1280 0x559259fb8980 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fe9d8105370 tx=0x7fe9d80ca1c0 comp rx=0 tx=0).stop 2024-09-21T06:36:05.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.795+0000 7fe9f173b740 1 -- 172.21.15.7:0/3493773771 shutdown_connections 2024-09-21T06:36:05.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.795+0000 7fe9f173b740 1 --2- 172.21.15.7:0/3493773771 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559259bf1280 0x559259fb8980 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:05.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.795+0000 7fe9f173b740 1 --2- 172.21.15.7:0/3493773771 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559259be90a0 0x559259fb8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:05.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.795+0000 7fe9f173b740 1 --2- 172.21.15.7:0/3493773771 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559259c11f60 0x559259fb7f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:05.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.795+0000 7fe9f173b740 1 -- 172.21.15.7:0/3493773771 >> 172.21.15.7:0/3493773771 conn(0x559259c06350 msgr2=0x559259fb5df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:05.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.795+0000 7fe9f173b740 1 -- 172.21.15.7:0/3493773771 shutdown_connections 2024-09-21T06:36:05.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.795+0000 7fe9f173b740 1 -- 172.21.15.7:0/3493773771 wait complete. 2024-09-21T06:36:05.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.796+0000 7fe9f173b740 1 -- start start 2024-09-21T06:36:05.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.796+0000 7fe9f173b740 1 Processor -- start 2024-09-21T06:36:05.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.796+0000 7fe9f173b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559259be90a0 0x559259fc7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:05.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.796+0000 7fe9f173b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559259bf1280 0x559259fc83e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:05.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.797+0000 7fe9f173b740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559259c11f60 0x559259fd3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:05.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.797+0000 7fe9f173b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x559259d805f0 con 0x559259bf1280 2024-09-21T06:36:05.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.797+0000 7fe9f173b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559259eba010 con 0x559259be90a0 2024-09-21T06:36:05.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.797+0000 7fe9f173b740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x559259fca800 con 0x559259c11f60 2024-09-21T06:36:05.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.797+0000 7fe9f173b740 10 client.0 _ll_register_callbacks cb 0x559259f19340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:36:05.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.797+0000 7fe9e3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559259bf1280 0x559259fc83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:05.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.797+0000 7fe9e3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559259bf1280 0x559259fc83e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56512/0 (socket says 172.21.15.7:56512) 2024-09-21T06:36:05.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.797+0000 7fe9e3fff640 1 -- 172.21.15.7:0/1291395076 learned_addr learned my addr 172.21.15.7:0/1291395076 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:36:05.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.797+0000 7fe9e8f63640 1 --2- 172.21.15.7:0/1291395076 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559259be90a0 0x559259fc7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:05.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.797+0000 7fe9e9764640 1 --2- 172.21.15.7:0/1291395076 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559259c11f60 0x559259fd3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:05.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.797+0000 7fe9e3fff640 1 -- 172.21.15.7:0/1291395076 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559259c11f60 msgr2=0x559259fd3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:05.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.797+0000 7fe9e3fff640 1 --2- 172.21.15.7:0/1291395076 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559259c11f60 0x559259fd3a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:05.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.797+0000 7fe9e3fff640 1 -- 172.21.15.7:0/1291395076 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559259be90a0 msgr2=0x559259fc7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:05.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.797+0000 7fe9e3fff640 1 --2- 172.21.15.7:0/1291395076 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559259be90a0 0x559259fc7ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:05.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.797+0000 7fe9e3fff640 1 -- 172.21.15.7:0/1291395076 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559259ee7a00 con 0x559259bf1280 2024-09-21T06:36:05.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.797+0000 7fe9e8f63640 1 --2- 172.21.15.7:0/1291395076 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559259be90a0 0x559259fc7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:36:05.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.797+0000 7fe9e3fff640 1 --2- 172.21.15.7:0/1291395076 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559259bf1280 0x559259fc83e0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fe9d81054b0 tx=0x7fe9d8009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e156de0296fddb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:05.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.797+0000 7fe9c3fff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:36:05.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.797+0000 7fe9c3fff640 1 -- 172.21.15.7:0/1291395076 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d8049070 con 0x559259bf1280 2024-09-21T06:36:05.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.797+0000 7fe9c3fff640 1 -- 172.21.15.7:0/1291395076 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fe9d80d7240 con 0x559259bf1280 2024-09-21T06:36:05.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.797+0000 7fe9f173b740 1 -- 172.21.15.7:0/1291395076 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559259f31b60 con 0x559259bf1280 2024-09-21T06:36:05.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.798+0000 7fe9c3fff640 1 -- 172.21.15.7:0/1291395076 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fe9d80cd220 con 0x559259bf1280 2024-09-21T06:36:05.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.798+0000 7fe9f173b740 10 client.15348 fetch_fsmap learned FSMap version 24 2024-09-21T06:36:05.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.798+0000 7fe9f173b740 1 -- 172.21.15.7:0/1291395076 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x559259fd6740 con 0x559259bf1280 2024-09-21T06:36:05.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.798+0000 7fe9c3fff640 1 -- 172.21.15.7:0/1291395076 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x559259f31b60 con 0x559259bf1280 2024-09-21T06:36:05.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.798+0000 7fe9c3fff640 1 -- 172.21.15.7:0/1291395076 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fe9d80d21f0 con 0x559259bf1280 2024-09-21T06:36:05.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.798+0000 7fe9f173b740 10 client.15348 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T06:36:05.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.798+0000 7fe9f173b740 10 client.15348 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T06:36:05.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.798+0000 7fe9f173b740 20 client.15348 populate_metadata read hostname 'smithi007' 2024-09-21T06:36:05.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.798+0000 7fe9f173b740 1 --2- 172.21.15.7:0/1291395076 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x559259bd08e0 0x559259fd9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:05.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.798+0000 7fe9f173b740 4 client.15348 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:36:05.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.798+0000 7fe9f173b740 1 -- 172.21.15.7:0/1291395076 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559259f2d610 con 0x559259bd08e0 2024-09-21T06:36:05.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.798+0000 7fe9e8f63640 1 --2- 172.21.15.7:0/1291395076 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x559259bd08e0 0x559259fd9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:05.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.799+0000 7fe9e8f63640 1 --2- 172.21.15.7:0/1291395076 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x559259bd08e0 0x559259fd9eb0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c49e1611bb00afba server_cookie=3c02046760d6fd45 in_seq=0 out_seq=0 2024-09-21T06:36:05.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.799+0000 7fe9c3fff640 10 client.15348 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:36:05.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.800+0000 7fe9c3fff640 1 -- 172.21.15.7:0/1291395076 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559259f2d610 con 0x559259bd08e0 2024-09-21T06:36:05.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.800+0000 7fe9c3fff640 10 client.15348 handle_command_reply: tid=0 2024-09-21T06:36:05.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.800+0000 7fe9f173b740 1 client.15348 shutdown 2024-09-21T06:36:05.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.800+0000 7fe9f173b740 1 -- 172.21.15.7:0/1291395076 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559259bf1280 msgr2=0x559259fc83e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:05.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.800+0000 7fe9f173b740 1 --2- 172.21.15.7:0/1291395076 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559259bf1280 0x559259fc83e0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fe9d81054b0 tx=0x7fe9d8009260 comp rx=0 tx=0).stop 2024-09-21T06:36:05.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.800+0000 7fe9f173b740 1 -- 172.21.15.7:0/1291395076 shutdown_connections 2024-09-21T06:36:05.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.800+0000 7fe9f173b740 1 --2- 172.21.15.7:0/1291395076 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x559259bd08e0 0x559259fd9eb0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:05.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.800+0000 7fe9c3fff640 0 client.15348 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:36:05.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.800+0000 7fe9f173b740 1 --2- 172.21.15.7:0/1291395076 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559259c11f60 0x559259fd3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:05.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.800+0000 7fe9f173b740 1 --2- 172.21.15.7:0/1291395076 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559259bf1280 0x559259fc83e0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:05.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.800+0000 7fe9f173b740 1 --2- 172.21.15.7:0/1291395076 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559259be90a0 0x559259fc7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:05.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.800+0000 7fe9f173b740 1 -- 172.21.15.7:0/1291395076 >> 172.21.15.7:0/1291395076 conn(0x559259c06350 msgr2=0x559259fb98f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:05.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.800+0000 7fe9f173b740 1 -- 172.21.15.7:0/1291395076 shutdown_connections 2024-09-21T06:36:05.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.800+0000 7fe9f173b740 1 -- 172.21.15.7:0/1291395076 wait complete. 2024-09-21T06:36:05.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.800+0000 7fe9f173b740 20 client.15348 trim_cache size 0 max 16384 2024-09-21T06:36:05.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.818+0000 7fe9f173b740 1 Processor -- start 2024-09-21T06:36:05.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.818+0000 7fe9f173b740 1 -- start start 2024-09-21T06:36:05.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.819+0000 7fe9f173b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559259bd08e0 0x559259fc6520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:05.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.819+0000 7fe9f173b740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559259be90a0 0x559259fc6a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:05.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.819+0000 7fe9f173b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559259bf1280 0x559259fb53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:05.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.819+0000 7fe9f173b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x559259fd81f0 con 0x559259bd08e0 2024-09-21T06:36:05.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.819+0000 7fe9f173b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559259fd88c0 con 0x559259bf1280 2024-09-21T06:36:05.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.819+0000 7fe9f173b740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x559259fd8f90 con 0x559259be90a0 2024-09-21T06:36:05.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.819+0000 7fe9e8f63640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559259bd08e0 0x559259fc6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:05.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.819+0000 7fe9e8f63640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559259bd08e0 0x559259fc6520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56518/0 (socket says 172.21.15.7:56518) 2024-09-21T06:36:05.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.819+0000 7fe9e8f63640 1 -- 172.21.15.7:0/1511898956 learned_addr learned my addr 172.21.15.7:0/1511898956 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:36:05.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.819+0000 7fe9e9764640 1 --2- 172.21.15.7:0/1511898956 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559259bf1280 0x559259fb53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:05.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.819+0000 7fe9e8f63640 1 -- 172.21.15.7:0/1511898956 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559259be90a0 msgr2=0x559259fc6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:05.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.819+0000 7fe9e3fff640 1 --2- 172.21.15.7:0/1511898956 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559259be90a0 0x559259fc6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:05.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.819+0000 7fe9e8f63640 1 --2- 172.21.15.7:0/1511898956 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559259be90a0 0x559259fc6a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:05.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.819+0000 7fe9e8f63640 1 -- 172.21.15.7:0/1511898956 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559259bf1280 msgr2=0x559259fb53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:05.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.819+0000 7fe9e8f63640 1 --2- 172.21.15.7:0/1511898956 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559259bf1280 0x559259fb53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:05.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.819+0000 7fe9e8f63640 1 -- 172.21.15.7:0/1511898956 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559259fc8f60 con 0x559259bd08e0 2024-09-21T06:36:05.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.819+0000 7fe9e9764640 1 --2- 172.21.15.7:0/1511898956 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559259bf1280 0x559259fb53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:36:05.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.819+0000 7fe9e3fff640 1 --2- 172.21.15.7:0/1511898956 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559259be90a0 0x559259fc6a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:36:05.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.819+0000 7fe9e8f63640 1 --2- 172.21.15.7:0/1511898956 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559259bd08e0 0x559259fc6520 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fe9d4005780 tx=0x7fe9d4005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a3b3dd425c5628d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:05.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.820+0000 7fe9ca7fc640 1 -- 172.21.15.7:0/1511898956 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d4004030 con 0x559259bd08e0 2024-09-21T06:36:05.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.820+0000 7fe9ca7fc640 1 -- 172.21.15.7:0/1511898956 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe9d40035f0 con 0x559259bd08e0 2024-09-21T06:36:05.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.820+0000 7fe9ca7fc640 1 -- 172.21.15.7:0/1511898956 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d4012650 con 0x559259bd08e0 2024-09-21T06:36:05.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.820+0000 7fe9f173b740 1 -- 172.21.15.7:0/1511898956 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559259bd08e0 msgr2=0x559259fc6520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:05.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.820+0000 7fe9f173b740 1 --2- 172.21.15.7:0/1511898956 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559259bd08e0 0x559259fc6520 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fe9d4005780 tx=0x7fe9d4005f90 comp rx=0 tx=0).stop 2024-09-21T06:36:05.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.820+0000 7fe9f173b740 1 -- 172.21.15.7:0/1511898956 shutdown_connections 2024-09-21T06:36:05.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.820+0000 7fe9f173b740 1 --2- 172.21.15.7:0/1511898956 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559259bf1280 0x559259fb53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:05.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.820+0000 7fe9f173b740 1 --2- 172.21.15.7:0/1511898956 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559259be90a0 0x559259fc6a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:05.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.820+0000 7fe9f173b740 1 --2- 172.21.15.7:0/1511898956 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559259bd08e0 0x559259fc6520 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:05.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.820+0000 7fe9f173b740 1 -- 172.21.15.7:0/1511898956 >> 172.21.15.7:0/1511898956 conn(0x559259c06350 msgr2=0x559259fc2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:05.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.821+0000 7fe9f173b740 1 -- 172.21.15.7:0/1511898956 shutdown_connections 2024-09-21T06:36:05.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.821+0000 7fe9f173b740 1 -- 172.21.15.7:0/1511898956 wait complete. 2024-09-21T06:36:05.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.821+0000 7fe9f173b740 1 -- start start 2024-09-21T06:36:05.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.821+0000 7fe9f173b740 1 Processor -- start 2024-09-21T06:36:05.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.821+0000 7fe9f173b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559259bd08e0 0x559259fdc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:05.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.821+0000 7fe9f173b740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559259be90a0 0x559259fdca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:05.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.821+0000 7fe9f173b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559259bf1280 0x559259fe1c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:05.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.821+0000 7fe9f173b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x559259fd9d30 con 0x559259bd08e0 2024-09-21T06:36:05.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.821+0000 7fe9f173b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559259fd9660 con 0x559259bf1280 2024-09-21T06:36:05.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.821+0000 7fe9f173b740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x559259fda400 con 0x559259be90a0 2024-09-21T06:36:05.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.821+0000 7fe9f173b740 10 client.0 _ll_register_callbacks cb 0x7fe9d80b5020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:36:05.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.822+0000 7fe9e8f63640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559259bd08e0 0x559259fdc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:05.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.822+0000 7fe9e8f63640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559259bd08e0 0x559259fdc4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56530/0 (socket says 172.21.15.7:56530) 2024-09-21T06:36:05.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.822+0000 7fe9e8f63640 1 -- 172.21.15.7:0/4239704959 learned_addr learned my addr 172.21.15.7:0/4239704959 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:36:05.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.822+0000 7fe9e9764640 1 --2- 172.21.15.7:0/4239704959 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559259bf1280 0x559259fe1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:05.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.822+0000 7fe9e3fff640 1 --2- 172.21.15.7:0/4239704959 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559259be90a0 0x559259fdca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:05.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.822+0000 7fe9e8f63640 1 -- 172.21.15.7:0/4239704959 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559259be90a0 msgr2=0x559259fdca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:05.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.822+0000 7fe9e8f63640 1 --2- 172.21.15.7:0/4239704959 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559259be90a0 0x559259fdca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:05.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.822+0000 7fe9e8f63640 1 -- 172.21.15.7:0/4239704959 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559259bf1280 msgr2=0x559259fe1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:05.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.822+0000 7fe9e8f63640 1 --2- 172.21.15.7:0/4239704959 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559259bf1280 0x559259fe1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:05.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.822+0000 7fe9e8f63640 1 -- 172.21.15.7:0/4239704959 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559259fe2190 con 0x559259bd08e0 2024-09-21T06:36:05.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.822+0000 7fe9e3fff640 1 --2- 172.21.15.7:0/4239704959 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559259be90a0 0x559259fdca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:36:05.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.822+0000 7fe9e8f63640 1 --2- 172.21.15.7:0/4239704959 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559259bd08e0 0x559259fdc4c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fe9d40096e0 tx=0x7fe9d4003fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82bee72d7b7d6d4f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:05.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.822+0000 7fe9c3fff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:36:05.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.822+0000 7fe9c3fff640 1 -- 172.21.15.7:0/4239704959 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9d4004160 con 0x559259bd08e0 2024-09-21T06:36:05.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.822+0000 7fe9c3fff640 1 -- 172.21.15.7:0/4239704959 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fe9d4004300 con 0x559259bd08e0 2024-09-21T06:36:05.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.822+0000 7fe9f173b740 1 -- 172.21.15.7:0/4239704959 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe9d40035f0 con 0x559259bd08e0 2024-09-21T06:36:05.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.823+0000 7fe9c3fff640 1 -- 172.21.15.7:0/4239704959 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fe9d4005020 con 0x559259bd08e0 2024-09-21T06:36:05.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.823+0000 7fe9f173b740 10 client.15354 fetch_fsmap learned FSMap version 24 2024-09-21T06:36:05.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.823+0000 7fe9f173b740 1 -- 172.21.15.7:0/4239704959 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55925a045940 con 0x559259bd08e0 2024-09-21T06:36:05.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.823+0000 7fe9c3fff640 1 -- 172.21.15.7:0/4239704959 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe9d40035f0 con 0x559259bd08e0 2024-09-21T06:36:05.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.823+0000 7fe9c3fff640 1 -- 172.21.15.7:0/4239704959 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fe9d400f040 con 0x559259bd08e0 2024-09-21T06:36:05.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.823+0000 7fe9f173b740 10 client.15354 fetch_fsmap finished waiting for FSMap version 24 2024-09-21T06:36:05.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.823+0000 7fe9f173b740 10 client.15354 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T06:36:05.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.823+0000 7fe9f173b740 20 client.15354 populate_metadata read hostname 'smithi007' 2024-09-21T06:36:05.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.823+0000 7fe9f173b740 1 --2- 172.21.15.7:0/4239704959 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x559259c11f60 0x55925a048f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:05.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.823+0000 7fe9f173b740 4 client.15354 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T06:36:05.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.823+0000 7fe9f173b740 1 -- 172.21.15.7:0/4239704959 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "status"}) -- 0x559259f2aa40 con 0x559259c11f60 2024-09-21T06:36:05.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.823+0000 7fe9e3fff640 1 --2- 172.21.15.7:0/4239704959 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x559259c11f60 0x55925a048f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:05.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.824+0000 7fe9e3fff640 1 --2- 172.21.15.7:0/4239704959 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x559259c11f60 0x55925a048f40 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=afdf11d6fc9eeebd server_cookie=fcb711c63b078c3d in_seq=0 out_seq=0 2024-09-21T06:36:05.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.824+0000 7fe9c3fff640 10 client.15354 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:36:05.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.824+0000 7fe9c3fff640 1 -- 172.21.15.7:0/4239704959 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x559259f2aa40 con 0x559259c11f60 2024-09-21T06:36:05.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.824+0000 7fe9c3fff640 10 client.15354 handle_command_reply: tid=0 2024-09-21T06:36:05.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.824+0000 7fe9f173b740 1 client.15354 shutdown 2024-09-21T06:36:05.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.824+0000 7fe9f173b740 1 -- 172.21.15.7:0/4239704959 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559259bd08e0 msgr2=0x559259fdc4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:05.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.824+0000 7fe9f173b740 1 --2- 172.21.15.7:0/4239704959 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559259bd08e0 0x559259fdc4c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fe9d40096e0 tx=0x7fe9d4003fc0 comp rx=0 tx=0).stop 2024-09-21T06:36:05.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.824+0000 7fe9f173b740 1 -- 172.21.15.7:0/4239704959 shutdown_connections 2024-09-21T06:36:05.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.824+0000 7fe9f173b740 1 --2- 172.21.15.7:0/4239704959 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x559259c11f60 0x55925a048f40 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:05.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.824+0000 7fe9c3fff640 0 client.15354 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:36:05.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.824+0000 7fe9f173b740 1 --2- 172.21.15.7:0/4239704959 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559259bf1280 0x559259fe1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:05.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.824+0000 7fe9f173b740 1 --2- 172.21.15.7:0/4239704959 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559259be90a0 0x559259fdca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:05.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.824+0000 7fe9f173b740 1 --2- 172.21.15.7:0/4239704959 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559259bd08e0 0x559259fdc4c0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:05.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.824+0000 7fe9f173b740 1 -- 172.21.15.7:0/4239704959 >> 172.21.15.7:0/4239704959 conn(0x559259c06350 msgr2=0x559259fc7e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:05.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.824+0000 7fe9f173b740 1 -- 172.21.15.7:0/4239704959 shutdown_connections 2024-09-21T06:36:05.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.825+0000 7fe9f173b740 1 -- 172.21.15.7:0/4239704959 wait complete. 2024-09-21T06:36:05.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.825+0000 7fe9f173b740 20 client.15354 trim_cache size 0 max 16384 2024-09-21T06:36:05.831 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:36:05.831 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "347cb918-77e2-11ef-baf5-efdc52797490", 2024-09-21T06:36:05.831 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 0, 2024-09-21T06:36:05.831 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 24716, 2024-09-21T06:36:05.831 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2024-09-21T06:36:05.831 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2024-09-21T06:36:05.831 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2024-09-21T06:36:05.831 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 100.876176962, 2024-09-21T06:36:05.831 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 24, 2024-09-21T06:36:05.831 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 77, 2024-09-21T06:36:05.831 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 75, 2024-09-21T06:36:05.832 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 111.37697195600001 2024-09-21T06:36:05.832 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:36:05.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.825+0000 7fe9eb1c7640 1 -- 172.21.15.7:0/373723681 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fe9cc0b6670 msgr2=0x7fe9cc0b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:05.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.825+0000 7fe9eb1c7640 1 --2- 172.21.15.7:0/373723681 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fe9cc0b6670 0x7fe9cc0b8b80 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe9e4110790 tx=0x7fe9dc009640 comp rx=0 tx=0).stop 2024-09-21T06:36:05.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.825+0000 7fe9eb1c7640 1 -- 172.21.15.7:0/373723681 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9e4107b70 msgr2=0x7fe9e419b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:05.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.825+0000 7fe9eb1c7640 1 --2- 172.21.15.7:0/373723681 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9e4107b70 0x7fe9e419b770 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fe9d8006010 tx=0x7fe9d8004060 comp rx=0 tx=0).stop 2024-09-21T06:36:05.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.825+0000 7fe9eb1c7640 1 -- 172.21.15.7:0/373723681 shutdown_connections 2024-09-21T06:36:05.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.825+0000 7fe9eb1c7640 1 --2- 172.21.15.7:0/373723681 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fe9cc0b6670 0x7fe9cc0b8b80 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:05.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.825+0000 7fe9eb1c7640 1 --2- 172.21.15.7:0/373723681 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe9e41084c0 0x7fe9e419bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:05.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.825+0000 7fe9eb1c7640 1 --2- 172.21.15.7:0/373723681 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe9e4107b70 0x7fe9e419b770 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:05.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.825+0000 7fe9eb1c7640 1 --2- 172.21.15.7:0/373723681 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe9e4102230 0x7fe9e419b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:05.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.825+0000 7fe9eb1c7640 1 -- 172.21.15.7:0/373723681 >> 172.21.15.7:0/373723681 conn(0x7fe9e4079e40 msgr2=0x7fe9e4105c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:05.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.825+0000 7fe9eb1c7640 1 -- 172.21.15.7:0/373723681 shutdown_connections 2024-09-21T06:36:05.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:05.825+0000 7fe9eb1c7640 1 -- 172.21.15.7:0/373723681 wait complete. 2024-09-21T06:36:06.683 INFO:teuthology.run_tasks:Running task kclient... 2024-09-21T06:36:06.714 INFO:tasks.kclient:Mounting kernel clients... 2024-09-21T06:36:06.714 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-21T06:36:06.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:36:06.714 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2024-09-21T06:36:06.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:36:06.732 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link delete ceph-brx 2024-09-21T06:36:06.801 INFO:teuthology.orchestra.run.smithi007.stderr:Cannot find device "ceph-brx" 2024-09-21T06:36:06.803 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:36:06.803 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=crc', 'wsync'], 'syntax': 'v1', 'mount_subvol_num': 1} 2024-09-21T06:36:06.803 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T06:36:06.803 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T06:36:06.803 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph fs ls 2024-09-21T06:36:07.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:36:06 smithi144 ceph-mon[34653]: pgmap v316: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:36:07.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:36:06 smithi007 ceph-mon[30983]: pgmap v316: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:36:07.100 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:36:07.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:36:06 smithi018 ceph-mon[34477]: pgmap v316: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:36:07.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:07.557+0000 7f67edaa2640 1 -- 172.21.15.7:0/1279200315 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f67e8103b60 msgr2=0x7f67e8103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:07.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:07.557+0000 7f67edaa2640 1 --2- 172.21.15.7:0/1279200315 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f67e8103b60 0x7f67e8103f70 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f67d8009900 tx=0x7f67d802a410 comp rx=0 tx=0).stop 2024-09-21T06:36:07.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:07.557+0000 7f67edaa2640 1 -- 172.21.15.7:0/1279200315 shutdown_connections 2024-09-21T06:36:07.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:07.557+0000 7f67edaa2640 1 --2- 172.21.15.7:0/1279200315 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f67e8109df0 0x7f67e8110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:07.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:07.557+0000 7f67edaa2640 1 --2- 172.21.15.7:0/1279200315 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67e81094a0 0x7f67e81098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:07.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:07.557+0000 7f67edaa2640 1 --2- 172.21.15.7:0/1279200315 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f67e8103b60 0x7f67e8103f70 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:07.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:07.557+0000 7f67edaa2640 1 -- 172.21.15.7:0/1279200315 >> 172.21.15.7:0/1279200315 conn(0x7f67e807b850 msgr2=0x7f67e807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:07.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:07.557+0000 7f67edaa2640 1 -- 172.21.15.7:0/1279200315 shutdown_connections 2024-09-21T06:36:07.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:07.557+0000 7f67edaa2640 1 -- 172.21.15.7:0/1279200315 wait complete. 2024-09-21T06:36:07.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:07.558+0000 7f67edaa2640 1 Processor -- start 2024-09-21T06:36:07.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:07.558+0000 7f67edaa2640 1 -- start start 2024-09-21T06:36:07.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:07.559+0000 7f67edaa2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67e8103b60 0x7f67e819a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:07.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:07.559+0000 7f67edaa2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f67e81094a0 0x7f67e819aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:07.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:07.559+0000 7f67edaa2640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f67e8109df0 0x7f67e819fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:07.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:07.559+0000 7f67edaa2640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f67e8113ab0 con 0x7f67e81094a0 2024-09-21T06:36:07.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:07.559+0000 7f67edaa2640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f67e8113930 con 0x7f67e8103b60 2024-09-21T06:36:07.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:07.559+0000 7f67edaa2640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f67e8113c30 con 0x7f67e8109df0 2024-09-21T06:36:07.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:07.559+0000 7f67e6ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f67e81094a0 0x7f67e819aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:07.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:07.559+0000 7f67e6ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f67e81094a0 0x7f67e819aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56550/0 (socket says 172.21.15.7:56550) 2024-09-21T06:36:07.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:07.559+0000 7f67e6ffd640 1 -- 172.21.15.7:0/2984006669 learned_addr learned my addr 172.21.15.7:0/2984006669 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:36:07.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:07.559+0000 7f67e7fff640 1 --2- 172.21.15.7:0/2984006669 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f67e8109df0 0x7f67e819fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:07.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:07.559+0000 7f67e77fe640 1 --2- 172.21.15.7:0/2984006669 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67e8103b60 0x7f67e819a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:07.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:07.559+0000 7f67e6ffd640 1 -- 172.21.15.7:0/2984006669 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f67e8109df0 msgr2=0x7f67e819fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:07.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:07.559+0000 7f67e6ffd640 1 --2- 172.21.15.7:0/2984006669 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f67e8109df0 0x7f67e819fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:07.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:07.559+0000 7f67e6ffd640 1 -- 172.21.15.7:0/2984006669 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67e8103b60 msgr2=0x7f67e819a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:07.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:07.559+0000 7f67e6ffd640 1 --2- 172.21.15.7:0/2984006669 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67e8103b60 0x7f67e819a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:07.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:07.559+0000 7f67e6ffd640 1 -- 172.21.15.7:0/2984006669 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67e81a03f0 con 0x7f67e81094a0 2024-09-21T06:36:07.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:07.560+0000 7f67e6ffd640 1 --2- 172.21.15.7:0/2984006669 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f67e81094a0 0x7f67e819aa20 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f67dc00d740 tx=0x7f67dc00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:07.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:07.560+0000 7f67e4ff9640 1 -- 172.21.15.7:0/2984006669 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67dc017070 con 0x7f67e81094a0 2024-09-21T06:36:07.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:07.560+0000 7f67edaa2640 1 -- 172.21.15.7:0/2984006669 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67e81a06e0 con 0x7f67e81094a0 2024-09-21T06:36:07.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:07.560+0000 7f67e4ff9640 1 -- 172.21.15.7:0/2984006669 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f67dc00de50 con 0x7f67e81094a0 2024-09-21T06:36:07.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:07.560+0000 7f67e4ff9640 1 -- 172.21.15.7:0/2984006669 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67dc00f620 con 0x7f67e81094a0 2024-09-21T06:36:07.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:07.560+0000 7f67edaa2640 1 -- 172.21.15.7:0/2984006669 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67e80755f0 con 0x7f67e81094a0 2024-09-21T06:36:07.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:07.561+0000 7f67edaa2640 1 -- 172.21.15.7:0/2984006669 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67e8103f70 con 0x7f67e81094a0 2024-09-21T06:36:07.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:07.562+0000 7f67e4ff9640 1 -- 172.21.15.7:0/2984006669 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154579+0+0 (secure 0 0 0) 0x7f67dc01a070 con 0x7f67e81094a0 2024-09-21T06:36:07.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:07.564+0000 7f67e4ff9640 1 --2- 172.21.15.7:0/2984006669 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f67d00b65f0 0x7f67d00b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:07.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:07.564+0000 7f67e77fe640 1 --2- 172.21.15.7:0/2984006669 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f67d00b65f0 0x7f67d00b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:07.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:07.564+0000 7f67e4ff9640 1 -- 172.21.15.7:0/2984006669 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f67dc0e6f90 con 0x7f67e81094a0 2024-09-21T06:36:07.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:07.564+0000 7f67e77fe640 1 --2- 172.21.15.7:0/2984006669 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f67d00b65f0 0x7f67d00b8b00 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f67d8031440 tx=0x7f67d8005d50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:07.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:07.567+0000 7f67e4ff9640 1 -- 172.21.15.7:0/2984006669 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f67dc0ad640 con 0x7f67e81094a0 2024-09-21T06:36:07.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:07.803+0000 7f67edaa2640 1 -- 172.21.15.7:0/2984006669 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f67e819b5b0 con 0x7f67e81094a0 2024-09-21T06:36:07.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:07.803+0000 7f67e4ff9640 1 -- 172.21.15.7:0/2984006669 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v24) ==== 53+0+73 (secure 0 0 0) 0x7f67e819b5b0 con 0x7f67e81094a0 2024-09-21T06:36:07.805 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-21T06:36:07.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:07.806+0000 7f67edaa2640 1 -- 172.21.15.7:0/2984006669 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f67d00b65f0 msgr2=0x7f67d00b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:07.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:07.806+0000 7f67edaa2640 1 --2- 172.21.15.7:0/2984006669 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f67d00b65f0 0x7f67d00b8b00 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f67d8031440 tx=0x7f67d8005d50 comp rx=0 tx=0).stop 2024-09-21T06:36:07.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:07.806+0000 7f67edaa2640 1 -- 172.21.15.7:0/2984006669 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f67e81094a0 msgr2=0x7f67e819aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:07.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:07.806+0000 7f67edaa2640 1 --2- 172.21.15.7:0/2984006669 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f67e81094a0 0x7f67e819aa20 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f67dc00d740 tx=0x7f67dc00dc00 comp rx=0 tx=0).stop 2024-09-21T06:36:07.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:07.806+0000 7f67edaa2640 1 -- 172.21.15.7:0/2984006669 shutdown_connections 2024-09-21T06:36:07.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:07.806+0000 7f67edaa2640 1 --2- 172.21.15.7:0/2984006669 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f67d00b65f0 0x7f67d00b8b00 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:07.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:07.806+0000 7f67edaa2640 1 --2- 172.21.15.7:0/2984006669 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f67e8109df0 0x7f67e819fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:07.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:07.806+0000 7f67edaa2640 1 --2- 172.21.15.7:0/2984006669 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f67e81094a0 0x7f67e819aa20 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:07.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:07.806+0000 7f67edaa2640 1 --2- 172.21.15.7:0/2984006669 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67e8103b60 0x7f67e819a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:07.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:07.806+0000 7f67edaa2640 1 -- 172.21.15.7:0/2984006669 >> 172.21.15.7:0/2984006669 conn(0x7f67e807b850 msgr2=0x7f67e8107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:07.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:07.806+0000 7f67edaa2640 1 -- 172.21.15.7:0/2984006669 shutdown_connections 2024-09-21T06:36:07.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:07.806+0000 7f67edaa2640 1 -- 172.21.15.7:0/2984006669 wait complete. 2024-09-21T06:36:08.577 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-21T06:36:08.577 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T06:36:08.577 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi007.front.sepia.ceph.com 2024-09-21T06:36:08.577 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T06:36:08.577 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T06:36:08.577 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-21T06:36:08.577 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T06:36:08.577 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T06:36:08.577 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T06:36:08.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:36:08.578 DEBUG:teuthology.orchestra.run.smithi007:> ip addr 2024-09-21T06:36:08.595 INFO:teuthology.orchestra.run.smithi007.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T06:36:08.596 INFO:teuthology.orchestra.run.smithi007.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T06:36:08.596 INFO:teuthology.orchestra.run.smithi007.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T06:36:08.596 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:36:08.596 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 ::1/128 scope host 2024-09-21T06:36:08.596 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:36:08.596 INFO:teuthology.orchestra.run.smithi007.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:36:08.596 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dc brd ff:ff:ff:ff:ff:ff 2024-09-21T06:36:08.596 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f0 2024-09-21T06:36:08.596 INFO:teuthology.orchestra.run.smithi007.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:36:08.596 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dd brd ff:ff:ff:ff:ff:ff 2024-09-21T06:36:08.596 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp7s0f1 2024-09-21T06:36:08.596 INFO:teuthology.orchestra.run.smithi007.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T06:36:08.596 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:ea brd ff:ff:ff:ff:ff:ff 2024-09-21T06:36:08.597 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f0 2024-09-21T06:36:08.597 INFO:teuthology.orchestra.run.smithi007.stdout: inet 172.21.15.7/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-21T06:36:08.597 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft 42119sec preferred_lft 42119sec 2024-09-21T06:36:08.597 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::ec4:7aff:febd:15ea/64 scope link 2024-09-21T06:36:08.597 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2024-09-21T06:36:08.597 INFO:teuthology.orchestra.run.smithi007.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T06:36:08.597 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:eb brd ff:ff:ff:ff:ff:ff 2024-09-21T06:36:08.597 INFO:teuthology.orchestra.run.smithi007.stdout: altname enp1s0f1 2024-09-21T06:36:08.597 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-21T06:36:08.597 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:36:08.598 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-09-21T06:36:08.598 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link add name ceph-brx type bridge 2024-09-21T06:36:08.598 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip addr flush dev ceph-brx 2024-09-21T06:36:08.598 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set ceph-brx up 2024-09-21T06:36:08.598 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-21T06:36:08.598 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-09-21T06:36:08.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:36:08.796 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:36:08 smithi007 ceph-mon[30983]: pgmap v317: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:36:08.797 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:36:08 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2984006669' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T06:36:08.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:36:08.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:36:08.827 DEBUG:teuthology.orchestra.run.smithi007:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T06:36:08.852 INFO:teuthology.orchestra.run.smithi007.stdout:1 2024-09-21T06:36:08.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:36:08.854 DEBUG:teuthology.orchestra.run.smithi007:> route 2024-09-21T06:36:08.927 INFO:teuthology.orchestra.run.smithi007.stdout:Kernel IP routing table 2024-09-21T06:36:08.927 INFO:teuthology.orchestra.run.smithi007.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T06:36:08.927 INFO:teuthology.orchestra.run.smithi007.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-21T06:36:08.927 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-21T06:36:08.927 INFO:teuthology.orchestra.run.smithi007.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T06:36:08.928 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:36:08.928 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-09-21T06:36:08.928 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-21T06:36:08.928 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-21T06:36:08.928 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-21T06:36:08.928 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-09-21T06:36:09.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:36:09.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:36:08 smithi144 ceph-mon[34653]: pgmap v317: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:36:09.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:36:08 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/2984006669' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T06:36:09.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:36:08 smithi018 ceph-mon[34477]: pgmap v317: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:36:09.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:36:08 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/2984006669' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T06:36:09.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:36:09.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:36:09.242 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2024-09-21T06:36:09.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:36:09.258 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list-id 2024-09-21T06:36:09.314 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:36:09.314 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-09-21T06:36:09.315 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T06:36:09.315 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-21T06:36:09.315 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-09-21T06:36:09.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:36:09.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:36:09.434 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-21T06:36:09.435 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:36:09.435 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-09-21T06:36:09.435 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-21T06:36:09.435 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-21T06:36:09.435 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-21T06:36:09.435 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-21T06:36:09.435 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-21T06:36:09.435 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-09-21T06:36:09.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:36:09.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:36:09.567 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T06:36:09.567 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2024-09-21T06:36:09.567 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set brx.0 up 2024-09-21T06:36:09.567 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set dev brx.0 master ceph-brx 2024-09-21T06:36:09.567 DEBUG:teuthology.orchestra.run.smithi007:> ') 2024-09-21T06:36:09.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:36:09.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:36:09.646 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T06:36:09.646 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-21T06:36:09.662 INFO:teuthology.orchestra.run.smithi007.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-21T06:36:09.662 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T06:36:09.662 DEBUG:teuthology.orchestra.run.smithi007:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-21T06:36:09.717 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-21T06:36:09.717 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-21T06:36:09.717 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/qa/sv_1/f0400eba-4fa3-4e83-a9cc-ae7f20332bca 2024-09-21T06:36:09.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:36:09.717 DEBUG:teuthology.orchestra.run.smithi007:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/qa/sv_1/f0400eba-4fa3-4e83-a9cc-ae7f20332bca /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync 2024-09-21T06:36:09.829 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync 2024-09-21T06:36:09.829 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync". 2024-09-21T06:36:09.829 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-09-21T06:36:09.971 INFO:teuthology.orchestra.run.smithi007.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync 2024-09-21T06:36:09.971 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync". 2024-09-21T06:36:09.971 INFO:teuthology.orchestra.run.smithi007.stdout:invalid new device string format 2024-09-21T06:36:09.971 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: resolved to: "172.21.15.7:3300,172.21.15.18:3300,172.21.15.144:3300" 2024-09-21T06:36:09.971 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.7:3300,172.21.15.18:3300,172.21.15.144:3300:/volumes/qa/sv_1/f0400eba-4fa3-4e83-a9cc-ae7f20332bca 2024-09-21T06:36:09.971 INFO:teuthology.orchestra.run.smithi007.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync,key=0,fsid=347cb918-77e2-11ef-baf5-efdc52797490" will pass to kernel 2024-09-21T06:36:09.972 INFO:teuthology.orchestra.run.smithi007.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-21T06:36:09.972 INFO:teuthology.orchestra.run.smithi007.stdout: You just mounted a file system that supports labels which does not 2024-09-21T06:36:09.972 INFO:teuthology.orchestra.run.smithi007.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-21T06:36:09.972 INFO:teuthology.orchestra.run.smithi007.stdout: applications will generate AVC messages and not be allowed access to 2024-09-21T06:36:09.972 INFO:teuthology.orchestra.run.smithi007.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-21T06:36:09.974 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-21T06:36:09.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:36:09.974 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-21T06:36:10.003 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T06:36:10.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T06:36:10.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:36:10.113 INFO:teuthology.orchestra.run.smithi007.stdout:client25042 2024-09-21T06:36:10.113 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-21T06:36:10.113 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:36:10.131 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T06:36:10.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T06:36:10.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:36:10.236 INFO:teuthology.orchestra.run.smithi007.stdout:client25042 2024-09-21T06:36:10.236 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-21T06:36:10.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T06:36:10.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:36:10.302 INFO:teuthology.orchestra.run.smithi007.stdout:client25042 2024-09-21T06:36:10.303 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/347cb918-77e2-11ef-baf5-efdc52797490.client25042/status') 2024-09-21T06:36:10.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T06:36:10.369 INFO:teuthology.orchestra.run.smithi007.stdout:instance: client.25042 (3)172.21.15.7:0/3514115350 2024-09-21T06:36:10.369 INFO:teuthology.orchestra.run.smithi007.stdout:blocklisted: false 2024-09-21T06:36:10.370 INFO:teuthology.orchestra.run.smithi007.stderr:0+1 records in 2024-09-21T06:36:10.370 INFO:teuthology.orchestra.run.smithi007.stderr:0+1 records out 2024-09-21T06:36:10.370 INFO:teuthology.orchestra.run.smithi007.stderr:70 bytes copied, 2.3679e-05 s, 3.0 MB/s 2024-09-21T06:36:10.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T06:36:10.377 INFO:teuthology.run_tasks:Running task exec... 2024-09-21T06:36:10.386 INFO:teuthology.task.exec:Executing custom commands... 2024-09-21T06:36:10.386 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi007.front.sepia.ceph.com 2024-09-21T06:36:10.386 DEBUG:teuthology.orchestra.run.smithi007:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-09-21T06:36:10.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.499+0000 7ff44e09b640 1 -- 172.21.15.7:0/682740990 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff4481029d0 msgr2=0x7ff448102de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:10.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.499+0000 7ff44e09b640 1 --2- 172.21.15.7:0/682740990 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff4481029d0 0x7ff448102de0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7ff438009900 tx=0x7ff43802a410 comp rx=0 tx=0).stop 2024-09-21T06:36:10.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.499+0000 7ff44e09b640 1 -- 172.21.15.7:0/682740990 shutdown_connections 2024-09-21T06:36:10.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.499+0000 7ff44e09b640 1 --2- 172.21.15.7:0/682740990 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff448108c50 0x7ff44810f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:10.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.499+0000 7ff44e09b640 1 --2- 172.21.15.7:0/682740990 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff448108300 0x7ff448108710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:10.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.499+0000 7ff44e09b640 1 --2- 172.21.15.7:0/682740990 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff4481029d0 0x7ff448102de0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:10.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.499+0000 7ff44e09b640 1 -- 172.21.15.7:0/682740990 >> 172.21.15.7:0/682740990 conn(0x7ff44807a710 msgr2=0x7ff44807ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:10.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.499+0000 7ff44e09b640 1 -- 172.21.15.7:0/682740990 shutdown_connections 2024-09-21T06:36:10.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.499+0000 7ff44e09b640 1 -- 172.21.15.7:0/682740990 wait complete. 2024-09-21T06:36:10.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.500+0000 7ff44e09b640 1 Processor -- start 2024-09-21T06:36:10.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.500+0000 7ff44e09b640 1 -- start start 2024-09-21T06:36:10.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.500+0000 7ff44e09b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff4481029d0 0x7ff44819b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:10.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.500+0000 7ff44e09b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff448108300 0x7ff44819b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:10.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.500+0000 7ff44e09b640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff448108c50 0x7ff44819bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:10.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.500+0000 7ff44e09b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff448112960 con 0x7ff4481029d0 2024-09-21T06:36:10.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.500+0000 7ff44e09b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff4481127e0 con 0x7ff448108300 2024-09-21T06:36:10.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.500+0000 7ff44e09b640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff448112ae0 con 0x7ff448108c50 2024-09-21T06:36:10.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.500+0000 7ff4477fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff4481029d0 0x7ff44819b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:10.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.500+0000 7ff4477fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff4481029d0 0x7ff44819b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42296/0 (socket says 172.21.15.7:42296) 2024-09-21T06:36:10.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.500+0000 7ff4477fe640 1 -- 172.21.15.7:0/818145734 learned_addr learned my addr 172.21.15.7:0/818145734 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:36:10.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.500+0000 7ff446ffd640 1 --2- 172.21.15.7:0/818145734 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff448108300 0x7ff44819b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:10.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.500+0000 7ff447fff640 1 --2- 172.21.15.7:0/818145734 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff448108c50 0x7ff44819bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:10.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.501+0000 7ff4477fe640 1 -- 172.21.15.7:0/818145734 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff448108c50 msgr2=0x7ff44819bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:10.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.501+0000 7ff4477fe640 1 --2- 172.21.15.7:0/818145734 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff448108c50 0x7ff44819bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:10.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.501+0000 7ff4477fe640 1 -- 172.21.15.7:0/818145734 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff448108300 msgr2=0x7ff44819b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:10.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.501+0000 7ff4477fe640 1 --2- 172.21.15.7:0/818145734 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff448108300 0x7ff44819b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:10.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.501+0000 7ff4477fe640 1 -- 172.21.15.7:0/818145734 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4481a6490 con 0x7ff4481029d0 2024-09-21T06:36:10.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.501+0000 7ff446ffd640 1 --2- 172.21.15.7:0/818145734 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff448108300 0x7ff44819b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:36:10.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.501+0000 7ff447fff640 1 --2- 172.21.15.7:0/818145734 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff448108c50 0x7ff44819bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:36:10.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.501+0000 7ff4477fe640 1 --2- 172.21.15.7:0/818145734 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff4481029d0 0x7ff44819b1d0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ff438005ab0 tx=0x7ff438003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:10.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.501+0000 7ff444ff9640 1 -- 172.21.15.7:0/818145734 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff43803f070 con 0x7ff4481029d0 2024-09-21T06:36:10.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.501+0000 7ff444ff9640 1 -- 172.21.15.7:0/818145734 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff438031d60 con 0x7ff4481029d0 2024-09-21T06:36:10.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.501+0000 7ff44e09b640 1 -- 172.21.15.7:0/818145734 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4481a6720 con 0x7ff4481029d0 2024-09-21T06:36:10.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.501+0000 7ff444ff9640 1 -- 172.21.15.7:0/818145734 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff438035030 con 0x7ff4481029d0 2024-09-21T06:36:10.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.501+0000 7ff44e09b640 1 -- 172.21.15.7:0/818145734 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4481a6c60 con 0x7ff4481029d0 2024-09-21T06:36:10.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.502+0000 7ff44e09b640 1 -- 172.21.15.7:0/818145734 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff448102de0 con 0x7ff4481029d0 2024-09-21T06:36:10.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.504+0000 7ff444ff9640 1 -- 172.21.15.7:0/818145734 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154579+0+0 (secure 0 0 0) 0x7ff438042070 con 0x7ff4481029d0 2024-09-21T06:36:10.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.504+0000 7ff444ff9640 1 --2- 172.21.15.7:0/818145734 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7ff4300b6670 0x7ff4300b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:10.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.504+0000 7ff446ffd640 1 --2- 172.21.15.7:0/818145734 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7ff4300b6670 0x7ff4300b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:10.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.504+0000 7ff444ff9640 1 -- 172.21.15.7:0/818145734 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7ff4381084d0 con 0x7ff4481029d0 2024-09-21T06:36:10.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.505+0000 7ff446ffd640 1 --2- 172.21.15.7:0/818145734 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7ff4300b6670 0x7ff4300b8b80 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff43c0058c0 tx=0x7ff43c005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:10.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.508+0000 7ff444ff9640 1 -- 172.21.15.7:0/818145734 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff4380ceb40 con 0x7ff4481029d0 2024-09-21T06:36:10.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.735+0000 7ff44e09b640 1 -- 172.21.15.7:0/818145734 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7ff44806bd80 con 0x7ff4481029d0 2024-09-21T06:36:10.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.754+0000 7ff444ff9640 1 -- 172.21.15.7:0/818145734 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v25) ==== 117+0+0 (secure 0 0 0) 0x7ff4380d2f20 con 0x7ff4481029d0 2024-09-21T06:36:10.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.756+0000 7ff44e09b640 1 -- 172.21.15.7:0/818145734 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7ff4300b6670 msgr2=0x7ff4300b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:10.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.756+0000 7ff44e09b640 1 --2- 172.21.15.7:0/818145734 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7ff4300b6670 0x7ff4300b8b80 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7ff43c0058c0 tx=0x7ff43c005850 comp rx=0 tx=0).stop 2024-09-21T06:36:10.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.756+0000 7ff44e09b640 1 -- 172.21.15.7:0/818145734 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff4481029d0 msgr2=0x7ff44819b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:10.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.756+0000 7ff44e09b640 1 --2- 172.21.15.7:0/818145734 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff4481029d0 0x7ff44819b1d0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ff438005ab0 tx=0x7ff438003cd0 comp rx=0 tx=0).stop 2024-09-21T06:36:10.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.756+0000 7ff44e09b640 1 -- 172.21.15.7:0/818145734 shutdown_connections 2024-09-21T06:36:10.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.756+0000 7ff44e09b640 1 --2- 172.21.15.7:0/818145734 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7ff4300b6670 0x7ff4300b8b80 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:10.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.756+0000 7ff44e09b640 1 --2- 172.21.15.7:0/818145734 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff448108c50 0x7ff44819bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:10.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.756+0000 7ff44e09b640 1 --2- 172.21.15.7:0/818145734 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff448108300 0x7ff44819b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:10.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.756+0000 7ff44e09b640 1 --2- 172.21.15.7:0/818145734 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff4481029d0 0x7ff44819b1d0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:10.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.756+0000 7ff44e09b640 1 -- 172.21.15.7:0/818145734 >> 172.21.15.7:0/818145734 conn(0x7ff44807a710 msgr2=0x7ff4481012d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:10.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.756+0000 7ff44e09b640 1 -- 172.21.15.7:0/818145734 shutdown_connections 2024-09-21T06:36:10.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.756+0000 7ff44e09b640 1 -- 172.21.15.7:0/818145734 wait complete. 2024-09-21T06:36:10.770 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-21T06:36:10.780 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-09-21T06:36:10.822 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:36:10.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.934+0000 7fdd804d3640 1 -- 172.21.15.7:0/2740373822 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd781029d0 msgr2=0x7fdd78102de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:10.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.934+0000 7fdd804d3640 1 --2- 172.21.15.7:0/2740373822 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd781029d0 0x7fdd78102de0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fdd74009900 tx=0x7fdd7402a410 comp rx=0 tx=0).stop 2024-09-21T06:36:10.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.935+0000 7fdd804d3640 1 -- 172.21.15.7:0/2740373822 shutdown_connections 2024-09-21T06:36:10.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.935+0000 7fdd804d3640 1 --2- 172.21.15.7:0/2740373822 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd78108c50 0x7fdd7810f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:10.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.935+0000 7fdd804d3640 1 --2- 172.21.15.7:0/2740373822 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd78108300 0x7fdd78108710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:10.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.935+0000 7fdd804d3640 1 --2- 172.21.15.7:0/2740373822 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd781029d0 0x7fdd78102de0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:10.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.935+0000 7fdd804d3640 1 -- 172.21.15.7:0/2740373822 >> 172.21.15.7:0/2740373822 conn(0x7fdd780fe3b0 msgr2=0x7fdd78100800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:10.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.935+0000 7fdd804d3640 1 -- 172.21.15.7:0/2740373822 shutdown_connections 2024-09-21T06:36:10.937 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.935+0000 7fdd804d3640 1 -- 172.21.15.7:0/2740373822 wait complete. 2024-09-21T06:36:10.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.935+0000 7fdd804d3640 1 Processor -- start 2024-09-21T06:36:10.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.935+0000 7fdd804d3640 1 -- start start 2024-09-21T06:36:10.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.936+0000 7fdd804d3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd781029d0 0x7fdd7819b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:10.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.936+0000 7fdd804d3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd78108300 0x7fdd7819b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:10.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.936+0000 7fdd804d3640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd78108c50 0x7fdd7819bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:10.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.936+0000 7fdd804d3640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fdd78112910 con 0x7fdd78108300 2024-09-21T06:36:10.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.936+0000 7fdd804d3640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fdd78112790 con 0x7fdd781029d0 2024-09-21T06:36:10.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.936+0000 7fdd804d3640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fdd78112a90 con 0x7fdd78108c50 2024-09-21T06:36:10.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.936+0000 7fdd7da6e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd78108300 0x7fdd7819b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:10.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.936+0000 7fdd7da6e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd78108300 0x7fdd7819b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42308/0 (socket says 172.21.15.7:42308) 2024-09-21T06:36:10.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.936+0000 7fdd7da6e640 1 -- 172.21.15.7:0/1387543484 learned_addr learned my addr 172.21.15.7:0/1387543484 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:36:10.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.936+0000 7fdd7e26f640 1 --2- 172.21.15.7:0/1387543484 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd781029d0 0x7fdd7819b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:10.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.936+0000 7fdd7ea70640 1 --2- 172.21.15.7:0/1387543484 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd78108c50 0x7fdd7819bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:10.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.936+0000 7fdd7da6e640 1 -- 172.21.15.7:0/1387543484 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd78108c50 msgr2=0x7fdd7819bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:10.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.936+0000 7fdd7da6e640 1 --2- 172.21.15.7:0/1387543484 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd78108c50 0x7fdd7819bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:10.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.936+0000 7fdd7da6e640 1 -- 172.21.15.7:0/1387543484 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd781029d0 msgr2=0x7fdd7819b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:10.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.936+0000 7fdd7da6e640 1 --2- 172.21.15.7:0/1387543484 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd781029d0 0x7fdd7819b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:10.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.936+0000 7fdd7da6e640 1 -- 172.21.15.7:0/1387543484 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd781a6480 con 0x7fdd78108300 2024-09-21T06:36:10.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.936+0000 7fdd7da6e640 1 --2- 172.21.15.7:0/1387543484 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd78108300 0x7fdd7819b700 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fdd6800c970 tx=0x7fdd6800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:10.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.936+0000 7fdd6f7fe640 1 -- 172.21.15.7:0/1387543484 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd68007bb0 con 0x7fdd78108300 2024-09-21T06:36:10.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.936+0000 7fdd804d3640 1 -- 172.21.15.7:0/1387543484 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd781a6770 con 0x7fdd78108300 2024-09-21T06:36:10.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.936+0000 7fdd6f7fe640 1 -- 172.21.15.7:0/1387543484 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdd68007d50 con 0x7fdd78108300 2024-09-21T06:36:10.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.936+0000 7fdd6f7fe640 1 -- 172.21.15.7:0/1387543484 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd68004e10 con 0x7fdd78108300 2024-09-21T06:36:10.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.936+0000 7fdd804d3640 1 -- 172.21.15.7:0/1387543484 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd781a6d10 con 0x7fdd78108300 2024-09-21T06:36:10.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.937+0000 7fdd804d3640 1 -- 172.21.15.7:0/1387543484 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd78102de0 con 0x7fdd78108300 2024-09-21T06:36:10.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.939+0000 7fdd6f7fe640 1 -- 172.21.15.7:0/1387543484 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154579+0+0 (secure 0 0 0) 0x7fdd68005000 con 0x7fdd78108300 2024-09-21T06:36:10.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.940+0000 7fdd6f7fe640 1 --2- 172.21.15.7:0/1387543484 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fdd640b65f0 0x7fdd640b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:10.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.940+0000 7fdd7e26f640 1 --2- 172.21.15.7:0/1387543484 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fdd640b65f0 0x7fdd640b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:10.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.940+0000 7fdd6f7fe640 1 -- 172.21.15.7:0/1387543484 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fdd680e7690 con 0x7fdd78108300 2024-09-21T06:36:10.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.940+0000 7fdd7e26f640 1 --2- 172.21.15.7:0/1387543484 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fdd640b65f0 0x7fdd640b8b00 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fdd74000c00 tx=0x7fdd74031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:10.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:10.943+0000 7fdd6f7fe640 1 -- 172.21.15.7:0/1387543484 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdd68014030 con 0x7fdd78108300 2024-09-21T06:36:11.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:36:10 smithi144 ceph-mon[34653]: pgmap v318: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T06:36:11.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:36:10 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/818145734' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} : dispatch 2024-09-21T06:36:11.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:36:10 smithi007 ceph-mon[30983]: pgmap v318: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T06:36:11.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:36:10 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/818145734' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} : dispatch 2024-09-21T06:36:11.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:36:10 smithi018 ceph-mon[34477]: pgmap v318: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-09-21T06:36:11.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:36:10 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/818145734' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} : dispatch 2024-09-21T06:36:11.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.133+0000 7fdd804d3640 1 -- 172.21.15.7:0/1387543484 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdd7806bd60 con 0x7fdd78108300 2024-09-21T06:36:11.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.134+0000 7fdd6f7fe640 1 -- 172.21.15.7:0/1387543484 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+22791 (secure 0 0 0) 0x7fdd680b20e0 con 0x7fdd78108300 2024-09-21T06:36:11.136 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:36:11.136 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":77,"fsid":"347cb918-77e2-11ef-baf5-efdc52797490","created":"2024-09-21T06:25:51.925032+0000","modified":"2024-09-21T06:34:44.220989+0000","last_up_change":"2024-09-21T06:33:32.888843+0000","last_in_change":"2024-09-21T06:33:09.926778+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:29:41.514179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:34:20.531755+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T06:34:22.552541+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1be5c4a4-3931-4d8b-95c7-c05f5b73fcfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":942632794},{"type":"v1","addr":"172.21.15.7:6803","nonce":942632794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":942632794},{"type":"v1","addr":"172.21.15.7:6805","nonce":942632794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":942632794},{"type":"v1","addr":"172.21.15.7:6809","nonce":942632794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":942632794},{"type":"v1","addr":"172.21.15.7:6807","nonce":942632794}]},"public_addr":"172.21.15.7:6803/942632794","cluster_addr":"172.21.15.7:6805/942632794","heartbeat_back_addr":"172.21.15.7:6809/942632794","heartbeat_front_addr":"172.21.15.7:6807/942632794","state":["exists","up"]},{"osd":1,"uuid":"7ae136a8-c614-47e5-b265-c6cfa857a7fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1839342931},{"type":"v1","addr":"172.21.15.18:6801","nonce":1839342931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1839342931},{"type":"v1","addr":"172.21.15.18:6803","nonce":1839342931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1839342931},{"type":"v1","addr":"172.21.15.18:6807","nonce":1839342931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1839342931},{"type":"v1","addr":"172.21.15.18:6805","nonce":1839342931}]},"public_addr":"172.21.15.18:6801/1839342931","cluster_addr":"172.21.15.18:6803/1839342931","heartbeat_back_addr":"172.21.15.18:6807/1839342931","heartbeat_front_addr":"172.21.15.18:6805/1839342931","state":["exists","up"]},{"osd":2,"uuid":"97b13994-4680-4573-9c2e-ac65ea740e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":1699582162},{"type":"v1","addr":"172.21.15.144:6801","nonce":1699582162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":1699582162},{"type":"v1","addr":"172.21.15.144:6803","nonce":1699582162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":1699582162},{"type":"v1","addr":"172.21.15.144:6807","nonce":1699582162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":1699582162},{"type":"v1","addr":"172.21.15.144:6805","nonce":1699582162}]},"public_addr":"172.21.15.144:6801/1699582162","cluster_addr":"172.21.15.144:6803/1699582162","heartbeat_back_addr":"172.21.15.144:6807/1699582162","heartbeat_front_addr":"172.21.15.144:6805/1699582162","state":["exists","up"]},{"osd":3,"uuid":"ddf70d51-404d-491d-a6a8-15fca4ef01db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":3202935163},{"type":"v1","addr":"172.21.15.7:6811","nonce":3202935163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":3202935163},{"type":"v1","addr":"172.21.15.7:6813","nonce":3202935163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":3202935163},{"type":"v1","addr":"172.21.15.7:6817","nonce":3202935163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":3202935163},{"type":"v1","addr":"172.21.15.7:6815","nonce":3202935163}]},"public_addr":"172.21.15.7:6811/3202935163","cluster_addr":"172.21.15.7:6813/3202935163","heartbeat_back_addr":"172.21.15.7:6817/3202935163","heartbeat_front_addr":"172.21.15.7:6815/3202935163","state":["exists","up"]},{"osd":4,"uuid":"f2ae4340-accf-4ac0-a4d3-c08302712ce1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1058105724},{"type":"v1","addr":"172.21.15.18:6809","nonce":1058105724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":1058105724},{"type":"v1","addr":"172.21.15.18:6811","nonce":1058105724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":1058105724},{"type":"v1","addr":"172.21.15.18:6815","nonce":1058105724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":1058105724},{"type":"v1","addr":"172.21.15.18:6813","nonce":1058105724}]},"public_addr":"172.21.15.18:6809/1058105724","cluster_addr":"172.21.15.18:6811/1058105724","heartbeat_back_addr":"172.21.15.18:6815/1058105724","heartbeat_front_addr":"172.21.15.18:6813/1058105724","state":["exists","up"]},{"osd":5,"uuid":"d56abc37-de6f-47a4-9f5e-67224da78f4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":2814586621},{"type":"v1","addr":"172.21.15.144:6809","nonce":2814586621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":2814586621},{"type":"v1","addr":"172.21.15.144:6811","nonce":2814586621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":2814586621},{"type":"v1","addr":"172.21.15.144:6815","nonce":2814586621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":2814586621},{"type":"v1","addr":"172.21.15.144:6813","nonce":2814586621}]},"public_addr":"172.21.15.144:6809/2814586621","cluster_addr":"172.21.15.144:6811/2814586621","heartbeat_back_addr":"172.21.15.144:6815/2814586621","heartbeat_front_addr":"172.21.15.144:6813/2814586621","state":["exists","up"]},{"osd":6,"uuid":"9145650c-e9b1-4e5a-ae6f-17c8960146e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":3770978305},{"type":"v1","addr":"172.21.15.7:6819","nonce":3770978305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":3770978305},{"type":"v1","addr":"172.21.15.7:6821","nonce":3770978305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3770978305},{"type":"v1","addr":"172.21.15.7:6825","nonce":3770978305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":3770978305},{"type":"v1","addr":"172.21.15.7:6823","nonce":3770978305}]},"public_addr":"172.21.15.7:6819/3770978305","cluster_addr":"172.21.15.7:6821/3770978305","heartbeat_back_addr":"172.21.15.7:6825/3770978305","heartbeat_front_addr":"172.21.15.7:6823/3770978305","state":["exists","up"]},{"osd":7,"uuid":"ca658683-38f7-47ca-b32e-512fe4738ef1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":1322408496},{"type":"v1","addr":"172.21.15.18:6817","nonce":1322408496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1322408496},{"type":"v1","addr":"172.21.15.18:6819","nonce":1322408496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1322408496},{"type":"v1","addr":"172.21.15.18:6823","nonce":1322408496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1322408496},{"type":"v1","addr":"172.21.15.18:6821","nonce":1322408496}]},"public_addr":"172.21.15.18:6817/1322408496","cluster_addr":"172.21.15.18:6819/1322408496","heartbeat_back_addr":"172.21.15.18:6823/1322408496","heartbeat_front_addr":"172.21.15.18:6821/1322408496","state":["exists","up"]},{"osd":8,"uuid":"40d1f37e-6fac-40b9-9319-78f4fc3a6f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1011657022},{"type":"v1","addr":"172.21.15.144:6817","nonce":1011657022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1011657022},{"type":"v1","addr":"172.21.15.144:6819","nonce":1011657022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1011657022},{"type":"v1","addr":"172.21.15.144:6823","nonce":1011657022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":1011657022},{"type":"v1","addr":"172.21.15.144:6821","nonce":1011657022}]},"public_addr":"172.21.15.144:6817/1011657022","cluster_addr":"172.21.15.144:6819/1011657022","heartbeat_back_addr":"172.21.15.144:6823/1011657022","heartbeat_front_addr":"172.21.15.144:6821/1011657022","state":["exists","up"]},{"osd":9,"uuid":"ad12d6f7-fd21-49bd-a343-744f3cff4bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":256146339},{"type":"v1","addr":"172.21.15.7:6827","nonce":256146339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":256146339},{"type":"v1","addr":"172.21.15.7:6829","nonce":256146339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":256146339},{"type":"v1","addr":"172.21.15.7:6833","nonce":256146339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":256146339},{"type":"v1","addr":"172.21.15.7:6831","nonce":256146339}]},"public_addr":"172.21.15.7:6827/256146339","cluster_addr":"172.21.15.7:6829/256146339","heartbeat_back_addr":"172.21.15.7:6833/256146339","heartbeat_front_addr":"172.21.15.7:6831/256146339","state":["exists","up"]},{"osd":10,"uuid":"1317a2ad-ec15-4096-b2da-689475b7cacc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":2038885362},{"type":"v1","addr":"172.21.15.18:6825","nonce":2038885362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2038885362},{"type":"v1","addr":"172.21.15.18:6827","nonce":2038885362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2038885362},{"type":"v1","addr":"172.21.15.18:6831","nonce":2038885362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2038885362},{"type":"v1","addr":"172.21.15.18:6829","nonce":2038885362}]},"public_addr":"172.21.15.18:6825/2038885362","cluster_addr":"172.21.15.18:6827/2038885362","heartbeat_back_addr":"172.21.15.18:6831/2038885362","heartbeat_front_addr":"172.21.15.18:6829/2038885362","state":["exists","up"]},{"osd":11,"uuid":"f9252acb-7290-4923-89f3-844c868d4b39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":1047060848},{"type":"v1","addr":"172.21.15.144:6825","nonce":1047060848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":1047060848},{"type":"v1","addr":"172.21.15.144:6827","nonce":1047060848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":1047060848},{"type":"v1","addr":"172.21.15.144:6831","nonce":1047060848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":1047060848},{"type":"v1","addr":"172.21.15.144:6829","nonce":1047060848}]},"public_addr":"172.21.15.144:6825/1047060848","cluster_addr":"172.21.15.144:6827/1047060848","heartbeat_back_addr":"172.21.15.144:6831/1047060848","heartbeat_front_addr":"172.21.15.144:6829/1047060848","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:28:48.842729+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:29:13.946624+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:29:38.589666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:30:05.116339+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:30:30.562090+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:30:55.586210+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:31:22.138457+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:31:49.178090+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:32:13.687830+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:32:40.408193+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:33:06.044578+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:33:30.988851+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/1296137341":"2024-09-22T06:27:43.044484+0000","172.21.15.7:6801/3879502931":"2024-09-22T06:27:43.044484+0000","172.21.15.7:0/1926706877":"2024-09-22T06:26:40.520265+0000","172.21.15.7:0/2034370456":"2024-09-22T06:26:14.181426+0000","172.21.15.7:6801/3339522713":"2024-09-22T06:26:14.181426+0000","172.21.15.7:6800/3339522713":"2024-09-22T06:26:14.181426+0000","172.21.15.7:0/3586807770":"2024-09-22T06:26:14.181426+0000","172.21.15.7:0/1814223919":"2024-09-22T06:27:43.044484+0000","172.21.15.7:0/601150037":"2024-09-22T06:26:40.520265+0000","172.21.15.7:6800/3876787626":"2024-09-22T06:26:40.520265+0000","172.21.15.7:0/186444636":"2024-09-22T06:26:14.181426+0000","172.21.15.7:0/2180184348":"2024-09-22T06:26:40.520265+0000","172.21.15.7:6801/3876787626":"2024-09-22T06:26:40.520265+0000","172.21.15.7:0/2931793461":"2024-09-22T06:27:43.044484+0000","172.21.15.7:6800/3879502931":"2024-09-22T06:27:43.044484+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:36:11.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.136+0000 7fdd804d3640 1 -- 172.21.15.7:0/1387543484 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fdd640b65f0 msgr2=0x7fdd640b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:11.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.136+0000 7fdd804d3640 1 --2- 172.21.15.7:0/1387543484 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fdd640b65f0 0x7fdd640b8b00 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fdd74000c00 tx=0x7fdd74031400 comp rx=0 tx=0).stop 2024-09-21T06:36:11.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.136+0000 7fdd804d3640 1 -- 172.21.15.7:0/1387543484 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd78108300 msgr2=0x7fdd7819b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:11.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.136+0000 7fdd804d3640 1 --2- 172.21.15.7:0/1387543484 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd78108300 0x7fdd7819b700 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fdd6800c970 tx=0x7fdd6800ce30 comp rx=0 tx=0).stop 2024-09-21T06:36:11.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.136+0000 7fdd804d3640 1 -- 172.21.15.7:0/1387543484 shutdown_connections 2024-09-21T06:36:11.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.136+0000 7fdd804d3640 1 --2- 172.21.15.7:0/1387543484 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fdd640b65f0 0x7fdd640b8b00 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:11.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.136+0000 7fdd804d3640 1 --2- 172.21.15.7:0/1387543484 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdd78108c50 0x7fdd7819bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:11.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.136+0000 7fdd804d3640 1 --2- 172.21.15.7:0/1387543484 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdd78108300 0x7fdd7819b700 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:11.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.136+0000 7fdd804d3640 1 --2- 172.21.15.7:0/1387543484 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd781029d0 0x7fdd7819b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:11.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.136+0000 7fdd804d3640 1 -- 172.21.15.7:0/1387543484 >> 172.21.15.7:0/1387543484 conn(0x7fdd780fe3b0 msgr2=0x7fdd7806a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:11.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.136+0000 7fdd804d3640 1 -- 172.21.15.7:0/1387543484 shutdown_connections 2024-09-21T06:36:11.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.136+0000 7fdd804d3640 1 -- 172.21.15.7:0/1387543484 wait complete. 2024-09-21T06:36:11.150 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T06:29:41.514179+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-21T06:34:20.531755+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-21T06:34:22.552541+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T06:36:11.150 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T06:36:11.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.265+0000 7fe542fa8640 1 -- 172.21.15.7:0/3144965501 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe53c109550 msgr2=0x7fe53c109960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:11.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.265+0000 7fe542fa8640 1 --2- 172.21.15.7:0/3144965501 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe53c109550 0x7fe53c109960 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fe530009900 tx=0x7fe53002a410 comp rx=0 tx=0).stop 2024-09-21T06:36:11.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.265+0000 7fe542fa8640 1 -- 172.21.15.7:0/3144965501 shutdown_connections 2024-09-21T06:36:11.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.265+0000 7fe542fa8640 1 --2- 172.21.15.7:0/3144965501 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe53c109ea0 0x7fe53c1106d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:11.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.265+0000 7fe542fa8640 1 --2- 172.21.15.7:0/3144965501 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe53c109550 0x7fe53c109960 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:11.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.265+0000 7fe542fa8640 1 --2- 172.21.15.7:0/3144965501 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe53c101f10 0x7fe53c102320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:11.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.265+0000 7fe542fa8640 1 -- 172.21.15.7:0/3144965501 >> 172.21.15.7:0/3144965501 conn(0x7fe53c079d40 msgr2=0x7fe53c07a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:11.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.265+0000 7fe542fa8640 1 -- 172.21.15.7:0/3144965501 shutdown_connections 2024-09-21T06:36:11.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.265+0000 7fe542fa8640 1 -- 172.21.15.7:0/3144965501 wait complete. 2024-09-21T06:36:11.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.266+0000 7fe542fa8640 1 Processor -- start 2024-09-21T06:36:11.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.266+0000 7fe542fa8640 1 -- start start 2024-09-21T06:36:11.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.266+0000 7fe542fa8640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe53c101f10 0x7fe53c102ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:11.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.266+0000 7fe542fa8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe53c109550 0x7fe53c1033e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:11.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.266+0000 7fe542fa8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe53c109ea0 0x7fe53c103920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:11.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.266+0000 7fe542fa8640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe53c113b60 con 0x7fe53c109ea0 2024-09-21T06:36:11.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.266+0000 7fe542fa8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe53c1139e0 con 0x7fe53c109550 2024-09-21T06:36:11.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.266+0000 7fe542fa8640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe53c113ce0 con 0x7fe53c101f10 2024-09-21T06:36:11.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.266+0000 7fe541545640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe53c109ea0 0x7fe53c103920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:11.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.266+0000 7fe541545640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe53c109ea0 0x7fe53c103920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42330/0 (socket says 172.21.15.7:42330) 2024-09-21T06:36:11.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.266+0000 7fe541545640 1 -- 172.21.15.7:0/2858605407 learned_addr learned my addr 172.21.15.7:0/2858605407 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:36:11.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.266+0000 7fe53bfff640 1 --2- 172.21.15.7:0/2858605407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe53c109550 0x7fe53c1033e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:11.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.266+0000 7fe540d44640 1 --2- 172.21.15.7:0/2858605407 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe53c101f10 0x7fe53c102ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:11.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.266+0000 7fe541545640 1 -- 172.21.15.7:0/2858605407 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe53c101f10 msgr2=0x7fe53c102ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:11.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.266+0000 7fe541545640 1 --2- 172.21.15.7:0/2858605407 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe53c101f10 0x7fe53c102ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:11.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.266+0000 7fe541545640 1 -- 172.21.15.7:0/2858605407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe53c109550 msgr2=0x7fe53c1033e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:11.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.266+0000 7fe541545640 1 --2- 172.21.15.7:0/2858605407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe53c109550 0x7fe53c1033e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:11.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.266+0000 7fe541545640 1 -- 172.21.15.7:0/2858605407 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe53c1a8790 con 0x7fe53c109ea0 2024-09-21T06:36:11.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.267+0000 7fe541545640 1 --2- 172.21.15.7:0/2858605407 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe53c109ea0 0x7fe53c103920 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fe53400efd0 tx=0x7fe53400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:11.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.267+0000 7fe539ffb640 1 -- 172.21.15.7:0/2858605407 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe534003b70 con 0x7fe53c109ea0 2024-09-21T06:36:11.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.267+0000 7fe539ffb640 1 -- 172.21.15.7:0/2858605407 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe534003d10 con 0x7fe53c109ea0 2024-09-21T06:36:11.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.267+0000 7fe542fa8640 1 -- 172.21.15.7:0/2858605407 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe53c1a8a80 con 0x7fe53c109ea0 2024-09-21T06:36:11.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.267+0000 7fe539ffb640 1 -- 172.21.15.7:0/2858605407 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5340108a0 con 0x7fe53c109ea0 2024-09-21T06:36:11.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.267+0000 7fe542fa8640 1 -- 172.21.15.7:0/2858605407 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe53c1a8ff0 con 0x7fe53c109ea0 2024-09-21T06:36:11.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.268+0000 7fe542fa8640 1 -- 172.21.15.7:0/2858605407 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe53c06b800 con 0x7fe53c109ea0 2024-09-21T06:36:11.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.270+0000 7fe539ffb640 1 -- 172.21.15.7:0/2858605407 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154579+0+0 (secure 0 0 0) 0x7fe534004b40 con 0x7fe53c109ea0 2024-09-21T06:36:11.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.271+0000 7fe539ffb640 1 --2- 172.21.15.7:0/2858605407 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fe5240b66a0 0x7fe5240b8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:11.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.271+0000 7fe540d44640 1 --2- 172.21.15.7:0/2858605407 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fe5240b66a0 0x7fe5240b8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:11.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.271+0000 7fe539ffb640 1 -- 172.21.15.7:0/2858605407 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fe5340e7cf0 con 0x7fe53c109ea0 2024-09-21T06:36:11.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.271+0000 7fe540d44640 1 --2- 172.21.15.7:0/2858605407 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fe5240b66a0 0x7fe5240b8bb0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe52c005fd0 tx=0x7fe52c005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:11.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.274+0000 7fe539ffb640 1 -- 172.21.15.7:0/2858605407 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe5340ae360 con 0x7fe53c109ea0 2024-09-21T06:36:11.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.462+0000 7fe542fa8640 1 -- 172.21.15.7:0/2858605407 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe53c10b6e0 con 0x7fe53c109ea0 2024-09-21T06:36:11.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.463+0000 7fe539ffb640 1 -- 172.21.15.7:0/2858605407 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v77) ==== 93+0+10 (secure 0 0 0) 0x7fe5340b2740 con 0x7fe53c109ea0 2024-09-21T06:36:11.465 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-09-21T06:36:11.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.465+0000 7fe542fa8640 1 -- 172.21.15.7:0/2858605407 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fe5240b66a0 msgr2=0x7fe5240b8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:11.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.465+0000 7fe542fa8640 1 --2- 172.21.15.7:0/2858605407 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fe5240b66a0 0x7fe5240b8bb0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe52c005fd0 tx=0x7fe52c005850 comp rx=0 tx=0).stop 2024-09-21T06:36:11.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.465+0000 7fe542fa8640 1 -- 172.21.15.7:0/2858605407 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe53c109ea0 msgr2=0x7fe53c103920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:11.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.465+0000 7fe542fa8640 1 --2- 172.21.15.7:0/2858605407 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe53c109ea0 0x7fe53c103920 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fe53400efd0 tx=0x7fe53400c6a0 comp rx=0 tx=0).stop 2024-09-21T06:36:11.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.465+0000 7fe542fa8640 1 -- 172.21.15.7:0/2858605407 shutdown_connections 2024-09-21T06:36:11.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.465+0000 7fe542fa8640 1 --2- 172.21.15.7:0/2858605407 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fe5240b66a0 0x7fe5240b8bb0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:11.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.465+0000 7fe542fa8640 1 --2- 172.21.15.7:0/2858605407 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe53c109ea0 0x7fe53c103920 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:11.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.465+0000 7fe542fa8640 1 --2- 172.21.15.7:0/2858605407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe53c109550 0x7fe53c1033e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:11.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.465+0000 7fe542fa8640 1 --2- 172.21.15.7:0/2858605407 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe53c101f10 0x7fe53c102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:11.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.465+0000 7fe542fa8640 1 -- 172.21.15.7:0/2858605407 >> 172.21.15.7:0/2858605407 conn(0x7fe53c079d40 msgr2=0x7fe53c105560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:11.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.466+0000 7fe542fa8640 1 -- 172.21.15.7:0/2858605407 shutdown_connections 2024-09-21T06:36:11.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.466+0000 7fe542fa8640 1 -- 172.21.15.7:0/2858605407 wait complete. 2024-09-21T06:36:11.479 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-21T06:36:11.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.593+0000 7f2d4da16640 1 -- 172.21.15.7:0/2357505310 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d48108300 msgr2=0x7f2d48108710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:11.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.593+0000 7f2d4da16640 1 --2- 172.21.15.7:0/2357505310 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d48108300 0x7f2d48108710 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c009900 tx=0x7f2d3c02a410 comp rx=0 tx=0).stop 2024-09-21T06:36:11.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.593+0000 7f2d4da16640 1 -- 172.21.15.7:0/2357505310 shutdown_connections 2024-09-21T06:36:11.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.593+0000 7f2d4da16640 1 --2- 172.21.15.7:0/2357505310 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d48108c50 0x7f2d4810f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:11.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.593+0000 7f2d4da16640 1 --2- 172.21.15.7:0/2357505310 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d48108300 0x7f2d48108710 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:11.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.593+0000 7f2d4da16640 1 --2- 172.21.15.7:0/2357505310 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2d481029d0 0x7f2d48102de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:11.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.593+0000 7f2d4da16640 1 -- 172.21.15.7:0/2357505310 >> 172.21.15.7:0/2357505310 conn(0x7f2d480fe3f0 msgr2=0x7f2d48100840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:11.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.594+0000 7f2d4da16640 1 -- 172.21.15.7:0/2357505310 shutdown_connections 2024-09-21T06:36:11.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.594+0000 7f2d4da16640 1 -- 172.21.15.7:0/2357505310 wait complete. 2024-09-21T06:36:11.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.594+0000 7f2d4da16640 1 Processor -- start 2024-09-21T06:36:11.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.594+0000 7f2d4da16640 1 -- start start 2024-09-21T06:36:11.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.595+0000 7f2d4da16640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d481029d0 0x7f2d4810fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:11.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.595+0000 7f2d4da16640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d48108300 0x7f2d48110320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:11.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.595+0000 7f2d4da16640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2d48108c50 0x7f2d48110860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:11.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.595+0000 7f2d4da16640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2d48113a50 con 0x7f2d48108300 2024-09-21T06:36:11.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.595+0000 7f2d4da16640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2d481138d0 con 0x7f2d481029d0 2024-09-21T06:36:11.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.595+0000 7f2d4da16640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2d48113bd0 con 0x7f2d48108c50 2024-09-21T06:36:11.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.595+0000 7f2d467fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d48108300 0x7f2d48110320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:11.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.595+0000 7f2d467fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d48108300 0x7f2d48110320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42346/0 (socket says 172.21.15.7:42346) 2024-09-21T06:36:11.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.595+0000 7f2d467fc640 1 -- 172.21.15.7:0/3828960054 learned_addr learned my addr 172.21.15.7:0/3828960054 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:36:11.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.595+0000 7f2d477fe640 1 --2- 172.21.15.7:0/3828960054 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2d48108c50 0x7f2d48110860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:11.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.595+0000 7f2d46ffd640 1 --2- 172.21.15.7:0/3828960054 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d481029d0 0x7f2d4810fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:11.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.595+0000 7f2d467fc640 1 -- 172.21.15.7:0/3828960054 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2d48108c50 msgr2=0x7f2d48110860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:11.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.595+0000 7f2d467fc640 1 --2- 172.21.15.7:0/3828960054 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2d48108c50 0x7f2d48110860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:11.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.595+0000 7f2d467fc640 1 -- 172.21.15.7:0/3828960054 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d481029d0 msgr2=0x7f2d4810fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:11.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.595+0000 7f2d467fc640 1 --2- 172.21.15.7:0/3828960054 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d481029d0 0x7f2d4810fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:11.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.595+0000 7f2d467fc640 1 -- 172.21.15.7:0/3828960054 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d481a86c0 con 0x7f2d48108300 2024-09-21T06:36:11.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.595+0000 7f2d46ffd640 1 --2- 172.21.15.7:0/3828960054 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d481029d0 0x7f2d4810fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:36:11.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.595+0000 7f2d467fc640 1 --2- 172.21.15.7:0/3828960054 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d48108300 0x7f2d48110320 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c005ab0 tx=0x7f2d3c003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:11.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.596+0000 7f2d4ca14640 1 -- 172.21.15.7:0/3828960054 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d3c03f070 con 0x7f2d48108300 2024-09-21T06:36:11.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.596+0000 7f2d4ca14640 1 -- 172.21.15.7:0/3828960054 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2d3c031b50 con 0x7f2d48108300 2024-09-21T06:36:11.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.596+0000 7f2d4da16640 1 -- 172.21.15.7:0/3828960054 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d481a8950 con 0x7f2d48108300 2024-09-21T06:36:11.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.596+0000 7f2d4ca14640 1 -- 172.21.15.7:0/3828960054 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d3c035030 con 0x7f2d48108300 2024-09-21T06:36:11.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.596+0000 7f2d4da16640 1 -- 172.21.15.7:0/3828960054 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d481a8e40 con 0x7f2d48108300 2024-09-21T06:36:11.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.597+0000 7f2d4da16640 1 -- 172.21.15.7:0/3828960054 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d48103c40 con 0x7f2d48108300 2024-09-21T06:36:11.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.599+0000 7f2d4ca14640 1 -- 172.21.15.7:0/3828960054 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154579+0+0 (secure 0 0 0) 0x7f2d3c042070 con 0x7f2d48108300 2024-09-21T06:36:11.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.600+0000 7f2d4ca14640 1 --2- 172.21.15.7:0/3828960054 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f2d300b6620 0x7f2d300b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:11.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.600+0000 7f2d4ca14640 1 -- 172.21.15.7:0/3828960054 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f2d3c107f40 con 0x7f2d48108300 2024-09-21T06:36:11.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.600+0000 7f2d46ffd640 1 --2- 172.21.15.7:0/3828960054 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f2d300b6620 0x7f2d300b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:11.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.601+0000 7f2d46ffd640 1 --2- 172.21.15.7:0/3828960054 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f2d300b6620 0x7f2d300b8b30 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2d48111830 tx=0x7f2d38005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:11.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.604+0000 7f2d4ca14640 1 -- 172.21.15.7:0/3828960054 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2d3c0ce5f0 con 0x7f2d48108300 2024-09-21T06:36:11.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.795+0000 7f2d4da16640 1 -- 172.21.15.7:0/3828960054 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f2d4802e640 con 0x7f2d48108300 2024-09-21T06:36:11.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.795+0000 7f2d4ca14640 1 -- 172.21.15.7:0/3828960054 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v77) ==== 104+0+11 (secure 0 0 0) 0x7f2d3c0d29d0 con 0x7f2d48108300 2024-09-21T06:36:11.797 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-09-21T06:36:11.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.798+0000 7f2d4da16640 1 -- 172.21.15.7:0/3828960054 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f2d300b6620 msgr2=0x7f2d300b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:11.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.798+0000 7f2d4da16640 1 --2- 172.21.15.7:0/3828960054 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f2d300b6620 0x7f2d300b8b30 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2d48111830 tx=0x7f2d38005f90 comp rx=0 tx=0).stop 2024-09-21T06:36:11.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.798+0000 7f2d4da16640 1 -- 172.21.15.7:0/3828960054 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d48108300 msgr2=0x7f2d48110320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:11.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.798+0000 7f2d4da16640 1 --2- 172.21.15.7:0/3828960054 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d48108300 0x7f2d48110320 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c005ab0 tx=0x7f2d3c003b90 comp rx=0 tx=0).stop 2024-09-21T06:36:11.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.798+0000 7f2d4da16640 1 -- 172.21.15.7:0/3828960054 shutdown_connections 2024-09-21T06:36:11.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.798+0000 7f2d4da16640 1 --2- 172.21.15.7:0/3828960054 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f2d300b6620 0x7f2d300b8b30 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:11.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.798+0000 7f2d4da16640 1 --2- 172.21.15.7:0/3828960054 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2d48108c50 0x7f2d48110860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:11.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.798+0000 7f2d4da16640 1 --2- 172.21.15.7:0/3828960054 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d48108300 0x7f2d48110320 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:11.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.798+0000 7f2d4da16640 1 --2- 172.21.15.7:0/3828960054 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d481029d0 0x7f2d4810fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:11.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.798+0000 7f2d4da16640 1 -- 172.21.15.7:0/3828960054 >> 172.21.15.7:0/3828960054 conn(0x7f2d480fe3f0 msgr2=0x7f2d48100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:11.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.798+0000 7f2d4da16640 1 -- 172.21.15.7:0/3828960054 shutdown_connections 2024-09-21T06:36:11.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.798+0000 7f2d4da16640 1 -- 172.21.15.7:0/3828960054 wait complete. 2024-09-21T06:36:11.812 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-21T06:36:11.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.926+0000 7fc9649df640 1 -- 172.21.15.7:0/2045829352 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc96006bd60 msgr2=0x7fc96006c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:11.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.926+0000 7fc9649df640 1 --2- 172.21.15.7:0/2045829352 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc96006bd60 0x7fc96006c170 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fc950009ca0 tx=0x7fc95002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:36:11.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.926+0000 7fc9649df640 1 -- 172.21.15.7:0/2045829352 shutdown_connections 2024-09-21T06:36:11.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.926+0000 7fc9649df640 1 --2- 172.21.15.7:0/2045829352 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc960109d50 0x7fc960110560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:11.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.926+0000 7fc9649df640 1 --2- 172.21.15.7:0/2045829352 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc960109400 0x7fc960109810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:11.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.926+0000 7fc9649df640 1 --2- 172.21.15.7:0/2045829352 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc96006bd60 0x7fc96006c170 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:11.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.926+0000 7fc9649df640 1 -- 172.21.15.7:0/2045829352 >> 172.21.15.7:0/2045829352 conn(0x7fc960079570 msgr2=0x7fc960079980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:11.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.926+0000 7fc9649df640 1 -- 172.21.15.7:0/2045829352 shutdown_connections 2024-09-21T06:36:11.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.926+0000 7fc9649df640 1 -- 172.21.15.7:0/2045829352 wait complete. 2024-09-21T06:36:11.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.927+0000 7fc9649df640 1 Processor -- start 2024-09-21T06:36:11.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.927+0000 7fc9649df640 1 -- start start 2024-09-21T06:36:11.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.927+0000 7fc9649df640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc96006bd60 0x7fc96019a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:11.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.927+0000 7fc9649df640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc960109400 0x7fc96019a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:11.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.927+0000 7fc9649df640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc960109d50 0x7fc96019fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:11.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.927+0000 7fc9649df640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc960113a40 con 0x7fc960109400 2024-09-21T06:36:11.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.927+0000 7fc9649df640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc9601138c0 con 0x7fc96006bd60 2024-09-21T06:36:11.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.927+0000 7fc9649df640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc960113bc0 con 0x7fc960109d50 2024-09-21T06:36:11.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.927+0000 7fc95dd9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc960109400 0x7fc96019a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:11.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.927+0000 7fc95dd9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc960109400 0x7fc96019a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42364/0 (socket says 172.21.15.7:42364) 2024-09-21T06:36:11.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.927+0000 7fc95dd9b640 1 -- 172.21.15.7:0/205173895 learned_addr learned my addr 172.21.15.7:0/205173895 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:36:11.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.928+0000 7fc95e59c640 1 --2- 172.21.15.7:0/205173895 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc96006bd60 0x7fc96019a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:11.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.928+0000 7fc95ed9d640 1 --2- 172.21.15.7:0/205173895 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc960109d50 0x7fc96019fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:11.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.928+0000 7fc95dd9b640 1 -- 172.21.15.7:0/205173895 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc960109d50 msgr2=0x7fc96019fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:11.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.928+0000 7fc95dd9b640 1 --2- 172.21.15.7:0/205173895 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc960109d50 0x7fc96019fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:11.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.928+0000 7fc95dd9b640 1 -- 172.21.15.7:0/205173895 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc96006bd60 msgr2=0x7fc96019a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:11.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.928+0000 7fc95dd9b640 1 --2- 172.21.15.7:0/205173895 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc96006bd60 0x7fc96019a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:11.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.928+0000 7fc95dd9b640 1 -- 172.21.15.7:0/205173895 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9601a0330 con 0x7fc960109400 2024-09-21T06:36:11.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.928+0000 7fc95dd9b640 1 --2- 172.21.15.7:0/205173895 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc960109400 0x7fc96019a9a0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fc95400e9f0 tx=0x7fc95400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:11.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.928+0000 7fc94f7fe640 1 -- 172.21.15.7:0/205173895 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc95400ccc0 con 0x7fc960109400 2024-09-21T06:36:11.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.928+0000 7fc9649df640 1 -- 172.21.15.7:0/205173895 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9601a0620 con 0x7fc960109400 2024-09-21T06:36:11.932 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.928+0000 7fc94f7fe640 1 -- 172.21.15.7:0/205173895 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9540054d0 con 0x7fc960109400 2024-09-21T06:36:11.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.928+0000 7fc94f7fe640 1 -- 172.21.15.7:0/205173895 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc954010430 con 0x7fc960109400 2024-09-21T06:36:11.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.928+0000 7fc9649df640 1 -- 172.21.15.7:0/205173895 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9601a6db0 con 0x7fc960109400 2024-09-21T06:36:11.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.929+0000 7fc9649df640 1 -- 172.21.15.7:0/205173895 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc96006c170 con 0x7fc960109400 2024-09-21T06:36:11.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.931+0000 7fc94f7fe640 1 -- 172.21.15.7:0/205173895 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154579+0+0 (secure 0 0 0) 0x7fc9540046c0 con 0x7fc960109400 2024-09-21T06:36:11.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.931+0000 7fc94f7fe640 1 --2- 172.21.15.7:0/205173895 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fc9480b65f0 0x7fc9480b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:11.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.932+0000 7fc95e59c640 1 --2- 172.21.15.7:0/205173895 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fc9480b65f0 0x7fc9480b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:11.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.932+0000 7fc94f7fe640 1 -- 172.21.15.7:0/205173895 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fc9540e7b90 con 0x7fc960109400 2024-09-21T06:36:11.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.932+0000 7fc95e59c640 1 --2- 172.21.15.7:0/205173895 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fc9480b65f0 0x7fc9480b8b00 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc950006010 tx=0x7fc950009820 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:11.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:11.935+0000 7fc94f7fe640 1 -- 172.21.15.7:0/205173895 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc954056710 con 0x7fc960109400 2024-09-21T06:36:12.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:36:11 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/818145734' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-21T06:36:12.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:36:11 smithi144 ceph-mon[34653]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:36:12.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:36:11 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/1387543484' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:36:12.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:36:11 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/2858605407' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T06:36:12.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:36:11 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/818145734' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-21T06:36:12.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:36:11 smithi007 ceph-mon[30983]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:36:12.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:36:11 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/1387543484' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:36:12.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:36:11 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2858605407' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T06:36:12.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:36:11 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/818145734' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-21T06:36:12.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:36:11 smithi018 ceph-mon[34477]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2024-09-21T06:36:12.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:36:11 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/1387543484' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:36:12.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:36:11 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/2858605407' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T06:36:12.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:12.124+0000 7fc9649df640 1 -- 172.21.15.7:0/205173895 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fc96002e640 con 0x7fc960109400 2024-09-21T06:36:12.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:12.124+0000 7fc94f7fe640 1 -- 172.21.15.7:0/205173895 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v77) ==== 100+0+11 (secure 0 0 0) 0x7fc9540ae240 con 0x7fc960109400 2024-09-21T06:36:12.126 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2024-09-21T06:36:12.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:12.127+0000 7fc9649df640 1 -- 172.21.15.7:0/205173895 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fc9480b65f0 msgr2=0x7fc9480b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:12.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:12.127+0000 7fc9649df640 1 --2- 172.21.15.7:0/205173895 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fc9480b65f0 0x7fc9480b8b00 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc950006010 tx=0x7fc950009820 comp rx=0 tx=0).stop 2024-09-21T06:36:12.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:12.127+0000 7fc9649df640 1 -- 172.21.15.7:0/205173895 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc960109400 msgr2=0x7fc96019a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:12.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:12.127+0000 7fc9649df640 1 --2- 172.21.15.7:0/205173895 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc960109400 0x7fc96019a9a0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fc95400e9f0 tx=0x7fc95400eeb0 comp rx=0 tx=0).stop 2024-09-21T06:36:12.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:12.127+0000 7fc9649df640 1 -- 172.21.15.7:0/205173895 shutdown_connections 2024-09-21T06:36:12.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:12.127+0000 7fc9649df640 1 --2- 172.21.15.7:0/205173895 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fc9480b65f0 0x7fc9480b8b00 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:12.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:12.127+0000 7fc9649df640 1 --2- 172.21.15.7:0/205173895 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc960109d50 0x7fc96019fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:12.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:12.127+0000 7fc9649df640 1 --2- 172.21.15.7:0/205173895 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc960109400 0x7fc96019a9a0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:12.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:12.127+0000 7fc9649df640 1 --2- 172.21.15.7:0/205173895 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc96006bd60 0x7fc96019a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:12.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:12.127+0000 7fc9649df640 1 -- 172.21.15.7:0/205173895 >> 172.21.15.7:0/205173895 conn(0x7fc960079570 msgr2=0x7fc960107430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:12.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:12.127+0000 7fc9649df640 1 -- 172.21.15.7:0/205173895 shutdown_connections 2024-09-21T06:36:12.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:12.127+0000 7fc9649df640 1 -- 172.21.15.7:0/205173895 wait complete. 2024-09-21T06:36:12.140 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-09-21T06:36:12.140 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:36:12.400 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:36:12.810 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:36:12 smithi007 ceph-mon[30983]: pgmap v319: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:36:12.810 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:36:12 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/3828960054' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T06:36:12.810 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:36:12 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/205173895' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T06:36:12.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:12.902+0000 7f2511cb3640 1 -- 172.21.15.7:0/1077967369 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f250c1094a0 msgr2=0x7f250c1098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:12.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:12.902+0000 7f2511cb3640 1 --2- 172.21.15.7:0/1077967369 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f250c1094a0 0x7f250c1098b0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f2500009900 tx=0x7f250002a410 comp rx=0 tx=0).stop 2024-09-21T06:36:12.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:12.902+0000 7f2511cb3640 1 -- 172.21.15.7:0/1077967369 shutdown_connections 2024-09-21T06:36:12.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:12.902+0000 7f2511cb3640 1 --2- 172.21.15.7:0/1077967369 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f250c109df0 0x7f250c110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:12.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:12.902+0000 7f2511cb3640 1 --2- 172.21.15.7:0/1077967369 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f250c1094a0 0x7f250c1098b0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:12.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:12.902+0000 7f2511cb3640 1 --2- 172.21.15.7:0/1077967369 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f250c103b60 0x7f250c103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:12.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:12.902+0000 7f2511cb3640 1 -- 172.21.15.7:0/1077967369 >> 172.21.15.7:0/1077967369 conn(0x7f250c07b850 msgr2=0x7f250c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:12.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:12.902+0000 7f2511cb3640 1 -- 172.21.15.7:0/1077967369 shutdown_connections 2024-09-21T06:36:12.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:12.902+0000 7f2511cb3640 1 -- 172.21.15.7:0/1077967369 wait complete. 2024-09-21T06:36:12.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:12.902+0000 7f2511cb3640 1 Processor -- start 2024-09-21T06:36:12.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:12.903+0000 7f2511cb3640 1 -- start start 2024-09-21T06:36:12.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:12.903+0000 7f2511cb3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f250c103b60 0x7f250c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:12.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:12.903+0000 7f2511cb3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f250c1094a0 0x7f250c075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:12.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:12.903+0000 7f2511cb3640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f250c109df0 0x7f250c076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:12.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:12.903+0000 7f2511cb3640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f250c113b00 con 0x7f250c103b60 2024-09-21T06:36:12.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:12.903+0000 7f2511cb3640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f250c113980 con 0x7f250c1094a0 2024-09-21T06:36:12.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:12.903+0000 7f2511cb3640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f250c113c80 con 0x7f250c109df0 2024-09-21T06:36:12.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:12.903+0000 7f250b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f250c103b60 0x7f250c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:12.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:12.903+0000 7f250b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f250c103b60 0x7f250c075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42378/0 (socket says 172.21.15.7:42378) 2024-09-21T06:36:12.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:12.903+0000 7f250b7fe640 1 -- 172.21.15.7:0/4036710959 learned_addr learned my addr 172.21.15.7:0/4036710959 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:36:12.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:12.903+0000 7f250affd640 1 --2- 172.21.15.7:0/4036710959 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f250c1094a0 0x7f250c075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:12.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:12.903+0000 7f250bfff640 1 --2- 172.21.15.7:0/4036710959 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f250c109df0 0x7f250c076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:12.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:12.903+0000 7f250b7fe640 1 -- 172.21.15.7:0/4036710959 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f250c109df0 msgr2=0x7f250c076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:12.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:12.903+0000 7f250b7fe640 1 --2- 172.21.15.7:0/4036710959 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f250c109df0 0x7f250c076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:12.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:12.903+0000 7f250b7fe640 1 -- 172.21.15.7:0/4036710959 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f250c1094a0 msgr2=0x7f250c075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:12.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:12.903+0000 7f250b7fe640 1 --2- 172.21.15.7:0/4036710959 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f250c1094a0 0x7f250c075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:12.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:12.903+0000 7f250b7fe640 1 -- 172.21.15.7:0/4036710959 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f250c1a8770 con 0x7f250c103b60 2024-09-21T06:36:12.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:12.903+0000 7f250bfff640 1 --2- 172.21.15.7:0/4036710959 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f250c109df0 0x7f250c076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:36:12.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:12.904+0000 7f250b7fe640 1 --2- 172.21.15.7:0/4036710959 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f250c103b60 0x7f250c075710 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f24fc00d950 tx=0x7f24fc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:12.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:12.904+0000 7f2508ff9640 1 -- 172.21.15.7:0/4036710959 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24fc017030 con 0x7f250c103b60 2024-09-21T06:36:12.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:12.904+0000 7f2511cb3640 1 -- 172.21.15.7:0/4036710959 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f250c1a8a60 con 0x7f250c103b60 2024-09-21T06:36:12.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:12.904+0000 7f2508ff9640 1 -- 172.21.15.7:0/4036710959 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f24fc004020 con 0x7f250c103b60 2024-09-21T06:36:12.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:12.904+0000 7f2508ff9640 1 -- 172.21.15.7:0/4036710959 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24fc0047a0 con 0x7f250c103b60 2024-09-21T06:36:12.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:12.904+0000 7f2511cb3640 1 -- 172.21.15.7:0/4036710959 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f250c1a8f70 con 0x7f250c103b60 2024-09-21T06:36:12.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:12.905+0000 7f2511cb3640 1 -- 172.21.15.7:0/4036710959 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f250c103f70 con 0x7f250c103b60 2024-09-21T06:36:12.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:12.906+0000 7f2508ff9640 1 -- 172.21.15.7:0/4036710959 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154579+0+0 (secure 0 0 0) 0x7f24fc009a30 con 0x7f250c103b60 2024-09-21T06:36:12.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:12.908+0000 7f2508ff9640 1 --2- 172.21.15.7:0/4036710959 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f24f40b65f0 0x7f24f40b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:12.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:12.908+0000 7f250affd640 1 --2- 172.21.15.7:0/4036710959 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f24f40b65f0 0x7f24f40b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:12.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:12.908+0000 7f2508ff9640 1 -- 172.21.15.7:0/4036710959 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f24fc0e76b0 con 0x7f250c103b60 2024-09-21T06:36:12.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:12.908+0000 7f250affd640 1 --2- 172.21.15.7:0/4036710959 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f24f40b65f0 0x7f24f40b8b00 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f250002aa00 tx=0x7f2500005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:12.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:12.911+0000 7f2508ff9640 1 -- 172.21.15.7:0/4036710959 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f24fc0add60 con 0x7f250c103b60 2024-09-21T06:36:13.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:36:12 smithi144 ceph-mon[34653]: pgmap v319: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:36:13.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:36:12 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/3828960054' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T06:36:13.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:36:12 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/205173895' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T06:36:13.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:36:12 smithi018 ceph-mon[34477]: pgmap v319: 97 pgs: 97 active+clean; 643 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:36:13.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:36:12 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/3828960054' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T06:36:13.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:36:12 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/205173895' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T06:36:13.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:13.139+0000 7f2511cb3640 1 -- 172.21.15.7:0/4036710959 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f250c076a10 con 0x7f250c103b60 2024-09-21T06:36:13.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:13.140+0000 7f2508ff9640 1 -- 172.21.15.7:0/4036710959 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11899 (secure 0 0 0) 0x7f250c076a10 con 0x7f250c103b60 2024-09-21T06:36:13.142 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:36:13.143 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-21T06:36:10:753693+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2015971546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2015971546},{"type":"v1","addr":"172.21.15.7:6835","nonce":2015971546}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/2350816224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":2350816224},{"type":"v1","addr":"172.21.15.7:6837","nonce":2350816224}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14823,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/1669980572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":1669980572},{"type":"v1","addr":"172.21.15.7:6839","nonce":1669980572}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14835,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/2528308973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":2528308973},{"type":"v1","addr":"172.21.15.7:6841","nonce":2528308973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24623,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1337382979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1337382979},{"type":"v1","addr":"172.21.15.18:6833","nonce":1337382979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/2751454345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":2751454345},{"type":"v1","addr":"172.21.15.144:6833","nonce":2751454345}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:34:24.627168+0000","modified":"2024-09-21T06:36:10.737288+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24716,"mds_1":24688,"mds_2":24686},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24656":{"gid":24656,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6835/158884796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":158884796},{"type":"v1","addr":"172.21.15.18:6835","nonce":158884796}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6835/3636739922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3636739922},{"type":"v1","addr":"172.21.15.144:6835","nonce":3636739922}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24673":{"gid":24673,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6837/1126341753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":1126341753},{"type":"v1","addr":"172.21.15.144:6837","nonce":1126341753}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.18:6837/1539670694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1539670694},{"type":"v1","addr":"172.21.15.18:6837","nonce":1539670694}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24688":{"gid":24688,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.144:6839/4027821922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":4027821922},{"type":"v1","addr":"172.21.15.144:6839","nonce":4027821922}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24716":{"gid":24716,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.18:6839/3798713532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":3798713532},{"type":"v1","addr":"172.21.15.18:6839","nonce":3798713532}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24716,"qdb_cluster":[24716,24688,24686]},"id":1}]} 2024-09-21T06:36:13.143 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-21T06:36:13.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:13.142+0000 7f2511cb3640 1 -- 172.21.15.7:0/4036710959 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f24f40b65f0 msgr2=0x7f24f40b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:13.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:13.142+0000 7f2511cb3640 1 --2- 172.21.15.7:0/4036710959 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f24f40b65f0 0x7f24f40b8b00 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f250002aa00 tx=0x7f2500005a20 comp rx=0 tx=0).stop 2024-09-21T06:36:13.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:13.142+0000 7f2511cb3640 1 -- 172.21.15.7:0/4036710959 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f250c103b60 msgr2=0x7f250c075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:13.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:13.142+0000 7f2511cb3640 1 --2- 172.21.15.7:0/4036710959 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f250c103b60 0x7f250c075710 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f24fc00d950 tx=0x7f24fc00de10 comp rx=0 tx=0).stop 2024-09-21T06:36:13.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:13.142+0000 7f2511cb3640 1 -- 172.21.15.7:0/4036710959 shutdown_connections 2024-09-21T06:36:13.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:13.142+0000 7f2511cb3640 1 --2- 172.21.15.7:0/4036710959 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f24f40b65f0 0x7f24f40b8b00 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:13.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:13.142+0000 7f2511cb3640 1 --2- 172.21.15.7:0/4036710959 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f250c109df0 0x7f250c076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:13.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:13.142+0000 7f2511cb3640 1 --2- 172.21.15.7:0/4036710959 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f250c1094a0 0x7f250c075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:13.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:13.142+0000 7f2511cb3640 1 --2- 172.21.15.7:0/4036710959 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f250c103b60 0x7f250c075710 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:13.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:13.142+0000 7f2511cb3640 1 -- 172.21.15.7:0/4036710959 >> 172.21.15.7:0/4036710959 conn(0x7f250c07b850 msgr2=0x7f250c107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:13.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:13.142+0000 7f2511cb3640 1 -- 172.21.15.7:0/4036710959 shutdown_connections 2024-09-21T06:36:13.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:13.142+0000 7f2511cb3640 1 -- 172.21.15.7:0/4036710959 wait complete. 2024-09-21T06:36:13.839 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:36:13 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/4036710959' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:36:13.987 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-09-21T06:36:13.987 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-09-21T06:36:13.987 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T06:36:14.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:36:13 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/4036710959' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:36:14.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.101+0000 7f9aa4470640 1 -- 172.21.15.7:0/450259069 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a9c108c60 msgr2=0x7f9a9c10f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:14.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.101+0000 7f9aa4470640 1 --2- 172.21.15.7:0/450259069 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a9c108c60 0x7f9a9c10f490 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f9a94009ca0 tx=0x7f9a9402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:36:14.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.102+0000 7f9aa4470640 1 -- 172.21.15.7:0/450259069 shutdown_connections 2024-09-21T06:36:14.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.102+0000 7f9aa4470640 1 --2- 172.21.15.7:0/450259069 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a9c108c60 0x7f9a9c10f490 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:14.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.102+0000 7f9aa4470640 1 --2- 172.21.15.7:0/450259069 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a9c108310 0x7f9a9c108720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:14.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.102+0000 7f9aa4470640 1 --2- 172.21.15.7:0/450259069 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9a9c103150 0x7f9a9c103560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:14.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.102+0000 7f9aa4470640 1 -- 172.21.15.7:0/450259069 >> 172.21.15.7:0/450259069 conn(0x7f9a9c079e70 msgr2=0x7f9a9c07a280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:14.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.102+0000 7f9aa4470640 1 -- 172.21.15.7:0/450259069 shutdown_connections 2024-09-21T06:36:14.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.102+0000 7f9aa4470640 1 -- 172.21.15.7:0/450259069 wait complete. 2024-09-21T06:36:14.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.102+0000 7f9aa4470640 1 Processor -- start 2024-09-21T06:36:14.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.102+0000 7f9aa4470640 1 -- start start 2024-09-21T06:36:14.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.103+0000 7f9aa4470640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a9c103150 0x7f9a9c19b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:14.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.103+0000 7f9aa4470640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9a9c108310 0x7f9a9c19b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:14.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.103+0000 7f9aa4470640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a9c108c60 0x7f9a9c19bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:14.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.103+0000 7f9aa4470640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9a9c112920 con 0x7f9a9c108c60 2024-09-21T06:36:14.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.103+0000 7f9aa4470640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9a9c1127a0 con 0x7f9a9c103150 2024-09-21T06:36:14.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.103+0000 7f9aa4470640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9a9c112aa0 con 0x7f9a9c108310 2024-09-21T06:36:14.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.103+0000 7f9aa2a0d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a9c108c60 0x7f9a9c19bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:14.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.103+0000 7f9aa2a0d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a9c108c60 0x7f9a9c19bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42400/0 (socket says 172.21.15.7:42400) 2024-09-21T06:36:14.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.103+0000 7f9aa2a0d640 1 -- 172.21.15.7:0/793170437 learned_addr learned my addr 172.21.15.7:0/793170437 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:36:14.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.103+0000 7f9aa220c640 1 --2- 172.21.15.7:0/793170437 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a9c103150 0x7f9a9c19b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:14.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.103+0000 7f9aa1a0b640 1 --2- 172.21.15.7:0/793170437 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9a9c108310 0x7f9a9c19b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:14.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.103+0000 7f9aa2a0d640 1 -- 172.21.15.7:0/793170437 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9a9c108310 msgr2=0x7f9a9c19b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:14.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.103+0000 7f9aa2a0d640 1 --2- 172.21.15.7:0/793170437 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9a9c108310 0x7f9a9c19b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:14.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.103+0000 7f9aa2a0d640 1 -- 172.21.15.7:0/793170437 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a9c103150 msgr2=0x7f9a9c19b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:14.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.103+0000 7f9aa2a0d640 1 --2- 172.21.15.7:0/793170437 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a9c103150 0x7f9a9c19b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:14.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.103+0000 7f9aa2a0d640 1 -- 172.21.15.7:0/793170437 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a9c1a6520 con 0x7f9a9c108c60 2024-09-21T06:36:14.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.103+0000 7f9aa2a0d640 1 --2- 172.21.15.7:0/793170437 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a9c108c60 0x7f9a9c19bd10 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f9a94005cc0 tx=0x7f9a94031700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:14.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.103+0000 7f9a937fe640 1 -- 172.21.15.7:0/793170437 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a94003b70 con 0x7f9a9c108c60 2024-09-21T06:36:14.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.103+0000 7f9a937fe640 1 -- 172.21.15.7:0/793170437 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9a940318f0 con 0x7f9a9c108c60 2024-09-21T06:36:14.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.104+0000 7f9aa4470640 1 -- 172.21.15.7:0/793170437 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a9c1a67b0 con 0x7f9a9c108c60 2024-09-21T06:36:14.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.104+0000 7f9a937fe640 1 -- 172.21.15.7:0/793170437 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a9402f950 con 0x7f9a9c108c60 2024-09-21T06:36:14.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.104+0000 7f9aa4470640 1 -- 172.21.15.7:0/793170437 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a9c1a6d00 con 0x7f9a9c108c60 2024-09-21T06:36:14.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.105+0000 7f9aa4470640 1 -- 172.21.15.7:0/793170437 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a9c103560 con 0x7f9a9c108c60 2024-09-21T06:36:14.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.106+0000 7f9a937fe640 1 -- 172.21.15.7:0/793170437 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154579+0+0 (secure 0 0 0) 0x7f9a9402fb30 con 0x7f9a9c108c60 2024-09-21T06:36:14.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.107+0000 7f9a937fe640 1 --2- 172.21.15.7:0/793170437 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f9a880b65f0 0x7f9a880b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:14.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.107+0000 7f9aa220c640 1 --2- 172.21.15.7:0/793170437 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f9a880b65f0 0x7f9a880b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:14.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.107+0000 7f9a937fe640 1 -- 172.21.15.7:0/793170437 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f9a94108840 con 0x7f9a9c108c60 2024-09-21T06:36:14.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.108+0000 7f9aa220c640 1 --2- 172.21.15.7:0/793170437 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f9a880b65f0 0x7f9a880b8b00 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c102900 tx=0x7f9a98005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:14.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.110+0000 7f9a937fe640 1 -- 172.21.15.7:0/793170437 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9a940ceeb0 con 0x7f9a9c108c60 2024-09-21T06:36:14.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:36:13 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/4036710959' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:36:14.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.313+0000 7f9aa4470640 1 -- 172.21.15.7:0/793170437 --> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9a9c063800 con 0x7f9a880b65f0 2024-09-21T06:36:14.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.318+0000 7f9a937fe640 1 -- 172.21.15.7:0/793170437 <== mgr.14223 v2:172.21.15.7:6800/3442812985 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258962 (secure 0 0 0) 0x7f9a9c063800 con 0x7f9a880b65f0 2024-09-21T06:36:14.323 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:36:14.324 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-09-21T06:36:14.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.322+0000 7f9aa4470640 1 -- 172.21.15.7:0/793170437 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f9a880b65f0 msgr2=0x7f9a880b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:14.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.322+0000 7f9aa4470640 1 --2- 172.21.15.7:0/793170437 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f9a880b65f0 0x7f9a880b8b00 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c102900 tx=0x7f9a98005f90 comp rx=0 tx=0).stop 2024-09-21T06:36:14.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.322+0000 7f9aa4470640 1 -- 172.21.15.7:0/793170437 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a9c108c60 msgr2=0x7f9a9c19bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:14.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.322+0000 7f9aa4470640 1 --2- 172.21.15.7:0/793170437 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a9c108c60 0x7f9a9c19bd10 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f9a94005cc0 tx=0x7f9a94031700 comp rx=0 tx=0).stop 2024-09-21T06:36:14.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.322+0000 7f9aa4470640 1 -- 172.21.15.7:0/793170437 shutdown_connections 2024-09-21T06:36:14.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.322+0000 7f9aa4470640 1 --2- 172.21.15.7:0/793170437 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f9a880b65f0 0x7f9a880b8b00 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:14.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.322+0000 7f9aa4470640 1 --2- 172.21.15.7:0/793170437 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a9c108c60 0x7f9a9c19bd10 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:14.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.322+0000 7f9aa4470640 1 --2- 172.21.15.7:0/793170437 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9a9c108310 0x7f9a9c19b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:14.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.322+0000 7f9aa4470640 1 --2- 172.21.15.7:0/793170437 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a9c103150 0x7f9a9c19b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:14.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.322+0000 7f9aa4470640 1 -- 172.21.15.7:0/793170437 >> 172.21.15.7:0/793170437 conn(0x7f9a9c079e70 msgr2=0x7f9a9c104280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:14.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.322+0000 7f9aa4470640 1 -- 172.21.15.7:0/793170437 shutdown_connections 2024-09-21T06:36:14.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.322+0000 7f9aa4470640 1 -- 172.21.15.7:0/793170437 wait complete. 2024-09-21T06:36:14.336 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":320,"stamp":"2024-09-21T06:36:13.162038+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659204,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":701,"num_read_kb":450,"num_write":289,"num_write_kb":2269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":2951840,"num_keys_recovered":11,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":234,"ondisk_log_size":234,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":367936,"kb_used_data":10332,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124573888,"statfs":{"total":1151940427776,"available":1151563661312,"internally_reserved":0,"allocated":10579968,"data_stored":6976440,"data_compressed":177384,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":19143,"internal_metadata":365933881},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":308,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":41,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002824"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.225546+0000","last_change":"2024-09-21T06:34:23.958146+0000","last_active":"2024-09-21T06:34:44.225546+0000","last_peered":"2024-09-21T06:34:44.225546+0000","last_clean":"2024-09-21T06:34:44.225546+0000","last_became_active":"2024-09-21T06:34:23.957580+0000","last_became_peered":"2024-09-21T06:34:23.957580+0000","last_unstale":"2024-09-21T06:34:44.225546+0000","last_undegraded":"2024-09-21T06:34:44.225546+0000","last_fullsized":"2024-09-21T06:34:44.225546+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:33:05.975310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265758+0000","last_change":"2024-09-21T06:34:23.948439+0000","last_active":"2024-09-21T06:34:44.265758+0000","last_peered":"2024-09-21T06:34:44.265758+0000","last_clean":"2024-09-21T06:34:44.265758+0000","last_became_active":"2024-09-21T06:34:23.947511+0000","last_became_peered":"2024-09-21T06:34:23.947511+0000","last_unstale":"2024-09-21T06:34:44.265758+0000","last_undegraded":"2024-09-21T06:34:44.265758+0000","last_fullsized":"2024-09-21T06:34:44.265758+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:13:53.589979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.264949+0000","last_change":"2024-09-21T06:34:23.950752+0000","last_active":"2024-09-21T06:34:44.264949+0000","last_peered":"2024-09-21T06:34:44.264949+0000","last_clean":"2024-09-21T06:34:44.264949+0000","last_became_active":"2024-09-21T06:34:23.950373+0000","last_became_peered":"2024-09-21T06:34:23.950373+0000","last_unstale":"2024-09-21T06:34:44.264949+0000","last_undegraded":"2024-09-21T06:34:44.264949+0000","last_fullsized":"2024-09-21T06:34:44.264949+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:01:29.183426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.267740+0000","last_change":"2024-09-21T06:34:44.267265+0000","last_active":"2024-09-21T06:34:44.267740+0000","last_peered":"2024-09-21T06:34:44.267740+0000","last_clean":"2024-09-21T06:34:44.267740+0000","last_became_active":"2024-09-21T06:34:44.266829+0000","last_became_peered":"2024-09-21T06:34:44.266829+0000","last_unstale":"2024-09-21T06:34:44.267740+0000","last_undegraded":"2024-09-21T06:34:44.267740+0000","last_fullsized":"2024-09-21T06:34:44.267740+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:47:57.873167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.229953+0000","last_change":"2024-09-21T06:34:23.947578+0000","last_active":"2024-09-21T06:34:44.229953+0000","last_peered":"2024-09-21T06:34:44.229953+0000","last_clean":"2024-09-21T06:34:44.229953+0000","last_became_active":"2024-09-21T06:34:23.947201+0000","last_became_peered":"2024-09-21T06:34:23.947201+0000","last_unstale":"2024-09-21T06:34:44.229953+0000","last_undegraded":"2024-09-21T06:34:44.229953+0000","last_fullsized":"2024-09-21T06:34:44.229953+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:48:32.279999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.227142+0000","last_change":"2024-09-21T06:34:23.946191+0000","last_active":"2024-09-21T06:34:44.227142+0000","last_peered":"2024-09-21T06:34:44.227142+0000","last_clean":"2024-09-21T06:34:44.227142+0000","last_became_active":"2024-09-21T06:34:23.945817+0000","last_became_peered":"2024-09-21T06:34:23.945817+0000","last_unstale":"2024-09-21T06:34:44.227142+0000","last_undegraded":"2024-09-21T06:34:44.227142+0000","last_fullsized":"2024-09-21T06:34:44.227142+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:29.443444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265435+0000","last_change":"2024-09-21T06:34:23.943433+0000","last_active":"2024-09-21T06:34:44.265435+0000","last_peered":"2024-09-21T06:34:44.265435+0000","last_clean":"2024-09-21T06:34:44.265435+0000","last_became_active":"2024-09-21T06:34:23.943001+0000","last_became_peered":"2024-09-21T06:34:23.943001+0000","last_unstale":"2024-09-21T06:34:44.265435+0000","last_undegraded":"2024-09-21T06:34:44.265435+0000","last_fullsized":"2024-09-21T06:34:44.265435+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:05:10.695083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.223932+0000","last_change":"2024-09-21T06:34:23.954397+0000","last_active":"2024-09-21T06:34:44.223932+0000","last_peered":"2024-09-21T06:34:44.223932+0000","last_clean":"2024-09-21T06:34:44.223932+0000","last_became_active":"2024-09-21T06:34:23.954008+0000","last_became_peered":"2024-09-21T06:34:23.954008+0000","last_unstale":"2024-09-21T06:34:44.223932+0000","last_undegraded":"2024-09-21T06:34:44.223932+0000","last_fullsized":"2024-09-21T06:34:44.223932+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:10:03.764400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.266422+0000","last_change":"2024-09-21T06:34:23.953371+0000","last_active":"2024-09-21T06:34:44.266422+0000","last_peered":"2024-09-21T06:34:44.266422+0000","last_clean":"2024-09-21T06:34:44.266422+0000","last_became_active":"2024-09-21T06:34:23.952864+0000","last_became_peered":"2024-09-21T06:34:23.952864+0000","last_unstale":"2024-09-21T06:34:44.266422+0000","last_undegraded":"2024-09-21T06:34:44.266422+0000","last_fullsized":"2024-09-21T06:34:44.266422+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:44:23.691372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.267477+0000","last_change":"2024-09-21T06:34:44.267366+0000","last_active":"2024-09-21T06:34:44.267477+0000","last_peered":"2024-09-21T06:34:44.267477+0000","last_clean":"2024-09-21T06:34:44.267477+0000","last_became_active":"2024-09-21T06:34:44.266937+0000","last_became_peered":"2024-09-21T06:34:44.266937+0000","last_unstale":"2024-09-21T06:34:44.267477+0000","last_undegraded":"2024-09-21T06:34:44.267477+0000","last_fullsized":"2024-09-21T06:34:44.267477+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:40:00.904219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.266545+0000","last_change":"2024-09-21T06:34:23.958191+0000","last_active":"2024-09-21T06:34:44.266545+0000","last_peered":"2024-09-21T06:34:44.266545+0000","last_clean":"2024-09-21T06:34:44.266545+0000","last_became_active":"2024-09-21T06:34:23.957836+0000","last_became_peered":"2024-09-21T06:34:23.957836+0000","last_unstale":"2024-09-21T06:34:44.266545+0000","last_undegraded":"2024-09-21T06:34:44.266545+0000","last_fullsized":"2024-09-21T06:34:44.266545+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:31:10.201245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.225421+0000","last_change":"2024-09-21T06:34:23.947256+0000","last_active":"2024-09-21T06:34:44.225421+0000","last_peered":"2024-09-21T06:34:44.225421+0000","last_clean":"2024-09-21T06:34:44.225421+0000","last_became_active":"2024-09-21T06:34:23.946029+0000","last_became_peered":"2024-09-21T06:34:23.946029+0000","last_unstale":"2024-09-21T06:34:44.225421+0000","last_undegraded":"2024-09-21T06:34:44.225421+0000","last_fullsized":"2024-09-21T06:34:44.225421+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:47:19.850700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265129+0000","last_change":"2024-09-21T06:34:23.940661+0000","last_active":"2024-09-21T06:34:44.265129+0000","last_peered":"2024-09-21T06:34:44.265129+0000","last_clean":"2024-09-21T06:34:44.265129+0000","last_became_active":"2024-09-21T06:34:23.940306+0000","last_became_peered":"2024-09-21T06:34:23.940306+0000","last_unstale":"2024-09-21T06:34:44.265129+0000","last_undegraded":"2024-09-21T06:34:44.265129+0000","last_fullsized":"2024-09-21T06:34:44.265129+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:19.062435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265265+0000","last_change":"2024-09-21T06:34:23.941906+0000","last_active":"2024-09-21T06:34:44.265265+0000","last_peered":"2024-09-21T06:34:44.265265+0000","last_clean":"2024-09-21T06:34:44.265265+0000","last_became_active":"2024-09-21T06:34:23.941522+0000","last_became_peered":"2024-09-21T06:34:23.941522+0000","last_unstale":"2024-09-21T06:34:44.265265+0000","last_undegraded":"2024-09-21T06:34:44.265265+0000","last_fullsized":"2024-09-21T06:34:44.265265+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:57:12.557051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.264948+0000","last_change":"2024-09-21T06:34:23.957181+0000","last_active":"2024-09-21T06:34:44.264948+0000","last_peered":"2024-09-21T06:34:44.264948+0000","last_clean":"2024-09-21T06:34:44.264948+0000","last_became_active":"2024-09-21T06:34:23.956269+0000","last_became_peered":"2024-09-21T06:34:23.956269+0000","last_unstale":"2024-09-21T06:34:44.264948+0000","last_undegraded":"2024-09-21T06:34:44.264948+0000","last_fullsized":"2024-09-21T06:34:44.264948+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:33:24.989570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265721+0000","last_change":"2024-09-21T06:34:23.951771+0000","last_active":"2024-09-21T06:34:44.265721+0000","last_peered":"2024-09-21T06:34:44.265721+0000","last_clean":"2024-09-21T06:34:44.265721+0000","last_became_active":"2024-09-21T06:34:23.951381+0000","last_became_peered":"2024-09-21T06:34:23.951381+0000","last_unstale":"2024-09-21T06:34:44.265721+0000","last_undegraded":"2024-09-21T06:34:44.265721+0000","last_fullsized":"2024-09-21T06:34:44.265721+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:26:16.049343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.225612+0000","last_change":"2024-09-21T06:34:23.959425+0000","last_active":"2024-09-21T06:34:44.225612+0000","last_peered":"2024-09-21T06:34:44.225612+0000","last_clean":"2024-09-21T06:34:44.225612+0000","last_became_active":"2024-09-21T06:34:23.959022+0000","last_became_peered":"2024-09-21T06:34:23.959022+0000","last_unstale":"2024-09-21T06:34:44.225612+0000","last_undegraded":"2024-09-21T06:34:44.225612+0000","last_fullsized":"2024-09-21T06:34:44.225612+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:19:45.203639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.226736+0000","last_change":"2024-09-21T06:34:23.950510+0000","last_active":"2024-09-21T06:34:44.226736+0000","last_peered":"2024-09-21T06:34:44.226736+0000","last_clean":"2024-09-21T06:34:44.226736+0000","last_became_active":"2024-09-21T06:34:23.950027+0000","last_became_peered":"2024-09-21T06:34:23.950027+0000","last_unstale":"2024-09-21T06:34:44.226736+0000","last_undegraded":"2024-09-21T06:34:44.226736+0000","last_fullsized":"2024-09-21T06:34:44.226736+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:22:23.093554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265658+0000","last_change":"2024-09-21T06:34:23.948824+0000","last_active":"2024-09-21T06:34:44.265658+0000","last_peered":"2024-09-21T06:34:44.265658+0000","last_clean":"2024-09-21T06:34:44.265658+0000","last_became_active":"2024-09-21T06:34:23.948441+0000","last_became_peered":"2024-09-21T06:34:23.948441+0000","last_unstale":"2024-09-21T06:34:44.265658+0000","last_undegraded":"2024-09-21T06:34:44.265658+0000","last_fullsized":"2024-09-21T06:34:44.265658+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:28.498876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.225240+0000","last_change":"2024-09-21T06:34:23.960278+0000","last_active":"2024-09-21T06:34:44.225240+0000","last_peered":"2024-09-21T06:34:44.225240+0000","last_clean":"2024-09-21T06:34:44.225240+0000","last_became_active":"2024-09-21T06:34:23.959737+0000","last_became_peered":"2024-09-21T06:34:23.959737+0000","last_unstale":"2024-09-21T06:34:44.225240+0000","last_undegraded":"2024-09-21T06:34:44.225240+0000","last_fullsized":"2024-09-21T06:34:44.225240+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:50.097954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265247+0000","last_change":"2024-09-21T06:34:23.942797+0000","last_active":"2024-09-21T06:34:44.265247+0000","last_peered":"2024-09-21T06:34:44.265247+0000","last_clean":"2024-09-21T06:34:44.265247+0000","last_became_active":"2024-09-21T06:34:23.942441+0000","last_became_peered":"2024-09-21T06:34:23.942441+0000","last_unstale":"2024-09-21T06:34:44.265247+0000","last_undegraded":"2024-09-21T06:34:44.265247+0000","last_fullsized":"2024-09-21T06:34:44.265247+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:57:30.552583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265998+0000","last_change":"2024-09-21T06:34:23.957433+0000","last_active":"2024-09-21T06:34:44.265998+0000","last_peered":"2024-09-21T06:34:44.265998+0000","last_clean":"2024-09-21T06:34:44.265998+0000","last_became_active":"2024-09-21T06:34:23.957035+0000","last_became_peered":"2024-09-21T06:34:23.957035+0000","last_unstale":"2024-09-21T06:34:44.265998+0000","last_undegraded":"2024-09-21T06:34:44.265998+0000","last_fullsized":"2024-09-21T06:34:44.265998+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:40:18.418705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.224015+0000","last_change":"2024-09-21T06:34:23.950308+0000","last_active":"2024-09-21T06:34:44.224015+0000","last_peered":"2024-09-21T06:34:44.224015+0000","last_clean":"2024-09-21T06:34:44.224015+0000","last_became_active":"2024-09-21T06:34:23.948417+0000","last_became_peered":"2024-09-21T06:34:23.948417+0000","last_unstale":"2024-09-21T06:34:44.224015+0000","last_undegraded":"2024-09-21T06:34:44.224015+0000","last_fullsized":"2024-09-21T06:34:44.224015+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:47.233504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.226437+0000","last_change":"2024-09-21T06:34:23.949369+0000","last_active":"2024-09-21T06:34:44.226437+0000","last_peered":"2024-09-21T06:34:44.226437+0000","last_clean":"2024-09-21T06:34:44.226437+0000","last_became_active":"2024-09-21T06:34:23.948713+0000","last_became_peered":"2024-09-21T06:34:23.948713+0000","last_unstale":"2024-09-21T06:34:44.226437+0000","last_undegraded":"2024-09-21T06:34:44.226437+0000","last_fullsized":"2024-09-21T06:34:44.226437+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:57:06.915379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.224467+0000","last_change":"2024-09-21T06:34:23.959315+0000","last_active":"2024-09-21T06:34:44.224467+0000","last_peered":"2024-09-21T06:34:44.224467+0000","last_clean":"2024-09-21T06:34:44.224467+0000","last_became_active":"2024-09-21T06:34:23.958904+0000","last_became_peered":"2024-09-21T06:34:23.958904+0000","last_unstale":"2024-09-21T06:34:44.224467+0000","last_undegraded":"2024-09-21T06:34:44.224467+0000","last_fullsized":"2024-09-21T06:34:44.224467+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:31:35.486369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265718+0000","last_change":"2024-09-21T06:34:23.952074+0000","last_active":"2024-09-21T06:34:44.265718+0000","last_peered":"2024-09-21T06:34:44.265718+0000","last_clean":"2024-09-21T06:34:44.265718+0000","last_became_active":"2024-09-21T06:34:23.951692+0000","last_became_peered":"2024-09-21T06:34:23.951692+0000","last_unstale":"2024-09-21T06:34:44.265718+0000","last_undegraded":"2024-09-21T06:34:44.265718+0000","last_fullsized":"2024-09-21T06:34:44.265718+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:15:06.300781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.225420+0000","last_change":"2024-09-21T06:34:23.947296+0000","last_active":"2024-09-21T06:34:44.225420+0000","last_peered":"2024-09-21T06:34:44.225420+0000","last_clean":"2024-09-21T06:34:44.225420+0000","last_became_active":"2024-09-21T06:34:23.946392+0000","last_became_peered":"2024-09-21T06:34:23.946392+0000","last_unstale":"2024-09-21T06:34:44.225420+0000","last_undegraded":"2024-09-21T06:34:44.225420+0000","last_fullsized":"2024-09-21T06:34:44.225420+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:05:27.597890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265035+0000","last_change":"2024-09-21T06:34:23.953161+0000","last_active":"2024-09-21T06:34:44.265035+0000","last_peered":"2024-09-21T06:34:44.265035+0000","last_clean":"2024-09-21T06:34:44.265035+0000","last_became_active":"2024-09-21T06:34:23.952811+0000","last_became_peered":"2024-09-21T06:34:23.952811+0000","last_unstale":"2024-09-21T06:34:44.265035+0000","last_undegraded":"2024-09-21T06:34:44.265035+0000","last_fullsized":"2024-09-21T06:34:44.265035+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:04.431094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265586+0000","last_change":"2024-09-21T06:34:23.959880+0000","last_active":"2024-09-21T06:34:44.265586+0000","last_peered":"2024-09-21T06:34:44.265586+0000","last_clean":"2024-09-21T06:34:44.265586+0000","last_became_active":"2024-09-21T06:34:23.959573+0000","last_became_peered":"2024-09-21T06:34:23.959573+0000","last_unstale":"2024-09-21T06:34:44.265586+0000","last_undegraded":"2024-09-21T06:34:44.265586+0000","last_fullsized":"2024-09-21T06:34:44.265586+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:21.921956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265362+0000","last_change":"2024-09-21T06:34:23.947209+0000","last_active":"2024-09-21T06:34:44.265362+0000","last_peered":"2024-09-21T06:34:44.265362+0000","last_clean":"2024-09-21T06:34:44.265362+0000","last_became_active":"2024-09-21T06:34:23.946763+0000","last_became_peered":"2024-09-21T06:34:23.946763+0000","last_unstale":"2024-09-21T06:34:44.265362+0000","last_undegraded":"2024-09-21T06:34:44.265362+0000","last_fullsized":"2024-09-21T06:34:44.265362+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:04:54.050980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265396+0000","last_change":"2024-09-21T06:34:23.955064+0000","last_active":"2024-09-21T06:34:44.265396+0000","last_peered":"2024-09-21T06:34:44.265396+0000","last_clean":"2024-09-21T06:34:44.265396+0000","last_became_active":"2024-09-21T06:34:23.954622+0000","last_became_peered":"2024-09-21T06:34:23.954622+0000","last_unstale":"2024-09-21T06:34:44.265396+0000","last_undegraded":"2024-09-21T06:34:44.265396+0000","last_fullsized":"2024-09-21T06:34:44.265396+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:04:59.056398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.224979+0000","last_change":"2024-09-21T06:34:23.947015+0000","last_active":"2024-09-21T06:34:44.224979+0000","last_peered":"2024-09-21T06:34:44.224979+0000","last_clean":"2024-09-21T06:34:44.224979+0000","last_became_active":"2024-09-21T06:34:23.946569+0000","last_became_peered":"2024-09-21T06:34:23.946569+0000","last_unstale":"2024-09-21T06:34:44.224979+0000","last_undegraded":"2024-09-21T06:34:44.224979+0000","last_fullsized":"2024-09-21T06:34:44.224979+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:50:35.935533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.230155+0000","last_change":"2024-09-21T06:34:23.951126+0000","last_active":"2024-09-21T06:34:44.230155+0000","last_peered":"2024-09-21T06:34:44.230155+0000","last_clean":"2024-09-21T06:34:44.230155+0000","last_became_active":"2024-09-21T06:34:23.950739+0000","last_became_peered":"2024-09-21T06:34:23.950739+0000","last_unstale":"2024-09-21T06:34:44.230155+0000","last_undegraded":"2024-09-21T06:34:44.230155+0000","last_fullsized":"2024-09-21T06:34:44.230155+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:52:43.201135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'6","reported_seq":131,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:36:11.165444+0000","last_change":"2024-09-21T06:34:21.939584+0000","last_active":"2024-09-21T06:36:11.165444+0000","last_peered":"2024-09-21T06:36:11.165444+0000","last_clean":"2024-09-21T06:36:11.165444+0000","last_became_active":"2024-09-21T06:34:21.939233+0000","last_became_peered":"2024-09-21T06:34:21.939233+0000","last_unstale":"2024-09-21T06:36:11.165444+0000","last_undegraded":"2024-09-21T06:36:11.165444+0000","last_fullsized":"2024-09-21T06:36:11.165444+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:54.701803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":102,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.232102+0000","last_change":"2024-09-21T06:34:44.232010+0000","last_active":"2024-09-21T06:34:44.232102+0000","last_peered":"2024-09-21T06:34:44.232102+0000","last_clean":"2024-09-21T06:34:44.232102+0000","last_became_active":"2024-09-21T06:34:44.231590+0000","last_became_peered":"2024-09-21T06:34:44.231590+0000","last_unstale":"2024-09-21T06:34:44.232102+0000","last_undegraded":"2024-09-21T06:34:44.232102+0000","last_fullsized":"2024-09-21T06:34:44.232102+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:33:02.751794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.227410+0000","last_change":"2024-09-21T06:34:21.937418+0000","last_active":"2024-09-21T06:34:44.227410+0000","last_peered":"2024-09-21T06:34:44.227410+0000","last_clean":"2024-09-21T06:34:44.227410+0000","last_became_active":"2024-09-21T06:34:21.937048+0000","last_became_peered":"2024-09-21T06:34:21.937048+0000","last_unstale":"2024-09-21T06:34:44.227410+0000","last_undegraded":"2024-09-21T06:34:44.227410+0000","last_fullsized":"2024-09-21T06:34:44.227410+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:33:38.731444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.264973+0000","last_change":"2024-09-21T06:34:21.932970+0000","last_active":"2024-09-21T06:34:44.264973+0000","last_peered":"2024-09-21T06:34:44.264973+0000","last_clean":"2024-09-21T06:34:44.264973+0000","last_became_active":"2024-09-21T06:34:21.932616+0000","last_became_peered":"2024-09-21T06:34:21.932616+0000","last_unstale":"2024-09-21T06:34:44.264973+0000","last_undegraded":"2024-09-21T06:34:44.264973+0000","last_fullsized":"2024-09-21T06:34:44.264973+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:33:20.611023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.224042+0000","last_change":"2024-09-21T06:34:23.950798+0000","last_active":"2024-09-21T06:34:44.224042+0000","last_peered":"2024-09-21T06:34:44.224042+0000","last_clean":"2024-09-21T06:34:44.224042+0000","last_became_active":"2024-09-21T06:34:23.950475+0000","last_became_peered":"2024-09-21T06:34:23.950475+0000","last_unstale":"2024-09-21T06:34:44.224042+0000","last_undegraded":"2024-09-21T06:34:44.224042+0000","last_fullsized":"2024-09-21T06:34:44.224042+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:43:23.177775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.226659+0000","last_change":"2024-09-21T06:34:21.937860+0000","last_active":"2024-09-21T06:34:44.226659+0000","last_peered":"2024-09-21T06:34:44.226659+0000","last_clean":"2024-09-21T06:34:44.226659+0000","last_became_active":"2024-09-21T06:34:21.937476+0000","last_became_peered":"2024-09-21T06:34:21.937476+0000","last_unstale":"2024-09-21T06:34:44.226659+0000","last_undegraded":"2024-09-21T06:34:44.226659+0000","last_fullsized":"2024-09-21T06:34:44.226659+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:49:06.069197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.226096+0000","last_change":"2024-09-21T06:34:23.944559+0000","last_active":"2024-09-21T06:34:44.226096+0000","last_peered":"2024-09-21T06:34:44.226096+0000","last_clean":"2024-09-21T06:34:44.226096+0000","last_became_active":"2024-09-21T06:34:23.944166+0000","last_became_peered":"2024-09-21T06:34:23.944166+0000","last_unstale":"2024-09-21T06:34:44.226096+0000","last_undegraded":"2024-09-21T06:34:44.226096+0000","last_fullsized":"2024-09-21T06:34:44.226096+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:01:56.532854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"75'3","reported_seq":125,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:36:11.164587+0000","last_change":"2024-09-21T06:34:21.936531+0000","last_active":"2024-09-21T06:36:11.164587+0000","last_peered":"2024-09-21T06:36:11.164587+0000","last_clean":"2024-09-21T06:36:11.164587+0000","last_became_active":"2024-09-21T06:34:21.936087+0000","last_became_peered":"2024-09-21T06:34:21.936087+0000","last_unstale":"2024-09-21T06:36:11.164587+0000","last_undegraded":"2024-09-21T06:36:11.164587+0000","last_fullsized":"2024-09-21T06:36:11.164587+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:27:12.370722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":99,"num_read_kb":99,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.266303+0000","last_change":"2024-09-21T06:34:23.954894+0000","last_active":"2024-09-21T06:34:44.266303+0000","last_peered":"2024-09-21T06:34:44.266303+0000","last_clean":"2024-09-21T06:34:44.266303+0000","last_became_active":"2024-09-21T06:34:23.954186+0000","last_became_peered":"2024-09-21T06:34:23.954186+0000","last_unstale":"2024-09-21T06:34:44.266303+0000","last_undegraded":"2024-09-21T06:34:44.266303+0000","last_fullsized":"2024-09-21T06:34:44.266303+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:18:49.623338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265585+0000","last_change":"2024-09-21T06:34:21.934989+0000","last_active":"2024-09-21T06:34:44.265585+0000","last_peered":"2024-09-21T06:34:44.265585+0000","last_clean":"2024-09-21T06:34:44.265585+0000","last_became_active":"2024-09-21T06:34:21.934550+0000","last_became_peered":"2024-09-21T06:34:21.934550+0000","last_unstale":"2024-09-21T06:34:44.265585+0000","last_undegraded":"2024-09-21T06:34:44.265585+0000","last_fullsized":"2024-09-21T06:34:44.265585+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:59:17.849338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265984+0000","last_change":"2024-09-21T06:34:23.956190+0000","last_active":"2024-09-21T06:34:44.265984+0000","last_peered":"2024-09-21T06:34:44.265984+0000","last_clean":"2024-09-21T06:34:44.265984+0000","last_became_active":"2024-09-21T06:34:23.955815+0000","last_became_peered":"2024-09-21T06:34:23.955815+0000","last_unstale":"2024-09-21T06:34:44.265984+0000","last_undegraded":"2024-09-21T06:34:44.265984+0000","last_fullsized":"2024-09-21T06:34:44.265984+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:14:56.165350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'4","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.227080+0000","last_change":"2024-09-21T06:34:22.096480+0000","last_active":"2024-09-21T06:34:44.227080+0000","last_peered":"2024-09-21T06:34:44.227080+0000","last_clean":"2024-09-21T06:34:44.227080+0000","last_became_active":"2024-09-21T06:34:22.095921+0000","last_became_peered":"2024-09-21T06:34:22.095921+0000","last_unstale":"2024-09-21T06:34:44.227080+0000","last_undegraded":"2024-09-21T06:34:44.227080+0000","last_fullsized":"2024-09-21T06:34:44.227080+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:19:30.006811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265960+0000","last_change":"2024-09-21T06:34:23.961840+0000","last_active":"2024-09-21T06:34:44.265960+0000","last_peered":"2024-09-21T06:34:44.265960+0000","last_clean":"2024-09-21T06:34:44.265960+0000","last_became_active":"2024-09-21T06:34:23.961313+0000","last_became_peered":"2024-09-21T06:34:23.961313+0000","last_unstale":"2024-09-21T06:34:44.265960+0000","last_undegraded":"2024-09-21T06:34:44.265960+0000","last_fullsized":"2024-09-21T06:34:44.265960+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:29:04.308598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"77'30","reported_seq":260,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:36:12.166573+0000","last_change":"2024-09-21T06:34:21.937326+0000","last_active":"2024-09-21T06:36:12.166573+0000","last_peered":"2024-09-21T06:36:12.166573+0000","last_clean":"2024-09-21T06:36:12.166573+0000","last_became_active":"2024-09-21T06:34:21.936940+0000","last_became_peered":"2024-09-21T06:34:21.936940+0000","last_unstale":"2024-09-21T06:36:12.166573+0000","last_undegraded":"2024-09-21T06:36:12.166573+0000","last_fullsized":"2024-09-21T06:36:12.166573+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:47:12.988306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64210,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":207,"num_read_kb":166,"num_write":31,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.230328+0000","last_change":"2024-09-21T06:34:23.950167+0000","last_active":"2024-09-21T06:34:44.230328+0000","last_peered":"2024-09-21T06:34:44.230328+0000","last_clean":"2024-09-21T06:34:44.230328+0000","last_became_active":"2024-09-21T06:34:23.949697+0000","last_became_peered":"2024-09-21T06:34:23.949697+0000","last_unstale":"2024-09-21T06:34:44.230328+0000","last_undegraded":"2024-09-21T06:34:44.230328+0000","last_fullsized":"2024-09-21T06:34:44.230328+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:37:48.882644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'6","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265516+0000","last_change":"2024-09-21T06:34:21.937366+0000","last_active":"2024-09-21T06:34:44.265516+0000","last_peered":"2024-09-21T06:34:44.265516+0000","last_clean":"2024-09-21T06:34:44.265516+0000","last_became_active":"2024-09-21T06:34:21.936988+0000","last_became_peered":"2024-09-21T06:34:21.936988+0000","last_unstale":"2024-09-21T06:34:44.265516+0000","last_undegraded":"2024-09-21T06:34:44.265516+0000","last_fullsized":"2024-09-21T06:34:44.265516+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:48:06.318645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265352+0000","last_change":"2024-09-21T06:34:23.947523+0000","last_active":"2024-09-21T06:34:44.265352+0000","last_peered":"2024-09-21T06:34:44.265352+0000","last_clean":"2024-09-21T06:34:44.265352+0000","last_became_active":"2024-09-21T06:34:23.947150+0000","last_became_peered":"2024-09-21T06:34:23.947150+0000","last_unstale":"2024-09-21T06:34:44.265352+0000","last_undegraded":"2024-09-21T06:34:44.265352+0000","last_fullsized":"2024-09-21T06:34:44.265352+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:18:50.417153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.226854+0000","last_change":"2024-09-21T06:34:21.938631+0000","last_active":"2024-09-21T06:34:44.226854+0000","last_peered":"2024-09-21T06:34:44.226854+0000","last_clean":"2024-09-21T06:34:44.226854+0000","last_became_active":"2024-09-21T06:34:21.938242+0000","last_became_peered":"2024-09-21T06:34:21.938242+0000","last_unstale":"2024-09-21T06:34:44.226854+0000","last_undegraded":"2024-09-21T06:34:44.226854+0000","last_fullsized":"2024-09-21T06:34:44.226854+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:40:02.056812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265725+0000","last_change":"2024-09-21T06:34:23.945276+0000","last_active":"2024-09-21T06:34:44.265725+0000","last_peered":"2024-09-21T06:34:44.265725+0000","last_clean":"2024-09-21T06:34:44.265725+0000","last_became_active":"2024-09-21T06:34:23.944914+0000","last_became_peered":"2024-09-21T06:34:23.944914+0000","last_unstale":"2024-09-21T06:34:44.265725+0000","last_undegraded":"2024-09-21T06:34:44.265725+0000","last_fullsized":"2024-09-21T06:34:44.265725+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:15:23.650908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"75'4","reported_seq":129,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:36:11.185383+0000","last_change":"2024-09-21T06:34:21.937593+0000","last_active":"2024-09-21T06:36:11.185383+0000","last_peered":"2024-09-21T06:36:11.185383+0000","last_clean":"2024-09-21T06:36:11.185383+0000","last_became_active":"2024-09-21T06:34:21.936851+0000","last_became_peered":"2024-09-21T06:34:21.936851+0000","last_unstale":"2024-09-21T06:36:11.185383+0000","last_undegraded":"2024-09-21T06:36:11.185383+0000","last_fullsized":"2024-09-21T06:36:11.185383+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:25:36.161431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265345+0000","last_change":"2024-09-21T06:34:23.945573+0000","last_active":"2024-09-21T06:34:44.265345+0000","last_peered":"2024-09-21T06:34:44.265345+0000","last_clean":"2024-09-21T06:34:44.265345+0000","last_became_active":"2024-09-21T06:34:23.944410+0000","last_became_peered":"2024-09-21T06:34:23.944410+0000","last_unstale":"2024-09-21T06:34:44.265345+0000","last_undegraded":"2024-09-21T06:34:44.265345+0000","last_fullsized":"2024-09-21T06:34:44.265345+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:33:54.613524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'15","reported_seq":39,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.229900+0000","last_change":"2024-09-21T06:34:22.096539+0000","last_active":"2024-09-21T06:34:44.229900+0000","last_peered":"2024-09-21T06:34:44.229900+0000","last_clean":"2024-09-21T06:34:44.229900+0000","last_became_active":"2024-09-21T06:34:22.096013+0000","last_became_peered":"2024-09-21T06:34:22.096013+0000","last_unstale":"2024-09-21T06:34:44.229900+0000","last_undegraded":"2024-09-21T06:34:44.229900+0000","last_fullsized":"2024-09-21T06:34:44.229900+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:30:59.414325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.226688+0000","last_change":"2024-09-21T06:34:23.958381+0000","last_active":"2024-09-21T06:34:44.226688+0000","last_peered":"2024-09-21T06:34:44.226688+0000","last_clean":"2024-09-21T06:34:44.226688+0000","last_became_active":"2024-09-21T06:34:23.957965+0000","last_became_peered":"2024-09-21T06:34:23.957965+0000","last_unstale":"2024-09-21T06:34:44.226688+0000","last_undegraded":"2024-09-21T06:34:44.226688+0000","last_fullsized":"2024-09-21T06:34:44.226688+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:37:43.474777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'2","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.230733+0000","last_change":"2024-09-21T06:34:21.937612+0000","last_active":"2024-09-21T06:34:44.230733+0000","last_peered":"2024-09-21T06:34:44.230733+0000","last_clean":"2024-09-21T06:34:44.230733+0000","last_became_active":"2024-09-21T06:34:21.936859+0000","last_became_peered":"2024-09-21T06:34:21.936859+0000","last_unstale":"2024-09-21T06:34:44.230733+0000","last_undegraded":"2024-09-21T06:34:44.230733+0000","last_fullsized":"2024-09-21T06:34:44.230733+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:40.957217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.229139+0000","last_change":"2024-09-21T06:34:44.228991+0000","last_active":"2024-09-21T06:34:44.229139+0000","last_peered":"2024-09-21T06:34:44.229139+0000","last_clean":"2024-09-21T06:34:44.229139+0000","last_became_active":"2024-09-21T06:34:44.228428+0000","last_became_peered":"2024-09-21T06:34:44.228428+0000","last_unstale":"2024-09-21T06:34:44.229139+0000","last_undegraded":"2024-09-21T06:34:44.229139+0000","last_fullsized":"2024-09-21T06:34:44.229139+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:21.719532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265523+0000","last_change":"2024-09-21T06:34:21.933392+0000","last_active":"2024-09-21T06:34:44.265523+0000","last_peered":"2024-09-21T06:34:44.265523+0000","last_clean":"2024-09-21T06:34:44.265523+0000","last_became_active":"2024-09-21T06:34:21.932999+0000","last_became_peered":"2024-09-21T06:34:21.932999+0000","last_unstale":"2024-09-21T06:34:44.265523+0000","last_undegraded":"2024-09-21T06:34:44.265523+0000","last_fullsized":"2024-09-21T06:34:44.265523+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:05:20.631755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.266194+0000","last_change":"2024-09-21T06:34:23.944675+0000","last_active":"2024-09-21T06:34:44.266194+0000","last_peered":"2024-09-21T06:34:44.266194+0000","last_clean":"2024-09-21T06:34:44.266194+0000","last_became_active":"2024-09-21T06:34:23.944258+0000","last_became_peered":"2024-09-21T06:34:23.944258+0000","last_unstale":"2024-09-21T06:34:44.266194+0000","last_undegraded":"2024-09-21T06:34:44.266194+0000","last_fullsized":"2024-09-21T06:34:44.266194+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:26:40.661840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'1","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.227259+0000","last_change":"2024-09-21T06:34:21.941064+0000","last_active":"2024-09-21T06:34:44.227259+0000","last_peered":"2024-09-21T06:34:44.227259+0000","last_clean":"2024-09-21T06:34:44.227259+0000","last_became_active":"2024-09-21T06:34:21.940667+0000","last_became_peered":"2024-09-21T06:34:21.940667+0000","last_unstale":"2024-09-21T06:34:44.227259+0000","last_undegraded":"2024-09-21T06:34:44.227259+0000","last_fullsized":"2024-09-21T06:34:44.227259+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:20:14.721719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'1","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.266571+0000","last_change":"2024-09-21T06:34:23.943503+0000","last_active":"2024-09-21T06:34:44.266571+0000","last_peered":"2024-09-21T06:34:44.266571+0000","last_clean":"2024-09-21T06:34:44.266571+0000","last_became_active":"2024-09-21T06:34:23.943097+0000","last_became_peered":"2024-09-21T06:34:23.943097+0000","last_unstale":"2024-09-21T06:34:44.266571+0000","last_undegraded":"2024-09-21T06:34:44.266571+0000","last_fullsized":"2024-09-21T06:34:44.266571+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:08:04.641273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"75'3","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265879+0000","last_change":"2024-09-21T06:34:22.096274+0000","last_active":"2024-09-21T06:34:44.265879+0000","last_peered":"2024-09-21T06:34:44.265879+0000","last_clean":"2024-09-21T06:34:44.265879+0000","last_became_active":"2024-09-21T06:34:22.095861+0000","last_became_peered":"2024-09-21T06:34:22.095861+0000","last_unstale":"2024-09-21T06:34:44.265879+0000","last_undegraded":"2024-09-21T06:34:44.265879+0000","last_fullsized":"2024-09-21T06:34:44.265879+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:22:47.807488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.266601+0000","last_change":"2024-09-21T06:34:23.953503+0000","last_active":"2024-09-21T06:34:44.266601+0000","last_peered":"2024-09-21T06:34:44.266601+0000","last_clean":"2024-09-21T06:34:44.266601+0000","last_became_active":"2024-09-21T06:34:23.952880+0000","last_became_peered":"2024-09-21T06:34:23.952880+0000","last_unstale":"2024-09-21T06:34:44.266601+0000","last_undegraded":"2024-09-21T06:34:44.266601+0000","last_fullsized":"2024-09-21T06:34:44.266601+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:29:47.746678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":98,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265624+0000","last_change":"2024-09-21T06:33:09.908154+0000","last_active":"2024-09-21T06:34:44.265624+0000","last_peered":"2024-09-21T06:34:44.265624+0000","last_clean":"2024-09-21T06:34:44.265624+0000","last_became_active":"2024-09-21T06:33:09.902397+0000","last_became_peered":"2024-09-21T06:33:09.902397+0000","last_unstale":"2024-09-21T06:34:44.265624+0000","last_undegraded":"2024-09-21T06:34:44.265624+0000","last_fullsized":"2024-09-21T06:34:44.265624+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:29:42.295555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:29:42.295555+0000","last_clean_scrub_stamp":"2024-09-21T06:29:42.295555+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:15:17.111178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"75'3","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.225389+0000","last_change":"2024-09-21T06:34:21.932618+0000","last_active":"2024-09-21T06:34:44.225389+0000","last_peered":"2024-09-21T06:34:44.225389+0000","last_clean":"2024-09-21T06:34:44.225389+0000","last_became_active":"2024-09-21T06:34:21.932187+0000","last_became_peered":"2024-09-21T06:34:21.932187+0000","last_unstale":"2024-09-21T06:34:44.225389+0000","last_undegraded":"2024-09-21T06:34:44.225389+0000","last_fullsized":"2024-09-21T06:34:44.225389+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:19:06.780448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.224167+0000","last_change":"2024-09-21T06:34:23.953580+0000","last_active":"2024-09-21T06:34:44.224167+0000","last_peered":"2024-09-21T06:34:44.224167+0000","last_clean":"2024-09-21T06:34:44.224167+0000","last_became_active":"2024-09-21T06:34:23.952222+0000","last_became_peered":"2024-09-21T06:34:23.952222+0000","last_unstale":"2024-09-21T06:34:44.224167+0000","last_undegraded":"2024-09-21T06:34:44.224167+0000","last_fullsized":"2024-09-21T06:34:44.224167+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:19.759042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265531+0000","last_change":"2024-09-21T06:34:21.939178+0000","last_active":"2024-09-21T06:34:44.265531+0000","last_peered":"2024-09-21T06:34:44.265531+0000","last_clean":"2024-09-21T06:34:44.265531+0000","last_became_active":"2024-09-21T06:34:21.938755+0000","last_became_peered":"2024-09-21T06:34:21.938755+0000","last_unstale":"2024-09-21T06:34:44.265531+0000","last_undegraded":"2024-09-21T06:34:44.265531+0000","last_fullsized":"2024-09-21T06:34:44.265531+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:10.474432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.264822+0000","last_change":"2024-09-21T06:34:23.954196+0000","last_active":"2024-09-21T06:34:44.264822+0000","last_peered":"2024-09-21T06:34:44.264822+0000","last_clean":"2024-09-21T06:34:44.264822+0000","last_became_active":"2024-09-21T06:34:23.953843+0000","last_became_peered":"2024-09-21T06:34:23.953843+0000","last_unstale":"2024-09-21T06:34:44.264822+0000","last_undegraded":"2024-09-21T06:34:44.264822+0000","last_fullsized":"2024-09-21T06:34:44.264822+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:41:02.896704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"75'4","reported_seq":123,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:36:08.180205+0000","last_change":"2024-09-21T06:34:22.095920+0000","last_active":"2024-09-21T06:36:08.180205+0000","last_peered":"2024-09-21T06:36:08.180205+0000","last_clean":"2024-09-21T06:36:08.180205+0000","last_became_active":"2024-09-21T06:34:22.095376+0000","last_became_peered":"2024-09-21T06:34:22.095376+0000","last_unstale":"2024-09-21T06:36:08.180205+0000","last_undegraded":"2024-09-21T06:36:08.180205+0000","last_fullsized":"2024-09-21T06:36:08.180205+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:40:44.400566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":96,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.226479+0000","last_change":"2024-09-21T06:34:23.956541+0000","last_active":"2024-09-21T06:34:44.226479+0000","last_peered":"2024-09-21T06:34:44.226479+0000","last_clean":"2024-09-21T06:34:44.226479+0000","last_became_active":"2024-09-21T06:34:23.956150+0000","last_became_peered":"2024-09-21T06:34:23.956150+0000","last_unstale":"2024-09-21T06:34:44.226479+0000","last_undegraded":"2024-09-21T06:34:44.226479+0000","last_fullsized":"2024-09-21T06:34:44.226479+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:09:32.432391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.266674+0000","last_change":"2024-09-21T06:34:21.942244+0000","last_active":"2024-09-21T06:34:44.266674+0000","last_peered":"2024-09-21T06:34:44.266674+0000","last_clean":"2024-09-21T06:34:44.266674+0000","last_became_active":"2024-09-21T06:34:21.941761+0000","last_became_peered":"2024-09-21T06:34:21.941761+0000","last_unstale":"2024-09-21T06:34:44.266674+0000","last_undegraded":"2024-09-21T06:34:44.266674+0000","last_fullsized":"2024-09-21T06:34:44.266674+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:10.507103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.227647+0000","last_change":"2024-09-21T06:34:23.951250+0000","last_active":"2024-09-21T06:34:44.227647+0000","last_peered":"2024-09-21T06:34:44.227647+0000","last_clean":"2024-09-21T06:34:44.227647+0000","last_became_active":"2024-09-21T06:34:23.950015+0000","last_became_peered":"2024-09-21T06:34:23.950015+0000","last_unstale":"2024-09-21T06:34:44.227647+0000","last_undegraded":"2024-09-21T06:34:44.227647+0000","last_fullsized":"2024-09-21T06:34:44.227647+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:53:22.884049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.266799+0000","last_change":"2024-09-21T06:34:44.266717+0000","last_active":"2024-09-21T06:34:44.266799+0000","last_peered":"2024-09-21T06:34:44.266799+0000","last_clean":"2024-09-21T06:34:44.266799+0000","last_became_active":"2024-09-21T06:34:44.266256+0000","last_became_peered":"2024-09-21T06:34:44.266256+0000","last_unstale":"2024-09-21T06:34:44.266799+0000","last_undegraded":"2024-09-21T06:34:44.266799+0000","last_fullsized":"2024-09-21T06:34:44.266799+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:38:04.674592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'1","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.227589+0000","last_change":"2024-09-21T06:34:23.947823+0000","last_active":"2024-09-21T06:34:44.227589+0000","last_peered":"2024-09-21T06:34:44.227589+0000","last_clean":"2024-09-21T06:34:44.227589+0000","last_became_active":"2024-09-21T06:34:23.947362+0000","last_became_peered":"2024-09-21T06:34:23.947362+0000","last_unstale":"2024-09-21T06:34:44.227589+0000","last_undegraded":"2024-09-21T06:34:44.227589+0000","last_fullsized":"2024-09-21T06:34:44.227589+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:32:22.401819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"75'1","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.230506+0000","last_change":"2024-09-21T06:34:22.096537+0000","last_active":"2024-09-21T06:34:44.230506+0000","last_peered":"2024-09-21T06:34:44.230506+0000","last_clean":"2024-09-21T06:34:44.230506+0000","last_became_active":"2024-09-21T06:34:22.095875+0000","last_became_peered":"2024-09-21T06:34:22.095875+0000","last_unstale":"2024-09-21T06:34:44.230506+0000","last_undegraded":"2024-09-21T06:34:44.230506+0000","last_fullsized":"2024-09-21T06:34:44.230506+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:11:44.955531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265151+0000","last_change":"2024-09-21T06:34:23.938784+0000","last_active":"2024-09-21T06:34:44.265151+0000","last_peered":"2024-09-21T06:34:44.265151+0000","last_clean":"2024-09-21T06:34:44.265151+0000","last_became_active":"2024-09-21T06:34:23.938400+0000","last_became_peered":"2024-09-21T06:34:23.938400+0000","last_unstale":"2024-09-21T06:34:44.265151+0000","last_undegraded":"2024-09-21T06:34:44.265151+0000","last_fullsized":"2024-09-21T06:34:44.265151+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:00:13.210874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"77'10","reported_seq":46,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:48.958566+0000","last_change":"2024-09-21T06:34:44.235532+0000","last_active":"2024-09-21T06:34:48.958566+0000","last_peered":"2024-09-21T06:34:48.958566+0000","last_clean":"2024-09-21T06:34:48.958566+0000","last_became_active":"2024-09-21T06:34:44.230220+0000","last_became_peered":"2024-09-21T06:34:44.230220+0000","last_unstale":"2024-09-21T06:34:48.958566+0000","last_undegraded":"2024-09-21T06:34:48.958566+0000","last_fullsized":"2024-09-21T06:34:48.958566+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:07:23.398177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":11,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.224475+0000","last_change":"2024-09-21T06:34:23.953477+0000","last_active":"2024-09-21T06:34:44.224475+0000","last_peered":"2024-09-21T06:34:44.224475+0000","last_clean":"2024-09-21T06:34:44.224475+0000","last_became_active":"2024-09-21T06:34:23.951404+0000","last_became_peered":"2024-09-21T06:34:23.951404+0000","last_unstale":"2024-09-21T06:34:44.224475+0000","last_undegraded":"2024-09-21T06:34:44.224475+0000","last_fullsized":"2024-09-21T06:34:44.224475+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:13:17.126680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'4","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.225262+0000","last_change":"2024-09-21T06:34:22.031837+0000","last_active":"2024-09-21T06:34:44.225262+0000","last_peered":"2024-09-21T06:34:44.225262+0000","last_clean":"2024-09-21T06:34:44.225262+0000","last_became_active":"2024-09-21T06:34:22.031377+0000","last_became_peered":"2024-09-21T06:34:22.031377+0000","last_unstale":"2024-09-21T06:34:44.225262+0000","last_undegraded":"2024-09-21T06:34:44.225262+0000","last_fullsized":"2024-09-21T06:34:44.225262+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:14:32.536634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265835+0000","last_change":"2024-09-21T06:34:23.955321+0000","last_active":"2024-09-21T06:34:44.265835+0000","last_peered":"2024-09-21T06:34:44.265835+0000","last_clean":"2024-09-21T06:34:44.265835+0000","last_became_active":"2024-09-21T06:34:23.954906+0000","last_became_peered":"2024-09-21T06:34:23.954906+0000","last_unstale":"2024-09-21T06:34:44.265835+0000","last_undegraded":"2024-09-21T06:34:44.265835+0000","last_fullsized":"2024-09-21T06:34:44.265835+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:59:07.771268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265823+0000","last_change":"2024-09-21T06:34:22.096135+0000","last_active":"2024-09-21T06:34:44.265823+0000","last_peered":"2024-09-21T06:34:44.265823+0000","last_clean":"2024-09-21T06:34:44.265823+0000","last_became_active":"2024-09-21T06:34:22.095721+0000","last_became_peered":"2024-09-21T06:34:22.095721+0000","last_unstale":"2024-09-21T06:34:44.265823+0000","last_undegraded":"2024-09-21T06:34:44.265823+0000","last_fullsized":"2024-09-21T06:34:44.265823+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:28.994324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.229717+0000","last_change":"2024-09-21T06:34:23.951769+0000","last_active":"2024-09-21T06:34:44.229717+0000","last_peered":"2024-09-21T06:34:44.229717+0000","last_clean":"2024-09-21T06:34:44.229717+0000","last_became_active":"2024-09-21T06:34:23.951377+0000","last_became_peered":"2024-09-21T06:34:23.951377+0000","last_unstale":"2024-09-21T06:34:44.229717+0000","last_undegraded":"2024-09-21T06:34:44.229717+0000","last_fullsized":"2024-09-21T06:34:44.229717+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:49:44.291714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.224147+0000","last_change":"2024-09-21T06:34:21.933909+0000","last_active":"2024-09-21T06:34:44.224147+0000","last_peered":"2024-09-21T06:34:44.224147+0000","last_clean":"2024-09-21T06:34:44.224147+0000","last_became_active":"2024-09-21T06:34:21.933524+0000","last_became_peered":"2024-09-21T06:34:21.933524+0000","last_unstale":"2024-09-21T06:34:44.224147+0000","last_undegraded":"2024-09-21T06:34:44.224147+0000","last_fullsized":"2024-09-21T06:34:44.224147+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:58.110444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.225073+0000","last_change":"2024-09-21T06:34:23.948586+0000","last_active":"2024-09-21T06:34:44.225073+0000","last_peered":"2024-09-21T06:34:44.225073+0000","last_clean":"2024-09-21T06:34:44.225073+0000","last_became_active":"2024-09-21T06:34:23.948225+0000","last_became_peered":"2024-09-21T06:34:23.948225+0000","last_unstale":"2024-09-21T06:34:44.225073+0000","last_undegraded":"2024-09-21T06:34:44.225073+0000","last_fullsized":"2024-09-21T06:34:44.225073+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:28:24.272712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265358+0000","last_change":"2024-09-21T06:34:21.935617+0000","last_active":"2024-09-21T06:34:44.265358+0000","last_peered":"2024-09-21T06:34:44.265358+0000","last_clean":"2024-09-21T06:34:44.265358+0000","last_became_active":"2024-09-21T06:34:21.934601+0000","last_became_peered":"2024-09-21T06:34:21.934601+0000","last_unstale":"2024-09-21T06:34:44.265358+0000","last_undegraded":"2024-09-21T06:34:44.265358+0000","last_fullsized":"2024-09-21T06:34:44.265358+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:30.836070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.224206+0000","last_change":"2024-09-21T06:34:23.947661+0000","last_active":"2024-09-21T06:34:44.224206+0000","last_peered":"2024-09-21T06:34:44.224206+0000","last_clean":"2024-09-21T06:34:44.224206+0000","last_became_active":"2024-09-21T06:34:23.947307+0000","last_became_peered":"2024-09-21T06:34:23.947307+0000","last_unstale":"2024-09-21T06:34:44.224206+0000","last_undegraded":"2024-09-21T06:34:44.224206+0000","last_fullsized":"2024-09-21T06:34:44.224206+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:08.045291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'4","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.230116+0000","last_change":"2024-09-21T06:34:21.942749+0000","last_active":"2024-09-21T06:34:44.230116+0000","last_peered":"2024-09-21T06:34:44.230116+0000","last_clean":"2024-09-21T06:34:44.230116+0000","last_became_active":"2024-09-21T06:34:21.942283+0000","last_became_peered":"2024-09-21T06:34:21.942283+0000","last_unstale":"2024-09-21T06:34:44.230116+0000","last_undegraded":"2024-09-21T06:34:44.230116+0000","last_fullsized":"2024-09-21T06:34:44.230116+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:47.477956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.266544+0000","last_change":"2024-09-21T06:34:23.957389+0000","last_active":"2024-09-21T06:34:44.266544+0000","last_peered":"2024-09-21T06:34:44.266544+0000","last_clean":"2024-09-21T06:34:44.266544+0000","last_became_active":"2024-09-21T06:34:23.957032+0000","last_became_peered":"2024-09-21T06:34:23.957032+0000","last_unstale":"2024-09-21T06:34:44.266544+0000","last_undegraded":"2024-09-21T06:34:44.266544+0000","last_fullsized":"2024-09-21T06:34:44.266544+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:00:53.932062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.227302+0000","last_change":"2024-09-21T06:34:23.957304+0000","last_active":"2024-09-21T06:34:44.227302+0000","last_peered":"2024-09-21T06:34:44.227302+0000","last_clean":"2024-09-21T06:34:44.227302+0000","last_became_active":"2024-09-21T06:34:23.956931+0000","last_became_peered":"2024-09-21T06:34:23.956931+0000","last_unstale":"2024-09-21T06:34:44.227302+0000","last_undegraded":"2024-09-21T06:34:44.227302+0000","last_fullsized":"2024-09-21T06:34:44.227302+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:14:12.240686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.230138+0000","last_change":"2024-09-21T06:34:21.937150+0000","last_active":"2024-09-21T06:34:44.230138+0000","last_peered":"2024-09-21T06:34:44.230138+0000","last_clean":"2024-09-21T06:34:44.230138+0000","last_became_active":"2024-09-21T06:34:21.936037+0000","last_became_peered":"2024-09-21T06:34:21.936037+0000","last_unstale":"2024-09-21T06:34:44.230138+0000","last_undegraded":"2024-09-21T06:34:44.230138+0000","last_fullsized":"2024-09-21T06:34:44.230138+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:24:44.821346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265815+0000","last_change":"2024-09-21T06:34:23.955585+0000","last_active":"2024-09-21T06:34:44.265815+0000","last_peered":"2024-09-21T06:34:44.265815+0000","last_clean":"2024-09-21T06:34:44.265815+0000","last_became_active":"2024-09-21T06:34:23.955225+0000","last_became_peered":"2024-09-21T06:34:23.955225+0000","last_unstale":"2024-09-21T06:34:44.265815+0000","last_undegraded":"2024-09-21T06:34:44.265815+0000","last_fullsized":"2024-09-21T06:34:44.265815+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:07:56.735854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'4","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.230684+0000","last_change":"2024-09-21T06:34:21.941804+0000","last_active":"2024-09-21T06:34:44.230684+0000","last_peered":"2024-09-21T06:34:44.230684+0000","last_clean":"2024-09-21T06:34:44.230684+0000","last_became_active":"2024-09-21T06:34:21.941387+0000","last_became_peered":"2024-09-21T06:34:21.941387+0000","last_unstale":"2024-09-21T06:34:44.230684+0000","last_undegraded":"2024-09-21T06:34:44.230684+0000","last_fullsized":"2024-09-21T06:34:44.230684+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:34:51.217549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265988+0000","last_change":"2024-09-21T06:34:23.957429+0000","last_active":"2024-09-21T06:34:44.265988+0000","last_peered":"2024-09-21T06:34:44.265988+0000","last_clean":"2024-09-21T06:34:44.265988+0000","last_became_active":"2024-09-21T06:34:23.956471+0000","last_became_peered":"2024-09-21T06:34:23.956471+0000","last_unstale":"2024-09-21T06:34:44.265988+0000","last_undegraded":"2024-09-21T06:34:44.265988+0000","last_fullsized":"2024-09-21T06:34:44.265988+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:46:26.770549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.224539+0000","last_change":"2024-09-21T06:34:22.096267+0000","last_active":"2024-09-21T06:34:44.224539+0000","last_peered":"2024-09-21T06:34:44.224539+0000","last_clean":"2024-09-21T06:34:44.224539+0000","last_became_active":"2024-09-21T06:34:22.095799+0000","last_became_peered":"2024-09-21T06:34:22.095799+0000","last_unstale":"2024-09-21T06:34:44.224539+0000","last_undegraded":"2024-09-21T06:34:44.224539+0000","last_fullsized":"2024-09-21T06:34:44.224539+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:29:00.075016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.224392+0000","last_change":"2024-09-21T06:34:23.952294+0000","last_active":"2024-09-21T06:34:44.224392+0000","last_peered":"2024-09-21T06:34:44.224392+0000","last_clean":"2024-09-21T06:34:44.224392+0000","last_became_active":"2024-09-21T06:34:23.951919+0000","last_became_peered":"2024-09-21T06:34:23.951919+0000","last_unstale":"2024-09-21T06:34:44.224392+0000","last_undegraded":"2024-09-21T06:34:44.224392+0000","last_fullsized":"2024-09-21T06:34:44.224392+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:30:28.039754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'9","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.226566+0000","last_change":"2024-09-21T06:34:21.934818+0000","last_active":"2024-09-21T06:34:44.226566+0000","last_peered":"2024-09-21T06:34:44.226566+0000","last_clean":"2024-09-21T06:34:44.226566+0000","last_became_active":"2024-09-21T06:34:21.934415+0000","last_became_peered":"2024-09-21T06:34:21.934415+0000","last_unstale":"2024-09-21T06:34:44.226566+0000","last_undegraded":"2024-09-21T06:34:44.226566+0000","last_fullsized":"2024-09-21T06:34:44.226566+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:25:48.460699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68602,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":620,"num_read_kb":381,"num_write":164,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":11,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":205806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":140,"ondisk_log_size":140,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282715,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743459,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27840,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717312,"statfs":{"total":95995035648,"available":95966527488,"internally_reserved":0,"allocated":835584,"data_stored":417151,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939687,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":991232,"data_stored":1073233,"data_compressed":41743,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103213,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27856,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717296,"statfs":{"total":95995035648,"available":95966511104,"internally_reserved":0,"allocated":851968,"data_stored":417387,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299442,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32024,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713128,"statfs":{"total":95995035648,"available":95962243072,"internally_reserved":0,"allocated":851968,"data_stored":417307,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462967,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":901120,"data_stored":1009628,"data_compressed":41743,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626492,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36172,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708980,"statfs":{"total":95995035648,"available":95957995520,"internally_reserved":0,"allocated":839680,"data_stored":416776,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822722,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":913408,"data_stored":1008921,"data_compressed":41743,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986248,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36168,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708984,"statfs":{"total":95995035648,"available":95957999616,"internally_reserved":0,"allocated":843776,"data_stored":417604,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182476,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36180,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708972,"statfs":{"total":95995035648,"available":95957987328,"internally_reserved":0,"allocated":856064,"data_stored":417087,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378706,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32092,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713060,"statfs":{"total":95995035648,"available":95962173440,"internally_reserved":0,"allocated":929792,"data_stored":482520,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542231,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":480779,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705755,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27872,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717280,"statfs":{"total":95995035648,"available":95966494720,"internally_reserved":0,"allocated":860160,"data_stored":418047,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34325,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34325,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34325,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":64210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":65951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":66179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T06:36:14.340 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T06:36:14.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.488+0000 7fd70dabd640 1 -- 172.21.15.7:0/4039653415 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd708108c50 msgr2=0x7fd70810f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:14.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.488+0000 7fd70dabd640 1 --2- 172.21.15.7:0/4039653415 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd708108c50 0x7fd70810f480 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fd700009900 tx=0x7fd70002a410 comp rx=0 tx=0).stop 2024-09-21T06:36:14.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.488+0000 7fd70dabd640 1 -- 172.21.15.7:0/4039653415 shutdown_connections 2024-09-21T06:36:14.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.488+0000 7fd70dabd640 1 --2- 172.21.15.7:0/4039653415 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd708108c50 0x7fd70810f480 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:14.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.488+0000 7fd70dabd640 1 --2- 172.21.15.7:0/4039653415 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd708108300 0x7fd708108710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:14.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.488+0000 7fd70dabd640 1 --2- 172.21.15.7:0/4039653415 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd7081029d0 0x7fd708102de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:14.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.488+0000 7fd70dabd640 1 -- 172.21.15.7:0/4039653415 >> 172.21.15.7:0/4039653415 conn(0x7fd70807a660 msgr2=0x7fd70807aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:14.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.488+0000 7fd70dabd640 1 -- 172.21.15.7:0/4039653415 shutdown_connections 2024-09-21T06:36:14.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.488+0000 7fd70dabd640 1 -- 172.21.15.7:0/4039653415 wait complete. 2024-09-21T06:36:14.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.489+0000 7fd70dabd640 1 Processor -- start 2024-09-21T06:36:14.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.489+0000 7fd70dabd640 1 -- start start 2024-09-21T06:36:14.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.489+0000 7fd70dabd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd7081029d0 0x7fd7081992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:14.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.489+0000 7fd70dabd640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd708108300 0x7fd708199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:14.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.489+0000 7fd70dabd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd708108c50 0x7fd70819eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:14.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.489+0000 7fd70dabd640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd708112910 con 0x7fd708108c50 2024-09-21T06:36:14.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.489+0000 7fd70dabd640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd708112790 con 0x7fd7081029d0 2024-09-21T06:36:14.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.489+0000 7fd70dabd640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd708112a90 con 0x7fd708108300 2024-09-21T06:36:14.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.489+0000 7fd707fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd708108c50 0x7fd70819eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:14.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.489+0000 7fd7077fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd7081029d0 0x7fd7081992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:14.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.489+0000 7fd707fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd708108c50 0x7fd70819eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42414/0 (socket says 172.21.15.7:42414) 2024-09-21T06:36:14.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.489+0000 7fd707fff640 1 -- 172.21.15.7:0/2473354730 learned_addr learned my addr 172.21.15.7:0/2473354730 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:36:14.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.489+0000 7fd706ffd640 1 --2- 172.21.15.7:0/2473354730 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd708108300 0x7fd708199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:14.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.490+0000 7fd707fff640 1 -- 172.21.15.7:0/2473354730 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd708108300 msgr2=0x7fd708199890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:14.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.490+0000 7fd707fff640 1 --2- 172.21.15.7:0/2473354730 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd708108300 0x7fd708199890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:14.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.490+0000 7fd707fff640 1 -- 172.21.15.7:0/2473354730 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd7081029d0 msgr2=0x7fd7081992f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:14.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.490+0000 7fd707fff640 1 --2- 172.21.15.7:0/2473354730 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd7081029d0 0x7fd7081992f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:14.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.490+0000 7fd707fff640 1 -- 172.21.15.7:0/2473354730 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd70819f220 con 0x7fd708108c50 2024-09-21T06:36:14.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.490+0000 7fd707fff640 1 --2- 172.21.15.7:0/2473354730 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd708108c50 0x7fd70819eb20 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fd700004770 tx=0x7fd700004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:14.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.490+0000 7fd704ff9640 1 -- 172.21.15.7:0/2473354730 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd70003f030 con 0x7fd708108c50 2024-09-21T06:36:14.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.490+0000 7fd704ff9640 1 -- 172.21.15.7:0/2473354730 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd700003aa0 con 0x7fd708108c50 2024-09-21T06:36:14.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.490+0000 7fd70dabd640 1 -- 172.21.15.7:0/2473354730 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd70819f4b0 con 0x7fd708108c50 2024-09-21T06:36:14.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.490+0000 7fd704ff9640 1 -- 172.21.15.7:0/2473354730 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd700035070 con 0x7fd708108c50 2024-09-21T06:36:14.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.490+0000 7fd70dabd640 1 -- 172.21.15.7:0/2473354730 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7081a5ca0 con 0x7fd708108c50 2024-09-21T06:36:14.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.491+0000 7fd70dabd640 1 -- 172.21.15.7:0/2473354730 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd708103c40 con 0x7fd708108c50 2024-09-21T06:36:14.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.493+0000 7fd704ff9640 1 -- 172.21.15.7:0/2473354730 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154579+0+0 (secure 0 0 0) 0x7fd700042030 con 0x7fd708108c50 2024-09-21T06:36:14.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.494+0000 7fd704ff9640 1 --2- 172.21.15.7:0/2473354730 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fd6f40b65f0 0x7fd6f40b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:14.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.494+0000 7fd7077fe640 1 --2- 172.21.15.7:0/2473354730 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fd6f40b65f0 0x7fd6f40b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:14.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.494+0000 7fd704ff9640 1 -- 172.21.15.7:0/2473354730 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fd700107f00 con 0x7fd708108c50 2024-09-21T06:36:14.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.494+0000 7fd7077fe640 1 --2- 172.21.15.7:0/2473354730 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fd6f40b65f0 0x7fd6f40b8b00 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd6f8005fd0 tx=0x7fd6f8009680 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:14.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.497+0000 7fd704ff9640 1 -- 172.21.15.7:0/2473354730 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd7000d2990 con 0x7fd708108c50 2024-09-21T06:36:14.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.683+0000 7fd70dabd640 1 -- 172.21.15.7:0/2473354730 --> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd708063800 con 0x7fd6f40b65f0 2024-09-21T06:36:14.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.687+0000 7fd704ff9640 1 -- 172.21.15.7:0/2473354730 <== mgr.14223 v2:172.21.15.7:6800/3442812985 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258962 (secure 0 0 0) 0x7fd708063800 con 0x7fd6f40b65f0 2024-09-21T06:36:14.689 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:36:14.698 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-09-21T06:36:14.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.690+0000 7fd70dabd640 1 -- 172.21.15.7:0/2473354730 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fd6f40b65f0 msgr2=0x7fd6f40b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:14.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.690+0000 7fd70dabd640 1 --2- 172.21.15.7:0/2473354730 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fd6f40b65f0 0x7fd6f40b8b00 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd6f8005fd0 tx=0x7fd6f8009680 comp rx=0 tx=0).stop 2024-09-21T06:36:14.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.690+0000 7fd70dabd640 1 -- 172.21.15.7:0/2473354730 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd708108c50 msgr2=0x7fd70819eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:14.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.690+0000 7fd70dabd640 1 --2- 172.21.15.7:0/2473354730 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd708108c50 0x7fd70819eb20 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fd700004770 tx=0x7fd700004270 comp rx=0 tx=0).stop 2024-09-21T06:36:14.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.690+0000 7fd70dabd640 1 -- 172.21.15.7:0/2473354730 shutdown_connections 2024-09-21T06:36:14.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.690+0000 7fd70dabd640 1 --2- 172.21.15.7:0/2473354730 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fd6f40b65f0 0x7fd6f40b8b00 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:14.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.690+0000 7fd70dabd640 1 --2- 172.21.15.7:0/2473354730 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd708108c50 0x7fd70819eb20 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:14.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.690+0000 7fd70dabd640 1 --2- 172.21.15.7:0/2473354730 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd708108300 0x7fd708199890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:14.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.690+0000 7fd70dabd640 1 --2- 172.21.15.7:0/2473354730 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd7081029d0 0x7fd7081992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:14.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.690+0000 7fd70dabd640 1 -- 172.21.15.7:0/2473354730 >> 172.21.15.7:0/2473354730 conn(0x7fd70807a660 msgr2=0x7fd7081042d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:14.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.690+0000 7fd70dabd640 1 -- 172.21.15.7:0/2473354730 shutdown_connections 2024-09-21T06:36:14.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.690+0000 7fd70dabd640 1 -- 172.21.15.7:0/2473354730 wait complete. 2024-09-21T06:36:14.704 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":320,"stamp":"2024-09-21T06:36:13.162038+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659204,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":701,"num_read_kb":450,"num_write":289,"num_write_kb":2269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":2951840,"num_keys_recovered":11,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":234,"ondisk_log_size":234,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":367936,"kb_used_data":10332,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124573888,"statfs":{"total":1151940427776,"available":1151563661312,"internally_reserved":0,"allocated":10579968,"data_stored":6976440,"data_compressed":177384,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":19143,"internal_metadata":365933881},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":308,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":41,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002824"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.225546+0000","last_change":"2024-09-21T06:34:23.958146+0000","last_active":"2024-09-21T06:34:44.225546+0000","last_peered":"2024-09-21T06:34:44.225546+0000","last_clean":"2024-09-21T06:34:44.225546+0000","last_became_active":"2024-09-21T06:34:23.957580+0000","last_became_peered":"2024-09-21T06:34:23.957580+0000","last_unstale":"2024-09-21T06:34:44.225546+0000","last_undegraded":"2024-09-21T06:34:44.225546+0000","last_fullsized":"2024-09-21T06:34:44.225546+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:33:05.975310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265758+0000","last_change":"2024-09-21T06:34:23.948439+0000","last_active":"2024-09-21T06:34:44.265758+0000","last_peered":"2024-09-21T06:34:44.265758+0000","last_clean":"2024-09-21T06:34:44.265758+0000","last_became_active":"2024-09-21T06:34:23.947511+0000","last_became_peered":"2024-09-21T06:34:23.947511+0000","last_unstale":"2024-09-21T06:34:44.265758+0000","last_undegraded":"2024-09-21T06:34:44.265758+0000","last_fullsized":"2024-09-21T06:34:44.265758+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:13:53.589979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.264949+0000","last_change":"2024-09-21T06:34:23.950752+0000","last_active":"2024-09-21T06:34:44.264949+0000","last_peered":"2024-09-21T06:34:44.264949+0000","last_clean":"2024-09-21T06:34:44.264949+0000","last_became_active":"2024-09-21T06:34:23.950373+0000","last_became_peered":"2024-09-21T06:34:23.950373+0000","last_unstale":"2024-09-21T06:34:44.264949+0000","last_undegraded":"2024-09-21T06:34:44.264949+0000","last_fullsized":"2024-09-21T06:34:44.264949+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:01:29.183426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.267740+0000","last_change":"2024-09-21T06:34:44.267265+0000","last_active":"2024-09-21T06:34:44.267740+0000","last_peered":"2024-09-21T06:34:44.267740+0000","last_clean":"2024-09-21T06:34:44.267740+0000","last_became_active":"2024-09-21T06:34:44.266829+0000","last_became_peered":"2024-09-21T06:34:44.266829+0000","last_unstale":"2024-09-21T06:34:44.267740+0000","last_undegraded":"2024-09-21T06:34:44.267740+0000","last_fullsized":"2024-09-21T06:34:44.267740+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:47:57.873167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.229953+0000","last_change":"2024-09-21T06:34:23.947578+0000","last_active":"2024-09-21T06:34:44.229953+0000","last_peered":"2024-09-21T06:34:44.229953+0000","last_clean":"2024-09-21T06:34:44.229953+0000","last_became_active":"2024-09-21T06:34:23.947201+0000","last_became_peered":"2024-09-21T06:34:23.947201+0000","last_unstale":"2024-09-21T06:34:44.229953+0000","last_undegraded":"2024-09-21T06:34:44.229953+0000","last_fullsized":"2024-09-21T06:34:44.229953+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:48:32.279999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.227142+0000","last_change":"2024-09-21T06:34:23.946191+0000","last_active":"2024-09-21T06:34:44.227142+0000","last_peered":"2024-09-21T06:34:44.227142+0000","last_clean":"2024-09-21T06:34:44.227142+0000","last_became_active":"2024-09-21T06:34:23.945817+0000","last_became_peered":"2024-09-21T06:34:23.945817+0000","last_unstale":"2024-09-21T06:34:44.227142+0000","last_undegraded":"2024-09-21T06:34:44.227142+0000","last_fullsized":"2024-09-21T06:34:44.227142+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:29.443444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265435+0000","last_change":"2024-09-21T06:34:23.943433+0000","last_active":"2024-09-21T06:34:44.265435+0000","last_peered":"2024-09-21T06:34:44.265435+0000","last_clean":"2024-09-21T06:34:44.265435+0000","last_became_active":"2024-09-21T06:34:23.943001+0000","last_became_peered":"2024-09-21T06:34:23.943001+0000","last_unstale":"2024-09-21T06:34:44.265435+0000","last_undegraded":"2024-09-21T06:34:44.265435+0000","last_fullsized":"2024-09-21T06:34:44.265435+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:05:10.695083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.223932+0000","last_change":"2024-09-21T06:34:23.954397+0000","last_active":"2024-09-21T06:34:44.223932+0000","last_peered":"2024-09-21T06:34:44.223932+0000","last_clean":"2024-09-21T06:34:44.223932+0000","last_became_active":"2024-09-21T06:34:23.954008+0000","last_became_peered":"2024-09-21T06:34:23.954008+0000","last_unstale":"2024-09-21T06:34:44.223932+0000","last_undegraded":"2024-09-21T06:34:44.223932+0000","last_fullsized":"2024-09-21T06:34:44.223932+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:10:03.764400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.266422+0000","last_change":"2024-09-21T06:34:23.953371+0000","last_active":"2024-09-21T06:34:44.266422+0000","last_peered":"2024-09-21T06:34:44.266422+0000","last_clean":"2024-09-21T06:34:44.266422+0000","last_became_active":"2024-09-21T06:34:23.952864+0000","last_became_peered":"2024-09-21T06:34:23.952864+0000","last_unstale":"2024-09-21T06:34:44.266422+0000","last_undegraded":"2024-09-21T06:34:44.266422+0000","last_fullsized":"2024-09-21T06:34:44.266422+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:44:23.691372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.267477+0000","last_change":"2024-09-21T06:34:44.267366+0000","last_active":"2024-09-21T06:34:44.267477+0000","last_peered":"2024-09-21T06:34:44.267477+0000","last_clean":"2024-09-21T06:34:44.267477+0000","last_became_active":"2024-09-21T06:34:44.266937+0000","last_became_peered":"2024-09-21T06:34:44.266937+0000","last_unstale":"2024-09-21T06:34:44.267477+0000","last_undegraded":"2024-09-21T06:34:44.267477+0000","last_fullsized":"2024-09-21T06:34:44.267477+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:40:00.904219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.266545+0000","last_change":"2024-09-21T06:34:23.958191+0000","last_active":"2024-09-21T06:34:44.266545+0000","last_peered":"2024-09-21T06:34:44.266545+0000","last_clean":"2024-09-21T06:34:44.266545+0000","last_became_active":"2024-09-21T06:34:23.957836+0000","last_became_peered":"2024-09-21T06:34:23.957836+0000","last_unstale":"2024-09-21T06:34:44.266545+0000","last_undegraded":"2024-09-21T06:34:44.266545+0000","last_fullsized":"2024-09-21T06:34:44.266545+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:31:10.201245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.225421+0000","last_change":"2024-09-21T06:34:23.947256+0000","last_active":"2024-09-21T06:34:44.225421+0000","last_peered":"2024-09-21T06:34:44.225421+0000","last_clean":"2024-09-21T06:34:44.225421+0000","last_became_active":"2024-09-21T06:34:23.946029+0000","last_became_peered":"2024-09-21T06:34:23.946029+0000","last_unstale":"2024-09-21T06:34:44.225421+0000","last_undegraded":"2024-09-21T06:34:44.225421+0000","last_fullsized":"2024-09-21T06:34:44.225421+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:47:19.850700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265129+0000","last_change":"2024-09-21T06:34:23.940661+0000","last_active":"2024-09-21T06:34:44.265129+0000","last_peered":"2024-09-21T06:34:44.265129+0000","last_clean":"2024-09-21T06:34:44.265129+0000","last_became_active":"2024-09-21T06:34:23.940306+0000","last_became_peered":"2024-09-21T06:34:23.940306+0000","last_unstale":"2024-09-21T06:34:44.265129+0000","last_undegraded":"2024-09-21T06:34:44.265129+0000","last_fullsized":"2024-09-21T06:34:44.265129+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:19.062435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265265+0000","last_change":"2024-09-21T06:34:23.941906+0000","last_active":"2024-09-21T06:34:44.265265+0000","last_peered":"2024-09-21T06:34:44.265265+0000","last_clean":"2024-09-21T06:34:44.265265+0000","last_became_active":"2024-09-21T06:34:23.941522+0000","last_became_peered":"2024-09-21T06:34:23.941522+0000","last_unstale":"2024-09-21T06:34:44.265265+0000","last_undegraded":"2024-09-21T06:34:44.265265+0000","last_fullsized":"2024-09-21T06:34:44.265265+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:57:12.557051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.264948+0000","last_change":"2024-09-21T06:34:23.957181+0000","last_active":"2024-09-21T06:34:44.264948+0000","last_peered":"2024-09-21T06:34:44.264948+0000","last_clean":"2024-09-21T06:34:44.264948+0000","last_became_active":"2024-09-21T06:34:23.956269+0000","last_became_peered":"2024-09-21T06:34:23.956269+0000","last_unstale":"2024-09-21T06:34:44.264948+0000","last_undegraded":"2024-09-21T06:34:44.264948+0000","last_fullsized":"2024-09-21T06:34:44.264948+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:33:24.989570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265721+0000","last_change":"2024-09-21T06:34:23.951771+0000","last_active":"2024-09-21T06:34:44.265721+0000","last_peered":"2024-09-21T06:34:44.265721+0000","last_clean":"2024-09-21T06:34:44.265721+0000","last_became_active":"2024-09-21T06:34:23.951381+0000","last_became_peered":"2024-09-21T06:34:23.951381+0000","last_unstale":"2024-09-21T06:34:44.265721+0000","last_undegraded":"2024-09-21T06:34:44.265721+0000","last_fullsized":"2024-09-21T06:34:44.265721+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:26:16.049343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.225612+0000","last_change":"2024-09-21T06:34:23.959425+0000","last_active":"2024-09-21T06:34:44.225612+0000","last_peered":"2024-09-21T06:34:44.225612+0000","last_clean":"2024-09-21T06:34:44.225612+0000","last_became_active":"2024-09-21T06:34:23.959022+0000","last_became_peered":"2024-09-21T06:34:23.959022+0000","last_unstale":"2024-09-21T06:34:44.225612+0000","last_undegraded":"2024-09-21T06:34:44.225612+0000","last_fullsized":"2024-09-21T06:34:44.225612+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:19:45.203639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.226736+0000","last_change":"2024-09-21T06:34:23.950510+0000","last_active":"2024-09-21T06:34:44.226736+0000","last_peered":"2024-09-21T06:34:44.226736+0000","last_clean":"2024-09-21T06:34:44.226736+0000","last_became_active":"2024-09-21T06:34:23.950027+0000","last_became_peered":"2024-09-21T06:34:23.950027+0000","last_unstale":"2024-09-21T06:34:44.226736+0000","last_undegraded":"2024-09-21T06:34:44.226736+0000","last_fullsized":"2024-09-21T06:34:44.226736+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:22:23.093554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265658+0000","last_change":"2024-09-21T06:34:23.948824+0000","last_active":"2024-09-21T06:34:44.265658+0000","last_peered":"2024-09-21T06:34:44.265658+0000","last_clean":"2024-09-21T06:34:44.265658+0000","last_became_active":"2024-09-21T06:34:23.948441+0000","last_became_peered":"2024-09-21T06:34:23.948441+0000","last_unstale":"2024-09-21T06:34:44.265658+0000","last_undegraded":"2024-09-21T06:34:44.265658+0000","last_fullsized":"2024-09-21T06:34:44.265658+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:28.498876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.225240+0000","last_change":"2024-09-21T06:34:23.960278+0000","last_active":"2024-09-21T06:34:44.225240+0000","last_peered":"2024-09-21T06:34:44.225240+0000","last_clean":"2024-09-21T06:34:44.225240+0000","last_became_active":"2024-09-21T06:34:23.959737+0000","last_became_peered":"2024-09-21T06:34:23.959737+0000","last_unstale":"2024-09-21T06:34:44.225240+0000","last_undegraded":"2024-09-21T06:34:44.225240+0000","last_fullsized":"2024-09-21T06:34:44.225240+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:50.097954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265247+0000","last_change":"2024-09-21T06:34:23.942797+0000","last_active":"2024-09-21T06:34:44.265247+0000","last_peered":"2024-09-21T06:34:44.265247+0000","last_clean":"2024-09-21T06:34:44.265247+0000","last_became_active":"2024-09-21T06:34:23.942441+0000","last_became_peered":"2024-09-21T06:34:23.942441+0000","last_unstale":"2024-09-21T06:34:44.265247+0000","last_undegraded":"2024-09-21T06:34:44.265247+0000","last_fullsized":"2024-09-21T06:34:44.265247+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:57:30.552583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265998+0000","last_change":"2024-09-21T06:34:23.957433+0000","last_active":"2024-09-21T06:34:44.265998+0000","last_peered":"2024-09-21T06:34:44.265998+0000","last_clean":"2024-09-21T06:34:44.265998+0000","last_became_active":"2024-09-21T06:34:23.957035+0000","last_became_peered":"2024-09-21T06:34:23.957035+0000","last_unstale":"2024-09-21T06:34:44.265998+0000","last_undegraded":"2024-09-21T06:34:44.265998+0000","last_fullsized":"2024-09-21T06:34:44.265998+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:40:18.418705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.224015+0000","last_change":"2024-09-21T06:34:23.950308+0000","last_active":"2024-09-21T06:34:44.224015+0000","last_peered":"2024-09-21T06:34:44.224015+0000","last_clean":"2024-09-21T06:34:44.224015+0000","last_became_active":"2024-09-21T06:34:23.948417+0000","last_became_peered":"2024-09-21T06:34:23.948417+0000","last_unstale":"2024-09-21T06:34:44.224015+0000","last_undegraded":"2024-09-21T06:34:44.224015+0000","last_fullsized":"2024-09-21T06:34:44.224015+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:47.233504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.226437+0000","last_change":"2024-09-21T06:34:23.949369+0000","last_active":"2024-09-21T06:34:44.226437+0000","last_peered":"2024-09-21T06:34:44.226437+0000","last_clean":"2024-09-21T06:34:44.226437+0000","last_became_active":"2024-09-21T06:34:23.948713+0000","last_became_peered":"2024-09-21T06:34:23.948713+0000","last_unstale":"2024-09-21T06:34:44.226437+0000","last_undegraded":"2024-09-21T06:34:44.226437+0000","last_fullsized":"2024-09-21T06:34:44.226437+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:57:06.915379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.224467+0000","last_change":"2024-09-21T06:34:23.959315+0000","last_active":"2024-09-21T06:34:44.224467+0000","last_peered":"2024-09-21T06:34:44.224467+0000","last_clean":"2024-09-21T06:34:44.224467+0000","last_became_active":"2024-09-21T06:34:23.958904+0000","last_became_peered":"2024-09-21T06:34:23.958904+0000","last_unstale":"2024-09-21T06:34:44.224467+0000","last_undegraded":"2024-09-21T06:34:44.224467+0000","last_fullsized":"2024-09-21T06:34:44.224467+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:31:35.486369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265718+0000","last_change":"2024-09-21T06:34:23.952074+0000","last_active":"2024-09-21T06:34:44.265718+0000","last_peered":"2024-09-21T06:34:44.265718+0000","last_clean":"2024-09-21T06:34:44.265718+0000","last_became_active":"2024-09-21T06:34:23.951692+0000","last_became_peered":"2024-09-21T06:34:23.951692+0000","last_unstale":"2024-09-21T06:34:44.265718+0000","last_undegraded":"2024-09-21T06:34:44.265718+0000","last_fullsized":"2024-09-21T06:34:44.265718+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:15:06.300781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.225420+0000","last_change":"2024-09-21T06:34:23.947296+0000","last_active":"2024-09-21T06:34:44.225420+0000","last_peered":"2024-09-21T06:34:44.225420+0000","last_clean":"2024-09-21T06:34:44.225420+0000","last_became_active":"2024-09-21T06:34:23.946392+0000","last_became_peered":"2024-09-21T06:34:23.946392+0000","last_unstale":"2024-09-21T06:34:44.225420+0000","last_undegraded":"2024-09-21T06:34:44.225420+0000","last_fullsized":"2024-09-21T06:34:44.225420+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:05:27.597890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265035+0000","last_change":"2024-09-21T06:34:23.953161+0000","last_active":"2024-09-21T06:34:44.265035+0000","last_peered":"2024-09-21T06:34:44.265035+0000","last_clean":"2024-09-21T06:34:44.265035+0000","last_became_active":"2024-09-21T06:34:23.952811+0000","last_became_peered":"2024-09-21T06:34:23.952811+0000","last_unstale":"2024-09-21T06:34:44.265035+0000","last_undegraded":"2024-09-21T06:34:44.265035+0000","last_fullsized":"2024-09-21T06:34:44.265035+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:04.431094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265586+0000","last_change":"2024-09-21T06:34:23.959880+0000","last_active":"2024-09-21T06:34:44.265586+0000","last_peered":"2024-09-21T06:34:44.265586+0000","last_clean":"2024-09-21T06:34:44.265586+0000","last_became_active":"2024-09-21T06:34:23.959573+0000","last_became_peered":"2024-09-21T06:34:23.959573+0000","last_unstale":"2024-09-21T06:34:44.265586+0000","last_undegraded":"2024-09-21T06:34:44.265586+0000","last_fullsized":"2024-09-21T06:34:44.265586+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:21.921956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265362+0000","last_change":"2024-09-21T06:34:23.947209+0000","last_active":"2024-09-21T06:34:44.265362+0000","last_peered":"2024-09-21T06:34:44.265362+0000","last_clean":"2024-09-21T06:34:44.265362+0000","last_became_active":"2024-09-21T06:34:23.946763+0000","last_became_peered":"2024-09-21T06:34:23.946763+0000","last_unstale":"2024-09-21T06:34:44.265362+0000","last_undegraded":"2024-09-21T06:34:44.265362+0000","last_fullsized":"2024-09-21T06:34:44.265362+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:04:54.050980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265396+0000","last_change":"2024-09-21T06:34:23.955064+0000","last_active":"2024-09-21T06:34:44.265396+0000","last_peered":"2024-09-21T06:34:44.265396+0000","last_clean":"2024-09-21T06:34:44.265396+0000","last_became_active":"2024-09-21T06:34:23.954622+0000","last_became_peered":"2024-09-21T06:34:23.954622+0000","last_unstale":"2024-09-21T06:34:44.265396+0000","last_undegraded":"2024-09-21T06:34:44.265396+0000","last_fullsized":"2024-09-21T06:34:44.265396+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:04:59.056398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.224979+0000","last_change":"2024-09-21T06:34:23.947015+0000","last_active":"2024-09-21T06:34:44.224979+0000","last_peered":"2024-09-21T06:34:44.224979+0000","last_clean":"2024-09-21T06:34:44.224979+0000","last_became_active":"2024-09-21T06:34:23.946569+0000","last_became_peered":"2024-09-21T06:34:23.946569+0000","last_unstale":"2024-09-21T06:34:44.224979+0000","last_undegraded":"2024-09-21T06:34:44.224979+0000","last_fullsized":"2024-09-21T06:34:44.224979+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:50:35.935533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.230155+0000","last_change":"2024-09-21T06:34:23.951126+0000","last_active":"2024-09-21T06:34:44.230155+0000","last_peered":"2024-09-21T06:34:44.230155+0000","last_clean":"2024-09-21T06:34:44.230155+0000","last_became_active":"2024-09-21T06:34:23.950739+0000","last_became_peered":"2024-09-21T06:34:23.950739+0000","last_unstale":"2024-09-21T06:34:44.230155+0000","last_undegraded":"2024-09-21T06:34:44.230155+0000","last_fullsized":"2024-09-21T06:34:44.230155+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:52:43.201135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'6","reported_seq":131,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:36:11.165444+0000","last_change":"2024-09-21T06:34:21.939584+0000","last_active":"2024-09-21T06:36:11.165444+0000","last_peered":"2024-09-21T06:36:11.165444+0000","last_clean":"2024-09-21T06:36:11.165444+0000","last_became_active":"2024-09-21T06:34:21.939233+0000","last_became_peered":"2024-09-21T06:34:21.939233+0000","last_unstale":"2024-09-21T06:36:11.165444+0000","last_undegraded":"2024-09-21T06:36:11.165444+0000","last_fullsized":"2024-09-21T06:36:11.165444+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:54.701803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":102,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.232102+0000","last_change":"2024-09-21T06:34:44.232010+0000","last_active":"2024-09-21T06:34:44.232102+0000","last_peered":"2024-09-21T06:34:44.232102+0000","last_clean":"2024-09-21T06:34:44.232102+0000","last_became_active":"2024-09-21T06:34:44.231590+0000","last_became_peered":"2024-09-21T06:34:44.231590+0000","last_unstale":"2024-09-21T06:34:44.232102+0000","last_undegraded":"2024-09-21T06:34:44.232102+0000","last_fullsized":"2024-09-21T06:34:44.232102+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:33:02.751794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.227410+0000","last_change":"2024-09-21T06:34:21.937418+0000","last_active":"2024-09-21T06:34:44.227410+0000","last_peered":"2024-09-21T06:34:44.227410+0000","last_clean":"2024-09-21T06:34:44.227410+0000","last_became_active":"2024-09-21T06:34:21.937048+0000","last_became_peered":"2024-09-21T06:34:21.937048+0000","last_unstale":"2024-09-21T06:34:44.227410+0000","last_undegraded":"2024-09-21T06:34:44.227410+0000","last_fullsized":"2024-09-21T06:34:44.227410+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:33:38.731444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.264973+0000","last_change":"2024-09-21T06:34:21.932970+0000","last_active":"2024-09-21T06:34:44.264973+0000","last_peered":"2024-09-21T06:34:44.264973+0000","last_clean":"2024-09-21T06:34:44.264973+0000","last_became_active":"2024-09-21T06:34:21.932616+0000","last_became_peered":"2024-09-21T06:34:21.932616+0000","last_unstale":"2024-09-21T06:34:44.264973+0000","last_undegraded":"2024-09-21T06:34:44.264973+0000","last_fullsized":"2024-09-21T06:34:44.264973+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:33:20.611023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.224042+0000","last_change":"2024-09-21T06:34:23.950798+0000","last_active":"2024-09-21T06:34:44.224042+0000","last_peered":"2024-09-21T06:34:44.224042+0000","last_clean":"2024-09-21T06:34:44.224042+0000","last_became_active":"2024-09-21T06:34:23.950475+0000","last_became_peered":"2024-09-21T06:34:23.950475+0000","last_unstale":"2024-09-21T06:34:44.224042+0000","last_undegraded":"2024-09-21T06:34:44.224042+0000","last_fullsized":"2024-09-21T06:34:44.224042+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:43:23.177775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.226659+0000","last_change":"2024-09-21T06:34:21.937860+0000","last_active":"2024-09-21T06:34:44.226659+0000","last_peered":"2024-09-21T06:34:44.226659+0000","last_clean":"2024-09-21T06:34:44.226659+0000","last_became_active":"2024-09-21T06:34:21.937476+0000","last_became_peered":"2024-09-21T06:34:21.937476+0000","last_unstale":"2024-09-21T06:34:44.226659+0000","last_undegraded":"2024-09-21T06:34:44.226659+0000","last_fullsized":"2024-09-21T06:34:44.226659+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:49:06.069197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.226096+0000","last_change":"2024-09-21T06:34:23.944559+0000","last_active":"2024-09-21T06:34:44.226096+0000","last_peered":"2024-09-21T06:34:44.226096+0000","last_clean":"2024-09-21T06:34:44.226096+0000","last_became_active":"2024-09-21T06:34:23.944166+0000","last_became_peered":"2024-09-21T06:34:23.944166+0000","last_unstale":"2024-09-21T06:34:44.226096+0000","last_undegraded":"2024-09-21T06:34:44.226096+0000","last_fullsized":"2024-09-21T06:34:44.226096+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:01:56.532854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"75'3","reported_seq":125,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:36:11.164587+0000","last_change":"2024-09-21T06:34:21.936531+0000","last_active":"2024-09-21T06:36:11.164587+0000","last_peered":"2024-09-21T06:36:11.164587+0000","last_clean":"2024-09-21T06:36:11.164587+0000","last_became_active":"2024-09-21T06:34:21.936087+0000","last_became_peered":"2024-09-21T06:34:21.936087+0000","last_unstale":"2024-09-21T06:36:11.164587+0000","last_undegraded":"2024-09-21T06:36:11.164587+0000","last_fullsized":"2024-09-21T06:36:11.164587+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:27:12.370722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":99,"num_read_kb":99,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.266303+0000","last_change":"2024-09-21T06:34:23.954894+0000","last_active":"2024-09-21T06:34:44.266303+0000","last_peered":"2024-09-21T06:34:44.266303+0000","last_clean":"2024-09-21T06:34:44.266303+0000","last_became_active":"2024-09-21T06:34:23.954186+0000","last_became_peered":"2024-09-21T06:34:23.954186+0000","last_unstale":"2024-09-21T06:34:44.266303+0000","last_undegraded":"2024-09-21T06:34:44.266303+0000","last_fullsized":"2024-09-21T06:34:44.266303+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:18:49.623338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265585+0000","last_change":"2024-09-21T06:34:21.934989+0000","last_active":"2024-09-21T06:34:44.265585+0000","last_peered":"2024-09-21T06:34:44.265585+0000","last_clean":"2024-09-21T06:34:44.265585+0000","last_became_active":"2024-09-21T06:34:21.934550+0000","last_became_peered":"2024-09-21T06:34:21.934550+0000","last_unstale":"2024-09-21T06:34:44.265585+0000","last_undegraded":"2024-09-21T06:34:44.265585+0000","last_fullsized":"2024-09-21T06:34:44.265585+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:59:17.849338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265984+0000","last_change":"2024-09-21T06:34:23.956190+0000","last_active":"2024-09-21T06:34:44.265984+0000","last_peered":"2024-09-21T06:34:44.265984+0000","last_clean":"2024-09-21T06:34:44.265984+0000","last_became_active":"2024-09-21T06:34:23.955815+0000","last_became_peered":"2024-09-21T06:34:23.955815+0000","last_unstale":"2024-09-21T06:34:44.265984+0000","last_undegraded":"2024-09-21T06:34:44.265984+0000","last_fullsized":"2024-09-21T06:34:44.265984+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:14:56.165350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'4","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.227080+0000","last_change":"2024-09-21T06:34:22.096480+0000","last_active":"2024-09-21T06:34:44.227080+0000","last_peered":"2024-09-21T06:34:44.227080+0000","last_clean":"2024-09-21T06:34:44.227080+0000","last_became_active":"2024-09-21T06:34:22.095921+0000","last_became_peered":"2024-09-21T06:34:22.095921+0000","last_unstale":"2024-09-21T06:34:44.227080+0000","last_undegraded":"2024-09-21T06:34:44.227080+0000","last_fullsized":"2024-09-21T06:34:44.227080+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:19:30.006811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265960+0000","last_change":"2024-09-21T06:34:23.961840+0000","last_active":"2024-09-21T06:34:44.265960+0000","last_peered":"2024-09-21T06:34:44.265960+0000","last_clean":"2024-09-21T06:34:44.265960+0000","last_became_active":"2024-09-21T06:34:23.961313+0000","last_became_peered":"2024-09-21T06:34:23.961313+0000","last_unstale":"2024-09-21T06:34:44.265960+0000","last_undegraded":"2024-09-21T06:34:44.265960+0000","last_fullsized":"2024-09-21T06:34:44.265960+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:29:04.308598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"77'30","reported_seq":260,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:36:12.166573+0000","last_change":"2024-09-21T06:34:21.937326+0000","last_active":"2024-09-21T06:36:12.166573+0000","last_peered":"2024-09-21T06:36:12.166573+0000","last_clean":"2024-09-21T06:36:12.166573+0000","last_became_active":"2024-09-21T06:34:21.936940+0000","last_became_peered":"2024-09-21T06:34:21.936940+0000","last_unstale":"2024-09-21T06:36:12.166573+0000","last_undegraded":"2024-09-21T06:36:12.166573+0000","last_fullsized":"2024-09-21T06:36:12.166573+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:47:12.988306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64210,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":207,"num_read_kb":166,"num_write":31,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.230328+0000","last_change":"2024-09-21T06:34:23.950167+0000","last_active":"2024-09-21T06:34:44.230328+0000","last_peered":"2024-09-21T06:34:44.230328+0000","last_clean":"2024-09-21T06:34:44.230328+0000","last_became_active":"2024-09-21T06:34:23.949697+0000","last_became_peered":"2024-09-21T06:34:23.949697+0000","last_unstale":"2024-09-21T06:34:44.230328+0000","last_undegraded":"2024-09-21T06:34:44.230328+0000","last_fullsized":"2024-09-21T06:34:44.230328+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:37:48.882644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'6","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265516+0000","last_change":"2024-09-21T06:34:21.937366+0000","last_active":"2024-09-21T06:34:44.265516+0000","last_peered":"2024-09-21T06:34:44.265516+0000","last_clean":"2024-09-21T06:34:44.265516+0000","last_became_active":"2024-09-21T06:34:21.936988+0000","last_became_peered":"2024-09-21T06:34:21.936988+0000","last_unstale":"2024-09-21T06:34:44.265516+0000","last_undegraded":"2024-09-21T06:34:44.265516+0000","last_fullsized":"2024-09-21T06:34:44.265516+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:48:06.318645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265352+0000","last_change":"2024-09-21T06:34:23.947523+0000","last_active":"2024-09-21T06:34:44.265352+0000","last_peered":"2024-09-21T06:34:44.265352+0000","last_clean":"2024-09-21T06:34:44.265352+0000","last_became_active":"2024-09-21T06:34:23.947150+0000","last_became_peered":"2024-09-21T06:34:23.947150+0000","last_unstale":"2024-09-21T06:34:44.265352+0000","last_undegraded":"2024-09-21T06:34:44.265352+0000","last_fullsized":"2024-09-21T06:34:44.265352+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:18:50.417153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.226854+0000","last_change":"2024-09-21T06:34:21.938631+0000","last_active":"2024-09-21T06:34:44.226854+0000","last_peered":"2024-09-21T06:34:44.226854+0000","last_clean":"2024-09-21T06:34:44.226854+0000","last_became_active":"2024-09-21T06:34:21.938242+0000","last_became_peered":"2024-09-21T06:34:21.938242+0000","last_unstale":"2024-09-21T06:34:44.226854+0000","last_undegraded":"2024-09-21T06:34:44.226854+0000","last_fullsized":"2024-09-21T06:34:44.226854+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:40:02.056812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265725+0000","last_change":"2024-09-21T06:34:23.945276+0000","last_active":"2024-09-21T06:34:44.265725+0000","last_peered":"2024-09-21T06:34:44.265725+0000","last_clean":"2024-09-21T06:34:44.265725+0000","last_became_active":"2024-09-21T06:34:23.944914+0000","last_became_peered":"2024-09-21T06:34:23.944914+0000","last_unstale":"2024-09-21T06:34:44.265725+0000","last_undegraded":"2024-09-21T06:34:44.265725+0000","last_fullsized":"2024-09-21T06:34:44.265725+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:15:23.650908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"75'4","reported_seq":129,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:36:11.185383+0000","last_change":"2024-09-21T06:34:21.937593+0000","last_active":"2024-09-21T06:36:11.185383+0000","last_peered":"2024-09-21T06:36:11.185383+0000","last_clean":"2024-09-21T06:36:11.185383+0000","last_became_active":"2024-09-21T06:34:21.936851+0000","last_became_peered":"2024-09-21T06:34:21.936851+0000","last_unstale":"2024-09-21T06:36:11.185383+0000","last_undegraded":"2024-09-21T06:36:11.185383+0000","last_fullsized":"2024-09-21T06:36:11.185383+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:25:36.161431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265345+0000","last_change":"2024-09-21T06:34:23.945573+0000","last_active":"2024-09-21T06:34:44.265345+0000","last_peered":"2024-09-21T06:34:44.265345+0000","last_clean":"2024-09-21T06:34:44.265345+0000","last_became_active":"2024-09-21T06:34:23.944410+0000","last_became_peered":"2024-09-21T06:34:23.944410+0000","last_unstale":"2024-09-21T06:34:44.265345+0000","last_undegraded":"2024-09-21T06:34:44.265345+0000","last_fullsized":"2024-09-21T06:34:44.265345+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:33:54.613524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'15","reported_seq":39,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.229900+0000","last_change":"2024-09-21T06:34:22.096539+0000","last_active":"2024-09-21T06:34:44.229900+0000","last_peered":"2024-09-21T06:34:44.229900+0000","last_clean":"2024-09-21T06:34:44.229900+0000","last_became_active":"2024-09-21T06:34:22.096013+0000","last_became_peered":"2024-09-21T06:34:22.096013+0000","last_unstale":"2024-09-21T06:34:44.229900+0000","last_undegraded":"2024-09-21T06:34:44.229900+0000","last_fullsized":"2024-09-21T06:34:44.229900+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:30:59.414325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.226688+0000","last_change":"2024-09-21T06:34:23.958381+0000","last_active":"2024-09-21T06:34:44.226688+0000","last_peered":"2024-09-21T06:34:44.226688+0000","last_clean":"2024-09-21T06:34:44.226688+0000","last_became_active":"2024-09-21T06:34:23.957965+0000","last_became_peered":"2024-09-21T06:34:23.957965+0000","last_unstale":"2024-09-21T06:34:44.226688+0000","last_undegraded":"2024-09-21T06:34:44.226688+0000","last_fullsized":"2024-09-21T06:34:44.226688+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:37:43.474777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'2","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.230733+0000","last_change":"2024-09-21T06:34:21.937612+0000","last_active":"2024-09-21T06:34:44.230733+0000","last_peered":"2024-09-21T06:34:44.230733+0000","last_clean":"2024-09-21T06:34:44.230733+0000","last_became_active":"2024-09-21T06:34:21.936859+0000","last_became_peered":"2024-09-21T06:34:21.936859+0000","last_unstale":"2024-09-21T06:34:44.230733+0000","last_undegraded":"2024-09-21T06:34:44.230733+0000","last_fullsized":"2024-09-21T06:34:44.230733+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:40.957217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.229139+0000","last_change":"2024-09-21T06:34:44.228991+0000","last_active":"2024-09-21T06:34:44.229139+0000","last_peered":"2024-09-21T06:34:44.229139+0000","last_clean":"2024-09-21T06:34:44.229139+0000","last_became_active":"2024-09-21T06:34:44.228428+0000","last_became_peered":"2024-09-21T06:34:44.228428+0000","last_unstale":"2024-09-21T06:34:44.229139+0000","last_undegraded":"2024-09-21T06:34:44.229139+0000","last_fullsized":"2024-09-21T06:34:44.229139+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:21.719532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265523+0000","last_change":"2024-09-21T06:34:21.933392+0000","last_active":"2024-09-21T06:34:44.265523+0000","last_peered":"2024-09-21T06:34:44.265523+0000","last_clean":"2024-09-21T06:34:44.265523+0000","last_became_active":"2024-09-21T06:34:21.932999+0000","last_became_peered":"2024-09-21T06:34:21.932999+0000","last_unstale":"2024-09-21T06:34:44.265523+0000","last_undegraded":"2024-09-21T06:34:44.265523+0000","last_fullsized":"2024-09-21T06:34:44.265523+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:05:20.631755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.266194+0000","last_change":"2024-09-21T06:34:23.944675+0000","last_active":"2024-09-21T06:34:44.266194+0000","last_peered":"2024-09-21T06:34:44.266194+0000","last_clean":"2024-09-21T06:34:44.266194+0000","last_became_active":"2024-09-21T06:34:23.944258+0000","last_became_peered":"2024-09-21T06:34:23.944258+0000","last_unstale":"2024-09-21T06:34:44.266194+0000","last_undegraded":"2024-09-21T06:34:44.266194+0000","last_fullsized":"2024-09-21T06:34:44.266194+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:26:40.661840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'1","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.227259+0000","last_change":"2024-09-21T06:34:21.941064+0000","last_active":"2024-09-21T06:34:44.227259+0000","last_peered":"2024-09-21T06:34:44.227259+0000","last_clean":"2024-09-21T06:34:44.227259+0000","last_became_active":"2024-09-21T06:34:21.940667+0000","last_became_peered":"2024-09-21T06:34:21.940667+0000","last_unstale":"2024-09-21T06:34:44.227259+0000","last_undegraded":"2024-09-21T06:34:44.227259+0000","last_fullsized":"2024-09-21T06:34:44.227259+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:20:14.721719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'1","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.266571+0000","last_change":"2024-09-21T06:34:23.943503+0000","last_active":"2024-09-21T06:34:44.266571+0000","last_peered":"2024-09-21T06:34:44.266571+0000","last_clean":"2024-09-21T06:34:44.266571+0000","last_became_active":"2024-09-21T06:34:23.943097+0000","last_became_peered":"2024-09-21T06:34:23.943097+0000","last_unstale":"2024-09-21T06:34:44.266571+0000","last_undegraded":"2024-09-21T06:34:44.266571+0000","last_fullsized":"2024-09-21T06:34:44.266571+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:08:04.641273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"75'3","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265879+0000","last_change":"2024-09-21T06:34:22.096274+0000","last_active":"2024-09-21T06:34:44.265879+0000","last_peered":"2024-09-21T06:34:44.265879+0000","last_clean":"2024-09-21T06:34:44.265879+0000","last_became_active":"2024-09-21T06:34:22.095861+0000","last_became_peered":"2024-09-21T06:34:22.095861+0000","last_unstale":"2024-09-21T06:34:44.265879+0000","last_undegraded":"2024-09-21T06:34:44.265879+0000","last_fullsized":"2024-09-21T06:34:44.265879+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:22:47.807488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.266601+0000","last_change":"2024-09-21T06:34:23.953503+0000","last_active":"2024-09-21T06:34:44.266601+0000","last_peered":"2024-09-21T06:34:44.266601+0000","last_clean":"2024-09-21T06:34:44.266601+0000","last_became_active":"2024-09-21T06:34:23.952880+0000","last_became_peered":"2024-09-21T06:34:23.952880+0000","last_unstale":"2024-09-21T06:34:44.266601+0000","last_undegraded":"2024-09-21T06:34:44.266601+0000","last_fullsized":"2024-09-21T06:34:44.266601+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:29:47.746678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":98,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265624+0000","last_change":"2024-09-21T06:33:09.908154+0000","last_active":"2024-09-21T06:34:44.265624+0000","last_peered":"2024-09-21T06:34:44.265624+0000","last_clean":"2024-09-21T06:34:44.265624+0000","last_became_active":"2024-09-21T06:33:09.902397+0000","last_became_peered":"2024-09-21T06:33:09.902397+0000","last_unstale":"2024-09-21T06:34:44.265624+0000","last_undegraded":"2024-09-21T06:34:44.265624+0000","last_fullsized":"2024-09-21T06:34:44.265624+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:29:42.295555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:29:42.295555+0000","last_clean_scrub_stamp":"2024-09-21T06:29:42.295555+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:15:17.111178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"75'3","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.225389+0000","last_change":"2024-09-21T06:34:21.932618+0000","last_active":"2024-09-21T06:34:44.225389+0000","last_peered":"2024-09-21T06:34:44.225389+0000","last_clean":"2024-09-21T06:34:44.225389+0000","last_became_active":"2024-09-21T06:34:21.932187+0000","last_became_peered":"2024-09-21T06:34:21.932187+0000","last_unstale":"2024-09-21T06:34:44.225389+0000","last_undegraded":"2024-09-21T06:34:44.225389+0000","last_fullsized":"2024-09-21T06:34:44.225389+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:19:06.780448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.224167+0000","last_change":"2024-09-21T06:34:23.953580+0000","last_active":"2024-09-21T06:34:44.224167+0000","last_peered":"2024-09-21T06:34:44.224167+0000","last_clean":"2024-09-21T06:34:44.224167+0000","last_became_active":"2024-09-21T06:34:23.952222+0000","last_became_peered":"2024-09-21T06:34:23.952222+0000","last_unstale":"2024-09-21T06:34:44.224167+0000","last_undegraded":"2024-09-21T06:34:44.224167+0000","last_fullsized":"2024-09-21T06:34:44.224167+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:19.759042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265531+0000","last_change":"2024-09-21T06:34:21.939178+0000","last_active":"2024-09-21T06:34:44.265531+0000","last_peered":"2024-09-21T06:34:44.265531+0000","last_clean":"2024-09-21T06:34:44.265531+0000","last_became_active":"2024-09-21T06:34:21.938755+0000","last_became_peered":"2024-09-21T06:34:21.938755+0000","last_unstale":"2024-09-21T06:34:44.265531+0000","last_undegraded":"2024-09-21T06:34:44.265531+0000","last_fullsized":"2024-09-21T06:34:44.265531+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:10.474432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.264822+0000","last_change":"2024-09-21T06:34:23.954196+0000","last_active":"2024-09-21T06:34:44.264822+0000","last_peered":"2024-09-21T06:34:44.264822+0000","last_clean":"2024-09-21T06:34:44.264822+0000","last_became_active":"2024-09-21T06:34:23.953843+0000","last_became_peered":"2024-09-21T06:34:23.953843+0000","last_unstale":"2024-09-21T06:34:44.264822+0000","last_undegraded":"2024-09-21T06:34:44.264822+0000","last_fullsized":"2024-09-21T06:34:44.264822+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:41:02.896704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"75'4","reported_seq":123,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:36:08.180205+0000","last_change":"2024-09-21T06:34:22.095920+0000","last_active":"2024-09-21T06:36:08.180205+0000","last_peered":"2024-09-21T06:36:08.180205+0000","last_clean":"2024-09-21T06:36:08.180205+0000","last_became_active":"2024-09-21T06:34:22.095376+0000","last_became_peered":"2024-09-21T06:34:22.095376+0000","last_unstale":"2024-09-21T06:36:08.180205+0000","last_undegraded":"2024-09-21T06:36:08.180205+0000","last_fullsized":"2024-09-21T06:36:08.180205+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:40:44.400566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":96,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.226479+0000","last_change":"2024-09-21T06:34:23.956541+0000","last_active":"2024-09-21T06:34:44.226479+0000","last_peered":"2024-09-21T06:34:44.226479+0000","last_clean":"2024-09-21T06:34:44.226479+0000","last_became_active":"2024-09-21T06:34:23.956150+0000","last_became_peered":"2024-09-21T06:34:23.956150+0000","last_unstale":"2024-09-21T06:34:44.226479+0000","last_undegraded":"2024-09-21T06:34:44.226479+0000","last_fullsized":"2024-09-21T06:34:44.226479+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:09:32.432391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.266674+0000","last_change":"2024-09-21T06:34:21.942244+0000","last_active":"2024-09-21T06:34:44.266674+0000","last_peered":"2024-09-21T06:34:44.266674+0000","last_clean":"2024-09-21T06:34:44.266674+0000","last_became_active":"2024-09-21T06:34:21.941761+0000","last_became_peered":"2024-09-21T06:34:21.941761+0000","last_unstale":"2024-09-21T06:34:44.266674+0000","last_undegraded":"2024-09-21T06:34:44.266674+0000","last_fullsized":"2024-09-21T06:34:44.266674+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:10.507103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.227647+0000","last_change":"2024-09-21T06:34:23.951250+0000","last_active":"2024-09-21T06:34:44.227647+0000","last_peered":"2024-09-21T06:34:44.227647+0000","last_clean":"2024-09-21T06:34:44.227647+0000","last_became_active":"2024-09-21T06:34:23.950015+0000","last_became_peered":"2024-09-21T06:34:23.950015+0000","last_unstale":"2024-09-21T06:34:44.227647+0000","last_undegraded":"2024-09-21T06:34:44.227647+0000","last_fullsized":"2024-09-21T06:34:44.227647+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:53:22.884049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.266799+0000","last_change":"2024-09-21T06:34:44.266717+0000","last_active":"2024-09-21T06:34:44.266799+0000","last_peered":"2024-09-21T06:34:44.266799+0000","last_clean":"2024-09-21T06:34:44.266799+0000","last_became_active":"2024-09-21T06:34:44.266256+0000","last_became_peered":"2024-09-21T06:34:44.266256+0000","last_unstale":"2024-09-21T06:34:44.266799+0000","last_undegraded":"2024-09-21T06:34:44.266799+0000","last_fullsized":"2024-09-21T06:34:44.266799+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:38:04.674592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'1","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.227589+0000","last_change":"2024-09-21T06:34:23.947823+0000","last_active":"2024-09-21T06:34:44.227589+0000","last_peered":"2024-09-21T06:34:44.227589+0000","last_clean":"2024-09-21T06:34:44.227589+0000","last_became_active":"2024-09-21T06:34:23.947362+0000","last_became_peered":"2024-09-21T06:34:23.947362+0000","last_unstale":"2024-09-21T06:34:44.227589+0000","last_undegraded":"2024-09-21T06:34:44.227589+0000","last_fullsized":"2024-09-21T06:34:44.227589+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:32:22.401819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"75'1","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.230506+0000","last_change":"2024-09-21T06:34:22.096537+0000","last_active":"2024-09-21T06:34:44.230506+0000","last_peered":"2024-09-21T06:34:44.230506+0000","last_clean":"2024-09-21T06:34:44.230506+0000","last_became_active":"2024-09-21T06:34:22.095875+0000","last_became_peered":"2024-09-21T06:34:22.095875+0000","last_unstale":"2024-09-21T06:34:44.230506+0000","last_undegraded":"2024-09-21T06:34:44.230506+0000","last_fullsized":"2024-09-21T06:34:44.230506+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:11:44.955531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265151+0000","last_change":"2024-09-21T06:34:23.938784+0000","last_active":"2024-09-21T06:34:44.265151+0000","last_peered":"2024-09-21T06:34:44.265151+0000","last_clean":"2024-09-21T06:34:44.265151+0000","last_became_active":"2024-09-21T06:34:23.938400+0000","last_became_peered":"2024-09-21T06:34:23.938400+0000","last_unstale":"2024-09-21T06:34:44.265151+0000","last_undegraded":"2024-09-21T06:34:44.265151+0000","last_fullsized":"2024-09-21T06:34:44.265151+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:00:13.210874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"77'10","reported_seq":46,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:48.958566+0000","last_change":"2024-09-21T06:34:44.235532+0000","last_active":"2024-09-21T06:34:48.958566+0000","last_peered":"2024-09-21T06:34:48.958566+0000","last_clean":"2024-09-21T06:34:48.958566+0000","last_became_active":"2024-09-21T06:34:44.230220+0000","last_became_peered":"2024-09-21T06:34:44.230220+0000","last_unstale":"2024-09-21T06:34:48.958566+0000","last_undegraded":"2024-09-21T06:34:48.958566+0000","last_fullsized":"2024-09-21T06:34:48.958566+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:07:23.398177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":11,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.224475+0000","last_change":"2024-09-21T06:34:23.953477+0000","last_active":"2024-09-21T06:34:44.224475+0000","last_peered":"2024-09-21T06:34:44.224475+0000","last_clean":"2024-09-21T06:34:44.224475+0000","last_became_active":"2024-09-21T06:34:23.951404+0000","last_became_peered":"2024-09-21T06:34:23.951404+0000","last_unstale":"2024-09-21T06:34:44.224475+0000","last_undegraded":"2024-09-21T06:34:44.224475+0000","last_fullsized":"2024-09-21T06:34:44.224475+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:13:17.126680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'4","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.225262+0000","last_change":"2024-09-21T06:34:22.031837+0000","last_active":"2024-09-21T06:34:44.225262+0000","last_peered":"2024-09-21T06:34:44.225262+0000","last_clean":"2024-09-21T06:34:44.225262+0000","last_became_active":"2024-09-21T06:34:22.031377+0000","last_became_peered":"2024-09-21T06:34:22.031377+0000","last_unstale":"2024-09-21T06:34:44.225262+0000","last_undegraded":"2024-09-21T06:34:44.225262+0000","last_fullsized":"2024-09-21T06:34:44.225262+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:14:32.536634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265835+0000","last_change":"2024-09-21T06:34:23.955321+0000","last_active":"2024-09-21T06:34:44.265835+0000","last_peered":"2024-09-21T06:34:44.265835+0000","last_clean":"2024-09-21T06:34:44.265835+0000","last_became_active":"2024-09-21T06:34:23.954906+0000","last_became_peered":"2024-09-21T06:34:23.954906+0000","last_unstale":"2024-09-21T06:34:44.265835+0000","last_undegraded":"2024-09-21T06:34:44.265835+0000","last_fullsized":"2024-09-21T06:34:44.265835+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:59:07.771268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265823+0000","last_change":"2024-09-21T06:34:22.096135+0000","last_active":"2024-09-21T06:34:44.265823+0000","last_peered":"2024-09-21T06:34:44.265823+0000","last_clean":"2024-09-21T06:34:44.265823+0000","last_became_active":"2024-09-21T06:34:22.095721+0000","last_became_peered":"2024-09-21T06:34:22.095721+0000","last_unstale":"2024-09-21T06:34:44.265823+0000","last_undegraded":"2024-09-21T06:34:44.265823+0000","last_fullsized":"2024-09-21T06:34:44.265823+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:28.994324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.229717+0000","last_change":"2024-09-21T06:34:23.951769+0000","last_active":"2024-09-21T06:34:44.229717+0000","last_peered":"2024-09-21T06:34:44.229717+0000","last_clean":"2024-09-21T06:34:44.229717+0000","last_became_active":"2024-09-21T06:34:23.951377+0000","last_became_peered":"2024-09-21T06:34:23.951377+0000","last_unstale":"2024-09-21T06:34:44.229717+0000","last_undegraded":"2024-09-21T06:34:44.229717+0000","last_fullsized":"2024-09-21T06:34:44.229717+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:49:44.291714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.224147+0000","last_change":"2024-09-21T06:34:21.933909+0000","last_active":"2024-09-21T06:34:44.224147+0000","last_peered":"2024-09-21T06:34:44.224147+0000","last_clean":"2024-09-21T06:34:44.224147+0000","last_became_active":"2024-09-21T06:34:21.933524+0000","last_became_peered":"2024-09-21T06:34:21.933524+0000","last_unstale":"2024-09-21T06:34:44.224147+0000","last_undegraded":"2024-09-21T06:34:44.224147+0000","last_fullsized":"2024-09-21T06:34:44.224147+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:58.110444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.225073+0000","last_change":"2024-09-21T06:34:23.948586+0000","last_active":"2024-09-21T06:34:44.225073+0000","last_peered":"2024-09-21T06:34:44.225073+0000","last_clean":"2024-09-21T06:34:44.225073+0000","last_became_active":"2024-09-21T06:34:23.948225+0000","last_became_peered":"2024-09-21T06:34:23.948225+0000","last_unstale":"2024-09-21T06:34:44.225073+0000","last_undegraded":"2024-09-21T06:34:44.225073+0000","last_fullsized":"2024-09-21T06:34:44.225073+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:28:24.272712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265358+0000","last_change":"2024-09-21T06:34:21.935617+0000","last_active":"2024-09-21T06:34:44.265358+0000","last_peered":"2024-09-21T06:34:44.265358+0000","last_clean":"2024-09-21T06:34:44.265358+0000","last_became_active":"2024-09-21T06:34:21.934601+0000","last_became_peered":"2024-09-21T06:34:21.934601+0000","last_unstale":"2024-09-21T06:34:44.265358+0000","last_undegraded":"2024-09-21T06:34:44.265358+0000","last_fullsized":"2024-09-21T06:34:44.265358+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:30.836070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.224206+0000","last_change":"2024-09-21T06:34:23.947661+0000","last_active":"2024-09-21T06:34:44.224206+0000","last_peered":"2024-09-21T06:34:44.224206+0000","last_clean":"2024-09-21T06:34:44.224206+0000","last_became_active":"2024-09-21T06:34:23.947307+0000","last_became_peered":"2024-09-21T06:34:23.947307+0000","last_unstale":"2024-09-21T06:34:44.224206+0000","last_undegraded":"2024-09-21T06:34:44.224206+0000","last_fullsized":"2024-09-21T06:34:44.224206+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:08.045291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'4","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.230116+0000","last_change":"2024-09-21T06:34:21.942749+0000","last_active":"2024-09-21T06:34:44.230116+0000","last_peered":"2024-09-21T06:34:44.230116+0000","last_clean":"2024-09-21T06:34:44.230116+0000","last_became_active":"2024-09-21T06:34:21.942283+0000","last_became_peered":"2024-09-21T06:34:21.942283+0000","last_unstale":"2024-09-21T06:34:44.230116+0000","last_undegraded":"2024-09-21T06:34:44.230116+0000","last_fullsized":"2024-09-21T06:34:44.230116+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:47.477956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.266544+0000","last_change":"2024-09-21T06:34:23.957389+0000","last_active":"2024-09-21T06:34:44.266544+0000","last_peered":"2024-09-21T06:34:44.266544+0000","last_clean":"2024-09-21T06:34:44.266544+0000","last_became_active":"2024-09-21T06:34:23.957032+0000","last_became_peered":"2024-09-21T06:34:23.957032+0000","last_unstale":"2024-09-21T06:34:44.266544+0000","last_undegraded":"2024-09-21T06:34:44.266544+0000","last_fullsized":"2024-09-21T06:34:44.266544+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:00:53.932062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.227302+0000","last_change":"2024-09-21T06:34:23.957304+0000","last_active":"2024-09-21T06:34:44.227302+0000","last_peered":"2024-09-21T06:34:44.227302+0000","last_clean":"2024-09-21T06:34:44.227302+0000","last_became_active":"2024-09-21T06:34:23.956931+0000","last_became_peered":"2024-09-21T06:34:23.956931+0000","last_unstale":"2024-09-21T06:34:44.227302+0000","last_undegraded":"2024-09-21T06:34:44.227302+0000","last_fullsized":"2024-09-21T06:34:44.227302+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:14:12.240686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.230138+0000","last_change":"2024-09-21T06:34:21.937150+0000","last_active":"2024-09-21T06:34:44.230138+0000","last_peered":"2024-09-21T06:34:44.230138+0000","last_clean":"2024-09-21T06:34:44.230138+0000","last_became_active":"2024-09-21T06:34:21.936037+0000","last_became_peered":"2024-09-21T06:34:21.936037+0000","last_unstale":"2024-09-21T06:34:44.230138+0000","last_undegraded":"2024-09-21T06:34:44.230138+0000","last_fullsized":"2024-09-21T06:34:44.230138+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:24:44.821346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265815+0000","last_change":"2024-09-21T06:34:23.955585+0000","last_active":"2024-09-21T06:34:44.265815+0000","last_peered":"2024-09-21T06:34:44.265815+0000","last_clean":"2024-09-21T06:34:44.265815+0000","last_became_active":"2024-09-21T06:34:23.955225+0000","last_became_peered":"2024-09-21T06:34:23.955225+0000","last_unstale":"2024-09-21T06:34:44.265815+0000","last_undegraded":"2024-09-21T06:34:44.265815+0000","last_fullsized":"2024-09-21T06:34:44.265815+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:07:56.735854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'4","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.230684+0000","last_change":"2024-09-21T06:34:21.941804+0000","last_active":"2024-09-21T06:34:44.230684+0000","last_peered":"2024-09-21T06:34:44.230684+0000","last_clean":"2024-09-21T06:34:44.230684+0000","last_became_active":"2024-09-21T06:34:21.941387+0000","last_became_peered":"2024-09-21T06:34:21.941387+0000","last_unstale":"2024-09-21T06:34:44.230684+0000","last_undegraded":"2024-09-21T06:34:44.230684+0000","last_fullsized":"2024-09-21T06:34:44.230684+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:34:51.217549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265988+0000","last_change":"2024-09-21T06:34:23.957429+0000","last_active":"2024-09-21T06:34:44.265988+0000","last_peered":"2024-09-21T06:34:44.265988+0000","last_clean":"2024-09-21T06:34:44.265988+0000","last_became_active":"2024-09-21T06:34:23.956471+0000","last_became_peered":"2024-09-21T06:34:23.956471+0000","last_unstale":"2024-09-21T06:34:44.265988+0000","last_undegraded":"2024-09-21T06:34:44.265988+0000","last_fullsized":"2024-09-21T06:34:44.265988+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:46:26.770549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.224539+0000","last_change":"2024-09-21T06:34:22.096267+0000","last_active":"2024-09-21T06:34:44.224539+0000","last_peered":"2024-09-21T06:34:44.224539+0000","last_clean":"2024-09-21T06:34:44.224539+0000","last_became_active":"2024-09-21T06:34:22.095799+0000","last_became_peered":"2024-09-21T06:34:22.095799+0000","last_unstale":"2024-09-21T06:34:44.224539+0000","last_undegraded":"2024-09-21T06:34:44.224539+0000","last_fullsized":"2024-09-21T06:34:44.224539+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:29:00.075016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.224392+0000","last_change":"2024-09-21T06:34:23.952294+0000","last_active":"2024-09-21T06:34:44.224392+0000","last_peered":"2024-09-21T06:34:44.224392+0000","last_clean":"2024-09-21T06:34:44.224392+0000","last_became_active":"2024-09-21T06:34:23.951919+0000","last_became_peered":"2024-09-21T06:34:23.951919+0000","last_unstale":"2024-09-21T06:34:44.224392+0000","last_undegraded":"2024-09-21T06:34:44.224392+0000","last_fullsized":"2024-09-21T06:34:44.224392+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:30:28.039754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'9","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.226566+0000","last_change":"2024-09-21T06:34:21.934818+0000","last_active":"2024-09-21T06:34:44.226566+0000","last_peered":"2024-09-21T06:34:44.226566+0000","last_clean":"2024-09-21T06:34:44.226566+0000","last_became_active":"2024-09-21T06:34:21.934415+0000","last_became_peered":"2024-09-21T06:34:21.934415+0000","last_unstale":"2024-09-21T06:34:44.226566+0000","last_undegraded":"2024-09-21T06:34:44.226566+0000","last_fullsized":"2024-09-21T06:34:44.226566+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:25:48.460699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68602,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":620,"num_read_kb":381,"num_write":164,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":11,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":205806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":140,"ondisk_log_size":140,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282715,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743459,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27840,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717312,"statfs":{"total":95995035648,"available":95966527488,"internally_reserved":0,"allocated":835584,"data_stored":417151,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939687,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":991232,"data_stored":1073233,"data_compressed":41743,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103213,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27856,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717296,"statfs":{"total":95995035648,"available":95966511104,"internally_reserved":0,"allocated":851968,"data_stored":417387,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299442,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32024,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713128,"statfs":{"total":95995035648,"available":95962243072,"internally_reserved":0,"allocated":851968,"data_stored":417307,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462967,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":901120,"data_stored":1009628,"data_compressed":41743,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626492,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36172,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708980,"statfs":{"total":95995035648,"available":95957995520,"internally_reserved":0,"allocated":839680,"data_stored":416776,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822722,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":913408,"data_stored":1008921,"data_compressed":41743,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986248,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36168,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708984,"statfs":{"total":95995035648,"available":95957999616,"internally_reserved":0,"allocated":843776,"data_stored":417604,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182476,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36180,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708972,"statfs":{"total":95995035648,"available":95957987328,"internally_reserved":0,"allocated":856064,"data_stored":417087,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378706,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32092,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713060,"statfs":{"total":95995035648,"available":95962173440,"internally_reserved":0,"allocated":929792,"data_stored":482520,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542231,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":480779,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705755,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27872,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717280,"statfs":{"total":95995035648,"available":95966494720,"internally_reserved":0,"allocated":860160,"data_stored":418047,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34325,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34325,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34325,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":64210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":65951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":66179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T06:36:14.710 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-09-21T06:36:14.710 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-21T06:36:14.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.861+0000 7f03a2acc640 1 -- 172.21.15.7:0/1245595036 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f039c10dd80 msgr2=0x7f039c110270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:14.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.861+0000 7f03a2acc640 1 --2- 172.21.15.7:0/1245595036 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f039c10dd80 0x7f039c110270 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f038c009ca0 tx=0x7f038c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:36:14.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.861+0000 7f03a2acc640 1 -- 172.21.15.7:0/1245595036 shutdown_connections 2024-09-21T06:36:14.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.861+0000 7f03a2acc640 1 --2- 172.21.15.7:0/1245595036 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f039c10dd80 0x7f039c110270 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:14.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.861+0000 7f03a2acc640 1 --2- 172.21.15.7:0/1245595036 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f039c105270 0x7f039c10d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:14.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.861+0000 7f03a2acc640 1 --2- 172.21.15.7:0/1245595036 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f039c104920 0x7f039c104d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:14.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.861+0000 7f03a2acc640 1 -- 172.21.15.7:0/1245595036 >> 172.21.15.7:0/1245595036 conn(0x7f039c07a660 msgr2=0x7f039c07aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:14.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.861+0000 7f03a2acc640 1 -- 172.21.15.7:0/1245595036 shutdown_connections 2024-09-21T06:36:14.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.861+0000 7f03a2acc640 1 -- 172.21.15.7:0/1245595036 wait complete. 2024-09-21T06:36:14.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.862+0000 7f03a2acc640 1 Processor -- start 2024-09-21T06:36:14.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.862+0000 7f03a2acc640 1 -- start start 2024-09-21T06:36:14.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.862+0000 7f03a2acc640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f039c104920 0x7f039c19a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:14.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.862+0000 7f03a2acc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f039c105270 0x7f039c19a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:14.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.862+0000 7f03a2acc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f039c10dd80 0x7f039c19fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:14.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.862+0000 7f03a2acc640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f039c1139e0 con 0x7f039c10dd80 2024-09-21T06:36:14.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.862+0000 7f03a2acc640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f039c113860 con 0x7f039c105270 2024-09-21T06:36:14.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.862+0000 7f03a2acc640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f039c113b60 con 0x7f039c104920 2024-09-21T06:36:14.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.862+0000 7f03a1069640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f039c10dd80 0x7f039c19fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:14.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.862+0000 7f03a1069640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f039c10dd80 0x7f039c19fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42438/0 (socket says 172.21.15.7:42438) 2024-09-21T06:36:14.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.862+0000 7f03a1069640 1 -- 172.21.15.7:0/359132665 learned_addr learned my addr 172.21.15.7:0/359132665 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:36:14.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.862+0000 7f039bfff640 1 --2- 172.21.15.7:0/359132665 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f039c105270 0x7f039c19a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:14.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.862+0000 7f03a0868640 1 --2- 172.21.15.7:0/359132665 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f039c104920 0x7f039c19a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:14.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.862+0000 7f03a1069640 1 -- 172.21.15.7:0/359132665 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f039c104920 msgr2=0x7f039c19a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:14.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.862+0000 7f03a1069640 1 --2- 172.21.15.7:0/359132665 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f039c104920 0x7f039c19a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:14.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.862+0000 7f03a1069640 1 -- 172.21.15.7:0/359132665 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f039c105270 msgr2=0x7f039c19a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:14.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.862+0000 7f03a1069640 1 --2- 172.21.15.7:0/359132665 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f039c105270 0x7f039c19a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:14.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.862+0000 7f03a1069640 1 -- 172.21.15.7:0/359132665 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f039c1a01a0 con 0x7f039c10dd80 2024-09-21T06:36:14.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.862+0000 7f039bfff640 1 --2- 172.21.15.7:0/359132665 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f039c105270 0x7f039c19a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:36:14.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.863+0000 7f03a1069640 1 --2- 172.21.15.7:0/359132665 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f039c10dd80 0x7f039c19fb30 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f038c005cc0 tx=0x7f038c02f470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:14.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.863+0000 7f0399ffb640 1 -- 172.21.15.7:0/359132665 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f038c003cf0 con 0x7f039c10dd80 2024-09-21T06:36:14.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.863+0000 7f0399ffb640 1 -- 172.21.15.7:0/359132665 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f038c0044f0 con 0x7f039c10dd80 2024-09-21T06:36:14.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.863+0000 7f03a2acc640 1 -- 172.21.15.7:0/359132665 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f039c1a0430 con 0x7f039c10dd80 2024-09-21T06:36:14.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.863+0000 7f0399ffb640 1 -- 172.21.15.7:0/359132665 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f038c02fd10 con 0x7f039c10dd80 2024-09-21T06:36:14.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.863+0000 7f03a2acc640 1 -- 172.21.15.7:0/359132665 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f039c1a6cb0 con 0x7f039c10dd80 2024-09-21T06:36:14.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.864+0000 7f03a2acc640 1 -- 172.21.15.7:0/359132665 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f039c06af90 con 0x7f039c10dd80 2024-09-21T06:36:14.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.866+0000 7f0399ffb640 1 -- 172.21.15.7:0/359132665 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 22) ==== 154579+0+0 (secure 0 0 0) 0x7f038c004040 con 0x7f039c10dd80 2024-09-21T06:36:14.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.867+0000 7f0399ffb640 1 --2- 172.21.15.7:0/359132665 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f03880b6670 0x7f03880b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:14.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.867+0000 7f03a0868640 1 --2- 172.21.15.7:0/359132665 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f03880b6670 0x7f03880b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:14.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.867+0000 7f0399ffb640 1 -- 172.21.15.7:0/359132665 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f038c108dd0 con 0x7f039c10dd80 2024-09-21T06:36:14.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.867+0000 7f03a0868640 1 --2- 172.21.15.7:0/359132665 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f03880b6670 0x7f03880b8b80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f039400ba40 tx=0x7f0394005cc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:14.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:14.870+0000 7f0399ffb640 1 -- 172.21.15.7:0/359132665 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f038c0cf480 con 0x7f039c10dd80 2024-09-21T06:36:15.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:36:14 smithi144 ceph-mon[34653]: pgmap v320: 97 pgs: 97 active+clean; 644 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-21T06:36:15.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:15.061+0000 7f03a2acc640 1 -- 172.21.15.7:0/359132665 --> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f039c1085e0 con 0x7f03880b6670 2024-09-21T06:36:15.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:15.065+0000 7f0399ffb640 1 -- 172.21.15.7:0/359132665 <== mgr.14223 v2:172.21.15.7:6800/3442812985 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258962 (secure 0 0 0) 0x7f039c1085e0 con 0x7f03880b6670 2024-09-21T06:36:15.070 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:36:15.071 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2024-09-21T06:36:15.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:15.068+0000 7f03a2acc640 1 -- 172.21.15.7:0/359132665 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f03880b6670 msgr2=0x7f03880b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:15.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:15.068+0000 7f03a2acc640 1 --2- 172.21.15.7:0/359132665 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f03880b6670 0x7f03880b8b80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f039400ba40 tx=0x7f0394005cc0 comp rx=0 tx=0).stop 2024-09-21T06:36:15.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:15.068+0000 7f03a2acc640 1 -- 172.21.15.7:0/359132665 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f039c10dd80 msgr2=0x7f039c19fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:15.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:15.068+0000 7f03a2acc640 1 --2- 172.21.15.7:0/359132665 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f039c10dd80 0x7f039c19fb30 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f038c005cc0 tx=0x7f038c02f470 comp rx=0 tx=0).stop 2024-09-21T06:36:15.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:15.068+0000 7f03a2acc640 1 -- 172.21.15.7:0/359132665 shutdown_connections 2024-09-21T06:36:15.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:15.068+0000 7f03a2acc640 1 --2- 172.21.15.7:0/359132665 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f03880b6670 0x7f03880b8b80 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:15.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:15.068+0000 7f03a2acc640 1 --2- 172.21.15.7:0/359132665 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f039c10dd80 0x7f039c19fb30 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:15.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:15.068+0000 7f03a2acc640 1 --2- 172.21.15.7:0/359132665 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f039c105270 0x7f039c19a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:15.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:15.068+0000 7f03a2acc640 1 --2- 172.21.15.7:0/359132665 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f039c104920 0x7f039c19a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:15.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:15.068+0000 7f03a2acc640 1 -- 172.21.15.7:0/359132665 >> 172.21.15.7:0/359132665 conn(0x7f039c07a660 msgr2=0x7f039c105750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:15.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:15.068+0000 7f03a2acc640 1 -- 172.21.15.7:0/359132665 shutdown_connections 2024-09-21T06:36:15.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:15.069+0000 7f03a2acc640 1 -- 172.21.15.7:0/359132665 wait complete. 2024-09-21T06:36:15.088 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:36:14 smithi007 ceph-mon[30983]: pgmap v320: 97 pgs: 97 active+clean; 644 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-21T06:36:15.090 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":320,"stamp":"2024-09-21T06:36:13.162038+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659204,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":701,"num_read_kb":450,"num_write":289,"num_write_kb":2269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":2951840,"num_keys_recovered":11,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":234,"ondisk_log_size":234,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":367936,"kb_used_data":10332,"kb_used_omap":18,"kb_used_meta":357357,"kb_avail":1124573888,"statfs":{"total":1151940427776,"available":1151563661312,"internally_reserved":0,"allocated":10579968,"data_stored":6976440,"data_compressed":177384,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":19143,"internal_metadata":365933881},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":308,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":41,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002824"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.225546+0000","last_change":"2024-09-21T06:34:23.958146+0000","last_active":"2024-09-21T06:34:44.225546+0000","last_peered":"2024-09-21T06:34:44.225546+0000","last_clean":"2024-09-21T06:34:44.225546+0000","last_became_active":"2024-09-21T06:34:23.957580+0000","last_became_peered":"2024-09-21T06:34:23.957580+0000","last_unstale":"2024-09-21T06:34:44.225546+0000","last_undegraded":"2024-09-21T06:34:44.225546+0000","last_fullsized":"2024-09-21T06:34:44.225546+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:33:05.975310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265758+0000","last_change":"2024-09-21T06:34:23.948439+0000","last_active":"2024-09-21T06:34:44.265758+0000","last_peered":"2024-09-21T06:34:44.265758+0000","last_clean":"2024-09-21T06:34:44.265758+0000","last_became_active":"2024-09-21T06:34:23.947511+0000","last_became_peered":"2024-09-21T06:34:23.947511+0000","last_unstale":"2024-09-21T06:34:44.265758+0000","last_undegraded":"2024-09-21T06:34:44.265758+0000","last_fullsized":"2024-09-21T06:34:44.265758+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:13:53.589979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.264949+0000","last_change":"2024-09-21T06:34:23.950752+0000","last_active":"2024-09-21T06:34:44.264949+0000","last_peered":"2024-09-21T06:34:44.264949+0000","last_clean":"2024-09-21T06:34:44.264949+0000","last_became_active":"2024-09-21T06:34:23.950373+0000","last_became_peered":"2024-09-21T06:34:23.950373+0000","last_unstale":"2024-09-21T06:34:44.264949+0000","last_undegraded":"2024-09-21T06:34:44.264949+0000","last_fullsized":"2024-09-21T06:34:44.264949+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:01:29.183426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.267740+0000","last_change":"2024-09-21T06:34:44.267265+0000","last_active":"2024-09-21T06:34:44.267740+0000","last_peered":"2024-09-21T06:34:44.267740+0000","last_clean":"2024-09-21T06:34:44.267740+0000","last_became_active":"2024-09-21T06:34:44.266829+0000","last_became_peered":"2024-09-21T06:34:44.266829+0000","last_unstale":"2024-09-21T06:34:44.267740+0000","last_undegraded":"2024-09-21T06:34:44.267740+0000","last_fullsized":"2024-09-21T06:34:44.267740+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:47:57.873167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.229953+0000","last_change":"2024-09-21T06:34:23.947578+0000","last_active":"2024-09-21T06:34:44.229953+0000","last_peered":"2024-09-21T06:34:44.229953+0000","last_clean":"2024-09-21T06:34:44.229953+0000","last_became_active":"2024-09-21T06:34:23.947201+0000","last_became_peered":"2024-09-21T06:34:23.947201+0000","last_unstale":"2024-09-21T06:34:44.229953+0000","last_undegraded":"2024-09-21T06:34:44.229953+0000","last_fullsized":"2024-09-21T06:34:44.229953+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:48:32.279999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.227142+0000","last_change":"2024-09-21T06:34:23.946191+0000","last_active":"2024-09-21T06:34:44.227142+0000","last_peered":"2024-09-21T06:34:44.227142+0000","last_clean":"2024-09-21T06:34:44.227142+0000","last_became_active":"2024-09-21T06:34:23.945817+0000","last_became_peered":"2024-09-21T06:34:23.945817+0000","last_unstale":"2024-09-21T06:34:44.227142+0000","last_undegraded":"2024-09-21T06:34:44.227142+0000","last_fullsized":"2024-09-21T06:34:44.227142+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:29.443444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265435+0000","last_change":"2024-09-21T06:34:23.943433+0000","last_active":"2024-09-21T06:34:44.265435+0000","last_peered":"2024-09-21T06:34:44.265435+0000","last_clean":"2024-09-21T06:34:44.265435+0000","last_became_active":"2024-09-21T06:34:23.943001+0000","last_became_peered":"2024-09-21T06:34:23.943001+0000","last_unstale":"2024-09-21T06:34:44.265435+0000","last_undegraded":"2024-09-21T06:34:44.265435+0000","last_fullsized":"2024-09-21T06:34:44.265435+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:05:10.695083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.223932+0000","last_change":"2024-09-21T06:34:23.954397+0000","last_active":"2024-09-21T06:34:44.223932+0000","last_peered":"2024-09-21T06:34:44.223932+0000","last_clean":"2024-09-21T06:34:44.223932+0000","last_became_active":"2024-09-21T06:34:23.954008+0000","last_became_peered":"2024-09-21T06:34:23.954008+0000","last_unstale":"2024-09-21T06:34:44.223932+0000","last_undegraded":"2024-09-21T06:34:44.223932+0000","last_fullsized":"2024-09-21T06:34:44.223932+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:10:03.764400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.266422+0000","last_change":"2024-09-21T06:34:23.953371+0000","last_active":"2024-09-21T06:34:44.266422+0000","last_peered":"2024-09-21T06:34:44.266422+0000","last_clean":"2024-09-21T06:34:44.266422+0000","last_became_active":"2024-09-21T06:34:23.952864+0000","last_became_peered":"2024-09-21T06:34:23.952864+0000","last_unstale":"2024-09-21T06:34:44.266422+0000","last_undegraded":"2024-09-21T06:34:44.266422+0000","last_fullsized":"2024-09-21T06:34:44.266422+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:44:23.691372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.267477+0000","last_change":"2024-09-21T06:34:44.267366+0000","last_active":"2024-09-21T06:34:44.267477+0000","last_peered":"2024-09-21T06:34:44.267477+0000","last_clean":"2024-09-21T06:34:44.267477+0000","last_became_active":"2024-09-21T06:34:44.266937+0000","last_became_peered":"2024-09-21T06:34:44.266937+0000","last_unstale":"2024-09-21T06:34:44.267477+0000","last_undegraded":"2024-09-21T06:34:44.267477+0000","last_fullsized":"2024-09-21T06:34:44.267477+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:40:00.904219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.266545+0000","last_change":"2024-09-21T06:34:23.958191+0000","last_active":"2024-09-21T06:34:44.266545+0000","last_peered":"2024-09-21T06:34:44.266545+0000","last_clean":"2024-09-21T06:34:44.266545+0000","last_became_active":"2024-09-21T06:34:23.957836+0000","last_became_peered":"2024-09-21T06:34:23.957836+0000","last_unstale":"2024-09-21T06:34:44.266545+0000","last_undegraded":"2024-09-21T06:34:44.266545+0000","last_fullsized":"2024-09-21T06:34:44.266545+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:31:10.201245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.225421+0000","last_change":"2024-09-21T06:34:23.947256+0000","last_active":"2024-09-21T06:34:44.225421+0000","last_peered":"2024-09-21T06:34:44.225421+0000","last_clean":"2024-09-21T06:34:44.225421+0000","last_became_active":"2024-09-21T06:34:23.946029+0000","last_became_peered":"2024-09-21T06:34:23.946029+0000","last_unstale":"2024-09-21T06:34:44.225421+0000","last_undegraded":"2024-09-21T06:34:44.225421+0000","last_fullsized":"2024-09-21T06:34:44.225421+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:47:19.850700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265129+0000","last_change":"2024-09-21T06:34:23.940661+0000","last_active":"2024-09-21T06:34:44.265129+0000","last_peered":"2024-09-21T06:34:44.265129+0000","last_clean":"2024-09-21T06:34:44.265129+0000","last_became_active":"2024-09-21T06:34:23.940306+0000","last_became_peered":"2024-09-21T06:34:23.940306+0000","last_unstale":"2024-09-21T06:34:44.265129+0000","last_undegraded":"2024-09-21T06:34:44.265129+0000","last_fullsized":"2024-09-21T06:34:44.265129+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:19.062435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265265+0000","last_change":"2024-09-21T06:34:23.941906+0000","last_active":"2024-09-21T06:34:44.265265+0000","last_peered":"2024-09-21T06:34:44.265265+0000","last_clean":"2024-09-21T06:34:44.265265+0000","last_became_active":"2024-09-21T06:34:23.941522+0000","last_became_peered":"2024-09-21T06:34:23.941522+0000","last_unstale":"2024-09-21T06:34:44.265265+0000","last_undegraded":"2024-09-21T06:34:44.265265+0000","last_fullsized":"2024-09-21T06:34:44.265265+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:57:12.557051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.264948+0000","last_change":"2024-09-21T06:34:23.957181+0000","last_active":"2024-09-21T06:34:44.264948+0000","last_peered":"2024-09-21T06:34:44.264948+0000","last_clean":"2024-09-21T06:34:44.264948+0000","last_became_active":"2024-09-21T06:34:23.956269+0000","last_became_peered":"2024-09-21T06:34:23.956269+0000","last_unstale":"2024-09-21T06:34:44.264948+0000","last_undegraded":"2024-09-21T06:34:44.264948+0000","last_fullsized":"2024-09-21T06:34:44.264948+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:33:24.989570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265721+0000","last_change":"2024-09-21T06:34:23.951771+0000","last_active":"2024-09-21T06:34:44.265721+0000","last_peered":"2024-09-21T06:34:44.265721+0000","last_clean":"2024-09-21T06:34:44.265721+0000","last_became_active":"2024-09-21T06:34:23.951381+0000","last_became_peered":"2024-09-21T06:34:23.951381+0000","last_unstale":"2024-09-21T06:34:44.265721+0000","last_undegraded":"2024-09-21T06:34:44.265721+0000","last_fullsized":"2024-09-21T06:34:44.265721+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:26:16.049343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.225612+0000","last_change":"2024-09-21T06:34:23.959425+0000","last_active":"2024-09-21T06:34:44.225612+0000","last_peered":"2024-09-21T06:34:44.225612+0000","last_clean":"2024-09-21T06:34:44.225612+0000","last_became_active":"2024-09-21T06:34:23.959022+0000","last_became_peered":"2024-09-21T06:34:23.959022+0000","last_unstale":"2024-09-21T06:34:44.225612+0000","last_undegraded":"2024-09-21T06:34:44.225612+0000","last_fullsized":"2024-09-21T06:34:44.225612+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:19:45.203639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.226736+0000","last_change":"2024-09-21T06:34:23.950510+0000","last_active":"2024-09-21T06:34:44.226736+0000","last_peered":"2024-09-21T06:34:44.226736+0000","last_clean":"2024-09-21T06:34:44.226736+0000","last_became_active":"2024-09-21T06:34:23.950027+0000","last_became_peered":"2024-09-21T06:34:23.950027+0000","last_unstale":"2024-09-21T06:34:44.226736+0000","last_undegraded":"2024-09-21T06:34:44.226736+0000","last_fullsized":"2024-09-21T06:34:44.226736+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:22:23.093554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265658+0000","last_change":"2024-09-21T06:34:23.948824+0000","last_active":"2024-09-21T06:34:44.265658+0000","last_peered":"2024-09-21T06:34:44.265658+0000","last_clean":"2024-09-21T06:34:44.265658+0000","last_became_active":"2024-09-21T06:34:23.948441+0000","last_became_peered":"2024-09-21T06:34:23.948441+0000","last_unstale":"2024-09-21T06:34:44.265658+0000","last_undegraded":"2024-09-21T06:34:44.265658+0000","last_fullsized":"2024-09-21T06:34:44.265658+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:30:28.498876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.225240+0000","last_change":"2024-09-21T06:34:23.960278+0000","last_active":"2024-09-21T06:34:44.225240+0000","last_peered":"2024-09-21T06:34:44.225240+0000","last_clean":"2024-09-21T06:34:44.225240+0000","last_became_active":"2024-09-21T06:34:23.959737+0000","last_became_peered":"2024-09-21T06:34:23.959737+0000","last_unstale":"2024-09-21T06:34:44.225240+0000","last_undegraded":"2024-09-21T06:34:44.225240+0000","last_fullsized":"2024-09-21T06:34:44.225240+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:50.097954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265247+0000","last_change":"2024-09-21T06:34:23.942797+0000","last_active":"2024-09-21T06:34:44.265247+0000","last_peered":"2024-09-21T06:34:44.265247+0000","last_clean":"2024-09-21T06:34:44.265247+0000","last_became_active":"2024-09-21T06:34:23.942441+0000","last_became_peered":"2024-09-21T06:34:23.942441+0000","last_unstale":"2024-09-21T06:34:44.265247+0000","last_undegraded":"2024-09-21T06:34:44.265247+0000","last_fullsized":"2024-09-21T06:34:44.265247+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:57:30.552583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265998+0000","last_change":"2024-09-21T06:34:23.957433+0000","last_active":"2024-09-21T06:34:44.265998+0000","last_peered":"2024-09-21T06:34:44.265998+0000","last_clean":"2024-09-21T06:34:44.265998+0000","last_became_active":"2024-09-21T06:34:23.957035+0000","last_became_peered":"2024-09-21T06:34:23.957035+0000","last_unstale":"2024-09-21T06:34:44.265998+0000","last_undegraded":"2024-09-21T06:34:44.265998+0000","last_fullsized":"2024-09-21T06:34:44.265998+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:40:18.418705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.224015+0000","last_change":"2024-09-21T06:34:23.950308+0000","last_active":"2024-09-21T06:34:44.224015+0000","last_peered":"2024-09-21T06:34:44.224015+0000","last_clean":"2024-09-21T06:34:44.224015+0000","last_became_active":"2024-09-21T06:34:23.948417+0000","last_became_peered":"2024-09-21T06:34:23.948417+0000","last_unstale":"2024-09-21T06:34:44.224015+0000","last_undegraded":"2024-09-21T06:34:44.224015+0000","last_fullsized":"2024-09-21T06:34:44.224015+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:48:47.233504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.226437+0000","last_change":"2024-09-21T06:34:23.949369+0000","last_active":"2024-09-21T06:34:44.226437+0000","last_peered":"2024-09-21T06:34:44.226437+0000","last_clean":"2024-09-21T06:34:44.226437+0000","last_became_active":"2024-09-21T06:34:23.948713+0000","last_became_peered":"2024-09-21T06:34:23.948713+0000","last_unstale":"2024-09-21T06:34:44.226437+0000","last_undegraded":"2024-09-21T06:34:44.226437+0000","last_fullsized":"2024-09-21T06:34:44.226437+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:57:06.915379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.224467+0000","last_change":"2024-09-21T06:34:23.959315+0000","last_active":"2024-09-21T06:34:44.224467+0000","last_peered":"2024-09-21T06:34:44.224467+0000","last_clean":"2024-09-21T06:34:44.224467+0000","last_became_active":"2024-09-21T06:34:23.958904+0000","last_became_peered":"2024-09-21T06:34:23.958904+0000","last_unstale":"2024-09-21T06:34:44.224467+0000","last_undegraded":"2024-09-21T06:34:44.224467+0000","last_fullsized":"2024-09-21T06:34:44.224467+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:31:35.486369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265718+0000","last_change":"2024-09-21T06:34:23.952074+0000","last_active":"2024-09-21T06:34:44.265718+0000","last_peered":"2024-09-21T06:34:44.265718+0000","last_clean":"2024-09-21T06:34:44.265718+0000","last_became_active":"2024-09-21T06:34:23.951692+0000","last_became_peered":"2024-09-21T06:34:23.951692+0000","last_unstale":"2024-09-21T06:34:44.265718+0000","last_undegraded":"2024-09-21T06:34:44.265718+0000","last_fullsized":"2024-09-21T06:34:44.265718+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:15:06.300781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.225420+0000","last_change":"2024-09-21T06:34:23.947296+0000","last_active":"2024-09-21T06:34:44.225420+0000","last_peered":"2024-09-21T06:34:44.225420+0000","last_clean":"2024-09-21T06:34:44.225420+0000","last_became_active":"2024-09-21T06:34:23.946392+0000","last_became_peered":"2024-09-21T06:34:23.946392+0000","last_unstale":"2024-09-21T06:34:44.225420+0000","last_undegraded":"2024-09-21T06:34:44.225420+0000","last_fullsized":"2024-09-21T06:34:44.225420+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:05:27.597890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265035+0000","last_change":"2024-09-21T06:34:23.953161+0000","last_active":"2024-09-21T06:34:44.265035+0000","last_peered":"2024-09-21T06:34:44.265035+0000","last_clean":"2024-09-21T06:34:44.265035+0000","last_became_active":"2024-09-21T06:34:23.952811+0000","last_became_peered":"2024-09-21T06:34:23.952811+0000","last_unstale":"2024-09-21T06:34:44.265035+0000","last_undegraded":"2024-09-21T06:34:44.265035+0000","last_fullsized":"2024-09-21T06:34:44.265035+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:22:04.431094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265586+0000","last_change":"2024-09-21T06:34:23.959880+0000","last_active":"2024-09-21T06:34:44.265586+0000","last_peered":"2024-09-21T06:34:44.265586+0000","last_clean":"2024-09-21T06:34:44.265586+0000","last_became_active":"2024-09-21T06:34:23.959573+0000","last_became_peered":"2024-09-21T06:34:23.959573+0000","last_unstale":"2024-09-21T06:34:44.265586+0000","last_undegraded":"2024-09-21T06:34:44.265586+0000","last_fullsized":"2024-09-21T06:34:44.265586+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:45:21.921956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265362+0000","last_change":"2024-09-21T06:34:23.947209+0000","last_active":"2024-09-21T06:34:44.265362+0000","last_peered":"2024-09-21T06:34:44.265362+0000","last_clean":"2024-09-21T06:34:44.265362+0000","last_became_active":"2024-09-21T06:34:23.946763+0000","last_became_peered":"2024-09-21T06:34:23.946763+0000","last_unstale":"2024-09-21T06:34:44.265362+0000","last_undegraded":"2024-09-21T06:34:44.265362+0000","last_fullsized":"2024-09-21T06:34:44.265362+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:04:54.050980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265396+0000","last_change":"2024-09-21T06:34:23.955064+0000","last_active":"2024-09-21T06:34:44.265396+0000","last_peered":"2024-09-21T06:34:44.265396+0000","last_clean":"2024-09-21T06:34:44.265396+0000","last_became_active":"2024-09-21T06:34:23.954622+0000","last_became_peered":"2024-09-21T06:34:23.954622+0000","last_unstale":"2024-09-21T06:34:44.265396+0000","last_undegraded":"2024-09-21T06:34:44.265396+0000","last_fullsized":"2024-09-21T06:34:44.265396+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:04:59.056398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.224979+0000","last_change":"2024-09-21T06:34:23.947015+0000","last_active":"2024-09-21T06:34:44.224979+0000","last_peered":"2024-09-21T06:34:44.224979+0000","last_clean":"2024-09-21T06:34:44.224979+0000","last_became_active":"2024-09-21T06:34:23.946569+0000","last_became_peered":"2024-09-21T06:34:23.946569+0000","last_unstale":"2024-09-21T06:34:44.224979+0000","last_undegraded":"2024-09-21T06:34:44.224979+0000","last_fullsized":"2024-09-21T06:34:44.224979+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:50:35.935533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.230155+0000","last_change":"2024-09-21T06:34:23.951126+0000","last_active":"2024-09-21T06:34:44.230155+0000","last_peered":"2024-09-21T06:34:44.230155+0000","last_clean":"2024-09-21T06:34:44.230155+0000","last_became_active":"2024-09-21T06:34:23.950739+0000","last_became_peered":"2024-09-21T06:34:23.950739+0000","last_unstale":"2024-09-21T06:34:44.230155+0000","last_undegraded":"2024-09-21T06:34:44.230155+0000","last_fullsized":"2024-09-21T06:34:44.230155+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:52:43.201135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"75'6","reported_seq":131,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:36:11.165444+0000","last_change":"2024-09-21T06:34:21.939584+0000","last_active":"2024-09-21T06:36:11.165444+0000","last_peered":"2024-09-21T06:36:11.165444+0000","last_clean":"2024-09-21T06:36:11.165444+0000","last_became_active":"2024-09-21T06:34:21.939233+0000","last_became_peered":"2024-09-21T06:34:21.939233+0000","last_unstale":"2024-09-21T06:36:11.165444+0000","last_undegraded":"2024-09-21T06:36:11.165444+0000","last_fullsized":"2024-09-21T06:36:11.165444+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:54.701803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":102,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.232102+0000","last_change":"2024-09-21T06:34:44.232010+0000","last_active":"2024-09-21T06:34:44.232102+0000","last_peered":"2024-09-21T06:34:44.232102+0000","last_clean":"2024-09-21T06:34:44.232102+0000","last_became_active":"2024-09-21T06:34:44.231590+0000","last_became_peered":"2024-09-21T06:34:44.231590+0000","last_unstale":"2024-09-21T06:34:44.232102+0000","last_undegraded":"2024-09-21T06:34:44.232102+0000","last_fullsized":"2024-09-21T06:34:44.232102+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:33:02.751794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.227410+0000","last_change":"2024-09-21T06:34:21.937418+0000","last_active":"2024-09-21T06:34:44.227410+0000","last_peered":"2024-09-21T06:34:44.227410+0000","last_clean":"2024-09-21T06:34:44.227410+0000","last_became_active":"2024-09-21T06:34:21.937048+0000","last_became_peered":"2024-09-21T06:34:21.937048+0000","last_unstale":"2024-09-21T06:34:44.227410+0000","last_undegraded":"2024-09-21T06:34:44.227410+0000","last_fullsized":"2024-09-21T06:34:44.227410+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:33:38.731444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.264973+0000","last_change":"2024-09-21T06:34:21.932970+0000","last_active":"2024-09-21T06:34:44.264973+0000","last_peered":"2024-09-21T06:34:44.264973+0000","last_clean":"2024-09-21T06:34:44.264973+0000","last_became_active":"2024-09-21T06:34:21.932616+0000","last_became_peered":"2024-09-21T06:34:21.932616+0000","last_unstale":"2024-09-21T06:34:44.264973+0000","last_undegraded":"2024-09-21T06:34:44.264973+0000","last_fullsized":"2024-09-21T06:34:44.264973+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:33:20.611023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.224042+0000","last_change":"2024-09-21T06:34:23.950798+0000","last_active":"2024-09-21T06:34:44.224042+0000","last_peered":"2024-09-21T06:34:44.224042+0000","last_clean":"2024-09-21T06:34:44.224042+0000","last_became_active":"2024-09-21T06:34:23.950475+0000","last_became_peered":"2024-09-21T06:34:23.950475+0000","last_unstale":"2024-09-21T06:34:44.224042+0000","last_undegraded":"2024-09-21T06:34:44.224042+0000","last_fullsized":"2024-09-21T06:34:44.224042+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:43:23.177775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.226659+0000","last_change":"2024-09-21T06:34:21.937860+0000","last_active":"2024-09-21T06:34:44.226659+0000","last_peered":"2024-09-21T06:34:44.226659+0000","last_clean":"2024-09-21T06:34:44.226659+0000","last_became_active":"2024-09-21T06:34:21.937476+0000","last_became_peered":"2024-09-21T06:34:21.937476+0000","last_unstale":"2024-09-21T06:34:44.226659+0000","last_undegraded":"2024-09-21T06:34:44.226659+0000","last_fullsized":"2024-09-21T06:34:44.226659+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:49:06.069197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.226096+0000","last_change":"2024-09-21T06:34:23.944559+0000","last_active":"2024-09-21T06:34:44.226096+0000","last_peered":"2024-09-21T06:34:44.226096+0000","last_clean":"2024-09-21T06:34:44.226096+0000","last_became_active":"2024-09-21T06:34:23.944166+0000","last_became_peered":"2024-09-21T06:34:23.944166+0000","last_unstale":"2024-09-21T06:34:44.226096+0000","last_undegraded":"2024-09-21T06:34:44.226096+0000","last_fullsized":"2024-09-21T06:34:44.226096+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:01:56.532854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"75'3","reported_seq":125,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:36:11.164587+0000","last_change":"2024-09-21T06:34:21.936531+0000","last_active":"2024-09-21T06:36:11.164587+0000","last_peered":"2024-09-21T06:36:11.164587+0000","last_clean":"2024-09-21T06:36:11.164587+0000","last_became_active":"2024-09-21T06:34:21.936087+0000","last_became_peered":"2024-09-21T06:34:21.936087+0000","last_unstale":"2024-09-21T06:36:11.164587+0000","last_undegraded":"2024-09-21T06:36:11.164587+0000","last_fullsized":"2024-09-21T06:36:11.164587+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:27:12.370722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":99,"num_read_kb":99,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.266303+0000","last_change":"2024-09-21T06:34:23.954894+0000","last_active":"2024-09-21T06:34:44.266303+0000","last_peered":"2024-09-21T06:34:44.266303+0000","last_clean":"2024-09-21T06:34:44.266303+0000","last_became_active":"2024-09-21T06:34:23.954186+0000","last_became_peered":"2024-09-21T06:34:23.954186+0000","last_unstale":"2024-09-21T06:34:44.266303+0000","last_undegraded":"2024-09-21T06:34:44.266303+0000","last_fullsized":"2024-09-21T06:34:44.266303+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:18:49.623338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265585+0000","last_change":"2024-09-21T06:34:21.934989+0000","last_active":"2024-09-21T06:34:44.265585+0000","last_peered":"2024-09-21T06:34:44.265585+0000","last_clean":"2024-09-21T06:34:44.265585+0000","last_became_active":"2024-09-21T06:34:21.934550+0000","last_became_peered":"2024-09-21T06:34:21.934550+0000","last_unstale":"2024-09-21T06:34:44.265585+0000","last_undegraded":"2024-09-21T06:34:44.265585+0000","last_fullsized":"2024-09-21T06:34:44.265585+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:59:17.849338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265984+0000","last_change":"2024-09-21T06:34:23.956190+0000","last_active":"2024-09-21T06:34:44.265984+0000","last_peered":"2024-09-21T06:34:44.265984+0000","last_clean":"2024-09-21T06:34:44.265984+0000","last_became_active":"2024-09-21T06:34:23.955815+0000","last_became_peered":"2024-09-21T06:34:23.955815+0000","last_unstale":"2024-09-21T06:34:44.265984+0000","last_undegraded":"2024-09-21T06:34:44.265984+0000","last_fullsized":"2024-09-21T06:34:44.265984+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:14:56.165350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"75'4","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.227080+0000","last_change":"2024-09-21T06:34:22.096480+0000","last_active":"2024-09-21T06:34:44.227080+0000","last_peered":"2024-09-21T06:34:44.227080+0000","last_clean":"2024-09-21T06:34:44.227080+0000","last_became_active":"2024-09-21T06:34:22.095921+0000","last_became_peered":"2024-09-21T06:34:22.095921+0000","last_unstale":"2024-09-21T06:34:44.227080+0000","last_undegraded":"2024-09-21T06:34:44.227080+0000","last_fullsized":"2024-09-21T06:34:44.227080+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:19:30.006811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265960+0000","last_change":"2024-09-21T06:34:23.961840+0000","last_active":"2024-09-21T06:34:44.265960+0000","last_peered":"2024-09-21T06:34:44.265960+0000","last_clean":"2024-09-21T06:34:44.265960+0000","last_became_active":"2024-09-21T06:34:23.961313+0000","last_became_peered":"2024-09-21T06:34:23.961313+0000","last_unstale":"2024-09-21T06:34:44.265960+0000","last_undegraded":"2024-09-21T06:34:44.265960+0000","last_fullsized":"2024-09-21T06:34:44.265960+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:29:04.308598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"77'30","reported_seq":260,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:36:12.166573+0000","last_change":"2024-09-21T06:34:21.937326+0000","last_active":"2024-09-21T06:36:12.166573+0000","last_peered":"2024-09-21T06:36:12.166573+0000","last_clean":"2024-09-21T06:36:12.166573+0000","last_became_active":"2024-09-21T06:34:21.936940+0000","last_became_peered":"2024-09-21T06:34:21.936940+0000","last_unstale":"2024-09-21T06:36:12.166573+0000","last_undegraded":"2024-09-21T06:36:12.166573+0000","last_fullsized":"2024-09-21T06:36:12.166573+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:47:12.988306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64210,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":207,"num_read_kb":166,"num_write":31,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.230328+0000","last_change":"2024-09-21T06:34:23.950167+0000","last_active":"2024-09-21T06:34:44.230328+0000","last_peered":"2024-09-21T06:34:44.230328+0000","last_clean":"2024-09-21T06:34:44.230328+0000","last_became_active":"2024-09-21T06:34:23.949697+0000","last_became_peered":"2024-09-21T06:34:23.949697+0000","last_unstale":"2024-09-21T06:34:44.230328+0000","last_undegraded":"2024-09-21T06:34:44.230328+0000","last_fullsized":"2024-09-21T06:34:44.230328+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:37:48.882644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"75'6","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265516+0000","last_change":"2024-09-21T06:34:21.937366+0000","last_active":"2024-09-21T06:34:44.265516+0000","last_peered":"2024-09-21T06:34:44.265516+0000","last_clean":"2024-09-21T06:34:44.265516+0000","last_became_active":"2024-09-21T06:34:21.936988+0000","last_became_peered":"2024-09-21T06:34:21.936988+0000","last_unstale":"2024-09-21T06:34:44.265516+0000","last_undegraded":"2024-09-21T06:34:44.265516+0000","last_fullsized":"2024-09-21T06:34:44.265516+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:48:06.318645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265352+0000","last_change":"2024-09-21T06:34:23.947523+0000","last_active":"2024-09-21T06:34:44.265352+0000","last_peered":"2024-09-21T06:34:44.265352+0000","last_clean":"2024-09-21T06:34:44.265352+0000","last_became_active":"2024-09-21T06:34:23.947150+0000","last_became_peered":"2024-09-21T06:34:23.947150+0000","last_unstale":"2024-09-21T06:34:44.265352+0000","last_undegraded":"2024-09-21T06:34:44.265352+0000","last_fullsized":"2024-09-21T06:34:44.265352+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:18:50.417153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.226854+0000","last_change":"2024-09-21T06:34:21.938631+0000","last_active":"2024-09-21T06:34:44.226854+0000","last_peered":"2024-09-21T06:34:44.226854+0000","last_clean":"2024-09-21T06:34:44.226854+0000","last_became_active":"2024-09-21T06:34:21.938242+0000","last_became_peered":"2024-09-21T06:34:21.938242+0000","last_unstale":"2024-09-21T06:34:44.226854+0000","last_undegraded":"2024-09-21T06:34:44.226854+0000","last_fullsized":"2024-09-21T06:34:44.226854+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:40:02.056812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265725+0000","last_change":"2024-09-21T06:34:23.945276+0000","last_active":"2024-09-21T06:34:44.265725+0000","last_peered":"2024-09-21T06:34:44.265725+0000","last_clean":"2024-09-21T06:34:44.265725+0000","last_became_active":"2024-09-21T06:34:23.944914+0000","last_became_peered":"2024-09-21T06:34:23.944914+0000","last_unstale":"2024-09-21T06:34:44.265725+0000","last_undegraded":"2024-09-21T06:34:44.265725+0000","last_fullsized":"2024-09-21T06:34:44.265725+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:15:23.650908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"75'4","reported_seq":129,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:36:11.185383+0000","last_change":"2024-09-21T06:34:21.937593+0000","last_active":"2024-09-21T06:36:11.185383+0000","last_peered":"2024-09-21T06:36:11.185383+0000","last_clean":"2024-09-21T06:36:11.185383+0000","last_became_active":"2024-09-21T06:34:21.936851+0000","last_became_peered":"2024-09-21T06:34:21.936851+0000","last_unstale":"2024-09-21T06:36:11.185383+0000","last_undegraded":"2024-09-21T06:36:11.185383+0000","last_fullsized":"2024-09-21T06:36:11.185383+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:25:36.161431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265345+0000","last_change":"2024-09-21T06:34:23.945573+0000","last_active":"2024-09-21T06:34:44.265345+0000","last_peered":"2024-09-21T06:34:44.265345+0000","last_clean":"2024-09-21T06:34:44.265345+0000","last_became_active":"2024-09-21T06:34:23.944410+0000","last_became_peered":"2024-09-21T06:34:23.944410+0000","last_unstale":"2024-09-21T06:34:44.265345+0000","last_undegraded":"2024-09-21T06:34:44.265345+0000","last_fullsized":"2024-09-21T06:34:44.265345+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:33:54.613524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"75'15","reported_seq":39,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.229900+0000","last_change":"2024-09-21T06:34:22.096539+0000","last_active":"2024-09-21T06:34:44.229900+0000","last_peered":"2024-09-21T06:34:44.229900+0000","last_clean":"2024-09-21T06:34:44.229900+0000","last_became_active":"2024-09-21T06:34:22.096013+0000","last_became_peered":"2024-09-21T06:34:22.096013+0000","last_unstale":"2024-09-21T06:34:44.229900+0000","last_undegraded":"2024-09-21T06:34:44.229900+0000","last_fullsized":"2024-09-21T06:34:44.229900+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:30:59.414325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.226688+0000","last_change":"2024-09-21T06:34:23.958381+0000","last_active":"2024-09-21T06:34:44.226688+0000","last_peered":"2024-09-21T06:34:44.226688+0000","last_clean":"2024-09-21T06:34:44.226688+0000","last_became_active":"2024-09-21T06:34:23.957965+0000","last_became_peered":"2024-09-21T06:34:23.957965+0000","last_unstale":"2024-09-21T06:34:44.226688+0000","last_undegraded":"2024-09-21T06:34:44.226688+0000","last_fullsized":"2024-09-21T06:34:44.226688+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:37:43.474777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"75'2","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.230733+0000","last_change":"2024-09-21T06:34:21.937612+0000","last_active":"2024-09-21T06:34:44.230733+0000","last_peered":"2024-09-21T06:34:44.230733+0000","last_clean":"2024-09-21T06:34:44.230733+0000","last_became_active":"2024-09-21T06:34:21.936859+0000","last_became_peered":"2024-09-21T06:34:21.936859+0000","last_unstale":"2024-09-21T06:34:44.230733+0000","last_undegraded":"2024-09-21T06:34:44.230733+0000","last_fullsized":"2024-09-21T06:34:44.230733+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:54:40.957217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.229139+0000","last_change":"2024-09-21T06:34:44.228991+0000","last_active":"2024-09-21T06:34:44.229139+0000","last_peered":"2024-09-21T06:34:44.229139+0000","last_clean":"2024-09-21T06:34:44.229139+0000","last_became_active":"2024-09-21T06:34:44.228428+0000","last_became_peered":"2024-09-21T06:34:44.228428+0000","last_unstale":"2024-09-21T06:34:44.229139+0000","last_undegraded":"2024-09-21T06:34:44.229139+0000","last_fullsized":"2024-09-21T06:34:44.229139+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:55:21.719532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265523+0000","last_change":"2024-09-21T06:34:21.933392+0000","last_active":"2024-09-21T06:34:44.265523+0000","last_peered":"2024-09-21T06:34:44.265523+0000","last_clean":"2024-09-21T06:34:44.265523+0000","last_became_active":"2024-09-21T06:34:21.932999+0000","last_became_peered":"2024-09-21T06:34:21.932999+0000","last_unstale":"2024-09-21T06:34:44.265523+0000","last_undegraded":"2024-09-21T06:34:44.265523+0000","last_fullsized":"2024-09-21T06:34:44.265523+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:05:20.631755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.266194+0000","last_change":"2024-09-21T06:34:23.944675+0000","last_active":"2024-09-21T06:34:44.266194+0000","last_peered":"2024-09-21T06:34:44.266194+0000","last_clean":"2024-09-21T06:34:44.266194+0000","last_became_active":"2024-09-21T06:34:23.944258+0000","last_became_peered":"2024-09-21T06:34:23.944258+0000","last_unstale":"2024-09-21T06:34:44.266194+0000","last_undegraded":"2024-09-21T06:34:44.266194+0000","last_fullsized":"2024-09-21T06:34:44.266194+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:26:40.661840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"75'1","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.227259+0000","last_change":"2024-09-21T06:34:21.941064+0000","last_active":"2024-09-21T06:34:44.227259+0000","last_peered":"2024-09-21T06:34:44.227259+0000","last_clean":"2024-09-21T06:34:44.227259+0000","last_became_active":"2024-09-21T06:34:21.940667+0000","last_became_peered":"2024-09-21T06:34:21.940667+0000","last_unstale":"2024-09-21T06:34:44.227259+0000","last_undegraded":"2024-09-21T06:34:44.227259+0000","last_fullsized":"2024-09-21T06:34:44.227259+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:20:14.721719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'1","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.266571+0000","last_change":"2024-09-21T06:34:23.943503+0000","last_active":"2024-09-21T06:34:44.266571+0000","last_peered":"2024-09-21T06:34:44.266571+0000","last_clean":"2024-09-21T06:34:44.266571+0000","last_became_active":"2024-09-21T06:34:23.943097+0000","last_became_peered":"2024-09-21T06:34:23.943097+0000","last_unstale":"2024-09-21T06:34:44.266571+0000","last_undegraded":"2024-09-21T06:34:44.266571+0000","last_fullsized":"2024-09-21T06:34:44.266571+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:08:04.641273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"75'3","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265879+0000","last_change":"2024-09-21T06:34:22.096274+0000","last_active":"2024-09-21T06:34:44.265879+0000","last_peered":"2024-09-21T06:34:44.265879+0000","last_clean":"2024-09-21T06:34:44.265879+0000","last_became_active":"2024-09-21T06:34:22.095861+0000","last_became_peered":"2024-09-21T06:34:22.095861+0000","last_unstale":"2024-09-21T06:34:44.265879+0000","last_undegraded":"2024-09-21T06:34:44.265879+0000","last_fullsized":"2024-09-21T06:34:44.265879+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T18:22:47.807488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.266601+0000","last_change":"2024-09-21T06:34:23.953503+0000","last_active":"2024-09-21T06:34:44.266601+0000","last_peered":"2024-09-21T06:34:44.266601+0000","last_clean":"2024-09-21T06:34:44.266601+0000","last_became_active":"2024-09-21T06:34:23.952880+0000","last_became_peered":"2024-09-21T06:34:23.952880+0000","last_unstale":"2024-09-21T06:34:44.266601+0000","last_undegraded":"2024-09-21T06:34:44.266601+0000","last_fullsized":"2024-09-21T06:34:44.266601+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:29:47.746678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":98,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265624+0000","last_change":"2024-09-21T06:33:09.908154+0000","last_active":"2024-09-21T06:34:44.265624+0000","last_peered":"2024-09-21T06:34:44.265624+0000","last_clean":"2024-09-21T06:34:44.265624+0000","last_became_active":"2024-09-21T06:33:09.902397+0000","last_became_peered":"2024-09-21T06:33:09.902397+0000","last_unstale":"2024-09-21T06:34:44.265624+0000","last_undegraded":"2024-09-21T06:34:44.265624+0000","last_fullsized":"2024-09-21T06:34:44.265624+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:29:42.295555+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:29:42.295555+0000","last_clean_scrub_stamp":"2024-09-21T06:29:42.295555+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:15:17.111178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"75'3","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.225389+0000","last_change":"2024-09-21T06:34:21.932618+0000","last_active":"2024-09-21T06:34:44.225389+0000","last_peered":"2024-09-21T06:34:44.225389+0000","last_clean":"2024-09-21T06:34:44.225389+0000","last_became_active":"2024-09-21T06:34:21.932187+0000","last_became_peered":"2024-09-21T06:34:21.932187+0000","last_unstale":"2024-09-21T06:34:44.225389+0000","last_undegraded":"2024-09-21T06:34:44.225389+0000","last_fullsized":"2024-09-21T06:34:44.225389+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:19:06.780448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.224167+0000","last_change":"2024-09-21T06:34:23.953580+0000","last_active":"2024-09-21T06:34:44.224167+0000","last_peered":"2024-09-21T06:34:44.224167+0000","last_clean":"2024-09-21T06:34:44.224167+0000","last_became_active":"2024-09-21T06:34:23.952222+0000","last_became_peered":"2024-09-21T06:34:23.952222+0000","last_unstale":"2024-09-21T06:34:44.224167+0000","last_undegraded":"2024-09-21T06:34:44.224167+0000","last_fullsized":"2024-09-21T06:34:44.224167+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:19.759042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265531+0000","last_change":"2024-09-21T06:34:21.939178+0000","last_active":"2024-09-21T06:34:44.265531+0000","last_peered":"2024-09-21T06:34:44.265531+0000","last_clean":"2024-09-21T06:34:44.265531+0000","last_became_active":"2024-09-21T06:34:21.938755+0000","last_became_peered":"2024-09-21T06:34:21.938755+0000","last_unstale":"2024-09-21T06:34:44.265531+0000","last_undegraded":"2024-09-21T06:34:44.265531+0000","last_fullsized":"2024-09-21T06:34:44.265531+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:10.474432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.264822+0000","last_change":"2024-09-21T06:34:23.954196+0000","last_active":"2024-09-21T06:34:44.264822+0000","last_peered":"2024-09-21T06:34:44.264822+0000","last_clean":"2024-09-21T06:34:44.264822+0000","last_became_active":"2024-09-21T06:34:23.953843+0000","last_became_peered":"2024-09-21T06:34:23.953843+0000","last_unstale":"2024-09-21T06:34:44.264822+0000","last_undegraded":"2024-09-21T06:34:44.264822+0000","last_fullsized":"2024-09-21T06:34:44.264822+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:41:02.896704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"75'4","reported_seq":123,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:36:08.180205+0000","last_change":"2024-09-21T06:34:22.095920+0000","last_active":"2024-09-21T06:36:08.180205+0000","last_peered":"2024-09-21T06:36:08.180205+0000","last_clean":"2024-09-21T06:36:08.180205+0000","last_became_active":"2024-09-21T06:34:22.095376+0000","last_became_peered":"2024-09-21T06:34:22.095376+0000","last_unstale":"2024-09-21T06:36:08.180205+0000","last_undegraded":"2024-09-21T06:36:08.180205+0000","last_fullsized":"2024-09-21T06:36:08.180205+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:40:44.400566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":96,"num_read_kb":96,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.226479+0000","last_change":"2024-09-21T06:34:23.956541+0000","last_active":"2024-09-21T06:34:44.226479+0000","last_peered":"2024-09-21T06:34:44.226479+0000","last_clean":"2024-09-21T06:34:44.226479+0000","last_became_active":"2024-09-21T06:34:23.956150+0000","last_became_peered":"2024-09-21T06:34:23.956150+0000","last_unstale":"2024-09-21T06:34:44.226479+0000","last_undegraded":"2024-09-21T06:34:44.226479+0000","last_fullsized":"2024-09-21T06:34:44.226479+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:09:32.432391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.266674+0000","last_change":"2024-09-21T06:34:21.942244+0000","last_active":"2024-09-21T06:34:44.266674+0000","last_peered":"2024-09-21T06:34:44.266674+0000","last_clean":"2024-09-21T06:34:44.266674+0000","last_became_active":"2024-09-21T06:34:21.941761+0000","last_became_peered":"2024-09-21T06:34:21.941761+0000","last_unstale":"2024-09-21T06:34:44.266674+0000","last_undegraded":"2024-09-21T06:34:44.266674+0000","last_fullsized":"2024-09-21T06:34:44.266674+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:35:10.507103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.227647+0000","last_change":"2024-09-21T06:34:23.951250+0000","last_active":"2024-09-21T06:34:44.227647+0000","last_peered":"2024-09-21T06:34:44.227647+0000","last_clean":"2024-09-21T06:34:44.227647+0000","last_became_active":"2024-09-21T06:34:23.950015+0000","last_became_peered":"2024-09-21T06:34:23.950015+0000","last_unstale":"2024-09-21T06:34:44.227647+0000","last_undegraded":"2024-09-21T06:34:44.227647+0000","last_fullsized":"2024-09-21T06:34:44.227647+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:53:22.884049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.266799+0000","last_change":"2024-09-21T06:34:44.266717+0000","last_active":"2024-09-21T06:34:44.266799+0000","last_peered":"2024-09-21T06:34:44.266799+0000","last_clean":"2024-09-21T06:34:44.266799+0000","last_became_active":"2024-09-21T06:34:44.266256+0000","last_became_peered":"2024-09-21T06:34:44.266256+0000","last_unstale":"2024-09-21T06:34:44.266799+0000","last_undegraded":"2024-09-21T06:34:44.266799+0000","last_fullsized":"2024-09-21T06:34:44.266799+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:38:04.674592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"75'1","reported_seq":19,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.227589+0000","last_change":"2024-09-21T06:34:23.947823+0000","last_active":"2024-09-21T06:34:44.227589+0000","last_peered":"2024-09-21T06:34:44.227589+0000","last_clean":"2024-09-21T06:34:44.227589+0000","last_became_active":"2024-09-21T06:34:23.947362+0000","last_became_peered":"2024-09-21T06:34:23.947362+0000","last_unstale":"2024-09-21T06:34:44.227589+0000","last_undegraded":"2024-09-21T06:34:44.227589+0000","last_fullsized":"2024-09-21T06:34:44.227589+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:32:22.401819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"75'1","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.230506+0000","last_change":"2024-09-21T06:34:22.096537+0000","last_active":"2024-09-21T06:34:44.230506+0000","last_peered":"2024-09-21T06:34:44.230506+0000","last_clean":"2024-09-21T06:34:44.230506+0000","last_became_active":"2024-09-21T06:34:22.095875+0000","last_became_peered":"2024-09-21T06:34:22.095875+0000","last_unstale":"2024-09-21T06:34:44.230506+0000","last_undegraded":"2024-09-21T06:34:44.230506+0000","last_fullsized":"2024-09-21T06:34:44.230506+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:11:44.955531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265151+0000","last_change":"2024-09-21T06:34:23.938784+0000","last_active":"2024-09-21T06:34:44.265151+0000","last_peered":"2024-09-21T06:34:44.265151+0000","last_clean":"2024-09-21T06:34:44.265151+0000","last_became_active":"2024-09-21T06:34:23.938400+0000","last_became_peered":"2024-09-21T06:34:23.938400+0000","last_unstale":"2024-09-21T06:34:44.265151+0000","last_undegraded":"2024-09-21T06:34:44.265151+0000","last_fullsized":"2024-09-21T06:34:44.265151+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:00:13.210874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"77'10","reported_seq":46,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:48.958566+0000","last_change":"2024-09-21T06:34:44.235532+0000","last_active":"2024-09-21T06:34:48.958566+0000","last_peered":"2024-09-21T06:34:48.958566+0000","last_clean":"2024-09-21T06:34:48.958566+0000","last_became_active":"2024-09-21T06:34:44.230220+0000","last_became_peered":"2024-09-21T06:34:44.230220+0000","last_unstale":"2024-09-21T06:34:48.958566+0000","last_undegraded":"2024-09-21T06:34:48.958566+0000","last_fullsized":"2024-09-21T06:34:48.958566+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:07:23.398177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":11,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.224475+0000","last_change":"2024-09-21T06:34:23.953477+0000","last_active":"2024-09-21T06:34:44.224475+0000","last_peered":"2024-09-21T06:34:44.224475+0000","last_clean":"2024-09-21T06:34:44.224475+0000","last_became_active":"2024-09-21T06:34:23.951404+0000","last_became_peered":"2024-09-21T06:34:23.951404+0000","last_unstale":"2024-09-21T06:34:44.224475+0000","last_undegraded":"2024-09-21T06:34:44.224475+0000","last_fullsized":"2024-09-21T06:34:44.224475+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:13:17.126680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"75'4","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.225262+0000","last_change":"2024-09-21T06:34:22.031837+0000","last_active":"2024-09-21T06:34:44.225262+0000","last_peered":"2024-09-21T06:34:44.225262+0000","last_clean":"2024-09-21T06:34:44.225262+0000","last_became_active":"2024-09-21T06:34:22.031377+0000","last_became_peered":"2024-09-21T06:34:22.031377+0000","last_unstale":"2024-09-21T06:34:44.225262+0000","last_undegraded":"2024-09-21T06:34:44.225262+0000","last_fullsized":"2024-09-21T06:34:44.225262+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:14:32.536634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265835+0000","last_change":"2024-09-21T06:34:23.955321+0000","last_active":"2024-09-21T06:34:44.265835+0000","last_peered":"2024-09-21T06:34:44.265835+0000","last_clean":"2024-09-21T06:34:44.265835+0000","last_became_active":"2024-09-21T06:34:23.954906+0000","last_became_peered":"2024-09-21T06:34:23.954906+0000","last_unstale":"2024-09-21T06:34:44.265835+0000","last_undegraded":"2024-09-21T06:34:44.265835+0000","last_fullsized":"2024-09-21T06:34:44.265835+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:59:07.771268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265823+0000","last_change":"2024-09-21T06:34:22.096135+0000","last_active":"2024-09-21T06:34:44.265823+0000","last_peered":"2024-09-21T06:34:44.265823+0000","last_clean":"2024-09-21T06:34:44.265823+0000","last_became_active":"2024-09-21T06:34:22.095721+0000","last_became_peered":"2024-09-21T06:34:22.095721+0000","last_unstale":"2024-09-21T06:34:44.265823+0000","last_undegraded":"2024-09-21T06:34:44.265823+0000","last_fullsized":"2024-09-21T06:34:44.265823+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:35:28.994324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.229717+0000","last_change":"2024-09-21T06:34:23.951769+0000","last_active":"2024-09-21T06:34:44.229717+0000","last_peered":"2024-09-21T06:34:44.229717+0000","last_clean":"2024-09-21T06:34:44.229717+0000","last_became_active":"2024-09-21T06:34:23.951377+0000","last_became_peered":"2024-09-21T06:34:23.951377+0000","last_unstale":"2024-09-21T06:34:44.229717+0000","last_undegraded":"2024-09-21T06:34:44.229717+0000","last_fullsized":"2024-09-21T06:34:44.229717+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:49:44.291714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"75'3","reported_seq":26,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.224147+0000","last_change":"2024-09-21T06:34:21.933909+0000","last_active":"2024-09-21T06:34:44.224147+0000","last_peered":"2024-09-21T06:34:44.224147+0000","last_clean":"2024-09-21T06:34:44.224147+0000","last_became_active":"2024-09-21T06:34:21.933524+0000","last_became_peered":"2024-09-21T06:34:21.933524+0000","last_unstale":"2024-09-21T06:34:44.224147+0000","last_undegraded":"2024-09-21T06:34:44.224147+0000","last_fullsized":"2024-09-21T06:34:44.224147+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:42:58.110444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.225073+0000","last_change":"2024-09-21T06:34:23.948586+0000","last_active":"2024-09-21T06:34:44.225073+0000","last_peered":"2024-09-21T06:34:44.225073+0000","last_clean":"2024-09-21T06:34:44.225073+0000","last_became_active":"2024-09-21T06:34:23.948225+0000","last_became_peered":"2024-09-21T06:34:23.948225+0000","last_unstale":"2024-09-21T06:34:44.225073+0000","last_undegraded":"2024-09-21T06:34:44.225073+0000","last_fullsized":"2024-09-21T06:34:44.225073+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:28:24.272712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"75'1","reported_seq":24,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265358+0000","last_change":"2024-09-21T06:34:21.935617+0000","last_active":"2024-09-21T06:34:44.265358+0000","last_peered":"2024-09-21T06:34:44.265358+0000","last_clean":"2024-09-21T06:34:44.265358+0000","last_became_active":"2024-09-21T06:34:21.934601+0000","last_became_peered":"2024-09-21T06:34:21.934601+0000","last_unstale":"2024-09-21T06:34:44.265358+0000","last_undegraded":"2024-09-21T06:34:44.265358+0000","last_fullsized":"2024-09-21T06:34:44.265358+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:17:30.836070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.224206+0000","last_change":"2024-09-21T06:34:23.947661+0000","last_active":"2024-09-21T06:34:44.224206+0000","last_peered":"2024-09-21T06:34:44.224206+0000","last_clean":"2024-09-21T06:34:44.224206+0000","last_became_active":"2024-09-21T06:34:23.947307+0000","last_became_peered":"2024-09-21T06:34:23.947307+0000","last_unstale":"2024-09-21T06:34:44.224206+0000","last_undegraded":"2024-09-21T06:34:44.224206+0000","last_fullsized":"2024-09-21T06:34:44.224206+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:08.045291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"75'4","reported_seq":28,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.230116+0000","last_change":"2024-09-21T06:34:21.942749+0000","last_active":"2024-09-21T06:34:44.230116+0000","last_peered":"2024-09-21T06:34:44.230116+0000","last_clean":"2024-09-21T06:34:44.230116+0000","last_became_active":"2024-09-21T06:34:21.942283+0000","last_became_peered":"2024-09-21T06:34:21.942283+0000","last_unstale":"2024-09-21T06:34:44.230116+0000","last_undegraded":"2024-09-21T06:34:44.230116+0000","last_fullsized":"2024-09-21T06:34:44.230116+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:47.477956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.266544+0000","last_change":"2024-09-21T06:34:23.957389+0000","last_active":"2024-09-21T06:34:44.266544+0000","last_peered":"2024-09-21T06:34:44.266544+0000","last_clean":"2024-09-21T06:34:44.266544+0000","last_became_active":"2024-09-21T06:34:23.957032+0000","last_became_peered":"2024-09-21T06:34:23.957032+0000","last_unstale":"2024-09-21T06:34:44.266544+0000","last_undegraded":"2024-09-21T06:34:44.266544+0000","last_fullsized":"2024-09-21T06:34:44.266544+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:00:53.932062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.227302+0000","last_change":"2024-09-21T06:34:23.957304+0000","last_active":"2024-09-21T06:34:44.227302+0000","last_peered":"2024-09-21T06:34:44.227302+0000","last_clean":"2024-09-21T06:34:44.227302+0000","last_became_active":"2024-09-21T06:34:23.956931+0000","last_became_peered":"2024-09-21T06:34:23.956931+0000","last_unstale":"2024-09-21T06:34:44.227302+0000","last_undegraded":"2024-09-21T06:34:44.227302+0000","last_fullsized":"2024-09-21T06:34:44.227302+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:14:12.240686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.230138+0000","last_change":"2024-09-21T06:34:21.937150+0000","last_active":"2024-09-21T06:34:44.230138+0000","last_peered":"2024-09-21T06:34:44.230138+0000","last_clean":"2024-09-21T06:34:44.230138+0000","last_became_active":"2024-09-21T06:34:21.936037+0000","last_became_peered":"2024-09-21T06:34:21.936037+0000","last_unstale":"2024-09-21T06:34:44.230138+0000","last_undegraded":"2024-09-21T06:34:44.230138+0000","last_fullsized":"2024-09-21T06:34:44.230138+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:24:44.821346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265815+0000","last_change":"2024-09-21T06:34:23.955585+0000","last_active":"2024-09-21T06:34:44.265815+0000","last_peered":"2024-09-21T06:34:44.265815+0000","last_clean":"2024-09-21T06:34:44.265815+0000","last_became_active":"2024-09-21T06:34:23.955225+0000","last_became_peered":"2024-09-21T06:34:23.955225+0000","last_unstale":"2024-09-21T06:34:44.265815+0000","last_undegraded":"2024-09-21T06:34:44.265815+0000","last_fullsized":"2024-09-21T06:34:44.265815+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:07:56.735854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"75'4","reported_seq":27,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.230684+0000","last_change":"2024-09-21T06:34:21.941804+0000","last_active":"2024-09-21T06:34:44.230684+0000","last_peered":"2024-09-21T06:34:44.230684+0000","last_clean":"2024-09-21T06:34:44.230684+0000","last_became_active":"2024-09-21T06:34:21.941387+0000","last_became_peered":"2024-09-21T06:34:21.941387+0000","last_unstale":"2024-09-21T06:34:44.230684+0000","last_undegraded":"2024-09-21T06:34:44.230684+0000","last_fullsized":"2024-09-21T06:34:44.230684+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:34:51.217549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.265988+0000","last_change":"2024-09-21T06:34:23.957429+0000","last_active":"2024-09-21T06:34:44.265988+0000","last_peered":"2024-09-21T06:34:44.265988+0000","last_clean":"2024-09-21T06:34:44.265988+0000","last_became_active":"2024-09-21T06:34:23.956471+0000","last_became_peered":"2024-09-21T06:34:23.956471+0000","last_unstale":"2024-09-21T06:34:44.265988+0000","last_undegraded":"2024-09-21T06:34:44.265988+0000","last_fullsized":"2024-09-21T06:34:44.265988+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:46:26.770549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"75'2","reported_seq":25,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.224539+0000","last_change":"2024-09-21T06:34:22.096267+0000","last_active":"2024-09-21T06:34:44.224539+0000","last_peered":"2024-09-21T06:34:44.224539+0000","last_clean":"2024-09-21T06:34:44.224539+0000","last_became_active":"2024-09-21T06:34:22.095799+0000","last_became_peered":"2024-09-21T06:34:22.095799+0000","last_unstale":"2024-09-21T06:34:44.224539+0000","last_undegraded":"2024-09-21T06:34:44.224539+0000","last_fullsized":"2024-09-21T06:34:44.224539+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T16:29:00.075016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":18,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.224392+0000","last_change":"2024-09-21T06:34:23.952294+0000","last_active":"2024-09-21T06:34:44.224392+0000","last_peered":"2024-09-21T06:34:44.224392+0000","last_clean":"2024-09-21T06:34:44.224392+0000","last_became_active":"2024-09-21T06:34:23.951919+0000","last_became_peered":"2024-09-21T06:34:23.951919+0000","last_unstale":"2024-09-21T06:34:44.224392+0000","last_undegraded":"2024-09-21T06:34:44.224392+0000","last_fullsized":"2024-09-21T06:34:44.224392+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:22.923018+0000","last_clean_scrub_stamp":"2024-09-21T06:34:22.923018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T17:30:28.039754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"75'9","reported_seq":33,"reported_epoch":77,"state":"active+clean","last_fresh":"2024-09-21T06:34:44.226566+0000","last_change":"2024-09-21T06:34:21.934818+0000","last_active":"2024-09-21T06:34:44.226566+0000","last_peered":"2024-09-21T06:34:44.226566+0000","last_clean":"2024-09-21T06:34:44.226566+0000","last_became_active":"2024-09-21T06:34:21.934415+0000","last_became_peered":"2024-09-21T06:34:21.934415+0000","last_unstale":"2024-09-21T06:34:44.226566+0000","last_undegraded":"2024-09-21T06:34:44.226566+0000","last_fullsized":"2024-09-21T06:34:44.226566+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T06:34:20.919319+0000","last_clean_scrub_stamp":"2024-09-21T06:34:20.919319+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:25:48.460699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68602,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":620,"num_read_kb":381,"num_write":164,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":11,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":205806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":140,"ondisk_log_size":140,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282715,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":69,"seq":296352743459,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27840,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717312,"statfs":{"total":95995035648,"available":95966527488,"internally_reserved":0,"allocated":835584,"data_stored":417151,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":63,"seq":270582939687,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":991232,"data_stored":1073233,"data_compressed":41743,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":58,"seq":249108103213,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27856,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717296,"statfs":{"total":95995035648,"available":95966511104,"internally_reserved":0,"allocated":851968,"data_stored":417387,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":52,"seq":223338299442,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32024,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713128,"statfs":{"total":95995035648,"available":95962243072,"internally_reserved":0,"allocated":851968,"data_stored":417307,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":47,"seq":201863462967,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":901120,"data_stored":1009628,"data_compressed":41743,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626492,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36172,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708980,"statfs":{"total":95995035648,"available":95957995520,"internally_reserved":0,"allocated":839680,"data_stored":416776,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822722,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":913408,"data_stored":1008921,"data_compressed":41743,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986248,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36168,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708984,"statfs":{"total":95995035648,"available":95957999616,"internally_reserved":0,"allocated":843776,"data_stored":417604,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182476,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36180,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708972,"statfs":{"total":95995035648,"available":95957987328,"internally_reserved":0,"allocated":856064,"data_stored":417087,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378706,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32092,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713060,"statfs":{"total":95995035648,"available":95962173440,"internally_reserved":0,"allocated":929792,"data_stored":482520,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542231,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":480779,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705755,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27872,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717280,"statfs":{"total":95995035648,"available":95966494720,"internally_reserved":0,"allocated":860160,"data_stored":418047,"data_compressed":5795,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34325,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34325,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34325,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35948,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":64210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":65951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":66179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T06:36:15.103 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:36:15.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:36:14 smithi018 ceph-mon[34477]: pgmap v320: 97 pgs: 97 active+clean; 644 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-21T06:36:15.390 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:36:15.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:15.919+0000 7f702b06f640 1 -- 172.21.15.7:0/431101975 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7024102a60 msgr2=0x7f7024102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:15.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:15.919+0000 7f702b06f640 1 --2- 172.21.15.7:0/431101975 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7024102a60 0x7f7024102e70 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f7014009900 tx=0x7f701402a410 comp rx=0 tx=0).stop 2024-09-21T06:36:15.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:15.919+0000 7f702b06f640 1 -- 172.21.15.7:0/431101975 shutdown_connections 2024-09-21T06:36:15.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:15.919+0000 7f702b06f640 1 --2- 172.21.15.7:0/431101975 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7024108cf0 0x7f702410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:15.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:15.919+0000 7f702b06f640 1 --2- 172.21.15.7:0/431101975 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f70241083a0 0x7f70241087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:15.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:15.919+0000 7f702b06f640 1 --2- 172.21.15.7:0/431101975 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7024102a60 0x7f7024102e70 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:15.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:15.919+0000 7f702b06f640 1 -- 172.21.15.7:0/431101975 >> 172.21.15.7:0/431101975 conn(0x7f7024079730 msgr2=0x7f7024079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:15.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:15.919+0000 7f702b06f640 1 -- 172.21.15.7:0/431101975 shutdown_connections 2024-09-21T06:36:15.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:15.919+0000 7f702b06f640 1 -- 172.21.15.7:0/431101975 wait complete. 2024-09-21T06:36:15.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:15.920+0000 7f702b06f640 1 Processor -- start 2024-09-21T06:36:15.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:15.920+0000 7f702b06f640 1 -- start start 2024-09-21T06:36:15.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:15.920+0000 7f702b06f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7024102a60 0x7f7024104250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:15.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:15.920+0000 7f702b06f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f70241083a0 0x7f7024104790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:15.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:15.920+0000 7f702b06f640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7024108cf0 0x7f7024104cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:15.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:15.920+0000 7f702b06f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7024112960 con 0x7f70241083a0 2024-09-21T06:36:15.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:15.920+0000 7f702b06f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f70241127e0 con 0x7f7024102a60 2024-09-21T06:36:15.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:15.920+0000 7f702b06f640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7024112ae0 con 0x7f7024108cf0 2024-09-21T06:36:15.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:15.921+0000 7f7023fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f70241083a0 0x7f7024104790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:15.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:15.921+0000 7f7023fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f70241083a0 0x7f7024104790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42456/0 (socket says 172.21.15.7:42456) 2024-09-21T06:36:15.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:15.921+0000 7f7023fff640 1 -- 172.21.15.7:0/397624265 learned_addr learned my addr 172.21.15.7:0/397624265 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:36:15.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:15.921+0000 7f7028e0b640 1 --2- 172.21.15.7:0/397624265 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7024102a60 0x7f7024104250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:15.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:15.921+0000 7f702960c640 1 --2- 172.21.15.7:0/397624265 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7024108cf0 0x7f7024104cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:15.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:15.921+0000 7f7023fff640 1 -- 172.21.15.7:0/397624265 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7024108cf0 msgr2=0x7f7024104cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:15.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:15.921+0000 7f7023fff640 1 --2- 172.21.15.7:0/397624265 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7024108cf0 0x7f7024104cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:15.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:15.921+0000 7f7023fff640 1 -- 172.21.15.7:0/397624265 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7024102a60 msgr2=0x7f7024104250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:15.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:15.921+0000 7f7023fff640 1 --2- 172.21.15.7:0/397624265 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7024102a60 0x7f7024104250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:15.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:15.921+0000 7f7023fff640 1 -- 172.21.15.7:0/397624265 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70241a8720 con 0x7f70241083a0 2024-09-21T06:36:15.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:15.921+0000 7f7023fff640 1 --2- 172.21.15.7:0/397624265 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f70241083a0 0x7f7024104790 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f7018005fd0 tx=0x7f701800dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:15.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:15.921+0000 7f7021ffb640 1 -- 172.21.15.7:0/397624265 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7018017070 con 0x7f70241083a0 2024-09-21T06:36:15.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:15.921+0000 7f702b06f640 1 -- 172.21.15.7:0/397624265 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70241a8a10 con 0x7f70241083a0 2024-09-21T06:36:15.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:15.921+0000 7f7021ffb640 1 -- 172.21.15.7:0/397624265 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7018009c30 con 0x7f70241083a0 2024-09-21T06:36:15.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:15.921+0000 7f7021ffb640 1 -- 172.21.15.7:0/397624265 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7018003d30 con 0x7f70241083a0 2024-09-21T06:36:15.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:15.922+0000 7f702b06f640 1 -- 172.21.15.7:0/397624265 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70241a8f50 con 0x7f70241083a0 2024-09-21T06:36:15.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:15.923+0000 7f702b06f640 1 -- 172.21.15.7:0/397624265 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7024102e70 con 0x7f70241083a0 2024-09-21T06:36:15.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:15.924+0000 7f7021ffb640 1 -- 172.21.15.7:0/397624265 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 23) ==== 154528+0+0 (secure 0 0 0) 0x7f7018003ed0 con 0x7f70241083a0 2024-09-21T06:36:15.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:15.925+0000 7f7021ffb640 1 --2- 172.21.15.7:0/397624265 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f700c0b6560 0x7f700c0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:15.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:15.925+0000 7f7028e0b640 1 --2- 172.21.15.7:0/397624265 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f700c0b6560 0x7f700c0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:15.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:15.925+0000 7f7021ffb640 1 -- 172.21.15.7:0/397624265 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f70180e7810 con 0x7f70241083a0 2024-09-21T06:36:15.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:15.926+0000 7f7028e0b640 1 --2- 172.21.15.7:0/397624265 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f700c0b6560 0x7f700c0b8a70 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7014000c00 tx=0x7f7014031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:15.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:15.929+0000 7f7021ffb640 1 -- 172.21.15.7:0/397624265 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7018020030 con 0x7f70241083a0 2024-09-21T06:36:16.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:36:15 smithi144 ceph-mon[34653]: from='client.15402 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:36:16.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:36:15 smithi144 ceph-mon[34653]: from='client.15408 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:36:16.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:36:15 smithi007 ceph-mon[30983]: from='client.15402 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:36:16.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:36:15 smithi007 ceph-mon[30983]: from='client.15408 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:36:16.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:36:15 smithi018 ceph-mon[34477]: from='client.15402 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:36:16.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:36:15 smithi018 ceph-mon[34477]: from='client.15408 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:36:16.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:16.159+0000 7f702b06f640 1 -- 172.21.15.7:0/397624265 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7024105550 con 0x7f70241083a0 2024-09-21T06:36:16.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:16.160+0000 7f7021ffb640 1 -- 172.21.15.7:0/397624265 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11899 (secure 0 0 0) 0x7f7024105550 con 0x7f70241083a0 2024-09-21T06:36:16.163 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:36:16.163 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-21T06:36:10:753693+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2015971546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2015971546},{"type":"v1","addr":"172.21.15.7:6835","nonce":2015971546}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/2350816224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":2350816224},{"type":"v1","addr":"172.21.15.7:6837","nonce":2350816224}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14823,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/1669980572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":1669980572},{"type":"v1","addr":"172.21.15.7:6839","nonce":1669980572}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14835,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/2528308973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":2528308973},{"type":"v1","addr":"172.21.15.7:6841","nonce":2528308973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24623,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1337382979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1337382979},{"type":"v1","addr":"172.21.15.18:6833","nonce":1337382979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/2751454345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":2751454345},{"type":"v1","addr":"172.21.15.144:6833","nonce":2751454345}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:34:24.627168+0000","modified":"2024-09-21T06:36:10.737288+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24716,"mds_1":24688,"mds_2":24686},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24656":{"gid":24656,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6835/158884796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":158884796},{"type":"v1","addr":"172.21.15.18:6835","nonce":158884796}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6835/3636739922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3636739922},{"type":"v1","addr":"172.21.15.144:6835","nonce":3636739922}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24673":{"gid":24673,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6837/1126341753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":1126341753},{"type":"v1","addr":"172.21.15.144:6837","nonce":1126341753}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.18:6837/1539670694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1539670694},{"type":"v1","addr":"172.21.15.18:6837","nonce":1539670694}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24688":{"gid":24688,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.144:6839/4027821922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":4027821922},{"type":"v1","addr":"172.21.15.144:6839","nonce":4027821922}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24716":{"gid":24716,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.18:6839/3798713532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":3798713532},{"type":"v1","addr":"172.21.15.18:6839","nonce":3798713532}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24716,"qdb_cluster":[24716,24688,24686]},"id":1}]} 2024-09-21T06:36:16.163 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-21T06:36:16.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:16.162+0000 7f702b06f640 1 -- 172.21.15.7:0/397624265 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f700c0b6560 msgr2=0x7f700c0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:16.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:16.162+0000 7f702b06f640 1 --2- 172.21.15.7:0/397624265 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f700c0b6560 0x7f700c0b8a70 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7014000c00 tx=0x7f7014031400 comp rx=0 tx=0).stop 2024-09-21T06:36:16.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:16.162+0000 7f702b06f640 1 -- 172.21.15.7:0/397624265 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f70241083a0 msgr2=0x7f7024104790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:16.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:16.162+0000 7f702b06f640 1 --2- 172.21.15.7:0/397624265 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f70241083a0 0x7f7024104790 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f7018005fd0 tx=0x7f701800dde0 comp rx=0 tx=0).stop 2024-09-21T06:36:16.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:16.162+0000 7f702b06f640 1 -- 172.21.15.7:0/397624265 shutdown_connections 2024-09-21T06:36:16.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:16.162+0000 7f702b06f640 1 --2- 172.21.15.7:0/397624265 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f700c0b6560 0x7f700c0b8a70 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:16.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:16.162+0000 7f702b06f640 1 --2- 172.21.15.7:0/397624265 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7024108cf0 0x7f7024104cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:16.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:16.162+0000 7f702b06f640 1 --2- 172.21.15.7:0/397624265 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f70241083a0 0x7f7024104790 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:16.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:16.162+0000 7f702b06f640 1 --2- 172.21.15.7:0/397624265 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7024102a60 0x7f7024104250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:16.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:16.162+0000 7f702b06f640 1 -- 172.21.15.7:0/397624265 >> 172.21.15.7:0/397624265 conn(0x7f7024079730 msgr2=0x7f7024101a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:16.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:16.163+0000 7f702b06f640 1 -- 172.21.15.7:0/397624265 shutdown_connections 2024-09-21T06:36:16.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:16.163+0000 7f702b06f640 1 -- 172.21.15.7:0/397624265 wait complete. 2024-09-21T06:36:16.962 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T06:36:17.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:36:16 smithi144 ceph-mon[34653]: from='client.15414 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:36:17.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:36:16 smithi144 ceph-mon[34653]: pgmap v321: 97 pgs: 97 active+clean; 644 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-21T06:36:17.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:36:16 smithi144 ceph-mon[34653]: mgrmap e23: x(active, since 8m), standbys: z, y 2024-09-21T06:36:17.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:36:16 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/397624265' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:36:17.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:36:16 smithi007 ceph-mon[30983]: from='client.15414 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:36:17.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:36:16 smithi007 ceph-mon[30983]: pgmap v321: 97 pgs: 97 active+clean; 644 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-21T06:36:17.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:36:16 smithi007 ceph-mon[30983]: mgrmap e23: x(active, since 8m), standbys: z, y 2024-09-21T06:36:17.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:36:16 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/397624265' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:36:17.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:36:16 smithi018 ceph-mon[34477]: from='client.15414 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T06:36:17.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:36:16 smithi018 ceph-mon[34477]: pgmap v321: 97 pgs: 97 active+clean; 644 KiB data, 359 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-21T06:36:17.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:36:16 smithi018 ceph-mon[34477]: mgrmap e23: x(active, since 8m), standbys: z, y 2024-09-21T06:36:17.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:36:16 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/397624265' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:36:17.227 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:36:17.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:17.728+0000 7f6603b5b640 1 -- 172.21.15.7:0/3783771650 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65fc109df0 msgr2=0x7f65fc110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:17.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:17.728+0000 7f6603b5b640 1 --2- 172.21.15.7:0/3783771650 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65fc109df0 0x7f65fc110620 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f65f4009ca0 tx=0x7f65f402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:36:17.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:17.728+0000 7f6603b5b640 1 -- 172.21.15.7:0/3783771650 shutdown_connections 2024-09-21T06:36:17.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:17.728+0000 7f6603b5b640 1 --2- 172.21.15.7:0/3783771650 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65fc109df0 0x7f65fc110620 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:17.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:17.728+0000 7f6603b5b640 1 --2- 172.21.15.7:0/3783771650 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f65fc1094a0 0x7f65fc1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:17.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:17.728+0000 7f6603b5b640 1 --2- 172.21.15.7:0/3783771650 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65fc103b60 0x7f65fc103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:17.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:17.728+0000 7f6603b5b640 1 -- 172.21.15.7:0/3783771650 >> 172.21.15.7:0/3783771650 conn(0x7f65fc07b850 msgr2=0x7f65fc07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:17.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:17.729+0000 7f6603b5b640 1 -- 172.21.15.7:0/3783771650 shutdown_connections 2024-09-21T06:36:17.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:17.729+0000 7f6603b5b640 1 -- 172.21.15.7:0/3783771650 wait complete. 2024-09-21T06:36:17.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:17.729+0000 7f6603b5b640 1 Processor -- start 2024-09-21T06:36:17.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:17.729+0000 7f6603b5b640 1 -- start start 2024-09-21T06:36:17.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:17.730+0000 7f6603b5b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65fc103b60 0x7f65fc19a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:17.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:17.730+0000 7f6603b5b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f65fc1094a0 0x7f65fc19aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:17.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:17.730+0000 7f6603b5b640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65fc109df0 0x7f65fc19fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:17.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:17.730+0000 7f6603b5b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f65fc113ab0 con 0x7f65fc103b60 2024-09-21T06:36:17.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:17.730+0000 7f6603b5b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f65fc113930 con 0x7f65fc1094a0 2024-09-21T06:36:17.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:17.730+0000 7f6603b5b640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f65fc113c30 con 0x7f65fc109df0 2024-09-21T06:36:17.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:17.730+0000 7f66018f7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65fc103b60 0x7f65fc19a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:17.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:17.730+0000 7f66018f7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65fc103b60 0x7f65fc19a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42474/0 (socket says 172.21.15.7:42474) 2024-09-21T06:36:17.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:17.730+0000 7f66018f7640 1 -- 172.21.15.7:0/1429880341 learned_addr learned my addr 172.21.15.7:0/1429880341 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:36:17.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:17.730+0000 7f66020f8640 1 --2- 172.21.15.7:0/1429880341 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65fc109df0 0x7f65fc19fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:17.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:17.730+0000 7f66010f6640 1 --2- 172.21.15.7:0/1429880341 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f65fc1094a0 0x7f65fc19aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:17.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:17.730+0000 7f66018f7640 1 -- 172.21.15.7:0/1429880341 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65fc109df0 msgr2=0x7f65fc19fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:17.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:17.730+0000 7f66018f7640 1 --2- 172.21.15.7:0/1429880341 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65fc109df0 0x7f65fc19fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:17.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:17.730+0000 7f66018f7640 1 -- 172.21.15.7:0/1429880341 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f65fc1094a0 msgr2=0x7f65fc19aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:17.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:17.730+0000 7f66018f7640 1 --2- 172.21.15.7:0/1429880341 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f65fc1094a0 0x7f65fc19aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:17.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:17.730+0000 7f66018f7640 1 -- 172.21.15.7:0/1429880341 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65fc1a0430 con 0x7f65fc103b60 2024-09-21T06:36:17.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:17.730+0000 7f66018f7640 1 --2- 172.21.15.7:0/1429880341 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65fc103b60 0x7f65fc19a4c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f65f800d950 tx=0x7f65f800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:17.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:17.731+0000 7f65f2ffd640 1 -- 172.21.15.7:0/1429880341 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f8017030 con 0x7f65fc103b60 2024-09-21T06:36:17.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:17.731+0000 7f6603b5b640 1 -- 172.21.15.7:0/1429880341 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65fc1a0720 con 0x7f65fc103b60 2024-09-21T06:36:17.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:17.731+0000 7f65f2ffd640 1 -- 172.21.15.7:0/1429880341 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f65f8004020 con 0x7f65fc103b60 2024-09-21T06:36:17.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:17.731+0000 7f65f2ffd640 1 -- 172.21.15.7:0/1429880341 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f80047a0 con 0x7f65fc103b60 2024-09-21T06:36:17.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:17.731+0000 7f6603b5b640 1 -- 172.21.15.7:0/1429880341 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65fc1a6e80 con 0x7f65fc103b60 2024-09-21T06:36:17.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:17.732+0000 7f6603b5b640 1 -- 172.21.15.7:0/1429880341 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65fc103f70 con 0x7f65fc103b60 2024-09-21T06:36:17.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:17.733+0000 7f65f2ffd640 1 -- 172.21.15.7:0/1429880341 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 23) ==== 154528+0+0 (secure 0 0 0) 0x7f65f8009a30 con 0x7f65fc103b60 2024-09-21T06:36:17.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:17.734+0000 7f65f2ffd640 1 --2- 172.21.15.7:0/1429880341 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f65e80b6560 0x7f65e80b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:17.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:17.734+0000 7f66010f6640 1 --2- 172.21.15.7:0/1429880341 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f65e80b6560 0x7f65e80b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:17.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:17.734+0000 7f65f2ffd640 1 -- 172.21.15.7:0/1429880341 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f65f80e74c0 con 0x7f65fc103b60 2024-09-21T06:36:17.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:17.734+0000 7f66010f6640 1 --2- 172.21.15.7:0/1429880341 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f65e80b6560 0x7f65e80b8a70 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f65ec005fd0 tx=0x7f65ec005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:17.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:17.737+0000 7f65f2ffd640 1 -- 172.21.15.7:0/1429880341 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f65f80adc90 con 0x7f65fc103b60 2024-09-21T06:36:17.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:17.927+0000 7f6603b5b640 1 -- 172.21.15.7:0/1429880341 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f65fc19b5f0 con 0x7f65fc103b60 2024-09-21T06:36:17.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:17.929+0000 7f65f2ffd640 1 -- 172.21.15.7:0/1429880341 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) ==== 74+0+22791 (secure 0 0 0) 0x7f65f80b2070 con 0x7f65fc103b60 2024-09-21T06:36:17.932 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:36:17.932 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":77,"fsid":"347cb918-77e2-11ef-baf5-efdc52797490","created":"2024-09-21T06:25:51.925032+0000","modified":"2024-09-21T06:34:44.220989+0000","last_up_change":"2024-09-21T06:33:32.888843+0000","last_in_change":"2024-09-21T06:33:09.926778+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:29:41.514179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:34:20.531755+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T06:34:22.552541+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1be5c4a4-3931-4d8b-95c7-c05f5b73fcfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":942632794},{"type":"v1","addr":"172.21.15.7:6803","nonce":942632794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":942632794},{"type":"v1","addr":"172.21.15.7:6805","nonce":942632794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":942632794},{"type":"v1","addr":"172.21.15.7:6809","nonce":942632794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":942632794},{"type":"v1","addr":"172.21.15.7:6807","nonce":942632794}]},"public_addr":"172.21.15.7:6803/942632794","cluster_addr":"172.21.15.7:6805/942632794","heartbeat_back_addr":"172.21.15.7:6809/942632794","heartbeat_front_addr":"172.21.15.7:6807/942632794","state":["exists","up"]},{"osd":1,"uuid":"7ae136a8-c614-47e5-b265-c6cfa857a7fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1839342931},{"type":"v1","addr":"172.21.15.18:6801","nonce":1839342931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1839342931},{"type":"v1","addr":"172.21.15.18:6803","nonce":1839342931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1839342931},{"type":"v1","addr":"172.21.15.18:6807","nonce":1839342931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1839342931},{"type":"v1","addr":"172.21.15.18:6805","nonce":1839342931}]},"public_addr":"172.21.15.18:6801/1839342931","cluster_addr":"172.21.15.18:6803/1839342931","heartbeat_back_addr":"172.21.15.18:6807/1839342931","heartbeat_front_addr":"172.21.15.18:6805/1839342931","state":["exists","up"]},{"osd":2,"uuid":"97b13994-4680-4573-9c2e-ac65ea740e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":1699582162},{"type":"v1","addr":"172.21.15.144:6801","nonce":1699582162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":1699582162},{"type":"v1","addr":"172.21.15.144:6803","nonce":1699582162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":1699582162},{"type":"v1","addr":"172.21.15.144:6807","nonce":1699582162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":1699582162},{"type":"v1","addr":"172.21.15.144:6805","nonce":1699582162}]},"public_addr":"172.21.15.144:6801/1699582162","cluster_addr":"172.21.15.144:6803/1699582162","heartbeat_back_addr":"172.21.15.144:6807/1699582162","heartbeat_front_addr":"172.21.15.144:6805/1699582162","state":["exists","up"]},{"osd":3,"uuid":"ddf70d51-404d-491d-a6a8-15fca4ef01db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":3202935163},{"type":"v1","addr":"172.21.15.7:6811","nonce":3202935163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":3202935163},{"type":"v1","addr":"172.21.15.7:6813","nonce":3202935163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":3202935163},{"type":"v1","addr":"172.21.15.7:6817","nonce":3202935163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":3202935163},{"type":"v1","addr":"172.21.15.7:6815","nonce":3202935163}]},"public_addr":"172.21.15.7:6811/3202935163","cluster_addr":"172.21.15.7:6813/3202935163","heartbeat_back_addr":"172.21.15.7:6817/3202935163","heartbeat_front_addr":"172.21.15.7:6815/3202935163","state":["exists","up"]},{"osd":4,"uuid":"f2ae4340-accf-4ac0-a4d3-c08302712ce1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1058105724},{"type":"v1","addr":"172.21.15.18:6809","nonce":1058105724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":1058105724},{"type":"v1","addr":"172.21.15.18:6811","nonce":1058105724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":1058105724},{"type":"v1","addr":"172.21.15.18:6815","nonce":1058105724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":1058105724},{"type":"v1","addr":"172.21.15.18:6813","nonce":1058105724}]},"public_addr":"172.21.15.18:6809/1058105724","cluster_addr":"172.21.15.18:6811/1058105724","heartbeat_back_addr":"172.21.15.18:6815/1058105724","heartbeat_front_addr":"172.21.15.18:6813/1058105724","state":["exists","up"]},{"osd":5,"uuid":"d56abc37-de6f-47a4-9f5e-67224da78f4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":2814586621},{"type":"v1","addr":"172.21.15.144:6809","nonce":2814586621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":2814586621},{"type":"v1","addr":"172.21.15.144:6811","nonce":2814586621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":2814586621},{"type":"v1","addr":"172.21.15.144:6815","nonce":2814586621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":2814586621},{"type":"v1","addr":"172.21.15.144:6813","nonce":2814586621}]},"public_addr":"172.21.15.144:6809/2814586621","cluster_addr":"172.21.15.144:6811/2814586621","heartbeat_back_addr":"172.21.15.144:6815/2814586621","heartbeat_front_addr":"172.21.15.144:6813/2814586621","state":["exists","up"]},{"osd":6,"uuid":"9145650c-e9b1-4e5a-ae6f-17c8960146e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":3770978305},{"type":"v1","addr":"172.21.15.7:6819","nonce":3770978305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":3770978305},{"type":"v1","addr":"172.21.15.7:6821","nonce":3770978305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3770978305},{"type":"v1","addr":"172.21.15.7:6825","nonce":3770978305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":3770978305},{"type":"v1","addr":"172.21.15.7:6823","nonce":3770978305}]},"public_addr":"172.21.15.7:6819/3770978305","cluster_addr":"172.21.15.7:6821/3770978305","heartbeat_back_addr":"172.21.15.7:6825/3770978305","heartbeat_front_addr":"172.21.15.7:6823/3770978305","state":["exists","up"]},{"osd":7,"uuid":"ca658683-38f7-47ca-b32e-512fe4738ef1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":1322408496},{"type":"v1","addr":"172.21.15.18:6817","nonce":1322408496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1322408496},{"type":"v1","addr":"172.21.15.18:6819","nonce":1322408496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1322408496},{"type":"v1","addr":"172.21.15.18:6823","nonce":1322408496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1322408496},{"type":"v1","addr":"172.21.15.18:6821","nonce":1322408496}]},"public_addr":"172.21.15.18:6817/1322408496","cluster_addr":"172.21.15.18:6819/1322408496","heartbeat_back_addr":"172.21.15.18:6823/1322408496","heartbeat_front_addr":"172.21.15.18:6821/1322408496","state":["exists","up"]},{"osd":8,"uuid":"40d1f37e-6fac-40b9-9319-78f4fc3a6f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1011657022},{"type":"v1","addr":"172.21.15.144:6817","nonce":1011657022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1011657022},{"type":"v1","addr":"172.21.15.144:6819","nonce":1011657022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1011657022},{"type":"v1","addr":"172.21.15.144:6823","nonce":1011657022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":1011657022},{"type":"v1","addr":"172.21.15.144:6821","nonce":1011657022}]},"public_addr":"172.21.15.144:6817/1011657022","cluster_addr":"172.21.15.144:6819/1011657022","heartbeat_back_addr":"172.21.15.144:6823/1011657022","heartbeat_front_addr":"172.21.15.144:6821/1011657022","state":["exists","up"]},{"osd":9,"uuid":"ad12d6f7-fd21-49bd-a343-744f3cff4bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":256146339},{"type":"v1","addr":"172.21.15.7:6827","nonce":256146339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":256146339},{"type":"v1","addr":"172.21.15.7:6829","nonce":256146339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":256146339},{"type":"v1","addr":"172.21.15.7:6833","nonce":256146339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":256146339},{"type":"v1","addr":"172.21.15.7:6831","nonce":256146339}]},"public_addr":"172.21.15.7:6827/256146339","cluster_addr":"172.21.15.7:6829/256146339","heartbeat_back_addr":"172.21.15.7:6833/256146339","heartbeat_front_addr":"172.21.15.7:6831/256146339","state":["exists","up"]},{"osd":10,"uuid":"1317a2ad-ec15-4096-b2da-689475b7cacc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":2038885362},{"type":"v1","addr":"172.21.15.18:6825","nonce":2038885362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2038885362},{"type":"v1","addr":"172.21.15.18:6827","nonce":2038885362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2038885362},{"type":"v1","addr":"172.21.15.18:6831","nonce":2038885362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2038885362},{"type":"v1","addr":"172.21.15.18:6829","nonce":2038885362}]},"public_addr":"172.21.15.18:6825/2038885362","cluster_addr":"172.21.15.18:6827/2038885362","heartbeat_back_addr":"172.21.15.18:6831/2038885362","heartbeat_front_addr":"172.21.15.18:6829/2038885362","state":["exists","up"]},{"osd":11,"uuid":"f9252acb-7290-4923-89f3-844c868d4b39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":1047060848},{"type":"v1","addr":"172.21.15.144:6825","nonce":1047060848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":1047060848},{"type":"v1","addr":"172.21.15.144:6827","nonce":1047060848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":1047060848},{"type":"v1","addr":"172.21.15.144:6831","nonce":1047060848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":1047060848},{"type":"v1","addr":"172.21.15.144:6829","nonce":1047060848}]},"public_addr":"172.21.15.144:6825/1047060848","cluster_addr":"172.21.15.144:6827/1047060848","heartbeat_back_addr":"172.21.15.144:6831/1047060848","heartbeat_front_addr":"172.21.15.144:6829/1047060848","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:28:48.842729+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:29:13.946624+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:29:38.589666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:30:05.116339+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:30:30.562090+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:30:55.586210+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:31:22.138457+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:31:49.178090+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:32:13.687830+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:32:40.408193+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:33:06.044578+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:33:30.988851+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/1296137341":"2024-09-22T06:27:43.044484+0000","172.21.15.7:6801/3879502931":"2024-09-22T06:27:43.044484+0000","172.21.15.7:0/1926706877":"2024-09-22T06:26:40.520265+0000","172.21.15.7:0/2034370456":"2024-09-22T06:26:14.181426+0000","172.21.15.7:6801/3339522713":"2024-09-22T06:26:14.181426+0000","172.21.15.7:6800/3339522713":"2024-09-22T06:26:14.181426+0000","172.21.15.7:0/3586807770":"2024-09-22T06:26:14.181426+0000","172.21.15.7:0/1814223919":"2024-09-22T06:27:43.044484+0000","172.21.15.7:0/601150037":"2024-09-22T06:26:40.520265+0000","172.21.15.7:6800/3876787626":"2024-09-22T06:26:40.520265+0000","172.21.15.7:0/186444636":"2024-09-22T06:26:14.181426+0000","172.21.15.7:0/2180184348":"2024-09-22T06:26:40.520265+0000","172.21.15.7:6801/3876787626":"2024-09-22T06:26:40.520265+0000","172.21.15.7:0/2931793461":"2024-09-22T06:27:43.044484+0000","172.21.15.7:6800/3879502931":"2024-09-22T06:27:43.044484+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:36:17.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:17.931+0000 7f6603b5b640 1 -- 172.21.15.7:0/1429880341 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f65e80b6560 msgr2=0x7f65e80b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:17.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:17.931+0000 7f6603b5b640 1 --2- 172.21.15.7:0/1429880341 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f65e80b6560 0x7f65e80b8a70 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f65ec005fd0 tx=0x7f65ec005850 comp rx=0 tx=0).stop 2024-09-21T06:36:17.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:17.931+0000 7f6603b5b640 1 -- 172.21.15.7:0/1429880341 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65fc103b60 msgr2=0x7f65fc19a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:17.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:17.931+0000 7f6603b5b640 1 --2- 172.21.15.7:0/1429880341 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65fc103b60 0x7f65fc19a4c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f65f800d950 tx=0x7f65f800de10 comp rx=0 tx=0).stop 2024-09-21T06:36:17.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:17.931+0000 7f6603b5b640 1 -- 172.21.15.7:0/1429880341 shutdown_connections 2024-09-21T06:36:17.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:17.931+0000 7f6603b5b640 1 --2- 172.21.15.7:0/1429880341 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f65e80b6560 0x7f65e80b8a70 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:17.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:17.931+0000 7f6603b5b640 1 --2- 172.21.15.7:0/1429880341 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65fc109df0 0x7f65fc19fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:17.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:17.931+0000 7f6603b5b640 1 --2- 172.21.15.7:0/1429880341 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f65fc1094a0 0x7f65fc19aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:17.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:17.931+0000 7f6603b5b640 1 --2- 172.21.15.7:0/1429880341 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65fc103b60 0x7f65fc19a4c0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:17.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:17.931+0000 7f6603b5b640 1 -- 172.21.15.7:0/1429880341 >> 172.21.15.7:0/1429880341 conn(0x7f65fc07b850 msgr2=0x7f65fc107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:17.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:17.931+0000 7f6603b5b640 1 -- 172.21.15.7:0/1429880341 shutdown_connections 2024-09-21T06:36:17.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:17.931+0000 7f6603b5b640 1 -- 172.21.15.7:0/1429880341 wait complete. 2024-09-21T06:36:18.671 DEBUG:tasks.fwd_scrub:Yielding 2024-09-21T06:36:18.672 INFO:teuthology.run_tasks:Running task exec... 2024-09-21T06:36:18.682 INFO:teuthology.task.exec:Executing custom commands... 2024-09-21T06:36:18.682 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi007.front.sepia.ceph.com 2024-09-21T06:36:18.682 DEBUG:teuthology.orchestra.run.smithi007:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-09-21T06:36:18.682 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-09-21T06:36:18.682 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:36:18.683 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:36:18.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:18.803+0000 7f4cbf7e6640 1 -- 172.21.15.7:0/844299878 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4cb8103ae0 msgr2=0x7f4cb8103ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:18.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:18.803+0000 7f4cbf7e6640 1 --2- 172.21.15.7:0/844299878 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4cb8103ae0 0x7f4cb8103ef0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f4cb4009900 tx=0x7f4cb402a410 comp rx=0 tx=0).stop 2024-09-21T06:36:18.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:18.804+0000 7f4cbf7e6640 1 -- 172.21.15.7:0/844299878 shutdown_connections 2024-09-21T06:36:18.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:18.804+0000 7f4cbf7e6640 1 --2- 172.21.15.7:0/844299878 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4cb8109d60 0x7f4cb8110590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:18.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:18.804+0000 7f4cbf7e6640 1 --2- 172.21.15.7:0/844299878 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4cb8109410 0x7f4cb8109820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:18.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:18.804+0000 7f4cbf7e6640 1 --2- 172.21.15.7:0/844299878 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4cb8103ae0 0x7f4cb8103ef0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:18.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:18.804+0000 7f4cbf7e6640 1 -- 172.21.15.7:0/844299878 >> 172.21.15.7:0/844299878 conn(0x7f4cb80ff540 msgr2=0x7f4cb8101990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:18.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:18.804+0000 7f4cbf7e6640 1 -- 172.21.15.7:0/844299878 shutdown_connections 2024-09-21T06:36:18.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:18.804+0000 7f4cbf7e6640 1 -- 172.21.15.7:0/844299878 wait complete. 2024-09-21T06:36:18.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:18.804+0000 7f4cbf7e6640 1 Processor -- start 2024-09-21T06:36:18.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:18.804+0000 7f4cbf7e6640 1 -- start start 2024-09-21T06:36:18.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:18.805+0000 7f4cbf7e6640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4cb8103ae0 0x7f4cb819a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:18.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:18.805+0000 7f4cbf7e6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4cb8109410 0x7f4cb819aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:18.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:18.805+0000 7f4cbf7e6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4cb8109d60 0x7f4cb819fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:18.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:18.805+0000 7f4cbf7e6640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb8113a20 con 0x7f4cb8109d60 2024-09-21T06:36:18.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:18.805+0000 7f4cbf7e6640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb81138a0 con 0x7f4cb8109410 2024-09-21T06:36:18.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:18.805+0000 7f4cbf7e6640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb8113ba0 con 0x7f4cb8103ae0 2024-09-21T06:36:18.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:18.805+0000 7f4cbdd83640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4cb8109d60 0x7f4cb819fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:18.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:18.805+0000 7f4cbdd83640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4cb8109d60 0x7f4cb819fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42486/0 (socket says 172.21.15.7:42486) 2024-09-21T06:36:18.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:18.805+0000 7f4cbdd83640 1 -- 172.21.15.7:0/3890779333 learned_addr learned my addr 172.21.15.7:0/3890779333 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:36:18.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:18.805+0000 7f4cbd582640 1 --2- 172.21.15.7:0/3890779333 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4cb8103ae0 0x7f4cb819a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:18.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:18.805+0000 7f4cbcd81640 1 --2- 172.21.15.7:0/3890779333 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4cb8109410 0x7f4cb819aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:18.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:18.805+0000 7f4cbdd83640 1 -- 172.21.15.7:0/3890779333 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4cb8103ae0 msgr2=0x7f4cb819a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:18.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:18.805+0000 7f4cbdd83640 1 --2- 172.21.15.7:0/3890779333 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4cb8103ae0 0x7f4cb819a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:18.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:18.805+0000 7f4cbdd83640 1 -- 172.21.15.7:0/3890779333 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4cb8109410 msgr2=0x7f4cb819aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:18.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:18.805+0000 7f4cbdd83640 1 --2- 172.21.15.7:0/3890779333 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4cb8109410 0x7f4cb819aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:18.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:18.805+0000 7f4cbdd83640 1 -- 172.21.15.7:0/3890779333 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cb81a03b0 con 0x7f4cb8109d60 2024-09-21T06:36:18.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:18.805+0000 7f4cbcd81640 1 --2- 172.21.15.7:0/3890779333 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4cb8109410 0x7f4cb819aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:36:18.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:18.805+0000 7f4cbdd83640 1 --2- 172.21.15.7:0/3890779333 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4cb8109d60 0x7f4cb819fcb0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f4cb000eaa0 tx=0x7f4cb000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:18.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:18.806+0000 7f4cae7fc640 1 -- 172.21.15.7:0/3890779333 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb000cdb0 con 0x7f4cb8109d60 2024-09-21T06:36:18.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:18.806+0000 7f4cbf7e6640 1 -- 172.21.15.7:0/3890779333 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cb81a06a0 con 0x7f4cb8109d60 2024-09-21T06:36:18.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:18.806+0000 7f4cae7fc640 1 -- 172.21.15.7:0/3890779333 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4cb0005020 con 0x7f4cb8109d60 2024-09-21T06:36:18.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:18.806+0000 7f4cbf7e6640 1 -- 172.21.15.7:0/3890779333 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cb81a6e30 con 0x7f4cb8109d60 2024-09-21T06:36:18.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:18.806+0000 7f4cae7fc640 1 -- 172.21.15.7:0/3890779333 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb00116d0 con 0x7f4cb8109d60 2024-09-21T06:36:18.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:18.807+0000 7f4cbf7e6640 1 -- 172.21.15.7:0/3890779333 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cb8103ef0 con 0x7f4cb8109d60 2024-09-21T06:36:18.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:18.809+0000 7f4cae7fc640 1 -- 172.21.15.7:0/3890779333 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 23) ==== 154528+0+0 (secure 0 0 0) 0x7f4cb00051d0 con 0x7f4cb8109d60 2024-09-21T06:36:18.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:18.809+0000 7f4cae7fc640 1 --2- 172.21.15.7:0/3890779333 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f4ca40b6560 0x7f4ca40b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:18.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:18.809+0000 7f4cbd582640 1 --2- 172.21.15.7:0/3890779333 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f4ca40b6560 0x7f4ca40b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:18.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:18.809+0000 7f4cae7fc640 1 -- 172.21.15.7:0/3890779333 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f4cb00e7590 con 0x7f4cb8109d60 2024-09-21T06:36:18.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:18.810+0000 7f4cbd582640 1 --2- 172.21.15.7:0/3890779333 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f4ca40b6560 0x7f4ca40b8a70 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4cb4031440 tx=0x7f4cb4009560 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:18.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:18.818+0000 7f4cae7fc640 1 -- 172.21.15.7:0/3890779333 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4cb0016030 con 0x7f4cb8109d60 2024-09-21T06:36:18.959 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:36:19.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.042+0000 7f4cbf7e6640 1 -- 172.21.15.7:0/3890779333 --> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7f4cb8063800 con 0x7f4ca40b6560 2024-09-21T06:36:19.080 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:36:18 smithi007 ceph-mon[30983]: pgmap v322: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-21T06:36:19.080 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:36:18 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/1429880341' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:36:19.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:36:18 smithi018 ceph-mon[34477]: pgmap v322: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-21T06:36:19.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:36:18 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/1429880341' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:36:19.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.206+0000 7f4cae7fc640 1 -- 172.21.15.7:0/3890779333 <== mgr.14223 v2:172.21.15.7:6800/3442812985 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f4cb8063800 con 0x7f4ca40b6560 2024-09-21T06:36:19.208 INFO:teuthology.orchestra.run.smithi007.stdout:Schedule set for path / 2024-09-21T06:36:19.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.209+0000 7f4cbf7e6640 1 -- 172.21.15.7:0/3890779333 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f4ca40b6560 msgr2=0x7f4ca40b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:19.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.209+0000 7f4cbf7e6640 1 --2- 172.21.15.7:0/3890779333 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f4ca40b6560 0x7f4ca40b8a70 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4cb4031440 tx=0x7f4cb4009560 comp rx=0 tx=0).stop 2024-09-21T06:36:19.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.209+0000 7f4cbf7e6640 1 -- 172.21.15.7:0/3890779333 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4cb8109d60 msgr2=0x7f4cb819fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:19.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.209+0000 7f4cbf7e6640 1 --2- 172.21.15.7:0/3890779333 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4cb8109d60 0x7f4cb819fcb0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f4cb000eaa0 tx=0x7f4cb000ef60 comp rx=0 tx=0).stop 2024-09-21T06:36:19.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.209+0000 7f4cbf7e6640 1 -- 172.21.15.7:0/3890779333 shutdown_connections 2024-09-21T06:36:19.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.209+0000 7f4cbf7e6640 1 --2- 172.21.15.7:0/3890779333 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f4ca40b6560 0x7f4ca40b8a70 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:19.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.209+0000 7f4cbf7e6640 1 --2- 172.21.15.7:0/3890779333 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4cb8109d60 0x7f4cb819fcb0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:19.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.209+0000 7f4cbf7e6640 1 --2- 172.21.15.7:0/3890779333 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4cb8109410 0x7f4cb819aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:19.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.209+0000 7f4cbf7e6640 1 --2- 172.21.15.7:0/3890779333 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4cb8103ae0 0x7f4cb819a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:19.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.209+0000 7f4cbf7e6640 1 -- 172.21.15.7:0/3890779333 >> 172.21.15.7:0/3890779333 conn(0x7f4cb80ff540 msgr2=0x7f4cb8101960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:19.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.209+0000 7f4cbf7e6640 1 -- 172.21.15.7:0/3890779333 shutdown_connections 2024-09-21T06:36:19.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.209+0000 7f4cbf7e6640 1 -- 172.21.15.7:0/3890779333 wait complete. 2024-09-21T06:36:19.222 DEBUG:teuthology.orchestra.run.smithi007:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-09-21T06:36:19.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:36:18 smithi144 ceph-mon[34653]: pgmap v322: 97 pgs: 97 active+clean; 644 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-21T06:36:19.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:36:18 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/1429880341' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:36:19.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.339+0000 7f6628bb0640 1 -- 172.21.15.7:0/4157748522 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6624105a60 msgr2=0x7f662410f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:19.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.339+0000 7f6628bb0640 1 --2- 172.21.15.7:0/4157748522 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6624105a60 0x7f662410f4b0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f661c009cd0 tx=0x7f661c02a8e0 comp rx=0 tx=0).stop 2024-09-21T06:36:19.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.340+0000 7f6628bb0640 1 -- 172.21.15.7:0/4157748522 shutdown_connections 2024-09-21T06:36:19.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.340+0000 7f6628bb0640 1 --2- 172.21.15.7:0/4157748522 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6624105a60 0x7f662410f4b0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:19.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.340+0000 7f6628bb0640 1 --2- 172.21.15.7:0/4157748522 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6624105110 0x7f6624105520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:19.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.340+0000 7f6628bb0640 1 --2- 172.21.15.7:0/4157748522 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6624103150 0x7f6624103560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:19.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.340+0000 7f6628bb0640 1 -- 172.21.15.7:0/4157748522 >> 172.21.15.7:0/4157748522 conn(0x7f6624079e50 msgr2=0x7f662407a260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:19.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.340+0000 7f6628bb0640 1 -- 172.21.15.7:0/4157748522 shutdown_connections 2024-09-21T06:36:19.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.340+0000 7f6628bb0640 1 -- 172.21.15.7:0/4157748522 wait complete. 2024-09-21T06:36:19.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.340+0000 7f6628bb0640 1 Processor -- start 2024-09-21T06:36:19.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.341+0000 7f6628bb0640 1 -- start start 2024-09-21T06:36:19.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.341+0000 7f6628bb0640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6624103150 0x7f662419b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:19.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.341+0000 7f6628bb0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6624105110 0x7f662419b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:19.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.341+0000 7f6628bb0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6624105a60 0x7f662419bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:19.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.341+0000 7f6628bb0640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6624112940 con 0x7f6624105110 2024-09-21T06:36:19.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.341+0000 7f6628bb0640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f66241127c0 con 0x7f6624105a60 2024-09-21T06:36:19.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.341+0000 7f6628bb0640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6624112ac0 con 0x7f6624103150 2024-09-21T06:36:19.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.341+0000 7f6621d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6624105110 0x7f662419b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:19.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.341+0000 7f6621d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6624105110 0x7f662419b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42526/0 (socket says 172.21.15.7:42526) 2024-09-21T06:36:19.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.341+0000 7f6621d9b640 1 -- 172.21.15.7:0/3327122000 learned_addr learned my addr 172.21.15.7:0/3327122000 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:36:19.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.341+0000 7f662259c640 1 --2- 172.21.15.7:0/3327122000 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6624103150 0x7f662419b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:19.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.341+0000 7f6622d9d640 1 --2- 172.21.15.7:0/3327122000 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6624105a60 0x7f662419bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:19.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.341+0000 7f6621d9b640 1 -- 172.21.15.7:0/3327122000 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6624103150 msgr2=0x7f662419b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:19.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.341+0000 7f6621d9b640 1 --2- 172.21.15.7:0/3327122000 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6624103150 0x7f662419b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:19.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.341+0000 7f6621d9b640 1 -- 172.21.15.7:0/3327122000 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6624105a60 msgr2=0x7f662419bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:19.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.341+0000 7f6621d9b640 1 --2- 172.21.15.7:0/3327122000 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6624105a60 0x7f662419bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:19.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.341+0000 7f6621d9b640 1 -- 172.21.15.7:0/3327122000 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66241a6530 con 0x7f6624105110 2024-09-21T06:36:19.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.341+0000 7f6621d9b640 1 --2- 172.21.15.7:0/3327122000 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6624105110 0x7f662419b7b0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f661800d770 tx=0x7f661800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:19.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.342+0000 7f66137fe640 1 -- 172.21.15.7:0/3327122000 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6618017070 con 0x7f6624105110 2024-09-21T06:36:19.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.342+0000 7f66137fe640 1 -- 172.21.15.7:0/3327122000 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6618009c30 con 0x7f6624105110 2024-09-21T06:36:19.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.342+0000 7f6628bb0640 1 -- 172.21.15.7:0/3327122000 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66241a6820 con 0x7f6624105110 2024-09-21T06:36:19.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.342+0000 7f66137fe640 1 -- 172.21.15.7:0/3327122000 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f661800f620 con 0x7f6624105110 2024-09-21T06:36:19.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.342+0000 7f6628bb0640 1 -- 172.21.15.7:0/3327122000 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66241a6d70 con 0x7f6624105110 2024-09-21T06:36:19.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.343+0000 7f6628bb0640 1 -- 172.21.15.7:0/3327122000 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6624103560 con 0x7f6624105110 2024-09-21T06:36:19.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.345+0000 7f66137fe640 1 -- 172.21.15.7:0/3327122000 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 23) ==== 154528+0+0 (secure 0 0 0) 0x7f661801a070 con 0x7f6624105110 2024-09-21T06:36:19.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.345+0000 7f66137fe640 1 --2- 172.21.15.7:0/3327122000 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f660c0b6560 0x7f660c0b8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:19.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.346+0000 7f66137fe640 1 -- 172.21.15.7:0/3327122000 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f66180e6e40 con 0x7f6624105110 2024-09-21T06:36:19.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.346+0000 7f662259c640 1 --2- 172.21.15.7:0/3327122000 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f660c0b6560 0x7f660c0b8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:19.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.346+0000 7f662259c640 1 --2- 172.21.15.7:0/3327122000 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f660c0b6560 0x7f660c0b8a70 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f6624102920 tx=0x7f661400b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:19.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.348+0000 7f66137fe640 1 -- 172.21.15.7:0/3327122000 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6618009de0 con 0x7f6624105110 2024-09-21T06:36:19.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.461+0000 7f9f38a25640 1 -- 172.21.15.7:0/904039059 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f34107b30 msgr2=0x7f9f34107f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:19.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.461+0000 7f9f38a25640 1 --2- 172.21.15.7:0/904039059 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f34107b30 0x7f9f34107f40 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f9f2800aa10 tx=0x7f9f2802b720 comp rx=0 tx=0).stop 2024-09-21T06:36:19.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.462+0000 7f9f38a25640 1 -- 172.21.15.7:0/904039059 shutdown_connections 2024-09-21T06:36:19.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.462+0000 7f9f38a25640 1 --2- 172.21.15.7:0/904039059 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f34108480 0x7f9f3410ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:19.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.462+0000 7f9f38a25640 1 --2- 172.21.15.7:0/904039059 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f34107b30 0x7f9f34107f40 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:19.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.462+0000 7f9f38a25640 1 --2- 172.21.15.7:0/904039059 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f341021f0 0x7f9f34102600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:19.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.462+0000 7f9f38a25640 1 -- 172.21.15.7:0/904039059 >> 172.21.15.7:0/904039059 conn(0x7f9f34077c60 msgr2=0x7f9f340780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:19.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.462+0000 7f9f38a25640 1 -- 172.21.15.7:0/904039059 shutdown_connections 2024-09-21T06:36:19.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.462+0000 7f9f38a25640 1 -- 172.21.15.7:0/904039059 wait complete. 2024-09-21T06:36:19.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.463+0000 7f9f38a25640 1 Processor -- start 2024-09-21T06:36:19.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.463+0000 7f9f38a25640 1 -- start start 2024-09-21T06:36:19.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.463+0000 7f9f38a25640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f341021f0 0x7f9f3419a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:19.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.463+0000 7f9f38a25640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f34107b30 0x7f9f3419aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:19.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.463+0000 7f9f38a25640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f34108480 0x7f9f3419fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:19.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.463+0000 7f9f38a25640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9f341118c0 con 0x7f9f341021f0 2024-09-21T06:36:19.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.463+0000 7f9f38a25640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9f34111740 con 0x7f9f34108480 2024-09-21T06:36:19.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.463+0000 7f9f38a25640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9f34111a40 con 0x7f9f34107b30 2024-09-21T06:36:19.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.463+0000 7f9f3259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f341021f0 0x7f9f3419a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:19.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.463+0000 7f9f3259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f341021f0 0x7f9f3419a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42550/0 (socket says 172.21.15.7:42550) 2024-09-21T06:36:19.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.463+0000 7f9f3259c640 1 -- 172.21.15.7:0/2958857408 learned_addr learned my addr 172.21.15.7:0/2958857408 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:36:19.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.463+0000 7f9f31d9b640 1 --2- 172.21.15.7:0/2958857408 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f34107b30 0x7f9f3419aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:19.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.463+0000 7f9f32d9d640 1 --2- 172.21.15.7:0/2958857408 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f34108480 0x7f9f3419fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:19.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.463+0000 7f9f3259c640 1 -- 172.21.15.7:0/2958857408 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f34107b30 msgr2=0x7f9f3419aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:19.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.463+0000 7f9f3259c640 1 --2- 172.21.15.7:0/2958857408 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f34107b30 0x7f9f3419aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:19.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.463+0000 7f9f3259c640 1 -- 172.21.15.7:0/2958857408 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f34108480 msgr2=0x7f9f3419fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:19.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.463+0000 7f9f3259c640 1 --2- 172.21.15.7:0/2958857408 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f34108480 0x7f9f3419fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:19.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.464+0000 7f9f3259c640 1 -- 172.21.15.7:0/2958857408 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f341a0450 con 0x7f9f341021f0 2024-09-21T06:36:19.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.464+0000 7f9f3259c640 1 --2- 172.21.15.7:0/2958857408 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f341021f0 0x7f9f3419a4e0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f9f2400d950 tx=0x7f9f2400dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:19.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.465+0000 7f9f237fe640 1 -- 172.21.15.7:0/2958857408 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f24017030 con 0x7f9f341021f0 2024-09-21T06:36:19.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.465+0000 7f9f237fe640 1 -- 172.21.15.7:0/2958857408 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9f24004020 con 0x7f9f341021f0 2024-09-21T06:36:19.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.465+0000 7f9f38a25640 1 -- 172.21.15.7:0/2958857408 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f341a0740 con 0x7f9f341021f0 2024-09-21T06:36:19.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.465+0000 7f9f237fe640 1 -- 172.21.15.7:0/2958857408 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f24005560 con 0x7f9f341021f0 2024-09-21T06:36:19.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.465+0000 7f9f38a25640 1 -- 172.21.15.7:0/2958857408 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f341a6ea0 con 0x7f9f341021f0 2024-09-21T06:36:19.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.468+0000 7f9f3ef99740 1 Processor -- start 2024-09-21T06:36:19.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.469+0000 7f9f3ef99740 1 -- start start 2024-09-21T06:36:19.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.469+0000 7f9f237fe640 1 -- 172.21.15.7:0/2958857408 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 23) ==== 154528+0+0 (secure 0 0 0) 0x7f9f240047a0 con 0x7f9f341021f0 2024-09-21T06:36:19.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.469+0000 7f9f3ef99740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c14c47b350 0x55c14c822430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:19.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.469+0000 7f9f3ef99740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c14c452490 0x55c14c822970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:19.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.469+0000 7f9f3ef99740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c14c45a670 0x55c14c822eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:19.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.469+0000 7f9f3ef99740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55c14c798e60 con 0x55c14c47b350 2024-09-21T06:36:19.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.469+0000 7f9f3ef99740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55c14c788290 con 0x55c14c45a670 2024-09-21T06:36:19.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.469+0000 7f9f3ef99740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55c14c78c0a0 con 0x55c14c452490 2024-09-21T06:36:19.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.469+0000 7f9f32d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c14c47b350 0x55c14c822430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:19.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.469+0000 7f9f32d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c14c47b350 0x55c14c822430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42558/0 (socket says 172.21.15.7:42558) 2024-09-21T06:36:19.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.469+0000 7f9f32d9d640 1 -- 172.21.15.7:0/78810166 learned_addr learned my addr 172.21.15.7:0/78810166 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:36:19.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.469+0000 7f9f3259c640 1 --2- 172.21.15.7:0/78810166 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c14c452490 0x55c14c822970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:19.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.469+0000 7f9f31d9b640 1 --2- 172.21.15.7:0/78810166 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c14c45a670 0x55c14c822eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:19.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.470+0000 7f9f32d9d640 1 -- 172.21.15.7:0/78810166 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c14c452490 msgr2=0x55c14c822970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:19.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.470+0000 7f9f32d9d640 1 --2- 172.21.15.7:0/78810166 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c14c452490 0x55c14c822970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:19.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.470+0000 7f9f32d9d640 1 -- 172.21.15.7:0/78810166 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c14c45a670 msgr2=0x55c14c822eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:19.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.470+0000 7f9f32d9d640 1 --2- 172.21.15.7:0/78810166 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c14c45a670 0x55c14c822eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:19.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.470+0000 7f9f32d9d640 1 -- 172.21.15.7:0/78810166 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c14c4e6930 con 0x55c14c47b350 2024-09-21T06:36:19.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.470+0000 7f9f32d9d640 1 --2- 172.21.15.7:0/78810166 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c14c47b350 0x55c14c822430 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c009f60 tx=0x7f9f2c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f32af29a4492fbba server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:19.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.470+0000 7f9f20ff9640 1 -- 172.21.15.7:0/78810166 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f2c01e070 con 0x55c14c47b350 2024-09-21T06:36:19.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.470+0000 7f9f237fe640 1 --2- 172.21.15.7:0/2958857408 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f9f1c0b65e0 0x7f9f1c0b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:19.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.470+0000 7f9f20ff9640 1 -- 172.21.15.7:0/78810166 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9f2c003c30 con 0x55c14c47b350 2024-09-21T06:36:19.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.470+0000 7f9f20ff9640 1 -- 172.21.15.7:0/78810166 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f2c00f820 con 0x55c14c47b350 2024-09-21T06:36:19.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.470+0000 7f9f3259c640 1 --2- 172.21.15.7:0/2958857408 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f9f1c0b65e0 0x7f9f1c0b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:19.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.471+0000 7f9f237fe640 1 -- 172.21.15.7:0/2958857408 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f9f240e6d00 con 0x7f9f341021f0 2024-09-21T06:36:19.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.471+0000 7f9f3ef99740 1 -- 172.21.15.7:0/78810166 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c14c47b350 msgr2=0x55c14c822430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:19.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.471+0000 7f9f3259c640 1 --2- 172.21.15.7:0/2958857408 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f9f1c0b65e0 0x7f9f1c0b8af0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9f240a93e0 tx=0x7f9f240d0040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:19.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.471+0000 7f9f3ef99740 1 --2- 172.21.15.7:0/78810166 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c14c47b350 0x55c14c822430 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c009f60 tx=0x7f9f2c009f90 comp rx=0 tx=0).stop 2024-09-21T06:36:19.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.471+0000 7f9f3ef99740 1 -- 172.21.15.7:0/78810166 shutdown_connections 2024-09-21T06:36:19.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.471+0000 7f9f3ef99740 1 --2- 172.21.15.7:0/78810166 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c14c45a670 0x55c14c822eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:19.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.471+0000 7f9f3ef99740 1 --2- 172.21.15.7:0/78810166 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c14c452490 0x55c14c822970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:19.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.471+0000 7f9f3ef99740 1 --2- 172.21.15.7:0/78810166 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c14c47b350 0x55c14c822430 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:19.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.471+0000 7f9f3ef99740 1 -- 172.21.15.7:0/78810166 >> 172.21.15.7:0/78810166 conn(0x55c14c46f740 msgr2=0x55c14c820320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:19.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.471+0000 7f9f3ef99740 1 -- 172.21.15.7:0/78810166 shutdown_connections 2024-09-21T06:36:19.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.471+0000 7f9f3ef99740 1 -- 172.21.15.7:0/78810166 wait complete. 2024-09-21T06:36:19.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.472+0000 7f9f3ef99740 1 -- start start 2024-09-21T06:36:19.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.472+0000 7f9f3ef99740 1 Processor -- start 2024-09-21T06:36:19.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.472+0000 7f9f3ef99740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c14c452490 0x55c14c82e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:19.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.472+0000 7f9f3ef99740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c14c45a670 0x55c14c82e640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:19.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.472+0000 7f9f3ef99740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c14c47b350 0x55c14c83e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:19.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.472+0000 7f9f3ef99740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55c14c5e9890 con 0x55c14c47b350 2024-09-21T06:36:19.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.472+0000 7f9f3ef99740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55c14c722d40 con 0x55c14c452490 2024-09-21T06:36:19.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.472+0000 7f9f3ef99740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55c14c835020 con 0x55c14c45a670 2024-09-21T06:36:19.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.472+0000 7f9f3ef99740 10 client.0 _ll_register_callbacks cb 0x55c14c786c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:36:19.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.472+0000 7f9f32d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c14c452490 0x55c14c82e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:19.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.473+0000 7f9f32d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c14c47b350 0x55c14c83e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:19.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.473+0000 7f9f32d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c14c47b350 0x55c14c83e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42564/0 (socket says 172.21.15.7:42564) 2024-09-21T06:36:19.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.473+0000 7f9f31d9b640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c14c45a670 0x55c14c82e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:19.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.473+0000 7f9f32d9d640 1 -- 172.21.15.7:0/251403188 learned_addr learned my addr 172.21.15.7:0/251403188 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:36:19.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.473+0000 7f9f32d9d640 1 -- 172.21.15.7:0/251403188 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c14c45a670 msgr2=0x55c14c82e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:19.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.473+0000 7f9f32d9d640 1 --2- 172.21.15.7:0/251403188 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c14c45a670 0x55c14c82e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:19.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.473+0000 7f9f32d9d640 1 -- 172.21.15.7:0/251403188 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c14c452490 msgr2=0x55c14c82e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:19.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.473+0000 7f9f32d9d640 1 --2- 172.21.15.7:0/251403188 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c14c452490 0x55c14c82e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:19.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.473+0000 7f9f32d9d640 1 -- 172.21.15.7:0/251403188 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c14c83e980 con 0x55c14c47b350 2024-09-21T06:36:19.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.473+0000 7f9f31d9b640 1 --2- 172.21.15.7:0/251403188 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c14c45a670 0x55c14c82e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:36:19.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.473+0000 7f9f32d9d640 1 --2- 172.21.15.7:0/251403188 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c14c47b350 0x55c14c83e310 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c009f30 tx=0x7f9f2c005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38906d25c19abc4e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:19.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.473+0000 7f9f19ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:36:19.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.473+0000 7f9f19ffb640 1 -- 172.21.15.7:0/251403188 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f2c02d060 con 0x55c14c47b350 2024-09-21T06:36:19.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.473+0000 7f9f19ffb640 1 -- 172.21.15.7:0/251403188 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f9f2c004460 con 0x55c14c47b350 2024-09-21T06:36:19.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.473+0000 7f9f3ef99740 1 -- 172.21.15.7:0/251403188 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f2c003c30 con 0x55c14c47b350 2024-09-21T06:36:19.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.474+0000 7f9f19ffb640 1 -- 172.21.15.7:0/251403188 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9f2c01e040 con 0x55c14c47b350 2024-09-21T06:36:19.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.474+0000 7f9f3ef99740 10 client.15456 fetch_fsmap learned FSMap version 25 2024-09-21T06:36:19.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.474+0000 7f9f3ef99740 1 -- 172.21.15.7:0/251403188 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c14c841290 con 0x55c14c47b350 2024-09-21T06:36:19.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.474+0000 7f9f19ffb640 1 -- 172.21.15.7:0/251403188 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9f2c003c30 con 0x55c14c47b350 2024-09-21T06:36:19.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.474+0000 7f9f19ffb640 1 -- 172.21.15.7:0/251403188 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9f2c005040 con 0x55c14c47b350 2024-09-21T06:36:19.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.474+0000 7f9f3ef99740 10 client.15456 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:36:19.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.474+0000 7f9f3ef99740 10 client.15456 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:36:19.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.474+0000 7f9f3ef99740 20 client.15456 populate_metadata read hostname 'smithi007' 2024-09-21T06:36:19.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.474+0000 7f9f3ef99740 1 --2- 172.21.15.7:0/251403188 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55c14c439cd0 0x55c14c844700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:19.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.474+0000 7f9f3ef99740 4 client.15456 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:36:19.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.474+0000 7f9f3ef99740 1 -- 172.21.15.7:0/251403188 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c14c79adb0 con 0x55c14c439cd0 2024-09-21T06:36:19.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.474+0000 7f9f31d9b640 1 --2- 172.21.15.7:0/251403188 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55c14c439cd0 0x55c14c844700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:19.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.475+0000 7f9f19ffb640 10 client.15456 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:36:19.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.475+0000 7f9f31d9b640 1 --2- 172.21.15.7:0/251403188 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55c14c439cd0 0x55c14c844700 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7041dc1e26d56f0 server_cookie=464b33ca4d3ea517 in_seq=0 out_seq=0 2024-09-21T06:36:19.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.476+0000 7f9f19ffb640 1 -- 172.21.15.7:0/251403188 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c14c79adb0 con 0x55c14c439cd0 2024-09-21T06:36:19.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.476+0000 7f9f19ffb640 10 client.15456 handle_command_reply: tid=0 2024-09-21T06:36:19.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.476+0000 7f9f3ef99740 1 client.15456 shutdown 2024-09-21T06:36:19.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.476+0000 7f9f3ef99740 1 -- 172.21.15.7:0/251403188 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c14c47b350 msgr2=0x55c14c83e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:19.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.476+0000 7f9f3ef99740 1 --2- 172.21.15.7:0/251403188 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c14c47b350 0x55c14c83e310 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c009f30 tx=0x7f9f2c005fd0 comp rx=0 tx=0).stop 2024-09-21T06:36:19.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.476+0000 7f9f3ef99740 1 -- 172.21.15.7:0/251403188 shutdown_connections 2024-09-21T06:36:19.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.476+0000 7f9f3ef99740 1 --2- 172.21.15.7:0/251403188 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55c14c439cd0 0x55c14c844700 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:19.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.476+0000 7f9f19ffb640 0 client.15456 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:36:19.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.476+0000 7f9f3ef99740 1 --2- 172.21.15.7:0/251403188 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c14c47b350 0x55c14c83e310 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:19.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.476+0000 7f9f3ef99740 1 --2- 172.21.15.7:0/251403188 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c14c45a670 0x55c14c82e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:19.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.476+0000 7f9f3ef99740 1 --2- 172.21.15.7:0/251403188 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c14c452490 0x55c14c82e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:19.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.476+0000 7f9f3ef99740 1 -- 172.21.15.7:0/251403188 >> 172.21.15.7:0/251403188 conn(0x55c14c46f740 msgr2=0x55c14c825610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:19.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.476+0000 7f9f3ef99740 1 -- 172.21.15.7:0/251403188 shutdown_connections 2024-09-21T06:36:19.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.476+0000 7f9f3ef99740 1 -- 172.21.15.7:0/251403188 wait complete. 2024-09-21T06:36:19.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.476+0000 7f9f3ef99740 20 client.15456 trim_cache size 0 max 16384 2024-09-21T06:36:19.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.494+0000 7f9f3ef99740 1 Processor -- start 2024-09-21T06:36:19.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.494+0000 7f9f3ef99740 1 -- start start 2024-09-21T06:36:19.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.494+0000 7f9f3ef99740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c14c439cd0 0x55c14c827510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:19.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.494+0000 7f9f3ef99740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c14c452490 0x55c14c827a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:19.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.494+0000 7f9f3ef99740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c14c45a670 0x55c14c825530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:19.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.494+0000 7f9f3ef99740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9f341afc50 con 0x55c14c45a670 2024-09-21T06:36:19.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.494+0000 7f9f3ef99740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9f341ad520 con 0x55c14c439cd0 2024-09-21T06:36:19.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.494+0000 7f9f3ef99740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9f341ab370 con 0x55c14c452490 2024-09-21T06:36:19.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.494+0000 7f9f32d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c14c45a670 0x55c14c825530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:19.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.495+0000 7f9f32d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c14c45a670 0x55c14c825530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42570/0 (socket says 172.21.15.7:42570) 2024-09-21T06:36:19.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.495+0000 7f9f32d9d640 1 -- 172.21.15.7:0/3441949319 learned_addr learned my addr 172.21.15.7:0/3441949319 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:36:19.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.495+0000 7f9f31d9b640 1 --2- 172.21.15.7:0/3441949319 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c14c452490 0x55c14c827a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:19.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.495+0000 7f9f32d9d640 1 --2- 172.21.15.7:0/3441949319 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c14c439cd0 0x55c14c827510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:19.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.495+0000 7f9f32d9d640 1 -- 172.21.15.7:0/3441949319 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c14c452490 msgr2=0x55c14c827a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:19.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.495+0000 7f9f32d9d640 1 --2- 172.21.15.7:0/3441949319 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c14c452490 0x55c14c827a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:19.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.495+0000 7f9f32d9d640 1 -- 172.21.15.7:0/3441949319 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c14c439cd0 msgr2=0x55c14c827510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:19.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.495+0000 7f9f32d9d640 1 --2- 172.21.15.7:0/3441949319 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c14c439cd0 0x55c14c827510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:19.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.495+0000 7f9f32d9d640 1 -- 172.21.15.7:0/3441949319 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c14c829710 con 0x55c14c45a670 2024-09-21T06:36:19.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.495+0000 7f9f31d9b640 1 --2- 172.21.15.7:0/3441949319 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c14c452490 0x55c14c827a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:36:19.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.495+0000 7f9f32d9d640 1 --2- 172.21.15.7:0/3441949319 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c14c45a670 0x55c14c825530 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c002230 tx=0x7f9f2c0048e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e483a99d6df77e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:19.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.495+0000 7f9f1bfff640 1 -- 172.21.15.7:0/3441949319 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f2c02d050 con 0x55c14c45a670 2024-09-21T06:36:19.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.495+0000 7f9f1bfff640 1 -- 172.21.15.7:0/3441949319 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9f2c005880 con 0x55c14c45a670 2024-09-21T06:36:19.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.495+0000 7f9f1bfff640 1 -- 172.21.15.7:0/3441949319 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f2c00fba0 con 0x55c14c45a670 2024-09-21T06:36:19.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.496+0000 7f9f3ef99740 1 -- 172.21.15.7:0/3441949319 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c14c45a670 msgr2=0x55c14c825530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:19.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.496+0000 7f9f3ef99740 1 --2- 172.21.15.7:0/3441949319 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c14c45a670 0x55c14c825530 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c002230 tx=0x7f9f2c0048e0 comp rx=0 tx=0).stop 2024-09-21T06:36:19.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.496+0000 7f9f3ef99740 1 -- 172.21.15.7:0/3441949319 shutdown_connections 2024-09-21T06:36:19.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.496+0000 7f9f3ef99740 1 --2- 172.21.15.7:0/3441949319 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c14c45a670 0x55c14c825530 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:19.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.496+0000 7f9f3ef99740 1 --2- 172.21.15.7:0/3441949319 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c14c452490 0x55c14c827a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:19.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.496+0000 7f9f3ef99740 1 --2- 172.21.15.7:0/3441949319 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c14c439cd0 0x55c14c827510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:19.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.496+0000 7f9f3ef99740 1 -- 172.21.15.7:0/3441949319 >> 172.21.15.7:0/3441949319 conn(0x55c14c46f740 msgr2=0x55c14c82c700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:19.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.496+0000 7f9f3ef99740 1 -- 172.21.15.7:0/3441949319 shutdown_connections 2024-09-21T06:36:19.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.496+0000 7f9f3ef99740 1 -- 172.21.15.7:0/3441949319 wait complete. 2024-09-21T06:36:19.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.497+0000 7f9f3ef99740 1 -- start start 2024-09-21T06:36:19.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.497+0000 7f9f3ef99740 1 Processor -- start 2024-09-21T06:36:19.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.497+0000 7f9f3ef99740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c14c439cd0 0x55c14c836360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:19.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.497+0000 7f9f3ef99740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c14c452490 0x55c14c8368a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:19.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.497+0000 7f9f3ef99740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c14c45a670 0x55c14c836de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:19.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.497+0000 7f9f3ef99740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9f341ab9e0 con 0x55c14c45a670 2024-09-21T06:36:19.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.497+0000 7f9f3ef99740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9f341ace50 con 0x55c14c439cd0 2024-09-21T06:36:19.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.497+0000 7f9f3ef99740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9f341ac0b0 con 0x55c14c452490 2024-09-21T06:36:19.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.497+0000 7f9f3ef99740 10 client.0 _ll_register_callbacks cb 0x7f9f2c01c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:36:19.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.497+0000 7f9f32d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c14c45a670 0x55c14c836de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:19.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.497+0000 7f9f32d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c14c45a670 0x55c14c836de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42572/0 (socket says 172.21.15.7:42572) 2024-09-21T06:36:19.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.497+0000 7f9f32d9d640 1 -- 172.21.15.7:0/3925364683 learned_addr learned my addr 172.21.15.7:0/3925364683 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:36:19.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.497+0000 7f9f32d9d640 1 --2- 172.21.15.7:0/3925364683 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c14c439cd0 0x55c14c836360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:19.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.497+0000 7f9f31d9b640 1 --2- 172.21.15.7:0/3925364683 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c14c452490 0x55c14c8368a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:19.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.498+0000 7f9f32d9d640 1 -- 172.21.15.7:0/3925364683 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c14c452490 msgr2=0x55c14c8368a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:19.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.498+0000 7f9f32d9d640 1 --2- 172.21.15.7:0/3925364683 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c14c452490 0x55c14c8368a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:19.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.498+0000 7f9f32d9d640 1 -- 172.21.15.7:0/3925364683 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c14c439cd0 msgr2=0x55c14c836360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:19.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.498+0000 7f9f32d9d640 1 --2- 172.21.15.7:0/3925364683 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c14c439cd0 0x55c14c836360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:19.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.498+0000 7f9f32d9d640 1 -- 172.21.15.7:0/3925364683 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c14c8ae030 con 0x55c14c45a670 2024-09-21T06:36:19.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.498+0000 7f9f32d9d640 1 --2- 172.21.15.7:0/3925364683 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c14c45a670 0x55c14c836de0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x55c14c83f930 tx=0x7f9f2c02a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20219fadfe6e94e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:19.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.498+0000 7f9f19ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:36:19.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.498+0000 7f9f19ffb640 1 -- 172.21.15.7:0/3925364683 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f2c02d070 con 0x55c14c45a670 2024-09-21T06:36:19.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.498+0000 7f9f19ffb640 1 -- 172.21.15.7:0/3925364683 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f9f2c005040 con 0x55c14c45a670 2024-09-21T06:36:19.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.498+0000 7f9f3ef99740 1 -- 172.21.15.7:0/3925364683 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f2c005880 con 0x55c14c45a670 2024-09-21T06:36:19.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.498+0000 7f9f19ffb640 1 -- 172.21.15.7:0/3925364683 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9f2c042040 con 0x55c14c45a670 2024-09-21T06:36:19.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.498+0000 7f9f3ef99740 10 client.15462 fetch_fsmap learned FSMap version 25 2024-09-21T06:36:19.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.498+0000 7f9f3ef99740 1 -- 172.21.15.7:0/3925364683 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c14c8af2d0 con 0x55c14c45a670 2024-09-21T06:36:19.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.498+0000 7f9f19ffb640 1 -- 172.21.15.7:0/3925364683 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9f2c005880 con 0x55c14c45a670 2024-09-21T06:36:19.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.499+0000 7f9f19ffb640 1 -- 172.21.15.7:0/3925364683 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9f2c048040 con 0x55c14c45a670 2024-09-21T06:36:19.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.499+0000 7f9f3ef99740 10 client.15462 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:36:19.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.499+0000 7f9f3ef99740 10 client.15462 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:36:19.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.499+0000 7f9f3ef99740 20 client.15462 populate_metadata read hostname 'smithi007' 2024-09-21T06:36:19.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.499+0000 7f9f3ef99740 1 --2- 172.21.15.7:0/3925364683 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55c14c47b350 0x55c14c8b1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:19.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.499+0000 7f9f3ef99740 4 client.15462 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:36:19.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.499+0000 7f9f3ef99740 1 -- 172.21.15.7:0/3925364683 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55c14c796860 con 0x55c14c47b350 2024-09-21T06:36:19.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.499+0000 7f9f31d9b640 1 --2- 172.21.15.7:0/3925364683 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55c14c47b350 0x55c14c8b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:19.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.500+0000 7f9f19ffb640 10 client.15462 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:36:19.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.500+0000 7f9f31d9b640 1 --2- 172.21.15.7:0/3925364683 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55c14c47b350 0x55c14c8b1890 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=38a50078cef0cb61 server_cookie=187d3d34aa862b18 in_seq=0 out_seq=0 2024-09-21T06:36:19.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.501+0000 7f9f19ffb640 1 -- 172.21.15.7:0/3925364683 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55c14c796860 con 0x55c14c47b350 2024-09-21T06:36:19.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.501+0000 7f9f19ffb640 10 client.15462 handle_command_reply: tid=0 2024-09-21T06:36:19.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.501+0000 7f9f3ef99740 1 client.15462 shutdown 2024-09-21T06:36:19.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.502+0000 7f9f3ef99740 1 -- 172.21.15.7:0/3925364683 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c14c45a670 msgr2=0x55c14c836de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:19.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.502+0000 7f9f3ef99740 1 --2- 172.21.15.7:0/3925364683 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c14c45a670 0x55c14c836de0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x55c14c83f930 tx=0x7f9f2c02a040 comp rx=0 tx=0).stop 2024-09-21T06:36:19.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.502+0000 7f9f3ef99740 1 -- 172.21.15.7:0/3925364683 shutdown_connections 2024-09-21T06:36:19.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.502+0000 7f9f3ef99740 1 --2- 172.21.15.7:0/3925364683 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55c14c47b350 0x55c14c8b1890 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:19.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.502+0000 7f9f19ffb640 0 client.15462 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:36:19.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.502+0000 7f9f3ef99740 1 --2- 172.21.15.7:0/3925364683 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c14c45a670 0x55c14c836de0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:19.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.502+0000 7f9f3ef99740 1 --2- 172.21.15.7:0/3925364683 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c14c452490 0x55c14c8368a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:19.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.502+0000 7f9f3ef99740 1 --2- 172.21.15.7:0/3925364683 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c14c439cd0 0x55c14c836360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:19.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.502+0000 7f9f3ef99740 1 -- 172.21.15.7:0/3925364683 >> 172.21.15.7:0/3925364683 conn(0x55c14c46f740 msgr2=0x55c14c823460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:19.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.502+0000 7f9f3ef99740 1 -- 172.21.15.7:0/3925364683 shutdown_connections 2024-09-21T06:36:19.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.502+0000 7f9f3ef99740 1 -- 172.21.15.7:0/3925364683 wait complete. 2024-09-21T06:36:19.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.502+0000 7f9f3ef99740 20 client.15462 trim_cache size 0 max 16384 2024-09-21T06:36:19.506 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:36:19.507 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0, 2024-09-21T06:36:19.507 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_tag": "0b89345c-1f00-4efe-8ee9-4cb17e43584c", 2024-09-21T06:36:19.507 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": "asynchronous" 2024-09-21T06:36:19.507 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:36:19.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.502+0000 7f9f38a25640 1 -- 172.21.15.7:0/2958857408 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f9f1c0b65e0 msgr2=0x7f9f1c0b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:19.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.503+0000 7f9f38a25640 1 --2- 172.21.15.7:0/2958857408 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f9f1c0b65e0 0x7f9f1c0b8af0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9f240a93e0 tx=0x7f9f240d0040 comp rx=0 tx=0).stop 2024-09-21T06:36:19.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.503+0000 7f9f38a25640 1 -- 172.21.15.7:0/2958857408 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f341021f0 msgr2=0x7f9f3419a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:19.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.503+0000 7f9f38a25640 1 --2- 172.21.15.7:0/2958857408 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f341021f0 0x7f9f3419a4e0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f9f2400d950 tx=0x7f9f2400dd50 comp rx=0 tx=0).stop 2024-09-21T06:36:19.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.503+0000 7f9f38a25640 1 -- 172.21.15.7:0/2958857408 shutdown_connections 2024-09-21T06:36:19.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.503+0000 7f9f38a25640 1 --2- 172.21.15.7:0/2958857408 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f9f1c0b65e0 0x7f9f1c0b8af0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:19.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.503+0000 7f9f38a25640 1 --2- 172.21.15.7:0/2958857408 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f34108480 0x7f9f3419fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:19.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.503+0000 7f9f38a25640 1 --2- 172.21.15.7:0/2958857408 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9f34107b30 0x7f9f3419aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:19.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.503+0000 7f9f38a25640 1 --2- 172.21.15.7:0/2958857408 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9f341021f0 0x7f9f3419a4e0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:19.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.503+0000 7f9f38a25640 1 -- 172.21.15.7:0/2958857408 >> 172.21.15.7:0/2958857408 conn(0x7f9f34077c60 msgr2=0x7f9f34103ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:19.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.503+0000 7f9f38a25640 1 -- 172.21.15.7:0/2958857408 shutdown_connections 2024-09-21T06:36:19.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.503+0000 7f9f38a25640 1 -- 172.21.15.7:0/2958857408 wait complete. 2024-09-21T06:36:19.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.572+0000 7f6628bb0640 1 -- 172.21.15.7:0/3327122000 --> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) -- 0x7f66240638a0 con 0x7f660c0b6560 2024-09-21T06:36:19.637 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.635+0000 7f66137fe640 1 -- 172.21.15.7:0/3327122000 <== mgr.14223 v2:172.21.15.7:6800/3442812985 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+26 (secure 0 0 0) 0x7f66240638a0 con 0x7f660c0b6560 2024-09-21T06:36:19.637 INFO:teuthology.orchestra.run.smithi007.stdout:Retention added to path / 2024-09-21T06:36:19.639 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.637+0000 7f6628bb0640 1 -- 172.21.15.7:0/3327122000 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f660c0b6560 msgr2=0x7f660c0b8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:19.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.637+0000 7f6628bb0640 1 --2- 172.21.15.7:0/3327122000 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f660c0b6560 0x7f660c0b8a70 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f6624102920 tx=0x7f661400b390 comp rx=0 tx=0).stop 2024-09-21T06:36:19.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.638+0000 7f6628bb0640 1 -- 172.21.15.7:0/3327122000 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6624105110 msgr2=0x7f662419b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:19.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.638+0000 7f6628bb0640 1 --2- 172.21.15.7:0/3327122000 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6624105110 0x7f662419b7b0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f661800d770 tx=0x7f661800dc30 comp rx=0 tx=0).stop 2024-09-21T06:36:19.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.638+0000 7f6628bb0640 1 -- 172.21.15.7:0/3327122000 shutdown_connections 2024-09-21T06:36:19.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.638+0000 7f6628bb0640 1 --2- 172.21.15.7:0/3327122000 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f660c0b6560 0x7f660c0b8a70 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:19.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.638+0000 7f6628bb0640 1 --2- 172.21.15.7:0/3327122000 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6624105a60 0x7f662419bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:19.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.638+0000 7f6628bb0640 1 --2- 172.21.15.7:0/3327122000 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6624105110 0x7f662419b7b0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:19.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.638+0000 7f6628bb0640 1 --2- 172.21.15.7:0/3327122000 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6624103150 0x7f662419b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:19.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.638+0000 7f6628bb0640 1 -- 172.21.15.7:0/3327122000 >> 172.21.15.7:0/3327122000 conn(0x7f6624079e50 msgr2=0x7f6624106420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:19.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.638+0000 7f6628bb0640 1 -- 172.21.15.7:0/3327122000 shutdown_connections 2024-09-21T06:36:19.640 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.638+0000 7f6628bb0640 1 -- 172.21.15.7:0/3327122000 wait complete. 2024-09-21T06:36:19.653 DEBUG:teuthology.orchestra.run.smithi007:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-21T06:36:19.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.768+0000 7f7b7eb9d640 1 -- 172.21.15.7:0/551311016 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b78103910 msgr2=0x7f7b78103d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:19.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.768+0000 7f7b7eb9d640 1 --2- 172.21.15.7:0/551311016 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b78103910 0x7f7b78103d20 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f7b74009900 tx=0x7f7b7402a410 comp rx=0 tx=0).stop 2024-09-21T06:36:19.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.768+0000 7f7b7eb9d640 1 -- 172.21.15.7:0/551311016 shutdown_connections 2024-09-21T06:36:19.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.768+0000 7f7b7eb9d640 1 --2- 172.21.15.7:0/551311016 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b78109b90 0x7f7b781103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:19.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.768+0000 7f7b7eb9d640 1 --2- 172.21.15.7:0/551311016 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7b78109240 0x7f7b78109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:19.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.768+0000 7f7b7eb9d640 1 --2- 172.21.15.7:0/551311016 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b78103910 0x7f7b78103d20 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:19.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.768+0000 7f7b7eb9d640 1 -- 172.21.15.7:0/551311016 >> 172.21.15.7:0/551311016 conn(0x7f7b780ff390 msgr2=0x7f7b781017e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:19.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.768+0000 7f7b7eb9d640 1 -- 172.21.15.7:0/551311016 shutdown_connections 2024-09-21T06:36:19.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.768+0000 7f7b7eb9d640 1 -- 172.21.15.7:0/551311016 wait complete. 2024-09-21T06:36:19.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.768+0000 7f7b7eb9d640 1 Processor -- start 2024-09-21T06:36:19.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.769+0000 7f7b7eb9d640 1 -- start start 2024-09-21T06:36:19.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.769+0000 7f7b7eb9d640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b78103910 0x7f7b78075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:19.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.769+0000 7f7b7eb9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7b78109240 0x7f7b78075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:19.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.769+0000 7f7b7eb9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b78109b90 0x7f7b78076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:19.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.769+0000 7f7b7eb9d640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7b78113850 con 0x7f7b78109b90 2024-09-21T06:36:19.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.769+0000 7f7b7eb9d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7b781136d0 con 0x7f7b78109240 2024-09-21T06:36:19.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.769+0000 7f7b7eb9d640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7b781139d0 con 0x7f7b78103910 2024-09-21T06:36:19.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.769+0000 7f7b7e39c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b78109b90 0x7f7b78076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:19.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.769+0000 7f7b7e39c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b78109b90 0x7f7b78076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42602/0 (socket says 172.21.15.7:42602) 2024-09-21T06:36:19.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.769+0000 7f7b7e39c640 1 -- 172.21.15.7:0/2879172533 learned_addr learned my addr 172.21.15.7:0/2879172533 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:36:19.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.769+0000 7f7b7d39a640 1 --2- 172.21.15.7:0/2879172533 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7b78109240 0x7f7b78075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:19.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.769+0000 7f7b7db9b640 1 --2- 172.21.15.7:0/2879172533 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b78103910 0x7f7b78075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:19.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.769+0000 7f7b7e39c640 1 -- 172.21.15.7:0/2879172533 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b78103910 msgr2=0x7f7b78075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:19.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.769+0000 7f7b7e39c640 1 --2- 172.21.15.7:0/2879172533 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b78103910 0x7f7b78075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:19.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.769+0000 7f7b7e39c640 1 -- 172.21.15.7:0/2879172533 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7b78109240 msgr2=0x7f7b78075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:19.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.769+0000 7f7b7e39c640 1 --2- 172.21.15.7:0/2879172533 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7b78109240 0x7f7b78075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:19.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.769+0000 7f7b7e39c640 1 -- 172.21.15.7:0/2879172533 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b781a8540 con 0x7f7b78109b90 2024-09-21T06:36:19.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.769+0000 7f7b7d39a640 1 --2- 172.21.15.7:0/2879172533 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7b78109240 0x7f7b78075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:36:19.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.770+0000 7f7b7e39c640 1 --2- 172.21.15.7:0/2879172533 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b78109b90 0x7f7b78076190 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f7b7000eb10 tx=0x7f7b7000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:19.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.770+0000 7f7b6effd640 1 -- 172.21.15.7:0/2879172533 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b70004b20 con 0x7f7b78109b90 2024-09-21T06:36:19.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.770+0000 7f7b7eb9d640 1 -- 172.21.15.7:0/2879172533 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b781a8830 con 0x7f7b78109b90 2024-09-21T06:36:19.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.770+0000 7f7b6effd640 1 -- 172.21.15.7:0/2879172533 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7b70004cc0 con 0x7f7b78109b90 2024-09-21T06:36:19.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.770+0000 7f7b6effd640 1 -- 172.21.15.7:0/2879172533 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b70010690 con 0x7f7b78109b90 2024-09-21T06:36:19.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.770+0000 7f7b7eb9d640 1 -- 172.21.15.7:0/2879172533 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b781a8dd0 con 0x7f7b78109b90 2024-09-21T06:36:19.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.771+0000 7f7b7eb9d640 1 -- 172.21.15.7:0/2879172533 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b78103d20 con 0x7f7b78109b90 2024-09-21T06:36:19.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.773+0000 7f7b6effd640 1 -- 172.21.15.7:0/2879172533 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 23) ==== 154528+0+0 (secure 0 0 0) 0x7f7b70005000 con 0x7f7b78109b90 2024-09-21T06:36:19.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.773+0000 7f7b6effd640 1 --2- 172.21.15.7:0/2879172533 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f7b640b6580 0x7f7b640b8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:19.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.774+0000 7f7b7db9b640 1 --2- 172.21.15.7:0/2879172533 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f7b640b6580 0x7f7b640b8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:19.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.774+0000 7f7b6effd640 1 -- 172.21.15.7:0/2879172533 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f7b700e7bb0 con 0x7f7b78109b90 2024-09-21T06:36:19.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.774+0000 7f7b7db9b640 1 --2- 172.21.15.7:0/2879172533 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f7b640b6580 0x7f7b640b8a90 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7b74000c00 tx=0x7f7b74031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:19.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.777+0000 7f7b6effd640 1 -- 172.21.15.7:0/2879172533 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7b70056710 con 0x7f7b78109b90 2024-09-21T06:36:19.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.804+0000 7f7b6effd640 1 -- 172.21.15.7:0/2879172533 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mgrmap(e 24) ==== 154585+0+0 (secure 0 0 0) 0x7f7b700a9f30 con 0x7f7b78109b90 2024-09-21T06:36:19.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.992+0000 7f7b7eb9d640 1 -- 172.21.15.7:0/2879172533 --> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f7b78063800 con 0x7f7b640b6580 2024-09-21T06:36:20.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:19.999+0000 7f7b6effd640 1 -- 172.21.15.7:0/2879172533 <== mgr.14223 v2:172.21.15.7:6800/3442812985 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+298 (secure 0 0 0) 0x7f7b78063800 con 0x7f7b640b6580 2024-09-21T06:36:20.000 INFO:teuthology.orchestra.run.smithi007.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-21T00:00:00", "created": "2024-09-21T06:36:19", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-09-21T06:36:20.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:20.001+0000 7f7b7eb9d640 1 -- 172.21.15.7:0/2879172533 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f7b640b6580 msgr2=0x7f7b640b8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:20.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:20.001+0000 7f7b7eb9d640 1 --2- 172.21.15.7:0/2879172533 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f7b640b6580 0x7f7b640b8a90 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7b74000c00 tx=0x7f7b74031400 comp rx=0 tx=0).stop 2024-09-21T06:36:20.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:20.001+0000 7f7b7eb9d640 1 -- 172.21.15.7:0/2879172533 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b78109b90 msgr2=0x7f7b78076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:20.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:20.001+0000 7f7b7eb9d640 1 --2- 172.21.15.7:0/2879172533 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b78109b90 0x7f7b78076190 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f7b7000eb10 tx=0x7f7b7000c2d0 comp rx=0 tx=0).stop 2024-09-21T06:36:20.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:20.001+0000 7f7b7eb9d640 1 -- 172.21.15.7:0/2879172533 shutdown_connections 2024-09-21T06:36:20.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:20.001+0000 7f7b7eb9d640 1 --2- 172.21.15.7:0/2879172533 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f7b640b6580 0x7f7b640b8a90 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:20.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:20.001+0000 7f7b7eb9d640 1 --2- 172.21.15.7:0/2879172533 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7b78109b90 0x7f7b78076190 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:20.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:20.001+0000 7f7b7eb9d640 1 --2- 172.21.15.7:0/2879172533 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7b78109240 0x7f7b78075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:20.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:20.001+0000 7f7b7eb9d640 1 --2- 172.21.15.7:0/2879172533 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7b78103910 0x7f7b78075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:20.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:20.001+0000 7f7b7eb9d640 1 -- 172.21.15.7:0/2879172533 >> 172.21.15.7:0/2879172533 conn(0x7f7b780ff390 msgr2=0x7f7b781017b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:20.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:20.001+0000 7f7b7eb9d640 1 -- 172.21.15.7:0/2879172533 shutdown_connections 2024-09-21T06:36:20.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:20.001+0000 7f7b7eb9d640 1 -- 172.21.15.7:0/2879172533 wait complete. 2024-09-21T06:36:20.014 DEBUG:teuthology.orchestra.run.smithi007:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-21T06:36:20.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:20.129+0000 7f72cae15640 1 -- 172.21.15.7:0/3391497200 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72c4109400 msgr2=0x7f72c4109810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:20.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:20.129+0000 7f72cae15640 1 --2- 172.21.15.7:0/3391497200 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72c4109400 0x7f72c4109810 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f72b0009900 tx=0x7f72b002a410 comp rx=0 tx=0).stop 2024-09-21T06:36:20.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:20.129+0000 7f72cae15640 1 -- 172.21.15.7:0/3391497200 shutdown_connections 2024-09-21T06:36:20.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:20.129+0000 7f72cae15640 1 --2- 172.21.15.7:0/3391497200 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f72c4109d50 0x7f72c4110580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:20.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:20.129+0000 7f72cae15640 1 --2- 172.21.15.7:0/3391497200 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72c4109400 0x7f72c4109810 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:20.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:20.129+0000 7f72cae15640 1 --2- 172.21.15.7:0/3391497200 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72c4103ad0 0x7f72c4103ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:20.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:20.129+0000 7f72cae15640 1 -- 172.21.15.7:0/3391497200 >> 172.21.15.7:0/3391497200 conn(0x7f72c40ff4d0 msgr2=0x7f72c4101920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:20.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:20.129+0000 7f72cae15640 1 -- 172.21.15.7:0/3391497200 shutdown_connections 2024-09-21T06:36:20.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:20.129+0000 7f72cae15640 1 -- 172.21.15.7:0/3391497200 wait complete. 2024-09-21T06:36:20.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:20.130+0000 7f72cae15640 1 Processor -- start 2024-09-21T06:36:20.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:20.130+0000 7f72cae15640 1 -- start start 2024-09-21T06:36:20.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:20.130+0000 7f72cae15640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f72c4103ad0 0x7f72c419a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:20.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:20.130+0000 7f72cae15640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72c4109400 0x7f72c419a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:20.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:20.130+0000 7f72cae15640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72c4109d50 0x7f72c419fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:20.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:20.130+0000 7f72cae15640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f72c4113a10 con 0x7f72c4109400 2024-09-21T06:36:20.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:20.130+0000 7f72cae15640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f72c4113890 con 0x7f72c4109d50 2024-09-21T06:36:20.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:20.130+0000 7f72cae15640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f72c4113b90 con 0x7f72c4103ad0 2024-09-21T06:36:20.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:20.131+0000 7f72c3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72c4109400 0x7f72c419a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:20.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:20.131+0000 7f72c3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72c4109400 0x7f72c419a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42612/0 (socket says 172.21.15.7:42612) 2024-09-21T06:36:20.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:20.131+0000 7f72c3fff640 1 -- 172.21.15.7:0/1867393123 learned_addr learned my addr 172.21.15.7:0/1867393123 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:36:20.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:20.131+0000 7f72c8bb1640 1 --2- 172.21.15.7:0/1867393123 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f72c4103ad0 0x7f72c419a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:20.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:20.131+0000 7f72c93b2640 1 --2- 172.21.15.7:0/1867393123 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72c4109d50 0x7f72c419fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:20.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:20.131+0000 7f72c3fff640 1 -- 172.21.15.7:0/1867393123 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f72c4103ad0 msgr2=0x7f72c419a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:20.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:20.131+0000 7f72c3fff640 1 --2- 172.21.15.7:0/1867393123 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f72c4103ad0 0x7f72c419a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:20.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:20.131+0000 7f72c3fff640 1 -- 172.21.15.7:0/1867393123 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72c4109d50 msgr2=0x7f72c419fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:20.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:20.131+0000 7f72c3fff640 1 --2- 172.21.15.7:0/1867393123 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72c4109d50 0x7f72c419fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:20.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:20.131+0000 7f72c3fff640 1 -- 172.21.15.7:0/1867393123 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72c41a0320 con 0x7f72c4109400 2024-09-21T06:36:20.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:20.131+0000 7f72c93b2640 1 --2- 172.21.15.7:0/1867393123 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72c4109d50 0x7f72c419fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:36:20.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:20.131+0000 7f72c3fff640 1 --2- 172.21.15.7:0/1867393123 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72c4109400 0x7f72c419a990 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f72b002a930 tx=0x7f72b0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:20.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:20.131+0000 7f72c1ffb640 1 -- 172.21.15.7:0/1867393123 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b003f030 con 0x7f72c4109400 2024-09-21T06:36:20.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:20.131+0000 7f72c1ffb640 1 -- 172.21.15.7:0/1867393123 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f72b0003aa0 con 0x7f72c4109400 2024-09-21T06:36:20.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:20.131+0000 7f72cae15640 1 -- 172.21.15.7:0/1867393123 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72c41a05b0 con 0x7f72c4109400 2024-09-21T06:36:20.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:20.131+0000 7f72c1ffb640 1 -- 172.21.15.7:0/1867393123 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b0035070 con 0x7f72c4109400 2024-09-21T06:36:20.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:20.132+0000 7f72cae15640 1 -- 172.21.15.7:0/1867393123 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72c41a6da0 con 0x7f72c4109400 2024-09-21T06:36:20.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:20.133+0000 7f72cae15640 1 -- 172.21.15.7:0/1867393123 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72c4104d40 con 0x7f72c4109400 2024-09-21T06:36:20.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:20.134+0000 7f72c1ffb640 1 -- 172.21.15.7:0/1867393123 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154585+0+0 (secure 0 0 0) 0x7f72b0042030 con 0x7f72c4109400 2024-09-21T06:36:20.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:20.135+0000 7f72c1ffb640 1 --2- 172.21.15.7:0/1867393123 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f72b40b65f0 0x7f72b40b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:20.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:20.135+0000 7f72c1ffb640 1 -- 172.21.15.7:0/1867393123 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f72b0108090 con 0x7f72c4109400 2024-09-21T06:36:20.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:20.135+0000 7f72c8bb1640 1 --2- 172.21.15.7:0/1867393123 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f72b40b65f0 0x7f72b40b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:20.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:20.136+0000 7f72c8bb1640 1 --2- 172.21.15.7:0/1867393123 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f72b40b65f0 0x7f72b40b8b00 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f72b8005d00 tx=0x7f72b800b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:20.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:20.138+0000 7f72c1ffb640 1 -- 172.21.15.7:0/1867393123 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f72b00ce740 con 0x7f72c4109400 2024-09-21T06:36:20.316 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:36:20.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:20.351+0000 7f72cae15640 1 -- 172.21.15.7:0/1867393123 --> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f72c4063800 con 0x7f72b40b65f0 2024-09-21T06:36:20.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:20.359+0000 7f72c1ffb640 1 -- 172.21.15.7:0/1867393123 <== mgr.14223 v2:172.21.15.7:6800/3442812985 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f72c4063800 con 0x7f72b40b65f0 2024-09-21T06:36:20.360 INFO:teuthology.orchestra.run.smithi007.stdout:/ 1m 6m3h 2024-09-21T06:36:20.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:20.361+0000 7f72cae15640 1 -- 172.21.15.7:0/1867393123 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f72b40b65f0 msgr2=0x7f72b40b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:20.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:20.361+0000 7f72cae15640 1 --2- 172.21.15.7:0/1867393123 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f72b40b65f0 0x7f72b40b8b00 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f72b8005d00 tx=0x7f72b800b410 comp rx=0 tx=0).stop 2024-09-21T06:36:20.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:20.361+0000 7f72cae15640 1 -- 172.21.15.7:0/1867393123 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72c4109400 msgr2=0x7f72c419a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:20.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:20.361+0000 7f72cae15640 1 --2- 172.21.15.7:0/1867393123 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72c4109400 0x7f72c419a990 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f72b002a930 tx=0x7f72b0004270 comp rx=0 tx=0).stop 2024-09-21T06:36:20.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:20.361+0000 7f72cae15640 1 -- 172.21.15.7:0/1867393123 shutdown_connections 2024-09-21T06:36:20.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:20.361+0000 7f72cae15640 1 --2- 172.21.15.7:0/1867393123 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f72b40b65f0 0x7f72b40b8b00 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:20.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:20.361+0000 7f72cae15640 1 --2- 172.21.15.7:0/1867393123 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f72c4109d50 0x7f72c419fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:20.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:20.361+0000 7f72cae15640 1 --2- 172.21.15.7:0/1867393123 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f72c4109400 0x7f72c419a990 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:20.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:20.361+0000 7f72cae15640 1 --2- 172.21.15.7:0/1867393123 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f72c4103ad0 0x7f72c419a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:20.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:20.361+0000 7f72cae15640 1 -- 172.21.15.7:0/1867393123 >> 172.21.15.7:0/1867393123 conn(0x7f72c40ff4d0 msgr2=0x7f72c4108ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:20.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:20.361+0000 7f72cae15640 1 -- 172.21.15.7:0/1867393123 shutdown_connections 2024-09-21T06:36:20.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:20.361+0000 7f72cae15640 1 -- 172.21.15.7:0/1867393123 wait complete. 2024-09-21T06:36:20.375 DEBUG:teuthology.orchestra.run.smithi007:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-09-21T06:36:20.442 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-09-21T06:36:20.454 INFO:teuthology.run_tasks:Running task background_exec... 2024-09-21T06:36:20.463 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi007.front.sepia.ceph.com 2024-09-21T06:36:20.464 DEBUG:teuthology.orchestra.run.smithi007:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-09-21T06:36:20.485 INFO:teuthology.run_tasks:Running task workunit... 2024-09-21T06:36:20.499 INFO:tasks.workunit:Pulling workunits from ref 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:36:20.499 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-21T06:36:20.499 INFO:tasks.workunit:timeout=3h 2024-09-21T06:36:20.499 INFO:tasks.workunit:cleanup=True 2024-09-21T06:36:20.499 DEBUG:teuthology.orchestra.run.smithi007:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-21T06:36:20.517 INFO:teuthology.orchestra.run.smithi007.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-21T06:36:20.517 INFO:teuthology.orchestra.run.smithi007.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-21T06:36:20.517 INFO:teuthology.orchestra.run.smithi007.stdout:Device: 78h/120d Inode: 1099511628283 Links: 2 2024-09-21T06:36:20.517 INFO:teuthology.orchestra.run.smithi007.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T06:36:20.518 INFO:teuthology.orchestra.run.smithi007.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-21T06:36:20.518 INFO:teuthology.orchestra.run.smithi007.stdout:Access: 2024-09-21 06:34:42.852813827 +0000 2024-09-21T06:36:20.518 INFO:teuthology.orchestra.run.smithi007.stdout:Modify: 2024-09-21 06:34:42.852813827 +0000 2024-09-21T06:36:20.518 INFO:teuthology.orchestra.run.smithi007.stdout:Change: 2024-09-21 06:36:09.998082097 +0000 2024-09-21T06:36:20.518 INFO:teuthology.orchestra.run.smithi007.stdout: Birth: 2024-09-21 06:34:42.852813827 +0000 2024-09-21T06:36:20.518 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-21T06:36:20.518 DEBUG:teuthology.orchestra.run.smithi007:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-21T06:36:20.586 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:36:20.595 DEBUG:teuthology.orchestra.run.smithi007:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T06:36:20.651 INFO:tasks.workunit.client.0.smithi007.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-21T06:36:20.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:36:20 smithi007 ceph-mon[30983]: from='client.15432 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:36:20.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:36:20 smithi007 ceph-mon[30983]: pgmap v323: 97 pgs: 97 active+clean; 649 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.1 KiB/s wr, 8 op/s 2024-09-21T06:36:20.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:36:20 smithi007 ceph-mon[30983]: scrub queued for path: / 2024-09-21T06:36:20.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:36:20 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T06:36:20.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:36:20 smithi007 ceph-mon[30983]: scrub summary: active paths [/] 2024-09-21T06:36:20.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:36:20 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T06:36:20.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:36:20 smithi007 ceph-mon[30983]: from='client.15444 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:36:20.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:36:20 smithi007 ceph-mon[30983]: mgrmap e24: x(active, since 8m), standbys: z, y 2024-09-21T06:36:21.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.086+0000 7fa8ab1ab640 1 -- 172.21.15.7:0/4237287210 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa8a41094b0 msgr2=0x7fa8a41098c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:21.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.086+0000 7fa8ab1ab640 1 --2- 172.21.15.7:0/4237287210 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa8a41094b0 0x7fa8a41098c0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fa898009900 tx=0x7fa89802a410 comp rx=0 tx=0).stop 2024-09-21T06:36:21.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.086+0000 7fa8ab1ab640 1 -- 172.21.15.7:0/4237287210 shutdown_connections 2024-09-21T06:36:21.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.086+0000 7fa8ab1ab640 1 --2- 172.21.15.7:0/4237287210 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa8a4109e00 0x7fa8a4110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:21.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.086+0000 7fa8ab1ab640 1 --2- 172.21.15.7:0/4237287210 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa8a41094b0 0x7fa8a41098c0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:21.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.086+0000 7fa8ab1ab640 1 --2- 172.21.15.7:0/4237287210 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa8a4103bc0 0x7fa8a4103fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:21.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.086+0000 7fa8ab1ab640 1 -- 172.21.15.7:0/4237287210 >> 172.21.15.7:0/4237287210 conn(0x7fa8a407b910 msgr2=0x7fa8a407bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:21.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.086+0000 7fa8ab1ab640 1 -- 172.21.15.7:0/4237287210 shutdown_connections 2024-09-21T06:36:21.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.086+0000 7fa8ab1ab640 1 -- 172.21.15.7:0/4237287210 wait complete. 2024-09-21T06:36:21.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.087+0000 7fa8ab1ab640 1 Processor -- start 2024-09-21T06:36:21.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.087+0000 7fa8ab1ab640 1 -- start start 2024-09-21T06:36:21.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.087+0000 7fa8ab1ab640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa8a4103bc0 0x7fa8a419c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:21.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.087+0000 7fa8ab1ab640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa8a41094b0 0x7fa8a419cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:21.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.087+0000 7fa8ab1ab640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa8a4109e00 0x7fa8a41a1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:21.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.087+0000 7fa8ab1ab640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa8a4113ac0 con 0x7fa8a4103bc0 2024-09-21T06:36:21.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.087+0000 7fa8ab1ab640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa8a4113940 con 0x7fa8a41094b0 2024-09-21T06:36:21.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.087+0000 7fa8ab1ab640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa8a4113c40 con 0x7fa8a4109e00 2024-09-21T06:36:21.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.088+0000 7fa8a8f47640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa8a4103bc0 0x7fa8a419c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:21.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.088+0000 7fa8a8f47640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa8a4103bc0 0x7fa8a419c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43924/0 (socket says 172.21.15.7:43924) 2024-09-21T06:36:21.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.088+0000 7fa8a8f47640 1 -- 172.21.15.7:0/549124815 learned_addr learned my addr 172.21.15.7:0/549124815 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:36:21.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.088+0000 7fa8a9748640 1 --2- 172.21.15.7:0/549124815 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa8a4109e00 0x7fa8a41a1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:21.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.088+0000 7fa8a3fff640 1 --2- 172.21.15.7:0/549124815 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa8a41094b0 0x7fa8a419cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:21.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.088+0000 7fa8a8f47640 1 -- 172.21.15.7:0/549124815 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa8a4109e00 msgr2=0x7fa8a41a1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:21.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.088+0000 7fa8a8f47640 1 --2- 172.21.15.7:0/549124815 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa8a4109e00 0x7fa8a41a1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:21.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.088+0000 7fa8a8f47640 1 -- 172.21.15.7:0/549124815 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa8a41094b0 msgr2=0x7fa8a419cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:21.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.088+0000 7fa8a8f47640 1 --2- 172.21.15.7:0/549124815 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa8a41094b0 0x7fa8a419cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:21.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.088+0000 7fa8a8f47640 1 -- 172.21.15.7:0/549124815 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8a41a2620 con 0x7fa8a4103bc0 2024-09-21T06:36:21.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.088+0000 7fa8a9748640 1 --2- 172.21.15.7:0/549124815 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa8a4109e00 0x7fa8a41a1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:36:21.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.088+0000 7fa8a3fff640 1 --2- 172.21.15.7:0/549124815 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa8a41094b0 0x7fa8a419cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:36:21.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.088+0000 7fa8a8f47640 1 --2- 172.21.15.7:0/549124815 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa8a4103bc0 0x7fa8a419c6b0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fa89c00db80 tx=0x7fa89c00b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:21.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.088+0000 7fa8a1ffb640 1 -- 172.21.15.7:0/549124815 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa89c017070 con 0x7fa8a4103bc0 2024-09-21T06:36:21.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.088+0000 7fa8a1ffb640 1 -- 172.21.15.7:0/549124815 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa89c003b70 con 0x7fa8a4103bc0 2024-09-21T06:36:21.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.088+0000 7fa8ab1ab640 1 -- 172.21.15.7:0/549124815 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8a41a2910 con 0x7fa8a4103bc0 2024-09-21T06:36:21.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.088+0000 7fa8a1ffb640 1 -- 172.21.15.7:0/549124815 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa89c0106c0 con 0x7fa8a4103bc0 2024-09-21T06:36:21.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.089+0000 7fa8ab1ab640 1 -- 172.21.15.7:0/549124815 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8a41a9070 con 0x7fa8a4103bc0 2024-09-21T06:36:21.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.091+0000 7fa8a1ffb640 1 -- 172.21.15.7:0/549124815 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154585+0+0 (secure 0 0 0) 0x7fa89c004020 con 0x7fa8a4103bc0 2024-09-21T06:36:21.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.091+0000 7fa8b171f740 1 Processor -- start 2024-09-21T06:36:21.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.091+0000 7fa8b171f740 1 -- start start 2024-09-21T06:36:21.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.092+0000 7fa8b171f740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5644722d3070 0x56447267a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:21.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.092+0000 7fa8b171f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644722aa1b0 0x56447267a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:21.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.092+0000 7fa8b171f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644722b2390 0x56447267acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:21.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.092+0000 7fa8b171f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5644725f0e50 con 0x5644722b2390 2024-09-21T06:36:21.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.092+0000 7fa8b171f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5644725e0280 con 0x5644722aa1b0 2024-09-21T06:36:21.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.092+0000 7fa8b171f740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5644725e4090 con 0x5644722d3070 2024-09-21T06:36:21.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.092+0000 7fa8a3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644722b2390 0x56447267acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:21.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.092+0000 7fa8a3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644722b2390 0x56447267acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43930/0 (socket says 172.21.15.7:43930) 2024-09-21T06:36:21.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.092+0000 7fa8a3fff640 1 -- 172.21.15.7:0/3672680025 learned_addr learned my addr 172.21.15.7:0/3672680025 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:36:21.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.092+0000 7fa8a1ffb640 1 --2- 172.21.15.7:0/549124815 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa88c0b6670 0x7fa88c0b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:21.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.092+0000 7fa8a9748640 1 --2- 172.21.15.7:0/3672680025 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5644722d3070 0x56447267a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:21.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.092+0000 7fa8a8f47640 1 --2- 172.21.15.7:0/3672680025 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644722aa1b0 0x56447267a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:21.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.092+0000 7fa8a3fff640 1 -- 172.21.15.7:0/3672680025 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5644722d3070 msgr2=0x56447267a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:21.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.092+0000 7fa8a3fff640 1 --2- 172.21.15.7:0/3672680025 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5644722d3070 0x56447267a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:21.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.092+0000 7fa8a3fff640 1 -- 172.21.15.7:0/3672680025 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644722aa1b0 msgr2=0x56447267a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:21.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.092+0000 7fa8a1ffb640 1 -- 172.21.15.7:0/549124815 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fa89c0e76a0 con 0x7fa8a4103bc0 2024-09-21T06:36:21.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.092+0000 7fa8a9748640 1 --2- 172.21.15.7:0/549124815 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa88c0b6670 0x7fa88c0b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:21.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.092+0000 7fa8a3fff640 1 --2- 172.21.15.7:0/3672680025 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644722aa1b0 0x56447267a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:21.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.092+0000 7fa8a3fff640 1 -- 172.21.15.7:0/3672680025 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56447233e650 con 0x5644722b2390 2024-09-21T06:36:21.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.092+0000 7fa8a8f47640 1 --2- 172.21.15.7:0/3672680025 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644722aa1b0 0x56447267a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:36:21.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.093+0000 7fa8a3fff640 1 --2- 172.21.15.7:0/3672680025 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644722b2390 0x56447267acf0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fa898031440 tx=0x7fa898032d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da482d0107e7f5ae server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:21.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.093+0000 7fa88affd640 1 -- 172.21.15.7:0/3672680025 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa89803f070 con 0x5644722b2390 2024-09-21T06:36:21.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.093+0000 7fa8a9748640 1 --2- 172.21.15.7:0/549124815 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa88c0b6670 0x7fa88c0b8b80 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa894005fd0 tx=0x7fa8940046c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:21.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.093+0000 7fa88affd640 1 -- 172.21.15.7:0/3672680025 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa8980316a0 con 0x5644722b2390 2024-09-21T06:36:21.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.093+0000 7fa88affd640 1 -- 172.21.15.7:0/3672680025 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa898035070 con 0x5644722b2390 2024-09-21T06:36:21.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.094+0000 7fa8b171f740 1 -- 172.21.15.7:0/3672680025 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644722b2390 msgr2=0x56447267acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:21.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.094+0000 7fa8b171f740 1 --2- 172.21.15.7:0/3672680025 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644722b2390 0x56447267acf0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fa898031440 tx=0x7fa898032d00 comp rx=0 tx=0).stop 2024-09-21T06:36:21.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.094+0000 7fa8b171f740 1 -- 172.21.15.7:0/3672680025 shutdown_connections 2024-09-21T06:36:21.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.094+0000 7fa8b171f740 1 --2- 172.21.15.7:0/3672680025 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644722b2390 0x56447267acf0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:21.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.094+0000 7fa8b171f740 1 --2- 172.21.15.7:0/3672680025 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644722aa1b0 0x56447267a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:21.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.094+0000 7fa8b171f740 1 --2- 172.21.15.7:0/3672680025 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5644722d3070 0x56447267a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:21.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.094+0000 7fa8b171f740 1 -- 172.21.15.7:0/3672680025 >> 172.21.15.7:0/3672680025 conn(0x5644722c7460 msgr2=0x564472678160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:21.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.094+0000 7fa8b171f740 1 -- 172.21.15.7:0/3672680025 shutdown_connections 2024-09-21T06:36:21.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.094+0000 7fa8b171f740 1 -- 172.21.15.7:0/3672680025 wait complete. 2024-09-21T06:36:21.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.094+0000 7fa8b171f740 1 -- start start 2024-09-21T06:36:21.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.094+0000 7fa8b171f740 1 Processor -- start 2024-09-21T06:36:21.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.095+0000 7fa8b171f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644722aa1b0 0x564472685970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:21.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.095+0000 7fa8b171f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644722b2390 0x564472685eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:21.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.095+0000 7fa8b171f740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5644722d3070 0x564472691ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:21.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.095+0000 7fa8b171f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x564472441700 con 0x5644722aa1b0 2024-09-21T06:36:21.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.095+0000 7fa8b171f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56447257b110 con 0x5644722b2390 2024-09-21T06:36:21.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.095+0000 7fa8b171f740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5644726889f0 con 0x5644722d3070 2024-09-21T06:36:21.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.095+0000 7fa8b171f740 10 client.0 _ll_register_callbacks cb 0x564472594990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:36:21.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.095+0000 7fa8a8f47640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644722aa1b0 0x564472685970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:21.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.095+0000 7fa8a8f47640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644722aa1b0 0x564472685970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43942/0 (socket says 172.21.15.7:43942) 2024-09-21T06:36:21.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.095+0000 7fa8a8f47640 1 -- 172.21.15.7:0/1475402096 learned_addr learned my addr 172.21.15.7:0/1475402096 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:36:21.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.095+0000 7fa8a3fff640 1 --2- 172.21.15.7:0/1475402096 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644722b2390 0x564472685eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:21.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.095+0000 7fa8a8f47640 1 -- 172.21.15.7:0/1475402096 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5644722d3070 msgr2=0x564472691ce0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T06:36:21.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.095+0000 7fa8a8f47640 1 --2- 172.21.15.7:0/1475402096 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5644722d3070 0x564472691ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:21.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.095+0000 7fa8a8f47640 1 -- 172.21.15.7:0/1475402096 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644722b2390 msgr2=0x564472685eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:21.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.095+0000 7fa8a8f47640 1 --2- 172.21.15.7:0/1475402096 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644722b2390 0x564472685eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:21.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.095+0000 7fa8a8f47640 1 -- 172.21.15.7:0/1475402096 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644725a8c40 con 0x5644722aa1b0 2024-09-21T06:36:21.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.095+0000 7fa8a3fff640 1 --2- 172.21.15.7:0/1475402096 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644722b2390 0x564472685eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:36:21.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.096+0000 7fa8a8f47640 1 --2- 172.21.15.7:0/1475402096 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644722aa1b0 0x564472685970 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fa89c0ad5a0 tx=0x7fa89c076130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=196c1f582d4bb4d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:21.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.096+0000 7fa883fff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:36:21.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.096+0000 7fa883fff640 1 -- 172.21.15.7:0/1475402096 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa89c0071c0 con 0x5644722aa1b0 2024-09-21T06:36:21.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.096+0000 7fa883fff640 1 -- 172.21.15.7:0/1475402096 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fa89c0e51e0 con 0x5644722aa1b0 2024-09-21T06:36:21.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.096+0000 7fa8b171f740 1 -- 172.21.15.7:0/1475402096 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa8980316a0 con 0x5644722aa1b0 2024-09-21T06:36:21.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.096+0000 7fa883fff640 1 -- 172.21.15.7:0/1475402096 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa89c00be60 con 0x5644722aa1b0 2024-09-21T06:36:21.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.096+0000 7fa8b171f740 10 client.15486 fetch_fsmap learned FSMap version 25 2024-09-21T06:36:21.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.096+0000 7fa8b171f740 1 -- 172.21.15.7:0/1475402096 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564472694760 con 0x5644722aa1b0 2024-09-21T06:36:21.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.096+0000 7fa883fff640 1 -- 172.21.15.7:0/1475402096 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa8980316a0 con 0x5644722aa1b0 2024-09-21T06:36:21.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.096+0000 7fa883fff640 1 -- 172.21.15.7:0/1475402096 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa89c023060 con 0x5644722aa1b0 2024-09-21T06:36:21.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.097+0000 7fa8b171f740 10 client.15486 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:36:21.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.097+0000 7fa8b171f740 10 client.15486 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:36:21.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.097+0000 7fa8b171f740 20 client.15486 populate_metadata read hostname 'smithi007' 2024-09-21T06:36:21.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.097+0000 7fa8b171f740 1 --2- 172.21.15.7:0/1475402096 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5644722919f0 0x564472697d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:21.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.097+0000 7fa8b171f740 4 client.15486 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:36:21.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.097+0000 7fa8b171f740 1 -- 172.21.15.7:0/1475402096 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5644725f2da0 con 0x5644722919f0 2024-09-21T06:36:21.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.097+0000 7fa8a3fff640 1 --2- 172.21.15.7:0/1475402096 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5644722919f0 0x564472697d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:21.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.097+0000 7fa883fff640 10 client.15486 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:36:21.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.097+0000 7fa8a3fff640 1 --2- 172.21.15.7:0/1475402096 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5644722919f0 0x564472697d60 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b4747895c3667e1 server_cookie=70a3df396a9aaee8 in_seq=0 out_seq=0 2024-09-21T06:36:21.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.098+0000 7fa883fff640 1 -- 172.21.15.7:0/1475402096 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5644725f2da0 con 0x5644722919f0 2024-09-21T06:36:21.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.098+0000 7fa883fff640 10 client.15486 handle_command_reply: tid=0 2024-09-21T06:36:21.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.098+0000 7fa8b171f740 1 client.15486 shutdown 2024-09-21T06:36:21.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.098+0000 7fa8b171f740 1 -- 172.21.15.7:0/1475402096 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644722aa1b0 msgr2=0x564472685970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:21.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.098+0000 7fa8b171f740 1 --2- 172.21.15.7:0/1475402096 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644722aa1b0 0x564472685970 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fa89c0ad5a0 tx=0x7fa89c076130 comp rx=0 tx=0).stop 2024-09-21T06:36:21.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.098+0000 7fa8b171f740 1 -- 172.21.15.7:0/1475402096 shutdown_connections 2024-09-21T06:36:21.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.098+0000 7fa8b171f740 1 --2- 172.21.15.7:0/1475402096 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5644722919f0 0x564472697d60 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:21.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.098+0000 7fa8b171f740 1 --2- 172.21.15.7:0/1475402096 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5644722d3070 0x564472691ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:21.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.098+0000 7fa8b171f740 1 --2- 172.21.15.7:0/1475402096 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644722b2390 0x564472685eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:21.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.098+0000 7fa8b171f740 1 --2- 172.21.15.7:0/1475402096 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644722aa1b0 0x564472685970 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:21.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.098+0000 7fa8b171f740 1 -- 172.21.15.7:0/1475402096 >> 172.21.15.7:0/1475402096 conn(0x5644722c7460 msgr2=0x56447267d400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:21.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.098+0000 7fa883fff640 0 client.15486 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:36:21.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.099+0000 7fa8b171f740 1 -- 172.21.15.7:0/1475402096 shutdown_connections 2024-09-21T06:36:21.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.099+0000 7fa8b171f740 1 -- 172.21.15.7:0/1475402096 wait complete. 2024-09-21T06:36:21.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.099+0000 7fa8b171f740 20 client.15486 trim_cache size 0 max 16384 2024-09-21T06:36:21.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.116+0000 7fa8b171f740 1 Processor -- start 2024-09-21T06:36:21.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.116+0000 7fa8b171f740 1 -- start start 2024-09-21T06:36:21.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.116+0000 7fa8b171f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644722aa1b0 0x56447267b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:21.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.116+0000 7fa8b171f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644722b2390 0x564472691be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:21.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.116+0000 7fa8b171f740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5644722d3070 0x564472682b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:21.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.116+0000 7fa8b171f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa8a41b3f50 con 0x5644722aa1b0 2024-09-21T06:36:21.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.116+0000 7fa8b171f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa8a41b1820 con 0x5644722b2390 2024-09-21T06:36:21.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.116+0000 7fa8b171f740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa8a41af650 con 0x5644722d3070 2024-09-21T06:36:21.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.117+0000 7fa8a8f47640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644722aa1b0 0x56447267b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:21.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.117+0000 7fa8a8f47640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644722aa1b0 0x56447267b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43954/0 (socket says 172.21.15.7:43954) 2024-09-21T06:36:21.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.117+0000 7fa8a8f47640 1 -- 172.21.15.7:0/3444771443 learned_addr learned my addr 172.21.15.7:0/3444771443 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:36:21.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.117+0000 7fa8a3fff640 1 --2- 172.21.15.7:0/3444771443 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644722b2390 0x564472691be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:21.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.117+0000 7fa8a9748640 1 --2- 172.21.15.7:0/3444771443 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5644722d3070 0x564472682b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:21.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:36:20 smithi018 ceph-mon[34477]: from='client.15432 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:36:21.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:36:20 smithi018 ceph-mon[34477]: pgmap v323: 97 pgs: 97 active+clean; 649 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.1 KiB/s wr, 8 op/s 2024-09-21T06:36:21.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:36:20 smithi018 ceph-mon[34477]: scrub queued for path: / 2024-09-21T06:36:21.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:36:20 smithi018 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-21T06:36:21.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:36:20 smithi018 ceph-mon[34477]: scrub summary: active paths [/] 2024-09-21T06:36:21.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:36:20 smithi018 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-21T06:36:21.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:36:20 smithi018 ceph-mon[34477]: from='client.15444 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:36:21.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:36:20 smithi018 ceph-mon[34477]: mgrmap e24: x(active, since 8m), standbys: z, y 2024-09-21T06:36:21.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.117+0000 7fa8a8f47640 1 -- 172.21.15.7:0/3444771443 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5644722d3070 msgr2=0x564472682b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:21.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.117+0000 7fa8a8f47640 1 --2- 172.21.15.7:0/3444771443 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5644722d3070 0x564472682b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:21.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.117+0000 7fa8a8f47640 1 -- 172.21.15.7:0/3444771443 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644722b2390 msgr2=0x564472691be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:21.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.117+0000 7fa8a8f47640 1 --2- 172.21.15.7:0/3444771443 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644722b2390 0x564472691be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:21.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.117+0000 7fa8a8f47640 1 -- 172.21.15.7:0/3444771443 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564472687f50 con 0x5644722aa1b0 2024-09-21T06:36:21.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.117+0000 7fa8a8f47640 1 --2- 172.21.15.7:0/3444771443 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644722aa1b0 0x56447267b9b0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fa89c009a70 tx=0x7fa89c004850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88405dc5d29982e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:21.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.118+0000 7fa88a7fc640 1 -- 172.21.15.7:0/3444771443 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa89c0a94b0 con 0x5644722aa1b0 2024-09-21T06:36:21.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.118+0000 7fa88a7fc640 1 -- 172.21.15.7:0/3444771443 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa89c0ad120 con 0x5644722aa1b0 2024-09-21T06:36:21.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.118+0000 7fa88a7fc640 1 -- 172.21.15.7:0/3444771443 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa89c0acf60 con 0x5644722aa1b0 2024-09-21T06:36:21.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.118+0000 7fa8b171f740 1 -- 172.21.15.7:0/3444771443 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644722aa1b0 msgr2=0x56447267b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:21.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.118+0000 7fa8b171f740 1 --2- 172.21.15.7:0/3444771443 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644722aa1b0 0x56447267b9b0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fa89c009a70 tx=0x7fa89c004850 comp rx=0 tx=0).stop 2024-09-21T06:36:21.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.118+0000 7fa8b171f740 1 -- 172.21.15.7:0/3444771443 shutdown_connections 2024-09-21T06:36:21.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.118+0000 7fa8b171f740 1 --2- 172.21.15.7:0/3444771443 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5644722d3070 0x564472682b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:21.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.118+0000 7fa8b171f740 1 --2- 172.21.15.7:0/3444771443 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644722b2390 0x564472691be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:21.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.118+0000 7fa8b171f740 1 --2- 172.21.15.7:0/3444771443 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644722aa1b0 0x56447267b9b0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:21.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.118+0000 7fa8b171f740 1 -- 172.21.15.7:0/3444771443 >> 172.21.15.7:0/3444771443 conn(0x5644722c7460 msgr2=0x56447267b2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:21.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.119+0000 7fa8b171f740 1 -- 172.21.15.7:0/3444771443 shutdown_connections 2024-09-21T06:36:21.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.119+0000 7fa8b171f740 1 -- 172.21.15.7:0/3444771443 wait complete. 2024-09-21T06:36:21.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.119+0000 7fa8b171f740 1 -- start start 2024-09-21T06:36:21.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.119+0000 7fa8b171f740 1 Processor -- start 2024-09-21T06:36:21.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.120+0000 7fa8b171f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644722aa1b0 0x564472689c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:21.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.120+0000 7fa8b171f740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5644722b2390 0x56447268a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:21.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.120+0000 7fa8b171f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644722d3070 0x56447268a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:21.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.120+0000 7fa8b171f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa8a41afce0 con 0x5644722d3070 2024-09-21T06:36:21.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.120+0000 7fa8b171f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa8a41b1150 con 0x5644722aa1b0 2024-09-21T06:36:21.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.120+0000 7fa8b171f740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa8a41b03b0 con 0x5644722b2390 2024-09-21T06:36:21.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.120+0000 7fa8a9748640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644722d3070 0x56447268a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:21.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.120+0000 7fa8a8f47640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644722aa1b0 0x564472689c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:21.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.120+0000 7fa8a8f47640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644722aa1b0 0x564472689c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.7:39708/0 (socket says 172.21.15.7:39708) 2024-09-21T06:36:21.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.120+0000 7fa8a8f47640 1 -- 172.21.15.7:0/3887449854 learned_addr learned my addr 172.21.15.7:0/3887449854 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:36:21.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.120+0000 7fa8a3fff640 1 --2- 172.21.15.7:0/3887449854 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5644722b2390 0x56447268a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:21.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.120+0000 7fa8b171f740 10 client.0 _ll_register_callbacks cb 0x7fa89c0099c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:36:21.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.120+0000 7fa8a8f47640 1 -- 172.21.15.7:0/3887449854 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5644722b2390 msgr2=0x56447268a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:21.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.120+0000 7fa8a8f47640 1 --2- 172.21.15.7:0/3887449854 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5644722b2390 0x56447268a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:21.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.120+0000 7fa8a8f47640 1 -- 172.21.15.7:0/3887449854 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644722d3070 msgr2=0x56447268a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:21.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.120+0000 7fa8a8f47640 1 --2- 172.21.15.7:0/3887449854 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644722d3070 0x56447268a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:21.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.120+0000 7fa8a8f47640 1 -- 172.21.15.7:0/3887449854 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564472709f30 con 0x5644722aa1b0 2024-09-21T06:36:21.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.120+0000 7fa8a9748640 1 --2- 172.21.15.7:0/3887449854 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644722d3070 0x56447268a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:36:21.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.121+0000 7fa8a8f47640 1 --2- 172.21.15.7:0/3887449854 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644722aa1b0 0x564472689c00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa89c004920 tx=0x7fa89c003f30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4eb1cf70bc8ddf56 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:21.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.121+0000 7fa883fff640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-21T06:36:21.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.121+0000 7fa883fff640 1 -- 172.21.15.7:0/3887449854 <== mon.2 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa89c0c7020 con 0x5644722aa1b0 2024-09-21T06:36:21.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.121+0000 7fa883fff640 1 -- 172.21.15.7:0/3887449854 <== mon.2 v2:172.21.15.18:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fa89c0a9200 con 0x5644722aa1b0 2024-09-21T06:36:21.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.121+0000 7fa8b171f740 1 -- 172.21.15.7:0/3887449854 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa89c0ad120 con 0x5644722aa1b0 2024-09-21T06:36:21.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.121+0000 7fa883fff640 1 -- 172.21.15.7:0/3887449854 <== mon.2 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa89c076050 con 0x5644722aa1b0 2024-09-21T06:36:21.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.121+0000 7fa8b171f740 10 client.25292 fetch_fsmap learned FSMap version 25 2024-09-21T06:36:21.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.121+0000 7fa8b171f740 1 -- 172.21.15.7:0/3887449854 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564472709f30 con 0x5644722aa1b0 2024-09-21T06:36:21.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.121+0000 7fa883fff640 1 -- 172.21.15.7:0/3887449854 <== mon.2 v2:172.21.15.18:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa89c0ad120 con 0x5644722aa1b0 2024-09-21T06:36:21.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.121+0000 7fa883fff640 1 -- 172.21.15.7:0/3887449854 <== mon.2 v2:172.21.15.18:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa89c0ac4e0 con 0x5644722aa1b0 2024-09-21T06:36:21.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.121+0000 7fa8b171f740 10 client.25292 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:36:21.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.121+0000 7fa8b171f740 10 client.25292 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:36:21.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.122+0000 7fa8b171f740 20 client.25292 populate_metadata read hostname 'smithi007' 2024-09-21T06:36:21.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.122+0000 7fa8b171f740 1 --2- 172.21.15.7:0/3887449854 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x564472266da0 0x56447270d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:21.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.122+0000 7fa8b171f740 4 client.25292 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:36:21.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.122+0000 7fa8b171f740 1 -- 172.21.15.7:0/3887449854 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5644725ee850 con 0x564472266da0 2024-09-21T06:36:21.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.122+0000 7fa8a3fff640 1 --2- 172.21.15.7:0/3887449854 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x564472266da0 0x56447270d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:21.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.122+0000 7fa883fff640 10 client.25292 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:36:21.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.122+0000 7fa8a3fff640 1 --2- 172.21.15.7:0/3887449854 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x564472266da0 0x56447270d480 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f1e84131c6a96e6 server_cookie=7de513aa1d49b82b in_seq=0 out_seq=0 2024-09-21T06:36:21.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.122+0000 7fa883fff640 1 -- 172.21.15.7:0/3887449854 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+570 (crc 0 0 0) 0x5644725ee850 con 0x564472266da0 2024-09-21T06:36:21.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.122+0000 7fa883fff640 10 client.25292 handle_command_reply: tid=0 2024-09-21T06:36:21.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.122+0000 7fa8b171f740 1 client.25292 shutdown 2024-09-21T06:36:21.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.123+0000 7fa8b171f740 1 -- 172.21.15.7:0/3887449854 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644722aa1b0 msgr2=0x564472689c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:21.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.123+0000 7fa8b171f740 1 --2- 172.21.15.7:0/3887449854 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644722aa1b0 0x564472689c00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa89c004920 tx=0x7fa89c003f30 comp rx=0 tx=0).stop 2024-09-21T06:36:21.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.123+0000 7fa8b171f740 1 -- 172.21.15.7:0/3887449854 shutdown_connections 2024-09-21T06:36:21.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.123+0000 7fa8b171f740 1 --2- 172.21.15.7:0/3887449854 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x564472266da0 0x56447270d480 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:21.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.123+0000 7fa8b171f740 1 --2- 172.21.15.7:0/3887449854 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644722d3070 0x56447268a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:21.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.123+0000 7fa883fff640 0 client.25292 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:36:21.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.123+0000 7fa8b171f740 1 --2- 172.21.15.7:0/3887449854 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5644722b2390 0x56447268a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:21.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.123+0000 7fa8b171f740 1 --2- 172.21.15.7:0/3887449854 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644722aa1b0 0x564472689c00 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:21.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.123+0000 7fa8b171f740 1 -- 172.21.15.7:0/3887449854 >> 172.21.15.7:0/3887449854 conn(0x5644722c7460 msgr2=0x56447267b250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:21.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.123+0000 7fa8b171f740 1 -- 172.21.15.7:0/3887449854 shutdown_connections 2024-09-21T06:36:21.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.123+0000 7fa8b171f740 1 -- 172.21.15.7:0/3887449854 wait complete. 2024-09-21T06:36:21.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.123+0000 7fa8b171f740 20 client.25292 trim_cache size 0 max 16384 2024-09-21T06:36:21.130 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:36:21.130 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T06:36:21.130 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": { 2024-09-21T06:36:21.130 INFO:teuthology.orchestra.run.smithi007.stdout: "0b89345c-1f00-4efe-8ee9-4cb17e43584c": { 2024-09-21T06:36:21.130 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:36:21.130 INFO:teuthology.orchestra.run.smithi007.stdout: "tag": "0b89345c-1f00-4efe-8ee9-4cb17e43584c", 2024-09-21T06:36:21.130 INFO:teuthology.orchestra.run.smithi007.stdout: "options": "recursive,force" 2024-09-21T06:36:21.130 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:36:21.130 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:36:21.131 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_stats": { 2024-09-21T06:36:21.131 INFO:teuthology.orchestra.run.smithi007.stdout: "0b89345c-1f00-4efe-8ee9-4cb17e43584c": { 2024-09-21T06:36:21.131 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:36:19.500334+0000", 2024-09-21T06:36:21.131 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:36:21.131 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:36:21.131 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:36:21.131 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:36:21.131 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:36:21.131 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:36:21.131 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:36:21.131 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:36:21.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.124+0000 7fa8ab1ab640 1 -- 172.21.15.7:0/549124815 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa88c0b6670 msgr2=0x7fa88c0b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:21.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.124+0000 7fa8ab1ab640 1 --2- 172.21.15.7:0/549124815 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa88c0b6670 0x7fa88c0b8b80 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa894005fd0 tx=0x7fa8940046c0 comp rx=0 tx=0).stop 2024-09-21T06:36:21.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.124+0000 7fa8ab1ab640 1 -- 172.21.15.7:0/549124815 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa8a4103bc0 msgr2=0x7fa8a419c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:21.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.124+0000 7fa8ab1ab640 1 --2- 172.21.15.7:0/549124815 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa8a4103bc0 0x7fa8a419c6b0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fa89c00db80 tx=0x7fa89c00b630 comp rx=0 tx=0).stop 2024-09-21T06:36:21.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.124+0000 7fa8ab1ab640 1 -- 172.21.15.7:0/549124815 shutdown_connections 2024-09-21T06:36:21.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.124+0000 7fa8ab1ab640 1 --2- 172.21.15.7:0/549124815 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa88c0b6670 0x7fa88c0b8b80 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:21.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.124+0000 7fa8ab1ab640 1 --2- 172.21.15.7:0/549124815 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa8a4109e00 0x7fa8a41a1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:21.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.124+0000 7fa8ab1ab640 1 --2- 172.21.15.7:0/549124815 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa8a41094b0 0x7fa8a419cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:21.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.124+0000 7fa8ab1ab640 1 --2- 172.21.15.7:0/549124815 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa8a4103bc0 0x7fa8a419c6b0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:21.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.124+0000 7fa8ab1ab640 1 -- 172.21.15.7:0/549124815 >> 172.21.15.7:0/549124815 conn(0x7fa8a407b910 msgr2=0x7fa8a41073c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:21.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.124+0000 7fa8ab1ab640 1 -- 172.21.15.7:0/549124815 shutdown_connections 2024-09-21T06:36:21.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:21.124+0000 7fa8ab1ab640 1 -- 172.21.15.7:0/549124815 wait complete. 2024-09-21T06:36:21.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:36:20 smithi144 ceph-mon[34653]: from='client.15432 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:36:21.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:36:20 smithi144 ceph-mon[34653]: pgmap v323: 97 pgs: 97 active+clean; 649 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.1 KiB/s wr, 8 op/s 2024-09-21T06:36:21.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:36:20 smithi144 ceph-mon[34653]: scrub queued for path: / 2024-09-21T06:36:21.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:36:20 smithi144 ceph-mon[34653]: scrub summary: idle+waiting paths [/] 2024-09-21T06:36:21.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:36:20 smithi144 ceph-mon[34653]: scrub summary: active paths [/] 2024-09-21T06:36:21.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:36:20 smithi144 ceph-mon[34653]: scrub summary: idle+waiting paths [/] 2024-09-21T06:36:21.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:36:20 smithi144 ceph-mon[34653]: from='client.15444 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:36:21.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:36:20 smithi144 ceph-mon[34653]: mgrmap e24: x(active, since 8m), standbys: z, y 2024-09-21T06:36:21.921 INFO:tasks.cephfs.filesystem:scrub status for tag:0b89345c-1f00-4efe-8ee9-4cb17e43584c - {'path': '/', 'tag': '0b89345c-1f00-4efe-8ee9-4cb17e43584c', 'options': 'recursive,force'} 2024-09-21T06:36:22.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:36:21 smithi007 ceph-mon[30983]: from='client.15468 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:36:22.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:36:21 smithi007 ceph-mon[30983]: from='client.15474 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:36:22.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:36:21 smithi018 ceph-mon[34477]: from='client.15468 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:36:22.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:36:21 smithi018 ceph-mon[34477]: from='client.15474 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:36:22.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:36:21 smithi144 ceph-mon[34653]: from='client.15468 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:36:22.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:36:21 smithi144 ceph-mon[34653]: from='client.15474 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:36:23.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:36:22 smithi007 ceph-mon[30983]: pgmap v324: 97 pgs: 97 active+clean; 649 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-09-21T06:36:23.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:36:22 smithi018 ceph-mon[34477]: pgmap v324: 97 pgs: 97 active+clean; 649 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-09-21T06:36:23.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:36:22 smithi144 ceph-mon[34653]: pgmap v324: 97 pgs: 97 active+clean; 649 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-09-21T06:36:25.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:36:24 smithi007 ceph-mon[30983]: pgmap v325: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 176 KiB/s wr, 55 op/s 2024-09-21T06:36:25.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:36:24 smithi018 ceph-mon[34477]: pgmap v325: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 176 KiB/s wr, 55 op/s 2024-09-21T06:36:25.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:36:24 smithi144 ceph-mon[34653]: pgmap v325: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 176 KiB/s wr, 55 op/s 2024-09-21T06:36:27.087 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:36:26 smithi144 ceph-mon[34653]: pgmap v326: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 176 KiB/s wr, 53 op/s 2024-09-21T06:36:27.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:36:26 smithi007 ceph-mon[30983]: pgmap v326: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 176 KiB/s wr, 53 op/s 2024-09-21T06:36:27.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:36:26 smithi018 ceph-mon[34477]: pgmap v326: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 176 KiB/s wr, 53 op/s 2024-09-21T06:36:29.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:36:28 smithi007 ceph-mon[30983]: pgmap v327: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 176 KiB/s wr, 53 op/s 2024-09-21T06:36:29.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:36:28 smithi018 ceph-mon[34477]: pgmap v327: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 176 KiB/s wr, 53 op/s 2024-09-21T06:36:29.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:36:28 smithi144 ceph-mon[34653]: pgmap v327: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 176 KiB/s wr, 53 op/s 2024-09-21T06:36:31.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:36:30 smithi007 ceph-mon[30983]: pgmap v328: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 176 KiB/s wr, 55 op/s 2024-09-21T06:36:31.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:36:30 smithi018 ceph-mon[34477]: pgmap v328: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 176 KiB/s wr, 55 op/s 2024-09-21T06:36:31.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:36:30 smithi144 ceph-mon[34653]: pgmap v328: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 176 KiB/s wr, 55 op/s 2024-09-21T06:36:32.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:36:31 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:36:32.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:36:31 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:36:32.218 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:36:31 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:36:33.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:36:32 smithi007 ceph-mon[30983]: pgmap v329: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 52 op/s 2024-09-21T06:36:33.118 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:36:32 smithi018 ceph-mon[34477]: pgmap v329: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 52 op/s 2024-09-21T06:36:33.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:36:32 smithi144 ceph-mon[34653]: pgmap v329: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 52 op/s 2024-09-21T06:36:33.635 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.632+0000 7f7851c3f640 1 -- 172.21.15.7:0/625939314 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f784c105260 msgr2=0x7f784c10d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:33.635 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.632+0000 7f7851c3f640 1 --2- 172.21.15.7:0/625939314 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f784c105260 0x7f784c10d7a0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f7834009900 tx=0x7f783402a410 comp rx=0 tx=0).stop 2024-09-21T06:36:33.635 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.632+0000 7f7851c3f640 1 -- 172.21.15.7:0/625939314 shutdown_connections 2024-09-21T06:36:33.635 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.632+0000 7f7851c3f640 1 --2- 172.21.15.7:0/625939314 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f784c10dd70 0x7f784c110260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:33.635 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.632+0000 7f7851c3f640 1 --2- 172.21.15.7:0/625939314 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f784c105260 0x7f784c10d7a0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:33.635 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.632+0000 7f7851c3f640 1 --2- 172.21.15.7:0/625939314 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f784c104910 0x7f784c104d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:33.635 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.632+0000 7f7851c3f640 1 -- 172.21.15.7:0/625939314 >> 172.21.15.7:0/625939314 conn(0x7f784c0fe3c0 msgr2=0x7f784c100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:33.635 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.633+0000 7f7851c3f640 1 -- 172.21.15.7:0/625939314 shutdown_connections 2024-09-21T06:36:33.635 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.633+0000 7f7851c3f640 1 -- 172.21.15.7:0/625939314 wait complete. 2024-09-21T06:36:33.636 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.633+0000 7f7851c3f640 1 Processor -- start 2024-09-21T06:36:33.636 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.633+0000 7f7851c3f640 1 -- start start 2024-09-21T06:36:33.637 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.634+0000 7f7851c3f640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f784c104910 0x7f784c19a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:33.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.634+0000 7f7851c3f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f784c105260 0x7f784c19a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:33.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.634+0000 7f7851c3f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f784c10dd70 0x7f784c19fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:33.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.634+0000 7f7851c3f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f784c113990 con 0x7f784c10dd70 2024-09-21T06:36:33.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.634+0000 7f7851c3f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f784c113810 con 0x7f784c105260 2024-09-21T06:36:33.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.634+0000 7f7851c3f640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f784c113b10 con 0x7f784c104910 2024-09-21T06:36:33.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.634+0000 7f784bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f784c10dd70 0x7f784c19fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:33.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.634+0000 7f784b7fe640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f784c104910 0x7f784c19a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:33.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.634+0000 7f784bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f784c10dd70 0x7f784c19fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47448/0 (socket says 172.21.15.7:47448) 2024-09-21T06:36:33.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.634+0000 7f784bfff640 1 -- 172.21.15.7:0/968587205 learned_addr learned my addr 172.21.15.7:0/968587205 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:36:33.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.634+0000 7f784affd640 1 --2- 172.21.15.7:0/968587205 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f784c105260 0x7f784c19a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:33.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.634+0000 7f784b7fe640 1 -- 172.21.15.7:0/968587205 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f784c105260 msgr2=0x7f784c19a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:33.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.634+0000 7f784b7fe640 1 --2- 172.21.15.7:0/968587205 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f784c105260 0x7f784c19a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:33.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.634+0000 7f784b7fe640 1 -- 172.21.15.7:0/968587205 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f784c10dd70 msgr2=0x7f784c19fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:33.638 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.634+0000 7f784b7fe640 1 --2- 172.21.15.7:0/968587205 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f784c10dd70 0x7f784c19fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:33.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.634+0000 7f784b7fe640 1 -- 172.21.15.7:0/968587205 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f784c1a0360 con 0x7f784c104910 2024-09-21T06:36:33.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.634+0000 7f784bfff640 1 --2- 172.21.15.7:0/968587205 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f784c10dd70 0x7f784c19fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:36:33.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.634+0000 7f784b7fe640 1 --2- 172.21.15.7:0/968587205 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f784c104910 0x7f784c19a430 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f783c00eb00 tx=0x7f783c00c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:33.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.635+0000 7f7848ff9640 1 -- 172.21.15.7:0/968587205 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f783c010430 con 0x7f784c104910 2024-09-21T06:36:33.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.635+0000 7f7851c3f640 1 -- 172.21.15.7:0/968587205 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f784c1a0650 con 0x7f784c104910 2024-09-21T06:36:33.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.635+0000 7f7848ff9640 1 -- 172.21.15.7:0/968587205 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f783c010a80 con 0x7f784c104910 2024-09-21T06:36:33.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.635+0000 7f7848ff9640 1 -- 172.21.15.7:0/968587205 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f783c003bf0 con 0x7f784c104910 2024-09-21T06:36:33.639 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.635+0000 7f7851c3f640 1 -- 172.21.15.7:0/968587205 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f784c1a6de0 con 0x7f784c104910 2024-09-21T06:36:33.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.637+0000 7f7848ff9640 1 -- 172.21.15.7:0/968587205 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 24) ==== 154585+0+0 (secure 0 0 0) 0x7f783c0105d0 con 0x7f784c104910 2024-09-21T06:36:33.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.638+0000 7f7858c8d740 1 Processor -- start 2024-09-21T06:36:33.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.638+0000 7f7858c8d740 1 -- start start 2024-09-21T06:36:33.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.638+0000 7f7858c8d740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562c9ce5c1b0 0x562c9d2019b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:33.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.638+0000 7f7858c8d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562c9ce332f0 0x562c9d201ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:33.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.638+0000 7f7858c8d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c9ce3b4d0 0x562c9d202430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:33.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.638+0000 7f7858c8d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x562c9d1766f0 con 0x562c9ce3b4d0 2024-09-21T06:36:33.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.638+0000 7f7858c8d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x562c9d165b20 con 0x562c9ce332f0 2024-09-21T06:36:33.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.638+0000 7f7858c8d740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x562c9d169930 con 0x562c9ce5c1b0 2024-09-21T06:36:33.642 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.638+0000 7f784affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c9ce3b4d0 0x562c9d202430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:33.643 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.638+0000 7f784affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c9ce3b4d0 0x562c9d202430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47450/0 (socket says 172.21.15.7:47450) 2024-09-21T06:36:33.643 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.638+0000 7f784affd640 1 -- 172.21.15.7:0/2052912933 learned_addr learned my addr 172.21.15.7:0/2052912933 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:36:33.643 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.638+0000 7f784bfff640 1 --2- 172.21.15.7:0/2052912933 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562c9ce5c1b0 0x562c9d2019b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:33.643 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.638+0000 7f784b7fe640 1 --2- 172.21.15.7:0/2052912933 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562c9ce332f0 0x562c9d201ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:33.643 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.638+0000 7f784affd640 1 -- 172.21.15.7:0/2052912933 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562c9ce5c1b0 msgr2=0x562c9d2019b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:33.643 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.638+0000 7f784affd640 1 --2- 172.21.15.7:0/2052912933 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562c9ce5c1b0 0x562c9d2019b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:33.643 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.638+0000 7f784affd640 1 -- 172.21.15.7:0/2052912933 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562c9ce332f0 msgr2=0x562c9d201ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:33.643 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.638+0000 7f784affd640 1 --2- 172.21.15.7:0/2052912933 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562c9ce332f0 0x562c9d201ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:33.643 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.638+0000 7f784affd640 1 -- 172.21.15.7:0/2052912933 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c9d12b530 con 0x562c9ce3b4d0 2024-09-21T06:36:33.643 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.639+0000 7f7848ff9640 1 --2- 172.21.15.7:0/968587205 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f78380b65f0 0x7f78380b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:33.643 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.639+0000 7f784affd640 1 --2- 172.21.15.7:0/2052912933 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c9ce3b4d0 0x562c9d202430 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f7834009900 tx=0x7f7834000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=472bca2a7b1d7f63 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:33.643 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.639+0000 7f784bfff640 1 --2- 172.21.15.7:0/968587205 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f78380b65f0 0x7f78380b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:33.643 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.639+0000 7f7848ff9640 1 -- 172.21.15.7:0/968587205 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f783c0e7f30 con 0x7f784c104910 2024-09-21T06:36:33.643 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.639+0000 7f7841ffb640 1 -- 172.21.15.7:0/2052912933 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7834040070 con 0x562c9ce3b4d0 2024-09-21T06:36:33.643 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.639+0000 7f7841ffb640 1 -- 172.21.15.7:0/2052912933 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7834004030 con 0x562c9ce3b4d0 2024-09-21T06:36:33.644 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.639+0000 7f7841ffb640 1 -- 172.21.15.7:0/2052912933 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7834035040 con 0x562c9ce3b4d0 2024-09-21T06:36:33.644 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.640+0000 7f7858c8d740 1 -- 172.21.15.7:0/2052912933 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c9ce3b4d0 msgr2=0x562c9d202430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:33.644 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.640+0000 7f7858c8d740 1 --2- 172.21.15.7:0/2052912933 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c9ce3b4d0 0x562c9d202430 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f7834009900 tx=0x7f7834000bc0 comp rx=0 tx=0).stop 2024-09-21T06:36:33.644 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.640+0000 7f784bfff640 1 --2- 172.21.15.7:0/968587205 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f78380b65f0 0x7f78380b8b00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7844005fd0 tx=0x7f784400b420 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:33.644 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.640+0000 7f7858c8d740 1 -- 172.21.15.7:0/2052912933 shutdown_connections 2024-09-21T06:36:33.644 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.640+0000 7f7858c8d740 1 --2- 172.21.15.7:0/2052912933 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c9ce3b4d0 0x562c9d202430 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:33.644 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.640+0000 7f7858c8d740 1 --2- 172.21.15.7:0/2052912933 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562c9ce332f0 0x562c9d201ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:33.644 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.640+0000 7f7858c8d740 1 --2- 172.21.15.7:0/2052912933 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562c9ce5c1b0 0x562c9d2019b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:33.644 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.640+0000 7f7858c8d740 1 -- 172.21.15.7:0/2052912933 >> 172.21.15.7:0/2052912933 conn(0x562c9ce50300 msgr2=0x562c9d1ff8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:33.644 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.640+0000 7f7858c8d740 1 -- 172.21.15.7:0/2052912933 shutdown_connections 2024-09-21T06:36:33.644 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.640+0000 7f7858c8d740 1 -- 172.21.15.7:0/2052912933 wait complete. 2024-09-21T06:36:33.644 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.640+0000 7f7858c8d740 1 -- start start 2024-09-21T06:36:33.644 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.640+0000 7f7858c8d740 1 Processor -- start 2024-09-21T06:36:33.648 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.641+0000 7f7858c8d740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562c9ce332f0 0x562c9d2114c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:33.648 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.641+0000 7f7858c8d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c9ce3b4d0 0x562c9d211a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:33.648 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.641+0000 7f7858c8d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562c9ce5c1b0 0x562c9d21d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:33.648 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.641+0000 7f7858c8d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x562c9d09dab0 con 0x562c9ce3b4d0 2024-09-21T06:36:33.648 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.641+0000 7f7858c8d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x562c9d10b730 con 0x562c9ce5c1b0 2024-09-21T06:36:33.648 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.641+0000 7f7858c8d740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x562c9d2144b0 con 0x562c9ce332f0 2024-09-21T06:36:33.648 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.641+0000 7f7858c8d740 10 client.0 _ll_register_callbacks cb 0x562c9d15f6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:36:33.648 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.641+0000 7f784affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c9ce3b4d0 0x562c9d211a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:33.648 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.641+0000 7f784affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c9ce3b4d0 0x562c9d211a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47452/0 (socket says 172.21.15.7:47452) 2024-09-21T06:36:33.649 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.641+0000 7f784affd640 1 -- 172.21.15.7:0/3959392550 learned_addr learned my addr 172.21.15.7:0/3959392550 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:36:33.649 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.641+0000 7f784b7fe640 1 --2- 172.21.15.7:0/3959392550 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562c9ce332f0 0x562c9d2114c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:33.649 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.641+0000 7f784bfff640 1 --2- 172.21.15.7:0/3959392550 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562c9ce5c1b0 0x562c9d21d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:33.649 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.641+0000 7f784b7fe640 1 -- 172.21.15.7:0/3959392550 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562c9ce5c1b0 msgr2=0x562c9d21d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:33.649 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.641+0000 7f784b7fe640 1 --2- 172.21.15.7:0/3959392550 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562c9ce5c1b0 0x562c9d21d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:33.649 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.641+0000 7f784b7fe640 1 -- 172.21.15.7:0/3959392550 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c9ce3b4d0 msgr2=0x562c9d211a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:33.649 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.641+0000 7f784b7fe640 1 --2- 172.21.15.7:0/3959392550 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c9ce3b4d0 0x562c9d211a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:33.649 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.641+0000 7f784b7fe640 1 -- 172.21.15.7:0/3959392550 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c9cec7790 con 0x562c9ce332f0 2024-09-21T06:36:33.649 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.641+0000 7f784affd640 1 --2- 172.21.15.7:0/3959392550 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c9ce3b4d0 0x562c9d211a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:36:33.649 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.641+0000 7f784b7fe640 1 --2- 172.21.15.7:0/3959392550 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562c9ce332f0 0x562c9d2114c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f783c0e5860 tx=0x7f783c0a9d80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5554013da6ec3266 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:33.649 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.641+0000 7f782affd640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-21T06:36:33.649 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.642+0000 7f782affd640 1 -- 172.21.15.7:0/3959392550 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f783c0ad650 con 0x562c9ce332f0 2024-09-21T06:36:33.649 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.642+0000 7f782affd640 1 -- 172.21.15.7:0/3959392550 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f783c0950b0 con 0x562c9ce332f0 2024-09-21T06:36:33.649 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.642+0000 7f7858c8d740 1 -- 172.21.15.7:0/3959392550 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7834004030 con 0x562c9ce332f0 2024-09-21T06:36:33.649 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.642+0000 7f782affd640 1 -- 172.21.15.7:0/3959392550 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f783c0108c0 con 0x562c9ce332f0 2024-09-21T06:36:33.650 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.642+0000 7f7858c8d740 10 client.25168 fetch_fsmap learned FSMap version 25 2024-09-21T06:36:33.650 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.642+0000 7f7858c8d740 1 -- 172.21.15.7:0/3959392550 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562c9cf40620 con 0x562c9ce332f0 2024-09-21T06:36:33.650 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.642+0000 7f782affd640 1 -- 172.21.15.7:0/3959392550 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7834004030 con 0x562c9ce332f0 2024-09-21T06:36:33.650 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.642+0000 7f782affd640 1 -- 172.21.15.7:0/3959392550 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f783c0b2080 con 0x562c9ce332f0 2024-09-21T06:36:33.650 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.642+0000 7f7858c8d740 10 client.25168 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:36:33.650 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.642+0000 7f7858c8d740 10 client.25168 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:36:33.650 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.642+0000 7f7858c8d740 20 client.25168 populate_metadata read hostname 'smithi007' 2024-09-21T06:36:33.650 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.642+0000 7f7858c8d740 1 --2- 172.21.15.7:0/3959392550 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x562c9ce1ad80 0x562c9d2235b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:33.650 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.642+0000 7f7858c8d740 4 client.25168 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:36:33.650 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.642+0000 7f7858c8d740 1 -- 172.21.15.7:0/3959392550 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562c9d178640 con 0x562c9ce1ad80 2024-09-21T06:36:33.650 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.643+0000 7f784affd640 1 --2- 172.21.15.7:0/3959392550 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x562c9ce1ad80 0x562c9d2235b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:33.650 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.643+0000 7f784affd640 1 --2- 172.21.15.7:0/3959392550 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x562c9ce1ad80 0x562c9d2235b0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64ad6e60599eb743 server_cookie=c07fc44f066681c8 in_seq=0 out_seq=0 2024-09-21T06:36:33.650 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.643+0000 7f782affd640 10 client.25168 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:36:33.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.644+0000 7f782affd640 1 -- 172.21.15.7:0/3959392550 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562c9d178640 con 0x562c9ce1ad80 2024-09-21T06:36:33.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.644+0000 7f782affd640 10 client.25168 handle_command_reply: tid=0 2024-09-21T06:36:33.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.644+0000 7f7858c8d740 1 client.25168 shutdown 2024-09-21T06:36:33.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.644+0000 7f7858c8d740 1 -- 172.21.15.7:0/3959392550 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562c9ce332f0 msgr2=0x562c9d2114c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:33.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.644+0000 7f7858c8d740 1 --2- 172.21.15.7:0/3959392550 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562c9ce332f0 0x562c9d2114c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f783c0e5860 tx=0x7f783c0a9d80 comp rx=0 tx=0).stop 2024-09-21T06:36:33.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.644+0000 7f7858c8d740 1 -- 172.21.15.7:0/3959392550 shutdown_connections 2024-09-21T06:36:33.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.644+0000 7f7858c8d740 1 --2- 172.21.15.7:0/3959392550 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x562c9ce1ad80 0x562c9d2235b0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:33.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.644+0000 7f7858c8d740 1 --2- 172.21.15.7:0/3959392550 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562c9ce5c1b0 0x562c9d21d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:33.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.644+0000 7f782affd640 0 client.25168 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:36:33.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.644+0000 7f7858c8d740 1 --2- 172.21.15.7:0/3959392550 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c9ce3b4d0 0x562c9d211a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:33.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.644+0000 7f7858c8d740 1 --2- 172.21.15.7:0/3959392550 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562c9ce332f0 0x562c9d2114c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:33.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.644+0000 7f7858c8d740 1 -- 172.21.15.7:0/3959392550 >> 172.21.15.7:0/3959392550 conn(0x562c9ce50300 msgr2=0x562c9d2033a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:33.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.644+0000 7f7858c8d740 1 -- 172.21.15.7:0/3959392550 shutdown_connections 2024-09-21T06:36:33.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.644+0000 7f7858c8d740 1 -- 172.21.15.7:0/3959392550 wait complete. 2024-09-21T06:36:33.651 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.644+0000 7f7858c8d740 20 client.25168 trim_cache size 0 max 16384 2024-09-21T06:36:33.662 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.659+0000 7f7858c8d740 1 Processor -- start 2024-09-21T06:36:33.662 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.659+0000 7f7858c8d740 1 -- start start 2024-09-21T06:36:33.662 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.659+0000 7f7858c8d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562c9ce332f0 0x562c9d2119a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:33.662 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.659+0000 7f7858c8d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c9ce3b4d0 0x562c9d21d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:33.662 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.659+0000 7f7858c8d740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562c9ce5c1b0 0x562c9d20e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:33.662 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.659+0000 7f7858c8d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f784c1afac0 con 0x562c9ce3b4d0 2024-09-21T06:36:33.662 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.659+0000 7f7858c8d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f784c1ad390 con 0x562c9ce332f0 2024-09-21T06:36:33.662 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.659+0000 7f7858c8d740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f784c1ab200 con 0x562c9ce5c1b0 2024-09-21T06:36:33.662 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.659+0000 7f784affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c9ce3b4d0 0x562c9d21d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:33.662 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.659+0000 7f784affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c9ce3b4d0 0x562c9d21d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47454/0 (socket says 172.21.15.7:47454) 2024-09-21T06:36:33.662 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.659+0000 7f784affd640 1 -- 172.21.15.7:0/2421729481 learned_addr learned my addr 172.21.15.7:0/2421729481 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:36:33.663 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.659+0000 7f784b7fe640 1 --2- 172.21.15.7:0/2421729481 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562c9ce332f0 0x562c9d2119a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:33.663 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.659+0000 7f784bfff640 1 --2- 172.21.15.7:0/2421729481 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562c9ce5c1b0 0x562c9d20e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:33.663 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.660+0000 7f784affd640 1 -- 172.21.15.7:0/2421729481 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562c9ce5c1b0 msgr2=0x562c9d20e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:33.663 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.660+0000 7f784affd640 1 --2- 172.21.15.7:0/2421729481 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562c9ce5c1b0 0x562c9d20e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:33.663 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.660+0000 7f784affd640 1 -- 172.21.15.7:0/2421729481 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562c9ce332f0 msgr2=0x562c9d2119a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:33.663 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.660+0000 7f784affd640 1 --2- 172.21.15.7:0/2421729481 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562c9ce332f0 0x562c9d2119a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:33.663 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.660+0000 7f784affd640 1 -- 172.21.15.7:0/2421729481 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562c9d2027f0 con 0x562c9ce3b4d0 2024-09-21T06:36:33.663 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.660+0000 7f784b7fe640 1 --2- 172.21.15.7:0/2421729481 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562c9ce332f0 0x562c9d2119a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:36:33.663 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.660+0000 7f784affd640 1 --2- 172.21.15.7:0/2421729481 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c9ce3b4d0 0x562c9d21d6e0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f78340095d0 tx=0x7f783402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89d8724b1b0fc39e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:33.663 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.660+0000 7f78417fa640 1 -- 172.21.15.7:0/2421729481 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7834040040 con 0x562c9ce3b4d0 2024-09-21T06:36:33.663 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.660+0000 7f78417fa640 1 -- 172.21.15.7:0/2421729481 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78340316a0 con 0x562c9ce3b4d0 2024-09-21T06:36:33.663 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.660+0000 7f78417fa640 1 -- 172.21.15.7:0/2421729481 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7834035040 con 0x562c9ce3b4d0 2024-09-21T06:36:33.666 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.661+0000 7f7858c8d740 1 -- 172.21.15.7:0/2421729481 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c9ce3b4d0 msgr2=0x562c9d21d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:33.666 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.661+0000 7f7858c8d740 1 --2- 172.21.15.7:0/2421729481 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c9ce3b4d0 0x562c9d21d6e0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f78340095d0 tx=0x7f783402a410 comp rx=0 tx=0).stop 2024-09-21T06:36:33.666 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.661+0000 7f7858c8d740 1 -- 172.21.15.7:0/2421729481 shutdown_connections 2024-09-21T06:36:33.666 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.661+0000 7f7858c8d740 1 --2- 172.21.15.7:0/2421729481 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562c9ce5c1b0 0x562c9d20e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:33.667 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.661+0000 7f7858c8d740 1 --2- 172.21.15.7:0/2421729481 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c9ce3b4d0 0x562c9d21d6e0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:33.667 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.661+0000 7f7858c8d740 1 --2- 172.21.15.7:0/2421729481 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562c9ce332f0 0x562c9d2119a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:33.667 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.661+0000 7f7858c8d740 1 -- 172.21.15.7:0/2421729481 >> 172.21.15.7:0/2421729481 conn(0x562c9ce50300 msgr2=0x562c9d20fd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:33.667 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.661+0000 7f7858c8d740 1 -- 172.21.15.7:0/2421729481 shutdown_connections 2024-09-21T06:36:33.667 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.661+0000 7f7858c8d740 1 -- 172.21.15.7:0/2421729481 wait complete. 2024-09-21T06:36:33.667 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.661+0000 7f7858c8d740 1 -- start start 2024-09-21T06:36:33.667 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.661+0000 7f7858c8d740 1 Processor -- start 2024-09-21T06:36:33.667 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.662+0000 7f7858c8d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562c9ce332f0 0x562c9d219cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:33.667 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.662+0000 7f7858c8d740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562c9ce3b4d0 0x562c9d215190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:33.667 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.662+0000 7f7858c8d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c9ce5c1b0 0x562c9d2156d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:33.667 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.662+0000 7f7858c8d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f784c1ab850 con 0x562c9ce5c1b0 2024-09-21T06:36:33.667 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.662+0000 7f7858c8d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f784c1accc0 con 0x562c9ce332f0 2024-09-21T06:36:33.667 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.662+0000 7f7858c8d740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f784c1abf20 con 0x562c9ce3b4d0 2024-09-21T06:36:33.667 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.662+0000 7f7858c8d740 10 client.0 _ll_register_callbacks cb 0x7f783c0eb590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:36:33.668 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.662+0000 7f784bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c9ce5c1b0 0x562c9d2156d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:33.668 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.662+0000 7f784bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c9ce5c1b0 0x562c9d2156d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47458/0 (socket says 172.21.15.7:47458) 2024-09-21T06:36:33.668 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.662+0000 7f784bfff640 1 -- 172.21.15.7:0/1488102523 learned_addr learned my addr 172.21.15.7:0/1488102523 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:36:33.668 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.662+0000 7f784affd640 1 --2- 172.21.15.7:0/1488102523 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562c9ce3b4d0 0x562c9d215190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:33.668 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.662+0000 7f784b7fe640 1 --2- 172.21.15.7:0/1488102523 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562c9ce332f0 0x562c9d219cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:33.668 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.662+0000 7f784bfff640 1 -- 172.21.15.7:0/1488102523 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562c9ce3b4d0 msgr2=0x562c9d215190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:33.668 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.662+0000 7f784bfff640 1 --2- 172.21.15.7:0/1488102523 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562c9ce3b4d0 0x562c9d215190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:33.668 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.662+0000 7f784bfff640 1 -- 172.21.15.7:0/1488102523 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562c9ce332f0 msgr2=0x562c9d219cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:33.668 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.662+0000 7f784bfff640 1 --2- 172.21.15.7:0/1488102523 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562c9ce332f0 0x562c9d219cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:33.668 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.662+0000 7f784bfff640 1 -- 172.21.15.7:0/1488102523 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562c9d215c40 con 0x562c9ce5c1b0 2024-09-21T06:36:33.668 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.662+0000 7f784bfff640 1 --2- 172.21.15.7:0/1488102523 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c9ce5c1b0 0x562c9d2156d0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f7844010b80 tx=0x7f78440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e81eed96eca10f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:33.668 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.662+0000 7f782affd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:36:33.668 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.663+0000 7f782affd640 1 -- 172.21.15.7:0/1488102523 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f784401e960 con 0x562c9ce5c1b0 2024-09-21T06:36:33.668 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.663+0000 7f782affd640 1 -- 172.21.15.7:0/1488102523 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f784401eb00 con 0x562c9ce5c1b0 2024-09-21T06:36:33.669 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.663+0000 7f7858c8d740 1 -- 172.21.15.7:0/1488102523 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f78340316a0 con 0x562c9ce5c1b0 2024-09-21T06:36:33.669 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.663+0000 7f782affd640 1 -- 172.21.15.7:0/1488102523 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f784401ed00 con 0x562c9ce5c1b0 2024-09-21T06:36:33.669 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.663+0000 7f7858c8d740 10 client.15510 fetch_fsmap learned FSMap version 25 2024-09-21T06:36:33.669 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.663+0000 7f7858c8d740 1 -- 172.21.15.7:0/1488102523 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562c9d28dd10 con 0x562c9ce5c1b0 2024-09-21T06:36:33.669 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.663+0000 7f782affd640 1 -- 172.21.15.7:0/1488102523 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78340316a0 con 0x562c9ce5c1b0 2024-09-21T06:36:33.669 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.663+0000 7f782affd640 1 -- 172.21.15.7:0/1488102523 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f784401d4a0 con 0x562c9ce5c1b0 2024-09-21T06:36:33.669 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.663+0000 7f7858c8d740 10 client.15510 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:36:33.669 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.663+0000 7f7858c8d740 10 client.15510 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:36:33.669 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.663+0000 7f7858c8d740 20 client.15510 populate_metadata read hostname 'smithi007' 2024-09-21T06:36:33.669 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.663+0000 7f7858c8d740 1 --2- 172.21.15.7:0/1488102523 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x562c9cdf01c0 0x562c9d290580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:33.669 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.663+0000 7f7858c8d740 4 client.15510 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T06:36:33.669 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.663+0000 7f7858c8d740 1 -- 172.21.15.7:0/1488102523 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562c9d1740f0 con 0x562c9cdf01c0 2024-09-21T06:36:33.669 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.663+0000 7f784b7fe640 1 --2- 172.21.15.7:0/1488102523 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x562c9cdf01c0 0x562c9d290580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:33.669 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.664+0000 7f782affd640 10 client.15510 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:36:33.670 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.664+0000 7f784b7fe640 1 --2- 172.21.15.7:0/1488102523 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x562c9cdf01c0 0x562c9d290580 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f7409efb8a173c3 server_cookie=adb5e90b4cd8ff33 in_seq=0 out_seq=0 2024-09-21T06:36:33.677 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.675+0000 7f782affd640 1 -- 172.21.15.7:0/1488102523 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562c9d1740f0 con 0x562c9cdf01c0 2024-09-21T06:36:33.677 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.675+0000 7f782affd640 10 client.15510 handle_command_reply: tid=0 2024-09-21T06:36:33.677 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.675+0000 7f7858c8d740 1 client.15510 shutdown 2024-09-21T06:36:33.677 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.675+0000 7f7858c8d740 1 -- 172.21.15.7:0/1488102523 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c9ce5c1b0 msgr2=0x562c9d2156d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:33.677 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.675+0000 7f7858c8d740 1 --2- 172.21.15.7:0/1488102523 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c9ce5c1b0 0x562c9d2156d0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f7844010b80 tx=0x7f78440046c0 comp rx=0 tx=0).stop 2024-09-21T06:36:33.677 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.675+0000 7f7858c8d740 1 -- 172.21.15.7:0/1488102523 shutdown_connections 2024-09-21T06:36:33.677 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.675+0000 7f7858c8d740 1 --2- 172.21.15.7:0/1488102523 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x562c9cdf01c0 0x562c9d290580 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:33.677 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.675+0000 7f7858c8d740 1 --2- 172.21.15.7:0/1488102523 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562c9ce5c1b0 0x562c9d2156d0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:33.677 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.675+0000 7f7858c8d740 1 --2- 172.21.15.7:0/1488102523 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562c9ce3b4d0 0x562c9d215190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:33.677 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.675+0000 7f7858c8d740 1 --2- 172.21.15.7:0/1488102523 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562c9ce332f0 0x562c9d219cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:33.677 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.675+0000 7f782affd640 0 client.15510 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:36:33.678 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.675+0000 7f7858c8d740 1 -- 172.21.15.7:0/1488102523 >> 172.21.15.7:0/1488102523 conn(0x562c9ce50300 msgr2=0x562c9d212970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:33.678 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.675+0000 7f7858c8d740 1 -- 172.21.15.7:0/1488102523 shutdown_connections 2024-09-21T06:36:33.678 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.675+0000 7f7858c8d740 1 -- 172.21.15.7:0/1488102523 wait complete. 2024-09-21T06:36:33.678 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.675+0000 7f7858c8d740 20 client.15510 trim_cache size 0 max 16384 2024-09-21T06:36:33.678 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-09-21T06:36:33.678 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-09-21T06:36:33.678 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-09-21T06:36:33.678 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-09-21T06:36:33.679 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.676+0000 7f7851c3f640 1 -- 172.21.15.7:0/968587205 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f78380b65f0 msgr2=0x7f78380b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:33.679 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.676+0000 7f7851c3f640 1 --2- 172.21.15.7:0/968587205 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f78380b65f0 0x7f78380b8b00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7844005fd0 tx=0x7f784400b420 comp rx=0 tx=0).stop 2024-09-21T06:36:33.679 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.676+0000 7f7851c3f640 1 -- 172.21.15.7:0/968587205 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f784c104910 msgr2=0x7f784c19a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:33.679 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.676+0000 7f7851c3f640 1 --2- 172.21.15.7:0/968587205 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f784c104910 0x7f784c19a430 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f783c00eb00 tx=0x7f783c00c2d0 comp rx=0 tx=0).stop 2024-09-21T06:36:33.679 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.676+0000 7f7851c3f640 1 -- 172.21.15.7:0/968587205 shutdown_connections 2024-09-21T06:36:33.679 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.676+0000 7f7851c3f640 1 --2- 172.21.15.7:0/968587205 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f78380b65f0 0x7f78380b8b00 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:33.679 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.676+0000 7f7851c3f640 1 --2- 172.21.15.7:0/968587205 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f784c10dd70 0x7f784c19fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:33.680 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.676+0000 7f7851c3f640 1 --2- 172.21.15.7:0/968587205 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f784c105260 0x7f784c19a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:33.680 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.676+0000 7f7851c3f640 1 --2- 172.21.15.7:0/968587205 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f784c104910 0x7f784c19a430 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:33.680 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.676+0000 7f7851c3f640 1 -- 172.21.15.7:0/968587205 >> 172.21.15.7:0/968587205 conn(0x7f784c0fe3c0 msgr2=0x7f784c1078a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:33.680 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.676+0000 7f7851c3f640 1 -- 172.21.15.7:0/968587205 shutdown_connections 2024-09-21T06:36:33.680 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:33.676+0000 7f7851c3f640 1 -- 172.21.15.7:0/968587205 wait complete. 2024-09-21T06:36:34.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:36:33 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:36:34.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:36:33 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:36:34.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:36:33 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:36:34.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:36:33 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:36:34.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:36:33 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:36:34.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:36:33 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:36:34.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:36:33 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:36:34.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:36:33 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:36:34.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:36:33 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:36:34.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:36:33 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:36:34.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:36:33 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:36:34.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:36:33 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:36:34.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:36:33 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:36:34.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:36:33 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:36:34.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:36:33 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:36:34.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:36:33 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:36:34.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:36:33 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:36:34.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:36:33 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:36:34.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:36:33 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:36:34.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:36:33 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:36:34.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:36:33 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:36:34.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:36:33 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:36:34.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:36:33 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:36:34.370 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:36:33 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:36:34.370 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:36:33 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:36:34.370 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:36:33 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:36:34.370 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:36:33 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:36:35.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:36:34 smithi144 ceph-mon[34653]: pgmap v330: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 54 op/s 2024-09-21T06:36:35.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:36:34 smithi144 ceph-mon[34653]: scrub summary: idle 2024-09-21T06:36:35.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:36:34 smithi007 ceph-mon[30983]: pgmap v330: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 54 op/s 2024-09-21T06:36:35.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:36:34 smithi007 ceph-mon[30983]: scrub summary: idle 2024-09-21T06:36:35.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:36:34 smithi018 ceph-mon[34477]: pgmap v330: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 175 KiB/s wr, 54 op/s 2024-09-21T06:36:35.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:36:34 smithi018 ceph-mon[34477]: scrub summary: idle 2024-09-21T06:36:37.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:36:36 smithi144 ceph-mon[34653]: pgmap v331: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:36:37.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:36:36 smithi007 ceph-mon[30983]: pgmap v331: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:36:37.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:36:36 smithi018 ceph-mon[34477]: pgmap v331: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:36:39.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:36:38 smithi144 ceph-mon[34653]: pgmap v332: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T06:36:39.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:36:38 smithi007 ceph-mon[30983]: pgmap v332: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T06:36:39.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:36:38 smithi018 ceph-mon[34477]: pgmap v332: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T06:36:41.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:36:40 smithi144 ceph-mon[34653]: pgmap v333: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.9 KiB/s wr, 11 op/s 2024-09-21T06:36:41.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:36:40 smithi007 ceph-mon[30983]: pgmap v333: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.9 KiB/s wr, 11 op/s 2024-09-21T06:36:41.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:36:40 smithi018 ceph-mon[34477]: pgmap v333: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.9 KiB/s wr, 11 op/s 2024-09-21T06:36:43.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:36:42 smithi144 ceph-mon[34653]: pgmap v334: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.9 KiB/s wr, 9 op/s 2024-09-21T06:36:43.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:36:42 smithi007 ceph-mon[30983]: pgmap v334: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.9 KiB/s wr, 9 op/s 2024-09-21T06:36:43.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:36:42 smithi018 ceph-mon[34477]: pgmap v334: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.9 KiB/s wr, 9 op/s 2024-09-21T06:36:45.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:36:44 smithi144 ceph-mon[34653]: pgmap v335: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.9 KiB/s wr, 11 op/s 2024-09-21T06:36:45.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:36:44 smithi007 ceph-mon[30983]: pgmap v335: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.9 KiB/s wr, 11 op/s 2024-09-21T06:36:45.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:36:44 smithi018 ceph-mon[34477]: pgmap v335: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.9 KiB/s wr, 11 op/s 2024-09-21T06:36:46.787 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.785+0000 7f319db98640 1 -- 172.21.15.7:0/455025069 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3198108c40 msgr2=0x7f319810f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:46.787 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.785+0000 7f319db98640 1 --2- 172.21.15.7:0/455025069 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3198108c40 0x7f319810f470 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f3190009ca0 tx=0x7f319002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:36:46.787 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.785+0000 7f319db98640 1 -- 172.21.15.7:0/455025069 shutdown_connections 2024-09-21T06:36:46.787 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.785+0000 7f319db98640 1 --2- 172.21.15.7:0/455025069 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3198108c40 0x7f319810f470 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:46.788 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.785+0000 7f319db98640 1 --2- 172.21.15.7:0/455025069 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f31981082f0 0x7f3198108700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:46.788 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.785+0000 7f319db98640 1 --2- 172.21.15.7:0/455025069 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31981029c0 0x7f3198102dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:46.788 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.785+0000 7f319db98640 1 -- 172.21.15.7:0/455025069 >> 172.21.15.7:0/455025069 conn(0x7f31980fe3c0 msgr2=0x7f3198100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:46.788 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.785+0000 7f319db98640 1 -- 172.21.15.7:0/455025069 shutdown_connections 2024-09-21T06:36:46.788 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.785+0000 7f319db98640 1 -- 172.21.15.7:0/455025069 wait complete. 2024-09-21T06:36:46.790 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.786+0000 7f319db98640 1 Processor -- start 2024-09-21T06:36:46.790 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.786+0000 7f319db98640 1 -- start start 2024-09-21T06:36:46.790 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.787+0000 7f319db98640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f31981029c0 0x7f319819b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:46.790 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.787+0000 7f319db98640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31981082f0 0x7f319819b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:46.790 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.787+0000 7f319db98640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3198108c40 0x7f319819bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:46.790 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.787+0000 7f319db98640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3198112900 con 0x7f31981029c0 2024-09-21T06:36:46.790 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.787+0000 7f319db98640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3198112780 con 0x7f31981082f0 2024-09-21T06:36:46.790 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.787+0000 7f319db98640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3198112a80 con 0x7f3198108c40 2024-09-21T06:36:46.790 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.787+0000 7f31977fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f31981029c0 0x7f319819b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:46.790 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.787+0000 7f31977fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f31981029c0 0x7f319819b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57482/0 (socket says 172.21.15.7:57482) 2024-09-21T06:36:46.790 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.787+0000 7f31977fe640 1 -- 172.21.15.7:0/146274411 learned_addr learned my addr 172.21.15.7:0/146274411 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:36:46.790 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.787+0000 7f3197fff640 1 --2- 172.21.15.7:0/146274411 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3198108c40 0x7f319819bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:46.791 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.787+0000 7f3196ffd640 1 --2- 172.21.15.7:0/146274411 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31981082f0 0x7f319819b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:46.791 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.787+0000 7f31977fe640 1 -- 172.21.15.7:0/146274411 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3198108c40 msgr2=0x7f319819bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:46.791 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.787+0000 7f31977fe640 1 --2- 172.21.15.7:0/146274411 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3198108c40 0x7f319819bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:46.791 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.787+0000 7f31977fe640 1 -- 172.21.15.7:0/146274411 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31981082f0 msgr2=0x7f319819b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:46.791 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.787+0000 7f31977fe640 1 --2- 172.21.15.7:0/146274411 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31981082f0 0x7f319819b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:46.791 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.787+0000 7f31977fe640 1 -- 172.21.15.7:0/146274411 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31981a6480 con 0x7f31981029c0 2024-09-21T06:36:46.791 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.787+0000 7f31977fe640 1 --2- 172.21.15.7:0/146274411 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f31981029c0 0x7f319819b1f0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f318800d950 tx=0x7f318800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:46.791 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.788+0000 7f3194ff9640 1 -- 172.21.15.7:0/146274411 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3188017070 con 0x7f31981029c0 2024-09-21T06:36:46.791 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.788+0000 7f319db98640 1 -- 172.21.15.7:0/146274411 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31981a6770 con 0x7f31981029c0 2024-09-21T06:36:46.791 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.788+0000 7f3194ff9640 1 -- 172.21.15.7:0/146274411 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3188009c30 con 0x7f31981029c0 2024-09-21T06:36:46.791 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.788+0000 7f3194ff9640 1 -- 172.21.15.7:0/146274411 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f318800f620 con 0x7f31981029c0 2024-09-21T06:36:46.791 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.788+0000 7f319db98640 1 -- 172.21.15.7:0/146274411 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31981a6cc0 con 0x7f31981029c0 2024-09-21T06:36:46.793 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.790+0000 7f31a4be2740 1 Processor -- start 2024-09-21T06:36:46.794 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.790+0000 7f31a4be2740 1 -- start start 2024-09-21T06:36:46.794 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.790+0000 7f3194ff9640 1 -- 172.21.15.7:0/146274411 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154585+0+0 (secure 0 0 0) 0x7f3188010460 con 0x7f31981029c0 2024-09-21T06:36:46.794 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.791+0000 7f31a4be2740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ae3d5c01b0 0x55ae3d9659b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:46.794 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.791+0000 7f31a4be2740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae3d5972f0 0x55ae3d965ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:46.794 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.791+0000 7f31a4be2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ae3d59f4d0 0x55ae3d966430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:46.794 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.791+0000 7f31a4be2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55ae3d8da6f0 con 0x55ae3d59f4d0 2024-09-21T06:36:46.794 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.791+0000 7f31a4be2740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55ae3d8c9b20 con 0x55ae3d5972f0 2024-09-21T06:36:46.794 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.791+0000 7f31a4be2740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55ae3d8cd930 con 0x55ae3d5c01b0 2024-09-21T06:36:46.794 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.791+0000 7f3196ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ae3d59f4d0 0x55ae3d966430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:46.794 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.791+0000 7f3196ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ae3d59f4d0 0x55ae3d966430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57488/0 (socket says 172.21.15.7:57488) 2024-09-21T06:36:46.794 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.791+0000 7f3196ffd640 1 -- 172.21.15.7:0/2331313678 learned_addr learned my addr 172.21.15.7:0/2331313678 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:36:46.794 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.791+0000 7f3197fff640 1 --2- 172.21.15.7:0/2331313678 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ae3d5c01b0 0x55ae3d9659b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:46.794 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.791+0000 7f31977fe640 1 --2- 172.21.15.7:0/2331313678 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae3d5972f0 0x55ae3d965ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:46.795 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.791+0000 7f3196ffd640 1 -- 172.21.15.7:0/2331313678 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ae3d5c01b0 msgr2=0x55ae3d9659b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:46.795 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.791+0000 7f3196ffd640 1 --2- 172.21.15.7:0/2331313678 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ae3d5c01b0 0x55ae3d9659b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:46.795 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.791+0000 7f3196ffd640 1 -- 172.21.15.7:0/2331313678 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae3d5972f0 msgr2=0x55ae3d965ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:46.795 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.791+0000 7f3196ffd640 1 --2- 172.21.15.7:0/2331313678 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae3d5972f0 0x55ae3d965ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:46.795 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.791+0000 7f3196ffd640 1 -- 172.21.15.7:0/2331313678 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae3d88f530 con 0x55ae3d59f4d0 2024-09-21T06:36:46.795 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.791+0000 7f31977fe640 1 --2- 172.21.15.7:0/2331313678 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae3d5972f0 0x55ae3d965ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:36:46.795 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.792+0000 7f3196ffd640 1 --2- 172.21.15.7:0/2331313678 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ae3d59f4d0 0x55ae3d966430 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f318c00b690 tx=0x7f318c00bb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50451c39916cee0e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:46.795 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.792+0000 7f3194ff9640 1 --2- 172.21.15.7:0/146274411 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f31800b65f0 0x7f31800b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:46.795 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.792+0000 7f3197fff640 1 --2- 172.21.15.7:0/146274411 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f31800b65f0 0x7f31800b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:46.795 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.792+0000 7f317dffb640 1 -- 172.21.15.7:0/2331313678 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f318c003bd0 con 0x55ae3d59f4d0 2024-09-21T06:36:46.795 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.792+0000 7f3194ff9640 1 -- 172.21.15.7:0/146274411 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f31880e7140 con 0x7f31981029c0 2024-09-21T06:36:46.795 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.792+0000 7f317dffb640 1 -- 172.21.15.7:0/2331313678 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f318c015070 con 0x55ae3d59f4d0 2024-09-21T06:36:46.795 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.792+0000 7f317dffb640 1 -- 172.21.15.7:0/2331313678 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f318c004d90 con 0x55ae3d59f4d0 2024-09-21T06:36:46.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.793+0000 7f31a4be2740 1 -- 172.21.15.7:0/2331313678 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ae3d59f4d0 msgr2=0x55ae3d966430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:46.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.793+0000 7f31a4be2740 1 --2- 172.21.15.7:0/2331313678 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ae3d59f4d0 0x55ae3d966430 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f318c00b690 tx=0x7f318c00bb50 comp rx=0 tx=0).stop 2024-09-21T06:36:46.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.793+0000 7f3197fff640 1 --2- 172.21.15.7:0/146274411 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f31800b65f0 0x7f31800b8b00 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f319002f500 tx=0x7f319002f370 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:46.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.793+0000 7f31a4be2740 1 -- 172.21.15.7:0/2331313678 shutdown_connections 2024-09-21T06:36:46.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.793+0000 7f31a4be2740 1 --2- 172.21.15.7:0/2331313678 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ae3d59f4d0 0x55ae3d966430 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:46.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.793+0000 7f31a4be2740 1 --2- 172.21.15.7:0/2331313678 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae3d5972f0 0x55ae3d965ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:46.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.793+0000 7f31a4be2740 1 --2- 172.21.15.7:0/2331313678 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ae3d5c01b0 0x55ae3d9659b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:46.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.793+0000 7f31a4be2740 1 -- 172.21.15.7:0/2331313678 >> 172.21.15.7:0/2331313678 conn(0x55ae3d5b4300 msgr2=0x55ae3d9638a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:46.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.793+0000 7f31a4be2740 1 -- 172.21.15.7:0/2331313678 shutdown_connections 2024-09-21T06:36:46.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.793+0000 7f31a4be2740 1 -- 172.21.15.7:0/2331313678 wait complete. 2024-09-21T06:36:46.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.793+0000 7f31a4be2740 1 -- start start 2024-09-21T06:36:46.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.794+0000 7f31a4be2740 1 Processor -- start 2024-09-21T06:36:46.800 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.794+0000 7f31a4be2740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae3d5972f0 0x55ae3d971040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:46.801 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.794+0000 7f31a4be2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ae3d59f4d0 0x55ae3d971580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:46.801 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.794+0000 7f31a4be2740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ae3d5c01b0 0x55ae3d97d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:46.801 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.794+0000 7f31a4be2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55ae3d801ab0 con 0x55ae3d59f4d0 2024-09-21T06:36:46.801 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.794+0000 7f31a4be2740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55ae3d86f730 con 0x55ae3d5972f0 2024-09-21T06:36:46.801 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.794+0000 7f31a4be2740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55ae3d974130 con 0x55ae3d5c01b0 2024-09-21T06:36:46.801 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.794+0000 7f31a4be2740 10 client.0 _ll_register_callbacks cb 0x55ae3d8c36b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:36:46.801 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.794+0000 7f3196ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ae3d59f4d0 0x55ae3d971580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:46.801 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.794+0000 7f3196ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ae3d59f4d0 0x55ae3d971580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57490/0 (socket says 172.21.15.7:57490) 2024-09-21T06:36:46.801 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.794+0000 7f3196ffd640 1 -- 172.21.15.7:0/2773834419 learned_addr learned my addr 172.21.15.7:0/2773834419 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:36:46.801 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.794+0000 7f31977fe640 1 --2- 172.21.15.7:0/2773834419 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae3d5972f0 0x55ae3d971040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:46.801 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.794+0000 7f3197fff640 1 --2- 172.21.15.7:0/2773834419 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ae3d5c01b0 0x55ae3d97d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:46.801 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.794+0000 7f3196ffd640 1 -- 172.21.15.7:0/2773834419 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ae3d5c01b0 msgr2=0x55ae3d97d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:46.801 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.794+0000 7f3196ffd640 1 --2- 172.21.15.7:0/2773834419 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ae3d5c01b0 0x55ae3d97d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:46.801 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.794+0000 7f3196ffd640 1 -- 172.21.15.7:0/2773834419 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae3d5972f0 msgr2=0x55ae3d971040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:46.802 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.794+0000 7f3196ffd640 1 --2- 172.21.15.7:0/2773834419 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae3d5972f0 0x55ae3d971040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:46.802 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.794+0000 7f3196ffd640 1 -- 172.21.15.7:0/2773834419 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae3d62b790 con 0x55ae3d59f4d0 2024-09-21T06:36:46.802 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.795+0000 7f3196ffd640 1 --2- 172.21.15.7:0/2773834419 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ae3d59f4d0 0x55ae3d971580 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f318c004910 tx=0x7f318c00bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d012418d7cd8938 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:46.802 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.795+0000 7f3176ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:36:46.802 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.795+0000 7f3176ffd640 1 -- 172.21.15.7:0/2773834419 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f318c028060 con 0x55ae3d59f4d0 2024-09-21T06:36:46.802 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.795+0000 7f3176ffd640 1 -- 172.21.15.7:0/2773834419 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f318c011440 con 0x55ae3d59f4d0 2024-09-21T06:36:46.802 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.795+0000 7f31a4be2740 1 -- 172.21.15.7:0/2773834419 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f318c015070 con 0x55ae3d59f4d0 2024-09-21T06:36:46.802 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.795+0000 7f3176ffd640 1 -- 172.21.15.7:0/2773834419 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f318c011640 con 0x55ae3d59f4d0 2024-09-21T06:36:46.802 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.795+0000 7f31a4be2740 10 client.15522 fetch_fsmap learned FSMap version 25 2024-09-21T06:36:46.802 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.795+0000 7f31a4be2740 1 -- 172.21.15.7:0/2773834419 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ae3d6a4620 con 0x55ae3d59f4d0 2024-09-21T06:36:46.802 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.795+0000 7f3176ffd640 1 -- 172.21.15.7:0/2773834419 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f318c015070 con 0x55ae3d59f4d0 2024-09-21T06:36:46.802 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.795+0000 7f3176ffd640 1 -- 172.21.15.7:0/2773834419 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f318c022070 con 0x55ae3d59f4d0 2024-09-21T06:36:46.802 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.796+0000 7f31a4be2740 10 client.15522 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:36:46.802 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.796+0000 7f31a4be2740 10 client.15522 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:36:46.803 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.796+0000 7f31a4be2740 20 client.15522 populate_metadata read hostname 'smithi007' 2024-09-21T06:36:46.803 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.796+0000 7f31a4be2740 1 --2- 172.21.15.7:0/2773834419 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55ae3d57ed80 0x55ae3d983090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:46.803 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.796+0000 7f31a4be2740 4 client.15522 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:36:46.803 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.796+0000 7f31a4be2740 1 -- 172.21.15.7:0/2773834419 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ae3d8dc640 con 0x55ae3d57ed80 2024-09-21T06:36:46.803 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.796+0000 7f31977fe640 1 --2- 172.21.15.7:0/2773834419 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55ae3d57ed80 0x55ae3d983090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:46.803 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.796+0000 7f31977fe640 1 --2- 172.21.15.7:0/2773834419 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55ae3d57ed80 0x55ae3d983090 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac7474fd718a47dd server_cookie=a51f2b912e50817a in_seq=0 out_seq=0 2024-09-21T06:36:46.803 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.796+0000 7f3176ffd640 10 client.15522 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:36:46.803 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.797+0000 7f3176ffd640 1 -- 172.21.15.7:0/2773834419 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ae3d8dc640 con 0x55ae3d57ed80 2024-09-21T06:36:46.803 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.797+0000 7f3176ffd640 10 client.15522 handle_command_reply: tid=0 2024-09-21T06:36:46.803 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.797+0000 7f31a4be2740 1 client.15522 shutdown 2024-09-21T06:36:46.803 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.797+0000 7f31a4be2740 1 -- 172.21.15.7:0/2773834419 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ae3d59f4d0 msgr2=0x55ae3d971580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:46.803 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.797+0000 7f31a4be2740 1 --2- 172.21.15.7:0/2773834419 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ae3d59f4d0 0x55ae3d971580 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f318c004910 tx=0x7f318c00bfd0 comp rx=0 tx=0).stop 2024-09-21T06:36:46.803 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.797+0000 7f31a4be2740 1 -- 172.21.15.7:0/2773834419 shutdown_connections 2024-09-21T06:36:46.803 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.797+0000 7f31a4be2740 1 --2- 172.21.15.7:0/2773834419 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55ae3d57ed80 0x55ae3d983090 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:46.804 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.797+0000 7f31a4be2740 1 --2- 172.21.15.7:0/2773834419 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ae3d5c01b0 0x55ae3d97d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:46.804 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.797+0000 7f31a4be2740 1 --2- 172.21.15.7:0/2773834419 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ae3d59f4d0 0x55ae3d971580 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:46.804 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.797+0000 7f3176ffd640 0 client.15522 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:36:46.804 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.797+0000 7f31a4be2740 1 --2- 172.21.15.7:0/2773834419 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae3d5972f0 0x55ae3d971040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:46.804 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.797+0000 7f31a4be2740 1 -- 172.21.15.7:0/2773834419 >> 172.21.15.7:0/2773834419 conn(0x55ae3d5b4300 msgr2=0x55ae3d9669e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:46.804 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.797+0000 7f31a4be2740 1 -- 172.21.15.7:0/2773834419 shutdown_connections 2024-09-21T06:36:46.804 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.797+0000 7f31a4be2740 1 -- 172.21.15.7:0/2773834419 wait complete. 2024-09-21T06:36:46.804 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.798+0000 7f31a4be2740 20 client.15522 trim_cache size 0 max 16384 2024-09-21T06:36:46.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.818+0000 7f31a4be2740 1 Processor -- start 2024-09-21T06:36:46.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.818+0000 7f31a4be2740 1 -- start start 2024-09-21T06:36:46.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.819+0000 7f31a4be2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ae3d5972f0 0x55ae3d962860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:46.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.819+0000 7f31a4be2740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae3d59f4d0 0x55ae3d9670f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:46.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.819+0000 7f31a4be2740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ae3d5c01b0 0x55ae3d96e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:46.821 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.819+0000 7f31a4be2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f31981b1d30 con 0x55ae3d5972f0 2024-09-21T06:36:46.822 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.819+0000 7f31a4be2740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f31981af600 con 0x55ae3d59f4d0 2024-09-21T06:36:46.822 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.819+0000 7f31a4be2740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f31981ad450 con 0x55ae3d5c01b0 2024-09-21T06:36:46.822 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.819+0000 7f31977fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ae3d5972f0 0x55ae3d962860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:46.822 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.819+0000 7f31977fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ae3d5972f0 0x55ae3d962860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57502/0 (socket says 172.21.15.7:57502) 2024-09-21T06:36:46.822 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.819+0000 7f31977fe640 1 -- 172.21.15.7:0/1264824629 learned_addr learned my addr 172.21.15.7:0/1264824629 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:36:46.822 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.819+0000 7f3197fff640 1 --2- 172.21.15.7:0/1264824629 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ae3d5c01b0 0x55ae3d96e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:46.822 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.819+0000 7f3196ffd640 1 --2- 172.21.15.7:0/1264824629 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae3d59f4d0 0x55ae3d9670f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:46.822 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.819+0000 7f31977fe640 1 -- 172.21.15.7:0/1264824629 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ae3d5c01b0 msgr2=0x55ae3d96e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:46.822 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.819+0000 7f31977fe640 1 --2- 172.21.15.7:0/1264824629 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ae3d5c01b0 0x55ae3d96e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:46.822 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.819+0000 7f31977fe640 1 -- 172.21.15.7:0/1264824629 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae3d59f4d0 msgr2=0x55ae3d9670f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:46.822 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.819+0000 7f31977fe640 1 --2- 172.21.15.7:0/1264824629 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae3d59f4d0 0x55ae3d9670f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:46.822 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.819+0000 7f31977fe640 1 -- 172.21.15.7:0/1264824629 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae3d989380 con 0x55ae3d5972f0 2024-09-21T06:36:46.822 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.819+0000 7f31977fe640 1 --2- 172.21.15.7:0/1264824629 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ae3d5972f0 0x55ae3d962860 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f31880e4ff0 tx=0x7f3188005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3982773be2bae9a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:46.822 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.820+0000 7f317d7fa640 1 -- 172.21.15.7:0/1264824629 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3188020040 con 0x55ae3d5972f0 2024-09-21T06:36:46.823 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.820+0000 7f317d7fa640 1 -- 172.21.15.7:0/1264824629 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f31880accb0 con 0x55ae3d5972f0 2024-09-21T06:36:46.823 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.820+0000 7f317d7fa640 1 -- 172.21.15.7:0/1264824629 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31880b6b10 con 0x55ae3d5972f0 2024-09-21T06:36:46.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.820+0000 7f31a4be2740 1 -- 172.21.15.7:0/1264824629 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ae3d5972f0 msgr2=0x55ae3d962860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:46.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.821+0000 7f31a4be2740 1 --2- 172.21.15.7:0/1264824629 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ae3d5972f0 0x55ae3d962860 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f31880e4ff0 tx=0x7f3188005880 comp rx=0 tx=0).stop 2024-09-21T06:36:46.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.821+0000 7f31a4be2740 1 -- 172.21.15.7:0/1264824629 shutdown_connections 2024-09-21T06:36:46.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.821+0000 7f31a4be2740 1 --2- 172.21.15.7:0/1264824629 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ae3d5c01b0 0x55ae3d96e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:46.826 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.821+0000 7f31a4be2740 1 --2- 172.21.15.7:0/1264824629 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae3d59f4d0 0x55ae3d9670f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:46.827 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.821+0000 7f31a4be2740 1 --2- 172.21.15.7:0/1264824629 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ae3d5972f0 0x55ae3d962860 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:46.827 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.821+0000 7f31a4be2740 1 -- 172.21.15.7:0/1264824629 >> 172.21.15.7:0/1264824629 conn(0x55ae3d5b4300 msgr2=0x55ae3d9669e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:46.827 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.821+0000 7f31a4be2740 1 -- 172.21.15.7:0/1264824629 shutdown_connections 2024-09-21T06:36:46.827 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.821+0000 7f31a4be2740 1 -- 172.21.15.7:0/1264824629 wait complete. 2024-09-21T06:36:46.827 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.821+0000 7f31a4be2740 1 -- start start 2024-09-21T06:36:46.827 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.821+0000 7f31a4be2740 1 Processor -- start 2024-09-21T06:36:46.827 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.822+0000 7f31a4be2740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ae3d5972f0 0x55ae3d985f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:46.827 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.822+0000 7f31a4be2740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae3d59f4d0 0x55ae3d986520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:46.827 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.822+0000 7f31a4be2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ae3d5c01b0 0x55ae3d9e6e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:46.827 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.822+0000 7f31a4be2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f31981adac0 con 0x55ae3d5c01b0 2024-09-21T06:36:46.827 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.822+0000 7f31a4be2740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f31981aef30 con 0x55ae3d59f4d0 2024-09-21T06:36:46.827 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.822+0000 7f31a4be2740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f31981ae190 con 0x55ae3d5972f0 2024-09-21T06:36:46.827 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.822+0000 7f31a4be2740 10 client.0 _ll_register_callbacks cb 0x7f3190009360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:36:46.828 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.822+0000 7f3197fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ae3d5c01b0 0x55ae3d9e6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:46.828 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.822+0000 7f3197fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ae3d5c01b0 0x55ae3d9e6e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57504/0 (socket says 172.21.15.7:57504) 2024-09-21T06:36:46.828 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.822+0000 7f3197fff640 1 -- 172.21.15.7:0/2204437304 learned_addr learned my addr 172.21.15.7:0/2204437304 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:36:46.828 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.822+0000 7f3196ffd640 1 --2- 172.21.15.7:0/2204437304 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae3d59f4d0 0x55ae3d986520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:46.828 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.822+0000 7f31977fe640 1 --2- 172.21.15.7:0/2204437304 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ae3d5972f0 0x55ae3d985f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:46.828 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.822+0000 7f3197fff640 1 -- 172.21.15.7:0/2204437304 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ae3d5972f0 msgr2=0x55ae3d985f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:46.828 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.822+0000 7f3197fff640 1 --2- 172.21.15.7:0/2204437304 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ae3d5972f0 0x55ae3d985f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:46.828 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.822+0000 7f3197fff640 1 -- 172.21.15.7:0/2204437304 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae3d59f4d0 msgr2=0x55ae3d986520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:46.828 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.822+0000 7f3197fff640 1 --2- 172.21.15.7:0/2204437304 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae3d59f4d0 0x55ae3d986520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:46.828 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.822+0000 7f3197fff640 1 -- 172.21.15.7:0/2204437304 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae3d9e7500 con 0x55ae3d5c01b0 2024-09-21T06:36:46.828 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.822+0000 7f31977fe640 1 --2- 172.21.15.7:0/2204437304 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ae3d5972f0 0x55ae3d985f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:36:46.828 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.822+0000 7f3176ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:36:46.828 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.822+0000 7f3197fff640 1 --2- 172.21.15.7:0/2204437304 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ae3d5c01b0 0x55ae3d9e6e90 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f3190031a00 tx=0x7f31900095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13c7091b91320a63 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:46.829 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.823+0000 7f3176ffd640 1 -- 172.21.15.7:0/2204437304 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3190059060 con 0x55ae3d5c01b0 2024-09-21T06:36:46.829 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.823+0000 7f3176ffd640 1 -- 172.21.15.7:0/2204437304 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f3190004250 con 0x55ae3d5c01b0 2024-09-21T06:36:46.829 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.823+0000 7f31a4be2740 1 -- 172.21.15.7:0/2204437304 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f31880accb0 con 0x55ae3d5c01b0 2024-09-21T06:36:46.829 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.823+0000 7f3176ffd640 1 -- 172.21.15.7:0/2204437304 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3190004450 con 0x55ae3d5c01b0 2024-09-21T06:36:46.829 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.823+0000 7f31a4be2740 10 client.15528 fetch_fsmap learned FSMap version 25 2024-09-21T06:36:46.829 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.823+0000 7f31a4be2740 1 -- 172.21.15.7:0/2204437304 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ae3d9f1b60 con 0x55ae3d5c01b0 2024-09-21T06:36:46.829 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.823+0000 7f3176ffd640 1 -- 172.21.15.7:0/2204437304 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f31880accb0 con 0x55ae3d5c01b0 2024-09-21T06:36:46.829 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.823+0000 7f3176ffd640 1 -- 172.21.15.7:0/2204437304 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f31900305c0 con 0x55ae3d5c01b0 2024-09-21T06:36:46.829 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.823+0000 7f31a4be2740 10 client.15528 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:36:46.829 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.823+0000 7f31a4be2740 10 client.15528 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:36:46.829 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.823+0000 7f31a4be2740 20 client.15528 populate_metadata read hostname 'smithi007' 2024-09-21T06:36:46.829 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.823+0000 7f31a4be2740 1 --2- 172.21.15.7:0/2204437304 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55ae3d5541c0 0x55ae3d9f4380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:46.829 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.823+0000 7f31a4be2740 4 client.15528 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T06:36:46.829 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.823+0000 7f31a4be2740 1 -- 172.21.15.7:0/2204437304 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ae3d8d80f0 con 0x55ae3d5541c0 2024-09-21T06:36:46.830 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.824+0000 7f31977fe640 1 --2- 172.21.15.7:0/2204437304 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55ae3d5541c0 0x55ae3d9f4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:46.830 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.824+0000 7f3176ffd640 10 client.15528 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:36:46.830 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.824+0000 7f31977fe640 1 --2- 172.21.15.7:0/2204437304 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55ae3d5541c0 0x55ae3d9f4380 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ccdcdb623c23974 server_cookie=6cfb5f84a28c21d5 in_seq=0 out_seq=0 2024-09-21T06:36:46.833 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.831+0000 7f3176ffd640 1 -- 172.21.15.7:0/2204437304 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ae3d8d80f0 con 0x55ae3d5541c0 2024-09-21T06:36:46.834 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.831+0000 7f3176ffd640 10 client.15528 handle_command_reply: tid=0 2024-09-21T06:36:46.834 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.831+0000 7f31a4be2740 1 client.15528 shutdown 2024-09-21T06:36:46.834 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.832+0000 7f31a4be2740 1 -- 172.21.15.7:0/2204437304 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ae3d5c01b0 msgr2=0x55ae3d9e6e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:46.834 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.832+0000 7f31a4be2740 1 --2- 172.21.15.7:0/2204437304 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ae3d5c01b0 0x55ae3d9e6e90 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f3190031a00 tx=0x7f31900095c0 comp rx=0 tx=0).stop 2024-09-21T06:36:46.834 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.832+0000 7f31a4be2740 1 -- 172.21.15.7:0/2204437304 shutdown_connections 2024-09-21T06:36:46.834 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.832+0000 7f31a4be2740 1 --2- 172.21.15.7:0/2204437304 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55ae3d5541c0 0x55ae3d9f4380 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:46.834 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.832+0000 7f31a4be2740 1 --2- 172.21.15.7:0/2204437304 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ae3d5c01b0 0x55ae3d9e6e90 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:46.834 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.832+0000 7f31a4be2740 1 --2- 172.21.15.7:0/2204437304 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ae3d59f4d0 0x55ae3d986520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:46.834 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.832+0000 7f31a4be2740 1 --2- 172.21.15.7:0/2204437304 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ae3d5972f0 0x55ae3d985f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:46.834 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.832+0000 7f31a4be2740 1 -- 172.21.15.7:0/2204437304 >> 172.21.15.7:0/2204437304 conn(0x55ae3d5b4300 msgr2=0x55ae3d962630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:46.834 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.832+0000 7f3176ffd640 0 client.15528 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:36:46.834 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.832+0000 7f31a4be2740 1 -- 172.21.15.7:0/2204437304 shutdown_connections 2024-09-21T06:36:46.834 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.832+0000 7f31a4be2740 1 -- 172.21.15.7:0/2204437304 wait complete. 2024-09-21T06:36:46.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.832+0000 7f31a4be2740 20 client.15528 trim_cache size 0 max 16384 2024-09-21T06:36:46.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-09-21T06:36:46.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-09-21T06:36:46.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-09-21T06:36:46.835 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-09-21T06:36:46.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.832+0000 7f319db98640 1 -- 172.21.15.7:0/146274411 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f31800b65f0 msgr2=0x7f31800b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:46.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.832+0000 7f319db98640 1 --2- 172.21.15.7:0/146274411 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f31800b65f0 0x7f31800b8b00 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f319002f500 tx=0x7f319002f370 comp rx=0 tx=0).stop 2024-09-21T06:36:46.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.832+0000 7f319db98640 1 -- 172.21.15.7:0/146274411 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f31981029c0 msgr2=0x7f319819b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:46.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.833+0000 7f319db98640 1 --2- 172.21.15.7:0/146274411 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f31981029c0 0x7f319819b1f0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f318800d950 tx=0x7f318800de10 comp rx=0 tx=0).stop 2024-09-21T06:36:46.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.833+0000 7f319db98640 1 -- 172.21.15.7:0/146274411 shutdown_connections 2024-09-21T06:36:46.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.833+0000 7f319db98640 1 --2- 172.21.15.7:0/146274411 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f31800b65f0 0x7f31800b8b00 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:46.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.833+0000 7f319db98640 1 --2- 172.21.15.7:0/146274411 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3198108c40 0x7f319819bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:46.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.833+0000 7f319db98640 1 --2- 172.21.15.7:0/146274411 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31981082f0 0x7f319819b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:46.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.833+0000 7f319db98640 1 --2- 172.21.15.7:0/146274411 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f31981029c0 0x7f319819b1f0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:46.836 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.833+0000 7f319db98640 1 -- 172.21.15.7:0/146274411 >> 172.21.15.7:0/146274411 conn(0x7f31980fe3c0 msgr2=0x7f31981068b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:46.837 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.833+0000 7f319db98640 1 -- 172.21.15.7:0/146274411 shutdown_connections 2024-09-21T06:36:46.837 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:46.833+0000 7f319db98640 1 -- 172.21.15.7:0/146274411 wait complete. 2024-09-21T06:36:47.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:36:46 smithi144 ceph-mon[34653]: pgmap v336: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.9 KiB/s wr, 9 op/s 2024-09-21T06:36:47.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:36:46 smithi007 ceph-mon[30983]: pgmap v336: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.9 KiB/s wr, 9 op/s 2024-09-21T06:36:47.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:36:46 smithi018 ceph-mon[34477]: pgmap v336: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.9 KiB/s wr, 9 op/s 2024-09-21T06:36:49.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:36:48 smithi144 ceph-mon[34653]: pgmap v337: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.9 KiB/s wr, 9 op/s 2024-09-21T06:36:49.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:36:48 smithi007 ceph-mon[30983]: pgmap v337: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.9 KiB/s wr, 9 op/s 2024-09-21T06:36:49.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:36:48 smithi018 ceph-mon[34477]: pgmap v337: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.9 KiB/s wr, 9 op/s 2024-09-21T06:36:51.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:36:50 smithi144 ceph-mon[34653]: pgmap v338: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2024-09-21T06:36:51.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:36:50 smithi007 ceph-mon[30983]: pgmap v338: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2024-09-21T06:36:51.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:36:50 smithi018 ceph-mon[34477]: pgmap v338: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 2.0 KiB/s wr, 10 op/s 2024-09-21T06:36:51.922 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:36:52.255 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:36:52.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.834+0000 7f4a2400f640 1 -- 172.21.15.7:0/3349240738 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a1c1094b0 msgr2=0x7f4a1c1098c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:52.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.834+0000 7f4a2400f640 1 --2- 172.21.15.7:0/3349240738 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a1c1094b0 0x7f4a1c1098c0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c009900 tx=0x7f4a0c02a410 comp rx=0 tx=0).stop 2024-09-21T06:36:52.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.835+0000 7f4a2400f640 1 -- 172.21.15.7:0/3349240738 shutdown_connections 2024-09-21T06:36:52.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.835+0000 7f4a2400f640 1 --2- 172.21.15.7:0/3349240738 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a1c109e00 0x7f4a1c110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:52.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.835+0000 7f4a2400f640 1 --2- 172.21.15.7:0/3349240738 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a1c1094b0 0x7f4a1c1098c0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:52.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.835+0000 7f4a2400f640 1 --2- 172.21.15.7:0/3349240738 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a1c103bc0 0x7f4a1c103fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:52.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.835+0000 7f4a2400f640 1 -- 172.21.15.7:0/3349240738 >> 172.21.15.7:0/3349240738 conn(0x7f4a1c07b910 msgr2=0x7f4a1c07bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:52.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.835+0000 7f4a2400f640 1 -- 172.21.15.7:0/3349240738 shutdown_connections 2024-09-21T06:36:52.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.835+0000 7f4a2400f640 1 -- 172.21.15.7:0/3349240738 wait complete. 2024-09-21T06:36:52.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.835+0000 7f4a2400f640 1 Processor -- start 2024-09-21T06:36:52.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.836+0000 7f4a2400f640 1 -- start start 2024-09-21T06:36:52.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.836+0000 7f4a2400f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a1c103bc0 0x7f4a1c19a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:52.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.836+0000 7f4a2400f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a1c1094b0 0x7f4a1c19aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:52.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.836+0000 7f4a2400f640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a1c109e00 0x7f4a1c19fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:52.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.836+0000 7f4a2400f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4a1c113ac0 con 0x7f4a1c1094b0 2024-09-21T06:36:52.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.836+0000 7f4a2400f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4a1c113940 con 0x7f4a1c103bc0 2024-09-21T06:36:52.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.836+0000 7f4a2400f640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4a1c113c40 con 0x7f4a1c109e00 2024-09-21T06:36:52.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.836+0000 7f4a215aa640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a1c1094b0 0x7f4a1c19aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:52.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.836+0000 7f4a21dab640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a1c103bc0 0x7f4a1c19a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:52.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.836+0000 7f4a215aa640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a1c1094b0 0x7f4a1c19aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45790/0 (socket says 172.21.15.7:45790) 2024-09-21T06:36:52.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.836+0000 7f4a215aa640 1 -- 172.21.15.7:0/3556197730 learned_addr learned my addr 172.21.15.7:0/3556197730 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:36:52.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.837+0000 7f4a225ac640 1 --2- 172.21.15.7:0/3556197730 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a1c109e00 0x7f4a1c19fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:52.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.837+0000 7f4a21dab640 1 -- 172.21.15.7:0/3556197730 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a1c109e00 msgr2=0x7f4a1c19fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:52.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.837+0000 7f4a21dab640 1 --2- 172.21.15.7:0/3556197730 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a1c109e00 0x7f4a1c19fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:52.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.837+0000 7f4a21dab640 1 -- 172.21.15.7:0/3556197730 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a1c1094b0 msgr2=0x7f4a1c19aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:52.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.837+0000 7f4a21dab640 1 --2- 172.21.15.7:0/3556197730 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a1c1094b0 0x7f4a1c19aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:52.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.837+0000 7f4a21dab640 1 -- 172.21.15.7:0/3556197730 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a1c1a0400 con 0x7f4a1c103bc0 2024-09-21T06:36:52.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.837+0000 7f4a215aa640 1 --2- 172.21.15.7:0/3556197730 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a1c1094b0 0x7f4a1c19aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:36:52.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.837+0000 7f4a21dab640 1 --2- 172.21.15.7:0/3556197730 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a1c103bc0 0x7f4a1c19a490 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4a1800d6d0 tx=0x7f4a1800db90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:52.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.837+0000 7f4a12ffd640 1 -- 172.21.15.7:0/3556197730 <== mon.2 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a18017070 con 0x7f4a1c103bc0 2024-09-21T06:36:52.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.837+0000 7f4a2400f640 1 -- 172.21.15.7:0/3556197730 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a1c1a06f0 con 0x7f4a1c103bc0 2024-09-21T06:36:52.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.837+0000 7f4a12ffd640 1 -- 172.21.15.7:0/3556197730 <== mon.2 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4a18009820 con 0x7f4a1c103bc0 2024-09-21T06:36:52.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.837+0000 7f4a12ffd640 1 -- 172.21.15.7:0/3556197730 <== mon.2 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a18004c40 con 0x7f4a1c103bc0 2024-09-21T06:36:52.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.838+0000 7f4a2400f640 1 -- 172.21.15.7:0/3556197730 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a1c1a6e50 con 0x7f4a1c103bc0 2024-09-21T06:36:52.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.841+0000 7f4a2a583740 1 Processor -- start 2024-09-21T06:36:52.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.841+0000 7f4a2a583740 1 -- start start 2024-09-21T06:36:52.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.842+0000 7f4a2a583740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5593f009a070 0x5593f0441270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:52.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.842+0000 7f4a2a583740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5593f00711b0 0x5593f04417b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:52.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.842+0000 7f4a2a583740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593f0079390 0x5593f0441cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:52.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.842+0000 7f4a2a583740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5593f03b7e50 con 0x5593f0079390 2024-09-21T06:36:52.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.842+0000 7f4a2a583740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5593f03a7280 con 0x5593f009a070 2024-09-21T06:36:52.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.842+0000 7f4a2a583740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5593f03ab090 con 0x5593f00711b0 2024-09-21T06:36:52.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.842+0000 7f4a215aa640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593f0079390 0x5593f0441cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:52.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.842+0000 7f4a215aa640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593f0079390 0x5593f0441cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45806/0 (socket says 172.21.15.7:45806) 2024-09-21T06:36:52.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.842+0000 7f4a215aa640 1 -- 172.21.15.7:0/2677263572 learned_addr learned my addr 172.21.15.7:0/2677263572 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:36:52.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.842+0000 7f4a225ac640 1 --2- 172.21.15.7:0/2677263572 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5593f009a070 0x5593f0441270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:52.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.842+0000 7f4a215aa640 1 -- 172.21.15.7:0/2677263572 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5593f00711b0 msgr2=0x5593f04417b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T06:36:52.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.842+0000 7f4a215aa640 1 --2- 172.21.15.7:0/2677263572 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5593f00711b0 0x5593f04417b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:52.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.842+0000 7f4a215aa640 1 -- 172.21.15.7:0/2677263572 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5593f009a070 msgr2=0x5593f0441270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:52.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.842+0000 7f4a215aa640 1 --2- 172.21.15.7:0/2677263572 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5593f009a070 0x5593f0441270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:52.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.842+0000 7f4a215aa640 1 -- 172.21.15.7:0/2677263572 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593f0105650 con 0x5593f0079390 2024-09-21T06:36:52.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.842+0000 7f4a12ffd640 1 -- 172.21.15.7:0/3556197730 <== mon.2 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 24) ==== 154585+0+0 (secure 0 0 0) 0x7f4a18005220 con 0x7f4a1c103bc0 2024-09-21T06:36:52.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.843+0000 7f4a215aa640 1 --2- 172.21.15.7:0/2677263572 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593f0079390 0x5593f0441cf0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c006010 tx=0x7f4a0c005ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eae6cb7a0100380 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:52.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.843+0000 7f4a07fff640 1 -- 172.21.15.7:0/2677263572 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a0c035040 con 0x5593f0079390 2024-09-21T06:36:52.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.843+0000 7f4a07fff640 1 -- 172.21.15.7:0/2677263572 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4a0c031820 con 0x5593f0079390 2024-09-21T06:36:52.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.843+0000 7f4a07fff640 1 -- 172.21.15.7:0/2677263572 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a0c004a00 con 0x5593f0079390 2024-09-21T06:36:52.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.844+0000 7f4a12ffd640 1 --2- 172.21.15.7:0/3556197730 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f4a080b6670 0x7f4a080b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:52.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.844+0000 7f4a12ffd640 1 -- 172.21.15.7:0/3556197730 <== mon.2 v2:172.21.15.18:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f4a180e7070 con 0x7f4a1c103bc0 2024-09-21T06:36:52.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.844+0000 7f4a225ac640 1 --2- 172.21.15.7:0/3556197730 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f4a080b6670 0x7f4a080b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:52.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.844+0000 7f4a2a583740 1 -- 172.21.15.7:0/2677263572 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593f0079390 msgr2=0x5593f0441cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:52.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.844+0000 7f4a2a583740 1 --2- 172.21.15.7:0/2677263572 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593f0079390 0x5593f0441cf0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c006010 tx=0x7f4a0c005ed0 comp rx=0 tx=0).stop 2024-09-21T06:36:52.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.844+0000 7f4a2a583740 1 -- 172.21.15.7:0/2677263572 shutdown_connections 2024-09-21T06:36:52.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.844+0000 7f4a2a583740 1 --2- 172.21.15.7:0/2677263572 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593f0079390 0x5593f0441cf0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:52.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.844+0000 7f4a2a583740 1 --2- 172.21.15.7:0/2677263572 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5593f00711b0 0x5593f04417b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:52.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.844+0000 7f4a2a583740 1 --2- 172.21.15.7:0/2677263572 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5593f009a070 0x5593f0441270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:52.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.845+0000 7f4a2a583740 1 -- 172.21.15.7:0/2677263572 >> 172.21.15.7:0/2677263572 conn(0x5593f008e460 msgr2=0x5593f043f160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:52.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.845+0000 7f4a2a583740 1 -- 172.21.15.7:0/2677263572 shutdown_connections 2024-09-21T06:36:52.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.845+0000 7f4a2a583740 1 -- 172.21.15.7:0/2677263572 wait complete. 2024-09-21T06:36:52.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.845+0000 7f4a225ac640 1 --2- 172.21.15.7:0/3556197730 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f4a080b6670 0x7f4a080b8b80 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4a14005fd0 tx=0x7f4a14009500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:52.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.845+0000 7f4a2a583740 1 -- start start 2024-09-21T06:36:52.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.845+0000 7f4a2a583740 1 Processor -- start 2024-09-21T06:36:52.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.846+0000 7f4a2a583740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593f00711b0 0x5593f044c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:52.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.846+0000 7f4a2a583740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5593f0079390 0x5593f044ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:52.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.846+0000 7f4a2a583740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5593f009a070 0x5593f0458d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:52.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.846+0000 7f4a2a583740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5593f0208700 con 0x5593f00711b0 2024-09-21T06:36:52.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.846+0000 7f4a2a583740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5593f0342110 con 0x5593f0079390 2024-09-21T06:36:52.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.846+0000 7f4a2a583740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5593f044f9f0 con 0x5593f009a070 2024-09-21T06:36:52.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.846+0000 7f4a2a583740 10 client.0 _ll_register_callbacks cb 0x5593f035b990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:36:52.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.846+0000 7f4a21dab640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593f00711b0 0x5593f044c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:52.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.846+0000 7f4a21dab640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593f00711b0 0x5593f044c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45822/0 (socket says 172.21.15.7:45822) 2024-09-21T06:36:52.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.846+0000 7f4a21dab640 1 -- 172.21.15.7:0/3179080022 learned_addr learned my addr 172.21.15.7:0/3179080022 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:36:52.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.846+0000 7f4a215aa640 1 --2- 172.21.15.7:0/3179080022 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5593f0079390 0x5593f044ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:52.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.847+0000 7f4a225ac640 1 --2- 172.21.15.7:0/3179080022 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5593f009a070 0x5593f0458d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:52.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.847+0000 7f4a215aa640 1 -- 172.21.15.7:0/3179080022 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5593f009a070 msgr2=0x5593f0458d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:52.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.847+0000 7f4a215aa640 1 --2- 172.21.15.7:0/3179080022 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5593f009a070 0x5593f0458d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:52.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.847+0000 7f4a215aa640 1 -- 172.21.15.7:0/3179080022 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593f00711b0 msgr2=0x5593f044c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:52.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.847+0000 7f4a215aa640 1 --2- 172.21.15.7:0/3179080022 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593f00711b0 0x5593f044c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:52.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.847+0000 7f4a215aa640 1 -- 172.21.15.7:0/3179080022 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593f036fc40 con 0x5593f0079390 2024-09-21T06:36:52.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.847+0000 7f4a21dab640 1 --2- 172.21.15.7:0/3179080022 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593f00711b0 0x5593f044c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:36:52.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.847+0000 7f4a215aa640 1 --2- 172.21.15.7:0/3179080022 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5593f0079390 0x5593f044ced0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c000c00 tx=0x7f4a0c0319d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff551b01db6fac9f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:52.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.847+0000 7f4a057fa640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-21T06:36:52.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.847+0000 7f4a057fa640 1 -- 172.21.15.7:0/3179080022 <== mon.2 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a0c035040 con 0x5593f0079390 2024-09-21T06:36:52.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.847+0000 7f4a057fa640 1 -- 172.21.15.7:0/3179080022 <== mon.2 v2:172.21.15.18:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f4a0c0035f0 con 0x5593f0079390 2024-09-21T06:36:52.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.847+0000 7f4a2a583740 1 -- 172.21.15.7:0/3179080022 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4a0c031820 con 0x5593f0079390 2024-09-21T06:36:52.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.848+0000 7f4a057fa640 1 -- 172.21.15.7:0/3179080022 <== mon.2 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4a0c058050 con 0x5593f0079390 2024-09-21T06:36:52.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.848+0000 7f4a2a583740 10 client.25340 fetch_fsmap learned FSMap version 25 2024-09-21T06:36:52.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.848+0000 7f4a2a583740 1 -- 172.21.15.7:0/3179080022 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5593f045b790 con 0x5593f0079390 2024-09-21T06:36:52.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.848+0000 7f4a057fa640 1 -- 172.21.15.7:0/3179080022 <== mon.2 v2:172.21.15.18:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4a0c009520 con 0x5593f0079390 2024-09-21T06:36:52.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.848+0000 7f4a057fa640 1 -- 172.21.15.7:0/3179080022 <== mon.2 v2:172.21.15.18:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f4a0c0467f0 con 0x5593f0079390 2024-09-21T06:36:52.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.848+0000 7f4a2a583740 10 client.25340 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:36:52.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.848+0000 7f4a2a583740 10 client.25340 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:36:52.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.848+0000 7f4a2a583740 20 client.25340 populate_metadata read hostname 'smithi007' 2024-09-21T06:36:52.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.848+0000 7f4a2a583740 1 --2- 172.21.15.7:0/3179080022 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5593f00589f0 0x5593f045eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:52.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.848+0000 7f4a2a583740 4 client.25340 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:36:52.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.848+0000 7f4a2a583740 1 -- 172.21.15.7:0/3179080022 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f4a0c031820 con 0x5593f00589f0 2024-09-21T06:36:52.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.849+0000 7f4a21dab640 1 --2- 172.21.15.7:0/3179080022 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5593f00589f0 0x5593f045eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:52.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.849+0000 7f4a21dab640 1 --2- 172.21.15.7:0/3179080022 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5593f00589f0 0x5593f045eaf0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47ee3e07b49d150c server_cookie=811c979df3dbbc01 in_seq=0 out_seq=0 2024-09-21T06:36:52.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.849+0000 7f4a057fa640 10 client.25340 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:36:52.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.850+0000 7f4a057fa640 1 -- 172.21.15.7:0/3179080022 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f4a0c031820 con 0x5593f00589f0 2024-09-21T06:36:52.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.850+0000 7f4a057fa640 10 client.25340 handle_command_reply: tid=0 2024-09-21T06:36:52.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.850+0000 7f4a2a583740 1 client.25340 shutdown 2024-09-21T06:36:52.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.850+0000 7f4a2a583740 1 -- 172.21.15.7:0/3179080022 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5593f0079390 msgr2=0x5593f044ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:52.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.850+0000 7f4a2a583740 1 --2- 172.21.15.7:0/3179080022 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5593f0079390 0x5593f044ced0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c000c00 tx=0x7f4a0c0319d0 comp rx=0 tx=0).stop 2024-09-21T06:36:52.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.850+0000 7f4a2a583740 1 -- 172.21.15.7:0/3179080022 shutdown_connections 2024-09-21T06:36:52.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.850+0000 7f4a2a583740 1 --2- 172.21.15.7:0/3179080022 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5593f00589f0 0x5593f045eaf0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:52.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.850+0000 7f4a057fa640 0 client.25340 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:36:52.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.850+0000 7f4a2a583740 1 --2- 172.21.15.7:0/3179080022 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5593f009a070 0x5593f0458d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:52.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.850+0000 7f4a2a583740 1 --2- 172.21.15.7:0/3179080022 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5593f0079390 0x5593f044ced0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:52.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.850+0000 7f4a2a583740 1 --2- 172.21.15.7:0/3179080022 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593f00711b0 0x5593f044c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:52.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.850+0000 7f4a2a583740 1 -- 172.21.15.7:0/3179080022 >> 172.21.15.7:0/3179080022 conn(0x5593f008e460 msgr2=0x5593f0444400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:52.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.850+0000 7f4a2a583740 1 -- 172.21.15.7:0/3179080022 shutdown_connections 2024-09-21T06:36:52.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.850+0000 7f4a2a583740 1 -- 172.21.15.7:0/3179080022 wait complete. 2024-09-21T06:36:52.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.850+0000 7f4a2a583740 20 client.25340 trim_cache size 0 max 16384 2024-09-21T06:36:52.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.868+0000 7f4a2a583740 1 Processor -- start 2024-09-21T06:36:52.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.868+0000 7f4a2a583740 1 -- start start 2024-09-21T06:36:52.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.868+0000 7f4a2a583740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5593f00711b0 0x5593f04429b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:52.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.868+0000 7f4a2a583740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593f0079390 0x5593f043e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:52.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.868+0000 7f4a2a583740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5593f009a070 0x5593f043ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:52.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.868+0000 7f4a2a583740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4a1c1afbc0 con 0x5593f0079390 2024-09-21T06:36:52.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.868+0000 7f4a2a583740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4a1c1ad490 con 0x5593f00711b0 2024-09-21T06:36:52.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.868+0000 7f4a2a583740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4a1c1ab2c0 con 0x5593f009a070 2024-09-21T06:36:52.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.869+0000 7f4a215aa640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593f0079390 0x5593f043e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:52.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.869+0000 7f4a215aa640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593f0079390 0x5593f043e710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45824/0 (socket says 172.21.15.7:45824) 2024-09-21T06:36:52.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.869+0000 7f4a215aa640 1 -- 172.21.15.7:0/1085522446 learned_addr learned my addr 172.21.15.7:0/1085522446 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:36:52.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.869+0000 7f4a21dab640 1 --2- 172.21.15.7:0/1085522446 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5593f00711b0 0x5593f04429b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:52.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.869+0000 7f4a225ac640 1 --2- 172.21.15.7:0/1085522446 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5593f009a070 0x5593f043ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:52.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.869+0000 7f4a21dab640 1 -- 172.21.15.7:0/1085522446 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5593f009a070 msgr2=0x5593f043ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:52.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.869+0000 7f4a21dab640 1 --2- 172.21.15.7:0/1085522446 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5593f009a070 0x5593f043ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:52.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.869+0000 7f4a21dab640 1 -- 172.21.15.7:0/1085522446 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593f0079390 msgr2=0x5593f043e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:52.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.869+0000 7f4a21dab640 1 --2- 172.21.15.7:0/1085522446 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593f0079390 0x5593f043e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:52.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.869+0000 7f4a21dab640 1 -- 172.21.15.7:0/1085522446 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593f0443560 con 0x5593f00711b0 2024-09-21T06:36:52.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.869+0000 7f4a225ac640 1 --2- 172.21.15.7:0/1085522446 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5593f009a070 0x5593f043ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:36:52.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.869+0000 7f4a215aa640 1 --2- 172.21.15.7:0/1085522446 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593f0079390 0x5593f043e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:36:52.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.870+0000 7f4a21dab640 1 --2- 172.21.15.7:0/1085522446 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5593f00711b0 0x5593f04429b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4a180a95b0 tx=0x7f4a18005760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0ed86161048b69f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:52.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.870+0000 7f4a077fe640 1 -- 172.21.15.7:0/1085522446 <== mon.2 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a18098070 con 0x5593f00711b0 2024-09-21T06:36:52.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.870+0000 7f4a077fe640 1 -- 172.21.15.7:0/1085522446 <== mon.2 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4a180b1ac0 con 0x5593f00711b0 2024-09-21T06:36:52.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.870+0000 7f4a077fe640 1 -- 172.21.15.7:0/1085522446 <== mon.2 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a18020040 con 0x5593f00711b0 2024-09-21T06:36:52.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.871+0000 7f4a2a583740 1 -- 172.21.15.7:0/1085522446 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5593f00711b0 msgr2=0x5593f04429b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:52.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.871+0000 7f4a2a583740 1 --2- 172.21.15.7:0/1085522446 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5593f00711b0 0x5593f04429b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4a180a95b0 tx=0x7f4a18005760 comp rx=0 tx=0).stop 2024-09-21T06:36:52.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.871+0000 7f4a2a583740 1 -- 172.21.15.7:0/1085522446 shutdown_connections 2024-09-21T06:36:52.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.871+0000 7f4a2a583740 1 --2- 172.21.15.7:0/1085522446 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5593f009a070 0x5593f043ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:52.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.871+0000 7f4a2a583740 1 --2- 172.21.15.7:0/1085522446 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593f0079390 0x5593f043e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:52.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.871+0000 7f4a2a583740 1 --2- 172.21.15.7:0/1085522446 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5593f00711b0 0x5593f04429b0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:52.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.871+0000 7f4a2a583740 1 -- 172.21.15.7:0/1085522446 >> 172.21.15.7:0/1085522446 conn(0x5593f008e460 msgr2=0x5593f04422a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:52.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.871+0000 7f4a2a583740 1 -- 172.21.15.7:0/1085522446 shutdown_connections 2024-09-21T06:36:52.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.871+0000 7f4a2a583740 1 -- 172.21.15.7:0/1085522446 wait complete. 2024-09-21T06:36:52.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.872+0000 7f4a2a583740 1 -- start start 2024-09-21T06:36:52.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.872+0000 7f4a2a583740 1 Processor -- start 2024-09-21T06:36:52.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.872+0000 7f4a2a583740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5593f00711b0 0x5593f045fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:52.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.872+0000 7f4a2a583740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593f0079390 0x5593f04601a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:52.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.872+0000 7f4a2a583740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5593f009a070 0x5593f04606e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:52.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.872+0000 7f4a2a583740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4a1c1ab950 con 0x5593f0079390 2024-09-21T06:36:52.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.872+0000 7f4a2a583740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4a1c1acdc0 con 0x5593f009a070 2024-09-21T06:36:52.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.872+0000 7f4a2a583740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4a1c1ac020 con 0x5593f00711b0 2024-09-21T06:36:52.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.872+0000 7f4a2a583740 10 client.0 _ll_register_callbacks cb 0x7f4a0c040070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:36:52.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.873+0000 7f4a215aa640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593f0079390 0x5593f04601a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:52.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.873+0000 7f4a21dab640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5593f00711b0 0x5593f045fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:52.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.873+0000 7f4a21dab640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5593f00711b0 0x5593f045fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.7:40166/0 (socket says 172.21.15.7:40166) 2024-09-21T06:36:52.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.873+0000 7f4a21dab640 1 -- 172.21.15.7:0/532816503 learned_addr learned my addr 172.21.15.7:0/532816503 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:36:52.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.873+0000 7f4a215aa640 1 --2- 172.21.15.7:0/532816503 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593f0079390 0x5593f04601a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45840/0 (socket says 172.21.15.7:45840) 2024-09-21T06:36:52.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.873+0000 7f4a225ac640 1 --2- 172.21.15.7:0/532816503 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5593f009a070 0x5593f04606e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:52.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.873+0000 7f4a21dab640 1 -- 172.21.15.7:0/532816503 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5593f009a070 msgr2=0x5593f04606e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:52.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.873+0000 7f4a21dab640 1 --2- 172.21.15.7:0/532816503 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5593f009a070 0x5593f04606e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:52.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.873+0000 7f4a21dab640 1 -- 172.21.15.7:0/532816503 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593f0079390 msgr2=0x5593f04601a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:52.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.873+0000 7f4a21dab640 1 --2- 172.21.15.7:0/532816503 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593f0079390 0x5593f04601a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:52.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.873+0000 7f4a21dab640 1 -- 172.21.15.7:0/532816503 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593f04c83d0 con 0x5593f00711b0 2024-09-21T06:36:52.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.873+0000 7f4a21dab640 1 --2- 172.21.15.7:0/532816503 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5593f00711b0 0x5593f045fc60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4a1800d6a0 tx=0x7f4a180ac750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd9b7bd11f5172dd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:52.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.873+0000 7f4a057fa640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-21T06:36:52.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.873+0000 7f4a057fa640 1 -- 172.21.15.7:0/532816503 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a18020070 con 0x5593f00711b0 2024-09-21T06:36:52.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.873+0000 7f4a057fa640 1 -- 172.21.15.7:0/532816503 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f4a180981e0 con 0x5593f00711b0 2024-09-21T06:36:52.878 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.873+0000 7f4a2a583740 1 -- 172.21.15.7:0/532816503 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4a180b1ac0 con 0x5593f00711b0 2024-09-21T06:36:52.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.874+0000 7f4a057fa640 1 -- 172.21.15.7:0/532816503 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4a18098040 con 0x5593f00711b0 2024-09-21T06:36:52.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.874+0000 7f4a2a583740 10 client.25207 fetch_fsmap learned FSMap version 25 2024-09-21T06:36:52.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.874+0000 7f4a2a583740 1 -- 172.21.15.7:0/532816503 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5593f04c9640 con 0x5593f00711b0 2024-09-21T06:36:52.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.874+0000 7f4a057fa640 1 -- 172.21.15.7:0/532816503 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4a180a9250 con 0x5593f00711b0 2024-09-21T06:36:52.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.874+0000 7f4a057fa640 1 -- 172.21.15.7:0/532816503 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f4a180abcb0 con 0x5593f00711b0 2024-09-21T06:36:52.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.874+0000 7f4a2a583740 10 client.25207 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:36:52.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.874+0000 7f4a2a583740 10 client.25207 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:36:52.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.874+0000 7f4a2a583740 20 client.25207 populate_metadata read hostname 'smithi007' 2024-09-21T06:36:52.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.875+0000 7f4a2a583740 1 --2- 172.21.15.7:0/532816503 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5593f002dda0 0x5593f04cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:52.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.875+0000 7f4a2a583740 4 client.25207 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:36:52.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.875+0000 7f4a2a583740 1 -- 172.21.15.7:0/532816503 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f4a180b1ac0 con 0x5593f002dda0 2024-09-21T06:36:52.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.875+0000 7f4a215aa640 1 --2- 172.21.15.7:0/532816503 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5593f002dda0 0x5593f04cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:52.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.875+0000 7f4a215aa640 1 --2- 172.21.15.7:0/532816503 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5593f002dda0 0x5593f04cbd30 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86a527cdef1e4134 server_cookie=ccc26a662ca85601 in_seq=0 out_seq=0 2024-09-21T06:36:52.879 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.876+0000 7f4a057fa640 10 client.25207 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:36:52.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.876+0000 7f4a057fa640 1 -- 172.21.15.7:0/532816503 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+374 (crc 0 0 0) 0x7f4a180b1ac0 con 0x5593f002dda0 2024-09-21T06:36:52.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.876+0000 7f4a057fa640 10 client.25207 handle_command_reply: tid=0 2024-09-21T06:36:52.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.876+0000 7f4a2a583740 1 client.25207 shutdown 2024-09-21T06:36:52.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.876+0000 7f4a2a583740 1 -- 172.21.15.7:0/532816503 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5593f00711b0 msgr2=0x5593f045fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:52.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.876+0000 7f4a2a583740 1 --2- 172.21.15.7:0/532816503 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5593f00711b0 0x5593f045fc60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4a1800d6a0 tx=0x7f4a180ac750 comp rx=0 tx=0).stop 2024-09-21T06:36:52.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.876+0000 7f4a2a583740 1 -- 172.21.15.7:0/532816503 shutdown_connections 2024-09-21T06:36:52.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.876+0000 7f4a2a583740 1 --2- 172.21.15.7:0/532816503 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5593f002dda0 0x5593f04cbd30 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:52.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.876+0000 7f4a2a583740 1 --2- 172.21.15.7:0/532816503 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5593f009a070 0x5593f04606e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:52.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.876+0000 7f4a2a583740 1 --2- 172.21.15.7:0/532816503 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593f0079390 0x5593f04601a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:52.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.876+0000 7f4a2a583740 1 --2- 172.21.15.7:0/532816503 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5593f00711b0 0x5593f045fc60 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:52.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.876+0000 7f4a2a583740 1 -- 172.21.15.7:0/532816503 >> 172.21.15.7:0/532816503 conn(0x5593f008e460 msgr2=0x5593f044ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:52.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.876+0000 7f4a057fa640 0 client.25207 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:36:52.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.876+0000 7f4a2a583740 1 -- 172.21.15.7:0/532816503 shutdown_connections 2024-09-21T06:36:52.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.876+0000 7f4a2a583740 1 -- 172.21.15.7:0/532816503 wait complete. 2024-09-21T06:36:52.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.877+0000 7f4a2a583740 20 client.25207 trim_cache size 0 max 16384 2024-09-21T06:36:52.882 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:36:52.882 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "no active scrubs running", 2024-09-21T06:36:52.882 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": {}, 2024-09-21T06:36:52.882 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_stats": { 2024-09-21T06:36:52.882 INFO:teuthology.orchestra.run.smithi007.stdout: "0b89345c-1f00-4efe-8ee9-4cb17e43584c": { 2024-09-21T06:36:52.882 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:36:19.500334+0000", 2024-09-21T06:36:52.882 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:36:52.883 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:36:52.883 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:36:52.883 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:36:52.883 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:36:52.883 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:36:52.883 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:36:52.883 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:36:52.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.877+0000 7f4a2400f640 1 -- 172.21.15.7:0/3556197730 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f4a080b6670 msgr2=0x7f4a080b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:52.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.877+0000 7f4a2400f640 1 --2- 172.21.15.7:0/3556197730 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f4a080b6670 0x7f4a080b8b80 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4a14005fd0 tx=0x7f4a14009500 comp rx=0 tx=0).stop 2024-09-21T06:36:52.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.877+0000 7f4a2400f640 1 -- 172.21.15.7:0/3556197730 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a1c103bc0 msgr2=0x7f4a1c19a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:52.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.877+0000 7f4a2400f640 1 --2- 172.21.15.7:0/3556197730 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a1c103bc0 0x7f4a1c19a490 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4a1800d6d0 tx=0x7f4a1800db90 comp rx=0 tx=0).stop 2024-09-21T06:36:52.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.878+0000 7f4a2400f640 1 -- 172.21.15.7:0/3556197730 shutdown_connections 2024-09-21T06:36:52.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.878+0000 7f4a2400f640 1 --2- 172.21.15.7:0/3556197730 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f4a080b6670 0x7f4a080b8b80 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:52.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.878+0000 7f4a2400f640 1 --2- 172.21.15.7:0/3556197730 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4a1c109e00 0x7f4a1c19fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:52.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.878+0000 7f4a2400f640 1 --2- 172.21.15.7:0/3556197730 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4a1c1094b0 0x7f4a1c19aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:52.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.878+0000 7f4a2400f640 1 --2- 172.21.15.7:0/3556197730 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a1c103bc0 0x7f4a1c19a490 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:52.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.878+0000 7f4a2400f640 1 -- 172.21.15.7:0/3556197730 >> 172.21.15.7:0/3556197730 conn(0x7f4a1c07b910 msgr2=0x7f4a1c1075a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:52.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.878+0000 7f4a2400f640 1 -- 172.21.15.7:0/3556197730 shutdown_connections 2024-09-21T06:36:52.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:52.878+0000 7f4a2400f640 1 -- 172.21.15.7:0/3556197730 wait complete. 2024-09-21T06:36:53.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:36:52 smithi007 ceph-mon[30983]: pgmap v339: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-21T06:36:53.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:36:52 smithi144 ceph-mon[34653]: pgmap v339: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-21T06:36:53.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:36:52 smithi018 ceph-mon[34477]: pgmap v339: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-21T06:36:53.702 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:36:53.702 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:36:54.051 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:36:54.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:54.600+0000 7faa9862c640 1 -- 172.21.15.7:0/1723494927 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa90102aa0 msgr2=0x7faa90102eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:54.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:54.600+0000 7faa9862c640 1 --2- 172.21.15.7:0/1723494927 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa90102aa0 0x7faa90102eb0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7faa8c009900 tx=0x7faa8c02a410 comp rx=0 tx=0).stop 2024-09-21T06:36:54.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:54.600+0000 7faa9862c640 1 -- 172.21.15.7:0/1723494927 shutdown_connections 2024-09-21T06:36:54.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:54.600+0000 7faa9862c640 1 --2- 172.21.15.7:0/1723494927 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa90108d30 0x7faa9010f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:54.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:54.600+0000 7faa9862c640 1 --2- 172.21.15.7:0/1723494927 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa901083e0 0x7faa901087f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:54.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:54.600+0000 7faa9862c640 1 --2- 172.21.15.7:0/1723494927 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa90102aa0 0x7faa90102eb0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:54.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:54.600+0000 7faa9862c640 1 -- 172.21.15.7:0/1723494927 >> 172.21.15.7:0/1723494927 conn(0x7faa90079750 msgr2=0x7faa90079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:54.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:54.601+0000 7faa9862c640 1 -- 172.21.15.7:0/1723494927 shutdown_connections 2024-09-21T06:36:54.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:54.601+0000 7faa9862c640 1 -- 172.21.15.7:0/1723494927 wait complete. 2024-09-21T06:36:54.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:54.602+0000 7faa9862c640 1 Processor -- start 2024-09-21T06:36:54.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:54.602+0000 7faa9862c640 1 -- start start 2024-09-21T06:36:54.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:54.602+0000 7faa9862c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa90102aa0 0x7faa9019a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:54.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:54.602+0000 7faa9862c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa901083e0 0x7faa9019aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:54.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:54.602+0000 7faa9862c640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa90108d30 0x7faa9019fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:54.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:54.602+0000 7faa9862c640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7faa90113b40 con 0x7faa901083e0 2024-09-21T06:36:54.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:54.602+0000 7faa9862c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7faa901139c0 con 0x7faa90102aa0 2024-09-21T06:36:54.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:54.602+0000 7faa9862c640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7faa90113cc0 con 0x7faa90108d30 2024-09-21T06:36:54.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:54.602+0000 7faa963c8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa90102aa0 0x7faa9019a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:54.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:54.602+0000 7faa963c8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa90102aa0 0x7faa9019a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.7:52982/0 (socket says 172.21.15.7:52982) 2024-09-21T06:36:54.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:54.602+0000 7faa963c8640 1 -- 172.21.15.7:0/131612946 learned_addr learned my addr 172.21.15.7:0/131612946 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:36:54.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:54.603+0000 7faa95bc7640 1 --2- 172.21.15.7:0/131612946 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa901083e0 0x7faa9019aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:54.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:54.603+0000 7faa96bc9640 1 --2- 172.21.15.7:0/131612946 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa90108d30 0x7faa9019fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:54.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:54.603+0000 7faa963c8640 1 -- 172.21.15.7:0/131612946 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa90108d30 msgr2=0x7faa9019fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:54.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:54.603+0000 7faa963c8640 1 --2- 172.21.15.7:0/131612946 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa90108d30 0x7faa9019fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:54.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:54.603+0000 7faa963c8640 1 -- 172.21.15.7:0/131612946 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa901083e0 msgr2=0x7faa9019aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:54.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:54.603+0000 7faa963c8640 1 --2- 172.21.15.7:0/131612946 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa901083e0 0x7faa9019aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:54.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:54.603+0000 7faa963c8640 1 -- 172.21.15.7:0/131612946 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa901a0460 con 0x7faa90102aa0 2024-09-21T06:36:54.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:54.603+0000 7faa963c8640 1 --2- 172.21.15.7:0/131612946 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa90102aa0 0x7faa9019a4f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7faa8c005ab0 tx=0x7faa8c003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:54.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:54.603+0000 7faa877fe640 1 -- 172.21.15.7:0/131612946 <== mon.2 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa8c03f070 con 0x7faa90102aa0 2024-09-21T06:36:54.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:54.604+0000 7faa877fe640 1 -- 172.21.15.7:0/131612946 <== mon.2 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa8c031b60 con 0x7faa90102aa0 2024-09-21T06:36:54.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:54.604+0000 7faa9862c640 1 -- 172.21.15.7:0/131612946 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa901a06f0 con 0x7faa90102aa0 2024-09-21T06:36:54.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:54.604+0000 7faa9862c640 1 -- 172.21.15.7:0/131612946 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa9010ff20 con 0x7faa90102aa0 2024-09-21T06:36:54.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:54.604+0000 7faa877fe640 1 -- 172.21.15.7:0/131612946 <== mon.2 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa8c035030 con 0x7faa90102aa0 2024-09-21T06:36:54.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:54.605+0000 7faa9862c640 1 -- 172.21.15.7:0/131612946 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa90103d20 con 0x7faa90102aa0 2024-09-21T06:36:54.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:54.609+0000 7faa877fe640 1 -- 172.21.15.7:0/131612946 <== mon.2 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 24) ==== 154585+0+0 (secure 0 0 0) 0x7faa8c042070 con 0x7faa90102aa0 2024-09-21T06:36:54.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:54.610+0000 7faa877fe640 1 --2- 172.21.15.7:0/131612946 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7faa7c0b6670 0x7faa7c0b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:54.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:54.611+0000 7faa95bc7640 1 --2- 172.21.15.7:0/131612946 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7faa7c0b6670 0x7faa7c0b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:54.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:54.611+0000 7faa877fe640 1 -- 172.21.15.7:0/131612946 <== mon.2 v2:172.21.15.18:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7faa8c1084c0 con 0x7faa90102aa0 2024-09-21T06:36:54.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:54.611+0000 7faa95bc7640 1 --2- 172.21.15.7:0/131612946 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7faa7c0b6670 0x7faa7c0b8b80 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7faa90107f40 tx=0x7faa80005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:54.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:54.612+0000 7faa877fe640 1 -- 172.21.15.7:0/131612946 <== mon.2 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7faa8c049030 con 0x7faa90102aa0 2024-09-21T06:36:54.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:54.996+0000 7faa9862c640 1 -- 172.21.15.7:0/131612946 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faa90102eb0 con 0x7faa90102aa0 2024-09-21T06:36:54.999 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:36:54.999 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-21T06:36:10:753693+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2015971546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2015971546},{"type":"v1","addr":"172.21.15.7:6835","nonce":2015971546}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/2350816224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":2350816224},{"type":"v1","addr":"172.21.15.7:6837","nonce":2350816224}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14823,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/1669980572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":1669980572},{"type":"v1","addr":"172.21.15.7:6839","nonce":1669980572}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14835,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/2528308973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":2528308973},{"type":"v1","addr":"172.21.15.7:6841","nonce":2528308973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24623,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1337382979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1337382979},{"type":"v1","addr":"172.21.15.18:6833","nonce":1337382979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/2751454345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":2751454345},{"type":"v1","addr":"172.21.15.144:6833","nonce":2751454345}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:34:24.627168+0000","modified":"2024-09-21T06:36:10.737288+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24716,"mds_1":24688,"mds_2":24686},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24656":{"gid":24656,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6835/158884796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":158884796},{"type":"v1","addr":"172.21.15.18:6835","nonce":158884796}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6835/3636739922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3636739922},{"type":"v1","addr":"172.21.15.144:6835","nonce":3636739922}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24673":{"gid":24673,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6837/1126341753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":1126341753},{"type":"v1","addr":"172.21.15.144:6837","nonce":1126341753}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.18:6837/1539670694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1539670694},{"type":"v1","addr":"172.21.15.18:6837","nonce":1539670694}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24688":{"gid":24688,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.144:6839/4027821922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":4027821922},{"type":"v1","addr":"172.21.15.144:6839","nonce":4027821922}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24716":{"gid":24716,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.18:6839/3798713532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":3798713532},{"type":"v1","addr":"172.21.15.18:6839","nonce":3798713532}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24716,"qdb_cluster":[24716,24688,24686]},"id":1}]} 2024-09-21T06:36:54.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:54.997+0000 7faa877fe640 1 -- 172.21.15.7:0/131612946 <== mon.2 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11899 (secure 0 0 0) 0x7faa8c0d2f50 con 0x7faa90102aa0 2024-09-21T06:36:54.999 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-21T06:36:55.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:55.000+0000 7faa9862c640 1 -- 172.21.15.7:0/131612946 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7faa7c0b6670 msgr2=0x7faa7c0b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:55.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:55.000+0000 7faa9862c640 1 --2- 172.21.15.7:0/131612946 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7faa7c0b6670 0x7faa7c0b8b80 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7faa90107f40 tx=0x7faa80005f90 comp rx=0 tx=0).stop 2024-09-21T06:36:55.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:55.000+0000 7faa9862c640 1 -- 172.21.15.7:0/131612946 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa90102aa0 msgr2=0x7faa9019a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:55.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:55.000+0000 7faa9862c640 1 --2- 172.21.15.7:0/131612946 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa90102aa0 0x7faa9019a4f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7faa8c005ab0 tx=0x7faa8c003c10 comp rx=0 tx=0).stop 2024-09-21T06:36:55.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:55.000+0000 7faa9862c640 1 -- 172.21.15.7:0/131612946 shutdown_connections 2024-09-21T06:36:55.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:55.001+0000 7faa9862c640 1 --2- 172.21.15.7:0/131612946 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7faa7c0b6670 0x7faa7c0b8b80 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:55.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:55.001+0000 7faa9862c640 1 --2- 172.21.15.7:0/131612946 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faa90108d30 0x7faa9019fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:55.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:55.001+0000 7faa9862c640 1 --2- 172.21.15.7:0/131612946 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faa901083e0 0x7faa9019aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:55.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:55.001+0000 7faa9862c640 1 --2- 172.21.15.7:0/131612946 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa90102aa0 0x7faa9019a4f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:55.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:55.001+0000 7faa9862c640 1 -- 172.21.15.7:0/131612946 >> 172.21.15.7:0/131612946 conn(0x7faa90079750 msgr2=0x7faa90106470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:55.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:55.001+0000 7faa9862c640 1 -- 172.21.15.7:0/131612946 shutdown_connections 2024-09-21T06:36:55.004 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:55.001+0000 7faa9862c640 1 -- 172.21.15.7:0/131612946 wait complete. 2024-09-21T06:36:55.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:36:54 smithi144 ceph-mon[34653]: pgmap v340: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-21T06:36:55.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:36:54 smithi007 ceph-mon[30983]: pgmap v340: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-21T06:36:55.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:36:54 smithi018 ceph-mon[34477]: pgmap v340: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-21T06:36:55.718 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:36:56.035 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:36:56.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:36:55 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/131612946' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:36:56.270 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:36:55 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/131612946' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:36:56.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:36:55 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/131612946' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:36:56.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.612+0000 7f5763e6a640 1 -- 172.21.15.7:0/845600621 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f575c10de30 msgr2=0x7f575c110300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:56.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.612+0000 7f5763e6a640 1 --2- 172.21.15.7:0/845600621 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f575c10de30 0x7f575c110300 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f5754009ca0 tx=0x7f575402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:36:56.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.613+0000 7f5763e6a640 1 -- 172.21.15.7:0/845600621 shutdown_connections 2024-09-21T06:36:56.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.613+0000 7f5763e6a640 1 --2- 172.21.15.7:0/845600621 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f575c10de30 0x7f575c110300 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:56.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.613+0000 7f5763e6a640 1 --2- 172.21.15.7:0/845600621 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f575c1052b0 0x7f575c10d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:56.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.613+0000 7f5763e6a640 1 --2- 172.21.15.7:0/845600621 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f575c104880 0x7f575c104c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:56.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.613+0000 7f5763e6a640 1 -- 172.21.15.7:0/845600621 >> 172.21.15.7:0/845600621 conn(0x7f575c079730 msgr2=0x7f575c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:56.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.613+0000 7f5763e6a640 1 -- 172.21.15.7:0/845600621 shutdown_connections 2024-09-21T06:36:56.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.613+0000 7f5763e6a640 1 -- 172.21.15.7:0/845600621 wait complete. 2024-09-21T06:36:56.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.614+0000 7f5763e6a640 1 Processor -- start 2024-09-21T06:36:56.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.614+0000 7f5763e6a640 1 -- start start 2024-09-21T06:36:56.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.614+0000 7f5763e6a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f575c104880 0x7f575c19a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:56.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.614+0000 7f5763e6a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f575c1052b0 0x7f575c19aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:56.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.614+0000 7f5763e6a640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f575c10de30 0x7f575c19fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:56.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.615+0000 7f5763e6a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f575c113ac0 con 0x7f575c104880 2024-09-21T06:36:56.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.615+0000 7f5763e6a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f575c113940 con 0x7f575c1052b0 2024-09-21T06:36:56.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.615+0000 7f5763e6a640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f575c113c40 con 0x7f575c10de30 2024-09-21T06:36:56.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.615+0000 7f5761c06640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f575c104880 0x7f575c19a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:56.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.615+0000 7f5762407640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f575c10de30 0x7f575c19fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:56.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.615+0000 7f5762407640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f575c10de30 0x7f575c19fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.7:40200/0 (socket says 172.21.15.7:40200) 2024-09-21T06:36:56.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.615+0000 7f5762407640 1 -- 172.21.15.7:0/360378977 learned_addr learned my addr 172.21.15.7:0/360378977 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:36:56.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.615+0000 7f5761c06640 1 --2- 172.21.15.7:0/360378977 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f575c104880 0x7f575c19a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45886/0 (socket says 172.21.15.7:45886) 2024-09-21T06:36:56.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.615+0000 7f5761405640 1 --2- 172.21.15.7:0/360378977 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f575c1052b0 0x7f575c19aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:56.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.615+0000 7f5762407640 1 -- 172.21.15.7:0/360378977 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f575c1052b0 msgr2=0x7f575c19aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:56.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.615+0000 7f5762407640 1 --2- 172.21.15.7:0/360378977 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f575c1052b0 0x7f575c19aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:56.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.615+0000 7f5762407640 1 -- 172.21.15.7:0/360378977 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f575c104880 msgr2=0x7f575c19a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:56.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.615+0000 7f5762407640 1 --2- 172.21.15.7:0/360378977 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f575c104880 0x7f575c19a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:56.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.615+0000 7f5762407640 1 -- 172.21.15.7:0/360378977 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f575c1a0420 con 0x7f575c10de30 2024-09-21T06:36:56.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.615+0000 7f5761c06640 1 --2- 172.21.15.7:0/360378977 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f575c104880 0x7f575c19a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:36:56.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.616+0000 7f5762407640 1 --2- 172.21.15.7:0/360378977 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f575c10de30 0x7f575c19fcf0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f575402f540 tx=0x7f57540316f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:56.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.616+0000 7f5752ffd640 1 -- 172.21.15.7:0/360378977 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5754003b70 con 0x7f575c10de30 2024-09-21T06:36:56.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.616+0000 7f5763e6a640 1 -- 172.21.15.7:0/360378977 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f575c1a06b0 con 0x7f575c10de30 2024-09-21T06:36:56.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.616+0000 7f5752ffd640 1 -- 172.21.15.7:0/360378977 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5754003d10 con 0x7f575c10de30 2024-09-21T06:36:56.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.616+0000 7f5752ffd640 1 -- 172.21.15.7:0/360378977 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f575402fa30 con 0x7f575c10de30 2024-09-21T06:36:56.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.616+0000 7f5763e6a640 1 -- 172.21.15.7:0/360378977 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f575c102670 con 0x7f575c10de30 2024-09-21T06:36:56.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.619+0000 7f576a3de740 1 Processor -- start 2024-09-21T06:36:56.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.621+0000 7f5752ffd640 1 -- 172.21.15.7:0/360378977 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 24) ==== 154585+0+0 (secure 0 0 0) 0x7f575402fbd0 con 0x7f575c10de30 2024-09-21T06:36:56.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.621+0000 7f576a3de740 1 -- start start 2024-09-21T06:36:56.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.621+0000 7f576a3de740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558947fe2070 0x5589483892c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:56.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.621+0000 7f576a3de740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558947fb91b0 0x558948389800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:56.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.621+0000 7f576a3de740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558947fc1390 0x558948389d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:56.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.621+0000 7f576a3de740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5589482ffea0 con 0x558947fe2070 2024-09-21T06:36:56.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.621+0000 7f576a3de740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5589482ef2d0 con 0x558947fb91b0 2024-09-21T06:36:56.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.621+0000 7f576a3de740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5589482f30e0 con 0x558947fc1390 2024-09-21T06:36:56.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.622+0000 7f5761405640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558947fe2070 0x5589483892c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:56.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.622+0000 7f5761c06640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558947fb91b0 0x558948389800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:56.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.622+0000 7f5761c06640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558947fb91b0 0x558948389800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.7:53008/0 (socket says 172.21.15.7:53008) 2024-09-21T06:36:56.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.622+0000 7f5761c06640 1 -- 172.21.15.7:0/1272510342 learned_addr learned my addr 172.21.15.7:0/1272510342 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:36:56.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.622+0000 7f5752ffd640 1 --2- 172.21.15.7:0/360378977 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f57480b6670 0x7f57480b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:56.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.622+0000 7f5761c06640 1 -- 172.21.15.7:0/1272510342 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558947fc1390 msgr2=0x558948389d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:56.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.622+0000 7f5761c06640 1 --2- 172.21.15.7:0/1272510342 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558947fc1390 0x558948389d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:56.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.622+0000 7f5761c06640 1 -- 172.21.15.7:0/1272510342 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558947fe2070 msgr2=0x5589483892c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:56.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.622+0000 7f5761c06640 1 --2- 172.21.15.7:0/1272510342 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558947fe2070 0x5589483892c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:56.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.622+0000 7f5761c06640 1 -- 172.21.15.7:0/1272510342 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55894804d650 con 0x558947fb91b0 2024-09-21T06:36:56.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.622+0000 7f5752ffd640 1 -- 172.21.15.7:0/360378977 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f5754108770 con 0x7f575c10de30 2024-09-21T06:36:56.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.622+0000 7f5761405640 1 --2- 172.21.15.7:0/1272510342 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558947fe2070 0x5589483892c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:36:56.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.622+0000 7f5762407640 1 --2- 172.21.15.7:0/360378977 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f57480b6670 0x7f57480b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:56.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.623+0000 7f5761c06640 1 --2- 172.21.15.7:0/1272510342 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558947fb91b0 0x558948389800 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f57580114c0 tx=0x7f5758011980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=956475fb176bf056 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:56.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.623+0000 7f5747fff640 1 -- 172.21.15.7:0/1272510342 <== mon.2 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5758004020 con 0x558947fb91b0 2024-09-21T06:36:56.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.623+0000 7f5762407640 1 --2- 172.21.15.7:0/360378977 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f57480b6670 0x7f57480b8b80 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f57540cacb0 tx=0x7f57540095c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:56.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.624+0000 7f5747fff640 1 -- 172.21.15.7:0/1272510342 <== mon.2 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f57580041c0 con 0x558947fb91b0 2024-09-21T06:36:56.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.624+0000 7f5747fff640 1 -- 172.21.15.7:0/1272510342 <== mon.2 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f575800f930 con 0x558947fb91b0 2024-09-21T06:36:56.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.625+0000 7f576a3de740 1 -- 172.21.15.7:0/1272510342 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558947fb91b0 msgr2=0x558948389800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:56.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.625+0000 7f576a3de740 1 --2- 172.21.15.7:0/1272510342 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558947fb91b0 0x558948389800 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f57580114c0 tx=0x7f5758011980 comp rx=0 tx=0).stop 2024-09-21T06:36:56.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.625+0000 7f576a3de740 1 -- 172.21.15.7:0/1272510342 shutdown_connections 2024-09-21T06:36:56.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.625+0000 7f576a3de740 1 --2- 172.21.15.7:0/1272510342 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558947fc1390 0x558948389d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:56.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.625+0000 7f576a3de740 1 --2- 172.21.15.7:0/1272510342 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558947fb91b0 0x558948389800 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:56.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.625+0000 7f576a3de740 1 --2- 172.21.15.7:0/1272510342 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558947fe2070 0x5589483892c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:56.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.625+0000 7f576a3de740 1 -- 172.21.15.7:0/1272510342 >> 172.21.15.7:0/1272510342 conn(0x558947fd6460 msgr2=0x5589483871b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:56.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.625+0000 7f576a3de740 1 -- 172.21.15.7:0/1272510342 shutdown_connections 2024-09-21T06:36:56.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.625+0000 7f576a3de740 1 -- 172.21.15.7:0/1272510342 wait complete. 2024-09-21T06:36:56.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.626+0000 7f576a3de740 1 -- start start 2024-09-21T06:36:56.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.626+0000 7f576a3de740 1 Processor -- start 2024-09-21T06:36:56.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.627+0000 7f576a3de740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558947fb91b0 0x55894839da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:56.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.627+0000 7f576a3de740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558947fc1390 0x55894839e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:56.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.627+0000 7f576a3de740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558947fe2070 0x5589483a3070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:56.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.627+0000 7f576a3de740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x558948150700 con 0x558947fe2070 2024-09-21T06:36:56.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.627+0000 7f576a3de740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55894828a160 con 0x558947fc1390 2024-09-21T06:36:56.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.627+0000 7f576a3de740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x558948397aa0 con 0x558947fb91b0 2024-09-21T06:36:56.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.627+0000 7f576a3de740 10 client.0 _ll_register_callbacks cb 0x5589482a39e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:36:56.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.627+0000 7f5761c06640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558947fc1390 0x55894839e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:56.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.627+0000 7f5761c06640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558947fc1390 0x55894839e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.7:53024/0 (socket says 172.21.15.7:53024) 2024-09-21T06:36:56.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.627+0000 7f5761c06640 1 -- 172.21.15.7:0/922966988 learned_addr learned my addr 172.21.15.7:0/922966988 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:36:56.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.627+0000 7f5761405640 1 --2- 172.21.15.7:0/922966988 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558947fe2070 0x5589483a3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:56.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.627+0000 7f5761c06640 1 -- 172.21.15.7:0/922966988 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558947fb91b0 msgr2=0x55894839da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:56.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.627+0000 7f5761c06640 1 --2- 172.21.15.7:0/922966988 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558947fb91b0 0x55894839da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:56.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.627+0000 7f5761c06640 1 -- 172.21.15.7:0/922966988 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558947fe2070 msgr2=0x5589483a3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:56.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.628+0000 7f5761c06640 1 --2- 172.21.15.7:0/922966988 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558947fe2070 0x5589483a3070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:56.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.628+0000 7f5761c06640 1 -- 172.21.15.7:0/922966988 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589482b7c90 con 0x558947fc1390 2024-09-21T06:36:56.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.628+0000 7f5761405640 1 --2- 172.21.15.7:0/922966988 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558947fe2070 0x5589483a3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:36:56.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.628+0000 7f5761c06640 1 --2- 172.21.15.7:0/922966988 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558947fc1390 0x55894839e050 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f575800a010 tx=0x7f5758005db0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fda3e1aa2ddd5118 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:56.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.628+0000 7f57457fa640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-21T06:36:56.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.628+0000 7f57457fa640 1 -- 172.21.15.7:0/922966988 <== mon.2 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f575801d050 con 0x558947fc1390 2024-09-21T06:36:56.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.628+0000 7f57457fa640 1 -- 172.21.15.7:0/922966988 <== mon.2 v2:172.21.15.18:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f5758016040 con 0x558947fc1390 2024-09-21T06:36:56.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.628+0000 7f576a3de740 1 -- 172.21.15.7:0/922966988 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f57580041c0 con 0x558947fc1390 2024-09-21T06:36:56.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.629+0000 7f57457fa640 1 -- 172.21.15.7:0/922966988 <== mon.2 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f57580035f0 con 0x558947fc1390 2024-09-21T06:36:56.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.629+0000 7f576a3de740 10 client.25364 fetch_fsmap learned FSMap version 25 2024-09-21T06:36:56.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.629+0000 7f576a3de740 1 -- 172.21.15.7:0/922966988 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5589483abfc0 con 0x558947fc1390 2024-09-21T06:36:56.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.629+0000 7f57457fa640 1 -- 172.21.15.7:0/922966988 <== mon.2 v2:172.21.15.18:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f57580041c0 con 0x558947fc1390 2024-09-21T06:36:56.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.630+0000 7f57457fa640 1 -- 172.21.15.7:0/922966988 <== mon.2 v2:172.21.15.18:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f5758004b40 con 0x558947fc1390 2024-09-21T06:36:56.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.630+0000 7f576a3de740 10 client.25364 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:36:56.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.630+0000 7f576a3de740 10 client.25364 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-21T06:36:56.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.630+0000 7f576a3de740 20 client.25364 populate_metadata read hostname 'smithi007' 2024-09-21T06:36:56.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.630+0000 7f576a3de740 1 --2- 172.21.15.7:0/922966988 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x558947fa09f0 0x5589483af320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:56.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.630+0000 7f576a3de740 4 client.25364 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:36:56.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.630+0000 7f576a3de740 1 -- 172.21.15.7:0/922966988 --> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558948301df0 con 0x558947fa09f0 2024-09-21T06:36:56.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.630+0000 7f5761405640 1 --2- 172.21.15.7:0/922966988 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x558947fa09f0 0x5589483af320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:56.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.631+0000 7f5761405640 1 --2- 172.21.15.7:0/922966988 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x558947fa09f0 0x5589483af320 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4cbec2b7ccc984dc server_cookie=2698acc9c88db9a2 in_seq=0 out_seq=0 2024-09-21T06:36:56.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.631+0000 7f57457fa640 10 client.25364 ms_handle_connect on v2:172.21.15.18:6836/1539670694 2024-09-21T06:36:56.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.632+0000 7f57457fa640 1 -- 172.21.15.7:0/922966988 <== mds.2 v2:172.21.15.18:6836/1539670694 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558948301df0 con 0x558947fa09f0 2024-09-21T06:36:56.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.632+0000 7f57457fa640 10 client.25364 handle_command_reply: tid=0 2024-09-21T06:36:56.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.632+0000 7f576a3de740 1 client.25364 shutdown 2024-09-21T06:36:56.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.632+0000 7f576a3de740 1 -- 172.21.15.7:0/922966988 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558947fc1390 msgr2=0x55894839e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:56.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.632+0000 7f576a3de740 1 --2- 172.21.15.7:0/922966988 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558947fc1390 0x55894839e050 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f575800a010 tx=0x7f5758005db0 comp rx=0 tx=0).stop 2024-09-21T06:36:56.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.632+0000 7f576a3de740 1 -- 172.21.15.7:0/922966988 shutdown_connections 2024-09-21T06:36:56.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.632+0000 7f576a3de740 1 --2- 172.21.15.7:0/922966988 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x558947fa09f0 0x5589483af320 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:56.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.632+0000 7f57457fa640 0 client.25364 ms_handle_reset on v2:172.21.15.18:6836/1539670694 2024-09-21T06:36:56.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.632+0000 7f576a3de740 1 --2- 172.21.15.7:0/922966988 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558947fe2070 0x5589483a3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:56.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.632+0000 7f576a3de740 1 --2- 172.21.15.7:0/922966988 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558947fc1390 0x55894839e050 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:56.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.632+0000 7f576a3de740 1 --2- 172.21.15.7:0/922966988 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558947fb91b0 0x55894839da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:56.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.632+0000 7f576a3de740 1 -- 172.21.15.7:0/922966988 >> 172.21.15.7:0/922966988 conn(0x558947fd6460 msgr2=0x55894838c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:56.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.632+0000 7f576a3de740 1 -- 172.21.15.7:0/922966988 shutdown_connections 2024-09-21T06:36:56.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.632+0000 7f576a3de740 1 -- 172.21.15.7:0/922966988 wait complete. 2024-09-21T06:36:56.636 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.632+0000 7f576a3de740 20 client.25364 trim_cache size 0 max 16384 2024-09-21T06:36:56.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.658+0000 7f576a3de740 1 Processor -- start 2024-09-21T06:36:56.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.659+0000 7f576a3de740 1 -- start start 2024-09-21T06:36:56.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.659+0000 7f576a3de740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558947fa09f0 0x55894839e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:56.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.659+0000 7f576a3de740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558947fb91b0 0x558948396dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:56.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.659+0000 7f576a3de740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558947fc1390 0x558948386b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:56.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.659+0000 7f5761405640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558947fa09f0 0x55894839e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:56.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.659+0000 7f5761405640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558947fa09f0 0x55894839e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.7:53040/0 (socket says 172.21.15.7:53040) 2024-09-21T06:36:56.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.659+0000 7f5761405640 1 -- 172.21.15.7:0/1642062328 learned_addr learned my addr 172.21.15.7:0/1642062328 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:36:56.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.659+0000 7f576a3de740 1 -- 172.21.15.7:0/1642062328 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f575c1afc50 con 0x558947fc1390 2024-09-21T06:36:56.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.659+0000 7f576a3de740 1 -- 172.21.15.7:0/1642062328 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f575c1ad520 con 0x558947fa09f0 2024-09-21T06:36:56.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.659+0000 7f576a3de740 1 -- 172.21.15.7:0/1642062328 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f575c1ab390 con 0x558947fb91b0 2024-09-21T06:36:56.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.660+0000 7f5761c06640 1 --2- 172.21.15.7:0/1642062328 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558947fb91b0 0x558948396dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:56.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.660+0000 7f5761405640 1 --2- 172.21.15.7:0/1642062328 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558947fc1390 0x558948386b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:56.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.660+0000 7f5761c06640 1 -- 172.21.15.7:0/1642062328 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558947fa09f0 msgr2=0x55894839e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:56.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.660+0000 7f5761c06640 1 --2- 172.21.15.7:0/1642062328 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558947fa09f0 0x55894839e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:56.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.660+0000 7f5761c06640 1 -- 172.21.15.7:0/1642062328 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558947fc1390 msgr2=0x558948386b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:56.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.660+0000 7f5761c06640 1 --2- 172.21.15.7:0/1642062328 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558947fc1390 0x558948386b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:56.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.660+0000 7f5761c06640 1 -- 172.21.15.7:0/1642062328 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55894838b5b0 con 0x558947fb91b0 2024-09-21T06:36:56.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.660+0000 7f5761405640 1 --2- 172.21.15.7:0/1642062328 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558947fc1390 0x558948386b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:36:56.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.660+0000 7f5761c06640 1 --2- 172.21.15.7:0/1642062328 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558947fb91b0 0x558948396dc0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5758009250 tx=0x7f57580096c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7e1a00d9c22fccd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:56.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.661+0000 7f57477fe640 1 -- 172.21.15.7:0/1642062328 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f575801d070 con 0x558947fb91b0 2024-09-21T06:36:56.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.661+0000 7f57477fe640 1 -- 172.21.15.7:0/1642062328 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f575801e040 con 0x558947fb91b0 2024-09-21T06:36:56.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.661+0000 7f57477fe640 1 -- 172.21.15.7:0/1642062328 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5758033080 con 0x558947fb91b0 2024-09-21T06:36:56.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.662+0000 7f576a3de740 1 -- 172.21.15.7:0/1642062328 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558947fb91b0 msgr2=0x558948396dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:56.664 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.662+0000 7f576a3de740 1 --2- 172.21.15.7:0/1642062328 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558947fb91b0 0x558948396dc0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5758009250 tx=0x7f57580096c0 comp rx=0 tx=0).stop 2024-09-21T06:36:56.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.662+0000 7f576a3de740 1 -- 172.21.15.7:0/1642062328 shutdown_connections 2024-09-21T06:36:56.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.662+0000 7f576a3de740 1 --2- 172.21.15.7:0/1642062328 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558947fc1390 0x558948386b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:56.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.662+0000 7f576a3de740 1 --2- 172.21.15.7:0/1642062328 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558947fb91b0 0x558948396dc0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:56.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.662+0000 7f576a3de740 1 --2- 172.21.15.7:0/1642062328 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558947fa09f0 0x55894839e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:56.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.662+0000 7f576a3de740 1 -- 172.21.15.7:0/1642062328 >> 172.21.15.7:0/1642062328 conn(0x558947fd6460 msgr2=0x55894839da50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:56.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.662+0000 7f576a3de740 1 -- 172.21.15.7:0/1642062328 shutdown_connections 2024-09-21T06:36:56.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.662+0000 7f576a3de740 1 -- 172.21.15.7:0/1642062328 wait complete. 2024-09-21T06:36:56.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.663+0000 7f576a3de740 1 -- start start 2024-09-21T06:36:56.665 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.663+0000 7f576a3de740 1 Processor -- start 2024-09-21T06:36:56.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.664+0000 7f576a3de740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558947fa09f0 0x5589483a4c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:56.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.664+0000 7f576a3de740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558947fb91b0 0x5589483a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:56.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.664+0000 7f576a3de740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558947fc1390 0x558948417b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:56.666 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.664+0000 7f576a3de740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f575c1ab9e0 con 0x558947fb91b0 2024-09-21T06:36:56.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.664+0000 7f5761405640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558947fa09f0 0x5589483a4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:56.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.664+0000 7f5761c06640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558947fb91b0 0x5589483a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:56.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.664+0000 7f5761c06640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558947fb91b0 0x5589483a51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45924/0 (socket says 172.21.15.7:45924) 2024-09-21T06:36:56.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.664+0000 7f5761c06640 1 -- 172.21.15.7:0/3185403515 learned_addr learned my addr 172.21.15.7:0/3185403515 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:36:56.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.664+0000 7f576a3de740 1 -- 172.21.15.7:0/3185403515 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f575c1ace50 con 0x558947fa09f0 2024-09-21T06:36:56.667 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.664+0000 7f576a3de740 1 -- 172.21.15.7:0/3185403515 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f575c1ac0b0 con 0x558947fc1390 2024-09-21T06:36:56.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.665+0000 7f5761c06640 1 -- 172.21.15.7:0/3185403515 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558947fc1390 msgr2=0x558948417b70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T06:36:56.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.665+0000 7f5761c06640 1 --2- 172.21.15.7:0/3185403515 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558947fc1390 0x558948417b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:56.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.665+0000 7f5761c06640 1 -- 172.21.15.7:0/3185403515 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558947fa09f0 msgr2=0x5589483a4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:56.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.665+0000 7f5761c06640 1 --2- 172.21.15.7:0/3185403515 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558947fa09f0 0x5589483a4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:56.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.665+0000 7f5761c06640 1 -- 172.21.15.7:0/3185403515 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589484181b0 con 0x558947fb91b0 2024-09-21T06:36:56.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.665+0000 7f5761405640 1 --2- 172.21.15.7:0/3185403515 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558947fa09f0 0x5589483a4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:36:56.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.665+0000 7f5761c06640 1 --2- 172.21.15.7:0/3185403515 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558947fb91b0 0x5589483a51b0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f5758000c00 tx=0x7f5758011450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=954dde1b012c697f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:56.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.665+0000 7f576a3de740 10 client.0 _ll_register_callbacks cb 0x7f5758009ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:36:56.668 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.665+0000 7f576a3de740 1 -- 172.21.15.7:0/3185403515 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f575801e040 con 0x558947fb91b0 2024-09-21T06:36:56.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.666+0000 7f57457fa640 10 client.15570 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:36:56.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.666+0000 7f57457fa640 1 -- 172.21.15.7:0/3185403515 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5758046050 con 0x558947fb91b0 2024-09-21T06:36:56.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.666+0000 7f57457fa640 1 -- 172.21.15.7:0/3185403515 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f5758004120 con 0x558947fb91b0 2024-09-21T06:36:56.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.666+0000 7f57457fa640 1 -- 172.21.15.7:0/3185403515 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5758033070 con 0x558947fb91b0 2024-09-21T06:36:56.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.666+0000 7f576a3de740 10 client.15570 fetch_fsmap learned FSMap version 25 2024-09-21T06:36:56.669 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.666+0000 7f576a3de740 1 -- 172.21.15.7:0/3185403515 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({fsmap=25}) -- 0x558948419250 con 0x558947fb91b0 2024-09-21T06:36:56.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.666+0000 7f57457fa640 1 -- 172.21.15.7:0/3185403515 <== mon.0 v2:172.21.15.7:3300/0 4 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f5758003790 con 0x558947fb91b0 2024-09-21T06:36:56.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.667+0000 7f576a3de740 10 client.15570 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:36:56.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.667+0000 7f576a3de740 10 client.15570 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-21T06:36:56.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.667+0000 7f576a3de740 20 client.15570 populate_metadata read hostname 'smithi007' 2024-09-21T06:36:56.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.667+0000 7f576a3de740 1 --2- 172.21.15.7:0/3185403515 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x558947fe2070 0x55894841b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:56.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.667+0000 7f576a3de740 4 client.15570 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:36:56.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.667+0000 7f576a3de740 1 -- 172.21.15.7:0/3185403515 --> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5589482fd8a0 con 0x558947fe2070 2024-09-21T06:36:56.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.667+0000 7f5761405640 1 --2- 172.21.15.7:0/3185403515 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x558947fe2070 0x55894841b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:56.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.667+0000 7f5761405640 1 --2- 172.21.15.7:0/3185403515 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x558947fe2070 0x55894841b9a0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1200eea22e6234f2 server_cookie=1d6de9a34054939a in_seq=0 out_seq=0 2024-09-21T06:36:56.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.667+0000 7f57457fa640 10 client.15570 ms_handle_connect on v2:172.21.15.18:6836/1539670694 2024-09-21T06:36:56.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.668+0000 7f57457fa640 1 -- 172.21.15.7:0/3185403515 <== mds.2 v2:172.21.15.18:6836/1539670694 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5589482fd8a0 con 0x558947fe2070 2024-09-21T06:36:56.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.668+0000 7f57457fa640 10 client.15570 handle_command_reply: tid=0 2024-09-21T06:36:56.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.668+0000 7f576a3de740 1 client.15570 shutdown 2024-09-21T06:36:56.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.668+0000 7f576a3de740 1 -- 172.21.15.7:0/3185403515 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558947fb91b0 msgr2=0x5589483a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:56.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.668+0000 7f576a3de740 1 --2- 172.21.15.7:0/3185403515 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558947fb91b0 0x5589483a51b0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f5758000c00 tx=0x7f5758011450 comp rx=0 tx=0).stop 2024-09-21T06:36:56.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.668+0000 7f576a3de740 1 -- 172.21.15.7:0/3185403515 shutdown_connections 2024-09-21T06:36:56.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.668+0000 7f576a3de740 1 --2- 172.21.15.7:0/3185403515 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x558947fe2070 0x55894841b9a0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:56.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.668+0000 7f576a3de740 1 --2- 172.21.15.7:0/3185403515 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558947fc1390 0x558948417b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:56.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.668+0000 7f576a3de740 1 --2- 172.21.15.7:0/3185403515 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558947fb91b0 0x5589483a51b0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:56.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.668+0000 7f576a3de740 1 --2- 172.21.15.7:0/3185403515 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558947fa09f0 0x5589483a4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:56.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.668+0000 7f576a3de740 1 -- 172.21.15.7:0/3185403515 >> 172.21.15.7:0/3185403515 conn(0x558947fd6460 msgr2=0x55894838c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:56.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.668+0000 7f57457fa640 0 client.15570 ms_handle_reset on v2:172.21.15.18:6836/1539670694 2024-09-21T06:36:56.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.668+0000 7f576a3de740 1 -- 172.21.15.7:0/3185403515 shutdown_connections 2024-09-21T06:36:56.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.668+0000 7f576a3de740 1 -- 172.21.15.7:0/3185403515 wait complete. 2024-09-21T06:36:56.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.668+0000 7f576a3de740 20 client.15570 trim_cache size 0 max 16384 2024-09-21T06:36:56.672 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:36:56.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.669+0000 7f5763e6a640 1 -- 172.21.15.7:0/360378977 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f57480b6670 msgr2=0x7f57480b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:56.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.669+0000 7f5763e6a640 1 --2- 172.21.15.7:0/360378977 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f57480b6670 0x7f57480b8b80 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f57540cacb0 tx=0x7f57540095c0 comp rx=0 tx=0).stop 2024-09-21T06:36:56.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.669+0000 7f5763e6a640 1 -- 172.21.15.7:0/360378977 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f575c10de30 msgr2=0x7f575c19fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:56.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.669+0000 7f5763e6a640 1 --2- 172.21.15.7:0/360378977 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f575c10de30 0x7f575c19fcf0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f575402f540 tx=0x7f57540316f0 comp rx=0 tx=0).stop 2024-09-21T06:36:56.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.669+0000 7f5763e6a640 1 -- 172.21.15.7:0/360378977 shutdown_connections 2024-09-21T06:36:56.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.669+0000 7f5763e6a640 1 --2- 172.21.15.7:0/360378977 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f57480b6670 0x7f57480b8b80 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:56.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.669+0000 7f5763e6a640 1 --2- 172.21.15.7:0/360378977 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f575c10de30 0x7f575c19fcf0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:56.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.669+0000 7f5763e6a640 1 --2- 172.21.15.7:0/360378977 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f575c1052b0 0x7f575c19aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:56.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.669+0000 7f5763e6a640 1 --2- 172.21.15.7:0/360378977 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f575c104880 0x7f575c19a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:56.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.670+0000 7f5763e6a640 1 -- 172.21.15.7:0/360378977 >> 172.21.15.7:0/360378977 conn(0x7f575c079730 msgr2=0x7f575c1078f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:56.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.670+0000 7f5763e6a640 1 -- 172.21.15.7:0/360378977 shutdown_connections 2024-09-21T06:36:56.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:56.670+0000 7f5763e6a640 1 -- 172.21.15.7:0/360378977 wait complete. 2024-09-21T06:36:57.186 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:36:56 smithi144 ceph-mon[34653]: pgmap v341: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-21T06:36:57.203 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:36:56 smithi007 ceph-mon[30983]: pgmap v341: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-21T06:36:57.287 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:36:56 smithi018 ceph-mon[34477]: pgmap v341: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-21T06:36:57.351 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:36:57.635 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:36:58.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.188+0000 7f0526410640 1 -- 172.21.15.7:0/2053498442 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0520102a60 msgr2=0x7f0520102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:58.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.188+0000 7f0526410640 1 --2- 172.21.15.7:0/2053498442 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0520102a60 0x7f0520102e70 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0510009900 tx=0x7f051002a3f0 comp rx=0 tx=0).stop 2024-09-21T06:36:58.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.189+0000 7f0526410640 1 -- 172.21.15.7:0/2053498442 shutdown_connections 2024-09-21T06:36:58.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.189+0000 7f0526410640 1 --2- 172.21.15.7:0/2053498442 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0520108cf0 0x7f052010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:58.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.189+0000 7f0526410640 1 --2- 172.21.15.7:0/2053498442 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f05201083a0 0x7f05201087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:58.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.189+0000 7f0526410640 1 --2- 172.21.15.7:0/2053498442 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0520102a60 0x7f0520102e70 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:58.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.189+0000 7f0526410640 1 -- 172.21.15.7:0/2053498442 >> 172.21.15.7:0/2053498442 conn(0x7f0520079730 msgr2=0x7f0520079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:58.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.189+0000 7f0526410640 1 -- 172.21.15.7:0/2053498442 shutdown_connections 2024-09-21T06:36:58.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.189+0000 7f0526410640 1 -- 172.21.15.7:0/2053498442 wait complete. 2024-09-21T06:36:58.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.190+0000 7f0526410640 1 Processor -- start 2024-09-21T06:36:58.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.190+0000 7f0526410640 1 -- start start 2024-09-21T06:36:58.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.190+0000 7f0526410640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0520102a60 0x7f05201982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:58.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.190+0000 7f0526410640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05201083a0 0x7f0520198850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:58.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.190+0000 7f0526410640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0520108cf0 0x7f052019daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:58.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.190+0000 7f051ffff640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0520102a60 0x7f05201982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:58.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.190+0000 7f051ffff640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0520102a60 0x7f05201982b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.7:40262/0 (socket says 172.21.15.7:40262) 2024-09-21T06:36:58.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.190+0000 7f0517fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05201083a0 0x7f0520198850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:58.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.190+0000 7f0517fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05201083a0 0x7f0520198850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45940/0 (socket says 172.21.15.7:45940) 2024-09-21T06:36:58.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.190+0000 7f0526410640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0520111860 con 0x7f05201083a0 2024-09-21T06:36:58.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.190+0000 7f0526410640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f05201116e0 con 0x7f0520108cf0 2024-09-21T06:36:58.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.190+0000 7f0526410640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f05201119e0 con 0x7f0520102a60 2024-09-21T06:36:58.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.190+0000 7f051ffff640 1 -- 172.21.15.7:0/526483423 learned_addr learned my addr 172.21.15.7:0/526483423 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:36:58.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.190+0000 7f05249ad640 1 --2- 172.21.15.7:0/526483423 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0520108cf0 0x7f052019daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:58.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.191+0000 7f051ffff640 1 -- 172.21.15.7:0/526483423 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0520108cf0 msgr2=0x7f052019daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:58.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.191+0000 7f051ffff640 1 --2- 172.21.15.7:0/526483423 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0520108cf0 0x7f052019daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:58.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.191+0000 7f051ffff640 1 -- 172.21.15.7:0/526483423 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05201083a0 msgr2=0x7f0520198850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:58.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.191+0000 7f051ffff640 1 --2- 172.21.15.7:0/526483423 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05201083a0 0x7f0520198850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:58.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.191+0000 7f051ffff640 1 -- 172.21.15.7:0/526483423 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f052019e220 con 0x7f0520102a60 2024-09-21T06:36:58.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.191+0000 7f05249ad640 1 --2- 172.21.15.7:0/526483423 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0520108cf0 0x7f052019daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:36:58.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.191+0000 7f051ffff640 1 --2- 172.21.15.7:0/526483423 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0520102a60 0x7f05201982b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0510005940 tx=0x7f05100040c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:58.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.191+0000 7f051dffb640 1 -- 172.21.15.7:0/526483423 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f051003f030 con 0x7f0520102a60 2024-09-21T06:36:58.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.191+0000 7f0526410640 1 -- 172.21.15.7:0/526483423 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f052019e4b0 con 0x7f0520102a60 2024-09-21T06:36:58.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.191+0000 7f051dffb640 1 -- 172.21.15.7:0/526483423 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f05100044c0 con 0x7f0520102a60 2024-09-21T06:36:58.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.192+0000 7f051dffb640 1 -- 172.21.15.7:0/526483423 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0510035070 con 0x7f0520102a60 2024-09-21T06:36:58.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.192+0000 7f0526410640 1 -- 172.21.15.7:0/526483423 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05201a4c70 con 0x7f0520102a60 2024-09-21T06:36:58.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.195+0000 7f051dffb640 1 -- 172.21.15.7:0/526483423 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 24) ==== 154585+0+0 (secure 0 0 0) 0x7f0510042030 con 0x7f0520102a60 2024-09-21T06:36:58.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.196+0000 7f052c984740 1 Processor -- start 2024-09-21T06:36:58.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.196+0000 7f052c984740 1 -- start start 2024-09-21T06:36:58.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.196+0000 7f052c984740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c140b2f070 0x55c140ed93a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:58.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.196+0000 7f052c984740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c140b061b0 0x55c140ed68a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:58.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.196+0000 7f052c984740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c140b0e390 0x55c140ed6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:58.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.196+0000 7f052c984740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55c140e4cea0 con 0x55c140b061b0 2024-09-21T06:36:58.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.196+0000 7f052c984740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55c140e3c2d0 con 0x55c140b0e390 2024-09-21T06:36:58.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.196+0000 7f052c984740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55c140e400e0 con 0x55c140b2f070 2024-09-21T06:36:58.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.197+0000 7f051ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c140b061b0 0x55c140ed68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:58.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.197+0000 7f05249ad640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c140b2f070 0x55c140ed93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:58.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.197+0000 7f05249ad640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c140b2f070 0x55c140ed93a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.7:40266/0 (socket says 172.21.15.7:40266) 2024-09-21T06:36:58.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.197+0000 7f05249ad640 1 -- 172.21.15.7:0/1333086276 learned_addr learned my addr 172.21.15.7:0/1333086276 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:36:58.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.197+0000 7f0517fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c140b0e390 0x55c140ed6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:58.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.197+0000 7f05249ad640 1 -- 172.21.15.7:0/1333086276 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c140b0e390 msgr2=0x55c140ed6fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:58.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.197+0000 7f05249ad640 1 --2- 172.21.15.7:0/1333086276 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c140b0e390 0x55c140ed6fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:58.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.197+0000 7f05249ad640 1 -- 172.21.15.7:0/1333086276 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c140b061b0 msgr2=0x55c140ed68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:58.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.197+0000 7f05249ad640 1 --2- 172.21.15.7:0/1333086276 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c140b061b0 0x55c140ed68a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:58.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.197+0000 7f05249ad640 1 -- 172.21.15.7:0/1333086276 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c140b9a650 con 0x55c140b2f070 2024-09-21T06:36:58.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.197+0000 7f051ffff640 1 --2- 172.21.15.7:0/1333086276 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c140b061b0 0x55c140ed68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:36:58.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.198+0000 7f05249ad640 1 --2- 172.21.15.7:0/1333086276 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c140b2f070 0x55c140ed93a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f051800be60 tx=0x7f051800d040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8fe473a17f60fb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:58.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.198+0000 7f0526410640 1 -- 172.21.15.7:0/1333086276 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0518012d10 con 0x55c140b2f070 2024-09-21T06:36:58.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.198+0000 7f051dffb640 1 --2- 172.21.15.7:0/526483423 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f050c0b66f0 0x7f050c0b8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:58.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.198+0000 7f0526410640 1 -- 172.21.15.7:0/1333086276 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0518009bf0 con 0x55c140b2f070 2024-09-21T06:36:58.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.198+0000 7f0526410640 1 -- 172.21.15.7:0/1333086276 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f051801db30 con 0x55c140b2f070 2024-09-21T06:36:58.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.198+0000 7f051ffff640 1 --2- 172.21.15.7:0/526483423 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f050c0b66f0 0x7f050c0b8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:58.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.199+0000 7f051dffb640 1 -- 172.21.15.7:0/526483423 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f0510107ca0 con 0x7f0520102a60 2024-09-21T06:36:58.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.200+0000 7f051ffff640 1 --2- 172.21.15.7:0/526483423 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f050c0b66f0 0x7f050c0b8c00 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f05100ca290 tx=0x7f05100095d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:58.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.200+0000 7f052c984740 1 -- 172.21.15.7:0/1333086276 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c140b2f070 msgr2=0x55c140ed93a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:58.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.200+0000 7f052c984740 1 --2- 172.21.15.7:0/1333086276 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c140b2f070 0x55c140ed93a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f051800be60 tx=0x7f051800d040 comp rx=0 tx=0).stop 2024-09-21T06:36:58.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.200+0000 7f052c984740 1 -- 172.21.15.7:0/1333086276 shutdown_connections 2024-09-21T06:36:58.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.200+0000 7f052c984740 1 --2- 172.21.15.7:0/1333086276 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c140b0e390 0x55c140ed6fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:58.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.200+0000 7f052c984740 1 --2- 172.21.15.7:0/1333086276 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c140b061b0 0x55c140ed68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:58.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.201+0000 7f052c984740 1 --2- 172.21.15.7:0/1333086276 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c140b2f070 0x55c140ed93a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:58.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.201+0000 7f052c984740 1 -- 172.21.15.7:0/1333086276 >> 172.21.15.7:0/1333086276 conn(0x55c140b23460 msgr2=0x55c140ed4790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:58.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.201+0000 7f052c984740 1 -- 172.21.15.7:0/1333086276 shutdown_connections 2024-09-21T06:36:58.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.201+0000 7f052c984740 1 -- 172.21.15.7:0/1333086276 wait complete. 2024-09-21T06:36:58.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.201+0000 7f052c984740 1 -- start start 2024-09-21T06:36:58.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.202+0000 7f052c984740 1 Processor -- start 2024-09-21T06:36:58.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.202+0000 7f052c984740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c140b061b0 0x55c140ee1f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:58.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.203+0000 7f052c984740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c140b0e390 0x55c140ee24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:58.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.203+0000 7f05249ad640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c140b061b0 0x55c140ee1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:58.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.203+0000 7f05249ad640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c140b061b0 0x55c140ee1f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45950/0 (socket says 172.21.15.7:45950) 2024-09-21T06:36:58.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.203+0000 7f05249ad640 1 -- 172.21.15.7:0/3247601910 learned_addr learned my addr 172.21.15.7:0/3247601910 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:36:58.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.203+0000 7f0517fff640 1 --2- 172.21.15.7:0/3247601910 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c140b0e390 0x55c140ee24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:58.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.203+0000 7f052c984740 1 --2- 172.21.15.7:0/3247601910 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c140b2f070 0x55c140eee150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:58.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.203+0000 7f052c984740 1 -- 172.21.15.7:0/3247601910 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55c140c9d700 con 0x55c140b061b0 2024-09-21T06:36:58.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.203+0000 7f052c984740 1 -- 172.21.15.7:0/3247601910 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55c140dd7160 con 0x55c140b0e390 2024-09-21T06:36:58.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.203+0000 7f052c984740 1 -- 172.21.15.7:0/3247601910 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55c140ee4e60 con 0x55c140b2f070 2024-09-21T06:36:58.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.203+0000 7f05249ad640 1 --2- 172.21.15.7:0/3247601910 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c140b2f070 0x55c140eee150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:58.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.204+0000 7f05249ad640 1 -- 172.21.15.7:0/3247601910 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c140b2f070 msgr2=0x55c140eee150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:58.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.204+0000 7f05249ad640 1 --2- 172.21.15.7:0/3247601910 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c140b2f070 0x55c140eee150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:58.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.204+0000 7f05249ad640 1 -- 172.21.15.7:0/3247601910 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c140b0e390 msgr2=0x55c140ee24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:58.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.204+0000 7f05249ad640 1 --2- 172.21.15.7:0/3247601910 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c140b0e390 0x55c140ee24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:58.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.204+0000 7f05249ad640 1 -- 172.21.15.7:0/3247601910 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c140e04c90 con 0x55c140b061b0 2024-09-21T06:36:58.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.204+0000 7f05249ad640 1 --2- 172.21.15.7:0/3247601910 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c140b061b0 0x55c140ee1f90 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f051801d790 tx=0x7f051801d690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d7babe72ebc14a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:58.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.204+0000 7f04ff7fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:36:58.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.204+0000 7f052c984740 10 client.0 _ll_register_callbacks cb 0x55c140df09e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:36:58.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.204+0000 7f052c984740 1 -- 172.21.15.7:0/3247601910 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0518009bf0 con 0x55c140b061b0 2024-09-21T06:36:58.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.204+0000 7f04ff7fe640 1 -- 172.21.15.7:0/3247601910 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0518030050 con 0x55c140b061b0 2024-09-21T06:36:58.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.204+0000 7f04ff7fe640 1 -- 172.21.15.7:0/3247601910 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f0518010040 con 0x55c140b061b0 2024-09-21T06:36:58.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.205+0000 7f04ff7fe640 1 -- 172.21.15.7:0/3247601910 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0518004b00 con 0x55c140b061b0 2024-09-21T06:36:58.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.205+0000 7f052c984740 10 client.15582 fetch_fsmap learned FSMap version 25 2024-09-21T06:36:58.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.205+0000 7f052c984740 1 -- 172.21.15.7:0/3247601910 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({fsmap=25}) -- 0x55c140ef0980 con 0x55c140b061b0 2024-09-21T06:36:58.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.205+0000 7f04ff7fe640 1 -- 172.21.15.7:0/3247601910 <== mon.0 v2:172.21.15.7:3300/0 4 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f0518004ca0 con 0x55c140b061b0 2024-09-21T06:36:58.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.205+0000 7f052c984740 10 client.15582 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:36:58.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.205+0000 7f052c984740 10 client.15582 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:36:58.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.205+0000 7f052c984740 20 client.15582 populate_metadata read hostname 'smithi007' 2024-09-21T06:36:58.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.205+0000 7f052c984740 1 --2- 172.21.15.7:0/3247601910 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x55c140aed9f0 0x55c140ef3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:58.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.206+0000 7f052c984740 4 client.15582 mds_command: new command op to 24688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:36:58.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.206+0000 7f052c984740 1 -- 172.21.15.7:0/3247601910 --> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f0518009bf0 con 0x55c140aed9f0 2024-09-21T06:36:58.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.206+0000 7f0517fff640 1 --2- 172.21.15.7:0/3247601910 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x55c140aed9f0 0x55c140ef3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:58.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.206+0000 7f0517fff640 1 --2- 172.21.15.7:0/3247601910 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x55c140aed9f0 0x55c140ef3d40 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f3860cd57d54c225 server_cookie=86cb7da518201681 in_seq=0 out_seq=0 2024-09-21T06:36:58.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.206+0000 7f04ff7fe640 10 client.15582 ms_handle_connect on v2:172.21.15.144:6838/4027821922 2024-09-21T06:36:58.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.207+0000 7f04ff7fe640 1 -- 172.21.15.7:0/3247601910 <== mds.1 v2:172.21.15.144:6838/4027821922 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f0518009bf0 con 0x55c140aed9f0 2024-09-21T06:36:58.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.207+0000 7f04ff7fe640 10 client.15582 handle_command_reply: tid=0 2024-09-21T06:36:58.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.207+0000 7f052c984740 1 client.15582 shutdown 2024-09-21T06:36:58.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.207+0000 7f052c984740 1 -- 172.21.15.7:0/3247601910 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c140b061b0 msgr2=0x55c140ee1f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:58.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.207+0000 7f052c984740 1 --2- 172.21.15.7:0/3247601910 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c140b061b0 0x55c140ee1f90 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f051801d790 tx=0x7f051801d690 comp rx=0 tx=0).stop 2024-09-21T06:36:58.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.208+0000 7f052c984740 1 -- 172.21.15.7:0/3247601910 shutdown_connections 2024-09-21T06:36:58.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.208+0000 7f052c984740 1 --2- 172.21.15.7:0/3247601910 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x55c140aed9f0 0x55c140ef3d40 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:58.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.208+0000 7f04ff7fe640 0 client.15582 ms_handle_reset on v2:172.21.15.144:6838/4027821922 2024-09-21T06:36:58.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.208+0000 7f052c984740 1 --2- 172.21.15.7:0/3247601910 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c140b2f070 0x55c140eee150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:58.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.208+0000 7f052c984740 1 --2- 172.21.15.7:0/3247601910 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c140b0e390 0x55c140ee24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:58.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.208+0000 7f052c984740 1 --2- 172.21.15.7:0/3247601910 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c140b061b0 0x55c140ee1f90 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:58.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.208+0000 7f052c984740 1 -- 172.21.15.7:0/3247601910 >> 172.21.15.7:0/3247601910 conn(0x55c140b23460 msgr2=0x55c140ed8290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:58.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.208+0000 7f052c984740 1 -- 172.21.15.7:0/3247601910 shutdown_connections 2024-09-21T06:36:58.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.208+0000 7f052c984740 1 -- 172.21.15.7:0/3247601910 wait complete. 2024-09-21T06:36:58.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.208+0000 7f052c984740 20 client.15582 trim_cache size 0 max 16384 2024-09-21T06:36:58.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.235+0000 7f052c984740 1 Processor -- start 2024-09-21T06:36:58.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.235+0000 7f052c984740 1 -- start start 2024-09-21T06:36:58.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.235+0000 7f052c984740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c140aed9f0 0x55c140ee2450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:58.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.235+0000 7f052c984740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c140b061b0 0x55c140eee050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:58.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.235+0000 7f052c984740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c140b0e390 0x55c140edc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:58.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.235+0000 7f052c984740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f05201afbc0 con 0x55c140b061b0 2024-09-21T06:36:58.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.235+0000 7f052c984740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f05201ad490 con 0x55c140aed9f0 2024-09-21T06:36:58.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.235+0000 7f052c984740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f05201ab2e0 con 0x55c140b0e390 2024-09-21T06:36:58.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.235+0000 7f05249ad640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c140aed9f0 0x55c140ee2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:58.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.235+0000 7f05249ad640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c140aed9f0 0x55c140ee2450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.7:53100/0 (socket says 172.21.15.7:53100) 2024-09-21T06:36:58.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.235+0000 7f05249ad640 1 -- 172.21.15.7:0/2647150417 learned_addr learned my addr 172.21.15.7:0/2647150417 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:36:58.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.235+0000 7f05249ad640 1 --2- 172.21.15.7:0/2647150417 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c140b0e390 0x55c140edc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:58.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.235+0000 7f0517fff640 1 --2- 172.21.15.7:0/2647150417 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c140b061b0 0x55c140eee050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:58.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.236+0000 7f05249ad640 1 -- 172.21.15.7:0/2647150417 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c140b0e390 msgr2=0x55c140edc3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:58.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.236+0000 7f05249ad640 1 --2- 172.21.15.7:0/2647150417 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c140b0e390 0x55c140edc3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:58.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.236+0000 7f05249ad640 1 -- 172.21.15.7:0/2647150417 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c140b061b0 msgr2=0x55c140eee050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:58.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.236+0000 7f05249ad640 1 --2- 172.21.15.7:0/2647150417 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c140b061b0 0x55c140eee050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:58.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.236+0000 7f05249ad640 1 -- 172.21.15.7:0/2647150417 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c140ef2d40 con 0x55c140aed9f0 2024-09-21T06:36:58.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.236+0000 7f05249ad640 1 --2- 172.21.15.7:0/2647150417 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c140aed9f0 0x55c140ee2450 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0518014010 tx=0x7f0518022000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb6e0bbe7dd4ae03 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:58.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.236+0000 7f0515ffb640 1 -- 172.21.15.7:0/2647150417 <== mon.2 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0518030040 con 0x55c140aed9f0 2024-09-21T06:36:58.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.236+0000 7f0515ffb640 1 -- 172.21.15.7:0/2647150417 <== mon.2 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0518026040 con 0x55c140aed9f0 2024-09-21T06:36:58.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.236+0000 7f0515ffb640 1 -- 172.21.15.7:0/2647150417 <== mon.2 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0518005040 con 0x55c140aed9f0 2024-09-21T06:36:58.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.237+0000 7f052c984740 1 -- 172.21.15.7:0/2647150417 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c140aed9f0 msgr2=0x55c140ee2450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:58.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.237+0000 7f052c984740 1 --2- 172.21.15.7:0/2647150417 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c140aed9f0 0x55c140ee2450 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0518014010 tx=0x7f0518022000 comp rx=0 tx=0).stop 2024-09-21T06:36:58.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.238+0000 7f052c984740 1 -- 172.21.15.7:0/2647150417 shutdown_connections 2024-09-21T06:36:58.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.238+0000 7f052c984740 1 --2- 172.21.15.7:0/2647150417 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c140b0e390 0x55c140edc3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:58.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.238+0000 7f052c984740 1 --2- 172.21.15.7:0/2647150417 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c140b061b0 0x55c140eee050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:58.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.238+0000 7f052c984740 1 --2- 172.21.15.7:0/2647150417 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c140aed9f0 0x55c140ee2450 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:58.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.238+0000 7f052c984740 1 -- 172.21.15.7:0/2647150417 >> 172.21.15.7:0/2647150417 conn(0x55c140b23460 msgr2=0x55c140ee1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:58.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.238+0000 7f052c984740 1 -- 172.21.15.7:0/2647150417 shutdown_connections 2024-09-21T06:36:58.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.238+0000 7f052c984740 1 -- 172.21.15.7:0/2647150417 wait complete. 2024-09-21T06:36:58.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.238+0000 7f052c984740 1 -- start start 2024-09-21T06:36:58.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.238+0000 7f052c984740 1 Processor -- start 2024-09-21T06:36:58.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.239+0000 7f052c984740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c140aed9f0 0x55c140ef85c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:58.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.239+0000 7f052c984740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c140b061b0 0x55c140ef8b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:58.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.239+0000 7f052c984740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c140b0e390 0x55c140ef9150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:58.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.239+0000 7f052c984740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f05201ab950 con 0x55c140aed9f0 2024-09-21T06:36:58.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.239+0000 7f052c984740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f05201acdc0 con 0x55c140b0e390 2024-09-21T06:36:58.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.239+0000 7f052c984740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f05201ac020 con 0x55c140b061b0 2024-09-21T06:36:58.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.239+0000 7f05249ad640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c140aed9f0 0x55c140ef85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:58.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.239+0000 7f052c984740 10 client.0 _ll_register_callbacks cb 0x7f051010d240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:36:58.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.239+0000 7f05249ad640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c140aed9f0 0x55c140ef85c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45960/0 (socket says 172.21.15.7:45960) 2024-09-21T06:36:58.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.239+0000 7f05249ad640 1 -- 172.21.15.7:0/4188003484 learned_addr learned my addr 172.21.15.7:0/4188003484 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:36:58.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.239+0000 7f0517fff640 1 --2- 172.21.15.7:0/4188003484 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c140b061b0 0x55c140ef8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:58.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.239+0000 7f05249ad640 1 --2- 172.21.15.7:0/4188003484 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c140b0e390 0x55c140ef9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:58.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.239+0000 7f0517fff640 1 -- 172.21.15.7:0/4188003484 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c140b0e390 msgr2=0x55c140ef9150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:58.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.239+0000 7f0517fff640 1 --2- 172.21.15.7:0/4188003484 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c140b0e390 0x55c140ef9150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:58.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.239+0000 7f0517fff640 1 -- 172.21.15.7:0/4188003484 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c140aed9f0 msgr2=0x55c140ef85c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:58.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.239+0000 7f0517fff640 1 --2- 172.21.15.7:0/4188003484 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c140aed9f0 0x55c140ef85c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:58.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.239+0000 7f0517fff640 1 -- 172.21.15.7:0/4188003484 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c140ef98e0 con 0x55c140b061b0 2024-09-21T06:36:58.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.239+0000 7f05249ad640 1 --2- 172.21.15.7:0/4188003484 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c140aed9f0 0x55c140ef85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:36:58.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.240+0000 7f0517fff640 1 --2- 172.21.15.7:0/4188003484 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c140b061b0 0x55c140ef8b00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0508019010 tx=0x7f0508004410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3bf4d5bf9e2b617 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:58.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.240+0000 7f04ff7fe640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-21T06:36:58.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.240+0000 7f04ff7fe640 1 -- 172.21.15.7:0/4188003484 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f050802c480 con 0x55c140b061b0 2024-09-21T06:36:58.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.240+0000 7f04ff7fe640 1 -- 172.21.15.7:0/4188003484 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f050802c620 con 0x55c140b061b0 2024-09-21T06:36:58.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.240+0000 7f052c984740 1 -- 172.21.15.7:0/4188003484 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0518026040 con 0x55c140b061b0 2024-09-21T06:36:58.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.240+0000 7f04ff7fe640 1 -- 172.21.15.7:0/4188003484 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0508016050 con 0x55c140b061b0 2024-09-21T06:36:58.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.240+0000 7f052c984740 10 client.25240 fetch_fsmap learned FSMap version 25 2024-09-21T06:36:58.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.240+0000 7f052c984740 1 -- 172.21.15.7:0/4188003484 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c140ee9990 con 0x55c140b061b0 2024-09-21T06:36:58.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.240+0000 7f04ff7fe640 1 -- 172.21.15.7:0/4188003484 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f050802ccd0 con 0x55c140b061b0 2024-09-21T06:36:58.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.241+0000 7f04ff7fe640 1 -- 172.21.15.7:0/4188003484 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f0508017810 con 0x55c140b061b0 2024-09-21T06:36:58.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.241+0000 7f052c984740 10 client.25240 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:36:58.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.241+0000 7f052c984740 10 client.25240 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:36:58.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.241+0000 7f052c984740 20 client.25240 populate_metadata read hostname 'smithi007' 2024-09-21T06:36:58.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.241+0000 7f052c984740 1 --2- 172.21.15.7:0/4188003484 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x55c140b2f070 0x55c140eea0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:58.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.241+0000 7f052c984740 4 client.25240 mds_command: new command op to 24688 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:36:58.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.241+0000 7f052c984740 1 -- 172.21.15.7:0/4188003484 --> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f0518026040 con 0x55c140b2f070 2024-09-21T06:36:58.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.241+0000 7f05249ad640 1 --2- 172.21.15.7:0/4188003484 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x55c140b2f070 0x55c140eea0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:58.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.241+0000 7f04ff7fe640 10 client.25240 ms_handle_connect on v2:172.21.15.144:6838/4027821922 2024-09-21T06:36:58.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.242+0000 7f05249ad640 1 --2- 172.21.15.7:0/4188003484 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x55c140b2f070 0x55c140eea0e0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a90dfdd386f1543c server_cookie=a43845024396ae37 in_seq=0 out_seq=0 2024-09-21T06:36:58.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.242+0000 7f04ff7fe640 1 -- 172.21.15.7:0/4188003484 <== mds.1 v2:172.21.15.144:6838/4027821922 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f0518026040 con 0x55c140b2f070 2024-09-21T06:36:58.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.242+0000 7f04ff7fe640 10 client.25240 handle_command_reply: tid=0 2024-09-21T06:36:58.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.242+0000 7f052c984740 1 client.25240 shutdown 2024-09-21T06:36:58.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.242+0000 7f052c984740 1 -- 172.21.15.7:0/4188003484 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c140b061b0 msgr2=0x55c140ef8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:58.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.242+0000 7f052c984740 1 --2- 172.21.15.7:0/4188003484 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c140b061b0 0x55c140ef8b00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0508019010 tx=0x7f0508004410 comp rx=0 tx=0).stop 2024-09-21T06:36:58.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.242+0000 7f052c984740 1 -- 172.21.15.7:0/4188003484 shutdown_connections 2024-09-21T06:36:58.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.242+0000 7f052c984740 1 --2- 172.21.15.7:0/4188003484 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x55c140b2f070 0x55c140eea0e0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:58.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.242+0000 7f052c984740 1 --2- 172.21.15.7:0/4188003484 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c140b0e390 0x55c140ef9150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:58.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.242+0000 7f052c984740 1 --2- 172.21.15.7:0/4188003484 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c140b061b0 0x55c140ef8b00 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:58.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.242+0000 7f052c984740 1 --2- 172.21.15.7:0/4188003484 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c140aed9f0 0x55c140ef85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:58.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.242+0000 7f052c984740 1 -- 172.21.15.7:0/4188003484 >> 172.21.15.7:0/4188003484 conn(0x55c140b23460 msgr2=0x55c140ed40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:58.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.242+0000 7f04ff7fe640 0 client.25240 ms_handle_reset on v2:172.21.15.144:6838/4027821922 2024-09-21T06:36:58.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.242+0000 7f052c984740 1 -- 172.21.15.7:0/4188003484 shutdown_connections 2024-09-21T06:36:58.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.242+0000 7f052c984740 1 -- 172.21.15.7:0/4188003484 wait complete. 2024-09-21T06:36:58.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.243+0000 7f052c984740 20 client.25240 trim_cache size 0 max 16384 2024-09-21T06:36:58.248 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:36:58.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.243+0000 7f0516ffd640 1 -- 172.21.15.7:0/526483423 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f050c0b66f0 msgr2=0x7f050c0b8c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:58.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.243+0000 7f0516ffd640 1 --2- 172.21.15.7:0/526483423 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f050c0b66f0 0x7f050c0b8c00 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f05100ca290 tx=0x7f05100095d0 comp rx=0 tx=0).stop 2024-09-21T06:36:58.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.243+0000 7f0516ffd640 1 -- 172.21.15.7:0/526483423 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0520102a60 msgr2=0x7f05201982b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:58.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.243+0000 7f0516ffd640 1 --2- 172.21.15.7:0/526483423 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0520102a60 0x7f05201982b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0510005940 tx=0x7f05100040c0 comp rx=0 tx=0).stop 2024-09-21T06:36:58.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.243+0000 7f0516ffd640 1 -- 172.21.15.7:0/526483423 shutdown_connections 2024-09-21T06:36:58.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.243+0000 7f0516ffd640 1 --2- 172.21.15.7:0/526483423 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f050c0b66f0 0x7f050c0b8c00 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:58.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.243+0000 7f0516ffd640 1 --2- 172.21.15.7:0/526483423 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0520108cf0 0x7f052019daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:58.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.243+0000 7f0516ffd640 1 --2- 172.21.15.7:0/526483423 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05201083a0 0x7f0520198850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:58.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.243+0000 7f0516ffd640 1 --2- 172.21.15.7:0/526483423 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0520102a60 0x7f05201982b0 secure :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0510005940 tx=0x7f05100040c0 comp rx=0 tx=0).stop 2024-09-21T06:36:58.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.243+0000 7f0516ffd640 1 -- 172.21.15.7:0/526483423 >> 172.21.15.7:0/526483423 conn(0x7f0520079730 msgr2=0x7f0520101440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:58.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.243+0000 7f0516ffd640 1 -- 172.21.15.7:0/526483423 shutdown_connections 2024-09-21T06:36:58.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:58.244+0000 7f0516ffd640 1 -- 172.21.15.7:0/526483423 wait complete. 2024-09-21T06:36:58.947 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:36:59.223 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:36:59.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:36:58 smithi144 ceph-mon[34653]: pgmap v342: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-21T06:36:59.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:36:58 smithi007 ceph-mon[30983]: pgmap v342: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-21T06:36:59.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:36:58 smithi018 ceph-mon[34477]: pgmap v342: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-21T06:36:59.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.726+0000 7f0bda3bd640 1 -- 172.21.15.7:0/287271504 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0bd410de10 msgr2=0x7f0bd4110300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:59.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.726+0000 7f0bda3bd640 1 --2- 172.21.15.7:0/287271504 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0bd410de10 0x7f0bd4110300 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc009be0 tx=0x7f0bcc02a6e0 comp rx=0 tx=0).stop 2024-09-21T06:36:59.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.726+0000 7f0bda3bd640 1 -- 172.21.15.7:0/287271504 shutdown_connections 2024-09-21T06:36:59.729 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.726+0000 7f0bda3bd640 1 --2- 172.21.15.7:0/287271504 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0bd410de10 0x7f0bd4110300 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:59.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.726+0000 7f0bda3bd640 1 --2- 172.21.15.7:0/287271504 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0bd4105300 0x7f0bd410d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:59.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.726+0000 7f0bda3bd640 1 --2- 172.21.15.7:0/287271504 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0bd41049b0 0x7f0bd4104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:59.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.726+0000 7f0bda3bd640 1 -- 172.21.15.7:0/287271504 >> 172.21.15.7:0/287271504 conn(0x7f0bd4079730 msgr2=0x7f0bd4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:59.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.726+0000 7f0bda3bd640 1 -- 172.21.15.7:0/287271504 shutdown_connections 2024-09-21T06:36:59.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.726+0000 7f0bda3bd640 1 -- 172.21.15.7:0/287271504 wait complete. 2024-09-21T06:36:59.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.727+0000 7f0bda3bd640 1 Processor -- start 2024-09-21T06:36:59.730 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.728+0000 7f0bda3bd640 1 -- start start 2024-09-21T06:36:59.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.728+0000 7f0bda3bd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0bd41049b0 0x7f0bd419a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:59.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.728+0000 7f0bda3bd640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0bd4105300 0x7f0bd419aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:59.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.728+0000 7f0bda3bd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0bd410de10 0x7f0bd419fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:59.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.728+0000 7f0bda3bd640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd4113a70 con 0x7f0bd410de10 2024-09-21T06:36:59.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.728+0000 7f0bda3bd640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd41138f0 con 0x7f0bd41049b0 2024-09-21T06:36:59.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.728+0000 7f0bda3bd640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd4113bf0 con 0x7f0bd4105300 2024-09-21T06:36:59.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.728+0000 7f0bd895a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0bd410de10 0x7f0bd419fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:59.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.728+0000 7f0bd895a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0bd410de10 0x7f0bd419fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45984/0 (socket says 172.21.15.7:45984) 2024-09-21T06:36:59.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.728+0000 7f0bd895a640 1 -- 172.21.15.7:0/87084077 learned_addr learned my addr 172.21.15.7:0/87084077 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:36:59.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.728+0000 7f0bd3fff640 1 --2- 172.21.15.7:0/87084077 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0bd41049b0 0x7f0bd419a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:59.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.728+0000 7f0bd37fe640 1 --2- 172.21.15.7:0/87084077 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0bd4105300 0x7f0bd419aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:59.732 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.729+0000 7f0bd895a640 1 -- 172.21.15.7:0/87084077 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0bd4105300 msgr2=0x7f0bd419aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:59.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.729+0000 7f0bd895a640 1 --2- 172.21.15.7:0/87084077 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0bd4105300 0x7f0bd419aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:59.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.729+0000 7f0bd895a640 1 -- 172.21.15.7:0/87084077 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0bd41049b0 msgr2=0x7f0bd419a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:59.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.729+0000 7f0bd895a640 1 --2- 172.21.15.7:0/87084077 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0bd41049b0 0x7f0bd419a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:59.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.729+0000 7f0bd895a640 1 -- 172.21.15.7:0/87084077 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bd41a0410 con 0x7f0bd410de10 2024-09-21T06:36:59.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.729+0000 7f0bd37fe640 1 --2- 172.21.15.7:0/87084077 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0bd4105300 0x7f0bd419aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:36:59.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.729+0000 7f0bd895a640 1 --2- 172.21.15.7:0/87084077 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0bd410de10 0x7f0bd419fce0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc006010 tx=0x7f0bcc003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:59.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.729+0000 7f0bd17fa640 1 -- 172.21.15.7:0/87084077 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bcc041020 con 0x7f0bd410de10 2024-09-21T06:36:59.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.729+0000 7f0bd17fa640 1 -- 172.21.15.7:0/87084077 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0bcc0318f0 con 0x7f0bd410de10 2024-09-21T06:36:59.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.730+0000 7f0bd17fa640 1 -- 172.21.15.7:0/87084077 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bcc036040 con 0x7f0bd410de10 2024-09-21T06:36:59.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.730+0000 7f0bda3bd640 1 -- 172.21.15.7:0/87084077 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bd41a06a0 con 0x7f0bd410de10 2024-09-21T06:36:59.733 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.730+0000 7f0bda3bd640 1 -- 172.21.15.7:0/87084077 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bd41025d0 con 0x7f0bd410de10 2024-09-21T06:36:59.734 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.732+0000 7f0be0931740 1 Processor -- start 2024-09-21T06:36:59.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.734+0000 7f0bd17fa640 1 -- 172.21.15.7:0/87084077 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154585+0+0 (secure 0 0 0) 0x7f0bcc044020 con 0x7f0bd410de10 2024-09-21T06:36:59.736 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.734+0000 7f0be0931740 1 -- start start 2024-09-21T06:36:59.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.735+0000 7f0be0931740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561879f7c070 0x56187a3232c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:59.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.735+0000 7f0be0931740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561879f531b0 0x56187a323800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:59.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.735+0000 7f0be0931740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561879f5b390 0x56187a323d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:59.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.735+0000 7f0be0931740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56187a299ea0 con 0x561879f5b390 2024-09-21T06:36:59.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.735+0000 7f0be0931740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56187a2892d0 con 0x561879f531b0 2024-09-21T06:36:59.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.735+0000 7f0be0931740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x56187a28d0e0 con 0x561879f7c070 2024-09-21T06:36:59.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.735+0000 7f0bd37fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561879f5b390 0x56187a323d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:59.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.735+0000 7f0bd37fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561879f5b390 0x56187a323d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45996/0 (socket says 172.21.15.7:45996) 2024-09-21T06:36:59.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.735+0000 7f0bd37fe640 1 -- 172.21.15.7:0/1790064602 learned_addr learned my addr 172.21.15.7:0/1790064602 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:36:59.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.735+0000 7f0bd37fe640 1 --2- 172.21.15.7:0/1790064602 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561879f7c070 0x56187a3232c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:59.737 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.735+0000 7f0bd3fff640 1 --2- 172.21.15.7:0/1790064602 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561879f531b0 0x56187a323800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:59.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.735+0000 7f0bd37fe640 1 -- 172.21.15.7:0/1790064602 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561879f7c070 msgr2=0x56187a3232c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:59.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.735+0000 7f0bd37fe640 1 --2- 172.21.15.7:0/1790064602 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561879f7c070 0x56187a3232c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:59.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.735+0000 7f0bd37fe640 1 -- 172.21.15.7:0/1790064602 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561879f531b0 msgr2=0x56187a323800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:59.738 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.735+0000 7f0bd37fe640 1 --2- 172.21.15.7:0/1790064602 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561879f531b0 0x56187a323800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:59.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.735+0000 7f0bd37fe640 1 -- 172.21.15.7:0/1790064602 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561879fe7650 con 0x561879f5b390 2024-09-21T06:36:59.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.735+0000 7f0bd17fa640 1 --2- 172.21.15.7:0/87084077 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f0bbc0b6670 0x7f0bbc0b8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:59.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.736+0000 7f0bd3fff640 1 --2- 172.21.15.7:0/87084077 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f0bbc0b6670 0x7f0bbc0b8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:59.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.736+0000 7f0bd17fa640 1 -- 172.21.15.7:0/87084077 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f0bcc108260 con 0x7f0bd410de10 2024-09-21T06:36:59.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.736+0000 7f0bd37fe640 1 --2- 172.21.15.7:0/1790064602 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561879f5b390 0x56187a323d40 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f0bc8009ee0 tx=0x7f0bc80096c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31075d0f70c08a92 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:59.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.736+0000 7f0bba7fc640 1 -- 172.21.15.7:0/1790064602 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bc8004030 con 0x561879f5b390 2024-09-21T06:36:59.739 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.736+0000 7f0bba7fc640 1 -- 172.21.15.7:0/1790064602 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0bc80035f0 con 0x561879f5b390 2024-09-21T06:36:59.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.737+0000 7f0bba7fc640 1 -- 172.21.15.7:0/1790064602 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bc800f840 con 0x561879f5b390 2024-09-21T06:36:59.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.737+0000 7f0be0931740 1 -- 172.21.15.7:0/1790064602 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561879f5b390 msgr2=0x56187a323d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:59.740 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.737+0000 7f0be0931740 1 --2- 172.21.15.7:0/1790064602 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561879f5b390 0x56187a323d40 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f0bc8009ee0 tx=0x7f0bc80096c0 comp rx=0 tx=0).stop 2024-09-21T06:36:59.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.737+0000 7f0bd3fff640 1 --2- 172.21.15.7:0/87084077 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f0bbc0b6670 0x7f0bbc0b8b80 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x56187a321f40 tx=0x7f0bc4009260 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:59.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.738+0000 7f0be0931740 1 -- 172.21.15.7:0/1790064602 shutdown_connections 2024-09-21T06:36:59.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.738+0000 7f0be0931740 1 --2- 172.21.15.7:0/1790064602 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561879f5b390 0x56187a323d40 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:59.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.738+0000 7f0be0931740 1 --2- 172.21.15.7:0/1790064602 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561879f531b0 0x56187a323800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:59.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.738+0000 7f0be0931740 1 --2- 172.21.15.7:0/1790064602 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561879f7c070 0x56187a3232c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:59.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.738+0000 7f0be0931740 1 -- 172.21.15.7:0/1790064602 >> 172.21.15.7:0/1790064602 conn(0x561879f70460 msgr2=0x56187a3211b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:59.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.738+0000 7f0be0931740 1 -- 172.21.15.7:0/1790064602 shutdown_connections 2024-09-21T06:36:59.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.738+0000 7f0be0931740 1 -- 172.21.15.7:0/1790064602 wait complete. 2024-09-21T06:36:59.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.738+0000 7f0be0931740 1 -- start start 2024-09-21T06:36:59.741 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.739+0000 7f0be0931740 1 Processor -- start 2024-09-21T06:36:59.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.739+0000 7f0be0931740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561879f531b0 0x56187a32e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:59.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.739+0000 7f0be0931740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561879f5b390 0x56187a32edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:59.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.740+0000 7f0bd37fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561879f5b390 0x56187a32edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:59.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.740+0000 7f0bd37fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561879f5b390 0x56187a32edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45998/0 (socket says 172.21.15.7:45998) 2024-09-21T06:36:59.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.740+0000 7f0bd37fe640 1 -- 172.21.15.7:0/227928808 learned_addr learned my addr 172.21.15.7:0/227928808 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:36:59.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.740+0000 7f0be0931740 1 --2- 172.21.15.7:0/227928808 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561879f7c070 0x56187a32f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:59.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.740+0000 7f0bd3fff640 1 --2- 172.21.15.7:0/227928808 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561879f531b0 0x56187a32e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:59.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.740+0000 7f0be0931740 1 -- 172.21.15.7:0/227928808 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56187a0ea700 con 0x561879f5b390 2024-09-21T06:36:59.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.740+0000 7f0be0931740 1 -- 172.21.15.7:0/227928808 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56187a224160 con 0x561879f7c070 2024-09-21T06:36:59.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.740+0000 7f0be0931740 1 -- 172.21.15.7:0/227928808 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x56187a331b40 con 0x561879f531b0 2024-09-21T06:36:59.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.740+0000 7f0bd895a640 1 --2- 172.21.15.7:0/227928808 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561879f7c070 0x56187a32f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:59.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.740+0000 7f0be0931740 10 client.0 _ll_register_callbacks cb 0x56187a23d9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:36:59.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.740+0000 7f0bd3fff640 1 -- 172.21.15.7:0/227928808 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561879f7c070 msgr2=0x56187a32f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:59.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.740+0000 7f0bd3fff640 1 --2- 172.21.15.7:0/227928808 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561879f7c070 0x56187a32f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:59.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.740+0000 7f0bd3fff640 1 -- 172.21.15.7:0/227928808 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561879f5b390 msgr2=0x56187a32edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:59.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.740+0000 7f0bd3fff640 1 --2- 172.21.15.7:0/227928808 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561879f5b390 0x56187a32edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:59.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.740+0000 7f0bd3fff640 1 -- 172.21.15.7:0/227928808 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56187a251c90 con 0x561879f531b0 2024-09-21T06:36:59.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.740+0000 7f0bd895a640 1 --2- 172.21.15.7:0/227928808 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561879f7c070 0x56187a32f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:36:59.745 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.740+0000 7f0be0931740 1 -- 172.21.15.7:0/227928808 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0bc80035f0 con 0x561879f531b0 2024-09-21T06:36:59.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.740+0000 7f0bd3fff640 1 --2- 172.21.15.7:0/227928808 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561879f531b0 0x56187a32e890 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0bc4013010 tx=0x7f0bc4004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9caa071fcacddb7e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:59.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.740+0000 7f0bb37fe640 10 client.25249 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-21T06:36:59.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.741+0000 7f0bb37fe640 1 -- 172.21.15.7:0/227928808 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bc4029ae0 con 0x561879f531b0 2024-09-21T06:36:59.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.741+0000 7f0bb37fe640 1 -- 172.21.15.7:0/227928808 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f0bc4029c80 con 0x561879f531b0 2024-09-21T06:36:59.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.741+0000 7f0bb37fe640 1 -- 172.21.15.7:0/227928808 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0bc4034480 con 0x561879f531b0 2024-09-21T06:36:59.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.741+0000 7f0be0931740 10 client.25249 fetch_fsmap learned FSMap version 25 2024-09-21T06:36:59.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.741+0000 7f0be0931740 1 -- 172.21.15.7:0/227928808 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({fsmap=25}) -- 0x56187a33d720 con 0x561879f531b0 2024-09-21T06:36:59.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.742+0000 7f0bb37fe640 1 -- 172.21.15.7:0/227928808 <== mon.1 v2:172.21.15.144:3300/0 4 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f0bc4034620 con 0x561879f531b0 2024-09-21T06:36:59.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.742+0000 7f0be0931740 10 client.25249 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:36:59.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.742+0000 7f0be0931740 10 client.25249 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:36:59.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.742+0000 7f0be0931740 20 client.25249 populate_metadata read hostname 'smithi007' 2024-09-21T06:36:59.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.742+0000 7f0be0931740 1 --2- 172.21.15.7:0/227928808 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x561879f3a9f0 0x56187a340b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:59.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.742+0000 7f0be0931740 4 client.25249 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:36:59.746 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.742+0000 7f0be0931740 1 -- 172.21.15.7:0/227928808 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56187a29bdf0 con 0x561879f3a9f0 2024-09-21T06:36:59.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.742+0000 7f0bd37fe640 1 --2- 172.21.15.7:0/227928808 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x561879f3a9f0 0x56187a340b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:59.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.743+0000 7f0bb37fe640 10 client.25249 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:36:59.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.743+0000 7f0bd37fe640 1 --2- 172.21.15.7:0/227928808 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x561879f3a9f0 0x56187a340b90 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d39f18601579954f server_cookie=7d80baf526e37472 in_seq=0 out_seq=0 2024-09-21T06:36:59.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.743+0000 7f0bb37fe640 1 -- 172.21.15.7:0/227928808 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56187a29bdf0 con 0x561879f3a9f0 2024-09-21T06:36:59.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.743+0000 7f0bb37fe640 10 client.25249 handle_command_reply: tid=0 2024-09-21T06:36:59.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.743+0000 7f0be0931740 1 client.25249 shutdown 2024-09-21T06:36:59.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.744+0000 7f0be0931740 1 -- 172.21.15.7:0/227928808 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561879f531b0 msgr2=0x56187a32e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:59.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.744+0000 7f0be0931740 1 --2- 172.21.15.7:0/227928808 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561879f531b0 0x56187a32e890 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0bc4013010 tx=0x7f0bc4004730 comp rx=0 tx=0).stop 2024-09-21T06:36:59.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.744+0000 7f0be0931740 1 -- 172.21.15.7:0/227928808 shutdown_connections 2024-09-21T06:36:59.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.744+0000 7f0be0931740 1 --2- 172.21.15.7:0/227928808 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x561879f3a9f0 0x56187a340b90 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:59.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.744+0000 7f0bb37fe640 0 client.25249 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:36:59.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.744+0000 7f0be0931740 1 --2- 172.21.15.7:0/227928808 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561879f7c070 0x56187a32f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:59.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.744+0000 7f0be0931740 1 --2- 172.21.15.7:0/227928808 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561879f5b390 0x56187a32edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:59.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.744+0000 7f0be0931740 1 --2- 172.21.15.7:0/227928808 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561879f531b0 0x56187a32e890 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:59.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.744+0000 7f0be0931740 1 -- 172.21.15.7:0/227928808 >> 172.21.15.7:0/227928808 conn(0x561879f70460 msgr2=0x56187a326450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:59.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.744+0000 7f0be0931740 1 -- 172.21.15.7:0/227928808 shutdown_connections 2024-09-21T06:36:59.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.744+0000 7f0be0931740 1 -- 172.21.15.7:0/227928808 wait complete. 2024-09-21T06:36:59.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.744+0000 7f0be0931740 20 client.25249 trim_cache size 0 max 16384 2024-09-21T06:36:59.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.758+0000 7f0be0931740 1 Processor -- start 2024-09-21T06:36:59.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.758+0000 7f0be0931740 1 -- start start 2024-09-21T06:36:59.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.758+0000 7f0be0931740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561879f531b0 0x56187a324dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:59.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.758+0000 7f0be0931740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561879f5b390 0x56187a320760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:59.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.758+0000 7f0be0931740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561879f7c070 0x56187a320ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:59.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.758+0000 7f0be0931740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd41afb50 con 0x561879f7c070 2024-09-21T06:36:59.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.758+0000 7f0be0931740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd41ad420 con 0x561879f5b390 2024-09-21T06:36:59.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.758+0000 7f0be0931740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd41ab270 con 0x561879f531b0 2024-09-21T06:36:59.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.758+0000 7f0bd37fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561879f5b390 0x56187a320760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:59.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.758+0000 7f0bd37fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561879f5b390 0x56187a320760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.7:53152/0 (socket says 172.21.15.7:53152) 2024-09-21T06:36:59.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.758+0000 7f0bd37fe640 1 -- 172.21.15.7:0/642686591 learned_addr learned my addr 172.21.15.7:0/642686591 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:36:59.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.758+0000 7f0bd895a640 1 --2- 172.21.15.7:0/642686591 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561879f7c070 0x56187a320ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:59.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.758+0000 7f0bd3fff640 1 --2- 172.21.15.7:0/642686591 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561879f531b0 0x56187a324dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:59.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.759+0000 7f0bd895a640 1 -- 172.21.15.7:0/642686591 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561879f531b0 msgr2=0x56187a324dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:59.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.759+0000 7f0bd895a640 1 --2- 172.21.15.7:0/642686591 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561879f531b0 0x56187a324dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:59.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.759+0000 7f0bd895a640 1 -- 172.21.15.7:0/642686591 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561879f5b390 msgr2=0x56187a320760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:59.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.759+0000 7f0bd895a640 1 --2- 172.21.15.7:0/642686591 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561879f5b390 0x56187a320760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:59.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.759+0000 7f0bd895a640 1 -- 172.21.15.7:0/642686591 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56187a31b460 con 0x561879f7c070 2024-09-21T06:36:59.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.759+0000 7f0bd37fe640 1 --2- 172.21.15.7:0/642686591 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561879f5b390 0x56187a320760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:36:59.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.759+0000 7f0bd895a640 1 --2- 172.21.15.7:0/642686591 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561879f7c070 0x56187a320ca0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc105b90 tx=0x7f0bcc02a6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e887bdcead6a853 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:59.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.759+0000 7f0bb9ffb640 1 -- 172.21.15.7:0/642686591 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bcc0cdd20 con 0x561879f7c070 2024-09-21T06:36:59.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.759+0000 7f0bb9ffb640 1 -- 172.21.15.7:0/642686591 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0bcc0ce910 con 0x561879f7c070 2024-09-21T06:36:59.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.759+0000 7f0bb9ffb640 1 -- 172.21.15.7:0/642686591 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bcc004d40 con 0x561879f7c070 2024-09-21T06:36:59.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.761+0000 7f0be0931740 1 -- 172.21.15.7:0/642686591 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561879f7c070 msgr2=0x56187a320ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:59.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.761+0000 7f0be0931740 1 --2- 172.21.15.7:0/642686591 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561879f7c070 0x56187a320ca0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc105b90 tx=0x7f0bcc02a6e0 comp rx=0 tx=0).stop 2024-09-21T06:36:59.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.761+0000 7f0be0931740 1 -- 172.21.15.7:0/642686591 shutdown_connections 2024-09-21T06:36:59.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.761+0000 7f0be0931740 1 --2- 172.21.15.7:0/642686591 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561879f7c070 0x56187a320ca0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:59.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.761+0000 7f0be0931740 1 --2- 172.21.15.7:0/642686591 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561879f5b390 0x56187a320760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:59.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.761+0000 7f0be0931740 1 --2- 172.21.15.7:0/642686591 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561879f531b0 0x56187a324dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:59.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.761+0000 7f0be0931740 1 -- 172.21.15.7:0/642686591 >> 172.21.15.7:0/642686591 conn(0x561879f70460 msgr2=0x56187a33a730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:59.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.761+0000 7f0be0931740 1 -- 172.21.15.7:0/642686591 shutdown_connections 2024-09-21T06:36:59.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.761+0000 7f0be0931740 1 -- 172.21.15.7:0/642686591 wait complete. 2024-09-21T06:36:59.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.761+0000 7f0be0931740 1 -- start start 2024-09-21T06:36:59.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.762+0000 7f0be0931740 1 Processor -- start 2024-09-21T06:36:59.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.762+0000 7f0be0931740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561879f531b0 0x56187a3335a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:59.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.762+0000 7f0be0931740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561879f5b390 0x56187a333b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:59.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.762+0000 7f0be0931740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561879f7c070 0x56187a3aa550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:59.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.762+0000 7f0be0931740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd41ab8e0 con 0x561879f531b0 2024-09-21T06:36:59.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.762+0000 7f0be0931740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd41acd50 con 0x561879f7c070 2024-09-21T06:36:59.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.762+0000 7f0be0931740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd41abfb0 con 0x561879f5b390 2024-09-21T06:36:59.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.762+0000 7f0be0931740 10 client.0 _ll_register_callbacks cb 0x7f0bc4009b10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:36:59.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.762+0000 7f0bd3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561879f531b0 0x56187a3335a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:59.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.763+0000 7f0bd3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561879f531b0 0x56187a3335a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46014/0 (socket says 172.21.15.7:46014) 2024-09-21T06:36:59.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.763+0000 7f0bd3fff640 1 -- 172.21.15.7:0/2901946190 learned_addr learned my addr 172.21.15.7:0/2901946190 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:36:59.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.763+0000 7f0bd895a640 1 --2- 172.21.15.7:0/2901946190 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561879f7c070 0x56187a3aa550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:59.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.763+0000 7f0bd37fe640 1 --2- 172.21.15.7:0/2901946190 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561879f5b390 0x56187a333b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:59.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.763+0000 7f0bd895a640 1 -- 172.21.15.7:0/2901946190 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561879f5b390 msgr2=0x56187a333b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:59.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.763+0000 7f0bd895a640 1 --2- 172.21.15.7:0/2901946190 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561879f5b390 0x56187a333b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:59.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.763+0000 7f0bd895a640 1 -- 172.21.15.7:0/2901946190 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561879f531b0 msgr2=0x56187a3335a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:59.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.763+0000 7f0bd895a640 1 --2- 172.21.15.7:0/2901946190 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561879f531b0 0x56187a3335a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:59.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.763+0000 7f0bd895a640 1 -- 172.21.15.7:0/2901946190 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56187a31c5d0 con 0x561879f7c070 2024-09-21T06:36:59.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.763+0000 7f0bd3fff640 1 --2- 172.21.15.7:0/2901946190 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561879f531b0 0x56187a3335a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:36:59.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.763+0000 7f0bd895a640 1 --2- 172.21.15.7:0/2901946190 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561879f7c070 0x56187a3aa550 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc0cdaf0 tx=0x7f0bcc030e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3cf4c87ee182ae2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:59.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.763+0000 7f0bb37fe640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-21T06:36:59.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.763+0000 7f0bb37fe640 1 -- 172.21.15.7:0/2901946190 <== mon.2 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bcc0b9030 con 0x561879f7c070 2024-09-21T06:36:59.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.764+0000 7f0bb37fe640 1 -- 172.21.15.7:0/2901946190 <== mon.2 v2:172.21.15.18:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f0bcc031440 con 0x561879f7c070 2024-09-21T06:36:59.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.764+0000 7f0be0931740 1 -- 172.21.15.7:0/2901946190 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0bcc0ce910 con 0x561879f7c070 2024-09-21T06:36:59.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.764+0000 7f0bb37fe640 1 -- 172.21.15.7:0/2901946190 <== mon.2 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0bcc0cdd20 con 0x561879f7c070 2024-09-21T06:36:59.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.764+0000 7f0be0931740 10 client.25406 fetch_fsmap learned FSMap version 25 2024-09-21T06:36:59.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.764+0000 7f0be0931740 1 -- 172.21.15.7:0/2901946190 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56187a3abbf0 con 0x561879f7c070 2024-09-21T06:36:59.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.764+0000 7f0bb37fe640 1 -- 172.21.15.7:0/2901946190 <== mon.2 v2:172.21.15.18:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0bcc0ce910 con 0x561879f7c070 2024-09-21T06:36:59.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.765+0000 7f0bb37fe640 1 -- 172.21.15.7:0/2901946190 <== mon.2 v2:172.21.15.18:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f0bcc0c9b60 con 0x561879f7c070 2024-09-21T06:36:59.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.765+0000 7f0be0931740 10 client.25406 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:36:59.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.765+0000 7f0be0931740 10 client.25406 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:36:59.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.765+0000 7f0be0931740 20 client.25406 populate_metadata read hostname 'smithi007' 2024-09-21T06:36:59.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.765+0000 7f0be0931740 1 --2- 172.21.15.7:0/2901946190 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x561879f0fda0 0x56187a3ae230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:59.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.765+0000 7f0be0931740 4 client.25406 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:36:59.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.765+0000 7f0be0931740 1 -- 172.21.15.7:0/2901946190 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56187a2978a0 con 0x561879f0fda0 2024-09-21T06:36:59.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.765+0000 7f0bd3fff640 1 --2- 172.21.15.7:0/2901946190 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x561879f0fda0 0x56187a3ae230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:59.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.765+0000 7f0bb37fe640 10 client.25406 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:36:59.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.765+0000 7f0bd3fff640 1 --2- 172.21.15.7:0/2901946190 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x561879f0fda0 0x56187a3ae230 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e909e8f76f1f70b server_cookie=e5d9bff0de2d4aec in_seq=0 out_seq=0 2024-09-21T06:36:59.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.766+0000 7f0bb37fe640 1 -- 172.21.15.7:0/2901946190 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56187a2978a0 con 0x561879f0fda0 2024-09-21T06:36:59.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.766+0000 7f0bb37fe640 10 client.25406 handle_command_reply: tid=0 2024-09-21T06:36:59.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.766+0000 7f0be0931740 1 client.25406 shutdown 2024-09-21T06:36:59.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.766+0000 7f0be0931740 1 -- 172.21.15.7:0/2901946190 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561879f7c070 msgr2=0x56187a3aa550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:59.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.766+0000 7f0be0931740 1 --2- 172.21.15.7:0/2901946190 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561879f7c070 0x56187a3aa550 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc0cdaf0 tx=0x7f0bcc030e70 comp rx=0 tx=0).stop 2024-09-21T06:36:59.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.766+0000 7f0be0931740 1 -- 172.21.15.7:0/2901946190 shutdown_connections 2024-09-21T06:36:59.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.766+0000 7f0be0931740 1 --2- 172.21.15.7:0/2901946190 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x561879f0fda0 0x56187a3ae230 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:59.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.766+0000 7f0be0931740 1 --2- 172.21.15.7:0/2901946190 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561879f7c070 0x56187a3aa550 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:59.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.766+0000 7f0be0931740 1 --2- 172.21.15.7:0/2901946190 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561879f5b390 0x56187a333b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:59.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.766+0000 7f0be0931740 1 --2- 172.21.15.7:0/2901946190 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561879f531b0 0x56187a3335a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:59.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.766+0000 7f0be0931740 1 -- 172.21.15.7:0/2901946190 >> 172.21.15.7:0/2901946190 conn(0x561879f70460 msgr2=0x56187a3283d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:59.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.766+0000 7f0bb37fe640 0 client.25406 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:36:59.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.766+0000 7f0be0931740 1 -- 172.21.15.7:0/2901946190 shutdown_connections 2024-09-21T06:36:59.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.766+0000 7f0be0931740 1 -- 172.21.15.7:0/2901946190 wait complete. 2024-09-21T06:36:59.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.766+0000 7f0be0931740 20 client.25406 trim_cache size 0 max 16384 2024-09-21T06:36:59.772 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:36:59.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.767+0000 7f0bda3bd640 1 -- 172.21.15.7:0/87084077 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f0bbc0b6670 msgr2=0x7f0bbc0b8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:59.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.767+0000 7f0bda3bd640 1 --2- 172.21.15.7:0/87084077 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f0bbc0b6670 0x7f0bbc0b8b80 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x56187a321f40 tx=0x7f0bc4009260 comp rx=0 tx=0).stop 2024-09-21T06:36:59.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.767+0000 7f0bda3bd640 1 -- 172.21.15.7:0/87084077 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0bd410de10 msgr2=0x7f0bd419fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:59.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.767+0000 7f0bda3bd640 1 --2- 172.21.15.7:0/87084077 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0bd410de10 0x7f0bd419fce0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc006010 tx=0x7f0bcc003ba0 comp rx=0 tx=0).stop 2024-09-21T06:36:59.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.767+0000 7f0bda3bd640 1 -- 172.21.15.7:0/87084077 shutdown_connections 2024-09-21T06:36:59.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.767+0000 7f0bda3bd640 1 --2- 172.21.15.7:0/87084077 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f0bbc0b6670 0x7f0bbc0b8b80 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:59.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.767+0000 7f0bda3bd640 1 --2- 172.21.15.7:0/87084077 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0bd410de10 0x7f0bd419fce0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:59.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.767+0000 7f0bda3bd640 1 --2- 172.21.15.7:0/87084077 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0bd4105300 0x7f0bd419aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:59.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.767+0000 7f0bda3bd640 1 --2- 172.21.15.7:0/87084077 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0bd41049b0 0x7f0bd419a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:59.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.768+0000 7f0bda3bd640 1 -- 172.21.15.7:0/87084077 >> 172.21.15.7:0/87084077 conn(0x7f0bd4079730 msgr2=0x7f0bd41007b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:59.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.768+0000 7f0bda3bd640 1 -- 172.21.15.7:0/87084077 shutdown_connections 2024-09-21T06:36:59.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:36:59.768+0000 7f0bda3bd640 1 -- 172.21.15.7:0/87084077 wait complete. 2024-09-21T06:36:59.984 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.982+0000 7f7187e84640 1 -- 172.21.15.7:0/1047887785 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7180102180 msgr2=0x7f7180102590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:59.985 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.982+0000 7f7187e84640 1 --2- 172.21.15.7:0/1047887785 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7180102180 0x7f7180102590 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f717c00adb0 tx=0x7f717c02b7c0 comp rx=0 tx=0).stop 2024-09-21T06:36:59.985 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.982+0000 7f7187e84640 1 -- 172.21.15.7:0/1047887785 shutdown_connections 2024-09-21T06:36:59.985 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.982+0000 7f7187e84640 1 --2- 172.21.15.7:0/1047887785 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7180108500 0x7f718010ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:59.985 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.982+0000 7f7187e84640 1 --2- 172.21.15.7:0/1047887785 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7180107bb0 0x7f7180107fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:59.985 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.982+0000 7f7187e84640 1 --2- 172.21.15.7:0/1047887785 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7180102180 0x7f7180102590 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:59.985 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.982+0000 7f7187e84640 1 -- 172.21.15.7:0/1047887785 >> 172.21.15.7:0/1047887785 conn(0x7f7180079e50 msgr2=0x7f718007a260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:36:59.985 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.983+0000 7f7187e84640 1 -- 172.21.15.7:0/1047887785 shutdown_connections 2024-09-21T06:36:59.985 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.983+0000 7f7187e84640 1 -- 172.21.15.7:0/1047887785 wait complete. 2024-09-21T06:36:59.986 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.984+0000 7f7187e84640 1 Processor -- start 2024-09-21T06:36:59.986 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.984+0000 7f7187e84640 1 -- start start 2024-09-21T06:36:59.987 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.985+0000 7f7187e84640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7180107bb0 0x7f718019c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:59.988 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.985+0000 7f7187e84640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7180108500 0x7f718019cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:59.988 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.985+0000 7f7185c20640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7180107bb0 0x7f718019c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:59.988 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.985+0000 7f7185c20640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7180107bb0 0x7f718019c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46024/0 (socket says 172.21.15.7:46024) 2024-09-21T06:36:59.988 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.985+0000 7f7185c20640 1 -- 172.21.15.7:0/1832042973 learned_addr learned my addr 172.21.15.7:0/1832042973 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:36:59.988 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.985+0000 7f7187e84640 1 --2- 172.21.15.7:0/1832042973 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71801a2110 0x7f71801a2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:59.988 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.986+0000 7f7187e84640 1 -- 172.21.15.7:0/1832042973 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f71801119d0 con 0x7f7180107bb0 2024-09-21T06:36:59.988 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.986+0000 7f718541f640 1 --2- 172.21.15.7:0/1832042973 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7180108500 0x7f718019cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:59.988 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.986+0000 7f7186421640 1 --2- 172.21.15.7:0/1832042973 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71801a2110 0x7f71801a2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:59.988 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.986+0000 7f7187e84640 1 -- 172.21.15.7:0/1832042973 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7180111850 con 0x7f7180108500 2024-09-21T06:36:59.988 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.986+0000 7f7187e84640 1 -- 172.21.15.7:0/1832042973 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7180111b50 con 0x7f71801a2110 2024-09-21T06:36:59.989 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.986+0000 7f7185c20640 1 -- 172.21.15.7:0/1832042973 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71801a2110 msgr2=0x7f71801a2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:59.989 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.986+0000 7f7185c20640 1 --2- 172.21.15.7:0/1832042973 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71801a2110 0x7f71801a2520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:59.989 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.986+0000 7f7185c20640 1 -- 172.21.15.7:0/1832042973 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7180108500 msgr2=0x7f718019cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:59.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.986+0000 7f7185c20640 1 --2- 172.21.15.7:0/1832042973 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7180108500 0x7f718019cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:59.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.987+0000 7f7185c20640 1 -- 172.21.15.7:0/1832042973 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71801a2cf0 con 0x7f7180107bb0 2024-09-21T06:36:59.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.987+0000 7f718541f640 1 --2- 172.21.15.7:0/1832042973 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7180108500 0x7f718019cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:36:59.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.987+0000 7f7185c20640 1 --2- 172.21.15.7:0/1832042973 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7180107bb0 0x7f718019c9a0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f717c031040 tx=0x7f717c00a470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:59.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.987+0000 7f7176ffd640 1 -- 172.21.15.7:0/1832042973 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f717c040070 con 0x7f7180107bb0 2024-09-21T06:36:59.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.987+0000 7f7176ffd640 1 -- 172.21.15.7:0/1832042973 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f717c030a20 con 0x7f7180107bb0 2024-09-21T06:36:59.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.987+0000 7f7176ffd640 1 -- 172.21.15.7:0/1832042973 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f717c03b600 con 0x7f7180107bb0 2024-09-21T06:36:59.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.987+0000 7f7187e84640 1 -- 172.21.15.7:0/1832042973 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71801a9290 con 0x7f7180107bb0 2024-09-21T06:36:59.990 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.987+0000 7f7187e84640 1 -- 172.21.15.7:0/1832042973 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71801a9640 con 0x7f7180107bb0 2024-09-21T06:36:59.993 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.991+0000 7f718edf1740 1 Processor -- start 2024-09-21T06:36:59.994 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.991+0000 7f718edf1740 1 -- start start 2024-09-21T06:36:59.994 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.992+0000 7f718edf1740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5564057161b0 0x556405ac41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:59.994 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.992+0000 7f718edf1740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5564056ed2f0 0x556405ac4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:59.994 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.992+0000 7f718edf1740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5564056f54d0 0x556405ac4c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:36:59.994 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.992+0000 7f718edf1740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x556405a306f0 con 0x5564056f54d0 2024-09-21T06:36:59.994 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.992+0000 7f718edf1740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x556405a1fb20 con 0x5564056ed2f0 2024-09-21T06:36:59.995 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.992+0000 7f718edf1740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x556405a23930 con 0x5564057161b0 2024-09-21T06:36:59.995 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.992+0000 7f7186421640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5564057161b0 0x556405ac41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:59.995 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.992+0000 7f7186421640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5564057161b0 0x556405ac41c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.7:40366/0 (socket says 172.21.15.7:40366) 2024-09-21T06:36:59.995 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.992+0000 7f7186421640 1 -- 172.21.15.7:0/3185295726 learned_addr learned my addr 172.21.15.7:0/3185295726 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:36:59.995 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.992+0000 7f718541f640 1 --2- 172.21.15.7:0/3185295726 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5564056f54d0 0x556405ac4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:36:59.997 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.992+0000 7f7186421640 1 -- 172.21.15.7:0/3185295726 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5564056ed2f0 msgr2=0x556405ac4700 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T06:36:59.997 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.992+0000 7f7186421640 1 --2- 172.21.15.7:0/3185295726 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5564056ed2f0 0x556405ac4700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:59.998 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.992+0000 7f7186421640 1 -- 172.21.15.7:0/3185295726 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5564056f54d0 msgr2=0x556405ac4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:36:59.998 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.992+0000 7f7186421640 1 --2- 172.21.15.7:0/3185295726 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5564056f54d0 0x556405ac4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:59.998 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.992+0000 7f7186421640 1 -- 172.21.15.7:0/3185295726 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564059e5530 con 0x5564057161b0 2024-09-21T06:36:59.998 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.993+0000 7f718541f640 1 --2- 172.21.15.7:0/3185295726 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5564056f54d0 0x556405ac4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:36:59.998 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.993+0000 7f7186421640 1 --2- 172.21.15.7:0/3185295726 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5564057161b0 0x556405ac41c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7178009cc0 tx=0x7f7178011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2178844ad88902aa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:36:59.998 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.993+0000 7f716bfff640 1 -- 172.21.15.7:0/3185295726 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7178004250 con 0x5564057161b0 2024-09-21T06:36:59.998 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.993+0000 7f716bfff640 1 -- 172.21.15.7:0/3185295726 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f71780043f0 con 0x5564057161b0 2024-09-21T06:36:59.998 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.993+0000 7f716bfff640 1 -- 172.21.15.7:0/3185295726 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7178019740 con 0x5564057161b0 2024-09-21T06:36:59.998 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.994+0000 7f7176ffd640 1 -- 172.21.15.7:0/1832042973 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 24) ==== 154585+0+0 (secure 0 0 0) 0x7f717c03b7a0 con 0x7f7180107bb0 2024-09-21T06:36:59.999 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.994+0000 7f718edf1740 1 -- 172.21.15.7:0/3185295726 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5564057161b0 msgr2=0x556405ac41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:36:59.999 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.994+0000 7f718edf1740 1 --2- 172.21.15.7:0/3185295726 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5564057161b0 0x556405ac41c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7178009cc0 tx=0x7f7178011810 comp rx=0 tx=0).stop 2024-09-21T06:36:59.999 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.995+0000 7f718edf1740 1 -- 172.21.15.7:0/3185295726 shutdown_connections 2024-09-21T06:36:59.999 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.995+0000 7f718edf1740 1 --2- 172.21.15.7:0/3185295726 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5564056f54d0 0x556405ac4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:59.999 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.995+0000 7f718edf1740 1 --2- 172.21.15.7:0/3185295726 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5564056ed2f0 0x556405ac4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:36:59.999 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.995+0000 7f718edf1740 1 --2- 172.21.15.7:0/3185295726 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5564057161b0 0x556405ac41c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:00.000 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.995+0000 7f718edf1740 1 -- 172.21.15.7:0/3185295726 >> 172.21.15.7:0/3185295726 conn(0x55640570a300 msgr2=0x556405ac20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:00.000 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.995+0000 7f718edf1740 1 -- 172.21.15.7:0/3185295726 shutdown_connections 2024-09-21T06:37:00.000 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.995+0000 7f7176ffd640 1 --2- 172.21.15.7:0/1832042973 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f716c0b66d0 0x7f716c0b8be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:00.000 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.996+0000 7f7176ffd640 1 -- 172.21.15.7:0/1832042973 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f717c108bf0 con 0x7f7180107bb0 2024-09-21T06:37:00.000 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.996+0000 7f718edf1740 1 -- 172.21.15.7:0/3185295726 wait complete. 2024-09-21T06:37:00.004 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.996+0000 7f718541f640 1 --2- 172.21.15.7:0/1832042973 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f716c0b66d0 0x7f716c0b8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:00.004 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.996+0000 7f718edf1740 1 -- start start 2024-09-21T06:37:00.004 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.996+0000 7f718edf1740 1 Processor -- start 2024-09-21T06:37:00.004 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.997+0000 7f718541f640 1 --2- 172.21.15.7:0/1832042973 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f716c0b66d0 0x7f716c0b8be0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f71801076d0 tx=0x7f7170008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:00.004 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.997+0000 7f718edf1740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5564056ed2f0 0x556405acf800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:00.004 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.997+0000 7f718edf1740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5564056f54d0 0x556405acfd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:00.004 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.997+0000 7f718edf1740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5564057161b0 0x556405adbc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:00.004 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.997+0000 7f718edf1740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x556405957ab0 con 0x5564056f54d0 2024-09-21T06:37:00.004 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.997+0000 7f718edf1740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5564059c5730 con 0x5564056ed2f0 2024-09-21T06:37:00.004 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.997+0000 7f718edf1740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x556405ad2940 con 0x5564057161b0 2024-09-21T06:37:00.005 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.997+0000 7f718edf1740 10 client.0 _ll_register_callbacks cb 0x556405a196b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:37:00.005 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.997+0000 7f7186421640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5564057161b0 0x556405adbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:00.005 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.997+0000 7f7186421640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5564057161b0 0x556405adbc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.7:40368/0 (socket says 172.21.15.7:40368) 2024-09-21T06:37:00.005 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.997+0000 7f7186421640 1 -- 172.21.15.7:0/3096289561 learned_addr learned my addr 172.21.15.7:0/3096289561 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:37:00.005 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.998+0000 7f7185c20640 1 --2- 172.21.15.7:0/3096289561 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5564056ed2f0 0x556405acf800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:00.005 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.997+0000 7f718541f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5564056f54d0 0x556405acfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:00.005 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.998+0000 7f7186421640 1 -- 172.21.15.7:0/3096289561 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5564056ed2f0 msgr2=0x556405acf800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:00.005 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.998+0000 7f7186421640 1 --2- 172.21.15.7:0/3096289561 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5564056ed2f0 0x556405acf800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:00.005 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.998+0000 7f7186421640 1 -- 172.21.15.7:0/3096289561 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5564056f54d0 msgr2=0x556405acfd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:00.005 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.998+0000 7f7186421640 1 --2- 172.21.15.7:0/3096289561 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5564056f54d0 0x556405acfd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:00.005 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.998+0000 7f7186421640 1 -- 172.21.15.7:0/3096289561 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556405781790 con 0x5564057161b0 2024-09-21T06:37:00.005 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.998+0000 7f718541f640 1 --2- 172.21.15.7:0/3096289561 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5564056f54d0 0x556405acfd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:37:00.005 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.998+0000 7f7186421640 1 --2- 172.21.15.7:0/3096289561 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5564057161b0 0x556405adbc60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f71780057a0 tx=0x7f71780045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69e8cdc53e98fed3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:00.005 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.998+0000 7f71697fa640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-21T06:37:00.006 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.999+0000 7f71697fa640 1 -- 172.21.15.7:0/3096289561 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7178027020 con 0x5564057161b0 2024-09-21T06:37:00.006 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.999+0000 7f718edf1740 1 -- 172.21.15.7:0/3096289561 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f71780043f0 con 0x5564057161b0 2024-09-21T06:37:00.006 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.999+0000 7f71697fa640 1 -- 172.21.15.7:0/3096289561 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f7178003800 con 0x5564057161b0 2024-09-21T06:37:00.006 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.999+0000 7f71697fa640 1 -- 172.21.15.7:0/3096289561 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7178003a00 con 0x5564057161b0 2024-09-21T06:37:00.006 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.999+0000 7f718edf1740 10 client.25264 fetch_fsmap learned FSMap version 25 2024-09-21T06:37:00.006 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:36:59.999+0000 7f718edf1740 1 -- 172.21.15.7:0/3096289561 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5564057fa620 con 0x5564057161b0 2024-09-21T06:37:00.006 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.000+0000 7f71697fa640 1 -- 172.21.15.7:0/3096289561 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f71780043f0 con 0x5564057161b0 2024-09-21T06:37:00.006 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.000+0000 7f71697fa640 1 -- 172.21.15.7:0/3096289561 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f7178034020 con 0x5564057161b0 2024-09-21T06:37:00.006 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.000+0000 7f718edf1740 10 client.25264 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:37:00.006 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.000+0000 7f718edf1740 10 client.25264 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:37:00.006 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.000+0000 7f718edf1740 20 client.25264 populate_metadata read hostname 'smithi007' 2024-09-21T06:37:00.006 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.000+0000 7f718edf1740 1 --2- 172.21.15.7:0/3096289561 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5564056d4d80 0x556405ae18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:00.006 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.000+0000 7f718edf1740 4 client.25264 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:37:00.007 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.000+0000 7f718edf1740 1 -- 172.21.15.7:0/3096289561 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556405a32640 con 0x5564056d4d80 2024-09-21T06:37:00.007 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.000+0000 7f7185c20640 1 --2- 172.21.15.7:0/3096289561 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5564056d4d80 0x556405ae18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:00.007 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.001+0000 7f71697fa640 10 client.25264 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:37:00.007 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.001+0000 7f7185c20640 1 --2- 172.21.15.7:0/3096289561 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5564056d4d80 0x556405ae18c0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b5eeb367bd2600 server_cookie=c914232bedd50d77 in_seq=0 out_seq=0 2024-09-21T06:37:00.007 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.001+0000 7f71697fa640 1 -- 172.21.15.7:0/3096289561 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556405a32640 con 0x5564056d4d80 2024-09-21T06:37:00.007 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.001+0000 7f71697fa640 10 client.25264 handle_command_reply: tid=0 2024-09-21T06:37:00.007 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.001+0000 7f718edf1740 1 client.25264 shutdown 2024-09-21T06:37:00.007 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.002+0000 7f718edf1740 1 -- 172.21.15.7:0/3096289561 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5564057161b0 msgr2=0x556405adbc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:00.007 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.002+0000 7f718edf1740 1 --2- 172.21.15.7:0/3096289561 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5564057161b0 0x556405adbc60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f71780057a0 tx=0x7f71780045e0 comp rx=0 tx=0).stop 2024-09-21T06:37:00.007 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.002+0000 7f718edf1740 1 -- 172.21.15.7:0/3096289561 shutdown_connections 2024-09-21T06:37:00.007 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.002+0000 7f718edf1740 1 --2- 172.21.15.7:0/3096289561 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5564056d4d80 0x556405ae18c0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:00.007 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.002+0000 7f718edf1740 1 --2- 172.21.15.7:0/3096289561 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5564057161b0 0x556405adbc60 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:00.007 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.002+0000 7f718edf1740 1 --2- 172.21.15.7:0/3096289561 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5564056f54d0 0x556405acfd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:00.008 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.002+0000 7f718edf1740 1 --2- 172.21.15.7:0/3096289561 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5564056ed2f0 0x556405acf800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:00.008 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.002+0000 7f718edf1740 1 -- 172.21.15.7:0/3096289561 >> 172.21.15.7:0/3096289561 conn(0x55640570a300 msgr2=0x556405ab7ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:00.008 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.002+0000 7f71697fa640 0 client.25264 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:37:00.008 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.002+0000 7f718edf1740 1 -- 172.21.15.7:0/3096289561 shutdown_connections 2024-09-21T06:37:00.008 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.002+0000 7f718edf1740 1 -- 172.21.15.7:0/3096289561 wait complete. 2024-09-21T06:37:00.008 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.002+0000 7f718edf1740 20 client.25264 trim_cache size 0 max 16384 2024-09-21T06:37:00.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.017+0000 7f718edf1740 1 Processor -- start 2024-09-21T06:37:00.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.017+0000 7f718edf1740 1 -- start start 2024-09-21T06:37:00.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.017+0000 7f718edf1740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5564056ed2f0 0x556405ac21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:00.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.017+0000 7f718edf1740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5564056f54d0 0x556405acfce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:00.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.017+0000 7f718edf1740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5564057161b0 0x556405adbb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:00.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.017+0000 7f718edf1740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f71801b0280 con 0x5564056f54d0 2024-09-21T06:37:00.020 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.017+0000 7f718edf1740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f71801adb50 con 0x5564057161b0 2024-09-21T06:37:00.021 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.017+0000 7f718edf1740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f71801ab9a0 con 0x5564056ed2f0 2024-09-21T06:37:00.021 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.017+0000 7f718541f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5564056f54d0 0x556405acfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:00.021 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.017+0000 7f718541f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5564056f54d0 0x556405acfce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46052/0 (socket says 172.21.15.7:46052) 2024-09-21T06:37:00.021 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.017+0000 7f718541f640 1 -- 172.21.15.7:0/603999366 learned_addr learned my addr 172.21.15.7:0/603999366 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:37:00.021 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.017+0000 7f7185c20640 1 --2- 172.21.15.7:0/603999366 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5564056ed2f0 0x556405ac21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:00.021 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.017+0000 7f7186421640 1 --2- 172.21.15.7:0/603999366 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5564057161b0 0x556405adbb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:00.021 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.018+0000 7f718541f640 1 -- 172.21.15.7:0/603999366 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5564056ed2f0 msgr2=0x556405ac21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:00.021 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.018+0000 7f718541f640 1 --2- 172.21.15.7:0/603999366 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5564056ed2f0 0x556405ac21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:00.021 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.018+0000 7f718541f640 1 -- 172.21.15.7:0/603999366 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5564057161b0 msgr2=0x556405adbb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:00.021 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.018+0000 7f718541f640 1 --2- 172.21.15.7:0/603999366 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5564057161b0 0x556405adbb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:00.021 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.018+0000 7f718541f640 1 -- 172.21.15.7:0/603999366 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556405ad0ad0 con 0x5564056f54d0 2024-09-21T06:37:00.022 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.018+0000 7f718541f640 1 --2- 172.21.15.7:0/603999366 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5564056f54d0 0x556405acfce0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f717000fae0 tx=0x7f7170012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9685df5a8400459a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:00.022 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.018+0000 7f716b7fe640 1 -- 172.21.15.7:0/603999366 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f717001b030 con 0x5564056f54d0 2024-09-21T06:37:00.022 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.018+0000 7f716b7fe640 1 -- 172.21.15.7:0/603999366 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7170026070 con 0x5564056f54d0 2024-09-21T06:37:00.022 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.018+0000 7f716b7fe640 1 -- 172.21.15.7:0/603999366 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7170015410 con 0x5564056f54d0 2024-09-21T06:37:00.026 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.019+0000 7f718edf1740 1 -- 172.21.15.7:0/603999366 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5564056f54d0 msgr2=0x556405acfce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:00.026 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.019+0000 7f718edf1740 1 --2- 172.21.15.7:0/603999366 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5564056f54d0 0x556405acfce0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f717000fae0 tx=0x7f7170012000 comp rx=0 tx=0).stop 2024-09-21T06:37:00.026 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.019+0000 7f718edf1740 1 -- 172.21.15.7:0/603999366 shutdown_connections 2024-09-21T06:37:00.026 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.019+0000 7f718edf1740 1 --2- 172.21.15.7:0/603999366 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5564057161b0 0x556405adbb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:00.026 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.019+0000 7f718edf1740 1 --2- 172.21.15.7:0/603999366 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5564056f54d0 0x556405acfce0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:00.026 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.019+0000 7f718edf1740 1 --2- 172.21.15.7:0/603999366 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5564056ed2f0 0x556405ac21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:00.026 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.019+0000 7f718edf1740 1 -- 172.21.15.7:0/603999366 >> 172.21.15.7:0/603999366 conn(0x55640570a300 msgr2=0x556405ac1aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:00.026 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.019+0000 7f718edf1740 1 -- 172.21.15.7:0/603999366 shutdown_connections 2024-09-21T06:37:00.026 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.019+0000 7f718edf1740 1 -- 172.21.15.7:0/603999366 wait complete. 2024-09-21T06:37:00.026 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.019+0000 7f718edf1740 1 -- start start 2024-09-21T06:37:00.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.020+0000 7f718edf1740 1 Processor -- start 2024-09-21T06:37:00.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.020+0000 7f718edf1740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5564056ed2f0 0x556405ad2b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:00.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.020+0000 7f718edf1740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5564056f54d0 0x556405ad30c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:00.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.020+0000 7f718edf1740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5564057161b0 0x556405ad3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:00.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.020+0000 7f718edf1740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f71801ac010 con 0x5564057161b0 2024-09-21T06:37:00.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.020+0000 7f718edf1740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f71801ad480 con 0x5564056f54d0 2024-09-21T06:37:00.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.020+0000 7f718edf1740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f71801ac6e0 con 0x5564056ed2f0 2024-09-21T06:37:00.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.020+0000 7f718edf1740 10 client.0 _ll_register_callbacks cb 0x7f7178009b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:37:00.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.020+0000 7f7186421640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5564057161b0 0x556405ad3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:00.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.020+0000 7f718541f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5564056f54d0 0x556405ad30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:00.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.020+0000 7f718541f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5564056f54d0 0x556405ad30c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.7:53200/0 (socket says 172.21.15.7:53200) 2024-09-21T06:37:00.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.020+0000 7f7186421640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5564057161b0 0x556405ad3600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46062/0 (socket says 172.21.15.7:46062) 2024-09-21T06:37:00.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.020+0000 7f718541f640 1 -- 172.21.15.7:0/2759967105 learned_addr learned my addr 172.21.15.7:0/2759967105 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:37:00.027 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.020+0000 7f7185c20640 1 --2- 172.21.15.7:0/2759967105 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5564056ed2f0 0x556405ad2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:00.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.021+0000 7f718541f640 1 -- 172.21.15.7:0/2759967105 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5564056ed2f0 msgr2=0x556405ad2b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:00.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.021+0000 7f718541f640 1 --2- 172.21.15.7:0/2759967105 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5564056ed2f0 0x556405ad2b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:00.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.021+0000 7f718541f640 1 -- 172.21.15.7:0/2759967105 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5564057161b0 msgr2=0x556405ad3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:00.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.021+0000 7f718541f640 1 --2- 172.21.15.7:0/2759967105 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5564057161b0 0x556405ad3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:00.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.021+0000 7f718541f640 1 -- 172.21.15.7:0/2759967105 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556405b4a200 con 0x5564056f54d0 2024-09-21T06:37:00.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.021+0000 7f718541f640 1 --2- 172.21.15.7:0/2759967105 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5564056f54d0 0x556405ad30c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7170004810 tx=0x7f7170014e90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=168452053838ded7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:00.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.021+0000 7f71697fa640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-21T06:37:00.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.021+0000 7f71697fa640 1 -- 172.21.15.7:0/2759967105 <== mon.2 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f717002f070 con 0x5564056f54d0 2024-09-21T06:37:00.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.021+0000 7f71697fa640 1 -- 172.21.15.7:0/2759967105 <== mon.2 v2:172.21.15.18:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f7170034460 con 0x5564056f54d0 2024-09-21T06:37:00.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.021+0000 7f718edf1740 1 -- 172.21.15.7:0/2759967105 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7170026070 con 0x5564056f54d0 2024-09-21T06:37:00.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.022+0000 7f71697fa640 1 -- 172.21.15.7:0/2759967105 <== mon.2 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7170039020 con 0x5564056f54d0 2024-09-21T06:37:00.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.022+0000 7f718edf1740 10 client.25421 fetch_fsmap learned FSMap version 25 2024-09-21T06:37:00.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.022+0000 7f718edf1740 1 -- 172.21.15.7:0/2759967105 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x556405b4b3c0 con 0x5564056f54d0 2024-09-21T06:37:00.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.022+0000 7f71697fa640 1 -- 172.21.15.7:0/2759967105 <== mon.2 v2:172.21.15.18:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f717001c040 con 0x5564056f54d0 2024-09-21T06:37:00.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.022+0000 7f71697fa640 1 -- 172.21.15.7:0/2759967105 <== mon.2 v2:172.21.15.18:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f717003e660 con 0x5564056f54d0 2024-09-21T06:37:00.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.022+0000 7f718edf1740 10 client.25421 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:37:00.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.022+0000 7f718edf1740 10 client.25421 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:37:00.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.022+0000 7f718edf1740 20 client.25421 populate_metadata read hostname 'smithi007' 2024-09-21T06:37:00.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.022+0000 7f718edf1740 1 --2- 172.21.15.7:0/2759967105 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5564056aa1c0 0x556405b4dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:00.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.022+0000 7f718edf1740 4 client.25421 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T06:37:00.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.022+0000 7f718edf1740 1 -- 172.21.15.7:0/2759967105 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f7170026070 con 0x5564056aa1c0 2024-09-21T06:37:00.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.023+0000 7f7185c20640 1 --2- 172.21.15.7:0/2759967105 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5564056aa1c0 0x556405b4dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:00.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.023+0000 7f7185c20640 1 --2- 172.21.15.7:0/2759967105 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5564056aa1c0 0x556405b4dad0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=44e53473b4199127 server_cookie=d9ad653a26efa22f in_seq=0 out_seq=0 2024-09-21T06:37:00.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.023+0000 7f71697fa640 10 client.25421 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:37:00.033 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.030+0000 7f71697fa640 1 -- 172.21.15.7:0/2759967105 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f7170026070 con 0x5564056aa1c0 2024-09-21T06:37:00.033 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.030+0000 7f71697fa640 10 client.25421 handle_command_reply: tid=0 2024-09-21T06:37:00.033 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.030+0000 7f718edf1740 1 client.25421 shutdown 2024-09-21T06:37:00.033 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.030+0000 7f718edf1740 1 -- 172.21.15.7:0/2759967105 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5564056f54d0 msgr2=0x556405ad30c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:00.033 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.030+0000 7f718edf1740 1 --2- 172.21.15.7:0/2759967105 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5564056f54d0 0x556405ad30c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7170004810 tx=0x7f7170014e90 comp rx=0 tx=0).stop 2024-09-21T06:37:00.033 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.031+0000 7f718edf1740 1 -- 172.21.15.7:0/2759967105 shutdown_connections 2024-09-21T06:37:00.033 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.031+0000 7f718edf1740 1 --2- 172.21.15.7:0/2759967105 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5564056aa1c0 0x556405b4dad0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:00.033 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.031+0000 7f718edf1740 1 --2- 172.21.15.7:0/2759967105 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5564057161b0 0x556405ad3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:00.033 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.031+0000 7f718edf1740 1 --2- 172.21.15.7:0/2759967105 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5564056f54d0 0x556405ad30c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:00.033 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.031+0000 7f71697fa640 0 client.25421 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:37:00.034 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.031+0000 7f718edf1740 1 --2- 172.21.15.7:0/2759967105 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5564056ed2f0 0x556405ad2b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:00.034 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.031+0000 7f718edf1740 1 -- 172.21.15.7:0/2759967105 >> 172.21.15.7:0/2759967105 conn(0x55640570a300 msgr2=0x556405ac50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:00.034 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.031+0000 7f718edf1740 1 -- 172.21.15.7:0/2759967105 shutdown_connections 2024-09-21T06:37:00.034 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.031+0000 7f718edf1740 1 -- 172.21.15.7:0/2759967105 wait complete. 2024-09-21T06:37:00.034 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.031+0000 7f718edf1740 20 client.25421 trim_cache size 0 max 16384 2024-09-21T06:37:00.034 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-09-21T06:37:00.034 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-09-21T06:37:00.034 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-09-21T06:37:00.034 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-09-21T06:37:00.035 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.032+0000 7f7187e84640 1 -- 172.21.15.7:0/1832042973 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f716c0b66d0 msgr2=0x7f716c0b8be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:00.035 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.032+0000 7f7187e84640 1 --2- 172.21.15.7:0/1832042973 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f716c0b66d0 0x7f716c0b8be0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f71801076d0 tx=0x7f7170008040 comp rx=0 tx=0).stop 2024-09-21T06:37:00.035 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.032+0000 7f7187e84640 1 -- 172.21.15.7:0/1832042973 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7180107bb0 msgr2=0x7f718019c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:00.035 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.032+0000 7f7187e84640 1 --2- 172.21.15.7:0/1832042973 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7180107bb0 0x7f718019c9a0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f717c031040 tx=0x7f717c00a470 comp rx=0 tx=0).stop 2024-09-21T06:37:00.035 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.032+0000 7f7187e84640 1 -- 172.21.15.7:0/1832042973 shutdown_connections 2024-09-21T06:37:00.036 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.032+0000 7f7187e84640 1 --2- 172.21.15.7:0/1832042973 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f716c0b66d0 0x7f716c0b8be0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:00.036 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.032+0000 7f7187e84640 1 --2- 172.21.15.7:0/1832042973 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f71801a2110 0x7f71801a2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:00.036 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.032+0000 7f7187e84640 1 --2- 172.21.15.7:0/1832042973 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7180108500 0x7f718019cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:00.036 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.032+0000 7f7187e84640 1 --2- 172.21.15.7:0/1832042973 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7180107bb0 0x7f718019c9a0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:00.036 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.032+0000 7f7187e84640 1 -- 172.21.15.7:0/1832042973 >> 172.21.15.7:0/1832042973 conn(0x7f7180079e50 msgr2=0x7f7180105a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:00.036 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.032+0000 7f7187e84640 1 -- 172.21.15.7:0/1832042973 shutdown_connections 2024-09-21T06:37:00.036 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:00.032+0000 7f7187e84640 1 -- 172.21.15.7:0/1832042973 wait complete. 2024-09-21T06:37:00.924 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:37:00 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: 2024-09-21T06:37:00.648+0000 7fd5c1574640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T06:37:00.924 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:37:00 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: 2024-09-21T06:37:00.648+0000 7fd5c1574640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T06:37:00.925 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:37:00 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: 2024-09-21T06:37:00.648+0000 7fd5c1574640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T06:37:00.925 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:37:00 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: 2024-09-21T06:37:00.648+0000 7fd5c1574640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T06:37:00.925 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:37:00 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: 2024-09-21T06:37:00.648+0000 7fd5c1574640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T06:37:01.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:37:00 smithi144 ceph-mon[34653]: pgmap v343: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.4 KiB/s wr, 8 op/s 2024-09-21T06:37:01.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:37:00 smithi007 ceph-mon[30983]: pgmap v343: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.4 KiB/s wr, 8 op/s 2024-09-21T06:37:01.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:37:00 smithi018 ceph-mon[34477]: pgmap v343: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.4 KiB/s wr, 8 op/s 2024-09-21T06:37:01.485 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:37:01.485 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:37:01.883 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:37:02.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.438+0000 7f8efe47a640 1 -- 172.21.15.7:0/149886172 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ef8106280 msgr2=0x7f8ef8106690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:02.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.438+0000 7f8efe47a640 1 --2- 172.21.15.7:0/149886172 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ef8106280 0x7f8ef8106690 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f8eec009900 tx=0x7f8eec02a410 comp rx=0 tx=0).stop 2024-09-21T06:37:02.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.438+0000 7f8efe47a640 1 -- 172.21.15.7:0/149886172 shutdown_connections 2024-09-21T06:37:02.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.439+0000 7f8efe47a640 1 --2- 172.21.15.7:0/149886172 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ef8106bd0 0x7f8ef8110660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:02.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.439+0000 7f8efe47a640 1 --2- 172.21.15.7:0/149886172 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ef8106280 0x7f8ef8106690 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:02.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.439+0000 7f8efe47a640 1 --2- 172.21.15.7:0/149886172 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8ef8102090 0x7f8ef81024a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:02.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.439+0000 7f8efe47a640 1 -- 172.21.15.7:0/149886172 >> 172.21.15.7:0/149886172 conn(0x7f8ef8077c60 msgr2=0x7f8ef80780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:02.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.439+0000 7f8efe47a640 1 -- 172.21.15.7:0/149886172 shutdown_connections 2024-09-21T06:37:02.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.439+0000 7f8efe47a640 1 -- 172.21.15.7:0/149886172 wait complete. 2024-09-21T06:37:02.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.440+0000 7f8efe47a640 1 Processor -- start 2024-09-21T06:37:02.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.440+0000 7f8efe47a640 1 -- start start 2024-09-21T06:37:02.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.440+0000 7f8efe47a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8ef8102090 0x7f8ef81984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:02.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.440+0000 7f8efe47a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ef8106bd0 0x7f8ef8198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:02.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.440+0000 7f8efe47a640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ef819dc20 0x7f8ef819e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:02.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.440+0000 7f8efe47a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8ef8104960 con 0x7f8ef8106bd0 2024-09-21T06:37:02.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.440+0000 7f8efe47a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8ef81047e0 con 0x7f8ef8102090 2024-09-21T06:37:02.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.440+0000 7f8efe47a640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8ef8104ae0 con 0x7f8ef819dc20 2024-09-21T06:37:02.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.441+0000 7f8ef7fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8ef8102090 0x7f8ef81984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:02.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.441+0000 7f8ef7fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8ef8102090 0x7f8ef81984a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.7:50760/0 (socket says 172.21.15.7:50760) 2024-09-21T06:37:02.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.441+0000 7f8ef7fff640 1 -- 172.21.15.7:0/1044089959 learned_addr learned my addr 172.21.15.7:0/1044089959 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:37:02.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.441+0000 7f8ef77fe640 1 --2- 172.21.15.7:0/1044089959 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ef8106bd0 0x7f8ef8198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:02.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.441+0000 7f8efca17640 1 --2- 172.21.15.7:0/1044089959 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ef819dc20 0x7f8ef819e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:02.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.441+0000 7f8ef7fff640 1 -- 172.21.15.7:0/1044089959 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ef819dc20 msgr2=0x7f8ef819e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:02.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.441+0000 7f8ef7fff640 1 --2- 172.21.15.7:0/1044089959 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ef819dc20 0x7f8ef819e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:02.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.441+0000 7f8ef7fff640 1 -- 172.21.15.7:0/1044089959 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ef8106bd0 msgr2=0x7f8ef8198a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:02.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.442+0000 7f8ef7fff640 1 --2- 172.21.15.7:0/1044089959 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ef8106bd0 0x7f8ef8198a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:02.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.442+0000 7f8ef7fff640 1 -- 172.21.15.7:0/1044089959 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ef819e800 con 0x7f8ef8102090 2024-09-21T06:37:02.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.442+0000 7f8ef77fe640 1 --2- 172.21.15.7:0/1044089959 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ef8106bd0 0x7f8ef8198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:37:02.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.442+0000 7f8ef7fff640 1 --2- 172.21.15.7:0/1044089959 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8ef8102090 0x7f8ef81984a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8ee800d770 tx=0x7f8ee800dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:02.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.442+0000 7f8ef57fa640 1 -- 172.21.15.7:0/1044089959 <== mon.2 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ee8017070 con 0x7f8ef8102090 2024-09-21T06:37:02.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.443+0000 7f8ef57fa640 1 -- 172.21.15.7:0/1044089959 <== mon.2 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ee8009c30 con 0x7f8ef8102090 2024-09-21T06:37:02.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.443+0000 7f8efe47a640 1 -- 172.21.15.7:0/1044089959 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ef81a4da0 con 0x7f8ef8102090 2024-09-21T06:37:02.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.443+0000 7f8ef57fa640 1 -- 172.21.15.7:0/1044089959 <== mon.2 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ee8003cc0 con 0x7f8ef8102090 2024-09-21T06:37:02.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.443+0000 7f8efe47a640 1 -- 172.21.15.7:0/1044089959 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ef81a5190 con 0x7f8ef8102090 2024-09-21T06:37:02.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.446+0000 7f8f049ee740 1 Processor -- start 2024-09-21T06:37:02.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.446+0000 7f8f049ee740 1 -- start start 2024-09-21T06:37:02.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.446+0000 7f8f049ee740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617feb04350 0x5617feeab430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:02.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.446+0000 7f8f049ee740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5617feadb490 0x5617feeab970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:02.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.446+0000 7f8f049ee740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5617feae3670 0x5617feeabeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:02.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.446+0000 7f8f049ee740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5617fee21e60 con 0x5617feb04350 2024-09-21T06:37:02.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.446+0000 7f8f049ee740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5617fee11290 con 0x5617feadb490 2024-09-21T06:37:02.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.446+0000 7f8f049ee740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5617fee150a0 con 0x5617feae3670 2024-09-21T06:37:02.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.447+0000 7f8efca17640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617feb04350 0x5617feeab430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:02.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.447+0000 7f8efca17640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617feb04350 0x5617feeab430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47638/0 (socket says 172.21.15.7:47638) 2024-09-21T06:37:02.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.447+0000 7f8efca17640 1 -- 172.21.15.7:0/2504580134 learned_addr learned my addr 172.21.15.7:0/2504580134 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:37:02.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.447+0000 7f8ef77fe640 1 --2- 172.21.15.7:0/2504580134 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5617feae3670 0x5617feeabeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:02.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.447+0000 7f8efca17640 1 -- 172.21.15.7:0/2504580134 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5617feae3670 msgr2=0x5617feeabeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:02.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.447+0000 7f8efca17640 1 --2- 172.21.15.7:0/2504580134 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5617feae3670 0x5617feeabeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:02.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.447+0000 7f8efca17640 1 -- 172.21.15.7:0/2504580134 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5617feadb490 msgr2=0x5617feeab970 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T06:37:02.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.447+0000 7f8efca17640 1 --2- 172.21.15.7:0/2504580134 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5617feadb490 0x5617feeab970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:02.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.447+0000 7f8efca17640 1 -- 172.21.15.7:0/2504580134 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617feb6f930 con 0x5617feb04350 2024-09-21T06:37:02.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.447+0000 7f8efca17640 1 --2- 172.21.15.7:0/2504580134 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617feb04350 0x5617feeab430 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f8ef0009eb0 tx=0x7f8ef0010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd460dcf2f544de2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:02.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.448+0000 7f8ef57fa640 1 -- 172.21.15.7:0/1044089959 <== mon.2 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f8ee8004020 con 0x7f8ef8102090 2024-09-21T06:37:02.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.448+0000 7f8ede7fc640 1 -- 172.21.15.7:0/2504580134 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef0016070 con 0x5617feb04350 2024-09-21T06:37:02.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.448+0000 7f8ede7fc640 1 -- 172.21.15.7:0/2504580134 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ef0004d20 con 0x5617feb04350 2024-09-21T06:37:02.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.448+0000 7f8ede7fc640 1 -- 172.21.15.7:0/2504580134 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef00127f0 con 0x5617feb04350 2024-09-21T06:37:02.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.449+0000 7f8f049ee740 1 -- 172.21.15.7:0/2504580134 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617feb04350 msgr2=0x5617feeab430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:02.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.449+0000 7f8f049ee740 1 --2- 172.21.15.7:0/2504580134 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617feb04350 0x5617feeab430 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f8ef0009eb0 tx=0x7f8ef0010740 comp rx=0 tx=0).stop 2024-09-21T06:37:02.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.449+0000 7f8ef57fa640 1 --2- 172.21.15.7:0/1044089959 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f8ee00baa90 0x7f8ee00bcfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:02.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.449+0000 7f8f049ee740 1 -- 172.21.15.7:0/2504580134 shutdown_connections 2024-09-21T06:37:02.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.449+0000 7f8f049ee740 1 --2- 172.21.15.7:0/2504580134 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5617feae3670 0x5617feeabeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:02.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.449+0000 7f8f049ee740 1 --2- 172.21.15.7:0/2504580134 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5617feadb490 0x5617feeab970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:02.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.449+0000 7f8f049ee740 1 --2- 172.21.15.7:0/2504580134 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617feb04350 0x5617feeab430 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:02.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.449+0000 7f8f049ee740 1 -- 172.21.15.7:0/2504580134 >> 172.21.15.7:0/2504580134 conn(0x5617feaf8740 msgr2=0x5617feea9320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:02.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.449+0000 7f8ef7fff640 1 --2- 172.21.15.7:0/1044089959 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f8ee00baa90 0x7f8ee00bcfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:02.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.450+0000 7f8ef57fa640 1 -- 172.21.15.7:0/1044089959 <== mon.2 v2:172.21.15.18:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f8ee80e7030 con 0x7f8ef8102090 2024-09-21T06:37:02.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.450+0000 7f8ef7fff640 1 --2- 172.21.15.7:0/1044089959 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f8ee00baa90 0x7f8ee00bcfa0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x5617feeaa0b0 tx=0x7f8ee80a9640 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:02.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.450+0000 7f8f049ee740 1 -- 172.21.15.7:0/2504580134 shutdown_connections 2024-09-21T06:37:02.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.450+0000 7f8f049ee740 1 -- 172.21.15.7:0/2504580134 wait complete. 2024-09-21T06:37:02.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.451+0000 7f8f049ee740 1 -- start start 2024-09-21T06:37:02.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.451+0000 7f8f049ee740 1 Processor -- start 2024-09-21T06:37:02.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.451+0000 7f8f049ee740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5617feadb490 0x5617feeb70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:02.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.451+0000 7f8f049ee740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5617feae3670 0x5617feeb7690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:02.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.451+0000 7f8f049ee740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617feb04350 0x5617feec2f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:02.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.452+0000 7f8f049ee740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5617fec72890 con 0x5617feb04350 2024-09-21T06:37:02.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.452+0000 7f8f049ee740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5617fedabd40 con 0x5617feadb490 2024-09-21T06:37:02.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.452+0000 7f8f049ee740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5617feeb9c10 con 0x5617feae3670 2024-09-21T06:37:02.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.452+0000 7f8f049ee740 10 client.0 _ll_register_callbacks cb 0x5617fee0fc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:37:02.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.452+0000 7f8ef77fe640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5617feae3670 0x5617feeb7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:02.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.452+0000 7f8ef77fe640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5617feae3670 0x5617feeb7690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.7:56408/0 (socket says 172.21.15.7:56408) 2024-09-21T06:37:02.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.452+0000 7f8ef77fe640 1 -- 172.21.15.7:0/3967548054 learned_addr learned my addr 172.21.15.7:0/3967548054 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:37:02.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.452+0000 7f8efca17640 1 --2- 172.21.15.7:0/3967548054 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617feb04350 0x5617feec2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:02.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.452+0000 7f8ef77fe640 1 -- 172.21.15.7:0/3967548054 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5617feadb490 msgr2=0x5617feeb70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:02.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.452+0000 7f8ef77fe640 1 --2- 172.21.15.7:0/3967548054 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5617feadb490 0x5617feeb70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:02.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.452+0000 7f8ef77fe640 1 -- 172.21.15.7:0/3967548054 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617feb04350 msgr2=0x5617feec2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:02.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.453+0000 7f8ef77fe640 1 --2- 172.21.15.7:0/3967548054 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617feb04350 0x5617feec2f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:02.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.453+0000 7f8ef77fe640 1 -- 172.21.15.7:0/3967548054 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617feec3570 con 0x5617feae3670 2024-09-21T06:37:02.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.453+0000 7f8efca17640 1 --2- 172.21.15.7:0/3967548054 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617feb04350 0x5617feec2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:37:02.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.453+0000 7f8ef77fe640 1 --2- 172.21.15.7:0/3967548054 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5617feae3670 0x5617feeb7690 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8eec009230 tx=0x7f8eec031830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2cd9f2ac7e2f1cab server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:02.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.453+0000 7f8ed77fe640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-21T06:37:02.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.453+0000 7f8ed77fe640 1 -- 172.21.15.7:0/3967548054 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eec035040 con 0x5617feae3670 2024-09-21T06:37:02.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.454+0000 7f8ed77fe640 1 -- 172.21.15.7:0/3967548054 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f8eec004240 con 0x5617feae3670 2024-09-21T06:37:02.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.454+0000 7f8f049ee740 1 -- 172.21.15.7:0/3967548054 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ef0004d20 con 0x5617feae3670 2024-09-21T06:37:02.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.454+0000 7f8ed77fe640 1 -- 172.21.15.7:0/3967548054 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8eec04b020 con 0x5617feae3670 2024-09-21T06:37:02.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.454+0000 7f8f049ee740 10 client.25288 fetch_fsmap learned FSMap version 25 2024-09-21T06:37:02.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.454+0000 7f8f049ee740 1 -- 172.21.15.7:0/3967548054 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5617feec5e80 con 0x5617feae3670 2024-09-21T06:37:02.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.454+0000 7f8ed77fe640 1 -- 172.21.15.7:0/3967548054 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8eec004440 con 0x5617feae3670 2024-09-21T06:37:02.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.456+0000 7f8ed77fe640 1 -- 172.21.15.7:0/3967548054 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f8eec004b60 con 0x5617feae3670 2024-09-21T06:37:02.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.456+0000 7f8f049ee740 10 client.25288 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:37:02.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.456+0000 7f8f049ee740 10 client.25288 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:37:02.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.456+0000 7f8f049ee740 20 client.25288 populate_metadata read hostname 'smithi007' 2024-09-21T06:37:02.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.456+0000 7f8f049ee740 1 --2- 172.21.15.7:0/3967548054 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5617feac2cd0 0x5617feec96b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:02.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.456+0000 7f8f049ee740 4 client.25288 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:37:02.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.456+0000 7f8f049ee740 1 -- 172.21.15.7:0/3967548054 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f8ef0004d20 con 0x5617feac2cd0 2024-09-21T06:37:02.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.456+0000 7f8efca17640 1 --2- 172.21.15.7:0/3967548054 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5617feac2cd0 0x5617feec96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:02.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.457+0000 7f8ed77fe640 10 client.25288 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:37:02.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.457+0000 7f8efca17640 1 --2- 172.21.15.7:0/3967548054 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5617feac2cd0 0x5617feec96b0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43fc8cfc6327012d server_cookie=460efe4bec77b46e in_seq=0 out_seq=0 2024-09-21T06:37:02.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.458+0000 7f8ed77fe640 1 -- 172.21.15.7:0/3967548054 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f8ef0004d20 con 0x5617feac2cd0 2024-09-21T06:37:02.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.458+0000 7f8ed77fe640 10 client.25288 handle_command_reply: tid=0 2024-09-21T06:37:02.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.458+0000 7f8f049ee740 1 client.25288 shutdown 2024-09-21T06:37:02.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.458+0000 7f8f049ee740 1 -- 172.21.15.7:0/3967548054 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5617feae3670 msgr2=0x5617feeb7690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:02.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.458+0000 7f8f049ee740 1 --2- 172.21.15.7:0/3967548054 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5617feae3670 0x5617feeb7690 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8eec009230 tx=0x7f8eec031830 comp rx=0 tx=0).stop 2024-09-21T06:37:02.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.458+0000 7f8f049ee740 1 -- 172.21.15.7:0/3967548054 shutdown_connections 2024-09-21T06:37:02.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.458+0000 7f8f049ee740 1 --2- 172.21.15.7:0/3967548054 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5617feac2cd0 0x5617feec96b0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:02.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.458+0000 7f8f049ee740 1 --2- 172.21.15.7:0/3967548054 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617feb04350 0x5617feec2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:02.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.458+0000 7f8f049ee740 1 --2- 172.21.15.7:0/3967548054 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5617feae3670 0x5617feeb7690 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:02.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.458+0000 7f8f049ee740 1 --2- 172.21.15.7:0/3967548054 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5617feadb490 0x5617feeb70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:02.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.458+0000 7f8f049ee740 1 -- 172.21.15.7:0/3967548054 >> 172.21.15.7:0/3967548054 conn(0x5617feaf8740 msgr2=0x5617feeae610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:02.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.458+0000 7f8ed77fe640 0 client.25288 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:37:02.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.458+0000 7f8f049ee740 1 -- 172.21.15.7:0/3967548054 shutdown_connections 2024-09-21T06:37:02.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.458+0000 7f8f049ee740 1 -- 172.21.15.7:0/3967548054 wait complete. 2024-09-21T06:37:02.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.459+0000 7f8f049ee740 20 client.25288 trim_cache size 0 max 16384 2024-09-21T06:37:02.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.476+0000 7f8f049ee740 1 Processor -- start 2024-09-21T06:37:02.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.476+0000 7f8f049ee740 1 -- start start 2024-09-21T06:37:02.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.477+0000 7f8f049ee740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5617feadb490 0x5617feeae530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:02.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.477+0000 7f8f049ee740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5617feae3670 0x5617feeaea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:02.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.477+0000 7f8f049ee740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617feb04350 0x5617feeb0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:02.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.477+0000 7f8f049ee740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8ef81b0220 con 0x5617feb04350 2024-09-21T06:37:02.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.477+0000 7f8f049ee740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8ef81adaf0 con 0x5617feadb490 2024-09-21T06:37:02.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.477+0000 7f8f049ee740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8ef81ab920 con 0x5617feae3670 2024-09-21T06:37:02.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.477+0000 7f8efca17640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617feb04350 0x5617feeb0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:02.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.477+0000 7f8efca17640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617feb04350 0x5617feeb0510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47656/0 (socket says 172.21.15.7:47656) 2024-09-21T06:37:02.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.477+0000 7f8efca17640 1 -- 172.21.15.7:0/1239660577 learned_addr learned my addr 172.21.15.7:0/1239660577 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:37:02.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.477+0000 7f8efca17640 1 --2- 172.21.15.7:0/1239660577 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5617feadb490 0x5617feeae530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:02.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.477+0000 7f8efca17640 1 -- 172.21.15.7:0/1239660577 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5617feae3670 msgr2=0x5617feeaea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:02.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.477+0000 7f8ef77fe640 1 --2- 172.21.15.7:0/1239660577 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5617feae3670 0x5617feeaea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:02.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.477+0000 7f8efca17640 1 --2- 172.21.15.7:0/1239660577 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5617feae3670 0x5617feeaea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:02.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.477+0000 7f8efca17640 1 -- 172.21.15.7:0/1239660577 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5617feadb490 msgr2=0x5617feeae530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:02.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.477+0000 7f8efca17640 1 --2- 172.21.15.7:0/1239660577 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5617feadb490 0x5617feeae530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:02.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.477+0000 7f8efca17640 1 -- 172.21.15.7:0/1239660577 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617feeb2760 con 0x5617feb04350 2024-09-21T06:37:02.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.478+0000 7f8efca17640 1 --2- 172.21.15.7:0/1239660577 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617feb04350 0x5617feeb0510 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f8ef0009c20 tx=0x7f8ef00124e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6e627da24f0240e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:02.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.478+0000 7f8eddffb640 1 -- 172.21.15.7:0/1239660577 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef0016040 con 0x5617feb04350 2024-09-21T06:37:02.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.478+0000 7f8eddffb640 1 -- 172.21.15.7:0/1239660577 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ef0033070 con 0x5617feb04350 2024-09-21T06:37:02.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.478+0000 7f8eddffb640 1 -- 172.21.15.7:0/1239660577 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef0024b60 con 0x5617feb04350 2024-09-21T06:37:02.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.480+0000 7f8f049ee740 1 -- 172.21.15.7:0/1239660577 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617feb04350 msgr2=0x5617feeb0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:02.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.480+0000 7f8f049ee740 1 --2- 172.21.15.7:0/1239660577 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617feb04350 0x5617feeb0510 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f8ef0009c20 tx=0x7f8ef00124e0 comp rx=0 tx=0).stop 2024-09-21T06:37:02.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.480+0000 7f8f049ee740 1 -- 172.21.15.7:0/1239660577 shutdown_connections 2024-09-21T06:37:02.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.480+0000 7f8f049ee740 1 --2- 172.21.15.7:0/1239660577 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617feb04350 0x5617feeb0510 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:02.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.480+0000 7f8f049ee740 1 --2- 172.21.15.7:0/1239660577 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5617feae3670 0x5617feeaea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:02.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.480+0000 7f8f049ee740 1 --2- 172.21.15.7:0/1239660577 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5617feadb490 0x5617feeae530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:02.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.480+0000 7f8f049ee740 1 -- 172.21.15.7:0/1239660577 >> 172.21.15.7:0/1239660577 conn(0x5617feaf8740 msgr2=0x5617feeb5750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:02.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.480+0000 7f8f049ee740 1 -- 172.21.15.7:0/1239660577 shutdown_connections 2024-09-21T06:37:02.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.480+0000 7f8f049ee740 1 -- 172.21.15.7:0/1239660577 wait complete. 2024-09-21T06:37:02.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.480+0000 7f8f049ee740 1 -- start start 2024-09-21T06:37:02.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.481+0000 7f8f049ee740 1 Processor -- start 2024-09-21T06:37:02.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.481+0000 7f8f049ee740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617feadb490 0x5617feebb180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:02.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.481+0000 7f8f049ee740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5617feae3670 0x5617feebb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:02.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.481+0000 7f8f049ee740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5617feb04350 0x5617fef3b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:02.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.481+0000 7f8f049ee740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8ef81abfb0 con 0x5617feadb490 2024-09-21T06:37:02.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.481+0000 7f8f049ee740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8ef81ad420 con 0x5617feae3670 2024-09-21T06:37:02.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.481+0000 7f8f049ee740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8ef81ac680 con 0x5617feb04350 2024-09-21T06:37:02.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.481+0000 7f8efca17640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617feadb490 0x5617feebb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:02.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.481+0000 7f8efca17640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617feadb490 0x5617feebb180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47668/0 (socket says 172.21.15.7:47668) 2024-09-21T06:37:02.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.481+0000 7f8efca17640 1 -- 172.21.15.7:0/253599116 learned_addr learned my addr 172.21.15.7:0/253599116 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:37:02.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.481+0000 7f8f049ee740 10 client.0 _ll_register_callbacks cb 0x7f8eec032e60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:37:02.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.482+0000 7f8efca17640 1 -- 172.21.15.7:0/253599116 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5617feb04350 msgr2=0x5617fef3b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:02.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.482+0000 7f8efca17640 1 --2- 172.21.15.7:0/253599116 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5617feb04350 0x5617fef3b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:02.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.482+0000 7f8efca17640 1 -- 172.21.15.7:0/253599116 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5617feae3670 msgr2=0x5617feebb6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:02.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.482+0000 7f8ef77fe640 1 --2- 172.21.15.7:0/253599116 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5617feae3670 0x5617feebb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:02.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.482+0000 7f8efca17640 1 --2- 172.21.15.7:0/253599116 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5617feae3670 0x5617feebb6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:02.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.482+0000 7f8efca17640 1 -- 172.21.15.7:0/253599116 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617feebbf40 con 0x5617feadb490 2024-09-21T06:37:02.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.482+0000 7f8efca17640 1 --2- 172.21.15.7:0/253599116 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617feadb490 0x5617feebb180 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f8ef0030040 tx=0x7f8ef0005ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7137884824cecb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:02.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.482+0000 7f8ed77fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:37:02.485 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.482+0000 7f8ed77fe640 1 -- 172.21.15.7:0/253599116 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef003b070 con 0x5617feadb490 2024-09-21T06:37:02.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.482+0000 7f8ed77fe640 1 -- 172.21.15.7:0/253599116 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f8ef0013040 con 0x5617feadb490 2024-09-21T06:37:02.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.482+0000 7f8f049ee740 1 -- 172.21.15.7:0/253599116 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ef0033070 con 0x5617feadb490 2024-09-21T06:37:02.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.483+0000 7f8ed77fe640 1 -- 172.21.15.7:0/253599116 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8ef0045050 con 0x5617feadb490 2024-09-21T06:37:02.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.483+0000 7f8f049ee740 10 client.15648 fetch_fsmap learned FSMap version 25 2024-09-21T06:37:02.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.483+0000 7f8f049ee740 1 -- 172.21.15.7:0/253599116 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5617fef3ce40 con 0x5617feadb490 2024-09-21T06:37:02.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.483+0000 7f8ed77fe640 1 -- 172.21.15.7:0/253599116 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ef0033070 con 0x5617feadb490 2024-09-21T06:37:02.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.483+0000 7f8ed77fe640 1 -- 172.21.15.7:0/253599116 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f8ef000f040 con 0x5617feadb490 2024-09-21T06:37:02.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.483+0000 7f8f049ee740 10 client.15648 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:37:02.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.483+0000 7f8f049ee740 10 client.15648 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:37:02.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.483+0000 7f8f049ee740 20 client.15648 populate_metadata read hostname 'smithi007' 2024-09-21T06:37:02.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.483+0000 7f8f049ee740 1 --2- 172.21.15.7:0/253599116 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5617fea98080 0x5617fef3f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:02.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.483+0000 7f8f049ee740 4 client.15648 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:37:02.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.483+0000 7f8f049ee740 1 -- 172.21.15.7:0/253599116 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5617fee23db0 con 0x5617fea98080 2024-09-21T06:37:02.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.484+0000 7f8ef77fe640 1 --2- 172.21.15.7:0/253599116 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5617fea98080 0x5617fef3f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:02.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.484+0000 7f8ed77fe640 10 client.15648 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:37:02.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.484+0000 7f8ef77fe640 1 --2- 172.21.15.7:0/253599116 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5617fea98080 0x5617fef3f360 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5fb5993a97e8e4d4 server_cookie=7443bedfc6438c41 in_seq=0 out_seq=0 2024-09-21T06:37:02.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.486+0000 7f8ed77fe640 1 -- 172.21.15.7:0/253599116 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5617fee23db0 con 0x5617fea98080 2024-09-21T06:37:02.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.486+0000 7f8ed77fe640 10 client.15648 handle_command_reply: tid=0 2024-09-21T06:37:02.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.486+0000 7f8f049ee740 1 client.15648 shutdown 2024-09-21T06:37:02.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.486+0000 7f8f049ee740 1 -- 172.21.15.7:0/253599116 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617feadb490 msgr2=0x5617feebb180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:02.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.486+0000 7f8f049ee740 1 --2- 172.21.15.7:0/253599116 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617feadb490 0x5617feebb180 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f8ef0030040 tx=0x7f8ef0005ae0 comp rx=0 tx=0).stop 2024-09-21T06:37:02.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.486+0000 7f8f049ee740 1 -- 172.21.15.7:0/253599116 shutdown_connections 2024-09-21T06:37:02.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.486+0000 7f8f049ee740 1 --2- 172.21.15.7:0/253599116 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5617fea98080 0x5617fef3f360 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:02.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.486+0000 7f8f049ee740 1 --2- 172.21.15.7:0/253599116 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5617feb04350 0x5617fef3b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:02.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.486+0000 7f8f049ee740 1 --2- 172.21.15.7:0/253599116 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5617feae3670 0x5617feebb6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:02.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.486+0000 7f8f049ee740 1 --2- 172.21.15.7:0/253599116 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5617feadb490 0x5617feebb180 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:02.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.486+0000 7f8f049ee740 1 -- 172.21.15.7:0/253599116 >> 172.21.15.7:0/253599116 conn(0x5617feaf8740 msgr2=0x5617feeb5410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:02.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.486+0000 7f8ed77fe640 0 client.15648 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:37:02.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.486+0000 7f8f049ee740 1 -- 172.21.15.7:0/253599116 shutdown_connections 2024-09-21T06:37:02.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.486+0000 7f8f049ee740 1 -- 172.21.15.7:0/253599116 wait complete. 2024-09-21T06:37:02.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.487+0000 7f8f049ee740 20 client.15648 trim_cache size 0 max 16384 2024-09-21T06:37:02.489 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:37:02.490 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0, 2024-09-21T06:37:02.490 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_tag": "6231e9c1-14a2-40b5-be3c-76d87a0d733b", 2024-09-21T06:37:02.490 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": "asynchronous" 2024-09-21T06:37:02.490 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:37:02.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.487+0000 7f8efe47a640 1 -- 172.21.15.7:0/1044089959 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f8ee00baa90 msgr2=0x7f8ee00bcfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:02.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.487+0000 7f8efe47a640 1 --2- 172.21.15.7:0/1044089959 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f8ee00baa90 0x7f8ee00bcfa0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x5617feeaa0b0 tx=0x7f8ee80a9640 comp rx=0 tx=0).stop 2024-09-21T06:37:02.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.487+0000 7f8efe47a640 1 -- 172.21.15.7:0/1044089959 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8ef8102090 msgr2=0x7f8ef81984a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:02.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.487+0000 7f8efe47a640 1 --2- 172.21.15.7:0/1044089959 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8ef8102090 0x7f8ef81984a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8ee800d770 tx=0x7f8ee800dc30 comp rx=0 tx=0).stop 2024-09-21T06:37:02.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.488+0000 7f8efe47a640 1 -- 172.21.15.7:0/1044089959 shutdown_connections 2024-09-21T06:37:02.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.488+0000 7f8efe47a640 1 --2- 172.21.15.7:0/1044089959 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f8ee00baa90 0x7f8ee00bcfa0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:02.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.488+0000 7f8efe47a640 1 --2- 172.21.15.7:0/1044089959 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ef819dc20 0x7f8ef819e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:02.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.488+0000 7f8efe47a640 1 --2- 172.21.15.7:0/1044089959 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ef8106bd0 0x7f8ef8198a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:02.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.488+0000 7f8efe47a640 1 --2- 172.21.15.7:0/1044089959 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8ef8102090 0x7f8ef81984a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:02.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.488+0000 7f8efe47a640 1 -- 172.21.15.7:0/1044089959 >> 172.21.15.7:0/1044089959 conn(0x7f8ef8077c60 msgr2=0x7f8ef8107610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:02.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.488+0000 7f8efe47a640 1 -- 172.21.15.7:0/1044089959 shutdown_connections 2024-09-21T06:37:02.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:02.488+0000 7f8efe47a640 1 -- 172.21.15.7:0/1044089959 wait complete. 2024-09-21T06:37:03.262 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:37:02 smithi007 ceph-mon[30983]: pgmap v344: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1023 B/s wr, 6 op/s 2024-09-21T06:37:03.262 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:37:02 smithi007 ceph-mon[30983]: mgrmap e25: x(active, since 9m), standbys: z, y 2024-09-21T06:37:03.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:37:02 smithi144 ceph-mon[34653]: pgmap v344: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1023 B/s wr, 6 op/s 2024-09-21T06:37:03.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:37:02 smithi144 ceph-mon[34653]: mgrmap e25: x(active, since 9m), standbys: z, y 2024-09-21T06:37:03.303 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:37:03.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:37:02 smithi018 ceph-mon[34477]: pgmap v344: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1023 B/s wr, 6 op/s 2024-09-21T06:37:03.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:37:02 smithi018 ceph-mon[34477]: mgrmap e25: x(active, since 9m), standbys: z, y 2024-09-21T06:37:03.711 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:37:04.199 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:37:03 smithi007 ceph-mon[30983]: scrub queued for path: / 2024-09-21T06:37:04.199 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:37:03 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T06:37:04.199 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:37:03 smithi007 ceph-mon[30983]: scrub summary: active paths [/] 2024-09-21T06:37:04.199 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:37:03 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T06:37:04.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:37:03 smithi144 ceph-mon[34653]: scrub queued for path: / 2024-09-21T06:37:04.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:37:03 smithi144 ceph-mon[34653]: scrub summary: idle+waiting paths [/] 2024-09-21T06:37:04.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:37:03 smithi144 ceph-mon[34653]: scrub summary: active paths [/] 2024-09-21T06:37:04.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:37:03 smithi144 ceph-mon[34653]: scrub summary: idle+waiting paths [/] 2024-09-21T06:37:04.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.345+0000 7fccdcfbb640 1 -- 172.21.15.7:0/2722471842 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fccd8102a60 msgr2=0x7fccd8102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:04.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.345+0000 7fccdcfbb640 1 --2- 172.21.15.7:0/2722471842 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fccd8102a60 0x7fccd8102e70 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fccc8009ca0 tx=0x7fccc802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:37:04.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.346+0000 7fccdcfbb640 1 -- 172.21.15.7:0/2722471842 shutdown_connections 2024-09-21T06:37:04.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.346+0000 7fccdcfbb640 1 --2- 172.21.15.7:0/2722471842 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fccd8108cf0 0x7fccd810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:04.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.346+0000 7fccdcfbb640 1 --2- 172.21.15.7:0/2722471842 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fccd81083a0 0x7fccd81087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:04.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.346+0000 7fccdcfbb640 1 --2- 172.21.15.7:0/2722471842 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fccd8102a60 0x7fccd8102e70 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:04.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.346+0000 7fccdcfbb640 1 -- 172.21.15.7:0/2722471842 >> 172.21.15.7:0/2722471842 conn(0x7fccd8079730 msgr2=0x7fccd8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:04.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.346+0000 7fccdcfbb640 1 -- 172.21.15.7:0/2722471842 shutdown_connections 2024-09-21T06:37:04.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.346+0000 7fccdcfbb640 1 -- 172.21.15.7:0/2722471842 wait complete. 2024-09-21T06:37:04.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.347+0000 7fccdcfbb640 1 Processor -- start 2024-09-21T06:37:04.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.347+0000 7fccdcfbb640 1 -- start start 2024-09-21T06:37:04.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.348+0000 7fccdcfbb640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fccd8102a60 0x7fccd819a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:04.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.348+0000 7fccdcfbb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fccd81083a0 0x7fccd819a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:04.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.348+0000 7fccdcfbb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fccd8108cf0 0x7fccd819fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:04.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.348+0000 7fccdcfbb640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fccd8113ab0 con 0x7fccd81083a0 2024-09-21T06:37:04.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.348+0000 7fccdcfbb640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fccd8113930 con 0x7fccd8108cf0 2024-09-21T06:37:04.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.348+0000 7fccdcfbb640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fccd8113c30 con 0x7fccd8102a60 2024-09-21T06:37:04.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.348+0000 7fccd5d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fccd81083a0 0x7fccd819a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:04.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.348+0000 7fccd5d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fccd81083a0 0x7fccd819a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47680/0 (socket says 172.21.15.7:47680) 2024-09-21T06:37:04.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.348+0000 7fccd5d9b640 1 -- 172.21.15.7:0/2832303953 learned_addr learned my addr 172.21.15.7:0/2832303953 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:37:04.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.348+0000 7fccd6d9d640 1 --2- 172.21.15.7:0/2832303953 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fccd8108cf0 0x7fccd819fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:04.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.348+0000 7fccd659c640 1 --2- 172.21.15.7:0/2832303953 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fccd8102a60 0x7fccd819a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:04.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.349+0000 7fccd5d9b640 1 -- 172.21.15.7:0/2832303953 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fccd8102a60 msgr2=0x7fccd819a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:04.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.349+0000 7fccd5d9b640 1 --2- 172.21.15.7:0/2832303953 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fccd8102a60 0x7fccd819a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:04.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.349+0000 7fccd5d9b640 1 -- 172.21.15.7:0/2832303953 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fccd8108cf0 msgr2=0x7fccd819fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:04.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.349+0000 7fccd5d9b640 1 --2- 172.21.15.7:0/2832303953 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fccd8108cf0 0x7fccd819fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:04.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.349+0000 7fccd5d9b640 1 -- 172.21.15.7:0/2832303953 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccd81a0370 con 0x7fccd81083a0 2024-09-21T06:37:04.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.349+0000 7fccd659c640 1 --2- 172.21.15.7:0/2832303953 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fccd8102a60 0x7fccd819a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:37:04.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.349+0000 7fccd5d9b640 1 --2- 172.21.15.7:0/2832303953 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fccd81083a0 0x7fccd819a9a0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fcccc00e9c0 tx=0x7fcccc00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:04.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.350+0000 7fccc77fe640 1 -- 172.21.15.7:0/2832303953 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcccc00cd80 con 0x7fccd81083a0 2024-09-21T06:37:04.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.350+0000 7fccc77fe640 1 -- 172.21.15.7:0/2832303953 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcccc0054d0 con 0x7fccd81083a0 2024-09-21T06:37:04.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.350+0000 7fccdcfbb640 1 -- 172.21.15.7:0/2832303953 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccd81a0660 con 0x7fccd81083a0 2024-09-21T06:37:04.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.351+0000 7fccc77fe640 1 -- 172.21.15.7:0/2832303953 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcccc010430 con 0x7fccd81083a0 2024-09-21T06:37:04.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.351+0000 7fccdcfbb640 1 -- 172.21.15.7:0/2832303953 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccd81a6dc0 con 0x7fccd81083a0 2024-09-21T06:37:04.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.354+0000 7fcce352f740 1 Processor -- start 2024-09-21T06:37:04.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.355+0000 7fcce352f740 1 -- start start 2024-09-21T06:37:04.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.355+0000 7fccc77fe640 1 -- 172.21.15.7:0/2832303953 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7fcccc0105d0 con 0x7fccd81083a0 2024-09-21T06:37:04.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.356+0000 7fcce352f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dad69c5070 0x55dad6d6c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:04.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.356+0000 7fcce352f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dad699c1b0 0x55dad6d6cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:04.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.356+0000 7fcce352f740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dad69a4390 0x55dad6d6d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:04.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.356+0000 7fcce352f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55dad6ce2e50 con 0x55dad699c1b0 2024-09-21T06:37:04.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.356+0000 7fcce352f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55dad6cd2280 con 0x55dad69c5070 2024-09-21T06:37:04.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.356+0000 7fcce352f740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55dad6cd6090 con 0x55dad69a4390 2024-09-21T06:37:04.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.356+0000 7fccd659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dad699c1b0 0x55dad6d6cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:04.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.356+0000 7fccd659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dad699c1b0 0x55dad6d6cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47684/0 (socket says 172.21.15.7:47684) 2024-09-21T06:37:04.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.356+0000 7fccd659c640 1 -- 172.21.15.7:0/762244538 learned_addr learned my addr 172.21.15.7:0/762244538 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:37:04.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.356+0000 7fccc77fe640 1 --2- 172.21.15.7:0/2832303953 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fccc00b6700 0x7fccc00b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:04.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.357+0000 7fccc77fe640 1 -- 172.21.15.7:0/2832303953 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fcccc0e74f0 con 0x7fccd81083a0 2024-09-21T06:37:04.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.357+0000 7fccd659c640 1 -- 172.21.15.7:0/762244538 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dad69a4390 msgr2=0x55dad6d6d0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T06:37:04.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.357+0000 7fccd659c640 1 --2- 172.21.15.7:0/762244538 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dad69a4390 0x55dad6d6d0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:04.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.357+0000 7fccd659c640 1 -- 172.21.15.7:0/762244538 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dad69c5070 msgr2=0x55dad6d6c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:04.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.357+0000 7fccd6d9d640 1 --2- 172.21.15.7:0/762244538 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dad69c5070 0x55dad6d6c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:04.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.357+0000 7fccd659c640 1 --2- 172.21.15.7:0/762244538 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dad69c5070 0x55dad6d6c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:04.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.357+0000 7fccd659c640 1 -- 172.21.15.7:0/762244538 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dad6a30650 con 0x55dad699c1b0 2024-09-21T06:37:04.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.357+0000 7fccd659c640 1 --2- 172.21.15.7:0/762244538 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dad699c1b0 0x55dad6d6cb90 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fccc802ade0 tx=0x7fccc8032ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6337b04ead52d035 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:04.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.357+0000 7fccd6d9d640 1 --2- 172.21.15.7:0/762244538 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dad69c5070 0x55dad6d6c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:37:04.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.358+0000 7fccc4ff9640 1 -- 172.21.15.7:0/762244538 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc8031650 con 0x55dad699c1b0 2024-09-21T06:37:04.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.358+0000 7fccd6d9d640 1 --2- 172.21.15.7:0/2832303953 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fccc00b6700 0x7fccc00b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:04.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.358+0000 7fccc4ff9640 1 -- 172.21.15.7:0/762244538 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fccc8036040 con 0x55dad699c1b0 2024-09-21T06:37:04.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.358+0000 7fccc4ff9640 1 -- 172.21.15.7:0/762244538 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc80045c0 con 0x55dad699c1b0 2024-09-21T06:37:04.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.359+0000 7fcce352f740 1 -- 172.21.15.7:0/762244538 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dad699c1b0 msgr2=0x55dad6d6cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:04.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.359+0000 7fccd6d9d640 1 --2- 172.21.15.7:0/2832303953 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fccc00b6700 0x7fccc00b8c10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fccd000ba20 tx=0x7fccd0004100 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:04.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.359+0000 7fcce352f740 1 --2- 172.21.15.7:0/762244538 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dad699c1b0 0x55dad6d6cb90 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fccc802ade0 tx=0x7fccc8032ff0 comp rx=0 tx=0).stop 2024-09-21T06:37:04.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.359+0000 7fcce352f740 1 -- 172.21.15.7:0/762244538 shutdown_connections 2024-09-21T06:37:04.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.359+0000 7fcce352f740 1 --2- 172.21.15.7:0/762244538 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dad69a4390 0x55dad6d6d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:04.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.359+0000 7fcce352f740 1 --2- 172.21.15.7:0/762244538 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dad699c1b0 0x55dad6d6cb90 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:04.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.359+0000 7fcce352f740 1 --2- 172.21.15.7:0/762244538 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dad69c5070 0x55dad6d6c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:04.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.359+0000 7fcce352f740 1 -- 172.21.15.7:0/762244538 >> 172.21.15.7:0/762244538 conn(0x55dad69b9460 msgr2=0x55dad6d6a540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:04.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.359+0000 7fcce352f740 1 -- 172.21.15.7:0/762244538 shutdown_connections 2024-09-21T06:37:04.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.361+0000 7fcce352f740 1 -- 172.21.15.7:0/762244538 wait complete. 2024-09-21T06:37:04.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.361+0000 7fcce352f740 1 -- start start 2024-09-21T06:37:04.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.361+0000 7fcce352f740 1 Processor -- start 2024-09-21T06:37:04.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.362+0000 7fcce352f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dad69a4390 0x55dad6d77e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:04.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.362+0000 7fcce352f740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dad69c5070 0x55dad6d783a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:04.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.362+0000 7fcce352f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dad69839f0 0x55dad6d883f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:04.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.362+0000 7fcce352f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55dad6b33700 con 0x55dad69839f0 2024-09-21T06:37:04.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.362+0000 7fcce352f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55dad6c6d110 con 0x55dad69a4390 2024-09-21T06:37:04.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.362+0000 7fcce352f740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55dad6d7f060 con 0x55dad69c5070 2024-09-21T06:37:04.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.362+0000 7fcce352f740 10 client.0 _ll_register_callbacks cb 0x55dad6c86990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:37:04.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.362+0000 7fccd5d9b640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dad69c5070 0x55dad6d783a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:04.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.362+0000 7fccd6d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dad69839f0 0x55dad6d883f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:04.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.362+0000 7fccd6d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dad69839f0 0x55dad6d883f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47696/0 (socket says 172.21.15.7:47696) 2024-09-21T06:37:04.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.362+0000 7fccd6d9d640 1 -- 172.21.15.7:0/2562511314 learned_addr learned my addr 172.21.15.7:0/2562511314 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:37:04.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.362+0000 7fccd6d9d640 1 -- 172.21.15.7:0/2562511314 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dad69c5070 msgr2=0x55dad6d783a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:04.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.362+0000 7fccd6d9d640 1 --2- 172.21.15.7:0/2562511314 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dad69c5070 0x55dad6d783a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:04.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.362+0000 7fccd659c640 1 --2- 172.21.15.7:0/2562511314 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dad69a4390 0x55dad6d77e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:04.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.363+0000 7fccd6d9d640 1 -- 172.21.15.7:0/2562511314 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dad69a4390 msgr2=0x55dad6d77e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:04.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.363+0000 7fccd6d9d640 1 --2- 172.21.15.7:0/2562511314 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dad69a4390 0x55dad6d77e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:04.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.363+0000 7fccd6d9d640 1 -- 172.21.15.7:0/2562511314 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dad6c9ac40 con 0x55dad69839f0 2024-09-21T06:37:04.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.363+0000 7fccd659c640 1 --2- 172.21.15.7:0/2562511314 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dad69a4390 0x55dad6d77e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:37:04.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.363+0000 7fccd6d9d640 1 --2- 172.21.15.7:0/2562511314 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dad69839f0 0x55dad6d883f0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fccd000b7b0 tx=0x7fccd000b520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d92c4b2b71486c54 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:04.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.363+0000 7fccbdffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:37:04.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.363+0000 7fccbdffb640 1 -- 172.21.15.7:0/2562511314 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccd0005260 con 0x55dad69839f0 2024-09-21T06:37:04.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.363+0000 7fccbdffb640 1 -- 172.21.15.7:0/2562511314 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fccd0005400 con 0x55dad69839f0 2024-09-21T06:37:04.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.363+0000 7fcce352f740 1 -- 172.21.15.7:0/2562511314 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fccc8036040 con 0x55dad69839f0 2024-09-21T06:37:04.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.363+0000 7fccbdffb640 1 -- 172.21.15.7:0/2562511314 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fccd002c030 con 0x55dad69839f0 2024-09-21T06:37:04.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.364+0000 7fcce352f740 10 client.15660 fetch_fsmap learned FSMap version 25 2024-09-21T06:37:04.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.364+0000 7fcce352f740 1 -- 172.21.15.7:0/2562511314 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55dad6d8aed0 con 0x55dad69839f0 2024-09-21T06:37:04.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.364+0000 7fccbdffb640 1 -- 172.21.15.7:0/2562511314 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fccd0022030 con 0x55dad69839f0 2024-09-21T06:37:04.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.364+0000 7fccbdffb640 1 -- 172.21.15.7:0/2562511314 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fccd0031690 con 0x55dad69839f0 2024-09-21T06:37:04.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.364+0000 7fcce352f740 10 client.15660 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:37:04.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.364+0000 7fcce352f740 10 client.15660 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:37:04.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.364+0000 7fcce352f740 20 client.15660 populate_metadata read hostname 'smithi007' 2024-09-21T06:37:04.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.364+0000 7fcce352f740 1 --2- 172.21.15.7:0/2562511314 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55dad6958da0 0x55dad6d8e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:04.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.364+0000 7fcce352f740 4 client.15660 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:37:04.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.364+0000 7fcce352f740 1 -- 172.21.15.7:0/2562511314 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fccc8036040 con 0x55dad6958da0 2024-09-21T06:37:04.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.365+0000 7fccd659c640 1 --2- 172.21.15.7:0/2562511314 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55dad6958da0 0x55dad6d8e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:04.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.365+0000 7fccbdffb640 10 client.15660 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:37:04.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.365+0000 7fccd659c640 1 --2- 172.21.15.7:0/2562511314 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55dad6958da0 0x55dad6d8e410 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=398a047dc23284be server_cookie=4d702101c34ea4f6 in_seq=0 out_seq=0 2024-09-21T06:37:04.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.366+0000 7fccbdffb640 1 -- 172.21.15.7:0/2562511314 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7fccc8036040 con 0x55dad6958da0 2024-09-21T06:37:04.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.366+0000 7fccbdffb640 10 client.15660 handle_command_reply: tid=0 2024-09-21T06:37:04.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.366+0000 7fcce352f740 1 client.15660 shutdown 2024-09-21T06:37:04.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.367+0000 7fcce352f740 1 -- 172.21.15.7:0/2562511314 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dad69839f0 msgr2=0x55dad6d883f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:04.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.367+0000 7fcce352f740 1 --2- 172.21.15.7:0/2562511314 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dad69839f0 0x55dad6d883f0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fccd000b7b0 tx=0x7fccd000b520 comp rx=0 tx=0).stop 2024-09-21T06:37:04.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.367+0000 7fcce352f740 1 -- 172.21.15.7:0/2562511314 shutdown_connections 2024-09-21T06:37:04.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.367+0000 7fcce352f740 1 --2- 172.21.15.7:0/2562511314 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55dad6958da0 0x55dad6d8e410 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:04.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.367+0000 7fccbdffb640 0 client.15660 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:37:04.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.367+0000 7fcce352f740 1 --2- 172.21.15.7:0/2562511314 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dad69839f0 0x55dad6d883f0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:04.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.367+0000 7fcce352f740 1 --2- 172.21.15.7:0/2562511314 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dad69c5070 0x55dad6d783a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:04.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.367+0000 7fcce352f740 1 --2- 172.21.15.7:0/2562511314 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dad69a4390 0x55dad6d77e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:04.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.367+0000 7fcce352f740 1 -- 172.21.15.7:0/2562511314 >> 172.21.15.7:0/2562511314 conn(0x55dad69b9460 msgr2=0x55dad6d6d680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:04.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.367+0000 7fcce352f740 1 -- 172.21.15.7:0/2562511314 shutdown_connections 2024-09-21T06:37:04.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.367+0000 7fcce352f740 1 -- 172.21.15.7:0/2562511314 wait complete. 2024-09-21T06:37:04.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.367+0000 7fcce352f740 20 client.15660 trim_cache size 0 max 16384 2024-09-21T06:37:04.371 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:37:03 smithi018 ceph-mon[34477]: scrub queued for path: / 2024-09-21T06:37:04.371 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:37:03 smithi018 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-21T06:37:04.371 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:37:03 smithi018 ceph-mon[34477]: scrub summary: active paths [/] 2024-09-21T06:37:04.371 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:37:03 smithi018 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-21T06:37:04.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.402+0000 7fcce352f740 1 Processor -- start 2024-09-21T06:37:04.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.402+0000 7fcce352f740 1 -- start start 2024-09-21T06:37:04.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.403+0000 7fcce352f740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dad6958da0 0x55dad6d69dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:04.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.403+0000 7fcce352f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dad69839f0 0x55dad6d6a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:04.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.403+0000 7fcce352f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dad69a4390 0x55dad6d75110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:04.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.403+0000 7fcce352f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fccd81afc10 con 0x55dad69839f0 2024-09-21T06:37:04.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.403+0000 7fcce352f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fccd81ad4e0 con 0x55dad69a4390 2024-09-21T06:37:04.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.403+0000 7fccd5d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dad69839f0 0x55dad6d6a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:04.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.403+0000 7fccd5d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dad69839f0 0x55dad6d6a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47704/0 (socket says 172.21.15.7:47704) 2024-09-21T06:37:04.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.403+0000 7fccd5d9b640 1 -- 172.21.15.7:0/3007774800 learned_addr learned my addr 172.21.15.7:0/3007774800 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:37:04.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.403+0000 7fcce352f740 1 -- 172.21.15.7:0/3007774800 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fccd81ab310 con 0x55dad6958da0 2024-09-21T06:37:04.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.403+0000 7fccd6d9d640 1 --2- 172.21.15.7:0/3007774800 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dad69a4390 0x55dad6d75110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:04.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.404+0000 7fccd659c640 1 --2- 172.21.15.7:0/3007774800 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dad6958da0 0x55dad6d69dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:04.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.404+0000 7fccd5d9b640 1 -- 172.21.15.7:0/3007774800 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dad6958da0 msgr2=0x55dad6d69dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:04.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.404+0000 7fccd5d9b640 1 --2- 172.21.15.7:0/3007774800 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dad6958da0 0x55dad6d69dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:04.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.404+0000 7fccd5d9b640 1 -- 172.21.15.7:0/3007774800 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dad69a4390 msgr2=0x55dad6d75110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:04.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.404+0000 7fccd5d9b640 1 --2- 172.21.15.7:0/3007774800 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dad69a4390 0x55dad6d75110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:04.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.404+0000 7fccd5d9b640 1 -- 172.21.15.7:0/3007774800 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dad6d76360 con 0x55dad69839f0 2024-09-21T06:37:04.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.404+0000 7fccd6d9d640 1 --2- 172.21.15.7:0/3007774800 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dad69a4390 0x55dad6d75110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:37:04.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.404+0000 7fccd5d9b640 1 --2- 172.21.15.7:0/3007774800 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dad69839f0 0x55dad6d6a310 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fcccc0ad1c0 tx=0x7fcccc0049b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bcf28c78bc03e58 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:04.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.405+0000 7fccbffff640 1 -- 172.21.15.7:0/3007774800 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcccc0d4020 con 0x55dad69839f0 2024-09-21T06:37:04.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.405+0000 7fccbffff640 1 -- 172.21.15.7:0/3007774800 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcccc0046c0 con 0x55dad69839f0 2024-09-21T06:37:04.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.405+0000 7fccbffff640 1 -- 172.21.15.7:0/3007774800 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcccc0d0e10 con 0x55dad69839f0 2024-09-21T06:37:04.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.405+0000 7fcce352f740 1 -- 172.21.15.7:0/3007774800 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dad69839f0 msgr2=0x55dad6d6a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:04.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.405+0000 7fcce352f740 1 --2- 172.21.15.7:0/3007774800 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dad69839f0 0x55dad6d6a310 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fcccc0ad1c0 tx=0x7fcccc0049b0 comp rx=0 tx=0).stop 2024-09-21T06:37:04.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.406+0000 7fcce352f740 1 -- 172.21.15.7:0/3007774800 shutdown_connections 2024-09-21T06:37:04.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.406+0000 7fcce352f740 1 --2- 172.21.15.7:0/3007774800 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dad69a4390 0x55dad6d75110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:04.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.406+0000 7fcce352f740 1 --2- 172.21.15.7:0/3007774800 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dad69839f0 0x55dad6d6a310 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:04.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.406+0000 7fcce352f740 1 --2- 172.21.15.7:0/3007774800 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dad6958da0 0x55dad6d69dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:04.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.406+0000 7fcce352f740 1 -- 172.21.15.7:0/3007774800 >> 172.21.15.7:0/3007774800 conn(0x55dad69b9460 msgr2=0x55dad6d766e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:04.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.406+0000 7fcce352f740 1 -- 172.21.15.7:0/3007774800 shutdown_connections 2024-09-21T06:37:04.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.406+0000 7fcce352f740 1 -- 172.21.15.7:0/3007774800 wait complete. 2024-09-21T06:37:04.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.406+0000 7fcce352f740 1 -- start start 2024-09-21T06:37:04.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.406+0000 7fcce352f740 1 Processor -- start 2024-09-21T06:37:04.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.407+0000 7fcce352f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dad6958da0 0x55dad6d84350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:04.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.407+0000 7fcce352f740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dad69839f0 0x55dad6d84890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:04.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.407+0000 7fcce352f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dad69a4390 0x55dad6d7c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:04.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.407+0000 7fccd659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dad6958da0 0x55dad6d84350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:04.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.407+0000 7fccd659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dad6958da0 0x55dad6d84350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47710/0 (socket says 172.21.15.7:47710) 2024-09-21T06:37:04.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.407+0000 7fccd659c640 1 -- 172.21.15.7:0/3387195167 learned_addr learned my addr 172.21.15.7:0/3387195167 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:37:04.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.407+0000 7fcce352f740 1 -- 172.21.15.7:0/3387195167 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fccd81ab9a0 con 0x55dad6958da0 2024-09-21T06:37:04.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.407+0000 7fcce352f740 1 -- 172.21.15.7:0/3387195167 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fccd81ace10 con 0x55dad69a4390 2024-09-21T06:37:04.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.407+0000 7fcce352f740 1 -- 172.21.15.7:0/3387195167 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fccd81ac070 con 0x55dad69839f0 2024-09-21T06:37:04.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.407+0000 7fccd5d9b640 1 --2- 172.21.15.7:0/3387195167 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dad69839f0 0x55dad6d84890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:04.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.407+0000 7fccd5d9b640 1 -- 172.21.15.7:0/3387195167 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dad69a4390 msgr2=0x55dad6d7c2d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T06:37:04.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.407+0000 7fccd5d9b640 1 --2- 172.21.15.7:0/3387195167 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dad69a4390 0x55dad6d7c2d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:04.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.407+0000 7fccd5d9b640 1 -- 172.21.15.7:0/3387195167 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dad6958da0 msgr2=0x55dad6d84350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:04.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.408+0000 7fccd5d9b640 1 --2- 172.21.15.7:0/3387195167 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dad6958da0 0x55dad6d84350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:04.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.408+0000 7fccd5d9b640 1 -- 172.21.15.7:0/3387195167 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dad6d7c810 con 0x55dad69839f0 2024-09-21T06:37:04.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.408+0000 7fccd659c640 1 --2- 172.21.15.7:0/3387195167 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dad6958da0 0x55dad6d84350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:37:04.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.408+0000 7fcce352f740 10 client.0 _ll_register_callbacks cb 0x7fccd000b700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:37:04.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.408+0000 7fcce352f740 1 -- 172.21.15.7:0/3387195167 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55dad6d88be0 con 0x55dad69839f0 2024-09-21T06:37:04.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.408+0000 7fccd5d9b640 1 --2- 172.21.15.7:0/3387195167 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dad69839f0 0x55dad6d84890 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x55dad6c707c0 tx=0x7fcccc0d0e40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68a939375933627f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:04.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.408+0000 7fccbdffb640 10 client.25303 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-21T06:37:04.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.408+0000 7fccbdffb640 1 -- 172.21.15.7:0/3387195167 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcccc0cd060 con 0x55dad69839f0 2024-09-21T06:37:04.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.408+0000 7fccbdffb640 1 -- 172.21.15.7:0/3387195167 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fcccc0a8b80 con 0x55dad69839f0 2024-09-21T06:37:04.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.408+0000 7fccbdffb640 1 -- 172.21.15.7:0/3387195167 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fcccc0d4030 con 0x55dad69839f0 2024-09-21T06:37:04.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.408+0000 7fcce352f740 10 client.25303 fetch_fsmap learned FSMap version 25 2024-09-21T06:37:04.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.408+0000 7fcce352f740 1 -- 172.21.15.7:0/3387195167 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({fsmap=25}) -- 0x55dad6dfd8f0 con 0x55dad69839f0 2024-09-21T06:37:04.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.409+0000 7fccbdffb640 1 -- 172.21.15.7:0/3387195167 <== mon.1 v2:172.21.15.144:3300/0 4 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fcccc0e8020 con 0x55dad69839f0 2024-09-21T06:37:04.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.409+0000 7fcce352f740 10 client.25303 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:37:04.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.409+0000 7fcce352f740 10 client.25303 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:37:04.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.409+0000 7fcce352f740 20 client.25303 populate_metadata read hostname 'smithi007' 2024-09-21T06:37:04.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.409+0000 7fcce352f740 1 --2- 172.21.15.7:0/3387195167 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55dad69c5070 0x55dad6e00010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:04.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.409+0000 7fcce352f740 4 client.25303 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:37:04.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.409+0000 7fcce352f740 1 -- 172.21.15.7:0/3387195167 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55dad6ce4da0 con 0x55dad69c5070 2024-09-21T06:37:04.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.409+0000 7fccd659c640 1 --2- 172.21.15.7:0/3387195167 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55dad69c5070 0x55dad6e00010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:04.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.410+0000 7fccbdffb640 10 client.25303 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:37:04.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.410+0000 7fccd659c640 1 --2- 172.21.15.7:0/3387195167 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55dad69c5070 0x55dad6e00010 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b958a843f1c9838 server_cookie=de3e0d94fee6a086 in_seq=0 out_seq=0 2024-09-21T06:37:04.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.410+0000 7fccbdffb640 1 -- 172.21.15.7:0/3387195167 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+854 (crc 0 0 0) 0x55dad6ce4da0 con 0x55dad69c5070 2024-09-21T06:37:04.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.410+0000 7fccbdffb640 10 client.25303 handle_command_reply: tid=0 2024-09-21T06:37:04.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.410+0000 7fcce352f740 1 client.25303 shutdown 2024-09-21T06:37:04.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.410+0000 7fcce352f740 1 -- 172.21.15.7:0/3387195167 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dad69839f0 msgr2=0x55dad6d84890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:04.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.410+0000 7fcce352f740 1 --2- 172.21.15.7:0/3387195167 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dad69839f0 0x55dad6d84890 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x55dad6c707c0 tx=0x7fcccc0d0e40 comp rx=0 tx=0).stop 2024-09-21T06:37:04.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.410+0000 7fcce352f740 1 -- 172.21.15.7:0/3387195167 shutdown_connections 2024-09-21T06:37:04.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.410+0000 7fcce352f740 1 --2- 172.21.15.7:0/3387195167 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55dad69c5070 0x55dad6e00010 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:04.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.410+0000 7fccbdffb640 0 client.25303 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:37:04.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.410+0000 7fcce352f740 1 --2- 172.21.15.7:0/3387195167 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dad69a4390 0x55dad6d7c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:04.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.410+0000 7fcce352f740 1 --2- 172.21.15.7:0/3387195167 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dad69839f0 0x55dad6d84890 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:04.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.410+0000 7fcce352f740 1 --2- 172.21.15.7:0/3387195167 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dad6958da0 0x55dad6d84350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:04.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.410+0000 7fcce352f740 1 -- 172.21.15.7:0/3387195167 >> 172.21.15.7:0/3387195167 conn(0x55dad69b9460 msgr2=0x55dad6d69d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:04.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.410+0000 7fcce352f740 1 -- 172.21.15.7:0/3387195167 shutdown_connections 2024-09-21T06:37:04.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.410+0000 7fcce352f740 1 -- 172.21.15.7:0/3387195167 wait complete. 2024-09-21T06:37:04.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.411+0000 7fcce352f740 20 client.25303 trim_cache size 0 max 16384 2024-09-21T06:37:04.416 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:37:04.416 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T06:37:04.416 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": { 2024-09-21T06:37:04.416 INFO:teuthology.orchestra.run.smithi007.stdout: "6231e9c1-14a2-40b5-be3c-76d87a0d733b": { 2024-09-21T06:37:04.416 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:37:04.416 INFO:teuthology.orchestra.run.smithi007.stdout: "tag": "6231e9c1-14a2-40b5-be3c-76d87a0d733b", 2024-09-21T06:37:04.416 INFO:teuthology.orchestra.run.smithi007.stdout: "options": "recursive,force" 2024-09-21T06:37:04.416 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:37:04.416 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:37:04.416 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_stats": { 2024-09-21T06:37:04.416 INFO:teuthology.orchestra.run.smithi007.stdout: "6231e9c1-14a2-40b5-be3c-76d87a0d733b": { 2024-09-21T06:37:04.417 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:37:02.484812+0000", 2024-09-21T06:37:04.417 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:37:04.417 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:37:04.417 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:37:04.417 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:37:04.417 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:37:04.417 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:37:04.417 INFO:teuthology.orchestra.run.smithi007.stdout: "0b89345c-1f00-4efe-8ee9-4cb17e43584c": { 2024-09-21T06:37:04.417 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:36:19.500334+0000", 2024-09-21T06:37:04.417 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:37:04.417 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:37:04.418 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:37:04.418 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:37:04.418 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:37:04.418 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:37:04.418 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:37:04.418 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:37:04.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.411+0000 7fccdcfbb640 1 -- 172.21.15.7:0/2832303953 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fccc00b6700 msgr2=0x7fccc00b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:04.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.411+0000 7fccdcfbb640 1 --2- 172.21.15.7:0/2832303953 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fccc00b6700 0x7fccc00b8c10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fccd000ba20 tx=0x7fccd0004100 comp rx=0 tx=0).stop 2024-09-21T06:37:04.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.411+0000 7fccdcfbb640 1 -- 172.21.15.7:0/2832303953 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fccd81083a0 msgr2=0x7fccd819a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:04.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.411+0000 7fccdcfbb640 1 --2- 172.21.15.7:0/2832303953 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fccd81083a0 0x7fccd819a9a0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fcccc00e9c0 tx=0x7fcccc00ee80 comp rx=0 tx=0).stop 2024-09-21T06:37:04.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.411+0000 7fccdcfbb640 1 -- 172.21.15.7:0/2832303953 shutdown_connections 2024-09-21T06:37:04.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.411+0000 7fccdcfbb640 1 --2- 172.21.15.7:0/2832303953 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fccc00b6700 0x7fccc00b8c10 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:04.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.411+0000 7fccdcfbb640 1 --2- 172.21.15.7:0/2832303953 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fccd8108cf0 0x7fccd819fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:04.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.411+0000 7fccdcfbb640 1 --2- 172.21.15.7:0/2832303953 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fccd81083a0 0x7fccd819a9a0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:04.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.411+0000 7fccdcfbb640 1 --2- 172.21.15.7:0/2832303953 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fccd8102a60 0x7fccd819a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:04.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.411+0000 7fccdcfbb640 1 -- 172.21.15.7:0/2832303953 >> 172.21.15.7:0/2832303953 conn(0x7fccd8079730 msgr2=0x7fccd81013b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:04.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.412+0000 7fccdcfbb640 1 -- 172.21.15.7:0/2832303953 shutdown_connections 2024-09-21T06:37:04.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:04.412+0000 7fccdcfbb640 1 -- 172.21.15.7:0/2832303953 wait complete. 2024-09-21T06:37:05.145 INFO:tasks.cephfs.filesystem:scrub status for tag:6231e9c1-14a2-40b5-be3c-76d87a0d733b - {'path': '/', 'tag': '6231e9c1-14a2-40b5-be3c-76d87a0d733b', 'options': 'recursive,force'} 2024-09-21T06:37:05.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:37:04 smithi144 ceph-mon[34653]: pgmap v345: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 24 op/s 2024-09-21T06:37:05.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:37:04 smithi144 ceph-mon[34653]: scrub summary: idle 2024-09-21T06:37:05.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:37:04 smithi007 ceph-mon[30983]: pgmap v345: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 24 op/s 2024-09-21T06:37:05.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:37:04 smithi007 ceph-mon[30983]: scrub summary: idle 2024-09-21T06:37:05.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:37:04 smithi018 ceph-mon[34477]: pgmap v345: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 24 op/s 2024-09-21T06:37:05.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:37:04 smithi018 ceph-mon[34477]: scrub summary: idle 2024-09-21T06:37:07.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:37:06 smithi144 ceph-mon[34653]: pgmap v346: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 23 op/s 2024-09-21T06:37:07.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:37:06 smithi007 ceph-mon[30983]: pgmap v346: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 23 op/s 2024-09-21T06:37:07.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:37:06 smithi018 ceph-mon[34477]: pgmap v346: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 23 op/s 2024-09-21T06:37:09.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:37:08 smithi144 ceph-mon[34653]: pgmap v347: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 23 op/s 2024-09-21T06:37:09.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:37:08 smithi007 ceph-mon[30983]: pgmap v347: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 23 op/s 2024-09-21T06:37:09.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:37:08 smithi018 ceph-mon[34477]: pgmap v347: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 23 op/s 2024-09-21T06:37:11.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:37:10 smithi144 ceph-mon[34653]: pgmap v348: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 KiB/s wr, 25 op/s 2024-09-21T06:37:11.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:37:10 smithi007 ceph-mon[30983]: pgmap v348: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 KiB/s wr, 25 op/s 2024-09-21T06:37:11.368 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:37:10 smithi018 ceph-mon[34477]: pgmap v348: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 KiB/s wr, 25 op/s 2024-09-21T06:37:13.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.187+0000 7fe2b074a640 1 -- 172.21.15.7:0/2865439516 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2a81029c0 msgr2=0x7fe2a8102dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:13.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.187+0000 7fe2b074a640 1 --2- 172.21.15.7:0/2865439516 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2a81029c0 0x7fe2a8102dd0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fe2a4009900 tx=0x7fe2a402a410 comp rx=0 tx=0).stop 2024-09-21T06:37:13.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.187+0000 7fe2b074a640 1 -- 172.21.15.7:0/2865439516 shutdown_connections 2024-09-21T06:37:13.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.187+0000 7fe2b074a640 1 --2- 172.21.15.7:0/2865439516 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2a8108c40 0x7fe2a810f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:13.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.187+0000 7fe2b074a640 1 --2- 172.21.15.7:0/2865439516 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2a81082f0 0x7fe2a8108700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:13.189 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.187+0000 7fe2b074a640 1 --2- 172.21.15.7:0/2865439516 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2a81029c0 0x7fe2a8102dd0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:13.190 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.187+0000 7fe2b074a640 1 -- 172.21.15.7:0/2865439516 >> 172.21.15.7:0/2865439516 conn(0x7fe2a80fe3c0 msgr2=0x7fe2a8100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:13.190 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.187+0000 7fe2b074a640 1 -- 172.21.15.7:0/2865439516 shutdown_connections 2024-09-21T06:37:13.190 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.187+0000 7fe2b074a640 1 -- 172.21.15.7:0/2865439516 wait complete. 2024-09-21T06:37:13.191 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.188+0000 7fe2b074a640 1 Processor -- start 2024-09-21T06:37:13.191 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.188+0000 7fe2b074a640 1 -- start start 2024-09-21T06:37:13.191 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.189+0000 7fe2b074a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2a81029c0 0x7fe2a819a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:13.191 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.189+0000 7fe2b074a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2a81082f0 0x7fe2a819a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:13.191 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.189+0000 7fe2b074a640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2a8108c40 0x7fe2a819fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:13.192 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.189+0000 7fe2b074a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a8113a50 con 0x7fe2a81029c0 2024-09-21T06:37:13.192 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.189+0000 7fe2ae4e6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2a81029c0 0x7fe2a819a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:13.192 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.189+0000 7fe2ae4e6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2a81029c0 0x7fe2a819a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42258/0 (socket says 172.21.15.7:42258) 2024-09-21T06:37:13.192 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.189+0000 7fe2ae4e6640 1 -- 172.21.15.7:0/2590615662 learned_addr learned my addr 172.21.15.7:0/2590615662 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:37:13.192 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.189+0000 7fe2b074a640 1 -- 172.21.15.7:0/2590615662 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a81138d0 con 0x7fe2a81082f0 2024-09-21T06:37:13.192 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.189+0000 7fe2b074a640 1 -- 172.21.15.7:0/2590615662 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a8113bd0 con 0x7fe2a8108c40 2024-09-21T06:37:13.192 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.189+0000 7fe2aece7640 1 --2- 172.21.15.7:0/2590615662 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2a8108c40 0x7fe2a819fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:13.192 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.189+0000 7fe2adce5640 1 --2- 172.21.15.7:0/2590615662 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2a81082f0 0x7fe2a819a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:13.192 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.189+0000 7fe2ae4e6640 1 -- 172.21.15.7:0/2590615662 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2a8108c40 msgr2=0x7fe2a819fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:13.192 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.189+0000 7fe2ae4e6640 1 --2- 172.21.15.7:0/2590615662 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2a8108c40 0x7fe2a819fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:13.192 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.189+0000 7fe2ae4e6640 1 -- 172.21.15.7:0/2590615662 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2a81082f0 msgr2=0x7fe2a819a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:13.192 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.189+0000 7fe2ae4e6640 1 --2- 172.21.15.7:0/2590615662 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2a81082f0 0x7fe2a819a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:13.192 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.189+0000 7fe2ae4e6640 1 -- 172.21.15.7:0/2590615662 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2a81a0360 con 0x7fe2a81029c0 2024-09-21T06:37:13.192 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.189+0000 7fe2adce5640 1 --2- 172.21.15.7:0/2590615662 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2a81082f0 0x7fe2a819a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:37:13.193 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.190+0000 7fe2ae4e6640 1 --2- 172.21.15.7:0/2590615662 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2a81029c0 0x7fe2a819a430 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fe2a4005ab0 tx=0x7fe2a4003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:13.193 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.190+0000 7fe29f7fe640 1 -- 172.21.15.7:0/2590615662 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a403f070 con 0x7fe2a81029c0 2024-09-21T06:37:13.193 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.190+0000 7fe29f7fe640 1 -- 172.21.15.7:0/2590615662 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe2a4031d60 con 0x7fe2a81029c0 2024-09-21T06:37:13.193 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.190+0000 7fe2b074a640 1 -- 172.21.15.7:0/2590615662 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2a81a05f0 con 0x7fe2a81029c0 2024-09-21T06:37:13.193 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.190+0000 7fe29f7fe640 1 -- 172.21.15.7:0/2590615662 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a4035030 con 0x7fe2a81029c0 2024-09-21T06:37:13.194 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.191+0000 7fe2b074a640 1 -- 172.21.15.7:0/2590615662 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2a81a6de0 con 0x7fe2a81029c0 2024-09-21T06:37:13.196 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.194+0000 7fe29f7fe640 1 -- 172.21.15.7:0/2590615662 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7fe2a4042070 con 0x7fe2a81029c0 2024-09-21T06:37:13.196 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.195+0000 7fe2b76b3740 1 Processor -- start 2024-09-21T06:37:13.197 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.195+0000 7fe2b76b3740 1 -- start start 2024-09-21T06:37:13.197 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.195+0000 7fe2b76b3740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644f3a101b0 0x5644f3db3420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:13.197 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.195+0000 7fe2b76b3740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644f39e72f0 0x5644f3db3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:13.197 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.195+0000 7fe2b76b3740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5644f39ef4d0 0x5644f3dc5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:13.197 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.195+0000 7fe2b76b3740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5644f3d2a6f0 con 0x5644f39e72f0 2024-09-21T06:37:13.197 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.195+0000 7fe2b76b3740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5644f3d19b20 con 0x5644f3a101b0 2024-09-21T06:37:13.197 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.195+0000 7fe2b76b3740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5644f3d1d930 con 0x5644f39ef4d0 2024-09-21T06:37:13.199 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.196+0000 7fe2adce5640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5644f39ef4d0 0x5644f3dc5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:13.199 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.196+0000 7fe2aece7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644f3a101b0 0x5644f3db3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:13.199 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.196+0000 7fe2adce5640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5644f39ef4d0 0x5644f3dc5dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.7:57666/0 (socket says 172.21.15.7:57666) 2024-09-21T06:37:13.199 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.196+0000 7fe2adce5640 1 -- 172.21.15.7:0/3570888934 learned_addr learned my addr 172.21.15.7:0/3570888934 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:37:13.199 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.196+0000 7fe2ae4e6640 1 --2- 172.21.15.7:0/3570888934 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644f39e72f0 0x5644f3db3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:13.199 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.196+0000 7fe2adce5640 1 -- 172.21.15.7:0/3570888934 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644f3a101b0 msgr2=0x5644f3db3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:13.199 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.196+0000 7fe2adce5640 1 --2- 172.21.15.7:0/3570888934 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644f3a101b0 0x5644f3db3420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:13.199 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.196+0000 7fe2adce5640 1 -- 172.21.15.7:0/3570888934 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644f39e72f0 msgr2=0x5644f3db3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:13.199 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.196+0000 7fe29f7fe640 1 --2- 172.21.15.7:0/2590615662 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fe2940b6700 0x7fe2940b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:13.199 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.196+0000 7fe2adce5640 1 --2- 172.21.15.7:0/3570888934 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644f39e72f0 0x5644f3db3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:13.199 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.196+0000 7fe2adce5640 1 -- 172.21.15.7:0/3570888934 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644f3cdf530 con 0x5644f39ef4d0 2024-09-21T06:37:13.200 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.196+0000 7fe2aece7640 1 --2- 172.21.15.7:0/3570888934 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644f3a101b0 0x5644f3db3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:37:13.200 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.196+0000 7fe2ae4e6640 1 --2- 172.21.15.7:0/3570888934 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644f39e72f0 0x5644f3db3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:37:13.200 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.196+0000 7fe2aece7640 1 --2- 172.21.15.7:0/2590615662 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fe2940b6700 0x7fe2940b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:13.200 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.196+0000 7fe29f7fe640 1 -- 172.21.15.7:0/2590615662 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fe2a4107a20 con 0x7fe2a81029c0 2024-09-21T06:37:13.200 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.197+0000 7fe2adce5640 1 --2- 172.21.15.7:0/3570888934 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5644f39ef4d0 0x5644f3dc5dd0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe2980104a0 tx=0x7fe298010960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2bb9432270e8bf9f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:13.200 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.197+0000 7fe29cff9640 1 -- 172.21.15.7:0/3570888934 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe298011700 con 0x5644f39ef4d0 2024-09-21T06:37:13.200 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.197+0000 7fe29cff9640 1 -- 172.21.15.7:0/3570888934 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe298011d50 con 0x5644f39ef4d0 2024-09-21T06:37:13.200 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.197+0000 7fe29cff9640 1 -- 172.21.15.7:0/3570888934 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe29800e430 con 0x5644f39ef4d0 2024-09-21T06:37:13.203 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.198+0000 7fe2b76b3740 1 -- 172.21.15.7:0/3570888934 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5644f39ef4d0 msgr2=0x5644f3dc5dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:13.203 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.198+0000 7fe2aece7640 1 --2- 172.21.15.7:0/2590615662 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fe2940b6700 0x7fe2940b8c10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe2a0005fd0 tx=0x7fe2a0009500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:13.203 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.198+0000 7fe2b76b3740 1 --2- 172.21.15.7:0/3570888934 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5644f39ef4d0 0x5644f3dc5dd0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe2980104a0 tx=0x7fe298010960 comp rx=0 tx=0).stop 2024-09-21T06:37:13.203 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.198+0000 7fe2b76b3740 1 -- 172.21.15.7:0/3570888934 shutdown_connections 2024-09-21T06:37:13.203 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.198+0000 7fe2b76b3740 1 --2- 172.21.15.7:0/3570888934 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5644f39ef4d0 0x5644f3dc5dd0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:13.203 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.198+0000 7fe2b76b3740 1 --2- 172.21.15.7:0/3570888934 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644f39e72f0 0x5644f3db3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:13.203 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.198+0000 7fe2b76b3740 1 --2- 172.21.15.7:0/3570888934 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644f3a101b0 0x5644f3db3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:13.203 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.198+0000 7fe2b76b3740 1 -- 172.21.15.7:0/3570888934 >> 172.21.15.7:0/3570888934 conn(0x5644f3a04300 msgr2=0x5644f3db5930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:13.203 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.198+0000 7fe2b76b3740 1 -- 172.21.15.7:0/3570888934 shutdown_connections 2024-09-21T06:37:13.204 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.198+0000 7fe2b76b3740 1 -- 172.21.15.7:0/3570888934 wait complete. 2024-09-21T06:37:13.204 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.199+0000 7fe2b76b3740 1 -- start start 2024-09-21T06:37:13.204 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.199+0000 7fe2b76b3740 1 Processor -- start 2024-09-21T06:37:13.204 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.199+0000 7fe2b76b3740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5644f39e72f0 0x5644f3dca110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:13.204 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.199+0000 7fe2b76b3740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644f39ef4d0 0x5644f3dca6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:13.204 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.200+0000 7fe2ae4e6640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5644f39e72f0 0x5644f3dca110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:13.204 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.200+0000 7fe2adce5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644f39ef4d0 0x5644f3dca6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:13.204 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.200+0000 7fe2ae4e6640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5644f39e72f0 0x5644f3dca110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.7:57678/0 (socket says 172.21.15.7:57678) 2024-09-21T06:37:13.204 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.200+0000 7fe2ae4e6640 1 -- 172.21.15.7:0/2091948253 learned_addr learned my addr 172.21.15.7:0/2091948253 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:37:13.204 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.200+0000 7fe2b76b3740 1 --2- 172.21.15.7:0/2091948253 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644f3a101b0 0x5644f3dcf700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:13.204 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.200+0000 7fe2b76b3740 1 -- 172.21.15.7:0/2091948253 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5644f3c51ab0 con 0x5644f39ef4d0 2024-09-21T06:37:13.204 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.200+0000 7fe2b76b3740 1 -- 172.21.15.7:0/2091948253 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5644f3cbf730 con 0x5644f3a101b0 2024-09-21T06:37:13.204 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.200+0000 7fe2b76b3740 1 -- 172.21.15.7:0/2091948253 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5644f3dc6850 con 0x5644f39e72f0 2024-09-21T06:37:13.204 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.200+0000 7fe2ae4e6640 1 -- 172.21.15.7:0/2091948253 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644f3a101b0 msgr2=0x5644f3dcf700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:13.205 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.200+0000 7fe2ae4e6640 1 --2- 172.21.15.7:0/2091948253 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644f3a101b0 0x5644f3dcf700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:13.205 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.200+0000 7fe2ae4e6640 1 -- 172.21.15.7:0/2091948253 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644f39ef4d0 msgr2=0x5644f3dca6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:13.205 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.200+0000 7fe2ae4e6640 1 --2- 172.21.15.7:0/2091948253 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644f39ef4d0 0x5644f3dca6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:13.205 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.200+0000 7fe2ae4e6640 1 -- 172.21.15.7:0/2091948253 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644f3a7b790 con 0x5644f39e72f0 2024-09-21T06:37:13.205 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.200+0000 7fe2adce5640 1 --2- 172.21.15.7:0/2091948253 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644f39ef4d0 0x5644f3dca6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:37:13.205 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.200+0000 7fe2b76b3740 10 client.0 _ll_register_callbacks cb 0x5644f3d136b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:37:13.205 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.201+0000 7fe2b76b3740 1 -- 172.21.15.7:0/2091948253 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe298011d50 con 0x5644f39e72f0 2024-09-21T06:37:13.205 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.201+0000 7fe2ae4e6640 1 --2- 172.21.15.7:0/2091948253 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5644f39e72f0 0x5644f3dca110 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe2a40cd6c0 tx=0x7fe2a4009610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79174f08ee30380e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:13.205 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.201+0000 7fe291ffb640 10 client.25315 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-21T06:37:13.205 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.201+0000 7fe291ffb640 1 -- 172.21.15.7:0/2091948253 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a4049070 con 0x5644f39e72f0 2024-09-21T06:37:13.205 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.201+0000 7fe291ffb640 1 -- 172.21.15.7:0/2091948253 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fe2a40d6ea0 con 0x5644f39e72f0 2024-09-21T06:37:13.205 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.201+0000 7fe291ffb640 1 -- 172.21.15.7:0/2091948253 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe2a40cd790 con 0x5644f39e72f0 2024-09-21T06:37:13.205 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.201+0000 7fe2b76b3740 10 client.25315 fetch_fsmap learned FSMap version 25 2024-09-21T06:37:13.205 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.201+0000 7fe2b76b3740 1 -- 172.21.15.7:0/2091948253 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({fsmap=25}) -- 0x5644f3af4620 con 0x5644f39e72f0 2024-09-21T06:37:13.207 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.202+0000 7fe291ffb640 1 -- 172.21.15.7:0/2091948253 <== mon.1 v2:172.21.15.144:3300/0 4 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fe2a40f3070 con 0x5644f39e72f0 2024-09-21T06:37:13.207 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.202+0000 7fe2b76b3740 10 client.25315 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:37:13.207 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.202+0000 7fe2b76b3740 10 client.25315 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:37:13.208 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.202+0000 7fe2b76b3740 20 client.25315 populate_metadata read hostname 'smithi007' 2024-09-21T06:37:13.208 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.202+0000 7fe2b76b3740 1 --2- 172.21.15.7:0/2091948253 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5644f39ced80 0x5644f3ddb810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:13.208 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.202+0000 7fe2b76b3740 4 client.25315 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:37:13.208 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.202+0000 7fe2b76b3740 1 -- 172.21.15.7:0/2091948253 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5644f3d2c640 con 0x5644f39ced80 2024-09-21T06:37:13.208 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.202+0000 7fe2adce5640 1 --2- 172.21.15.7:0/2091948253 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5644f39ced80 0x5644f3ddb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:13.208 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.202+0000 7fe291ffb640 10 client.25315 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:37:13.208 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.202+0000 7fe2adce5640 1 --2- 172.21.15.7:0/2091948253 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5644f39ced80 0x5644f3ddb810 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a508cd5735aa4eb server_cookie=b4c0728cba420a5b in_seq=0 out_seq=0 2024-09-21T06:37:13.208 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.203+0000 7fe291ffb640 1 -- 172.21.15.7:0/2091948253 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5644f3d2c640 con 0x5644f39ced80 2024-09-21T06:37:13.208 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.203+0000 7fe291ffb640 10 client.25315 handle_command_reply: tid=0 2024-09-21T06:37:13.208 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.203+0000 7fe2b76b3740 1 client.25315 shutdown 2024-09-21T06:37:13.208 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.203+0000 7fe2b76b3740 1 -- 172.21.15.7:0/2091948253 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5644f39e72f0 msgr2=0x5644f3dca110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:13.208 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.203+0000 7fe2b76b3740 1 --2- 172.21.15.7:0/2091948253 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5644f39e72f0 0x5644f3dca110 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe2a40cd6c0 tx=0x7fe2a4009610 comp rx=0 tx=0).stop 2024-09-21T06:37:13.208 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.204+0000 7fe2b76b3740 1 -- 172.21.15.7:0/2091948253 shutdown_connections 2024-09-21T06:37:13.209 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.204+0000 7fe2b76b3740 1 --2- 172.21.15.7:0/2091948253 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5644f39ced80 0x5644f3ddb810 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:13.209 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.204+0000 7fe291ffb640 0 client.25315 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:37:13.209 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.204+0000 7fe2b76b3740 1 --2- 172.21.15.7:0/2091948253 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644f3a101b0 0x5644f3dcf700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:13.209 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.204+0000 7fe2b76b3740 1 --2- 172.21.15.7:0/2091948253 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644f39ef4d0 0x5644f3dca6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:13.209 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.204+0000 7fe2b76b3740 1 --2- 172.21.15.7:0/2091948253 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5644f39e72f0 0x5644f3dca110 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:13.209 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.204+0000 7fe2b76b3740 1 -- 172.21.15.7:0/2091948253 >> 172.21.15.7:0/2091948253 conn(0x5644f3a04300 msgr2=0x5644f3db2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:13.209 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.204+0000 7fe2b76b3740 1 -- 172.21.15.7:0/2091948253 shutdown_connections 2024-09-21T06:37:13.209 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.204+0000 7fe2b76b3740 1 -- 172.21.15.7:0/2091948253 wait complete. 2024-09-21T06:37:13.209 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.204+0000 7fe2b76b3740 20 client.25315 trim_cache size 0 max 16384 2024-09-21T06:37:13.234 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.232+0000 7fe2b76b3740 1 Processor -- start 2024-09-21T06:37:13.234 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.233+0000 7fe2b76b3740 1 -- start start 2024-09-21T06:37:13.236 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.233+0000 7fe2b76b3740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644f39e72f0 0x5644f3dc4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:13.236 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.233+0000 7fe2b76b3740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644f39ef4d0 0x5644f3db5480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:13.236 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.233+0000 7fe2b76b3740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5644f3a101b0 0x5644f3db59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:13.236 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.233+0000 7fe2adce5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644f39ef4d0 0x5644f3db5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:13.236 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.233+0000 7fe2adce5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644f39ef4d0 0x5644f3db5480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42284/0 (socket says 172.21.15.7:42284) 2024-09-21T06:37:13.236 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.233+0000 7fe2ae4e6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644f39e72f0 0x5644f3dc4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:13.236 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.233+0000 7fe2adce5640 1 -- 172.21.15.7:0/4212765767 learned_addr learned my addr 172.21.15.7:0/4212765767 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:37:13.236 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.233+0000 7fe2b76b3740 1 -- 172.21.15.7:0/4212765767 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a81afac0 con 0x5644f39ef4d0 2024-09-21T06:37:13.236 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.234+0000 7fe2b76b3740 1 -- 172.21.15.7:0/4212765767 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a81ad390 con 0x5644f39e72f0 2024-09-21T06:37:13.236 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.234+0000 7fe2b76b3740 1 -- 172.21.15.7:0/4212765767 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a81ab1c0 con 0x5644f3a101b0 2024-09-21T06:37:13.237 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.234+0000 7fe2aece7640 1 --2- 172.21.15.7:0/4212765767 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5644f3a101b0 0x5644f3db59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:13.237 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.234+0000 7fe2ae4e6640 1 -- 172.21.15.7:0/4212765767 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5644f3a101b0 msgr2=0x5644f3db59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:13.237 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.234+0000 7fe2ae4e6640 1 --2- 172.21.15.7:0/4212765767 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5644f3a101b0 0x5644f3db59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:13.237 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.234+0000 7fe2ae4e6640 1 -- 172.21.15.7:0/4212765767 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644f39ef4d0 msgr2=0x5644f3db5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:13.237 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.234+0000 7fe2ae4e6640 1 --2- 172.21.15.7:0/4212765767 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644f39ef4d0 0x5644f3db5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:13.237 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.234+0000 7fe2ae4e6640 1 -- 172.21.15.7:0/4212765767 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644f3db6230 con 0x5644f39e72f0 2024-09-21T06:37:13.237 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.234+0000 7fe2adce5640 1 --2- 172.21.15.7:0/4212765767 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644f39ef4d0 0x5644f3db5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:37:13.237 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.234+0000 7fe2ae4e6640 1 --2- 172.21.15.7:0/4212765767 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644f39e72f0 0x5644f3dc4ec0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe2a40c99d0 tx=0x7fe2a40b4000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a4e215435a55391 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:13.238 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.234+0000 7fe293fff640 1 -- 172.21.15.7:0/4212765767 <== mon.2 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a41056a0 con 0x5644f39e72f0 2024-09-21T06:37:13.238 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.235+0000 7fe293fff640 1 -- 172.21.15.7:0/4212765767 <== mon.2 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe298011d50 con 0x5644f39e72f0 2024-09-21T06:37:13.238 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.235+0000 7fe293fff640 1 -- 172.21.15.7:0/4212765767 <== mon.2 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a40ca010 con 0x5644f39e72f0 2024-09-21T06:37:13.238 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.236+0000 7fe2b76b3740 1 -- 172.21.15.7:0/4212765767 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644f39e72f0 msgr2=0x5644f3dc4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:13.238 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.236+0000 7fe2b76b3740 1 --2- 172.21.15.7:0/4212765767 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644f39e72f0 0x5644f3dc4ec0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe2a40c99d0 tx=0x7fe2a40b4000 comp rx=0 tx=0).stop 2024-09-21T06:37:13.239 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.236+0000 7fe2b76b3740 1 -- 172.21.15.7:0/4212765767 shutdown_connections 2024-09-21T06:37:13.239 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.236+0000 7fe2b76b3740 1 --2- 172.21.15.7:0/4212765767 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5644f3a101b0 0x5644f3db59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:13.239 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.236+0000 7fe2b76b3740 1 --2- 172.21.15.7:0/4212765767 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644f39ef4d0 0x5644f3db5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:13.239 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.236+0000 7fe2b76b3740 1 --2- 172.21.15.7:0/4212765767 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644f39e72f0 0x5644f3dc4ec0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:13.239 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.236+0000 7fe2b76b3740 1 -- 172.21.15.7:0/4212765767 >> 172.21.15.7:0/4212765767 conn(0x5644f3a04300 msgr2=0x5644f3dc8760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:13.239 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.236+0000 7fe2b76b3740 1 -- 172.21.15.7:0/4212765767 shutdown_connections 2024-09-21T06:37:13.239 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.236+0000 7fe2b76b3740 1 -- 172.21.15.7:0/4212765767 wait complete. 2024-09-21T06:37:13.239 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.236+0000 7fe2b76b3740 1 -- start start 2024-09-21T06:37:13.239 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.236+0000 7fe2b76b3740 1 Processor -- start 2024-09-21T06:37:13.242 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.237+0000 7fe2b76b3740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644f39e72f0 0x5644f3dd6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:13.242 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.237+0000 7fe2b76b3740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644f39ef4d0 0x5644f3dd37c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:13.242 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.237+0000 7fe2ae4e6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644f39e72f0 0x5644f3dd6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:13.242 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.237+0000 7fe2ae4e6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644f39e72f0 0x5644f3dd6300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42290/0 (socket says 172.21.15.7:42290) 2024-09-21T06:37:13.242 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.237+0000 7fe2b76b3740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5644f3a101b0 0x5644f3dd3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:13.242 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.237+0000 7fe2adce5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644f39ef4d0 0x5644f3dd37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:13.242 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.237+0000 7fe2ae4e6640 1 -- 172.21.15.7:0/943658683 learned_addr learned my addr 172.21.15.7:0/943658683 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:37:13.242 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.238+0000 7fe2b76b3740 1 -- 172.21.15.7:0/943658683 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a81ab850 con 0x5644f39e72f0 2024-09-21T06:37:13.242 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.238+0000 7fe2b76b3740 1 -- 172.21.15.7:0/943658683 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a81accc0 con 0x5644f39ef4d0 2024-09-21T06:37:13.242 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.238+0000 7fe2b76b3740 1 -- 172.21.15.7:0/943658683 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a81abf20 con 0x5644f3a101b0 2024-09-21T06:37:13.243 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.238+0000 7fe2aece7640 1 --2- 172.21.15.7:0/943658683 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5644f3a101b0 0x5644f3dd3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:13.243 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.238+0000 7fe2ae4e6640 1 -- 172.21.15.7:0/943658683 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5644f3a101b0 msgr2=0x5644f3dd3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:13.243 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.238+0000 7fe2b76b3740 10 client.0 _ll_register_callbacks cb 0x7fe2a4005ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:37:13.243 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.238+0000 7fe2ae4e6640 1 --2- 172.21.15.7:0/943658683 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5644f3a101b0 0x5644f3dd3dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:13.243 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.238+0000 7fe2ae4e6640 1 -- 172.21.15.7:0/943658683 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644f39ef4d0 msgr2=0x5644f3dd37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:13.243 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.238+0000 7fe2ae4e6640 1 --2- 172.21.15.7:0/943658683 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644f39ef4d0 0x5644f3dd37c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:13.243 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.238+0000 7fe2ae4e6640 1 -- 172.21.15.7:0/943658683 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644f3dd4520 con 0x5644f39e72f0 2024-09-21T06:37:13.243 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.238+0000 7fe2b76b3740 1 -- 172.21.15.7:0/943658683 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe298011d50 con 0x5644f39e72f0 2024-09-21T06:37:13.243 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.238+0000 7fe2ae4e6640 1 --2- 172.21.15.7:0/943658683 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644f39e72f0 0x5644f3dd6300 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fe2a402a9d0 tx=0x7fe2a402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eabb7d34cb47d196 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:13.243 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.238+0000 7fe291ffb640 10 client.15684 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:37:13.243 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.238+0000 7fe2adce5640 1 --2- 172.21.15.7:0/943658683 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644f39ef4d0 0x5644f3dd37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:37:13.244 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.239+0000 7fe291ffb640 1 -- 172.21.15.7:0/943658683 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a40e8060 con 0x5644f39e72f0 2024-09-21T06:37:13.244 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.239+0000 7fe291ffb640 1 -- 172.21.15.7:0/943658683 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fe2a40cce20 con 0x5644f39e72f0 2024-09-21T06:37:13.244 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.239+0000 7fe291ffb640 1 -- 172.21.15.7:0/943658683 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe2a40cd130 con 0x5644f39e72f0 2024-09-21T06:37:13.244 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.239+0000 7fe2b76b3740 10 client.15684 fetch_fsmap learned FSMap version 25 2024-09-21T06:37:13.244 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.239+0000 7fe2b76b3740 1 -- 172.21.15.7:0/943658683 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({fsmap=25}) -- 0x5644f3e460c0 con 0x5644f39e72f0 2024-09-21T06:37:13.244 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.239+0000 7fe291ffb640 1 -- 172.21.15.7:0/943658683 <== mon.0 v2:172.21.15.7:3300/0 4 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fe2a40f3040 con 0x5644f39e72f0 2024-09-21T06:37:13.244 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.240+0000 7fe2b76b3740 10 client.15684 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:37:13.244 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.240+0000 7fe2b76b3740 10 client.15684 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:37:13.244 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.240+0000 7fe2b76b3740 20 client.15684 populate_metadata read hostname 'smithi007' 2024-09-21T06:37:13.244 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.240+0000 7fe2b76b3740 1 --2- 172.21.15.7:0/943658683 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5644f39a41c0 0x5644f3e485e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:13.244 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.240+0000 7fe2b76b3740 4 client.15684 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T06:37:13.244 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.240+0000 7fe2b76b3740 1 -- 172.21.15.7:0/943658683 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5644f3d280f0 con 0x5644f39a41c0 2024-09-21T06:37:13.244 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.240+0000 7fe2adce5640 1 --2- 172.21.15.7:0/943658683 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5644f39a41c0 0x5644f3e485e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:13.245 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.241+0000 7fe291ffb640 10 client.15684 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:37:13.245 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.241+0000 7fe2adce5640 1 --2- 172.21.15.7:0/943658683 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5644f39a41c0 0x5644f3e485e0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c5cbc31a71c5b33 server_cookie=d2553e08eb65f1d7 in_seq=0 out_seq=0 2024-09-21T06:37:13.249 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.247+0000 7fe291ffb640 1 -- 172.21.15.7:0/943658683 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5644f3d280f0 con 0x5644f39a41c0 2024-09-21T06:37:13.249 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.247+0000 7fe291ffb640 10 client.15684 handle_command_reply: tid=0 2024-09-21T06:37:13.249 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.247+0000 7fe2b76b3740 1 client.15684 shutdown 2024-09-21T06:37:13.250 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.248+0000 7fe2b76b3740 1 -- 172.21.15.7:0/943658683 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644f39e72f0 msgr2=0x5644f3dd6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:13.250 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.248+0000 7fe2b76b3740 1 --2- 172.21.15.7:0/943658683 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644f39e72f0 0x5644f3dd6300 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fe2a402a9d0 tx=0x7fe2a402a410 comp rx=0 tx=0).stop 2024-09-21T06:37:13.250 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.248+0000 7fe2b76b3740 1 -- 172.21.15.7:0/943658683 shutdown_connections 2024-09-21T06:37:13.250 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.248+0000 7fe2b76b3740 1 --2- 172.21.15.7:0/943658683 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5644f39a41c0 0x5644f3e485e0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:13.250 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.248+0000 7fe2b76b3740 1 --2- 172.21.15.7:0/943658683 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5644f3a101b0 0x5644f3dd3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:13.250 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.248+0000 7fe2b76b3740 1 --2- 172.21.15.7:0/943658683 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5644f39ef4d0 0x5644f3dd37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:13.250 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.248+0000 7fe291ffb640 0 client.15684 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:37:13.251 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.248+0000 7fe2b76b3740 1 --2- 172.21.15.7:0/943658683 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5644f39e72f0 0x5644f3dd6300 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:13.251 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.248+0000 7fe2b76b3740 1 -- 172.21.15.7:0/943658683 >> 172.21.15.7:0/943658683 conn(0x5644f3a04300 msgr2=0x5644f3db1ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:13.251 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.248+0000 7fe2b76b3740 1 -- 172.21.15.7:0/943658683 shutdown_connections 2024-09-21T06:37:13.251 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.248+0000 7fe2b76b3740 1 -- 172.21.15.7:0/943658683 wait complete. 2024-09-21T06:37:13.251 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.248+0000 7fe2b76b3740 20 client.15684 trim_cache size 0 max 16384 2024-09-21T06:37:13.251 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-09-21T06:37:13.251 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-09-21T06:37:13.251 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-09-21T06:37:13.251 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-09-21T06:37:13.252 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.249+0000 7fe2b074a640 1 -- 172.21.15.7:0/2590615662 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fe2940b6700 msgr2=0x7fe2940b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:13.252 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.249+0000 7fe2b074a640 1 --2- 172.21.15.7:0/2590615662 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fe2940b6700 0x7fe2940b8c10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe2a0005fd0 tx=0x7fe2a0009500 comp rx=0 tx=0).stop 2024-09-21T06:37:13.252 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.249+0000 7fe2b074a640 1 -- 172.21.15.7:0/2590615662 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2a81029c0 msgr2=0x7fe2a819a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:13.252 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.249+0000 7fe2b074a640 1 --2- 172.21.15.7:0/2590615662 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2a81029c0 0x7fe2a819a430 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fe2a4005ab0 tx=0x7fe2a4003c80 comp rx=0 tx=0).stop 2024-09-21T06:37:13.252 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.249+0000 7fe2b074a640 1 -- 172.21.15.7:0/2590615662 shutdown_connections 2024-09-21T06:37:13.253 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.249+0000 7fe2b074a640 1 --2- 172.21.15.7:0/2590615662 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fe2940b6700 0x7fe2940b8c10 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:13.253 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.249+0000 7fe2b074a640 1 --2- 172.21.15.7:0/2590615662 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe2a8108c40 0x7fe2a819fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:13.253 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.249+0000 7fe2b074a640 1 --2- 172.21.15.7:0/2590615662 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2a81082f0 0x7fe2a819a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:13.253 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.249+0000 7fe2b074a640 1 --2- 172.21.15.7:0/2590615662 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe2a81029c0 0x7fe2a819a430 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:13.253 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.249+0000 7fe2b074a640 1 -- 172.21.15.7:0/2590615662 >> 172.21.15.7:0/2590615662 conn(0x7fe2a80fe3c0 msgr2=0x7fe2a8107940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:13.253 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.249+0000 7fe2b074a640 1 -- 172.21.15.7:0/2590615662 shutdown_connections 2024-09-21T06:37:13.253 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:13.249+0000 7fe2b074a640 1 -- 172.21.15.7:0/2590615662 wait complete. 2024-09-21T06:37:13.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:37:12 smithi144 ceph-mon[34653]: pgmap v349: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-09-21T06:37:13.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:37:12 smithi007 ceph-mon[30983]: pgmap v349: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-09-21T06:37:13.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:37:12 smithi018 ceph-mon[34477]: pgmap v349: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-09-21T06:37:15.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:37:14 smithi144 ceph-mon[34653]: pgmap v350: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 25 op/s 2024-09-21T06:37:15.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:37:14 smithi007 ceph-mon[30983]: pgmap v350: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 25 op/s 2024-09-21T06:37:15.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:37:14 smithi018 ceph-mon[34477]: pgmap v350: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 25 op/s 2024-09-21T06:37:17.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:37:16 smithi144 ceph-mon[34653]: pgmap v351: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-21T06:37:17.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:37:16 smithi007 ceph-mon[30983]: pgmap v351: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-21T06:37:17.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:37:16 smithi018 ceph-mon[34477]: pgmap v351: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-21T06:37:19.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:37:18 smithi144 ceph-mon[34653]: pgmap v352: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-21T06:37:19.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:37:18 smithi007 ceph-mon[30983]: pgmap v352: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-21T06:37:19.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:37:18 smithi018 ceph-mon[34477]: pgmap v352: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-21T06:37:21.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:37:20 smithi144 ceph-mon[34653]: pgmap v353: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-21T06:37:21.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:37:20 smithi007 ceph-mon[30983]: pgmap v353: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-21T06:37:21.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:37:20 smithi018 ceph-mon[34477]: pgmap v353: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 597 B/s wr, 8 op/s 2024-09-21T06:37:22.878 INFO:tasks.workunit.client.0.smithi007.stderr:Updating files: 91% (11681/12697) Updating files: 92% (11682/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-21T06:37:23.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:37:22 smithi144 ceph-mon[34653]: pgmap v354: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-21T06:37:23.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:37:22 smithi007 ceph-mon[30983]: pgmap v354: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-21T06:37:23.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:37:22 smithi018 ceph-mon[34477]: pgmap v354: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-21T06:37:23.786 INFO:tasks.workunit.client.0.smithi007.stderr:Note: switching to '1843221895adccfb3b692060251dd6a0183bc410'. 2024-09-21T06:37:23.787 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-21T06:37:23.787 INFO:tasks.workunit.client.0.smithi007.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-21T06:37:23.787 INFO:tasks.workunit.client.0.smithi007.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-21T06:37:23.787 INFO:tasks.workunit.client.0.smithi007.stderr:state without impacting any branches by switching back to a branch. 2024-09-21T06:37:23.787 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-21T06:37:23.787 INFO:tasks.workunit.client.0.smithi007.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-21T06:37:23.787 INFO:tasks.workunit.client.0.smithi007.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-21T06:37:23.787 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-21T06:37:23.787 INFO:tasks.workunit.client.0.smithi007.stderr: git switch -c 2024-09-21T06:37:23.787 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-21T06:37:23.787 INFO:tasks.workunit.client.0.smithi007.stderr:Or undo this operation with: 2024-09-21T06:37:23.787 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-21T06:37:23.787 INFO:tasks.workunit.client.0.smithi007.stderr: git switch - 2024-09-21T06:37:23.787 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-21T06:37:23.788 INFO:tasks.workunit.client.0.smithi007.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-21T06:37:23.788 INFO:tasks.workunit.client.0.smithi007.stderr: 2024-09-21T06:37:23.788 INFO:tasks.workunit.client.0.smithi007.stderr:HEAD is now at 1843221895a Merge PR #56776 into wip-pdonnell-testing-20240920.212106-debug 2024-09-21T06:37:23.792 DEBUG:teuthology.orchestra.run.smithi007:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-21T06:37:23.815 INFO:tasks.workunit.client.0.smithi007.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-21T06:37:23.818 INFO:tasks.workunit.client.0.smithi007.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-21T06:37:23.818 INFO:tasks.workunit.client.0.smithi007.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-21T06:37:24.595 INFO:tasks.workunit.client.0.smithi007.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-21T06:37:24.672 INFO:tasks.workunit.client.0.smithi007.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-21T06:37:24.715 INFO:tasks.workunit.client.0.smithi007.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-21T06:37:24.717 INFO:tasks.workunit.client.0.smithi007.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-21T06:37:24.717 INFO:tasks.workunit.client.0.smithi007.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-21T06:37:24.758 INFO:tasks.workunit.client.0.smithi007.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-21T06:37:24.762 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-21T06:37:24.762 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-21T06:37:24.820 INFO:tasks.workunit:Running workunits matching suites/iozone.sh on client.0... 2024-09-21T06:37:24.821 INFO:tasks.workunit:Running workunit suites/iozone.sh... 2024-09-21T06:37:24.821 DEBUG:teuthology.orchestra.run.smithi007:workunit test suites/iozone.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1843221895adccfb3b692060251dd6a0183bc410 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/iozone.sh 2024-09-21T06:37:24.882 INFO:tasks.workunit.client.0.smithi007.stderr:+ iozone -c -e -s 1024M -r 16K -t 1 -F f1 -i 0 -i 1 2024-09-21T06:37:24.971 INFO:tasks.workunit.client.0.smithi007.stdout: Iozone: Performance Test of File I/O 2024-09-21T06:37:24.971 INFO:tasks.workunit.client.0.smithi007.stdout: Version $Revision: 3.494 $ 2024-09-21T06:37:24.971 INFO:tasks.workunit.client.0.smithi007.stdout: Compiled for 64 bit mode. 2024-09-21T06:37:24.971 INFO:tasks.workunit.client.0.smithi007.stdout: Build: linux-AMD64 2024-09-21T06:37:24.971 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-09-21T06:37:24.971 INFO:tasks.workunit.client.0.smithi007.stdout: Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins 2024-09-21T06:37:24.971 INFO:tasks.workunit.client.0.smithi007.stdout: Al Slater, Scott Rhine, Mike Wisner, Ken Goss 2024-09-21T06:37:24.971 INFO:tasks.workunit.client.0.smithi007.stdout: Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, 2024-09-21T06:37:24.971 INFO:tasks.workunit.client.0.smithi007.stdout: Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, 2024-09-21T06:37:24.972 INFO:tasks.workunit.client.0.smithi007.stdout: Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, 2024-09-21T06:37:24.972 INFO:tasks.workunit.client.0.smithi007.stdout: Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, 2024-09-21T06:37:24.972 INFO:tasks.workunit.client.0.smithi007.stdout: Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, 2024-09-21T06:37:24.972 INFO:tasks.workunit.client.0.smithi007.stdout: Vangel Bojaxhi, Ben England, Vikentsi Lapa, 2024-09-21T06:37:24.972 INFO:tasks.workunit.client.0.smithi007.stdout: Alexey Skidanov, Sudhir Kumar. 2024-09-21T06:37:24.972 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-09-21T06:37:24.972 INFO:tasks.workunit.client.0.smithi007.stdout: Run began: Sat Sep 21 06:37:24 2024 2024-09-21T06:37:24.972 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-09-21T06:37:24.972 INFO:tasks.workunit.client.0.smithi007.stdout: Include close in write timing 2024-09-21T06:37:24.972 INFO:tasks.workunit.client.0.smithi007.stdout: Include fsync in write timing 2024-09-21T06:37:24.972 INFO:tasks.workunit.client.0.smithi007.stdout: File size set to 1048576 kB 2024-09-21T06:37:24.972 INFO:tasks.workunit.client.0.smithi007.stdout: Record Size 16 kB 2024-09-21T06:37:24.972 INFO:tasks.workunit.client.0.smithi007.stdout: Command line used: iozone -c -e -s 1024M -r 16K -t 1 -F f1 -i 0 -i 1 2024-09-21T06:37:24.972 INFO:tasks.workunit.client.0.smithi007.stdout: Output is in kBytes/sec 2024-09-21T06:37:24.972 INFO:tasks.workunit.client.0.smithi007.stdout: Time Resolution = 0.000001 seconds. 2024-09-21T06:37:24.972 INFO:tasks.workunit.client.0.smithi007.stdout: Processor cache size set to 1024 kBytes. 2024-09-21T06:37:24.973 INFO:tasks.workunit.client.0.smithi007.stdout: Processor cache line size set to 32 bytes. 2024-09-21T06:37:24.973 INFO:tasks.workunit.client.0.smithi007.stdout: File stride size set to 17 * record size. 2024-09-21T06:37:24.973 INFO:tasks.workunit.client.0.smithi007.stdout: Throughput test with 1 process 2024-09-21T06:37:24.973 INFO:tasks.workunit.client.0.smithi007.stdout: Each process writes a 1048576 kByte file in 16 kByte records 2024-09-21T06:37:25.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:37:24 smithi144 ceph-mon[34653]: pgmap v355: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 511 B/s wr, 7 op/s 2024-09-21T06:37:25.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:37:24 smithi007 ceph-mon[30983]: pgmap v355: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 511 B/s wr, 7 op/s 2024-09-21T06:37:25.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:37:24 smithi018 ceph-mon[34477]: pgmap v355: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 511 B/s wr, 7 op/s 2024-09-21T06:37:26.270 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:37:25 smithi018 ceph-mon[34477]: pgmap v356: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T06:37:26.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:37:25 smithi144 ceph-mon[34653]: pgmap v356: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T06:37:26.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:37:25 smithi007 ceph-mon[30983]: pgmap v356: 97 pgs: 97 active+clean; 1.4 MiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 426 B/s wr, 6 op/s 2024-09-21T06:37:26.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.390+0000 7f6102a94640 1 -- 172.21.15.7:0/1785120107 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60fc108c40 msgr2=0x7f60fc10f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:26.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.390+0000 7f6102a94640 1 --2- 172.21.15.7:0/1785120107 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60fc108c40 0x7f60fc10f470 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f60f4009ca0 tx=0x7f60f402a8e0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.392 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.390+0000 7f6102a94640 1 -- 172.21.15.7:0/1785120107 shutdown_connections 2024-09-21T06:37:26.393 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.390+0000 7f6102a94640 1 --2- 172.21.15.7:0/1785120107 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60fc108c40 0x7f60fc10f470 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.393 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.390+0000 7f6102a94640 1 --2- 172.21.15.7:0/1785120107 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f60fc1082f0 0x7f60fc108700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.393 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.390+0000 7f6102a94640 1 --2- 172.21.15.7:0/1785120107 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60fc1029c0 0x7f60fc102dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.393 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.390+0000 7f6102a94640 1 -- 172.21.15.7:0/1785120107 >> 172.21.15.7:0/1785120107 conn(0x7f60fc0fe3c0 msgr2=0x7f60fc100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:26.393 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.390+0000 7f6102a94640 1 -- 172.21.15.7:0/1785120107 shutdown_connections 2024-09-21T06:37:26.393 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.391+0000 7f6102a94640 1 -- 172.21.15.7:0/1785120107 wait complete. 2024-09-21T06:37:26.394 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.391+0000 7f6102a94640 1 Processor -- start 2024-09-21T06:37:26.394 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.392+0000 7f6102a94640 1 -- start start 2024-09-21T06:37:26.394 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.392+0000 7f6102a94640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60fc1029c0 0x7f60fc19a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:26.394 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.392+0000 7f6102a94640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f60fc1082f0 0x7f60fc19aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:26.394 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.392+0000 7f6102a94640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60fc108c40 0x7f60fc19fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:26.394 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.392+0000 7f6102a94640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f60fc1129c0 con 0x7f60fc108c40 2024-09-21T06:37:26.394 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.392+0000 7f6102a94640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f60fc112840 con 0x7f60fc1082f0 2024-09-21T06:37:26.394 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.392+0000 7f6102a94640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f60fc112b40 con 0x7f60fc1029c0 2024-09-21T06:37:26.394 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.392+0000 7f6101031640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60fc108c40 0x7f60fc19fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:26.395 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.392+0000 7f6101031640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60fc108c40 0x7f60fc19fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52766/0 (socket says 172.21.15.7:52766) 2024-09-21T06:37:26.395 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.392+0000 7f6101031640 1 -- 172.21.15.7:0/2304110928 learned_addr learned my addr 172.21.15.7:0/2304110928 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:37:26.395 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.393+0000 7f6101031640 1 -- 172.21.15.7:0/2304110928 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60fc1029c0 msgr2=0x7f60fc19a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:26.395 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.393+0000 7f6101031640 1 --2- 172.21.15.7:0/2304110928 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60fc1029c0 0x7f60fc19a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.393+0000 7f6101031640 1 -- 172.21.15.7:0/2304110928 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f60fc1082f0 msgr2=0x7f60fc19aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:26.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.393+0000 7f6101031640 1 --2- 172.21.15.7:0/2304110928 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f60fc1082f0 0x7f60fc19aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.393+0000 7f6101031640 1 -- 172.21.15.7:0/2304110928 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60fc1a0440 con 0x7f60fc108c40 2024-09-21T06:37:26.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.393+0000 7f6101031640 1 --2- 172.21.15.7:0/2304110928 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60fc108c40 0x7f60fc19fd40 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f60f4005cc0 tx=0x7f60f4003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:26.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.393+0000 7f60f9ffb640 1 -- 172.21.15.7:0/2304110928 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60f4004040 con 0x7f60fc108c40 2024-09-21T06:37:26.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.394+0000 7f6102a94640 1 -- 172.21.15.7:0/2304110928 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60fc1a06d0 con 0x7f60fc108c40 2024-09-21T06:37:26.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.394+0000 7f60f9ffb640 1 -- 172.21.15.7:0/2304110928 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f60f4004690 con 0x7f60fc108c40 2024-09-21T06:37:26.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.394+0000 7f6102a94640 1 -- 172.21.15.7:0/2304110928 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60fc0fe7d0 con 0x7f60fc108c40 2024-09-21T06:37:26.396 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.394+0000 7f60f9ffb640 1 -- 172.21.15.7:0/2304110928 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60f4030e40 con 0x7f60fc108c40 2024-09-21T06:37:26.400 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.398+0000 7f6109a07740 1 Processor -- start 2024-09-21T06:37:26.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.398+0000 7f60f9ffb640 1 -- 172.21.15.7:0/2304110928 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f60f404d440 con 0x7f60fc108c40 2024-09-21T06:37:26.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.398+0000 7f6109a07740 1 -- start start 2024-09-21T06:37:26.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.399+0000 7f6109a07740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe4b8401b0 0x55fe4bbe59b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:26.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.399+0000 7f6109a07740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe4b8172f0 0x55fe4bbe5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:26.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.399+0000 7f6109a07740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fe4b81f4d0 0x55fe4bbe6430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:26.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.399+0000 7f6109a07740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55fe4bb5a6f0 con 0x55fe4b8401b0 2024-09-21T06:37:26.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.399+0000 7f6109a07740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55fe4bb49b20 con 0x55fe4b81f4d0 2024-09-21T06:37:26.401 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.399+0000 7f6109a07740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55fe4bb4d930 con 0x55fe4b8172f0 2024-09-21T06:37:26.402 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.399+0000 7f60fbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe4b8401b0 0x55fe4bbe59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:26.402 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.399+0000 7f60fbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe4b8401b0 0x55fe4bbe59b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52776/0 (socket says 172.21.15.7:52776) 2024-09-21T06:37:26.402 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.399+0000 7f60fbfff640 1 -- 172.21.15.7:0/2887870150 learned_addr learned my addr 172.21.15.7:0/2887870150 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:37:26.402 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.400+0000 7f60fbfff640 1 -- 172.21.15.7:0/2887870150 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe4b8172f0 msgr2=0x55fe4bbe5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:26.402 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.400+0000 7f60fbfff640 1 --2- 172.21.15.7:0/2887870150 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe4b8172f0 0x55fe4bbe5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.402 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.400+0000 7f60fbfff640 1 -- 172.21.15.7:0/2887870150 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fe4b81f4d0 msgr2=0x55fe4bbe6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:26.402 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.400+0000 7f60fbfff640 1 --2- 172.21.15.7:0/2887870150 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fe4b81f4d0 0x55fe4bbe6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.402 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.400+0000 7f60fbfff640 1 -- 172.21.15.7:0/2887870150 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe4bb0f530 con 0x55fe4b8401b0 2024-09-21T06:37:26.403 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.400+0000 7f60f9ffb640 1 --2- 172.21.15.7:0/2304110928 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f60ec0b6680 0x7f60ec0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:26.403 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.400+0000 7f60fbfff640 1 --2- 172.21.15.7:0/2887870150 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe4b8401b0 0x55fe4bbe59b0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f60e8009890 tx=0x7f60e8009d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19b92c95b1580166 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:26.403 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.400+0000 7f60f9ffb640 1 -- 172.21.15.7:0/2304110928 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f60f4108c20 con 0x7f60fc108c40 2024-09-21T06:37:26.403 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.401+0000 7f6100830640 1 --2- 172.21.15.7:0/2304110928 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f60ec0b6680 0x7f60ec0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:26.403 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.401+0000 7f60e6ffd640 1 -- 172.21.15.7:0/2887870150 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60e800f070 con 0x55fe4b8401b0 2024-09-21T06:37:26.403 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.401+0000 7f60e6ffd640 1 -- 172.21.15.7:0/2887870150 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f60e8017070 con 0x55fe4b8401b0 2024-09-21T06:37:26.404 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.401+0000 7f60e6ffd640 1 -- 172.21.15.7:0/2887870150 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60e8012e20 con 0x55fe4b8401b0 2024-09-21T06:37:26.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.403+0000 7f6109a07740 1 -- 172.21.15.7:0/2887870150 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe4b8401b0 msgr2=0x55fe4bbe59b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:26.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.403+0000 7f6109a07740 1 --2- 172.21.15.7:0/2887870150 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe4b8401b0 0x55fe4bbe59b0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f60e8009890 tx=0x7f60e8009d50 comp rx=0 tx=0).stop 2024-09-21T06:37:26.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.403+0000 7f6100830640 1 --2- 172.21.15.7:0/2304110928 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f60ec0b6680 0x7f60ec0b8b90 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f60f0009710 tx=0x7f60f0006d00 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:26.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.403+0000 7f6109a07740 1 -- 172.21.15.7:0/2887870150 shutdown_connections 2024-09-21T06:37:26.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.403+0000 7f6109a07740 1 --2- 172.21.15.7:0/2887870150 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fe4b81f4d0 0x55fe4bbe6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.405 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.403+0000 7f6109a07740 1 --2- 172.21.15.7:0/2887870150 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe4b8172f0 0x55fe4bbe5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.403+0000 7f6109a07740 1 --2- 172.21.15.7:0/2887870150 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe4b8401b0 0x55fe4bbe59b0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.403+0000 7f6109a07740 1 -- 172.21.15.7:0/2887870150 >> 172.21.15.7:0/2887870150 conn(0x55fe4b834300 msgr2=0x55fe4bbe38a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:26.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.403+0000 7f6109a07740 1 -- 172.21.15.7:0/2887870150 shutdown_connections 2024-09-21T06:37:26.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.403+0000 7f6109a07740 1 -- 172.21.15.7:0/2887870150 wait complete. 2024-09-21T06:37:26.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.403+0000 7f6109a07740 1 -- start start 2024-09-21T06:37:26.406 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.404+0000 7f6109a07740 1 Processor -- start 2024-09-21T06:37:26.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.404+0000 7f6109a07740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe4b8172f0 0x55fe4bbf9930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:26.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.404+0000 7f6109a07740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fe4b81f4d0 0x55fe4bbf9e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:26.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.404+0000 7f6109a07740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe4b7fed80 0x55fe4bc05c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:26.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.404+0000 7f6109a07740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55fe4ba81ab0 con 0x55fe4b8172f0 2024-09-21T06:37:26.407 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.404+0000 7f6109a07740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55fe4baef730 con 0x55fe4b81f4d0 2024-09-21T06:37:26.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.404+0000 7f6109a07740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55fe4bbfc8f0 con 0x55fe4b7fed80 2024-09-21T06:37:26.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.404+0000 7f6109a07740 10 client.0 _ll_register_callbacks cb 0x55fe4bb436b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:37:26.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.404+0000 7f6100830640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe4b8172f0 0x55fe4bbf9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:26.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.405+0000 7f6100830640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe4b8172f0 0x55fe4bbf9930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52788/0 (socket says 172.21.15.7:52788) 2024-09-21T06:37:26.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.405+0000 7f6100830640 1 -- 172.21.15.7:0/1844541738 learned_addr learned my addr 172.21.15.7:0/1844541738 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:37:26.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.405+0000 7f60fbfff640 1 --2- 172.21.15.7:0/1844541738 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fe4b81f4d0 0x55fe4bbf9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:26.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.405+0000 7f6100830640 1 -- 172.21.15.7:0/1844541738 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe4b7fed80 msgr2=0x55fe4bc05c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:26.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.405+0000 7f6100830640 1 --2- 172.21.15.7:0/1844541738 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe4b7fed80 0x55fe4bc05c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.405+0000 7f6100830640 1 -- 172.21.15.7:0/1844541738 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fe4b81f4d0 msgr2=0x55fe4bbf9e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:26.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.405+0000 7f6100830640 1 --2- 172.21.15.7:0/1844541738 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fe4b81f4d0 0x55fe4bbf9e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.405+0000 7f6100830640 1 -- 172.21.15.7:0/1844541738 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe4b8ab790 con 0x55fe4b8172f0 2024-09-21T06:37:26.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.406+0000 7f6100830640 1 --2- 172.21.15.7:0/1844541738 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe4b8172f0 0x55fe4bbf9930 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f60f0015f50 tx=0x7f60f0004840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee81a45148a803 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:26.408 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.406+0000 7f60dbfff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:37:26.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.406+0000 7f60dbfff640 1 -- 172.21.15.7:0/1844541738 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60f0023060 con 0x55fe4b8172f0 2024-09-21T06:37:26.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.406+0000 7f60dbfff640 1 -- 172.21.15.7:0/1844541738 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f60f00150d0 con 0x55fe4b8172f0 2024-09-21T06:37:26.409 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.406+0000 7f6109a07740 1 -- 172.21.15.7:0/1844541738 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f60e8017070 con 0x55fe4b8172f0 2024-09-21T06:37:26.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.406+0000 7f60dbfff640 1 -- 172.21.15.7:0/1844541738 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f60f0013420 con 0x55fe4b8172f0 2024-09-21T06:37:26.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.406+0000 7f6109a07740 10 client.15696 fetch_fsmap learned FSMap version 25 2024-09-21T06:37:26.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.406+0000 7f6109a07740 1 -- 172.21.15.7:0/1844541738 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55fe4b924620 con 0x55fe4b8172f0 2024-09-21T06:37:26.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.407+0000 7f60dbfff640 1 -- 172.21.15.7:0/1844541738 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f60e8017070 con 0x55fe4b8172f0 2024-09-21T06:37:26.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.407+0000 7f60dbfff640 1 -- 172.21.15.7:0/1844541738 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f60f001e650 con 0x55fe4b8172f0 2024-09-21T06:37:26.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.407+0000 7f6109a07740 10 client.15696 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:37:26.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.407+0000 7f6109a07740 10 client.15696 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:37:26.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.407+0000 7f6109a07740 20 client.15696 populate_metadata read hostname 'smithi007' 2024-09-21T06:37:26.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.407+0000 7f6109a07740 1 --2- 172.21.15.7:0/1844541738 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55fe4b7d41c0 0x55fe4bc0bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:26.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.407+0000 7f6109a07740 4 client.15696 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:37:26.410 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.407+0000 7f6109a07740 1 -- 172.21.15.7:0/1844541738 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fe4bb5c640 con 0x55fe4b7d41c0 2024-09-21T06:37:26.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.408+0000 7f60fbfff640 1 --2- 172.21.15.7:0/1844541738 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55fe4b7d41c0 0x55fe4bc0bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:26.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.409+0000 7f60fbfff640 1 --2- 172.21.15.7:0/1844541738 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55fe4b7d41c0 0x55fe4bc0bae0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9af13478b7958074 server_cookie=cae2c2492efae4b3 in_seq=0 out_seq=0 2024-09-21T06:37:26.411 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.409+0000 7f60dbfff640 10 client.15696 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:37:26.412 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.411+0000 7f60dbfff640 1 -- 172.21.15.7:0/1844541738 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fe4bb5c640 con 0x55fe4b7d41c0 2024-09-21T06:37:26.412 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.411+0000 7f60dbfff640 10 client.15696 handle_command_reply: tid=0 2024-09-21T06:37:26.413 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.411+0000 7f6109a07740 1 client.15696 shutdown 2024-09-21T06:37:26.413 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.411+0000 7f6109a07740 1 -- 172.21.15.7:0/1844541738 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe4b8172f0 msgr2=0x55fe4bbf9930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:26.413 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.411+0000 7f6109a07740 1 --2- 172.21.15.7:0/1844541738 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe4b8172f0 0x55fe4bbf9930 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f60f0015f50 tx=0x7f60f0004840 comp rx=0 tx=0).stop 2024-09-21T06:37:26.414 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.411+0000 7f6109a07740 1 -- 172.21.15.7:0/1844541738 shutdown_connections 2024-09-21T06:37:26.414 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.411+0000 7f6109a07740 1 --2- 172.21.15.7:0/1844541738 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55fe4b7d41c0 0x55fe4bc0bae0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.414 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.411+0000 7f6109a07740 1 --2- 172.21.15.7:0/1844541738 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe4b7fed80 0x55fe4bc05c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.414 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.411+0000 7f6109a07740 1 --2- 172.21.15.7:0/1844541738 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fe4b81f4d0 0x55fe4bbf9e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.414 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.411+0000 7f6109a07740 1 --2- 172.21.15.7:0/1844541738 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe4b8172f0 0x55fe4bbf9930 secure :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f60f0015f50 tx=0x7f60f0004840 comp rx=0 tx=0).stop 2024-09-21T06:37:26.414 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.411+0000 7f60dbfff640 0 client.15696 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:37:26.414 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.411+0000 7f6109a07740 1 -- 172.21.15.7:0/1844541738 >> 172.21.15.7:0/1844541738 conn(0x55fe4b834300 msgr2=0x55fe4bbe8bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:26.414 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.412+0000 7f6109a07740 1 -- 172.21.15.7:0/1844541738 shutdown_connections 2024-09-21T06:37:26.414 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.412+0000 7f6109a07740 1 -- 172.21.15.7:0/1844541738 wait complete. 2024-09-21T06:37:26.414 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.412+0000 7f6109a07740 20 client.15696 trim_cache size 0 max 16384 2024-09-21T06:37:26.445 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.443+0000 7f6109a07740 1 Processor -- start 2024-09-21T06:37:26.446 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.443+0000 7f6109a07740 1 -- start start 2024-09-21T06:37:26.446 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.444+0000 7f6109a07740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe4b7d41c0 0x55fe4bbe70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:26.446 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.444+0000 7f6109a07740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe4b7fed80 0x55fe4bc05b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:26.446 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.444+0000 7f6109a07740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fe4b81f4d0 0x55fe4bbeaca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:26.446 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.444+0000 7f6109a07740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f60fc1afce0 con 0x55fe4b7fed80 2024-09-21T06:37:26.447 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.444+0000 7f6109a07740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f60fc1ad5b0 con 0x55fe4b81f4d0 2024-09-21T06:37:26.447 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.444+0000 7f6109a07740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f60fc1ab400 con 0x55fe4b7d41c0 2024-09-21T06:37:26.447 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.444+0000 7f60fbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe4b7fed80 0x55fe4bc05b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:26.447 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.444+0000 7f60fbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe4b7fed80 0x55fe4bc05b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52796/0 (socket says 172.21.15.7:52796) 2024-09-21T06:37:26.447 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.444+0000 7f60fbfff640 1 -- 172.21.15.7:0/3720442242 learned_addr learned my addr 172.21.15.7:0/3720442242 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:37:26.447 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.445+0000 7f6100830640 1 --2- 172.21.15.7:0/3720442242 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe4b7d41c0 0x55fe4bbe70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:26.448 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.445+0000 7f60fbfff640 1 -- 172.21.15.7:0/3720442242 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe4b7d41c0 msgr2=0x55fe4bbe70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:26.448 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.445+0000 7f60fbfff640 1 --2- 172.21.15.7:0/3720442242 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe4b7d41c0 0x55fe4bbe70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.448 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.445+0000 7f60fbfff640 1 -- 172.21.15.7:0/3720442242 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fe4b81f4d0 msgr2=0x55fe4bbeaca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:26.448 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.445+0000 7f60fbfff640 1 --2- 172.21.15.7:0/3720442242 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fe4b81f4d0 0x55fe4bbeaca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.448 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.445+0000 7f60fbfff640 1 -- 172.21.15.7:0/3720442242 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe4bbe8770 con 0x55fe4b7fed80 2024-09-21T06:37:26.448 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.445+0000 7f60fbfff640 1 --2- 172.21.15.7:0/3720442242 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe4b7fed80 0x55fe4bc05b50 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f60e8009860 tx=0x7f60e8009280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af738479d4317a6d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:26.448 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.446+0000 7f60e67fc640 1 -- 172.21.15.7:0/3720442242 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60e800f040 con 0x55fe4b7fed80 2024-09-21T06:37:26.448 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.446+0000 7f60e67fc640 1 -- 172.21.15.7:0/3720442242 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f60e8017050 con 0x55fe4b7fed80 2024-09-21T06:37:26.448 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.446+0000 7f60e67fc640 1 -- 172.21.15.7:0/3720442242 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60e800daf0 con 0x55fe4b7fed80 2024-09-21T06:37:26.449 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.447+0000 7f6109a07740 1 -- 172.21.15.7:0/3720442242 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe4b7fed80 msgr2=0x55fe4bc05b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:26.449 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.447+0000 7f6109a07740 1 --2- 172.21.15.7:0/3720442242 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe4b7fed80 0x55fe4bc05b50 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f60e8009860 tx=0x7f60e8009280 comp rx=0 tx=0).stop 2024-09-21T06:37:26.449 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.447+0000 7f6109a07740 1 -- 172.21.15.7:0/3720442242 shutdown_connections 2024-09-21T06:37:26.449 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.447+0000 7f6109a07740 1 --2- 172.21.15.7:0/3720442242 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fe4b81f4d0 0x55fe4bbeaca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.449 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.447+0000 7f6109a07740 1 --2- 172.21.15.7:0/3720442242 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe4b7fed80 0x55fe4bc05b50 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.449 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.447+0000 7f6109a07740 1 --2- 172.21.15.7:0/3720442242 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe4b7d41c0 0x55fe4bbe70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.449 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.447+0000 7f6109a07740 1 -- 172.21.15.7:0/3720442242 >> 172.21.15.7:0/3720442242 conn(0x55fe4b834300 msgr2=0x55fe4bbe69e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:26.450 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.447+0000 7f6109a07740 1 -- 172.21.15.7:0/3720442242 shutdown_connections 2024-09-21T06:37:26.450 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.448+0000 7f6109a07740 1 -- 172.21.15.7:0/3720442242 wait complete. 2024-09-21T06:37:26.450 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.448+0000 7f6109a07740 1 -- start start 2024-09-21T06:37:26.450 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.449+0000 7f6109a07740 1 Processor -- start 2024-09-21T06:37:26.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.449+0000 7f6109a07740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe4b7d41c0 0x55fe4bc02320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:26.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.450+0000 7f6109a07740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fe4b7fed80 0x55fe4bc10e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:26.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.450+0000 7f6100830640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe4b7d41c0 0x55fe4bc02320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:26.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.450+0000 7f6100830640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe4b7d41c0 0x55fe4bc02320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52806/0 (socket says 172.21.15.7:52806) 2024-09-21T06:37:26.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.450+0000 7f6109a07740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe4b81f4d0 0x55fe4bc11380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:26.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.450+0000 7f6109a07740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f60fc1aba70 con 0x55fe4b7d41c0 2024-09-21T06:37:26.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.450+0000 7f6109a07740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f60fc1acee0 con 0x55fe4b7fed80 2024-09-21T06:37:26.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.450+0000 7f6109a07740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f60fc1ac140 con 0x55fe4b81f4d0 2024-09-21T06:37:26.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.450+0000 7f6109a07740 10 client.0 _ll_register_callbacks cb 0x7f60f0009050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:37:26.452 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.450+0000 7f6100830640 1 -- 172.21.15.7:0/776181176 learned_addr learned my addr 172.21.15.7:0/776181176 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:37:26.453 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.451+0000 7f6100830640 1 -- 172.21.15.7:0/776181176 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe4b81f4d0 msgr2=0x55fe4bc11380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:26.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.451+0000 7f6100830640 1 --2- 172.21.15.7:0/776181176 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe4b81f4d0 0x55fe4bc11380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.451+0000 7f6100830640 1 -- 172.21.15.7:0/776181176 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fe4b7fed80 msgr2=0x55fe4bc10e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:26.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.451+0000 7f6100830640 1 --2- 172.21.15.7:0/776181176 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fe4b7fed80 0x55fe4bc10e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.451+0000 7f6100830640 1 -- 172.21.15.7:0/776181176 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe4bc11a70 con 0x55fe4b7d41c0 2024-09-21T06:37:26.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.451+0000 7f6100830640 1 --2- 172.21.15.7:0/776181176 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe4b7d41c0 0x55fe4bc02320 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f60f0015040 tx=0x7f60f001e790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87847e9af918405b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:26.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.451+0000 7f60dbfff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:37:26.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.451+0000 7f60dbfff640 1 -- 172.21.15.7:0/776181176 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60f0036060 con 0x55fe4b7d41c0 2024-09-21T06:37:26.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.451+0000 7f60dbfff640 1 -- 172.21.15.7:0/776181176 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f60f00137d0 con 0x55fe4b7d41c0 2024-09-21T06:37:26.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.451+0000 7f6109a07740 1 -- 172.21.15.7:0/776181176 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f60e8017050 con 0x55fe4b7d41c0 2024-09-21T06:37:26.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.452+0000 7f60dbfff640 1 -- 172.21.15.7:0/776181176 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f60f00139d0 con 0x55fe4b7d41c0 2024-09-21T06:37:26.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.452+0000 7f6109a07740 10 client.15702 fetch_fsmap learned FSMap version 25 2024-09-21T06:37:26.454 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.452+0000 7f6109a07740 1 -- 172.21.15.7:0/776181176 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55fe4bc764e0 con 0x55fe4b7d41c0 2024-09-21T06:37:26.455 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.452+0000 7f60dbfff640 1 -- 172.21.15.7:0/776181176 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f60e8017050 con 0x55fe4b7d41c0 2024-09-21T06:37:26.455 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.452+0000 7f60dbfff640 1 -- 172.21.15.7:0/776181176 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f60f0031c00 con 0x55fe4b7d41c0 2024-09-21T06:37:26.455 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.452+0000 7f6109a07740 10 client.15702 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:37:26.455 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.452+0000 7f6109a07740 10 client.15702 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:37:26.455 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.452+0000 7f6109a07740 20 client.15702 populate_metadata read hostname 'smithi007' 2024-09-21T06:37:26.456 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.452+0000 7f6109a07740 1 --2- 172.21.15.7:0/776181176 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55fe4bc76ab0 0x55fe4bc78f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:26.456 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.452+0000 7f6109a07740 4 client.15702 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T06:37:26.456 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.452+0000 7f6109a07740 1 -- 172.21.15.7:0/776181176 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55fe4bb580f0 con 0x55fe4bc76ab0 2024-09-21T06:37:26.456 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.453+0000 7f60fbfff640 1 --2- 172.21.15.7:0/776181176 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55fe4bc76ab0 0x55fe4bc78f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:26.457 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.455+0000 7f60dbfff640 10 client.15702 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:37:26.457 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.455+0000 7f60fbfff640 1 --2- 172.21.15.7:0/776181176 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55fe4bc76ab0 0x55fe4bc78f80 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50945e3f371ed476 server_cookie=13d2500359bd417f in_seq=0 out_seq=0 2024-09-21T06:37:26.485 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.483+0000 7f60dbfff640 1 -- 172.21.15.7:0/776181176 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55fe4bb580f0 con 0x55fe4bc76ab0 2024-09-21T06:37:26.485 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.483+0000 7f60dbfff640 10 client.15702 handle_command_reply: tid=0 2024-09-21T06:37:26.485 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.483+0000 7f6109a07740 1 client.15702 shutdown 2024-09-21T06:37:26.485 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.483+0000 7f6109a07740 1 -- 172.21.15.7:0/776181176 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe4b7d41c0 msgr2=0x55fe4bc02320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:26.486 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.483+0000 7f6109a07740 1 --2- 172.21.15.7:0/776181176 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe4b7d41c0 0x55fe4bc02320 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f60f0015040 tx=0x7f60f001e790 comp rx=0 tx=0).stop 2024-09-21T06:37:26.486 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.483+0000 7f6109a07740 1 -- 172.21.15.7:0/776181176 shutdown_connections 2024-09-21T06:37:26.486 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.483+0000 7f6109a07740 1 --2- 172.21.15.7:0/776181176 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55fe4bc76ab0 0x55fe4bc78f80 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.486 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.483+0000 7f6109a07740 1 --2- 172.21.15.7:0/776181176 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fe4b81f4d0 0x55fe4bc11380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.486 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.483+0000 7f6109a07740 1 --2- 172.21.15.7:0/776181176 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fe4b7fed80 0x55fe4bc10e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.486 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.483+0000 7f60dbfff640 0 client.15702 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:37:26.486 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.483+0000 7f6109a07740 1 --2- 172.21.15.7:0/776181176 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fe4b7d41c0 0x55fe4bc02320 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.486 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.483+0000 7f6109a07740 1 -- 172.21.15.7:0/776181176 >> 172.21.15.7:0/776181176 conn(0x55fe4b834300 msgr2=0x55fe4bbe8bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:26.486 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.483+0000 7f6109a07740 1 -- 172.21.15.7:0/776181176 shutdown_connections 2024-09-21T06:37:26.486 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.483+0000 7f6109a07740 1 -- 172.21.15.7:0/776181176 wait complete. 2024-09-21T06:37:26.486 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.483+0000 7f6109a07740 20 client.15702 trim_cache size 0 max 16384 2024-09-21T06:37:26.487 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-09-21T06:37:26.487 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-09-21T06:37:26.487 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-09-21T06:37:26.487 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-09-21T06:37:26.488 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.484+0000 7f6102a94640 1 -- 172.21.15.7:0/2304110928 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f60ec0b6680 msgr2=0x7f60ec0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:26.488 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.484+0000 7f6102a94640 1 --2- 172.21.15.7:0/2304110928 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f60ec0b6680 0x7f60ec0b8b90 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f60f0009710 tx=0x7f60f0006d00 comp rx=0 tx=0).stop 2024-09-21T06:37:26.488 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.484+0000 7f6102a94640 1 -- 172.21.15.7:0/2304110928 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60fc108c40 msgr2=0x7f60fc19fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:26.488 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.484+0000 7f6102a94640 1 --2- 172.21.15.7:0/2304110928 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60fc108c40 0x7f60fc19fd40 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f60f4005cc0 tx=0x7f60f4003ba0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.488 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.484+0000 7f6102a94640 1 -- 172.21.15.7:0/2304110928 shutdown_connections 2024-09-21T06:37:26.488 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.484+0000 7f6102a94640 1 --2- 172.21.15.7:0/2304110928 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f60ec0b6680 0x7f60ec0b8b90 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.488 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.484+0000 7f6102a94640 1 --2- 172.21.15.7:0/2304110928 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60fc108c40 0x7f60fc19fd40 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.488 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.484+0000 7f6102a94640 1 --2- 172.21.15.7:0/2304110928 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f60fc1082f0 0x7f60fc19aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.488 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.484+0000 7f6102a94640 1 --2- 172.21.15.7:0/2304110928 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60fc1029c0 0x7f60fc19a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:26.488 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.484+0000 7f6102a94640 1 -- 172.21.15.7:0/2304110928 >> 172.21.15.7:0/2304110928 conn(0x7f60fc0fe3c0 msgr2=0x7f60fc06ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:26.488 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.484+0000 7f6102a94640 1 -- 172.21.15.7:0/2304110928 shutdown_connections 2024-09-21T06:37:26.488 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:26.484+0000 7f6102a94640 1 -- 172.21.15.7:0/2304110928 wait complete. 2024-09-21T06:37:26.501 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-09-21T06:37:26.501 INFO:tasks.workunit.client.0.smithi007.stdout: Children see throughput for 1 initial writers = 686208.00 kB/sec 2024-09-21T06:37:26.501 INFO:tasks.workunit.client.0.smithi007.stdout: Parent sees throughput for 1 initial writers = 686143.38 kB/sec 2024-09-21T06:37:26.501 INFO:tasks.workunit.client.0.smithi007.stdout: Min throughput per process = 686208.00 kB/sec 2024-09-21T06:37:26.501 INFO:tasks.workunit.client.0.smithi007.stdout: Max throughput per process = 686208.00 kB/sec 2024-09-21T06:37:26.501 INFO:tasks.workunit.client.0.smithi007.stdout: Avg throughput per process = 686208.00 kB/sec 2024-09-21T06:37:26.501 INFO:tasks.workunit.client.0.smithi007.stdout: Min xfer = 1048576.00 kB 2024-09-21T06:37:28.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:37:28 smithi144 ceph-mon[34653]: pgmap v357: 97 pgs: 97 active+clean; 413 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 34 MiB/s wr, 14 op/s 2024-09-21T06:37:28.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:37:28 smithi007 ceph-mon[30983]: pgmap v357: 97 pgs: 97 active+clean; 413 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 34 MiB/s wr, 14 op/s 2024-09-21T06:37:28.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:37:28 smithi018 ceph-mon[34477]: pgmap v357: 97 pgs: 97 active+clean; 413 MiB data, 419 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 34 MiB/s wr, 14 op/s 2024-09-21T06:37:30.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:37:30 smithi144 ceph-mon[34653]: pgmap v358: 97 pgs: 97 active+clean; 741 MiB data, 499 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 62 MiB/s wr, 26 op/s 2024-09-21T06:37:30.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:37:30 smithi007 ceph-mon[30983]: pgmap v358: 97 pgs: 97 active+clean; 741 MiB data, 499 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 62 MiB/s wr, 26 op/s 2024-09-21T06:37:30.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:37:30 smithi018 ceph-mon[34477]: pgmap v358: 97 pgs: 97 active+clean; 741 MiB data, 499 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 62 MiB/s wr, 26 op/s 2024-09-21T06:37:32.397 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-09-21T06:37:32.398 INFO:tasks.workunit.client.0.smithi007.stdout: Children see throughput for 1 rewriters = 725872.56 kB/sec 2024-09-21T06:37:32.398 INFO:tasks.workunit.client.0.smithi007.stdout: Parent sees throughput for 1 rewriters = 725777.70 kB/sec 2024-09-21T06:37:32.398 INFO:tasks.workunit.client.0.smithi007.stdout: Min throughput per process = 725872.56 kB/sec 2024-09-21T06:37:32.398 INFO:tasks.workunit.client.0.smithi007.stdout: Max throughput per process = 725872.56 kB/sec 2024-09-21T06:37:32.398 INFO:tasks.workunit.client.0.smithi007.stdout: Avg throughput per process = 725872.56 kB/sec 2024-09-21T06:37:32.398 INFO:tasks.workunit.client.0.smithi007.stdout: Min xfer = 1048576.00 kB 2024-09-21T06:37:32.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:37:32 smithi144 ceph-mon[34653]: pgmap v359: 97 pgs: 97 active+clean; 1.0 GiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 85 MiB/s wr, 30 op/s 2024-09-21T06:37:32.589 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:37:32 smithi007 ceph-mon[30983]: pgmap v359: 97 pgs: 97 active+clean; 1.0 GiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 85 MiB/s wr, 30 op/s 2024-09-21T06:37:32.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:37:32 smithi018 ceph-mon[34477]: pgmap v359: 97 pgs: 97 active+clean; 1.0 GiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 85 MiB/s wr, 30 op/s 2024-09-21T06:37:34.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:37:34 smithi144 ceph-mon[34653]: pgmap v360: 97 pgs: 97 active+clean; 1.0 GiB data, 556 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 111 MiB/s wr, 39 op/s 2024-09-21T06:37:34.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:37:34 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:37:34.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:37:34 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:37:34.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:37:34 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:37:34.536 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:37:34 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:37:34.536 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:37:34 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:37:34.536 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:37:34 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:37:34.536 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:37:34 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:37:34.536 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:37:34 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:37:34.536 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:37:34 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:37:34.536 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:37:34 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:37:34.589 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:37:34 smithi007 ceph-mon[30983]: pgmap v360: 97 pgs: 97 active+clean; 1.0 GiB data, 556 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 111 MiB/s wr, 39 op/s 2024-09-21T06:37:34.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:37:34 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:37:34.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:37:34 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:37:34.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:37:34 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:37:34.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:37:34 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:37:34.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:37:34 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:37:34.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:37:34 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:37:34.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:37:34 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:37:34.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:37:34 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:37:34.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:37:34 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:37:34.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:37:34 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:37:34.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:37:34 smithi018 ceph-mon[34477]: pgmap v360: 97 pgs: 97 active+clean; 1.0 GiB data, 556 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 111 MiB/s wr, 39 op/s 2024-09-21T06:37:34.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:37:34 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:37:34.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:37:34 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:37:34.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:37:34 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:37:34.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:37:34 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:37:34.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:37:34 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:37:34.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:37:34 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:37:34.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:37:34 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:37:34.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:37:34 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:37:34.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:37:34 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:37:34.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:37:34 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:37:34.732 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-09-21T06:37:34.732 INFO:tasks.workunit.client.0.smithi007.stdout: Children see throughput for 1 readers = 7234107.50 kB/sec 2024-09-21T06:37:34.733 INFO:tasks.workunit.client.0.smithi007.stdout: Parent sees throughput for 1 readers = 7225182.25 kB/sec 2024-09-21T06:37:34.733 INFO:tasks.workunit.client.0.smithi007.stdout: Min throughput per process = 7234107.50 kB/sec 2024-09-21T06:37:34.733 INFO:tasks.workunit.client.0.smithi007.stdout: Max throughput per process = 7234107.50 kB/sec 2024-09-21T06:37:34.733 INFO:tasks.workunit.client.0.smithi007.stdout: Avg throughput per process = 7234107.50 kB/sec 2024-09-21T06:37:34.733 INFO:tasks.workunit.client.0.smithi007.stdout: Min xfer = 1048576.00 kB 2024-09-21T06:37:35.145 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:37:35.409 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:37:35.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.941+0000 7fa147918640 1 -- 172.21.15.7:0/1736309406 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa140109df0 msgr2=0x7fa140110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:35.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.941+0000 7fa147918640 1 --2- 172.21.15.7:0/1736309406 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa140109df0 0x7fa140110620 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fa130009ca0 tx=0x7fa13002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:37:35.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.941+0000 7fa147918640 1 -- 172.21.15.7:0/1736309406 shutdown_connections 2024-09-21T06:37:35.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.941+0000 7fa147918640 1 --2- 172.21.15.7:0/1736309406 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa140109df0 0x7fa140110620 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:35.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.941+0000 7fa147918640 1 --2- 172.21.15.7:0/1736309406 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1401094a0 0x7fa1401098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:35.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.941+0000 7fa147918640 1 --2- 172.21.15.7:0/1736309406 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa140103b60 0x7fa140103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:35.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.941+0000 7fa147918640 1 -- 172.21.15.7:0/1736309406 >> 172.21.15.7:0/1736309406 conn(0x7fa14007b850 msgr2=0x7fa14007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:35.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.941+0000 7fa147918640 1 -- 172.21.15.7:0/1736309406 shutdown_connections 2024-09-21T06:37:35.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.941+0000 7fa147918640 1 -- 172.21.15.7:0/1736309406 wait complete. 2024-09-21T06:37:35.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.942+0000 7fa147918640 1 Processor -- start 2024-09-21T06:37:35.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.942+0000 7fa147918640 1 -- start start 2024-09-21T06:37:35.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.942+0000 7fa147918640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa140103b60 0x7fa14019a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:35.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.942+0000 7fa147918640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1401094a0 0x7fa14019a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:35.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.942+0000 7fa147918640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa140109df0 0x7fa14019fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:35.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.942+0000 7fa147918640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa140113ab0 con 0x7fa1401094a0 2024-09-21T06:37:35.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.942+0000 7fa147918640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa140113930 con 0x7fa140109df0 2024-09-21T06:37:35.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.942+0000 7fa147918640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa140113c30 con 0x7fa140103b60 2024-09-21T06:37:35.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.942+0000 7fa144eb3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1401094a0 0x7fa14019a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:35.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.942+0000 7fa144eb3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1401094a0 0x7fa14019a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41998/0 (socket says 172.21.15.7:41998) 2024-09-21T06:37:35.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.942+0000 7fa144eb3640 1 -- 172.21.15.7:0/3997883343 learned_addr learned my addr 172.21.15.7:0/3997883343 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:37:35.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.942+0000 7fa1456b4640 1 --2- 172.21.15.7:0/3997883343 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa140103b60 0x7fa14019a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:35.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.942+0000 7fa145eb5640 1 --2- 172.21.15.7:0/3997883343 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa140109df0 0x7fa14019fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:35.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.943+0000 7fa144eb3640 1 -- 172.21.15.7:0/3997883343 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa140103b60 msgr2=0x7fa14019a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:35.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.943+0000 7fa144eb3640 1 --2- 172.21.15.7:0/3997883343 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa140103b60 0x7fa14019a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:35.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.943+0000 7fa144eb3640 1 -- 172.21.15.7:0/3997883343 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa140109df0 msgr2=0x7fa14019fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:35.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.943+0000 7fa144eb3640 1 --2- 172.21.15.7:0/3997883343 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa140109df0 0x7fa14019fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:35.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.943+0000 7fa144eb3640 1 -- 172.21.15.7:0/3997883343 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1401a03b0 con 0x7fa1401094a0 2024-09-21T06:37:35.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.943+0000 7fa144eb3640 1 --2- 172.21.15.7:0/3997883343 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1401094a0 0x7fa14019a9e0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fa13400d950 tx=0x7fa13400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:35.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.943+0000 7fa13e7fc640 1 -- 172.21.15.7:0/3997883343 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa134017070 con 0x7fa1401094a0 2024-09-21T06:37:35.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.943+0000 7fa13e7fc640 1 -- 172.21.15.7:0/3997883343 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa1340054d0 con 0x7fa1401094a0 2024-09-21T06:37:35.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.943+0000 7fa147918640 1 -- 172.21.15.7:0/3997883343 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1401a06a0 con 0x7fa1401094a0 2024-09-21T06:37:35.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.943+0000 7fa13e7fc640 1 -- 172.21.15.7:0/3997883343 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa134004ca0 con 0x7fa1401094a0 2024-09-21T06:37:35.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.943+0000 7fa147918640 1 -- 172.21.15.7:0/3997883343 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1401a6e00 con 0x7fa1401094a0 2024-09-21T06:37:35.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.946+0000 7fa14de8c740 1 Processor -- start 2024-09-21T06:37:35.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.946+0000 7fa14de8c740 1 -- start start 2024-09-21T06:37:35.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.946+0000 7fa13e7fc640 1 -- 172.21.15.7:0/3997883343 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7fa134004e40 con 0x7fa1401094a0 2024-09-21T06:37:35.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.947+0000 7fa14de8c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5648890ee070 0x564889495650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:35.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.947+0000 7fa14de8c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648890c51b0 0x564889495b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:35.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.947+0000 7fa14de8c740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5648890cd390 0x5648894960d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:35.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.947+0000 7fa14de8c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56488940be50 con 0x5648890ee070 2024-09-21T06:37:35.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.947+0000 7fa14de8c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5648893fb280 con 0x5648890c51b0 2024-09-21T06:37:35.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.947+0000 7fa14de8c740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5648893ff090 con 0x5648890cd390 2024-09-21T06:37:35.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.947+0000 7fa145eb5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5648890ee070 0x564889495650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:35.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.947+0000 7fa145eb5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5648890ee070 0x564889495650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42004/0 (socket says 172.21.15.7:42004) 2024-09-21T06:37:35.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.947+0000 7fa145eb5640 1 -- 172.21.15.7:0/1268206172 learned_addr learned my addr 172.21.15.7:0/1268206172 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:37:35.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.947+0000 7fa144eb3640 1 --2- 172.21.15.7:0/1268206172 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5648890cd390 0x5648894960d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:35.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.947+0000 7fa145eb5640 1 -- 172.21.15.7:0/1268206172 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5648890cd390 msgr2=0x5648894960d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:35.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.947+0000 7fa145eb5640 1 --2- 172.21.15.7:0/1268206172 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5648890cd390 0x5648894960d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:35.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.947+0000 7fa145eb5640 1 -- 172.21.15.7:0/1268206172 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648890c51b0 msgr2=0x564889495b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:35.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.947+0000 7fa1456b4640 1 --2- 172.21.15.7:0/1268206172 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648890c51b0 0x564889495b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:35.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.947+0000 7fa145eb5640 1 --2- 172.21.15.7:0/1268206172 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648890c51b0 0x564889495b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:35.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.947+0000 7fa145eb5640 1 -- 172.21.15.7:0/1268206172 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564889159650 con 0x5648890ee070 2024-09-21T06:37:35.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.947+0000 7fa144eb3640 1 --2- 172.21.15.7:0/1268206172 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5648890cd390 0x5648894960d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:37:35.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.947+0000 7fa1456b4640 1 --2- 172.21.15.7:0/1268206172 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648890c51b0 0x564889495b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:37:35.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.948+0000 7fa145eb5640 1 --2- 172.21.15.7:0/1268206172 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5648890ee070 0x564889495650 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fa130005cc0 tx=0x7fa13002f420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cc267078aeb604a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:35.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.948+0000 7fa1277fe640 1 -- 172.21.15.7:0/1268206172 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa130031cf0 con 0x5648890ee070 2024-09-21T06:37:35.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.948+0000 7fa13e7fc640 1 --2- 172.21.15.7:0/3997883343 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa1280b6680 0x7fa1280b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:35.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.948+0000 7fa1277fe640 1 -- 172.21.15.7:0/1268206172 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa130036040 con 0x5648890ee070 2024-09-21T06:37:35.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.948+0000 7fa1277fe640 1 -- 172.21.15.7:0/1268206172 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa130004040 con 0x5648890ee070 2024-09-21T06:37:35.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.948+0000 7fa1456b4640 1 --2- 172.21.15.7:0/3997883343 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa1280b6680 0x7fa1280b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:35.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.948+0000 7fa13e7fc640 1 -- 172.21.15.7:0/3997883343 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fa1340e6e60 con 0x7fa1401094a0 2024-09-21T06:37:35.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.949+0000 7fa14de8c740 1 -- 172.21.15.7:0/1268206172 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5648890ee070 msgr2=0x564889495650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:35.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.949+0000 7fa1456b4640 1 --2- 172.21.15.7:0/3997883343 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa1280b6680 0x7fa1280b8b90 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x5648894942d0 tx=0x7fa138005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:35.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.949+0000 7fa14de8c740 1 --2- 172.21.15.7:0/1268206172 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5648890ee070 0x564889495650 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fa130005cc0 tx=0x7fa13002f420 comp rx=0 tx=0).stop 2024-09-21T06:37:35.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.949+0000 7fa14de8c740 1 -- 172.21.15.7:0/1268206172 shutdown_connections 2024-09-21T06:37:35.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.949+0000 7fa14de8c740 1 --2- 172.21.15.7:0/1268206172 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5648890cd390 0x5648894960d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:35.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.949+0000 7fa14de8c740 1 --2- 172.21.15.7:0/1268206172 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648890c51b0 0x564889495b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:35.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.949+0000 7fa14de8c740 1 --2- 172.21.15.7:0/1268206172 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5648890ee070 0x564889495650 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:35.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.949+0000 7fa14de8c740 1 -- 172.21.15.7:0/1268206172 >> 172.21.15.7:0/1268206172 conn(0x5648890e2460 msgr2=0x564889493540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:35.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.949+0000 7fa14de8c740 1 -- 172.21.15.7:0/1268206172 shutdown_connections 2024-09-21T06:37:35.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.949+0000 7fa14de8c740 1 -- 172.21.15.7:0/1268206172 wait complete. 2024-09-21T06:37:35.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.950+0000 7fa14de8c740 1 -- start start 2024-09-21T06:37:35.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.950+0000 7fa14de8c740 1 Processor -- start 2024-09-21T06:37:35.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.950+0000 7fa14de8c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5648890c51b0 0x5648894a0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:35.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.950+0000 7fa14de8c740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5648890cd390 0x5648894a1270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:35.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.950+0000 7fa14de8c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648890ee070 0x5648894b1500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:35.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.950+0000 7fa14de8c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56488925c700 con 0x5648890c51b0 2024-09-21T06:37:35.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.950+0000 7fa14de8c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x564889396110 con 0x5648890ee070 2024-09-21T06:37:35.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.950+0000 7fa14de8c740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5648894a3dd0 con 0x5648890cd390 2024-09-21T06:37:35.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.950+0000 7fa14de8c740 10 client.0 _ll_register_callbacks cb 0x5648893af990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:37:35.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.951+0000 7fa145eb5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648890ee070 0x5648894b1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:35.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.951+0000 7fa1456b4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5648890c51b0 0x5648894a0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:35.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.951+0000 7fa144eb3640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5648890cd390 0x5648894a1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:35.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.951+0000 7fa1456b4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5648890c51b0 0x5648894a0d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42006/0 (socket says 172.21.15.7:42006) 2024-09-21T06:37:35.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.951+0000 7fa1456b4640 1 -- 172.21.15.7:0/3634785907 learned_addr learned my addr 172.21.15.7:0/3634785907 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:37:35.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.951+0000 7fa145eb5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648890ee070 0x5648894b1500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.7:52794/0 (socket says 172.21.15.7:52794) 2024-09-21T06:37:35.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.951+0000 7fa1456b4640 1 -- 172.21.15.7:0/3634785907 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5648890cd390 msgr2=0x5648894a1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:35.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.951+0000 7fa1456b4640 1 --2- 172.21.15.7:0/3634785907 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5648890cd390 0x5648894a1270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:35.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.951+0000 7fa1456b4640 1 -- 172.21.15.7:0/3634785907 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648890ee070 msgr2=0x5648894b1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:35.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.951+0000 7fa1456b4640 1 --2- 172.21.15.7:0/3634785907 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648890ee070 0x5648894b1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:35.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.951+0000 7fa1456b4640 1 -- 172.21.15.7:0/3634785907 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648893c3c40 con 0x5648890c51b0 2024-09-21T06:37:35.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.952+0000 7fa1456b4640 1 --2- 172.21.15.7:0/3634785907 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5648890c51b0 0x5648894a0d30 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fa1380038a0 tx=0x7fa1380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96a22fa2094410e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:35.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.952+0000 7fa124ff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:37:35.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.952+0000 7fa124ff9640 1 -- 172.21.15.7:0/3634785907 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa138011b50 con 0x5648890c51b0 2024-09-21T06:37:35.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.952+0000 7fa124ff9640 1 -- 172.21.15.7:0/3634785907 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fa138011cf0 con 0x5648890c51b0 2024-09-21T06:37:35.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.952+0000 7fa14de8c740 1 -- 172.21.15.7:0/3634785907 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa130036040 con 0x5648890c51b0 2024-09-21T06:37:35.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.952+0000 7fa124ff9640 1 -- 172.21.15.7:0/3634785907 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa13802d030 con 0x5648890c51b0 2024-09-21T06:37:35.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.952+0000 7fa14de8c740 10 client.15714 fetch_fsmap learned FSMap version 25 2024-09-21T06:37:35.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.952+0000 7fa14de8c740 1 -- 172.21.15.7:0/3634785907 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5648894b3eb0 con 0x5648890c51b0 2024-09-21T06:37:35.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.953+0000 7fa124ff9640 1 -- 172.21.15.7:0/3634785907 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa130036040 con 0x5648890c51b0 2024-09-21T06:37:35.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.953+0000 7fa124ff9640 1 -- 172.21.15.7:0/3634785907 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa138028400 con 0x5648890c51b0 2024-09-21T06:37:35.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.953+0000 7fa14de8c740 10 client.15714 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:37:35.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.953+0000 7fa14de8c740 10 client.15714 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:37:35.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.953+0000 7fa14de8c740 20 client.15714 populate_metadata read hostname 'smithi007' 2024-09-21T06:37:35.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.953+0000 7fa14de8c740 1 --2- 172.21.15.7:0/3634785907 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5648890ac9f0 0x5648894b73e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:35.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.953+0000 7fa14de8c740 4 client.15714 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:37:35.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.953+0000 7fa14de8c740 1 -- 172.21.15.7:0/3634785907 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56488940dda0 con 0x5648890ac9f0 2024-09-21T06:37:35.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.954+0000 7fa144eb3640 1 --2- 172.21.15.7:0/3634785907 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5648890ac9f0 0x5648894b73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:35.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.954+0000 7fa144eb3640 1 --2- 172.21.15.7:0/3634785907 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5648890ac9f0 0x5648894b73e0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df08daa200738e18 server_cookie=9352eb7304764ae7 in_seq=0 out_seq=0 2024-09-21T06:37:35.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.954+0000 7fa124ff9640 10 client.15714 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:37:35.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.955+0000 7fa124ff9640 1 -- 172.21.15.7:0/3634785907 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56488940dda0 con 0x5648890ac9f0 2024-09-21T06:37:35.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.955+0000 7fa124ff9640 10 client.15714 handle_command_reply: tid=0 2024-09-21T06:37:35.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.955+0000 7fa14de8c740 1 client.15714 shutdown 2024-09-21T06:37:35.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.955+0000 7fa14de8c740 1 -- 172.21.15.7:0/3634785907 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5648890c51b0 msgr2=0x5648894a0d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:35.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.955+0000 7fa14de8c740 1 --2- 172.21.15.7:0/3634785907 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5648890c51b0 0x5648894a0d30 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fa1380038a0 tx=0x7fa1380046c0 comp rx=0 tx=0).stop 2024-09-21T06:37:35.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.955+0000 7fa14de8c740 1 -- 172.21.15.7:0/3634785907 shutdown_connections 2024-09-21T06:37:35.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.955+0000 7fa14de8c740 1 --2- 172.21.15.7:0/3634785907 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5648890ac9f0 0x5648894b73e0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:35.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.955+0000 7fa14de8c740 1 --2- 172.21.15.7:0/3634785907 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648890ee070 0x5648894b1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:35.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.955+0000 7fa14de8c740 1 --2- 172.21.15.7:0/3634785907 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5648890cd390 0x5648894a1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:35.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.955+0000 7fa124ff9640 0 client.15714 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:37:35.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.955+0000 7fa14de8c740 1 --2- 172.21.15.7:0/3634785907 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5648890c51b0 0x5648894a0d30 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:35.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.955+0000 7fa14de8c740 1 -- 172.21.15.7:0/3634785907 >> 172.21.15.7:0/3634785907 conn(0x5648890e2460 msgr2=0x564889498800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:35.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.956+0000 7fa14de8c740 1 -- 172.21.15.7:0/3634785907 shutdown_connections 2024-09-21T06:37:35.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.956+0000 7fa14de8c740 1 -- 172.21.15.7:0/3634785907 wait complete. 2024-09-21T06:37:35.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.956+0000 7fa14de8c740 20 client.15714 trim_cache size 0 max 16384 2024-09-21T06:37:35.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.974+0000 7fa14de8c740 1 Processor -- start 2024-09-21T06:37:35.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.974+0000 7fa14de8c740 1 -- start start 2024-09-21T06:37:35.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.974+0000 7fa14de8c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648890c51b0 0x564889496d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:35.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.974+0000 7fa14de8c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5648890cd390 0x564889492b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:35.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.974+0000 7fa14de8c740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5648890ee070 0x5648894930b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:35.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.974+0000 7fa14de8c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa1401afd30 con 0x5648890cd390 2024-09-21T06:37:35.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.974+0000 7fa14de8c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa1401ad600 con 0x5648890c51b0 2024-09-21T06:37:35.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.974+0000 7fa14de8c740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa1401ab430 con 0x5648890ee070 2024-09-21T06:37:35.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.974+0000 7fa144eb3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5648890cd390 0x564889492b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:35.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.975+0000 7fa144eb3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5648890cd390 0x564889492b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42016/0 (socket says 172.21.15.7:42016) 2024-09-21T06:37:35.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.975+0000 7fa144eb3640 1 -- 172.21.15.7:0/170647276 learned_addr learned my addr 172.21.15.7:0/170647276 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:37:35.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.975+0000 7fa145eb5640 1 --2- 172.21.15.7:0/170647276 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5648890ee070 0x5648894930b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:35.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.975+0000 7fa1456b4640 1 --2- 172.21.15.7:0/170647276 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648890c51b0 0x564889496d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:35.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.975+0000 7fa144eb3640 1 -- 172.21.15.7:0/170647276 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5648890ee070 msgr2=0x5648894930b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:35.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.975+0000 7fa144eb3640 1 --2- 172.21.15.7:0/170647276 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5648890ee070 0x5648894930b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:35.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.975+0000 7fa144eb3640 1 -- 172.21.15.7:0/170647276 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648890c51b0 msgr2=0x564889496d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:35.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.975+0000 7fa144eb3640 1 --2- 172.21.15.7:0/170647276 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648890c51b0 0x564889496d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:35.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.975+0000 7fa144eb3640 1 -- 172.21.15.7:0/170647276 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56488949f230 con 0x5648890cd390 2024-09-21T06:37:35.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.975+0000 7fa1456b4640 1 --2- 172.21.15.7:0/170647276 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648890c51b0 0x564889496d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:37:35.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.975+0000 7fa144eb3640 1 --2- 172.21.15.7:0/170647276 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5648890cd390 0x564889492b70 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fa1340a9fc0 tx=0x7fa1340d0040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ddce9edad90c915 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:35.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.975+0000 7fa126ffd640 1 -- 172.21.15.7:0/170647276 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1340ac860 con 0x5648890cd390 2024-09-21T06:37:35.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.975+0000 7fa126ffd640 1 -- 172.21.15.7:0/170647276 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa1340ad450 con 0x5648890cd390 2024-09-21T06:37:35.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.975+0000 7fa126ffd640 1 -- 172.21.15.7:0/170647276 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa134005130 con 0x5648890cd390 2024-09-21T06:37:35.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.976+0000 7fa14de8c740 1 -- 172.21.15.7:0/170647276 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5648890cd390 msgr2=0x564889492b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:35.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.976+0000 7fa14de8c740 1 --2- 172.21.15.7:0/170647276 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5648890cd390 0x564889492b70 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fa1340a9fc0 tx=0x7fa1340d0040 comp rx=0 tx=0).stop 2024-09-21T06:37:35.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.976+0000 7fa14de8c740 1 -- 172.21.15.7:0/170647276 shutdown_connections 2024-09-21T06:37:35.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.976+0000 7fa14de8c740 1 --2- 172.21.15.7:0/170647276 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5648890ee070 0x5648894930b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:35.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.976+0000 7fa14de8c740 1 --2- 172.21.15.7:0/170647276 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5648890cd390 0x564889492b70 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:35.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.976+0000 7fa14de8c740 1 --2- 172.21.15.7:0/170647276 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648890c51b0 0x564889496d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:35.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.976+0000 7fa14de8c740 1 -- 172.21.15.7:0/170647276 >> 172.21.15.7:0/170647276 conn(0x5648890e2460 msgr2=0x564889496680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:35.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.976+0000 7fa14de8c740 1 -- 172.21.15.7:0/170647276 shutdown_connections 2024-09-21T06:37:35.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.976+0000 7fa14de8c740 1 -- 172.21.15.7:0/170647276 wait complete. 2024-09-21T06:37:35.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.977+0000 7fa14de8c740 1 -- start start 2024-09-21T06:37:35.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.977+0000 7fa14de8c740 1 Processor -- start 2024-09-21T06:37:35.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.977+0000 7fa14de8c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648890c51b0 0x5648894a9480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:35.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.977+0000 7fa14de8c740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5648890cd390 0x5648894a99c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:35.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.977+0000 7fa14de8c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5648890ee070 0x5648894a9f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:35.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.977+0000 7fa14de8c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa1401abac0 con 0x5648890ee070 2024-09-21T06:37:35.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.977+0000 7fa14de8c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa1401acf30 con 0x5648890c51b0 2024-09-21T06:37:35.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.977+0000 7fa14de8c740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa1401ac190 con 0x5648890cd390 2024-09-21T06:37:35.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.977+0000 7fa14de8c740 10 client.0 _ll_register_callbacks cb 0x7fa138009d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:37:35.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.978+0000 7fa145eb5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5648890ee070 0x5648894a9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:35.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.978+0000 7fa144eb3640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5648890cd390 0x5648894a99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:35.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.978+0000 7fa145eb5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5648890ee070 0x5648894a9f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42028/0 (socket says 172.21.15.7:42028) 2024-09-21T06:37:35.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.978+0000 7fa145eb5640 1 -- 172.21.15.7:0/4038252563 learned_addr learned my addr 172.21.15.7:0/4038252563 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:37:35.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.978+0000 7fa1456b4640 1 --2- 172.21.15.7:0/4038252563 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648890c51b0 0x5648894a9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:35.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.978+0000 7fa145eb5640 1 -- 172.21.15.7:0/4038252563 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5648890cd390 msgr2=0x5648894a99c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:35.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.978+0000 7fa145eb5640 1 --2- 172.21.15.7:0/4038252563 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5648890cd390 0x5648894a99c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:35.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.978+0000 7fa145eb5640 1 -- 172.21.15.7:0/4038252563 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648890c51b0 msgr2=0x5648894a9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:35.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.978+0000 7fa145eb5640 1 --2- 172.21.15.7:0/4038252563 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648890c51b0 0x5648894a9480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:35.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.978+0000 7fa145eb5640 1 -- 172.21.15.7:0/4038252563 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564889520de0 con 0x5648890ee070 2024-09-21T06:37:35.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.978+0000 7fa1456b4640 1 --2- 172.21.15.7:0/4038252563 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648890c51b0 0x5648894a9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:37:35.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.978+0000 7fa144eb3640 1 --2- 172.21.15.7:0/4038252563 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5648890cd390 0x5648894a99c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:37:35.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.978+0000 7fa145eb5640 1 --2- 172.21.15.7:0/4038252563 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5648890ee070 0x5648894a9f00 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fa130009a60 tx=0x7fa130031db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=755f69e6c0c7926a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:35.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.978+0000 7fa124ff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:37:35.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.978+0000 7fa124ff9640 1 -- 172.21.15.7:0/4038252563 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa130052020 con 0x5648890ee070 2024-09-21T06:37:35.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.978+0000 7fa124ff9640 1 -- 172.21.15.7:0/4038252563 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fa130031650 con 0x5648890ee070 2024-09-21T06:37:35.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.978+0000 7fa14de8c740 1 -- 172.21.15.7:0/4038252563 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa1340ad450 con 0x5648890ee070 2024-09-21T06:37:35.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.979+0000 7fa124ff9640 1 -- 172.21.15.7:0/4038252563 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa13005d050 con 0x5648890ee070 2024-09-21T06:37:35.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.979+0000 7fa14de8c740 10 client.15720 fetch_fsmap learned FSMap version 25 2024-09-21T06:37:35.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.979+0000 7fa14de8c740 1 -- 172.21.15.7:0/4038252563 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564889522040 con 0x5648890ee070 2024-09-21T06:37:35.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.979+0000 7fa124ff9640 1 -- 172.21.15.7:0/4038252563 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa1340ad450 con 0x5648890ee070 2024-09-21T06:37:35.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.979+0000 7fa124ff9640 1 -- 172.21.15.7:0/4038252563 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa130004460 con 0x5648890ee070 2024-09-21T06:37:35.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.979+0000 7fa14de8c740 10 client.15720 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:37:35.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.979+0000 7fa14de8c740 10 client.15720 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:37:35.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.979+0000 7fa14de8c740 20 client.15720 populate_metadata read hostname 'smithi007' 2024-09-21T06:37:35.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.979+0000 7fa14de8c740 1 --2- 172.21.15.7:0/4038252563 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x564889081da0 0x5648895243a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:35.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.979+0000 7fa14de8c740 4 client.15720 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:37:35.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.979+0000 7fa14de8c740 1 -- 172.21.15.7:0/4038252563 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564889409850 con 0x564889081da0 2024-09-21T06:37:35.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.979+0000 7fa1456b4640 1 --2- 172.21.15.7:0/4038252563 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x564889081da0 0x5648895243a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:35.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.980+0000 7fa1456b4640 1 --2- 172.21.15.7:0/4038252563 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x564889081da0 0x5648895243a0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=789de04c276bbf95 server_cookie=8844d89a9ec10a2 in_seq=0 out_seq=0 2024-09-21T06:37:35.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.980+0000 7fa124ff9640 10 client.15720 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:37:35.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.980+0000 7fa124ff9640 1 -- 172.21.15.7:0/4038252563 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+658 (crc 0 0 0) 0x564889409850 con 0x564889081da0 2024-09-21T06:37:35.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.980+0000 7fa124ff9640 10 client.15720 handle_command_reply: tid=0 2024-09-21T06:37:35.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.980+0000 7fa14de8c740 1 client.15720 shutdown 2024-09-21T06:37:35.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.980+0000 7fa14de8c740 1 -- 172.21.15.7:0/4038252563 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5648890ee070 msgr2=0x5648894a9f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:35.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.980+0000 7fa14de8c740 1 --2- 172.21.15.7:0/4038252563 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5648890ee070 0x5648894a9f00 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fa130009a60 tx=0x7fa130031db0 comp rx=0 tx=0).stop 2024-09-21T06:37:35.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.980+0000 7fa14de8c740 1 -- 172.21.15.7:0/4038252563 shutdown_connections 2024-09-21T06:37:35.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.980+0000 7fa14de8c740 1 --2- 172.21.15.7:0/4038252563 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x564889081da0 0x5648895243a0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:35.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.980+0000 7fa14de8c740 1 --2- 172.21.15.7:0/4038252563 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5648890ee070 0x5648894a9f00 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:35.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.980+0000 7fa14de8c740 1 --2- 172.21.15.7:0/4038252563 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5648890cd390 0x5648894a99c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:35.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.980+0000 7fa14de8c740 1 --2- 172.21.15.7:0/4038252563 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648890c51b0 0x5648894a9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:35.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.980+0000 7fa14de8c740 1 -- 172.21.15.7:0/4038252563 >> 172.21.15.7:0/4038252563 conn(0x5648890e2460 msgr2=0x5648894a21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:35.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.980+0000 7fa124ff9640 0 client.15720 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:37:35.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.980+0000 7fa14de8c740 1 -- 172.21.15.7:0/4038252563 shutdown_connections 2024-09-21T06:37:35.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.980+0000 7fa14de8c740 1 -- 172.21.15.7:0/4038252563 wait complete. 2024-09-21T06:37:35.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.980+0000 7fa14de8c740 20 client.15720 trim_cache size 0 max 16384 2024-09-21T06:37:35.987 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:37:35.987 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "no active scrubs running", 2024-09-21T06:37:35.987 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": {}, 2024-09-21T06:37:35.987 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_stats": { 2024-09-21T06:37:35.987 INFO:teuthology.orchestra.run.smithi007.stdout: "6231e9c1-14a2-40b5-be3c-76d87a0d733b": { 2024-09-21T06:37:35.987 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:37:02.484812+0000", 2024-09-21T06:37:35.987 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:37:35.988 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:37:35.988 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:37:35.988 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:37:35.988 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:37:35.988 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:37:35.988 INFO:teuthology.orchestra.run.smithi007.stdout: "0b89345c-1f00-4efe-8ee9-4cb17e43584c": { 2024-09-21T06:37:35.988 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:36:19.500334+0000", 2024-09-21T06:37:35.988 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:37:35.988 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:37:35.988 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:37:35.988 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:37:35.988 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:37:35.988 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:37:35.989 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:37:35.989 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:37:35.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.981+0000 7fa147918640 1 -- 172.21.15.7:0/3997883343 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa1280b6680 msgr2=0x7fa1280b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:35.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.981+0000 7fa147918640 1 --2- 172.21.15.7:0/3997883343 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa1280b6680 0x7fa1280b8b90 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x5648894942d0 tx=0x7fa138005f90 comp rx=0 tx=0).stop 2024-09-21T06:37:35.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.981+0000 7fa147918640 1 -- 172.21.15.7:0/3997883343 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1401094a0 msgr2=0x7fa14019a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:35.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.981+0000 7fa147918640 1 --2- 172.21.15.7:0/3997883343 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1401094a0 0x7fa14019a9e0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fa13400d950 tx=0x7fa13400de10 comp rx=0 tx=0).stop 2024-09-21T06:37:35.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.981+0000 7fa147918640 1 -- 172.21.15.7:0/3997883343 shutdown_connections 2024-09-21T06:37:35.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.981+0000 7fa147918640 1 --2- 172.21.15.7:0/3997883343 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa1280b6680 0x7fa1280b8b90 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:35.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.981+0000 7fa147918640 1 --2- 172.21.15.7:0/3997883343 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa140109df0 0x7fa14019fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:35.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.981+0000 7fa147918640 1 --2- 172.21.15.7:0/3997883343 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1401094a0 0x7fa14019a9e0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:35.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.981+0000 7fa147918640 1 --2- 172.21.15.7:0/3997883343 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa140103b60 0x7fa14019a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:35.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.981+0000 7fa147918640 1 -- 172.21.15.7:0/3997883343 >> 172.21.15.7:0/3997883343 conn(0x7fa14007b850 msgr2=0x7fa140105470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:35.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.981+0000 7fa147918640 1 -- 172.21.15.7:0/3997883343 shutdown_connections 2024-09-21T06:37:35.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:35.981+0000 7fa147918640 1 -- 172.21.15.7:0/3997883343 wait complete. 2024-09-21T06:37:36.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:37:36 smithi144 ceph-mon[34653]: pgmap v361: 97 pgs: 97 active+clean; 1.0 GiB data, 556 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 130 MiB/s wr, 42 op/s 2024-09-21T06:37:36.564 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:37:36 smithi007 ceph-mon[30983]: pgmap v361: 97 pgs: 97 active+clean; 1.0 GiB data, 556 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 130 MiB/s wr, 42 op/s 2024-09-21T06:37:36.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:37:36 smithi018 ceph-mon[34477]: pgmap v361: 97 pgs: 97 active+clean; 1.0 GiB data, 556 MiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 130 MiB/s wr, 42 op/s 2024-09-21T06:37:36.917 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:37:36.918 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:37:36.983 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-09-21T06:37:36.983 INFO:tasks.workunit.client.0.smithi007.stdout: Children see throughput for 1 re-readers = 6475535.50 kB/sec 2024-09-21T06:37:36.983 INFO:tasks.workunit.client.0.smithi007.stdout: Parent sees throughput for 1 re-readers = 6467936.07 kB/sec 2024-09-21T06:37:36.983 INFO:tasks.workunit.client.0.smithi007.stdout: Min throughput per process = 6475535.50 kB/sec 2024-09-21T06:37:36.983 INFO:tasks.workunit.client.0.smithi007.stdout: Max throughput per process = 6475535.50 kB/sec 2024-09-21T06:37:36.984 INFO:tasks.workunit.client.0.smithi007.stdout: Avg throughput per process = 6475535.50 kB/sec 2024-09-21T06:37:36.984 INFO:tasks.workunit.client.0.smithi007.stdout: Min xfer = 1048576.00 kB 2024-09-21T06:37:37.182 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:37:37.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:37.701+0000 7f9a6868a640 1 -- 172.21.15.7:0/3625486936 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a60109df0 msgr2=0x7f9a60110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:37.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:37.701+0000 7f9a6868a640 1 --2- 172.21.15.7:0/3625486936 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a60109df0 0x7f9a60110620 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f9a58009ca0 tx=0x7f9a5802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:37:37.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:37.701+0000 7f9a6868a640 1 -- 172.21.15.7:0/3625486936 shutdown_connections 2024-09-21T06:37:37.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:37.701+0000 7f9a6868a640 1 --2- 172.21.15.7:0/3625486936 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a60109df0 0x7f9a60110620 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:37.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:37.701+0000 7f9a6868a640 1 --2- 172.21.15.7:0/3625486936 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9a601094a0 0x7f9a601098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:37.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:37.701+0000 7f9a6868a640 1 --2- 172.21.15.7:0/3625486936 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a60103b60 0x7f9a60103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:37.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:37.701+0000 7f9a6868a640 1 -- 172.21.15.7:0/3625486936 >> 172.21.15.7:0/3625486936 conn(0x7f9a6007b850 msgr2=0x7f9a6007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:37.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:37.701+0000 7f9a6868a640 1 -- 172.21.15.7:0/3625486936 shutdown_connections 2024-09-21T06:37:37.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:37.701+0000 7f9a6868a640 1 -- 172.21.15.7:0/3625486936 wait complete. 2024-09-21T06:37:37.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:37.702+0000 7f9a6868a640 1 Processor -- start 2024-09-21T06:37:37.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:37.702+0000 7f9a6868a640 1 -- start start 2024-09-21T06:37:37.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:37.702+0000 7f9a6868a640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9a60103b60 0x7f9a60075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:37.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:37.702+0000 7f9a6868a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a601094a0 0x7f9a60075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:37.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:37.702+0000 7f9a6868a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a60109df0 0x7f9a60076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:37.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:37.702+0000 7f9a6868a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9a60113ab0 con 0x7f9a601094a0 2024-09-21T06:37:37.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:37.702+0000 7f9a6868a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9a60113930 con 0x7f9a60109df0 2024-09-21T06:37:37.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:37.702+0000 7f9a6868a640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9a60113c30 con 0x7f9a60103b60 2024-09-21T06:37:37.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:37.702+0000 7f9a65c25640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a601094a0 0x7f9a60075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:37.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:37.702+0000 7f9a65c25640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a601094a0 0x7f9a60075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42046/0 (socket says 172.21.15.7:42046) 2024-09-21T06:37:37.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:37.702+0000 7f9a65c25640 1 -- 172.21.15.7:0/4089865561 learned_addr learned my addr 172.21.15.7:0/4089865561 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:37:37.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:37.702+0000 7f9a66c27640 1 --2- 172.21.15.7:0/4089865561 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a60109df0 0x7f9a60076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:37.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:37.702+0000 7f9a66426640 1 --2- 172.21.15.7:0/4089865561 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9a60103b60 0x7f9a60075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:37.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:37.702+0000 7f9a65c25640 1 -- 172.21.15.7:0/4089865561 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9a60103b60 msgr2=0x7f9a60075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:37.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:37.702+0000 7f9a65c25640 1 --2- 172.21.15.7:0/4089865561 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9a60103b60 0x7f9a60075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:37.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:37.702+0000 7f9a65c25640 1 -- 172.21.15.7:0/4089865561 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a60109df0 msgr2=0x7f9a60076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:37.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:37.702+0000 7f9a65c25640 1 --2- 172.21.15.7:0/4089865561 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a60109df0 0x7f9a60076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:37.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:37.702+0000 7f9a65c25640 1 -- 172.21.15.7:0/4089865561 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a601a8720 con 0x7f9a601094a0 2024-09-21T06:37:37.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:37.703+0000 7f9a65c25640 1 --2- 172.21.15.7:0/4089865561 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a601094a0 0x7f9a60075c50 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f9a5400e9c0 tx=0x7f9a5400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:37.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:37.703+0000 7f9a537fe640 1 -- 172.21.15.7:0/4089865561 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a5400ccc0 con 0x7f9a601094a0 2024-09-21T06:37:37.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:37.703+0000 7f9a537fe640 1 -- 172.21.15.7:0/4089865561 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9a540054d0 con 0x7f9a601094a0 2024-09-21T06:37:37.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:37.703+0000 7f9a6868a640 1 -- 172.21.15.7:0/4089865561 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a601a8a10 con 0x7f9a601094a0 2024-09-21T06:37:37.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:37.703+0000 7f9a537fe640 1 -- 172.21.15.7:0/4089865561 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a54010430 con 0x7f9a601094a0 2024-09-21T06:37:37.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:37.703+0000 7f9a6868a640 1 -- 172.21.15.7:0/4089865561 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a601a8f50 con 0x7f9a601094a0 2024-09-21T06:37:37.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:37.704+0000 7f9a6868a640 1 -- 172.21.15.7:0/4089865561 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a60103f70 con 0x7f9a601094a0 2024-09-21T06:37:37.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:37.706+0000 7f9a537fe640 1 -- 172.21.15.7:0/4089865561 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f9a54005000 con 0x7f9a601094a0 2024-09-21T06:37:37.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:37.706+0000 7f9a537fe640 1 --2- 172.21.15.7:0/4089865561 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f9a4c0b6700 0x7f9a4c0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:37.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:37.706+0000 7f9a66426640 1 --2- 172.21.15.7:0/4089865561 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f9a4c0b6700 0x7f9a4c0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:37.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:37.706+0000 7f9a537fe640 1 -- 172.21.15.7:0/4089865561 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f9a540e7bd0 con 0x7f9a601094a0 2024-09-21T06:37:37.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:37.707+0000 7f9a66426640 1 --2- 172.21.15.7:0/4089865561 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f9a4c0b6700 0x7f9a4c0b8c10 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9a60077160 tx=0x7f9a5c005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:37.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:37.710+0000 7f9a537fe640 1 -- 172.21.15.7:0/4089865561 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9a54056710 con 0x7f9a601094a0 2024-09-21T06:37:37.939 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:37.937+0000 7f9a6868a640 1 -- 172.21.15.7:0/4089865561 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9a60076a10 con 0x7f9a601094a0 2024-09-21T06:37:37.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:37.938+0000 7f9a537fe640 1 -- 172.21.15.7:0/4089865561 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11899 (secure 0 0 0) 0x7f9a540052f0 con 0x7f9a601094a0 2024-09-21T06:37:37.940 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:37:37.940 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-21T06:36:10:753693+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2015971546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2015971546},{"type":"v1","addr":"172.21.15.7:6835","nonce":2015971546}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/2350816224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":2350816224},{"type":"v1","addr":"172.21.15.7:6837","nonce":2350816224}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14823,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/1669980572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":1669980572},{"type":"v1","addr":"172.21.15.7:6839","nonce":1669980572}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14835,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/2528308973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":2528308973},{"type":"v1","addr":"172.21.15.7:6841","nonce":2528308973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24623,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1337382979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1337382979},{"type":"v1","addr":"172.21.15.18:6833","nonce":1337382979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/2751454345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":2751454345},{"type":"v1","addr":"172.21.15.144:6833","nonce":2751454345}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:34:24.627168+0000","modified":"2024-09-21T06:36:10.737288+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24716,"mds_1":24688,"mds_2":24686},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24656":{"gid":24656,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6835/158884796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":158884796},{"type":"v1","addr":"172.21.15.18:6835","nonce":158884796}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6835/3636739922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3636739922},{"type":"v1","addr":"172.21.15.144:6835","nonce":3636739922}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24673":{"gid":24673,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6837/1126341753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":1126341753},{"type":"v1","addr":"172.21.15.144:6837","nonce":1126341753}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.18:6837/1539670694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1539670694},{"type":"v1","addr":"172.21.15.18:6837","nonce":1539670694}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24688":{"gid":24688,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.144:6839/4027821922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":4027821922},{"type":"v1","addr":"172.21.15.144:6839","nonce":4027821922}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24716":{"gid":24716,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.18:6839/3798713532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":3798713532},{"type":"v1","addr":"172.21.15.18:6839","nonce":3798713532}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24716,"qdb_cluster":[24716,24688,24686]},"id":1}]} 2024-09-21T06:37:37.941 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-21T06:37:37.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:37.940+0000 7f9a6868a640 1 -- 172.21.15.7:0/4089865561 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f9a4c0b6700 msgr2=0x7f9a4c0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:37.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:37.940+0000 7f9a6868a640 1 --2- 172.21.15.7:0/4089865561 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f9a4c0b6700 0x7f9a4c0b8c10 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9a60077160 tx=0x7f9a5c005f90 comp rx=0 tx=0).stop 2024-09-21T06:37:37.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:37.940+0000 7f9a6868a640 1 -- 172.21.15.7:0/4089865561 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a601094a0 msgr2=0x7f9a60075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:37.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:37.940+0000 7f9a6868a640 1 --2- 172.21.15.7:0/4089865561 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a601094a0 0x7f9a60075c50 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f9a5400e9c0 tx=0x7f9a5400ee80 comp rx=0 tx=0).stop 2024-09-21T06:37:37.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:37.940+0000 7f9a6868a640 1 -- 172.21.15.7:0/4089865561 shutdown_connections 2024-09-21T06:37:37.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:37.940+0000 7f9a6868a640 1 --2- 172.21.15.7:0/4089865561 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f9a4c0b6700 0x7f9a4c0b8c10 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:37.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:37.940+0000 7f9a6868a640 1 --2- 172.21.15.7:0/4089865561 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a60109df0 0x7f9a60076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:37.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:37.940+0000 7f9a6868a640 1 --2- 172.21.15.7:0/4089865561 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9a601094a0 0x7f9a60075c50 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:37.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:37.940+0000 7f9a6868a640 1 --2- 172.21.15.7:0/4089865561 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9a60103b60 0x7f9a60075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:37.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:37.940+0000 7f9a6868a640 1 -- 172.21.15.7:0/4089865561 >> 172.21.15.7:0/4089865561 conn(0x7f9a6007b850 msgr2=0x7f9a601074f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:37.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:37.941+0000 7f9a6868a640 1 -- 172.21.15.7:0/4089865561 shutdown_connections 2024-09-21T06:37:37.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:37.941+0000 7f9a6868a640 1 -- 172.21.15.7:0/4089865561 wait complete. 2024-09-21T06:37:38.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:37:38 smithi144 ceph-mon[34653]: pgmap v362: 97 pgs: 97 active+clean; 1.0 GiB data, 560 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 171 MiB/s wr, 52 op/s 2024-09-21T06:37:38.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:37:38 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/4089865561' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:37:38.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:37:38 smithi007 ceph-mon[30983]: pgmap v362: 97 pgs: 97 active+clean; 1.0 GiB data, 560 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 171 MiB/s wr, 52 op/s 2024-09-21T06:37:38.591 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:37:38 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/4089865561' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:37:38.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:37:38 smithi018 ceph-mon[34477]: pgmap v362: 97 pgs: 97 active+clean; 1.0 GiB data, 560 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 171 MiB/s wr, 52 op/s 2024-09-21T06:37:38.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:37:38 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/4089865561' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:37:38.628 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:37:38.887 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:37:39.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.405+0000 7f6ba67eb640 1 -- 172.21.15.7:0/1487791976 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ba0102a60 msgr2=0x7f6ba0102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:39.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.405+0000 7f6ba67eb640 1 --2- 172.21.15.7:0/1487791976 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ba0102a60 0x7f6ba0102e70 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f6b90009900 tx=0x7f6b9002a410 comp rx=0 tx=0).stop 2024-09-21T06:37:39.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.405+0000 7f6ba67eb640 1 -- 172.21.15.7:0/1487791976 shutdown_connections 2024-09-21T06:37:39.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.405+0000 7f6ba67eb640 1 --2- 172.21.15.7:0/1487791976 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ba0108cf0 0x7f6ba010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.405+0000 7f6ba67eb640 1 --2- 172.21.15.7:0/1487791976 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ba01083a0 0x7f6ba01087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.405+0000 7f6ba67eb640 1 --2- 172.21.15.7:0/1487791976 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ba0102a60 0x7f6ba0102e70 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.405+0000 7f6ba67eb640 1 -- 172.21.15.7:0/1487791976 >> 172.21.15.7:0/1487791976 conn(0x7f6ba0079730 msgr2=0x7f6ba0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:39.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.405+0000 7f6ba67eb640 1 -- 172.21.15.7:0/1487791976 shutdown_connections 2024-09-21T06:37:39.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.405+0000 7f6ba67eb640 1 -- 172.21.15.7:0/1487791976 wait complete. 2024-09-21T06:37:39.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.406+0000 7f6ba67eb640 1 Processor -- start 2024-09-21T06:37:39.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.406+0000 7f6ba67eb640 1 -- start start 2024-09-21T06:37:39.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.406+0000 7f6ba67eb640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ba0102a60 0x7f6ba019b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:39.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.406+0000 7f6ba67eb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ba01083a0 0x7f6ba019b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:39.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.406+0000 7f6ba67eb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ba0108cf0 0x7f6ba019bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:39.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.406+0000 7f6ba67eb640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6ba0112960 con 0x7f6ba01083a0 2024-09-21T06:37:39.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.406+0000 7f6ba67eb640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6ba01127e0 con 0x7f6ba0108cf0 2024-09-21T06:37:39.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.406+0000 7f6ba67eb640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6ba0112ae0 con 0x7f6ba0102a60 2024-09-21T06:37:39.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.406+0000 7f6b97fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ba01083a0 0x7f6ba019b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:39.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.406+0000 7f6b97fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ba01083a0 0x7f6ba019b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42070/0 (socket says 172.21.15.7:42070) 2024-09-21T06:37:39.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.406+0000 7f6b97fff640 1 -- 172.21.15.7:0/3089737308 learned_addr learned my addr 172.21.15.7:0/3089737308 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:37:39.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.406+0000 7f6b9ffff640 1 --2- 172.21.15.7:0/3089737308 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ba0102a60 0x7f6ba019b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:39.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.407+0000 7f6ba4d88640 1 --2- 172.21.15.7:0/3089737308 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ba0108cf0 0x7f6ba019bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:39.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.407+0000 7f6b97fff640 1 -- 172.21.15.7:0/3089737308 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ba0102a60 msgr2=0x7f6ba019b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:39.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.407+0000 7f6b97fff640 1 --2- 172.21.15.7:0/3089737308 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ba0102a60 0x7f6ba019b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.407+0000 7f6b97fff640 1 -- 172.21.15.7:0/3089737308 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ba0108cf0 msgr2=0x7f6ba019bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:39.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.407+0000 7f6b97fff640 1 --2- 172.21.15.7:0/3089737308 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ba0108cf0 0x7f6ba019bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.407+0000 7f6b97fff640 1 -- 172.21.15.7:0/3089737308 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ba01a6540 con 0x7f6ba01083a0 2024-09-21T06:37:39.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.407+0000 7f6b97fff640 1 --2- 172.21.15.7:0/3089737308 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ba01083a0 0x7f6ba019b770 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f6b8800d740 tx=0x7f6b8800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:39.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.407+0000 7f6b9dffb640 1 -- 172.21.15.7:0/3089737308 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b88017070 con 0x7f6ba01083a0 2024-09-21T06:37:39.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.407+0000 7f6b9dffb640 1 -- 172.21.15.7:0/3089737308 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b8800de50 con 0x7f6ba01083a0 2024-09-21T06:37:39.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.407+0000 7f6ba67eb640 1 -- 172.21.15.7:0/3089737308 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ba01a6830 con 0x7f6ba01083a0 2024-09-21T06:37:39.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.407+0000 7f6b9dffb640 1 -- 172.21.15.7:0/3089737308 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b88004ce0 con 0x7f6ba01083a0 2024-09-21T06:37:39.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.407+0000 7f6ba67eb640 1 -- 172.21.15.7:0/3089737308 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ba01a6d70 con 0x7f6ba01083a0 2024-09-21T06:37:39.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.410+0000 7f6bacd5f740 1 Processor -- start 2024-09-21T06:37:39.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.410+0000 7f6bacd5f740 1 -- start start 2024-09-21T06:37:39.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.410+0000 7f6bacd5f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ba010ef070 0x55ba014966a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:39.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.410+0000 7f6bacd5f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ba010c61b0 0x55ba01496be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:39.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.410+0000 7f6bacd5f740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ba010ce390 0x55ba01497120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:39.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.410+0000 7f6bacd5f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55ba0140cea0 con 0x55ba010ef070 2024-09-21T06:37:39.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.410+0000 7f6bacd5f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55ba013fc2d0 con 0x55ba010c61b0 2024-09-21T06:37:39.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.410+0000 7f6bacd5f740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55ba014000e0 con 0x55ba010ce390 2024-09-21T06:37:39.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.410+0000 7f6b9dffb640 1 -- 172.21.15.7:0/3089737308 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f6b88004e80 con 0x7f6ba01083a0 2024-09-21T06:37:39.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.410+0000 7f6ba4d88640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ba010ef070 0x55ba014966a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:39.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.410+0000 7f6ba4d88640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ba010ef070 0x55ba014966a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42086/0 (socket says 172.21.15.7:42086) 2024-09-21T06:37:39.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.410+0000 7f6ba4d88640 1 -- 172.21.15.7:0/882122527 learned_addr learned my addr 172.21.15.7:0/882122527 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:37:39.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.411+0000 7f6b9ffff640 1 --2- 172.21.15.7:0/882122527 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ba010c61b0 0x55ba01496be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:39.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.411+0000 7f6b97fff640 1 --2- 172.21.15.7:0/882122527 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ba010ce390 0x55ba01497120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:39.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.411+0000 7f6ba4d88640 1 -- 172.21.15.7:0/882122527 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ba010ce390 msgr2=0x55ba01497120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:39.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.411+0000 7f6ba4d88640 1 --2- 172.21.15.7:0/882122527 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ba010ce390 0x55ba01497120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.411+0000 7f6ba4d88640 1 -- 172.21.15.7:0/882122527 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ba010c61b0 msgr2=0x55ba01496be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:39.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.411+0000 7f6ba4d88640 1 --2- 172.21.15.7:0/882122527 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ba010c61b0 0x55ba01496be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.411+0000 7f6ba4d88640 1 -- 172.21.15.7:0/882122527 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba0115a650 con 0x55ba010ef070 2024-09-21T06:37:39.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.411+0000 7f6b97fff640 1 --2- 172.21.15.7:0/882122527 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ba010ce390 0x55ba01497120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:37:39.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.411+0000 7f6b9ffff640 1 --2- 172.21.15.7:0/882122527 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ba010c61b0 0x55ba01496be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:37:39.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.411+0000 7f6ba4d88640 1 --2- 172.21.15.7:0/882122527 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ba010ef070 0x55ba014966a0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f6b98009f90 tx=0x7f6b980118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f18277cf130958b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:39.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.411+0000 7f6b967fc640 1 -- 172.21.15.7:0/882122527 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b98004d20 con 0x55ba010ef070 2024-09-21T06:37:39.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.411+0000 7f6b967fc640 1 -- 172.21.15.7:0/882122527 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b98004050 con 0x55ba010ef070 2024-09-21T06:37:39.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.411+0000 7f6b967fc640 1 -- 172.21.15.7:0/882122527 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b98005260 con 0x55ba010ef070 2024-09-21T06:37:39.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.412+0000 7f6b9dffb640 1 --2- 172.21.15.7:0/3089737308 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f6b8c0b6700 0x7f6b8c0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:39.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.412+0000 7f6b9ffff640 1 --2- 172.21.15.7:0/3089737308 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f6b8c0b6700 0x7f6b8c0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:39.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.412+0000 7f6b9dffb640 1 -- 172.21.15.7:0/3089737308 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f6b880e6f30 con 0x7f6ba01083a0 2024-09-21T06:37:39.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.412+0000 7f6bacd5f740 1 -- 172.21.15.7:0/882122527 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ba010ef070 msgr2=0x55ba014966a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:39.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.412+0000 7f6bacd5f740 1 --2- 172.21.15.7:0/882122527 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ba010ef070 0x55ba014966a0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f6b98009f90 tx=0x7f6b980118d0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.412+0000 7f6bacd5f740 1 -- 172.21.15.7:0/882122527 shutdown_connections 2024-09-21T06:37:39.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.412+0000 7f6bacd5f740 1 --2- 172.21.15.7:0/882122527 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ba010ce390 0x55ba01497120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.412+0000 7f6bacd5f740 1 --2- 172.21.15.7:0/882122527 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ba010c61b0 0x55ba01496be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.412+0000 7f6bacd5f740 1 --2- 172.21.15.7:0/882122527 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ba010ef070 0x55ba014966a0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.412+0000 7f6bacd5f740 1 -- 172.21.15.7:0/882122527 >> 172.21.15.7:0/882122527 conn(0x55ba010e3460 msgr2=0x55ba01494590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:39.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.413+0000 7f6bacd5f740 1 -- 172.21.15.7:0/882122527 shutdown_connections 2024-09-21T06:37:39.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.413+0000 7f6b9ffff640 1 --2- 172.21.15.7:0/3089737308 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f6b8c0b6700 0x7f6b8c0b8c10 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6b90000c00 tx=0x7f6b90031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:39.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.413+0000 7f6bacd5f740 1 -- 172.21.15.7:0/882122527 wait complete. 2024-09-21T06:37:39.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.413+0000 7f6bacd5f740 1 -- start start 2024-09-21T06:37:39.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.413+0000 7f6bacd5f740 1 Processor -- start 2024-09-21T06:37:39.420 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.414+0000 7f6bacd5f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ba010c61b0 0x55ba014a1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:39.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.414+0000 7f6bacd5f740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ba010ce390 0x55ba014a22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:39.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.414+0000 7f6bacd5f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ba010ef070 0x55ba014ae170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:39.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.414+0000 7f6bacd5f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55ba0125d700 con 0x55ba010ef070 2024-09-21T06:37:39.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.414+0000 7f6bacd5f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55ba01397160 con 0x55ba010c61b0 2024-09-21T06:37:39.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.414+0000 7f6bacd5f740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55ba014a4e80 con 0x55ba010ce390 2024-09-21T06:37:39.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.414+0000 7f6bacd5f740 10 client.0 _ll_register_callbacks cb 0x55ba013b09e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:37:39.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.414+0000 7f6ba4d88640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ba010ef070 0x55ba014ae170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:39.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.414+0000 7f6ba4d88640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ba010ef070 0x55ba014ae170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42088/0 (socket says 172.21.15.7:42088) 2024-09-21T06:37:39.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.414+0000 7f6b97fff640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ba010ce390 0x55ba014a22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:39.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.414+0000 7f6ba4d88640 1 -- 172.21.15.7:0/921021372 learned_addr learned my addr 172.21.15.7:0/921021372 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:37:39.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.414+0000 7f6b9ffff640 1 --2- 172.21.15.7:0/921021372 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ba010c61b0 0x55ba014a1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:39.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.414+0000 7f6ba4d88640 1 -- 172.21.15.7:0/921021372 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ba010ce390 msgr2=0x55ba014a22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:39.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.414+0000 7f6ba4d88640 1 --2- 172.21.15.7:0/921021372 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ba010ce390 0x55ba014a22c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.414+0000 7f6ba4d88640 1 -- 172.21.15.7:0/921021372 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ba010c61b0 msgr2=0x55ba014a1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:39.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.414+0000 7f6ba4d88640 1 --2- 172.21.15.7:0/921021372 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ba010c61b0 0x55ba014a1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.414+0000 7f6ba4d88640 1 -- 172.21.15.7:0/921021372 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba013c4c90 con 0x55ba010ef070 2024-09-21T06:37:39.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.414+0000 7f6ba4d88640 1 --2- 172.21.15.7:0/921021372 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ba010ef070 0x55ba014ae170 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f6b98011dd0 tx=0x7f6b98004c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2db3ac1ea7040e7e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:39.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.414+0000 7f6b7f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:37:39.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.415+0000 7f6b7f7fe640 1 -- 172.21.15.7:0/921021372 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b98028070 con 0x55ba010ef070 2024-09-21T06:37:39.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.415+0000 7f6b7f7fe640 1 -- 172.21.15.7:0/921021372 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f6b98005040 con 0x55ba010ef070 2024-09-21T06:37:39.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.415+0000 7f6bacd5f740 1 -- 172.21.15.7:0/921021372 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b98004050 con 0x55ba010ef070 2024-09-21T06:37:39.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.415+0000 7f6b7f7fe640 1 -- 172.21.15.7:0/921021372 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6b98034050 con 0x55ba010ef070 2024-09-21T06:37:39.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.415+0000 7f6bacd5f740 10 client.15738 fetch_fsmap learned FSMap version 25 2024-09-21T06:37:39.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.415+0000 7f6bacd5f740 1 -- 172.21.15.7:0/921021372 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ba014b0ac0 con 0x55ba010ef070 2024-09-21T06:37:39.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.415+0000 7f6b7f7fe640 1 -- 172.21.15.7:0/921021372 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b98004050 con 0x55ba010ef070 2024-09-21T06:37:39.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.415+0000 7f6b7f7fe640 1 -- 172.21.15.7:0/921021372 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f6b9800f570 con 0x55ba010ef070 2024-09-21T06:37:39.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.415+0000 7f6bacd5f740 10 client.15738 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:37:39.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.415+0000 7f6bacd5f740 10 client.15738 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-21T06:37:39.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.415+0000 7f6bacd5f740 20 client.15738 populate_metadata read hostname 'smithi007' 2024-09-21T06:37:39.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.415+0000 7f6bacd5f740 1 --2- 172.21.15.7:0/921021372 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x55ba010ad9f0 0x55ba014b3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:39.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.415+0000 7f6bacd5f740 4 client.15738 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:37:39.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.415+0000 7f6bacd5f740 1 -- 172.21.15.7:0/921021372 --> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ba0140edf0 con 0x55ba010ad9f0 2024-09-21T06:37:39.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.416+0000 7f6b9ffff640 1 --2- 172.21.15.7:0/921021372 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x55ba010ad9f0 0x55ba014b3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:39.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.416+0000 7f6b9ffff640 1 --2- 172.21.15.7:0/921021372 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x55ba010ad9f0 0x55ba014b3ee0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9cd4c07833ffb8bf server_cookie=e59de619ac674d89 in_seq=0 out_seq=0 2024-09-21T06:37:39.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.416+0000 7f6b7f7fe640 10 client.15738 ms_handle_connect on v2:172.21.15.18:6836/1539670694 2024-09-21T06:37:39.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.417+0000 7f6b7f7fe640 1 -- 172.21.15.7:0/921021372 <== mds.2 v2:172.21.15.18:6836/1539670694 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ba0140edf0 con 0x55ba010ad9f0 2024-09-21T06:37:39.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.417+0000 7f6b7f7fe640 10 client.15738 handle_command_reply: tid=0 2024-09-21T06:37:39.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.417+0000 7f6bacd5f740 1 client.15738 shutdown 2024-09-21T06:37:39.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.417+0000 7f6bacd5f740 1 -- 172.21.15.7:0/921021372 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ba010ef070 msgr2=0x55ba014ae170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:39.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.417+0000 7f6bacd5f740 1 --2- 172.21.15.7:0/921021372 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ba010ef070 0x55ba014ae170 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f6b98011dd0 tx=0x7f6b98004c50 comp rx=0 tx=0).stop 2024-09-21T06:37:39.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.417+0000 7f6bacd5f740 1 -- 172.21.15.7:0/921021372 shutdown_connections 2024-09-21T06:37:39.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.417+0000 7f6bacd5f740 1 --2- 172.21.15.7:0/921021372 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x55ba010ad9f0 0x55ba014b3ee0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.417+0000 7f6bacd5f740 1 --2- 172.21.15.7:0/921021372 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ba010ef070 0x55ba014ae170 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.417+0000 7f6bacd5f740 1 --2- 172.21.15.7:0/921021372 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ba010ce390 0x55ba014a22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.417+0000 7f6bacd5f740 1 --2- 172.21.15.7:0/921021372 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ba010c61b0 0x55ba014a1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.417+0000 7f6bacd5f740 1 -- 172.21.15.7:0/921021372 >> 172.21.15.7:0/921021372 conn(0x55ba010e3460 msgr2=0x55ba01499850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:39.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.417+0000 7f6b7f7fe640 0 client.15738 ms_handle_reset on v2:172.21.15.18:6836/1539670694 2024-09-21T06:37:39.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.417+0000 7f6bacd5f740 1 -- 172.21.15.7:0/921021372 shutdown_connections 2024-09-21T06:37:39.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.417+0000 7f6bacd5f740 1 -- 172.21.15.7:0/921021372 wait complete. 2024-09-21T06:37:39.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.418+0000 7f6bacd5f740 20 client.15738 trim_cache size 0 max 16384 2024-09-21T06:37:39.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.431+0000 7f6bacd5f740 1 Processor -- start 2024-09-21T06:37:39.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.431+0000 7f6bacd5f740 1 -- start start 2024-09-21T06:37:39.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.431+0000 7f6bacd5f740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ba010c61b0 0x55ba01498090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:39.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.431+0000 7f6bacd5f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ba010ce390 0x55ba014a39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:39.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.431+0000 7f6bacd5f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ba010ef070 0x55ba01493bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:39.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.431+0000 7f6bacd5f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6ba01b1d30 con 0x55ba010ce390 2024-09-21T06:37:39.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.431+0000 7f6bacd5f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6ba01af600 con 0x55ba010ef070 2024-09-21T06:37:39.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.431+0000 7f6bacd5f740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6ba01ad450 con 0x55ba010c61b0 2024-09-21T06:37:39.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.431+0000 7f6b97fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ba010ce390 0x55ba014a39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:39.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.431+0000 7f6b97fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ba010ce390 0x55ba014a39b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42090/0 (socket says 172.21.15.7:42090) 2024-09-21T06:37:39.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.431+0000 7f6b97fff640 1 -- 172.21.15.7:0/3828890830 learned_addr learned my addr 172.21.15.7:0/3828890830 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:37:39.435 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.431+0000 7f6b9ffff640 1 --2- 172.21.15.7:0/3828890830 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ba010c61b0 0x55ba01498090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:39.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.431+0000 7f6ba4d88640 1 --2- 172.21.15.7:0/3828890830 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ba010ef070 0x55ba01493bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:39.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.432+0000 7f6b97fff640 1 -- 172.21.15.7:0/3828890830 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ba010c61b0 msgr2=0x55ba01498090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:39.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.432+0000 7f6b97fff640 1 --2- 172.21.15.7:0/3828890830 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ba010c61b0 0x55ba01498090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.432+0000 7f6b97fff640 1 -- 172.21.15.7:0/3828890830 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ba010ef070 msgr2=0x55ba01493bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:39.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.432+0000 7f6b97fff640 1 --2- 172.21.15.7:0/3828890830 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ba010ef070 0x55ba01493bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.432+0000 7f6b97fff640 1 -- 172.21.15.7:0/3828890830 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba014a0280 con 0x55ba010ce390 2024-09-21T06:37:39.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.432+0000 7f6b9ffff640 1 --2- 172.21.15.7:0/3828890830 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ba010c61b0 0x55ba01498090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:37:39.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.432+0000 7f6ba4d88640 1 --2- 172.21.15.7:0/3828890830 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ba010ef070 0x55ba01493bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:37:39.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.432+0000 7f6b97fff640 1 --2- 172.21.15.7:0/3828890830 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ba010ce390 0x55ba014a39b0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f6b880a94a0 tx=0x7f6b880d0040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9864e18fac9a9a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:39.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.432+0000 7f6b95ffb640 1 -- 172.21.15.7:0/3828890830 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b88020040 con 0x55ba010ce390 2024-09-21T06:37:39.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.432+0000 7f6b95ffb640 1 -- 172.21.15.7:0/3828890830 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b880b6840 con 0x55ba010ce390 2024-09-21T06:37:39.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.432+0000 7f6b95ffb640 1 -- 172.21.15.7:0/3828890830 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b880a8a80 con 0x55ba010ce390 2024-09-21T06:37:39.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.433+0000 7f6bacd5f740 1 -- 172.21.15.7:0/3828890830 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ba010ce390 msgr2=0x55ba014a39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:39.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.433+0000 7f6bacd5f740 1 --2- 172.21.15.7:0/3828890830 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ba010ce390 0x55ba014a39b0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f6b880a94a0 tx=0x7f6b880d0040 comp rx=0 tx=0).stop 2024-09-21T06:37:39.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.433+0000 7f6bacd5f740 1 -- 172.21.15.7:0/3828890830 shutdown_connections 2024-09-21T06:37:39.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.433+0000 7f6bacd5f740 1 --2- 172.21.15.7:0/3828890830 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ba010ef070 0x55ba01493bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.433+0000 7f6bacd5f740 1 --2- 172.21.15.7:0/3828890830 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ba010ce390 0x55ba014a39b0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.433+0000 7f6bacd5f740 1 --2- 172.21.15.7:0/3828890830 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ba010c61b0 0x55ba01498090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.433+0000 7f6bacd5f740 1 -- 172.21.15.7:0/3828890830 >> 172.21.15.7:0/3828890830 conn(0x55ba010e3460 msgr2=0x55ba014a32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:39.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.433+0000 7f6bacd5f740 1 -- 172.21.15.7:0/3828890830 shutdown_connections 2024-09-21T06:37:39.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.433+0000 7f6bacd5f740 1 -- 172.21.15.7:0/3828890830 wait complete. 2024-09-21T06:37:39.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.433+0000 7f6bacd5f740 1 -- start start 2024-09-21T06:37:39.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.433+0000 7f6bacd5f740 1 Processor -- start 2024-09-21T06:37:39.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.434+0000 7f6bacd5f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ba010c61b0 0x55ba014aa560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:39.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.434+0000 7f6bacd5f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ba010ce390 0x55ba014a5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:39.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.434+0000 7f6bacd5f740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ba010ef070 0x55ba014a5f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:39.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.434+0000 7f6bacd5f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6ba01adac0 con 0x55ba010ce390 2024-09-21T06:37:39.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.434+0000 7f6bacd5f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6ba01aef30 con 0x55ba010c61b0 2024-09-21T06:37:39.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.434+0000 7f6bacd5f740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6ba01ae190 con 0x55ba010ef070 2024-09-21T06:37:39.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.434+0000 7f6bacd5f740 10 client.0 _ll_register_callbacks cb 0x7f6b90009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:37:39.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.434+0000 7f6b97fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ba010ce390 0x55ba014a5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:39.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.434+0000 7f6b97fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ba010ce390 0x55ba014a5a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42106/0 (socket says 172.21.15.7:42106) 2024-09-21T06:37:39.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.434+0000 7f6b97fff640 1 -- 172.21.15.7:0/2115147332 learned_addr learned my addr 172.21.15.7:0/2115147332 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:37:39.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.434+0000 7f6ba4d88640 1 --2- 172.21.15.7:0/2115147332 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ba010ef070 0x55ba014a5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:39.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.434+0000 7f6b9ffff640 1 --2- 172.21.15.7:0/2115147332 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ba010c61b0 0x55ba014aa560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:39.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.434+0000 7f6b97fff640 1 -- 172.21.15.7:0/2115147332 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ba010ef070 msgr2=0x55ba014a5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:39.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.434+0000 7f6b97fff640 1 --2- 172.21.15.7:0/2115147332 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ba010ef070 0x55ba014a5f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.434+0000 7f6b97fff640 1 -- 172.21.15.7:0/2115147332 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ba010c61b0 msgr2=0x55ba014aa560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:39.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.434+0000 7f6b97fff640 1 --2- 172.21.15.7:0/2115147332 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ba010c61b0 0x55ba014aa560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.434+0000 7f6b97fff640 1 -- 172.21.15.7:0/2115147332 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba014a6490 con 0x55ba010ce390 2024-09-21T06:37:39.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.435+0000 7f6b97fff640 1 --2- 172.21.15.7:0/2115147332 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ba010ce390 0x55ba014a5a10 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f6b88009610 tx=0x7f6b880e4bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=701d9e9190b605ce server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:39.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.435+0000 7f6b7f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:37:39.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.435+0000 7f6b7f7fe640 1 -- 172.21.15.7:0/2115147332 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b8805c020 con 0x55ba010ce390 2024-09-21T06:37:39.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.435+0000 7f6b7f7fe640 1 -- 172.21.15.7:0/2115147332 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f6b880d4100 con 0x55ba010ce390 2024-09-21T06:37:39.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.435+0000 7f6bacd5f740 1 -- 172.21.15.7:0/2115147332 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b880b6840 con 0x55ba010ce390 2024-09-21T06:37:39.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.435+0000 7f6b7f7fe640 1 -- 172.21.15.7:0/2115147332 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6b8805c3c0 con 0x55ba010ce390 2024-09-21T06:37:39.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.435+0000 7f6bacd5f740 10 client.15744 fetch_fsmap learned FSMap version 25 2024-09-21T06:37:39.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.435+0000 7f6bacd5f740 1 -- 172.21.15.7:0/2115147332 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ba0151e310 con 0x55ba010ce390 2024-09-21T06:37:39.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.435+0000 7f6b7f7fe640 1 -- 172.21.15.7:0/2115147332 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b880b6840 con 0x55ba010ce390 2024-09-21T06:37:39.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.435+0000 7f6b7f7fe640 1 -- 172.21.15.7:0/2115147332 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f6b880abba0 con 0x55ba010ce390 2024-09-21T06:37:39.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.435+0000 7f6bacd5f740 10 client.15744 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:37:39.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.435+0000 7f6bacd5f740 10 client.15744 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-21T06:37:39.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.435+0000 7f6bacd5f740 20 client.15744 populate_metadata read hostname 'smithi007' 2024-09-21T06:37:39.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.435+0000 7f6bacd5f740 1 --2- 172.21.15.7:0/2115147332 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x55ba01082da0 0x55ba01520a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:39.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.435+0000 7f6bacd5f740 4 client.15744 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:37:39.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.435+0000 7f6bacd5f740 1 -- 172.21.15.7:0/2115147332 --> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ba0140a8a0 con 0x55ba01082da0 2024-09-21T06:37:39.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.436+0000 7f6b9ffff640 1 --2- 172.21.15.7:0/2115147332 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x55ba01082da0 0x55ba01520a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:39.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.436+0000 7f6b9ffff640 1 --2- 172.21.15.7:0/2115147332 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x55ba01082da0 0x55ba01520a20 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=675ee90072ac4dec server_cookie=871dceabcf61d636 in_seq=0 out_seq=0 2024-09-21T06:37:39.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.436+0000 7f6b7f7fe640 10 client.15744 ms_handle_connect on v2:172.21.15.18:6836/1539670694 2024-09-21T06:37:39.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.436+0000 7f6b7f7fe640 1 -- 172.21.15.7:0/2115147332 <== mds.2 v2:172.21.15.18:6836/1539670694 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ba0140a8a0 con 0x55ba01082da0 2024-09-21T06:37:39.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.436+0000 7f6b7f7fe640 10 client.15744 handle_command_reply: tid=0 2024-09-21T06:37:39.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.436+0000 7f6bacd5f740 1 client.15744 shutdown 2024-09-21T06:37:39.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.437+0000 7f6bacd5f740 1 -- 172.21.15.7:0/2115147332 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ba010ce390 msgr2=0x55ba014a5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:39.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.437+0000 7f6bacd5f740 1 --2- 172.21.15.7:0/2115147332 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ba010ce390 0x55ba014a5a10 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f6b88009610 tx=0x7f6b880e4bd0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.437+0000 7f6bacd5f740 1 -- 172.21.15.7:0/2115147332 shutdown_connections 2024-09-21T06:37:39.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.437+0000 7f6bacd5f740 1 --2- 172.21.15.7:0/2115147332 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x55ba01082da0 0x55ba01520a20 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.437+0000 7f6bacd5f740 1 --2- 172.21.15.7:0/2115147332 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ba010ef070 0x55ba014a5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.437+0000 7f6bacd5f740 1 --2- 172.21.15.7:0/2115147332 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ba010ce390 0x55ba014a5a10 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.437+0000 7f6bacd5f740 1 --2- 172.21.15.7:0/2115147332 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ba010c61b0 0x55ba014aa560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.437+0000 7f6bacd5f740 1 -- 172.21.15.7:0/2115147332 >> 172.21.15.7:0/2115147332 conn(0x55ba010e3460 msgr2=0x55ba01497f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:39.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.437+0000 7f6b7f7fe640 0 client.15744 ms_handle_reset on v2:172.21.15.18:6836/1539670694 2024-09-21T06:37:39.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.437+0000 7f6bacd5f740 1 -- 172.21.15.7:0/2115147332 shutdown_connections 2024-09-21T06:37:39.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.437+0000 7f6bacd5f740 1 -- 172.21.15.7:0/2115147332 wait complete. 2024-09-21T06:37:39.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.437+0000 7f6bacd5f740 20 client.15744 trim_cache size 0 max 16384 2024-09-21T06:37:39.446 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:37:39.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.437+0000 7f6ba67eb640 1 -- 172.21.15.7:0/3089737308 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f6b8c0b6700 msgr2=0x7f6b8c0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:39.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.437+0000 7f6ba67eb640 1 --2- 172.21.15.7:0/3089737308 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f6b8c0b6700 0x7f6b8c0b8c10 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6b90000c00 tx=0x7f6b90031400 comp rx=0 tx=0).stop 2024-09-21T06:37:39.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.437+0000 7f6ba67eb640 1 -- 172.21.15.7:0/3089737308 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ba01083a0 msgr2=0x7f6ba019b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:39.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.437+0000 7f6ba67eb640 1 --2- 172.21.15.7:0/3089737308 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ba01083a0 0x7f6ba019b770 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f6b8800d740 tx=0x7f6b8800dc00 comp rx=0 tx=0).stop 2024-09-21T06:37:39.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.438+0000 7f6ba67eb640 1 -- 172.21.15.7:0/3089737308 shutdown_connections 2024-09-21T06:37:39.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.438+0000 7f6ba67eb640 1 --2- 172.21.15.7:0/3089737308 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f6b8c0b6700 0x7f6b8c0b8c10 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.438+0000 7f6ba67eb640 1 --2- 172.21.15.7:0/3089737308 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ba0108cf0 0x7f6ba019bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.438+0000 7f6ba67eb640 1 --2- 172.21.15.7:0/3089737308 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6ba01083a0 0x7f6ba019b770 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.438+0000 7f6ba67eb640 1 --2- 172.21.15.7:0/3089737308 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6ba0102a60 0x7f6ba019b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.438+0000 7f6ba67eb640 1 -- 172.21.15.7:0/3089737308 >> 172.21.15.7:0/3089737308 conn(0x7f6ba0079730 msgr2=0x7f6ba0101490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:39.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.438+0000 7f6ba67eb640 1 -- 172.21.15.7:0/3089737308 shutdown_connections 2024-09-21T06:37:39.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:39.438+0000 7f6ba67eb640 1 -- 172.21.15.7:0/3089737308 wait complete. 2024-09-21T06:37:39.589 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.585+0000 7fb742c64640 1 -- 172.21.15.7:0/62600224 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb73c108c40 msgr2=0x7fb73c10f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:39.589 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.585+0000 7fb742c64640 1 --2- 172.21.15.7:0/62600224 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb73c108c40 0x7fb73c10f470 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fb734009ca0 tx=0x7fb73402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.590 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.586+0000 7fb742c64640 1 -- 172.21.15.7:0/62600224 shutdown_connections 2024-09-21T06:37:39.590 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.586+0000 7fb742c64640 1 --2- 172.21.15.7:0/62600224 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb73c108c40 0x7fb73c10f470 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.590 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.586+0000 7fb742c64640 1 --2- 172.21.15.7:0/62600224 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb73c1082f0 0x7fb73c108700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.590 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.586+0000 7fb742c64640 1 --2- 172.21.15.7:0/62600224 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb73c1029c0 0x7fb73c102dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.590 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.586+0000 7fb742c64640 1 -- 172.21.15.7:0/62600224 >> 172.21.15.7:0/62600224 conn(0x7fb73c0fe3c0 msgr2=0x7fb73c100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:39.590 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.586+0000 7fb742c64640 1 -- 172.21.15.7:0/62600224 shutdown_connections 2024-09-21T06:37:39.590 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.586+0000 7fb742c64640 1 -- 172.21.15.7:0/62600224 wait complete. 2024-09-21T06:37:39.590 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.586+0000 7fb742c64640 1 Processor -- start 2024-09-21T06:37:39.590 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.586+0000 7fb742c64640 1 -- start start 2024-09-21T06:37:39.590 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.587+0000 7fb742c64640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb73c1029c0 0x7fb73c19a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:39.590 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.587+0000 7fb742c64640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb73c1082f0 0x7fb73c19a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:39.590 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.587+0000 7fb742c64640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb73c108c40 0x7fb73c19fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:39.590 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.587+0000 7fb742c64640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb73c112900 con 0x7fb73c1082f0 2024-09-21T06:37:39.591 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.587+0000 7fb742c64640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb73c112780 con 0x7fb73c1029c0 2024-09-21T06:37:39.591 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.587+0000 7fb742c64640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb73c112a80 con 0x7fb73c108c40 2024-09-21T06:37:39.591 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.587+0000 7fb73bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb73c1082f0 0x7fb73c19a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:39.591 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.587+0000 7fb73bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb73c1082f0 0x7fb73c19a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42132/0 (socket says 172.21.15.7:42132) 2024-09-21T06:37:39.591 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.587+0000 7fb73bfff640 1 -- 172.21.15.7:0/3536851124 learned_addr learned my addr 172.21.15.7:0/3536851124 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:37:39.591 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.587+0000 7fb740a00640 1 --2- 172.21.15.7:0/3536851124 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb73c1029c0 0x7fb73c19a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:39.591 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.587+0000 7fb741201640 1 --2- 172.21.15.7:0/3536851124 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb73c108c40 0x7fb73c19fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:39.591 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.587+0000 7fb73bfff640 1 -- 172.21.15.7:0/3536851124 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb73c108c40 msgr2=0x7fb73c19fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:39.591 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.587+0000 7fb73bfff640 1 --2- 172.21.15.7:0/3536851124 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb73c108c40 0x7fb73c19fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.591 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.587+0000 7fb73bfff640 1 -- 172.21.15.7:0/3536851124 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb73c1029c0 msgr2=0x7fb73c19a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:39.591 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.587+0000 7fb73bfff640 1 --2- 172.21.15.7:0/3536851124 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb73c1029c0 0x7fb73c19a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.591 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.587+0000 7fb73bfff640 1 -- 172.21.15.7:0/3536851124 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb73c1a0380 con 0x7fb73c1082f0 2024-09-21T06:37:39.591 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.587+0000 7fb740a00640 1 --2- 172.21.15.7:0/3536851124 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb73c1029c0 0x7fb73c19a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:37:39.591 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.587+0000 7fb741201640 1 --2- 172.21.15.7:0/3536851124 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb73c108c40 0x7fb73c19fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:37:39.592 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.587+0000 7fb73bfff640 1 --2- 172.21.15.7:0/3536851124 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb73c1082f0 0x7fb73c19a9f0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fb72800e970 tx=0x7fb72800ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:39.592 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.587+0000 7fb739ffb640 1 -- 172.21.15.7:0/3536851124 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb72800cd80 con 0x7fb73c1082f0 2024-09-21T06:37:39.592 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.587+0000 7fb742c64640 1 -- 172.21.15.7:0/3536851124 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb73c1a0670 con 0x7fb73c1082f0 2024-09-21T06:37:39.592 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.587+0000 7fb739ffb640 1 -- 172.21.15.7:0/3536851124 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb7280035f0 con 0x7fb73c1082f0 2024-09-21T06:37:39.592 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.587+0000 7fb739ffb640 1 -- 172.21.15.7:0/3536851124 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb728010690 con 0x7fb73c1082f0 2024-09-21T06:37:39.592 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.588+0000 7fb742c64640 1 -- 172.21.15.7:0/3536851124 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb73c1a6e00 con 0x7fb73c1082f0 2024-09-21T06:37:39.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.590+0000 7fb739ffb640 1 -- 172.21.15.7:0/3536851124 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7fb728003aa0 con 0x7fb73c1082f0 2024-09-21T06:37:39.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.591+0000 7fb749bce740 1 Processor -- start 2024-09-21T06:37:39.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.591+0000 7fb749bce740 1 -- start start 2024-09-21T06:37:39.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.591+0000 7fb749bce740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5629ce0751b0 0x5629ce41a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:39.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.591+0000 7fb739ffb640 1 --2- 172.21.15.7:0/3536851124 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fb72c0b6680 0x7fb72c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:39.594 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.591+0000 7fb749bce740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629ce04c2f0 0x5629ce41aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:39.595 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.591+0000 7fb749bce740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5629ce0544d0 0x5629ce41b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:39.595 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.591+0000 7fb749bce740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5629ce38f6f0 con 0x5629ce04c2f0 2024-09-21T06:37:39.595 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.591+0000 7fb749bce740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5629ce37eb20 con 0x5629ce0544d0 2024-09-21T06:37:39.595 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.591+0000 7fb749bce740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5629ce382930 con 0x5629ce0751b0 2024-09-21T06:37:39.595 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.591+0000 7fb73bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629ce04c2f0 0x5629ce41aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:39.595 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.591+0000 7fb740a00640 1 --2- 172.21.15.7:0/3536851124 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fb72c0b6680 0x7fb72c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:39.595 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.591+0000 7fb73bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629ce04c2f0 0x5629ce41aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42136/0 (socket says 172.21.15.7:42136) 2024-09-21T06:37:39.595 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.591+0000 7fb73bfff640 1 -- 172.21.15.7:0/2040371640 learned_addr learned my addr 172.21.15.7:0/2040371640 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:37:39.595 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.591+0000 7fb741201640 1 --2- 172.21.15.7:0/2040371640 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5629ce0544d0 0x5629ce41b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:39.595 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.591+0000 7fb739ffb640 1 -- 172.21.15.7:0/3536851124 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fb7280e7a20 con 0x7fb73c1082f0 2024-09-21T06:37:39.595 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.592+0000 7fb73bfff640 1 -- 172.21.15.7:0/2040371640 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5629ce0751b0 msgr2=0x5629ce41a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:39.595 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.592+0000 7fb73bfff640 1 --2- 172.21.15.7:0/2040371640 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5629ce0751b0 0x5629ce41a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.595 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.592+0000 7fb73bfff640 1 -- 172.21.15.7:0/2040371640 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5629ce0544d0 msgr2=0x5629ce41b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:39.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.592+0000 7fb73bfff640 1 --2- 172.21.15.7:0/2040371640 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5629ce0544d0 0x5629ce41b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.592+0000 7fb73bfff640 1 -- 172.21.15.7:0/2040371640 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629ce344530 con 0x5629ce04c2f0 2024-09-21T06:37:39.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.592+0000 7fb741201640 1 --2- 172.21.15.7:0/2040371640 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5629ce0544d0 0x5629ce41b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:37:39.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.592+0000 7fb740a00640 1 --2- 172.21.15.7:0/3536851124 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fb72c0b6680 0x7fb72c0b8b90 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb730009c30 tx=0x7fb730005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:39.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.592+0000 7fb73bfff640 1 --2- 172.21.15.7:0/2040371640 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629ce04c2f0 0x5629ce41aef0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fb7280a9ea0 tx=0x7fb7280a9f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78ddf494845274a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:39.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.592+0000 7fb726ffd640 1 -- 172.21.15.7:0/2040371640 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7280ad220 con 0x5629ce04c2f0 2024-09-21T06:37:39.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.592+0000 7fb726ffd640 1 -- 172.21.15.7:0/2040371640 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb7280ad3e0 con 0x5629ce04c2f0 2024-09-21T06:37:39.596 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.592+0000 7fb726ffd640 1 -- 172.21.15.7:0/2040371640 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7280037a0 con 0x5629ce04c2f0 2024-09-21T06:37:39.600 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.593+0000 7fb749bce740 1 -- 172.21.15.7:0/2040371640 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629ce04c2f0 msgr2=0x5629ce41aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:39.600 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.593+0000 7fb749bce740 1 --2- 172.21.15.7:0/2040371640 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629ce04c2f0 0x5629ce41aef0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fb7280a9ea0 tx=0x7fb7280a9f20 comp rx=0 tx=0).stop 2024-09-21T06:37:39.600 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.593+0000 7fb749bce740 1 -- 172.21.15.7:0/2040371640 shutdown_connections 2024-09-21T06:37:39.600 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.593+0000 7fb749bce740 1 --2- 172.21.15.7:0/2040371640 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5629ce0544d0 0x5629ce41b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.601 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.593+0000 7fb749bce740 1 --2- 172.21.15.7:0/2040371640 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629ce04c2f0 0x5629ce41aef0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.601 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.593+0000 7fb749bce740 1 --2- 172.21.15.7:0/2040371640 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5629ce0751b0 0x5629ce41a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.601 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.593+0000 7fb749bce740 1 -- 172.21.15.7:0/2040371640 >> 172.21.15.7:0/2040371640 conn(0x5629ce069300 msgr2=0x5629ce4188a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:39.601 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.593+0000 7fb749bce740 1 -- 172.21.15.7:0/2040371640 shutdown_connections 2024-09-21T06:37:39.601 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.593+0000 7fb749bce740 1 -- 172.21.15.7:0/2040371640 wait complete. 2024-09-21T06:37:39.601 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.593+0000 7fb749bce740 1 -- start start 2024-09-21T06:37:39.601 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.594+0000 7fb749bce740 1 Processor -- start 2024-09-21T06:37:39.601 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.594+0000 7fb749bce740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5629ce04c2f0 0x5629ce4260c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:39.601 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.594+0000 7fb749bce740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629ce0544d0 0x5629ce426600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:39.601 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.594+0000 7fb749bce740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5629ce0751b0 0x5629ce432450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:39.601 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.594+0000 7fb749bce740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5629ce2b6ab0 con 0x5629ce0544d0 2024-09-21T06:37:39.601 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.594+0000 7fb749bce740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5629ce324730 con 0x5629ce04c2f0 2024-09-21T06:37:39.601 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.594+0000 7fb749bce740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5629ce429130 con 0x5629ce0751b0 2024-09-21T06:37:39.601 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.594+0000 7fb749bce740 10 client.0 _ll_register_callbacks cb 0x5629ce3786b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:37:39.602 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.594+0000 7fb73bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629ce0544d0 0x5629ce426600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:39.602 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.594+0000 7fb73bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629ce0544d0 0x5629ce426600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42144/0 (socket says 172.21.15.7:42144) 2024-09-21T06:37:39.602 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.594+0000 7fb73bfff640 1 -- 172.21.15.7:0/3997183976 learned_addr learned my addr 172.21.15.7:0/3997183976 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:37:39.602 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.594+0000 7fb740a00640 1 --2- 172.21.15.7:0/3997183976 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5629ce04c2f0 0x5629ce4260c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:39.602 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.594+0000 7fb741201640 1 --2- 172.21.15.7:0/3997183976 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5629ce0751b0 0x5629ce432450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:39.602 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.595+0000 7fb73bfff640 1 -- 172.21.15.7:0/3997183976 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5629ce0751b0 msgr2=0x5629ce432450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:39.602 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.595+0000 7fb73bfff640 1 --2- 172.21.15.7:0/3997183976 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5629ce0751b0 0x5629ce432450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.602 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.595+0000 7fb73bfff640 1 -- 172.21.15.7:0/3997183976 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5629ce04c2f0 msgr2=0x5629ce4260c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:39.602 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.595+0000 7fb73bfff640 1 --2- 172.21.15.7:0/3997183976 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5629ce04c2f0 0x5629ce4260c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.602 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.595+0000 7fb73bfff640 1 -- 172.21.15.7:0/3997183976 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629ce0e0790 con 0x5629ce0544d0 2024-09-21T06:37:39.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.595+0000 7fb740a00640 1 --2- 172.21.15.7:0/3997183976 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5629ce04c2f0 0x5629ce4260c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:37:39.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.595+0000 7fb73bfff640 1 --2- 172.21.15.7:0/3997183976 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629ce0544d0 0x5629ce426600 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fb7280058c0 tx=0x7fb7280b3a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0f263a86f136f06 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:39.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.595+0000 7fb71bfff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:37:39.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.595+0000 7fb71bfff640 1 -- 172.21.15.7:0/3997183976 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7280b3540 con 0x5629ce0544d0 2024-09-21T06:37:39.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.595+0000 7fb71bfff640 1 -- 172.21.15.7:0/3997183976 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fb7280b2150 con 0x5629ce0544d0 2024-09-21T06:37:39.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.595+0000 7fb749bce740 1 -- 172.21.15.7:0/3997183976 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb7280ad3e0 con 0x5629ce0544d0 2024-09-21T06:37:39.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.595+0000 7fb71bfff640 1 -- 172.21.15.7:0/3997183976 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb7280b3b40 con 0x5629ce0544d0 2024-09-21T06:37:39.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.595+0000 7fb749bce740 10 client.15756 fetch_fsmap learned FSMap version 25 2024-09-21T06:37:39.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.595+0000 7fb749bce740 1 -- 172.21.15.7:0/3997183976 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5629ce159620 con 0x5629ce0544d0 2024-09-21T06:37:39.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.595+0000 7fb71bfff640 1 -- 172.21.15.7:0/3997183976 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb7280ad3e0 con 0x5629ce0544d0 2024-09-21T06:37:39.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.596+0000 7fb71bfff640 1 -- 172.21.15.7:0/3997183976 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb7280d3020 con 0x5629ce0544d0 2024-09-21T06:37:39.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.596+0000 7fb749bce740 10 client.15756 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:37:39.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.596+0000 7fb749bce740 10 client.15756 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:37:39.603 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.596+0000 7fb749bce740 20 client.15756 populate_metadata read hostname 'smithi007' 2024-09-21T06:37:39.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.596+0000 7fb749bce740 1 --2- 172.21.15.7:0/3997183976 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5629ce033d80 0x5629ce438060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:39.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.596+0000 7fb749bce740 4 client.15756 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:37:39.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.596+0000 7fb749bce740 1 -- 172.21.15.7:0/3997183976 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5629ce391640 con 0x5629ce033d80 2024-09-21T06:37:39.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.596+0000 7fb740a00640 1 --2- 172.21.15.7:0/3997183976 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5629ce033d80 0x5629ce438060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:39.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.597+0000 7fb740a00640 1 --2- 172.21.15.7:0/3997183976 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5629ce033d80 0x5629ce438060 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83d92473ba6df6ac server_cookie=d053e4c22652cc42 in_seq=0 out_seq=0 2024-09-21T06:37:39.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.597+0000 7fb71bfff640 10 client.15756 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:37:39.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.597+0000 7fb71bfff640 1 -- 172.21.15.7:0/3997183976 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5629ce391640 con 0x5629ce033d80 2024-09-21T06:37:39.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.597+0000 7fb71bfff640 10 client.15756 handle_command_reply: tid=0 2024-09-21T06:37:39.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.597+0000 7fb749bce740 1 client.15756 shutdown 2024-09-21T06:37:39.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.598+0000 7fb749bce740 1 -- 172.21.15.7:0/3997183976 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629ce0544d0 msgr2=0x5629ce426600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:39.604 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.598+0000 7fb749bce740 1 --2- 172.21.15.7:0/3997183976 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629ce0544d0 0x5629ce426600 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fb7280058c0 tx=0x7fb7280b3a00 comp rx=0 tx=0).stop 2024-09-21T06:37:39.605 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.598+0000 7fb749bce740 1 -- 172.21.15.7:0/3997183976 shutdown_connections 2024-09-21T06:37:39.605 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.598+0000 7fb749bce740 1 --2- 172.21.15.7:0/3997183976 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5629ce033d80 0x5629ce438060 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.605 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.598+0000 7fb749bce740 1 --2- 172.21.15.7:0/3997183976 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5629ce0751b0 0x5629ce432450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.605 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.598+0000 7fb749bce740 1 --2- 172.21.15.7:0/3997183976 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629ce0544d0 0x5629ce426600 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.605 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.598+0000 7fb71bfff640 0 client.15756 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:37:39.605 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.598+0000 7fb749bce740 1 --2- 172.21.15.7:0/3997183976 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5629ce04c2f0 0x5629ce4260c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.605 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.598+0000 7fb749bce740 1 -- 172.21.15.7:0/3997183976 >> 172.21.15.7:0/3997183976 conn(0x5629ce069300 msgr2=0x5629ce41b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:39.605 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.598+0000 7fb749bce740 1 -- 172.21.15.7:0/3997183976 shutdown_connections 2024-09-21T06:37:39.605 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.598+0000 7fb749bce740 1 -- 172.21.15.7:0/3997183976 wait complete. 2024-09-21T06:37:39.605 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.598+0000 7fb749bce740 20 client.15756 trim_cache size 0 max 16384 2024-09-21T06:37:39.619 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.612+0000 7fb749bce740 1 Processor -- start 2024-09-21T06:37:39.619 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.613+0000 7fb749bce740 1 -- start start 2024-09-21T06:37:39.619 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.613+0000 7fb749bce740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629ce04c2f0 0x5629ce4217f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.613+0000 7fb749bce740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5629ce0544d0 0x5629ce427fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.613+0000 7fb749bce740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5629ce0751b0 0x5629ce41c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.613+0000 7fb749bce740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb73c1b1ea0 con 0x5629ce04c2f0 2024-09-21T06:37:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.613+0000 7fb749bce740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb73c1af770 con 0x5629ce0751b0 2024-09-21T06:37:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.613+0000 7fb749bce740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb73c1ad5a0 con 0x5629ce0544d0 2024-09-21T06:37:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.613+0000 7fb740a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629ce04c2f0 0x5629ce4217f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.613+0000 7fb740a00640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629ce04c2f0 0x5629ce4217f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42154/0 (socket says 172.21.15.7:42154) 2024-09-21T06:37:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.613+0000 7fb740a00640 1 -- 172.21.15.7:0/409399652 learned_addr learned my addr 172.21.15.7:0/409399652 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:37:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.613+0000 7fb73bfff640 1 --2- 172.21.15.7:0/409399652 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5629ce0544d0 0x5629ce427fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.613+0000 7fb740a00640 1 -- 172.21.15.7:0/409399652 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5629ce0544d0 msgr2=0x5629ce427fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.613+0000 7fb741201640 1 --2- 172.21.15.7:0/409399652 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5629ce0751b0 0x5629ce41c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.613+0000 7fb740a00640 1 --2- 172.21.15.7:0/409399652 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5629ce0544d0 0x5629ce427fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.613+0000 7fb740a00640 1 -- 172.21.15.7:0/409399652 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5629ce0751b0 msgr2=0x5629ce41c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.613+0000 7fb740a00640 1 --2- 172.21.15.7:0/409399652 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5629ce0751b0 0x5629ce41c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.621 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.613+0000 7fb740a00640 1 -- 172.21.15.7:0/409399652 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629ce4205b0 con 0x5629ce04c2f0 2024-09-21T06:37:39.621 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.613+0000 7fb73bfff640 1 --2- 172.21.15.7:0/409399652 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5629ce0544d0 0x5629ce427fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:37:39.621 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.613+0000 7fb741201640 1 --2- 172.21.15.7:0/409399652 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5629ce0751b0 0x5629ce41c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:37:39.621 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.613+0000 7fb740a00640 1 --2- 172.21.15.7:0/409399652 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629ce04c2f0 0x5629ce4217f0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fb7300095f0 tx=0x7fb730014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=265a627ad685d18c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:39.621 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.613+0000 7fb7267fc640 1 -- 172.21.15.7:0/409399652 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb73002d070 con 0x5629ce04c2f0 2024-09-21T06:37:39.621 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.614+0000 7fb7267fc640 1 -- 172.21.15.7:0/409399652 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb73000f3d0 con 0x5629ce04c2f0 2024-09-21T06:37:39.621 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.614+0000 7fb7267fc640 1 -- 172.21.15.7:0/409399652 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb73001e610 con 0x5629ce04c2f0 2024-09-21T06:37:39.621 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.614+0000 7fb749bce740 1 -- 172.21.15.7:0/409399652 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629ce04c2f0 msgr2=0x5629ce4217f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:39.621 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.614+0000 7fb749bce740 1 --2- 172.21.15.7:0/409399652 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629ce04c2f0 0x5629ce4217f0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fb7300095f0 tx=0x7fb730014000 comp rx=0 tx=0).stop 2024-09-21T06:37:39.621 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.614+0000 7fb749bce740 1 -- 172.21.15.7:0/409399652 shutdown_connections 2024-09-21T06:37:39.621 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.614+0000 7fb749bce740 1 --2- 172.21.15.7:0/409399652 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5629ce0751b0 0x5629ce41c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.621 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.614+0000 7fb749bce740 1 --2- 172.21.15.7:0/409399652 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5629ce0544d0 0x5629ce427fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.621 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.614+0000 7fb749bce740 1 --2- 172.21.15.7:0/409399652 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629ce04c2f0 0x5629ce4217f0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.621 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.614+0000 7fb749bce740 1 -- 172.21.15.7:0/409399652 >> 172.21.15.7:0/409399652 conn(0x5629ce069300 msgr2=0x5629ce41b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:39.621 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.614+0000 7fb749bce740 1 -- 172.21.15.7:0/409399652 shutdown_connections 2024-09-21T06:37:39.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.614+0000 7fb749bce740 1 -- 172.21.15.7:0/409399652 wait complete. 2024-09-21T06:37:39.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.615+0000 7fb749bce740 1 -- start start 2024-09-21T06:37:39.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.615+0000 7fb749bce740 1 Processor -- start 2024-09-21T06:37:39.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.615+0000 7fb749bce740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5629ce04c2f0 0x5629ce438b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:39.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.615+0000 7fb749bce740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629ce0544d0 0x5629ce439140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:39.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.615+0000 7fb749bce740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5629ce0751b0 0x5629ce499790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:39.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.615+0000 7fb749bce740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb73c1adc30 con 0x5629ce0544d0 2024-09-21T06:37:39.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.615+0000 7fb749bce740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb73c1af0a0 con 0x5629ce04c2f0 2024-09-21T06:37:39.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.615+0000 7fb749bce740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb73c1ae300 con 0x5629ce0751b0 2024-09-21T06:37:39.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.615+0000 7fb749bce740 10 client.0 _ll_register_callbacks cb 0x7fb7280b3420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:37:39.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.615+0000 7fb73bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629ce0544d0 0x5629ce439140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:39.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.615+0000 7fb73bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629ce0544d0 0x5629ce439140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42170/0 (socket says 172.21.15.7:42170) 2024-09-21T06:37:39.622 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.615+0000 7fb73bfff640 1 -- 172.21.15.7:0/907016674 learned_addr learned my addr 172.21.15.7:0/907016674 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:37:39.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.615+0000 7fb740a00640 1 --2- 172.21.15.7:0/907016674 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5629ce04c2f0 0x5629ce438b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:39.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.616+0000 7fb741201640 1 --2- 172.21.15.7:0/907016674 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5629ce0751b0 0x5629ce499790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:39.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.616+0000 7fb73bfff640 1 -- 172.21.15.7:0/907016674 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5629ce0751b0 msgr2=0x5629ce499790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:39.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.616+0000 7fb73bfff640 1 --2- 172.21.15.7:0/907016674 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5629ce0751b0 0x5629ce499790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.616+0000 7fb73bfff640 1 -- 172.21.15.7:0/907016674 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5629ce04c2f0 msgr2=0x5629ce438b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:39.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.616+0000 7fb73bfff640 1 --2- 172.21.15.7:0/907016674 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5629ce04c2f0 0x5629ce438b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.616+0000 7fb73bfff640 1 -- 172.21.15.7:0/907016674 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629ce499e30 con 0x5629ce0544d0 2024-09-21T06:37:39.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.616+0000 7fb741201640 1 --2- 172.21.15.7:0/907016674 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5629ce0751b0 0x5629ce499790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:37:39.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.616+0000 7fb73bfff640 1 --2- 172.21.15.7:0/907016674 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629ce0544d0 0x5629ce439140 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fb728097030 tx=0x7fb7280a9870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=570c3c91ec899817 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:39.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.616+0000 7fb71bfff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:37:39.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.616+0000 7fb71bfff640 1 -- 172.21.15.7:0/907016674 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7280ad040 con 0x5629ce0544d0 2024-09-21T06:37:39.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.616+0000 7fb749bce740 1 -- 172.21.15.7:0/907016674 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb73000f3d0 con 0x5629ce0544d0 2024-09-21T06:37:39.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.616+0000 7fb71bfff640 1 -- 172.21.15.7:0/907016674 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fb7280ac5a0 con 0x5629ce0544d0 2024-09-21T06:37:39.623 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.616+0000 7fb71bfff640 1 -- 172.21.15.7:0/907016674 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb7280b3540 con 0x5629ce0544d0 2024-09-21T06:37:39.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.616+0000 7fb749bce740 10 client.15762 fetch_fsmap learned FSMap version 25 2024-09-21T06:37:39.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.616+0000 7fb749bce740 1 -- 172.21.15.7:0/907016674 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5629ce4a2230 con 0x5629ce0544d0 2024-09-21T06:37:39.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.616+0000 7fb71bfff640 1 -- 172.21.15.7:0/907016674 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb73000f3d0 con 0x5629ce0544d0 2024-09-21T06:37:39.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.617+0000 7fb71bfff640 1 -- 172.21.15.7:0/907016674 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb7280d3070 con 0x5629ce0544d0 2024-09-21T06:37:39.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.617+0000 7fb749bce740 10 client.15762 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:37:39.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.617+0000 7fb749bce740 10 client.15762 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:37:39.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.617+0000 7fb749bce740 20 client.15762 populate_metadata read hostname 'smithi007' 2024-09-21T06:37:39.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.617+0000 7fb749bce740 1 --2- 172.21.15.7:0/907016674 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5629ce0091c0 0x5629ce4a47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:39.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.617+0000 7fb749bce740 4 client.15762 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T06:37:39.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.617+0000 7fb749bce740 1 -- 172.21.15.7:0/907016674 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5629ce38d0f0 con 0x5629ce0091c0 2024-09-21T06:37:39.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.617+0000 7fb740a00640 1 --2- 172.21.15.7:0/907016674 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5629ce0091c0 0x5629ce4a47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:39.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.618+0000 7fb71bfff640 10 client.15762 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:37:39.624 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.618+0000 7fb740a00640 1 --2- 172.21.15.7:0/907016674 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5629ce0091c0 0x5629ce4a47d0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47c4eecf0522450d server_cookie=fc7d7d80b3831f6b in_seq=0 out_seq=0 2024-09-21T06:37:39.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.625+0000 7fb71bfff640 1 -- 172.21.15.7:0/907016674 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5629ce38d0f0 con 0x5629ce0091c0 2024-09-21T06:37:39.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.625+0000 7fb71bfff640 10 client.15762 handle_command_reply: tid=0 2024-09-21T06:37:39.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.625+0000 7fb749bce740 1 client.15762 shutdown 2024-09-21T06:37:39.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.625+0000 7fb749bce740 1 -- 172.21.15.7:0/907016674 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629ce0544d0 msgr2=0x5629ce439140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:39.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.625+0000 7fb749bce740 1 --2- 172.21.15.7:0/907016674 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629ce0544d0 0x5629ce439140 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fb728097030 tx=0x7fb7280a9870 comp rx=0 tx=0).stop 2024-09-21T06:37:39.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.625+0000 7fb749bce740 1 -- 172.21.15.7:0/907016674 shutdown_connections 2024-09-21T06:37:39.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.625+0000 7fb749bce740 1 --2- 172.21.15.7:0/907016674 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5629ce0091c0 0x5629ce4a47d0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.626+0000 7fb749bce740 1 --2- 172.21.15.7:0/907016674 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5629ce0751b0 0x5629ce499790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.626+0000 7fb749bce740 1 --2- 172.21.15.7:0/907016674 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5629ce0544d0 0x5629ce439140 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.626+0000 7fb71bfff640 0 client.15762 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:37:39.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.626+0000 7fb749bce740 1 --2- 172.21.15.7:0/907016674 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5629ce04c2f0 0x5629ce438b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.628 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.626+0000 7fb749bce740 1 -- 172.21.15.7:0/907016674 >> 172.21.15.7:0/907016674 conn(0x5629ce069300 msgr2=0x5629ce427380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:39.629 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.626+0000 7fb749bce740 1 -- 172.21.15.7:0/907016674 shutdown_connections 2024-09-21T06:37:39.629 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.626+0000 7fb749bce740 1 -- 172.21.15.7:0/907016674 wait complete. 2024-09-21T06:37:39.629 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.626+0000 7fb749bce740 20 client.15762 trim_cache size 0 max 16384 2024-09-21T06:37:39.629 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-09-21T06:37:39.629 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-09-21T06:37:39.629 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-09-21T06:37:39.629 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-09-21T06:37:39.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.627+0000 7fb742c64640 1 -- 172.21.15.7:0/3536851124 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fb72c0b6680 msgr2=0x7fb72c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:39.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.627+0000 7fb742c64640 1 --2- 172.21.15.7:0/3536851124 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fb72c0b6680 0x7fb72c0b8b90 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb730009c30 tx=0x7fb730005f90 comp rx=0 tx=0).stop 2024-09-21T06:37:39.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.627+0000 7fb742c64640 1 -- 172.21.15.7:0/3536851124 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb73c1082f0 msgr2=0x7fb73c19a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:39.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.627+0000 7fb742c64640 1 --2- 172.21.15.7:0/3536851124 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb73c1082f0 0x7fb73c19a9f0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fb72800e970 tx=0x7fb72800ee30 comp rx=0 tx=0).stop 2024-09-21T06:37:39.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.627+0000 7fb742c64640 1 -- 172.21.15.7:0/3536851124 shutdown_connections 2024-09-21T06:37:39.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.627+0000 7fb742c64640 1 --2- 172.21.15.7:0/3536851124 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fb72c0b6680 0x7fb72c0b8b90 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.627+0000 7fb742c64640 1 --2- 172.21.15.7:0/3536851124 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb73c108c40 0x7fb73c19fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.630 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.627+0000 7fb742c64640 1 --2- 172.21.15.7:0/3536851124 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb73c1082f0 0x7fb73c19a9f0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.631 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.627+0000 7fb742c64640 1 --2- 172.21.15.7:0/3536851124 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb73c1029c0 0x7fb73c19a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:39.631 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.627+0000 7fb742c64640 1 -- 172.21.15.7:0/3536851124 >> 172.21.15.7:0/3536851124 conn(0x7fb73c0fe3c0 msgr2=0x7fb73c06b150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:39.631 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.627+0000 7fb742c64640 1 -- 172.21.15.7:0/3536851124 shutdown_connections 2024-09-21T06:37:39.631 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:39.627+0000 7fb742c64640 1 -- 172.21.15.7:0/3536851124 wait complete. 2024-09-21T06:37:40.157 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:37:40.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:37:40 smithi007 ceph-mon[30983]: pgmap v363: 97 pgs: 97 active+clean; 1.0 GiB data, 560 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 136 MiB/s wr, 45 op/s 2024-09-21T06:37:40.419 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:37:40.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:37:40 smithi144 ceph-mon[34653]: pgmap v363: 97 pgs: 97 active+clean; 1.0 GiB data, 560 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 136 MiB/s wr, 45 op/s 2024-09-21T06:37:40.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:37:40 smithi018 ceph-mon[34477]: pgmap v363: 97 pgs: 97 active+clean; 1.0 GiB data, 560 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 136 MiB/s wr, 45 op/s 2024-09-21T06:37:40.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.930+0000 7fa87aea3640 1 -- 172.21.15.7:0/3829169134 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa8741094a0 msgr2=0x7fa8741098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:40.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.930+0000 7fa87aea3640 1 --2- 172.21.15.7:0/3829169134 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa8741094a0 0x7fa8741098b0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fa860009900 tx=0x7fa86002a410 comp rx=0 tx=0).stop 2024-09-21T06:37:40.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.930+0000 7fa87aea3640 1 -- 172.21.15.7:0/3829169134 shutdown_connections 2024-09-21T06:37:40.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.930+0000 7fa87aea3640 1 --2- 172.21.15.7:0/3829169134 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa874109df0 0x7fa874110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:40.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.930+0000 7fa87aea3640 1 --2- 172.21.15.7:0/3829169134 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa8741094a0 0x7fa8741098b0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:40.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.930+0000 7fa87aea3640 1 --2- 172.21.15.7:0/3829169134 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa874103b60 0x7fa874103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:40.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.930+0000 7fa87aea3640 1 -- 172.21.15.7:0/3829169134 >> 172.21.15.7:0/3829169134 conn(0x7fa87407b850 msgr2=0x7fa87407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:40.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.930+0000 7fa87aea3640 1 -- 172.21.15.7:0/3829169134 shutdown_connections 2024-09-21T06:37:40.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.930+0000 7fa87aea3640 1 -- 172.21.15.7:0/3829169134 wait complete. 2024-09-21T06:37:40.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.930+0000 7fa87aea3640 1 Processor -- start 2024-09-21T06:37:40.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.930+0000 7fa87aea3640 1 -- start start 2024-09-21T06:37:40.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.931+0000 7fa87aea3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa874103b60 0x7fa87419a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:40.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.931+0000 7fa87aea3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa8741094a0 0x7fa87419ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:40.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.931+0000 7fa87aea3640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa874109df0 0x7fa87419fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:40.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.931+0000 7fa87aea3640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa874113ab0 con 0x7fa8741094a0 2024-09-21T06:37:40.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.931+0000 7fa87aea3640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa874113930 con 0x7fa874103b60 2024-09-21T06:37:40.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.931+0000 7fa87aea3640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa874113c30 con 0x7fa874109df0 2024-09-21T06:37:40.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.931+0000 7fa873fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa8741094a0 0x7fa87419ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:40.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.931+0000 7fa873fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa8741094a0 0x7fa87419ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43614/0 (socket says 172.21.15.7:43614) 2024-09-21T06:37:40.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.931+0000 7fa873fff640 1 -- 172.21.15.7:0/1935455142 learned_addr learned my addr 172.21.15.7:0/1935455142 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:37:40.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.931+0000 7fa879440640 1 --2- 172.21.15.7:0/1935455142 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa874109df0 0x7fa87419fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:40.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.931+0000 7fa878c3f640 1 --2- 172.21.15.7:0/1935455142 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa874103b60 0x7fa87419a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:40.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.931+0000 7fa873fff640 1 -- 172.21.15.7:0/1935455142 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa874109df0 msgr2=0x7fa87419fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:40.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.931+0000 7fa873fff640 1 --2- 172.21.15.7:0/1935455142 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa874109df0 0x7fa87419fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:40.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.931+0000 7fa873fff640 1 -- 172.21.15.7:0/1935455142 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa874103b60 msgr2=0x7fa87419a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:40.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.931+0000 7fa873fff640 1 --2- 172.21.15.7:0/1935455142 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa874103b60 0x7fa87419a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:40.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.931+0000 7fa873fff640 1 -- 172.21.15.7:0/1935455142 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8741a04f0 con 0x7fa8741094a0 2024-09-21T06:37:40.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.931+0000 7fa873fff640 1 --2- 172.21.15.7:0/1935455142 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa8741094a0 0x7fa87419ab20 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fa86002a930 tx=0x7fa860004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:40.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.932+0000 7fa871ffb640 1 -- 172.21.15.7:0/1935455142 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa86003f030 con 0x7fa8741094a0 2024-09-21T06:37:40.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.932+0000 7fa871ffb640 1 -- 172.21.15.7:0/1935455142 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa860003aa0 con 0x7fa8741094a0 2024-09-21T06:37:40.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.932+0000 7fa87aea3640 1 -- 172.21.15.7:0/1935455142 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8741a0780 con 0x7fa8741094a0 2024-09-21T06:37:40.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.932+0000 7fa871ffb640 1 -- 172.21.15.7:0/1935455142 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa860035070 con 0x7fa8741094a0 2024-09-21T06:37:40.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.932+0000 7fa87aea3640 1 -- 172.21.15.7:0/1935455142 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8741a6f40 con 0x7fa8741094a0 2024-09-21T06:37:40.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.935+0000 7fa881417740 1 Processor -- start 2024-09-21T06:37:40.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.935+0000 7fa881417740 1 -- start start 2024-09-21T06:37:40.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.935+0000 7fa871ffb640 1 -- 172.21.15.7:0/1935455142 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7fa860042030 con 0x7fa8741094a0 2024-09-21T06:37:40.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.935+0000 7fa881417740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56406d181070 0x56406d5286a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:40.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.935+0000 7fa881417740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56406d1581b0 0x56406d528be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:40.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.935+0000 7fa881417740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56406d160390 0x56406d529120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:40.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.935+0000 7fa881417740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56406d49eea0 con 0x56406d160390 2024-09-21T06:37:40.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.935+0000 7fa881417740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56406d48e2d0 con 0x56406d181070 2024-09-21T06:37:40.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.935+0000 7fa881417740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x56406d4920e0 con 0x56406d1581b0 2024-09-21T06:37:40.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.935+0000 7fa873fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56406d160390 0x56406d529120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:40.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.935+0000 7fa878c3f640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56406d1581b0 0x56406d528be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:40.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.935+0000 7fa873fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56406d160390 0x56406d529120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43620/0 (socket says 172.21.15.7:43620) 2024-09-21T06:37:40.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.935+0000 7fa873fff640 1 -- 172.21.15.7:0/1441604615 learned_addr learned my addr 172.21.15.7:0/1441604615 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:37:40.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.935+0000 7fa879440640 1 --2- 172.21.15.7:0/1441604615 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56406d181070 0x56406d5286a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:40.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.935+0000 7fa873fff640 1 -- 172.21.15.7:0/1441604615 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56406d1581b0 msgr2=0x56406d528be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:40.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.935+0000 7fa873fff640 1 --2- 172.21.15.7:0/1441604615 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56406d1581b0 0x56406d528be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:40.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.935+0000 7fa873fff640 1 -- 172.21.15.7:0/1441604615 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56406d181070 msgr2=0x56406d5286a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:40.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.936+0000 7fa873fff640 1 --2- 172.21.15.7:0/1441604615 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56406d181070 0x56406d5286a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:40.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.936+0000 7fa873fff640 1 -- 172.21.15.7:0/1441604615 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56406d1ec650 con 0x56406d160390 2024-09-21T06:37:40.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.936+0000 7fa879440640 1 --2- 172.21.15.7:0/1441604615 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56406d181070 0x56406d5286a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:37:40.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.936+0000 7fa871ffb640 1 --2- 172.21.15.7:0/1935455142 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa8640b6680 0x7fa8640b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:40.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.936+0000 7fa873fff640 1 --2- 172.21.15.7:0/1441604615 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56406d160390 0x56406d529120 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fa86010be90 tx=0x7fa86010bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d5d4ba1baaf367 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:40.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.936+0000 7fa879440640 1 --2- 172.21.15.7:0/1935455142 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa8640b6680 0x7fa8640b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:40.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.936+0000 7fa871ffb640 1 -- 172.21.15.7:0/1935455142 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fa860107d60 con 0x7fa8741094a0 2024-09-21T06:37:40.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.936+0000 7fa85effd640 1 -- 172.21.15.7:0/1441604615 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8600ca2a0 con 0x56406d160390 2024-09-21T06:37:40.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.936+0000 7fa85effd640 1 -- 172.21.15.7:0/1441604615 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa8600c93b0 con 0x56406d160390 2024-09-21T06:37:40.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.936+0000 7fa85effd640 1 -- 172.21.15.7:0/1441604615 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8600cd3c0 con 0x56406d160390 2024-09-21T06:37:40.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.937+0000 7fa881417740 1 -- 172.21.15.7:0/1441604615 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56406d160390 msgr2=0x56406d529120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:40.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.937+0000 7fa881417740 1 --2- 172.21.15.7:0/1441604615 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56406d160390 0x56406d529120 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fa86010be90 tx=0x7fa86010bf80 comp rx=0 tx=0).stop 2024-09-21T06:37:40.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.937+0000 7fa879440640 1 --2- 172.21.15.7:0/1935455142 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa8640b6680 0x7fa8640b8b90 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa86c005fd0 tx=0x7fa86c0096a0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:40.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.937+0000 7fa881417740 1 -- 172.21.15.7:0/1441604615 shutdown_connections 2024-09-21T06:37:40.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.937+0000 7fa881417740 1 --2- 172.21.15.7:0/1441604615 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56406d160390 0x56406d529120 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:40.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.937+0000 7fa881417740 1 --2- 172.21.15.7:0/1441604615 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56406d1581b0 0x56406d528be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:40.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.937+0000 7fa881417740 1 --2- 172.21.15.7:0/1441604615 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56406d181070 0x56406d5286a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:40.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.937+0000 7fa881417740 1 -- 172.21.15.7:0/1441604615 >> 172.21.15.7:0/1441604615 conn(0x56406d175460 msgr2=0x56406d526590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:40.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.937+0000 7fa881417740 1 -- 172.21.15.7:0/1441604615 shutdown_connections 2024-09-21T06:37:40.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.937+0000 7fa881417740 1 -- 172.21.15.7:0/1441604615 wait complete. 2024-09-21T06:37:40.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.938+0000 7fa881417740 1 -- start start 2024-09-21T06:37:40.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.938+0000 7fa881417740 1 Processor -- start 2024-09-21T06:37:40.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.939+0000 7fa881417740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56406d1581b0 0x56406d538100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:40.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.939+0000 7fa881417740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56406d160390 0x56406d538640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:40.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.939+0000 7fa881417740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56406d181070 0x56406d544220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:40.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.939+0000 7fa881417740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56406d2ef700 con 0x56406d160390 2024-09-21T06:37:40.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.939+0000 7fa881417740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56406d429160 con 0x56406d181070 2024-09-21T06:37:40.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.939+0000 7fa881417740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x56406d53af70 con 0x56406d1581b0 2024-09-21T06:37:40.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.939+0000 7fa881417740 10 client.0 _ll_register_callbacks cb 0x56406d4429e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:37:40.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.939+0000 7fa873fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56406d160390 0x56406d538640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:40.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.939+0000 7fa873fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56406d160390 0x56406d538640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43634/0 (socket says 172.21.15.7:43634) 2024-09-21T06:37:40.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.939+0000 7fa873fff640 1 -- 172.21.15.7:0/2279102710 learned_addr learned my addr 172.21.15.7:0/2279102710 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:37:40.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.939+0000 7fa878c3f640 1 --2- 172.21.15.7:0/2279102710 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56406d1581b0 0x56406d538100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:40.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.939+0000 7fa879440640 1 --2- 172.21.15.7:0/2279102710 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56406d181070 0x56406d544220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:40.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.939+0000 7fa873fff640 1 -- 172.21.15.7:0/2279102710 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56406d1581b0 msgr2=0x56406d538100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:40.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.939+0000 7fa873fff640 1 --2- 172.21.15.7:0/2279102710 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56406d1581b0 0x56406d538100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:40.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.939+0000 7fa873fff640 1 -- 172.21.15.7:0/2279102710 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56406d181070 msgr2=0x56406d544220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:40.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.939+0000 7fa873fff640 1 --2- 172.21.15.7:0/2279102710 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56406d181070 0x56406d544220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:40.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.939+0000 7fa873fff640 1 -- 172.21.15.7:0/2279102710 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56406d456c90 con 0x56406d160390 2024-09-21T06:37:40.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.939+0000 7fa879440640 1 --2- 172.21.15.7:0/2279102710 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56406d181070 0x56406d544220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:37:40.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.939+0000 7fa873fff640 1 --2- 172.21.15.7:0/2279102710 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56406d160390 0x56406d538640 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fa860032af0 tx=0x7fa860031a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49db1939773f097a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:40.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.939+0000 7fa853fff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:37:40.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.940+0000 7fa853fff640 1 -- 172.21.15.7:0/2279102710 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa860049030 con 0x56406d160390 2024-09-21T06:37:40.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.940+0000 7fa853fff640 1 -- 172.21.15.7:0/2279102710 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fa86003b460 con 0x56406d160390 2024-09-21T06:37:40.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.940+0000 7fa881417740 1 -- 172.21.15.7:0/2279102710 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa8600c93b0 con 0x56406d160390 2024-09-21T06:37:40.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.940+0000 7fa853fff640 1 -- 172.21.15.7:0/2279102710 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa8600cd5a0 con 0x56406d160390 2024-09-21T06:37:40.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.940+0000 7fa881417740 10 client.15774 fetch_fsmap learned FSMap version 25 2024-09-21T06:37:40.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.940+0000 7fa881417740 1 -- 172.21.15.7:0/2279102710 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56406d546be0 con 0x56406d160390 2024-09-21T06:37:40.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.940+0000 7fa853fff640 1 -- 172.21.15.7:0/2279102710 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa8600c93b0 con 0x56406d160390 2024-09-21T06:37:40.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.940+0000 7fa853fff640 1 -- 172.21.15.7:0/2279102710 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa86010e0c0 con 0x56406d160390 2024-09-21T06:37:40.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.940+0000 7fa881417740 10 client.15774 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:37:40.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.940+0000 7fa881417740 10 client.15774 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:37:40.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.940+0000 7fa881417740 20 client.15774 populate_metadata read hostname 'smithi007' 2024-09-21T06:37:40.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.940+0000 7fa881417740 1 --2- 172.21.15.7:0/2279102710 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x56406d13f9f0 0x56406d549f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:40.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.940+0000 7fa881417740 4 client.15774 mds_command: new command op to 24688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:37:40.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.940+0000 7fa881417740 1 -- 172.21.15.7:0/2279102710 --> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56406d4a0df0 con 0x56406d13f9f0 2024-09-21T06:37:40.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.941+0000 7fa878c3f640 1 --2- 172.21.15.7:0/2279102710 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x56406d13f9f0 0x56406d549f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:40.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.941+0000 7fa853fff640 10 client.15774 ms_handle_connect on v2:172.21.15.144:6838/4027821922 2024-09-21T06:37:40.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.941+0000 7fa878c3f640 1 --2- 172.21.15.7:0/2279102710 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x56406d13f9f0 0x56406d549f40 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=13bc1ffaf8bf0573 server_cookie=27ac64d8af845c in_seq=0 out_seq=0 2024-09-21T06:37:40.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.942+0000 7fa853fff640 1 -- 172.21.15.7:0/2279102710 <== mds.1 v2:172.21.15.144:6838/4027821922 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56406d4a0df0 con 0x56406d13f9f0 2024-09-21T06:37:40.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.942+0000 7fa853fff640 10 client.15774 handle_command_reply: tid=0 2024-09-21T06:37:40.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.942+0000 7fa881417740 1 client.15774 shutdown 2024-09-21T06:37:40.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.942+0000 7fa881417740 1 -- 172.21.15.7:0/2279102710 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56406d160390 msgr2=0x56406d538640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:40.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.942+0000 7fa881417740 1 --2- 172.21.15.7:0/2279102710 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56406d160390 0x56406d538640 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fa860032af0 tx=0x7fa860031a10 comp rx=0 tx=0).stop 2024-09-21T06:37:40.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.942+0000 7fa881417740 1 -- 172.21.15.7:0/2279102710 shutdown_connections 2024-09-21T06:37:40.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.942+0000 7fa881417740 1 --2- 172.21.15.7:0/2279102710 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x56406d13f9f0 0x56406d549f40 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:40.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.942+0000 7fa881417740 1 --2- 172.21.15.7:0/2279102710 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56406d181070 0x56406d544220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:40.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.942+0000 7fa881417740 1 --2- 172.21.15.7:0/2279102710 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56406d160390 0x56406d538640 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:40.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.942+0000 7fa881417740 1 --2- 172.21.15.7:0/2279102710 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56406d1581b0 0x56406d538100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:40.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.942+0000 7fa881417740 1 -- 172.21.15.7:0/2279102710 >> 172.21.15.7:0/2279102710 conn(0x56406d175460 msgr2=0x56406d52b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:40.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.942+0000 7fa853fff640 0 client.15774 ms_handle_reset on v2:172.21.15.144:6838/4027821922 2024-09-21T06:37:40.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.942+0000 7fa881417740 1 -- 172.21.15.7:0/2279102710 shutdown_connections 2024-09-21T06:37:40.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.942+0000 7fa881417740 1 -- 172.21.15.7:0/2279102710 wait complete. 2024-09-21T06:37:40.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.942+0000 7fa881417740 20 client.15774 trim_cache size 0 max 16384 2024-09-21T06:37:40.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.956+0000 7fa881417740 1 Processor -- start 2024-09-21T06:37:40.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.956+0000 7fa881417740 1 -- start start 2024-09-21T06:37:40.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.956+0000 7fa881417740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56406d1581b0 0x56406d5385c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:40.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.956+0000 7fa881417740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56406d160390 0x56406d544160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:40.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.956+0000 7fa881417740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56406d181070 0x56406d5352f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:40.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.956+0000 7fa881417740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa8741afc50 con 0x56406d1581b0 2024-09-21T06:37:40.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.956+0000 7fa881417740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa8741ad520 con 0x56406d181070 2024-09-21T06:37:40.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.956+0000 7fa881417740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa8741ab350 con 0x56406d160390 2024-09-21T06:37:40.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.956+0000 7fa878c3f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56406d1581b0 0x56406d5385c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:40.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.956+0000 7fa878c3f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56406d1581b0 0x56406d5385c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43638/0 (socket says 172.21.15.7:43638) 2024-09-21T06:37:40.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.956+0000 7fa878c3f640 1 -- 172.21.15.7:0/415462565 learned_addr learned my addr 172.21.15.7:0/415462565 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:37:40.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.956+0000 7fa879440640 1 --2- 172.21.15.7:0/415462565 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56406d181070 0x56406d5352f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:40.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.956+0000 7fa873fff640 1 --2- 172.21.15.7:0/415462565 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56406d160390 0x56406d544160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:40.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.956+0000 7fa878c3f640 1 -- 172.21.15.7:0/415462565 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56406d160390 msgr2=0x56406d544160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:40.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.956+0000 7fa878c3f640 1 --2- 172.21.15.7:0/415462565 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56406d160390 0x56406d544160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:40.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.956+0000 7fa878c3f640 1 -- 172.21.15.7:0/415462565 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56406d181070 msgr2=0x56406d5352f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:40.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.957+0000 7fa878c3f640 1 --2- 172.21.15.7:0/415462565 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56406d181070 0x56406d5352f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:40.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.957+0000 7fa878c3f640 1 -- 172.21.15.7:0/415462565 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56406d526e80 con 0x56406d1581b0 2024-09-21T06:37:40.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.957+0000 7fa879440640 1 --2- 172.21.15.7:0/415462565 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56406d181070 0x56406d5352f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:37:40.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.957+0000 7fa873fff640 1 --2- 172.21.15.7:0/415462565 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56406d160390 0x56406d544160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:37:40.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.957+0000 7fa878c3f640 1 --2- 172.21.15.7:0/415462565 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56406d1581b0 0x56406d5385c0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x56406d54a4e0 tx=0x7fa868013830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1826c8a0d3e0bbf7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:40.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.957+0000 7fa85e7fc640 1 -- 172.21.15.7:0/415462565 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa868013110 con 0x56406d1581b0 2024-09-21T06:37:40.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.957+0000 7fa85e7fc640 1 -- 172.21.15.7:0/415462565 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa8680132b0 con 0x56406d1581b0 2024-09-21T06:37:40.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.957+0000 7fa85e7fc640 1 -- 172.21.15.7:0/415462565 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa86801d430 con 0x56406d1581b0 2024-09-21T06:37:40.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.958+0000 7fa881417740 1 -- 172.21.15.7:0/415462565 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56406d1581b0 msgr2=0x56406d5385c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:40.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.958+0000 7fa881417740 1 --2- 172.21.15.7:0/415462565 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56406d1581b0 0x56406d5385c0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x56406d54a4e0 tx=0x7fa868013830 comp rx=0 tx=0).stop 2024-09-21T06:37:40.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.958+0000 7fa881417740 1 -- 172.21.15.7:0/415462565 shutdown_connections 2024-09-21T06:37:40.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.958+0000 7fa881417740 1 --2- 172.21.15.7:0/415462565 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56406d181070 0x56406d5352f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:40.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.958+0000 7fa881417740 1 --2- 172.21.15.7:0/415462565 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56406d160390 0x56406d544160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:40.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.958+0000 7fa881417740 1 --2- 172.21.15.7:0/415462565 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56406d1581b0 0x56406d5385c0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:40.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.958+0000 7fa881417740 1 -- 172.21.15.7:0/415462565 >> 172.21.15.7:0/415462565 conn(0x56406d175460 msgr2=0x56406d537eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:40.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.958+0000 7fa881417740 1 -- 172.21.15.7:0/415462565 shutdown_connections 2024-09-21T06:37:40.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.958+0000 7fa881417740 1 -- 172.21.15.7:0/415462565 wait complete. 2024-09-21T06:37:40.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.958+0000 7fa881417740 1 -- start start 2024-09-21T06:37:40.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.958+0000 7fa881417740 1 Processor -- start 2024-09-21T06:37:40.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.959+0000 7fa881417740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56406d1581b0 0x56406d53c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:40.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.959+0000 7fa881417740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56406d160390 0x56406d53ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:40.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.959+0000 7fa881417740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56406d181070 0x56406d5b37a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:40.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.959+0000 7fa881417740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa8741ab9e0 con 0x56406d160390 2024-09-21T06:37:40.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.959+0000 7fa881417740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa8741ace50 con 0x56406d181070 2024-09-21T06:37:40.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.959+0000 7fa881417740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa8741ac0b0 con 0x56406d1581b0 2024-09-21T06:37:40.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.959+0000 7fa881417740 10 client.0 _ll_register_callbacks cb 0x7fa86800b3a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:37:40.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.959+0000 7fa873fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56406d160390 0x56406d53ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:40.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.959+0000 7fa873fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56406d160390 0x56406d53ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43640/0 (socket says 172.21.15.7:43640) 2024-09-21T06:37:40.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.959+0000 7fa873fff640 1 -- 172.21.15.7:0/1878761258 learned_addr learned my addr 172.21.15.7:0/1878761258 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:37:40.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.959+0000 7fa879440640 1 --2- 172.21.15.7:0/1878761258 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56406d181070 0x56406d5b37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:40.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.959+0000 7fa873fff640 1 -- 172.21.15.7:0/1878761258 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56406d1581b0 msgr2=0x56406d53c4e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T06:37:40.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.959+0000 7fa873fff640 1 --2- 172.21.15.7:0/1878761258 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56406d1581b0 0x56406d53c4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:40.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.959+0000 7fa873fff640 1 -- 172.21.15.7:0/1878761258 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56406d181070 msgr2=0x56406d5b37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:40.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.959+0000 7fa873fff640 1 --2- 172.21.15.7:0/1878761258 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56406d181070 0x56406d5b37a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:40.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.959+0000 7fa873fff640 1 -- 172.21.15.7:0/1878761258 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56406d53d2a0 con 0x56406d160390 2024-09-21T06:37:40.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.960+0000 7fa873fff640 1 --2- 172.21.15.7:0/1878761258 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56406d160390 0x56406d53ca20 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fa86003bfd0 tx=0x7fa8600ca190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f039437bbe197cbe server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:40.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.960+0000 7fa853fff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:37:40.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.960+0000 7fa853fff640 1 -- 172.21.15.7:0/1878761258 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa860049060 con 0x56406d160390 2024-09-21T06:37:40.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.960+0000 7fa853fff640 1 -- 172.21.15.7:0/1878761258 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fa86010e4d0 con 0x56406d160390 2024-09-21T06:37:40.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.960+0000 7fa881417740 1 -- 172.21.15.7:0/1878761258 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa8680132b0 con 0x56406d160390 2024-09-21T06:37:40.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.960+0000 7fa853fff640 1 -- 172.21.15.7:0/1878761258 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa8600d2070 con 0x56406d160390 2024-09-21T06:37:40.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.960+0000 7fa881417740 10 client.15780 fetch_fsmap learned FSMap version 25 2024-09-21T06:37:40.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.960+0000 7fa881417740 1 -- 172.21.15.7:0/1878761258 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56406d53d2a0 con 0x56406d160390 2024-09-21T06:37:40.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.960+0000 7fa853fff640 1 -- 172.21.15.7:0/1878761258 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa8680132b0 con 0x56406d160390 2024-09-21T06:37:40.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.960+0000 7fa853fff640 1 -- 172.21.15.7:0/1878761258 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa86010e0c0 con 0x56406d160390 2024-09-21T06:37:40.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.960+0000 7fa881417740 10 client.15780 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:37:40.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.960+0000 7fa881417740 10 client.15780 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:37:40.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.960+0000 7fa881417740 20 client.15780 populate_metadata read hostname 'smithi007' 2024-09-21T06:37:40.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.960+0000 7fa881417740 1 --2- 172.21.15.7:0/1878761258 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x56406d114da0 0x56406d5b70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:40.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.960+0000 7fa881417740 4 client.15780 mds_command: new command op to 24688 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:37:40.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.960+0000 7fa881417740 1 -- 172.21.15.7:0/1878761258 --> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56406d49c8a0 con 0x56406d114da0 2024-09-21T06:37:40.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.961+0000 7fa878c3f640 1 --2- 172.21.15.7:0/1878761258 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x56406d114da0 0x56406d5b70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:40.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.961+0000 7fa878c3f640 1 --2- 172.21.15.7:0/1878761258 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x56406d114da0 0x56406d5b70c0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=555ed16bb2942b63 server_cookie=65c5f7d3b90c8e46 in_seq=0 out_seq=0 2024-09-21T06:37:40.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.961+0000 7fa853fff640 10 client.15780 ms_handle_connect on v2:172.21.15.144:6838/4027821922 2024-09-21T06:37:40.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.961+0000 7fa853fff640 1 -- 172.21.15.7:0/1878761258 <== mds.1 v2:172.21.15.144:6838/4027821922 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56406d49c8a0 con 0x56406d114da0 2024-09-21T06:37:40.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.961+0000 7fa853fff640 10 client.15780 handle_command_reply: tid=0 2024-09-21T06:37:40.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.961+0000 7fa881417740 1 client.15780 shutdown 2024-09-21T06:37:40.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.962+0000 7fa881417740 1 -- 172.21.15.7:0/1878761258 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56406d160390 msgr2=0x56406d53ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:40.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.962+0000 7fa881417740 1 --2- 172.21.15.7:0/1878761258 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56406d160390 0x56406d53ca20 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fa86003bfd0 tx=0x7fa8600ca190 comp rx=0 tx=0).stop 2024-09-21T06:37:40.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.962+0000 7fa881417740 1 -- 172.21.15.7:0/1878761258 shutdown_connections 2024-09-21T06:37:40.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.962+0000 7fa881417740 1 --2- 172.21.15.7:0/1878761258 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x56406d114da0 0x56406d5b70c0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:40.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.962+0000 7fa881417740 1 --2- 172.21.15.7:0/1878761258 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56406d181070 0x56406d5b37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:40.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.962+0000 7fa881417740 1 --2- 172.21.15.7:0/1878761258 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56406d160390 0x56406d53ca20 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:40.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.962+0000 7fa881417740 1 --2- 172.21.15.7:0/1878761258 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56406d1581b0 0x56406d53c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:40.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.962+0000 7fa881417740 1 -- 172.21.15.7:0/1878761258 >> 172.21.15.7:0/1878761258 conn(0x56406d175460 msgr2=0x56406d5296d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:40.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.962+0000 7fa853fff640 0 client.15780 ms_handle_reset on v2:172.21.15.144:6838/4027821922 2024-09-21T06:37:40.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.962+0000 7fa881417740 1 -- 172.21.15.7:0/1878761258 shutdown_connections 2024-09-21T06:37:40.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.962+0000 7fa881417740 1 -- 172.21.15.7:0/1878761258 wait complete. 2024-09-21T06:37:40.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.962+0000 7fa881417740 20 client.15780 trim_cache size 0 max 16384 2024-09-21T06:37:40.968 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:37:40.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.962+0000 7fa87aea3640 1 -- 172.21.15.7:0/1935455142 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa8640b6680 msgr2=0x7fa8640b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:40.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.962+0000 7fa87aea3640 1 --2- 172.21.15.7:0/1935455142 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa8640b6680 0x7fa8640b8b90 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa86c005fd0 tx=0x7fa86c0096a0 comp rx=0 tx=0).stop 2024-09-21T06:37:40.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.962+0000 7fa87aea3640 1 -- 172.21.15.7:0/1935455142 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa8741094a0 msgr2=0x7fa87419ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:40.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.962+0000 7fa87aea3640 1 --2- 172.21.15.7:0/1935455142 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa8741094a0 0x7fa87419ab20 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fa86002a930 tx=0x7fa860004270 comp rx=0 tx=0).stop 2024-09-21T06:37:40.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.963+0000 7fa87aea3640 1 -- 172.21.15.7:0/1935455142 shutdown_connections 2024-09-21T06:37:40.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.963+0000 7fa87aea3640 1 --2- 172.21.15.7:0/1935455142 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa8640b6680 0x7fa8640b8b90 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:40.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.963+0000 7fa87aea3640 1 --2- 172.21.15.7:0/1935455142 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa874109df0 0x7fa87419fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:40.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.963+0000 7fa87aea3640 1 --2- 172.21.15.7:0/1935455142 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa8741094a0 0x7fa87419ab20 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:40.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.963+0000 7fa87aea3640 1 --2- 172.21.15.7:0/1935455142 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa874103b60 0x7fa87419a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:40.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.963+0000 7fa87aea3640 1 -- 172.21.15.7:0/1935455142 >> 172.21.15.7:0/1935455142 conn(0x7fa87407b850 msgr2=0x7fa874105610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:40.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.963+0000 7fa87aea3640 1 -- 172.21.15.7:0/1935455142 shutdown_connections 2024-09-21T06:37:40.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:40.963+0000 7fa87aea3640 1 -- 172.21.15.7:0/1935455142 wait complete. 2024-09-21T06:37:42.077 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:37:42.335 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:37:42.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:37:42 smithi007 ceph-mon[30983]: pgmap v364: 97 pgs: 97 active+clean; 1.0 GiB data, 560 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 109 MiB/s wr, 34 op/s 2024-09-21T06:37:42.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:37:42 smithi144 ceph-mon[34653]: pgmap v364: 97 pgs: 97 active+clean; 1.0 GiB data, 560 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 109 MiB/s wr, 34 op/s 2024-09-21T06:37:42.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:37:42 smithi018 ceph-mon[34477]: pgmap v364: 97 pgs: 97 active+clean; 1.0 GiB data, 560 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 109 MiB/s wr, 34 op/s 2024-09-21T06:37:42.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.819+0000 7f6304d30640 1 -- 172.21.15.7:0/1193156558 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6300108d30 msgr2=0x7f630010f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:42.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.819+0000 7f6304d30640 1 --2- 172.21.15.7:0/1193156558 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6300108d30 0x7f630010f560 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f62f8009ca0 tx=0x7f62f802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:37:42.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.819+0000 7f6304d30640 1 -- 172.21.15.7:0/1193156558 shutdown_connections 2024-09-21T06:37:42.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.819+0000 7f6304d30640 1 --2- 172.21.15.7:0/1193156558 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6300108d30 0x7f630010f560 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:42.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.819+0000 7f6304d30640 1 --2- 172.21.15.7:0/1193156558 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63001083e0 0x7f63001087f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:42.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.819+0000 7f6304d30640 1 --2- 172.21.15.7:0/1193156558 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6300102aa0 0x7f6300102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:42.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.819+0000 7f6304d30640 1 -- 172.21.15.7:0/1193156558 >> 172.21.15.7:0/1193156558 conn(0x7f6300079750 msgr2=0x7f6300079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:42.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.819+0000 7f6304d30640 1 -- 172.21.15.7:0/1193156558 shutdown_connections 2024-09-21T06:37:42.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.819+0000 7f6304d30640 1 -- 172.21.15.7:0/1193156558 wait complete. 2024-09-21T06:37:42.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.820+0000 7f6304d30640 1 Processor -- start 2024-09-21T06:37:42.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.820+0000 7f6304d30640 1 -- start start 2024-09-21T06:37:42.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.820+0000 7f6304d30640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6300102aa0 0x7f6300199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:42.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.820+0000 7f6304d30640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63001083e0 0x7f63001998e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:42.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.820+0000 7f6304d30640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6300108d30 0x7f630019eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:42.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.820+0000 7f6304d30640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f63001129f0 con 0x7f6300102aa0 2024-09-21T06:37:42.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.820+0000 7f6304d30640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6300112870 con 0x7f6300108d30 2024-09-21T06:37:42.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.820+0000 7f6304d30640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6300112b70 con 0x7f63001083e0 2024-09-21T06:37:42.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.820+0000 7f62fe59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6300102aa0 0x7f6300199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:42.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.820+0000 7f62fe59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6300102aa0 0x7f6300199340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43658/0 (socket says 172.21.15.7:43658) 2024-09-21T06:37:42.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.820+0000 7f62fe59c640 1 -- 172.21.15.7:0/2416022851 learned_addr learned my addr 172.21.15.7:0/2416022851 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:37:42.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.820+0000 7f62fed9d640 1 --2- 172.21.15.7:0/2416022851 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6300108d30 0x7f630019eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:42.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.821+0000 7f62fdd9b640 1 --2- 172.21.15.7:0/2416022851 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63001083e0 0x7f63001998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:42.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.821+0000 7f62fe59c640 1 -- 172.21.15.7:0/2416022851 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63001083e0 msgr2=0x7f63001998e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:42.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.821+0000 7f62fe59c640 1 --2- 172.21.15.7:0/2416022851 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63001083e0 0x7f63001998e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:42.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.821+0000 7f62fe59c640 1 -- 172.21.15.7:0/2416022851 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6300108d30 msgr2=0x7f630019eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:42.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.821+0000 7f62fe59c640 1 --2- 172.21.15.7:0/2416022851 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6300108d30 0x7f630019eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:42.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.821+0000 7f62fe59c640 1 -- 172.21.15.7:0/2416022851 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f630019f1f0 con 0x7f6300102aa0 2024-09-21T06:37:42.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.821+0000 7f62fdd9b640 1 --2- 172.21.15.7:0/2416022851 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63001083e0 0x7f63001998e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:37:42.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.821+0000 7f62fe59c640 1 --2- 172.21.15.7:0/2416022851 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6300102aa0 0x7f6300199340 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f62f000c920 tx=0x7f62f000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:42.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.821+0000 7f62ef7fe640 1 -- 172.21.15.7:0/2416022851 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62f0007c70 con 0x7f6300102aa0 2024-09-21T06:37:42.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.821+0000 7f6304d30640 1 -- 172.21.15.7:0/2416022851 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f630019f4e0 con 0x7f6300102aa0 2024-09-21T06:37:42.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.821+0000 7f62ef7fe640 1 -- 172.21.15.7:0/2416022851 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f62f0007e10 con 0x7f6300102aa0 2024-09-21T06:37:42.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.821+0000 7f62ef7fe640 1 -- 172.21.15.7:0/2416022851 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62f0018820 con 0x7f6300102aa0 2024-09-21T06:37:42.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.821+0000 7f6304d30640 1 -- 172.21.15.7:0/2416022851 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63001a5d00 con 0x7f6300102aa0 2024-09-21T06:37:42.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.824+0000 7f62ef7fe640 1 -- 172.21.15.7:0/2416022851 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f62f000f450 con 0x7f6300102aa0 2024-09-21T06:37:42.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.824+0000 7f630b2a4740 1 Processor -- start 2024-09-21T06:37:42.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.824+0000 7f630b2a4740 1 -- start start 2024-09-21T06:37:42.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.824+0000 7f630b2a4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5fc20c070 0x55e5fc5b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:42.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.824+0000 7f630b2a4740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e5fc1e31b0 0x55e5fc5b3be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:42.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.824+0000 7f630b2a4740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e5fc1eb390 0x55e5fc5b4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:42.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.824+0000 7f630b2a4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e5fc529ea0 con 0x55e5fc20c070 2024-09-21T06:37:42.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.824+0000 7f630b2a4740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55e5fc5192d0 con 0x55e5fc1eb390 2024-09-21T06:37:42.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.824+0000 7f630b2a4740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55e5fc51d0e0 con 0x55e5fc1e31b0 2024-09-21T06:37:42.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.825+0000 7f62fed9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5fc20c070 0x55e5fc5b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:42.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.825+0000 7f62fed9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5fc20c070 0x55e5fc5b36a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43670/0 (socket says 172.21.15.7:43670) 2024-09-21T06:37:42.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.825+0000 7f62fed9d640 1 -- 172.21.15.7:0/149324845 learned_addr learned my addr 172.21.15.7:0/149324845 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:37:42.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.825+0000 7f62fe59c640 1 --2- 172.21.15.7:0/149324845 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e5fc1e31b0 0x55e5fc5b3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:42.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.825+0000 7f62fdd9b640 1 --2- 172.21.15.7:0/149324845 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e5fc1eb390 0x55e5fc5b4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:42.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.825+0000 7f62fed9d640 1 -- 172.21.15.7:0/149324845 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e5fc1e31b0 msgr2=0x55e5fc5b3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:42.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.825+0000 7f62fed9d640 1 --2- 172.21.15.7:0/149324845 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e5fc1e31b0 0x55e5fc5b3be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:42.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.825+0000 7f62fed9d640 1 -- 172.21.15.7:0/149324845 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e5fc1eb390 msgr2=0x55e5fc5b4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:42.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.825+0000 7f62ef7fe640 1 --2- 172.21.15.7:0/2416022851 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f62e80b66b0 0x7f62e80b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:42.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.825+0000 7f62fed9d640 1 --2- 172.21.15.7:0/149324845 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e5fc1eb390 0x55e5fc5b4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:42.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.825+0000 7f62fed9d640 1 -- 172.21.15.7:0/149324845 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5fc277650 con 0x55e5fc20c070 2024-09-21T06:37:42.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.825+0000 7f62ef7fe640 1 -- 172.21.15.7:0/2416022851 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f62f00e7810 con 0x7f6300102aa0 2024-09-21T06:37:42.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.825+0000 7f62fed9d640 1 --2- 172.21.15.7:0/2416022851 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f62e80b66b0 0x7f62e80b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:42.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.825+0000 7f62fed9d640 1 --2- 172.21.15.7:0/149324845 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5fc20c070 0x55e5fc5b36a0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f62f8009920 tx=0x7f62f8009950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b856d11136172dd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:42.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.826+0000 7f62ecff9640 1 -- 172.21.15.7:0/149324845 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62f8031450 con 0x55e5fc20c070 2024-09-21T06:37:42.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.826+0000 7f62ecff9640 1 -- 172.21.15.7:0/149324845 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f62f8036030 con 0x55e5fc20c070 2024-09-21T06:37:42.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.826+0000 7f62ecff9640 1 -- 172.21.15.7:0/149324845 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62f8004730 con 0x55e5fc20c070 2024-09-21T06:37:42.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.827+0000 7f630b2a4740 1 -- 172.21.15.7:0/149324845 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5fc20c070 msgr2=0x55e5fc5b36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:42.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.827+0000 7f630b2a4740 1 --2- 172.21.15.7:0/149324845 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5fc20c070 0x55e5fc5b36a0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f62f8009920 tx=0x7f62f8009950 comp rx=0 tx=0).stop 2024-09-21T06:37:42.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.827+0000 7f62fed9d640 1 --2- 172.21.15.7:0/2416022851 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f62e80b66b0 0x7f62e80b8bc0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f62f80049d0 tx=0x7f62f802f6b0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:42.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.827+0000 7f630b2a4740 1 -- 172.21.15.7:0/149324845 shutdown_connections 2024-09-21T06:37:42.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.827+0000 7f630b2a4740 1 --2- 172.21.15.7:0/149324845 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e5fc1eb390 0x55e5fc5b4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:42.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.827+0000 7f630b2a4740 1 --2- 172.21.15.7:0/149324845 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e5fc1e31b0 0x55e5fc5b3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:42.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.827+0000 7f630b2a4740 1 --2- 172.21.15.7:0/149324845 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5fc20c070 0x55e5fc5b36a0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:42.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.827+0000 7f630b2a4740 1 -- 172.21.15.7:0/149324845 >> 172.21.15.7:0/149324845 conn(0x55e5fc200460 msgr2=0x55e5fc5b1590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:42.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.827+0000 7f630b2a4740 1 -- 172.21.15.7:0/149324845 shutdown_connections 2024-09-21T06:37:42.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.827+0000 7f630b2a4740 1 -- 172.21.15.7:0/149324845 wait complete. 2024-09-21T06:37:42.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.827+0000 7f630b2a4740 1 -- start start 2024-09-21T06:37:42.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.827+0000 7f630b2a4740 1 Processor -- start 2024-09-21T06:37:42.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.828+0000 7f630b2a4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5fc1e31b0 0x55e5fc5c0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:42.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.828+0000 7f630b2a4740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e5fc1eb390 0x55e5fc5c14a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:42.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.828+0000 7f630b2a4740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e5fc20c070 0x55e5fc5cd190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:42.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.828+0000 7f630b2a4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e5fc37a700 con 0x55e5fc1e31b0 2024-09-21T06:37:42.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.828+0000 7f630b2a4740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55e5fc4b4160 con 0x55e5fc20c070 2024-09-21T06:37:42.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.828+0000 7f630b2a4740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55e5fc5c3e60 con 0x55e5fc1eb390 2024-09-21T06:37:42.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.828+0000 7f630b2a4740 10 client.0 _ll_register_callbacks cb 0x55e5fc4cd9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:37:42.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.828+0000 7f62fe59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5fc1e31b0 0x55e5fc5c0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:42.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.828+0000 7f62fe59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5fc1e31b0 0x55e5fc5c0f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43680/0 (socket says 172.21.15.7:43680) 2024-09-21T06:37:42.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.828+0000 7f62fe59c640 1 -- 172.21.15.7:0/2280402525 learned_addr learned my addr 172.21.15.7:0/2280402525 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:37:42.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.828+0000 7f62fed9d640 1 --2- 172.21.15.7:0/2280402525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e5fc20c070 0x55e5fc5cd190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:42.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.828+0000 7f62fdd9b640 1 --2- 172.21.15.7:0/2280402525 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e5fc1eb390 0x55e5fc5c14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:42.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.828+0000 7f62fe59c640 1 -- 172.21.15.7:0/2280402525 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e5fc1eb390 msgr2=0x55e5fc5c14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:42.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.828+0000 7f62fe59c640 1 --2- 172.21.15.7:0/2280402525 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e5fc1eb390 0x55e5fc5c14a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:42.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.828+0000 7f62fe59c640 1 -- 172.21.15.7:0/2280402525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e5fc20c070 msgr2=0x55e5fc5cd190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:42.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.828+0000 7f62fe59c640 1 --2- 172.21.15.7:0/2280402525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e5fc20c070 0x55e5fc5cd190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:42.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.828+0000 7f62fe59c640 1 -- 172.21.15.7:0/2280402525 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5fc4e1c90 con 0x55e5fc1e31b0 2024-09-21T06:37:42.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.828+0000 7f62fed9d640 1 --2- 172.21.15.7:0/2280402525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e5fc20c070 0x55e5fc5cd190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:37:42.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.828+0000 7f62fe59c640 1 --2- 172.21.15.7:0/2280402525 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5fc1e31b0 0x55e5fc5c0f60 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f62f0007590 tx=0x7f62f00a9620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccf08c9fd581e8f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:42.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.828+0000 7f62e5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:37:42.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.829+0000 7f62e5ffb640 1 -- 172.21.15.7:0/2280402525 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62f00e5440 con 0x55e5fc1e31b0 2024-09-21T06:37:42.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.829+0000 7f62e5ffb640 1 -- 172.21.15.7:0/2280402525 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f62f00ac920 con 0x55e5fc1e31b0 2024-09-21T06:37:42.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.829+0000 7f630b2a4740 1 -- 172.21.15.7:0/2280402525 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f62f8036030 con 0x55e5fc1e31b0 2024-09-21T06:37:42.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.829+0000 7f62e5ffb640 1 -- 172.21.15.7:0/2280402525 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f62f00ad1d0 con 0x55e5fc1e31b0 2024-09-21T06:37:42.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.829+0000 7f630b2a4740 10 client.15792 fetch_fsmap learned FSMap version 25 2024-09-21T06:37:42.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.829+0000 7f630b2a4740 1 -- 172.21.15.7:0/2280402525 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e5fc5cfbd0 con 0x55e5fc1e31b0 2024-09-21T06:37:42.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.829+0000 7f62e5ffb640 1 -- 172.21.15.7:0/2280402525 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f62f8036030 con 0x55e5fc1e31b0 2024-09-21T06:37:42.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.829+0000 7f62e5ffb640 1 -- 172.21.15.7:0/2280402525 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f62f00ac390 con 0x55e5fc1e31b0 2024-09-21T06:37:42.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.829+0000 7f630b2a4740 10 client.15792 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:37:42.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.829+0000 7f630b2a4740 10 client.15792 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:37:42.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.829+0000 7f630b2a4740 20 client.15792 populate_metadata read hostname 'smithi007' 2024-09-21T06:37:42.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.829+0000 7f630b2a4740 1 --2- 172.21.15.7:0/2280402525 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55e5fc1ca9f0 0x55e5fc5d3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:42.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.829+0000 7f630b2a4740 4 client.15792 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:37:42.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.829+0000 7f630b2a4740 1 -- 172.21.15.7:0/2280402525 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e5fc52bdf0 con 0x55e5fc1ca9f0 2024-09-21T06:37:42.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.829+0000 7f62fdd9b640 1 --2- 172.21.15.7:0/2280402525 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55e5fc1ca9f0 0x55e5fc5d3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:42.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.830+0000 7f62e5ffb640 10 client.15792 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:37:42.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.830+0000 7f62fdd9b640 1 --2- 172.21.15.7:0/2280402525 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55e5fc1ca9f0 0x55e5fc5d3010 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8fb6fb44ad7b0e42 server_cookie=40a3b384f42ffab3 in_seq=0 out_seq=0 2024-09-21T06:37:42.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.831+0000 7f62e5ffb640 1 -- 172.21.15.7:0/2280402525 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e5fc52bdf0 con 0x55e5fc1ca9f0 2024-09-21T06:37:42.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.831+0000 7f62e5ffb640 10 client.15792 handle_command_reply: tid=0 2024-09-21T06:37:42.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.831+0000 7f630b2a4740 1 client.15792 shutdown 2024-09-21T06:37:42.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.831+0000 7f630b2a4740 1 -- 172.21.15.7:0/2280402525 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5fc1e31b0 msgr2=0x55e5fc5c0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:42.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.831+0000 7f630b2a4740 1 --2- 172.21.15.7:0/2280402525 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5fc1e31b0 0x55e5fc5c0f60 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f62f0007590 tx=0x7f62f00a9620 comp rx=0 tx=0).stop 2024-09-21T06:37:42.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.831+0000 7f630b2a4740 1 -- 172.21.15.7:0/2280402525 shutdown_connections 2024-09-21T06:37:42.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.831+0000 7f630b2a4740 1 --2- 172.21.15.7:0/2280402525 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55e5fc1ca9f0 0x55e5fc5d3010 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:42.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.831+0000 7f630b2a4740 1 --2- 172.21.15.7:0/2280402525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e5fc20c070 0x55e5fc5cd190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:42.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.831+0000 7f62e5ffb640 0 client.15792 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:37:42.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.831+0000 7f630b2a4740 1 --2- 172.21.15.7:0/2280402525 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e5fc1eb390 0x55e5fc5c14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:42.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.831+0000 7f630b2a4740 1 --2- 172.21.15.7:0/2280402525 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5fc1e31b0 0x55e5fc5c0f60 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:42.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.831+0000 7f630b2a4740 1 -- 172.21.15.7:0/2280402525 >> 172.21.15.7:0/2280402525 conn(0x55e5fc200460 msgr2=0x55e5fc5afbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:42.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.831+0000 7f630b2a4740 1 -- 172.21.15.7:0/2280402525 shutdown_connections 2024-09-21T06:37:42.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.831+0000 7f630b2a4740 1 -- 172.21.15.7:0/2280402525 wait complete. 2024-09-21T06:37:42.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.831+0000 7f630b2a4740 20 client.15792 trim_cache size 0 max 16384 2024-09-21T06:37:42.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.844+0000 7f630b2a4740 1 Processor -- start 2024-09-21T06:37:42.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.844+0000 7f630b2a4740 1 -- start start 2024-09-21T06:37:42.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.844+0000 7f630b2a4740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e5fc1e31b0 0x55e5fc5c1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:42.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.844+0000 7f630b2a4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5fc1eb390 0x55e5fc5b15b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:42.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.845+0000 7f630b2a4740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e5fc20c070 0x55e5fc5cd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:42.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.845+0000 7f630b2a4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f63001afaf0 con 0x55e5fc1eb390 2024-09-21T06:37:42.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.845+0000 7f630b2a4740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f63001ad3c0 con 0x55e5fc20c070 2024-09-21T06:37:42.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.845+0000 7f630b2a4740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f63001ab1f0 con 0x55e5fc1e31b0 2024-09-21T06:37:42.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.845+0000 7f62fdd9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5fc1eb390 0x55e5fc5b15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:42.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.845+0000 7f62fdd9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5fc1eb390 0x55e5fc5b15b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43690/0 (socket says 172.21.15.7:43690) 2024-09-21T06:37:42.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.845+0000 7f62fdd9b640 1 -- 172.21.15.7:0/3937805225 learned_addr learned my addr 172.21.15.7:0/3937805225 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:37:42.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.845+0000 7f62fe59c640 1 --2- 172.21.15.7:0/3937805225 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e5fc1e31b0 0x55e5fc5c1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:42.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.845+0000 7f62fed9d640 1 --2- 172.21.15.7:0/3937805225 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e5fc20c070 0x55e5fc5cd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:42.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.845+0000 7f62fdd9b640 1 -- 172.21.15.7:0/3937805225 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e5fc1e31b0 msgr2=0x55e5fc5c1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:42.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.845+0000 7f62fdd9b640 1 --2- 172.21.15.7:0/3937805225 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e5fc1e31b0 0x55e5fc5c1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:42.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.845+0000 7f62fdd9b640 1 -- 172.21.15.7:0/3937805225 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e5fc20c070 msgr2=0x55e5fc5cd090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:42.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.845+0000 7f62fdd9b640 1 --2- 172.21.15.7:0/3937805225 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e5fc20c070 0x55e5fc5cd090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:42.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.845+0000 7f62fdd9b640 1 -- 172.21.15.7:0/3937805225 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e5fc5b64e0 con 0x55e5fc1eb390 2024-09-21T06:37:42.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.845+0000 7f62fdd9b640 1 --2- 172.21.15.7:0/3937805225 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5fc1eb390 0x55e5fc5b15b0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f62f4005d00 tx=0x7f62f40094a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c17596c51842665 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:42.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.845+0000 7f62e7fff640 1 -- 172.21.15.7:0/3937805225 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62f4005020 con 0x55e5fc1eb390 2024-09-21T06:37:42.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.845+0000 7f62e7fff640 1 -- 172.21.15.7:0/3937805225 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f62f401f030 con 0x55e5fc1eb390 2024-09-21T06:37:42.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.845+0000 7f62e7fff640 1 -- 172.21.15.7:0/3937805225 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62f40126b0 con 0x55e5fc1eb390 2024-09-21T06:37:42.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.846+0000 7f630b2a4740 1 -- 172.21.15.7:0/3937805225 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5fc1eb390 msgr2=0x55e5fc5b15b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:42.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.846+0000 7f630b2a4740 1 --2- 172.21.15.7:0/3937805225 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5fc1eb390 0x55e5fc5b15b0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f62f4005d00 tx=0x7f62f40094a0 comp rx=0 tx=0).stop 2024-09-21T06:37:42.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.846+0000 7f630b2a4740 1 -- 172.21.15.7:0/3937805225 shutdown_connections 2024-09-21T06:37:42.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.846+0000 7f630b2a4740 1 --2- 172.21.15.7:0/3937805225 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e5fc20c070 0x55e5fc5cd090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:42.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.846+0000 7f630b2a4740 1 --2- 172.21.15.7:0/3937805225 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5fc1eb390 0x55e5fc5b15b0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:42.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.846+0000 7f630b2a4740 1 --2- 172.21.15.7:0/3937805225 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e5fc1e31b0 0x55e5fc5c1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:42.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.846+0000 7f630b2a4740 1 -- 172.21.15.7:0/3937805225 >> 172.21.15.7:0/3937805225 conn(0x55e5fc200460 msgr2=0x55e5fc5c0d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:42.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.846+0000 7f630b2a4740 1 -- 172.21.15.7:0/3937805225 shutdown_connections 2024-09-21T06:37:42.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.846+0000 7f630b2a4740 1 -- 172.21.15.7:0/3937805225 wait complete. 2024-09-21T06:37:42.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.847+0000 7f630b2a4740 1 -- start start 2024-09-21T06:37:42.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.847+0000 7f630b2a4740 1 Processor -- start 2024-09-21T06:37:42.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.847+0000 7f630b2a4740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e5fc1e31b0 0x55e5fc5c5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:42.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.847+0000 7f630b2a4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5fc1eb390 0x55e5fc5c5650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:42.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.847+0000 7f630b2a4740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e5fc20c070 0x55e5fc5c5b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:42.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.847+0000 7f630b2a4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f63001ab880 con 0x55e5fc1eb390 2024-09-21T06:37:42.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.847+0000 7f630b2a4740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f63001accf0 con 0x55e5fc1e31b0 2024-09-21T06:37:42.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.847+0000 7f630b2a4740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f63001abf50 con 0x55e5fc20c070 2024-09-21T06:37:42.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.847+0000 7f630b2a4740 10 client.0 _ll_register_callbacks cb 0x7f62f000cf10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:37:42.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.847+0000 7f62fdd9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5fc1eb390 0x55e5fc5c5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:42.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.847+0000 7f62fe59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e5fc1e31b0 0x55e5fc5c5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:42.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.847+0000 7f62fdd9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5fc1eb390 0x55e5fc5c5650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43692/0 (socket says 172.21.15.7:43692) 2024-09-21T06:37:42.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.847+0000 7f62fdd9b640 1 -- 172.21.15.7:0/427235160 learned_addr learned my addr 172.21.15.7:0/427235160 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:37:42.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.847+0000 7f62fed9d640 1 --2- 172.21.15.7:0/427235160 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e5fc20c070 0x55e5fc5c5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:42.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.848+0000 7f62fe59c640 1 -- 172.21.15.7:0/427235160 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e5fc20c070 msgr2=0x55e5fc5c5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:42.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.848+0000 7f62fe59c640 1 --2- 172.21.15.7:0/427235160 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e5fc20c070 0x55e5fc5c5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:42.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.848+0000 7f62fe59c640 1 -- 172.21.15.7:0/427235160 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5fc1eb390 msgr2=0x55e5fc5c5650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:42.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.848+0000 7f62fe59c640 1 --2- 172.21.15.7:0/427235160 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5fc1eb390 0x55e5fc5c5650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:42.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.848+0000 7f62fe59c640 1 -- 172.21.15.7:0/427235160 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e5fc63ca20 con 0x55e5fc1e31b0 2024-09-21T06:37:42.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.848+0000 7f62fdd9b640 1 --2- 172.21.15.7:0/427235160 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5fc1eb390 0x55e5fc5c5650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:37:42.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.848+0000 7f62fe59c640 1 --2- 172.21.15.7:0/427235160 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e5fc1e31b0 0x55e5fc5c5110 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f62f00ed190 tx=0x7f62f00e54f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11adbd2d84074b70 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:42.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.848+0000 7f62e5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-21T06:37:42.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.848+0000 7f62e5ffb640 1 -- 172.21.15.7:0/427235160 <== mon.2 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62f00ad010 con 0x55e5fc1e31b0 2024-09-21T06:37:42.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.848+0000 7f62e5ffb640 1 -- 172.21.15.7:0/427235160 <== mon.2 v2:172.21.15.18:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f62f00acb30 con 0x55e5fc1e31b0 2024-09-21T06:37:42.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.848+0000 7f630b2a4740 1 -- 172.21.15.7:0/427235160 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f62f401f030 con 0x55e5fc1e31b0 2024-09-21T06:37:42.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.849+0000 7f62e5ffb640 1 -- 172.21.15.7:0/427235160 <== mon.2 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f62f00addc0 con 0x55e5fc1e31b0 2024-09-21T06:37:42.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.849+0000 7f630b2a4740 10 client.25547 fetch_fsmap learned FSMap version 25 2024-09-21T06:37:42.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.849+0000 7f630b2a4740 1 -- 172.21.15.7:0/427235160 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e5fc63dca0 con 0x55e5fc1e31b0 2024-09-21T06:37:42.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.849+0000 7f62e5ffb640 1 -- 172.21.15.7:0/427235160 <== mon.2 v2:172.21.15.18:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f62f401f030 con 0x55e5fc1e31b0 2024-09-21T06:37:42.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.849+0000 7f62e5ffb640 1 -- 172.21.15.7:0/427235160 <== mon.2 v2:172.21.15.18:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f62f00b34c0 con 0x55e5fc1e31b0 2024-09-21T06:37:42.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.849+0000 7f630b2a4740 10 client.25547 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:37:42.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.849+0000 7f630b2a4740 10 client.25547 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:37:42.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.849+0000 7f630b2a4740 20 client.25547 populate_metadata read hostname 'smithi007' 2024-09-21T06:37:42.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.849+0000 7f630b2a4740 1 --2- 172.21.15.7:0/427235160 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55e5fc19fda0 0x55e5fc640400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:42.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.849+0000 7f630b2a4740 4 client.25547 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:37:42.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.849+0000 7f630b2a4740 1 -- 172.21.15.7:0/427235160 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e5fc5278a0 con 0x55e5fc19fda0 2024-09-21T06:37:42.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.849+0000 7f62fdd9b640 1 --2- 172.21.15.7:0/427235160 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55e5fc19fda0 0x55e5fc640400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:42.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.850+0000 7f62fdd9b640 1 --2- 172.21.15.7:0/427235160 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55e5fc19fda0 0x55e5fc640400 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c2c2576dbf0709a server_cookie=11a4e282799294f9 in_seq=0 out_seq=0 2024-09-21T06:37:42.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.850+0000 7f62e5ffb640 10 client.25547 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:37:42.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.850+0000 7f62e5ffb640 1 -- 172.21.15.7:0/427235160 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e5fc5278a0 con 0x55e5fc19fda0 2024-09-21T06:37:42.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.850+0000 7f62e5ffb640 10 client.25547 handle_command_reply: tid=0 2024-09-21T06:37:42.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.850+0000 7f630b2a4740 1 client.25547 shutdown 2024-09-21T06:37:42.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.850+0000 7f630b2a4740 1 -- 172.21.15.7:0/427235160 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e5fc1e31b0 msgr2=0x55e5fc5c5110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:42.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.850+0000 7f630b2a4740 1 --2- 172.21.15.7:0/427235160 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e5fc1e31b0 0x55e5fc5c5110 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f62f00ed190 tx=0x7f62f00e54f0 comp rx=0 tx=0).stop 2024-09-21T06:37:42.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.850+0000 7f630b2a4740 1 -- 172.21.15.7:0/427235160 shutdown_connections 2024-09-21T06:37:42.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.850+0000 7f630b2a4740 1 --2- 172.21.15.7:0/427235160 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55e5fc19fda0 0x55e5fc640400 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:42.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.850+0000 7f630b2a4740 1 --2- 172.21.15.7:0/427235160 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e5fc20c070 0x55e5fc5c5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:42.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.850+0000 7f630b2a4740 1 --2- 172.21.15.7:0/427235160 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e5fc1eb390 0x55e5fc5c5650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:42.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.850+0000 7f62e5ffb640 0 client.25547 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:37:42.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.850+0000 7f630b2a4740 1 --2- 172.21.15.7:0/427235160 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e5fc1e31b0 0x55e5fc5c5110 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:42.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.850+0000 7f630b2a4740 1 -- 172.21.15.7:0/427235160 >> 172.21.15.7:0/427235160 conn(0x55e5fc200460 msgr2=0x55e5fc5b4690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:42.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.850+0000 7f630b2a4740 1 -- 172.21.15.7:0/427235160 shutdown_connections 2024-09-21T06:37:42.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.850+0000 7f630b2a4740 1 -- 172.21.15.7:0/427235160 wait complete. 2024-09-21T06:37:42.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.850+0000 7f630b2a4740 20 client.25547 trim_cache size 0 max 16384 2024-09-21T06:37:42.857 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:37:42.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.851+0000 7f6304d30640 1 -- 172.21.15.7:0/2416022851 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f62e80b66b0 msgr2=0x7f62e80b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:42.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.851+0000 7f6304d30640 1 --2- 172.21.15.7:0/2416022851 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f62e80b66b0 0x7f62e80b8bc0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f62f80049d0 tx=0x7f62f802f6b0 comp rx=0 tx=0).stop 2024-09-21T06:37:42.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.851+0000 7f6304d30640 1 -- 172.21.15.7:0/2416022851 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6300102aa0 msgr2=0x7f6300199340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:42.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.851+0000 7f6304d30640 1 --2- 172.21.15.7:0/2416022851 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6300102aa0 0x7f6300199340 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f62f000c920 tx=0x7f62f000cde0 comp rx=0 tx=0).stop 2024-09-21T06:37:42.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.851+0000 7f6304d30640 1 -- 172.21.15.7:0/2416022851 shutdown_connections 2024-09-21T06:37:42.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.851+0000 7f6304d30640 1 --2- 172.21.15.7:0/2416022851 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f62e80b66b0 0x7f62e80b8bc0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:42.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.851+0000 7f6304d30640 1 --2- 172.21.15.7:0/2416022851 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6300108d30 0x7f630019eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:42.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.851+0000 7f6304d30640 1 --2- 172.21.15.7:0/2416022851 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63001083e0 0x7f63001998e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:42.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.851+0000 7f6304d30640 1 --2- 172.21.15.7:0/2416022851 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6300102aa0 0x7f6300199340 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:42.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.851+0000 7f6304d30640 1 -- 172.21.15.7:0/2416022851 >> 172.21.15.7:0/2416022851 conn(0x7f6300079750 msgr2=0x7f63001063d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:42.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.851+0000 7f6304d30640 1 -- 172.21.15.7:0/2416022851 shutdown_connections 2024-09-21T06:37:42.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:42.851+0000 7f6304d30640 1 -- 172.21.15.7:0/2416022851 wait complete. 2024-09-21T06:37:43.638 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-09-21T06:37:43.638 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-09-21T06:37:43.638 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-09-21T06:37:43.638 INFO:tasks.workunit.client.0.smithi007.stdout:iozone test complete. 2024-09-21T06:37:43.638 INFO:tasks.workunit.client.0.smithi007.stderr:+ iozone -c -e -s 1024M -r 1M -t 1 -F f2 -i 0 -i 1 2024-09-21T06:37:43.704 INFO:tasks.workunit.client.0.smithi007.stdout: Iozone: Performance Test of File I/O 2024-09-21T06:37:43.704 INFO:tasks.workunit.client.0.smithi007.stdout: Version $Revision: 3.494 $ 2024-09-21T06:37:43.704 INFO:tasks.workunit.client.0.smithi007.stdout: Compiled for 64 bit mode. 2024-09-21T06:37:43.704 INFO:tasks.workunit.client.0.smithi007.stdout: Build: linux-AMD64 2024-09-21T06:37:43.704 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-09-21T06:37:43.704 INFO:tasks.workunit.client.0.smithi007.stdout: Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins 2024-09-21T06:37:43.704 INFO:tasks.workunit.client.0.smithi007.stdout: Al Slater, Scott Rhine, Mike Wisner, Ken Goss 2024-09-21T06:37:43.705 INFO:tasks.workunit.client.0.smithi007.stdout: Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, 2024-09-21T06:37:43.705 INFO:tasks.workunit.client.0.smithi007.stdout: Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, 2024-09-21T06:37:43.705 INFO:tasks.workunit.client.0.smithi007.stdout: Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, 2024-09-21T06:37:43.705 INFO:tasks.workunit.client.0.smithi007.stdout: Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, 2024-09-21T06:37:43.705 INFO:tasks.workunit.client.0.smithi007.stdout: Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, 2024-09-21T06:37:43.705 INFO:tasks.workunit.client.0.smithi007.stdout: Vangel Bojaxhi, Ben England, Vikentsi Lapa, 2024-09-21T06:37:43.705 INFO:tasks.workunit.client.0.smithi007.stdout: Alexey Skidanov, Sudhir Kumar. 2024-09-21T06:37:43.705 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-09-21T06:37:43.705 INFO:tasks.workunit.client.0.smithi007.stdout: Run began: Sat Sep 21 06:37:43 2024 2024-09-21T06:37:43.705 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-09-21T06:37:43.705 INFO:tasks.workunit.client.0.smithi007.stdout: Include close in write timing 2024-09-21T06:37:43.705 INFO:tasks.workunit.client.0.smithi007.stdout: Include fsync in write timing 2024-09-21T06:37:43.705 INFO:tasks.workunit.client.0.smithi007.stdout: File size set to 1048576 kB 2024-09-21T06:37:43.705 INFO:tasks.workunit.client.0.smithi007.stdout: Record Size 1024 kB 2024-09-21T06:37:43.706 INFO:tasks.workunit.client.0.smithi007.stdout: Command line used: iozone -c -e -s 1024M -r 1M -t 1 -F f2 -i 0 -i 1 2024-09-21T06:37:43.706 INFO:tasks.workunit.client.0.smithi007.stdout: Output is in kBytes/sec 2024-09-21T06:37:43.706 INFO:tasks.workunit.client.0.smithi007.stdout: Time Resolution = 0.000001 seconds. 2024-09-21T06:37:43.706 INFO:tasks.workunit.client.0.smithi007.stdout: Processor cache size set to 1024 kBytes. 2024-09-21T06:37:43.706 INFO:tasks.workunit.client.0.smithi007.stdout: Processor cache line size set to 32 bytes. 2024-09-21T06:37:43.706 INFO:tasks.workunit.client.0.smithi007.stdout: File stride size set to 17 * record size. 2024-09-21T06:37:43.706 INFO:tasks.workunit.client.0.smithi007.stdout: Throughput test with 1 process 2024-09-21T06:37:43.706 INFO:tasks.workunit.client.0.smithi007.stdout: Each process writes a 1048576 kByte file in 1024 kByte records 2024-09-21T06:37:44.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:37:44 smithi144 ceph-mon[34653]: pgmap v365: 97 pgs: 97 active+clean; 1.0 GiB data, 560 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 85 MiB/s wr, 31 op/s 2024-09-21T06:37:44.591 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:37:44 smithi007 ceph-mon[30983]: pgmap v365: 97 pgs: 97 active+clean; 1.0 GiB data, 560 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 85 MiB/s wr, 31 op/s 2024-09-21T06:37:44.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:37:44 smithi018 ceph-mon[34477]: pgmap v365: 97 pgs: 97 active+clean; 1.0 GiB data, 560 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 85 MiB/s wr, 31 op/s 2024-09-21T06:37:44.853 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:37:44.853 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:37:45.252 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:37:45.290 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-09-21T06:37:45.290 INFO:tasks.workunit.client.0.smithi007.stdout: Children see throughput for 1 initial writers = 676235.31 kB/sec 2024-09-21T06:37:45.291 INFO:tasks.workunit.client.0.smithi007.stdout: Parent sees throughput for 1 initial writers = 676131.27 kB/sec 2024-09-21T06:37:45.291 INFO:tasks.workunit.client.0.smithi007.stdout: Min throughput per process = 676235.31 kB/sec 2024-09-21T06:37:45.291 INFO:tasks.workunit.client.0.smithi007.stdout: Max throughput per process = 676235.31 kB/sec 2024-09-21T06:37:45.291 INFO:tasks.workunit.client.0.smithi007.stdout: Avg throughput per process = 676235.31 kB/sec 2024-09-21T06:37:45.291 INFO:tasks.workunit.client.0.smithi007.stdout: Min xfer = 1048576.00 kB 2024-09-21T06:37:46.430 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:37:46 smithi007 ceph-mon[30983]: pgmap v366: 97 pgs: 97 active+clean; 1.1 GiB data, 567 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 69 MiB/s wr, 25 op/s 2024-09-21T06:37:46.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.529+0000 7f9d6dbe3640 1 -- 172.21.15.7:0/562600239 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d68109df0 msgr2=0x7f9d68110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:46.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.529+0000 7f9d6dbe3640 1 --2- 172.21.15.7:0/562600239 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d68109df0 0x7f9d68110620 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f9d60009ca0 tx=0x7f9d6002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:37:46.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.529+0000 7f9d6dbe3640 1 -- 172.21.15.7:0/562600239 shutdown_connections 2024-09-21T06:37:46.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.529+0000 7f9d6dbe3640 1 --2- 172.21.15.7:0/562600239 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d68109df0 0x7f9d68110620 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:46.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.529+0000 7f9d6dbe3640 1 --2- 172.21.15.7:0/562600239 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d681094a0 0x7f9d681098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:46.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.529+0000 7f9d6dbe3640 1 --2- 172.21.15.7:0/562600239 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d68103b60 0x7f9d68103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:46.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.529+0000 7f9d6dbe3640 1 -- 172.21.15.7:0/562600239 >> 172.21.15.7:0/562600239 conn(0x7f9d6807b850 msgr2=0x7f9d6807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:46.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.529+0000 7f9d6dbe3640 1 -- 172.21.15.7:0/562600239 shutdown_connections 2024-09-21T06:37:46.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.529+0000 7f9d6dbe3640 1 -- 172.21.15.7:0/562600239 wait complete. 2024-09-21T06:37:46.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.530+0000 7f9d6dbe3640 1 Processor -- start 2024-09-21T06:37:46.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.530+0000 7f9d6dbe3640 1 -- start start 2024-09-21T06:37:46.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.530+0000 7f9d6dbe3640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d68103b60 0x7f9d6819a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:46.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.530+0000 7f9d6dbe3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d681094a0 0x7f9d6819a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:46.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.530+0000 7f9d6dbe3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d68109df0 0x7f9d6819fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:46.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.530+0000 7f9d6dbe3640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9d68113ab0 con 0x7f9d68109df0 2024-09-21T06:37:46.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.530+0000 7f9d6dbe3640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9d68113930 con 0x7f9d681094a0 2024-09-21T06:37:46.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.530+0000 7f9d6dbe3640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9d68113c30 con 0x7f9d68103b60 2024-09-21T06:37:46.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.531+0000 7f9d67fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d68109df0 0x7f9d6819fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:46.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.531+0000 7f9d67fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d68109df0 0x7f9d6819fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43698/0 (socket says 172.21.15.7:43698) 2024-09-21T06:37:46.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.531+0000 7f9d67fff640 1 -- 172.21.15.7:0/741713056 learned_addr learned my addr 172.21.15.7:0/741713056 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:37:46.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.531+0000 7f9d677fe640 1 --2- 172.21.15.7:0/741713056 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d68103b60 0x7f9d6819a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:46.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.531+0000 7f9d66ffd640 1 --2- 172.21.15.7:0/741713056 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d681094a0 0x7f9d6819a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:46.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.531+0000 7f9d67fff640 1 -- 172.21.15.7:0/741713056 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d68103b60 msgr2=0x7f9d6819a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:46.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.531+0000 7f9d67fff640 1 --2- 172.21.15.7:0/741713056 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d68103b60 0x7f9d6819a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:46.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.531+0000 7f9d67fff640 1 -- 172.21.15.7:0/741713056 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d681094a0 msgr2=0x7f9d6819a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:46.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.531+0000 7f9d67fff640 1 --2- 172.21.15.7:0/741713056 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d681094a0 0x7f9d6819a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:46.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.531+0000 7f9d67fff640 1 -- 172.21.15.7:0/741713056 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d681a02f0 con 0x7f9d68109df0 2024-09-21T06:37:46.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.531+0000 7f9d67fff640 1 --2- 172.21.15.7:0/741713056 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d68109df0 0x7f9d6819fc80 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f9d60005cc0 tx=0x7f9d6002f470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:46.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.531+0000 7f9d64ff9640 1 -- 172.21.15.7:0/741713056 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d60003cf0 con 0x7f9d68109df0 2024-09-21T06:37:46.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.531+0000 7f9d64ff9640 1 -- 172.21.15.7:0/741713056 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9d600044f0 con 0x7f9d68109df0 2024-09-21T06:37:46.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.531+0000 7f9d6dbe3640 1 -- 172.21.15.7:0/741713056 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d681a0580 con 0x7f9d68109df0 2024-09-21T06:37:46.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.531+0000 7f9d64ff9640 1 -- 172.21.15.7:0/741713056 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d6002fc30 con 0x7f9d68109df0 2024-09-21T06:37:46.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.532+0000 7f9d6dbe3640 1 -- 172.21.15.7:0/741713056 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d681a0ac0 con 0x7f9d68109df0 2024-09-21T06:37:46.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:37:46 smithi144 ceph-mon[34653]: pgmap v366: 97 pgs: 97 active+clean; 1.1 GiB data, 567 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 69 MiB/s wr, 25 op/s 2024-09-21T06:37:46.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.534+0000 7f9d74157740 1 Processor -- start 2024-09-21T06:37:46.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.535+0000 7f9d64ff9640 1 -- 172.21.15.7:0/741713056 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f9d60004040 con 0x7f9d68109df0 2024-09-21T06:37:46.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.535+0000 7f9d74157740 1 -- start start 2024-09-21T06:37:46.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.535+0000 7f9d74157740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55982cafe350 0x55982cea5430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:46.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.535+0000 7f9d74157740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55982cad5490 0x55982cea5970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:46.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.535+0000 7f9d74157740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55982cadd670 0x55982cea5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:46.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.535+0000 7f9d74157740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55982ce1be60 con 0x55982cadd670 2024-09-21T06:37:46.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.535+0000 7f9d74157740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55982ce0b290 con 0x55982cafe350 2024-09-21T06:37:46.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.535+0000 7f9d74157740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55982ce0f0a0 con 0x55982cad5490 2024-09-21T06:37:46.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.535+0000 7f9d66ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55982cadd670 0x55982cea5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:46.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.535+0000 7f9d66ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55982cadd670 0x55982cea5eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43706/0 (socket says 172.21.15.7:43706) 2024-09-21T06:37:46.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.535+0000 7f9d66ffd640 1 -- 172.21.15.7:0/2609998615 learned_addr learned my addr 172.21.15.7:0/2609998615 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:37:46.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.535+0000 7f9d66ffd640 1 --2- 172.21.15.7:0/2609998615 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55982cafe350 0x55982cea5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:46.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.535+0000 7f9d677fe640 1 --2- 172.21.15.7:0/2609998615 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55982cad5490 0x55982cea5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:46.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.536+0000 7f9d66ffd640 1 -- 172.21.15.7:0/2609998615 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55982cad5490 msgr2=0x55982cea5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:46.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.536+0000 7f9d66ffd640 1 --2- 172.21.15.7:0/2609998615 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55982cad5490 0x55982cea5970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:46.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.536+0000 7f9d66ffd640 1 -- 172.21.15.7:0/2609998615 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55982cafe350 msgr2=0x55982cea5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:46.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.536+0000 7f9d66ffd640 1 --2- 172.21.15.7:0/2609998615 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55982cafe350 0x55982cea5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:46.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.536+0000 7f9d66ffd640 1 -- 172.21.15.7:0/2609998615 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55982cb69930 con 0x55982cadd670 2024-09-21T06:37:46.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.536+0000 7f9d64ff9640 1 --2- 172.21.15.7:0/741713056 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f9d540b66b0 0x7f9d540b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:46.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.536+0000 7f9d66ffd640 1 --2- 172.21.15.7:0/2609998615 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55982cadd670 0x55982cea5eb0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f9d500138f0 tx=0x7f9d5000e410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ac19b680e7eea39 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:46.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.536+0000 7f9d677fe640 1 --2- 172.21.15.7:0/741713056 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f9d540b66b0 0x7f9d540b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:46.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.536+0000 7f9d64ff9640 1 -- 172.21.15.7:0/741713056 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f9d60108b60 con 0x7f9d68109df0 2024-09-21T06:37:46.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.536+0000 7f9d5dffb640 1 -- 172.21.15.7:0/2609998615 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d5000b8d0 con 0x55982cadd670 2024-09-21T06:37:46.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.536+0000 7f9d5dffb640 1 -- 172.21.15.7:0/2609998615 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9d50005020 con 0x55982cadd670 2024-09-21T06:37:46.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.536+0000 7f9d5dffb640 1 -- 172.21.15.7:0/2609998615 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d50004a00 con 0x55982cadd670 2024-09-21T06:37:46.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.537+0000 7f9d74157740 1 -- 172.21.15.7:0/2609998615 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55982cadd670 msgr2=0x55982cea5eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:46.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.537+0000 7f9d677fe640 1 --2- 172.21.15.7:0/741713056 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f9d540b66b0 0x7f9d540b8bc0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x55982cea40b0 tx=0x7f9d5800a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:46.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.537+0000 7f9d74157740 1 --2- 172.21.15.7:0/2609998615 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55982cadd670 0x55982cea5eb0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f9d500138f0 tx=0x7f9d5000e410 comp rx=0 tx=0).stop 2024-09-21T06:37:46.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.537+0000 7f9d74157740 1 -- 172.21.15.7:0/2609998615 shutdown_connections 2024-09-21T06:37:46.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.537+0000 7f9d74157740 1 --2- 172.21.15.7:0/2609998615 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55982cadd670 0x55982cea5eb0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:46.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.537+0000 7f9d74157740 1 --2- 172.21.15.7:0/2609998615 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55982cad5490 0x55982cea5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:46.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.537+0000 7f9d74157740 1 --2- 172.21.15.7:0/2609998615 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55982cafe350 0x55982cea5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:46.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.537+0000 7f9d74157740 1 -- 172.21.15.7:0/2609998615 >> 172.21.15.7:0/2609998615 conn(0x55982caf2740 msgr2=0x55982cea3320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:46.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.537+0000 7f9d74157740 1 -- 172.21.15.7:0/2609998615 shutdown_connections 2024-09-21T06:37:46.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.537+0000 7f9d74157740 1 -- 172.21.15.7:0/2609998615 wait complete. 2024-09-21T06:37:46.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.538+0000 7f9d74157740 1 -- start start 2024-09-21T06:37:46.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.538+0000 7f9d74157740 1 Processor -- start 2024-09-21T06:37:46.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.538+0000 7f9d74157740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55982cad5490 0x55982ceb0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:46.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.538+0000 7f9d74157740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55982cadd670 0x55982ceb1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:46.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.538+0000 7f9d74157740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55982cafe350 0x55982cebcf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:46.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.538+0000 7f9d74157740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55982cc6c890 con 0x55982cadd670 2024-09-21T06:37:46.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.538+0000 7f9d74157740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55982cda5d40 con 0x55982cad5490 2024-09-21T06:37:46.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.538+0000 7f9d74157740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55982ceb3c10 con 0x55982cafe350 2024-09-21T06:37:46.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.538+0000 7f9d74157740 10 client.0 _ll_register_callbacks cb 0x55982ce09c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:37:46.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.538+0000 7f9d66ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55982cadd670 0x55982ceb1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:46.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.538+0000 7f9d66ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55982cadd670 0x55982ceb1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43720/0 (socket says 172.21.15.7:43720) 2024-09-21T06:37:46.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.539+0000 7f9d66ffd640 1 -- 172.21.15.7:0/3945337584 learned_addr learned my addr 172.21.15.7:0/3945337584 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:37:46.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.539+0000 7f9d67fff640 1 --2- 172.21.15.7:0/3945337584 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55982cafe350 0x55982cebcf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:46.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.539+0000 7f9d677fe640 1 --2- 172.21.15.7:0/3945337584 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55982cad5490 0x55982ceb0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:46.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.539+0000 7f9d66ffd640 1 -- 172.21.15.7:0/3945337584 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55982cafe350 msgr2=0x55982cebcf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:46.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.539+0000 7f9d66ffd640 1 --2- 172.21.15.7:0/3945337584 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55982cafe350 0x55982cebcf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:46.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.539+0000 7f9d66ffd640 1 -- 172.21.15.7:0/3945337584 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55982cad5490 msgr2=0x55982ceb0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:46.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.539+0000 7f9d66ffd640 1 --2- 172.21.15.7:0/3945337584 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55982cad5490 0x55982ceb0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:46.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.539+0000 7f9d66ffd640 1 -- 172.21.15.7:0/3945337584 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55982cebd4c0 con 0x55982cadd670 2024-09-21T06:37:46.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.539+0000 7f9d66ffd640 1 --2- 172.21.15.7:0/3945337584 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55982cadd670 0x55982ceb1510 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f9d5000e3e0 tx=0x7f9d5000ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2afa0916deee1508 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:46.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.539+0000 7f9d46ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:37:46.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.539+0000 7f9d46ffd640 1 -- 172.21.15.7:0/3945337584 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d500053d0 con 0x55982cadd670 2024-09-21T06:37:46.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.539+0000 7f9d46ffd640 1 -- 172.21.15.7:0/3945337584 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f9d50005570 con 0x55982cadd670 2024-09-21T06:37:46.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.539+0000 7f9d74157740 1 -- 172.21.15.7:0/3945337584 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d50005020 con 0x55982cadd670 2024-09-21T06:37:46.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.540+0000 7f9d46ffd640 1 -- 172.21.15.7:0/3945337584 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9d5002c020 con 0x55982cadd670 2024-09-21T06:37:46.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.540+0000 7f9d74157740 10 client.15810 fetch_fsmap learned FSMap version 25 2024-09-21T06:37:46.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.540+0000 7f9d74157740 1 -- 172.21.15.7:0/3945337584 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55982cebfdf0 con 0x55982cadd670 2024-09-21T06:37:46.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.540+0000 7f9d46ffd640 1 -- 172.21.15.7:0/3945337584 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9d50005020 con 0x55982cadd670 2024-09-21T06:37:46.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.540+0000 7f9d46ffd640 1 -- 172.21.15.7:0/3945337584 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9d50025020 con 0x55982cadd670 2024-09-21T06:37:46.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.540+0000 7f9d74157740 10 client.15810 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:37:46.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.540+0000 7f9d74157740 10 client.15810 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:37:46.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.540+0000 7f9d74157740 20 client.15810 populate_metadata read hostname 'smithi007' 2024-09-21T06:37:46.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.540+0000 7f9d74157740 1 --2- 172.21.15.7:0/3945337584 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55982cabccd0 0x55982cec3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:46.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.540+0000 7f9d74157740 4 client.15810 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:37:46.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.540+0000 7f9d74157740 1 -- 172.21.15.7:0/3945337584 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55982ce1ddb0 con 0x55982cabccd0 2024-09-21T06:37:46.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.540+0000 7f9d677fe640 1 --2- 172.21.15.7:0/3945337584 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55982cabccd0 0x55982cec3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:46.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.541+0000 7f9d677fe640 1 --2- 172.21.15.7:0/3945337584 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55982cabccd0 0x55982cec3150 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=74dc6bf792f89c28 server_cookie=15ee007c210beffd in_seq=0 out_seq=0 2024-09-21T06:37:46.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.541+0000 7f9d46ffd640 10 client.15810 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:37:46.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.542+0000 7f9d46ffd640 1 -- 172.21.15.7:0/3945337584 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55982ce1ddb0 con 0x55982cabccd0 2024-09-21T06:37:46.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.542+0000 7f9d46ffd640 10 client.15810 handle_command_reply: tid=0 2024-09-21T06:37:46.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.542+0000 7f9d74157740 1 client.15810 shutdown 2024-09-21T06:37:46.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.542+0000 7f9d74157740 1 -- 172.21.15.7:0/3945337584 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55982cadd670 msgr2=0x55982ceb1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:46.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.542+0000 7f9d74157740 1 --2- 172.21.15.7:0/3945337584 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55982cadd670 0x55982ceb1510 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f9d5000e3e0 tx=0x7f9d5000ee00 comp rx=0 tx=0).stop 2024-09-21T06:37:46.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.542+0000 7f9d74157740 1 -- 172.21.15.7:0/3945337584 shutdown_connections 2024-09-21T06:37:46.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.542+0000 7f9d74157740 1 --2- 172.21.15.7:0/3945337584 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55982cabccd0 0x55982cec3150 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:46.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.542+0000 7f9d74157740 1 --2- 172.21.15.7:0/3945337584 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55982cafe350 0x55982cebcf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:46.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.542+0000 7f9d74157740 1 --2- 172.21.15.7:0/3945337584 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55982cadd670 0x55982ceb1510 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:46.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.542+0000 7f9d74157740 1 --2- 172.21.15.7:0/3945337584 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55982cad5490 0x55982ceb0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:46.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.542+0000 7f9d74157740 1 -- 172.21.15.7:0/3945337584 >> 172.21.15.7:0/3945337584 conn(0x55982caf2740 msgr2=0x55982cea8610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:46.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.542+0000 7f9d46ffd640 0 client.15810 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:37:46.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.542+0000 7f9d74157740 1 -- 172.21.15.7:0/3945337584 shutdown_connections 2024-09-21T06:37:46.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.542+0000 7f9d74157740 1 -- 172.21.15.7:0/3945337584 wait complete. 2024-09-21T06:37:46.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.542+0000 7f9d74157740 20 client.15810 trim_cache size 0 max 16384 2024-09-21T06:37:46.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.560+0000 7f9d74157740 1 Processor -- start 2024-09-21T06:37:46.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.560+0000 7f9d74157740 1 -- start start 2024-09-21T06:37:46.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.560+0000 7f9d74157740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55982cad5490 0x55982ceac580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:46.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.560+0000 7f9d74157740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55982cadd670 0x55982ceab550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:46.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.560+0000 7f9d74157740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55982cafe350 0x55982cea6e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:46.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.560+0000 7f9d74157740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9d681b1bd0 con 0x55982cadd670 2024-09-21T06:37:46.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.560+0000 7f9d74157740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9d681af4a0 con 0x55982cad5490 2024-09-21T06:37:46.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.560+0000 7f9d74157740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9d681ad2f0 con 0x55982cafe350 2024-09-21T06:37:46.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.560+0000 7f9d66ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55982cadd670 0x55982ceab550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:46.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.560+0000 7f9d66ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55982cadd670 0x55982ceab550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43722/0 (socket says 172.21.15.7:43722) 2024-09-21T06:37:46.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.560+0000 7f9d66ffd640 1 -- 172.21.15.7:0/2131193144 learned_addr learned my addr 172.21.15.7:0/2131193144 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:37:46.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.560+0000 7f9d677fe640 1 --2- 172.21.15.7:0/2131193144 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55982cad5490 0x55982ceac580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:46.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.560+0000 7f9d67fff640 1 --2- 172.21.15.7:0/2131193144 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55982cafe350 0x55982cea6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:46.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.561+0000 7f9d66ffd640 1 -- 172.21.15.7:0/2131193144 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55982cafe350 msgr2=0x55982cea6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:46.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.561+0000 7f9d66ffd640 1 --2- 172.21.15.7:0/2131193144 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55982cafe350 0x55982cea6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:46.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.561+0000 7f9d66ffd640 1 -- 172.21.15.7:0/2131193144 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55982cad5490 msgr2=0x55982ceac580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:46.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.561+0000 7f9d66ffd640 1 --2- 172.21.15.7:0/2131193144 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55982cad5490 0x55982ceac580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:46.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.561+0000 7f9d66ffd640 1 -- 172.21.15.7:0/2131193144 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55982ceb2090 con 0x55982cadd670 2024-09-21T06:37:46.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.561+0000 7f9d66ffd640 1 --2- 172.21.15.7:0/2131193144 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55982cadd670 0x55982ceab550 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f9d50016040 tx=0x7f9d5000e880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd19481cb938d09b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:46.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.561+0000 7f9d5d7fa640 1 -- 172.21.15.7:0/2131193144 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d50036030 con 0x55982cadd670 2024-09-21T06:37:46.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.561+0000 7f9d5d7fa640 1 -- 172.21.15.7:0/2131193144 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9d50004b10 con 0x55982cadd670 2024-09-21T06:37:46.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.561+0000 7f9d5d7fa640 1 -- 172.21.15.7:0/2131193144 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d5001e810 con 0x55982cadd670 2024-09-21T06:37:46.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.562+0000 7f9d74157740 1 -- 172.21.15.7:0/2131193144 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55982cadd670 msgr2=0x55982ceab550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:46.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.562+0000 7f9d74157740 1 --2- 172.21.15.7:0/2131193144 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55982cadd670 0x55982ceab550 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f9d50016040 tx=0x7f9d5000e880 comp rx=0 tx=0).stop 2024-09-21T06:37:46.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.562+0000 7f9d74157740 1 -- 172.21.15.7:0/2131193144 shutdown_connections 2024-09-21T06:37:46.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.562+0000 7f9d74157740 1 --2- 172.21.15.7:0/2131193144 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55982cafe350 0x55982cea6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:46.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.562+0000 7f9d74157740 1 --2- 172.21.15.7:0/2131193144 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55982cadd670 0x55982ceab550 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:46.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.562+0000 7f9d74157740 1 --2- 172.21.15.7:0/2131193144 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55982cad5490 0x55982ceac580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:46.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.562+0000 7f9d74157740 1 -- 172.21.15.7:0/2131193144 >> 172.21.15.7:0/2131193144 conn(0x55982caf2740 msgr2=0x55982ceb22f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:46.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.562+0000 7f9d74157740 1 -- 172.21.15.7:0/2131193144 shutdown_connections 2024-09-21T06:37:46.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.562+0000 7f9d74157740 1 -- 172.21.15.7:0/2131193144 wait complete. 2024-09-21T06:37:46.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.562+0000 7f9d74157740 1 -- start start 2024-09-21T06:37:46.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.562+0000 7f9d74157740 1 Processor -- start 2024-09-21T06:37:46.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.563+0000 7f9d74157740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55982cad5490 0x55982ceb4d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:46.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.563+0000 7f9d74157740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55982cadd670 0x55982ceb52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:46.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.563+0000 7f9d74157740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55982cafe350 0x55982ceb57e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:46.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.563+0000 7f9d74157740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9d681ad960 con 0x55982cadd670 2024-09-21T06:37:46.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.563+0000 7f9d74157740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9d681aedd0 con 0x55982cafe350 2024-09-21T06:37:46.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.563+0000 7f9d74157740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9d681ae030 con 0x55982cad5490 2024-09-21T06:37:46.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.563+0000 7f9d74157740 10 client.0 _ll_register_callbacks cb 0x7f9d5000ee70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:37:46.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.563+0000 7f9d66ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55982cadd670 0x55982ceb52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:46.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.563+0000 7f9d66ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55982cadd670 0x55982ceb52a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43730/0 (socket says 172.21.15.7:43730) 2024-09-21T06:37:46.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.563+0000 7f9d66ffd640 1 -- 172.21.15.7:0/4075679177 learned_addr learned my addr 172.21.15.7:0/4075679177 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:37:46.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.563+0000 7f9d67fff640 1 --2- 172.21.15.7:0/4075679177 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55982cafe350 0x55982ceb57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:46.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.563+0000 7f9d677fe640 1 --2- 172.21.15.7:0/4075679177 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55982cad5490 0x55982ceb4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:46.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.563+0000 7f9d66ffd640 1 -- 172.21.15.7:0/4075679177 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55982cad5490 msgr2=0x55982ceb4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:46.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.563+0000 7f9d66ffd640 1 --2- 172.21.15.7:0/4075679177 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55982cad5490 0x55982ceb4d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:46.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.563+0000 7f9d66ffd640 1 -- 172.21.15.7:0/4075679177 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55982cafe350 msgr2=0x55982ceb57e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:46.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.563+0000 7f9d66ffd640 1 --2- 172.21.15.7:0/4075679177 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55982cafe350 0x55982ceb57e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:46.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.563+0000 7f9d66ffd640 1 -- 172.21.15.7:0/4075679177 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55982cf2c920 con 0x55982cadd670 2024-09-21T06:37:46.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.564+0000 7f9d66ffd640 1 --2- 172.21.15.7:0/4075679177 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55982cadd670 0x55982ceb52a0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f9d50004ce0 tx=0x7f9d5000e810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ade64adf1d07e49 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:46.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.564+0000 7f9d46ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:37:46.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.564+0000 7f9d46ffd640 1 -- 172.21.15.7:0/4075679177 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d50036040 con 0x55982cadd670 2024-09-21T06:37:46.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.564+0000 7f9d46ffd640 1 -- 172.21.15.7:0/4075679177 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f9d50004860 con 0x55982cadd670 2024-09-21T06:37:46.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.564+0000 7f9d74157740 1 -- 172.21.15.7:0/4075679177 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d50004b10 con 0x55982cadd670 2024-09-21T06:37:46.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.564+0000 7f9d46ffd640 1 -- 172.21.15.7:0/4075679177 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9d50005e90 con 0x55982cadd670 2024-09-21T06:37:46.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.564+0000 7f9d74157740 10 client.15816 fetch_fsmap learned FSMap version 25 2024-09-21T06:37:46.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.564+0000 7f9d74157740 1 -- 172.21.15.7:0/4075679177 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55982cf2db00 con 0x55982cadd670 2024-09-21T06:37:46.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.564+0000 7f9d46ffd640 1 -- 172.21.15.7:0/4075679177 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9d50004b10 con 0x55982cadd670 2024-09-21T06:37:46.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.564+0000 7f9d46ffd640 1 -- 172.21.15.7:0/4075679177 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9d50025040 con 0x55982cadd670 2024-09-21T06:37:46.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.564+0000 7f9d74157740 10 client.15816 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:37:46.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.564+0000 7f9d74157740 10 client.15816 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:37:46.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.564+0000 7f9d74157740 20 client.15816 populate_metadata read hostname 'smithi007' 2024-09-21T06:37:46.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.564+0000 7f9d74157740 1 --2- 172.21.15.7:0/4075679177 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55982ca92080 0x55982cf30180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:46.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.564+0000 7f9d74157740 4 client.15816 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:37:46.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.564+0000 7f9d74157740 1 -- 172.21.15.7:0/4075679177 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55982ce19860 con 0x55982ca92080 2024-09-21T06:37:46.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.565+0000 7f9d677fe640 1 --2- 172.21.15.7:0/4075679177 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55982ca92080 0x55982cf30180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:46.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.565+0000 7f9d46ffd640 10 client.15816 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:37:46.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.565+0000 7f9d677fe640 1 --2- 172.21.15.7:0/4075679177 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55982ca92080 0x55982cf30180 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1498ef2a36cd0c3 server_cookie=18a387c6cdc06f73 in_seq=0 out_seq=0 2024-09-21T06:37:46.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.567+0000 7f9d46ffd640 1 -- 172.21.15.7:0/4075679177 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55982ce19860 con 0x55982ca92080 2024-09-21T06:37:46.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.567+0000 7f9d46ffd640 10 client.15816 handle_command_reply: tid=0 2024-09-21T06:37:46.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.567+0000 7f9d74157740 1 client.15816 shutdown 2024-09-21T06:37:46.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.568+0000 7f9d74157740 1 -- 172.21.15.7:0/4075679177 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55982cadd670 msgr2=0x55982ceb52a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:46.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.568+0000 7f9d74157740 1 --2- 172.21.15.7:0/4075679177 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55982cadd670 0x55982ceb52a0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f9d50004ce0 tx=0x7f9d5000e810 comp rx=0 tx=0).stop 2024-09-21T06:37:46.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.568+0000 7f9d74157740 1 -- 172.21.15.7:0/4075679177 shutdown_connections 2024-09-21T06:37:46.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.568+0000 7f9d74157740 1 --2- 172.21.15.7:0/4075679177 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55982ca92080 0x55982cf30180 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:46.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.568+0000 7f9d74157740 1 --2- 172.21.15.7:0/4075679177 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55982cafe350 0x55982ceb57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:46.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.568+0000 7f9d74157740 1 --2- 172.21.15.7:0/4075679177 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55982cadd670 0x55982ceb52a0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:46.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.568+0000 7f9d46ffd640 0 client.15816 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:37:46.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.568+0000 7f9d74157740 1 --2- 172.21.15.7:0/4075679177 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55982cad5490 0x55982ceb4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:46.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.568+0000 7f9d74157740 1 -- 172.21.15.7:0/4075679177 >> 172.21.15.7:0/4075679177 conn(0x55982caf2740 msgr2=0x55982cea6b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:46.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.568+0000 7f9d74157740 1 -- 172.21.15.7:0/4075679177 shutdown_connections 2024-09-21T06:37:46.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.568+0000 7f9d74157740 1 -- 172.21.15.7:0/4075679177 wait complete. 2024-09-21T06:37:46.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.568+0000 7f9d74157740 20 client.15816 trim_cache size 0 max 16384 2024-09-21T06:37:46.573 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:37:46.573 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0, 2024-09-21T06:37:46.573 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_tag": "5cbaaba2-6ab1-4f83-abd6-8c6eef4b5c42", 2024-09-21T06:37:46.573 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": "asynchronous" 2024-09-21T06:37:46.573 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:37:46.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.569+0000 7f9d6dbe3640 1 -- 172.21.15.7:0/741713056 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f9d540b66b0 msgr2=0x7f9d540b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:46.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.569+0000 7f9d6dbe3640 1 --2- 172.21.15.7:0/741713056 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f9d540b66b0 0x7f9d540b8bc0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x55982cea40b0 tx=0x7f9d5800a2d0 comp rx=0 tx=0).stop 2024-09-21T06:37:46.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.569+0000 7f9d6dbe3640 1 -- 172.21.15.7:0/741713056 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d68109df0 msgr2=0x7f9d6819fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:46.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.569+0000 7f9d6dbe3640 1 --2- 172.21.15.7:0/741713056 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d68109df0 0x7f9d6819fc80 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f9d60005cc0 tx=0x7f9d6002f470 comp rx=0 tx=0).stop 2024-09-21T06:37:46.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.569+0000 7f9d6dbe3640 1 -- 172.21.15.7:0/741713056 shutdown_connections 2024-09-21T06:37:46.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.569+0000 7f9d6dbe3640 1 --2- 172.21.15.7:0/741713056 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f9d540b66b0 0x7f9d540b8bc0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:46.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.569+0000 7f9d6dbe3640 1 --2- 172.21.15.7:0/741713056 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9d68109df0 0x7f9d6819fc80 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:46.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.569+0000 7f9d6dbe3640 1 --2- 172.21.15.7:0/741713056 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d681094a0 0x7f9d6819a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:46.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.569+0000 7f9d6dbe3640 1 --2- 172.21.15.7:0/741713056 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9d68103b60 0x7f9d6819a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:46.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.569+0000 7f9d6dbe3640 1 -- 172.21.15.7:0/741713056 >> 172.21.15.7:0/741713056 conn(0x7f9d6807b850 msgr2=0x7f9d681074b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:46.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.569+0000 7f9d6dbe3640 1 -- 172.21.15.7:0/741713056 shutdown_connections 2024-09-21T06:37:46.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:46.569+0000 7f9d6dbe3640 1 -- 172.21.15.7:0/741713056 wait complete. 2024-09-21T06:37:46.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:37:46 smithi018 ceph-mon[34477]: pgmap v366: 97 pgs: 97 active+clean; 1.1 GiB data, 567 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 69 MiB/s wr, 25 op/s 2024-09-21T06:37:47.314 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:37:47.571 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:37:48.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.058+0000 7fb50dab2640 1 -- 172.21.15.7:0/253997142 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb508075730 msgr2=0x7fb508075b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:48.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.058+0000 7fb50dab2640 1 --2- 172.21.15.7:0/253997142 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb508075730 0x7fb508075b40 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fb4f8009ca0 tx=0x7fb4f802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:37:48.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.058+0000 7fb50dab2640 1 -- 172.21.15.7:0/253997142 shutdown_connections 2024-09-21T06:37:48.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.058+0000 7fb50dab2640 1 --2- 172.21.15.7:0/253997142 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb508110190 0x7fb5081125b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:48.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.058+0000 7fb50dab2640 1 --2- 172.21.15.7:0/253997142 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb508076080 0x7fb50810fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:48.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.058+0000 7fb50dab2640 1 --2- 172.21.15.7:0/253997142 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb508075730 0x7fb508075b40 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:48.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.058+0000 7fb50dab2640 1 -- 172.21.15.7:0/253997142 >> 172.21.15.7:0/253997142 conn(0x7fb5080ff600 msgr2=0x7fb508101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:48.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.058+0000 7fb50dab2640 1 -- 172.21.15.7:0/253997142 shutdown_connections 2024-09-21T06:37:48.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.058+0000 7fb50dab2640 1 -- 172.21.15.7:0/253997142 wait complete. 2024-09-21T06:37:48.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.059+0000 7fb50dab2640 1 Processor -- start 2024-09-21T06:37:48.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.059+0000 7fb50dab2640 1 -- start start 2024-09-21T06:37:48.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.059+0000 7fb50dab2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb508075730 0x7fb50819c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:48.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.059+0000 7fb50dab2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb508076080 0x7fb50819cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:48.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.059+0000 7fb50dab2640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb508110190 0x7fb5081a1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:48.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.059+0000 7fb50dab2640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb508115cf0 con 0x7fb508075730 2024-09-21T06:37:48.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.059+0000 7fb50dab2640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb508115b70 con 0x7fb508076080 2024-09-21T06:37:48.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.059+0000 7fb50dab2640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb508115e70 con 0x7fb508110190 2024-09-21T06:37:48.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.059+0000 7fb5077fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb508075730 0x7fb50819c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:48.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.059+0000 7fb5077fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb508075730 0x7fb50819c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43756/0 (socket says 172.21.15.7:43756) 2024-09-21T06:37:48.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.059+0000 7fb5077fe640 1 -- 172.21.15.7:0/1635253799 learned_addr learned my addr 172.21.15.7:0/1635253799 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:37:48.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.059+0000 7fb506ffd640 1 --2- 172.21.15.7:0/1635253799 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb508076080 0x7fb50819cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:48.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.060+0000 7fb507fff640 1 --2- 172.21.15.7:0/1635253799 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb508110190 0x7fb5081a1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:48.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.060+0000 7fb5077fe640 1 -- 172.21.15.7:0/1635253799 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb508110190 msgr2=0x7fb5081a1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:48.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.060+0000 7fb5077fe640 1 --2- 172.21.15.7:0/1635253799 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb508110190 0x7fb5081a1f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:48.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.060+0000 7fb5077fe640 1 -- 172.21.15.7:0/1635253799 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb508076080 msgr2=0x7fb50819cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:48.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.060+0000 7fb5077fe640 1 --2- 172.21.15.7:0/1635253799 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb508076080 0x7fb50819cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:48.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.060+0000 7fb5077fe640 1 -- 172.21.15.7:0/1635253799 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5081a26b0 con 0x7fb508075730 2024-09-21T06:37:48.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.060+0000 7fb5077fe640 1 --2- 172.21.15.7:0/1635253799 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb508075730 0x7fb50819c740 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fb4f8006010 tx=0x7fb4f80319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:48.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.060+0000 7fb504ff9640 1 -- 172.21.15.7:0/1635253799 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4f8003bf0 con 0x7fb508075730 2024-09-21T06:37:48.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.060+0000 7fb50dab2640 1 -- 172.21.15.7:0/1635253799 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5081a2940 con 0x7fb508075730 2024-09-21T06:37:48.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.060+0000 7fb504ff9640 1 -- 172.21.15.7:0/1635253799 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb4f8003d90 con 0x7fb508075730 2024-09-21T06:37:48.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.060+0000 7fb504ff9640 1 -- 172.21.15.7:0/1635253799 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4f802fc20 con 0x7fb508075730 2024-09-21T06:37:48.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.060+0000 7fb50dab2640 1 -- 172.21.15.7:0/1635253799 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5081a9100 con 0x7fb508075730 2024-09-21T06:37:48.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.063+0000 7fb514026740 1 Processor -- start 2024-09-21T06:37:48.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.063+0000 7fb514026740 1 -- start start 2024-09-21T06:37:48.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.063+0000 7fb504ff9640 1 -- 172.21.15.7:0/1635253799 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7fb4f80046a0 con 0x7fb508075730 2024-09-21T06:37:48.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.063+0000 7fb514026740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da5fb8c070 0x55da5ff33650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:48.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.063+0000 7fb514026740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55da5fb631b0 0x55da5ff33b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:48.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.063+0000 7fb514026740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da5fb6b390 0x55da5ff340d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:48.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.063+0000 7fb514026740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55da5fea9e50 con 0x55da5fb8c070 2024-09-21T06:37:48.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.063+0000 7fb514026740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55da5fe99280 con 0x55da5fb631b0 2024-09-21T06:37:48.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.063+0000 7fb514026740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55da5fe9d090 con 0x55da5fb6b390 2024-09-21T06:37:48.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.063+0000 7fb507fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da5fb8c070 0x55da5ff33650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:48.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.063+0000 7fb507fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da5fb8c070 0x55da5ff33650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43772/0 (socket says 172.21.15.7:43772) 2024-09-21T06:37:48.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.063+0000 7fb507fff640 1 -- 172.21.15.7:0/3036758025 learned_addr learned my addr 172.21.15.7:0/3036758025 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:37:48.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.063+0000 7fb5077fe640 1 --2- 172.21.15.7:0/3036758025 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55da5fb631b0 0x55da5ff33b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:48.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.064+0000 7fb506ffd640 1 --2- 172.21.15.7:0/3036758025 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da5fb6b390 0x55da5ff340d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:48.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.064+0000 7fb507fff640 1 -- 172.21.15.7:0/3036758025 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da5fb6b390 msgr2=0x55da5ff340d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:48.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.064+0000 7fb507fff640 1 --2- 172.21.15.7:0/3036758025 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da5fb6b390 0x55da5ff340d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:48.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.064+0000 7fb507fff640 1 -- 172.21.15.7:0/3036758025 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55da5fb631b0 msgr2=0x55da5ff33b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:48.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.064+0000 7fb507fff640 1 --2- 172.21.15.7:0/3036758025 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55da5fb631b0 0x55da5ff33b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:48.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.064+0000 7fb507fff640 1 -- 172.21.15.7:0/3036758025 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da5fbf7650 con 0x55da5fb8c070 2024-09-21T06:37:48.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.064+0000 7fb507fff640 1 --2- 172.21.15.7:0/3036758025 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da5fb8c070 0x55da5ff33650 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fb500009ab0 tx=0x7fb500009f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71845880098cd1af server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:48.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.064+0000 7fb504ff9640 1 --2- 172.21.15.7:0/1635253799 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fb4f00b6680 0x7fb4f00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:48.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.064+0000 7fb4edffb640 1 -- 172.21.15.7:0/3036758025 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb500016070 con 0x55da5fb8c070 2024-09-21T06:37:48.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.064+0000 7fb5077fe640 1 --2- 172.21.15.7:0/1635253799 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fb4f00b6680 0x7fb4f00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:48.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.064+0000 7fb4edffb640 1 -- 172.21.15.7:0/3036758025 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb50000ecb0 con 0x55da5fb8c070 2024-09-21T06:37:48.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.064+0000 7fb4edffb640 1 -- 172.21.15.7:0/3036758025 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb500010630 con 0x55da5fb8c070 2024-09-21T06:37:48.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.064+0000 7fb504ff9640 1 -- 172.21.15.7:0/1635253799 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fb4f81089d0 con 0x7fb508075730 2024-09-21T06:37:48.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.065+0000 7fb514026740 1 -- 172.21.15.7:0/3036758025 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da5fb8c070 msgr2=0x55da5ff33650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:48.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.065+0000 7fb5077fe640 1 --2- 172.21.15.7:0/1635253799 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fb4f00b6680 0x7fb4f00b8b90 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x55da5ff322d0 tx=0x7fb4f810c410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:48.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.065+0000 7fb514026740 1 --2- 172.21.15.7:0/3036758025 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da5fb8c070 0x55da5ff33650 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fb500009ab0 tx=0x7fb500009f70 comp rx=0 tx=0).stop 2024-09-21T06:37:48.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.065+0000 7fb514026740 1 -- 172.21.15.7:0/3036758025 shutdown_connections 2024-09-21T06:37:48.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.065+0000 7fb514026740 1 --2- 172.21.15.7:0/3036758025 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da5fb6b390 0x55da5ff340d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:48.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.065+0000 7fb514026740 1 --2- 172.21.15.7:0/3036758025 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55da5fb631b0 0x55da5ff33b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:48.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.065+0000 7fb514026740 1 --2- 172.21.15.7:0/3036758025 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da5fb8c070 0x55da5ff33650 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:48.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.065+0000 7fb514026740 1 -- 172.21.15.7:0/3036758025 >> 172.21.15.7:0/3036758025 conn(0x55da5fb80460 msgr2=0x55da5ff31540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:48.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.065+0000 7fb514026740 1 -- 172.21.15.7:0/3036758025 shutdown_connections 2024-09-21T06:37:48.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.065+0000 7fb514026740 1 -- 172.21.15.7:0/3036758025 wait complete. 2024-09-21T06:37:48.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.065+0000 7fb514026740 1 -- start start 2024-09-21T06:37:48.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.066+0000 7fb514026740 1 Processor -- start 2024-09-21T06:37:48.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.066+0000 7fb514026740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55da5fb631b0 0x55da5ff3ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:48.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.066+0000 7fb514026740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da5fb6b390 0x55da5ff3f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:48.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.066+0000 7fb514026740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da5fb8c070 0x55da5ff4b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:48.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.066+0000 7fb514026740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55da5fcfa700 con 0x55da5fb6b390 2024-09-21T06:37:48.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.066+0000 7fb514026740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55da5fe34110 con 0x55da5fb631b0 2024-09-21T06:37:48.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.066+0000 7fb514026740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55da5ff41e30 con 0x55da5fb8c070 2024-09-21T06:37:48.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.066+0000 7fb514026740 10 client.0 _ll_register_callbacks cb 0x55da5fe4d990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:37:48.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.066+0000 7fb506ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da5fb6b390 0x55da5ff3f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:48.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.066+0000 7fb506ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da5fb6b390 0x55da5ff3f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43784/0 (socket says 172.21.15.7:43784) 2024-09-21T06:37:48.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.066+0000 7fb506ffd640 1 -- 172.21.15.7:0/1902791801 learned_addr learned my addr 172.21.15.7:0/1902791801 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:37:48.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.066+0000 7fb507fff640 1 --2- 172.21.15.7:0/1902791801 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55da5fb631b0 0x55da5ff3ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:48.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.066+0000 7fb507fff640 1 --2- 172.21.15.7:0/1902791801 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da5fb8c070 0x55da5ff4b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:48.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.067+0000 7fb506ffd640 1 -- 172.21.15.7:0/1902791801 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da5fb8c070 msgr2=0x55da5ff4b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:48.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.067+0000 7fb506ffd640 1 --2- 172.21.15.7:0/1902791801 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da5fb8c070 0x55da5ff4b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:48.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.067+0000 7fb506ffd640 1 -- 172.21.15.7:0/1902791801 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55da5fb631b0 msgr2=0x55da5ff3ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:48.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.067+0000 7fb506ffd640 1 --2- 172.21.15.7:0/1902791801 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55da5fb631b0 0x55da5ff3ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:48.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.067+0000 7fb506ffd640 1 -- 172.21.15.7:0/1902791801 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da5fe61c40 con 0x55da5fb6b390 2024-09-21T06:37:48.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.067+0000 7fb507fff640 1 --2- 172.21.15.7:0/1902791801 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da5fb8c070 0x55da5ff4b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:37:48.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.067+0000 7fb506ffd640 1 --2- 172.21.15.7:0/1902791801 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da5fb6b390 0x55da5ff3f250 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc00b920 tx=0x7fb4fc00bd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d17cc13364f680b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:48.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.067+0000 7fb4e6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:37:48.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.067+0000 7fb4e6ffd640 1 -- 172.21.15.7:0/1902791801 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4fc01b440 con 0x55da5fb6b390 2024-09-21T06:37:48.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.067+0000 7fb4e6ffd640 1 -- 172.21.15.7:0/1902791801 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fb4fc011440 con 0x55da5fb6b390 2024-09-21T06:37:48.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.067+0000 7fb514026740 1 -- 172.21.15.7:0/1902791801 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb50000ecb0 con 0x55da5fb6b390 2024-09-21T06:37:48.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.067+0000 7fb4e6ffd640 1 -- 172.21.15.7:0/1902791801 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb4fc020030 con 0x55da5fb6b390 2024-09-21T06:37:48.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.067+0000 7fb514026740 10 client.15828 fetch_fsmap learned FSMap version 25 2024-09-21T06:37:48.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.067+0000 7fb514026740 1 -- 172.21.15.7:0/1902791801 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55da5ff4dba0 con 0x55da5fb6b390 2024-09-21T06:37:48.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.067+0000 7fb4e6ffd640 1 -- 172.21.15.7:0/1902791801 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb50000ecb0 con 0x55da5fb6b390 2024-09-21T06:37:48.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.068+0000 7fb4e6ffd640 1 -- 172.21.15.7:0/1902791801 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb4fc019020 con 0x55da5fb6b390 2024-09-21T06:37:48.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.068+0000 7fb514026740 10 client.15828 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:37:48.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.068+0000 7fb514026740 10 client.15828 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:37:48.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.068+0000 7fb514026740 20 client.15828 populate_metadata read hostname 'smithi007' 2024-09-21T06:37:48.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.068+0000 7fb514026740 1 --2- 172.21.15.7:0/1902791801 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55da5fb4a9f0 0x55da5ff511a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:48.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.068+0000 7fb514026740 4 client.15828 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:37:48.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.068+0000 7fb514026740 1 -- 172.21.15.7:0/1902791801 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55da5feabda0 con 0x55da5fb4a9f0 2024-09-21T06:37:48.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.068+0000 7fb507fff640 1 --2- 172.21.15.7:0/1902791801 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55da5fb4a9f0 0x55da5ff511a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:48.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.068+0000 7fb4e6ffd640 10 client.15828 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:37:48.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.068+0000 7fb507fff640 1 --2- 172.21.15.7:0/1902791801 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55da5fb4a9f0 0x55da5ff511a0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54ae4e892c942c0f server_cookie=1459759329068c04 in_seq=0 out_seq=0 2024-09-21T06:37:48.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.069+0000 7fb4e6ffd640 1 -- 172.21.15.7:0/1902791801 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55da5feabda0 con 0x55da5fb4a9f0 2024-09-21T06:37:48.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.069+0000 7fb4e6ffd640 10 client.15828 handle_command_reply: tid=0 2024-09-21T06:37:48.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.069+0000 7fb514026740 1 client.15828 shutdown 2024-09-21T06:37:48.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.069+0000 7fb514026740 1 -- 172.21.15.7:0/1902791801 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da5fb6b390 msgr2=0x55da5ff3f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:48.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.069+0000 7fb514026740 1 --2- 172.21.15.7:0/1902791801 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da5fb6b390 0x55da5ff3f250 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc00b920 tx=0x7fb4fc00bd20 comp rx=0 tx=0).stop 2024-09-21T06:37:48.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.069+0000 7fb514026740 1 -- 172.21.15.7:0/1902791801 shutdown_connections 2024-09-21T06:37:48.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.069+0000 7fb514026740 1 --2- 172.21.15.7:0/1902791801 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55da5fb4a9f0 0x55da5ff511a0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:48.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.069+0000 7fb514026740 1 --2- 172.21.15.7:0/1902791801 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da5fb8c070 0x55da5ff4b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:48.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.069+0000 7fb514026740 1 --2- 172.21.15.7:0/1902791801 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da5fb6b390 0x55da5ff3f250 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:48.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.069+0000 7fb4e6ffd640 0 client.15828 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:37:48.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.069+0000 7fb514026740 1 --2- 172.21.15.7:0/1902791801 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55da5fb631b0 0x55da5ff3ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:48.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.069+0000 7fb514026740 1 -- 172.21.15.7:0/1902791801 >> 172.21.15.7:0/1902791801 conn(0x55da5fb80460 msgr2=0x55da5ff36830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:48.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.070+0000 7fb514026740 1 -- 172.21.15.7:0/1902791801 shutdown_connections 2024-09-21T06:37:48.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.070+0000 7fb514026740 1 -- 172.21.15.7:0/1902791801 wait complete. 2024-09-21T06:37:48.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.070+0000 7fb514026740 20 client.15828 trim_cache size 0 max 16384 2024-09-21T06:37:48.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.087+0000 7fb514026740 1 Processor -- start 2024-09-21T06:37:48.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.087+0000 7fb514026740 1 -- start start 2024-09-21T06:37:48.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.088+0000 7fb514026740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da5fb631b0 0x55da5ff35040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:48.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.088+0000 7fb514026740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55da5fb6b390 0x55da5ff40940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:48.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.088+0000 7fb514026740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da5fb8c070 0x55da5ff30b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:48.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.088+0000 7fb514026740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb5081b4000 con 0x55da5fb631b0 2024-09-21T06:37:48.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.088+0000 7fb514026740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb5081b18d0 con 0x55da5fb6b390 2024-09-21T06:37:48.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.088+0000 7fb514026740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb5081af700 con 0x55da5fb8c070 2024-09-21T06:37:48.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.088+0000 7fb507fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da5fb631b0 0x55da5ff35040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:48.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.088+0000 7fb507fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da5fb631b0 0x55da5ff35040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43792/0 (socket says 172.21.15.7:43792) 2024-09-21T06:37:48.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.088+0000 7fb507fff640 1 -- 172.21.15.7:0/759053671 learned_addr learned my addr 172.21.15.7:0/759053671 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:37:48.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.088+0000 7fb506ffd640 1 --2- 172.21.15.7:0/759053671 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55da5fb6b390 0x55da5ff40940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:48.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.088+0000 7fb507fff640 1 --2- 172.21.15.7:0/759053671 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da5fb8c070 0x55da5ff30b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:48.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.088+0000 7fb507fff640 1 -- 172.21.15.7:0/759053671 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da5fb8c070 msgr2=0x55da5ff30b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:48.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.088+0000 7fb507fff640 1 --2- 172.21.15.7:0/759053671 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da5fb8c070 0x55da5ff30b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:48.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.088+0000 7fb507fff640 1 -- 172.21.15.7:0/759053671 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55da5fb6b390 msgr2=0x55da5ff40940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:48.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.088+0000 7fb507fff640 1 --2- 172.21.15.7:0/759053671 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55da5fb6b390 0x55da5ff40940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:48.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.088+0000 7fb507fff640 1 -- 172.21.15.7:0/759053671 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da5ff3ffd0 con 0x55da5fb631b0 2024-09-21T06:37:48.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.088+0000 7fb507fff640 1 --2- 172.21.15.7:0/759053671 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da5fb631b0 0x55da5ff35040 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fb500011e00 tx=0x7fb500011e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d388741df8e05424 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:48.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.089+0000 7fb4ed7fa640 1 -- 172.21.15.7:0/759053671 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb500016070 con 0x55da5fb631b0 2024-09-21T06:37:48.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.089+0000 7fb4ed7fa640 1 -- 172.21.15.7:0/759053671 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb50000ec10 con 0x55da5fb631b0 2024-09-21T06:37:48.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.089+0000 7fb4ed7fa640 1 -- 172.21.15.7:0/759053671 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5000052d0 con 0x55da5fb631b0 2024-09-21T06:37:48.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.089+0000 7fb514026740 1 -- 172.21.15.7:0/759053671 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da5fb631b0 msgr2=0x55da5ff35040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:48.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.089+0000 7fb514026740 1 --2- 172.21.15.7:0/759053671 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da5fb631b0 0x55da5ff35040 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fb500011e00 tx=0x7fb500011e30 comp rx=0 tx=0).stop 2024-09-21T06:37:48.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.089+0000 7fb514026740 1 -- 172.21.15.7:0/759053671 shutdown_connections 2024-09-21T06:37:48.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.089+0000 7fb514026740 1 --2- 172.21.15.7:0/759053671 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da5fb8c070 0x55da5ff30b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:48.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.089+0000 7fb514026740 1 --2- 172.21.15.7:0/759053671 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55da5fb6b390 0x55da5ff40940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:48.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.089+0000 7fb514026740 1 --2- 172.21.15.7:0/759053671 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da5fb631b0 0x55da5ff35040 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:48.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.089+0000 7fb514026740 1 -- 172.21.15.7:0/759053671 >> 172.21.15.7:0/759053671 conn(0x55da5fb80460 msgr2=0x55da5ff40230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:48.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.090+0000 7fb514026740 1 -- 172.21.15.7:0/759053671 shutdown_connections 2024-09-21T06:37:48.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.090+0000 7fb514026740 1 -- 172.21.15.7:0/759053671 wait complete. 2024-09-21T06:37:48.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.090+0000 7fb514026740 1 -- start start 2024-09-21T06:37:48.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.090+0000 7fb514026740 1 Processor -- start 2024-09-21T06:37:48.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.090+0000 7fb514026740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da5fb631b0 0x55da5ff477b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:48.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.090+0000 7fb514026740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55da5fb6b390 0x55da5ff42cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:48.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.090+0000 7fb514026740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da5fb8c070 0x55da5ff431f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:48.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.091+0000 7fb514026740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb5081afd90 con 0x55da5fb631b0 2024-09-21T06:37:48.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.091+0000 7fb514026740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb5081b1200 con 0x55da5fb6b390 2024-09-21T06:37:48.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.091+0000 7fb514026740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb5081b0460 con 0x55da5fb8c070 2024-09-21T06:37:48.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.091+0000 7fb514026740 10 client.0 _ll_register_callbacks cb 0x7fb4fc004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:37:48.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.091+0000 7fb507fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da5fb631b0 0x55da5ff477b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:48.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.091+0000 7fb507fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da5fb631b0 0x55da5ff477b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43794/0 (socket says 172.21.15.7:43794) 2024-09-21T06:37:48.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.091+0000 7fb507fff640 1 -- 172.21.15.7:0/130573966 learned_addr learned my addr 172.21.15.7:0/130573966 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:37:48.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.091+0000 7fb507fff640 1 --2- 172.21.15.7:0/130573966 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da5fb8c070 0x55da5ff431f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:48.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.091+0000 7fb506ffd640 1 --2- 172.21.15.7:0/130573966 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55da5fb6b390 0x55da5ff42cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:48.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.091+0000 7fb507fff640 1 -- 172.21.15.7:0/130573966 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da5fb8c070 msgr2=0x55da5ff431f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:48.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.091+0000 7fb507fff640 1 --2- 172.21.15.7:0/130573966 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da5fb8c070 0x55da5ff431f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:48.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.091+0000 7fb507fff640 1 -- 172.21.15.7:0/130573966 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55da5fb6b390 msgr2=0x55da5ff42cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:48.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.091+0000 7fb507fff640 1 --2- 172.21.15.7:0/130573966 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55da5fb6b390 0x55da5ff42cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:48.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.091+0000 7fb507fff640 1 -- 172.21.15.7:0/130573966 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da5ff43860 con 0x55da5fb631b0 2024-09-21T06:37:48.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.091+0000 7fb507fff640 1 --2- 172.21.15.7:0/130573966 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da5fb631b0 0x55da5ff477b0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fb500009870 tx=0x7fb5000097e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8f3635382313b8a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:48.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.091+0000 7fb4e6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:37:48.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.092+0000 7fb4e6ffd640 1 -- 172.21.15.7:0/130573966 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb500016070 con 0x55da5fb631b0 2024-09-21T06:37:48.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.092+0000 7fb4e6ffd640 1 -- 172.21.15.7:0/130573966 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fb500011470 con 0x55da5fb631b0 2024-09-21T06:37:48.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.092+0000 7fb514026740 1 -- 172.21.15.7:0/130573966 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb50000ec10 con 0x55da5fb631b0 2024-09-21T06:37:48.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.092+0000 7fb4e6ffd640 1 -- 172.21.15.7:0/130573966 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb500011670 con 0x55da5fb631b0 2024-09-21T06:37:48.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.092+0000 7fb514026740 10 client.15834 fetch_fsmap learned FSMap version 25 2024-09-21T06:37:48.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.092+0000 7fb514026740 1 -- 172.21.15.7:0/130573966 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55da5ffbb9e0 con 0x55da5fb631b0 2024-09-21T06:37:48.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.092+0000 7fb4e6ffd640 1 -- 172.21.15.7:0/130573966 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb50000ec10 con 0x55da5fb631b0 2024-09-21T06:37:48.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.092+0000 7fb4e6ffd640 1 -- 172.21.15.7:0/130573966 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb50000f040 con 0x55da5fb631b0 2024-09-21T06:37:48.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.092+0000 7fb514026740 10 client.15834 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:37:48.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.092+0000 7fb514026740 10 client.15834 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:37:48.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.092+0000 7fb514026740 20 client.15834 populate_metadata read hostname 'smithi007' 2024-09-21T06:37:48.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.092+0000 7fb514026740 1 --2- 172.21.15.7:0/130573966 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55da5fb1fda0 0x55da5ffbddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:48.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.092+0000 7fb514026740 4 client.15834 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:37:48.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.092+0000 7fb514026740 1 -- 172.21.15.7:0/130573966 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55da5fea7850 con 0x55da5fb1fda0 2024-09-21T06:37:48.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.093+0000 7fb506ffd640 1 --2- 172.21.15.7:0/130573966 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55da5fb1fda0 0x55da5ffbddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:48.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.093+0000 7fb4e6ffd640 10 client.15834 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:37:48.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.093+0000 7fb506ffd640 1 --2- 172.21.15.7:0/130573966 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55da5fb1fda0 0x55da5ffbddc0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5bd968714d4baa1f server_cookie=c6a48f90a10bcd84 in_seq=0 out_seq=0 2024-09-21T06:37:48.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.093+0000 7fb4e6ffd640 1 -- 172.21.15.7:0/130573966 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1138 (crc 0 0 0) 0x55da5fea7850 con 0x55da5fb1fda0 2024-09-21T06:37:48.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.093+0000 7fb4e6ffd640 10 client.15834 handle_command_reply: tid=0 2024-09-21T06:37:48.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.093+0000 7fb514026740 1 client.15834 shutdown 2024-09-21T06:37:48.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.094+0000 7fb514026740 1 -- 172.21.15.7:0/130573966 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da5fb631b0 msgr2=0x55da5ff477b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:48.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.094+0000 7fb514026740 1 --2- 172.21.15.7:0/130573966 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da5fb631b0 0x55da5ff477b0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fb500009870 tx=0x7fb5000097e0 comp rx=0 tx=0).stop 2024-09-21T06:37:48.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.094+0000 7fb514026740 1 -- 172.21.15.7:0/130573966 shutdown_connections 2024-09-21T06:37:48.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.094+0000 7fb514026740 1 --2- 172.21.15.7:0/130573966 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55da5fb1fda0 0x55da5ffbddc0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:48.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.094+0000 7fb514026740 1 --2- 172.21.15.7:0/130573966 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da5fb8c070 0x55da5ff431f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:48.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.094+0000 7fb514026740 1 --2- 172.21.15.7:0/130573966 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55da5fb6b390 0x55da5ff42cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:48.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.094+0000 7fb514026740 1 --2- 172.21.15.7:0/130573966 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da5fb631b0 0x55da5ff477b0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:48.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.094+0000 7fb514026740 1 -- 172.21.15.7:0/130573966 >> 172.21.15.7:0/130573966 conn(0x55da5fb80460 msgr2=0x55da5ff34e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:48.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.094+0000 7fb4e6ffd640 0 client.15834 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:37:48.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.094+0000 7fb514026740 1 -- 172.21.15.7:0/130573966 shutdown_connections 2024-09-21T06:37:48.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.094+0000 7fb514026740 1 -- 172.21.15.7:0/130573966 wait complete. 2024-09-21T06:37:48.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.094+0000 7fb514026740 20 client.15834 trim_cache size 0 max 16384 2024-09-21T06:37:48.105 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:37:48.105 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T06:37:48.106 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": { 2024-09-21T06:37:48.106 INFO:teuthology.orchestra.run.smithi007.stdout: "5cbaaba2-6ab1-4f83-abd6-8c6eef4b5c42": { 2024-09-21T06:37:48.106 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:37:48.106 INFO:teuthology.orchestra.run.smithi007.stdout: "tag": "5cbaaba2-6ab1-4f83-abd6-8c6eef4b5c42", 2024-09-21T06:37:48.106 INFO:teuthology.orchestra.run.smithi007.stdout: "options": "recursive,force" 2024-09-21T06:37:48.106 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:37:48.106 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:37:48.106 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_stats": { 2024-09-21T06:37:48.106 INFO:teuthology.orchestra.run.smithi007.stdout: "5cbaaba2-6ab1-4f83-abd6-8c6eef4b5c42": { 2024-09-21T06:37:48.106 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:37:46.566272+0000", 2024-09-21T06:37:48.106 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:37:48.107 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:37:48.107 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:37:48.107 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:37:48.107 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:37:48.107 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:37:48.107 INFO:teuthology.orchestra.run.smithi007.stdout: "6231e9c1-14a2-40b5-be3c-76d87a0d733b": { 2024-09-21T06:37:48.107 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:37:02.484812+0000", 2024-09-21T06:37:48.107 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:37:48.107 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:37:48.108 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:37:48.108 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:37:48.108 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:37:48.108 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:37:48.108 INFO:teuthology.orchestra.run.smithi007.stdout: "0b89345c-1f00-4efe-8ee9-4cb17e43584c": { 2024-09-21T06:37:48.108 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:36:19.500334+0000", 2024-09-21T06:37:48.108 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:37:48.108 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:37:48.108 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:37:48.108 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:37:48.109 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:37:48.109 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:37:48.109 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:37:48.109 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:37:48.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.095+0000 7fb50dab2640 1 -- 172.21.15.7:0/1635253799 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fb4f00b6680 msgr2=0x7fb4f00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:48.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.095+0000 7fb50dab2640 1 --2- 172.21.15.7:0/1635253799 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fb4f00b6680 0x7fb4f00b8b90 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x55da5ff322d0 tx=0x7fb4f810c410 comp rx=0 tx=0).stop 2024-09-21T06:37:48.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.095+0000 7fb50dab2640 1 -- 172.21.15.7:0/1635253799 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb508075730 msgr2=0x7fb50819c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:48.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.095+0000 7fb50dab2640 1 --2- 172.21.15.7:0/1635253799 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb508075730 0x7fb50819c740 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fb4f8006010 tx=0x7fb4f80319f0 comp rx=0 tx=0).stop 2024-09-21T06:37:48.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.095+0000 7fb50dab2640 1 -- 172.21.15.7:0/1635253799 shutdown_connections 2024-09-21T06:37:48.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.095+0000 7fb50dab2640 1 --2- 172.21.15.7:0/1635253799 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fb4f00b6680 0x7fb4f00b8b90 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:48.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.095+0000 7fb50dab2640 1 --2- 172.21.15.7:0/1635253799 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb508110190 0x7fb5081a1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:48.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.095+0000 7fb50dab2640 1 --2- 172.21.15.7:0/1635253799 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb508076080 0x7fb50819cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:48.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.095+0000 7fb50dab2640 1 --2- 172.21.15.7:0/1635253799 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb508075730 0x7fb50819c740 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:48.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.095+0000 7fb50dab2640 1 -- 172.21.15.7:0/1635253799 >> 172.21.15.7:0/1635253799 conn(0x7fb5080ff600 msgr2=0x7fb508109d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:48.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.095+0000 7fb50dab2640 1 -- 172.21.15.7:0/1635253799 shutdown_connections 2024-09-21T06:37:48.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:37:48.095+0000 7fb50dab2640 1 -- 172.21.15.7:0/1635253799 wait complete. 2024-09-21T06:37:48.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:37:48 smithi144 ceph-mon[34653]: scrub queued for path: / 2024-09-21T06:37:48.536 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:37:48 smithi144 ceph-mon[34653]: scrub summary: idle+waiting paths [/] 2024-09-21T06:37:48.536 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:37:48 smithi144 ceph-mon[34653]: scrub summary: active paths [/] 2024-09-21T06:37:48.536 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:37:48 smithi144 ceph-mon[34653]: scrub summary: idle+waiting paths [/] 2024-09-21T06:37:48.536 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:37:48 smithi144 ceph-mon[34653]: pgmap v367: 97 pgs: 97 active+clean; 1.1 GiB data, 571 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 103 MiB/s wr, 46 op/s 2024-09-21T06:37:48.593 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:37:48 smithi007 ceph-mon[30983]: scrub queued for path: / 2024-09-21T06:37:48.593 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:37:48 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T06:37:48.593 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:37:48 smithi007 ceph-mon[30983]: scrub summary: active paths [/] 2024-09-21T06:37:48.593 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:37:48 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T06:37:48.593 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:37:48 smithi007 ceph-mon[30983]: pgmap v367: 97 pgs: 97 active+clean; 1.1 GiB data, 571 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 103 MiB/s wr, 46 op/s 2024-09-21T06:37:48.620 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:37:48 smithi018 ceph-mon[34477]: scrub queued for path: / 2024-09-21T06:37:48.621 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:37:48 smithi018 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-21T06:37:48.621 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:37:48 smithi018 ceph-mon[34477]: scrub summary: active paths [/] 2024-09-21T06:37:48.621 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:37:48 smithi018 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-21T06:37:48.621 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:37:48 smithi018 ceph-mon[34477]: pgmap v367: 97 pgs: 97 active+clean; 1.1 GiB data, 571 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 103 MiB/s wr, 46 op/s 2024-09-21T06:37:48.890 INFO:tasks.cephfs.filesystem:scrub status for tag:5cbaaba2-6ab1-4f83-abd6-8c6eef4b5c42 - {'path': '/', 'tag': '5cbaaba2-6ab1-4f83-abd6-8c6eef4b5c42', 'options': 'recursive,force'} 2024-09-21T06:37:49.548 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-09-21T06:37:49.548 INFO:tasks.workunit.client.0.smithi007.stdout: Children see throughput for 1 rewriters = 735090.12 kB/sec 2024-09-21T06:37:49.548 INFO:tasks.workunit.client.0.smithi007.stdout: Parent sees throughput for 1 rewriters = 734991.76 kB/sec 2024-09-21T06:37:49.548 INFO:tasks.workunit.client.0.smithi007.stdout: Min throughput per process = 735090.12 kB/sec 2024-09-21T06:37:49.548 INFO:tasks.workunit.client.0.smithi007.stdout: Max throughput per process = 735090.12 kB/sec 2024-09-21T06:37:49.548 INFO:tasks.workunit.client.0.smithi007.stdout: Avg throughput per process = 735090.12 kB/sec 2024-09-21T06:37:49.548 INFO:tasks.workunit.client.0.smithi007.stdout: Min xfer = 1048576.00 kB 2024-09-21T06:37:50.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:37:50 smithi144 ceph-mon[34653]: pgmap v368: 97 pgs: 97 active+clean; 1.1 GiB data, 569 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 89 MiB/s wr, 54 op/s 2024-09-21T06:37:50.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:37:50 smithi144 ceph-mon[34653]: scrub summary: idle 2024-09-21T06:37:50.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:37:50 smithi007 ceph-mon[30983]: pgmap v368: 97 pgs: 97 active+clean; 1.1 GiB data, 569 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 89 MiB/s wr, 54 op/s 2024-09-21T06:37:50.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:37:50 smithi007 ceph-mon[30983]: scrub summary: idle 2024-09-21T06:37:50.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:37:50 smithi018 ceph-mon[34477]: pgmap v368: 97 pgs: 97 active+clean; 1.1 GiB data, 569 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 89 MiB/s wr, 54 op/s 2024-09-21T06:37:50.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:37:50 smithi018 ceph-mon[34477]: scrub summary: idle 2024-09-21T06:37:52.322 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-09-21T06:37:52.322 INFO:tasks.workunit.client.0.smithi007.stdout: Children see throughput for 1 readers = 7654610.00 kB/sec 2024-09-21T06:37:52.322 INFO:tasks.workunit.client.0.smithi007.stdout: Parent sees throughput for 1 readers = 7642080.67 kB/sec 2024-09-21T06:37:52.322 INFO:tasks.workunit.client.0.smithi007.stdout: Min throughput per process = 7654610.00 kB/sec 2024-09-21T06:37:52.322 INFO:tasks.workunit.client.0.smithi007.stdout: Max throughput per process = 7654610.00 kB/sec 2024-09-21T06:37:52.322 INFO:tasks.workunit.client.0.smithi007.stdout: Avg throughput per process = 7654610.00 kB/sec 2024-09-21T06:37:52.322 INFO:tasks.workunit.client.0.smithi007.stdout: Min xfer = 1048576.00 kB 2024-09-21T06:37:52.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:37:52 smithi144 ceph-mon[34653]: pgmap v369: 97 pgs: 97 active+clean; 1.0 GiB data, 564 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 116 MiB/s wr, 61 op/s 2024-09-21T06:37:52.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:37:52 smithi007 ceph-mon[30983]: pgmap v369: 97 pgs: 97 active+clean; 1.0 GiB data, 564 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 116 MiB/s wr, 61 op/s 2024-09-21T06:37:52.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:37:52 smithi018 ceph-mon[34477]: pgmap v369: 97 pgs: 97 active+clean; 1.0 GiB data, 564 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 116 MiB/s wr, 61 op/s 2024-09-21T06:37:52.737 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.735+0000 7f74e6ff9640 1 -- 172.21.15.7:0/477294290 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f74e0105a40 msgr2=0x7f74e010f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:52.737 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.735+0000 7f74e6ff9640 1 --2- 172.21.15.7:0/477294290 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f74e0105a40 0x7f74e010f4b0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f74d8009900 tx=0x7f74d802a410 comp rx=0 tx=0).stop 2024-09-21T06:37:52.737 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.735+0000 7f74e6ff9640 1 -- 172.21.15.7:0/477294290 shutdown_connections 2024-09-21T06:37:52.737 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.735+0000 7f74e6ff9640 1 --2- 172.21.15.7:0/477294290 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f74e0105a40 0x7f74e010f4b0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:52.738 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.735+0000 7f74e6ff9640 1 --2- 172.21.15.7:0/477294290 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f74e01050f0 0x7f74e0105500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:52.738 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.735+0000 7f74e6ff9640 1 --2- 172.21.15.7:0/477294290 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74e0103130 0x7f74e0103540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:52.738 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.735+0000 7f74e6ff9640 1 -- 172.21.15.7:0/477294290 >> 172.21.15.7:0/477294290 conn(0x7f74e0079e50 msgr2=0x7f74e007a260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:52.738 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.735+0000 7f74e6ff9640 1 -- 172.21.15.7:0/477294290 shutdown_connections 2024-09-21T06:37:52.738 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.735+0000 7f74e6ff9640 1 -- 172.21.15.7:0/477294290 wait complete. 2024-09-21T06:37:52.738 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.735+0000 7f74e6ff9640 1 Processor -- start 2024-09-21T06:37:52.738 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.735+0000 7f74e6ff9640 1 -- start start 2024-09-21T06:37:52.740 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.736+0000 7f74e6ff9640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74e0103130 0x7f74e019b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:52.740 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.736+0000 7f74e6ff9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f74e01050f0 0x7f74e019b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:52.740 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.736+0000 7f74e6ff9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f74e0105a40 0x7f74e019bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:52.740 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.736+0000 7f74e6ff9640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f74e0112940 con 0x7f74e01050f0 2024-09-21T06:37:52.740 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.736+0000 7f74e6ff9640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f74e01127c0 con 0x7f74e0105a40 2024-09-21T06:37:52.740 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.736+0000 7f74e6ff9640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f74e0112ac0 con 0x7f74e0103130 2024-09-21T06:37:52.740 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.736+0000 7f74dffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f74e01050f0 0x7f74e019b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:52.740 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.736+0000 7f74dffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f74e01050f0 0x7f74e019b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45086/0 (socket says 172.21.15.7:45086) 2024-09-21T06:37:52.741 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.736+0000 7f74dffff640 1 -- 172.21.15.7:0/2718905393 learned_addr learned my addr 172.21.15.7:0/2718905393 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:37:52.741 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.736+0000 7f74e4d95640 1 --2- 172.21.15.7:0/2718905393 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74e0103130 0x7f74e019b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:52.741 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.736+0000 7f74e5596640 1 --2- 172.21.15.7:0/2718905393 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f74e0105a40 0x7f74e019bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:52.741 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.736+0000 7f74dffff640 1 -- 172.21.15.7:0/2718905393 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74e0103130 msgr2=0x7f74e019b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:52.741 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.736+0000 7f74dffff640 1 --2- 172.21.15.7:0/2718905393 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74e0103130 0x7f74e019b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:52.741 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.736+0000 7f74dffff640 1 -- 172.21.15.7:0/2718905393 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f74e0105a40 msgr2=0x7f74e019bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:52.741 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.736+0000 7f74dffff640 1 --2- 172.21.15.7:0/2718905393 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f74e0105a40 0x7f74e019bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:52.741 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.736+0000 7f74dffff640 1 -- 172.21.15.7:0/2718905393 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74e01a6520 con 0x7f74e01050f0 2024-09-21T06:37:52.741 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.736+0000 7f74e4d95640 1 --2- 172.21.15.7:0/2718905393 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74e0103130 0x7f74e019b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:37:52.741 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.736+0000 7f74dffff640 1 --2- 172.21.15.7:0/2718905393 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f74e01050f0 0x7f74e019b7d0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f74d000ea50 tx=0x7f74d000ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:52.741 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.736+0000 7f74ddffb640 1 -- 172.21.15.7:0/2718905393 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74d000cdc0 con 0x7f74e01050f0 2024-09-21T06:37:52.742 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.736+0000 7f74ddffb640 1 -- 172.21.15.7:0/2718905393 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f74d0011920 con 0x7f74e01050f0 2024-09-21T06:37:52.742 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.736+0000 7f74e6ff9640 1 -- 172.21.15.7:0/2718905393 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74e01a6810 con 0x7f74e01050f0 2024-09-21T06:37:52.742 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.736+0000 7f74ddffb640 1 -- 172.21.15.7:0/2718905393 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74d001aa60 con 0x7f74e01050f0 2024-09-21T06:37:52.742 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.737+0000 7f74e6ff9640 1 -- 172.21.15.7:0/2718905393 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74e01a6db0 con 0x7f74e01050f0 2024-09-21T06:37:52.749 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.740+0000 7f74ee042740 1 Processor -- start 2024-09-21T06:37:52.749 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.740+0000 7f74ee042740 1 -- start start 2024-09-21T06:37:52.749 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.740+0000 7f74ddffb640 1 -- 172.21.15.7:0/2718905393 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f74d0011ad0 con 0x7f74e01050f0 2024-09-21T06:37:52.749 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.740+0000 7f74ee042740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555aeddb31b0 0x555aee1589b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:52.749 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.740+0000 7f74ee042740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555aedd8a2f0 0x555aee158ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:52.749 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.740+0000 7f74ee042740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555aedd924d0 0x555aee159430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:52.750 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.740+0000 7f74ee042740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x555aee0cd6f0 con 0x555aedd8a2f0 2024-09-21T06:37:52.750 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.740+0000 7f74ee042740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x555aee0bcb20 con 0x555aeddb31b0 2024-09-21T06:37:52.750 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.740+0000 7f74ee042740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x555aee0c0930 con 0x555aedd924d0 2024-09-21T06:37:52.750 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.740+0000 7f74e4d95640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555aedd8a2f0 0x555aee158ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:52.750 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.741+0000 7f74e4d95640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555aedd8a2f0 0x555aee158ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45100/0 (socket says 172.21.15.7:45100) 2024-09-21T06:37:52.750 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.741+0000 7f74e4d95640 1 -- 172.21.15.7:0/4226892154 learned_addr learned my addr 172.21.15.7:0/4226892154 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:37:52.750 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.741+0000 7f74e5596640 1 --2- 172.21.15.7:0/4226892154 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555aeddb31b0 0x555aee1589b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:52.750 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.741+0000 7f74dffff640 1 --2- 172.21.15.7:0/4226892154 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555aedd924d0 0x555aee159430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:52.750 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.741+0000 7f74e4d95640 1 -- 172.21.15.7:0/4226892154 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555aedd924d0 msgr2=0x555aee159430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:52.750 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.741+0000 7f74e4d95640 1 --2- 172.21.15.7:0/4226892154 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555aedd924d0 0x555aee159430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:52.750 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.741+0000 7f74e4d95640 1 -- 172.21.15.7:0/4226892154 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555aeddb31b0 msgr2=0x555aee1589b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:52.750 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.741+0000 7f74e4d95640 1 --2- 172.21.15.7:0/4226892154 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555aeddb31b0 0x555aee1589b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:52.751 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.741+0000 7f74e4d95640 1 -- 172.21.15.7:0/4226892154 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555aee082530 con 0x555aedd8a2f0 2024-09-21T06:37:52.751 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.741+0000 7f74ddffb640 1 --2- 172.21.15.7:0/2718905393 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f74cc0b6700 0x7f74cc0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:52.751 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.741+0000 7f74e4d95640 1 --2- 172.21.15.7:0/4226892154 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555aedd8a2f0 0x555aee158ef0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f74c800bd30 tx=0x7f74c800f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12c5301a549dcc11 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:52.751 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.741+0000 7f74e5596640 1 --2- 172.21.15.7:0/2718905393 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f74cc0b6700 0x7f74cc0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:52.751 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.741+0000 7f74ddffb640 1 -- 172.21.15.7:0/2718905393 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f74d00e7bb0 con 0x7f74e01050f0 2024-09-21T06:37:52.751 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.741+0000 7f74d6ffd640 1 -- 172.21.15.7:0/4226892154 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74c8015070 con 0x555aedd8a2f0 2024-09-21T06:37:52.751 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.741+0000 7f74d6ffd640 1 -- 172.21.15.7:0/4226892154 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f74c800be20 con 0x555aedd8a2f0 2024-09-21T06:37:52.751 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.741+0000 7f74d6ffd640 1 -- 172.21.15.7:0/4226892154 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74c80116a0 con 0x555aedd8a2f0 2024-09-21T06:37:52.751 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.742+0000 7f74ee042740 1 -- 172.21.15.7:0/4226892154 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555aedd8a2f0 msgr2=0x555aee158ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:52.751 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.742+0000 7f74e5596640 1 --2- 172.21.15.7:0/2718905393 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f74cc0b6700 0x7f74cc0b8c10 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f74d8006010 tx=0x7f74d80058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:52.751 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.742+0000 7f74ee042740 1 --2- 172.21.15.7:0/4226892154 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555aedd8a2f0 0x555aee158ef0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f74c800bd30 tx=0x7f74c800f730 comp rx=0 tx=0).stop 2024-09-21T06:37:52.751 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.742+0000 7f74ee042740 1 -- 172.21.15.7:0/4226892154 shutdown_connections 2024-09-21T06:37:52.751 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.742+0000 7f74ee042740 1 --2- 172.21.15.7:0/4226892154 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555aedd924d0 0x555aee159430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:52.751 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.742+0000 7f74ee042740 1 --2- 172.21.15.7:0/4226892154 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555aedd8a2f0 0x555aee158ef0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:52.752 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.742+0000 7f74ee042740 1 --2- 172.21.15.7:0/4226892154 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555aeddb31b0 0x555aee1589b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:52.752 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.742+0000 7f74ee042740 1 -- 172.21.15.7:0/4226892154 >> 172.21.15.7:0/4226892154 conn(0x555aedda7300 msgr2=0x555aee1568a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:52.752 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.742+0000 7f74ee042740 1 -- 172.21.15.7:0/4226892154 shutdown_connections 2024-09-21T06:37:52.752 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.742+0000 7f74ee042740 1 -- 172.21.15.7:0/4226892154 wait complete. 2024-09-21T06:37:52.752 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.743+0000 7f74ee042740 1 -- start start 2024-09-21T06:37:52.752 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.743+0000 7f74ee042740 1 Processor -- start 2024-09-21T06:37:52.752 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.743+0000 7f74ee042740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555aedd8a2f0 0x555aee164060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:52.752 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.743+0000 7f74ee042740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555aedd924d0 0x555aee1645a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:52.752 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.743+0000 7f74ee042740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555aeddb31b0 0x555aee170450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:52.752 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.743+0000 7f74ee042740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x555aedff4ab0 con 0x555aeddb31b0 2024-09-21T06:37:52.752 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.743+0000 7f74ee042740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x555aee062730 con 0x555aedd924d0 2024-09-21T06:37:52.752 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.743+0000 7f74ee042740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x555aee167130 con 0x555aedd8a2f0 2024-09-21T06:37:52.752 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.743+0000 7f74ee042740 10 client.0 _ll_register_callbacks cb 0x555aee0b66b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:37:52.753 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.744+0000 7f74e5596640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555aeddb31b0 0x555aee170450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:52.753 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.744+0000 7f74e5596640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555aeddb31b0 0x555aee170450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45104/0 (socket says 172.21.15.7:45104) 2024-09-21T06:37:52.753 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.744+0000 7f74e5596640 1 -- 172.21.15.7:0/1278116695 learned_addr learned my addr 172.21.15.7:0/1278116695 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:37:52.753 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.744+0000 7f74dffff640 1 --2- 172.21.15.7:0/1278116695 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555aedd924d0 0x555aee1645a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:52.753 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.744+0000 7f74e4d95640 1 --2- 172.21.15.7:0/1278116695 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555aedd8a2f0 0x555aee164060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:52.753 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.744+0000 7f74e5596640 1 -- 172.21.15.7:0/1278116695 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555aedd8a2f0 msgr2=0x555aee164060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:52.753 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.744+0000 7f74e5596640 1 --2- 172.21.15.7:0/1278116695 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555aedd8a2f0 0x555aee164060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:52.753 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.744+0000 7f74e5596640 1 -- 172.21.15.7:0/1278116695 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555aedd924d0 msgr2=0x555aee1645a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:52.753 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.744+0000 7f74e5596640 1 --2- 172.21.15.7:0/1278116695 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555aedd924d0 0x555aee1645a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:52.753 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.744+0000 7f74e5596640 1 -- 172.21.15.7:0/1278116695 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555aede1e790 con 0x555aeddb31b0 2024-09-21T06:37:52.753 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.744+0000 7f74e4d95640 1 --2- 172.21.15.7:0/1278116695 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555aedd8a2f0 0x555aee164060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:37:52.753 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.744+0000 7f74e5596640 1 --2- 172.21.15.7:0/1278116695 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555aeddb31b0 0x555aee170450 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f74d8009900 tx=0x7f74d802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96e1f04fbb4acd70 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:52.753 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.744+0000 7f74bffff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:37:52.754 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.744+0000 7f74bffff640 1 -- 172.21.15.7:0/1278116695 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74d804c070 con 0x555aeddb31b0 2024-09-21T06:37:52.754 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.744+0000 7f74bffff640 1 -- 172.21.15.7:0/1278116695 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f74d8004250 con 0x555aeddb31b0 2024-09-21T06:37:52.754 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.744+0000 7f74ee042740 1 -- 172.21.15.7:0/1278116695 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f74c800be20 con 0x555aeddb31b0 2024-09-21T06:37:52.754 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.745+0000 7f74bffff640 1 -- 172.21.15.7:0/1278116695 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f74d8058050 con 0x555aeddb31b0 2024-09-21T06:37:52.754 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.745+0000 7f74ee042740 10 client.15846 fetch_fsmap learned FSMap version 25 2024-09-21T06:37:52.754 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.745+0000 7f74ee042740 1 -- 172.21.15.7:0/1278116695 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x555aede97620 con 0x555aeddb31b0 2024-09-21T06:37:52.754 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.745+0000 7f74bffff640 1 -- 172.21.15.7:0/1278116695 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f74c800be20 con 0x555aeddb31b0 2024-09-21T06:37:52.754 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.745+0000 7f74bffff640 1 -- 172.21.15.7:0/1278116695 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f74d803c440 con 0x555aeddb31b0 2024-09-21T06:37:52.754 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.745+0000 7f74ee042740 10 client.15846 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:37:52.754 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.745+0000 7f74ee042740 10 client.15846 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:37:52.754 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.745+0000 7f74ee042740 20 client.15846 populate_metadata read hostname 'smithi007' 2024-09-21T06:37:52.754 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.745+0000 7f74ee042740 1 --2- 172.21.15.7:0/1278116695 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x555aedd71d80 0x555aee176220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:52.754 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.745+0000 7f74ee042740 4 client.15846 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:37:52.755 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.745+0000 7f74ee042740 1 -- 172.21.15.7:0/1278116695 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555aee0cf640 con 0x555aedd71d80 2024-09-21T06:37:52.755 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.745+0000 7f74e4d95640 1 --2- 172.21.15.7:0/1278116695 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x555aedd71d80 0x555aee176220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:52.755 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.746+0000 7f74bffff640 10 client.15846 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:37:52.755 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.746+0000 7f74e4d95640 1 --2- 172.21.15.7:0/1278116695 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x555aedd71d80 0x555aee176220 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=36f3be399ccd24c9 server_cookie=3bed1eec295eb6a2 in_seq=0 out_seq=0 2024-09-21T06:37:52.755 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.746+0000 7f74bffff640 1 -- 172.21.15.7:0/1278116695 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555aee0cf640 con 0x555aedd71d80 2024-09-21T06:37:52.755 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.746+0000 7f74bffff640 10 client.15846 handle_command_reply: tid=0 2024-09-21T06:37:52.756 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.746+0000 7f74ee042740 1 client.15846 shutdown 2024-09-21T06:37:52.756 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.747+0000 7f74ee042740 1 -- 172.21.15.7:0/1278116695 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555aeddb31b0 msgr2=0x555aee170450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:52.756 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.747+0000 7f74ee042740 1 --2- 172.21.15.7:0/1278116695 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555aeddb31b0 0x555aee170450 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f74d8009900 tx=0x7f74d802a410 comp rx=0 tx=0).stop 2024-09-21T06:37:52.756 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.747+0000 7f74ee042740 1 -- 172.21.15.7:0/1278116695 shutdown_connections 2024-09-21T06:37:52.756 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.747+0000 7f74ee042740 1 --2- 172.21.15.7:0/1278116695 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x555aedd71d80 0x555aee176220 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:52.757 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.747+0000 7f74ee042740 1 --2- 172.21.15.7:0/1278116695 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555aeddb31b0 0x555aee170450 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:52.757 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.747+0000 7f74bffff640 0 client.15846 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:37:52.757 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.747+0000 7f74ee042740 1 --2- 172.21.15.7:0/1278116695 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555aedd924d0 0x555aee1645a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:52.757 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.747+0000 7f74ee042740 1 --2- 172.21.15.7:0/1278116695 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555aedd8a2f0 0x555aee164060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:52.757 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.747+0000 7f74ee042740 1 -- 172.21.15.7:0/1278116695 >> 172.21.15.7:0/1278116695 conn(0x555aedda7300 msgr2=0x555aee1599e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:52.757 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.747+0000 7f74ee042740 1 -- 172.21.15.7:0/1278116695 shutdown_connections 2024-09-21T06:37:52.758 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.747+0000 7f74ee042740 1 -- 172.21.15.7:0/1278116695 wait complete. 2024-09-21T06:37:52.758 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.747+0000 7f74ee042740 20 client.15846 trim_cache size 0 max 16384 2024-09-21T06:37:52.766 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.762+0000 7f74ee042740 1 Processor -- start 2024-09-21T06:37:52.766 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.762+0000 7f74ee042740 1 -- start start 2024-09-21T06:37:52.766 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.762+0000 7f74ee042740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555aedd8a2f0 0x555aee15a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:52.766 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.762+0000 7f74ee042740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555aedd924d0 0x555aee170350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:52.766 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.762+0000 7f74ee042740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555aeddb31b0 0x555aee161230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:52.767 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.762+0000 7f74ee042740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f74e01b1de0 con 0x555aedd924d0 2024-09-21T06:37:52.767 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.762+0000 7f74ee042740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f74e01af6b0 con 0x555aeddb31b0 2024-09-21T06:37:52.767 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.762+0000 7f74ee042740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f74e01ad4e0 con 0x555aedd8a2f0 2024-09-21T06:37:52.767 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.762+0000 7f74dffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555aedd924d0 0x555aee170350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:52.767 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.762+0000 7f74dffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555aedd924d0 0x555aee170350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45108/0 (socket says 172.21.15.7:45108) 2024-09-21T06:37:52.767 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.762+0000 7f74dffff640 1 -- 172.21.15.7:0/704112901 learned_addr learned my addr 172.21.15.7:0/704112901 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:37:52.767 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.762+0000 7f74e5596640 1 --2- 172.21.15.7:0/704112901 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555aeddb31b0 0x555aee161230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:52.767 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.763+0000 7f74e4d95640 1 --2- 172.21.15.7:0/704112901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555aedd8a2f0 0x555aee15a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:52.768 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.763+0000 7f74dffff640 1 -- 172.21.15.7:0/704112901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555aedd8a2f0 msgr2=0x555aee15a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:52.768 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.763+0000 7f74dffff640 1 --2- 172.21.15.7:0/704112901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555aedd8a2f0 0x555aee15a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:52.768 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.763+0000 7f74dffff640 1 -- 172.21.15.7:0/704112901 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555aeddb31b0 msgr2=0x555aee161230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:52.768 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.763+0000 7f74dffff640 1 --2- 172.21.15.7:0/704112901 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555aeddb31b0 0x555aee161230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:52.768 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.763+0000 7f74dffff640 1 -- 172.21.15.7:0/704112901 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555aee15acb0 con 0x555aedd924d0 2024-09-21T06:37:52.769 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.763+0000 7f74e5596640 1 --2- 172.21.15.7:0/704112901 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555aeddb31b0 0x555aee161230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:37:52.769 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.763+0000 7f74dffff640 1 --2- 172.21.15.7:0/704112901 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555aedd924d0 0x555aee170350 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f74d00aa070 tx=0x7f74d00eb6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79cc193125e561fd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:52.769 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.763+0000 7f74d67fc640 1 -- 172.21.15.7:0/704112901 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74d00ad3f0 con 0x555aedd924d0 2024-09-21T06:37:52.769 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.763+0000 7f74d67fc640 1 -- 172.21.15.7:0/704112901 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f74d00ad5b0 con 0x555aedd924d0 2024-09-21T06:37:52.769 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.763+0000 7f74d67fc640 1 -- 172.21.15.7:0/704112901 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74d00a9210 con 0x555aedd924d0 2024-09-21T06:37:52.769 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.764+0000 7f74ee042740 1 -- 172.21.15.7:0/704112901 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555aedd924d0 msgr2=0x555aee170350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:52.770 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.764+0000 7f74ee042740 1 --2- 172.21.15.7:0/704112901 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555aedd924d0 0x555aee170350 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f74d00aa070 tx=0x7f74d00eb6a0 comp rx=0 tx=0).stop 2024-09-21T06:37:52.770 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.764+0000 7f74ee042740 1 -- 172.21.15.7:0/704112901 shutdown_connections 2024-09-21T06:37:52.770 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.764+0000 7f74ee042740 1 --2- 172.21.15.7:0/704112901 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555aeddb31b0 0x555aee161230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:52.770 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.764+0000 7f74ee042740 1 --2- 172.21.15.7:0/704112901 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555aedd924d0 0x555aee170350 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:52.770 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.764+0000 7f74ee042740 1 --2- 172.21.15.7:0/704112901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555aedd8a2f0 0x555aee15a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:52.770 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.764+0000 7f74ee042740 1 -- 172.21.15.7:0/704112901 >> 172.21.15.7:0/704112901 conn(0x555aedda7300 msgr2=0x555aee1599e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:52.770 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.764+0000 7f74ee042740 1 -- 172.21.15.7:0/704112901 shutdown_connections 2024-09-21T06:37:52.770 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.764+0000 7f74ee042740 1 -- 172.21.15.7:0/704112901 wait complete. 2024-09-21T06:37:52.770 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.764+0000 7f74ee042740 1 -- start start 2024-09-21T06:37:52.770 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.764+0000 7f74ee042740 1 Processor -- start 2024-09-21T06:37:52.773 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.765+0000 7f74ee042740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555aedd8a2f0 0x555aee16c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:52.773 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.765+0000 7f74ee042740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555aedd924d0 0x555aee169dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:52.773 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.765+0000 7f74ee042740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555aeddb31b0 0x555aee16a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:52.773 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.765+0000 7f74ee042740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f74e01adb70 con 0x555aeddb31b0 2024-09-21T06:37:52.773 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.765+0000 7f74ee042740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f74e01aefe0 con 0x555aedd8a2f0 2024-09-21T06:37:52.773 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.765+0000 7f74ee042740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f74e01ae240 con 0x555aedd924d0 2024-09-21T06:37:52.773 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.765+0000 7f74ee042740 10 client.0 _ll_register_callbacks cb 0x7f74d8040070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:37:52.774 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.765+0000 7f74e5596640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555aeddb31b0 0x555aee16a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:52.774 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.765+0000 7f74e5596640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555aeddb31b0 0x555aee16a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45122/0 (socket says 172.21.15.7:45122) 2024-09-21T06:37:52.774 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.765+0000 7f74e5596640 1 -- 172.21.15.7:0/1286160915 learned_addr learned my addr 172.21.15.7:0/1286160915 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:37:52.774 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.765+0000 7f74dffff640 1 --2- 172.21.15.7:0/1286160915 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555aedd924d0 0x555aee169dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:52.774 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.765+0000 7f74e4d95640 1 --2- 172.21.15.7:0/1286160915 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555aedd8a2f0 0x555aee16c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:52.774 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.765+0000 7f74e5596640 1 -- 172.21.15.7:0/1286160915 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555aedd924d0 msgr2=0x555aee169dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:52.774 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.765+0000 7f74e5596640 1 --2- 172.21.15.7:0/1286160915 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555aedd924d0 0x555aee169dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:52.774 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.765+0000 7f74e5596640 1 -- 172.21.15.7:0/1286160915 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555aedd8a2f0 msgr2=0x555aee16c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:37:52.774 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.765+0000 7f74e5596640 1 --2- 172.21.15.7:0/1286160915 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555aedd8a2f0 0x555aee16c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:52.774 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.765+0000 7f74e5596640 1 -- 172.21.15.7:0/1286160915 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555aee16a840 con 0x555aeddb31b0 2024-09-21T06:37:52.774 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.765+0000 7f74dffff640 1 --2- 172.21.15.7:0/1286160915 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555aedd924d0 0x555aee169dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:37:52.774 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.765+0000 7f74e4d95640 1 --2- 172.21.15.7:0/1286160915 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555aedd8a2f0 0x555aee16c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:37:52.774 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.765+0000 7f74e5596640 1 --2- 172.21.15.7:0/1286160915 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555aeddb31b0 0x555aee16a300 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f74d8005940 tx=0x7f74d8031980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac295d44eeb202bb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:37:52.775 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.765+0000 7f74bffff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:37:52.775 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.765+0000 7f74bffff640 1 -- 172.21.15.7:0/1286160915 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74d8060020 con 0x555aeddb31b0 2024-09-21T06:37:52.775 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.765+0000 7f74bffff640 1 -- 172.21.15.7:0/1286160915 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f74d8004250 con 0x555aeddb31b0 2024-09-21T06:37:52.775 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.765+0000 7f74ee042740 1 -- 172.21.15.7:0/1286160915 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f74d00ad5b0 con 0x555aeddb31b0 2024-09-21T06:37:52.775 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.766+0000 7f74bffff640 1 -- 172.21.15.7:0/1286160915 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f74d806b050 con 0x555aeddb31b0 2024-09-21T06:37:52.775 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.766+0000 7f74ee042740 10 client.15852 fetch_fsmap learned FSMap version 25 2024-09-21T06:37:52.775 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.766+0000 7f74ee042740 1 -- 172.21.15.7:0/1286160915 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x555aee1e08e0 con 0x555aeddb31b0 2024-09-21T06:37:52.775 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.766+0000 7f74bffff640 1 -- 172.21.15.7:0/1286160915 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f74d00ad5b0 con 0x555aeddb31b0 2024-09-21T06:37:52.776 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.766+0000 7f74bffff640 1 -- 172.21.15.7:0/1286160915 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f74d80046c0 con 0x555aeddb31b0 2024-09-21T06:37:52.776 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.766+0000 7f74ee042740 10 client.15852 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:37:52.776 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.766+0000 7f74ee042740 10 client.15852 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:37:52.776 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.766+0000 7f74ee042740 20 client.15852 populate_metadata read hostname 'smithi007' 2024-09-21T06:37:52.776 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.766+0000 7f74ee042740 1 --2- 172.21.15.7:0/1286160915 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x555aedd471c0 0x555aee1e3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:37:52.776 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.766+0000 7f74ee042740 4 client.15852 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T06:37:52.776 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.766+0000 7f74ee042740 1 -- 172.21.15.7:0/1286160915 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "flush journal"}) -- 0x555aee0cb0f0 con 0x555aedd471c0 2024-09-21T06:37:52.777 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.766+0000 7f74e4d95640 1 --2- 172.21.15.7:0/1286160915 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x555aedd471c0 0x555aee1e3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:37:52.777 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.767+0000 7f74bffff640 10 client.15852 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:37:52.777 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.767+0000 7f74e4d95640 1 --2- 172.21.15.7:0/1286160915 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x555aedd471c0 0x555aee1e3090 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=edc2b6e9dde663a9 server_cookie=b5d51e6d1e2f5a36 in_seq=0 out_seq=0 2024-09-21T06:37:52.780 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.778+0000 7f74bffff640 1 -- 172.21.15.7:0/1286160915 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x555aee0cb0f0 con 0x555aedd471c0 2024-09-21T06:37:52.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.778+0000 7f74bffff640 10 client.15852 handle_command_reply: tid=0 2024-09-21T06:37:52.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.778+0000 7f74ee042740 1 client.15852 shutdown 2024-09-21T06:37:52.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.778+0000 7f74ee042740 1 -- 172.21.15.7:0/1286160915 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555aeddb31b0 msgr2=0x555aee16a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:52.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.778+0000 7f74ee042740 1 --2- 172.21.15.7:0/1286160915 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555aeddb31b0 0x555aee16a300 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f74d8005940 tx=0x7f74d8031980 comp rx=0 tx=0).stop 2024-09-21T06:37:52.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.778+0000 7f74ee042740 1 -- 172.21.15.7:0/1286160915 shutdown_connections 2024-09-21T06:37:52.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.778+0000 7f74ee042740 1 --2- 172.21.15.7:0/1286160915 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x555aedd471c0 0x555aee1e3090 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:52.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.778+0000 7f74ee042740 1 --2- 172.21.15.7:0/1286160915 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555aeddb31b0 0x555aee16a300 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:52.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.778+0000 7f74ee042740 1 --2- 172.21.15.7:0/1286160915 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555aedd924d0 0x555aee169dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:52.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.778+0000 7f74ee042740 1 --2- 172.21.15.7:0/1286160915 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555aedd8a2f0 0x555aee16c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:52.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.778+0000 7f74bffff640 0 client.15852 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:37:52.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.778+0000 7f74ee042740 1 -- 172.21.15.7:0/1286160915 >> 172.21.15.7:0/1286160915 conn(0x555aedda7300 msgr2=0x555aee154ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:52.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.778+0000 7f74ee042740 1 -- 172.21.15.7:0/1286160915 shutdown_connections 2024-09-21T06:37:52.781 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.778+0000 7f74ee042740 1 -- 172.21.15.7:0/1286160915 wait complete. 2024-09-21T06:37:52.782 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.778+0000 7f74ee042740 20 client.15852 trim_cache size 0 max 16384 2024-09-21T06:37:52.782 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-09-21T06:37:52.782 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-09-21T06:37:52.782 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-09-21T06:37:52.782 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-09-21T06:37:52.783 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.779+0000 7f74e6ff9640 1 -- 172.21.15.7:0/2718905393 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f74cc0b6700 msgr2=0x7f74cc0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:52.783 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.779+0000 7f74e6ff9640 1 --2- 172.21.15.7:0/2718905393 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f74cc0b6700 0x7f74cc0b8c10 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f74d8006010 tx=0x7f74d80058d0 comp rx=0 tx=0).stop 2024-09-21T06:37:52.783 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.779+0000 7f74e6ff9640 1 -- 172.21.15.7:0/2718905393 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f74e01050f0 msgr2=0x7f74e019b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:37:52.783 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.779+0000 7f74e6ff9640 1 --2- 172.21.15.7:0/2718905393 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f74e01050f0 0x7f74e019b7d0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f74d000ea50 tx=0x7f74d000ef10 comp rx=0 tx=0).stop 2024-09-21T06:37:52.783 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.779+0000 7f74e6ff9640 1 -- 172.21.15.7:0/2718905393 shutdown_connections 2024-09-21T06:37:52.783 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.779+0000 7f74e6ff9640 1 --2- 172.21.15.7:0/2718905393 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f74cc0b6700 0x7f74cc0b8c10 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:52.783 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.779+0000 7f74e6ff9640 1 --2- 172.21.15.7:0/2718905393 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f74e0105a40 0x7f74e019bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:52.783 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.779+0000 7f74e6ff9640 1 --2- 172.21.15.7:0/2718905393 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f74e01050f0 0x7f74e019b7d0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:52.783 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.779+0000 7f74e6ff9640 1 --2- 172.21.15.7:0/2718905393 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f74e0103130 0x7f74e019b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:37:52.784 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.779+0000 7f74e6ff9640 1 -- 172.21.15.7:0/2718905393 >> 172.21.15.7:0/2718905393 conn(0x7f74e0079e50 msgr2=0x7f74e01063c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:37:52.784 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.779+0000 7f74e6ff9640 1 -- 172.21.15.7:0/2718905393 shutdown_connections 2024-09-21T06:37:52.784 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:37:52.779+0000 7f74e6ff9640 1 -- 172.21.15.7:0/2718905393 wait complete. 2024-09-21T06:37:54.530 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-09-21T06:37:54.530 INFO:tasks.workunit.client.0.smithi007.stdout: Children see throughput for 1 re-readers = 8104745.00 kB/sec 2024-09-21T06:37:54.530 INFO:tasks.workunit.client.0.smithi007.stdout: Parent sees throughput for 1 re-readers = 8090804.55 kB/sec 2024-09-21T06:37:54.530 INFO:tasks.workunit.client.0.smithi007.stdout: Min throughput per process = 8104745.00 kB/sec 2024-09-21T06:37:54.531 INFO:tasks.workunit.client.0.smithi007.stdout: Max throughput per process = 8104745.00 kB/sec 2024-09-21T06:37:54.531 INFO:tasks.workunit.client.0.smithi007.stdout: Avg throughput per process = 8104745.00 kB/sec 2024-09-21T06:37:54.531 INFO:tasks.workunit.client.0.smithi007.stdout: Min xfer = 1048576.00 kB 2024-09-21T06:37:55.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:37:54 smithi144 ceph-mon[34653]: pgmap v370: 97 pgs: 97 active+clean; 1.0 GiB data, 564 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 166 MiB/s wr, 76 op/s 2024-09-21T06:37:55.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:37:54 smithi007 ceph-mon[30983]: pgmap v370: 97 pgs: 97 active+clean; 1.0 GiB data, 564 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 166 MiB/s wr, 76 op/s 2024-09-21T06:37:55.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:37:54 smithi018 ceph-mon[34477]: pgmap v370: 97 pgs: 97 active+clean; 1.0 GiB data, 564 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 166 MiB/s wr, 76 op/s 2024-09-21T06:37:57.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:37:56 smithi144 ceph-mon[34653]: pgmap v371: 97 pgs: 97 active+clean; 1.0 GiB data, 564 MiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 171 MiB/s wr, 74 op/s 2024-09-21T06:37:57.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:37:56 smithi007 ceph-mon[30983]: pgmap v371: 97 pgs: 97 active+clean; 1.0 GiB data, 564 MiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 171 MiB/s wr, 74 op/s 2024-09-21T06:37:57.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:37:56 smithi018 ceph-mon[34477]: pgmap v371: 97 pgs: 97 active+clean; 1.0 GiB data, 564 MiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 171 MiB/s wr, 74 op/s 2024-09-21T06:37:59.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:37:58 smithi144 ceph-mon[34653]: pgmap v372: 97 pgs: 97 active+clean; 1.0 GiB data, 564 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 161 MiB/s wr, 72 op/s 2024-09-21T06:37:59.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:37:58 smithi007 ceph-mon[30983]: pgmap v372: 97 pgs: 97 active+clean; 1.0 GiB data, 564 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 161 MiB/s wr, 72 op/s 2024-09-21T06:37:59.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:37:58 smithi018 ceph-mon[34477]: pgmap v372: 97 pgs: 97 active+clean; 1.0 GiB data, 564 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 161 MiB/s wr, 72 op/s 2024-09-21T06:38:00.850 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-09-21T06:38:00.850 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-09-21T06:38:00.850 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-09-21T06:38:00.850 INFO:tasks.workunit.client.0.smithi007.stdout:iozone test complete. 2024-09-21T06:38:00.850 INFO:tasks.workunit.client.0.smithi007.stderr:+ iozone -c -e -s 10240M -r 1M -t 1 -F f3 -i 0 -i 1 2024-09-21T06:38:00.917 INFO:tasks.workunit.client.0.smithi007.stdout: Iozone: Performance Test of File I/O 2024-09-21T06:38:00.917 INFO:tasks.workunit.client.0.smithi007.stdout: Version $Revision: 3.494 $ 2024-09-21T06:38:00.917 INFO:tasks.workunit.client.0.smithi007.stdout: Compiled for 64 bit mode. 2024-09-21T06:38:00.917 INFO:tasks.workunit.client.0.smithi007.stdout: Build: linux-AMD64 2024-09-21T06:38:00.917 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-09-21T06:38:00.917 INFO:tasks.workunit.client.0.smithi007.stdout: Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins 2024-09-21T06:38:00.917 INFO:tasks.workunit.client.0.smithi007.stdout: Al Slater, Scott Rhine, Mike Wisner, Ken Goss 2024-09-21T06:38:00.917 INFO:tasks.workunit.client.0.smithi007.stdout: Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, 2024-09-21T06:38:00.918 INFO:tasks.workunit.client.0.smithi007.stdout: Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, 2024-09-21T06:38:00.918 INFO:tasks.workunit.client.0.smithi007.stdout: Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, 2024-09-21T06:38:00.918 INFO:tasks.workunit.client.0.smithi007.stdout: Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, 2024-09-21T06:38:00.918 INFO:tasks.workunit.client.0.smithi007.stdout: Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, 2024-09-21T06:38:00.918 INFO:tasks.workunit.client.0.smithi007.stdout: Vangel Bojaxhi, Ben England, Vikentsi Lapa, 2024-09-21T06:38:00.918 INFO:tasks.workunit.client.0.smithi007.stdout: Alexey Skidanov, Sudhir Kumar. 2024-09-21T06:38:00.918 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-09-21T06:38:00.918 INFO:tasks.workunit.client.0.smithi007.stdout: Run began: Sat Sep 21 06:38:00 2024 2024-09-21T06:38:00.918 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-09-21T06:38:00.918 INFO:tasks.workunit.client.0.smithi007.stdout: Include close in write timing 2024-09-21T06:38:00.918 INFO:tasks.workunit.client.0.smithi007.stdout: Include fsync in write timing 2024-09-21T06:38:00.918 INFO:tasks.workunit.client.0.smithi007.stdout: File size set to 10485760 kB 2024-09-21T06:38:00.918 INFO:tasks.workunit.client.0.smithi007.stdout: Record Size 1024 kB 2024-09-21T06:38:00.918 INFO:tasks.workunit.client.0.smithi007.stdout: Command line used: iozone -c -e -s 10240M -r 1M -t 1 -F f3 -i 0 -i 1 2024-09-21T06:38:00.919 INFO:tasks.workunit.client.0.smithi007.stdout: Output is in kBytes/sec 2024-09-21T06:38:00.919 INFO:tasks.workunit.client.0.smithi007.stdout: Time Resolution = 0.000001 seconds. 2024-09-21T06:38:00.919 INFO:tasks.workunit.client.0.smithi007.stdout: Processor cache size set to 1024 kBytes. 2024-09-21T06:38:00.919 INFO:tasks.workunit.client.0.smithi007.stdout: Processor cache line size set to 32 bytes. 2024-09-21T06:38:00.919 INFO:tasks.workunit.client.0.smithi007.stdout: File stride size set to 17 * record size. 2024-09-21T06:38:00.919 INFO:tasks.workunit.client.0.smithi007.stdout: Throughput test with 1 process 2024-09-21T06:38:00.919 INFO:tasks.workunit.client.0.smithi007.stdout: Each process writes a 10485760 kByte file in 1024 kByte records 2024-09-21T06:38:01.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:38:00 smithi144 ceph-mon[34653]: pgmap v373: 97 pgs: 97 active+clean; 1.0 GiB data, 564 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 108 MiB/s wr, 49 op/s 2024-09-21T06:38:01.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:38:00 smithi007 ceph-mon[30983]: pgmap v373: 97 pgs: 97 active+clean; 1.0 GiB data, 564 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 108 MiB/s wr, 49 op/s 2024-09-21T06:38:01.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:38:00 smithi018 ceph-mon[34477]: pgmap v373: 97 pgs: 97 active+clean; 1.0 GiB data, 564 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 108 MiB/s wr, 49 op/s 2024-09-21T06:38:03.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:38:02 smithi007 ceph-mon[30983]: pgmap v374: 97 pgs: 97 active+clean; 1.0 GiB data, 564 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 82 MiB/s wr, 32 op/s 2024-09-21T06:38:03.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:38:02 smithi018 ceph-mon[34477]: pgmap v374: 97 pgs: 97 active+clean; 1.0 GiB data, 564 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 82 MiB/s wr, 32 op/s 2024-09-21T06:38:03.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:38:02 smithi144 ceph-mon[34653]: pgmap v374: 97 pgs: 97 active+clean; 1.0 GiB data, 564 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 82 MiB/s wr, 32 op/s 2024-09-21T06:38:05.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:38:04 smithi007 ceph-mon[30983]: pgmap v375: 97 pgs: 97 active+clean; 587 MiB data, 495 MiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 69 MiB/s wr, 116 op/s 2024-09-21T06:38:05.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:38:04 smithi018 ceph-mon[34477]: pgmap v375: 97 pgs: 97 active+clean; 587 MiB data, 495 MiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 69 MiB/s wr, 116 op/s 2024-09-21T06:38:05.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:38:04 smithi144 ceph-mon[34653]: pgmap v375: 97 pgs: 97 active+clean; 587 MiB data, 495 MiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 69 MiB/s wr, 116 op/s 2024-09-21T06:38:05.924 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.922+0000 7fa2e4d8b640 1 -- 172.21.15.7:0/1432444427 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2e01082f0 msgr2=0x7fa2e0108700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:05.925 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.922+0000 7fa2e4d8b640 1 --2- 172.21.15.7:0/1432444427 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2e01082f0 0x7fa2e0108700 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fa2d4009900 tx=0x7fa2d402a410 comp rx=0 tx=0).stop 2024-09-21T06:38:05.925 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.923+0000 7fa2e4d8b640 1 -- 172.21.15.7:0/1432444427 shutdown_connections 2024-09-21T06:38:05.925 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.923+0000 7fa2e4d8b640 1 --2- 172.21.15.7:0/1432444427 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa2e0108c40 0x7fa2e010f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:05.926 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.923+0000 7fa2e4d8b640 1 --2- 172.21.15.7:0/1432444427 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2e01082f0 0x7fa2e0108700 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:05.926 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.923+0000 7fa2e4d8b640 1 --2- 172.21.15.7:0/1432444427 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2e01029c0 0x7fa2e0102dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:05.926 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.924+0000 7fa2e4d8b640 1 -- 172.21.15.7:0/1432444427 >> 172.21.15.7:0/1432444427 conn(0x7fa2e00fe3c0 msgr2=0x7fa2e0100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:05.926 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.924+0000 7fa2e4d8b640 1 -- 172.21.15.7:0/1432444427 shutdown_connections 2024-09-21T06:38:05.926 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.924+0000 7fa2e4d8b640 1 -- 172.21.15.7:0/1432444427 wait complete. 2024-09-21T06:38:05.928 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.925+0000 7fa2e4d8b640 1 Processor -- start 2024-09-21T06:38:05.928 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.925+0000 7fa2e4d8b640 1 -- start start 2024-09-21T06:38:05.928 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.926+0000 7fa2e4d8b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2e01029c0 0x7fa2e01a0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:05.928 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.926+0000 7fa2e4d8b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2e01082f0 0x7fa2e01a1170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:05.928 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.926+0000 7fa2e4d8b640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa2e0108c40 0x7fa2e01a6400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:05.928 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.926+0000 7fa2e4d8b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa2e01118a0 con 0x7fa2e01082f0 2024-09-21T06:38:05.928 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.926+0000 7fa2e4d8b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa2e0111720 con 0x7fa2e01029c0 2024-09-21T06:38:05.928 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.926+0000 7fa2e4d8b640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa2e0111a20 con 0x7fa2e0108c40 2024-09-21T06:38:05.928 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.926+0000 7fa2ddd9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2e01082f0 0x7fa2e01a1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:05.928 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.926+0000 7fa2ddd9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2e01082f0 0x7fa2e01a1170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54330/0 (socket says 172.21.15.7:54330) 2024-09-21T06:38:05.928 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.926+0000 7fa2ddd9b640 1 -- 172.21.15.7:0/837254570 learned_addr learned my addr 172.21.15.7:0/837254570 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:38:05.929 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.926+0000 7fa2de59c640 1 --2- 172.21.15.7:0/837254570 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2e01029c0 0x7fa2e01a0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:05.929 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.926+0000 7fa2ddd9b640 1 -- 172.21.15.7:0/837254570 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa2e0108c40 msgr2=0x7fa2e01a6400 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T06:38:05.930 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.926+0000 7fa2ddd9b640 1 --2- 172.21.15.7:0/837254570 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa2e0108c40 0x7fa2e01a6400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:05.930 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.927+0000 7fa2ddd9b640 1 -- 172.21.15.7:0/837254570 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2e01029c0 msgr2=0x7fa2e01a0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:05.930 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.927+0000 7fa2ddd9b640 1 --2- 172.21.15.7:0/837254570 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2e01029c0 0x7fa2e01a0bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:05.930 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.927+0000 7fa2ddd9b640 1 -- 172.21.15.7:0/837254570 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2e01a6b00 con 0x7fa2e01082f0 2024-09-21T06:38:05.930 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.927+0000 7fa2ddd9b640 1 --2- 172.21.15.7:0/837254570 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2e01082f0 0x7fa2e01a1170 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fa2d402a930 tx=0x7fa2d4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:05.930 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.927+0000 7fa2cf7fe640 1 -- 172.21.15.7:0/837254570 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2d403f030 con 0x7fa2e01082f0 2024-09-21T06:38:05.930 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.927+0000 7fa2cf7fe640 1 -- 172.21.15.7:0/837254570 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa2d4003cb0 con 0x7fa2e01082f0 2024-09-21T06:38:05.930 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.927+0000 7fa2cf7fe640 1 -- 172.21.15.7:0/837254570 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2d4035070 con 0x7fa2e01082f0 2024-09-21T06:38:05.930 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.927+0000 7fa2e4d8b640 1 -- 172.21.15.7:0/837254570 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2e01a6d90 con 0x7fa2e01082f0 2024-09-21T06:38:05.930 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.928+0000 7fa2e4d8b640 1 -- 172.21.15.7:0/837254570 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2e01ad580 con 0x7fa2e01082f0 2024-09-21T06:38:05.934 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.932+0000 7fa2ebdd8740 1 Processor -- start 2024-09-21T06:38:05.935 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.933+0000 7fa2ebdd8740 1 -- start start 2024-09-21T06:38:05.935 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.933+0000 7fa2ebdd8740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56478abad1b0 0x56478af529b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:05.935 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.933+0000 7fa2ebdd8740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56478ab842f0 0x56478af52ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:05.936 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.933+0000 7fa2ebdd8740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56478ab8c4d0 0x56478af53430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:05.936 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.933+0000 7fa2ebdd8740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56478aec76f0 con 0x56478abad1b0 2024-09-21T06:38:05.936 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.934+0000 7fa2ded9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56478abad1b0 0x56478af529b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:05.936 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.934+0000 7fa2ded9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56478abad1b0 0x56478af529b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54332/0 (socket says 172.21.15.7:54332) 2024-09-21T06:38:05.936 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.934+0000 7fa2ded9d640 1 -- 172.21.15.7:0/4000301730 learned_addr learned my addr 172.21.15.7:0/4000301730 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:38:05.936 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.934+0000 7fa2ebdd8740 1 -- 172.21.15.7:0/4000301730 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56478aeb6b20 con 0x56478ab842f0 2024-09-21T06:38:05.936 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.934+0000 7fa2ebdd8740 1 -- 172.21.15.7:0/4000301730 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x56478aeba930 con 0x56478ab8c4d0 2024-09-21T06:38:05.937 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.934+0000 7fa2ded9d640 1 -- 172.21.15.7:0/4000301730 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56478ab8c4d0 msgr2=0x56478af53430 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T06:38:05.937 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.934+0000 7fa2ded9d640 1 --2- 172.21.15.7:0/4000301730 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56478ab8c4d0 0x56478af53430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:05.937 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.934+0000 7fa2ded9d640 1 -- 172.21.15.7:0/4000301730 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56478ab842f0 msgr2=0x56478af52ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T06:38:05.937 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.935+0000 7fa2ded9d640 1 --2- 172.21.15.7:0/4000301730 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56478ab842f0 0x56478af52ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:05.937 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.935+0000 7fa2ded9d640 1 -- 172.21.15.7:0/4000301730 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56478ae7c530 con 0x56478abad1b0 2024-09-21T06:38:05.937 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.935+0000 7fa2cf7fe640 1 -- 172.21.15.7:0/837254570 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7fa2d4042030 con 0x7fa2e01082f0 2024-09-21T06:38:05.937 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.935+0000 7fa2ded9d640 1 --2- 172.21.15.7:0/4000301730 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56478abad1b0 0x56478af529b0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fa2d8009d00 tx=0x7fa2d800b420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f73873dad99e5e07 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:05.939 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.936+0000 7fa2ccff9640 1 -- 172.21.15.7:0/4000301730 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2d800bd40 con 0x56478abad1b0 2024-09-21T06:38:05.939 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.936+0000 7fa2ccff9640 1 -- 172.21.15.7:0/4000301730 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa2d8017070 con 0x56478abad1b0 2024-09-21T06:38:05.939 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.936+0000 7fa2ccff9640 1 -- 172.21.15.7:0/4000301730 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2d80115b0 con 0x56478abad1b0 2024-09-21T06:38:05.939 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.937+0000 7fa2cf7fe640 1 --2- 172.21.15.7:0/837254570 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa2c80b66f0 0x7fa2c80b8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:05.939 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.937+0000 7fa2cf7fe640 1 -- 172.21.15.7:0/837254570 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fa2d4107d40 con 0x7fa2e01082f0 2024-09-21T06:38:05.940 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.938+0000 7fa2de59c640 1 --2- 172.21.15.7:0/837254570 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa2c80b66f0 0x7fa2c80b8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:05.941 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.939+0000 7fa2ebdd8740 1 -- 172.21.15.7:0/4000301730 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56478abad1b0 msgr2=0x56478af529b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:05.941 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.939+0000 7fa2ebdd8740 1 --2- 172.21.15.7:0/4000301730 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56478abad1b0 0x56478af529b0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fa2d8009d00 tx=0x7fa2d800b420 comp rx=0 tx=0).stop 2024-09-21T06:38:05.942 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.939+0000 7fa2de59c640 1 --2- 172.21.15.7:0/837254570 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa2c80b66f0 0x7fa2c80b8c00 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x56478af51630 tx=0x7fa2d0008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:05.942 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.939+0000 7fa2ebdd8740 1 -- 172.21.15.7:0/4000301730 shutdown_connections 2024-09-21T06:38:05.942 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.939+0000 7fa2ebdd8740 1 --2- 172.21.15.7:0/4000301730 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56478ab8c4d0 0x56478af53430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:05.942 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.939+0000 7fa2ebdd8740 1 --2- 172.21.15.7:0/4000301730 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56478ab842f0 0x56478af52ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:05.942 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.939+0000 7fa2ebdd8740 1 --2- 172.21.15.7:0/4000301730 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56478abad1b0 0x56478af529b0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:05.942 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.939+0000 7fa2ebdd8740 1 -- 172.21.15.7:0/4000301730 >> 172.21.15.7:0/4000301730 conn(0x56478aba1300 msgr2=0x56478af508a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:05.942 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.940+0000 7fa2ebdd8740 1 -- 172.21.15.7:0/4000301730 shutdown_connections 2024-09-21T06:38:05.943 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.941+0000 7fa2ebdd8740 1 -- 172.21.15.7:0/4000301730 wait complete. 2024-09-21T06:38:05.944 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.942+0000 7fa2ebdd8740 1 -- start start 2024-09-21T06:38:05.944 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.942+0000 7fa2ebdd8740 1 Processor -- start 2024-09-21T06:38:05.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.944+0000 7fa2ebdd8740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56478ab842f0 0x56478af5e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:05.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.944+0000 7fa2ebdd8740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56478ab8c4d0 0x56478af5e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:05.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.944+0000 7fa2ebdd8740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56478abad1b0 0x56478af6a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:05.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.944+0000 7fa2ebdd8740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56478adeeab0 con 0x56478abad1b0 2024-09-21T06:38:05.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.944+0000 7fa2ebdd8740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56478ae5c730 con 0x56478ab842f0 2024-09-21T06:38:05.946 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.944+0000 7fa2ebdd8740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x56478af61130 con 0x56478ab8c4d0 2024-09-21T06:38:05.947 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.944+0000 7fa2ebdd8740 10 client.0 _ll_register_callbacks cb 0x56478aeb06b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:38:05.947 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.944+0000 7fa2ded9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56478abad1b0 0x56478af6a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:05.947 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.944+0000 7fa2ded9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56478abad1b0 0x56478af6a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54342/0 (socket says 172.21.15.7:54342) 2024-09-21T06:38:05.947 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.944+0000 7fa2ded9d640 1 -- 172.21.15.7:0/3331987374 learned_addr learned my addr 172.21.15.7:0/3331987374 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:38:05.947 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.944+0000 7fa2de59c640 1 --2- 172.21.15.7:0/3331987374 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56478ab842f0 0x56478af5e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:05.947 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.944+0000 7fa2ded9d640 1 -- 172.21.15.7:0/3331987374 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56478ab8c4d0 msgr2=0x56478af5e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:05.947 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.944+0000 7fa2ded9d640 1 --2- 172.21.15.7:0/3331987374 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56478ab8c4d0 0x56478af5e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:05.947 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.944+0000 7fa2ded9d640 1 -- 172.21.15.7:0/3331987374 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56478ab842f0 msgr2=0x56478af5e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:05.947 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.944+0000 7fa2ded9d640 1 --2- 172.21.15.7:0/3331987374 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56478ab842f0 0x56478af5e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:05.948 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.944+0000 7fa2ded9d640 1 -- 172.21.15.7:0/3331987374 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56478ac18790 con 0x56478abad1b0 2024-09-21T06:38:05.948 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.945+0000 7fa2ded9d640 1 --2- 172.21.15.7:0/3331987374 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56478abad1b0 0x56478af6a480 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fa2d8012dc0 tx=0x7fa2d8012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc2fa0e0451a309e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:05.948 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.945+0000 7fa2c5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:38:05.948 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.945+0000 7fa2c5ffb640 1 -- 172.21.15.7:0/3331987374 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2d801b800 con 0x56478abad1b0 2024-09-21T06:38:05.948 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.945+0000 7fa2c5ffb640 1 -- 172.21.15.7:0/3331987374 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fa2d801b9a0 con 0x56478abad1b0 2024-09-21T06:38:05.949 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.945+0000 7fa2ebdd8740 1 -- 172.21.15.7:0/3331987374 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa2d8017070 con 0x56478abad1b0 2024-09-21T06:38:05.949 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.945+0000 7fa2c5ffb640 1 -- 172.21.15.7:0/3331987374 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa2d802a020 con 0x56478abad1b0 2024-09-21T06:38:05.949 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.945+0000 7fa2ebdd8740 10 client.15864 fetch_fsmap learned FSMap version 25 2024-09-21T06:38:05.949 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.946+0000 7fa2ebdd8740 1 -- 172.21.15.7:0/3331987374 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56478ac91620 con 0x56478abad1b0 2024-09-21T06:38:05.949 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.946+0000 7fa2c5ffb640 1 -- 172.21.15.7:0/3331987374 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa2d8017070 con 0x56478abad1b0 2024-09-21T06:38:05.949 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.946+0000 7fa2c5ffb640 1 -- 172.21.15.7:0/3331987374 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa2d8011070 con 0x56478abad1b0 2024-09-21T06:38:05.949 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.946+0000 7fa2ebdd8740 10 client.15864 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:38:05.949 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.946+0000 7fa2ebdd8740 10 client.15864 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:38:05.949 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.946+0000 7fa2ebdd8740 20 client.15864 populate_metadata read hostname 'smithi007' 2024-09-21T06:38:05.949 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.946+0000 7fa2ebdd8740 1 --2- 172.21.15.7:0/3331987374 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x56478ab6bd80 0x56478af70170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:05.949 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.946+0000 7fa2ebdd8740 4 client.15864 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:38:05.949 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.946+0000 7fa2ebdd8740 1 -- 172.21.15.7:0/3331987374 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56478aec9640 con 0x56478ab6bd80 2024-09-21T06:38:05.950 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.947+0000 7fa2de59c640 1 --2- 172.21.15.7:0/3331987374 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x56478ab6bd80 0x56478af70170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:05.950 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.948+0000 7fa2de59c640 1 --2- 172.21.15.7:0/3331987374 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x56478ab6bd80 0x56478af70170 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e36d6e783d2d121b server_cookie=7e467cd712442691 in_seq=0 out_seq=0 2024-09-21T06:38:05.950 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.948+0000 7fa2c5ffb640 10 client.15864 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:38:05.951 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.948+0000 7fa2c5ffb640 1 -- 172.21.15.7:0/3331987374 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56478aec9640 con 0x56478ab6bd80 2024-09-21T06:38:05.951 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.948+0000 7fa2c5ffb640 10 client.15864 handle_command_reply: tid=0 2024-09-21T06:38:05.951 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.949+0000 7fa2ebdd8740 1 client.15864 shutdown 2024-09-21T06:38:05.951 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.949+0000 7fa2ebdd8740 1 -- 172.21.15.7:0/3331987374 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56478abad1b0 msgr2=0x56478af6a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:05.951 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.949+0000 7fa2ebdd8740 1 --2- 172.21.15.7:0/3331987374 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56478abad1b0 0x56478af6a480 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fa2d8012dc0 tx=0x7fa2d8012820 comp rx=0 tx=0).stop 2024-09-21T06:38:05.951 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.949+0000 7fa2ebdd8740 1 -- 172.21.15.7:0/3331987374 shutdown_connections 2024-09-21T06:38:05.951 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.949+0000 7fa2ebdd8740 1 --2- 172.21.15.7:0/3331987374 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x56478ab6bd80 0x56478af70170 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:05.952 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.949+0000 7fa2ebdd8740 1 --2- 172.21.15.7:0/3331987374 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56478abad1b0 0x56478af6a480 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:05.952 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.949+0000 7fa2ebdd8740 1 --2- 172.21.15.7:0/3331987374 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56478ab8c4d0 0x56478af5e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:05.952 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.949+0000 7fa2ebdd8740 1 --2- 172.21.15.7:0/3331987374 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56478ab842f0 0x56478af5e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:05.952 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.949+0000 7fa2c5ffb640 0 client.15864 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:38:05.952 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.949+0000 7fa2ebdd8740 1 -- 172.21.15.7:0/3331987374 >> 172.21.15.7:0/3331987374 conn(0x56478aba1300 msgr2=0x56478af539e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:05.952 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.949+0000 7fa2ebdd8740 1 -- 172.21.15.7:0/3331987374 shutdown_connections 2024-09-21T06:38:05.952 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.949+0000 7fa2ebdd8740 1 -- 172.21.15.7:0/3331987374 wait complete. 2024-09-21T06:38:05.952 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.949+0000 7fa2ebdd8740 20 client.15864 trim_cache size 0 max 16384 2024-09-21T06:38:05.974 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.972+0000 7fa2ebdd8740 1 Processor -- start 2024-09-21T06:38:05.974 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.972+0000 7fa2ebdd8740 1 -- start start 2024-09-21T06:38:05.974 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.972+0000 7fa2ebdd8740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56478ab842f0 0x56478af5ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:05.974 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.972+0000 7fa2ebdd8740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56478ab8c4d0 0x56478af5e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:05.974 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.972+0000 7fa2ebdd8740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56478abad1b0 0x56478af540f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:05.974 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.972+0000 7fa2ebdd8740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa2e01b84c0 con 0x56478ab8c4d0 2024-09-21T06:38:05.974 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.972+0000 7fa2ebdd8740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa2e01b5d90 con 0x56478ab842f0 2024-09-21T06:38:05.974 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.972+0000 7fa2ebdd8740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa2e01b3c00 con 0x56478abad1b0 2024-09-21T06:38:05.975 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.972+0000 7fa2ddd9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56478ab8c4d0 0x56478af5e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:05.975 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.972+0000 7fa2ddd9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56478ab8c4d0 0x56478af5e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54356/0 (socket says 172.21.15.7:54356) 2024-09-21T06:38:05.976 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.972+0000 7fa2ddd9b640 1 -- 172.21.15.7:0/3454952485 learned_addr learned my addr 172.21.15.7:0/3454952485 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:38:05.976 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.973+0000 7fa2ded9d640 1 --2- 172.21.15.7:0/3454952485 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56478abad1b0 0x56478af540f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:05.976 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.973+0000 7fa2ddd9b640 1 -- 172.21.15.7:0/3454952485 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56478abad1b0 msgr2=0x56478af540f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:05.976 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.973+0000 7fa2ddd9b640 1 --2- 172.21.15.7:0/3454952485 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56478abad1b0 0x56478af540f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:05.976 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.973+0000 7fa2ddd9b640 1 -- 172.21.15.7:0/3454952485 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56478ab842f0 msgr2=0x56478af5ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:05.976 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.973+0000 7fa2ddd9b640 1 --2- 172.21.15.7:0/3454952485 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56478ab842f0 0x56478af5ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:05.976 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.973+0000 7fa2ddd9b640 1 -- 172.21.15.7:0/3454952485 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56478af54cb0 con 0x56478ab8c4d0 2024-09-21T06:38:05.976 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.973+0000 7fa2ddd9b640 1 --2- 172.21.15.7:0/3454952485 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56478ab8c4d0 0x56478af5e5b0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fa2d40ca200 tx=0x7fa2d40c9b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f51a2be93e2930e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:05.977 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.974+0000 7fa2c7fff640 1 -- 172.21.15.7:0/3454952485 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2d4049070 con 0x56478ab8c4d0 2024-09-21T06:38:05.977 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.974+0000 7fa2c7fff640 1 -- 172.21.15.7:0/3454952485 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa2d40cd740 con 0x56478ab8c4d0 2024-09-21T06:38:05.977 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.974+0000 7fa2c7fff640 1 -- 172.21.15.7:0/3454952485 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2d40d7650 con 0x56478ab8c4d0 2024-09-21T06:38:05.977 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.976+0000 7fa2ebdd8740 1 -- 172.21.15.7:0/3454952485 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56478ab8c4d0 msgr2=0x56478af5e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:05.977 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.976+0000 7fa2ebdd8740 1 --2- 172.21.15.7:0/3454952485 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56478ab8c4d0 0x56478af5e5b0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fa2d40ca200 tx=0x7fa2d40c9b90 comp rx=0 tx=0).stop 2024-09-21T06:38:05.978 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.976+0000 7fa2ebdd8740 1 -- 172.21.15.7:0/3454952485 shutdown_connections 2024-09-21T06:38:05.978 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.976+0000 7fa2ebdd8740 1 --2- 172.21.15.7:0/3454952485 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56478abad1b0 0x56478af540f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:05.978 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.976+0000 7fa2ebdd8740 1 --2- 172.21.15.7:0/3454952485 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56478ab8c4d0 0x56478af5e5b0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:05.978 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.976+0000 7fa2ebdd8740 1 --2- 172.21.15.7:0/3454952485 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56478ab842f0 0x56478af5ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:05.978 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.976+0000 7fa2ebdd8740 1 -- 172.21.15.7:0/3454952485 >> 172.21.15.7:0/3454952485 conn(0x56478aba1300 msgr2=0x56478af539e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:05.978 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.976+0000 7fa2ebdd8740 1 -- 172.21.15.7:0/3454952485 shutdown_connections 2024-09-21T06:38:05.979 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.976+0000 7fa2ebdd8740 1 -- 172.21.15.7:0/3454952485 wait complete. 2024-09-21T06:38:05.979 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.977+0000 7fa2ebdd8740 1 -- start start 2024-09-21T06:38:05.981 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.977+0000 7fa2ebdd8740 1 Processor -- start 2024-09-21T06:38:05.981 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.977+0000 7fa2ebdd8740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56478ab842f0 0x56478af615d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:05.981 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.977+0000 7fa2ebdd8740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56478ab8c4d0 0x56478af61b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:05.981 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.978+0000 7fa2ebdd8740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56478abad1b0 0x56478af62090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:05.981 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.978+0000 7fa2ebdd8740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa2e01b4250 con 0x56478ab8c4d0 2024-09-21T06:38:05.981 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.978+0000 7fa2ebdd8740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa2e01b56c0 con 0x56478abad1b0 2024-09-21T06:38:05.982 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.978+0000 7fa2ebdd8740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa2e01b4920 con 0x56478ab842f0 2024-09-21T06:38:05.982 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.978+0000 7fa2ebdd8740 10 client.0 _ll_register_callbacks cb 0x7fa2d8009bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:38:05.982 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.978+0000 7fa2ddd9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56478ab8c4d0 0x56478af61b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:05.982 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.978+0000 7fa2ddd9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56478ab8c4d0 0x56478af61b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54366/0 (socket says 172.21.15.7:54366) 2024-09-21T06:38:05.982 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.978+0000 7fa2ddd9b640 1 -- 172.21.15.7:0/1089355220 learned_addr learned my addr 172.21.15.7:0/1089355220 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:38:05.982 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.978+0000 7fa2ded9d640 1 --2- 172.21.15.7:0/1089355220 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56478abad1b0 0x56478af62090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:05.982 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.978+0000 7fa2de59c640 1 --2- 172.21.15.7:0/1089355220 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56478ab842f0 0x56478af615d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:05.982 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.979+0000 7fa2ddd9b640 1 -- 172.21.15.7:0/1089355220 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56478ab842f0 msgr2=0x56478af615d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:05.982 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.979+0000 7fa2ddd9b640 1 --2- 172.21.15.7:0/1089355220 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56478ab842f0 0x56478af615d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:05.982 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.979+0000 7fa2ddd9b640 1 -- 172.21.15.7:0/1089355220 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56478abad1b0 msgr2=0x56478af62090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:05.982 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.979+0000 7fa2ddd9b640 1 --2- 172.21.15.7:0/1089355220 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56478abad1b0 0x56478af62090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:05.982 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.979+0000 7fa2ddd9b640 1 -- 172.21.15.7:0/1089355220 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56478afd8c10 con 0x56478ab8c4d0 2024-09-21T06:38:05.983 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.979+0000 7fa2ddd9b640 1 --2- 172.21.15.7:0/1089355220 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56478ab8c4d0 0x56478af61b10 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fa2d40cd930 tx=0x7fa2d41059e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52c99b3598b4997b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:05.983 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.979+0000 7fa2c5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:38:05.983 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.979+0000 7fa2c5ffb640 1 -- 172.21.15.7:0/1089355220 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2d4049070 con 0x56478ab8c4d0 2024-09-21T06:38:05.983 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.979+0000 7fa2c5ffb640 1 -- 172.21.15.7:0/1089355220 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fa2d403bde0 con 0x56478ab8c4d0 2024-09-21T06:38:05.983 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.979+0000 7fa2ebdd8740 1 -- 172.21.15.7:0/1089355220 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa2d40cd740 con 0x56478ab8c4d0 2024-09-21T06:38:05.983 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.979+0000 7fa2c5ffb640 1 -- 172.21.15.7:0/1089355220 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa2d40d2070 con 0x56478ab8c4d0 2024-09-21T06:38:05.983 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.979+0000 7fa2ebdd8740 10 client.15870 fetch_fsmap learned FSMap version 25 2024-09-21T06:38:05.984 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.979+0000 7fa2ebdd8740 1 -- 172.21.15.7:0/1089355220 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56478afd9ea0 con 0x56478ab8c4d0 2024-09-21T06:38:05.984 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.981+0000 7fa2c5ffb640 1 -- 172.21.15.7:0/1089355220 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa2d40cd740 con 0x56478ab8c4d0 2024-09-21T06:38:05.984 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.981+0000 7fa2c5ffb640 1 -- 172.21.15.7:0/1089355220 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa2d40d71c0 con 0x56478ab8c4d0 2024-09-21T06:38:05.984 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.981+0000 7fa2ebdd8740 10 client.15870 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:38:05.984 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.981+0000 7fa2ebdd8740 10 client.15870 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:38:05.984 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.981+0000 7fa2ebdd8740 20 client.15870 populate_metadata read hostname 'smithi007' 2024-09-21T06:38:05.984 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.981+0000 7fa2ebdd8740 1 --2- 172.21.15.7:0/1089355220 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x56478ab411c0 0x56478afdc4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:05.984 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.982+0000 7fa2ebdd8740 4 client.15870 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T06:38:05.984 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.982+0000 7fa2ebdd8740 1 -- 172.21.15.7:0/1089355220 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56478aec50f0 con 0x56478ab411c0 2024-09-21T06:38:05.985 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.982+0000 7fa2de59c640 1 --2- 172.21.15.7:0/1089355220 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x56478ab411c0 0x56478afdc4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:05.987 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.985+0000 7fa2de59c640 1 --2- 172.21.15.7:0/1089355220 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x56478ab411c0 0x56478afdc4b0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=111d5a52f7b4e833 server_cookie=c4e25db33f65092f in_seq=0 out_seq=0 2024-09-21T06:38:05.987 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:05.985+0000 7fa2c5ffb640 10 client.15870 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:38:06.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:06.025+0000 7fa2c5ffb640 1 -- 172.21.15.7:0/1089355220 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56478aec50f0 con 0x56478ab411c0 2024-09-21T06:38:06.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:06.025+0000 7fa2c5ffb640 10 client.15870 handle_command_reply: tid=0 2024-09-21T06:38:06.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:06.025+0000 7fa2ebdd8740 1 client.15870 shutdown 2024-09-21T06:38:06.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:06.025+0000 7fa2ebdd8740 1 -- 172.21.15.7:0/1089355220 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56478ab8c4d0 msgr2=0x56478af61b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:06.028 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:06.025+0000 7fa2ebdd8740 1 --2- 172.21.15.7:0/1089355220 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56478ab8c4d0 0x56478af61b10 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fa2d40cd930 tx=0x7fa2d41059e0 comp rx=0 tx=0).stop 2024-09-21T06:38:06.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:06.025+0000 7fa2ebdd8740 1 -- 172.21.15.7:0/1089355220 shutdown_connections 2024-09-21T06:38:06.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:06.025+0000 7fa2ebdd8740 1 --2- 172.21.15.7:0/1089355220 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x56478ab411c0 0x56478afdc4b0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:06.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:06.025+0000 7fa2ebdd8740 1 --2- 172.21.15.7:0/1089355220 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56478abad1b0 0x56478af62090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:06.029 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:06.025+0000 7fa2ebdd8740 1 --2- 172.21.15.7:0/1089355220 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56478ab8c4d0 0x56478af61b10 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:06.030 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:06.025+0000 7fa2ebdd8740 1 --2- 172.21.15.7:0/1089355220 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56478ab842f0 0x56478af615d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:06.030 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:06.025+0000 7fa2ebdd8740 1 -- 172.21.15.7:0/1089355220 >> 172.21.15.7:0/1089355220 conn(0x56478aba1300 msgr2=0x56478af5fd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:06.030 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:06.026+0000 7fa2c5ffb640 0 client.15870 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:38:06.030 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:06.026+0000 7fa2ebdd8740 1 -- 172.21.15.7:0/1089355220 shutdown_connections 2024-09-21T06:38:06.030 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:06.026+0000 7fa2ebdd8740 1 -- 172.21.15.7:0/1089355220 wait complete. 2024-09-21T06:38:06.030 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:06.026+0000 7fa2ebdd8740 20 client.15870 trim_cache size 0 max 16384 2024-09-21T06:38:06.030 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-09-21T06:38:06.030 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-09-21T06:38:06.030 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-09-21T06:38:06.030 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-09-21T06:38:06.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:06.027+0000 7fa2e4d8b640 1 -- 172.21.15.7:0/837254570 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa2c80b66f0 msgr2=0x7fa2c80b8c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:06.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:06.027+0000 7fa2e4d8b640 1 --2- 172.21.15.7:0/837254570 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa2c80b66f0 0x7fa2c80b8c00 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x56478af51630 tx=0x7fa2d0008040 comp rx=0 tx=0).stop 2024-09-21T06:38:06.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:06.027+0000 7fa2e4d8b640 1 -- 172.21.15.7:0/837254570 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2e01082f0 msgr2=0x7fa2e01a1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:06.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:06.027+0000 7fa2e4d8b640 1 --2- 172.21.15.7:0/837254570 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2e01082f0 0x7fa2e01a1170 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fa2d402a930 tx=0x7fa2d4004270 comp rx=0 tx=0).stop 2024-09-21T06:38:06.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:06.027+0000 7fa2e4d8b640 1 -- 172.21.15.7:0/837254570 shutdown_connections 2024-09-21T06:38:06.031 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:06.027+0000 7fa2e4d8b640 1 --2- 172.21.15.7:0/837254570 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa2c80b66f0 0x7fa2c80b8c00 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:06.032 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:06.027+0000 7fa2e4d8b640 1 --2- 172.21.15.7:0/837254570 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa2e0108c40 0x7fa2e01a6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:06.032 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:06.027+0000 7fa2e4d8b640 1 --2- 172.21.15.7:0/837254570 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa2e01082f0 0x7fa2e01a1170 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:06.032 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:06.027+0000 7fa2e4d8b640 1 --2- 172.21.15.7:0/837254570 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2e01029c0 0x7fa2e01a0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:06.032 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:06.027+0000 7fa2e4d8b640 1 -- 172.21.15.7:0/837254570 >> 172.21.15.7:0/837254570 conn(0x7fa2e00fe3c0 msgr2=0x7fa2e01007e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:06.032 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:06.027+0000 7fa2e4d8b640 1 -- 172.21.15.7:0/837254570 shutdown_connections 2024-09-21T06:38:06.032 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:06.028+0000 7fa2e4d8b640 1 -- 172.21.15.7:0/837254570 wait complete. 2024-09-21T06:38:07.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:38:06 smithi007 ceph-mon[30983]: pgmap v376: 97 pgs: 97 active+clean; 851 MiB data, 519 MiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 58 MiB/s wr, 115 op/s 2024-09-21T06:38:07.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:38:06 smithi018 ceph-mon[34477]: pgmap v376: 97 pgs: 97 active+clean; 851 MiB data, 519 MiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 58 MiB/s wr, 115 op/s 2024-09-21T06:38:07.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:38:06 smithi144 ceph-mon[34653]: pgmap v376: 97 pgs: 97 active+clean; 851 MiB data, 519 MiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 58 MiB/s wr, 115 op/s 2024-09-21T06:38:09.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:38:08 smithi007 ceph-mon[30983]: pgmap v377: 97 pgs: 97 active+clean; 2.8 GiB data, 820 MiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 243 MiB/s wr, 166 op/s 2024-09-21T06:38:09.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:38:08 smithi018 ceph-mon[34477]: pgmap v377: 97 pgs: 97 active+clean; 2.8 GiB data, 820 MiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 243 MiB/s wr, 166 op/s 2024-09-21T06:38:09.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:38:08 smithi144 ceph-mon[34653]: pgmap v377: 97 pgs: 97 active+clean; 2.8 GiB data, 820 MiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 243 MiB/s wr, 166 op/s 2024-09-21T06:38:11.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:38:10 smithi007 ceph-mon[30983]: pgmap v378: 97 pgs: 97 active+clean; 4.0 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 345 MiB/s wr, 312 op/s 2024-09-21T06:38:11.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:38:10 smithi018 ceph-mon[34477]: pgmap v378: 97 pgs: 97 active+clean; 4.0 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 345 MiB/s wr, 312 op/s 2024-09-21T06:38:11.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:38:10 smithi144 ceph-mon[34653]: pgmap v378: 97 pgs: 97 active+clean; 4.0 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 472 KiB/s rd, 345 MiB/s wr, 312 op/s 2024-09-21T06:38:13.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:38:12 smithi007 ceph-mon[30983]: pgmap v379: 97 pgs: 97 active+clean; 5.3 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 455 MiB/s wr, 337 op/s 2024-09-21T06:38:13.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:38:12 smithi018 ceph-mon[34477]: pgmap v379: 97 pgs: 97 active+clean; 5.3 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 455 MiB/s wr, 337 op/s 2024-09-21T06:38:13.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:38:12 smithi144 ceph-mon[34653]: pgmap v379: 97 pgs: 97 active+clean; 5.3 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 455 MiB/s wr, 337 op/s 2024-09-21T06:38:13.563 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-09-21T06:38:13.563 INFO:tasks.workunit.client.0.smithi007.stdout: Children see throughput for 1 initial writers = 831482.00 kB/sec 2024-09-21T06:38:13.563 INFO:tasks.workunit.client.0.smithi007.stdout: Parent sees throughput for 1 initial writers = 831467.91 kB/sec 2024-09-21T06:38:13.564 INFO:tasks.workunit.client.0.smithi007.stdout: Min throughput per process = 831482.00 kB/sec 2024-09-21T06:38:13.564 INFO:tasks.workunit.client.0.smithi007.stdout: Max throughput per process = 831482.00 kB/sec 2024-09-21T06:38:13.564 INFO:tasks.workunit.client.0.smithi007.stdout: Avg throughput per process = 831482.00 kB/sec 2024-09-21T06:38:13.564 INFO:tasks.workunit.client.0.smithi007.stdout: Min xfer = 10485760.00 kB 2024-09-21T06:38:15.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:38:14 smithi007 ceph-mon[30983]: pgmap v380: 97 pgs: 97 active+clean; 7.9 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 532 KiB/s rd, 678 MiB/s wr, 417 op/s 2024-09-21T06:38:15.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:38:14 smithi018 ceph-mon[34477]: pgmap v380: 97 pgs: 97 active+clean; 7.9 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 532 KiB/s rd, 678 MiB/s wr, 417 op/s 2024-09-21T06:38:15.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:38:14 smithi144 ceph-mon[34653]: pgmap v380: 97 pgs: 97 active+clean; 7.9 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 532 KiB/s rd, 678 MiB/s wr, 417 op/s 2024-09-21T06:38:17.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:38:16 smithi007 ceph-mon[30983]: pgmap v381: 97 pgs: 97 active+clean; 8.7 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 438 KiB/s rd, 726 MiB/s wr, 339 op/s 2024-09-21T06:38:17.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:38:16 smithi018 ceph-mon[34477]: pgmap v381: 97 pgs: 97 active+clean; 8.7 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 438 KiB/s rd, 726 MiB/s wr, 339 op/s 2024-09-21T06:38:17.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:38:16 smithi144 ceph-mon[34653]: pgmap v381: 97 pgs: 97 active+clean; 8.7 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 438 KiB/s rd, 726 MiB/s wr, 339 op/s 2024-09-21T06:38:18.891 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:38:19.107 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:38:18 smithi007 ceph-mon[30983]: pgmap v382: 97 pgs: 97 active+clean; 9.9 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 788 MiB/s wr, 350 op/s 2024-09-21T06:38:19.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:38:18 smithi018 ceph-mon[34477]: pgmap v382: 97 pgs: 97 active+clean; 9.9 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 788 MiB/s wr, 350 op/s 2024-09-21T06:38:19.275 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.272+0000 7f951b44d640 1 -- 172.21.15.7:0/4133296320 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95141165a0 msgr2=0x7f9514118a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:19.275 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.272+0000 7f951b44d640 1 --2- 172.21.15.7:0/4133296320 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95141165a0 0x7f9514118a80 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f950c009ca0 tx=0x7f950c02a8e0 comp rx=0 tx=0).stop 2024-09-21T06:38:19.276 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.273+0000 7f951b44d640 1 -- 172.21.15.7:0/4133296320 shutdown_connections 2024-09-21T06:38:19.276 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.273+0000 7f951b44d640 1 --2- 172.21.15.7:0/4133296320 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95141165a0 0x7f9514118a80 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:19.276 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.273+0000 7f951b44d640 1 --2- 172.21.15.7:0/4133296320 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f951410aef0 0x7f9514115fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:19.276 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.273+0000 7f951b44d640 1 --2- 172.21.15.7:0/4133296320 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f951410a5a0 0x7f951410a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:19.276 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.273+0000 7f951b44d640 1 -- 172.21.15.7:0/4133296320 >> 172.21.15.7:0/4133296320 conn(0x7f9514070d90 msgr2=0x7f95140711a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:19.277 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.274+0000 7f951b44d640 1 -- 172.21.15.7:0/4133296320 shutdown_connections 2024-09-21T06:38:19.277 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.274+0000 7f951b44d640 1 -- 172.21.15.7:0/4133296320 wait complete. 2024-09-21T06:38:19.280 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.276+0000 7f951b44d640 1 Processor -- start 2024-09-21T06:38:19.280 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.276+0000 7f951b44d640 1 -- start start 2024-09-21T06:38:19.280 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.277+0000 7f951b44d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f951410a5a0 0x7f95141a2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:19.281 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.277+0000 7f951b44d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f951410aef0 0x7f95141a3030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:19.281 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.277+0000 7f951b44d640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f95141165a0 0x7f95141a82c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:19.282 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.277+0000 7f951b44d640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f951411c2e0 con 0x7f951410a5a0 2024-09-21T06:38:19.282 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.277+0000 7f95191e9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f951410a5a0 0x7f95141a2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:19.282 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.277+0000 7f951b44d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f951411c160 con 0x7f951410aef0 2024-09-21T06:38:19.282 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.277+0000 7f951b44d640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f951411c460 con 0x7f95141165a0 2024-09-21T06:38:19.282 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.277+0000 7f95191e9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f951410a5a0 0x7f95141a2a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36148/0 (socket says 172.21.15.7:36148) 2024-09-21T06:38:19.282 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.277+0000 7f95191e9640 1 -- 172.21.15.7:0/1098352003 learned_addr learned my addr 172.21.15.7:0/1098352003 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:38:19.283 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.278+0000 7f95191e9640 1 -- 172.21.15.7:0/1098352003 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f95141165a0 msgr2=0x7f95141a82c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T06:38:19.283 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.278+0000 7f95191e9640 1 --2- 172.21.15.7:0/1098352003 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f95141165a0 0x7f95141a82c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:19.283 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.278+0000 7f95191e9640 1 -- 172.21.15.7:0/1098352003 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f951410aef0 msgr2=0x7f95141a3030 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T06:38:19.283 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.278+0000 7f95191e9640 1 --2- 172.21.15.7:0/1098352003 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f951410aef0 0x7f95141a3030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:19.283 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.278+0000 7f95191e9640 1 -- 172.21.15.7:0/1098352003 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95141a89c0 con 0x7f951410a5a0 2024-09-21T06:38:19.283 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.278+0000 7f95191e9640 1 --2- 172.21.15.7:0/1098352003 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f951410a5a0 0x7f95141a2a90 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f951000b450 tx=0x7f951000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:19.284 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.279+0000 7f950a7fc640 1 -- 172.21.15.7:0/1098352003 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9510015020 con 0x7f951410a5a0 2024-09-21T06:38:19.284 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.279+0000 7f950a7fc640 1 -- 172.21.15.7:0/1098352003 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9510011d40 con 0x7f951410a5a0 2024-09-21T06:38:19.284 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.279+0000 7f951b44d640 1 -- 172.21.15.7:0/1098352003 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95141a8cb0 con 0x7f951410a5a0 2024-09-21T06:38:19.284 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.279+0000 7f950a7fc640 1 -- 172.21.15.7:0/1098352003 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f951000f340 con 0x7f951410a5a0 2024-09-21T06:38:19.284 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.279+0000 7f951b44d640 1 -- 172.21.15.7:0/1098352003 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95141af440 con 0x7f951410a5a0 2024-09-21T06:38:19.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:38:18 smithi144 ceph-mon[34653]: pgmap v382: 97 pgs: 97 active+clean; 9.9 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 788 MiB/s wr, 350 op/s 2024-09-21T06:38:19.288 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.285+0000 7f95223c1740 1 Processor -- start 2024-09-21T06:38:19.289 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.285+0000 7f95223c1740 1 -- start start 2024-09-21T06:38:19.290 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.285+0000 7f950a7fc640 1 -- 172.21.15.7:0/1098352003 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f9510018020 con 0x7f951410a5a0 2024-09-21T06:38:19.290 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.286+0000 7f95223c1740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c265b2f1b0 0x55c265ed49b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:19.291 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.286+0000 7f95223c1740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c265b062f0 0x55c265ed4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:19.291 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.286+0000 7f95223c1740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c265b0e4d0 0x55c265ed5430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:19.291 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.286+0000 7f95223c1740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55c265e496f0 con 0x55c265b0e4d0 2024-09-21T06:38:19.291 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.286+0000 7f95223c1740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55c265e38b20 con 0x55c265b2f1b0 2024-09-21T06:38:19.291 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.286+0000 7f95223c1740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55c265e3c930 con 0x55c265b062f0 2024-09-21T06:38:19.291 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.286+0000 7f95189e8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c265b0e4d0 0x55c265ed5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:19.293 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.287+0000 7f95189e8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c265b0e4d0 0x55c265ed5430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36164/0 (socket says 172.21.15.7:36164) 2024-09-21T06:38:19.293 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.287+0000 7f95189e8640 1 -- 172.21.15.7:0/1365414150 learned_addr learned my addr 172.21.15.7:0/1365414150 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:38:19.293 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.287+0000 7f950a7fc640 1 --2- 172.21.15.7:0/1098352003 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f95000b6700 0x7f95000b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:19.293 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.287+0000 7f95189e8640 1 -- 172.21.15.7:0/1365414150 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c265b062f0 msgr2=0x55c265ed4ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T06:38:19.293 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.287+0000 7f95189e8640 1 --2- 172.21.15.7:0/1365414150 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c265b062f0 0x55c265ed4ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:19.293 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.287+0000 7f95189e8640 1 -- 172.21.15.7:0/1365414150 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c265b2f1b0 msgr2=0x55c265ed49b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T06:38:19.293 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.287+0000 7f95189e8640 1 --2- 172.21.15.7:0/1365414150 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c265b2f1b0 0x55c265ed49b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:19.293 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.287+0000 7f95189e8640 1 -- 172.21.15.7:0/1365414150 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c265dfe530 con 0x55c265b0e4d0 2024-09-21T06:38:19.293 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.287+0000 7f95199ea640 1 --2- 172.21.15.7:0/1098352003 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f95000b6700 0x7f95000b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:19.293 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.287+0000 7f950a7fc640 1 -- 172.21.15.7:0/1098352003 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f95100e7040 con 0x7f951410a5a0 2024-09-21T06:38:19.293 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.287+0000 7f95189e8640 1 --2- 172.21.15.7:0/1365414150 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c265b0e4d0 0x55c265ed5430 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f950400a8d0 tx=0x7f950400ad90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0f00300b6ed8673 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:19.294 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.288+0000 7f94ff7fe640 1 -- 172.21.15.7:0/1365414150 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9504004220 con 0x55c265b0e4d0 2024-09-21T06:38:19.294 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.288+0000 7f95199ea640 1 --2- 172.21.15.7:0/1098352003 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f95000b6700 0x7f95000b8c10 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f950c031590 tx=0x7f950c005df0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:19.294 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.288+0000 7f94ff7fe640 1 -- 172.21.15.7:0/1365414150 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f95040043c0 con 0x55c265b0e4d0 2024-09-21T06:38:19.294 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.288+0000 7f94ff7fe640 1 -- 172.21.15.7:0/1365414150 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f950400f450 con 0x55c265b0e4d0 2024-09-21T06:38:19.295 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.290+0000 7f95223c1740 1 -- 172.21.15.7:0/1365414150 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c265b0e4d0 msgr2=0x55c265ed5430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:19.295 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.290+0000 7f95223c1740 1 --2- 172.21.15.7:0/1365414150 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c265b0e4d0 0x55c265ed5430 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f950400a8d0 tx=0x7f950400ad90 comp rx=0 tx=0).stop 2024-09-21T06:38:19.295 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.290+0000 7f95223c1740 1 -- 172.21.15.7:0/1365414150 shutdown_connections 2024-09-21T06:38:19.295 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.290+0000 7f95223c1740 1 --2- 172.21.15.7:0/1365414150 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c265b0e4d0 0x55c265ed5430 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:19.295 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.290+0000 7f95223c1740 1 --2- 172.21.15.7:0/1365414150 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c265b062f0 0x55c265ed4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:19.295 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.290+0000 7f95223c1740 1 --2- 172.21.15.7:0/1365414150 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c265b2f1b0 0x55c265ed49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:19.295 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.290+0000 7f95223c1740 1 -- 172.21.15.7:0/1365414150 >> 172.21.15.7:0/1365414150 conn(0x55c265b23300 msgr2=0x55c265ed28a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:19.295 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.290+0000 7f95223c1740 1 -- 172.21.15.7:0/1365414150 shutdown_connections 2024-09-21T06:38:19.295 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.290+0000 7f95223c1740 1 -- 172.21.15.7:0/1365414150 wait complete. 2024-09-21T06:38:19.295 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.291+0000 7f95223c1740 1 -- start start 2024-09-21T06:38:19.296 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.291+0000 7f95223c1740 1 Processor -- start 2024-09-21T06:38:19.297 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.292+0000 7f95223c1740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c265b062f0 0x55c265ee8840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:19.297 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.292+0000 7f95223c1740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c265b0e4d0 0x55c265ee8d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:19.297 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.292+0000 7f95189e8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c265b0e4d0 0x55c265ee8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:19.297 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.292+0000 7f95189e8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c265b0e4d0 0x55c265ee8d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36178/0 (socket says 172.21.15.7:36178) 2024-09-21T06:38:19.297 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.292+0000 7f95223c1740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c265b2f1b0 0x55c265ef4c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:19.297 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.292+0000 7f95189e8640 1 -- 172.21.15.7:0/492196356 learned_addr learned my addr 172.21.15.7:0/492196356 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:38:19.297 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.293+0000 7f95223c1740 1 -- 172.21.15.7:0/492196356 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55c265d70ab0 con 0x55c265b0e4d0 2024-09-21T06:38:19.297 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.293+0000 7f95223c1740 1 -- 172.21.15.7:0/492196356 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55c265dde730 con 0x55c265b2f1b0 2024-09-21T06:38:19.297 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.293+0000 7f95223c1740 1 -- 172.21.15.7:0/492196356 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55c265eeb8f0 con 0x55c265b062f0 2024-09-21T06:38:19.298 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.293+0000 7f95223c1740 10 client.0 _ll_register_callbacks cb 0x55c265e326b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:38:19.298 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.293+0000 7f95191e9640 1 --2- 172.21.15.7:0/492196356 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c265b062f0 0x55c265ee8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:19.298 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.293+0000 7f95189e8640 1 -- 172.21.15.7:0/492196356 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c265b062f0 msgr2=0x55c265ee8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:19.298 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.293+0000 7f95189e8640 1 --2- 172.21.15.7:0/492196356 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c265b062f0 0x55c265ee8840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:19.298 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.293+0000 7f95189e8640 1 -- 172.21.15.7:0/492196356 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c265b2f1b0 msgr2=0x55c265ef4c80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T06:38:19.300 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.293+0000 7f95189e8640 1 --2- 172.21.15.7:0/492196356 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c265b2f1b0 0x55c265ef4c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:19.300 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.294+0000 7f95189e8640 1 -- 172.21.15.7:0/492196356 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c265b9a790 con 0x55c265b0e4d0 2024-09-21T06:38:19.300 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.294+0000 7f95189e8640 1 --2- 172.21.15.7:0/492196356 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c265b0e4d0 0x55c265ee8d80 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f9504006010 tx=0x7f9504003800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7f5bc4f6c67e75e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:19.300 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.294+0000 7f94fcff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:38:19.300 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.294+0000 7f94fcff9640 1 -- 172.21.15.7:0/492196356 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9504003d90 con 0x55c265b0e4d0 2024-09-21T06:38:19.300 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.294+0000 7f95223c1740 1 -- 172.21.15.7:0/492196356 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f95040043c0 con 0x55c265b0e4d0 2024-09-21T06:38:19.300 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.295+0000 7f94fcff9640 1 -- 172.21.15.7:0/492196356 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f950400c9e0 con 0x55c265b0e4d0 2024-09-21T06:38:19.300 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.295+0000 7f94fcff9640 1 -- 172.21.15.7:0/492196356 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f950400cc00 con 0x55c265b0e4d0 2024-09-21T06:38:19.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.295+0000 7f95223c1740 10 client.15882 fetch_fsmap learned FSMap version 25 2024-09-21T06:38:19.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.295+0000 7f95223c1740 1 -- 172.21.15.7:0/492196356 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c265c13620 con 0x55c265b0e4d0 2024-09-21T06:38:19.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.295+0000 7f94fcff9640 1 -- 172.21.15.7:0/492196356 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f95040043c0 con 0x55c265b0e4d0 2024-09-21T06:38:19.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.295+0000 7f94fcff9640 1 -- 172.21.15.7:0/492196356 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9504004a60 con 0x55c265b0e4d0 2024-09-21T06:38:19.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.295+0000 7f95223c1740 10 client.15882 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:38:19.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.295+0000 7f95223c1740 10 client.15882 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:38:19.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.295+0000 7f95223c1740 20 client.15882 populate_metadata read hostname 'smithi007' 2024-09-21T06:38:19.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.295+0000 7f95223c1740 1 --2- 172.21.15.7:0/492196356 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55c265aedd80 0x55c265efa870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:19.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.296+0000 7f95223c1740 4 client.15882 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:38:19.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.296+0000 7f95223c1740 1 -- 172.21.15.7:0/492196356 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c265e4b640 con 0x55c265aedd80 2024-09-21T06:38:19.301 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.296+0000 7f95191e9640 1 --2- 172.21.15.7:0/492196356 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55c265aedd80 0x55c265efa870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:19.306 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.304+0000 7f94fcff9640 10 client.15882 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:38:19.306 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.304+0000 7f95191e9640 1 --2- 172.21.15.7:0/492196356 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55c265aedd80 0x55c265efa870 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe857237dc098366 server_cookie=4e255cc0b544a7e6 in_seq=0 out_seq=0 2024-09-21T06:38:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.310+0000 7f94fcff9640 1 -- 172.21.15.7:0/492196356 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c265e4b640 con 0x55c265aedd80 2024-09-21T06:38:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.310+0000 7f94fcff9640 10 client.15882 handle_command_reply: tid=0 2024-09-21T06:38:19.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.310+0000 7f95223c1740 1 client.15882 shutdown 2024-09-21T06:38:19.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.310+0000 7f95223c1740 1 -- 172.21.15.7:0/492196356 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c265b0e4d0 msgr2=0x55c265ee8d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:19.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.310+0000 7f95223c1740 1 --2- 172.21.15.7:0/492196356 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c265b0e4d0 0x55c265ee8d80 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f9504006010 tx=0x7f9504003800 comp rx=0 tx=0).stop 2024-09-21T06:38:19.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.310+0000 7f95223c1740 1 -- 172.21.15.7:0/492196356 shutdown_connections 2024-09-21T06:38:19.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.310+0000 7f95223c1740 1 --2- 172.21.15.7:0/492196356 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55c265aedd80 0x55c265efa870 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:19.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.310+0000 7f95223c1740 1 --2- 172.21.15.7:0/492196356 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c265b2f1b0 0x55c265ef4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:19.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.310+0000 7f95223c1740 1 --2- 172.21.15.7:0/492196356 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c265b0e4d0 0x55c265ee8d80 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:19.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.310+0000 7f95223c1740 1 --2- 172.21.15.7:0/492196356 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c265b062f0 0x55c265ee8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:19.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.310+0000 7f94fcff9640 0 client.15882 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:38:19.315 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.310+0000 7f95223c1740 1 -- 172.21.15.7:0/492196356 >> 172.21.15.7:0/492196356 conn(0x55c265b23300 msgr2=0x55c265ed7b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:19.316 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.310+0000 7f95223c1740 1 -- 172.21.15.7:0/492196356 shutdown_connections 2024-09-21T06:38:19.316 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.311+0000 7f95223c1740 1 -- 172.21.15.7:0/492196356 wait complete. 2024-09-21T06:38:19.316 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.311+0000 7f95223c1740 20 client.15882 trim_cache size 0 max 16384 2024-09-21T06:38:19.337 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.334+0000 7f95223c1740 1 Processor -- start 2024-09-21T06:38:19.338 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.334+0000 7f95223c1740 1 -- start start 2024-09-21T06:38:19.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.334+0000 7f95223c1740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c265b062f0 0x55c265ee8d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:19.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.334+0000 7f95223c1740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c265b0e4d0 0x55c265ef4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:19.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.335+0000 7f95223c1740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c265b2f1b0 0x55c265eea470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:19.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.335+0000 7f95223c1740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f95141b8480 con 0x55c265b0e4d0 2024-09-21T06:38:19.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.335+0000 7f95223c1740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f95141b5d50 con 0x55c265b2f1b0 2024-09-21T06:38:19.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.335+0000 7f95223c1740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f95141b3ba0 con 0x55c265b062f0 2024-09-21T06:38:19.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.335+0000 7f95189e8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c265b0e4d0 0x55c265ef4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:19.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.335+0000 7f95189e8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c265b0e4d0 0x55c265ef4b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36192/0 (socket says 172.21.15.7:36192) 2024-09-21T06:38:19.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.335+0000 7f95189e8640 1 -- 172.21.15.7:0/1818795669 learned_addr learned my addr 172.21.15.7:0/1818795669 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:38:19.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.335+0000 7f95199ea640 1 --2- 172.21.15.7:0/1818795669 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c265b2f1b0 0x55c265eea470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:19.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.335+0000 7f95189e8640 1 -- 172.21.15.7:0/1818795669 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c265b062f0 msgr2=0x55c265ee8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:19.339 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.335+0000 7f95189e8640 1 --2- 172.21.15.7:0/1818795669 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c265b062f0 0x55c265ee8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:19.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.335+0000 7f95189e8640 1 -- 172.21.15.7:0/1818795669 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c265b2f1b0 msgr2=0x55c265eea470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:19.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.335+0000 7f95189e8640 1 --2- 172.21.15.7:0/1818795669 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c265b2f1b0 0x55c265eea470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:19.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.335+0000 7f95189e8640 1 -- 172.21.15.7:0/1818795669 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c265ee6d20 con 0x55c265b0e4d0 2024-09-21T06:38:19.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.335+0000 7f95199ea640 1 --2- 172.21.15.7:0/1818795669 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c265b2f1b0 0x55c265eea470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:38:19.340 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.336+0000 7f95189e8640 1 --2- 172.21.15.7:0/1818795669 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c265b0e4d0 0x55c265ef4b80 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f9504004e30 tx=0x7f9504005e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee96d75a27d114e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:19.343 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.336+0000 7f94feffd640 1 -- 172.21.15.7:0/1818795669 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f950401c070 con 0x55c265b0e4d0 2024-09-21T06:38:19.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.336+0000 7f94feffd640 1 -- 172.21.15.7:0/1818795669 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f95040043f0 con 0x55c265b0e4d0 2024-09-21T06:38:19.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.336+0000 7f94feffd640 1 -- 172.21.15.7:0/1818795669 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9504005030 con 0x55c265b0e4d0 2024-09-21T06:38:19.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.337+0000 7f95223c1740 1 -- 172.21.15.7:0/1818795669 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c265b0e4d0 msgr2=0x55c265ef4b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:19.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.337+0000 7f95223c1740 1 --2- 172.21.15.7:0/1818795669 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c265b0e4d0 0x55c265ef4b80 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f9504004e30 tx=0x7f9504005e50 comp rx=0 tx=0).stop 2024-09-21T06:38:19.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.337+0000 7f95223c1740 1 -- 172.21.15.7:0/1818795669 shutdown_connections 2024-09-21T06:38:19.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.337+0000 7f95223c1740 1 --2- 172.21.15.7:0/1818795669 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c265b2f1b0 0x55c265eea470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:19.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.337+0000 7f95223c1740 1 --2- 172.21.15.7:0/1818795669 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c265b0e4d0 0x55c265ef4b80 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:19.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.337+0000 7f95223c1740 1 --2- 172.21.15.7:0/1818795669 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c265b062f0 0x55c265ee8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:19.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.337+0000 7f95223c1740 1 -- 172.21.15.7:0/1818795669 >> 172.21.15.7:0/1818795669 conn(0x55c265b23300 msgr2=0x55c265ee9d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:19.344 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.337+0000 7f95223c1740 1 -- 172.21.15.7:0/1818795669 shutdown_connections 2024-09-21T06:38:19.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.337+0000 7f95223c1740 1 -- 172.21.15.7:0/1818795669 wait complete. 2024-09-21T06:38:19.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.337+0000 7f95223c1740 1 -- start start 2024-09-21T06:38:19.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.337+0000 7f95223c1740 1 Processor -- start 2024-09-21T06:38:19.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.338+0000 7f95223c1740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c265b062f0 0x55c265eec1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:19.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.338+0000 7f95223c1740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c265b0e4d0 0x55c265eec790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:19.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.338+0000 7f95223c1740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c265b2f1b0 0x55c265f630f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:19.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.338+0000 7f95223c1740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f95141b4210 con 0x55c265b0e4d0 2024-09-21T06:38:19.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.338+0000 7f95223c1740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f95141b5680 con 0x55c265b2f1b0 2024-09-21T06:38:19.345 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.338+0000 7f95223c1740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f95141b48e0 con 0x55c265b062f0 2024-09-21T06:38:19.346 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.338+0000 7f95223c1740 10 client.0 _ll_register_callbacks cb 0x7f950400a750 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:38:19.346 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.338+0000 7f95189e8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c265b0e4d0 0x55c265eec790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:19.346 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.338+0000 7f95189e8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c265b0e4d0 0x55c265eec790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36198/0 (socket says 172.21.15.7:36198) 2024-09-21T06:38:19.346 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.338+0000 7f95189e8640 1 -- 172.21.15.7:0/2608892080 learned_addr learned my addr 172.21.15.7:0/2608892080 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:38:19.346 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.339+0000 7f95189e8640 1 -- 172.21.15.7:0/2608892080 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c265b062f0 msgr2=0x55c265eec1d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T06:38:19.346 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.339+0000 7f95189e8640 1 --2- 172.21.15.7:0/2608892080 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c265b062f0 0x55c265eec1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:19.346 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.339+0000 7f95189e8640 1 -- 172.21.15.7:0/2608892080 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c265b2f1b0 msgr2=0x55c265f630f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T06:38:19.346 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.339+0000 7f95189e8640 1 --2- 172.21.15.7:0/2608892080 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c265b2f1b0 0x55c265f630f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:19.346 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.339+0000 7f95189e8640 1 -- 172.21.15.7:0/2608892080 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c265f63630 con 0x55c265b0e4d0 2024-09-21T06:38:19.346 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.339+0000 7f95189e8640 1 --2- 172.21.15.7:0/2608892080 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c265b0e4d0 0x55c265eec790 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f9504001e90 tx=0x7f9504004cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bba5b96c0bdd147 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:19.346 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.339+0000 7f94fcff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:38:19.346 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.339+0000 7f94fcff9640 1 -- 172.21.15.7:0/2608892080 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f950403c060 con 0x55c265b0e4d0 2024-09-21T06:38:19.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.339+0000 7f94fcff9640 1 -- 172.21.15.7:0/2608892080 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f9504033040 con 0x55c265b0e4d0 2024-09-21T06:38:19.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.339+0000 7f95223c1740 1 -- 172.21.15.7:0/2608892080 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f95040043f0 con 0x55c265b0e4d0 2024-09-21T06:38:19.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.339+0000 7f94fcff9640 1 -- 172.21.15.7:0/2608892080 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f950401c030 con 0x55c265b0e4d0 2024-09-21T06:38:19.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.339+0000 7f95223c1740 10 client.15888 fetch_fsmap learned FSMap version 25 2024-09-21T06:38:19.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.339+0000 7f95223c1740 1 -- 172.21.15.7:0/2608892080 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c265f64740 con 0x55c265b0e4d0 2024-09-21T06:38:19.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.340+0000 7f94fcff9640 1 -- 172.21.15.7:0/2608892080 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f95040043f0 con 0x55c265b0e4d0 2024-09-21T06:38:19.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.340+0000 7f94fcff9640 1 -- 172.21.15.7:0/2608892080 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f950400f850 con 0x55c265b0e4d0 2024-09-21T06:38:19.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.340+0000 7f95223c1740 10 client.15888 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:38:19.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.340+0000 7f95223c1740 10 client.15888 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:38:19.347 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.340+0000 7f95223c1740 20 client.15888 populate_metadata read hostname 'smithi007' 2024-09-21T06:38:19.348 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.340+0000 7f95223c1740 1 --2- 172.21.15.7:0/2608892080 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55c265ac31c0 0x55c265f66dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:19.348 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.340+0000 7f95223c1740 4 client.15888 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T06:38:19.348 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.340+0000 7f95223c1740 1 -- 172.21.15.7:0/2608892080 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c265e470f0 con 0x55c265ac31c0 2024-09-21T06:38:19.348 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.341+0000 7f95191e9640 1 --2- 172.21.15.7:0/2608892080 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55c265ac31c0 0x55c265f66dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:19.348 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.343+0000 7f94fcff9640 10 client.15888 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:38:19.348 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.343+0000 7f95191e9640 1 --2- 172.21.15.7:0/2608892080 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55c265ac31c0 0x55c265f66dc0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6226f84a50535050 server_cookie=1213f761715cbae1 in_seq=0 out_seq=0 2024-09-21T06:38:19.385 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.383+0000 7f94fcff9640 1 -- 172.21.15.7:0/2608892080 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c265e470f0 con 0x55c265ac31c0 2024-09-21T06:38:19.385 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.383+0000 7f94fcff9640 10 client.15888 handle_command_reply: tid=0 2024-09-21T06:38:19.385 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.383+0000 7f95223c1740 1 client.15888 shutdown 2024-09-21T06:38:19.385 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.383+0000 7f95223c1740 1 -- 172.21.15.7:0/2608892080 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c265b0e4d0 msgr2=0x55c265eec790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:19.385 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.383+0000 7f95223c1740 1 --2- 172.21.15.7:0/2608892080 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c265b0e4d0 0x55c265eec790 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f9504001e90 tx=0x7f9504004cc0 comp rx=0 tx=0).stop 2024-09-21T06:38:19.386 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.383+0000 7f95223c1740 1 -- 172.21.15.7:0/2608892080 shutdown_connections 2024-09-21T06:38:19.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.383+0000 7f95223c1740 1 --2- 172.21.15.7:0/2608892080 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55c265ac31c0 0x55c265f66dc0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:19.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.383+0000 7f95223c1740 1 --2- 172.21.15.7:0/2608892080 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c265b2f1b0 0x55c265f630f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:19.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.383+0000 7f95223c1740 1 --2- 172.21.15.7:0/2608892080 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c265b0e4d0 0x55c265eec790 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:19.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.383+0000 7f94fcff9640 0 client.15888 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:38:19.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.383+0000 7f95223c1740 1 --2- 172.21.15.7:0/2608892080 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c265b062f0 0x55c265eec1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:19.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.383+0000 7f95223c1740 1 -- 172.21.15.7:0/2608892080 >> 172.21.15.7:0/2608892080 conn(0x55c265b23300 msgr2=0x55c265ed2880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:19.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.384+0000 7f95223c1740 1 -- 172.21.15.7:0/2608892080 shutdown_connections 2024-09-21T06:38:19.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.384+0000 7f95223c1740 1 -- 172.21.15.7:0/2608892080 wait complete. 2024-09-21T06:38:19.387 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.384+0000 7f95223c1740 20 client.15888 trim_cache size 0 max 16384 2024-09-21T06:38:19.388 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-09-21T06:38:19.388 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-09-21T06:38:19.388 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-09-21T06:38:19.388 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-09-21T06:38:19.389 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.385+0000 7f951b44d640 1 -- 172.21.15.7:0/1098352003 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f95000b6700 msgr2=0x7f95000b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:19.389 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.385+0000 7f951b44d640 1 --2- 172.21.15.7:0/1098352003 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f95000b6700 0x7f95000b8c10 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f950c031590 tx=0x7f950c005df0 comp rx=0 tx=0).stop 2024-09-21T06:38:19.389 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.385+0000 7f951b44d640 1 -- 172.21.15.7:0/1098352003 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f951410a5a0 msgr2=0x7f95141a2a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:19.389 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.385+0000 7f951b44d640 1 --2- 172.21.15.7:0/1098352003 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f951410a5a0 0x7f95141a2a90 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f951000b450 tx=0x7f951000b910 comp rx=0 tx=0).stop 2024-09-21T06:38:19.390 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.385+0000 7f951b44d640 1 -- 172.21.15.7:0/1098352003 shutdown_connections 2024-09-21T06:38:19.390 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.385+0000 7f951b44d640 1 --2- 172.21.15.7:0/1098352003 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f95000b6700 0x7f95000b8c10 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:19.390 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.385+0000 7f951b44d640 1 --2- 172.21.15.7:0/1098352003 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f95141165a0 0x7f95141a82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:19.390 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.386+0000 7f951b44d640 1 --2- 172.21.15.7:0/1098352003 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f951410aef0 0x7f95141a3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:19.390 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.386+0000 7f951b44d640 1 --2- 172.21.15.7:0/1098352003 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f951410a5a0 0x7f95141a2a90 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:19.390 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.386+0000 7f951b44d640 1 -- 172.21.15.7:0/1098352003 >> 172.21.15.7:0/1098352003 conn(0x7f9514070d90 msgr2=0x7f951410df70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:19.390 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.386+0000 7f951b44d640 1 -- 172.21.15.7:0/1098352003 shutdown_connections 2024-09-21T06:38:19.390 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:19.387+0000 7f951b44d640 1 -- 172.21.15.7:0/1098352003 wait complete. 2024-09-21T06:38:19.409 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:38:21.093 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:38:20 smithi007 ceph-mon[30983]: pgmap v383: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 481 KiB/s rd, 624 MiB/s wr, 322 op/s 2024-09-21T06:38:21.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:38:20 smithi018 ceph-mon[34477]: pgmap v383: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 481 KiB/s rd, 624 MiB/s wr, 322 op/s 2024-09-21T06:38:21.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:38:20 smithi144 ceph-mon[34653]: pgmap v383: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 481 KiB/s rd, 624 MiB/s wr, 322 op/s 2024-09-21T06:38:22.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.460+0000 7f3b218b2640 1 -- 172.21.15.7:0/2290765972 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b1c10fad0 msgr2=0x7f3b1c10fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:22.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.460+0000 7f3b218b2640 1 --2- 172.21.15.7:0/2290765972 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b1c10fad0 0x7f3b1c10fee0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f3b14009900 tx=0x7f3b1402a440 comp rx=0 tx=0).stop 2024-09-21T06:38:22.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.464+0000 7f3b218b2640 1 -- 172.21.15.7:0/2290765972 shutdown_connections 2024-09-21T06:38:22.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.464+0000 7f3b218b2640 1 --2- 172.21.15.7:0/2290765972 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b1c110420 0x7f3b1c116c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:22.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.464+0000 7f3b218b2640 1 --2- 172.21.15.7:0/2290765972 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b1c10fad0 0x7f3b1c10fee0 secure :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f3b14009900 tx=0x7f3b1402a440 comp rx=0 tx=0).stop 2024-09-21T06:38:22.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.464+0000 7f3b218b2640 1 --2- 172.21.15.7:0/2290765972 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3b1c10a190 0x7f3b1c10a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:22.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.464+0000 7f3b218b2640 1 -- 172.21.15.7:0/2290765972 >> 172.21.15.7:0/2290765972 conn(0x7f3b1c0780f0 msgr2=0x7f3b1c1081e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:22.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.466+0000 7f3b218b2640 1 -- 172.21.15.7:0/2290765972 shutdown_connections 2024-09-21T06:38:22.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.466+0000 7f3b218b2640 1 -- 172.21.15.7:0/2290765972 wait complete. 2024-09-21T06:38:22.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.468+0000 7f3b218b2640 1 Processor -- start 2024-09-21T06:38:22.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.468+0000 7f3b218b2640 1 -- start start 2024-09-21T06:38:22.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.469+0000 7f3b218b2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3b1c10a190 0x7f3b1c075010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:22.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.469+0000 7f3b218b2640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b1c110420 0x7f3b1c06e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:22.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.469+0000 7f3b218b2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b1c06e880 0x7f3b1c073bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:22.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.469+0000 7f3b218b2640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3b1c11a0e0 con 0x7f3b1c06e880 2024-09-21T06:38:22.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.469+0000 7f3b218b2640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3b1c119f60 con 0x7f3b1c10a190 2024-09-21T06:38:22.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.469+0000 7f3b218b2640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3b1c11a260 con 0x7f3b1c110420 2024-09-21T06:38:22.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.470+0000 7f3b1b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b1c06e880 0x7f3b1c073bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:22.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.470+0000 7f3b1b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b1c06e880 0x7f3b1c073bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33534/0 (socket says 172.21.15.7:33534) 2024-09-21T06:38:22.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.470+0000 7f3b1b7fe640 1 -- 172.21.15.7:0/3796759581 learned_addr learned my addr 172.21.15.7:0/3796759581 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:38:22.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.470+0000 7f3b1affd640 1 --2- 172.21.15.7:0/3796759581 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3b1c10a190 0x7f3b1c075010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:22.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.470+0000 7f3b1a7fc640 1 --2- 172.21.15.7:0/3796759581 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b1c110420 0x7f3b1c06e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:22.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.472+0000 7f3b1affd640 1 -- 172.21.15.7:0/3796759581 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b1c110420 msgr2=0x7f3b1c06e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:22.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.472+0000 7f3b1affd640 1 --2- 172.21.15.7:0/3796759581 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b1c110420 0x7f3b1c06e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:22.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.472+0000 7f3b1affd640 1 -- 172.21.15.7:0/3796759581 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b1c06e880 msgr2=0x7f3b1c073bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:22.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.472+0000 7f3b1affd640 1 --2- 172.21.15.7:0/3796759581 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b1c06e880 0x7f3b1c073bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:22.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.472+0000 7f3b1affd640 1 -- 172.21.15.7:0/3796759581 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b1c06f040 con 0x7f3b1c10a190 2024-09-21T06:38:22.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.472+0000 7f3b1a7fc640 1 --2- 172.21.15.7:0/3796759581 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b1c110420 0x7f3b1c06e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:38:22.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.472+0000 7f3b1b7fe640 1 --2- 172.21.15.7:0/3796759581 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b1c06e880 0x7f3b1c073bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:38:22.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.473+0000 7f3b1affd640 1 --2- 172.21.15.7:0/3796759581 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3b1c10a190 0x7f3b1c075010 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3b1000d6d0 tx=0x7f3b1000db90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:22.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.474+0000 7f3b208b0640 1 -- 172.21.15.7:0/3796759581 <== mon.2 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b10017070 con 0x7f3b1c10a190 2024-09-21T06:38:22.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.474+0000 7f3b218b2640 1 -- 172.21.15.7:0/3796759581 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b1c074220 con 0x7f3b1c10a190 2024-09-21T06:38:22.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.474+0000 7f3b218b2640 1 -- 172.21.15.7:0/3796759581 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b1c074780 con 0x7f3b1c10a190 2024-09-21T06:38:22.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.479+0000 7f3b27e26740 1 Processor -- start 2024-09-21T06:38:22.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.480+0000 7f3b27e26740 1 -- start start 2024-09-21T06:38:22.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.480+0000 7f3b27e26740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560732c14070 0x560732fbe350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:22.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.480+0000 7f3b27e26740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560732beb1b0 0x560732fbb960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:22.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.480+0000 7f3b27e26740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560732bf3390 0x560732fbbf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:22.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.480+0000 7f3b27e26740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x560732f31e50 con 0x560732c14070 2024-09-21T06:38:22.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.480+0000 7f3b27e26740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x560732f21280 con 0x560732beb1b0 2024-09-21T06:38:22.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.480+0000 7f3b27e26740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x560732f25090 con 0x560732bf3390 2024-09-21T06:38:22.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.481+0000 7f3b208b0640 1 -- 172.21.15.7:0/3796759581 <== mon.2 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3b10009820 con 0x7f3b1c10a190 2024-09-21T06:38:22.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.481+0000 7f3b1b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560732c14070 0x560732fbe350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:22.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.481+0000 7f3b208b0640 1 -- 172.21.15.7:0/3796759581 <== mon.2 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b10004c40 con 0x7f3b1c10a190 2024-09-21T06:38:22.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.481+0000 7f3b1a7fc640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560732bf3390 0x560732fbbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:22.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.481+0000 7f3b1a7fc640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560732bf3390 0x560732fbbf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.7:33900/0 (socket says 172.21.15.7:33900) 2024-09-21T06:38:22.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.481+0000 7f3b1a7fc640 1 -- 172.21.15.7:0/1222915904 learned_addr learned my addr 172.21.15.7:0/1222915904 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:38:22.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.483+0000 7f3b1affd640 1 --2- 172.21.15.7:0/1222915904 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560732beb1b0 0x560732fbb960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:22.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.483+0000 7f3b1a7fc640 1 -- 172.21.15.7:0/1222915904 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560732beb1b0 msgr2=0x560732fbb960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:22.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.483+0000 7f3b1a7fc640 1 --2- 172.21.15.7:0/1222915904 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560732beb1b0 0x560732fbb960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:22.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.483+0000 7f3b1a7fc640 1 -- 172.21.15.7:0/1222915904 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560732c14070 msgr2=0x560732fbe350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:22.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.483+0000 7f3b1a7fc640 1 --2- 172.21.15.7:0/1222915904 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560732c14070 0x560732fbe350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:22.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.485+0000 7f3b1a7fc640 1 -- 172.21.15.7:0/1222915904 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560732c7f650 con 0x560732bf3390 2024-09-21T06:38:22.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.491+0000 7f3b1b7fe640 1 --2- 172.21.15.7:0/1222915904 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560732c14070 0x560732fbe350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:38:22.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.497+0000 7f3b208b0640 1 -- 172.21.15.7:0/3796759581 <== mon.2 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f3b10005220 con 0x7f3b1c10a190 2024-09-21T06:38:22.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.499+0000 7f3b208b0640 1 --2- 172.21.15.7:0/3796759581 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f3b040b6780 0x7f3b040b8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:22.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.499+0000 7f3b208b0640 1 -- 172.21.15.7:0/3796759581 <== mon.2 v2:172.21.15.18:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f3b100e7290 con 0x7f3b1c10a190 2024-09-21T06:38:22.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.499+0000 7f3b1a7fc640 1 --2- 172.21.15.7:0/1222915904 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560732bf3390 0x560732fbbf00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3b14009230 tx=0x7f3b140048a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae143c48acb54635 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:22.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.504+0000 7f3b218b2640 1 -- 172.21.15.7:0/1222915904 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b14035030 con 0x560732bf3390 2024-09-21T06:38:22.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.505+0000 7f3b218b2640 1 -- 172.21.15.7:0/1222915904 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3b14040070 con 0x560732bf3390 2024-09-21T06:38:22.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.505+0000 7f3b218b2640 1 -- 172.21.15.7:0/1222915904 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b14004ff0 con 0x560732bf3390 2024-09-21T06:38:22.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.505+0000 7f3b1b7fe640 1 --2- 172.21.15.7:0/3796759581 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f3b040b6780 0x7f3b040b8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:22.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.509+0000 7f3b27e26740 1 -- 172.21.15.7:0/1222915904 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560732bf3390 msgr2=0x560732fbbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:22.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.509+0000 7f3b27e26740 1 --2- 172.21.15.7:0/1222915904 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560732bf3390 0x560732fbbf00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3b14009230 tx=0x7f3b140048a0 comp rx=0 tx=0).stop 2024-09-21T06:38:22.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.509+0000 7f3b1b7fe640 1 --2- 172.21.15.7:0/3796759581 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f3b040b6780 0x7f3b040b8c90 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c0049d0 tx=0x7f3b0c009500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:22.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.512+0000 7f3b27e26740 1 -- 172.21.15.7:0/1222915904 shutdown_connections 2024-09-21T06:38:22.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.512+0000 7f3b27e26740 1 --2- 172.21.15.7:0/1222915904 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560732bf3390 0x560732fbbf00 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:22.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.512+0000 7f3b27e26740 1 --2- 172.21.15.7:0/1222915904 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560732beb1b0 0x560732fbb960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:22.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.512+0000 7f3b27e26740 1 --2- 172.21.15.7:0/1222915904 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560732c14070 0x560732fbe350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:22.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.512+0000 7f3b27e26740 1 -- 172.21.15.7:0/1222915904 >> 172.21.15.7:0/1222915904 conn(0x560732c08460 msgr2=0x560732fb9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:22.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.513+0000 7f3b27e26740 1 -- 172.21.15.7:0/1222915904 shutdown_connections 2024-09-21T06:38:22.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.513+0000 7f3b27e26740 1 -- 172.21.15.7:0/1222915904 wait complete. 2024-09-21T06:38:22.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.514+0000 7f3b27e26740 1 -- start start 2024-09-21T06:38:22.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.514+0000 7f3b27e26740 1 Processor -- start 2024-09-21T06:38:22.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.515+0000 7f3b27e26740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560732beb1b0 0x560732fc6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:22.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.515+0000 7f3b27e26740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560732bf3390 0x560732fc7500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:22.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.515+0000 7f3b27e26740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560732c14070 0x560732fd3160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:22.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.515+0000 7f3b27e26740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x560732d82700 con 0x560732c14070 2024-09-21T06:38:22.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.515+0000 7f3b27e26740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x560732ebc110 con 0x560732beb1b0 2024-09-21T06:38:22.063 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:38:22.064 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "no active scrubs running", 2024-09-21T06:38:22.064 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": {}, 2024-09-21T06:38:22.064 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_stats": { 2024-09-21T06:38:22.064 INFO:teuthology.orchestra.run.smithi007.stdout: "5cbaaba2-6ab1-4f83-abd6-8c6eef4b5c42": { 2024-09-21T06:38:22.064 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:37:46.566272+0000", 2024-09-21T06:38:22.064 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:38:22.064 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:38:22.064 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:38:22.064 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:38:22.064 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:38:22.064 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:38:22.064 INFO:teuthology.orchestra.run.smithi007.stdout: "6231e9c1-14a2-40b5-be3c-76d87a0d733b": { 2024-09-21T06:38:22.064 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:37:02.484812+0000", 2024-09-21T06:38:22.064 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:38:22.065 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:38:22.065 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:38:22.065 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:38:22.065 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:38:22.065 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:38:22.065 INFO:teuthology.orchestra.run.smithi007.stdout: "0b89345c-1f00-4efe-8ee9-4cb17e43584c": { 2024-09-21T06:38:22.065 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:36:19.500334+0000", 2024-09-21T06:38:22.065 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:38:22.065 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:38:22.065 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:38:22.065 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:38:22.065 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:38:22.065 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:38:22.065 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:38:22.065 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:38:22.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.515+0000 7f3b27e26740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x560732fc9da0 con 0x560732bf3390 2024-09-21T06:38:22.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.515+0000 7f3b27e26740 10 client.0 _ll_register_callbacks cb 0x560732ed5990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:38:22.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.517+0000 7f3b1b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560732c14070 0x560732fd3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:22.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.517+0000 7f3b1a7fc640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560732bf3390 0x560732fc7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:22.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.517+0000 7f3b1b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560732c14070 0x560732fd3160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33562/0 (socket says 172.21.15.7:33562) 2024-09-21T06:38:22.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.517+0000 7f3b1b7fe640 1 -- 172.21.15.7:0/2465611196 learned_addr learned my addr 172.21.15.7:0/2465611196 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:38:22.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.517+0000 7f3b1affd640 1 --2- 172.21.15.7:0/2465611196 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560732beb1b0 0x560732fc6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:22.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.517+0000 7f3b1b7fe640 1 -- 172.21.15.7:0/2465611196 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560732bf3390 msgr2=0x560732fc7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:22.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.517+0000 7f3b1b7fe640 1 --2- 172.21.15.7:0/2465611196 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560732bf3390 0x560732fc7500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:22.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.517+0000 7f3b1b7fe640 1 -- 172.21.15.7:0/2465611196 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560732beb1b0 msgr2=0x560732fc6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:22.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.517+0000 7f3b1b7fe640 1 --2- 172.21.15.7:0/2465611196 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560732beb1b0 0x560732fc6fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:22.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.517+0000 7f3b1b7fe640 1 -- 172.21.15.7:0/2465611196 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560732ee9c40 con 0x560732c14070 2024-09-21T06:38:22.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.518+0000 7f3b1affd640 1 --2- 172.21.15.7:0/2465611196 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560732beb1b0 0x560732fc6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:38:22.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.518+0000 7f3b1b7fe640 1 --2- 172.21.15.7:0/2465611196 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560732c14070 0x560732fd3160 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c012260 tx=0x7f3b0c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53e722d107a26013 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:22.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.518+0000 7f3afaffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:38:22.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.519+0000 7f3afaffd640 1 -- 172.21.15.7:0/2465611196 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b0c011c50 con 0x560732c14070 2024-09-21T06:38:22.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.519+0000 7f3b27e26740 1 -- 172.21.15.7:0/2465611196 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b14040070 con 0x560732c14070 2024-09-21T06:38:22.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.519+0000 7f3afaffd640 1 -- 172.21.15.7:0/2465611196 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f3b0c018030 con 0x560732c14070 2024-09-21T06:38:22.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.519+0000 7f3afaffd640 1 -- 172.21.15.7:0/2465611196 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3b0c011c50 con 0x560732c14070 2024-09-21T06:38:22.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.519+0000 7f3b27e26740 10 client.15900 fetch_fsmap learned FSMap version 25 2024-09-21T06:38:22.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.519+0000 7f3b27e26740 1 -- 172.21.15.7:0/2465611196 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560732fd5bd0 con 0x560732c14070 2024-09-21T06:38:22.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.520+0000 7f3afaffd640 1 -- 172.21.15.7:0/2465611196 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3b14040070 con 0x560732c14070 2024-09-21T06:38:22.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.522+0000 7f3afaffd640 1 -- 172.21.15.7:0/2465611196 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f3b0c027070 con 0x560732c14070 2024-09-21T06:38:22.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.522+0000 7f3b27e26740 10 client.15900 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:38:22.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.522+0000 7f3b27e26740 10 client.15900 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:38:22.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.522+0000 7f3b27e26740 20 client.15900 populate_metadata read hostname 'smithi007' 2024-09-21T06:38:22.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.522+0000 7f3b27e26740 1 --2- 172.21.15.7:0/2465611196 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x560732bd29f0 0x560732fd9110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:22.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.522+0000 7f3b27e26740 4 client.15900 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:38:22.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.522+0000 7f3b27e26740 1 -- 172.21.15.7:0/2465611196 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560732f33da0 con 0x560732bd29f0 2024-09-21T06:38:22.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.523+0000 7f3b1affd640 1 --2- 172.21.15.7:0/2465611196 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x560732bd29f0 0x560732fd9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:22.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.527+0000 7f3afaffd640 10 client.15900 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:38:22.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.527+0000 7f3b1affd640 1 --2- 172.21.15.7:0/2465611196 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x560732bd29f0 0x560732fd9110 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3679e71620aa686 server_cookie=1f5e4ebed38ee20a in_seq=0 out_seq=0 2024-09-21T06:38:22.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.531+0000 7f3afaffd640 1 -- 172.21.15.7:0/2465611196 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560732f33da0 con 0x560732bd29f0 2024-09-21T06:38:22.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.531+0000 7f3afaffd640 10 client.15900 handle_command_reply: tid=0 2024-09-21T06:38:22.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.531+0000 7f3b27e26740 1 client.15900 shutdown 2024-09-21T06:38:22.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.532+0000 7f3b27e26740 1 -- 172.21.15.7:0/2465611196 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560732c14070 msgr2=0x560732fd3160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:22.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.532+0000 7f3b27e26740 1 --2- 172.21.15.7:0/2465611196 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560732c14070 0x560732fd3160 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c012260 tx=0x7f3b0c004ab0 comp rx=0 tx=0).stop 2024-09-21T06:38:22.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.532+0000 7f3b27e26740 1 -- 172.21.15.7:0/2465611196 shutdown_connections 2024-09-21T06:38:22.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.532+0000 7f3b27e26740 1 --2- 172.21.15.7:0/2465611196 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x560732bd29f0 0x560732fd9110 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:22.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.532+0000 7f3b27e26740 1 --2- 172.21.15.7:0/2465611196 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560732c14070 0x560732fd3160 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:22.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.532+0000 7f3b27e26740 1 --2- 172.21.15.7:0/2465611196 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560732bf3390 0x560732fc7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:22.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.532+0000 7f3b27e26740 1 --2- 172.21.15.7:0/2465611196 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560732beb1b0 0x560732fc6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:22.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.532+0000 7f3b27e26740 1 -- 172.21.15.7:0/2465611196 >> 172.21.15.7:0/2465611196 conn(0x560732c08460 msgr2=0x560732fbd350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:22.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.532+0000 7f3afaffd640 0 client.15900 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:38:22.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.535+0000 7f3b27e26740 1 -- 172.21.15.7:0/2465611196 shutdown_connections 2024-09-21T06:38:22.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.535+0000 7f3b27e26740 1 -- 172.21.15.7:0/2465611196 wait complete. 2024-09-21T06:38:22.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.536+0000 7f3b27e26740 20 client.15900 trim_cache size 0 max 16384 2024-09-21T06:38:22.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.579+0000 7f3b27e26740 1 Processor -- start 2024-09-21T06:38:22.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.579+0000 7f3b27e26740 1 -- start start 2024-09-21T06:38:22.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.579+0000 7f3b27e26740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560732beb1b0 0x560732fc5840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:22.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.579+0000 7f3b27e26740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560732bf3390 0x560732fc5d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:22.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.579+0000 7f3b27e26740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560732c14070 0x560732fbb850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:22.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.579+0000 7f3b27e26740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3b08011140 con 0x560732c14070 2024-09-21T06:38:22.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.579+0000 7f3b27e26740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3b0800ea10 con 0x560732beb1b0 2024-09-21T06:38:22.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.579+0000 7f3b27e26740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3b0800c800 con 0x560732bf3390 2024-09-21T06:38:22.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.580+0000 7f3b1b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560732c14070 0x560732fbb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:22.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.580+0000 7f3b1b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560732c14070 0x560732fbb850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33570/0 (socket says 172.21.15.7:33570) 2024-09-21T06:38:22.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.580+0000 7f3b1b7fe640 1 -- 172.21.15.7:0/1824507865 learned_addr learned my addr 172.21.15.7:0/1824507865 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:38:22.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.580+0000 7f3b1a7fc640 1 --2- 172.21.15.7:0/1824507865 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560732bf3390 0x560732fc5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:22.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.580+0000 7f3b1affd640 1 --2- 172.21.15.7:0/1824507865 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560732beb1b0 0x560732fc5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:22.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.580+0000 7f3b1b7fe640 1 -- 172.21.15.7:0/1824507865 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560732bf3390 msgr2=0x560732fc5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:22.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.581+0000 7f3b1b7fe640 1 --2- 172.21.15.7:0/1824507865 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560732bf3390 0x560732fc5d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:22.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.581+0000 7f3b1b7fe640 1 -- 172.21.15.7:0/1824507865 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560732beb1b0 msgr2=0x560732fc5840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:22.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.581+0000 7f3b1b7fe640 1 --2- 172.21.15.7:0/1824507865 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560732beb1b0 0x560732fc5840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:22.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.581+0000 7f3b1b7fe640 1 -- 172.21.15.7:0/1824507865 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560732fc2b30 con 0x560732c14070 2024-09-21T06:38:22.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.582+0000 7f3b1b7fe640 1 --2- 172.21.15.7:0/1824507865 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560732c14070 0x560732fbb850 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c00f8f0 tx=0x7f3b0c0297e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a14265cc174b8392 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:22.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.582+0000 7f3b017fa640 1 -- 172.21.15.7:0/1824507865 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b0c011c50 con 0x560732c14070 2024-09-21T06:38:22.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.582+0000 7f3b017fa640 1 -- 172.21.15.7:0/1824507865 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3b0c038020 con 0x560732c14070 2024-09-21T06:38:22.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.582+0000 7f3b017fa640 1 -- 172.21.15.7:0/1824507865 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b0c033810 con 0x560732c14070 2024-09-21T06:38:22.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.583+0000 7f3b27e26740 1 -- 172.21.15.7:0/1824507865 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560732c14070 msgr2=0x560732fbb850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:22.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.583+0000 7f3b27e26740 1 --2- 172.21.15.7:0/1824507865 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560732c14070 0x560732fbb850 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c00f8f0 tx=0x7f3b0c0297e0 comp rx=0 tx=0).stop 2024-09-21T06:38:22.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.584+0000 7f3b27e26740 1 -- 172.21.15.7:0/1824507865 shutdown_connections 2024-09-21T06:38:22.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.584+0000 7f3b27e26740 1 --2- 172.21.15.7:0/1824507865 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560732c14070 0x560732fbb850 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:22.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.584+0000 7f3b27e26740 1 --2- 172.21.15.7:0/1824507865 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560732bf3390 0x560732fc5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:22.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.584+0000 7f3b27e26740 1 --2- 172.21.15.7:0/1824507865 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560732beb1b0 0x560732fc5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:22.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.584+0000 7f3b27e26740 1 -- 172.21.15.7:0/1824507865 >> 172.21.15.7:0/1824507865 conn(0x560732c08460 msgr2=0x560732fb4280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:22.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.584+0000 7f3b27e26740 1 -- 172.21.15.7:0/1824507865 shutdown_connections 2024-09-21T06:38:22.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.584+0000 7f3b27e26740 1 -- 172.21.15.7:0/1824507865 wait complete. 2024-09-21T06:38:22.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.585+0000 7f3b27e26740 1 -- start start 2024-09-21T06:38:22.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.585+0000 7f3b27e26740 1 Processor -- start 2024-09-21T06:38:22.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.586+0000 7f3b27e26740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560732beb1b0 0x560732fcafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:22.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.586+0000 7f3b27e26740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560732bf3390 0x560732fcb520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:22.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.587+0000 7f3b27e26740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560732c14070 0x560732fcba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:22.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.587+0000 7f3b27e26740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3b0800ced0 con 0x560732bf3390 2024-09-21T06:38:22.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.587+0000 7f3b1a7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560732bf3390 0x560732fcb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:22.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.587+0000 7f3b1a7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560732bf3390 0x560732fcb520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33580/0 (socket says 172.21.15.7:33580) 2024-09-21T06:38:22.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.587+0000 7f3b1a7fc640 1 -- 172.21.15.7:0/4013729933 learned_addr learned my addr 172.21.15.7:0/4013729933 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:38:22.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.587+0000 7f3b27e26740 1 -- 172.21.15.7:0/4013729933 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3b0800e340 con 0x560732beb1b0 2024-09-21T06:38:22.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.587+0000 7f3b27e26740 1 -- 172.21.15.7:0/4013729933 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3b0800d5a0 con 0x560732c14070 2024-09-21T06:38:22.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.587+0000 7f3b27e26740 10 client.0 _ll_register_callbacks cb 0x7f3b0c0128e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:38:22.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.588+0000 7f3b1affd640 1 --2- 172.21.15.7:0/4013729933 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560732beb1b0 0x560732fcafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:22.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.588+0000 7f3b1a7fc640 1 -- 172.21.15.7:0/4013729933 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560732c14070 msgr2=0x560732fcba60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T06:38:22.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.588+0000 7f3b1a7fc640 1 --2- 172.21.15.7:0/4013729933 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560732c14070 0x560732fcba60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:22.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.588+0000 7f3b1a7fc640 1 -- 172.21.15.7:0/4013729933 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560732beb1b0 msgr2=0x560732fcafe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:22.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.588+0000 7f3b1a7fc640 1 --2- 172.21.15.7:0/4013729933 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560732beb1b0 0x560732fcafe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:22.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.588+0000 7f3b1a7fc640 1 -- 172.21.15.7:0/4013729933 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560733042b10 con 0x560732bf3390 2024-09-21T06:38:22.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.588+0000 7f3b1a7fc640 1 --2- 172.21.15.7:0/4013729933 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560732bf3390 0x560732fcb520 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f3b14009230 tx=0x7f3b140043f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87ce1ab1b93ee2a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:22.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.588+0000 7f3afaffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:38:22.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.588+0000 7f3afaffd640 1 -- 172.21.15.7:0/4013729933 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b14035040 con 0x560732bf3390 2024-09-21T06:38:22.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.589+0000 7f3b27e26740 1 -- 172.21.15.7:0/4013729933 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b0c038020 con 0x560732bf3390 2024-09-21T06:38:22.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.589+0000 7f3afaffd640 1 -- 172.21.15.7:0/4013729933 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f3b14003800 con 0x560732bf3390 2024-09-21T06:38:22.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.589+0000 7f3afaffd640 1 -- 172.21.15.7:0/4013729933 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3b14054030 con 0x560732bf3390 2024-09-21T06:38:22.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.589+0000 7f3b27e26740 10 client.15906 fetch_fsmap learned FSMap version 25 2024-09-21T06:38:22.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.589+0000 7f3b27e26740 1 -- 172.21.15.7:0/4013729933 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560733043ce0 con 0x560732bf3390 2024-09-21T06:38:22.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.590+0000 7f3afaffd640 1 -- 172.21.15.7:0/4013729933 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3b0c038020 con 0x560732bf3390 2024-09-21T06:38:22.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.590+0000 7f3afaffd640 1 -- 172.21.15.7:0/4013729933 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f3b140050a0 con 0x560732bf3390 2024-09-21T06:38:22.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.590+0000 7f3b27e26740 10 client.15906 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:38:22.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.590+0000 7f3b27e26740 10 client.15906 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:38:22.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.590+0000 7f3b27e26740 20 client.15906 populate_metadata read hostname 'smithi007' 2024-09-21T06:38:22.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.590+0000 7f3b27e26740 1 --2- 172.21.15.7:0/4013729933 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x560732ba7da0 0x560733046020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:22.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.590+0000 7f3b27e26740 4 client.15906 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:38:22.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.590+0000 7f3b27e26740 1 -- 172.21.15.7:0/4013729933 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "scrub status"}) -- 0x560732f2f850 con 0x560732ba7da0 2024-09-21T06:38:22.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.591+0000 7f3b1affd640 1 --2- 172.21.15.7:0/4013729933 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x560732ba7da0 0x560733046020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:22.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.594+0000 7f3afaffd640 10 client.15906 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:38:22.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.594+0000 7f3b1affd640 1 --2- 172.21.15.7:0/4013729933 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x560732ba7da0 0x560733046020 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed9ead9ce2bc1e7 server_cookie=d98caaa0ddfd252e in_seq=0 out_seq=0 2024-09-21T06:38:22.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.597+0000 7f3afaffd640 1 -- 172.21.15.7:0/4013729933 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+942 (crc 0 0 0) 0x560732f2f850 con 0x560732ba7da0 2024-09-21T06:38:22.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.597+0000 7f3afaffd640 10 client.15906 handle_command_reply: tid=0 2024-09-21T06:38:22.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.597+0000 7f3b27e26740 1 client.15906 shutdown 2024-09-21T06:38:22.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.597+0000 7f3b27e26740 1 -- 172.21.15.7:0/4013729933 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560732bf3390 msgr2=0x560732fcb520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:22.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.597+0000 7f3b27e26740 1 --2- 172.21.15.7:0/4013729933 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560732bf3390 0x560732fcb520 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f3b14009230 tx=0x7f3b140043f0 comp rx=0 tx=0).stop 2024-09-21T06:38:22.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.597+0000 7f3b27e26740 1 -- 172.21.15.7:0/4013729933 shutdown_connections 2024-09-21T06:38:22.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.597+0000 7f3b27e26740 1 --2- 172.21.15.7:0/4013729933 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x560732ba7da0 0x560733046020 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:22.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.597+0000 7f3b27e26740 1 --2- 172.21.15.7:0/4013729933 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560732c14070 0x560732fcba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:22.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.597+0000 7f3b27e26740 1 --2- 172.21.15.7:0/4013729933 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560732bf3390 0x560732fcb520 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:22.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.597+0000 7f3afaffd640 0 client.15906 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:38:22.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.597+0000 7f3b27e26740 1 --2- 172.21.15.7:0/4013729933 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560732beb1b0 0x560732fcafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:22.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.597+0000 7f3b27e26740 1 -- 172.21.15.7:0/4013729933 >> 172.21.15.7:0/4013729933 conn(0x560732c08460 msgr2=0x560732fc6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:22.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.598+0000 7f3b27e26740 1 -- 172.21.15.7:0/4013729933 shutdown_connections 2024-09-21T06:38:22.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.598+0000 7f3b27e26740 1 -- 172.21.15.7:0/4013729933 wait complete. 2024-09-21T06:38:22.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.598+0000 7f3b27e26740 20 client.15906 trim_cache size 0 max 16384 2024-09-21T06:38:22.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.599+0000 7f3b027fc640 1 -- 172.21.15.7:0/3796759581 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f3b040b6780 msgr2=0x7f3b040b8c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:22.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.599+0000 7f3b027fc640 1 --2- 172.21.15.7:0/3796759581 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f3b040b6780 0x7f3b040b8c90 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c0049d0 tx=0x7f3b0c009500 comp rx=0 tx=0).stop 2024-09-21T06:38:22.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.599+0000 7f3b027fc640 1 -- 172.21.15.7:0/3796759581 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3b1c10a190 msgr2=0x7f3b1c075010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:22.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.599+0000 7f3b027fc640 1 --2- 172.21.15.7:0/3796759581 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3b1c10a190 0x7f3b1c075010 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3b1000d6d0 tx=0x7f3b1000db90 comp rx=0 tx=0).stop 2024-09-21T06:38:22.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.599+0000 7f3b027fc640 1 -- 172.21.15.7:0/3796759581 shutdown_connections 2024-09-21T06:38:22.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.599+0000 7f3b027fc640 1 --2- 172.21.15.7:0/3796759581 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f3b040b6780 0x7f3b040b8c90 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:22.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.599+0000 7f3b027fc640 1 --2- 172.21.15.7:0/3796759581 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3b1c06e880 0x7f3b1c073bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:22.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.599+0000 7f3b027fc640 1 --2- 172.21.15.7:0/3796759581 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3b1c110420 0x7f3b1c06e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:22.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.599+0000 7f3b027fc640 1 --2- 172.21.15.7:0/3796759581 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3b1c10a190 0x7f3b1c075010 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:22.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.599+0000 7f3b027fc640 1 -- 172.21.15.7:0/3796759581 >> 172.21.15.7:0/3796759581 conn(0x7f3b1c0780f0 msgr2=0x7f3b1c10df80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:22.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.599+0000 7f3b027fc640 1 -- 172.21.15.7:0/3796759581 shutdown_connections 2024-09-21T06:38:22.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:21.599+0000 7f3b027fc640 1 -- 172.21.15.7:0/3796759581 wait complete. 2024-09-21T06:38:23.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:38:22 smithi018 ceph-mon[34477]: pgmap v384: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 583 MiB/s wr, 195 op/s 2024-09-21T06:38:23.182 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:38:22 smithi007 ceph-mon[30983]: pgmap v384: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 583 MiB/s wr, 195 op/s 2024-09-21T06:38:23.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:38:22 smithi144 ceph-mon[34653]: pgmap v384: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 583 MiB/s wr, 195 op/s 2024-09-21T06:38:24.909 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:38:24.910 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:38:25.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:38:24 smithi007 ceph-mon[30983]: pgmap v385: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 675 MiB/s wr, 258 op/s 2024-09-21T06:38:25.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:38:24 smithi018 ceph-mon[34477]: pgmap v385: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 675 MiB/s wr, 258 op/s 2024-09-21T06:38:25.293 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:38:24 smithi144 ceph-mon[34653]: pgmap v385: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 675 MiB/s wr, 258 op/s 2024-09-21T06:38:25.695 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:38:26.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:26.371+0000 7fca50339640 1 -- 172.21.15.7:0/1190712212 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca48108cf0 msgr2=0x7fca4810f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:26.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:26.371+0000 7fca50339640 1 --2- 172.21.15.7:0/1190712212 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca48108cf0 0x7fca4810f520 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fca40009ca0 tx=0x7fca4002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:38:26.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:26.371+0000 7fca50339640 1 -- 172.21.15.7:0/1190712212 shutdown_connections 2024-09-21T06:38:26.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:26.372+0000 7fca50339640 1 --2- 172.21.15.7:0/1190712212 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca48108cf0 0x7fca4810f520 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:26.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:26.372+0000 7fca50339640 1 --2- 172.21.15.7:0/1190712212 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca481083a0 0x7fca481087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:26.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:26.372+0000 7fca50339640 1 --2- 172.21.15.7:0/1190712212 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fca48102a60 0x7fca48102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:26.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:26.372+0000 7fca50339640 1 -- 172.21.15.7:0/1190712212 >> 172.21.15.7:0/1190712212 conn(0x7fca48079730 msgr2=0x7fca48079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:26.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:26.372+0000 7fca50339640 1 -- 172.21.15.7:0/1190712212 shutdown_connections 2024-09-21T06:38:26.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:26.372+0000 7fca50339640 1 -- 172.21.15.7:0/1190712212 wait complete. 2024-09-21T06:38:26.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:26.373+0000 7fca50339640 1 Processor -- start 2024-09-21T06:38:26.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:26.373+0000 7fca50339640 1 -- start start 2024-09-21T06:38:26.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:26.374+0000 7fca50339640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca48102a60 0x7fca4819a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:26.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:26.374+0000 7fca50339640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fca481083a0 0x7fca4819aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:26.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:26.374+0000 7fca50339640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca48108cf0 0x7fca4819fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:26.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:26.374+0000 7fca50339640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fca48112960 con 0x7fca48108cf0 2024-09-21T06:38:26.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:26.374+0000 7fca50339640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fca481127e0 con 0x7fca48102a60 2024-09-21T06:38:26.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:26.374+0000 7fca50339640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fca48112ae0 con 0x7fca481083a0 2024-09-21T06:38:26.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:26.374+0000 7fca4e8d6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca48108cf0 0x7fca4819fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:26.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:26.374+0000 7fca4e8d6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca48108cf0 0x7fca4819fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33584/0 (socket says 172.21.15.7:33584) 2024-09-21T06:38:26.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:26.374+0000 7fca4e8d6640 1 -- 172.21.15.7:0/2219998777 learned_addr learned my addr 172.21.15.7:0/2219998777 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:38:26.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:26.374+0000 7fca4d8d4640 1 --2- 172.21.15.7:0/2219998777 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fca481083a0 0x7fca4819aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:26.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:26.375+0000 7fca4e8d6640 1 -- 172.21.15.7:0/2219998777 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fca481083a0 msgr2=0x7fca4819aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:26.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:26.375+0000 7fca4e8d6640 1 --2- 172.21.15.7:0/2219998777 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fca481083a0 0x7fca4819aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:26.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:26.375+0000 7fca4e8d6640 1 -- 172.21.15.7:0/2219998777 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca48102a60 msgr2=0x7fca4819a4e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T06:38:26.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:26.375+0000 7fca4e8d6640 1 --2- 172.21.15.7:0/2219998777 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca48102a60 0x7fca4819a4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:26.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:26.375+0000 7fca4e8d6640 1 -- 172.21.15.7:0/2219998777 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca481a0450 con 0x7fca48108cf0 2024-09-21T06:38:26.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:26.375+0000 7fca4e8d6640 1 --2- 172.21.15.7:0/2219998777 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca48108cf0 0x7fca4819fd20 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fca40005cc0 tx=0x7fca4002f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:26.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:26.375+0000 7fca3f7fe640 1 -- 172.21.15.7:0/2219998777 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca40003bf0 con 0x7fca48108cf0 2024-09-21T06:38:26.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:26.376+0000 7fca50339640 1 -- 172.21.15.7:0/2219998777 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca481a06e0 con 0x7fca48108cf0 2024-09-21T06:38:26.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:26.376+0000 7fca3f7fe640 1 -- 172.21.15.7:0/2219998777 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca40003d90 con 0x7fca48108cf0 2024-09-21T06:38:26.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:26.376+0000 7fca3f7fe640 1 -- 172.21.15.7:0/2219998777 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca4002fbc0 con 0x7fca48108cf0 2024-09-21T06:38:26.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:26.376+0000 7fca50339640 1 -- 172.21.15.7:0/2219998777 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca481a6ea0 con 0x7fca48108cf0 2024-09-21T06:38:26.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:26.377+0000 7fca50339640 1 -- 172.21.15.7:0/2219998777 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca48103ce0 con 0x7fca48108cf0 2024-09-21T06:38:26.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:26.379+0000 7fca3f7fe640 1 -- 172.21.15.7:0/2219998777 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7fca4002fd60 con 0x7fca48108cf0 2024-09-21T06:38:26.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:26.381+0000 7fca3f7fe640 1 --2- 172.21.15.7:0/2219998777 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fca340b6680 0x7fca340b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:26.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:26.381+0000 7fca4e0d5640 1 --2- 172.21.15.7:0/2219998777 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fca340b6680 0x7fca340b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:26.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:26.381+0000 7fca3f7fe640 1 -- 172.21.15.7:0/2219998777 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fca40108d40 con 0x7fca48108cf0 2024-09-21T06:38:26.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:26.381+0000 7fca4e0d5640 1 --2- 172.21.15.7:0/2219998777 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fca340b6680 0x7fca340b8b90 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fca4400a890 tx=0x7fca44005b80 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:26.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:26.385+0000 7fca3f7fe640 1 -- 172.21.15.7:0/2219998777 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fca400cf330 con 0x7fca48108cf0 2024-09-21T06:38:26.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:26.688+0000 7fca50339640 1 -- 172.21.15.7:0/2219998777 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fca48102e70 con 0x7fca48108cf0 2024-09-21T06:38:26.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:26.689+0000 7fca3f7fe640 1 -- 172.21.15.7:0/2219998777 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11899 (secure 0 0 0) 0x7fca400d3710 con 0x7fca48108cf0 2024-09-21T06:38:26.693 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:38:26.693 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-21T06:36:10:753693+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2015971546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2015971546},{"type":"v1","addr":"172.21.15.7:6835","nonce":2015971546}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/2350816224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":2350816224},{"type":"v1","addr":"172.21.15.7:6837","nonce":2350816224}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14823,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/1669980572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":1669980572},{"type":"v1","addr":"172.21.15.7:6839","nonce":1669980572}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14835,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/2528308973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":2528308973},{"type":"v1","addr":"172.21.15.7:6841","nonce":2528308973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24623,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1337382979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1337382979},{"type":"v1","addr":"172.21.15.18:6833","nonce":1337382979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/2751454345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":2751454345},{"type":"v1","addr":"172.21.15.144:6833","nonce":2751454345}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:34:24.627168+0000","modified":"2024-09-21T06:36:10.737288+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24716,"mds_1":24688,"mds_2":24686},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24656":{"gid":24656,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6835/158884796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":158884796},{"type":"v1","addr":"172.21.15.18:6835","nonce":158884796}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6835/3636739922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3636739922},{"type":"v1","addr":"172.21.15.144:6835","nonce":3636739922}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24673":{"gid":24673,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6837/1126341753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":1126341753},{"type":"v1","addr":"172.21.15.144:6837","nonce":1126341753}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.18:6837/1539670694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1539670694},{"type":"v1","addr":"172.21.15.18:6837","nonce":1539670694}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24688":{"gid":24688,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.144:6839/4027821922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":4027821922},{"type":"v1","addr":"172.21.15.144:6839","nonce":4027821922}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24716":{"gid":24716,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.18:6839/3798713532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":3798713532},{"type":"v1","addr":"172.21.15.18:6839","nonce":3798713532}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24716,"qdb_cluster":[24716,24688,24686]},"id":1}]} 2024-09-21T06:38:26.693 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-21T06:38:26.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:26.692+0000 7fca50339640 1 -- 172.21.15.7:0/2219998777 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fca340b6680 msgr2=0x7fca340b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:26.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:26.692+0000 7fca50339640 1 --2- 172.21.15.7:0/2219998777 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fca340b6680 0x7fca340b8b90 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fca4400a890 tx=0x7fca44005b80 comp rx=0 tx=0).stop 2024-09-21T06:38:26.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:26.692+0000 7fca50339640 1 -- 172.21.15.7:0/2219998777 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca48108cf0 msgr2=0x7fca4819fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:26.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:26.692+0000 7fca50339640 1 --2- 172.21.15.7:0/2219998777 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca48108cf0 0x7fca4819fd20 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fca40005cc0 tx=0x7fca4002f380 comp rx=0 tx=0).stop 2024-09-21T06:38:26.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:26.693+0000 7fca50339640 1 -- 172.21.15.7:0/2219998777 shutdown_connections 2024-09-21T06:38:26.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:26.693+0000 7fca50339640 1 --2- 172.21.15.7:0/2219998777 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fca340b6680 0x7fca340b8b90 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:26.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:26.693+0000 7fca50339640 1 --2- 172.21.15.7:0/2219998777 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca48108cf0 0x7fca4819fd20 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:26.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:26.693+0000 7fca50339640 1 --2- 172.21.15.7:0/2219998777 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fca481083a0 0x7fca4819aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:26.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:26.693+0000 7fca50339640 1 --2- 172.21.15.7:0/2219998777 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca48102a60 0x7fca4819a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:26.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:26.693+0000 7fca50339640 1 -- 172.21.15.7:0/2219998777 >> 172.21.15.7:0/2219998777 conn(0x7fca48079730 msgr2=0x7fca4806b250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:26.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:26.693+0000 7fca50339640 1 -- 172.21.15.7:0/2219998777 shutdown_connections 2024-09-21T06:38:26.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:26.693+0000 7fca50339640 1 -- 172.21.15.7:0/2219998777 wait complete. 2024-09-21T06:38:27.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:38:26 smithi007 ceph-mon[30983]: pgmap v386: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 488 MiB/s wr, 187 op/s 2024-09-21T06:38:27.084 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:38:26 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2219998777' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:38:27.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:38:26 smithi018 ceph-mon[34477]: pgmap v386: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 488 MiB/s wr, 187 op/s 2024-09-21T06:38:27.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:38:26 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/2219998777' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:38:27.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:38:26 smithi144 ceph-mon[34653]: pgmap v386: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 488 MiB/s wr, 187 op/s 2024-09-21T06:38:27.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:38:26 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/2219998777' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:38:27.423 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:38:27.795 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:38:28.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.381+0000 7f1a91d70640 1 -- 172.21.15.7:0/126012475 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a8c105d90 msgr2=0x7f1a8c1061a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:28.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.381+0000 7f1a91d70640 1 --2- 172.21.15.7:0/126012475 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a8c105d90 0x7f1a8c1061a0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c009900 tx=0x7f1a7c02a410 comp rx=0 tx=0).stop 2024-09-21T06:38:28.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.381+0000 7f1a91d70640 1 -- 172.21.15.7:0/126012475 shutdown_connections 2024-09-21T06:38:28.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.381+0000 7f1a91d70640 1 --2- 172.21.15.7:0/126012475 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a8c10c020 0x7f1a8c112850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:28.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.381+0000 7f1a91d70640 1 --2- 172.21.15.7:0/126012475 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a8c10b6d0 0x7f1a8c10bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:28.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.381+0000 7f1a91d70640 1 --2- 172.21.15.7:0/126012475 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a8c105d90 0x7f1a8c1061a0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:28.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.381+0000 7f1a91d70640 1 -- 172.21.15.7:0/126012475 >> 172.21.15.7:0/126012475 conn(0x7f1a8c1017c0 msgr2=0x7f1a8c103c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:28.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.381+0000 7f1a91d70640 1 -- 172.21.15.7:0/126012475 shutdown_connections 2024-09-21T06:38:28.385 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.382+0000 7f1a91d70640 1 -- 172.21.15.7:0/126012475 wait complete. 2024-09-21T06:38:28.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.383+0000 7f1a91d70640 1 Processor -- start 2024-09-21T06:38:28.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.383+0000 7f1a91d70640 1 -- start start 2024-09-21T06:38:28.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.384+0000 7f1a91d70640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a8c105d90 0x7f1a8c19c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:28.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.384+0000 7f1a91d70640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a8c10b6d0 0x7f1a8c19cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:28.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.384+0000 7f1a91d70640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a8c10c020 0x7f1a8c1a1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:28.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.384+0000 7f1a91d70640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1a8c115d70 con 0x7f1a8c105d90 2024-09-21T06:38:28.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.384+0000 7f1a91d70640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1a8c115bf0 con 0x7f1a8c10b6d0 2024-09-21T06:38:28.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.384+0000 7f1a91d70640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1a8c115ef0 con 0x7f1a8c10c020 2024-09-21T06:38:28.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.385+0000 7f1a8b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a8c105d90 0x7f1a8c19c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:28.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.385+0000 7f1a8b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a8c105d90 0x7f1a8c19c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33602/0 (socket says 172.21.15.7:33602) 2024-09-21T06:38:28.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.385+0000 7f1a8b7fe640 1 -- 172.21.15.7:0/37287299 learned_addr learned my addr 172.21.15.7:0/37287299 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:38:28.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.386+0000 7f1a8b7fe640 1 -- 172.21.15.7:0/37287299 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a8c10c020 msgr2=0x7f1a8c1a1f80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T06:38:28.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.386+0000 7f1a8b7fe640 1 --2- 172.21.15.7:0/37287299 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a8c10c020 0x7f1a8c1a1f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:28.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.386+0000 7f1a8b7fe640 1 -- 172.21.15.7:0/37287299 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a8c10b6d0 msgr2=0x7f1a8c19cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:28.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.386+0000 7f1a8b7fe640 1 --2- 172.21.15.7:0/37287299 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a8c10b6d0 0x7f1a8c19cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:28.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.386+0000 7f1a8b7fe640 1 -- 172.21.15.7:0/37287299 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a8c1a26b0 con 0x7f1a8c105d90 2024-09-21T06:38:28.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.386+0000 7f1a8b7fe640 1 --2- 172.21.15.7:0/37287299 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a8c105d90 0x7f1a8c19c740 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c031440 tx=0x7f1a7c003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:28.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.387+0000 7f1a88ff9640 1 -- 172.21.15.7:0/37287299 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a7c03f070 con 0x7f1a8c105d90 2024-09-21T06:38:28.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.387+0000 7f1a88ff9640 1 -- 172.21.15.7:0/37287299 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a7c031d60 con 0x7f1a8c105d90 2024-09-21T06:38:28.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.387+0000 7f1a91d70640 1 -- 172.21.15.7:0/37287299 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a8c1a2940 con 0x7f1a8c105d90 2024-09-21T06:38:28.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.387+0000 7f1a88ff9640 1 -- 172.21.15.7:0/37287299 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a7c035030 con 0x7f1a8c105d90 2024-09-21T06:38:28.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.387+0000 7f1a91d70640 1 -- 172.21.15.7:0/37287299 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a8c1a9100 con 0x7f1a8c105d90 2024-09-21T06:38:28.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.392+0000 7f1a982e4740 1 Processor -- start 2024-09-21T06:38:28.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.392+0000 7f1a982e4740 1 -- start start 2024-09-21T06:38:28.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.392+0000 7f1a982e4740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557443dd1070 0x5574441786a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:28.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.392+0000 7f1a982e4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557443da81b0 0x557444178be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:28.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.392+0000 7f1a982e4740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557443db0390 0x557444179120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:28.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.392+0000 7f1a982e4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5574440eeea0 con 0x557443da81b0 2024-09-21T06:38:28.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.392+0000 7f1a982e4740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5574440de2d0 con 0x557443db0390 2024-09-21T06:38:28.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.392+0000 7f1a982e4740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5574440e20e0 con 0x557443dd1070 2024-09-21T06:38:28.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.393+0000 7f1a88ff9640 1 -- 172.21.15.7:0/37287299 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f1a7c042070 con 0x7f1a8c105d90 2024-09-21T06:38:28.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.393+0000 7f1a8b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557443da81b0 0x557444178be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:28.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.393+0000 7f1a8b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557443da81b0 0x557444178be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33604/0 (socket says 172.21.15.7:33604) 2024-09-21T06:38:28.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.393+0000 7f1a8b7fe640 1 -- 172.21.15.7:0/1439044975 learned_addr learned my addr 172.21.15.7:0/1439044975 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:38:28.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.394+0000 7f1a8b7fe640 1 -- 172.21.15.7:0/1439044975 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557443dd1070 msgr2=0x5574441786a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:28.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.394+0000 7f1a8b7fe640 1 --2- 172.21.15.7:0/1439044975 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557443dd1070 0x5574441786a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:28.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.394+0000 7f1a8b7fe640 1 -- 172.21.15.7:0/1439044975 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557443db0390 msgr2=0x557444179120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:28.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.394+0000 7f1a8b7fe640 1 --2- 172.21.15.7:0/1439044975 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557443db0390 0x557444179120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:28.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.394+0000 7f1a8b7fe640 1 -- 172.21.15.7:0/1439044975 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557443e3c650 con 0x557443da81b0 2024-09-21T06:38:28.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.394+0000 7f1a8b7fe640 1 --2- 172.21.15.7:0/1439044975 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557443da81b0 0x557444178be0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c1059f0 tx=0x7f1a7c110660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32fdf96e340e5d0c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:28.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.395+0000 7f1a88ff9640 1 --2- 172.21.15.7:0/37287299 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f1a740b6700 0x7f1a740b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:28.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.395+0000 7f1a71ffb640 1 -- 172.21.15.7:0/1439044975 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a7c0ca800 con 0x557443da81b0 2024-09-21T06:38:28.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.395+0000 7f1a8bfff640 1 --2- 172.21.15.7:0/37287299 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f1a740b6700 0x7f1a740b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:28.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.395+0000 7f1a88ff9640 1 -- 172.21.15.7:0/37287299 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f1a7c1082c0 con 0x7f1a8c105d90 2024-09-21T06:38:28.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.395+0000 7f1a71ffb640 1 -- 172.21.15.7:0/1439044975 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a7c0ce8b0 con 0x557443da81b0 2024-09-21T06:38:28.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.395+0000 7f1a71ffb640 1 -- 172.21.15.7:0/1439044975 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a7c0cdb00 con 0x557443da81b0 2024-09-21T06:38:28.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.397+0000 7f1a982e4740 1 -- 172.21.15.7:0/1439044975 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557443da81b0 msgr2=0x557444178be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:28.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.397+0000 7f1a982e4740 1 --2- 172.21.15.7:0/1439044975 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557443da81b0 0x557444178be0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c1059f0 tx=0x7f1a7c110660 comp rx=0 tx=0).stop 2024-09-21T06:38:28.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.397+0000 7f1a8bfff640 1 --2- 172.21.15.7:0/37287299 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f1a740b6700 0x7f1a740b8c10 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f1a84005fd0 tx=0x7f1a84009710 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:28.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.397+0000 7f1a982e4740 1 -- 172.21.15.7:0/1439044975 shutdown_connections 2024-09-21T06:38:28.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.397+0000 7f1a982e4740 1 --2- 172.21.15.7:0/1439044975 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557443db0390 0x557444179120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:28.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.397+0000 7f1a982e4740 1 --2- 172.21.15.7:0/1439044975 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557443da81b0 0x557444178be0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:28.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.397+0000 7f1a982e4740 1 --2- 172.21.15.7:0/1439044975 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557443dd1070 0x5574441786a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:28.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.397+0000 7f1a982e4740 1 -- 172.21.15.7:0/1439044975 >> 172.21.15.7:0/1439044975 conn(0x557443dc5460 msgr2=0x557444176590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:28.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.397+0000 7f1a982e4740 1 -- 172.21.15.7:0/1439044975 shutdown_connections 2024-09-21T06:38:28.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.397+0000 7f1a982e4740 1 -- 172.21.15.7:0/1439044975 wait complete. 2024-09-21T06:38:28.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.397+0000 7f1a982e4740 1 -- start start 2024-09-21T06:38:28.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.398+0000 7f1a982e4740 1 Processor -- start 2024-09-21T06:38:28.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.399+0000 7f1a982e4740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557443da81b0 0x557444183d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:28.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.399+0000 7f1a982e4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557443db0390 0x557444184280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:28.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.399+0000 7f1a982e4740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557443dd1070 0x557444184800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:28.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.399+0000 7f1a982e4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x557443f3f700 con 0x557443db0390 2024-09-21T06:38:28.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.399+0000 7f1a982e4740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x557444079160 con 0x557443da81b0 2024-09-21T06:38:28.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.399+0000 7f1a982e4740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x557444186c40 con 0x557443dd1070 2024-09-21T06:38:28.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.399+0000 7f1a8affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557443db0390 0x557444184280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:28.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.399+0000 7f1a982e4740 10 client.0 _ll_register_callbacks cb 0x5574440929e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:38:28.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.399+0000 7f1a8affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557443db0390 0x557444184280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33616/0 (socket says 172.21.15.7:33616) 2024-09-21T06:38:28.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.399+0000 7f1a8affd640 1 -- 172.21.15.7:0/3696254384 learned_addr learned my addr 172.21.15.7:0/3696254384 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:38:28.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.399+0000 7f1a8affd640 1 -- 172.21.15.7:0/3696254384 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557443dd1070 msgr2=0x557444184800 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T06:38:28.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.399+0000 7f1a8affd640 1 --2- 172.21.15.7:0/3696254384 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557443dd1070 0x557444184800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:28.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.399+0000 7f1a8affd640 1 -- 172.21.15.7:0/3696254384 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557443da81b0 msgr2=0x557444183d40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T06:38:28.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.399+0000 7f1a8affd640 1 --2- 172.21.15.7:0/3696254384 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557443da81b0 0x557444183d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:28.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.399+0000 7f1a8affd640 1 -- 172.21.15.7:0/3696254384 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5574440a6c90 con 0x557443db0390 2024-09-21T06:38:28.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.400+0000 7f1a8affd640 1 --2- 172.21.15.7:0/3696254384 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557443db0390 0x557444184280 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f1a80009df0 tx=0x7f1a8000b4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f1a4dbf5364cf98 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:28.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.400+0000 7f1a6affd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:38:28.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.400+0000 7f1a6affd640 1 -- 172.21.15.7:0/3696254384 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a80015020 con 0x557443db0390 2024-09-21T06:38:28.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.400+0000 7f1a6affd640 1 -- 172.21.15.7:0/3696254384 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f1a80011420 con 0x557443db0390 2024-09-21T06:38:28.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.400+0000 7f1a982e4740 1 -- 172.21.15.7:0/3696254384 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a7c0ce8b0 con 0x557443db0390 2024-09-21T06:38:28.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.401+0000 7f1a6affd640 1 -- 172.21.15.7:0/3696254384 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1a80020050 con 0x557443db0390 2024-09-21T06:38:28.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.401+0000 7f1a982e4740 10 client.15924 fetch_fsmap learned FSMap version 25 2024-09-21T06:38:28.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.401+0000 7f1a982e4740 1 -- 172.21.15.7:0/3696254384 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5574441928b0 con 0x557443db0390 2024-09-21T06:38:28.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.404+0000 7f1a6affd640 1 -- 172.21.15.7:0/3696254384 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a80011b10 con 0x557443db0390 2024-09-21T06:38:28.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.406+0000 7f1a6affd640 1 -- 172.21.15.7:0/3696254384 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f1a80019a70 con 0x557443db0390 2024-09-21T06:38:28.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.406+0000 7f1a982e4740 10 client.15924 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:38:28.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.406+0000 7f1a982e4740 10 client.15924 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-21T06:38:28.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.406+0000 7f1a982e4740 20 client.15924 populate_metadata read hostname 'smithi007' 2024-09-21T06:38:28.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.406+0000 7f1a982e4740 1 --2- 172.21.15.7:0/3696254384 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x557443d8f9f0 0x557444195e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:28.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.406+0000 7f1a982e4740 4 client.15924 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:38:28.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.406+0000 7f1a982e4740 1 -- 172.21.15.7:0/3696254384 --> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f1a7c0ce8b0 con 0x557443d8f9f0 2024-09-21T06:38:28.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.407+0000 7f1a8b7fe640 1 --2- 172.21.15.7:0/3696254384 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x557443d8f9f0 0x557444195e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:28.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.408+0000 7f1a6affd640 10 client.15924 ms_handle_connect on v2:172.21.15.18:6836/1539670694 2024-09-21T06:38:28.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.408+0000 7f1a8b7fe640 1 --2- 172.21.15.7:0/3696254384 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x557443d8f9f0 0x557444195e60 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=621b808aeebbb469 server_cookie=7f5d5ec6987f056a in_seq=0 out_seq=0 2024-09-21T06:38:28.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.411+0000 7f1a6affd640 1 -- 172.21.15.7:0/3696254384 <== mds.2 v2:172.21.15.18:6836/1539670694 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f1a7c0ce8b0 con 0x557443d8f9f0 2024-09-21T06:38:28.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.411+0000 7f1a6affd640 10 client.15924 handle_command_reply: tid=0 2024-09-21T06:38:28.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.412+0000 7f1a982e4740 1 client.15924 shutdown 2024-09-21T06:38:28.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.412+0000 7f1a982e4740 1 -- 172.21.15.7:0/3696254384 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557443db0390 msgr2=0x557444184280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:28.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.412+0000 7f1a982e4740 1 --2- 172.21.15.7:0/3696254384 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557443db0390 0x557444184280 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f1a80009df0 tx=0x7f1a8000b4b0 comp rx=0 tx=0).stop 2024-09-21T06:38:28.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.412+0000 7f1a982e4740 1 -- 172.21.15.7:0/3696254384 shutdown_connections 2024-09-21T06:38:28.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.412+0000 7f1a982e4740 1 --2- 172.21.15.7:0/3696254384 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x557443d8f9f0 0x557444195e60 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:28.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.412+0000 7f1a982e4740 1 --2- 172.21.15.7:0/3696254384 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557443dd1070 0x557444184800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:28.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.412+0000 7f1a6affd640 0 client.15924 ms_handle_reset on v2:172.21.15.18:6836/1539670694 2024-09-21T06:38:28.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.412+0000 7f1a982e4740 1 --2- 172.21.15.7:0/3696254384 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557443db0390 0x557444184280 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:28.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.412+0000 7f1a982e4740 1 --2- 172.21.15.7:0/3696254384 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557443da81b0 0x557444183d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:28.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.412+0000 7f1a982e4740 1 -- 172.21.15.7:0/3696254384 >> 172.21.15.7:0/3696254384 conn(0x557443dc5460 msgr2=0x55744417b830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:28.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.413+0000 7f1a982e4740 1 -- 172.21.15.7:0/3696254384 shutdown_connections 2024-09-21T06:38:28.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.413+0000 7f1a982e4740 1 -- 172.21.15.7:0/3696254384 wait complete. 2024-09-21T06:38:28.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.413+0000 7f1a982e4740 20 client.15924 trim_cache size 0 max 16384 2024-09-21T06:38:28.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.441+0000 7f1a982e4740 1 Processor -- start 2024-09-21T06:38:28.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.441+0000 7f1a982e4740 1 -- start start 2024-09-21T06:38:28.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.442+0000 7f1a982e4740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557443d8f9f0 0x557444184200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:28.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.442+0000 7f1a982e4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557443da81b0 0x557444180f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:28.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.442+0000 7f1a982e4740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557443db0390 0x557444181470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:28.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.442+0000 7f1a982e4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1a8c1b4270 con 0x557443da81b0 2024-09-21T06:38:28.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.442+0000 7f1a982e4740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1a8c1b1b40 con 0x557443db0390 2024-09-21T06:38:28.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.442+0000 7f1a982e4740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1a8c1af970 con 0x557443d8f9f0 2024-09-21T06:38:28.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.442+0000 7f1a8affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557443da81b0 0x557444180f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:28.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.442+0000 7f1a8affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557443da81b0 0x557444180f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33630/0 (socket says 172.21.15.7:33630) 2024-09-21T06:38:28.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.442+0000 7f1a8affd640 1 -- 172.21.15.7:0/2488180994 learned_addr learned my addr 172.21.15.7:0/2488180994 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:38:28.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.442+0000 7f1a8bfff640 1 --2- 172.21.15.7:0/2488180994 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557443db0390 0x557444181470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:28.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.443+0000 7f1a8affd640 1 -- 172.21.15.7:0/2488180994 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557443d8f9f0 msgr2=0x557444184200 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T06:38:28.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.443+0000 7f1a8affd640 1 --2- 172.21.15.7:0/2488180994 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557443d8f9f0 0x557444184200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:28.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.443+0000 7f1a8affd640 1 -- 172.21.15.7:0/2488180994 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557443db0390 msgr2=0x557444181470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:28.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.443+0000 7f1a8affd640 1 --2- 172.21.15.7:0/2488180994 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557443db0390 0x557444181470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:28.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.443+0000 7f1a8affd640 1 -- 172.21.15.7:0/2488180994 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557444186480 con 0x557443da81b0 2024-09-21T06:38:28.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.444+0000 7f1a8affd640 1 --2- 172.21.15.7:0/2488180994 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557443da81b0 0x557444180f30 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f1a8000c010 tx=0x7f1a80009150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c09e83984b2c2801 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:28.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.445+0000 7f1a717fa640 1 -- 172.21.15.7:0/2488180994 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a80029070 con 0x557443da81b0 2024-09-21T06:38:28.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.446+0000 7f1a717fa640 1 -- 172.21.15.7:0/2488180994 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a8001c570 con 0x557443da81b0 2024-09-21T06:38:28.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.446+0000 7f1a717fa640 1 -- 172.21.15.7:0/2488180994 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a80015070 con 0x557443da81b0 2024-09-21T06:38:28.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.448+0000 7f1a982e4740 1 -- 172.21.15.7:0/2488180994 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557443da81b0 msgr2=0x557444180f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:28.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.448+0000 7f1a982e4740 1 --2- 172.21.15.7:0/2488180994 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557443da81b0 0x557444180f30 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f1a8000c010 tx=0x7f1a80009150 comp rx=0 tx=0).stop 2024-09-21T06:38:28.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.448+0000 7f1a982e4740 1 -- 172.21.15.7:0/2488180994 shutdown_connections 2024-09-21T06:38:28.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.448+0000 7f1a982e4740 1 --2- 172.21.15.7:0/2488180994 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557443db0390 0x557444181470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:28.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.448+0000 7f1a982e4740 1 --2- 172.21.15.7:0/2488180994 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557443da81b0 0x557444180f30 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:28.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.448+0000 7f1a982e4740 1 --2- 172.21.15.7:0/2488180994 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557443d8f9f0 0x557444184200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:28.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.448+0000 7f1a982e4740 1 -- 172.21.15.7:0/2488180994 >> 172.21.15.7:0/2488180994 conn(0x557443dc5460 msgr2=0x557444183af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:28.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.448+0000 7f1a982e4740 1 -- 172.21.15.7:0/2488180994 shutdown_connections 2024-09-21T06:38:28.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.448+0000 7f1a982e4740 1 -- 172.21.15.7:0/2488180994 wait complete. 2024-09-21T06:38:28.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.449+0000 7f1a982e4740 1 -- start start 2024-09-21T06:38:28.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.449+0000 7f1a982e4740 1 Processor -- start 2024-09-21T06:38:28.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.450+0000 7f1a982e4740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557443d8f9f0 0x557444187f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:28.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.450+0000 7f1a982e4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557443db0390 0x557444188480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:28.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.450+0000 7f1a982e4740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557443dd1070 0x5574441889c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:28.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.450+0000 7f1a982e4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1a8c1b0000 con 0x557443db0390 2024-09-21T06:38:28.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.450+0000 7f1a982e4740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1a8c1b1470 con 0x557443d8f9f0 2024-09-21T06:38:28.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.450+0000 7f1a982e4740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1a8c1b06d0 con 0x557443dd1070 2024-09-21T06:38:28.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.450+0000 7f1a982e4740 10 client.0 _ll_register_callbacks cb 0x7f1a80006ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:38:28.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.450+0000 7f1a8affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557443db0390 0x557444188480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:28.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.450+0000 7f1a8affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557443db0390 0x557444188480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33646/0 (socket says 172.21.15.7:33646) 2024-09-21T06:38:28.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.450+0000 7f1a8affd640 1 -- 172.21.15.7:0/2827910000 learned_addr learned my addr 172.21.15.7:0/2827910000 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:38:28.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.451+0000 7f1a8b7fe640 1 --2- 172.21.15.7:0/2827910000 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557443d8f9f0 0x557444187f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:28.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.451+0000 7f1a8affd640 1 -- 172.21.15.7:0/2827910000 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557443dd1070 msgr2=0x5574441889c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:28.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.451+0000 7f1a8affd640 1 --2- 172.21.15.7:0/2827910000 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557443dd1070 0x5574441889c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:28.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.451+0000 7f1a8affd640 1 -- 172.21.15.7:0/2827910000 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557443d8f9f0 msgr2=0x557444187f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:28.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.451+0000 7f1a8affd640 1 --2- 172.21.15.7:0/2827910000 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557443d8f9f0 0x557444187f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:28.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.451+0000 7f1a8affd640 1 -- 172.21.15.7:0/2827910000 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5574441ff9d0 con 0x557443db0390 2024-09-21T06:38:28.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.451+0000 7f1a8b7fe640 1 --2- 172.21.15.7:0/2827910000 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557443d8f9f0 0x557444187f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:38:28.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.451+0000 7f1a8affd640 1 --2- 172.21.15.7:0/2827910000 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557443db0390 0x557444188480 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f1a8001e040 tx=0x7f1a8001c1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3c58214e8abd332 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:28.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.451+0000 7f1a6affd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:38:28.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.452+0000 7f1a6affd640 1 -- 172.21.15.7:0/2827910000 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a80029030 con 0x557443db0390 2024-09-21T06:38:28.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.452+0000 7f1a6affd640 1 -- 172.21.15.7:0/2827910000 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f1a80019990 con 0x557443db0390 2024-09-21T06:38:28.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.452+0000 7f1a982e4740 1 -- 172.21.15.7:0/2827910000 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a8001c570 con 0x557443db0390 2024-09-21T06:38:28.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.452+0000 7f1a6affd640 1 -- 172.21.15.7:0/2827910000 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1a80034030 con 0x557443db0390 2024-09-21T06:38:28.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.452+0000 7f1a982e4740 10 client.15930 fetch_fsmap learned FSMap version 25 2024-09-21T06:38:28.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.453+0000 7f1a982e4740 1 -- 172.21.15.7:0/2827910000 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557444200c50 con 0x557443db0390 2024-09-21T06:38:28.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.453+0000 7f1a6affd640 1 -- 172.21.15.7:0/2827910000 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a8002b050 con 0x557443db0390 2024-09-21T06:38:28.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.453+0000 7f1a6affd640 1 -- 172.21.15.7:0/2827910000 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f1a8002f480 con 0x557443db0390 2024-09-21T06:38:28.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.453+0000 7f1a982e4740 10 client.15930 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:38:28.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.453+0000 7f1a982e4740 10 client.15930 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-21T06:38:28.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.453+0000 7f1a982e4740 20 client.15930 populate_metadata read hostname 'smithi007' 2024-09-21T06:38:28.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.453+0000 7f1a982e4740 1 --2- 172.21.15.7:0/2827910000 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x557443d64da0 0x5574442032f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:28.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.453+0000 7f1a982e4740 4 client.15930 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:38:28.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.454+0000 7f1a982e4740 1 -- 172.21.15.7:0/2827910000 --> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f1a8001c570 con 0x557443d64da0 2024-09-21T06:38:28.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.455+0000 7f1a8b7fe640 1 --2- 172.21.15.7:0/2827910000 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x557443d64da0 0x5574442032f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:28.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.456+0000 7f1a8b7fe640 1 --2- 172.21.15.7:0/2827910000 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x557443d64da0 0x5574442032f0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f29b1bb500076c4f server_cookie=da98bf7eda28c86d in_seq=0 out_seq=0 2024-09-21T06:38:28.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.456+0000 7f1a6affd640 10 client.15930 ms_handle_connect on v2:172.21.15.18:6836/1539670694 2024-09-21T06:38:28.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.457+0000 7f1a6affd640 1 -- 172.21.15.7:0/2827910000 <== mds.2 v2:172.21.15.18:6836/1539670694 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f1a8001c570 con 0x557443d64da0 2024-09-21T06:38:28.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.457+0000 7f1a6affd640 10 client.15930 handle_command_reply: tid=0 2024-09-21T06:38:28.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.457+0000 7f1a982e4740 1 client.15930 shutdown 2024-09-21T06:38:28.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.457+0000 7f1a982e4740 1 -- 172.21.15.7:0/2827910000 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557443db0390 msgr2=0x557444188480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:28.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.457+0000 7f1a982e4740 1 --2- 172.21.15.7:0/2827910000 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557443db0390 0x557444188480 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f1a8001e040 tx=0x7f1a8001c1a0 comp rx=0 tx=0).stop 2024-09-21T06:38:28.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.457+0000 7f1a982e4740 1 -- 172.21.15.7:0/2827910000 shutdown_connections 2024-09-21T06:38:28.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.457+0000 7f1a982e4740 1 --2- 172.21.15.7:0/2827910000 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x557443d64da0 0x5574442032f0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:28.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.457+0000 7f1a982e4740 1 --2- 172.21.15.7:0/2827910000 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557443dd1070 0x5574441889c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:28.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.457+0000 7f1a982e4740 1 --2- 172.21.15.7:0/2827910000 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557443db0390 0x557444188480 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:28.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.457+0000 7f1a982e4740 1 --2- 172.21.15.7:0/2827910000 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557443d8f9f0 0x557444187f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:28.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.457+0000 7f1a6affd640 0 client.15930 ms_handle_reset on v2:172.21.15.18:6836/1539670694 2024-09-21T06:38:28.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.458+0000 7f1a982e4740 1 -- 172.21.15.7:0/2827910000 >> 172.21.15.7:0/2827910000 conn(0x557443dc5460 msgr2=0x55744417b7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:28.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.458+0000 7f1a982e4740 1 -- 172.21.15.7:0/2827910000 shutdown_connections 2024-09-21T06:38:28.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.458+0000 7f1a982e4740 1 -- 172.21.15.7:0/2827910000 wait complete. 2024-09-21T06:38:28.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.458+0000 7f1a982e4740 20 client.15930 trim_cache size 0 max 16384 2024-09-21T06:38:28.462 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:38:28.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.459+0000 7f1a91d70640 1 -- 172.21.15.7:0/37287299 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f1a740b6700 msgr2=0x7f1a740b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:28.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.459+0000 7f1a91d70640 1 --2- 172.21.15.7:0/37287299 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f1a740b6700 0x7f1a740b8c10 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f1a84005fd0 tx=0x7f1a84009710 comp rx=0 tx=0).stop 2024-09-21T06:38:28.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.459+0000 7f1a91d70640 1 -- 172.21.15.7:0/37287299 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a8c105d90 msgr2=0x7f1a8c19c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:28.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.459+0000 7f1a91d70640 1 --2- 172.21.15.7:0/37287299 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a8c105d90 0x7f1a8c19c740 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c031440 tx=0x7f1a7c003c80 comp rx=0 tx=0).stop 2024-09-21T06:38:28.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.460+0000 7f1a91d70640 1 -- 172.21.15.7:0/37287299 shutdown_connections 2024-09-21T06:38:28.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.460+0000 7f1a91d70640 1 --2- 172.21.15.7:0/37287299 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f1a740b6700 0x7f1a740b8c10 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:28.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.460+0000 7f1a91d70640 1 --2- 172.21.15.7:0/37287299 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a8c10c020 0x7f1a8c1a1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:28.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.460+0000 7f1a91d70640 1 --2- 172.21.15.7:0/37287299 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a8c10b6d0 0x7f1a8c19cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:28.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.460+0000 7f1a91d70640 1 --2- 172.21.15.7:0/37287299 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a8c105d90 0x7f1a8c19c740 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:28.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.460+0000 7f1a91d70640 1 -- 172.21.15.7:0/37287299 >> 172.21.15.7:0/37287299 conn(0x7f1a8c1017c0 msgr2=0x7f1a8c10ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:28.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.460+0000 7f1a91d70640 1 -- 172.21.15.7:0/37287299 shutdown_connections 2024-09-21T06:38:28.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:28.460+0000 7f1a91d70640 1 -- 172.21.15.7:0/37287299 wait complete. 2024-09-21T06:38:29.028 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-09-21T06:38:29.028 INFO:tasks.workunit.client.0.smithi007.stdout: Children see throughput for 1 rewriters = 858701.50 kB/sec 2024-09-21T06:38:29.028 INFO:tasks.workunit.client.0.smithi007.stdout: Parent sees throughput for 1 rewriters = 858687.14 kB/sec 2024-09-21T06:38:29.028 INFO:tasks.workunit.client.0.smithi007.stdout: Min throughput per process = 858701.50 kB/sec 2024-09-21T06:38:29.028 INFO:tasks.workunit.client.0.smithi007.stdout: Max throughput per process = 858701.50 kB/sec 2024-09-21T06:38:29.029 INFO:tasks.workunit.client.0.smithi007.stdout: Avg throughput per process = 858701.50 kB/sec 2024-09-21T06:38:29.029 INFO:tasks.workunit.client.0.smithi007.stdout: Min xfer = 10485760.00 kB 2024-09-21T06:38:29.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:38:28 smithi018 ceph-mon[34477]: pgmap v387: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 730 MiB/s wr, 303 op/s 2024-09-21T06:38:29.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:38:28 smithi144 ceph-mon[34653]: pgmap v387: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 730 MiB/s wr, 303 op/s 2024-09-21T06:38:29.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:38:28 smithi007 ceph-mon[30983]: pgmap v387: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 730 MiB/s wr, 303 op/s 2024-09-21T06:38:31.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:38:30 smithi018 ceph-mon[34477]: pgmap v388: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 736 MiB/s wr, 307 op/s 2024-09-21T06:38:31.248 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:38:30 smithi007 ceph-mon[30983]: pgmap v388: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 736 MiB/s wr, 307 op/s 2024-09-21T06:38:31.284 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:38:31.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:38:30 smithi144 ceph-mon[34653]: pgmap v388: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 736 MiB/s wr, 307 op/s 2024-09-21T06:38:31.550 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:38:32.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.047+0000 7f8805438640 1 -- 172.21.15.7:0/2344772539 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8800108d20 msgr2=0x7f880010f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:32.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.047+0000 7f8805438640 1 --2- 172.21.15.7:0/2344772539 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8800108d20 0x7f880010f550 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f87f0009900 tx=0x7f87f002a410 comp rx=0 tx=0).stop 2024-09-21T06:38:32.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.047+0000 7f8805438640 1 -- 172.21.15.7:0/2344772539 shutdown_connections 2024-09-21T06:38:32.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.047+0000 7f8805438640 1 --2- 172.21.15.7:0/2344772539 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8800108d20 0x7f880010f550 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:32.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.047+0000 7f8805438640 1 --2- 172.21.15.7:0/2344772539 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88001083d0 0x7f88001087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:32.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.047+0000 7f8805438640 1 --2- 172.21.15.7:0/2344772539 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8800102a90 0x7f8800102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:32.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.047+0000 7f8805438640 1 -- 172.21.15.7:0/2344772539 >> 172.21.15.7:0/2344772539 conn(0x7f8800079750 msgr2=0x7f8800079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:32.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.047+0000 7f8805438640 1 -- 172.21.15.7:0/2344772539 shutdown_connections 2024-09-21T06:38:32.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.048+0000 7f8805438640 1 -- 172.21.15.7:0/2344772539 wait complete. 2024-09-21T06:38:32.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.048+0000 7f8805438640 1 Processor -- start 2024-09-21T06:38:32.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.049+0000 7f8805438640 1 -- start start 2024-09-21T06:38:32.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.049+0000 7f8805438640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8800102a90 0x7f88001993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:32.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.049+0000 7f8805438640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88001083d0 0x7f8800199960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:32.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.049+0000 7f8805438640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8800108d20 0x7f880019ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:32.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.049+0000 7f8805438640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8800112990 con 0x7f8800102a90 2024-09-21T06:38:32.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.049+0000 7f8805438640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8800112810 con 0x7f8800108d20 2024-09-21T06:38:32.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.049+0000 7f8805438640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8800112b10 con 0x7f88001083d0 2024-09-21T06:38:32.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.049+0000 7f87feffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8800102a90 0x7f88001993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:32.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.049+0000 7f87feffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8800102a90 0x7f88001993c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51884/0 (socket says 172.21.15.7:51884) 2024-09-21T06:38:32.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.049+0000 7f87feffd640 1 -- 172.21.15.7:0/1107938063 learned_addr learned my addr 172.21.15.7:0/1107938063 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:38:32.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.049+0000 7f87ff7fe640 1 --2- 172.21.15.7:0/1107938063 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8800108d20 0x7f880019ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:32.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.049+0000 7f87fe7fc640 1 --2- 172.21.15.7:0/1107938063 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88001083d0 0x7f8800199960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:32.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.049+0000 7f87feffd640 1 -- 172.21.15.7:0/1107938063 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88001083d0 msgr2=0x7f8800199960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:32.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.049+0000 7f87feffd640 1 --2- 172.21.15.7:0/1107938063 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88001083d0 0x7f8800199960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:32.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.049+0000 7f87feffd640 1 -- 172.21.15.7:0/1107938063 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8800108d20 msgr2=0x7f880019ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:32.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.049+0000 7f87feffd640 1 --2- 172.21.15.7:0/1107938063 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8800108d20 0x7f880019ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:32.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.049+0000 7f87feffd640 1 -- 172.21.15.7:0/1107938063 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f880019f330 con 0x7f8800102a90 2024-09-21T06:38:32.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.050+0000 7f87feffd640 1 --2- 172.21.15.7:0/1107938063 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8800102a90 0x7f88001993c0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f87f800e9f0 tx=0x7f87f800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:32.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.050+0000 7f87e7fff640 1 -- 172.21.15.7:0/1107938063 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87f800cd80 con 0x7f8800102a90 2024-09-21T06:38:32.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.050+0000 7f8805438640 1 -- 172.21.15.7:0/1107938063 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f880019f620 con 0x7f8800102a90 2024-09-21T06:38:32.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.050+0000 7f87e7fff640 1 -- 172.21.15.7:0/1107938063 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f87f80108e0 con 0x7f8800102a90 2024-09-21T06:38:32.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.050+0000 7f87e7fff640 1 -- 172.21.15.7:0/1107938063 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87f8018980 con 0x7f8800102a90 2024-09-21T06:38:32.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.050+0000 7f8805438640 1 -- 172.21.15.7:0/1107938063 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88001a5d80 con 0x7f8800102a90 2024-09-21T06:38:32.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.053+0000 7f880b9ac740 1 Processor -- start 2024-09-21T06:38:32.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.053+0000 7f880b9ac740 1 -- start start 2024-09-21T06:38:32.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.053+0000 7f87e7fff640 1 -- 172.21.15.7:0/1107938063 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f87f8010430 con 0x7f8800102a90 2024-09-21T06:38:32.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.053+0000 7f880b9ac740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a8bef37070 0x55a8bf2de2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:32.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.053+0000 7f880b9ac740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8bef0e1b0 0x55a8bf2de800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:32.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.053+0000 7f880b9ac740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a8bef16390 0x55a8bf2ded40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:32.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.053+0000 7f880b9ac740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55a8bf254ea0 con 0x55a8bef37070 2024-09-21T06:38:32.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.053+0000 7f880b9ac740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a8bf2442d0 con 0x55a8bef0e1b0 2024-09-21T06:38:32.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.053+0000 7f880b9ac740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55a8bf2480e0 con 0x55a8bef16390 2024-09-21T06:38:32.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.053+0000 7f87ff7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a8bef37070 0x55a8bf2de2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:32.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.053+0000 7f87ff7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a8bef37070 0x55a8bf2de2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51888/0 (socket says 172.21.15.7:51888) 2024-09-21T06:38:32.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.053+0000 7f87ff7fe640 1 -- 172.21.15.7:0/3925834595 learned_addr learned my addr 172.21.15.7:0/3925834595 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:38:32.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.053+0000 7f87feffd640 1 --2- 172.21.15.7:0/3925834595 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8bef0e1b0 0x55a8bf2de800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:32.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.053+0000 7f87fe7fc640 1 --2- 172.21.15.7:0/3925834595 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a8bef16390 0x55a8bf2ded40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:32.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.054+0000 7f87ff7fe640 1 -- 172.21.15.7:0/3925834595 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a8bef16390 msgr2=0x55a8bf2ded40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:32.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.054+0000 7f87ff7fe640 1 --2- 172.21.15.7:0/3925834595 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a8bef16390 0x55a8bf2ded40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:32.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.054+0000 7f87ff7fe640 1 -- 172.21.15.7:0/3925834595 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8bef0e1b0 msgr2=0x55a8bf2de800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:32.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.054+0000 7f87ff7fe640 1 --2- 172.21.15.7:0/3925834595 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8bef0e1b0 0x55a8bf2de800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:32.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.054+0000 7f87ff7fe640 1 -- 172.21.15.7:0/3925834595 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8befa2650 con 0x55a8bef37070 2024-09-21T06:38:32.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.054+0000 7f87e7fff640 1 --2- 172.21.15.7:0/1107938063 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f87e80b6680 0x7f87e80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:32.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.054+0000 7f87ff7fe640 1 --2- 172.21.15.7:0/3925834595 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a8bef37070 0x55a8bf2de2c0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f87f0009900 tx=0x7f87f0032bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c957d9a827d1f9a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:32.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.054+0000 7f87feffd640 1 --2- 172.21.15.7:0/1107938063 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f87e80b6680 0x7f87e80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:32.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.054+0000 7f87e57fa640 1 -- 172.21.15.7:0/3925834595 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87f003f070 con 0x55a8bef37070 2024-09-21T06:38:32.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.054+0000 7f87e57fa640 1 -- 172.21.15.7:0/3925834595 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f87f0004030 con 0x55a8bef37070 2024-09-21T06:38:32.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.054+0000 7f87e57fa640 1 -- 172.21.15.7:0/3925834595 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87f0035070 con 0x55a8bef37070 2024-09-21T06:38:32.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.054+0000 7f87e7fff640 1 -- 172.21.15.7:0/1107938063 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f87f80e7b10 con 0x7f8800102a90 2024-09-21T06:38:32.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.055+0000 7f880b9ac740 1 -- 172.21.15.7:0/3925834595 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a8bef37070 msgr2=0x55a8bf2de2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:32.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.055+0000 7f87feffd640 1 --2- 172.21.15.7:0/1107938063 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f87e80b6680 0x7f87e80b8b90 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x55a8bf2dcf40 tx=0x7f87f80eb600 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:32.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.055+0000 7f880b9ac740 1 --2- 172.21.15.7:0/3925834595 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a8bef37070 0x55a8bf2de2c0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f87f0009900 tx=0x7f87f0032bb0 comp rx=0 tx=0).stop 2024-09-21T06:38:32.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.055+0000 7f880b9ac740 1 -- 172.21.15.7:0/3925834595 shutdown_connections 2024-09-21T06:38:32.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.055+0000 7f880b9ac740 1 --2- 172.21.15.7:0/3925834595 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a8bef16390 0x55a8bf2ded40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:32.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.055+0000 7f880b9ac740 1 --2- 172.21.15.7:0/3925834595 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8bef0e1b0 0x55a8bf2de800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:32.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.055+0000 7f880b9ac740 1 --2- 172.21.15.7:0/3925834595 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a8bef37070 0x55a8bf2de2c0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:32.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.055+0000 7f880b9ac740 1 -- 172.21.15.7:0/3925834595 >> 172.21.15.7:0/3925834595 conn(0x55a8bef2b460 msgr2=0x55a8bf2dc1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:32.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.055+0000 7f880b9ac740 1 -- 172.21.15.7:0/3925834595 shutdown_connections 2024-09-21T06:38:32.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.055+0000 7f880b9ac740 1 -- 172.21.15.7:0/3925834595 wait complete. 2024-09-21T06:38:32.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.056+0000 7f880b9ac740 1 -- start start 2024-09-21T06:38:32.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.056+0000 7f880b9ac740 1 Processor -- start 2024-09-21T06:38:32.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.056+0000 7f880b9ac740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8bef0e1b0 0x55a8bf2ebb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:32.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.056+0000 7f880b9ac740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a8bef16390 0x55a8bf2ec080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:32.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.056+0000 7f880b9ac740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a8bef37070 0x55a8bf2ec600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:32.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.056+0000 7f880b9ac740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55a8bf0a5700 con 0x55a8bef16390 2024-09-21T06:38:32.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.056+0000 7f880b9ac740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a8bf1df160 con 0x55a8bef0e1b0 2024-09-21T06:38:32.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.056+0000 7f880b9ac740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55a8bf2eeba0 con 0x55a8bef37070 2024-09-21T06:38:32.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.056+0000 7f880b9ac740 10 client.0 _ll_register_callbacks cb 0x55a8bf1f89e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:38:32.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.056+0000 7f87fe7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a8bef16390 0x55a8bf2ec080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:32.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.056+0000 7f87fe7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a8bef16390 0x55a8bf2ec080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51894/0 (socket says 172.21.15.7:51894) 2024-09-21T06:38:32.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.056+0000 7f87fe7fc640 1 -- 172.21.15.7:0/3806558253 learned_addr learned my addr 172.21.15.7:0/3806558253 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:38:32.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.056+0000 7f87ff7fe640 1 --2- 172.21.15.7:0/3806558253 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a8bef37070 0x55a8bf2ec600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:32.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.057+0000 7f87ff7fe640 1 --2- 172.21.15.7:0/3806558253 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8bef0e1b0 0x55a8bf2ebb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:32.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.057+0000 7f87fe7fc640 1 -- 172.21.15.7:0/3806558253 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a8bef37070 msgr2=0x55a8bf2ec600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:32.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.057+0000 7f87fe7fc640 1 --2- 172.21.15.7:0/3806558253 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a8bef37070 0x55a8bf2ec600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:32.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.057+0000 7f87fe7fc640 1 -- 172.21.15.7:0/3806558253 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8bef0e1b0 msgr2=0x55a8bf2ebb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:32.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.057+0000 7f87fe7fc640 1 --2- 172.21.15.7:0/3806558253 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8bef0e1b0 0x55a8bf2ebb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:32.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.057+0000 7f87fe7fc640 1 -- 172.21.15.7:0/3806558253 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8bf20cc90 con 0x55a8bef16390 2024-09-21T06:38:32.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.057+0000 7f87fe7fc640 1 --2- 172.21.15.7:0/3806558253 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a8bef16390 0x55a8bf2ec080 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f87f4003f30 tx=0x7f87f40044d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63c5dd3c176955ee server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:32.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.057+0000 7f87e2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:38:32.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.057+0000 7f87e2ff5640 1 -- 172.21.15.7:0/3806558253 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87f4012a60 con 0x55a8bef16390 2024-09-21T06:38:32.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.057+0000 7f87e2ff5640 1 -- 172.21.15.7:0/3806558253 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f87f4012c00 con 0x55a8bef16390 2024-09-21T06:38:32.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.057+0000 7f880b9ac740 1 -- 172.21.15.7:0/3806558253 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f87f0004030 con 0x55a8bef16390 2024-09-21T06:38:32.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.057+0000 7f87e2ff5640 1 -- 172.21.15.7:0/3806558253 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f87f4012e40 con 0x55a8bef16390 2024-09-21T06:38:32.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.057+0000 7f880b9ac740 10 client.15942 fetch_fsmap learned FSMap version 25 2024-09-21T06:38:32.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.057+0000 7f880b9ac740 1 -- 172.21.15.7:0/3806558253 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a8bf2fa910 con 0x55a8bef16390 2024-09-21T06:38:32.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.057+0000 7f87e2ff5640 1 -- 172.21.15.7:0/3806558253 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f87f0004030 con 0x55a8bef16390 2024-09-21T06:38:32.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.058+0000 7f87e2ff5640 1 -- 172.21.15.7:0/3806558253 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f87f4019070 con 0x55a8bef16390 2024-09-21T06:38:32.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.058+0000 7f880b9ac740 10 client.15942 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:38:32.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.058+0000 7f880b9ac740 10 client.15942 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:38:32.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.058+0000 7f880b9ac740 20 client.15942 populate_metadata read hostname 'smithi007' 2024-09-21T06:38:32.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.058+0000 7f880b9ac740 1 --2- 172.21.15.7:0/3806558253 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x55a8beef59f0 0x55a8bf2fdea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:32.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.058+0000 7f880b9ac740 4 client.15942 mds_command: new command op to 24688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:38:32.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.058+0000 7f880b9ac740 1 -- 172.21.15.7:0/3806558253 --> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a8bf256df0 con 0x55a8beef59f0 2024-09-21T06:38:32.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.058+0000 7f87ff7fe640 1 --2- 172.21.15.7:0/3806558253 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x55a8beef59f0 0x55a8bf2fdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:32.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.058+0000 7f87e2ff5640 10 client.15942 ms_handle_connect on v2:172.21.15.144:6838/4027821922 2024-09-21T06:38:32.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.058+0000 7f87ff7fe640 1 --2- 172.21.15.7:0/3806558253 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x55a8beef59f0 0x55a8bf2fdea0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d30b8086e41ba4fe server_cookie=3e3360bc455b2f17 in_seq=0 out_seq=0 2024-09-21T06:38:32.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.059+0000 7f87e2ff5640 1 -- 172.21.15.7:0/3806558253 <== mds.1 v2:172.21.15.144:6838/4027821922 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a8bf256df0 con 0x55a8beef59f0 2024-09-21T06:38:32.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.059+0000 7f87e2ff5640 10 client.15942 handle_command_reply: tid=0 2024-09-21T06:38:32.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.059+0000 7f880b9ac740 1 client.15942 shutdown 2024-09-21T06:38:32.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.059+0000 7f880b9ac740 1 -- 172.21.15.7:0/3806558253 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a8bef16390 msgr2=0x55a8bf2ec080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:32.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.059+0000 7f880b9ac740 1 --2- 172.21.15.7:0/3806558253 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a8bef16390 0x55a8bf2ec080 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f87f4003f30 tx=0x7f87f40044d0 comp rx=0 tx=0).stop 2024-09-21T06:38:32.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.059+0000 7f880b9ac740 1 -- 172.21.15.7:0/3806558253 shutdown_connections 2024-09-21T06:38:32.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.059+0000 7f880b9ac740 1 --2- 172.21.15.7:0/3806558253 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x55a8beef59f0 0x55a8bf2fdea0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:32.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.059+0000 7f880b9ac740 1 --2- 172.21.15.7:0/3806558253 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a8bef37070 0x55a8bf2ec600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:32.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.059+0000 7f880b9ac740 1 --2- 172.21.15.7:0/3806558253 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a8bef16390 0x55a8bf2ec080 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:32.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.059+0000 7f87e2ff5640 0 client.15942 ms_handle_reset on v2:172.21.15.144:6838/4027821922 2024-09-21T06:38:32.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.059+0000 7f880b9ac740 1 --2- 172.21.15.7:0/3806558253 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8bef0e1b0 0x55a8bf2ebb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:32.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.059+0000 7f880b9ac740 1 -- 172.21.15.7:0/3806558253 >> 172.21.15.7:0/3806558253 conn(0x55a8bef2b460 msgr2=0x55a8bf2da750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:32.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.060+0000 7f880b9ac740 1 -- 172.21.15.7:0/3806558253 shutdown_connections 2024-09-21T06:38:32.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.060+0000 7f880b9ac740 1 -- 172.21.15.7:0/3806558253 wait complete. 2024-09-21T06:38:32.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.060+0000 7f880b9ac740 20 client.15942 trim_cache size 0 max 16384 2024-09-21T06:38:32.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.073+0000 7f880b9ac740 1 Processor -- start 2024-09-21T06:38:32.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.073+0000 7f880b9ac740 1 -- start start 2024-09-21T06:38:32.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.073+0000 7f880b9ac740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8beef59f0 0x55a8bf2edb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:32.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.073+0000 7f880b9ac740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a8bef0e1b0 0x55a8bf2dc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:32.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.073+0000 7f880b9ac740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a8bef16390 0x55a8bf2ead70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:32.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.073+0000 7f880b9ac740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f88001afbf0 con 0x55a8bef16390 2024-09-21T06:38:32.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.073+0000 7f880b9ac740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f88001ad4c0 con 0x55a8beef59f0 2024-09-21T06:38:32.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.073+0000 7f880b9ac740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f88001ab2f0 con 0x55a8bef0e1b0 2024-09-21T06:38:32.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.073+0000 7f87ff7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a8bef16390 0x55a8bf2ead70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:32.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.073+0000 7f87ff7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a8bef16390 0x55a8bf2ead70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51900/0 (socket says 172.21.15.7:51900) 2024-09-21T06:38:32.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.073+0000 7f87ff7fe640 1 -- 172.21.15.7:0/4129590773 learned_addr learned my addr 172.21.15.7:0/4129590773 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:38:32.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.073+0000 7f87ff7fe640 1 --2- 172.21.15.7:0/4129590773 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8beef59f0 0x55a8bf2edb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:32.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.074+0000 7f87fe7fc640 1 --2- 172.21.15.7:0/4129590773 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a8bef0e1b0 0x55a8bf2dc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:32.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.074+0000 7f87ff7fe640 1 -- 172.21.15.7:0/4129590773 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a8bef0e1b0 msgr2=0x55a8bf2dc1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:32.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.074+0000 7f87ff7fe640 1 --2- 172.21.15.7:0/4129590773 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a8bef0e1b0 0x55a8bf2dc1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:32.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.074+0000 7f87ff7fe640 1 -- 172.21.15.7:0/4129590773 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8beef59f0 msgr2=0x55a8bf2edb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:32.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.074+0000 7f87ff7fe640 1 --2- 172.21.15.7:0/4129590773 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8beef59f0 0x55a8bf2edb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:32.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.074+0000 7f87ff7fe640 1 -- 172.21.15.7:0/4129590773 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8bf2dc6e0 con 0x55a8bef16390 2024-09-21T06:38:32.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.074+0000 7f87ff7fe640 1 --2- 172.21.15.7:0/4129590773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a8bef16390 0x55a8bf2ead70 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f87f0000c00 tx=0x7f87f0005a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adf176bcd791c93f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:32.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.074+0000 7f87e4ff9640 1 -- 172.21.15.7:0/4129590773 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87f003f040 con 0x55a8bef16390 2024-09-21T06:38:32.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.074+0000 7f87e4ff9640 1 -- 172.21.15.7:0/4129590773 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f87f0005460 con 0x55a8bef16390 2024-09-21T06:38:32.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.074+0000 7f87e4ff9640 1 -- 172.21.15.7:0/4129590773 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87f0035040 con 0x55a8bef16390 2024-09-21T06:38:32.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.075+0000 7f880b9ac740 1 -- 172.21.15.7:0/4129590773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a8bef16390 msgr2=0x55a8bf2ead70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:32.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.075+0000 7f880b9ac740 1 --2- 172.21.15.7:0/4129590773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a8bef16390 0x55a8bf2ead70 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f87f0000c00 tx=0x7f87f0005a40 comp rx=0 tx=0).stop 2024-09-21T06:38:32.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.075+0000 7f880b9ac740 1 -- 172.21.15.7:0/4129590773 shutdown_connections 2024-09-21T06:38:32.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.075+0000 7f880b9ac740 1 --2- 172.21.15.7:0/4129590773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a8bef16390 0x55a8bf2ead70 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:32.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.075+0000 7f880b9ac740 1 --2- 172.21.15.7:0/4129590773 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a8bef0e1b0 0x55a8bf2dc1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:32.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.075+0000 7f880b9ac740 1 --2- 172.21.15.7:0/4129590773 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8beef59f0 0x55a8bf2edb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:32.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.075+0000 7f880b9ac740 1 -- 172.21.15.7:0/4129590773 >> 172.21.15.7:0/4129590773 conn(0x55a8bef2b460 msgr2=0x55a8bf2dfcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:32.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.075+0000 7f880b9ac740 1 -- 172.21.15.7:0/4129590773 shutdown_connections 2024-09-21T06:38:32.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.075+0000 7f880b9ac740 1 -- 172.21.15.7:0/4129590773 wait complete. 2024-09-21T06:38:32.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.075+0000 7f880b9ac740 1 -- start start 2024-09-21T06:38:32.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.075+0000 7f880b9ac740 1 Processor -- start 2024-09-21T06:38:32.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.076+0000 7f880b9ac740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a8beef59f0 0x55a8bf2f44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:32.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.076+0000 7f880b9ac740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a8bef0e1b0 0x55a8bf2e87f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:32.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.076+0000 7f880b9ac740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8bef16390 0x55a8bf2e8d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:32.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.076+0000 7f880b9ac740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f88001ab980 con 0x55a8bef0e1b0 2024-09-21T06:38:32.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.076+0000 7f880b9ac740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f88001acdf0 con 0x55a8bef16390 2024-09-21T06:38:32.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.076+0000 7f880b9ac740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f88001ac050 con 0x55a8beef59f0 2024-09-21T06:38:32.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.076+0000 7f880b9ac740 10 client.0 _ll_register_callbacks cb 0x7f87f4009aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:38:32.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.076+0000 7f87fe7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a8bef0e1b0 0x55a8bf2e87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:32.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.076+0000 7f87fe7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a8bef0e1b0 0x55a8bf2e87f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51910/0 (socket says 172.21.15.7:51910) 2024-09-21T06:38:32.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.076+0000 7f87fe7fc640 1 -- 172.21.15.7:0/2694324861 learned_addr learned my addr 172.21.15.7:0/2694324861 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:38:32.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.076+0000 7f87ff7fe640 1 --2- 172.21.15.7:0/2694324861 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a8beef59f0 0x55a8bf2f44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:32.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.076+0000 7f87ff7fe640 1 --2- 172.21.15.7:0/2694324861 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8bef16390 0x55a8bf2e8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:32.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.076+0000 7f87fe7fc640 1 -- 172.21.15.7:0/2694324861 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a8beef59f0 msgr2=0x55a8bf2f44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:32.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.076+0000 7f87fe7fc640 1 --2- 172.21.15.7:0/2694324861 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a8beef59f0 0x55a8bf2f44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:32.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.076+0000 7f87fe7fc640 1 -- 172.21.15.7:0/2694324861 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8bef16390 msgr2=0x55a8bf2e8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:32.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.076+0000 7f87fe7fc640 1 --2- 172.21.15.7:0/2694324861 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8bef16390 0x55a8bf2e8d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:32.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.076+0000 7f87fe7fc640 1 -- 172.21.15.7:0/2694324861 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8bf2e9340 con 0x55a8bef0e1b0 2024-09-21T06:38:32.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.076+0000 7f87ff7fe640 1 --2- 172.21.15.7:0/2694324861 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a8beef59f0 0x55a8bf2f44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:38:32.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.076+0000 7f87fe7fc640 1 --2- 172.21.15.7:0/2694324861 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a8bef0e1b0 0x55a8bf2e87f0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f87f401b920 tx=0x7f87f4005d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4bb208c9fc1e38 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:32.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.076+0000 7f87e2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:38:32.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.077+0000 7f87e2ff5640 1 -- 172.21.15.7:0/2694324861 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87f4012250 con 0x55a8bef0e1b0 2024-09-21T06:38:32.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.077+0000 7f87e2ff5640 1 -- 172.21.15.7:0/2694324861 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f87f4012860 con 0x55a8bef0e1b0 2024-09-21T06:38:32.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.077+0000 7f880b9ac740 1 -- 172.21.15.7:0/2694324861 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f87f0005460 con 0x55a8bef0e1b0 2024-09-21T06:38:32.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.077+0000 7f87e2ff5640 1 -- 172.21.15.7:0/2694324861 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f87f4034030 con 0x55a8bef0e1b0 2024-09-21T06:38:32.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.077+0000 7f880b9ac740 10 client.15948 fetch_fsmap learned FSMap version 25 2024-09-21T06:38:32.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.077+0000 7f880b9ac740 1 -- 172.21.15.7:0/2694324861 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a8bf368630 con 0x55a8bef0e1b0 2024-09-21T06:38:32.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.077+0000 7f87e2ff5640 1 -- 172.21.15.7:0/2694324861 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f87f0005460 con 0x55a8bef0e1b0 2024-09-21T06:38:32.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.077+0000 7f87e2ff5640 1 -- 172.21.15.7:0/2694324861 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f87f4019040 con 0x55a8bef0e1b0 2024-09-21T06:38:32.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.077+0000 7f880b9ac740 10 client.15948 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:38:32.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.077+0000 7f880b9ac740 10 client.15948 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:38:32.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.077+0000 7f880b9ac740 20 client.15948 populate_metadata read hostname 'smithi007' 2024-09-21T06:38:32.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.077+0000 7f880b9ac740 1 --2- 172.21.15.7:0/2694324861 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x55a8bef37070 0x55a8bf36adc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:32.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.077+0000 7f880b9ac740 4 client.15948 mds_command: new command op to 24688 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:38:32.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.077+0000 7f880b9ac740 1 -- 172.21.15.7:0/2694324861 --> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a8bf2528a0 con 0x55a8bef37070 2024-09-21T06:38:32.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.078+0000 7f87ff7fe640 1 --2- 172.21.15.7:0/2694324861 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x55a8bef37070 0x55a8bf36adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:32.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.078+0000 7f87e2ff5640 10 client.15948 ms_handle_connect on v2:172.21.15.144:6838/4027821922 2024-09-21T06:38:32.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.078+0000 7f87ff7fe640 1 --2- 172.21.15.7:0/2694324861 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x55a8bef37070 0x55a8bf36adc0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b4dd08c06361cfdb server_cookie=e5029c9b88e8947e in_seq=0 out_seq=0 2024-09-21T06:38:32.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.078+0000 7f87e2ff5640 1 -- 172.21.15.7:0/2694324861 <== mds.1 v2:172.21.15.144:6838/4027821922 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a8bf2528a0 con 0x55a8bef37070 2024-09-21T06:38:32.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.078+0000 7f87e2ff5640 10 client.15948 handle_command_reply: tid=0 2024-09-21T06:38:32.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.078+0000 7f880b9ac740 1 client.15948 shutdown 2024-09-21T06:38:32.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.079+0000 7f880b9ac740 1 -- 172.21.15.7:0/2694324861 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a8bef0e1b0 msgr2=0x55a8bf2e87f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:32.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.079+0000 7f880b9ac740 1 --2- 172.21.15.7:0/2694324861 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a8bef0e1b0 0x55a8bf2e87f0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f87f401b920 tx=0x7f87f4005d30 comp rx=0 tx=0).stop 2024-09-21T06:38:32.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.079+0000 7f880b9ac740 1 -- 172.21.15.7:0/2694324861 shutdown_connections 2024-09-21T06:38:32.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.079+0000 7f880b9ac740 1 --2- 172.21.15.7:0/2694324861 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x55a8bef37070 0x55a8bf36adc0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:32.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.079+0000 7f880b9ac740 1 --2- 172.21.15.7:0/2694324861 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a8bef16390 0x55a8bf2e8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:32.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.079+0000 7f880b9ac740 1 --2- 172.21.15.7:0/2694324861 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a8bef0e1b0 0x55a8bf2e87f0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:32.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.079+0000 7f880b9ac740 1 --2- 172.21.15.7:0/2694324861 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a8beef59f0 0x55a8bf2f44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:32.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.079+0000 7f880b9ac740 1 -- 172.21.15.7:0/2694324861 >> 172.21.15.7:0/2694324861 conn(0x55a8bef2b460 msgr2=0x55a8bf2ec2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:32.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.079+0000 7f87e2ff5640 0 client.15948 ms_handle_reset on v2:172.21.15.144:6838/4027821922 2024-09-21T06:38:32.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.079+0000 7f880b9ac740 1 -- 172.21.15.7:0/2694324861 shutdown_connections 2024-09-21T06:38:32.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.079+0000 7f880b9ac740 1 -- 172.21.15.7:0/2694324861 wait complete. 2024-09-21T06:38:32.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.079+0000 7f880b9ac740 20 client.15948 trim_cache size 0 max 16384 2024-09-21T06:38:32.086 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:38:32.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.079+0000 7f8805438640 1 -- 172.21.15.7:0/1107938063 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f87e80b6680 msgr2=0x7f87e80b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:32.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.079+0000 7f8805438640 1 --2- 172.21.15.7:0/1107938063 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f87e80b6680 0x7f87e80b8b90 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x55a8bf2dcf40 tx=0x7f87f80eb600 comp rx=0 tx=0).stop 2024-09-21T06:38:32.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.079+0000 7f8805438640 1 -- 172.21.15.7:0/1107938063 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8800102a90 msgr2=0x7f88001993c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:32.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.079+0000 7f8805438640 1 --2- 172.21.15.7:0/1107938063 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8800102a90 0x7f88001993c0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f87f800e9f0 tx=0x7f87f800eeb0 comp rx=0 tx=0).stop 2024-09-21T06:38:32.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.079+0000 7f8805438640 1 -- 172.21.15.7:0/1107938063 shutdown_connections 2024-09-21T06:38:32.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.079+0000 7f8805438640 1 --2- 172.21.15.7:0/1107938063 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f87e80b6680 0x7f87e80b8b90 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:32.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.079+0000 7f8805438640 1 --2- 172.21.15.7:0/1107938063 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8800108d20 0x7f880019ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:32.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.079+0000 7f8805438640 1 --2- 172.21.15.7:0/1107938063 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f88001083d0 0x7f8800199960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:32.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.079+0000 7f8805438640 1 --2- 172.21.15.7:0/1107938063 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8800102a90 0x7f88001993c0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:32.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.079+0000 7f8805438640 1 -- 172.21.15.7:0/1107938063 >> 172.21.15.7:0/1107938063 conn(0x7f8800079750 msgr2=0x7f88001044a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:32.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.080+0000 7f8805438640 1 -- 172.21.15.7:0/1107938063 shutdown_connections 2024-09-21T06:38:32.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:32.080+0000 7f8805438640 1 -- 172.21.15.7:0/1107938063 wait complete. 2024-09-21T06:38:32.496 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.494+0000 7fb1a60c5640 1 -- 172.21.15.7:0/1273868397 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1a0108c40 msgr2=0x7fb1a010f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:32.496 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.494+0000 7fb1a60c5640 1 --2- 172.21.15.7:0/1273868397 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1a0108c40 0x7fb1a010f470 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fb198009ca0 tx=0x7fb19802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:38:32.496 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.494+0000 7fb1a60c5640 1 -- 172.21.15.7:0/1273868397 shutdown_connections 2024-09-21T06:38:32.496 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.494+0000 7fb1a60c5640 1 --2- 172.21.15.7:0/1273868397 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1a0108c40 0x7fb1a010f470 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:32.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.494+0000 7fb1a60c5640 1 --2- 172.21.15.7:0/1273868397 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb1a01082f0 0x7fb1a0108700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:32.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.494+0000 7fb1a60c5640 1 --2- 172.21.15.7:0/1273868397 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1a01029c0 0x7fb1a0102dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:32.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.494+0000 7fb1a60c5640 1 -- 172.21.15.7:0/1273868397 >> 172.21.15.7:0/1273868397 conn(0x7fb1a00fe3c0 msgr2=0x7fb1a0100810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:32.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.494+0000 7fb1a60c5640 1 -- 172.21.15.7:0/1273868397 shutdown_connections 2024-09-21T06:38:32.497 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.494+0000 7fb1a60c5640 1 -- 172.21.15.7:0/1273868397 wait complete. 2024-09-21T06:38:32.499 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.495+0000 7fb1a60c5640 1 Processor -- start 2024-09-21T06:38:32.499 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.495+0000 7fb1a60c5640 1 -- start start 2024-09-21T06:38:32.499 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.495+0000 7fb1a60c5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb1a01029c0 0x7fb1a019a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:32.499 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.495+0000 7fb1a60c5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1a01082f0 0x7fb1a019a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:32.499 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.495+0000 7fb1a60c5640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1a0108c40 0x7fb1a019fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:32.499 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.495+0000 7fb1a60c5640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb1a0112900 con 0x7fb1a01082f0 2024-09-21T06:38:32.499 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.495+0000 7fb1a60c5640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb1a0112780 con 0x7fb1a01029c0 2024-09-21T06:38:32.500 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.495+0000 7fb1a60c5640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb1a0112a80 con 0x7fb1a0108c40 2024-09-21T06:38:32.500 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.496+0000 7fb19effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1a01082f0 0x7fb1a019a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:32.500 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.496+0000 7fb19effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1a01082f0 0x7fb1a019a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51924/0 (socket says 172.21.15.7:51924) 2024-09-21T06:38:32.500 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.496+0000 7fb19effd640 1 -- 172.21.15.7:0/510235577 learned_addr learned my addr 172.21.15.7:0/510235577 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:38:32.500 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.496+0000 7fb19ffff640 1 --2- 172.21.15.7:0/510235577 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1a0108c40 0x7fb1a019fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:32.500 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.496+0000 7fb19f7fe640 1 --2- 172.21.15.7:0/510235577 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb1a01029c0 0x7fb1a019a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:32.500 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.496+0000 7fb19effd640 1 -- 172.21.15.7:0/510235577 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1a0108c40 msgr2=0x7fb1a019fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:32.500 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.496+0000 7fb19effd640 1 --2- 172.21.15.7:0/510235577 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1a0108c40 0x7fb1a019fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:32.500 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.496+0000 7fb19effd640 1 -- 172.21.15.7:0/510235577 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb1a01029c0 msgr2=0x7fb1a019a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:32.500 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.496+0000 7fb19effd640 1 --2- 172.21.15.7:0/510235577 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb1a01029c0 0x7fb1a019a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:32.500 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.496+0000 7fb19effd640 1 -- 172.21.15.7:0/510235577 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1a01a0340 con 0x7fb1a01082f0 2024-09-21T06:38:32.500 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.496+0000 7fb19effd640 1 --2- 172.21.15.7:0/510235577 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1a01082f0 0x7fb1a019a9b0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fb19000d740 tx=0x7fb19000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:32.500 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.496+0000 7fb19cff9640 1 -- 172.21.15.7:0/510235577 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb190017070 con 0x7fb1a01082f0 2024-09-21T06:38:32.501 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.496+0000 7fb19cff9640 1 -- 172.21.15.7:0/510235577 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb19000de50 con 0x7fb1a01082f0 2024-09-21T06:38:32.501 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.496+0000 7fb1a60c5640 1 -- 172.21.15.7:0/510235577 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1a01a0630 con 0x7fb1a01082f0 2024-09-21T06:38:32.501 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.496+0000 7fb19cff9640 1 -- 172.21.15.7:0/510235577 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb19000f620 con 0x7fb1a01082f0 2024-09-21T06:38:32.501 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.496+0000 7fb1a60c5640 1 -- 172.21.15.7:0/510235577 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1a01a6dc0 con 0x7fb1a01082f0 2024-09-21T06:38:32.503 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.499+0000 7fb1ad035740 1 Processor -- start 2024-09-21T06:38:32.503 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.499+0000 7fb1ad035740 1 -- start start 2024-09-21T06:38:32.503 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.500+0000 7fb1ad035740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555c052ed1b0 0x555c056929b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:32.503 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.500+0000 7fb1ad035740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c052c42f0 0x555c05692ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:32.503 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.500+0000 7fb1ad035740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c052cc4d0 0x555c05693430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:32.503 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.500+0000 7fb1ad035740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x555c056076f0 con 0x555c052c42f0 2024-09-21T06:38:32.503 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.500+0000 7fb1ad035740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x555c055f6b20 con 0x555c052cc4d0 2024-09-21T06:38:32.503 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.500+0000 7fb1ad035740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x555c055fa930 con 0x555c052ed1b0 2024-09-21T06:38:32.503 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.500+0000 7fb19cff9640 1 -- 172.21.15.7:0/510235577 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7fb19001a070 con 0x7fb1a01082f0 2024-09-21T06:38:32.503 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.500+0000 7fb19f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c052c42f0 0x555c05692ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:32.504 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.500+0000 7fb19f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c052c42f0 0x555c05692ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51928/0 (socket says 172.21.15.7:51928) 2024-09-21T06:38:32.504 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.500+0000 7fb19f7fe640 1 -- 172.21.15.7:0/2289545259 learned_addr learned my addr 172.21.15.7:0/2289545259 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:38:32.504 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.500+0000 7fb19effd640 1 --2- 172.21.15.7:0/2289545259 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c052cc4d0 0x555c05693430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:32.504 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.500+0000 7fb19ffff640 1 --2- 172.21.15.7:0/2289545259 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555c052ed1b0 0x555c056929b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:32.504 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.500+0000 7fb19f7fe640 1 -- 172.21.15.7:0/2289545259 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555c052ed1b0 msgr2=0x555c056929b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:32.504 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.500+0000 7fb19f7fe640 1 --2- 172.21.15.7:0/2289545259 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555c052ed1b0 0x555c056929b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:32.504 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.500+0000 7fb19f7fe640 1 -- 172.21.15.7:0/2289545259 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c052cc4d0 msgr2=0x555c05693430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:32.504 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.500+0000 7fb19f7fe640 1 --2- 172.21.15.7:0/2289545259 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c052cc4d0 0x555c05693430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:32.504 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.500+0000 7fb19f7fe640 1 -- 172.21.15.7:0/2289545259 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c055bc530 con 0x555c052c42f0 2024-09-21T06:38:32.504 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.501+0000 7fb19f7fe640 1 --2- 172.21.15.7:0/2289545259 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c052c42f0 0x555c05692ef0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fb188009c90 tx=0x7fb1880117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a047681adefd874 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:32.504 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.501+0000 7fb19cff9640 1 --2- 172.21.15.7:0/510235577 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fb18c0b6680 0x7fb18c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:32.504 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.501+0000 7fb195ffb640 1 -- 172.21.15.7:0/2289545259 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb188012450 con 0x555c052c42f0 2024-09-21T06:38:32.504 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.501+0000 7fb195ffb640 1 -- 172.21.15.7:0/2289545259 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb188012aa0 con 0x555c052c42f0 2024-09-21T06:38:32.504 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.501+0000 7fb195ffb640 1 -- 172.21.15.7:0/2289545259 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb18800fb50 con 0x555c052c42f0 2024-09-21T06:38:32.505 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.501+0000 7fb19ffff640 1 --2- 172.21.15.7:0/510235577 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fb18c0b6680 0x7fb18c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:32.505 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.501+0000 7fb19cff9640 1 -- 172.21.15.7:0/510235577 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fb1900e7080 con 0x7fb1a01082f0 2024-09-21T06:38:32.508 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.502+0000 7fb1ad035740 1 -- 172.21.15.7:0/2289545259 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c052c42f0 msgr2=0x555c05692ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:32.509 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.502+0000 7fb19ffff640 1 --2- 172.21.15.7:0/510235577 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fb18c0b6680 0x7fb18c0b8b90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb198006010 tx=0x7fb198009440 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:32.509 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.502+0000 7fb1ad035740 1 --2- 172.21.15.7:0/2289545259 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c052c42f0 0x555c05692ef0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fb188009c90 tx=0x7fb1880117b0 comp rx=0 tx=0).stop 2024-09-21T06:38:32.509 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.502+0000 7fb1ad035740 1 -- 172.21.15.7:0/2289545259 shutdown_connections 2024-09-21T06:38:32.509 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.502+0000 7fb1ad035740 1 --2- 172.21.15.7:0/2289545259 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c052cc4d0 0x555c05693430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:32.509 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.502+0000 7fb1ad035740 1 --2- 172.21.15.7:0/2289545259 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c052c42f0 0x555c05692ef0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:32.509 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.502+0000 7fb1ad035740 1 --2- 172.21.15.7:0/2289545259 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555c052ed1b0 0x555c056929b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:32.509 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.502+0000 7fb1ad035740 1 -- 172.21.15.7:0/2289545259 >> 172.21.15.7:0/2289545259 conn(0x555c052e1300 msgr2=0x555c056908a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:32.509 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.502+0000 7fb1ad035740 1 -- 172.21.15.7:0/2289545259 shutdown_connections 2024-09-21T06:38:32.509 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.502+0000 7fb1ad035740 1 -- 172.21.15.7:0/2289545259 wait complete. 2024-09-21T06:38:32.509 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.502+0000 7fb1ad035740 1 -- start start 2024-09-21T06:38:32.509 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.502+0000 7fb1ad035740 1 Processor -- start 2024-09-21T06:38:32.509 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.503+0000 7fb1ad035740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c052c42f0 0x555c0569dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:32.509 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.503+0000 7fb1ad035740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c052cc4d0 0x555c0569e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:32.510 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.503+0000 7fb1ad035740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555c052ed1b0 0x555c0569ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:32.510 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.503+0000 7fb1ad035740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x555c0552eab0 con 0x555c052cc4d0 2024-09-21T06:38:32.510 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.503+0000 7fb1ad035740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x555c0559c730 con 0x555c052c42f0 2024-09-21T06:38:32.510 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.503+0000 7fb1ad035740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x555c056a1130 con 0x555c052ed1b0 2024-09-21T06:38:32.510 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.503+0000 7fb1ad035740 10 client.0 _ll_register_callbacks cb 0x555c055f06b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:38:32.510 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.503+0000 7fb19effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c052cc4d0 0x555c0569e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:32.510 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.503+0000 7fb19effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c052cc4d0 0x555c0569e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51934/0 (socket says 172.21.15.7:51934) 2024-09-21T06:38:32.510 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.503+0000 7fb19effd640 1 -- 172.21.15.7:0/1707565729 learned_addr learned my addr 172.21.15.7:0/1707565729 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:38:32.510 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.503+0000 7fb19f7fe640 1 --2- 172.21.15.7:0/1707565729 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c052c42f0 0x555c0569dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:32.510 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.503+0000 7fb19ffff640 1 --2- 172.21.15.7:0/1707565729 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555c052ed1b0 0x555c0569ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:32.510 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.503+0000 7fb19effd640 1 -- 172.21.15.7:0/1707565729 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555c052ed1b0 msgr2=0x555c0569ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:32.510 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.503+0000 7fb19effd640 1 --2- 172.21.15.7:0/1707565729 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555c052ed1b0 0x555c0569ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:32.510 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.503+0000 7fb19effd640 1 -- 172.21.15.7:0/1707565729 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c052c42f0 msgr2=0x555c0569dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:32.511 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.503+0000 7fb19effd640 1 --2- 172.21.15.7:0/1707565729 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c052c42f0 0x555c0569dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:32.511 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.503+0000 7fb19effd640 1 -- 172.21.15.7:0/1707565729 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c05358790 con 0x555c052cc4d0 2024-09-21T06:38:32.511 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.503+0000 7fb19f7fe640 1 --2- 172.21.15.7:0/1707565729 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c052c42f0 0x555c0569dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:38:32.511 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.503+0000 7fb19effd640 1 --2- 172.21.15.7:0/1707565729 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c052cc4d0 0x555c0569e4f0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fb190009610 tx=0x7fb1900a8e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1680cdc46a876109 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:32.511 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.503+0000 7fb17effd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:38:32.511 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.504+0000 7fb17effd640 1 -- 172.21.15.7:0/1707565729 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb190021030 con 0x555c052cc4d0 2024-09-21T06:38:32.511 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.504+0000 7fb17effd640 1 -- 172.21.15.7:0/1707565729 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fb1900e92d0 con 0x555c052cc4d0 2024-09-21T06:38:32.511 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.504+0000 7fb1ad035740 1 -- 172.21.15.7:0/1707565729 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb188012aa0 con 0x555c052cc4d0 2024-09-21T06:38:32.511 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.504+0000 7fb17effd640 1 -- 172.21.15.7:0/1707565729 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb1900ac8c0 con 0x555c052cc4d0 2024-09-21T06:38:32.511 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.504+0000 7fb1ad035740 10 client.15960 fetch_fsmap learned FSMap version 25 2024-09-21T06:38:32.511 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.504+0000 7fb1ad035740 1 -- 172.21.15.7:0/1707565729 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x555c053d1620 con 0x555c052cc4d0 2024-09-21T06:38:32.511 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.504+0000 7fb17effd640 1 -- 172.21.15.7:0/1707565729 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb188012aa0 con 0x555c052cc4d0 2024-09-21T06:38:32.511 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.504+0000 7fb17effd640 1 -- 172.21.15.7:0/1707565729 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb190098180 con 0x555c052cc4d0 2024-09-21T06:38:32.511 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.504+0000 7fb1ad035740 10 client.15960 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:38:32.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.504+0000 7fb1ad035740 10 client.15960 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:38:32.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.504+0000 7fb1ad035740 20 client.15960 populate_metadata read hostname 'smithi007' 2024-09-21T06:38:32.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.504+0000 7fb1ad035740 1 --2- 172.21.15.7:0/1707565729 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x555c052abd80 0x555c056b0140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:32.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.504+0000 7fb1ad035740 4 client.15960 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:38:32.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.504+0000 7fb1ad035740 1 -- 172.21.15.7:0/1707565729 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555c05609640 con 0x555c052abd80 2024-09-21T06:38:32.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.505+0000 7fb19f7fe640 1 --2- 172.21.15.7:0/1707565729 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x555c052abd80 0x555c056b0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:32.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.505+0000 7fb19f7fe640 1 --2- 172.21.15.7:0/1707565729 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x555c052abd80 0x555c056b0140 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d56deadaf102a84 server_cookie=4befdb9330b305fb in_seq=0 out_seq=0 2024-09-21T06:38:32.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.505+0000 7fb17effd640 10 client.15960 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:38:32.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.506+0000 7fb17effd640 1 -- 172.21.15.7:0/1707565729 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555c05609640 con 0x555c052abd80 2024-09-21T06:38:32.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.506+0000 7fb17effd640 10 client.15960 handle_command_reply: tid=0 2024-09-21T06:38:32.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.506+0000 7fb1ad035740 1 client.15960 shutdown 2024-09-21T06:38:32.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.506+0000 7fb1ad035740 1 -- 172.21.15.7:0/1707565729 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c052cc4d0 msgr2=0x555c0569e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:32.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.506+0000 7fb1ad035740 1 --2- 172.21.15.7:0/1707565729 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c052cc4d0 0x555c0569e4f0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fb190009610 tx=0x7fb1900a8e10 comp rx=0 tx=0).stop 2024-09-21T06:38:32.512 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.506+0000 7fb1ad035740 1 -- 172.21.15.7:0/1707565729 shutdown_connections 2024-09-21T06:38:32.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.506+0000 7fb1ad035740 1 --2- 172.21.15.7:0/1707565729 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x555c052abd80 0x555c056b0140 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:32.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.506+0000 7fb1ad035740 1 --2- 172.21.15.7:0/1707565729 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555c052ed1b0 0x555c0569ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:32.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.506+0000 7fb1ad035740 1 --2- 172.21.15.7:0/1707565729 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c052cc4d0 0x555c0569e4f0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:32.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.506+0000 7fb17effd640 0 client.15960 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:38:32.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.506+0000 7fb1ad035740 1 --2- 172.21.15.7:0/1707565729 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c052c42f0 0x555c0569dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:32.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.506+0000 7fb1ad035740 1 -- 172.21.15.7:0/1707565729 >> 172.21.15.7:0/1707565729 conn(0x555c052e1300 msgr2=0x555c056939e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:32.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.506+0000 7fb1ad035740 1 -- 172.21.15.7:0/1707565729 shutdown_connections 2024-09-21T06:38:32.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.506+0000 7fb1ad035740 1 -- 172.21.15.7:0/1707565729 wait complete. 2024-09-21T06:38:32.513 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.506+0000 7fb1ad035740 20 client.15960 trim_cache size 0 max 16384 2024-09-21T06:38:32.524 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.521+0000 7fb1ad035740 1 Processor -- start 2024-09-21T06:38:32.524 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.521+0000 7fb1ad035740 1 -- start start 2024-09-21T06:38:32.524 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.521+0000 7fb1ad035740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c052abd80 0x555c0569fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:32.525 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.521+0000 7fb1ad035740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555c052c42f0 0x555c0569b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:32.525 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.521+0000 7fb1ad035740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c052cc4d0 0x555c0569b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:32.525 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.521+0000 7fb1ad035740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb1a01b1dd0 con 0x555c052cc4d0 2024-09-21T06:38:32.525 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.521+0000 7fb1ad035740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb1a01af6a0 con 0x555c052abd80 2024-09-21T06:38:32.525 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.521+0000 7fb1ad035740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb1a01ad4f0 con 0x555c052c42f0 2024-09-21T06:38:32.525 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.521+0000 7fb19ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c052cc4d0 0x555c0569b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:32.525 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.521+0000 7fb19ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c052cc4d0 0x555c0569b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51940/0 (socket says 172.21.15.7:51940) 2024-09-21T06:38:32.525 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.521+0000 7fb19ffff640 1 -- 172.21.15.7:0/1209947749 learned_addr learned my addr 172.21.15.7:0/1209947749 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:38:32.525 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.522+0000 7fb19f7fe640 1 --2- 172.21.15.7:0/1209947749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c052abd80 0x555c0569fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:32.525 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.522+0000 7fb19effd640 1 --2- 172.21.15.7:0/1209947749 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555c052c42f0 0x555c0569b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:32.525 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.522+0000 7fb19ffff640 1 -- 172.21.15.7:0/1209947749 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555c052c42f0 msgr2=0x555c0569b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:32.525 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.522+0000 7fb19ffff640 1 --2- 172.21.15.7:0/1209947749 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555c052c42f0 0x555c0569b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:32.525 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.522+0000 7fb19ffff640 1 -- 172.21.15.7:0/1209947749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c052abd80 msgr2=0x555c0569fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:32.525 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.522+0000 7fb19ffff640 1 --2- 172.21.15.7:0/1209947749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c052abd80 0x555c0569fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:32.526 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.522+0000 7fb19ffff640 1 -- 172.21.15.7:0/1209947749 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c05699af0 con 0x555c052cc4d0 2024-09-21T06:38:32.526 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.522+0000 7fb19ffff640 1 --2- 172.21.15.7:0/1209947749 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c052cc4d0 0x555c0569b6c0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fb198035000 tx=0x7fb198041000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c31cbdb81b794b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:32.526 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.522+0000 7fb1957fa640 1 -- 172.21.15.7:0/1209947749 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1980318d0 con 0x555c052cc4d0 2024-09-21T06:38:32.526 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.522+0000 7fb1957fa640 1 -- 172.21.15.7:0/1209947749 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb198036050 con 0x555c052cc4d0 2024-09-21T06:38:32.526 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.522+0000 7fb1957fa640 1 -- 172.21.15.7:0/1209947749 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1980046c0 con 0x555c052cc4d0 2024-09-21T06:38:32.529 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.523+0000 7fb1ad035740 1 -- 172.21.15.7:0/1209947749 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c052cc4d0 msgr2=0x555c0569b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:32.529 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.523+0000 7fb1ad035740 1 --2- 172.21.15.7:0/1209947749 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c052cc4d0 0x555c0569b6c0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fb198035000 tx=0x7fb198041000 comp rx=0 tx=0).stop 2024-09-21T06:38:32.529 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.523+0000 7fb1ad035740 1 -- 172.21.15.7:0/1209947749 shutdown_connections 2024-09-21T06:38:32.529 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.523+0000 7fb1ad035740 1 --2- 172.21.15.7:0/1209947749 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c052cc4d0 0x555c0569b6c0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:32.529 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.523+0000 7fb1ad035740 1 --2- 172.21.15.7:0/1209947749 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555c052c42f0 0x555c0569b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:32.530 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.523+0000 7fb1ad035740 1 --2- 172.21.15.7:0/1209947749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c052abd80 0x555c0569fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:32.530 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.523+0000 7fb1ad035740 1 -- 172.21.15.7:0/1209947749 >> 172.21.15.7:0/1209947749 conn(0x555c052e1300 msgr2=0x555c0569f4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:32.530 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.523+0000 7fb1ad035740 1 -- 172.21.15.7:0/1209947749 shutdown_connections 2024-09-21T06:38:32.530 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.523+0000 7fb1ad035740 1 -- 172.21.15.7:0/1209947749 wait complete. 2024-09-21T06:38:32.530 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.523+0000 7fb1ad035740 1 -- start start 2024-09-21T06:38:32.530 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.524+0000 7fb1ad035740 1 Processor -- start 2024-09-21T06:38:32.530 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.524+0000 7fb1ad035740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555c052abd80 0x555c056a3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:32.530 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.524+0000 7fb1ad035740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c052c42f0 0x555c056a4590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:32.530 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.524+0000 7fb1ad035740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c052cc4d0 0x555c05712d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:32.530 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.524+0000 7fb1ad035740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb1a01adb60 con 0x555c052c42f0 2024-09-21T06:38:32.530 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.524+0000 7fb1ad035740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb1a01aefd0 con 0x555c052cc4d0 2024-09-21T06:38:32.530 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.524+0000 7fb1ad035740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb1a01ae230 con 0x555c052abd80 2024-09-21T06:38:32.530 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.524+0000 7fb1ad035740 10 client.0 _ll_register_callbacks cb 0x7fb190009f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:38:32.531 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.524+0000 7fb19effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c052c42f0 0x555c056a4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:32.531 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.524+0000 7fb19effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c052c42f0 0x555c056a4590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51956/0 (socket says 172.21.15.7:51956) 2024-09-21T06:38:32.531 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.524+0000 7fb19effd640 1 -- 172.21.15.7:0/2394520509 learned_addr learned my addr 172.21.15.7:0/2394520509 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:38:32.531 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.524+0000 7fb19f7fe640 1 --2- 172.21.15.7:0/2394520509 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555c052abd80 0x555c056a3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:32.531 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.524+0000 7fb19ffff640 1 --2- 172.21.15.7:0/2394520509 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c052cc4d0 0x555c05712d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:32.531 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.525+0000 7fb19effd640 1 -- 172.21.15.7:0/2394520509 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555c052abd80 msgr2=0x555c056a3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:32.531 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.525+0000 7fb19effd640 1 --2- 172.21.15.7:0/2394520509 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555c052abd80 0x555c056a3fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:32.531 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.525+0000 7fb19effd640 1 -- 172.21.15.7:0/2394520509 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c052cc4d0 msgr2=0x555c05712d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:32.531 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.525+0000 7fb19effd640 1 --2- 172.21.15.7:0/2394520509 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c052cc4d0 0x555c05712d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:32.531 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.525+0000 7fb19effd640 1 -- 172.21.15.7:0/2394520509 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c057133a0 con 0x555c052c42f0 2024-09-21T06:38:32.531 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.525+0000 7fb19effd640 1 --2- 172.21.15.7:0/2394520509 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c052c42f0 0x555c056a4590 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fb1900a9540 tx=0x7fb1900a8f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3366cb4475bccfa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:32.531 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.525+0000 7fb17effd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:38:32.531 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.525+0000 7fb17effd640 1 -- 172.21.15.7:0/2394520509 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb190021070 con 0x555c052c42f0 2024-09-21T06:38:32.531 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.525+0000 7fb17effd640 1 -- 172.21.15.7:0/2394520509 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fb1900d4170 con 0x555c052c42f0 2024-09-21T06:38:32.532 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.525+0000 7fb1ad035740 1 -- 172.21.15.7:0/2394520509 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb198036050 con 0x555c052c42f0 2024-09-21T06:38:32.532 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.525+0000 7fb17effd640 1 -- 172.21.15.7:0/2394520509 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb1900e4d00 con 0x555c052c42f0 2024-09-21T06:38:32.532 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.525+0000 7fb1ad035740 10 client.15966 fetch_fsmap learned FSMap version 25 2024-09-21T06:38:32.532 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.525+0000 7fb1ad035740 1 -- 172.21.15.7:0/2394520509 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x555c0571a7c0 con 0x555c052c42f0 2024-09-21T06:38:32.532 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.525+0000 7fb17effd640 1 -- 172.21.15.7:0/2394520509 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb198036050 con 0x555c052c42f0 2024-09-21T06:38:32.532 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.525+0000 7fb17effd640 1 -- 172.21.15.7:0/2394520509 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb1900d4370 con 0x555c052c42f0 2024-09-21T06:38:32.532 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.525+0000 7fb1ad035740 10 client.15966 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:38:32.532 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.525+0000 7fb1ad035740 10 client.15966 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-21T06:38:32.532 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.525+0000 7fb1ad035740 20 client.15966 populate_metadata read hostname 'smithi007' 2024-09-21T06:38:32.532 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.525+0000 7fb1ad035740 1 --2- 172.21.15.7:0/2394520509 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x555c052ed1b0 0x555c0571cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:32.532 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.525+0000 7fb1ad035740 4 client.15966 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-21T06:38:32.532 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.525+0000 7fb1ad035740 1 -- 172.21.15.7:0/2394520509 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "flush journal"}) -- 0x555c056050f0 con 0x555c052ed1b0 2024-09-21T06:38:32.532 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.526+0000 7fb19f7fe640 1 --2- 172.21.15.7:0/2394520509 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x555c052ed1b0 0x555c0571cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:32.533 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.526+0000 7fb19f7fe640 1 --2- 172.21.15.7:0/2394520509 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x555c052ed1b0 0x555c0571cf60 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=395c3533c3e1bb2b server_cookie=49beefff06022ef4 in_seq=0 out_seq=0 2024-09-21T06:38:32.533 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.526+0000 7fb17effd640 10 client.15966 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:38:32.540 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.538+0000 7fb17effd640 1 -- 172.21.15.7:0/2394520509 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x555c056050f0 con 0x555c052ed1b0 2024-09-21T06:38:32.540 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.538+0000 7fb17effd640 10 client.15966 handle_command_reply: tid=0 2024-09-21T06:38:32.540 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.538+0000 7fb1ad035740 1 client.15966 shutdown 2024-09-21T06:38:32.540 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.538+0000 7fb1ad035740 1 -- 172.21.15.7:0/2394520509 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c052c42f0 msgr2=0x555c056a4590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:32.540 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.538+0000 7fb1ad035740 1 --2- 172.21.15.7:0/2394520509 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c052c42f0 0x555c056a4590 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fb1900a9540 tx=0x7fb1900a8f40 comp rx=0 tx=0).stop 2024-09-21T06:38:32.540 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.538+0000 7fb1ad035740 1 -- 172.21.15.7:0/2394520509 shutdown_connections 2024-09-21T06:38:32.540 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.538+0000 7fb1ad035740 1 --2- 172.21.15.7:0/2394520509 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x555c052ed1b0 0x555c0571cf60 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:32.540 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.538+0000 7fb1ad035740 1 --2- 172.21.15.7:0/2394520509 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c052cc4d0 0x555c05712d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:32.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.538+0000 7fb1ad035740 1 --2- 172.21.15.7:0/2394520509 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c052c42f0 0x555c056a4590 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:32.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.538+0000 7fb1ad035740 1 --2- 172.21.15.7:0/2394520509 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555c052abd80 0x555c056a3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:32.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.538+0000 7fb17effd640 0 client.15966 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:38:32.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.538+0000 7fb1ad035740 1 -- 172.21.15.7:0/2394520509 >> 172.21.15.7:0/2394520509 conn(0x555c052e1300 msgr2=0x555c05690880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:32.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.538+0000 7fb1ad035740 1 -- 172.21.15.7:0/2394520509 shutdown_connections 2024-09-21T06:38:32.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.538+0000 7fb1ad035740 1 -- 172.21.15.7:0/2394520509 wait complete. 2024-09-21T06:38:32.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.538+0000 7fb1ad035740 20 client.15966 trim_cache size 0 max 16384 2024-09-21T06:38:32.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:{ 2024-09-21T06:38:32.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "message": "", 2024-09-21T06:38:32.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout: "return_code": 0 2024-09-21T06:38:32.541 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stdout:} 2024-09-21T06:38:32.542 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.539+0000 7fb1a60c5640 1 -- 172.21.15.7:0/510235577 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fb18c0b6680 msgr2=0x7fb18c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:32.542 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.539+0000 7fb1a60c5640 1 --2- 172.21.15.7:0/510235577 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fb18c0b6680 0x7fb18c0b8b90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb198006010 tx=0x7fb198009440 comp rx=0 tx=0).stop 2024-09-21T06:38:32.542 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.539+0000 7fb1a60c5640 1 -- 172.21.15.7:0/510235577 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1a01082f0 msgr2=0x7fb1a019a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:32.542 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.539+0000 7fb1a60c5640 1 --2- 172.21.15.7:0/510235577 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1a01082f0 0x7fb1a019a9b0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fb19000d740 tx=0x7fb19000dc00 comp rx=0 tx=0).stop 2024-09-21T06:38:32.543 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.539+0000 7fb1a60c5640 1 -- 172.21.15.7:0/510235577 shutdown_connections 2024-09-21T06:38:32.543 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.539+0000 7fb1a60c5640 1 --2- 172.21.15.7:0/510235577 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fb18c0b6680 0x7fb18c0b8b90 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:32.543 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.539+0000 7fb1a60c5640 1 --2- 172.21.15.7:0/510235577 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1a0108c40 0x7fb1a019fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:32.543 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.539+0000 7fb1a60c5640 1 --2- 172.21.15.7:0/510235577 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb1a01082f0 0x7fb1a019a9b0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:32.543 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.539+0000 7fb1a60c5640 1 --2- 172.21.15.7:0/510235577 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb1a01029c0 0x7fb1a019a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:32.543 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.539+0000 7fb1a60c5640 1 -- 172.21.15.7:0/510235577 >> 172.21.15.7:0/510235577 conn(0x7fb1a00fe3c0 msgr2=0x7fb1a006b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:32.543 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.539+0000 7fb1a60c5640 1 -- 172.21.15.7:0/510235577 shutdown_connections 2024-09-21T06:38:32.543 INFO:teuthology.task.background_exec.ubuntu@smithi007.front.sepia.ceph.com.smithi007.stderr:2024-09-21T06:38:32.539+0000 7fb1a60c5640 1 -- 172.21.15.7:0/510235577 wait complete. 2024-09-21T06:38:32.890 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:38:32.954 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:38:32 smithi007 ceph-mon[30983]: pgmap v389: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 774 MiB/s wr, 299 op/s 2024-09-21T06:38:33.211 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:38:33.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:38:32 smithi144 ceph-mon[34653]: pgmap v389: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 774 MiB/s wr, 299 op/s 2024-09-21T06:38:33.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:38:32 smithi018 ceph-mon[34477]: pgmap v389: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 774 MiB/s wr, 299 op/s 2024-09-21T06:38:33.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.752+0000 7efd9015b640 1 -- 172.21.15.7:0/1973728349 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd881052b0 msgr2=0x7efd8810d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:33.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.752+0000 7efd9015b640 1 --2- 172.21.15.7:0/1973728349 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd881052b0 0x7efd8810d8f0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7efd78009900 tx=0x7efd7802a410 comp rx=0 tx=0).stop 2024-09-21T06:38:33.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.752+0000 7efd9015b640 1 -- 172.21.15.7:0/1973728349 shutdown_connections 2024-09-21T06:38:33.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.752+0000 7efd9015b640 1 --2- 172.21.15.7:0/1973728349 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd8810de30 0x7efd88110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:33.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.752+0000 7efd9015b640 1 --2- 172.21.15.7:0/1973728349 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd881052b0 0x7efd8810d8f0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:33.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.752+0000 7efd9015b640 1 --2- 172.21.15.7:0/1973728349 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd88104880 0x7efd88104c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:33.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.752+0000 7efd9015b640 1 -- 172.21.15.7:0/1973728349 >> 172.21.15.7:0/1973728349 conn(0x7efd88079730 msgr2=0x7efd88079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:33.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.752+0000 7efd9015b640 1 -- 172.21.15.7:0/1973728349 shutdown_connections 2024-09-21T06:38:33.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.752+0000 7efd9015b640 1 -- 172.21.15.7:0/1973728349 wait complete. 2024-09-21T06:38:33.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.753+0000 7efd9015b640 1 Processor -- start 2024-09-21T06:38:33.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.753+0000 7efd9015b640 1 -- start start 2024-09-21T06:38:33.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.753+0000 7efd9015b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd88104880 0x7efd8819a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:33.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.753+0000 7efd9015b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd881052b0 0x7efd8819aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:33.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.753+0000 7efd9015b640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd8810de30 0x7efd8819fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:33.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.753+0000 7efd9015b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7efd88113a70 con 0x7efd88104880 2024-09-21T06:38:33.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.753+0000 7efd9015b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7efd881138f0 con 0x7efd881052b0 2024-09-21T06:38:33.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.753+0000 7efd9015b640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7efd88113bf0 con 0x7efd8810de30 2024-09-21T06:38:33.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.753+0000 7efd8def7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd88104880 0x7efd8819a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:33.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.754+0000 7efd8def7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd88104880 0x7efd8819a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51970/0 (socket says 172.21.15.7:51970) 2024-09-21T06:38:33.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.754+0000 7efd8def7640 1 -- 172.21.15.7:0/3350944965 learned_addr learned my addr 172.21.15.7:0/3350944965 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:38:33.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.754+0000 7efd8e6f8640 1 --2- 172.21.15.7:0/3350944965 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd8810de30 0x7efd8819fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:33.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.754+0000 7efd8d6f6640 1 --2- 172.21.15.7:0/3350944965 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd881052b0 0x7efd8819aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:33.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.754+0000 7efd8e6f8640 1 -- 172.21.15.7:0/3350944965 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd881052b0 msgr2=0x7efd8819aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:33.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.754+0000 7efd8e6f8640 1 --2- 172.21.15.7:0/3350944965 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd881052b0 0x7efd8819aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:33.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.754+0000 7efd8e6f8640 1 -- 172.21.15.7:0/3350944965 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd88104880 msgr2=0x7efd8819a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:33.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.754+0000 7efd8e6f8640 1 --2- 172.21.15.7:0/3350944965 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd88104880 0x7efd8819a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:33.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.754+0000 7efd8e6f8640 1 -- 172.21.15.7:0/3350944965 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd881a03d0 con 0x7efd8810de30 2024-09-21T06:38:33.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.754+0000 7efd8def7640 1 --2- 172.21.15.7:0/3350944965 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd88104880 0x7efd8819a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:38:33.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.754+0000 7efd8e6f8640 1 --2- 172.21.15.7:0/3350944965 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd8810de30 0x7efd8819fca0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7efd8000e940 tx=0x7efd8000ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:33.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.755+0000 7efd7effd640 1 -- 172.21.15.7:0/3350944965 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd80004d20 con 0x7efd8810de30 2024-09-21T06:38:33.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.755+0000 7efd7effd640 1 -- 172.21.15.7:0/3350944965 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd80005020 con 0x7efd8810de30 2024-09-21T06:38:33.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.755+0000 7efd9015b640 1 -- 172.21.15.7:0/3350944965 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd881a06c0 con 0x7efd8810de30 2024-09-21T06:38:33.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.755+0000 7efd7effd640 1 -- 172.21.15.7:0/3350944965 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd800116d0 con 0x7efd8810de30 2024-09-21T06:38:33.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.755+0000 7efd9015b640 1 -- 172.21.15.7:0/3350944965 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd881a6e20 con 0x7efd8810de30 2024-09-21T06:38:33.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.757+0000 7efd966cf740 1 Processor -- start 2024-09-21T06:38:33.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.758+0000 7efd7effd640 1 -- 172.21.15.7:0/3350944965 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7efd8000cb20 con 0x7efd8810de30 2024-09-21T06:38:33.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.758+0000 7efd966cf740 1 -- start start 2024-09-21T06:38:33.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.759+0000 7efd966cf740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fb68840070 0x55fb68be72c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:33.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.759+0000 7efd966cf740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb688171b0 0x55fb68be7800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:33.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.759+0000 7efd966cf740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fb6881f390 0x55fb68be7d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:33.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.759+0000 7efd966cf740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55fb68b5dea0 con 0x55fb688171b0 2024-09-21T06:38:33.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.759+0000 7efd966cf740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55fb68b4d2d0 con 0x55fb6881f390 2024-09-21T06:38:33.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.759+0000 7efd966cf740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55fb68b510e0 con 0x55fb68840070 2024-09-21T06:38:33.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.759+0000 7efd8def7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb688171b0 0x55fb68be7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:33.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.759+0000 7efd8def7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb688171b0 0x55fb68be7800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51982/0 (socket says 172.21.15.7:51982) 2024-09-21T06:38:33.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.759+0000 7efd8def7640 1 -- 172.21.15.7:0/1151183665 learned_addr learned my addr 172.21.15.7:0/1151183665 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:38:33.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.759+0000 7efd8d6f6640 1 --2- 172.21.15.7:0/1151183665 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fb6881f390 0x55fb68be7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:33.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.759+0000 7efd8d6f6640 1 --2- 172.21.15.7:0/1151183665 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fb68840070 0x55fb68be72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:33.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.759+0000 7efd7effd640 1 --2- 172.21.15.7:0/3350944965 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7efd740b6700 0x7efd740b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:33.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.759+0000 7efd8def7640 1 -- 172.21.15.7:0/1151183665 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fb68840070 msgr2=0x55fb68be72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:33.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.759+0000 7efd8def7640 1 --2- 172.21.15.7:0/1151183665 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fb68840070 0x55fb68be72c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:33.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.759+0000 7efd8def7640 1 -- 172.21.15.7:0/1151183665 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fb6881f390 msgr2=0x55fb68be7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:33.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.759+0000 7efd8def7640 1 --2- 172.21.15.7:0/1151183665 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fb6881f390 0x55fb68be7d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:33.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.759+0000 7efd8def7640 1 -- 172.21.15.7:0/1151183665 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb688ab650 con 0x55fb688171b0 2024-09-21T06:38:33.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.760+0000 7efd8e6f8640 1 --2- 172.21.15.7:0/3350944965 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7efd740b6700 0x7efd740b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:33.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.760+0000 7efd8def7640 1 --2- 172.21.15.7:0/1151183665 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb688171b0 0x55fb68be7800 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7efd84010580 tx=0x7efd8400bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6f4a42652ba939c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:33.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.760+0000 7efd7effd640 1 -- 172.21.15.7:0/3350944965 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7efd800e7630 con 0x7efd8810de30 2024-09-21T06:38:33.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.760+0000 7efd73fff640 1 -- 172.21.15.7:0/1151183665 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd84011760 con 0x55fb688171b0 2024-09-21T06:38:33.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.760+0000 7efd73fff640 1 -- 172.21.15.7:0/1151183665 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd84011db0 con 0x55fb688171b0 2024-09-21T06:38:33.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.760+0000 7efd73fff640 1 -- 172.21.15.7:0/1151183665 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd8401cde0 con 0x55fb688171b0 2024-09-21T06:38:33.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.761+0000 7efd966cf740 1 -- 172.21.15.7:0/1151183665 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb688171b0 msgr2=0x55fb68be7800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:33.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.761+0000 7efd966cf740 1 --2- 172.21.15.7:0/1151183665 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb688171b0 0x55fb68be7800 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7efd84010580 tx=0x7efd8400bf90 comp rx=0 tx=0).stop 2024-09-21T06:38:33.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.761+0000 7efd8e6f8640 1 --2- 172.21.15.7:0/3350944965 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7efd740b6700 0x7efd740b8c10 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7efd8000c640 tx=0x7efd80005340 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:33.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.761+0000 7efd966cf740 1 -- 172.21.15.7:0/1151183665 shutdown_connections 2024-09-21T06:38:33.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.761+0000 7efd966cf740 1 --2- 172.21.15.7:0/1151183665 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fb6881f390 0x55fb68be7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:33.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.761+0000 7efd966cf740 1 --2- 172.21.15.7:0/1151183665 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb688171b0 0x55fb68be7800 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:33.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.761+0000 7efd966cf740 1 --2- 172.21.15.7:0/1151183665 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fb68840070 0x55fb68be72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:33.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.761+0000 7efd966cf740 1 -- 172.21.15.7:0/1151183665 >> 172.21.15.7:0/1151183665 conn(0x55fb68834460 msgr2=0x55fb68be51b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:33.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.761+0000 7efd966cf740 1 -- 172.21.15.7:0/1151183665 shutdown_connections 2024-09-21T06:38:33.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.761+0000 7efd966cf740 1 -- 172.21.15.7:0/1151183665 wait complete. 2024-09-21T06:38:33.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.762+0000 7efd966cf740 1 -- start start 2024-09-21T06:38:33.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.762+0000 7efd966cf740 1 Processor -- start 2024-09-21T06:38:33.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.762+0000 7efd966cf740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fb688171b0 0x55fb68bf29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:33.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.762+0000 7efd966cf740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb6881f390 0x55fb68bf2f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:33.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.762+0000 7efd966cf740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fb68840070 0x55fb68bfed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:33.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.762+0000 7efd966cf740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55fb689ae700 con 0x55fb6881f390 2024-09-21T06:38:33.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.762+0000 7efd966cf740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55fb68ae8160 con 0x55fb68840070 2024-09-21T06:38:33.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.762+0000 7efd966cf740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55fb68bf5aa0 con 0x55fb688171b0 2024-09-21T06:38:33.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.763+0000 7efd966cf740 10 client.0 _ll_register_callbacks cb 0x55fb68b019e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:38:33.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.763+0000 7efd8def7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb6881f390 0x55fb68bf2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:33.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.763+0000 7efd8def7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb6881f390 0x55fb68bf2f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51994/0 (socket says 172.21.15.7:51994) 2024-09-21T06:38:33.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.763+0000 7efd8def7640 1 -- 172.21.15.7:0/1163787914 learned_addr learned my addr 172.21.15.7:0/1163787914 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:38:33.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.763+0000 7efd8d6f6640 1 --2- 172.21.15.7:0/1163787914 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fb688171b0 0x55fb68bf29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:33.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.763+0000 7efd8d6f6640 1 --2- 172.21.15.7:0/1163787914 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fb68840070 0x55fb68bfed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:33.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.763+0000 7efd8def7640 1 -- 172.21.15.7:0/1163787914 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fb688171b0 msgr2=0x55fb68bf29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:33.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.763+0000 7efd8def7640 1 --2- 172.21.15.7:0/1163787914 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fb688171b0 0x55fb68bf29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:33.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.763+0000 7efd8def7640 1 -- 172.21.15.7:0/1163787914 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fb68840070 msgr2=0x55fb68bfed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:33.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.763+0000 7efd8def7640 1 --2- 172.21.15.7:0/1163787914 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fb68840070 0x55fb68bfed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:33.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.763+0000 7efd8def7640 1 -- 172.21.15.7:0/1163787914 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb68b15c90 con 0x55fb6881f390 2024-09-21T06:38:33.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.763+0000 7efd8def7640 1 --2- 172.21.15.7:0/1163787914 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb6881f390 0x55fb68bf2f00 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7efd84011fa0 tx=0x7efd8401cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a56eb69b798be51 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:33.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.763+0000 7efd717fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:38:33.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.763+0000 7efd717fa640 1 -- 172.21.15.7:0/1163787914 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd8402b060 con 0x55fb6881f390 2024-09-21T06:38:33.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.764+0000 7efd717fa640 1 -- 172.21.15.7:0/1163787914 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7efd8401c750 con 0x55fb6881f390 2024-09-21T06:38:33.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.764+0000 7efd966cf740 1 -- 172.21.15.7:0/1163787914 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd84011db0 con 0x55fb6881f390 2024-09-21T06:38:33.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.764+0000 7efd717fa640 1 -- 172.21.15.7:0/1163787914 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7efd84011560 con 0x55fb6881f390 2024-09-21T06:38:33.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.764+0000 7efd966cf740 10 client.15978 fetch_fsmap learned FSMap version 25 2024-09-21T06:38:33.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.764+0000 7efd966cf740 1 -- 172.21.15.7:0/1163787914 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55fb68c01810 con 0x55fb6881f390 2024-09-21T06:38:33.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.764+0000 7efd717fa640 1 -- 172.21.15.7:0/1163787914 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd84011db0 con 0x55fb6881f390 2024-09-21T06:38:33.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.764+0000 7efd717fa640 1 -- 172.21.15.7:0/1163787914 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7efd840268d0 con 0x55fb6881f390 2024-09-21T06:38:33.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.764+0000 7efd966cf740 10 client.15978 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:38:33.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.764+0000 7efd966cf740 10 client.15978 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:38:33.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.764+0000 7efd966cf740 20 client.15978 populate_metadata read hostname 'smithi007' 2024-09-21T06:38:33.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.764+0000 7efd966cf740 1 --2- 172.21.15.7:0/1163787914 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55fb687fe9f0 0x55fb68c04c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:33.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.764+0000 7efd966cf740 4 client.15978 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:38:33.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.764+0000 7efd966cf740 1 -- 172.21.15.7:0/1163787914 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fb68b5fdf0 con 0x55fb687fe9f0 2024-09-21T06:38:33.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.765+0000 7efd8d6f6640 1 --2- 172.21.15.7:0/1163787914 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55fb687fe9f0 0x55fb68c04c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:33.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.765+0000 7efd8d6f6640 1 --2- 172.21.15.7:0/1163787914 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55fb687fe9f0 0x55fb68c04c20 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7ebdc08dbca060b server_cookie=f48a2363600df23c in_seq=0 out_seq=0 2024-09-21T06:38:33.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.765+0000 7efd717fa640 10 client.15978 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:38:33.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.766+0000 7efd717fa640 1 -- 172.21.15.7:0/1163787914 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fb68b5fdf0 con 0x55fb687fe9f0 2024-09-21T06:38:33.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.766+0000 7efd717fa640 10 client.15978 handle_command_reply: tid=0 2024-09-21T06:38:33.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.766+0000 7efd966cf740 1 client.15978 shutdown 2024-09-21T06:38:33.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.766+0000 7efd966cf740 1 -- 172.21.15.7:0/1163787914 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb6881f390 msgr2=0x55fb68bf2f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:33.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.766+0000 7efd966cf740 1 --2- 172.21.15.7:0/1163787914 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb6881f390 0x55fb68bf2f00 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7efd84011fa0 tx=0x7efd8401cd90 comp rx=0 tx=0).stop 2024-09-21T06:38:33.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.766+0000 7efd966cf740 1 -- 172.21.15.7:0/1163787914 shutdown_connections 2024-09-21T06:38:33.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.766+0000 7efd966cf740 1 --2- 172.21.15.7:0/1163787914 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55fb687fe9f0 0x55fb68c04c20 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:33.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.766+0000 7efd966cf740 1 --2- 172.21.15.7:0/1163787914 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fb68840070 0x55fb68bfed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:33.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.766+0000 7efd966cf740 1 --2- 172.21.15.7:0/1163787914 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb6881f390 0x55fb68bf2f00 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:33.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.766+0000 7efd966cf740 1 --2- 172.21.15.7:0/1163787914 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fb688171b0 0x55fb68bf29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:33.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.766+0000 7efd966cf740 1 -- 172.21.15.7:0/1163787914 >> 172.21.15.7:0/1163787914 conn(0x55fb68834460 msgr2=0x55fb68bea450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:33.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.766+0000 7efd717fa640 0 client.15978 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:38:33.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.767+0000 7efd966cf740 1 -- 172.21.15.7:0/1163787914 shutdown_connections 2024-09-21T06:38:33.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.767+0000 7efd966cf740 1 -- 172.21.15.7:0/1163787914 wait complete. 2024-09-21T06:38:33.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.767+0000 7efd966cf740 20 client.15978 trim_cache size 0 max 16384 2024-09-21T06:38:33.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.780+0000 7efd966cf740 1 Processor -- start 2024-09-21T06:38:33.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.780+0000 7efd966cf740 1 -- start start 2024-09-21T06:38:33.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.781+0000 7efd966cf740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fb688171b0 0x55fb68beaad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:33.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.781+0000 7efd966cf740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb6881f390 0x55fb68bfed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:33.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.781+0000 7efd966cf740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fb68840070 0x55fb68be4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:33.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.781+0000 7efd966cf740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7efd881b1de0 con 0x55fb6881f390 2024-09-21T06:38:33.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.781+0000 7efd966cf740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7efd881af6b0 con 0x55fb68840070 2024-09-21T06:38:33.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.781+0000 7efd966cf740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7efd881ad500 con 0x55fb688171b0 2024-09-21T06:38:33.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.781+0000 7efd8def7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb6881f390 0x55fb68bfed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:33.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.781+0000 7efd8def7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb6881f390 0x55fb68bfed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52002/0 (socket says 172.21.15.7:52002) 2024-09-21T06:38:33.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.781+0000 7efd8def7640 1 -- 172.21.15.7:0/3034388131 learned_addr learned my addr 172.21.15.7:0/3034388131 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:38:33.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.781+0000 7efd8d6f6640 1 --2- 172.21.15.7:0/3034388131 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fb688171b0 0x55fb68beaad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:33.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.781+0000 7efd8d6f6640 1 --2- 172.21.15.7:0/3034388131 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fb68840070 0x55fb68be4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:33.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.781+0000 7efd8def7640 1 -- 172.21.15.7:0/3034388131 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fb688171b0 msgr2=0x55fb68beaad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:33.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.781+0000 7efd8def7640 1 --2- 172.21.15.7:0/3034388131 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fb688171b0 0x55fb68beaad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:33.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.781+0000 7efd8def7640 1 -- 172.21.15.7:0/3034388131 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fb68840070 msgr2=0x55fb68be4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:33.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.781+0000 7efd8def7640 1 --2- 172.21.15.7:0/3034388131 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fb68840070 0x55fb68be4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:33.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.781+0000 7efd8def7640 1 -- 172.21.15.7:0/3034388131 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb687fec20 con 0x55fb6881f390 2024-09-21T06:38:33.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.781+0000 7efd8d6f6640 1 --2- 172.21.15.7:0/3034388131 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fb68840070 0x55fb68be4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:38:33.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.781+0000 7efd8def7640 1 --2- 172.21.15.7:0/3034388131 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb6881f390 0x55fb68bfed00 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7efd8400b580 tx=0x7efd8400bbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=843299b09b4811aa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:33.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.782+0000 7efd737fe640 1 -- 172.21.15.7:0/3034388131 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd8402b070 con 0x55fb6881f390 2024-09-21T06:38:33.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.782+0000 7efd737fe640 1 -- 172.21.15.7:0/3034388131 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd8401c750 con 0x55fb6881f390 2024-09-21T06:38:33.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.782+0000 7efd737fe640 1 -- 172.21.15.7:0/3034388131 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd84026740 con 0x55fb6881f390 2024-09-21T06:38:33.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.783+0000 7efd966cf740 1 -- 172.21.15.7:0/3034388131 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb6881f390 msgr2=0x55fb68bfed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:33.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.783+0000 7efd966cf740 1 --2- 172.21.15.7:0/3034388131 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb6881f390 0x55fb68bfed00 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7efd8400b580 tx=0x7efd8400bbc0 comp rx=0 tx=0).stop 2024-09-21T06:38:33.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.783+0000 7efd966cf740 1 -- 172.21.15.7:0/3034388131 shutdown_connections 2024-09-21T06:38:33.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.783+0000 7efd966cf740 1 --2- 172.21.15.7:0/3034388131 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fb68840070 0x55fb68be4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:33.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.783+0000 7efd966cf740 1 --2- 172.21.15.7:0/3034388131 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb6881f390 0x55fb68bfed00 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:33.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.783+0000 7efd966cf740 1 --2- 172.21.15.7:0/3034388131 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fb688171b0 0x55fb68beaad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:33.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.783+0000 7efd966cf740 1 -- 172.21.15.7:0/3034388131 >> 172.21.15.7:0/3034388131 conn(0x55fb68834460 msgr2=0x55fb68bea3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:33.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.783+0000 7efd966cf740 1 -- 172.21.15.7:0/3034388131 shutdown_connections 2024-09-21T06:38:33.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.783+0000 7efd966cf740 1 -- 172.21.15.7:0/3034388131 wait complete. 2024-09-21T06:38:33.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.783+0000 7efd966cf740 1 -- start start 2024-09-21T06:38:33.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.783+0000 7efd966cf740 1 Processor -- start 2024-09-21T06:38:33.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.784+0000 7efd966cf740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fb688171b0 0x55fb68c66650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:33.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.784+0000 7efd966cf740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb6881f390 0x55fb68c66c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:33.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.784+0000 7efd966cf740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fb68840070 0x55fb68c054c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:33.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.784+0000 7efd966cf740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7efd881adb70 con 0x55fb6881f390 2024-09-21T06:38:33.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.784+0000 7efd966cf740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7efd881aefe0 con 0x55fb68840070 2024-09-21T06:38:33.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.784+0000 7efd966cf740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7efd881ae240 con 0x55fb688171b0 2024-09-21T06:38:33.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.784+0000 7efd966cf740 10 client.0 _ll_register_callbacks cb 0x7efd78005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:38:33.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.784+0000 7efd8def7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb6881f390 0x55fb68c66c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:33.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.784+0000 7efd8def7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb6881f390 0x55fb68c66c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52010/0 (socket says 172.21.15.7:52010) 2024-09-21T06:38:33.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.784+0000 7efd8def7640 1 -- 172.21.15.7:0/2790342634 learned_addr learned my addr 172.21.15.7:0/2790342634 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:38:33.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.784+0000 7efd8d6f6640 1 --2- 172.21.15.7:0/2790342634 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fb68840070 0x55fb68c054c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:33.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.784+0000 7efd8d6f6640 1 --2- 172.21.15.7:0/2790342634 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fb688171b0 0x55fb68c66650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:33.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.785+0000 7efd8def7640 1 -- 172.21.15.7:0/2790342634 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fb688171b0 msgr2=0x55fb68c66650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:33.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.785+0000 7efd8def7640 1 --2- 172.21.15.7:0/2790342634 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fb688171b0 0x55fb68c66650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:33.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.785+0000 7efd8def7640 1 -- 172.21.15.7:0/2790342634 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fb68840070 msgr2=0x55fb68c054c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:33.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.785+0000 7efd8def7640 1 --2- 172.21.15.7:0/2790342634 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fb68840070 0x55fb68c054c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:33.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.785+0000 7efd8def7640 1 -- 172.21.15.7:0/2790342634 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb68c05c30 con 0x55fb6881f390 2024-09-21T06:38:33.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.785+0000 7efd8def7640 1 --2- 172.21.15.7:0/2790342634 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb6881f390 0x55fb68c66c10 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7efd84005bf0 tx=0x7efd840058f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=815e60b230c559b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:33.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.785+0000 7efd717fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:38:33.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.785+0000 7efd717fa640 1 -- 172.21.15.7:0/2790342634 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd8403d070 con 0x55fb6881f390 2024-09-21T06:38:33.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.785+0000 7efd717fa640 1 -- 172.21.15.7:0/2790342634 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7efd84026680 con 0x55fb6881f390 2024-09-21T06:38:33.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.785+0000 7efd966cf740 1 -- 172.21.15.7:0/2790342634 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd8401c750 con 0x55fb6881f390 2024-09-21T06:38:33.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.785+0000 7efd717fa640 1 -- 172.21.15.7:0/2790342634 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7efd84049050 con 0x55fb6881f390 2024-09-21T06:38:33.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.785+0000 7efd966cf740 10 client.15984 fetch_fsmap learned FSMap version 25 2024-09-21T06:38:33.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.785+0000 7efd966cf740 1 -- 172.21.15.7:0/2790342634 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55fb68c6ee30 con 0x55fb6881f390 2024-09-21T06:38:33.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.786+0000 7efd717fa640 1 -- 172.21.15.7:0/2790342634 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd8401c750 con 0x55fb6881f390 2024-09-21T06:38:33.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.786+0000 7efd717fa640 1 -- 172.21.15.7:0/2790342634 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7efd84011790 con 0x55fb6881f390 2024-09-21T06:38:33.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.786+0000 7efd966cf740 10 client.15984 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:38:33.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.786+0000 7efd966cf740 10 client.15984 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:38:33.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.786+0000 7efd966cf740 20 client.15984 populate_metadata read hostname 'smithi007' 2024-09-21T06:38:33.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.786+0000 7efd966cf740 1 --2- 172.21.15.7:0/2790342634 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55fb687d3da0 0x55fb68c714b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:33.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.786+0000 7efd966cf740 4 client.15984 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:38:33.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.786+0000 7efd966cf740 1 -- 172.21.15.7:0/2790342634 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fb68b5b8a0 con 0x55fb687d3da0 2024-09-21T06:38:33.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.786+0000 7efd8d6f6640 1 --2- 172.21.15.7:0/2790342634 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55fb687d3da0 0x55fb68c714b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:33.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.787+0000 7efd8d6f6640 1 --2- 172.21.15.7:0/2790342634 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55fb687d3da0 0x55fb68c714b0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7077009167ebcb7 server_cookie=1b81247b0902295 in_seq=0 out_seq=0 2024-09-21T06:38:33.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.787+0000 7efd717fa640 10 client.15984 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:38:33.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.787+0000 7efd717fa640 1 -- 172.21.15.7:0/2790342634 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fb68b5b8a0 con 0x55fb687d3da0 2024-09-21T06:38:33.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.787+0000 7efd717fa640 10 client.15984 handle_command_reply: tid=0 2024-09-21T06:38:33.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.787+0000 7efd966cf740 1 client.15984 shutdown 2024-09-21T06:38:33.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.787+0000 7efd966cf740 1 -- 172.21.15.7:0/2790342634 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb6881f390 msgr2=0x55fb68c66c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:33.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.787+0000 7efd966cf740 1 --2- 172.21.15.7:0/2790342634 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb6881f390 0x55fb68c66c10 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7efd84005bf0 tx=0x7efd840058f0 comp rx=0 tx=0).stop 2024-09-21T06:38:33.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.787+0000 7efd966cf740 1 -- 172.21.15.7:0/2790342634 shutdown_connections 2024-09-21T06:38:33.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.787+0000 7efd966cf740 1 --2- 172.21.15.7:0/2790342634 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55fb687d3da0 0x55fb68c714b0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:33.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.787+0000 7efd966cf740 1 --2- 172.21.15.7:0/2790342634 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fb68840070 0x55fb68c054c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:33.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.787+0000 7efd966cf740 1 --2- 172.21.15.7:0/2790342634 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fb6881f390 0x55fb68c66c10 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:33.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.787+0000 7efd966cf740 1 --2- 172.21.15.7:0/2790342634 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fb688171b0 0x55fb68c66650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:33.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.787+0000 7efd717fa640 0 client.15984 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:38:33.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.787+0000 7efd966cf740 1 -- 172.21.15.7:0/2790342634 >> 172.21.15.7:0/2790342634 conn(0x55fb68834460 msgr2=0x55fb68be4970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:33.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.787+0000 7efd966cf740 1 -- 172.21.15.7:0/2790342634 shutdown_connections 2024-09-21T06:38:33.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.787+0000 7efd966cf740 1 -- 172.21.15.7:0/2790342634 wait complete. 2024-09-21T06:38:33.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.788+0000 7efd966cf740 20 client.15984 trim_cache size 0 max 16384 2024-09-21T06:38:33.794 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:38:33.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.788+0000 7efd9015b640 1 -- 172.21.15.7:0/3350944965 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7efd740b6700 msgr2=0x7efd740b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:33.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.788+0000 7efd9015b640 1 --2- 172.21.15.7:0/3350944965 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7efd740b6700 0x7efd740b8c10 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7efd8000c640 tx=0x7efd80005340 comp rx=0 tx=0).stop 2024-09-21T06:38:33.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.788+0000 7efd9015b640 1 -- 172.21.15.7:0/3350944965 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd8810de30 msgr2=0x7efd8819fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:33.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.788+0000 7efd9015b640 1 --2- 172.21.15.7:0/3350944965 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd8810de30 0x7efd8819fca0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7efd8000e940 tx=0x7efd8000ee00 comp rx=0 tx=0).stop 2024-09-21T06:38:33.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.788+0000 7efd9015b640 1 -- 172.21.15.7:0/3350944965 shutdown_connections 2024-09-21T06:38:33.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.788+0000 7efd9015b640 1 --2- 172.21.15.7:0/3350944965 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7efd740b6700 0x7efd740b8c10 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:33.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.788+0000 7efd9015b640 1 --2- 172.21.15.7:0/3350944965 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efd8810de30 0x7efd8819fca0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:33.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.788+0000 7efd9015b640 1 --2- 172.21.15.7:0/3350944965 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efd881052b0 0x7efd8819aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:33.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.788+0000 7efd9015b640 1 --2- 172.21.15.7:0/3350944965 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efd88104880 0x7efd8819a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:33.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.788+0000 7efd9015b640 1 -- 172.21.15.7:0/3350944965 >> 172.21.15.7:0/3350944965 conn(0x7efd88079730 msgr2=0x7efd881008f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:33.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.788+0000 7efd9015b640 1 -- 172.21.15.7:0/3350944965 shutdown_connections 2024-09-21T06:38:33.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:33.788+0000 7efd9015b640 1 -- 172.21.15.7:0/3350944965 wait complete. 2024-09-21T06:38:34.232 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-09-21T06:38:34.232 INFO:tasks.workunit.client.0.smithi007.stdout: Children see throughput for 1 readers = 8860945.00 kB/sec 2024-09-21T06:38:34.232 INFO:tasks.workunit.client.0.smithi007.stdout: Parent sees throughput for 1 readers = 8859322.35 kB/sec 2024-09-21T06:38:34.232 INFO:tasks.workunit.client.0.smithi007.stdout: Min throughput per process = 8860945.00 kB/sec 2024-09-21T06:38:34.232 INFO:tasks.workunit.client.0.smithi007.stdout: Max throughput per process = 8860945.00 kB/sec 2024-09-21T06:38:34.232 INFO:tasks.workunit.client.0.smithi007.stdout: Avg throughput per process = 8860945.00 kB/sec 2024-09-21T06:38:34.233 INFO:tasks.workunit.client.0.smithi007.stdout: Min xfer = 10485760.00 kB 2024-09-21T06:38:35.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:38:34 smithi144 ceph-mon[34653]: pgmap v390: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 774 MiB/s wr, 296 op/s 2024-09-21T06:38:35.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:38:34 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:38:35.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:38:34 smithi007 ceph-mon[30983]: pgmap v390: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 774 MiB/s wr, 296 op/s 2024-09-21T06:38:35.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:38:34 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:38:35.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:38:34 smithi018 ceph-mon[34477]: pgmap v390: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 774 MiB/s wr, 296 op/s 2024-09-21T06:38:35.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:38:34 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:38:35.998 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:38:35.998 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:38:36.146 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:38:35 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:38:36.146 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:38:35 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:38:36.147 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:38:35 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:38:36.274 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:38:36.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:38:35 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:38:36.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:38:35 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:38:36.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:38:35 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:38:36.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:38:35 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:38:36.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:38:35 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:38:36.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:38:35 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:38:36.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.788+0000 7fd25d546640 1 -- 172.21.15.7:0/4054966939 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd258108cf0 msgr2=0x7fd25810f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:36.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.788+0000 7fd25d546640 1 --2- 172.21.15.7:0/4054966939 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd258108cf0 0x7fd25810f520 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd250009ca0 tx=0x7fd25002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:38:36.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.788+0000 7fd25d546640 1 -- 172.21.15.7:0/4054966939 shutdown_connections 2024-09-21T06:38:36.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.788+0000 7fd25d546640 1 --2- 172.21.15.7:0/4054966939 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd258108cf0 0x7fd25810f520 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:36.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.788+0000 7fd25d546640 1 --2- 172.21.15.7:0/4054966939 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd2581083a0 0x7fd2581087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:36.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.788+0000 7fd25d546640 1 --2- 172.21.15.7:0/4054966939 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd258102a60 0x7fd258102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:36.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.788+0000 7fd25d546640 1 -- 172.21.15.7:0/4054966939 >> 172.21.15.7:0/4054966939 conn(0x7fd258079730 msgr2=0x7fd258079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:36.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.788+0000 7fd25d546640 1 -- 172.21.15.7:0/4054966939 shutdown_connections 2024-09-21T06:38:36.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.788+0000 7fd25d546640 1 -- 172.21.15.7:0/4054966939 wait complete. 2024-09-21T06:38:36.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.789+0000 7fd25d546640 1 Processor -- start 2024-09-21T06:38:36.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.789+0000 7fd25d546640 1 -- start start 2024-09-21T06:38:36.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.789+0000 7fd25d546640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd258102a60 0x7fd25819b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:36.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.789+0000 7fd25d546640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2581083a0 0x7fd25819b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:36.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.789+0000 7fd25d546640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd258108cf0 0x7fd25819bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:36.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.789+0000 7fd25d546640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd258112960 con 0x7fd258108cf0 2024-09-21T06:38:36.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.789+0000 7fd25d546640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd2581127e0 con 0x7fd258102a60 2024-09-21T06:38:36.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.789+0000 7fd25d546640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd258112ae0 con 0x7fd2581083a0 2024-09-21T06:38:36.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.789+0000 7fd2577fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd258108cf0 0x7fd25819bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:36.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.789+0000 7fd2577fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd258108cf0 0x7fd25819bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52022/0 (socket says 172.21.15.7:52022) 2024-09-21T06:38:36.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.789+0000 7fd2577fe640 1 -- 172.21.15.7:0/2456861725 learned_addr learned my addr 172.21.15.7:0/2456861725 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:38:36.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.789+0000 7fd256ffd640 1 --2- 172.21.15.7:0/2456861725 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd258102a60 0x7fd25819b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:36.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.790+0000 7fd24ffff640 1 --2- 172.21.15.7:0/2456861725 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2581083a0 0x7fd25819b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:36.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.790+0000 7fd2577fe640 1 -- 172.21.15.7:0/2456861725 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2581083a0 msgr2=0x7fd25819b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:36.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.790+0000 7fd2577fe640 1 --2- 172.21.15.7:0/2456861725 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2581083a0 0x7fd25819b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:36.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.790+0000 7fd2577fe640 1 -- 172.21.15.7:0/2456861725 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd258102a60 msgr2=0x7fd25819b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:36.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.790+0000 7fd2577fe640 1 --2- 172.21.15.7:0/2456861725 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd258102a60 0x7fd25819b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:36.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.790+0000 7fd2577fe640 1 -- 172.21.15.7:0/2456861725 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2581a6540 con 0x7fd258108cf0 2024-09-21T06:38:36.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.790+0000 7fd256ffd640 1 --2- 172.21.15.7:0/2456861725 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd258102a60 0x7fd25819b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:38:36.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.790+0000 7fd2577fe640 1 --2- 172.21.15.7:0/2456861725 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd258108cf0 0x7fd25819bd30 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fd250005cc0 tx=0x7fd250031700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:36.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.790+0000 7fd254ff9640 1 -- 172.21.15.7:0/2456861725 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd250003b70 con 0x7fd258108cf0 2024-09-21T06:38:36.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.790+0000 7fd25d546640 1 -- 172.21.15.7:0/2456861725 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2581a67d0 con 0x7fd258108cf0 2024-09-21T06:38:36.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.790+0000 7fd254ff9640 1 -- 172.21.15.7:0/2456861725 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2500318f0 con 0x7fd258108cf0 2024-09-21T06:38:36.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.790+0000 7fd254ff9640 1 -- 172.21.15.7:0/2456861725 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd25002f950 con 0x7fd258108cf0 2024-09-21T06:38:36.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.790+0000 7fd25d546640 1 -- 172.21.15.7:0/2456861725 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2581a6d60 con 0x7fd258108cf0 2024-09-21T06:38:36.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.793+0000 7fd263aba740 1 Processor -- start 2024-09-21T06:38:36.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.794+0000 7fd254ff9640 1 -- 172.21.15.7:0/2456861725 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7fd25002fb10 con 0x7fd258108cf0 2024-09-21T06:38:36.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.794+0000 7fd263aba740 1 -- start start 2024-09-21T06:38:36.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.795+0000 7fd263aba740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563c4f691350 0x563c4fa38430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:36.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.795+0000 7fd263aba740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563c4f668490 0x563c4fa38970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:36.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.795+0000 7fd263aba740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c4f670670 0x563c4fa38eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:36.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.795+0000 7fd263aba740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x563c4f9aee60 con 0x563c4f670670 2024-09-21T06:38:36.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.795+0000 7fd263aba740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x563c4f99e290 con 0x563c4f668490 2024-09-21T06:38:36.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.795+0000 7fd263aba740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x563c4f9a20a0 con 0x563c4f691350 2024-09-21T06:38:36.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.795+0000 7fd24ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c4f670670 0x563c4fa38eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:36.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.795+0000 7fd24ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c4f670670 0x563c4fa38eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52024/0 (socket says 172.21.15.7:52024) 2024-09-21T06:38:36.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.795+0000 7fd24ffff640 1 -- 172.21.15.7:0/1509964764 learned_addr learned my addr 172.21.15.7:0/1509964764 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:38:36.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.795+0000 7fd24ffff640 1 --2- 172.21.15.7:0/1509964764 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563c4f691350 0x563c4fa38430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:36.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.795+0000 7fd256ffd640 1 --2- 172.21.15.7:0/1509964764 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563c4f668490 0x563c4fa38970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:36.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.795+0000 7fd254ff9640 1 --2- 172.21.15.7:0/2456861725 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fd2440b66b0 0x7fd2440b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:36.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.795+0000 7fd24ffff640 1 -- 172.21.15.7:0/1509964764 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563c4f691350 msgr2=0x563c4fa38430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:36.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.795+0000 7fd24ffff640 1 --2- 172.21.15.7:0/1509964764 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563c4f691350 0x563c4fa38430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:36.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.795+0000 7fd24ffff640 1 -- 172.21.15.7:0/1509964764 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563c4f668490 msgr2=0x563c4fa38970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:36.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.795+0000 7fd24ffff640 1 --2- 172.21.15.7:0/1509964764 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563c4f668490 0x563c4fa38970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:36.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.795+0000 7fd24ffff640 1 -- 172.21.15.7:0/1509964764 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c4f6fc930 con 0x563c4f670670 2024-09-21T06:38:36.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.796+0000 7fd2577fe640 1 --2- 172.21.15.7:0/2456861725 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fd2440b66b0 0x7fd2440b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:36.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.796+0000 7fd254ff9640 1 -- 172.21.15.7:0/2456861725 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fd250108740 con 0x7fd258108cf0 2024-09-21T06:38:36.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.796+0000 7fd24ffff640 1 --2- 172.21.15.7:0/1509964764 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c4f670670 0x563c4fa38eb0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fd24001ca00 tx=0x7fd240004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0f4f57c2070c042 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:36.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.796+0000 7fd24d7fa640 1 -- 172.21.15.7:0/1509964764 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd240004230 con 0x563c4f670670 2024-09-21T06:38:36.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.796+0000 7fd24d7fa640 1 -- 172.21.15.7:0/1509964764 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2400043d0 con 0x563c4f670670 2024-09-21T06:38:36.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.796+0000 7fd24d7fa640 1 -- 172.21.15.7:0/1509964764 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd240005580 con 0x563c4f670670 2024-09-21T06:38:36.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.798+0000 7fd263aba740 1 -- 172.21.15.7:0/1509964764 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c4f670670 msgr2=0x563c4fa38eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:36.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.798+0000 7fd2577fe640 1 --2- 172.21.15.7:0/2456861725 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fd2440b66b0 0x7fd2440b8bc0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd2500097b0 tx=0x7fd2500b7040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:36.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.798+0000 7fd263aba740 1 --2- 172.21.15.7:0/1509964764 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c4f670670 0x563c4fa38eb0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fd24001ca00 tx=0x7fd240004730 comp rx=0 tx=0).stop 2024-09-21T06:38:36.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.798+0000 7fd263aba740 1 -- 172.21.15.7:0/1509964764 shutdown_connections 2024-09-21T06:38:36.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.798+0000 7fd263aba740 1 --2- 172.21.15.7:0/1509964764 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c4f670670 0x563c4fa38eb0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:36.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.798+0000 7fd263aba740 1 --2- 172.21.15.7:0/1509964764 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563c4f668490 0x563c4fa38970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:36.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.798+0000 7fd263aba740 1 --2- 172.21.15.7:0/1509964764 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563c4f691350 0x563c4fa38430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:36.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.798+0000 7fd263aba740 1 -- 172.21.15.7:0/1509964764 >> 172.21.15.7:0/1509964764 conn(0x563c4f685740 msgr2=0x563c4fa36320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:36.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.798+0000 7fd263aba740 1 -- 172.21.15.7:0/1509964764 shutdown_connections 2024-09-21T06:38:36.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.798+0000 7fd263aba740 1 -- 172.21.15.7:0/1509964764 wait complete. 2024-09-21T06:38:36.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.798+0000 7fd263aba740 1 -- start start 2024-09-21T06:38:36.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.798+0000 7fd263aba740 1 Processor -- start 2024-09-21T06:38:36.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.799+0000 7fd263aba740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563c4f668490 0x563c4fa43fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:36.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.799+0000 7fd263aba740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c4f670670 0x563c4fa444f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:36.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.799+0000 7fd263aba740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563c4f691350 0x563c4fa4ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:36.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.799+0000 7fd263aba740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x563c4f7ff890 con 0x563c4f670670 2024-09-21T06:38:36.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.799+0000 7fd263aba740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x563c4f938d40 con 0x563c4f691350 2024-09-21T06:38:36.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.799+0000 7fd263aba740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x563c4fa46c10 con 0x563c4f668490 2024-09-21T06:38:36.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.799+0000 7fd263aba740 10 client.0 _ll_register_callbacks cb 0x563c4f99cc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:38:36.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.799+0000 7fd256ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c4f670670 0x563c4fa444f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:36.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.799+0000 7fd256ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c4f670670 0x563c4fa444f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52038/0 (socket says 172.21.15.7:52038) 2024-09-21T06:38:36.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.799+0000 7fd256ffd640 1 -- 172.21.15.7:0/3589062535 learned_addr learned my addr 172.21.15.7:0/3589062535 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:38:36.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.799+0000 7fd24ffff640 1 --2- 172.21.15.7:0/3589062535 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563c4f691350 0x563c4fa4ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:36.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.799+0000 7fd24ffff640 1 --2- 172.21.15.7:0/3589062535 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563c4f668490 0x563c4fa43fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:36.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.799+0000 7fd256ffd640 1 -- 172.21.15.7:0/3589062535 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563c4f668490 msgr2=0x563c4fa43fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:36.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.799+0000 7fd256ffd640 1 --2- 172.21.15.7:0/3589062535 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563c4f668490 0x563c4fa43fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:36.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.799+0000 7fd256ffd640 1 -- 172.21.15.7:0/3589062535 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563c4f691350 msgr2=0x563c4fa4ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:36.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.799+0000 7fd256ffd640 1 --2- 172.21.15.7:0/3589062535 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563c4f691350 0x563c4fa4ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:36.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.800+0000 7fd256ffd640 1 -- 172.21.15.7:0/3589062535 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c4fa50490 con 0x563c4f670670 2024-09-21T06:38:36.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.800+0000 7fd256ffd640 1 --2- 172.21.15.7:0/3589062535 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c4f670670 0x563c4fa444f0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fd248012b10 tx=0x7fd24800f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4545802416aac40f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:36.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.800+0000 7fd23e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:38:36.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.800+0000 7fd23e7fc640 1 -- 172.21.15.7:0/3589062535 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd24800fb40 con 0x563c4f670670 2024-09-21T06:38:36.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.800+0000 7fd23e7fc640 1 -- 172.21.15.7:0/3589062535 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fd24800fce0 con 0x563c4f670670 2024-09-21T06:38:36.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.800+0000 7fd263aba740 1 -- 172.21.15.7:0/3589062535 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd2400043d0 con 0x563c4f670670 2024-09-21T06:38:36.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.800+0000 7fd23e7fc640 1 -- 172.21.15.7:0/3589062535 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd248021030 con 0x563c4f670670 2024-09-21T06:38:36.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.800+0000 7fd263aba740 10 client.15996 fetch_fsmap learned FSMap version 25 2024-09-21T06:38:36.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.800+0000 7fd263aba740 1 -- 172.21.15.7:0/3589062535 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563c4fa52e20 con 0x563c4f670670 2024-09-21T06:38:36.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.800+0000 7fd23e7fc640 1 -- 172.21.15.7:0/3589062535 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2400043d0 con 0x563c4f670670 2024-09-21T06:38:36.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.801+0000 7fd23e7fc640 1 -- 172.21.15.7:0/3589062535 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd248003c10 con 0x563c4f670670 2024-09-21T06:38:36.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.801+0000 7fd263aba740 10 client.15996 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:38:36.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.801+0000 7fd263aba740 10 client.15996 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:38:36.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.801+0000 7fd263aba740 20 client.15996 populate_metadata read hostname 'smithi007' 2024-09-21T06:38:36.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.801+0000 7fd263aba740 1 --2- 172.21.15.7:0/3589062535 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x563c4f64fcd0 0x563c4fa562f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:36.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.801+0000 7fd263aba740 4 client.15996 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:38:36.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.801+0000 7fd263aba740 1 -- 172.21.15.7:0/3589062535 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563c4f9b0db0 con 0x563c4f64fcd0 2024-09-21T06:38:36.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.801+0000 7fd24ffff640 1 --2- 172.21.15.7:0/3589062535 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x563c4f64fcd0 0x563c4fa562f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:36.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.802+0000 7fd23e7fc640 10 client.15996 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:38:36.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.802+0000 7fd24ffff640 1 --2- 172.21.15.7:0/3589062535 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x563c4f64fcd0 0x563c4fa562f0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1bb51cfeb0313cc9 server_cookie=b4146434fd2edc3a in_seq=0 out_seq=0 2024-09-21T06:38:36.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.802+0000 7fd23e7fc640 1 -- 172.21.15.7:0/3589062535 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563c4f9b0db0 con 0x563c4f64fcd0 2024-09-21T06:38:36.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.802+0000 7fd23e7fc640 10 client.15996 handle_command_reply: tid=0 2024-09-21T06:38:36.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.802+0000 7fd263aba740 1 client.15996 shutdown 2024-09-21T06:38:36.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.803+0000 7fd263aba740 1 -- 172.21.15.7:0/3589062535 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c4f670670 msgr2=0x563c4fa444f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:36.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.803+0000 7fd263aba740 1 --2- 172.21.15.7:0/3589062535 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c4f670670 0x563c4fa444f0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fd248012b10 tx=0x7fd24800f3c0 comp rx=0 tx=0).stop 2024-09-21T06:38:36.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.803+0000 7fd263aba740 1 -- 172.21.15.7:0/3589062535 shutdown_connections 2024-09-21T06:38:36.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.803+0000 7fd263aba740 1 --2- 172.21.15.7:0/3589062535 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x563c4f64fcd0 0x563c4fa562f0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:36.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.803+0000 7fd263aba740 1 --2- 172.21.15.7:0/3589062535 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563c4f691350 0x563c4fa4ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:36.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.803+0000 7fd263aba740 1 --2- 172.21.15.7:0/3589062535 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c4f670670 0x563c4fa444f0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:36.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.803+0000 7fd263aba740 1 --2- 172.21.15.7:0/3589062535 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563c4f668490 0x563c4fa43fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:36.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.803+0000 7fd263aba740 1 -- 172.21.15.7:0/3589062535 >> 172.21.15.7:0/3589062535 conn(0x563c4f685740 msgr2=0x563c4fa3b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:36.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.803+0000 7fd23e7fc640 0 client.15996 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:38:36.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.803+0000 7fd263aba740 1 -- 172.21.15.7:0/3589062535 shutdown_connections 2024-09-21T06:38:36.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.803+0000 7fd263aba740 1 -- 172.21.15.7:0/3589062535 wait complete. 2024-09-21T06:38:36.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.803+0000 7fd263aba740 20 client.15996 trim_cache size 0 max 16384 2024-09-21T06:38:36.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.821+0000 7fd263aba740 1 Processor -- start 2024-09-21T06:38:36.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.821+0000 7fd263aba740 1 -- start start 2024-09-21T06:38:36.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.822+0000 7fd263aba740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563c4f668490 0x563c4fa3e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:36.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.822+0000 7fd263aba740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563c4f670670 0x563c4fa4fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:36.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.822+0000 7fd263aba740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c4f691350 0x563c4fa40fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:36.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.822+0000 7fd263aba740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd2581afbd0 con 0x563c4f691350 2024-09-21T06:38:36.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.822+0000 7fd263aba740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd2581ad4a0 con 0x563c4f668490 2024-09-21T06:38:36.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.822+0000 7fd263aba740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd2581ab2d0 con 0x563c4f670670 2024-09-21T06:38:36.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.822+0000 7fd24ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c4f691350 0x563c4fa40fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:36.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.822+0000 7fd24ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c4f691350 0x563c4fa40fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52054/0 (socket says 172.21.15.7:52054) 2024-09-21T06:38:36.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.822+0000 7fd24ffff640 1 -- 172.21.15.7:0/3919456543 learned_addr learned my addr 172.21.15.7:0/3919456543 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:38:36.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.822+0000 7fd24ffff640 1 --2- 172.21.15.7:0/3919456543 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563c4f668490 0x563c4fa3e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:36.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.822+0000 7fd256ffd640 1 --2- 172.21.15.7:0/3919456543 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563c4f670670 0x563c4fa4fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:36.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.822+0000 7fd24ffff640 1 -- 172.21.15.7:0/3919456543 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563c4f670670 msgr2=0x563c4fa4fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:36.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.823+0000 7fd24ffff640 1 --2- 172.21.15.7:0/3919456543 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563c4f670670 0x563c4fa4fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:36.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.823+0000 7fd24ffff640 1 -- 172.21.15.7:0/3919456543 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563c4f668490 msgr2=0x563c4fa3e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:36.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.823+0000 7fd24ffff640 1 --2- 172.21.15.7:0/3919456543 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563c4f668490 0x563c4fa3e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:36.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.823+0000 7fd24ffff640 1 -- 172.21.15.7:0/3919456543 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c4fa3a720 con 0x563c4f691350 2024-09-21T06:38:36.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.823+0000 7fd24ffff640 1 --2- 172.21.15.7:0/3919456543 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c4f691350 0x563c4fa40fa0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fd240005130 tx=0x7fd240005160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acd624f18ad100c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:36.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.823+0000 7fd24cff9640 1 -- 172.21.15.7:0/3919456543 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd240011810 con 0x563c4f691350 2024-09-21T06:38:36.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.823+0000 7fd24cff9640 1 -- 172.21.15.7:0/3919456543 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2400056a0 con 0x563c4f691350 2024-09-21T06:38:36.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.823+0000 7fd24cff9640 1 -- 172.21.15.7:0/3919456543 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd24002a440 con 0x563c4f691350 2024-09-21T06:38:36.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.824+0000 7fd263aba740 1 -- 172.21.15.7:0/3919456543 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c4f691350 msgr2=0x563c4fa40fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:36.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.824+0000 7fd263aba740 1 --2- 172.21.15.7:0/3919456543 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c4f691350 0x563c4fa40fa0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fd240005130 tx=0x7fd240005160 comp rx=0 tx=0).stop 2024-09-21T06:38:36.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.824+0000 7fd263aba740 1 -- 172.21.15.7:0/3919456543 shutdown_connections 2024-09-21T06:38:36.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.824+0000 7fd263aba740 1 --2- 172.21.15.7:0/3919456543 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c4f691350 0x563c4fa40fa0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:36.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.824+0000 7fd263aba740 1 --2- 172.21.15.7:0/3919456543 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563c4f670670 0x563c4fa4fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:36.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.824+0000 7fd263aba740 1 --2- 172.21.15.7:0/3919456543 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563c4f668490 0x563c4fa3e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:36.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.824+0000 7fd263aba740 1 -- 172.21.15.7:0/3919456543 >> 172.21.15.7:0/3919456543 conn(0x563c4f685740 msgr2=0x563c4fa42630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:36.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.824+0000 7fd263aba740 1 -- 172.21.15.7:0/3919456543 shutdown_connections 2024-09-21T06:38:36.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.824+0000 7fd263aba740 1 -- 172.21.15.7:0/3919456543 wait complete. 2024-09-21T06:38:36.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.825+0000 7fd263aba740 1 -- start start 2024-09-21T06:38:36.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.825+0000 7fd263aba740 1 Processor -- start 2024-09-21T06:38:36.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.825+0000 7fd263aba740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563c4f668490 0x563c4fa487b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:36.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.825+0000 7fd263aba740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c4f670670 0x563c4fa48d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:36.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.825+0000 7fd263aba740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563c4f691350 0x563c4fab9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:36.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.825+0000 7fd263aba740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd2581ab960 con 0x563c4f670670 2024-09-21T06:38:36.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.825+0000 7fd263aba740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd2581acdd0 con 0x563c4f691350 2024-09-21T06:38:36.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.825+0000 7fd263aba740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd2581ac030 con 0x563c4f668490 2024-09-21T06:38:36.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.825+0000 7fd263aba740 10 client.0 _ll_register_callbacks cb 0x7fd248009ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:38:36.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.825+0000 7fd256ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c4f670670 0x563c4fa48d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:36.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.825+0000 7fd24ffff640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563c4f668490 0x563c4fa487b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:36.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.825+0000 7fd24ffff640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563c4f668490 0x563c4fa487b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.7:40436/0 (socket says 172.21.15.7:40436) 2024-09-21T06:38:36.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.825+0000 7fd256ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c4f670670 0x563c4fa48d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52062/0 (socket says 172.21.15.7:52062) 2024-09-21T06:38:36.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.825+0000 7fd24ffff640 1 -- 172.21.15.7:0/2529637368 learned_addr learned my addr 172.21.15.7:0/2529637368 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:38:36.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.825+0000 7fd24ffff640 1 --2- 172.21.15.7:0/2529637368 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563c4f691350 0x563c4fab9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:36.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.826+0000 7fd256ffd640 1 -- 172.21.15.7:0/2529637368 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563c4f668490 msgr2=0x563c4fa487b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:36.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.826+0000 7fd256ffd640 1 --2- 172.21.15.7:0/2529637368 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563c4f668490 0x563c4fa487b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:36.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.826+0000 7fd256ffd640 1 -- 172.21.15.7:0/2529637368 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563c4f691350 msgr2=0x563c4fab9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:36.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.826+0000 7fd256ffd640 1 --2- 172.21.15.7:0/2529637368 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563c4f691350 0x563c4fab9cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:36.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.826+0000 7fd256ffd640 1 -- 172.21.15.7:0/2529637368 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c4faba320 con 0x563c4f670670 2024-09-21T06:38:36.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.826+0000 7fd24ffff640 1 --2- 172.21.15.7:0/2529637368 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563c4f668490 0x563c4fa487b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:38:36.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.826+0000 7fd256ffd640 1 --2- 172.21.15.7:0/2529637368 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c4f670670 0x563c4fa48d90 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fd248001eb0 tx=0x7fd24800f920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=556226c9e83bffd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:36.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.826+0000 7fd23e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:38:36.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.826+0000 7fd23e7fc640 1 -- 172.21.15.7:0/2529637368 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd248034060 con 0x563c4f670670 2024-09-21T06:38:36.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.826+0000 7fd23e7fc640 1 -- 172.21.15.7:0/2529637368 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fd248022070 con 0x563c4f670670 2024-09-21T06:38:36.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.826+0000 7fd263aba740 1 -- 172.21.15.7:0/2529637368 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd2400056a0 con 0x563c4f670670 2024-09-21T06:38:36.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.826+0000 7fd23e7fc640 1 -- 172.21.15.7:0/2529637368 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd24802b040 con 0x563c4f670670 2024-09-21T06:38:36.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.826+0000 7fd263aba740 10 client.16002 fetch_fsmap learned FSMap version 25 2024-09-21T06:38:36.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.826+0000 7fd263aba740 1 -- 172.21.15.7:0/2529637368 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563c4fac16a0 con 0x563c4f670670 2024-09-21T06:38:36.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.827+0000 7fd23e7fc640 1 -- 172.21.15.7:0/2529637368 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2400056a0 con 0x563c4f670670 2024-09-21T06:38:36.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.827+0000 7fd23e7fc640 1 -- 172.21.15.7:0/2529637368 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd248003b90 con 0x563c4f670670 2024-09-21T06:38:36.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.827+0000 7fd263aba740 10 client.16002 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:38:36.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.827+0000 7fd263aba740 10 client.16002 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:38:36.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.827+0000 7fd263aba740 20 client.16002 populate_metadata read hostname 'smithi007' 2024-09-21T06:38:36.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.827+0000 7fd263aba740 1 --2- 172.21.15.7:0/2529637368 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x563c4f625080 0x563c4fac3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:36.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.827+0000 7fd263aba740 4 client.16002 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:38:36.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.827+0000 7fd263aba740 1 -- 172.21.15.7:0/2529637368 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x563c4f9ac860 con 0x563c4f625080 2024-09-21T06:38:36.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.827+0000 7fd24ffff640 1 --2- 172.21.15.7:0/2529637368 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x563c4f625080 0x563c4fac3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:36.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.828+0000 7fd24ffff640 1 --2- 172.21.15.7:0/2529637368 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x563c4f625080 0x563c4fac3e90 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=31f932c2f7032bed server_cookie=656ff3cd9c205232 in_seq=0 out_seq=0 2024-09-21T06:38:36.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.828+0000 7fd23e7fc640 10 client.16002 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:38:36.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.830+0000 7fd23e7fc640 1 -- 172.21.15.7:0/2529637368 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x563c4f9ac860 con 0x563c4f625080 2024-09-21T06:38:36.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.830+0000 7fd23e7fc640 10 client.16002 handle_command_reply: tid=0 2024-09-21T06:38:36.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.830+0000 7fd263aba740 1 client.16002 shutdown 2024-09-21T06:38:36.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.830+0000 7fd263aba740 1 -- 172.21.15.7:0/2529637368 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c4f670670 msgr2=0x563c4fa48d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:36.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.830+0000 7fd263aba740 1 --2- 172.21.15.7:0/2529637368 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c4f670670 0x563c4fa48d90 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fd248001eb0 tx=0x7fd24800f920 comp rx=0 tx=0).stop 2024-09-21T06:38:36.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.830+0000 7fd263aba740 1 -- 172.21.15.7:0/2529637368 shutdown_connections 2024-09-21T06:38:36.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.830+0000 7fd263aba740 1 --2- 172.21.15.7:0/2529637368 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x563c4f625080 0x563c4fac3e90 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:36.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.831+0000 7fd263aba740 1 --2- 172.21.15.7:0/2529637368 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563c4f691350 0x563c4fab9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:36.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.831+0000 7fd23e7fc640 0 client.16002 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:38:36.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.831+0000 7fd263aba740 1 --2- 172.21.15.7:0/2529637368 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563c4f670670 0x563c4fa48d90 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:36.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.831+0000 7fd263aba740 1 --2- 172.21.15.7:0/2529637368 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563c4f668490 0x563c4fa487b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:36.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.831+0000 7fd263aba740 1 -- 172.21.15.7:0/2529637368 >> 172.21.15.7:0/2529637368 conn(0x563c4f685740 msgr2=0x563c4fa421f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:36.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.831+0000 7fd263aba740 1 -- 172.21.15.7:0/2529637368 shutdown_connections 2024-09-21T06:38:36.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.831+0000 7fd263aba740 1 -- 172.21.15.7:0/2529637368 wait complete. 2024-09-21T06:38:36.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.831+0000 7fd263aba740 20 client.16002 trim_cache size 0 max 16384 2024-09-21T06:38:36.835 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:38:36.835 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0, 2024-09-21T06:38:36.835 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_tag": "b0327167-8c41-4286-8afc-7f0780972fd7", 2024-09-21T06:38:36.835 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": "asynchronous" 2024-09-21T06:38:36.835 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:38:36.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.832+0000 7fd25d546640 1 -- 172.21.15.7:0/2456861725 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fd2440b66b0 msgr2=0x7fd2440b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:36.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.832+0000 7fd25d546640 1 --2- 172.21.15.7:0/2456861725 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fd2440b66b0 0x7fd2440b8bc0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd2500097b0 tx=0x7fd2500b7040 comp rx=0 tx=0).stop 2024-09-21T06:38:36.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.832+0000 7fd25d546640 1 -- 172.21.15.7:0/2456861725 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd258108cf0 msgr2=0x7fd25819bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:36.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.832+0000 7fd25d546640 1 --2- 172.21.15.7:0/2456861725 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd258108cf0 0x7fd25819bd30 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fd250005cc0 tx=0x7fd250031700 comp rx=0 tx=0).stop 2024-09-21T06:38:36.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.832+0000 7fd25d546640 1 -- 172.21.15.7:0/2456861725 shutdown_connections 2024-09-21T06:38:36.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.832+0000 7fd25d546640 1 --2- 172.21.15.7:0/2456861725 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fd2440b66b0 0x7fd2440b8bc0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:36.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.832+0000 7fd25d546640 1 --2- 172.21.15.7:0/2456861725 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd258108cf0 0x7fd25819bd30 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:36.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.832+0000 7fd25d546640 1 --2- 172.21.15.7:0/2456861725 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd2581083a0 0x7fd25819b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:36.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.832+0000 7fd25d546640 1 --2- 172.21.15.7:0/2456861725 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd258102a60 0x7fd25819b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:36.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.832+0000 7fd25d546640 1 -- 172.21.15.7:0/2456861725 >> 172.21.15.7:0/2456861725 conn(0x7fd258079730 msgr2=0x7fd258104410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:36.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.832+0000 7fd25d546640 1 -- 172.21.15.7:0/2456861725 shutdown_connections 2024-09-21T06:38:36.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:36.832+0000 7fd25d546640 1 -- 172.21.15.7:0/2456861725 wait complete. 2024-09-21T06:38:37.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:38:36 smithi007 ceph-mon[30983]: pgmap v391: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 577 MiB/s wr, 206 op/s 2024-09-21T06:38:37.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:38:36 smithi144 ceph-mon[34653]: pgmap v391: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 577 MiB/s wr, 206 op/s 2024-09-21T06:38:37.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:38:36 smithi018 ceph-mon[34477]: pgmap v391: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 577 MiB/s wr, 206 op/s 2024-09-21T06:38:37.676 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:38:37.783 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-09-21T06:38:37.783 INFO:tasks.workunit.client.0.smithi007.stdout: Children see throughput for 1 re-readers = 8973876.00 kB/sec 2024-09-21T06:38:37.783 INFO:tasks.workunit.client.0.smithi007.stdout: Parent sees throughput for 1 re-readers = 8972287.57 kB/sec 2024-09-21T06:38:37.783 INFO:tasks.workunit.client.0.smithi007.stdout: Min throughput per process = 8973876.00 kB/sec 2024-09-21T06:38:37.783 INFO:tasks.workunit.client.0.smithi007.stdout: Max throughput per process = 8973876.00 kB/sec 2024-09-21T06:38:37.783 INFO:tasks.workunit.client.0.smithi007.stdout: Avg throughput per process = 8973876.00 kB/sec 2024-09-21T06:38:37.783 INFO:tasks.workunit.client.0.smithi007.stdout: Min xfer = 10485760.00 kB 2024-09-21T06:38:37.950 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:38:38.071 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:38:37 smithi007 ceph-mon[30983]: scrub queued for path: / 2024-09-21T06:38:38.071 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:38:37 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T06:38:38.072 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:38:37 smithi007 ceph-mon[30983]: scrub summary: active paths [/] 2024-09-21T06:38:38.072 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:38:37 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T06:38:38.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:38:37 smithi144 ceph-mon[34653]: scrub queued for path: / 2024-09-21T06:38:38.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:38:37 smithi144 ceph-mon[34653]: scrub summary: idle+waiting paths [/] 2024-09-21T06:38:38.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:38:37 smithi144 ceph-mon[34653]: scrub summary: active paths [/] 2024-09-21T06:38:38.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:38:37 smithi144 ceph-mon[34653]: scrub summary: idle+waiting paths [/] 2024-09-21T06:38:38.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:38:37 smithi018 ceph-mon[34477]: scrub queued for path: / 2024-09-21T06:38:38.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:38:37 smithi018 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-21T06:38:38.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:38:37 smithi018 ceph-mon[34477]: scrub summary: active paths [/] 2024-09-21T06:38:38.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:38:37 smithi018 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-21T06:38:38.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.530+0000 7f10c9477640 1 -- 172.21.15.7:0/816630702 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10c41094e0 msgr2=0x7f10c41098f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:38.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.530+0000 7f10c9477640 1 --2- 172.21.15.7:0/816630702 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10c41094e0 0x7f10c41098f0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f10ac009900 tx=0x7f10ac02a410 comp rx=0 tx=0).stop 2024-09-21T06:38:38.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.530+0000 7f10c9477640 1 -- 172.21.15.7:0/816630702 shutdown_connections 2024-09-21T06:38:38.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.530+0000 7f10c9477640 1 --2- 172.21.15.7:0/816630702 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10c4109e30 0x7f10c4110660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:38.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.530+0000 7f10c9477640 1 --2- 172.21.15.7:0/816630702 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10c41094e0 0x7f10c41098f0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:38.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.530+0000 7f10c9477640 1 --2- 172.21.15.7:0/816630702 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10c4103ba0 0x7f10c4103fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:38.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.530+0000 7f10c9477640 1 -- 172.21.15.7:0/816630702 >> 172.21.15.7:0/816630702 conn(0x7f10c40ff630 msgr2=0x7f10c4101a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:38.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.530+0000 7f10c9477640 1 -- 172.21.15.7:0/816630702 shutdown_connections 2024-09-21T06:38:38.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.530+0000 7f10c9477640 1 -- 172.21.15.7:0/816630702 wait complete. 2024-09-21T06:38:38.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.531+0000 7f10c9477640 1 Processor -- start 2024-09-21T06:38:38.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.532+0000 7f10c9477640 1 -- start start 2024-09-21T06:38:38.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.532+0000 7f10c9477640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10c4103ba0 0x7f10c4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:38.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.532+0000 7f10c9477640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10c41094e0 0x7f10c4075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:38.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.532+0000 7f10c9477640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10c4109e30 0x7f10c4076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:38.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.532+0000 7f10c9477640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f10c4113af0 con 0x7f10c4109e30 2024-09-21T06:38:38.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.532+0000 7f10c9477640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f10c4113970 con 0x7f10c41094e0 2024-09-21T06:38:38.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.532+0000 7f10c9477640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f10c4113c70 con 0x7f10c4103ba0 2024-09-21T06:38:38.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.532+0000 7f10c37fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10c4109e30 0x7f10c4076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:38.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.532+0000 7f10c37fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10c4109e30 0x7f10c4076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52086/0 (socket says 172.21.15.7:52086) 2024-09-21T06:38:38.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.532+0000 7f10c37fe640 1 -- 172.21.15.7:0/307117958 learned_addr learned my addr 172.21.15.7:0/307117958 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:38:38.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.532+0000 7f10c2ffd640 1 --2- 172.21.15.7:0/307117958 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10c4103ba0 0x7f10c4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:38.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.532+0000 7f10c27fc640 1 --2- 172.21.15.7:0/307117958 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10c41094e0 0x7f10c4075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:38.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.532+0000 7f10c37fe640 1 -- 172.21.15.7:0/307117958 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10c4103ba0 msgr2=0x7f10c4075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:38.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.532+0000 7f10c37fe640 1 --2- 172.21.15.7:0/307117958 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10c4103ba0 0x7f10c4075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:38.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.532+0000 7f10c37fe640 1 -- 172.21.15.7:0/307117958 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10c41094e0 msgr2=0x7f10c4075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:38.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.532+0000 7f10c37fe640 1 --2- 172.21.15.7:0/307117958 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10c41094e0 0x7f10c4075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:38.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.532+0000 7f10c37fe640 1 -- 172.21.15.7:0/307117958 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10c41a8710 con 0x7f10c4109e30 2024-09-21T06:38:38.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.533+0000 7f10c37fe640 1 --2- 172.21.15.7:0/307117958 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10c4109e30 0x7f10c4076190 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f10bc00c970 tx=0x7f10bc00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:38.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.533+0000 7f10bbfff640 1 -- 172.21.15.7:0/307117958 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10bc007bb0 con 0x7f10c4109e30 2024-09-21T06:38:38.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.533+0000 7f10c9477640 1 -- 172.21.15.7:0/307117958 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10c41a8a00 con 0x7f10c4109e30 2024-09-21T06:38:38.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.533+0000 7f10bbfff640 1 -- 172.21.15.7:0/307117958 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f10bc007d50 con 0x7f10c4109e30 2024-09-21T06:38:38.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.533+0000 7f10bbfff640 1 -- 172.21.15.7:0/307117958 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10bc018770 con 0x7f10c4109e30 2024-09-21T06:38:38.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.533+0000 7f10c9477640 1 -- 172.21.15.7:0/307117958 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10c41a8ec0 con 0x7f10c4109e30 2024-09-21T06:38:38.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.535+0000 7f10cf9eb740 1 Processor -- start 2024-09-21T06:38:38.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.536+0000 7f10bbfff640 1 -- 172.21.15.7:0/307117958 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f10bc00f990 con 0x7f10c4109e30 2024-09-21T06:38:38.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.536+0000 7f10cf9eb740 1 -- start start 2024-09-21T06:38:38.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.536+0000 7f10cf9eb740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561c1154f070 0x561c118f6650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:38.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.536+0000 7f10cf9eb740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561c115261b0 0x561c118f6b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:38.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.536+0000 7f10cf9eb740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561c1152e390 0x561c118f70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:38.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.536+0000 7f10cf9eb740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x561c1186ce50 con 0x561c1154f070 2024-09-21T06:38:38.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.536+0000 7f10cf9eb740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x561c1185c280 con 0x561c1152e390 2024-09-21T06:38:38.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.536+0000 7f10cf9eb740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x561c11860090 con 0x561c115261b0 2024-09-21T06:38:38.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.536+0000 7f10c27fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561c1154f070 0x561c118f6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:38.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.536+0000 7f10c27fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561c1154f070 0x561c118f6650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52100/0 (socket says 172.21.15.7:52100) 2024-09-21T06:38:38.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.536+0000 7f10c27fc640 1 -- 172.21.15.7:0/2415315949 learned_addr learned my addr 172.21.15.7:0/2415315949 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:38:38.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.537+0000 7f10c27fc640 1 --2- 172.21.15.7:0/2415315949 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561c1152e390 0x561c118f70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:38.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.537+0000 7f10c2ffd640 1 --2- 172.21.15.7:0/2415315949 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561c115261b0 0x561c118f6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:38.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.537+0000 7f10c27fc640 1 -- 172.21.15.7:0/2415315949 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561c115261b0 msgr2=0x561c118f6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:38.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.537+0000 7f10c27fc640 1 --2- 172.21.15.7:0/2415315949 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561c115261b0 0x561c118f6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:38.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.537+0000 7f10bbfff640 1 --2- 172.21.15.7:0/307117958 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f10b00b6680 0x7f10b00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:38.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.537+0000 7f10c27fc640 1 -- 172.21.15.7:0/2415315949 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561c1152e390 msgr2=0x561c118f70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:38.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.537+0000 7f10c27fc640 1 --2- 172.21.15.7:0/2415315949 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561c1152e390 0x561c118f70d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:38.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.537+0000 7f10c27fc640 1 -- 172.21.15.7:0/2415315949 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c115ba650 con 0x561c1154f070 2024-09-21T06:38:38.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.537+0000 7f10c37fe640 1 --2- 172.21.15.7:0/307117958 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f10b00b6680 0x7f10b00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:38.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.537+0000 7f10c27fc640 1 --2- 172.21.15.7:0/2415315949 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561c1154f070 0x561c118f6650 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f10ac009900 tx=0x7f10ac000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29543a180c13c0a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:38.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.537+0000 7f10bbfff640 1 -- 172.21.15.7:0/307117958 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f10bc0e76d0 con 0x7f10c4109e30 2024-09-21T06:38:38.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.537+0000 7f10b97fa640 1 -- 172.21.15.7:0/2415315949 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10ac044030 con 0x561c1154f070 2024-09-21T06:38:38.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.537+0000 7f10b97fa640 1 -- 172.21.15.7:0/2415315949 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f10ac031670 con 0x561c1154f070 2024-09-21T06:38:38.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.537+0000 7f10b97fa640 1 -- 172.21.15.7:0/2415315949 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10ac035040 con 0x561c1154f070 2024-09-21T06:38:38.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.538+0000 7f10cf9eb740 1 -- 172.21.15.7:0/2415315949 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561c1154f070 msgr2=0x561c118f6650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:38.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.538+0000 7f10c37fe640 1 --2- 172.21.15.7:0/307117958 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f10b00b6680 0x7f10b00b8b90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f10bc0aa830 tx=0x7f10bc07a270 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:38.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.538+0000 7f10cf9eb740 1 --2- 172.21.15.7:0/2415315949 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561c1154f070 0x561c118f6650 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f10ac009900 tx=0x7f10ac000bc0 comp rx=0 tx=0).stop 2024-09-21T06:38:38.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.538+0000 7f10cf9eb740 1 -- 172.21.15.7:0/2415315949 shutdown_connections 2024-09-21T06:38:38.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.538+0000 7f10cf9eb740 1 --2- 172.21.15.7:0/2415315949 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561c1152e390 0x561c118f70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:38.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.538+0000 7f10cf9eb740 1 --2- 172.21.15.7:0/2415315949 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561c115261b0 0x561c118f6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:38.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.538+0000 7f10cf9eb740 1 --2- 172.21.15.7:0/2415315949 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561c1154f070 0x561c118f6650 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:38.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.538+0000 7f10cf9eb740 1 -- 172.21.15.7:0/2415315949 >> 172.21.15.7:0/2415315949 conn(0x561c11543460 msgr2=0x561c118f4540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:38.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.538+0000 7f10cf9eb740 1 -- 172.21.15.7:0/2415315949 shutdown_connections 2024-09-21T06:38:38.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.538+0000 7f10cf9eb740 1 -- 172.21.15.7:0/2415315949 wait complete. 2024-09-21T06:38:38.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.539+0000 7f10cf9eb740 1 -- start start 2024-09-21T06:38:38.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.539+0000 7f10cf9eb740 1 Processor -- start 2024-09-21T06:38:38.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.539+0000 7f10cf9eb740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561c115261b0 0x561c11901d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:38.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.539+0000 7f10cf9eb740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561c1152e390 0x561c11902280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:38.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.539+0000 7f10cf9eb740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561c1154f070 0x561c1190e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:38.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.539+0000 7f10cf9eb740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x561c116bd700 con 0x561c115261b0 2024-09-21T06:38:38.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.539+0000 7f10cf9eb740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x561c117f7110 con 0x561c1152e390 2024-09-21T06:38:38.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.539+0000 7f10cf9eb740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x561c11904dd0 con 0x561c1154f070 2024-09-21T06:38:38.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.539+0000 7f10cf9eb740 10 client.0 _ll_register_callbacks cb 0x561c11810990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:38:38.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.539+0000 7f10c27fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561c115261b0 0x561c11901d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:38.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.539+0000 7f10c27fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561c115261b0 0x561c11901d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52110/0 (socket says 172.21.15.7:52110) 2024-09-21T06:38:38.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.539+0000 7f10c27fc640 1 -- 172.21.15.7:0/720989292 learned_addr learned my addr 172.21.15.7:0/720989292 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:38:38.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.540+0000 7f10c2ffd640 1 --2- 172.21.15.7:0/720989292 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561c1152e390 0x561c11902280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:38.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.540+0000 7f10c27fc640 1 --2- 172.21.15.7:0/720989292 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561c1154f070 0x561c1190e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:38.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.540+0000 7f10c27fc640 1 -- 172.21.15.7:0/720989292 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561c1154f070 msgr2=0x561c1190e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:38.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.540+0000 7f10c27fc640 1 --2- 172.21.15.7:0/720989292 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561c1154f070 0x561c1190e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:38.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.540+0000 7f10c27fc640 1 -- 172.21.15.7:0/720989292 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561c1152e390 msgr2=0x561c11902280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:38.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.540+0000 7f10c27fc640 1 --2- 172.21.15.7:0/720989292 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561c1152e390 0x561c11902280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:38.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.540+0000 7f10c27fc640 1 -- 172.21.15.7:0/720989292 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c11824c40 con 0x561c115261b0 2024-09-21T06:38:38.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.540+0000 7f10c2ffd640 1 --2- 172.21.15.7:0/720989292 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561c1152e390 0x561c11902280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:38:38.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.540+0000 7f10c27fc640 1 --2- 172.21.15.7:0/720989292 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561c115261b0 0x561c11901d40 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f10ac005790 tx=0x7f10ac0053c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24e950d30fcdff27 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:38.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.540+0000 7f10aa7fc640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:38:38.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.540+0000 7f10aa7fc640 1 -- 172.21.15.7:0/720989292 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10ac035030 con 0x561c115261b0 2024-09-21T06:38:38.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.540+0000 7f10aa7fc640 1 -- 172.21.15.7:0/720989292 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f10ac0049a0 con 0x561c115261b0 2024-09-21T06:38:38.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.540+0000 7f10cf9eb740 1 -- 172.21.15.7:0/720989292 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f10ac031670 con 0x561c115261b0 2024-09-21T06:38:38.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.540+0000 7f10aa7fc640 1 -- 172.21.15.7:0/720989292 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f10ac004ba0 con 0x561c115261b0 2024-09-21T06:38:38.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.540+0000 7f10cf9eb740 10 client.16014 fetch_fsmap learned FSMap version 25 2024-09-21T06:38:38.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.540+0000 7f10cf9eb740 1 -- 172.21.15.7:0/720989292 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561c11910ae0 con 0x561c115261b0 2024-09-21T06:38:38.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.541+0000 7f10aa7fc640 1 -- 172.21.15.7:0/720989292 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f10ac031670 con 0x561c115261b0 2024-09-21T06:38:38.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.541+0000 7f10aa7fc640 1 -- 172.21.15.7:0/720989292 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f10ac04acd0 con 0x561c115261b0 2024-09-21T06:38:38.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.541+0000 7f10cf9eb740 10 client.16014 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:38:38.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.541+0000 7f10cf9eb740 10 client.16014 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:38:38.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.541+0000 7f10cf9eb740 20 client.16014 populate_metadata read hostname 'smithi007' 2024-09-21T06:38:38.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.541+0000 7f10cf9eb740 1 --2- 172.21.15.7:0/720989292 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x561c1150d9f0 0x561c11913e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:38.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.541+0000 7f10cf9eb740 4 client.16014 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:38:38.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.541+0000 7f10cf9eb740 1 -- 172.21.15.7:0/720989292 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561c1186eda0 con 0x561c1150d9f0 2024-09-21T06:38:38.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.541+0000 7f10c2ffd640 1 --2- 172.21.15.7:0/720989292 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x561c1150d9f0 0x561c11913e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:38.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.542+0000 7f10c2ffd640 1 --2- 172.21.15.7:0/720989292 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x561c1150d9f0 0x561c11913e40 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=517c20e192b63fdd server_cookie=6afe5f6c185d8f36 in_seq=0 out_seq=0 2024-09-21T06:38:38.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.542+0000 7f10aa7fc640 10 client.16014 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:38:38.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.542+0000 7f10aa7fc640 1 -- 172.21.15.7:0/720989292 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561c1186eda0 con 0x561c1150d9f0 2024-09-21T06:38:38.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.542+0000 7f10aa7fc640 10 client.16014 handle_command_reply: tid=0 2024-09-21T06:38:38.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.542+0000 7f10cf9eb740 1 client.16014 shutdown 2024-09-21T06:38:38.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.543+0000 7f10cf9eb740 1 -- 172.21.15.7:0/720989292 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561c115261b0 msgr2=0x561c11901d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:38.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.543+0000 7f10cf9eb740 1 --2- 172.21.15.7:0/720989292 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561c115261b0 0x561c11901d40 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f10ac005790 tx=0x7f10ac0053c0 comp rx=0 tx=0).stop 2024-09-21T06:38:38.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.543+0000 7f10cf9eb740 1 -- 172.21.15.7:0/720989292 shutdown_connections 2024-09-21T06:38:38.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.543+0000 7f10cf9eb740 1 --2- 172.21.15.7:0/720989292 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x561c1150d9f0 0x561c11913e40 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:38.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.543+0000 7f10cf9eb740 1 --2- 172.21.15.7:0/720989292 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561c1154f070 0x561c1190e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:38.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.543+0000 7f10cf9eb740 1 --2- 172.21.15.7:0/720989292 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561c1152e390 0x561c11902280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:38.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.543+0000 7f10aa7fc640 0 client.16014 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:38:38.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.543+0000 7f10cf9eb740 1 --2- 172.21.15.7:0/720989292 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561c115261b0 0x561c11901d40 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:38.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.543+0000 7f10cf9eb740 1 -- 172.21.15.7:0/720989292 >> 172.21.15.7:0/720989292 conn(0x561c11543460 msgr2=0x561c118f9830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:38.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.543+0000 7f10cf9eb740 1 -- 172.21.15.7:0/720989292 shutdown_connections 2024-09-21T06:38:38.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.543+0000 7f10cf9eb740 1 -- 172.21.15.7:0/720989292 wait complete. 2024-09-21T06:38:38.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.543+0000 7f10cf9eb740 20 client.16014 trim_cache size 0 max 16384 2024-09-21T06:38:38.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.560+0000 7f10cf9eb740 1 Processor -- start 2024-09-21T06:38:38.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.560+0000 7f10cf9eb740 1 -- start start 2024-09-21T06:38:38.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.561+0000 7f10cf9eb740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561c115261b0 0x561c118f9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:38.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.561+0000 7f10cf9eb740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561c1152e390 0x561c1190e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:38.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.561+0000 7f10cf9eb740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561c1154f070 0x561c118fef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:38.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.561+0000 7f10cf9eb740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f10c41b3e60 con 0x561c1152e390 2024-09-21T06:38:38.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.561+0000 7f10cf9eb740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f10c41b1730 con 0x561c115261b0 2024-09-21T06:38:38.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.561+0000 7f10cf9eb740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f10c41af560 con 0x561c1154f070 2024-09-21T06:38:38.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.561+0000 7f10c2ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561c1152e390 0x561c1190e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:38.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.561+0000 7f10c2ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561c1152e390 0x561c1190e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52122/0 (socket says 172.21.15.7:52122) 2024-09-21T06:38:38.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.561+0000 7f10c2ffd640 1 -- 172.21.15.7:0/3179093984 learned_addr learned my addr 172.21.15.7:0/3179093984 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:38:38.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.561+0000 7f10c27fc640 1 --2- 172.21.15.7:0/3179093984 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561c1154f070 0x561c118fef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:38.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.561+0000 7f10c27fc640 1 --2- 172.21.15.7:0/3179093984 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561c115261b0 0x561c118f9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:38.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.561+0000 7f10c2ffd640 1 -- 172.21.15.7:0/3179093984 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561c1154f070 msgr2=0x561c118fef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:38.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.561+0000 7f10c2ffd640 1 --2- 172.21.15.7:0/3179093984 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561c1154f070 0x561c118fef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:38.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.561+0000 7f10c2ffd640 1 -- 172.21.15.7:0/3179093984 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561c115261b0 msgr2=0x561c118f9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:38.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.561+0000 7f10c2ffd640 1 --2- 172.21.15.7:0/3179093984 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561c115261b0 0x561c118f9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:38.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.561+0000 7f10c2ffd640 1 -- 172.21.15.7:0/3179093984 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c118f94b0 con 0x561c1152e390 2024-09-21T06:38:38.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.562+0000 7f10c2ffd640 1 --2- 172.21.15.7:0/3179093984 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561c1152e390 0x561c1190e060 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x561c11904dd0 tx=0x7f10b4012af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1627f10557e1d478 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:38.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.562+0000 7f10b8ff9640 1 -- 172.21.15.7:0/3179093984 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10b4029070 con 0x561c1152e390 2024-09-21T06:38:38.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.562+0000 7f10b8ff9640 1 -- 172.21.15.7:0/3179093984 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f10b400fd50 con 0x561c1152e390 2024-09-21T06:38:38.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.562+0000 7f10b8ff9640 1 -- 172.21.15.7:0/3179093984 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10b4020040 con 0x561c1152e390 2024-09-21T06:38:38.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.563+0000 7f10cf9eb740 1 -- 172.21.15.7:0/3179093984 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561c1152e390 msgr2=0x561c1190e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:38.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.563+0000 7f10cf9eb740 1 --2- 172.21.15.7:0/3179093984 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561c1152e390 0x561c1190e060 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x561c11904dd0 tx=0x7f10b4012af0 comp rx=0 tx=0).stop 2024-09-21T06:38:38.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.563+0000 7f10cf9eb740 1 -- 172.21.15.7:0/3179093984 shutdown_connections 2024-09-21T06:38:38.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.563+0000 7f10cf9eb740 1 --2- 172.21.15.7:0/3179093984 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561c1154f070 0x561c118fef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:38.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.563+0000 7f10cf9eb740 1 --2- 172.21.15.7:0/3179093984 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561c1152e390 0x561c1190e060 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:38.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.563+0000 7f10cf9eb740 1 --2- 172.21.15.7:0/3179093984 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561c115261b0 0x561c118f9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:38.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.563+0000 7f10cf9eb740 1 -- 172.21.15.7:0/3179093984 >> 172.21.15.7:0/3179093984 conn(0x561c11543460 msgr2=0x561c118f9750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:38.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.563+0000 7f10cf9eb740 1 -- 172.21.15.7:0/3179093984 shutdown_connections 2024-09-21T06:38:38.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.563+0000 7f10cf9eb740 1 -- 172.21.15.7:0/3179093984 wait complete. 2024-09-21T06:38:38.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.563+0000 7f10cf9eb740 1 -- start start 2024-09-21T06:38:38.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.563+0000 7f10cf9eb740 1 Processor -- start 2024-09-21T06:38:38.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.564+0000 7f10cf9eb740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561c115261b0 0x561c119175d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:38.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.564+0000 7f10cf9eb740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561c1152e390 0x561c11914aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:38.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.564+0000 7f10cf9eb740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561c1154f070 0x561c11914fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:38.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.564+0000 7f10cf9eb740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f10c41afbf0 con 0x561c1154f070 2024-09-21T06:38:38.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.564+0000 7f10cf9eb740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f10c41b1060 con 0x561c115261b0 2024-09-21T06:38:38.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.564+0000 7f10cf9eb740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f10c41b02c0 con 0x561c1152e390 2024-09-21T06:38:38.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.564+0000 7f10cf9eb740 10 client.0 _ll_register_callbacks cb 0x7f10ac0314a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:38:38.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.564+0000 7f10c27fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561c1154f070 0x561c11914fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:38.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.564+0000 7f10c2ffd640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561c1152e390 0x561c11914aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:38.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.564+0000 7f10c27fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561c1154f070 0x561c11914fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52134/0 (socket says 172.21.15.7:52134) 2024-09-21T06:38:38.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.564+0000 7f10c27fc640 1 -- 172.21.15.7:0/3773028412 learned_addr learned my addr 172.21.15.7:0/3773028412 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:38:38.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.564+0000 7f10c27fc640 1 --2- 172.21.15.7:0/3773028412 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561c115261b0 0x561c119175d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:38.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.564+0000 7f10c27fc640 1 -- 172.21.15.7:0/3773028412 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561c1152e390 msgr2=0x561c11914aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:38.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.564+0000 7f10c27fc640 1 --2- 172.21.15.7:0/3773028412 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561c1152e390 0x561c11914aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:38.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.564+0000 7f10c27fc640 1 -- 172.21.15.7:0/3773028412 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561c115261b0 msgr2=0x561c119175d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:38:38.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.564+0000 7f10c27fc640 1 --2- 172.21.15.7:0/3773028412 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561c115261b0 0x561c119175d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:38.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.564+0000 7f10c27fc640 1 -- 172.21.15.7:0/3773028412 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c11915720 con 0x561c1154f070 2024-09-21T06:38:38.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.564+0000 7f10c27fc640 1 --2- 172.21.15.7:0/3773028412 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561c1154f070 0x561c11914fe0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f10ac031440 tx=0x7f10ac005320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a228b1503281e4a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:38:38.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.564+0000 7f10aa7fc640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:38:38.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.565+0000 7f10aa7fc640 1 -- 172.21.15.7:0/3773028412 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10ac035070 con 0x561c1154f070 2024-09-21T06:38:38.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.565+0000 7f10aa7fc640 1 -- 172.21.15.7:0/3773028412 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f10ac03acb0 con 0x561c1154f070 2024-09-21T06:38:38.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.565+0000 7f10cf9eb740 1 -- 172.21.15.7:0/3773028412 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f10b400fd50 con 0x561c1154f070 2024-09-21T06:38:38.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.565+0000 7f10aa7fc640 1 -- 172.21.15.7:0/3773028412 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f10ac044040 con 0x561c1154f070 2024-09-21T06:38:38.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.565+0000 7f10cf9eb740 10 client.16020 fetch_fsmap learned FSMap version 25 2024-09-21T06:38:38.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.565+0000 7f10cf9eb740 1 -- 172.21.15.7:0/3773028412 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561c1197e480 con 0x561c1154f070 2024-09-21T06:38:38.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.565+0000 7f10aa7fc640 1 -- 172.21.15.7:0/3773028412 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f10b400fd50 con 0x561c1154f070 2024-09-21T06:38:38.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.565+0000 7f10aa7fc640 1 -- 172.21.15.7:0/3773028412 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f10ac05e060 con 0x561c1154f070 2024-09-21T06:38:38.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.565+0000 7f10cf9eb740 10 client.16020 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:38:38.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.565+0000 7f10cf9eb740 10 client.16020 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:38:38.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.565+0000 7f10cf9eb740 20 client.16020 populate_metadata read hostname 'smithi007' 2024-09-21T06:38:38.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.565+0000 7f10cf9eb740 1 --2- 172.21.15.7:0/3773028412 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x561c114e2da0 0x561c11980b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:38:38.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.565+0000 7f10cf9eb740 4 client.16020 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:38:38.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.565+0000 7f10cf9eb740 1 -- 172.21.15.7:0/3773028412 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561c11902630 con 0x561c114e2da0 2024-09-21T06:38:38.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.566+0000 7f10c2ffd640 1 --2- 172.21.15.7:0/3773028412 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x561c114e2da0 0x561c11980b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:38:38.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.566+0000 7f10c2ffd640 1 --2- 172.21.15.7:0/3773028412 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x561c114e2da0 0x561c11980b20 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=657155245155b8b4 server_cookie=5292f263108414ea in_seq=0 out_seq=0 2024-09-21T06:38:38.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.566+0000 7f10aa7fc640 10 client.16020 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:38:38.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.566+0000 7f10aa7fc640 1 -- 172.21.15.7:0/3773028412 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1422 (crc 0 0 0) 0x561c11902630 con 0x561c114e2da0 2024-09-21T06:38:38.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.566+0000 7f10aa7fc640 10 client.16020 handle_command_reply: tid=0 2024-09-21T06:38:38.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.566+0000 7f10cf9eb740 1 client.16020 shutdown 2024-09-21T06:38:38.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.566+0000 7f10cf9eb740 1 -- 172.21.15.7:0/3773028412 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561c1154f070 msgr2=0x561c11914fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:38.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.566+0000 7f10cf9eb740 1 --2- 172.21.15.7:0/3773028412 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561c1154f070 0x561c11914fe0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f10ac031440 tx=0x7f10ac005320 comp rx=0 tx=0).stop 2024-09-21T06:38:38.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.566+0000 7f10cf9eb740 1 -- 172.21.15.7:0/3773028412 shutdown_connections 2024-09-21T06:38:38.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.566+0000 7f10cf9eb740 1 --2- 172.21.15.7:0/3773028412 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x561c114e2da0 0x561c11980b20 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:38.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.566+0000 7f10cf9eb740 1 --2- 172.21.15.7:0/3773028412 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561c1154f070 0x561c11914fe0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:38.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.566+0000 7f10cf9eb740 1 --2- 172.21.15.7:0/3773028412 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561c1152e390 0x561c11914aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:38.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.566+0000 7f10cf9eb740 1 --2- 172.21.15.7:0/3773028412 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561c115261b0 0x561c119175d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:38.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.567+0000 7f10cf9eb740 1 -- 172.21.15.7:0/3773028412 >> 172.21.15.7:0/3773028412 conn(0x561c11543460 msgr2=0x561c118f4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:38.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.567+0000 7f10aa7fc640 0 client.16020 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:38:38.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.567+0000 7f10cf9eb740 1 -- 172.21.15.7:0/3773028412 shutdown_connections 2024-09-21T06:38:38.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.567+0000 7f10cf9eb740 1 -- 172.21.15.7:0/3773028412 wait complete. 2024-09-21T06:38:38.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.567+0000 7f10cf9eb740 20 client.16020 trim_cache size 0 max 16384 2024-09-21T06:38:38.574 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:38:38.574 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T06:38:38.574 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": { 2024-09-21T06:38:38.574 INFO:teuthology.orchestra.run.smithi007.stdout: "b0327167-8c41-4286-8afc-7f0780972fd7": { 2024-09-21T06:38:38.574 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:38:38.574 INFO:teuthology.orchestra.run.smithi007.stdout: "tag": "b0327167-8c41-4286-8afc-7f0780972fd7", 2024-09-21T06:38:38.574 INFO:teuthology.orchestra.run.smithi007.stdout: "options": "recursive,force" 2024-09-21T06:38:38.574 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:38:38.574 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:38:38.575 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_stats": { 2024-09-21T06:38:38.575 INFO:teuthology.orchestra.run.smithi007.stdout: "b0327167-8c41-4286-8afc-7f0780972fd7": { 2024-09-21T06:38:38.575 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:38:36.828657+0000", 2024-09-21T06:38:38.575 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:38:38.575 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:38:38.575 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:38:38.575 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:38:38.575 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:38:38.575 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:38:38.575 INFO:teuthology.orchestra.run.smithi007.stdout: "5cbaaba2-6ab1-4f83-abd6-8c6eef4b5c42": { 2024-09-21T06:38:38.575 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:37:46.566272+0000", 2024-09-21T06:38:38.575 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:38:38.575 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:38:38.575 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:38:38.576 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:38:38.576 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:38:38.576 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:38:38.576 INFO:teuthology.orchestra.run.smithi007.stdout: "6231e9c1-14a2-40b5-be3c-76d87a0d733b": { 2024-09-21T06:38:38.576 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:37:02.484812+0000", 2024-09-21T06:38:38.576 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:38:38.576 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:38:38.576 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:38:38.576 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:38:38.576 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:38:38.576 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:38:38.576 INFO:teuthology.orchestra.run.smithi007.stdout: "0b89345c-1f00-4efe-8ee9-4cb17e43584c": { 2024-09-21T06:38:38.576 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:36:19.500334+0000", 2024-09-21T06:38:38.576 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:38:38.576 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:38:38.576 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:38:38.577 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:38:38.577 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:38:38.577 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:38:38.577 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:38:38.577 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:38:38.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.567+0000 7f10c9477640 1 -- 172.21.15.7:0/307117958 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f10b00b6680 msgr2=0x7f10b00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:38.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.567+0000 7f10c9477640 1 --2- 172.21.15.7:0/307117958 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f10b00b6680 0x7f10b00b8b90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f10bc0aa830 tx=0x7f10bc07a270 comp rx=0 tx=0).stop 2024-09-21T06:38:38.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.567+0000 7f10c9477640 1 -- 172.21.15.7:0/307117958 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10c4109e30 msgr2=0x7f10c4076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:38:38.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.567+0000 7f10c9477640 1 --2- 172.21.15.7:0/307117958 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10c4109e30 0x7f10c4076190 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f10bc00c970 tx=0x7f10bc00ce30 comp rx=0 tx=0).stop 2024-09-21T06:38:38.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.567+0000 7f10c9477640 1 -- 172.21.15.7:0/307117958 shutdown_connections 2024-09-21T06:38:38.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.567+0000 7f10c9477640 1 --2- 172.21.15.7:0/307117958 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f10b00b6680 0x7f10b00b8b90 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:38.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.567+0000 7f10c9477640 1 --2- 172.21.15.7:0/307117958 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f10c4109e30 0x7f10c4076190 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:38.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.567+0000 7f10c9477640 1 --2- 172.21.15.7:0/307117958 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10c41094e0 0x7f10c4075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:38.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.567+0000 7f10c9477640 1 --2- 172.21.15.7:0/307117958 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f10c4103ba0 0x7f10c4075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:38:38.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.567+0000 7f10c9477640 1 -- 172.21.15.7:0/307117958 >> 172.21.15.7:0/307117958 conn(0x7f10c40ff630 msgr2=0x7f10c4101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:38:38.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.568+0000 7f10c9477640 1 -- 172.21.15.7:0/307117958 shutdown_connections 2024-09-21T06:38:38.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:38:38.568+0000 7f10c9477640 1 -- 172.21.15.7:0/307117958 wait complete. 2024-09-21T06:38:39.188 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:38:38 smithi007 ceph-mon[30983]: pgmap v392: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 541 MiB/s wr, 199 op/s 2024-09-21T06:38:39.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:38:38 smithi144 ceph-mon[34653]: pgmap v392: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 541 MiB/s wr, 199 op/s 2024-09-21T06:38:39.349 INFO:tasks.cephfs.filesystem:scrub status for tag:b0327167-8c41-4286-8afc-7f0780972fd7 - {'path': '/', 'tag': 'b0327167-8c41-4286-8afc-7f0780972fd7', 'options': 'recursive,force'} 2024-09-21T06:38:39.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:38:38 smithi018 ceph-mon[34477]: pgmap v392: 97 pgs: 97 active+clean; 10 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 541 MiB/s wr, 199 op/s 2024-09-21T06:38:40.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:38:39 smithi144 ceph-mon[34653]: scrub summary: idle 2024-09-21T06:38:40.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:38:39 smithi007 ceph-mon[30983]: scrub summary: idle 2024-09-21T06:38:40.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:38:39 smithi018 ceph-mon[34477]: scrub summary: idle 2024-09-21T06:38:41.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:38:40 smithi144 ceph-mon[34653]: pgmap v393: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 237 MiB/s wr, 70 op/s 2024-09-21T06:38:41.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:38:40 smithi007 ceph-mon[30983]: pgmap v393: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 237 MiB/s wr, 70 op/s 2024-09-21T06:38:41.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:38:40 smithi018 ceph-mon[34477]: pgmap v393: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 237 MiB/s wr, 70 op/s 2024-09-21T06:38:43.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:38:42 smithi144 ceph-mon[34653]: pgmap v394: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 130 MiB/s wr, 43 op/s 2024-09-21T06:38:43.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:38:42 smithi007 ceph-mon[30983]: pgmap v394: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 130 MiB/s wr, 43 op/s 2024-09-21T06:38:43.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:38:42 smithi018 ceph-mon[34477]: pgmap v394: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 130 MiB/s wr, 43 op/s 2024-09-21T06:38:44.864 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-09-21T06:38:44.864 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-09-21T06:38:44.864 INFO:tasks.workunit.client.0.smithi007.stdout: 2024-09-21T06:38:44.864 INFO:tasks.workunit.client.0.smithi007.stdout:iozone test complete. 2024-09-21T06:38:44.865 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-21T06:38:44.865 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-21T06:38:44.901 INFO:tasks.workunit:Stopping ['suites/iozone.sh'] on client.0... 2024-09-21T06:38:44.902 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-21T06:38:45.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:38:44 smithi144 ceph-mon[34653]: pgmap v395: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 66 MiB/s wr, 27 op/s 2024-09-21T06:38:45.321 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:38:44 smithi007 ceph-mon[30983]: pgmap v395: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 66 MiB/s wr, 27 op/s 2024-09-21T06:38:45.321 DEBUG:teuthology.parallel:result is None 2024-09-21T06:38:45.321 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-21T06:38:45.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:38:44 smithi018 ceph-mon[34477]: pgmap v395: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 66 MiB/s wr, 27 op/s 2024-09-21T06:38:45.373 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-21T06:38:45.373 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-09-21T06:38:45.382 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi007.front.sepia.ceph.com 2024-09-21T06:38:45.394 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-09-21T06:38:45.404 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2024-09-21T06:38:45.404 INFO:teuthology.task.exec:Executing custom commands... 2024-09-21T06:38:45.404 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi007.front.sepia.ceph.com 2024-09-21T06:38:45.404 DEBUG:teuthology.orchestra.run.smithi007:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2024-09-21T06:38:45.474 DEBUG:teuthology.orchestra.run.smithi007:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2024-09-21T06:38:47.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:38:46 smithi144 ceph-mon[34653]: pgmap v396: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.3 MiB/s wr, 9 op/s 2024-09-21T06:38:47.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:38:46 smithi007 ceph-mon[30983]: pgmap v396: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.3 MiB/s wr, 9 op/s 2024-09-21T06:38:47.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:38:46 smithi018 ceph-mon[34477]: pgmap v396: 97 pgs: 97 active+clean; 10 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.3 MiB/s wr, 9 op/s 2024-09-21T06:38:49.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:38:48 smithi144 ceph-mon[34653]: pgmap v397: 97 pgs: 97 active+clean; 4.4 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 7.2 KiB/s wr, 129 op/s 2024-09-21T06:38:49.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:38:48 smithi007 ceph-mon[30983]: pgmap v397: 97 pgs: 97 active+clean; 4.4 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 7.2 KiB/s wr, 129 op/s 2024-09-21T06:38:49.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:38:48 smithi018 ceph-mon[34477]: pgmap v397: 97 pgs: 97 active+clean; 4.4 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 7.2 KiB/s wr, 129 op/s 2024-09-21T06:38:51.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:38:50 smithi144 ceph-mon[34653]: pgmap v398: 97 pgs: 97 active+clean; 1.5 GiB data, 939 MiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 5.8 KiB/s wr, 191 op/s 2024-09-21T06:38:51.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:38:50 smithi007 ceph-mon[30983]: pgmap v398: 97 pgs: 97 active+clean; 1.5 GiB data, 939 MiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 5.8 KiB/s wr, 191 op/s 2024-09-21T06:38:51.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:38:50 smithi018 ceph-mon[34477]: pgmap v398: 97 pgs: 97 active+clean; 1.5 GiB data, 939 MiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 5.8 KiB/s wr, 191 op/s 2024-09-21T06:38:53.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:38:52 smithi144 ceph-mon[34653]: pgmap v399: 97 pgs: 97 active+clean; 3.2 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 6.0 KiB/s wr, 221 op/s 2024-09-21T06:38:53.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:38:52 smithi007 ceph-mon[30983]: pgmap v399: 97 pgs: 97 active+clean; 3.2 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 6.0 KiB/s wr, 221 op/s 2024-09-21T06:38:53.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:38:52 smithi018 ceph-mon[34477]: pgmap v399: 97 pgs: 97 active+clean; 3.2 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 6.0 KiB/s wr, 221 op/s 2024-09-21T06:38:55.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:38:54 smithi144 ceph-mon[34653]: pgmap v400: 97 pgs: 97 active+clean; 3.2 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.2 KiB/s wr, 221 op/s 2024-09-21T06:38:55.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:38:54 smithi007 ceph-mon[30983]: pgmap v400: 97 pgs: 97 active+clean; 3.2 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.2 KiB/s wr, 221 op/s 2024-09-21T06:38:55.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:38:54 smithi018 ceph-mon[34477]: pgmap v400: 97 pgs: 97 active+clean; 3.2 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 4.2 KiB/s wr, 221 op/s 2024-09-21T06:38:57.171 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:38:56 smithi018 ceph-mon[34477]: pgmap v401: 97 pgs: 97 active+clean; 3.2 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.2 KiB/s wr, 220 op/s 2024-09-21T06:38:57.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:38:56 smithi144 ceph-mon[34653]: pgmap v401: 97 pgs: 97 active+clean; 3.2 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.2 KiB/s wr, 220 op/s 2024-09-21T06:38:57.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:38:56 smithi007 ceph-mon[30983]: pgmap v401: 97 pgs: 97 active+clean; 3.2 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 4.2 KiB/s wr, 220 op/s 2024-09-21T06:38:59.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:38:58 smithi144 ceph-mon[34653]: pgmap v402: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 5.6 KiB/s wr, 221 op/s 2024-09-21T06:38:59.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:38:58 smithi007 ceph-mon[30983]: pgmap v402: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 5.6 KiB/s wr, 221 op/s 2024-09-21T06:38:59.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:38:58 smithi018 ceph-mon[34477]: pgmap v402: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 5.6 KiB/s wr, 221 op/s 2024-09-21T06:39:01.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:39:00 smithi144 ceph-mon[34653]: pgmap v403: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 2.4 KiB/s wr, 102 op/s 2024-09-21T06:39:01.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:39:00 smithi007 ceph-mon[30983]: pgmap v403: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 2.4 KiB/s wr, 102 op/s 2024-09-21T06:39:01.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:39:00 smithi018 ceph-mon[34477]: pgmap v403: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 2.4 KiB/s wr, 102 op/s 2024-09-21T06:39:03.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:39:02 smithi144 ceph-mon[34653]: pgmap v404: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 2.1 KiB/s wr, 39 op/s 2024-09-21T06:39:03.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:39:02 smithi007 ceph-mon[30983]: pgmap v404: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 2.1 KiB/s wr, 39 op/s 2024-09-21T06:39:03.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:39:02 smithi018 ceph-mon[34477]: pgmap v404: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 2.1 KiB/s wr, 39 op/s 2024-09-21T06:39:05.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:39:04 smithi144 ceph-mon[34653]: pgmap v405: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 21 op/s 2024-09-21T06:39:05.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:39:04 smithi007 ceph-mon[30983]: pgmap v405: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 21 op/s 2024-09-21T06:39:05.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:39:04 smithi018 ceph-mon[34477]: pgmap v405: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 21 op/s 2024-09-21T06:39:07.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:39:06 smithi144 ceph-mon[34653]: pgmap v406: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 19 op/s 2024-09-21T06:39:07.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:39:06 smithi007 ceph-mon[30983]: pgmap v406: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 19 op/s 2024-09-21T06:39:07.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:39:06 smithi018 ceph-mon[34477]: pgmap v406: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 19 op/s 2024-09-21T06:39:09.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:39:08 smithi144 ceph-mon[34653]: pgmap v407: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 21 op/s 2024-09-21T06:39:09.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:39:08 smithi007 ceph-mon[30983]: pgmap v407: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 21 op/s 2024-09-21T06:39:09.350 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:39:09.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:39:08 smithi018 ceph-mon[34477]: pgmap v407: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 24 KiB/s wr, 21 op/s 2024-09-21T06:39:09.625 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:39:10.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.143+0000 7f0c87c1a640 1 -- 172.21.15.7:0/4251743335 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c80102a60 msgr2=0x7f0c80102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:10.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.143+0000 7f0c87c1a640 1 --2- 172.21.15.7:0/4251743335 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c80102a60 0x7f0c80102e70 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c009900 tx=0x7f0c7c02a410 comp rx=0 tx=0).stop 2024-09-21T06:39:10.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.144+0000 7f0c87c1a640 1 -- 172.21.15.7:0/4251743335 shutdown_connections 2024-09-21T06:39:10.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.144+0000 7f0c87c1a640 1 --2- 172.21.15.7:0/4251743335 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c80108cf0 0x7f0c8010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:10.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.144+0000 7f0c87c1a640 1 --2- 172.21.15.7:0/4251743335 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c801083a0 0x7f0c801087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:10.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.144+0000 7f0c87c1a640 1 --2- 172.21.15.7:0/4251743335 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c80102a60 0x7f0c80102e70 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:10.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.144+0000 7f0c87c1a640 1 -- 172.21.15.7:0/4251743335 >> 172.21.15.7:0/4251743335 conn(0x7f0c80079730 msgr2=0x7f0c80079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:10.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.144+0000 7f0c87c1a640 1 -- 172.21.15.7:0/4251743335 shutdown_connections 2024-09-21T06:39:10.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.144+0000 7f0c87c1a640 1 -- 172.21.15.7:0/4251743335 wait complete. 2024-09-21T06:39:10.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.144+0000 7f0c87c1a640 1 Processor -- start 2024-09-21T06:39:10.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.145+0000 7f0c87c1a640 1 -- start start 2024-09-21T06:39:10.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.145+0000 7f0c87c1a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c80102a60 0x7f0c80199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:10.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.145+0000 7f0c87c1a640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c801083a0 0x7f0c801998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:10.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.145+0000 7f0c87c1a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c80108cf0 0x7f0c8019eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:10.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.145+0000 7f0c87c1a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0c80112960 con 0x7f0c80102a60 2024-09-21T06:39:10.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.145+0000 7f0c87c1a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0c801127e0 con 0x7f0c80108cf0 2024-09-21T06:39:10.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.145+0000 7f0c87c1a640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0c80112ae0 con 0x7f0c801083a0 2024-09-21T06:39:10.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.145+0000 7f0c859b6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c80102a60 0x7f0c80199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:10.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.145+0000 7f0c859b6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c80102a60 0x7f0c80199310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42280/0 (socket says 172.21.15.7:42280) 2024-09-21T06:39:10.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.145+0000 7f0c859b6640 1 -- 172.21.15.7:0/3244501631 learned_addr learned my addr 172.21.15.7:0/3244501631 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:39:10.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.145+0000 7f0c861b7640 1 --2- 172.21.15.7:0/3244501631 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c80108cf0 0x7f0c8019eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:10.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.145+0000 7f0c851b5640 1 --2- 172.21.15.7:0/3244501631 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c801083a0 0x7f0c801998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:10.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.146+0000 7f0c859b6640 1 -- 172.21.15.7:0/3244501631 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c801083a0 msgr2=0x7f0c801998b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:10.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.146+0000 7f0c859b6640 1 --2- 172.21.15.7:0/3244501631 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c801083a0 0x7f0c801998b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:10.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.146+0000 7f0c859b6640 1 -- 172.21.15.7:0/3244501631 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c80108cf0 msgr2=0x7f0c8019eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:10.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.146+0000 7f0c859b6640 1 --2- 172.21.15.7:0/3244501631 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c80108cf0 0x7f0c8019eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:10.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.146+0000 7f0c859b6640 1 -- 172.21.15.7:0/3244501631 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c8019f280 con 0x7f0c80102a60 2024-09-21T06:39:10.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.146+0000 7f0c859b6640 1 --2- 172.21.15.7:0/3244501631 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c80102a60 0x7f0c80199310 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c005940 tx=0x7f0c7c0040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:10.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.146+0000 7f0c72ffd640 1 -- 172.21.15.7:0/3244501631 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c7c03f030 con 0x7f0c80102a60 2024-09-21T06:39:10.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.146+0000 7f0c72ffd640 1 -- 172.21.15.7:0/3244501631 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0c7c0044c0 con 0x7f0c80102a60 2024-09-21T06:39:10.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.146+0000 7f0c72ffd640 1 -- 172.21.15.7:0/3244501631 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c7c035070 con 0x7f0c80102a60 2024-09-21T06:39:10.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.146+0000 7f0c87c1a640 1 -- 172.21.15.7:0/3244501631 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c8019f510 con 0x7f0c80102a60 2024-09-21T06:39:10.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.146+0000 7f0c87c1a640 1 -- 172.21.15.7:0/3244501631 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c8006ae60 con 0x7f0c80102a60 2024-09-21T06:39:10.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.149+0000 7f0c8e18e740 1 Processor -- start 2024-09-21T06:39:10.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.149+0000 7f0c8e18e740 1 -- start start 2024-09-21T06:39:10.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.149+0000 7f0c72ffd640 1 -- 172.21.15.7:0/3244501631 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f0c7c042030 con 0x7f0c80102a60 2024-09-21T06:39:10.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.150+0000 7f0c8e18e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55803db31070 0x55803ded8270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:10.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.150+0000 7f0c8e18e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55803db081b0 0x55803ded87b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:10.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.150+0000 7f0c8e18e740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55803db10390 0x55803ded8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:10.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.150+0000 7f0c8e18e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55803de4ee50 con 0x55803db081b0 2024-09-21T06:39:10.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.150+0000 7f0c8e18e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55803de3e280 con 0x55803db31070 2024-09-21T06:39:10.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.150+0000 7f0c8e18e740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55803de42090 con 0x55803db10390 2024-09-21T06:39:10.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.150+0000 7f0c859b6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55803db081b0 0x55803ded87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:10.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.150+0000 7f0c861b7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55803db31070 0x55803ded8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:10.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.150+0000 7f0c861b7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55803db31070 0x55803ded8270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.7:60616/0 (socket says 172.21.15.7:60616) 2024-09-21T06:39:10.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.150+0000 7f0c861b7640 1 -- 172.21.15.7:0/1059060973 learned_addr learned my addr 172.21.15.7:0/1059060973 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:39:10.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.150+0000 7f0c851b5640 1 --2- 172.21.15.7:0/1059060973 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55803db10390 0x55803ded8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:10.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.150+0000 7f0c861b7640 1 -- 172.21.15.7:0/1059060973 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55803db10390 msgr2=0x55803ded8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:10.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.150+0000 7f0c861b7640 1 --2- 172.21.15.7:0/1059060973 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55803db10390 0x55803ded8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:10.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.150+0000 7f0c861b7640 1 -- 172.21.15.7:0/1059060973 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55803db081b0 msgr2=0x55803ded87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:10.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.150+0000 7f0c861b7640 1 --2- 172.21.15.7:0/1059060973 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55803db081b0 0x55803ded87b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:10.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.150+0000 7f0c861b7640 1 -- 172.21.15.7:0/1059060973 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55803db9c650 con 0x55803db31070 2024-09-21T06:39:10.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.150+0000 7f0c72ffd640 1 --2- 172.21.15.7:0/3244501631 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f0c6c0b6680 0x7f0c6c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:10.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.150+0000 7f0c861b7640 1 --2- 172.21.15.7:0/1059060973 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55803db31070 0x55803ded8270 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0c78009fd0 tx=0x7f0c780118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebecc5e6dbba2de9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:10.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.151+0000 7f0c859b6640 1 --2- 172.21.15.7:0/3244501631 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f0c6c0b6680 0x7f0c6c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:10.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.151+0000 7f0c6bfff640 1 -- 172.21.15.7:0/1059060973 <== mon.2 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c78004d20 con 0x55803db31070 2024-09-21T06:39:10.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.151+0000 7f0c72ffd640 1 -- 172.21.15.7:0/3244501631 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f0c7c107a50 con 0x7f0c80102a60 2024-09-21T06:39:10.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.151+0000 7f0c6bfff640 1 -- 172.21.15.7:0/1059060973 <== mon.2 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0c78004050 con 0x55803db31070 2024-09-21T06:39:10.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.151+0000 7f0c6bfff640 1 -- 172.21.15.7:0/1059060973 <== mon.2 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c78005280 con 0x55803db31070 2024-09-21T06:39:10.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.152+0000 7f0c8e18e740 1 -- 172.21.15.7:0/1059060973 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55803db31070 msgr2=0x55803ded8270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:10.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.152+0000 7f0c859b6640 1 --2- 172.21.15.7:0/3244501631 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f0c6c0b6680 0x7f0c6c0b8b90 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c0cd980 tx=0x7f0c7c10b540 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:10.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.152+0000 7f0c8e18e740 1 --2- 172.21.15.7:0/1059060973 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55803db31070 0x55803ded8270 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0c78009fd0 tx=0x7f0c780118d0 comp rx=0 tx=0).stop 2024-09-21T06:39:10.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.152+0000 7f0c8e18e740 1 -- 172.21.15.7:0/1059060973 shutdown_connections 2024-09-21T06:39:10.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.152+0000 7f0c8e18e740 1 --2- 172.21.15.7:0/1059060973 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55803db10390 0x55803ded8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:10.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.152+0000 7f0c8e18e740 1 --2- 172.21.15.7:0/1059060973 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55803db081b0 0x55803ded87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:10.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.152+0000 7f0c8e18e740 1 --2- 172.21.15.7:0/1059060973 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55803db31070 0x55803ded8270 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:10.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.152+0000 7f0c8e18e740 1 -- 172.21.15.7:0/1059060973 >> 172.21.15.7:0/1059060973 conn(0x55803db25460 msgr2=0x55803ded6160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:10.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.152+0000 7f0c8e18e740 1 -- 172.21.15.7:0/1059060973 shutdown_connections 2024-09-21T06:39:10.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.152+0000 7f0c8e18e740 1 -- 172.21.15.7:0/1059060973 wait complete. 2024-09-21T06:39:10.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.152+0000 7f0c8e18e740 1 -- start start 2024-09-21T06:39:10.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.152+0000 7f0c8e18e740 1 Processor -- start 2024-09-21T06:39:10.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.153+0000 7f0c8e18e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55803db081b0 0x55803dee7c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:10.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.153+0000 7f0c8e18e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55803db10390 0x55803dee81a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:10.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.153+0000 7f0c8e18e740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55803db31070 0x55803dee86e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:10.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.153+0000 7f0c8e18e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55803dc9f700 con 0x55803db10390 2024-09-21T06:39:10.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.153+0000 7f0c8e18e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55803ddd9110 con 0x55803db081b0 2024-09-21T06:39:10.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.153+0000 7f0c8e18e740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55803deead80 con 0x55803db31070 2024-09-21T06:39:10.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.153+0000 7f0c8e18e740 10 client.0 _ll_register_callbacks cb 0x55803ddf2990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:39:10.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.153+0000 7f0c861b7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55803db081b0 0x55803dee7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:10.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.153+0000 7f0c861b7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55803db081b0 0x55803dee7c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.7:60632/0 (socket says 172.21.15.7:60632) 2024-09-21T06:39:10.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.153+0000 7f0c861b7640 1 -- 172.21.15.7:0/2993099481 learned_addr learned my addr 172.21.15.7:0/2993099481 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:39:10.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.153+0000 7f0c851b5640 1 --2- 172.21.15.7:0/2993099481 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55803db10390 0x55803dee81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:10.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.153+0000 7f0c861b7640 1 --2- 172.21.15.7:0/2993099481 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55803db31070 0x55803dee86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:10.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.154+0000 7f0c851b5640 1 -- 172.21.15.7:0/2993099481 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55803db31070 msgr2=0x55803dee86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:10.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.154+0000 7f0c851b5640 1 --2- 172.21.15.7:0/2993099481 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55803db31070 0x55803dee86e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:10.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.154+0000 7f0c851b5640 1 -- 172.21.15.7:0/2993099481 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55803db081b0 msgr2=0x55803dee7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:10.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.154+0000 7f0c851b5640 1 --2- 172.21.15.7:0/2993099481 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55803db081b0 0x55803dee7c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:10.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.154+0000 7f0c851b5640 1 -- 172.21.15.7:0/2993099481 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55803de06c40 con 0x55803db10390 2024-09-21T06:39:10.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.154+0000 7f0c861b7640 1 --2- 172.21.15.7:0/2993099481 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55803db081b0 0x55803dee7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:39:10.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.154+0000 7f0c851b5640 1 --2- 172.21.15.7:0/2993099481 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55803db10390 0x55803dee81a0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f0c8006aaa0 tx=0x7f0c74012b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55fc2df5e66b89e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:10.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.154+0000 7f0c697fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:39:10.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.154+0000 7f0c697fa640 1 -- 172.21.15.7:0/2993099481 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c7400f920 con 0x55803db10390 2024-09-21T06:39:10.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.154+0000 7f0c697fa640 1 -- 172.21.15.7:0/2993099481 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f0c7400fac0 con 0x55803db10390 2024-09-21T06:39:10.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.154+0000 7f0c8e18e740 1 -- 172.21.15.7:0/2993099481 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0c78004050 con 0x55803db10390 2024-09-21T06:39:10.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.154+0000 7f0c697fa640 1 -- 172.21.15.7:0/2993099481 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0c7400fcc0 con 0x55803db10390 2024-09-21T06:39:10.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.154+0000 7f0c8e18e740 10 client.16032 fetch_fsmap learned FSMap version 25 2024-09-21T06:39:10.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.154+0000 7f0c8e18e740 1 -- 172.21.15.7:0/2993099481 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55803def6a50 con 0x55803db10390 2024-09-21T06:39:10.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.155+0000 7f0c697fa640 1 -- 172.21.15.7:0/2993099481 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0c78004050 con 0x55803db10390 2024-09-21T06:39:10.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.155+0000 7f0c697fa640 1 -- 172.21.15.7:0/2993099481 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f0c74010430 con 0x55803db10390 2024-09-21T06:39:10.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.155+0000 7f0c8e18e740 10 client.16032 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:39:10.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.155+0000 7f0c8e18e740 10 client.16032 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:39:10.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.155+0000 7f0c8e18e740 20 client.16032 populate_metadata read hostname 'smithi007' 2024-09-21T06:39:10.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.155+0000 7f0c8e18e740 1 --2- 172.21.15.7:0/2993099481 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55803daef9f0 0x55803def9f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:10.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.155+0000 7f0c8e18e740 4 client.16032 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:39:10.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.155+0000 7f0c8e18e740 1 -- 172.21.15.7:0/2993099481 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55803de50da0 con 0x55803daef9f0 2024-09-21T06:39:10.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.155+0000 7f0c861b7640 1 --2- 172.21.15.7:0/2993099481 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55803daef9f0 0x55803def9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:10.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.156+0000 7f0c697fa640 10 client.16032 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:39:10.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.156+0000 7f0c861b7640 1 --2- 172.21.15.7:0/2993099481 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55803daef9f0 0x55803def9f90 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a0f07fc596f32ee server_cookie=1e0307003975a815 in_seq=0 out_seq=0 2024-09-21T06:39:10.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.156+0000 7f0c697fa640 1 -- 172.21.15.7:0/2993099481 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55803de50da0 con 0x55803daef9f0 2024-09-21T06:39:10.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.156+0000 7f0c697fa640 10 client.16032 handle_command_reply: tid=0 2024-09-21T06:39:10.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.156+0000 7f0c8e18e740 1 client.16032 shutdown 2024-09-21T06:39:10.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.157+0000 7f0c8e18e740 1 -- 172.21.15.7:0/2993099481 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55803db10390 msgr2=0x55803dee81a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:10.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.157+0000 7f0c8e18e740 1 --2- 172.21.15.7:0/2993099481 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55803db10390 0x55803dee81a0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f0c8006aaa0 tx=0x7f0c74012b60 comp rx=0 tx=0).stop 2024-09-21T06:39:10.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.157+0000 7f0c8e18e740 1 -- 172.21.15.7:0/2993099481 shutdown_connections 2024-09-21T06:39:10.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.157+0000 7f0c8e18e740 1 --2- 172.21.15.7:0/2993099481 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55803daef9f0 0x55803def9f90 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:10.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.157+0000 7f0c8e18e740 1 --2- 172.21.15.7:0/2993099481 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55803db31070 0x55803dee86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:10.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.157+0000 7f0c8e18e740 1 --2- 172.21.15.7:0/2993099481 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55803db10390 0x55803dee81a0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:10.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.157+0000 7f0c697fa640 0 client.16032 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:39:10.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.157+0000 7f0c8e18e740 1 --2- 172.21.15.7:0/2993099481 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55803db081b0 0x55803dee7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:10.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.157+0000 7f0c8e18e740 1 -- 172.21.15.7:0/2993099481 >> 172.21.15.7:0/2993099481 conn(0x55803db25460 msgr2=0x55803dedb310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:10.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.157+0000 7f0c8e18e740 1 -- 172.21.15.7:0/2993099481 shutdown_connections 2024-09-21T06:39:10.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.157+0000 7f0c8e18e740 1 -- 172.21.15.7:0/2993099481 wait complete. 2024-09-21T06:39:10.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.157+0000 7f0c8e18e740 20 client.16032 trim_cache size 0 max 16384 2024-09-21T06:39:10.177 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.174+0000 7f0c8e18e740 1 Processor -- start 2024-09-21T06:39:10.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.175+0000 7f0c8e18e740 1 -- start start 2024-09-21T06:39:10.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.175+0000 7f0c8e18e740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55803daef9f0 0x55803dedbde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:10.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.175+0000 7f0c8e18e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55803db081b0 0x55803dee9b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:10.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.175+0000 7f0c8e18e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55803db10390 0x55803ded99b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:10.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.175+0000 7f0c8e18e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0c801afae0 con 0x55803db10390 2024-09-21T06:39:10.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.175+0000 7f0c8e18e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0c801ad3b0 con 0x55803db081b0 2024-09-21T06:39:10.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.175+0000 7f0c8e18e740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0c801ab200 con 0x55803daef9f0 2024-09-21T06:39:10.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.175+0000 7f0c861b7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55803db10390 0x55803ded99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:10.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.175+0000 7f0c861b7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55803db10390 0x55803ded99b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42310/0 (socket says 172.21.15.7:42310) 2024-09-21T06:39:10.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.175+0000 7f0c861b7640 1 -- 172.21.15.7:0/1364785715 learned_addr learned my addr 172.21.15.7:0/1364785715 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:39:10.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.175+0000 7f0c851b5640 1 --2- 172.21.15.7:0/1364785715 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55803db081b0 0x55803dee9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:10.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.175+0000 7f0c861b7640 1 --2- 172.21.15.7:0/1364785715 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55803daef9f0 0x55803dedbde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:10.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.175+0000 7f0c861b7640 1 -- 172.21.15.7:0/1364785715 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55803daef9f0 msgr2=0x55803dedbde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:10.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.175+0000 7f0c861b7640 1 --2- 172.21.15.7:0/1364785715 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55803daef9f0 0x55803dedbde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:10.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.175+0000 7f0c861b7640 1 -- 172.21.15.7:0/1364785715 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55803db081b0 msgr2=0x55803dee9b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:10.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.175+0000 7f0c861b7640 1 --2- 172.21.15.7:0/1364785715 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55803db081b0 0x55803dee9b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:10.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.175+0000 7f0c861b7640 1 -- 172.21.15.7:0/1364785715 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55803dee6160 con 0x55803db10390 2024-09-21T06:39:10.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.176+0000 7f0c861b7640 1 --2- 172.21.15.7:0/1364785715 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55803db10390 0x55803ded99b0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f0c780099b0 tx=0x7f0c78005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bb2a7606d4c280d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:10.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.176+0000 7f0c6b7fe640 1 -- 172.21.15.7:0/1364785715 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c78003ab0 con 0x55803db10390 2024-09-21T06:39:10.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.176+0000 7f0c6b7fe640 1 -- 172.21.15.7:0/1364785715 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0c78004d40 con 0x55803db10390 2024-09-21T06:39:10.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.176+0000 7f0c6b7fe640 1 -- 172.21.15.7:0/1364785715 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c780051c0 con 0x55803db10390 2024-09-21T06:39:10.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.177+0000 7f0c8e18e740 1 -- 172.21.15.7:0/1364785715 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55803db10390 msgr2=0x55803ded99b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:10.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.177+0000 7f0c8e18e740 1 --2- 172.21.15.7:0/1364785715 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55803db10390 0x55803ded99b0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f0c780099b0 tx=0x7f0c78005bd0 comp rx=0 tx=0).stop 2024-09-21T06:39:10.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.177+0000 7f0c8e18e740 1 -- 172.21.15.7:0/1364785715 shutdown_connections 2024-09-21T06:39:10.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.177+0000 7f0c8e18e740 1 --2- 172.21.15.7:0/1364785715 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55803db10390 0x55803ded99b0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:10.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.177+0000 7f0c8e18e740 1 --2- 172.21.15.7:0/1364785715 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55803db081b0 0x55803dee9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:10.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.177+0000 7f0c8e18e740 1 --2- 172.21.15.7:0/1364785715 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55803daef9f0 0x55803dedbde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:10.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.177+0000 7f0c8e18e740 1 -- 172.21.15.7:0/1364785715 >> 172.21.15.7:0/1364785715 conn(0x55803db25460 msgr2=0x55803ded92a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:10.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.177+0000 7f0c8e18e740 1 -- 172.21.15.7:0/1364785715 shutdown_connections 2024-09-21T06:39:10.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.177+0000 7f0c8e18e740 1 -- 172.21.15.7:0/1364785715 wait complete. 2024-09-21T06:39:10.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.177+0000 7f0c8e18e740 1 -- start start 2024-09-21T06:39:10.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.177+0000 7f0c8e18e740 1 Processor -- start 2024-09-21T06:39:10.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.178+0000 7f0c8e18e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55803daef9f0 0x55803deec060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:10.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.178+0000 7f0c8e18e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55803db081b0 0x55803deec5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:10.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.178+0000 7f0c8e18e740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55803db10390 0x55803deecae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:10.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.178+0000 7f0c8e18e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0c801ab870 con 0x55803daef9f0 2024-09-21T06:39:10.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.178+0000 7f0c8e18e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0c801acce0 con 0x55803db081b0 2024-09-21T06:39:10.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.178+0000 7f0c8e18e740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0c801abf40 con 0x55803db10390 2024-09-21T06:39:10.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.178+0000 7f0c8e18e740 10 client.0 _ll_register_callbacks cb 0x7f0c74009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:39:10.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.178+0000 7f0c861b7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55803daef9f0 0x55803deec060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:10.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.178+0000 7f0c861b7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55803daef9f0 0x55803deec060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42316/0 (socket says 172.21.15.7:42316) 2024-09-21T06:39:10.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.178+0000 7f0c861b7640 1 -- 172.21.15.7:0/3396032350 learned_addr learned my addr 172.21.15.7:0/3396032350 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:39:10.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.178+0000 7f0c851b5640 1 --2- 172.21.15.7:0/3396032350 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55803db081b0 0x55803deec5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:10.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.178+0000 7f0c861b7640 1 --2- 172.21.15.7:0/3396032350 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55803db10390 0x55803deecae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:10.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.178+0000 7f0c861b7640 1 -- 172.21.15.7:0/3396032350 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55803db10390 msgr2=0x55803deecae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:10.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.178+0000 7f0c861b7640 1 --2- 172.21.15.7:0/3396032350 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55803db10390 0x55803deecae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:10.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.178+0000 7f0c861b7640 1 -- 172.21.15.7:0/3396032350 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55803db081b0 msgr2=0x55803deec5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:10.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.178+0000 7f0c861b7640 1 --2- 172.21.15.7:0/3396032350 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55803db081b0 0x55803deec5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:10.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.178+0000 7f0c861b7640 1 -- 172.21.15.7:0/3396032350 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55803df639d0 con 0x55803daef9f0 2024-09-21T06:39:10.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.178+0000 7f0c851b5640 1 --2- 172.21.15.7:0/3396032350 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55803db081b0 0x55803deec5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:39:10.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.179+0000 7f0c861b7640 1 --2- 172.21.15.7:0/3396032350 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55803daef9f0 0x55803deec060 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f0c78002230 tx=0x7f0c78004230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc7fa3a66da6e3e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:10.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.179+0000 7f0c697fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:39:10.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.179+0000 7f0c697fa640 1 -- 172.21.15.7:0/3396032350 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c78004820 con 0x55803daef9f0 2024-09-21T06:39:10.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.179+0000 7f0c697fa640 1 -- 172.21.15.7:0/3396032350 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f0c78002030 con 0x55803daef9f0 2024-09-21T06:39:10.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.179+0000 7f0c8e18e740 1 -- 172.21.15.7:0/3396032350 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0c78004d40 con 0x55803daef9f0 2024-09-21T06:39:10.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.179+0000 7f0c697fa640 1 -- 172.21.15.7:0/3396032350 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0c780049c0 con 0x55803daef9f0 2024-09-21T06:39:10.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.179+0000 7f0c8e18e740 10 client.16038 fetch_fsmap learned FSMap version 25 2024-09-21T06:39:10.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.179+0000 7f0c8e18e740 1 -- 172.21.15.7:0/3396032350 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55803df64c60 con 0x55803daef9f0 2024-09-21T06:39:10.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.179+0000 7f0c697fa640 1 -- 172.21.15.7:0/3396032350 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0c78004d40 con 0x55803daef9f0 2024-09-21T06:39:10.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.179+0000 7f0c697fa640 1 -- 172.21.15.7:0/3396032350 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f0c78041470 con 0x55803daef9f0 2024-09-21T06:39:10.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.180+0000 7f0c8e18e740 10 client.16038 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:39:10.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.180+0000 7f0c8e18e740 10 client.16038 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:39:10.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.180+0000 7f0c8e18e740 20 client.16038 populate_metadata read hostname 'smithi007' 2024-09-21T06:39:10.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.180+0000 7f0c8e18e740 1 --2- 172.21.15.7:0/3396032350 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55803db31070 0x55803df671c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:10.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.180+0000 7f0c8e18e740 4 client.16038 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:39:10.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.180+0000 7f0c8e18e740 1 -- 172.21.15.7:0/3396032350 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55803de4c850 con 0x55803db31070 2024-09-21T06:39:10.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.180+0000 7f0c851b5640 1 --2- 172.21.15.7:0/3396032350 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55803db31070 0x55803df671c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:10.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.180+0000 7f0c851b5640 1 --2- 172.21.15.7:0/3396032350 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55803db31070 0x55803df671c0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32ccde970520540e server_cookie=b1a9f1ef51f04129 in_seq=0 out_seq=0 2024-09-21T06:39:10.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.180+0000 7f0c697fa640 10 client.16038 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:39:10.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.181+0000 7f0c697fa640 1 -- 172.21.15.7:0/3396032350 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1226 (crc 0 0 0) 0x55803de4c850 con 0x55803db31070 2024-09-21T06:39:10.187 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.181+0000 7f0c697fa640 10 client.16038 handle_command_reply: tid=0 2024-09-21T06:39:10.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.181+0000 7f0c8e18e740 1 client.16038 shutdown 2024-09-21T06:39:10.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.181+0000 7f0c8e18e740 1 -- 172.21.15.7:0/3396032350 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55803daef9f0 msgr2=0x55803deec060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:10.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.181+0000 7f0c8e18e740 1 --2- 172.21.15.7:0/3396032350 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55803daef9f0 0x55803deec060 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f0c78002230 tx=0x7f0c78004230 comp rx=0 tx=0).stop 2024-09-21T06:39:10.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.181+0000 7f0c8e18e740 1 -- 172.21.15.7:0/3396032350 shutdown_connections 2024-09-21T06:39:10.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.181+0000 7f0c8e18e740 1 --2- 172.21.15.7:0/3396032350 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55803db31070 0x55803df671c0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:10.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.181+0000 7f0c8e18e740 1 --2- 172.21.15.7:0/3396032350 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55803db10390 0x55803deecae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:10.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.181+0000 7f0c8e18e740 1 --2- 172.21.15.7:0/3396032350 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55803db081b0 0x55803deec5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:10.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.181+0000 7f0c697fa640 0 client.16038 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:39:10.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.181+0000 7f0c8e18e740 1 --2- 172.21.15.7:0/3396032350 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55803daef9f0 0x55803deec060 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:10.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.181+0000 7f0c8e18e740 1 -- 172.21.15.7:0/3396032350 >> 172.21.15.7:0/3396032350 conn(0x55803db25460 msgr2=0x55803dee9830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:10.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.181+0000 7f0c8e18e740 1 -- 172.21.15.7:0/3396032350 shutdown_connections 2024-09-21T06:39:10.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.181+0000 7f0c8e18e740 1 -- 172.21.15.7:0/3396032350 wait complete. 2024-09-21T06:39:10.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.181+0000 7f0c8e18e740 20 client.16038 trim_cache size 0 max 16384 2024-09-21T06:39:10.189 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:39:10.189 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "no active scrubs running", 2024-09-21T06:39:10.189 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": {}, 2024-09-21T06:39:10.189 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_stats": { 2024-09-21T06:39:10.189 INFO:teuthology.orchestra.run.smithi007.stdout: "b0327167-8c41-4286-8afc-7f0780972fd7": { 2024-09-21T06:39:10.189 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:38:36.828657+0000", 2024-09-21T06:39:10.189 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:39:10.189 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:39:10.189 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:39:10.189 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:39:10.190 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:39:10.190 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:39:10.190 INFO:teuthology.orchestra.run.smithi007.stdout: "5cbaaba2-6ab1-4f83-abd6-8c6eef4b5c42": { 2024-09-21T06:39:10.190 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:37:46.566272+0000", 2024-09-21T06:39:10.190 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:39:10.190 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:39:10.190 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:39:10.190 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:39:10.190 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:39:10.190 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:39:10.190 INFO:teuthology.orchestra.run.smithi007.stdout: "6231e9c1-14a2-40b5-be3c-76d87a0d733b": { 2024-09-21T06:39:10.190 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:37:02.484812+0000", 2024-09-21T06:39:10.191 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:39:10.191 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:39:10.191 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:39:10.191 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:39:10.191 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:39:10.191 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:39:10.191 INFO:teuthology.orchestra.run.smithi007.stdout: "0b89345c-1f00-4efe-8ee9-4cb17e43584c": { 2024-09-21T06:39:10.191 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:36:19.500334+0000", 2024-09-21T06:39:10.191 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:39:10.191 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:39:10.191 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:39:10.191 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:39:10.191 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:39:10.192 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:39:10.192 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:39:10.192 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:39:10.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.182+0000 7f0c87c1a640 1 -- 172.21.15.7:0/3244501631 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f0c6c0b6680 msgr2=0x7f0c6c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:10.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.182+0000 7f0c87c1a640 1 --2- 172.21.15.7:0/3244501631 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f0c6c0b6680 0x7f0c6c0b8b90 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c0cd980 tx=0x7f0c7c10b540 comp rx=0 tx=0).stop 2024-09-21T06:39:10.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.182+0000 7f0c87c1a640 1 -- 172.21.15.7:0/3244501631 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c80102a60 msgr2=0x7f0c80199310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:10.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.182+0000 7f0c87c1a640 1 --2- 172.21.15.7:0/3244501631 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c80102a60 0x7f0c80199310 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c005940 tx=0x7f0c7c0040c0 comp rx=0 tx=0).stop 2024-09-21T06:39:10.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.182+0000 7f0c87c1a640 1 -- 172.21.15.7:0/3244501631 shutdown_connections 2024-09-21T06:39:10.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.182+0000 7f0c87c1a640 1 --2- 172.21.15.7:0/3244501631 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f0c6c0b6680 0x7f0c6c0b8b90 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:10.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.182+0000 7f0c87c1a640 1 --2- 172.21.15.7:0/3244501631 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c80108cf0 0x7f0c8019eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:10.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.182+0000 7f0c87c1a640 1 --2- 172.21.15.7:0/3244501631 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0c801083a0 0x7f0c801998b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:10.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.182+0000 7f0c87c1a640 1 --2- 172.21.15.7:0/3244501631 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0c80102a60 0x7f0c80199310 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:10.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.182+0000 7f0c87c1a640 1 -- 172.21.15.7:0/3244501631 >> 172.21.15.7:0/3244501631 conn(0x7f0c80079730 msgr2=0x7f0c80101410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:10.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.182+0000 7f0c87c1a640 1 -- 172.21.15.7:0/3244501631 shutdown_connections 2024-09-21T06:39:10.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:10.182+0000 7f0c87c1a640 1 -- 172.21.15.7:0/3244501631 wait complete. 2024-09-21T06:39:10.999 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:39:10.999 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:39:11.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:39:10 smithi007 ceph-mon[30983]: pgmap v408: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 21 op/s 2024-09-21T06:39:11.264 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:39:11.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:39:10 smithi144 ceph-mon[34653]: pgmap v408: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 21 op/s 2024-09-21T06:39:11.371 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:39:10 smithi018 ceph-mon[34477]: pgmap v408: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 21 op/s 2024-09-21T06:39:11.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:11.784+0000 7f2969c56640 1 -- 172.21.15.7:0/1195705495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2964105250 msgr2=0x7f296410d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:11.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:11.784+0000 7f2969c56640 1 --2- 172.21.15.7:0/1195705495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2964105250 0x7f296410d970 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f2958009900 tx=0x7f295802a410 comp rx=0 tx=0).stop 2024-09-21T06:39:11.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:11.784+0000 7f2969c56640 1 -- 172.21.15.7:0/1195705495 shutdown_connections 2024-09-21T06:39:11.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:11.784+0000 7f2969c56640 1 --2- 172.21.15.7:0/1195705495 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f296410deb0 0x7f2964110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:11.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:11.784+0000 7f2969c56640 1 --2- 172.21.15.7:0/1195705495 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2964105250 0x7f296410d970 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:11.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:11.784+0000 7f2969c56640 1 --2- 172.21.15.7:0/1195705495 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2964104900 0x7f2964104d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:11.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:11.784+0000 7f2969c56640 1 -- 172.21.15.7:0/1195705495 >> 172.21.15.7:0/1195705495 conn(0x7f2964079760 msgr2=0x7f2964079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:11.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:11.784+0000 7f2969c56640 1 -- 172.21.15.7:0/1195705495 shutdown_connections 2024-09-21T06:39:11.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:11.784+0000 7f2969c56640 1 -- 172.21.15.7:0/1195705495 wait complete. 2024-09-21T06:39:11.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:11.785+0000 7f2969c56640 1 Processor -- start 2024-09-21T06:39:11.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:11.785+0000 7f2969c56640 1 -- start start 2024-09-21T06:39:11.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:11.786+0000 7f2969c56640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2964104900 0x7f296419a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:11.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:11.786+0000 7f2969c56640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2964105250 0x7f296419ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:11.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:11.786+0000 7f2969c56640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f296410deb0 0x7f296419fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:11.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:11.786+0000 7f2969c56640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2964113aa0 con 0x7f2964104900 2024-09-21T06:39:11.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:11.786+0000 7f2969c56640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2964113920 con 0x7f2964105250 2024-09-21T06:39:11.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:11.786+0000 7f2969c56640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2964113c20 con 0x7f296410deb0 2024-09-21T06:39:11.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:11.786+0000 7f29637fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2964104900 0x7f296419a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:11.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:11.786+0000 7f29637fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2964104900 0x7f296419a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39710/0 (socket says 172.21.15.7:39710) 2024-09-21T06:39:11.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:11.786+0000 7f29637fe640 1 -- 172.21.15.7:0/3436681776 learned_addr learned my addr 172.21.15.7:0/3436681776 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:39:11.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:11.786+0000 7f2962ffd640 1 --2- 172.21.15.7:0/3436681776 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2964105250 0x7f296419ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:11.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:11.786+0000 7f2963fff640 1 --2- 172.21.15.7:0/3436681776 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f296410deb0 0x7f296419fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:11.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:11.786+0000 7f29637fe640 1 -- 172.21.15.7:0/3436681776 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f296410deb0 msgr2=0x7f296419fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:11.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:11.786+0000 7f29637fe640 1 --2- 172.21.15.7:0/3436681776 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f296410deb0 0x7f296419fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:11.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:11.786+0000 7f29637fe640 1 -- 172.21.15.7:0/3436681776 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2964105250 msgr2=0x7f296419ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:11.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:11.786+0000 7f29637fe640 1 --2- 172.21.15.7:0/3436681776 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2964105250 0x7f296419ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:11.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:11.786+0000 7f29637fe640 1 -- 172.21.15.7:0/3436681776 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29641a0560 con 0x7f2964104900 2024-09-21T06:39:11.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:11.786+0000 7f2963fff640 1 --2- 172.21.15.7:0/3436681776 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f296410deb0 0x7f296419fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:39:11.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:11.786+0000 7f29637fe640 1 --2- 172.21.15.7:0/3436681776 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2964104900 0x7f296419a5f0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f295400d950 tx=0x7f295400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:11.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:11.787+0000 7f2960ff9640 1 -- 172.21.15.7:0/3436681776 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2954017070 con 0x7f2964104900 2024-09-21T06:39:11.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:11.787+0000 7f2969c56640 1 -- 172.21.15.7:0/3436681776 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29641a0850 con 0x7f2964104900 2024-09-21T06:39:11.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:11.787+0000 7f2960ff9640 1 -- 172.21.15.7:0/3436681776 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2954009c30 con 0x7f2964104900 2024-09-21T06:39:11.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:11.787+0000 7f2960ff9640 1 -- 172.21.15.7:0/3436681776 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f295400f620 con 0x7f2964104900 2024-09-21T06:39:11.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:11.787+0000 7f2969c56640 1 -- 172.21.15.7:0/3436681776 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29641a6fb0 con 0x7f2964104900 2024-09-21T06:39:11.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:11.788+0000 7f2969c56640 1 -- 172.21.15.7:0/3436681776 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f296406c150 con 0x7f2964104900 2024-09-21T06:39:11.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:11.789+0000 7f2960ff9640 1 -- 172.21.15.7:0/3436681776 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f295401a070 con 0x7f2964104900 2024-09-21T06:39:11.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:11.790+0000 7f2960ff9640 1 --2- 172.21.15.7:0/3436681776 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f294c0b6680 0x7f294c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:11.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:11.790+0000 7f2962ffd640 1 --2- 172.21.15.7:0/3436681776 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f294c0b6680 0x7f294c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:11.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:11.790+0000 7f2960ff9640 1 -- 172.21.15.7:0/3436681776 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f29540e7150 con 0x7f2964104900 2024-09-21T06:39:11.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:11.791+0000 7f2962ffd640 1 --2- 172.21.15.7:0/3436681776 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f294c0b6680 0x7f294c0b8b90 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f2958000c00 tx=0x7f2958031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:11.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:11.793+0000 7f2960ff9640 1 -- 172.21.15.7:0/3436681776 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2954009de0 con 0x7f2964104900 2024-09-21T06:39:12.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:12.026+0000 7f2969c56640 1 -- 172.21.15.7:0/3436681776 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2964104d10 con 0x7f2964104900 2024-09-21T06:39:12.029 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:12.027+0000 7f2960ff9640 1 -- 172.21.15.7:0/3436681776 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11899 (secure 0 0 0) 0x7f29540ad740 con 0x7f2964104900 2024-09-21T06:39:12.029 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:39:12.029 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-21T06:36:10:753693+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2015971546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2015971546},{"type":"v1","addr":"172.21.15.7:6835","nonce":2015971546}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/2350816224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":2350816224},{"type":"v1","addr":"172.21.15.7:6837","nonce":2350816224}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14823,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/1669980572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":1669980572},{"type":"v1","addr":"172.21.15.7:6839","nonce":1669980572}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14835,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/2528308973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":2528308973},{"type":"v1","addr":"172.21.15.7:6841","nonce":2528308973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24623,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1337382979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1337382979},{"type":"v1","addr":"172.21.15.18:6833","nonce":1337382979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/2751454345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":2751454345},{"type":"v1","addr":"172.21.15.144:6833","nonce":2751454345}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:34:24.627168+0000","modified":"2024-09-21T06:36:10.737288+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24716,"mds_1":24688,"mds_2":24686},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24656":{"gid":24656,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6835/158884796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":158884796},{"type":"v1","addr":"172.21.15.18:6835","nonce":158884796}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6835/3636739922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3636739922},{"type":"v1","addr":"172.21.15.144:6835","nonce":3636739922}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24673":{"gid":24673,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6837/1126341753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":1126341753},{"type":"v1","addr":"172.21.15.144:6837","nonce":1126341753}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.18:6837/1539670694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1539670694},{"type":"v1","addr":"172.21.15.18:6837","nonce":1539670694}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24688":{"gid":24688,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.144:6839/4027821922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":4027821922},{"type":"v1","addr":"172.21.15.144:6839","nonce":4027821922}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24716":{"gid":24716,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.18:6839/3798713532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":3798713532},{"type":"v1","addr":"172.21.15.18:6839","nonce":3798713532}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24716,"qdb_cluster":[24716,24688,24686]},"id":1}]} 2024-09-21T06:39:12.030 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-21T06:39:12.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:12.029+0000 7f2969c56640 1 -- 172.21.15.7:0/3436681776 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f294c0b6680 msgr2=0x7f294c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:12.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:12.029+0000 7f2969c56640 1 --2- 172.21.15.7:0/3436681776 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f294c0b6680 0x7f294c0b8b90 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f2958000c00 tx=0x7f2958031400 comp rx=0 tx=0).stop 2024-09-21T06:39:12.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:12.029+0000 7f2969c56640 1 -- 172.21.15.7:0/3436681776 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2964104900 msgr2=0x7f296419a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:12.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:12.029+0000 7f2969c56640 1 --2- 172.21.15.7:0/3436681776 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2964104900 0x7f296419a5f0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f295400d950 tx=0x7f295400de10 comp rx=0 tx=0).stop 2024-09-21T06:39:12.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:12.029+0000 7f2969c56640 1 -- 172.21.15.7:0/3436681776 shutdown_connections 2024-09-21T06:39:12.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:12.029+0000 7f2969c56640 1 --2- 172.21.15.7:0/3436681776 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f294c0b6680 0x7f294c0b8b90 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:12.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:12.029+0000 7f2969c56640 1 --2- 172.21.15.7:0/3436681776 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f296410deb0 0x7f296419fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:12.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:12.029+0000 7f2969c56640 1 --2- 172.21.15.7:0/3436681776 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2964105250 0x7f296419ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:12.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:12.029+0000 7f2969c56640 1 --2- 172.21.15.7:0/3436681776 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2964104900 0x7f296419a5f0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:12.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:12.029+0000 7f2969c56640 1 -- 172.21.15.7:0/3436681776 >> 172.21.15.7:0/3436681776 conn(0x7f2964079760 msgr2=0x7f2964107ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:12.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:12.029+0000 7f2969c56640 1 -- 172.21.15.7:0/3436681776 shutdown_connections 2024-09-21T06:39:12.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:12.029+0000 7f2969c56640 1 -- 172.21.15.7:0/3436681776 wait complete. 2024-09-21T06:39:12.695 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:39:12.954 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:39:13.219 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:39:12 smithi007 ceph-mon[30983]: pgmap v409: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 21 op/s 2024-09-21T06:39:13.219 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:39:12 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/3436681776' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:39:13.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:39:12 smithi144 ceph-mon[34653]: pgmap v409: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 21 op/s 2024-09-21T06:39:13.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:39:12 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/3436681776' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:39:13.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:39:12 smithi018 ceph-mon[34477]: pgmap v409: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 21 op/s 2024-09-21T06:39:13.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:39:12 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/3436681776' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:39:13.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.461+0000 7fbd61d35640 1 -- 172.21.15.7:0/2093566968 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd5c105b10 msgr2=0x7fbd5c10f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:13.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.461+0000 7fbd61d35640 1 --2- 172.21.15.7:0/2093566968 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd5c105b10 0x7fbd5c10f560 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fbd54009ca0 tx=0x7fbd5402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:39:13.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.461+0000 7fbd61d35640 1 -- 172.21.15.7:0/2093566968 shutdown_connections 2024-09-21T06:39:13.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.461+0000 7fbd61d35640 1 --2- 172.21.15.7:0/2093566968 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd5c105b10 0x7fbd5c10f560 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:13.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.461+0000 7fbd61d35640 1 --2- 172.21.15.7:0/2093566968 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd5c1051c0 0x7fbd5c1055d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:13.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.461+0000 7fbd61d35640 1 --2- 172.21.15.7:0/2093566968 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbd5c1031f0 0x7fbd5c103600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:13.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.461+0000 7fbd61d35640 1 -- 172.21.15.7:0/2093566968 >> 172.21.15.7:0/2093566968 conn(0x7fbd5c077cc0 msgr2=0x7fbd5c078100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:13.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.461+0000 7fbd61d35640 1 -- 172.21.15.7:0/2093566968 shutdown_connections 2024-09-21T06:39:13.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.461+0000 7fbd61d35640 1 -- 172.21.15.7:0/2093566968 wait complete. 2024-09-21T06:39:13.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.462+0000 7fbd61d35640 1 Processor -- start 2024-09-21T06:39:13.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.462+0000 7fbd61d35640 1 -- start start 2024-09-21T06:39:13.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.462+0000 7fbd61d35640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbd5c1031f0 0x7fbd5c0fee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:13.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.462+0000 7fbd61d35640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd5c1051c0 0x7fbd5c0ff370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:13.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.462+0000 7fbd61d35640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd5c105b10 0x7fbd5c0ff8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:13.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.462+0000 7fbd61d35640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbd5c1129b0 con 0x7fbd5c1051c0 2024-09-21T06:39:13.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.462+0000 7fbd61d35640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fbd5c112830 con 0x7fbd5c105b10 2024-09-21T06:39:13.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.462+0000 7fbd61d35640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fbd5c112b30 con 0x7fbd5c1031f0 2024-09-21T06:39:13.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.462+0000 7fbd53fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd5c1051c0 0x7fbd5c0ff370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:13.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.463+0000 7fbd53fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd5c1051c0 0x7fbd5c0ff370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39732/0 (socket says 172.21.15.7:39732) 2024-09-21T06:39:13.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.463+0000 7fbd53fff640 1 -- 172.21.15.7:0/3895630489 learned_addr learned my addr 172.21.15.7:0/3895630489 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:39:13.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.463+0000 7fbd5b7fe640 1 --2- 172.21.15.7:0/3895630489 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbd5c1031f0 0x7fbd5c0fee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:13.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.463+0000 7fbd5bfff640 1 --2- 172.21.15.7:0/3895630489 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd5c105b10 0x7fbd5c0ff8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:13.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.463+0000 7fbd53fff640 1 -- 172.21.15.7:0/3895630489 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbd5c1031f0 msgr2=0x7fbd5c0fee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:13.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.463+0000 7fbd53fff640 1 --2- 172.21.15.7:0/3895630489 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbd5c1031f0 0x7fbd5c0fee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:13.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.463+0000 7fbd53fff640 1 -- 172.21.15.7:0/3895630489 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd5c105b10 msgr2=0x7fbd5c0ff8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:13.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.463+0000 7fbd53fff640 1 --2- 172.21.15.7:0/3895630489 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd5c105b10 0x7fbd5c0ff8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:13.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.463+0000 7fbd53fff640 1 -- 172.21.15.7:0/3895630489 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd5c1a86d0 con 0x7fbd5c1051c0 2024-09-21T06:39:13.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.463+0000 7fbd53fff640 1 --2- 172.21.15.7:0/3895630489 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd5c1051c0 0x7fbd5c0ff370 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fbd4400d770 tx=0x7fbd4400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:13.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.463+0000 7fbd597fa640 1 -- 172.21.15.7:0/3895630489 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd44017070 con 0x7fbd5c1051c0 2024-09-21T06:39:13.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.463+0000 7fbd597fa640 1 -- 172.21.15.7:0/3895630489 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd44009c30 con 0x7fbd5c1051c0 2024-09-21T06:39:13.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.463+0000 7fbd61d35640 1 -- 172.21.15.7:0/3895630489 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd5c1a89c0 con 0x7fbd5c1051c0 2024-09-21T06:39:13.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.463+0000 7fbd597fa640 1 -- 172.21.15.7:0/3895630489 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd4400f620 con 0x7fbd5c1051c0 2024-09-21T06:39:13.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.463+0000 7fbd61d35640 1 -- 172.21.15.7:0/3895630489 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd5c1a8f50 con 0x7fbd5c1051c0 2024-09-21T06:39:13.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.466+0000 7fbd682a9740 1 Processor -- start 2024-09-21T06:39:13.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.466+0000 7fbd682a9740 1 -- start start 2024-09-21T06:39:13.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.466+0000 7fbd597fa640 1 -- 172.21.15.7:0/3895630489 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7fbd4401a070 con 0x7fbd5c1051c0 2024-09-21T06:39:13.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.466+0000 7fbd682a9740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5590650ac070 0x5590654536a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:13.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.466+0000 7fbd682a9740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5590650831b0 0x559065453be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:13.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.466+0000 7fbd682a9740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55906508b390 0x559065454120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:13.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.466+0000 7fbd682a9740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5590653c9ea0 con 0x55906508b390 2024-09-21T06:39:13.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.466+0000 7fbd682a9740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5590653b92d0 con 0x5590650831b0 2024-09-21T06:39:13.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.466+0000 7fbd682a9740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5590653bd0e0 con 0x5590650ac070 2024-09-21T06:39:13.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.467+0000 7fbd53fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55906508b390 0x559065454120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:13.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.467+0000 7fbd53fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55906508b390 0x559065454120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39740/0 (socket says 172.21.15.7:39740) 2024-09-21T06:39:13.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.467+0000 7fbd53fff640 1 -- 172.21.15.7:0/664558690 learned_addr learned my addr 172.21.15.7:0/664558690 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:39:13.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.467+0000 7fbd5bfff640 1 --2- 172.21.15.7:0/664558690 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5590650ac070 0x5590654536a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:13.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.467+0000 7fbd5b7fe640 1 --2- 172.21.15.7:0/664558690 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5590650831b0 0x559065453be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:13.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.467+0000 7fbd53fff640 1 -- 172.21.15.7:0/664558690 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5590650ac070 msgr2=0x5590654536a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:13.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.467+0000 7fbd53fff640 1 --2- 172.21.15.7:0/664558690 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5590650ac070 0x5590654536a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:13.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.467+0000 7fbd53fff640 1 -- 172.21.15.7:0/664558690 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5590650831b0 msgr2=0x559065453be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:13.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.467+0000 7fbd53fff640 1 --2- 172.21.15.7:0/664558690 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5590650831b0 0x559065453be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:13.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.467+0000 7fbd53fff640 1 -- 172.21.15.7:0/664558690 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559065117650 con 0x55906508b390 2024-09-21T06:39:13.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.467+0000 7fbd53fff640 1 --2- 172.21.15.7:0/664558690 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55906508b390 0x559065454120 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fbd440e47a0 tx=0x7fbd440ef700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=476bd645d3d2d072 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:13.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.468+0000 7fbd5b7fe640 1 --2- 172.21.15.7:0/664558690 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5590650831b0 0x559065453be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:39:13.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.468+0000 7fbd597fa640 1 --2- 172.21.15.7:0/3895630489 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fbd480b6700 0x7fbd480b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:13.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.468+0000 7fbd51ffb640 1 -- 172.21.15.7:0/664558690 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd440fa070 con 0x55906508b390 2024-09-21T06:39:13.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.468+0000 7fbd51ffb640 1 -- 172.21.15.7:0/664558690 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd440acb20 con 0x55906508b390 2024-09-21T06:39:13.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.468+0000 7fbd51ffb640 1 -- 172.21.15.7:0/664558690 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd440ac780 con 0x55906508b390 2024-09-21T06:39:13.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.468+0000 7fbd5bfff640 1 --2- 172.21.15.7:0/3895630489 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fbd480b6700 0x7fbd480b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:13.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.468+0000 7fbd597fa640 1 -- 172.21.15.7:0/3895630489 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fbd440e7070 con 0x7fbd5c1051c0 2024-09-21T06:39:13.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.469+0000 7fbd682a9740 1 -- 172.21.15.7:0/664558690 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55906508b390 msgr2=0x559065454120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:13.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.469+0000 7fbd5bfff640 1 --2- 172.21.15.7:0/3895630489 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fbd480b6700 0x7fbd480b8c10 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fbd5402f500 tx=0x7fbd5402f370 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:13.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.469+0000 7fbd682a9740 1 --2- 172.21.15.7:0/664558690 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55906508b390 0x559065454120 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fbd440e47a0 tx=0x7fbd440ef700 comp rx=0 tx=0).stop 2024-09-21T06:39:13.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.469+0000 7fbd682a9740 1 -- 172.21.15.7:0/664558690 shutdown_connections 2024-09-21T06:39:13.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.469+0000 7fbd682a9740 1 --2- 172.21.15.7:0/664558690 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55906508b390 0x559065454120 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:13.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.469+0000 7fbd682a9740 1 --2- 172.21.15.7:0/664558690 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5590650831b0 0x559065453be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:13.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.469+0000 7fbd682a9740 1 --2- 172.21.15.7:0/664558690 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5590650ac070 0x5590654536a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:13.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.469+0000 7fbd682a9740 1 -- 172.21.15.7:0/664558690 >> 172.21.15.7:0/664558690 conn(0x5590650a0460 msgr2=0x559065451590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:13.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.469+0000 7fbd682a9740 1 -- 172.21.15.7:0/664558690 shutdown_connections 2024-09-21T06:39:13.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.469+0000 7fbd682a9740 1 -- 172.21.15.7:0/664558690 wait complete. 2024-09-21T06:39:13.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.469+0000 7fbd682a9740 1 -- start start 2024-09-21T06:39:13.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.470+0000 7fbd682a9740 1 Processor -- start 2024-09-21T06:39:13.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.470+0000 7fbd682a9740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5590650831b0 0x55906545ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:13.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.470+0000 7fbd682a9740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55906508b390 0x55906545f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:13.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.470+0000 7fbd682a9740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5590650ac070 0x55906546b170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:13.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.470+0000 7fbd682a9740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55906521a700 con 0x5590650ac070 2024-09-21T06:39:13.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.470+0000 7fbd682a9740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559065354160 con 0x55906508b390 2024-09-21T06:39:13.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.470+0000 7fbd682a9740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x559065461e80 con 0x5590650831b0 2024-09-21T06:39:13.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.470+0000 7fbd5bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5590650ac070 0x55906546b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:13.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.470+0000 7fbd682a9740 10 client.0 _ll_register_callbacks cb 0x55906536d9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:39:13.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.470+0000 7fbd5bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5590650ac070 0x55906546b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39746/0 (socket says 172.21.15.7:39746) 2024-09-21T06:39:13.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.470+0000 7fbd5bfff640 1 -- 172.21.15.7:0/371400308 learned_addr learned my addr 172.21.15.7:0/371400308 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:39:13.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.471+0000 7fbd53fff640 1 --2- 172.21.15.7:0/371400308 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55906508b390 0x55906545f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:13.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.471+0000 7fbd5b7fe640 1 --2- 172.21.15.7:0/371400308 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5590650831b0 0x55906545ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:13.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.471+0000 7fbd5bfff640 1 -- 172.21.15.7:0/371400308 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5590650831b0 msgr2=0x55906545ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:13.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.471+0000 7fbd5bfff640 1 --2- 172.21.15.7:0/371400308 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5590650831b0 0x55906545ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:13.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.471+0000 7fbd5bfff640 1 -- 172.21.15.7:0/371400308 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55906508b390 msgr2=0x55906545f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:13.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.471+0000 7fbd5bfff640 1 --2- 172.21.15.7:0/371400308 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55906508b390 0x55906545f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:13.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.471+0000 7fbd5bfff640 1 -- 172.21.15.7:0/371400308 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559065381c90 con 0x5590650ac070 2024-09-21T06:39:13.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.471+0000 7fbd5bfff640 1 --2- 172.21.15.7:0/371400308 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5590650ac070 0x55906546b170 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fbd54031660 tx=0x7fbd5402a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b1af2e30016b8d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:13.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.471+0000 7fbd3affd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:39:13.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.471+0000 7fbd3affd640 1 -- 172.21.15.7:0/371400308 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd54004040 con 0x5590650ac070 2024-09-21T06:39:13.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.471+0000 7fbd3affd640 1 -- 172.21.15.7:0/371400308 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fbd540041e0 con 0x5590650ac070 2024-09-21T06:39:13.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.471+0000 7fbd682a9740 1 -- 172.21.15.7:0/371400308 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbd440acb20 con 0x5590650ac070 2024-09-21T06:39:13.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.472+0000 7fbd3affd640 1 -- 172.21.15.7:0/371400308 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fbd540043e0 con 0x5590650ac070 2024-09-21T06:39:13.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.472+0000 7fbd682a9740 10 client.16056 fetch_fsmap learned FSMap version 25 2024-09-21T06:39:13.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.472+0000 7fbd682a9740 1 -- 172.21.15.7:0/371400308 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55906546dc30 con 0x5590650ac070 2024-09-21T06:39:13.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.472+0000 7fbd3affd640 1 -- 172.21.15.7:0/371400308 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd440acb20 con 0x5590650ac070 2024-09-21T06:39:13.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.472+0000 7fbd3affd640 1 -- 172.21.15.7:0/371400308 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fbd54051070 con 0x5590650ac070 2024-09-21T06:39:13.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.472+0000 7fbd682a9740 10 client.16056 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:39:13.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.472+0000 7fbd682a9740 10 client.16056 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-21T06:39:13.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.472+0000 7fbd682a9740 20 client.16056 populate_metadata read hostname 'smithi007' 2024-09-21T06:39:13.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.472+0000 7fbd682a9740 1 --2- 172.21.15.7:0/371400308 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x55906506a9f0 0x559065471120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:13.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.472+0000 7fbd682a9740 4 client.16056 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:39:13.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.472+0000 7fbd682a9740 1 -- 172.21.15.7:0/371400308 --> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5590653cbdf0 con 0x55906506a9f0 2024-09-21T06:39:13.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.473+0000 7fbd5b7fe640 1 --2- 172.21.15.7:0/371400308 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x55906506a9f0 0x559065471120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:13.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.473+0000 7fbd5b7fe640 1 --2- 172.21.15.7:0/371400308 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x55906506a9f0 0x559065471120 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=afd6a5e02af0544e server_cookie=b8af44149282f60e in_seq=0 out_seq=0 2024-09-21T06:39:13.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.473+0000 7fbd3affd640 10 client.16056 ms_handle_connect on v2:172.21.15.18:6836/1539670694 2024-09-21T06:39:13.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.474+0000 7fbd3affd640 1 -- 172.21.15.7:0/371400308 <== mds.2 v2:172.21.15.18:6836/1539670694 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5590653cbdf0 con 0x55906506a9f0 2024-09-21T06:39:13.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.474+0000 7fbd3affd640 10 client.16056 handle_command_reply: tid=0 2024-09-21T06:39:13.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.474+0000 7fbd682a9740 1 client.16056 shutdown 2024-09-21T06:39:13.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.474+0000 7fbd682a9740 1 -- 172.21.15.7:0/371400308 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5590650ac070 msgr2=0x55906546b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:13.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.474+0000 7fbd682a9740 1 --2- 172.21.15.7:0/371400308 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5590650ac070 0x55906546b170 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fbd54031660 tx=0x7fbd5402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:39:13.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.474+0000 7fbd682a9740 1 -- 172.21.15.7:0/371400308 shutdown_connections 2024-09-21T06:39:13.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.474+0000 7fbd682a9740 1 --2- 172.21.15.7:0/371400308 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x55906506a9f0 0x559065471120 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:13.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.474+0000 7fbd682a9740 1 --2- 172.21.15.7:0/371400308 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5590650ac070 0x55906546b170 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:13.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.474+0000 7fbd3affd640 0 client.16056 ms_handle_reset on v2:172.21.15.18:6836/1539670694 2024-09-21T06:39:13.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.474+0000 7fbd682a9740 1 --2- 172.21.15.7:0/371400308 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55906508b390 0x55906545f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:13.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.474+0000 7fbd682a9740 1 --2- 172.21.15.7:0/371400308 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5590650831b0 0x55906545ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:13.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.474+0000 7fbd682a9740 1 -- 172.21.15.7:0/371400308 >> 172.21.15.7:0/371400308 conn(0x5590650a0460 msgr2=0x559065456830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:13.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.474+0000 7fbd682a9740 1 -- 172.21.15.7:0/371400308 shutdown_connections 2024-09-21T06:39:13.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.474+0000 7fbd682a9740 1 -- 172.21.15.7:0/371400308 wait complete. 2024-09-21T06:39:13.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.474+0000 7fbd682a9740 20 client.16056 trim_cache size 0 max 16384 2024-09-21T06:39:13.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.487+0000 7fbd682a9740 1 Processor -- start 2024-09-21T06:39:13.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.487+0000 7fbd682a9740 1 -- start start 2024-09-21T06:39:13.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.488+0000 7fbd682a9740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55906506a9f0 0x559065456eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:13.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.488+0000 7fbd682a9740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5590650831b0 0x55906546b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:13.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.488+0000 7fbd682a9740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55906508b390 0x559065450eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:13.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.488+0000 7fbd682a9740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbd5c1b3f70 con 0x5590650831b0 2024-09-21T06:39:13.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.488+0000 7fbd682a9740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fbd5c1b1840 con 0x55906508b390 2024-09-21T06:39:13.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.488+0000 7fbd682a9740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fbd5c1af670 con 0x55906506a9f0 2024-09-21T06:39:13.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.488+0000 7fbd53fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5590650831b0 0x55906546b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:13.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.488+0000 7fbd53fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5590650831b0 0x55906546b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39754/0 (socket says 172.21.15.7:39754) 2024-09-21T06:39:13.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.488+0000 7fbd53fff640 1 -- 172.21.15.7:0/3985821233 learned_addr learned my addr 172.21.15.7:0/3985821233 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:39:13.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.488+0000 7fbd5b7fe640 1 --2- 172.21.15.7:0/3985821233 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55906506a9f0 0x559065456eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:13.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.488+0000 7fbd5bfff640 1 --2- 172.21.15.7:0/3985821233 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55906508b390 0x559065450eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:13.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.488+0000 7fbd53fff640 1 -- 172.21.15.7:0/3985821233 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55906506a9f0 msgr2=0x559065456eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:13.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.488+0000 7fbd53fff640 1 --2- 172.21.15.7:0/3985821233 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55906506a9f0 0x559065456eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:13.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.488+0000 7fbd53fff640 1 -- 172.21.15.7:0/3985821233 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55906508b390 msgr2=0x559065450eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:13.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.488+0000 7fbd53fff640 1 --2- 172.21.15.7:0/3985821233 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55906508b390 0x559065450eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:13.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.488+0000 7fbd53fff640 1 -- 172.21.15.7:0/3985821233 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559065456500 con 0x5590650831b0 2024-09-21T06:39:13.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.488+0000 7fbd53fff640 1 --2- 172.21.15.7:0/3985821233 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5590650831b0 0x55906546b070 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fbd440b51c0 tx=0x7fbd4400df10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18f2da45fbe5457a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:13.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.489+0000 7fbd517fa640 1 -- 172.21.15.7:0/3985821233 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd440b4b60 con 0x5590650831b0 2024-09-21T06:39:13.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.489+0000 7fbd517fa640 1 -- 172.21.15.7:0/3985821233 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd440ea9b0 con 0x5590650831b0 2024-09-21T06:39:13.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.489+0000 7fbd517fa640 1 -- 172.21.15.7:0/3985821233 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd440b4dc0 con 0x5590650831b0 2024-09-21T06:39:13.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.489+0000 7fbd682a9740 1 -- 172.21.15.7:0/3985821233 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5590650831b0 msgr2=0x55906546b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:13.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.489+0000 7fbd682a9740 1 --2- 172.21.15.7:0/3985821233 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5590650831b0 0x55906546b070 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fbd440b51c0 tx=0x7fbd4400df10 comp rx=0 tx=0).stop 2024-09-21T06:39:13.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.489+0000 7fbd682a9740 1 -- 172.21.15.7:0/3985821233 shutdown_connections 2024-09-21T06:39:13.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.489+0000 7fbd682a9740 1 --2- 172.21.15.7:0/3985821233 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55906508b390 0x559065450eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:13.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.489+0000 7fbd682a9740 1 --2- 172.21.15.7:0/3985821233 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5590650831b0 0x55906546b070 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:13.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.489+0000 7fbd682a9740 1 --2- 172.21.15.7:0/3985821233 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55906506a9f0 0x559065456eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:13.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.489+0000 7fbd682a9740 1 -- 172.21.15.7:0/3985821233 >> 172.21.15.7:0/3985821233 conn(0x5590650a0460 msgr2=0x5590654567a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:13.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.490+0000 7fbd682a9740 1 -- 172.21.15.7:0/3985821233 shutdown_connections 2024-09-21T06:39:13.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.490+0000 7fbd682a9740 1 -- 172.21.15.7:0/3985821233 wait complete. 2024-09-21T06:39:13.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.490+0000 7fbd682a9740 1 -- start start 2024-09-21T06:39:13.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.490+0000 7fbd682a9740 1 Processor -- start 2024-09-21T06:39:13.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.490+0000 7fbd682a9740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55906506a9f0 0x559065463170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:13.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.490+0000 7fbd682a9740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5590650831b0 0x5590654636b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:13.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.490+0000 7fbd682a9740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55906508b390 0x559065463bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:13.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.490+0000 7fbd682a9740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbd5c1afd00 con 0x5590650831b0 2024-09-21T06:39:13.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.490+0000 7fbd682a9740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fbd5c1b1170 con 0x55906506a9f0 2024-09-21T06:39:13.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.490+0000 7fbd682a9740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fbd5c1b03d0 con 0x55906508b390 2024-09-21T06:39:13.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.491+0000 7fbd53fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5590650831b0 0x5590654636b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:13.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.491+0000 7fbd682a9740 10 client.0 _ll_register_callbacks cb 0x7fbd54031520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:39:13.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.491+0000 7fbd53fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5590650831b0 0x5590654636b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39766/0 (socket says 172.21.15.7:39766) 2024-09-21T06:39:13.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.491+0000 7fbd53fff640 1 -- 172.21.15.7:0/3998696490 learned_addr learned my addr 172.21.15.7:0/3998696490 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:39:13.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.491+0000 7fbd5b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55906506a9f0 0x559065463170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:13.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.491+0000 7fbd5bfff640 1 --2- 172.21.15.7:0/3998696490 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55906508b390 0x559065463bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:13.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.491+0000 7fbd53fff640 1 -- 172.21.15.7:0/3998696490 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55906508b390 msgr2=0x559065463bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:13.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.491+0000 7fbd53fff640 1 --2- 172.21.15.7:0/3998696490 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55906508b390 0x559065463bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:13.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.491+0000 7fbd53fff640 1 -- 172.21.15.7:0/3998696490 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55906506a9f0 msgr2=0x559065463170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:13.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.491+0000 7fbd53fff640 1 --2- 172.21.15.7:0/3998696490 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55906506a9f0 0x559065463170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:13.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.491+0000 7fbd53fff640 1 -- 172.21.15.7:0/3998696490 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5590654dab90 con 0x5590650831b0 2024-09-21T06:39:13.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.491+0000 7fbd5b7fe640 1 --2- 172.21.15.7:0/3998696490 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55906506a9f0 0x559065463170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:39:13.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.491+0000 7fbd53fff640 1 --2- 172.21.15.7:0/3998696490 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5590650831b0 0x5590654636b0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fbd440acd10 tx=0x7fbd440ea910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64b805d7483064b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:13.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.491+0000 7fbd3affd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:39:13.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.491+0000 7fbd3affd640 1 -- 172.21.15.7:0/3998696490 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd44021070 con 0x5590650831b0 2024-09-21T06:39:13.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.491+0000 7fbd3affd640 1 -- 172.21.15.7:0/3998696490 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fbd440b31d0 con 0x5590650831b0 2024-09-21T06:39:13.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.491+0000 7fbd682a9740 1 -- 172.21.15.7:0/3998696490 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbd440ea9b0 con 0x5590650831b0 2024-09-21T06:39:13.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.492+0000 7fbd3affd640 1 -- 172.21.15.7:0/3998696490 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fbd440b5000 con 0x5590650831b0 2024-09-21T06:39:13.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.492+0000 7fbd682a9740 10 client.16062 fetch_fsmap learned FSMap version 25 2024-09-21T06:39:13.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.492+0000 7fbd682a9740 1 -- 172.21.15.7:0/3998696490 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5590654dbe10 con 0x5590650831b0 2024-09-21T06:39:13.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.492+0000 7fbd3affd640 1 -- 172.21.15.7:0/3998696490 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd440ea9b0 con 0x5590650831b0 2024-09-21T06:39:13.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.492+0000 7fbd3affd640 1 -- 172.21.15.7:0/3998696490 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fbd440e4ae0 con 0x5590650831b0 2024-09-21T06:39:13.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.492+0000 7fbd682a9740 10 client.16062 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:39:13.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.492+0000 7fbd682a9740 10 client.16062 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-21T06:39:13.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.492+0000 7fbd682a9740 20 client.16062 populate_metadata read hostname 'smithi007' 2024-09-21T06:39:13.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.492+0000 7fbd682a9740 1 --2- 172.21.15.7:0/3998696490 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x5590650ac070 0x5590654de0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:13.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.492+0000 7fbd682a9740 4 client.16062 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:39:13.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.492+0000 7fbd682a9740 1 -- 172.21.15.7:0/3998696490 --> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5590653c78a0 con 0x5590650ac070 2024-09-21T06:39:13.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.492+0000 7fbd5b7fe640 1 --2- 172.21.15.7:0/3998696490 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x5590650ac070 0x5590654de0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:13.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.493+0000 7fbd3affd640 10 client.16062 ms_handle_connect on v2:172.21.15.18:6836/1539670694 2024-09-21T06:39:13.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.493+0000 7fbd5b7fe640 1 --2- 172.21.15.7:0/3998696490 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x5590650ac070 0x5590654de0a0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=82f91561d1f36492 server_cookie=b76125ca386e5554 in_seq=0 out_seq=0 2024-09-21T06:39:13.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.493+0000 7fbd3affd640 1 -- 172.21.15.7:0/3998696490 <== mds.2 v2:172.21.15.18:6836/1539670694 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5590653c78a0 con 0x5590650ac070 2024-09-21T06:39:13.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.493+0000 7fbd3affd640 10 client.16062 handle_command_reply: tid=0 2024-09-21T06:39:13.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.493+0000 7fbd682a9740 1 client.16062 shutdown 2024-09-21T06:39:13.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.493+0000 7fbd682a9740 1 -- 172.21.15.7:0/3998696490 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5590650831b0 msgr2=0x5590654636b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:13.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.493+0000 7fbd682a9740 1 --2- 172.21.15.7:0/3998696490 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5590650831b0 0x5590654636b0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fbd440acd10 tx=0x7fbd440ea910 comp rx=0 tx=0).stop 2024-09-21T06:39:13.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.493+0000 7fbd682a9740 1 -- 172.21.15.7:0/3998696490 shutdown_connections 2024-09-21T06:39:13.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.493+0000 7fbd682a9740 1 --2- 172.21.15.7:0/3998696490 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x5590650ac070 0x5590654de0a0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:13.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.493+0000 7fbd682a9740 1 --2- 172.21.15.7:0/3998696490 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55906508b390 0x559065463bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:13.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.493+0000 7fbd682a9740 1 --2- 172.21.15.7:0/3998696490 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5590650831b0 0x5590654636b0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:13.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.493+0000 7fbd682a9740 1 --2- 172.21.15.7:0/3998696490 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55906506a9f0 0x559065463170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:13.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.493+0000 7fbd3affd640 0 client.16062 ms_handle_reset on v2:172.21.15.18:6836/1539670694 2024-09-21T06:39:13.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.493+0000 7fbd682a9740 1 -- 172.21.15.7:0/3998696490 >> 172.21.15.7:0/3998696490 conn(0x5590650a0460 msgr2=0x559065450e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:13.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.493+0000 7fbd682a9740 1 -- 172.21.15.7:0/3998696490 shutdown_connections 2024-09-21T06:39:13.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.493+0000 7fbd682a9740 1 -- 172.21.15.7:0/3998696490 wait complete. 2024-09-21T06:39:13.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.494+0000 7fbd682a9740 20 client.16062 trim_cache size 0 max 16384 2024-09-21T06:39:13.502 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:39:13.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.494+0000 7fbd61d35640 1 -- 172.21.15.7:0/3895630489 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fbd480b6700 msgr2=0x7fbd480b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:13.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.494+0000 7fbd61d35640 1 --2- 172.21.15.7:0/3895630489 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fbd480b6700 0x7fbd480b8c10 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fbd5402f500 tx=0x7fbd5402f370 comp rx=0 tx=0).stop 2024-09-21T06:39:13.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.494+0000 7fbd61d35640 1 -- 172.21.15.7:0/3895630489 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd5c1051c0 msgr2=0x7fbd5c0ff370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:13.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.494+0000 7fbd61d35640 1 --2- 172.21.15.7:0/3895630489 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd5c1051c0 0x7fbd5c0ff370 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fbd4400d770 tx=0x7fbd4400dc30 comp rx=0 tx=0).stop 2024-09-21T06:39:13.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.494+0000 7fbd61d35640 1 -- 172.21.15.7:0/3895630489 shutdown_connections 2024-09-21T06:39:13.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.494+0000 7fbd61d35640 1 --2- 172.21.15.7:0/3895630489 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fbd480b6700 0x7fbd480b8c10 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:13.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.494+0000 7fbd61d35640 1 --2- 172.21.15.7:0/3895630489 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd5c105b10 0x7fbd5c0ff8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:13.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.494+0000 7fbd61d35640 1 --2- 172.21.15.7:0/3895630489 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbd5c1051c0 0x7fbd5c0ff370 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:13.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.494+0000 7fbd61d35640 1 --2- 172.21.15.7:0/3895630489 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbd5c1031f0 0x7fbd5c0fee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:13.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.494+0000 7fbd61d35640 1 -- 172.21.15.7:0/3895630489 >> 172.21.15.7:0/3895630489 conn(0x7fbd5c077cc0 msgr2=0x7fbd5c1064d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:13.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.494+0000 7fbd61d35640 1 -- 172.21.15.7:0/3895630489 shutdown_connections 2024-09-21T06:39:13.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:13.494+0000 7fbd61d35640 1 -- 172.21.15.7:0/3895630489 wait complete. 2024-09-21T06:39:14.264 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:39:14.521 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:39:15.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.016+0000 7ff28efd6640 1 -- 172.21.15.7:0/1086060987 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff28810de10 msgr2=0x7ff288110300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:15.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.016+0000 7ff28efd6640 1 --2- 172.21.15.7:0/1086060987 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff28810de10 0x7ff288110300 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7ff280009900 tx=0x7ff28002a410 comp rx=0 tx=0).stop 2024-09-21T06:39:15.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.016+0000 7ff28efd6640 1 -- 172.21.15.7:0/1086060987 shutdown_connections 2024-09-21T06:39:15.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.016+0000 7ff28efd6640 1 --2- 172.21.15.7:0/1086060987 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff28810de10 0x7ff288110300 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:15.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.016+0000 7ff28efd6640 1 --2- 172.21.15.7:0/1086060987 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff288105300 0x7ff28810d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:15.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.016+0000 7ff28efd6640 1 --2- 172.21.15.7:0/1086060987 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2881049b0 0x7ff288104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:15.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.016+0000 7ff28efd6640 1 -- 172.21.15.7:0/1086060987 >> 172.21.15.7:0/1086060987 conn(0x7ff288079730 msgr2=0x7ff288079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:15.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.016+0000 7ff28efd6640 1 -- 172.21.15.7:0/1086060987 shutdown_connections 2024-09-21T06:39:15.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.016+0000 7ff28efd6640 1 -- 172.21.15.7:0/1086060987 wait complete. 2024-09-21T06:39:15.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.017+0000 7ff28efd6640 1 Processor -- start 2024-09-21T06:39:15.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.017+0000 7ff28efd6640 1 -- start start 2024-09-21T06:39:15.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.017+0000 7ff28efd6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2881049b0 0x7ff28819a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:15.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.017+0000 7ff28efd6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff288105300 0x7ff28819ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:15.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.017+0000 7ff28efd6640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff28810de10 0x7ff28819fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:15.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.017+0000 7ff28efd6640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff288113a70 con 0x7ff2881049b0 2024-09-21T06:39:15.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.017+0000 7ff28efd6640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff2881138f0 con 0x7ff288105300 2024-09-21T06:39:15.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.017+0000 7ff28efd6640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff288113bf0 con 0x7ff28810de10 2024-09-21T06:39:15.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.017+0000 7ff28cd72640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2881049b0 0x7ff28819a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:15.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.018+0000 7ff28cd72640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2881049b0 0x7ff28819a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39776/0 (socket says 172.21.15.7:39776) 2024-09-21T06:39:15.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.018+0000 7ff28cd72640 1 -- 172.21.15.7:0/2588024670 learned_addr learned my addr 172.21.15.7:0/2588024670 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:39:15.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.018+0000 7ff28d573640 1 --2- 172.21.15.7:0/2588024670 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff28810de10 0x7ff28819fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:15.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.018+0000 7ff287fff640 1 --2- 172.21.15.7:0/2588024670 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff288105300 0x7ff28819ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:15.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.018+0000 7ff28cd72640 1 -- 172.21.15.7:0/2588024670 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff28810de10 msgr2=0x7ff28819fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:15.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.018+0000 7ff28cd72640 1 --2- 172.21.15.7:0/2588024670 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff28810de10 0x7ff28819fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:15.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.018+0000 7ff28cd72640 1 -- 172.21.15.7:0/2588024670 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff288105300 msgr2=0x7ff28819ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:15.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.018+0000 7ff28cd72640 1 --2- 172.21.15.7:0/2588024670 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff288105300 0x7ff28819ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:15.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.018+0000 7ff28cd72640 1 -- 172.21.15.7:0/2588024670 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2881a0430 con 0x7ff2881049b0 2024-09-21T06:39:15.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.018+0000 7ff28cd72640 1 --2- 172.21.15.7:0/2588024670 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2881049b0 0x7ff28819a580 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7ff27000c970 tx=0x7ff27000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:15.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.018+0000 7ff285ffb640 1 -- 172.21.15.7:0/2588024670 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff270007c10 con 0x7ff2881049b0 2024-09-21T06:39:15.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.018+0000 7ff285ffb640 1 -- 172.21.15.7:0/2588024670 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff270007db0 con 0x7ff2881049b0 2024-09-21T06:39:15.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.018+0000 7ff28efd6640 1 -- 172.21.15.7:0/2588024670 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2881a0720 con 0x7ff2881049b0 2024-09-21T06:39:15.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.018+0000 7ff285ffb640 1 -- 172.21.15.7:0/2588024670 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff27000f870 con 0x7ff2881049b0 2024-09-21T06:39:15.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.019+0000 7ff28efd6640 1 -- 172.21.15.7:0/2588024670 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2881a6f40 con 0x7ff2881049b0 2024-09-21T06:39:15.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.021+0000 7ff29554a740 1 Processor -- start 2024-09-21T06:39:15.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.021+0000 7ff285ffb640 1 -- 172.21.15.7:0/2588024670 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7ff27000fa10 con 0x7ff2881049b0 2024-09-21T06:39:15.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.021+0000 7ff29554a740 1 -- start start 2024-09-21T06:39:15.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.021+0000 7ff29554a740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e95eae5070 0x55e95ee8c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:15.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.021+0000 7ff29554a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e95eabc1b0 0x55e95ee8cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:15.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.021+0000 7ff29554a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e95eac4390 0x55e95ee8d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:15.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.021+0000 7ff29554a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e95ee02ea0 con 0x55e95eac4390 2024-09-21T06:39:15.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.021+0000 7ff29554a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55e95edf22d0 con 0x55e95eabc1b0 2024-09-21T06:39:15.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.021+0000 7ff29554a740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55e95edf60e0 con 0x55e95eae5070 2024-09-21T06:39:15.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.022+0000 7ff287fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e95eac4390 0x55e95ee8d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:15.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.022+0000 7ff28cd72640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e95eabc1b0 0x55e95ee8cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:15.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.022+0000 7ff287fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e95eac4390 0x55e95ee8d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39786/0 (socket says 172.21.15.7:39786) 2024-09-21T06:39:15.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.022+0000 7ff287fff640 1 -- 172.21.15.7:0/2844589177 learned_addr learned my addr 172.21.15.7:0/2844589177 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:39:15.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.022+0000 7ff28d573640 1 --2- 172.21.15.7:0/2844589177 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e95eae5070 0x55e95ee8c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:15.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.022+0000 7ff287fff640 1 -- 172.21.15.7:0/2844589177 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e95eae5070 msgr2=0x55e95ee8c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:15.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.022+0000 7ff287fff640 1 --2- 172.21.15.7:0/2844589177 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e95eae5070 0x55e95ee8c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:15.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.022+0000 7ff287fff640 1 -- 172.21.15.7:0/2844589177 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e95eabc1b0 msgr2=0x55e95ee8cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:15.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.022+0000 7ff287fff640 1 --2- 172.21.15.7:0/2844589177 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e95eabc1b0 0x55e95ee8cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:15.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.022+0000 7ff287fff640 1 -- 172.21.15.7:0/2844589177 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e95eb50650 con 0x55e95eac4390 2024-09-21T06:39:15.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.022+0000 7ff285ffb640 1 --2- 172.21.15.7:0/2588024670 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7ff2740b66b0 0x7ff2740b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:15.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.022+0000 7ff28d573640 1 --2- 172.21.15.7:0/2588024670 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7ff2740b66b0 0x7ff2740b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:15.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.022+0000 7ff287fff640 1 --2- 172.21.15.7:0/2844589177 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e95eac4390 0x55e95ee8d120 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7ff27800ad60 tx=0x7ff27800f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fe81a047e68352e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:15.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.023+0000 7ff285ffb640 1 -- 172.21.15.7:0/2588024670 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7ff2700e79e0 con 0x7ff2881049b0 2024-09-21T06:39:15.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.023+0000 7ff27effd640 1 -- 172.21.15.7:0/2844589177 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff278003970 con 0x55e95eac4390 2024-09-21T06:39:15.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.023+0000 7ff27effd640 1 -- 172.21.15.7:0/2844589177 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff278004020 con 0x55e95eac4390 2024-09-21T06:39:15.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.023+0000 7ff27effd640 1 -- 172.21.15.7:0/2844589177 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2780119b0 con 0x55e95eac4390 2024-09-21T06:39:15.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.024+0000 7ff29554a740 1 -- 172.21.15.7:0/2844589177 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e95eac4390 msgr2=0x55e95ee8d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:15.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.024+0000 7ff28d573640 1 --2- 172.21.15.7:0/2588024670 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7ff2740b66b0 0x7ff2740b8bc0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff280006010 tx=0x7ff2800058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:15.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.024+0000 7ff29554a740 1 --2- 172.21.15.7:0/2844589177 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e95eac4390 0x55e95ee8d120 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7ff27800ad60 tx=0x7ff27800f730 comp rx=0 tx=0).stop 2024-09-21T06:39:15.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.024+0000 7ff29554a740 1 -- 172.21.15.7:0/2844589177 shutdown_connections 2024-09-21T06:39:15.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.024+0000 7ff29554a740 1 --2- 172.21.15.7:0/2844589177 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e95eac4390 0x55e95ee8d120 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:15.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.024+0000 7ff29554a740 1 --2- 172.21.15.7:0/2844589177 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e95eabc1b0 0x55e95ee8cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:15.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.024+0000 7ff29554a740 1 --2- 172.21.15.7:0/2844589177 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e95eae5070 0x55e95ee8c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:15.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.024+0000 7ff29554a740 1 -- 172.21.15.7:0/2844589177 >> 172.21.15.7:0/2844589177 conn(0x55e95ead9460 msgr2=0x55e95ee8a590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:15.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.024+0000 7ff29554a740 1 -- 172.21.15.7:0/2844589177 shutdown_connections 2024-09-21T06:39:15.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.024+0000 7ff29554a740 1 -- 172.21.15.7:0/2844589177 wait complete. 2024-09-21T06:39:15.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.024+0000 7ff29554a740 1 -- start start 2024-09-21T06:39:15.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.024+0000 7ff29554a740 1 Processor -- start 2024-09-21T06:39:15.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.025+0000 7ff29554a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e95eabc1b0 0x55e95ee97ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:15.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.025+0000 7ff29554a740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e95eac4390 0x55e95ee981e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:15.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.025+0000 7ff29554a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e95eae5070 0x55e95ee98720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:15.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.025+0000 7ff29554a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e95ec53700 con 0x55e95eabc1b0 2024-09-21T06:39:15.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.025+0000 7ff29554a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55e95ed8d160 con 0x55e95eae5070 2024-09-21T06:39:15.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.025+0000 7ff29554a740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55e95ee9ae80 con 0x55e95eac4390 2024-09-21T06:39:15.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.025+0000 7ff29554a740 10 client.0 _ll_register_callbacks cb 0x55e95eda69e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:39:15.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.025+0000 7ff28cd72640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e95eabc1b0 0x55e95ee97ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:15.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.025+0000 7ff287fff640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e95eac4390 0x55e95ee981e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:15.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.025+0000 7ff28cd72640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e95eabc1b0 0x55e95ee97ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39802/0 (socket says 172.21.15.7:39802) 2024-09-21T06:39:15.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.025+0000 7ff28cd72640 1 -- 172.21.15.7:0/666476168 learned_addr learned my addr 172.21.15.7:0/666476168 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:39:15.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.025+0000 7ff28d573640 1 --2- 172.21.15.7:0/666476168 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e95eae5070 0x55e95ee98720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:15.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.025+0000 7ff28cd72640 1 -- 172.21.15.7:0/666476168 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e95eac4390 msgr2=0x55e95ee981e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:15.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.025+0000 7ff28cd72640 1 --2- 172.21.15.7:0/666476168 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e95eac4390 0x55e95ee981e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:15.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.025+0000 7ff28cd72640 1 -- 172.21.15.7:0/666476168 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e95eae5070 msgr2=0x55e95ee98720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:15.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.025+0000 7ff28cd72640 1 --2- 172.21.15.7:0/666476168 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e95eae5070 0x55e95ee98720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:15.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.025+0000 7ff28cd72640 1 -- 172.21.15.7:0/666476168 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e95edbac90 con 0x55e95eabc1b0 2024-09-21T06:39:15.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.025+0000 7ff287fff640 1 --2- 172.21.15.7:0/666476168 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e95eac4390 0x55e95ee981e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:39:15.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.026+0000 7ff267fff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:39:15.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.026+0000 7ff28cd72640 1 --2- 172.21.15.7:0/666476168 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e95eabc1b0 0x55e95ee97ca0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7ff2700ad620 tx=0x7ff27000a550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47c88e0ce0aac557 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:15.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.026+0000 7ff267fff640 1 -- 172.21.15.7:0/666476168 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2700ad270 con 0x55e95eabc1b0 2024-09-21T06:39:15.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.026+0000 7ff267fff640 1 -- 172.21.15.7:0/666476168 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7ff2700b2170 con 0x55e95eabc1b0 2024-09-21T06:39:15.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.026+0000 7ff29554a740 1 -- 172.21.15.7:0/666476168 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff278004020 con 0x55e95eabc1b0 2024-09-21T06:39:15.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.026+0000 7ff267fff640 1 -- 172.21.15.7:0/666476168 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff2700e5620 con 0x55e95eabc1b0 2024-09-21T06:39:15.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.026+0000 7ff29554a740 10 client.16074 fetch_fsmap learned FSMap version 25 2024-09-21T06:39:15.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.026+0000 7ff29554a740 1 -- 172.21.15.7:0/666476168 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e95eea6bb0 con 0x55e95eabc1b0 2024-09-21T06:39:15.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.026+0000 7ff267fff640 1 -- 172.21.15.7:0/666476168 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff278004020 con 0x55e95eabc1b0 2024-09-21T06:39:15.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.026+0000 7ff267fff640 1 -- 172.21.15.7:0/666476168 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff2700ac5f0 con 0x55e95eabc1b0 2024-09-21T06:39:15.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.026+0000 7ff29554a740 10 client.16074 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:39:15.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.026+0000 7ff29554a740 10 client.16074 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:39:15.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.027+0000 7ff29554a740 20 client.16074 populate_metadata read hostname 'smithi007' 2024-09-21T06:39:15.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.027+0000 7ff29554a740 1 --2- 172.21.15.7:0/666476168 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x55e95eaa39f0 0x55e95eeaa080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:15.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.027+0000 7ff29554a740 4 client.16074 mds_command: new command op to 24688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:39:15.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.027+0000 7ff29554a740 1 -- 172.21.15.7:0/666476168 --> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e95ee04df0 con 0x55e95eaa39f0 2024-09-21T06:39:15.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.027+0000 7ff287fff640 1 --2- 172.21.15.7:0/666476168 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x55e95eaa39f0 0x55e95eeaa080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:15.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.027+0000 7ff287fff640 1 --2- 172.21.15.7:0/666476168 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x55e95eaa39f0 0x55e95eeaa080 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d53e921f28df852f server_cookie=249484ed92f49df9 in_seq=0 out_seq=0 2024-09-21T06:39:15.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.027+0000 7ff267fff640 10 client.16074 ms_handle_connect on v2:172.21.15.144:6838/4027821922 2024-09-21T06:39:15.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.028+0000 7ff267fff640 1 -- 172.21.15.7:0/666476168 <== mds.1 v2:172.21.15.144:6838/4027821922 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e95ee04df0 con 0x55e95eaa39f0 2024-09-21T06:39:15.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.028+0000 7ff267fff640 10 client.16074 handle_command_reply: tid=0 2024-09-21T06:39:15.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.028+0000 7ff29554a740 1 client.16074 shutdown 2024-09-21T06:39:15.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.028+0000 7ff29554a740 1 -- 172.21.15.7:0/666476168 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e95eabc1b0 msgr2=0x55e95ee97ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:15.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.028+0000 7ff29554a740 1 --2- 172.21.15.7:0/666476168 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e95eabc1b0 0x55e95ee97ca0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7ff2700ad620 tx=0x7ff27000a550 comp rx=0 tx=0).stop 2024-09-21T06:39:15.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.028+0000 7ff29554a740 1 -- 172.21.15.7:0/666476168 shutdown_connections 2024-09-21T06:39:15.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.028+0000 7ff29554a740 1 --2- 172.21.15.7:0/666476168 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x55e95eaa39f0 0x55e95eeaa080 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:15.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.028+0000 7ff29554a740 1 --2- 172.21.15.7:0/666476168 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e95eae5070 0x55e95ee98720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:15.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.028+0000 7ff29554a740 1 --2- 172.21.15.7:0/666476168 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e95eac4390 0x55e95ee981e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:15.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.028+0000 7ff29554a740 1 --2- 172.21.15.7:0/666476168 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e95eabc1b0 0x55e95ee97ca0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:15.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.028+0000 7ff29554a740 1 -- 172.21.15.7:0/666476168 >> 172.21.15.7:0/666476168 conn(0x55e95ead9460 msgr2=0x55e95ee8f830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:15.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.028+0000 7ff267fff640 0 client.16074 ms_handle_reset on v2:172.21.15.144:6838/4027821922 2024-09-21T06:39:15.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.029+0000 7ff29554a740 1 -- 172.21.15.7:0/666476168 shutdown_connections 2024-09-21T06:39:15.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.029+0000 7ff29554a740 1 -- 172.21.15.7:0/666476168 wait complete. 2024-09-21T06:39:15.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.029+0000 7ff29554a740 20 client.16074 trim_cache size 0 max 16384 2024-09-21T06:39:15.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.042+0000 7ff29554a740 1 Processor -- start 2024-09-21T06:39:15.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.042+0000 7ff29554a740 1 -- start start 2024-09-21T06:39:15.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.042+0000 7ff29554a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e95eabc1b0 0x55e95ee998d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:15.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.042+0000 7ff29554a740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e95eac4390 0x55e95ee89bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:15.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.042+0000 7ff29554a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e95eae5070 0x55e95ee8a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:15.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.042+0000 7ff29554a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff2881b1d40 con 0x55e95eae5070 2024-09-21T06:39:15.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.042+0000 7ff29554a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff2881af610 con 0x55e95eabc1b0 2024-09-21T06:39:15.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.042+0000 7ff29554a740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff2881ad440 con 0x55e95eac4390 2024-09-21T06:39:15.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.042+0000 7ff28d573640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e95eae5070 0x55e95ee8a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:15.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.042+0000 7ff28d573640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e95eae5070 0x55e95ee8a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39816/0 (socket says 172.21.15.7:39816) 2024-09-21T06:39:15.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.042+0000 7ff28d573640 1 -- 172.21.15.7:0/216676540 learned_addr learned my addr 172.21.15.7:0/216676540 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:39:15.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.042+0000 7ff28cd72640 1 --2- 172.21.15.7:0/216676540 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e95eabc1b0 0x55e95ee998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:15.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.042+0000 7ff287fff640 1 --2- 172.21.15.7:0/216676540 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e95eac4390 0x55e95ee89bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:15.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.043+0000 7ff28d573640 1 -- 172.21.15.7:0/216676540 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e95eac4390 msgr2=0x55e95ee89bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:15.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.043+0000 7ff28d573640 1 --2- 172.21.15.7:0/216676540 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e95eac4390 0x55e95ee89bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:15.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.043+0000 7ff28d573640 1 -- 172.21.15.7:0/216676540 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e95eabc1b0 msgr2=0x55e95ee998d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:15.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.043+0000 7ff28d573640 1 --2- 172.21.15.7:0/216676540 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e95eabc1b0 0x55e95ee998d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:15.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.043+0000 7ff28d573640 1 -- 172.21.15.7:0/216676540 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e95ee8e990 con 0x55e95eae5070 2024-09-21T06:39:15.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.043+0000 7ff28cd72640 1 --2- 172.21.15.7:0/216676540 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e95eabc1b0 0x55e95ee998d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:39:15.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.043+0000 7ff28d573640 1 --2- 172.21.15.7:0/216676540 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e95eae5070 0x55e95ee8a100 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7ff28002a930 tx=0x7ff28003f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b467136f64c072f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:15.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.043+0000 7ff27e7fc640 1 -- 172.21.15.7:0/216676540 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff280035040 con 0x55e95eae5070 2024-09-21T06:39:15.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.043+0000 7ff27e7fc640 1 -- 172.21.15.7:0/216676540 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff280003aa0 con 0x55e95eae5070 2024-09-21T06:39:15.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.043+0000 7ff27e7fc640 1 -- 172.21.15.7:0/216676540 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff28003dab0 con 0x55e95eae5070 2024-09-21T06:39:15.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.044+0000 7ff29554a740 1 -- 172.21.15.7:0/216676540 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e95eae5070 msgr2=0x55e95ee8a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:15.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.044+0000 7ff29554a740 1 --2- 172.21.15.7:0/216676540 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e95eae5070 0x55e95ee8a100 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7ff28002a930 tx=0x7ff28003f000 comp rx=0 tx=0).stop 2024-09-21T06:39:15.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.044+0000 7ff29554a740 1 -- 172.21.15.7:0/216676540 shutdown_connections 2024-09-21T06:39:15.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.044+0000 7ff29554a740 1 --2- 172.21.15.7:0/216676540 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e95eae5070 0x55e95ee8a100 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:15.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.044+0000 7ff29554a740 1 --2- 172.21.15.7:0/216676540 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e95eac4390 0x55e95ee89bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:15.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.044+0000 7ff29554a740 1 --2- 172.21.15.7:0/216676540 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e95eabc1b0 0x55e95ee998d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:15.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.044+0000 7ff29554a740 1 -- 172.21.15.7:0/216676540 >> 172.21.15.7:0/216676540 conn(0x55e95ead9460 msgr2=0x55e95ee991c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:15.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.044+0000 7ff29554a740 1 -- 172.21.15.7:0/216676540 shutdown_connections 2024-09-21T06:39:15.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.044+0000 7ff29554a740 1 -- 172.21.15.7:0/216676540 wait complete. 2024-09-21T06:39:15.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.044+0000 7ff29554a740 1 -- start start 2024-09-21T06:39:15.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.044+0000 7ff29554a740 1 Processor -- start 2024-09-21T06:39:15.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.045+0000 7ff29554a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e95eabc1b0 0x55e95ee9bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:15.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.045+0000 7ff29554a740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e95eac4390 0x55e95ee9c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:15.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.045+0000 7ff29554a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e95eae5070 0x55e95ef0cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:15.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.045+0000 7ff29554a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff2881adad0 con 0x55e95eae5070 2024-09-21T06:39:15.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.045+0000 7ff29554a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff2881aef40 con 0x55e95eabc1b0 2024-09-21T06:39:15.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.045+0000 7ff29554a740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff2881ae1a0 con 0x55e95eac4390 2024-09-21T06:39:15.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.045+0000 7ff29554a740 10 client.0 _ll_register_callbacks cb 0x7ff27000c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:39:15.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.045+0000 7ff28d573640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e95eae5070 0x55e95ef0cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:15.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.045+0000 7ff28d573640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e95eae5070 0x55e95ef0cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39818/0 (socket says 172.21.15.7:39818) 2024-09-21T06:39:15.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.045+0000 7ff28d573640 1 -- 172.21.15.7:0/644577982 learned_addr learned my addr 172.21.15.7:0/644577982 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:39:15.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.045+0000 7ff287fff640 1 --2- 172.21.15.7:0/644577982 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e95eac4390 0x55e95ee9c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:15.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.045+0000 7ff28cd72640 1 --2- 172.21.15.7:0/644577982 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e95eabc1b0 0x55e95ee9bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:15.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.045+0000 7ff28d573640 1 -- 172.21.15.7:0/644577982 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e95eac4390 msgr2=0x55e95ee9c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:15.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.045+0000 7ff28d573640 1 --2- 172.21.15.7:0/644577982 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e95eac4390 0x55e95ee9c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:15.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.045+0000 7ff28d573640 1 -- 172.21.15.7:0/644577982 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e95eabc1b0 msgr2=0x55e95ee9bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:15.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.045+0000 7ff28d573640 1 --2- 172.21.15.7:0/644577982 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e95eabc1b0 0x55e95ee9bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:15.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.045+0000 7ff28d573640 1 -- 172.21.15.7:0/644577982 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e95ef0d150 con 0x55e95eae5070 2024-09-21T06:39:15.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.045+0000 7ff28cd72640 1 --2- 172.21.15.7:0/644577982 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e95eabc1b0 0x55e95ee9bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:39:15.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.045+0000 7ff287fff640 1 --2- 172.21.15.7:0/644577982 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e95eac4390 0x55e95ee9c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:39:15.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.045+0000 7ff28d573640 1 --2- 172.21.15.7:0/644577982 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e95eae5070 0x55e95ef0cae0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7ff28003d630 tx=0x7ff28003d4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=754cc2a82fce3ec6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:15.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.045+0000 7ff267fff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:39:15.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.046+0000 7ff267fff640 1 -- 172.21.15.7:0/644577982 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff280060020 con 0x55e95eae5070 2024-09-21T06:39:15.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.046+0000 7ff267fff640 1 -- 172.21.15.7:0/644577982 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7ff280003c50 con 0x55e95eae5070 2024-09-21T06:39:15.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.046+0000 7ff29554a740 1 -- 172.21.15.7:0/644577982 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff280003aa0 con 0x55e95eae5070 2024-09-21T06:39:15.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.046+0000 7ff267fff640 1 -- 172.21.15.7:0/644577982 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff28006b050 con 0x55e95eae5070 2024-09-21T06:39:15.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.046+0000 7ff29554a740 10 client.16080 fetch_fsmap learned FSMap version 25 2024-09-21T06:39:15.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.046+0000 7ff29554a740 1 -- 172.21.15.7:0/644577982 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e95ef14540 con 0x55e95eae5070 2024-09-21T06:39:15.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.046+0000 7ff267fff640 1 -- 172.21.15.7:0/644577982 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff280003aa0 con 0x55e95eae5070 2024-09-21T06:39:15.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.046+0000 7ff267fff640 1 -- 172.21.15.7:0/644577982 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff28005b030 con 0x55e95eae5070 2024-09-21T06:39:15.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.046+0000 7ff29554a740 10 client.16080 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:39:15.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.046+0000 7ff29554a740 10 client.16080 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:39:15.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.046+0000 7ff29554a740 20 client.16080 populate_metadata read hostname 'smithi007' 2024-09-21T06:39:15.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.046+0000 7ff29554a740 1 --2- 172.21.15.7:0/644577982 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x55e95ea78da0 0x55e95ef16d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:15.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.046+0000 7ff29554a740 4 client.16080 mds_command: new command op to 24688 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:39:15.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.046+0000 7ff29554a740 1 -- 172.21.15.7:0/644577982 --> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e95ee008a0 con 0x55e95ea78da0 2024-09-21T06:39:15.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.047+0000 7ff28cd72640 1 --2- 172.21.15.7:0/644577982 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x55e95ea78da0 0x55e95ef16d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:15.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.047+0000 7ff28cd72640 1 --2- 172.21.15.7:0/644577982 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x55e95ea78da0 0x55e95ef16d20 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e8af26b663745511 server_cookie=9d564d9424a7d75c in_seq=0 out_seq=0 2024-09-21T06:39:15.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.047+0000 7ff267fff640 10 client.16080 ms_handle_connect on v2:172.21.15.144:6838/4027821922 2024-09-21T06:39:15.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.047+0000 7ff267fff640 1 -- 172.21.15.7:0/644577982 <== mds.1 v2:172.21.15.144:6838/4027821922 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e95ee008a0 con 0x55e95ea78da0 2024-09-21T06:39:15.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.047+0000 7ff267fff640 10 client.16080 handle_command_reply: tid=0 2024-09-21T06:39:15.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.047+0000 7ff29554a740 1 client.16080 shutdown 2024-09-21T06:39:15.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.047+0000 7ff29554a740 1 -- 172.21.15.7:0/644577982 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e95eae5070 msgr2=0x55e95ef0cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:15.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.047+0000 7ff29554a740 1 --2- 172.21.15.7:0/644577982 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e95eae5070 0x55e95ef0cae0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7ff28003d630 tx=0x7ff28003d4e0 comp rx=0 tx=0).stop 2024-09-21T06:39:15.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.048+0000 7ff29554a740 1 -- 172.21.15.7:0/644577982 shutdown_connections 2024-09-21T06:39:15.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.048+0000 7ff29554a740 1 --2- 172.21.15.7:0/644577982 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x55e95ea78da0 0x55e95ef16d20 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:15.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.048+0000 7ff29554a740 1 --2- 172.21.15.7:0/644577982 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e95eae5070 0x55e95ef0cae0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:15.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.048+0000 7ff29554a740 1 --2- 172.21.15.7:0/644577982 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e95eac4390 0x55e95ee9c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:15.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.048+0000 7ff29554a740 1 --2- 172.21.15.7:0/644577982 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e95eabc1b0 0x55e95ee9bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:15.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.048+0000 7ff267fff640 0 client.16080 ms_handle_reset on v2:172.21.15.144:6838/4027821922 2024-09-21T06:39:15.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.048+0000 7ff29554a740 1 -- 172.21.15.7:0/644577982 >> 172.21.15.7:0/644577982 conn(0x55e95ead9460 msgr2=0x55e95ee968f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:15.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.048+0000 7ff29554a740 1 -- 172.21.15.7:0/644577982 shutdown_connections 2024-09-21T06:39:15.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.048+0000 7ff29554a740 1 -- 172.21.15.7:0/644577982 wait complete. 2024-09-21T06:39:15.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.048+0000 7ff29554a740 20 client.16080 trim_cache size 0 max 16384 2024-09-21T06:39:15.056 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:39:15.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.048+0000 7ff28efd6640 1 -- 172.21.15.7:0/2588024670 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7ff2740b66b0 msgr2=0x7ff2740b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:15.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.048+0000 7ff28efd6640 1 --2- 172.21.15.7:0/2588024670 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7ff2740b66b0 0x7ff2740b8bc0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff280006010 tx=0x7ff2800058d0 comp rx=0 tx=0).stop 2024-09-21T06:39:15.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.048+0000 7ff28efd6640 1 -- 172.21.15.7:0/2588024670 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2881049b0 msgr2=0x7ff28819a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:15.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.049+0000 7ff28efd6640 1 --2- 172.21.15.7:0/2588024670 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2881049b0 0x7ff28819a580 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7ff27000c970 tx=0x7ff27000ce30 comp rx=0 tx=0).stop 2024-09-21T06:39:15.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.049+0000 7ff28efd6640 1 -- 172.21.15.7:0/2588024670 shutdown_connections 2024-09-21T06:39:15.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.049+0000 7ff28efd6640 1 --2- 172.21.15.7:0/2588024670 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7ff2740b66b0 0x7ff2740b8bc0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:15.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.049+0000 7ff28efd6640 1 --2- 172.21.15.7:0/2588024670 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff28810de10 0x7ff28819fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:15.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.049+0000 7ff28efd6640 1 --2- 172.21.15.7:0/2588024670 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff288105300 0x7ff28819ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:15.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.049+0000 7ff28efd6640 1 --2- 172.21.15.7:0/2588024670 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2881049b0 0x7ff28819a580 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:15.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.049+0000 7ff28efd6640 1 -- 172.21.15.7:0/2588024670 >> 172.21.15.7:0/2588024670 conn(0x7ff288079730 msgr2=0x7ff2880ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:15.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.049+0000 7ff28efd6640 1 -- 172.21.15.7:0/2588024670 shutdown_connections 2024-09-21T06:39:15.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:15.049+0000 7ff28efd6640 1 -- 172.21.15.7:0/2588024670 wait complete. 2024-09-21T06:39:15.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:39:14 smithi144 ceph-mon[34653]: pgmap v410: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 21 op/s 2024-09-21T06:39:15.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:39:14 smithi007 ceph-mon[30983]: pgmap v410: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 21 op/s 2024-09-21T06:39:15.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:39:14 smithi018 ceph-mon[34477]: pgmap v410: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 21 op/s 2024-09-21T06:39:15.748 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:39:16.006 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:39:16.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.534+0000 7fe6834e8640 1 -- 172.21.15.7:0/605045754 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe67c1083a0 msgr2=0x7fe67c1087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:16.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.534+0000 7fe6834e8640 1 --2- 172.21.15.7:0/605045754 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe67c1083a0 0x7fe67c1087b0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fe66c009900 tx=0x7fe66c02a410 comp rx=0 tx=0).stop 2024-09-21T06:39:16.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.534+0000 7fe6834e8640 1 -- 172.21.15.7:0/605045754 shutdown_connections 2024-09-21T06:39:16.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.534+0000 7fe6834e8640 1 --2- 172.21.15.7:0/605045754 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe67c108cf0 0x7fe67c10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:16.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.534+0000 7fe6834e8640 1 --2- 172.21.15.7:0/605045754 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe67c1083a0 0x7fe67c1087b0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:16.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.534+0000 7fe6834e8640 1 --2- 172.21.15.7:0/605045754 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe67c102a60 0x7fe67c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:16.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.534+0000 7fe6834e8640 1 -- 172.21.15.7:0/605045754 >> 172.21.15.7:0/605045754 conn(0x7fe67c079730 msgr2=0x7fe67c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:16.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.534+0000 7fe6834e8640 1 -- 172.21.15.7:0/605045754 shutdown_connections 2024-09-21T06:39:16.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.534+0000 7fe6834e8640 1 -- 172.21.15.7:0/605045754 wait complete. 2024-09-21T06:39:16.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.535+0000 7fe6834e8640 1 Processor -- start 2024-09-21T06:39:16.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.535+0000 7fe6834e8640 1 -- start start 2024-09-21T06:39:16.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.535+0000 7fe6834e8640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe67c102a60 0x7fe67c19a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:16.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.535+0000 7fe6834e8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe67c1083a0 0x7fe67c19abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:16.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.535+0000 7fe6834e8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe67c108cf0 0x7fe67c19fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:16.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.536+0000 7fe6834e8640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe67c113b30 con 0x7fe67c1083a0 2024-09-21T06:39:16.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.536+0000 7fe6834e8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe67c1139b0 con 0x7fe67c108cf0 2024-09-21T06:39:16.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.536+0000 7fe6834e8640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe67c113cb0 con 0x7fe67c102a60 2024-09-21T06:39:16.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.536+0000 7fe680a83640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe67c1083a0 0x7fe67c19abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:16.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.536+0000 7fe680a83640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe67c1083a0 0x7fe67c19abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39834/0 (socket says 172.21.15.7:39834) 2024-09-21T06:39:16.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.536+0000 7fe680a83640 1 -- 172.21.15.7:0/3494151001 learned_addr learned my addr 172.21.15.7:0/3494151001 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:39:16.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.536+0000 7fe681284640 1 --2- 172.21.15.7:0/3494151001 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe67c102a60 0x7fe67c19a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:16.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.536+0000 7fe681a85640 1 --2- 172.21.15.7:0/3494151001 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe67c108cf0 0x7fe67c19fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:16.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.536+0000 7fe680a83640 1 -- 172.21.15.7:0/3494151001 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe67c102a60 msgr2=0x7fe67c19a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:16.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.536+0000 7fe680a83640 1 --2- 172.21.15.7:0/3494151001 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe67c102a60 0x7fe67c19a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:16.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.536+0000 7fe680a83640 1 -- 172.21.15.7:0/3494151001 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe67c108cf0 msgr2=0x7fe67c19fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:16.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.536+0000 7fe680a83640 1 --2- 172.21.15.7:0/3494151001 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe67c108cf0 0x7fe67c19fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:16.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.536+0000 7fe680a83640 1 -- 172.21.15.7:0/3494151001 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe67c1a05b0 con 0x7fe67c1083a0 2024-09-21T06:39:16.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.536+0000 7fe680a83640 1 --2- 172.21.15.7:0/3494151001 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe67c1083a0 0x7fe67c19abe0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fe66c031a90 tx=0x7fe66c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:16.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.536+0000 7fe6727fc640 1 -- 172.21.15.7:0/3494151001 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe66c03f030 con 0x7fe67c1083a0 2024-09-21T06:39:16.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.536+0000 7fe6727fc640 1 -- 172.21.15.7:0/3494151001 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe66c004490 con 0x7fe67c1083a0 2024-09-21T06:39:16.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.536+0000 7fe6727fc640 1 -- 172.21.15.7:0/3494151001 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe66c035070 con 0x7fe67c1083a0 2024-09-21T06:39:16.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.537+0000 7fe6834e8640 1 -- 172.21.15.7:0/3494151001 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe67c1a0840 con 0x7fe67c1083a0 2024-09-21T06:39:16.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.537+0000 7fe6834e8640 1 -- 172.21.15.7:0/3494151001 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe67c1a7000 con 0x7fe67c1083a0 2024-09-21T06:39:16.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.539+0000 7fe689a5c740 1 Processor -- start 2024-09-21T06:39:16.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.539+0000 7fe689a5c740 1 -- start start 2024-09-21T06:39:16.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.540+0000 7fe689a5c740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558f46bb6070 0x558f46f5d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:16.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.540+0000 7fe689a5c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558f46b8d1b0 0x558f46f5dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:16.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.540+0000 7fe689a5c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558f46b95390 0x558f46f5e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:16.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.540+0000 7fe689a5c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x558f46ed3ea0 con 0x558f46b8d1b0 2024-09-21T06:39:16.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.540+0000 7fe689a5c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x558f46ec32d0 con 0x558f46b95390 2024-09-21T06:39:16.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.540+0000 7fe689a5c740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x558f46ec70e0 con 0x558f46bb6070 2024-09-21T06:39:16.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.540+0000 7fe6727fc640 1 -- 172.21.15.7:0/3494151001 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7fe66c042030 con 0x7fe67c1083a0 2024-09-21T06:39:16.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.540+0000 7fe681284640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558f46b8d1b0 0x558f46f5dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:16.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.540+0000 7fe681284640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558f46b8d1b0 0x558f46f5dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39848/0 (socket says 172.21.15.7:39848) 2024-09-21T06:39:16.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.540+0000 7fe681284640 1 -- 172.21.15.7:0/1298937457 learned_addr learned my addr 172.21.15.7:0/1298937457 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:39:16.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.540+0000 7fe681a85640 1 --2- 172.21.15.7:0/1298937457 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558f46bb6070 0x558f46f5d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:16.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.540+0000 7fe680a83640 1 --2- 172.21.15.7:0/1298937457 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558f46b95390 0x558f46f5e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:16.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.540+0000 7fe681284640 1 -- 172.21.15.7:0/1298937457 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558f46bb6070 msgr2=0x558f46f5d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:16.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.540+0000 7fe681284640 1 --2- 172.21.15.7:0/1298937457 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558f46bb6070 0x558f46f5d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:16.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.540+0000 7fe681284640 1 -- 172.21.15.7:0/1298937457 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558f46b95390 msgr2=0x558f46f5e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:16.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.540+0000 7fe681284640 1 --2- 172.21.15.7:0/1298937457 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558f46b95390 0x558f46f5e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:16.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.540+0000 7fe681284640 1 -- 172.21.15.7:0/1298937457 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f46c21650 con 0x558f46b8d1b0 2024-09-21T06:39:16.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.540+0000 7fe681284640 1 --2- 172.21.15.7:0/1298937457 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558f46b8d1b0 0x558f46f5dbe0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fe678009a70 tx=0x7fe678009f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c7f3f589a34a2ad server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:16.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.541+0000 7fe6677fe640 1 -- 172.21.15.7:0/1298937457 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe678017070 con 0x558f46b8d1b0 2024-09-21T06:39:16.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.541+0000 7fe6677fe640 1 -- 172.21.15.7:0/1298937457 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe678013470 con 0x558f46b8d1b0 2024-09-21T06:39:16.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.541+0000 7fe6727fc640 1 --2- 172.21.15.7:0/3494151001 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fe6680b6700 0x7fe6680b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:16.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.541+0000 7fe6677fe640 1 -- 172.21.15.7:0/1298937457 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6780125d0 con 0x558f46b8d1b0 2024-09-21T06:39:16.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.541+0000 7fe681a85640 1 --2- 172.21.15.7:0/3494151001 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fe6680b6700 0x7fe6680b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:16.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.541+0000 7fe6727fc640 1 -- 172.21.15.7:0/3494151001 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fe66c107b80 con 0x7fe67c1083a0 2024-09-21T06:39:16.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.542+0000 7fe689a5c740 1 -- 172.21.15.7:0/1298937457 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558f46b8d1b0 msgr2=0x558f46f5dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:16.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.542+0000 7fe681a85640 1 --2- 172.21.15.7:0/3494151001 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fe6680b6700 0x7fe6680b8c10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fe67400a400 tx=0x7fe67400d040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:16.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.542+0000 7fe689a5c740 1 --2- 172.21.15.7:0/1298937457 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558f46b8d1b0 0x558f46f5dbe0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fe678009a70 tx=0x7fe678009f30 comp rx=0 tx=0).stop 2024-09-21T06:39:16.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.542+0000 7fe689a5c740 1 -- 172.21.15.7:0/1298937457 shutdown_connections 2024-09-21T06:39:16.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.542+0000 7fe689a5c740 1 --2- 172.21.15.7:0/1298937457 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558f46b95390 0x558f46f5e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:16.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.542+0000 7fe689a5c740 1 --2- 172.21.15.7:0/1298937457 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558f46b8d1b0 0x558f46f5dbe0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:16.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.542+0000 7fe689a5c740 1 --2- 172.21.15.7:0/1298937457 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558f46bb6070 0x558f46f5d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:16.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.542+0000 7fe689a5c740 1 -- 172.21.15.7:0/1298937457 >> 172.21.15.7:0/1298937457 conn(0x558f46baa460 msgr2=0x558f46f5b590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:16.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.542+0000 7fe689a5c740 1 -- 172.21.15.7:0/1298937457 shutdown_connections 2024-09-21T06:39:16.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.542+0000 7fe689a5c740 1 -- 172.21.15.7:0/1298937457 wait complete. 2024-09-21T06:39:16.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.542+0000 7fe689a5c740 1 -- start start 2024-09-21T06:39:16.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.542+0000 7fe689a5c740 1 Processor -- start 2024-09-21T06:39:16.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.543+0000 7fe689a5c740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558f46b8d1b0 0x558f46f68ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:16.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.543+0000 7fe689a5c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558f46b95390 0x558f46f691e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:16.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.543+0000 7fe689a5c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558f46bb6070 0x558f46f69720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:16.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.543+0000 7fe689a5c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x558f46d24700 con 0x558f46bb6070 2024-09-21T06:39:16.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.543+0000 7fe689a5c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x558f46e5e160 con 0x558f46b95390 2024-09-21T06:39:16.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.543+0000 7fe689a5c740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x558f46f6bed0 con 0x558f46b8d1b0 2024-09-21T06:39:16.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.543+0000 7fe689a5c740 10 client.0 _ll_register_callbacks cb 0x558f46e779e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:39:16.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.543+0000 7fe681a85640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558f46bb6070 0x558f46f69720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:16.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.543+0000 7fe681a85640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558f46bb6070 0x558f46f69720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39860/0 (socket says 172.21.15.7:39860) 2024-09-21T06:39:16.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.543+0000 7fe681a85640 1 -- 172.21.15.7:0/4095754302 learned_addr learned my addr 172.21.15.7:0/4095754302 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:39:16.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.543+0000 7fe680a83640 1 --2- 172.21.15.7:0/4095754302 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558f46b95390 0x558f46f691e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:16.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.543+0000 7fe681284640 1 --2- 172.21.15.7:0/4095754302 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558f46b8d1b0 0x558f46f68ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:16.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.543+0000 7fe681a85640 1 -- 172.21.15.7:0/4095754302 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558f46b8d1b0 msgr2=0x558f46f68ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:16.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.543+0000 7fe681a85640 1 --2- 172.21.15.7:0/4095754302 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558f46b8d1b0 0x558f46f68ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:16.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.543+0000 7fe681a85640 1 -- 172.21.15.7:0/4095754302 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558f46b95390 msgr2=0x558f46f691e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:16.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.543+0000 7fe681a85640 1 --2- 172.21.15.7:0/4095754302 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558f46b95390 0x558f46f691e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:16.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.543+0000 7fe681a85640 1 -- 172.21.15.7:0/4095754302 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f46e8bc90 con 0x558f46bb6070 2024-09-21T06:39:16.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.543+0000 7fe680a83640 1 --2- 172.21.15.7:0/4095754302 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558f46b95390 0x558f46f691e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:39:16.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.544+0000 7fe681a85640 1 --2- 172.21.15.7:0/4095754302 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558f46bb6070 0x558f46f69720 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fe674018ed0 tx=0x7fe674004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe20a3c42940bb1c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:16.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.544+0000 7fe664ff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:39:16.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.544+0000 7fe664ff9640 1 -- 172.21.15.7:0/4095754302 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe674028060 con 0x558f46bb6070 2024-09-21T06:39:16.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.544+0000 7fe664ff9640 1 -- 172.21.15.7:0/4095754302 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fe6740177d0 con 0x558f46bb6070 2024-09-21T06:39:16.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.544+0000 7fe689a5c740 1 -- 172.21.15.7:0/4095754302 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe678013470 con 0x558f46bb6070 2024-09-21T06:39:16.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.544+0000 7fe664ff9640 1 -- 172.21.15.7:0/4095754302 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe674016e40 con 0x558f46bb6070 2024-09-21T06:39:16.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.544+0000 7fe689a5c740 10 client.16092 fetch_fsmap learned FSMap version 25 2024-09-21T06:39:16.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.544+0000 7fe689a5c740 1 -- 172.21.15.7:0/4095754302 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558f46f77bf0 con 0x558f46bb6070 2024-09-21T06:39:16.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.544+0000 7fe664ff9640 1 -- 172.21.15.7:0/4095754302 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe678013470 con 0x558f46bb6070 2024-09-21T06:39:16.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.544+0000 7fe664ff9640 1 -- 172.21.15.7:0/4095754302 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fe674015a10 con 0x558f46bb6070 2024-09-21T06:39:16.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.544+0000 7fe689a5c740 10 client.16092 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:39:16.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.544+0000 7fe689a5c740 10 client.16092 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:39:16.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.544+0000 7fe689a5c740 20 client.16092 populate_metadata read hostname 'smithi007' 2024-09-21T06:39:16.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.544+0000 7fe689a5c740 1 --2- 172.21.15.7:0/4095754302 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x558f46b749f0 0x558f46f7b190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:16.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.544+0000 7fe689a5c740 4 client.16092 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:39:16.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.544+0000 7fe689a5c740 1 -- 172.21.15.7:0/4095754302 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558f46ed5df0 con 0x558f46b749f0 2024-09-21T06:39:16.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.545+0000 7fe681284640 1 --2- 172.21.15.7:0/4095754302 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x558f46b749f0 0x558f46f7b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:16.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.545+0000 7fe681284640 1 --2- 172.21.15.7:0/4095754302 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x558f46b749f0 0x558f46f7b190 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b8c4eb14ad3a7dca server_cookie=52ec97be0a0b7294 in_seq=0 out_seq=0 2024-09-21T06:39:16.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.545+0000 7fe664ff9640 10 client.16092 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:39:16.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.546+0000 7fe664ff9640 1 -- 172.21.15.7:0/4095754302 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558f46ed5df0 con 0x558f46b749f0 2024-09-21T06:39:16.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.546+0000 7fe664ff9640 10 client.16092 handle_command_reply: tid=0 2024-09-21T06:39:16.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.546+0000 7fe689a5c740 1 client.16092 shutdown 2024-09-21T06:39:16.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.546+0000 7fe689a5c740 1 -- 172.21.15.7:0/4095754302 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558f46bb6070 msgr2=0x558f46f69720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:16.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.546+0000 7fe689a5c740 1 --2- 172.21.15.7:0/4095754302 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558f46bb6070 0x558f46f69720 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fe674018ed0 tx=0x7fe674004a40 comp rx=0 tx=0).stop 2024-09-21T06:39:16.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.546+0000 7fe689a5c740 1 -- 172.21.15.7:0/4095754302 shutdown_connections 2024-09-21T06:39:16.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.546+0000 7fe689a5c740 1 --2- 172.21.15.7:0/4095754302 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x558f46b749f0 0x558f46f7b190 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:16.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.546+0000 7fe689a5c740 1 --2- 172.21.15.7:0/4095754302 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558f46bb6070 0x558f46f69720 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:16.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.546+0000 7fe689a5c740 1 --2- 172.21.15.7:0/4095754302 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558f46b95390 0x558f46f691e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:16.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.546+0000 7fe689a5c740 1 --2- 172.21.15.7:0/4095754302 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558f46b8d1b0 0x558f46f68ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:16.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.546+0000 7fe664ff9640 0 client.16092 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:39:16.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.546+0000 7fe689a5c740 1 -- 172.21.15.7:0/4095754302 >> 172.21.15.7:0/4095754302 conn(0x558f46baa460 msgr2=0x558f46f5f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:16.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.547+0000 7fe689a5c740 1 -- 172.21.15.7:0/4095754302 shutdown_connections 2024-09-21T06:39:16.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.547+0000 7fe689a5c740 1 -- 172.21.15.7:0/4095754302 wait complete. 2024-09-21T06:39:16.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.547+0000 7fe689a5c740 20 client.16092 trim_cache size 0 max 16384 2024-09-21T06:39:16.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.560+0000 7fe689a5c740 1 Processor -- start 2024-09-21T06:39:16.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.560+0000 7fe689a5c740 1 -- start start 2024-09-21T06:39:16.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.560+0000 7fe689a5c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558f46b8d1b0 0x558f46f5b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:16.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.560+0000 7fe689a5c740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558f46b95390 0x558f46f62900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:16.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.560+0000 7fe689a5c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558f46bb6070 0x558f46f6a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:16.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.560+0000 7fe689a5c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe67c1b1e60 con 0x558f46bb6070 2024-09-21T06:39:16.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.560+0000 7fe689a5c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe67c1af730 con 0x558f46b8d1b0 2024-09-21T06:39:16.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.560+0000 7fe689a5c740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe67c1ad5c0 con 0x558f46b95390 2024-09-21T06:39:16.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.560+0000 7fe681a85640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558f46bb6070 0x558f46f6a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:16.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.560+0000 7fe681a85640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558f46bb6070 0x558f46f6a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39864/0 (socket says 172.21.15.7:39864) 2024-09-21T06:39:16.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.560+0000 7fe681a85640 1 -- 172.21.15.7:0/3661816473 learned_addr learned my addr 172.21.15.7:0/3661816473 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:39:16.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.561+0000 7fe681284640 1 --2- 172.21.15.7:0/3661816473 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558f46b8d1b0 0x558f46f5b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:16.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.561+0000 7fe680a83640 1 --2- 172.21.15.7:0/3661816473 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558f46b95390 0x558f46f62900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:16.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.561+0000 7fe681a85640 1 -- 172.21.15.7:0/3661816473 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558f46b95390 msgr2=0x558f46f62900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:16.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.561+0000 7fe681a85640 1 --2- 172.21.15.7:0/3661816473 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558f46b95390 0x558f46f62900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:16.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.561+0000 7fe681a85640 1 -- 172.21.15.7:0/3661816473 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558f46b8d1b0 msgr2=0x558f46f5b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:16.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.561+0000 7fe681a85640 1 --2- 172.21.15.7:0/3661816473 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558f46b8d1b0 0x558f46f5b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:16.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.561+0000 7fe681a85640 1 -- 172.21.15.7:0/3661816473 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f46f5be80 con 0x558f46bb6070 2024-09-21T06:39:16.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.561+0000 7fe681a85640 1 --2- 172.21.15.7:0/3661816473 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558f46bb6070 0x558f46f6a1c0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fe674009690 tx=0x7fe674009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb5ab981152ab7e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:16.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.561+0000 7fe666ffd640 1 -- 172.21.15.7:0/3661816473 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe674015590 con 0x558f46bb6070 2024-09-21T06:39:16.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.561+0000 7fe666ffd640 1 -- 172.21.15.7:0/3661816473 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe67401f040 con 0x558f46bb6070 2024-09-21T06:39:16.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.561+0000 7fe666ffd640 1 -- 172.21.15.7:0/3661816473 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe674017dc0 con 0x558f46bb6070 2024-09-21T06:39:16.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.562+0000 7fe689a5c740 1 -- 172.21.15.7:0/3661816473 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558f46bb6070 msgr2=0x558f46f6a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:16.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.562+0000 7fe689a5c740 1 --2- 172.21.15.7:0/3661816473 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558f46bb6070 0x558f46f6a1c0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fe674009690 tx=0x7fe674009b30 comp rx=0 tx=0).stop 2024-09-21T06:39:16.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.562+0000 7fe689a5c740 1 -- 172.21.15.7:0/3661816473 shutdown_connections 2024-09-21T06:39:16.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.562+0000 7fe689a5c740 1 --2- 172.21.15.7:0/3661816473 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558f46bb6070 0x558f46f6a1c0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:16.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.562+0000 7fe689a5c740 1 --2- 172.21.15.7:0/3661816473 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558f46b95390 0x558f46f62900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:16.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.562+0000 7fe689a5c740 1 --2- 172.21.15.7:0/3661816473 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558f46b8d1b0 0x558f46f5b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:16.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.562+0000 7fe689a5c740 1 -- 172.21.15.7:0/3661816473 >> 172.21.15.7:0/3661816473 conn(0x558f46baa460 msgr2=0x558f46f5aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:16.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.562+0000 7fe689a5c740 1 -- 172.21.15.7:0/3661816473 shutdown_connections 2024-09-21T06:39:16.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.562+0000 7fe689a5c740 1 -- 172.21.15.7:0/3661816473 wait complete. 2024-09-21T06:39:16.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.562+0000 7fe689a5c740 1 -- start start 2024-09-21T06:39:16.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.563+0000 7fe689a5c740 1 Processor -- start 2024-09-21T06:39:16.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.563+0000 7fe689a5c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558f46b8d1b0 0x558f46f719a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:16.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.563+0000 7fe689a5c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558f46b95390 0x558f46f80650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:16.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.563+0000 7fe689a5c740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558f46bb6070 0x558f46f80b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:16.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.563+0000 7fe689a5c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe67c1adc10 con 0x558f46b95390 2024-09-21T06:39:16.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.563+0000 7fe689a5c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe67c1af060 con 0x558f46b8d1b0 2024-09-21T06:39:16.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.563+0000 7fe689a5c740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe67c1ae2c0 con 0x558f46bb6070 2024-09-21T06:39:16.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.563+0000 7fe689a5c740 10 client.0 _ll_register_callbacks cb 0x7fe674009a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:39:16.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.563+0000 7fe680a83640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558f46b95390 0x558f46f80650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:16.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.563+0000 7fe681284640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558f46b8d1b0 0x558f46f719a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:16.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.563+0000 7fe680a83640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558f46b95390 0x558f46f80650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39868/0 (socket says 172.21.15.7:39868) 2024-09-21T06:39:16.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.563+0000 7fe680a83640 1 -- 172.21.15.7:0/1788813785 learned_addr learned my addr 172.21.15.7:0/1788813785 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:39:16.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.563+0000 7fe681a85640 1 --2- 172.21.15.7:0/1788813785 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558f46bb6070 0x558f46f80b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:16.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.564+0000 7fe680a83640 1 -- 172.21.15.7:0/1788813785 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558f46bb6070 msgr2=0x558f46f80b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:16.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.564+0000 7fe680a83640 1 --2- 172.21.15.7:0/1788813785 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558f46bb6070 0x558f46f80b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:16.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.564+0000 7fe680a83640 1 -- 172.21.15.7:0/1788813785 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558f46b8d1b0 msgr2=0x558f46f719a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:16.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.564+0000 7fe680a83640 1 --2- 172.21.15.7:0/1788813785 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558f46b8d1b0 0x558f46f719a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:16.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.564+0000 7fe680a83640 1 -- 172.21.15.7:0/1788813785 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f46f81320 con 0x558f46b95390 2024-09-21T06:39:16.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.564+0000 7fe681284640 1 --2- 172.21.15.7:0/1788813785 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558f46b8d1b0 0x558f46f719a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:39:16.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.564+0000 7fe680a83640 1 --2- 172.21.15.7:0/1788813785 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558f46b95390 0x558f46f80650 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fe66c0cd730 tx=0x7fe66c005de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c28bb627babfdb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:16.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.564+0000 7fe664ff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:39:16.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.564+0000 7fe664ff9640 1 -- 172.21.15.7:0/1788813785 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe66c049040 con 0x558f46b95390 2024-09-21T06:39:16.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.564+0000 7fe664ff9640 1 -- 172.21.15.7:0/1788813785 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fe66c0d71d0 con 0x558f46b95390 2024-09-21T06:39:16.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.564+0000 7fe689a5c740 1 -- 172.21.15.7:0/1788813785 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe67401f040 con 0x558f46b95390 2024-09-21T06:39:16.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.564+0000 7fe664ff9640 1 -- 172.21.15.7:0/1788813785 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe66c0b6020 con 0x558f46b95390 2024-09-21T06:39:16.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.564+0000 7fe689a5c740 10 client.16098 fetch_fsmap learned FSMap version 25 2024-09-21T06:39:16.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.564+0000 7fe689a5c740 1 -- 172.21.15.7:0/1788813785 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558f46fe5b90 con 0x558f46b95390 2024-09-21T06:39:16.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.564+0000 7fe664ff9640 1 -- 172.21.15.7:0/1788813785 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe67401f040 con 0x558f46b95390 2024-09-21T06:39:16.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.565+0000 7fe664ff9640 1 -- 172.21.15.7:0/1788813785 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fe66c07a080 con 0x558f46b95390 2024-09-21T06:39:16.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.565+0000 7fe689a5c740 10 client.16098 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:39:16.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.565+0000 7fe689a5c740 10 client.16098 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:39:16.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.565+0000 7fe689a5c740 20 client.16098 populate_metadata read hostname 'smithi007' 2024-09-21T06:39:16.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.565+0000 7fe689a5c740 1 --2- 172.21.15.7:0/1788813785 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x558f46b49da0 0x558f46fe8290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:16.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.565+0000 7fe689a5c740 4 client.16098 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:39:16.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.565+0000 7fe689a5c740 1 -- 172.21.15.7:0/1788813785 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558f46ed18a0 con 0x558f46b49da0 2024-09-21T06:39:16.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.565+0000 7fe681284640 1 --2- 172.21.15.7:0/1788813785 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x558f46b49da0 0x558f46fe8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:16.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.566+0000 7fe664ff9640 10 client.16098 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:39:16.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.566+0000 7fe681284640 1 --2- 172.21.15.7:0/1788813785 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x558f46b49da0 0x558f46fe8290 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64846ef2d30fd8f2 server_cookie=796a11c85fc4823e in_seq=0 out_seq=0 2024-09-21T06:39:16.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.566+0000 7fe664ff9640 1 -- 172.21.15.7:0/1788813785 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558f46ed18a0 con 0x558f46b49da0 2024-09-21T06:39:16.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.566+0000 7fe664ff9640 10 client.16098 handle_command_reply: tid=0 2024-09-21T06:39:16.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.566+0000 7fe689a5c740 1 client.16098 shutdown 2024-09-21T06:39:16.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.566+0000 7fe689a5c740 1 -- 172.21.15.7:0/1788813785 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558f46b95390 msgr2=0x558f46f80650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:16.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.566+0000 7fe689a5c740 1 --2- 172.21.15.7:0/1788813785 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558f46b95390 0x558f46f80650 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fe66c0cd730 tx=0x7fe66c005de0 comp rx=0 tx=0).stop 2024-09-21T06:39:16.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.566+0000 7fe689a5c740 1 -- 172.21.15.7:0/1788813785 shutdown_connections 2024-09-21T06:39:16.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.566+0000 7fe689a5c740 1 --2- 172.21.15.7:0/1788813785 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x558f46b49da0 0x558f46fe8290 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:16.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.566+0000 7fe689a5c740 1 --2- 172.21.15.7:0/1788813785 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558f46bb6070 0x558f46f80b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:16.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.566+0000 7fe689a5c740 1 --2- 172.21.15.7:0/1788813785 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558f46b95390 0x558f46f80650 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:16.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.566+0000 7fe689a5c740 1 --2- 172.21.15.7:0/1788813785 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558f46b8d1b0 0x558f46f719a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:16.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.566+0000 7fe689a5c740 1 -- 172.21.15.7:0/1788813785 >> 172.21.15.7:0/1788813785 conn(0x558f46baa460 msgr2=0x558f46f5e6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:16.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.566+0000 7fe664ff9640 0 client.16098 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:39:16.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.566+0000 7fe689a5c740 1 -- 172.21.15.7:0/1788813785 shutdown_connections 2024-09-21T06:39:16.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.566+0000 7fe689a5c740 1 -- 172.21.15.7:0/1788813785 wait complete. 2024-09-21T06:39:16.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.566+0000 7fe689a5c740 20 client.16098 trim_cache size 0 max 16384 2024-09-21T06:39:16.573 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:39:16.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.567+0000 7fe6834e8640 1 -- 172.21.15.7:0/3494151001 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fe6680b6700 msgr2=0x7fe6680b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:16.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.567+0000 7fe6834e8640 1 --2- 172.21.15.7:0/3494151001 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fe6680b6700 0x7fe6680b8c10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fe67400a400 tx=0x7fe67400d040 comp rx=0 tx=0).stop 2024-09-21T06:39:16.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.567+0000 7fe6834e8640 1 -- 172.21.15.7:0/3494151001 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe67c1083a0 msgr2=0x7fe67c19abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:16.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.567+0000 7fe6834e8640 1 --2- 172.21.15.7:0/3494151001 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe67c1083a0 0x7fe67c19abe0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fe66c031a90 tx=0x7fe66c004270 comp rx=0 tx=0).stop 2024-09-21T06:39:16.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.567+0000 7fe6834e8640 1 -- 172.21.15.7:0/3494151001 shutdown_connections 2024-09-21T06:39:16.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.567+0000 7fe6834e8640 1 --2- 172.21.15.7:0/3494151001 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fe6680b6700 0x7fe6680b8c10 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:16.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.567+0000 7fe6834e8640 1 --2- 172.21.15.7:0/3494151001 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe67c108cf0 0x7fe67c19fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:16.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.567+0000 7fe6834e8640 1 --2- 172.21.15.7:0/3494151001 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe67c1083a0 0x7fe67c19abe0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:16.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.567+0000 7fe6834e8640 1 --2- 172.21.15.7:0/3494151001 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe67c102a60 0x7fe67c19a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:16.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.567+0000 7fe6834e8640 1 -- 172.21.15.7:0/3494151001 >> 172.21.15.7:0/3494151001 conn(0x7fe67c079730 msgr2=0x7fe67c105320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:16.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.567+0000 7fe6834e8640 1 -- 172.21.15.7:0/3494151001 shutdown_connections 2024-09-21T06:39:16.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:16.567+0000 7fe6834e8640 1 -- 172.21.15.7:0/3494151001 wait complete. 2024-09-21T06:39:17.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:39:16 smithi144 ceph-mon[34653]: pgmap v411: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 938 B/s wr, 5 op/s 2024-09-21T06:39:17.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:39:16 smithi007 ceph-mon[30983]: pgmap v411: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 938 B/s wr, 5 op/s 2024-09-21T06:39:17.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:39:16 smithi018 ceph-mon[34477]: pgmap v411: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 938 B/s wr, 5 op/s 2024-09-21T06:39:18.424 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:39:18.424 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:39:18.697 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:39:19.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:39:18 smithi007 ceph-mon[30983]: pgmap v412: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 938 B/s wr, 6 op/s 2024-09-21T06:39:19.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.189+0000 7f5d19723640 1 -- 172.21.15.7:0/213888332 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d141083c0 msgr2=0x7f5d141087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:19.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.189+0000 7f5d19723640 1 --2- 172.21.15.7:0/213888332 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d141083c0 0x7f5d141087d0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f5d08009900 tx=0x7f5d0802a3f0 comp rx=0 tx=0).stop 2024-09-21T06:39:19.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.189+0000 7f5d19723640 1 -- 172.21.15.7:0/213888332 shutdown_connections 2024-09-21T06:39:19.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.189+0000 7f5d19723640 1 --2- 172.21.15.7:0/213888332 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d14108d10 0x7f5d1410f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:19.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.189+0000 7f5d19723640 1 --2- 172.21.15.7:0/213888332 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d141083c0 0x7f5d141087d0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:19.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.189+0000 7f5d19723640 1 --2- 172.21.15.7:0/213888332 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d14102a80 0x7f5d14102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:19.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.189+0000 7f5d19723640 1 -- 172.21.15.7:0/213888332 >> 172.21.15.7:0/213888332 conn(0x7f5d14079740 msgr2=0x7f5d14079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:19.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.189+0000 7f5d19723640 1 -- 172.21.15.7:0/213888332 shutdown_connections 2024-09-21T06:39:19.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.189+0000 7f5d19723640 1 -- 172.21.15.7:0/213888332 wait complete. 2024-09-21T06:39:19.196 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.189+0000 7f5d19723640 1 Processor -- start 2024-09-21T06:39:19.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.190+0000 7f5d19723640 1 -- start start 2024-09-21T06:39:19.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.190+0000 7f5d19723640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d14102a80 0x7f5d1419b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:19.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.190+0000 7f5d19723640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d141083c0 0x7f5d1419b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:19.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.190+0000 7f5d19723640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d14108d10 0x7f5d1419bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:19.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.190+0000 7f5d19723640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5d14112980 con 0x7f5d141083c0 2024-09-21T06:39:19.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.190+0000 7f5d19723640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5d14112800 con 0x7f5d14102a80 2024-09-21T06:39:19.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.190+0000 7f5d19723640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5d14112b00 con 0x7f5d14108d10 2024-09-21T06:39:19.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.190+0000 7f5d127fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d141083c0 0x7f5d1419b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:19.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.190+0000 7f5d127fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d141083c0 0x7f5d1419b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39890/0 (socket says 172.21.15.7:39890) 2024-09-21T06:39:19.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.190+0000 7f5d12ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d14102a80 0x7f5d1419b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:19.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.190+0000 7f5d127fc640 1 -- 172.21.15.7:0/3228543232 learned_addr learned my addr 172.21.15.7:0/3228543232 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:39:19.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.190+0000 7f5d137fe640 1 --2- 172.21.15.7:0/3228543232 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d14108d10 0x7f5d1419bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:19.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.190+0000 7f5d127fc640 1 -- 172.21.15.7:0/3228543232 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d14108d10 msgr2=0x7f5d1419bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:19.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.190+0000 7f5d127fc640 1 --2- 172.21.15.7:0/3228543232 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d14108d10 0x7f5d1419bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:19.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.190+0000 7f5d127fc640 1 -- 172.21.15.7:0/3228543232 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d14102a80 msgr2=0x7f5d1419b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:19.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.190+0000 7f5d127fc640 1 --2- 172.21.15.7:0/3228543232 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d14102a80 0x7f5d1419b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:19.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.190+0000 7f5d127fc640 1 -- 172.21.15.7:0/3228543232 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d141a64b0 con 0x7f5d141083c0 2024-09-21T06:39:19.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.191+0000 7f5d127fc640 1 --2- 172.21.15.7:0/3228543232 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d141083c0 0x7f5d1419b7f0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f5d08031a90 tx=0x7f5d08004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:19.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.191+0000 7f5cfbfff640 1 -- 172.21.15.7:0/3228543232 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d0803f030 con 0x7f5d141083c0 2024-09-21T06:39:19.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.191+0000 7f5d19723640 1 -- 172.21.15.7:0/3228543232 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d141a6740 con 0x7f5d141083c0 2024-09-21T06:39:19.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.191+0000 7f5cfbfff640 1 -- 172.21.15.7:0/3228543232 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5d08003cb0 con 0x7f5d141083c0 2024-09-21T06:39:19.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.191+0000 7f5cfbfff640 1 -- 172.21.15.7:0/3228543232 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d08035070 con 0x7f5d141083c0 2024-09-21T06:39:19.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.191+0000 7f5d19723640 1 -- 172.21.15.7:0/3228543232 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d141a6c70 con 0x7f5d141083c0 2024-09-21T06:39:19.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.194+0000 7f5d1fc97740 1 Processor -- start 2024-09-21T06:39:19.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.194+0000 7f5d1fc97740 1 -- start start 2024-09-21T06:39:19.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.195+0000 7f5d1fc97740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc0116a350 0x55bc01511430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:19.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.195+0000 7f5d1fc97740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc01141490 0x55bc01511970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:19.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.195+0000 7f5d1fc97740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bc01149670 0x55bc01511eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:19.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.195+0000 7f5d1fc97740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55bc01487e60 con 0x55bc01149670 2024-09-21T06:39:19.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.195+0000 7f5d1fc97740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55bc01477290 con 0x55bc01141490 2024-09-21T06:39:19.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.195+0000 7f5d1fc97740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55bc0147b0a0 con 0x55bc0116a350 2024-09-21T06:39:19.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.195+0000 7f5cfbfff640 1 -- 172.21.15.7:0/3228543232 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f5d08042030 con 0x7f5d141083c0 2024-09-21T06:39:19.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.195+0000 7f5d12ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc01141490 0x55bc01511970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:19.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.195+0000 7f5d12ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc01141490 0x55bc01511970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.7:56448/0 (socket says 172.21.15.7:56448) 2024-09-21T06:39:19.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.195+0000 7f5d137fe640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc0116a350 0x55bc01511430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:19.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.195+0000 7f5d12ffd640 1 -- 172.21.15.7:0/43516630 learned_addr learned my addr 172.21.15.7:0/43516630 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:39:19.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.195+0000 7f5d127fc640 1 --2- 172.21.15.7:0/43516630 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bc01149670 0x55bc01511eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:19.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.196+0000 7f5d12ffd640 1 -- 172.21.15.7:0/43516630 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc0116a350 msgr2=0x55bc01511430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:19.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.196+0000 7f5d12ffd640 1 --2- 172.21.15.7:0/43516630 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc0116a350 0x55bc01511430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:19.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.196+0000 7f5d12ffd640 1 -- 172.21.15.7:0/43516630 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bc01149670 msgr2=0x55bc01511eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:19.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.196+0000 7f5d12ffd640 1 --2- 172.21.15.7:0/43516630 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bc01149670 0x55bc01511eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:19.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.196+0000 7f5d12ffd640 1 -- 172.21.15.7:0/43516630 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc011d5930 con 0x55bc01141490 2024-09-21T06:39:19.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.196+0000 7f5d127fc640 1 --2- 172.21.15.7:0/43516630 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bc01149670 0x55bc01511eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:39:19.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.196+0000 7f5d12ffd640 1 --2- 172.21.15.7:0/43516630 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc01141490 0x55bc01511970 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5d04007f40 tx=0x7f5d0400f850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0a81bef16e72913 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:19.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.196+0000 7f5cfbfff640 1 --2- 172.21.15.7:0/3228543232 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f5cfc0b66b0 0x7f5cfc0b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:19.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.196+0000 7f5cf97fa640 1 -- 172.21.15.7:0/43516630 <== mon.2 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d04010900 con 0x55bc01141490 2024-09-21T06:39:19.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.196+0000 7f5cf97fa640 1 -- 172.21.15.7:0/43516630 <== mon.2 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5d040183f0 con 0x55bc01141490 2024-09-21T06:39:19.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.196+0000 7f5cf97fa640 1 -- 172.21.15.7:0/43516630 <== mon.2 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d040175a0 con 0x55bc01141490 2024-09-21T06:39:19.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.196+0000 7f5d137fe640 1 --2- 172.21.15.7:0/3228543232 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f5cfc0b66b0 0x7f5cfc0b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:19.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.196+0000 7f5cfbfff640 1 -- 172.21.15.7:0/3228543232 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f5d08107920 con 0x7f5d141083c0 2024-09-21T06:39:19.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.197+0000 7f5d1fc97740 1 -- 172.21.15.7:0/43516630 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc01141490 msgr2=0x55bc01511970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:19.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.197+0000 7f5d137fe640 1 --2- 172.21.15.7:0/3228543232 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f5cfc0b66b0 0x7f5cfc0b8bc0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5d0c0045d0 tx=0x7f5d0c005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:19.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.197+0000 7f5d1fc97740 1 --2- 172.21.15.7:0/43516630 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc01141490 0x55bc01511970 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5d04007f40 tx=0x7f5d0400f850 comp rx=0 tx=0).stop 2024-09-21T06:39:19.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.197+0000 7f5d1fc97740 1 -- 172.21.15.7:0/43516630 shutdown_connections 2024-09-21T06:39:19.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.197+0000 7f5d1fc97740 1 --2- 172.21.15.7:0/43516630 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bc01149670 0x55bc01511eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:19.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.197+0000 7f5d1fc97740 1 --2- 172.21.15.7:0/43516630 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc01141490 0x55bc01511970 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:19.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.197+0000 7f5d1fc97740 1 --2- 172.21.15.7:0/43516630 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc0116a350 0x55bc01511430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:19.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.197+0000 7f5d1fc97740 1 -- 172.21.15.7:0/43516630 >> 172.21.15.7:0/43516630 conn(0x55bc0115e740 msgr2=0x55bc0150f320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:19.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.197+0000 7f5d1fc97740 1 -- 172.21.15.7:0/43516630 shutdown_connections 2024-09-21T06:39:19.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.197+0000 7f5d1fc97740 1 -- 172.21.15.7:0/43516630 wait complete. 2024-09-21T06:39:19.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.198+0000 7f5d1fc97740 1 -- start start 2024-09-21T06:39:19.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.198+0000 7f5d1fc97740 1 Processor -- start 2024-09-21T06:39:19.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.198+0000 7f5d1fc97740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bc01141490 0x55bc0151cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:19.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.198+0000 7f5d1fc97740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc01149670 0x55bc0151d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:19.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.198+0000 7f5d1fc97740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc0116a350 0x55bc0152d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:19.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.198+0000 7f5d1fc97740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55bc012d8890 con 0x55bc01141490 2024-09-21T06:39:19.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.198+0000 7f5d1fc97740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55bc01411d40 con 0x55bc0116a350 2024-09-21T06:39:19.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.198+0000 7f5d1fc97740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55bc01524020 con 0x55bc01149670 2024-09-21T06:39:19.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.198+0000 7f5d1fc97740 10 client.0 _ll_register_callbacks cb 0x55bc01475c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:39:19.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.198+0000 7f5d12ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bc01141490 0x55bc0151cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:19.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.198+0000 7f5d12ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bc01141490 0x55bc0151cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39908/0 (socket says 172.21.15.7:39908) 2024-09-21T06:39:19.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.198+0000 7f5d12ffd640 1 -- 172.21.15.7:0/3026068310 learned_addr learned my addr 172.21.15.7:0/3026068310 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:39:19.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.198+0000 7f5d127fc640 1 --2- 172.21.15.7:0/3026068310 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc01149670 0x55bc0151d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:19.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.198+0000 7f5d137fe640 1 --2- 172.21.15.7:0/3026068310 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc0116a350 0x55bc0152d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:19.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.199+0000 7f5d12ffd640 1 -- 172.21.15.7:0/3026068310 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc01149670 msgr2=0x55bc0151d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:19.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.199+0000 7f5d12ffd640 1 --2- 172.21.15.7:0/3026068310 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc01149670 0x55bc0151d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:19.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.199+0000 7f5d12ffd640 1 -- 172.21.15.7:0/3026068310 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc0116a350 msgr2=0x55bc0152d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:19.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.199+0000 7f5d12ffd640 1 --2- 172.21.15.7:0/3026068310 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc0116a350 0x55bc0152d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:19.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.199+0000 7f5d12ffd640 1 -- 172.21.15.7:0/3026068310 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc0152d8b0 con 0x55bc01141490 2024-09-21T06:39:19.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.199+0000 7f5d137fe640 1 --2- 172.21.15.7:0/3026068310 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc0116a350 0x55bc0152d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:39:19.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.199+0000 7f5d12ffd640 1 --2- 172.21.15.7:0/3026068310 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bc01141490 0x55bc0151cf00 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f5d0401a040 tx=0x7f5d04007c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c590b55328a13e22 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:19.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.199+0000 7f5cf6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:39:19.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.199+0000 7f5cf6ff5640 1 -- 172.21.15.7:0/3026068310 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d04026070 con 0x55bc01141490 2024-09-21T06:39:19.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.199+0000 7f5cf6ff5640 1 -- 172.21.15.7:0/3026068310 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f5d04018a70 con 0x55bc01141490 2024-09-21T06:39:19.210 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.199+0000 7f5d1fc97740 1 -- 172.21.15.7:0/3026068310 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d040183f0 con 0x55bc01141490 2024-09-21T06:39:19.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.199+0000 7f5cf6ff5640 1 -- 172.21.15.7:0/3026068310 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5d04032050 con 0x55bc01141490 2024-09-21T06:39:19.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.199+0000 7f5d1fc97740 10 client.16110 fetch_fsmap learned FSMap version 25 2024-09-21T06:39:19.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.199+0000 7f5d1fc97740 1 -- 172.21.15.7:0/3026068310 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55bc01530170 con 0x55bc01141490 2024-09-21T06:39:19.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.200+0000 7f5cf6ff5640 1 -- 172.21.15.7:0/3026068310 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5d040183f0 con 0x55bc01141490 2024-09-21T06:39:19.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.200+0000 7f5cf6ff5640 1 -- 172.21.15.7:0/3026068310 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f5d04022980 con 0x55bc01141490 2024-09-21T06:39:19.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.200+0000 7f5d1fc97740 10 client.16110 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:39:19.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.200+0000 7f5d1fc97740 10 client.16110 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:39:19.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.200+0000 7f5d1fc97740 20 client.16110 populate_metadata read hostname 'smithi007' 2024-09-21T06:39:19.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.200+0000 7f5d1fc97740 1 --2- 172.21.15.7:0/3026068310 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55bc01128cd0 0x55bc01533530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:19.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.200+0000 7f5d1fc97740 4 client.16110 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:39:19.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.200+0000 7f5d1fc97740 1 -- 172.21.15.7:0/3026068310 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bc01489db0 con 0x55bc01128cd0 2024-09-21T06:39:19.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.200+0000 7f5d127fc640 1 --2- 172.21.15.7:0/3026068310 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55bc01128cd0 0x55bc01533530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:19.211 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.200+0000 7f5cf6ff5640 10 client.16110 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:39:19.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.200+0000 7f5d127fc640 1 --2- 172.21.15.7:0/3026068310 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55bc01128cd0 0x55bc01533530 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=819b63ee7b103eee server_cookie=cf1fa82f923a512d in_seq=0 out_seq=0 2024-09-21T06:39:19.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.201+0000 7f5cf6ff5640 1 -- 172.21.15.7:0/3026068310 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bc01489db0 con 0x55bc01128cd0 2024-09-21T06:39:19.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.201+0000 7f5cf6ff5640 10 client.16110 handle_command_reply: tid=0 2024-09-21T06:39:19.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.201+0000 7f5d1fc97740 1 client.16110 shutdown 2024-09-21T06:39:19.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.202+0000 7f5d1fc97740 1 -- 172.21.15.7:0/3026068310 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bc01141490 msgr2=0x55bc0151cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:19.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.202+0000 7f5d1fc97740 1 --2- 172.21.15.7:0/3026068310 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bc01141490 0x55bc0151cf00 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f5d0401a040 tx=0x7f5d04007c70 comp rx=0 tx=0).stop 2024-09-21T06:39:19.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.202+0000 7f5d1fc97740 1 -- 172.21.15.7:0/3026068310 shutdown_connections 2024-09-21T06:39:19.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.202+0000 7f5d1fc97740 1 --2- 172.21.15.7:0/3026068310 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55bc01128cd0 0x55bc01533530 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:19.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.202+0000 7f5d1fc97740 1 --2- 172.21.15.7:0/3026068310 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc0116a350 0x55bc0152d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:19.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.202+0000 7f5d1fc97740 1 --2- 172.21.15.7:0/3026068310 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc01149670 0x55bc0151d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:19.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.202+0000 7f5d1fc97740 1 --2- 172.21.15.7:0/3026068310 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bc01141490 0x55bc0151cf00 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:19.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.202+0000 7f5d1fc97740 1 -- 172.21.15.7:0/3026068310 >> 172.21.15.7:0/3026068310 conn(0x55bc0115e740 msgr2=0x55bc015145c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:19.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.202+0000 7f5cf6ff5640 0 client.16110 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:39:19.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.202+0000 7f5d1fc97740 1 -- 172.21.15.7:0/3026068310 shutdown_connections 2024-09-21T06:39:19.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.202+0000 7f5d1fc97740 1 -- 172.21.15.7:0/3026068310 wait complete. 2024-09-21T06:39:19.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.202+0000 7f5d1fc97740 20 client.16110 trim_cache size 0 max 16384 2024-09-21T06:39:19.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.220+0000 7f5d1fc97740 1 Processor -- start 2024-09-21T06:39:19.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.220+0000 7f5d1fc97740 1 -- start start 2024-09-21T06:39:19.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.220+0000 7f5d1fc97740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bc01141490 0x55bc0152d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:19.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.220+0000 7f5d1fc97740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc01149670 0x55bc0151c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:19.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.220+0000 7f5d1fc97740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc0116a350 0x55bc0150f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:19.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.220+0000 7f5d1fc97740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5d141afb20 con 0x55bc01141490 2024-09-21T06:39:19.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.220+0000 7f5d1fc97740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5d141ad3f0 con 0x55bc01149670 2024-09-21T06:39:19.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.220+0000 7f5d1fc97740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5d141ab240 con 0x55bc0116a350 2024-09-21T06:39:19.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.220+0000 7f5d12ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bc01141490 0x55bc0152d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:19.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.220+0000 7f5d12ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bc01141490 0x55bc0152d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39920/0 (socket says 172.21.15.7:39920) 2024-09-21T06:39:19.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.220+0000 7f5d12ffd640 1 -- 172.21.15.7:0/107526976 learned_addr learned my addr 172.21.15.7:0/107526976 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:39:19.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.220+0000 7f5d127fc640 1 --2- 172.21.15.7:0/107526976 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc01149670 0x55bc0151c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:19.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.220+0000 7f5d137fe640 1 --2- 172.21.15.7:0/107526976 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc0116a350 0x55bc0150f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:19.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.220+0000 7f5d12ffd640 1 -- 172.21.15.7:0/107526976 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc0116a350 msgr2=0x55bc0150f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:19.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.220+0000 7f5d12ffd640 1 --2- 172.21.15.7:0/107526976 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc0116a350 0x55bc0150f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:19.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.220+0000 7f5d12ffd640 1 -- 172.21.15.7:0/107526976 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc01149670 msgr2=0x55bc0151c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:19.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.220+0000 7f5d12ffd640 1 --2- 172.21.15.7:0/107526976 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc01149670 0x55bc0151c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:19.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.220+0000 7f5d12ffd640 1 -- 172.21.15.7:0/107526976 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bc0151dda0 con 0x55bc01141490 2024-09-21T06:39:19.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.220+0000 7f5d127fc640 1 --2- 172.21.15.7:0/107526976 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc01149670 0x55bc0151c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:39:19.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.221+0000 7f5d12ffd640 1 --2- 172.21.15.7:0/107526976 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bc01141490 0x55bc0152d2e0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f5d04008010 tx=0x7f5d04007dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0cb350196e0e010 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:19.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.221+0000 7f5cf8ff9640 1 -- 172.21.15.7:0/107526976 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d04026040 con 0x55bc01141490 2024-09-21T06:39:19.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.221+0000 7f5cf8ff9640 1 -- 172.21.15.7:0/107526976 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5d0403b070 con 0x55bc01141490 2024-09-21T06:39:19.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.221+0000 7f5cf8ff9640 1 -- 172.21.15.7:0/107526976 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d04018ad0 con 0x55bc01141490 2024-09-21T06:39:19.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.222+0000 7f5d1fc97740 1 -- 172.21.15.7:0/107526976 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bc01141490 msgr2=0x55bc0152d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:19.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.222+0000 7f5d1fc97740 1 --2- 172.21.15.7:0/107526976 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bc01141490 0x55bc0152d2e0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f5d04008010 tx=0x7f5d04007dc0 comp rx=0 tx=0).stop 2024-09-21T06:39:19.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.222+0000 7f5d1fc97740 1 -- 172.21.15.7:0/107526976 shutdown_connections 2024-09-21T06:39:19.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.222+0000 7f5d1fc97740 1 --2- 172.21.15.7:0/107526976 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc0116a350 0x55bc0150f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:19.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.222+0000 7f5d1fc97740 1 --2- 172.21.15.7:0/107526976 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc01149670 0x55bc0151c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:19.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.222+0000 7f5d1fc97740 1 --2- 172.21.15.7:0/107526976 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bc01141490 0x55bc0152d2e0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:19.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.222+0000 7f5d1fc97740 1 -- 172.21.15.7:0/107526976 >> 172.21.15.7:0/107526976 conn(0x55bc0115e740 msgr2=0x55bc0150eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:19.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.222+0000 7f5d1fc97740 1 -- 172.21.15.7:0/107526976 shutdown_connections 2024-09-21T06:39:19.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.222+0000 7f5d1fc97740 1 -- 172.21.15.7:0/107526976 wait complete. 2024-09-21T06:39:19.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.222+0000 7f5d1fc97740 1 -- start start 2024-09-21T06:39:19.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.222+0000 7f5d1fc97740 1 Processor -- start 2024-09-21T06:39:19.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.222+0000 7f5d1fc97740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc01141490 0x55bc01534530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:19.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.222+0000 7f5d1fc97740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bc01149670 0x55bc01534a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:19.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.222+0000 7f5d1fc97740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc0116a350 0x55bc01534fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:19.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.223+0000 7f5d1fc97740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5d141ab8b0 con 0x55bc01149670 2024-09-21T06:39:19.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.223+0000 7f5d1fc97740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5d141acd20 con 0x55bc0116a350 2024-09-21T06:39:19.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.223+0000 7f5d1fc97740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5d141abf80 con 0x55bc01141490 2024-09-21T06:39:19.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.223+0000 7f5d1fc97740 10 client.0 _ll_register_callbacks cb 0x7f5d0c00c2d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:39:19.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.223+0000 7f5d127fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bc01149670 0x55bc01534a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:19.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.223+0000 7f5d127fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bc01149670 0x55bc01534a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39932/0 (socket says 172.21.15.7:39932) 2024-09-21T06:39:19.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.223+0000 7f5d127fc640 1 -- 172.21.15.7:0/1121562890 learned_addr learned my addr 172.21.15.7:0/1121562890 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:39:19.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.223+0000 7f5d12ffd640 1 --2- 172.21.15.7:0/1121562890 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc01141490 0x55bc01534530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:19.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.223+0000 7f5d137fe640 1 --2- 172.21.15.7:0/1121562890 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc0116a350 0x55bc01534fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:19.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.223+0000 7f5d127fc640 1 -- 172.21.15.7:0/1121562890 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc01141490 msgr2=0x55bc01534530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:19.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.223+0000 7f5d127fc640 1 --2- 172.21.15.7:0/1121562890 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc01141490 0x55bc01534530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:19.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.223+0000 7f5d127fc640 1 -- 172.21.15.7:0/1121562890 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc0116a350 msgr2=0x55bc01534fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:19.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.223+0000 7f5d127fc640 1 --2- 172.21.15.7:0/1121562890 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc0116a350 0x55bc01534fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:19.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.223+0000 7f5d127fc640 1 -- 172.21.15.7:0/1121562890 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bc0159ccb0 con 0x55bc01149670 2024-09-21T06:39:19.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.223+0000 7f5d137fe640 1 --2- 172.21.15.7:0/1121562890 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc0116a350 0x55bc01534fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:39:19.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.223+0000 7f5d127fc640 1 --2- 172.21.15.7:0/1121562890 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bc01149670 0x55bc01534a70 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f5d080caa80 tx=0x7f5d08000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da26fd5b82ee7f35 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:19.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.223+0000 7f5cf6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:39:19.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.223+0000 7f5cf6ff5640 1 -- 172.21.15.7:0/1121562890 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d08049040 con 0x55bc01149670 2024-09-21T06:39:19.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.223+0000 7f5cf6ff5640 1 -- 172.21.15.7:0/1121562890 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f5d08105390 con 0x55bc01149670 2024-09-21T06:39:19.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.223+0000 7f5d1fc97740 1 -- 172.21.15.7:0/1121562890 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d0403b070 con 0x55bc01149670 2024-09-21T06:39:19.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.224+0000 7f5cf6ff5640 1 -- 172.21.15.7:0/1121562890 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5d0803be50 con 0x55bc01149670 2024-09-21T06:39:19.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.224+0000 7f5d1fc97740 10 client.16116 fetch_fsmap learned FSMap version 25 2024-09-21T06:39:19.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.224+0000 7f5d1fc97740 1 -- 172.21.15.7:0/1121562890 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55bc0159df40 con 0x55bc01149670 2024-09-21T06:39:19.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.224+0000 7f5cf6ff5640 1 -- 172.21.15.7:0/1121562890 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5d0403b070 con 0x55bc01149670 2024-09-21T06:39:19.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.224+0000 7f5cf6ff5640 1 -- 172.21.15.7:0/1121562890 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f5d0804c060 con 0x55bc01149670 2024-09-21T06:39:19.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.224+0000 7f5d1fc97740 10 client.16116 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:39:19.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.224+0000 7f5d1fc97740 10 client.16116 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:39:19.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.224+0000 7f5d1fc97740 20 client.16116 populate_metadata read hostname 'smithi007' 2024-09-21T06:39:19.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.224+0000 7f5d1fc97740 1 --2- 172.21.15.7:0/1121562890 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55bc010fe080 0x55bc015a06c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:19.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.224+0000 7f5d1fc97740 4 client.16116 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:39:19.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.224+0000 7f5d1fc97740 1 -- 172.21.15.7:0/1121562890 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55bc01485860 con 0x55bc010fe080 2024-09-21T06:39:19.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.224+0000 7f5d12ffd640 1 --2- 172.21.15.7:0/1121562890 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55bc010fe080 0x55bc015a06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:19.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.225+0000 7f5d12ffd640 1 --2- 172.21.15.7:0/1121562890 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55bc010fe080 0x55bc015a06c0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=20ccbc29bf784570 server_cookie=e0e14f964cde7c2a in_seq=0 out_seq=0 2024-09-21T06:39:19.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.225+0000 7f5cf6ff5640 10 client.16116 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:39:19.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.226+0000 7f5cf6ff5640 1 -- 172.21.15.7:0/1121562890 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55bc01485860 con 0x55bc010fe080 2024-09-21T06:39:19.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.226+0000 7f5cf6ff5640 10 client.16116 handle_command_reply: tid=0 2024-09-21T06:39:19.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.226+0000 7f5d1fc97740 1 client.16116 shutdown 2024-09-21T06:39:19.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.226+0000 7f5d1fc97740 1 -- 172.21.15.7:0/1121562890 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bc01149670 msgr2=0x55bc01534a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:19.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.226+0000 7f5d1fc97740 1 --2- 172.21.15.7:0/1121562890 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bc01149670 0x55bc01534a70 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f5d080caa80 tx=0x7f5d08000bc0 comp rx=0 tx=0).stop 2024-09-21T06:39:19.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.226+0000 7f5d1fc97740 1 -- 172.21.15.7:0/1121562890 shutdown_connections 2024-09-21T06:39:19.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.226+0000 7f5d1fc97740 1 --2- 172.21.15.7:0/1121562890 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55bc010fe080 0x55bc015a06c0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:19.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.226+0000 7f5d1fc97740 1 --2- 172.21.15.7:0/1121562890 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55bc0116a350 0x55bc01534fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:19.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.226+0000 7f5d1fc97740 1 --2- 172.21.15.7:0/1121562890 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55bc01149670 0x55bc01534a70 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:19.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.227+0000 7f5cf6ff5640 0 client.16116 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:39:19.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.226+0000 7f5d1fc97740 1 --2- 172.21.15.7:0/1121562890 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55bc01141490 0x55bc01534530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:19.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.227+0000 7f5d1fc97740 1 -- 172.21.15.7:0/1121562890 >> 172.21.15.7:0/1121562890 conn(0x55bc0115e740 msgr2=0x55bc01512460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:19.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.227+0000 7f5d1fc97740 1 -- 172.21.15.7:0/1121562890 shutdown_connections 2024-09-21T06:39:19.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.227+0000 7f5d1fc97740 1 -- 172.21.15.7:0/1121562890 wait complete. 2024-09-21T06:39:19.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.227+0000 7f5d1fc97740 20 client.16116 trim_cache size 0 max 16384 2024-09-21T06:39:19.234 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:39:19.234 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0, 2024-09-21T06:39:19.234 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_tag": "d7b6a90c-9ae1-4e02-93ad-335a7e9df1d7", 2024-09-21T06:39:19.234 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": "asynchronous" 2024-09-21T06:39:19.235 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:39:19.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.227+0000 7f5d19723640 1 -- 172.21.15.7:0/3228543232 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f5cfc0b66b0 msgr2=0x7f5cfc0b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:19.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.227+0000 7f5d19723640 1 --2- 172.21.15.7:0/3228543232 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f5cfc0b66b0 0x7f5cfc0b8bc0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5d0c0045d0 tx=0x7f5d0c005f90 comp rx=0 tx=0).stop 2024-09-21T06:39:19.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.228+0000 7f5d19723640 1 -- 172.21.15.7:0/3228543232 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d141083c0 msgr2=0x7f5d1419b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:19.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.228+0000 7f5d19723640 1 --2- 172.21.15.7:0/3228543232 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d141083c0 0x7f5d1419b7f0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f5d08031a90 tx=0x7f5d08004270 comp rx=0 tx=0).stop 2024-09-21T06:39:19.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.228+0000 7f5d19723640 1 -- 172.21.15.7:0/3228543232 shutdown_connections 2024-09-21T06:39:19.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.228+0000 7f5d19723640 1 --2- 172.21.15.7:0/3228543232 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f5cfc0b66b0 0x7f5cfc0b8bc0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:19.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.228+0000 7f5d19723640 1 --2- 172.21.15.7:0/3228543232 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d14108d10 0x7f5d1419bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:19.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.228+0000 7f5d19723640 1 --2- 172.21.15.7:0/3228543232 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d141083c0 0x7f5d1419b7f0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:19.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.228+0000 7f5d19723640 1 --2- 172.21.15.7:0/3228543232 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d14102a80 0x7f5d1419b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:19.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.228+0000 7f5d19723640 1 -- 172.21.15.7:0/3228543232 >> 172.21.15.7:0/3228543232 conn(0x7f5d14079740 msgr2=0x7f5d14104440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:19.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.228+0000 7f5d19723640 1 -- 172.21.15.7:0/3228543232 shutdown_connections 2024-09-21T06:39:19.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:19.228+0000 7f5d19723640 1 -- 172.21.15.7:0/3228543232 wait complete. 2024-09-21T06:39:19.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:39:18 smithi144 ceph-mon[34653]: pgmap v412: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 938 B/s wr, 6 op/s 2024-09-21T06:39:19.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:39:18 smithi018 ceph-mon[34477]: pgmap v412: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 938 B/s wr, 6 op/s 2024-09-21T06:39:20.097 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:39:19 smithi007 ceph-mon[30983]: scrub queued for path: / 2024-09-21T06:39:20.097 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:39:19 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T06:39:20.097 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:39:19 smithi007 ceph-mon[30983]: scrub summary: active paths [/] 2024-09-21T06:39:20.097 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:39:19 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T06:39:20.097 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:39:19 smithi007 ceph-mon[30983]: scrub summary: idle 2024-09-21T06:39:20.099 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:39:20.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:39:19 smithi144 ceph-mon[34653]: scrub queued for path: / 2024-09-21T06:39:20.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:39:19 smithi144 ceph-mon[34653]: scrub summary: idle+waiting paths [/] 2024-09-21T06:39:20.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:39:19 smithi144 ceph-mon[34653]: scrub summary: active paths [/] 2024-09-21T06:39:20.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:39:19 smithi144 ceph-mon[34653]: scrub summary: idle+waiting paths [/] 2024-09-21T06:39:20.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:39:19 smithi144 ceph-mon[34653]: scrub summary: idle 2024-09-21T06:39:20.356 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:39:20.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:39:19 smithi018 ceph-mon[34477]: scrub queued for path: / 2024-09-21T06:39:20.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:39:19 smithi018 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-21T06:39:20.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:39:19 smithi018 ceph-mon[34477]: scrub summary: active paths [/] 2024-09-21T06:39:20.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:39:19 smithi018 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-21T06:39:20.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:39:19 smithi018 ceph-mon[34477]: scrub summary: idle 2024-09-21T06:39:20.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.850+0000 7f7798cfd640 1 -- 172.21.15.7:0/573470816 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7794103b60 msgr2=0x7f7794103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:20.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.850+0000 7f7798cfd640 1 --2- 172.21.15.7:0/573470816 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7794103b60 0x7f7794103f70 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f7784009900 tx=0x7f778402a410 comp rx=0 tx=0).stop 2024-09-21T06:39:20.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.850+0000 7f7798cfd640 1 -- 172.21.15.7:0/573470816 shutdown_connections 2024-09-21T06:39:20.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.850+0000 7f7798cfd640 1 --2- 172.21.15.7:0/573470816 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7794109df0 0x7f7794110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:20.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.850+0000 7f7798cfd640 1 --2- 172.21.15.7:0/573470816 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f77941094a0 0x7f77941098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:20.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.850+0000 7f7798cfd640 1 --2- 172.21.15.7:0/573470816 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7794103b60 0x7f7794103f70 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:20.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.850+0000 7f7798cfd640 1 -- 172.21.15.7:0/573470816 >> 172.21.15.7:0/573470816 conn(0x7f779407b850 msgr2=0x7f779407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:20.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.851+0000 7f7798cfd640 1 -- 172.21.15.7:0/573470816 shutdown_connections 2024-09-21T06:39:20.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.851+0000 7f7798cfd640 1 -- 172.21.15.7:0/573470816 wait complete. 2024-09-21T06:39:20.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.851+0000 7f7798cfd640 1 Processor -- start 2024-09-21T06:39:20.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.851+0000 7f7798cfd640 1 -- start start 2024-09-21T06:39:20.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.852+0000 7f7798cfd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7794103b60 0x7f779419a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:20.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.852+0000 7f7798cfd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f77941094a0 0x7f779419aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:20.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.852+0000 7f7798cfd640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7794109df0 0x7f779419fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:20.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.852+0000 7f7798cfd640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7794113ab0 con 0x7f77941094a0 2024-09-21T06:39:20.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.852+0000 7f7798cfd640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7794113930 con 0x7f7794103b60 2024-09-21T06:39:20.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.852+0000 7f7798cfd640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7794113c30 con 0x7f7794109df0 2024-09-21T06:39:20.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.852+0000 7f778bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f77941094a0 0x7f779419aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:20.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.852+0000 7f778bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f77941094a0 0x7f779419aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45920/0 (socket says 172.21.15.7:45920) 2024-09-21T06:39:20.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.852+0000 7f778bfff640 1 -- 172.21.15.7:0/387017332 learned_addr learned my addr 172.21.15.7:0/387017332 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:39:20.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.852+0000 7f779259c640 1 --2- 172.21.15.7:0/387017332 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7794103b60 0x7f779419a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:20.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.852+0000 7f7792d9d640 1 --2- 172.21.15.7:0/387017332 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7794109df0 0x7f779419fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:20.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.852+0000 7f778bfff640 1 -- 172.21.15.7:0/387017332 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7794109df0 msgr2=0x7f779419fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:20.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.852+0000 7f778bfff640 1 --2- 172.21.15.7:0/387017332 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7794109df0 0x7f779419fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:20.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.852+0000 7f778bfff640 1 -- 172.21.15.7:0/387017332 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7794103b60 msgr2=0x7f779419a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:20.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.852+0000 7f778bfff640 1 --2- 172.21.15.7:0/387017332 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7794103b60 0x7f779419a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:20.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.852+0000 7f778bfff640 1 -- 172.21.15.7:0/387017332 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77941a0410 con 0x7f77941094a0 2024-09-21T06:39:20.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.852+0000 7f778bfff640 1 --2- 172.21.15.7:0/387017332 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f77941094a0 0x7f779419aa40 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f777c00d950 tx=0x7f777c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:20.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.853+0000 7f778b7fe640 1 -- 172.21.15.7:0/387017332 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f777c017070 con 0x7f77941094a0 2024-09-21T06:39:20.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.853+0000 7f7798cfd640 1 -- 172.21.15.7:0/387017332 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77941a0700 con 0x7f77941094a0 2024-09-21T06:39:20.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.853+0000 7f778b7fe640 1 -- 172.21.15.7:0/387017332 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f777c009c30 con 0x7f77941094a0 2024-09-21T06:39:20.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.853+0000 7f778b7fe640 1 -- 172.21.15.7:0/387017332 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f777c0047a0 con 0x7f77941094a0 2024-09-21T06:39:20.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.853+0000 7f7798cfd640 1 -- 172.21.15.7:0/387017332 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77941a6e60 con 0x7f77941094a0 2024-09-21T06:39:20.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.855+0000 7f779f271740 1 Processor -- start 2024-09-21T06:39:20.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.856+0000 7f779f271740 1 -- start start 2024-09-21T06:39:20.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.856+0000 7f779f271740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc60108070 0x55dc604accd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:20.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.856+0000 7f779f271740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dc600df1b0 0x55dc604ad250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:20.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.856+0000 7f779f271740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dc600e7390 0x55dc604bf620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:20.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.856+0000 7f779f271740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55dc60425e50 con 0x55dc60108070 2024-09-21T06:39:20.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.856+0000 7f779f271740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55dc60415280 con 0x55dc600df1b0 2024-09-21T06:39:20.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.856+0000 7f779f271740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55dc60419090 con 0x55dc600e7390 2024-09-21T06:39:20.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.856+0000 7f778b7fe640 1 -- 172.21.15.7:0/387017332 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f777c004020 con 0x7f77941094a0 2024-09-21T06:39:20.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.856+0000 7f7792d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc60108070 0x55dc604accd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:20.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.856+0000 7f7792d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc60108070 0x55dc604accd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45922/0 (socket says 172.21.15.7:45922) 2024-09-21T06:39:20.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.856+0000 7f7792d9d640 1 -- 172.21.15.7:0/414118220 learned_addr learned my addr 172.21.15.7:0/414118220 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:39:20.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.856+0000 7f779259c640 1 --2- 172.21.15.7:0/414118220 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dc600df1b0 0x55dc604ad250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:20.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.857+0000 7f778bfff640 1 --2- 172.21.15.7:0/414118220 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dc600e7390 0x55dc604bf620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:20.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.857+0000 7f779259c640 1 -- 172.21.15.7:0/414118220 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dc600e7390 msgr2=0x55dc604bf620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:20.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.857+0000 7f779259c640 1 --2- 172.21.15.7:0/414118220 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dc600e7390 0x55dc604bf620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:20.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.857+0000 7f779259c640 1 -- 172.21.15.7:0/414118220 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc60108070 msgr2=0x55dc604accd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:20.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.857+0000 7f779259c640 1 --2- 172.21.15.7:0/414118220 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc60108070 0x55dc604accd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:20.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.857+0000 7f779259c640 1 -- 172.21.15.7:0/414118220 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc60173650 con 0x55dc600df1b0 2024-09-21T06:39:20.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.857+0000 7f7792d9d640 1 --2- 172.21.15.7:0/414118220 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc60108070 0x55dc604accd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:39:20.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.857+0000 7f779259c640 1 --2- 172.21.15.7:0/414118220 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dc600df1b0 0x55dc604ad250 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7784009230 tx=0x7f7784032cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80c22b56144fd87a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:20.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.857+0000 7f778b7fe640 1 --2- 172.21.15.7:0/387017332 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f77800b6700 0x7f77800b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:20.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.857+0000 7f7788ff9640 1 -- 172.21.15.7:0/414118220 <== mon.2 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7784040070 con 0x55dc600df1b0 2024-09-21T06:39:20.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.857+0000 7f7788ff9640 1 -- 172.21.15.7:0/414118220 <== mon.2 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7784032e40 con 0x55dc600df1b0 2024-09-21T06:39:20.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.857+0000 7f7792d9d640 1 --2- 172.21.15.7:0/387017332 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f77800b6700 0x7f77800b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:20.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.857+0000 7f7788ff9640 1 -- 172.21.15.7:0/414118220 <== mon.2 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7784035040 con 0x55dc600df1b0 2024-09-21T06:39:20.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.858+0000 7f778b7fe640 1 -- 172.21.15.7:0/387017332 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f777c0e7240 con 0x7f77941094a0 2024-09-21T06:39:20.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.858+0000 7f779f271740 1 -- 172.21.15.7:0/414118220 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dc600df1b0 msgr2=0x55dc604ad250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:20.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.858+0000 7f7792d9d640 1 --2- 172.21.15.7:0/387017332 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f77800b6700 0x7f77800b8c10 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f778c005f40 tx=0x7f778c009600 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:20.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.858+0000 7f779f271740 1 --2- 172.21.15.7:0/414118220 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dc600df1b0 0x55dc604ad250 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7784009230 tx=0x7f7784032cd0 comp rx=0 tx=0).stop 2024-09-21T06:39:20.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.859+0000 7f779f271740 1 -- 172.21.15.7:0/414118220 shutdown_connections 2024-09-21T06:39:20.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.859+0000 7f779f271740 1 --2- 172.21.15.7:0/414118220 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dc600e7390 0x55dc604bf620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:20.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.859+0000 7f779f271740 1 --2- 172.21.15.7:0/414118220 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dc600df1b0 0x55dc604ad250 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:20.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.859+0000 7f779f271740 1 --2- 172.21.15.7:0/414118220 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc60108070 0x55dc604accd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:20.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.859+0000 7f779f271740 1 -- 172.21.15.7:0/414118220 >> 172.21.15.7:0/414118220 conn(0x55dc600fc460 msgr2=0x55dc604af1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:20.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.859+0000 7f779f271740 1 -- 172.21.15.7:0/414118220 shutdown_connections 2024-09-21T06:39:20.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.859+0000 7f779f271740 1 -- 172.21.15.7:0/414118220 wait complete. 2024-09-21T06:39:20.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.859+0000 7f779f271740 1 -- start start 2024-09-21T06:39:20.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.859+0000 7f779f271740 1 Processor -- start 2024-09-21T06:39:20.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.860+0000 7f779f271740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dc600df1b0 0x55dc604c3890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:20.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.860+0000 7f779f271740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dc600e7390 0x55dc604c3e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:20.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.860+0000 7f779f271740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc60108070 0x55dc604c8e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:20.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.860+0000 7f779f271740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55dc60276700 con 0x55dc60108070 2024-09-21T06:39:20.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.860+0000 7f779f271740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55dc603b0110 con 0x55dc600df1b0 2024-09-21T06:39:20.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.860+0000 7f779f271740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55dc604c00c0 con 0x55dc600e7390 2024-09-21T06:39:20.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.860+0000 7f779f271740 10 client.0 _ll_register_callbacks cb 0x55dc603c9990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:39:20.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.860+0000 7f7792d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc60108070 0x55dc604c8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:20.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.860+0000 7f7792d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc60108070 0x55dc604c8e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45928/0 (socket says 172.21.15.7:45928) 2024-09-21T06:39:20.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.860+0000 7f7792d9d640 1 -- 172.21.15.7:0/248562914 learned_addr learned my addr 172.21.15.7:0/248562914 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:39:20.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.860+0000 7f779259c640 1 --2- 172.21.15.7:0/248562914 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dc600df1b0 0x55dc604c3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:20.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.860+0000 7f778bfff640 1 --2- 172.21.15.7:0/248562914 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dc600e7390 0x55dc604c3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:20.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.860+0000 7f7792d9d640 1 -- 172.21.15.7:0/248562914 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dc600e7390 msgr2=0x55dc604c3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:20.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.860+0000 7f7792d9d640 1 --2- 172.21.15.7:0/248562914 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dc600e7390 0x55dc604c3e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:20.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.860+0000 7f7792d9d640 1 -- 172.21.15.7:0/248562914 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dc600df1b0 msgr2=0x55dc604c3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:20.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.860+0000 7f7792d9d640 1 --2- 172.21.15.7:0/248562914 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dc600df1b0 0x55dc604c3890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:20.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.860+0000 7f7792d9d640 1 -- 172.21.15.7:0/248562914 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc603ddc40 con 0x55dc60108070 2024-09-21T06:39:20.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.860+0000 7f7792d9d640 1 --2- 172.21.15.7:0/248562914 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc60108070 0x55dc604c8e90 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f778c011f70 tx=0x7f778c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23eec4f091cca72d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:20.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.860+0000 7f7779ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:39:20.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.861+0000 7f7779ffb640 1 -- 172.21.15.7:0/248562914 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f778c01ed30 con 0x55dc60108070 2024-09-21T06:39:20.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.861+0000 7f7779ffb640 1 -- 172.21.15.7:0/248562914 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f778c02a480 con 0x55dc60108070 2024-09-21T06:39:20.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.861+0000 7f779f271740 1 -- 172.21.15.7:0/248562914 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55dc60427da0 con 0x55dc60108070 2024-09-21T06:39:20.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.861+0000 7f7779ffb640 1 -- 172.21.15.7:0/248562914 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f778c02f030 con 0x55dc60108070 2024-09-21T06:39:20.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.861+0000 7f779f271740 10 client.16128 fetch_fsmap learned FSMap version 25 2024-09-21T06:39:20.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.861+0000 7f779f271740 1 -- 172.21.15.7:0/248562914 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55dc604d1e40 con 0x55dc60108070 2024-09-21T06:39:20.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.861+0000 7f7779ffb640 1 -- 172.21.15.7:0/248562914 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55dc60427da0 con 0x55dc60108070 2024-09-21T06:39:20.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.861+0000 7f7779ffb640 1 -- 172.21.15.7:0/248562914 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f778c00f040 con 0x55dc60108070 2024-09-21T06:39:20.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.861+0000 7f779f271740 10 client.16128 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:39:20.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.861+0000 7f779f271740 10 client.16128 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:39:20.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.861+0000 7f779f271740 20 client.16128 populate_metadata read hostname 'smithi007' 2024-09-21T06:39:20.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.861+0000 7f779f271740 1 --2- 172.21.15.7:0/248562914 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55dc600c69f0 0x55dc604d53e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:20.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.862+0000 7f779f271740 4 client.16128 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:39:20.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.862+0000 7f779f271740 1 -- 172.21.15.7:0/248562914 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dc60423850 con 0x55dc600c69f0 2024-09-21T06:39:20.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.862+0000 7f779259c640 1 --2- 172.21.15.7:0/248562914 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55dc600c69f0 0x55dc604d53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:20.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.862+0000 7f779259c640 1 --2- 172.21.15.7:0/248562914 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55dc600c69f0 0x55dc604d53e0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ae67394b3c30551 server_cookie=a28d224c355b81e5 in_seq=0 out_seq=0 2024-09-21T06:39:20.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.862+0000 7f7779ffb640 10 client.16128 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:39:20.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.863+0000 7f7779ffb640 1 -- 172.21.15.7:0/248562914 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55dc60423850 con 0x55dc600c69f0 2024-09-21T06:39:20.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.863+0000 7f7779ffb640 10 client.16128 handle_command_reply: tid=0 2024-09-21T06:39:20.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.863+0000 7f779f271740 1 client.16128 shutdown 2024-09-21T06:39:20.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.863+0000 7f779f271740 1 -- 172.21.15.7:0/248562914 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc60108070 msgr2=0x55dc604c8e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:20.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.863+0000 7f779f271740 1 --2- 172.21.15.7:0/248562914 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc60108070 0x55dc604c8e90 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f778c011f70 tx=0x7f778c004a40 comp rx=0 tx=0).stop 2024-09-21T06:39:20.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.864+0000 7f779f271740 1 -- 172.21.15.7:0/248562914 shutdown_connections 2024-09-21T06:39:20.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.864+0000 7f779f271740 1 --2- 172.21.15.7:0/248562914 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55dc600c69f0 0x55dc604d53e0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:20.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.864+0000 7f7779ffb640 0 client.16128 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:39:20.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.864+0000 7f779f271740 1 --2- 172.21.15.7:0/248562914 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc60108070 0x55dc604c8e90 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:20.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.864+0000 7f779f271740 1 --2- 172.21.15.7:0/248562914 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dc600e7390 0x55dc604c3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:20.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.864+0000 7f779f271740 1 --2- 172.21.15.7:0/248562914 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dc600df1b0 0x55dc604c3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:20.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.864+0000 7f779f271740 1 -- 172.21.15.7:0/248562914 >> 172.21.15.7:0/248562914 conn(0x55dc600fc460 msgr2=0x55dc604ac0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:20.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.864+0000 7f779f271740 1 -- 172.21.15.7:0/248562914 shutdown_connections 2024-09-21T06:39:20.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.864+0000 7f779f271740 1 -- 172.21.15.7:0/248562914 wait complete. 2024-09-21T06:39:20.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.864+0000 7f779f271740 20 client.16128 trim_cache size 0 max 16384 2024-09-21T06:39:20.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.881+0000 7f779f271740 1 Processor -- start 2024-09-21T06:39:20.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.881+0000 7f779f271740 1 -- start start 2024-09-21T06:39:20.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.881+0000 7f779f271740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc600df1b0 0x55dc604af120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:20.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.881+0000 7f779f271740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dc600e7390 0x55dc604be0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:20.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.881+0000 7f779f271740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dc60108070 0x55dc604be5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:20.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.881+0000 7f779f271740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f77941afc60 con 0x55dc600df1b0 2024-09-21T06:39:20.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.881+0000 7f779f271740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f77941ad530 con 0x55dc600e7390 2024-09-21T06:39:20.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.881+0000 7f779f271740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f77941ab380 con 0x55dc60108070 2024-09-21T06:39:20.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.881+0000 7f779259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc600df1b0 0x55dc604af120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:20.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.882+0000 7f779259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc600df1b0 0x55dc604af120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45936/0 (socket says 172.21.15.7:45936) 2024-09-21T06:39:20.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.882+0000 7f779259c640 1 -- 172.21.15.7:0/3623290734 learned_addr learned my addr 172.21.15.7:0/3623290734 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:39:20.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.882+0000 7f778bfff640 1 --2- 172.21.15.7:0/3623290734 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dc600e7390 0x55dc604be0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:20.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.882+0000 7f7792d9d640 1 --2- 172.21.15.7:0/3623290734 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dc60108070 0x55dc604be5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:20.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.882+0000 7f779259c640 1 -- 172.21.15.7:0/3623290734 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dc60108070 msgr2=0x55dc604be5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:20.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.882+0000 7f779259c640 1 --2- 172.21.15.7:0/3623290734 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dc60108070 0x55dc604be5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:20.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.882+0000 7f779259c640 1 -- 172.21.15.7:0/3623290734 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dc600e7390 msgr2=0x55dc604be0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:20.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.882+0000 7f779259c640 1 --2- 172.21.15.7:0/3623290734 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dc600e7390 0x55dc604be0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:20.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.882+0000 7f779259c640 1 -- 172.21.15.7:0/3623290734 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc604ada80 con 0x55dc600df1b0 2024-09-21T06:39:20.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.882+0000 7f779259c640 1 --2- 172.21.15.7:0/3623290734 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc600df1b0 0x55dc604af120 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x55dc604ade70 tx=0x7f77840052a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17dc75dbb609ffb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:20.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.882+0000 7f777bfff640 1 -- 172.21.15.7:0/3623290734 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7784051070 con 0x55dc600df1b0 2024-09-21T06:39:20.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.882+0000 7f777bfff640 1 -- 172.21.15.7:0/3623290734 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f77840316a0 con 0x55dc600df1b0 2024-09-21T06:39:20.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.882+0000 7f777bfff640 1 -- 172.21.15.7:0/3623290734 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7784035040 con 0x55dc600df1b0 2024-09-21T06:39:20.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.883+0000 7f779f271740 1 -- 172.21.15.7:0/3623290734 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc600df1b0 msgr2=0x55dc604af120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:20.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.883+0000 7f779f271740 1 --2- 172.21.15.7:0/3623290734 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc600df1b0 0x55dc604af120 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x55dc604ade70 tx=0x7f77840052a0 comp rx=0 tx=0).stop 2024-09-21T06:39:20.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.883+0000 7f779f271740 1 -- 172.21.15.7:0/3623290734 shutdown_connections 2024-09-21T06:39:20.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.883+0000 7f779f271740 1 --2- 172.21.15.7:0/3623290734 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dc60108070 0x55dc604be5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:20.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.883+0000 7f779f271740 1 --2- 172.21.15.7:0/3623290734 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dc600e7390 0x55dc604be0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:20.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.883+0000 7f779f271740 1 --2- 172.21.15.7:0/3623290734 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc600df1b0 0x55dc604af120 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:20.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.883+0000 7f779f271740 1 -- 172.21.15.7:0/3623290734 >> 172.21.15.7:0/3623290734 conn(0x55dc600fc460 msgr2=0x55dc604acc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:20.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.883+0000 7f779f271740 1 -- 172.21.15.7:0/3623290734 shutdown_connections 2024-09-21T06:39:20.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.883+0000 7f779f271740 1 -- 172.21.15.7:0/3623290734 wait complete. 2024-09-21T06:39:20.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.883+0000 7f779f271740 1 -- start start 2024-09-21T06:39:20.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.884+0000 7f779f271740 1 Processor -- start 2024-09-21T06:39:20.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.884+0000 7f779f271740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc600df1b0 0x55dc604d9d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:20.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.884+0000 7f779f271740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dc600e7390 0x55dc604da2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:20.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.884+0000 7f779f271740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dc60108070 0x55dc604da810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:20.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.884+0000 7f779f271740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f77941ab9f0 con 0x55dc600df1b0 2024-09-21T06:39:20.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.884+0000 7f779f271740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f77941ace60 con 0x55dc60108070 2024-09-21T06:39:20.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.884+0000 7f779f271740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f77941ac0c0 con 0x55dc600e7390 2024-09-21T06:39:20.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.884+0000 7f779f271740 10 client.0 _ll_register_callbacks cb 0x7f778c011bf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:39:20.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.884+0000 7f779259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc600df1b0 0x55dc604d9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:20.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.884+0000 7f779259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc600df1b0 0x55dc604d9d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45938/0 (socket says 172.21.15.7:45938) 2024-09-21T06:39:20.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.884+0000 7f779259c640 1 -- 172.21.15.7:0/3109399875 learned_addr learned my addr 172.21.15.7:0/3109399875 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:39:20.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.884+0000 7f7792d9d640 1 --2- 172.21.15.7:0/3109399875 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dc60108070 0x55dc604da810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:20.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.884+0000 7f778bfff640 1 --2- 172.21.15.7:0/3109399875 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dc600e7390 0x55dc604da2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:20.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.884+0000 7f779259c640 1 -- 172.21.15.7:0/3109399875 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dc600e7390 msgr2=0x55dc604da2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:20.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.884+0000 7f779259c640 1 --2- 172.21.15.7:0/3109399875 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dc600e7390 0x55dc604da2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:20.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.884+0000 7f779259c640 1 -- 172.21.15.7:0/3109399875 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dc60108070 msgr2=0x55dc604da810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:20.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.884+0000 7f779259c640 1 --2- 172.21.15.7:0/3109399875 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dc60108070 0x55dc604da810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:20.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.884+0000 7f779259c640 1 -- 172.21.15.7:0/3109399875 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc604dadd0 con 0x55dc600df1b0 2024-09-21T06:39:20.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.885+0000 7f779259c640 1 --2- 172.21.15.7:0/3109399875 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc600df1b0 0x55dc604d9d90 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f7784005e60 tx=0x7f7784005310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be5302b97e668689 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:20.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.885+0000 7f7779ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:39:20.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.885+0000 7f7779ffb640 1 -- 172.21.15.7:0/3109399875 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7784062060 con 0x55dc600df1b0 2024-09-21T06:39:20.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.885+0000 7f7779ffb640 1 -- 172.21.15.7:0/3109399875 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f778404f440 con 0x55dc600df1b0 2024-09-21T06:39:20.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.885+0000 7f779f271740 1 -- 172.21.15.7:0/3109399875 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f77840316a0 con 0x55dc600df1b0 2024-09-21T06:39:20.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.885+0000 7f7779ffb640 1 -- 172.21.15.7:0/3109399875 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7784035040 con 0x55dc600df1b0 2024-09-21T06:39:20.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.885+0000 7f779f271740 10 client.16134 fetch_fsmap learned FSMap version 25 2024-09-21T06:39:20.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.885+0000 7f779f271740 1 -- 172.21.15.7:0/3109399875 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55dc60540300 con 0x55dc600df1b0 2024-09-21T06:39:20.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.885+0000 7f7779ffb640 1 -- 172.21.15.7:0/3109399875 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f77840316a0 con 0x55dc600df1b0 2024-09-21T06:39:20.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.886+0000 7f7779ffb640 1 -- 172.21.15.7:0/3109399875 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f7784004ab0 con 0x55dc600df1b0 2024-09-21T06:39:20.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.886+0000 7f779f271740 10 client.16134 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:39:20.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.886+0000 7f779f271740 10 client.16134 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:39:20.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.886+0000 7f779f271740 20 client.16134 populate_metadata read hostname 'smithi007' 2024-09-21T06:39:20.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.886+0000 7f779f271740 1 --2- 172.21.15.7:0/3109399875 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55dc6009bda0 0x55dc60542590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:20.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.886+0000 7f779f271740 4 client.16134 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:39:20.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.886+0000 7f779f271740 1 -- 172.21.15.7:0/3109399875 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55dc60420c80 con 0x55dc6009bda0 2024-09-21T06:39:20.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.886+0000 7f778bfff640 1 --2- 172.21.15.7:0/3109399875 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55dc6009bda0 0x55dc60542590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:20.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.886+0000 7f778bfff640 1 --2- 172.21.15.7:0/3109399875 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55dc6009bda0 0x55dc60542590 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d9386136a410bb7 server_cookie=1eb2f0d470f6bc11 in_seq=0 out_seq=0 2024-09-21T06:39:20.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.886+0000 7f7779ffb640 10 client.16134 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:39:20.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.887+0000 7f7779ffb640 1 -- 172.21.15.7:0/3109399875 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1510 (crc 0 0 0) 0x55dc60420c80 con 0x55dc6009bda0 2024-09-21T06:39:20.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.887+0000 7f7779ffb640 10 client.16134 handle_command_reply: tid=0 2024-09-21T06:39:20.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.887+0000 7f779f271740 1 client.16134 shutdown 2024-09-21T06:39:20.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.887+0000 7f779f271740 1 -- 172.21.15.7:0/3109399875 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc600df1b0 msgr2=0x55dc604d9d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:20.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.887+0000 7f779f271740 1 --2- 172.21.15.7:0/3109399875 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc600df1b0 0x55dc604d9d90 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f7784005e60 tx=0x7f7784005310 comp rx=0 tx=0).stop 2024-09-21T06:39:20.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.887+0000 7f779f271740 1 -- 172.21.15.7:0/3109399875 shutdown_connections 2024-09-21T06:39:20.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.887+0000 7f779f271740 1 --2- 172.21.15.7:0/3109399875 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55dc6009bda0 0x55dc60542590 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:20.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.887+0000 7f779f271740 1 --2- 172.21.15.7:0/3109399875 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dc60108070 0x55dc604da810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:20.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.887+0000 7f779f271740 1 --2- 172.21.15.7:0/3109399875 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dc600e7390 0x55dc604da2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:20.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.887+0000 7f779f271740 1 --2- 172.21.15.7:0/3109399875 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dc600df1b0 0x55dc604d9d90 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:20.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.887+0000 7f779f271740 1 -- 172.21.15.7:0/3109399875 >> 172.21.15.7:0/3109399875 conn(0x55dc600fc460 msgr2=0x55dc604acc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:20.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.887+0000 7f7779ffb640 0 client.16134 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:39:20.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.887+0000 7f779f271740 1 -- 172.21.15.7:0/3109399875 shutdown_connections 2024-09-21T06:39:20.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.887+0000 7f779f271740 1 -- 172.21.15.7:0/3109399875 wait complete. 2024-09-21T06:39:20.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.887+0000 7f779f271740 20 client.16134 trim_cache size 0 max 16384 2024-09-21T06:39:20.894 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:39:20.894 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "no active scrubs running", 2024-09-21T06:39:20.894 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": {}, 2024-09-21T06:39:20.894 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_stats": { 2024-09-21T06:39:20.894 INFO:teuthology.orchestra.run.smithi007.stdout: "d7b6a90c-9ae1-4e02-93ad-335a7e9df1d7": { 2024-09-21T06:39:20.895 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:39:19.226139+0000", 2024-09-21T06:39:20.895 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:39:20.895 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:39:20.895 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:39:20.895 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:39:20.895 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:39:20.895 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:39:20.895 INFO:teuthology.orchestra.run.smithi007.stdout: "b0327167-8c41-4286-8afc-7f0780972fd7": { 2024-09-21T06:39:20.895 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:38:36.828657+0000", 2024-09-21T06:39:20.895 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:39:20.895 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:39:20.895 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:39:20.895 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:39:20.895 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:39:20.896 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:39:20.896 INFO:teuthology.orchestra.run.smithi007.stdout: "5cbaaba2-6ab1-4f83-abd6-8c6eef4b5c42": { 2024-09-21T06:39:20.896 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:37:46.566272+0000", 2024-09-21T06:39:20.896 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:39:20.896 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:39:20.896 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:39:20.896 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:39:20.896 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:39:20.896 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:39:20.896 INFO:teuthology.orchestra.run.smithi007.stdout: "6231e9c1-14a2-40b5-be3c-76d87a0d733b": { 2024-09-21T06:39:20.896 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:37:02.484812+0000", 2024-09-21T06:39:20.896 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:39:20.897 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:39:20.897 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:39:20.897 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:39:20.897 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:39:20.897 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:39:20.897 INFO:teuthology.orchestra.run.smithi007.stdout: "0b89345c-1f00-4efe-8ee9-4cb17e43584c": { 2024-09-21T06:39:20.898 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:36:19.500334+0000", 2024-09-21T06:39:20.898 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:39:20.898 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:39:20.898 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:39:20.898 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:39:20.898 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:39:20.898 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:39:20.899 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:39:20.899 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:39:20.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.887+0000 7f7798cfd640 1 -- 172.21.15.7:0/387017332 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f77800b6700 msgr2=0x7f77800b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:20.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.887+0000 7f7798cfd640 1 --2- 172.21.15.7:0/387017332 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f77800b6700 0x7f77800b8c10 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f778c005f40 tx=0x7f778c009600 comp rx=0 tx=0).stop 2024-09-21T06:39:20.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.887+0000 7f7798cfd640 1 -- 172.21.15.7:0/387017332 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f77941094a0 msgr2=0x7f779419aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:20.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.887+0000 7f7798cfd640 1 --2- 172.21.15.7:0/387017332 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f77941094a0 0x7f779419aa40 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f777c00d950 tx=0x7f777c00de10 comp rx=0 tx=0).stop 2024-09-21T06:39:20.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.888+0000 7f7798cfd640 1 -- 172.21.15.7:0/387017332 shutdown_connections 2024-09-21T06:39:20.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.888+0000 7f7798cfd640 1 --2- 172.21.15.7:0/387017332 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f77800b6700 0x7f77800b8c10 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:20.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.888+0000 7f7798cfd640 1 --2- 172.21.15.7:0/387017332 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7794109df0 0x7f779419fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:20.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.888+0000 7f7798cfd640 1 --2- 172.21.15.7:0/387017332 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f77941094a0 0x7f779419aa40 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:20.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.888+0000 7f7798cfd640 1 --2- 172.21.15.7:0/387017332 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7794103b60 0x7f779419a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:20.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.888+0000 7f7798cfd640 1 -- 172.21.15.7:0/387017332 >> 172.21.15.7:0/387017332 conn(0x7f779407b850 msgr2=0x7f7794107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:20.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.888+0000 7f7798cfd640 1 -- 172.21.15.7:0/387017332 shutdown_connections 2024-09-21T06:39:20.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:20.888+0000 7f7798cfd640 1 -- 172.21.15.7:0/387017332 wait complete. 2024-09-21T06:39:21.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:39:20 smithi007 ceph-mon[30983]: pgmap v413: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-21T06:39:21.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:39:20 smithi144 ceph-mon[34653]: pgmap v413: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-21T06:39:21.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:39:20 smithi018 ceph-mon[34477]: pgmap v413: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-21T06:39:21.674 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:39:21.674 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:39:21.929 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:39:22.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:22.449+0000 7f9c4861f640 1 -- 172.21.15.7:0/3301603504 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c401048c0 msgr2=0x7f9c40104cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:22.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:22.449+0000 7f9c4861f640 1 --2- 172.21.15.7:0/3301603504 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c401048c0 0x7f9c40104cd0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c009900 tx=0x7f9c3c02a3f0 comp rx=0 tx=0).stop 2024-09-21T06:39:22.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:22.449+0000 7f9c4861f640 1 -- 172.21.15.7:0/3301603504 shutdown_connections 2024-09-21T06:39:22.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:22.449+0000 7f9c4861f640 1 --2- 172.21.15.7:0/3301603504 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9c4010de70 0x7f9c40110340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:22.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:22.449+0000 7f9c4861f640 1 --2- 172.21.15.7:0/3301603504 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c401052a0 0x7f9c4010d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:22.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:22.449+0000 7f9c4861f640 1 --2- 172.21.15.7:0/3301603504 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c401048c0 0x7f9c40104cd0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:22.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:22.449+0000 7f9c4861f640 1 -- 172.21.15.7:0/3301603504 >> 172.21.15.7:0/3301603504 conn(0x7f9c40079760 msgr2=0x7f9c40079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:22.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:22.450+0000 7f9c4861f640 1 -- 172.21.15.7:0/3301603504 shutdown_connections 2024-09-21T06:39:22.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:22.450+0000 7f9c4861f640 1 -- 172.21.15.7:0/3301603504 wait complete. 2024-09-21T06:39:22.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:22.450+0000 7f9c4861f640 1 Processor -- start 2024-09-21T06:39:22.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:22.450+0000 7f9c4861f640 1 -- start start 2024-09-21T06:39:22.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:22.451+0000 7f9c4861f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c401048c0 0x7f9c4019a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:22.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:22.451+0000 7f9c4861f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9c401052a0 0x7f9c4019aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:22.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:22.451+0000 7f9c4861f640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c4010de70 0x7f9c4019fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:22.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:22.451+0000 7f9c4861f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9c40113ab0 con 0x7f9c401048c0 2024-09-21T06:39:22.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:22.451+0000 7f9c4861f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9c40113930 con 0x7f9c401052a0 2024-09-21T06:39:22.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:22.451+0000 7f9c4861f640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9c40113c30 con 0x7f9c4010de70 2024-09-21T06:39:22.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:22.451+0000 7f9c463bb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c401048c0 0x7f9c4019a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:22.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:22.451+0000 7f9c463bb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c401048c0 0x7f9c4019a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45960/0 (socket says 172.21.15.7:45960) 2024-09-21T06:39:22.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:22.451+0000 7f9c463bb640 1 -- 172.21.15.7:0/2289412655 learned_addr learned my addr 172.21.15.7:0/2289412655 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:39:22.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:22.451+0000 7f9c45bba640 1 --2- 172.21.15.7:0/2289412655 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9c401052a0 0x7f9c4019aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:22.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:22.451+0000 7f9c46bbc640 1 --2- 172.21.15.7:0/2289412655 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c4010de70 0x7f9c4019fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:22.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:22.451+0000 7f9c463bb640 1 -- 172.21.15.7:0/2289412655 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c4010de70 msgr2=0x7f9c4019fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:22.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:22.451+0000 7f9c463bb640 1 --2- 172.21.15.7:0/2289412655 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c4010de70 0x7f9c4019fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:22.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:22.451+0000 7f9c463bb640 1 -- 172.21.15.7:0/2289412655 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9c401052a0 msgr2=0x7f9c4019aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:22.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:22.451+0000 7f9c463bb640 1 --2- 172.21.15.7:0/2289412655 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9c401052a0 0x7f9c4019aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:22.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:22.451+0000 7f9c463bb640 1 -- 172.21.15.7:0/2289412655 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c401a0390 con 0x7f9c401048c0 2024-09-21T06:39:22.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:22.451+0000 7f9c45bba640 1 --2- 172.21.15.7:0/2289412655 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9c401052a0 0x7f9c4019aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:39:22.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:22.451+0000 7f9c46bbc640 1 --2- 172.21.15.7:0/2289412655 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c4010de70 0x7f9c4019fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:39:22.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:22.451+0000 7f9c463bb640 1 --2- 172.21.15.7:0/2289412655 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c401048c0 0x7f9c4019a4e0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c032fd0 tx=0x7f9c3c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:22.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:22.452+0000 7f9c377fe640 1 -- 172.21.15.7:0/2289412655 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c3c03f030 con 0x7f9c401048c0 2024-09-21T06:39:22.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:22.452+0000 7f9c377fe640 1 -- 172.21.15.7:0/2289412655 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9c3c004490 con 0x7f9c401048c0 2024-09-21T06:39:22.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:22.452+0000 7f9c377fe640 1 -- 172.21.15.7:0/2289412655 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c3c035070 con 0x7f9c401048c0 2024-09-21T06:39:22.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:22.452+0000 7f9c4861f640 1 -- 172.21.15.7:0/2289412655 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c401a0620 con 0x7f9c401048c0 2024-09-21T06:39:22.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:22.452+0000 7f9c4861f640 1 -- 172.21.15.7:0/2289412655 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c401a0b50 con 0x7f9c401048c0 2024-09-21T06:39:22.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:22.453+0000 7f9c4861f640 1 -- 172.21.15.7:0/2289412655 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c4006c190 con 0x7f9c401048c0 2024-09-21T06:39:22.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:22.454+0000 7f9c377fe640 1 -- 172.21.15.7:0/2289412655 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f9c3c042030 con 0x7f9c401048c0 2024-09-21T06:39:22.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:22.455+0000 7f9c377fe640 1 --2- 172.21.15.7:0/2289412655 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f9c2c0b6730 0x7f9c2c0b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:22.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:22.455+0000 7f9c45bba640 1 --2- 172.21.15.7:0/2289412655 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f9c2c0b6730 0x7f9c2c0b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:22.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:22.455+0000 7f9c377fe640 1 -- 172.21.15.7:0/2289412655 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f9c3c107f90 con 0x7f9c401048c0 2024-09-21T06:39:22.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:22.456+0000 7f9c45bba640 1 --2- 172.21.15.7:0/2289412655 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f9c2c0b6730 0x7f9c2c0b8c40 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9c300058c0 tx=0x7f9c30005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:22.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:22.459+0000 7f9c377fe640 1 -- 172.21.15.7:0/2289412655 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9c401a0b50 con 0x7f9c401048c0 2024-09-21T06:39:22.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:22.683+0000 7f9c4861f640 1 -- 172.21.15.7:0/2289412655 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9c4019b610 con 0x7f9c401048c0 2024-09-21T06:39:22.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:22.684+0000 7f9c377fe640 1 -- 172.21.15.7:0/2289412655 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11899 (secure 0 0 0) 0x7f9c3c0ce580 con 0x7f9c401048c0 2024-09-21T06:39:22.686 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:39:22.686 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-21T06:36:10:753693+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2015971546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2015971546},{"type":"v1","addr":"172.21.15.7:6835","nonce":2015971546}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/2350816224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":2350816224},{"type":"v1","addr":"172.21.15.7:6837","nonce":2350816224}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14823,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/1669980572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":1669980572},{"type":"v1","addr":"172.21.15.7:6839","nonce":1669980572}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14835,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/2528308973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":2528308973},{"type":"v1","addr":"172.21.15.7:6841","nonce":2528308973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24623,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1337382979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1337382979},{"type":"v1","addr":"172.21.15.18:6833","nonce":1337382979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/2751454345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":2751454345},{"type":"v1","addr":"172.21.15.144:6833","nonce":2751454345}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:34:24.627168+0000","modified":"2024-09-21T06:36:10.737288+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24716,"mds_1":24688,"mds_2":24686},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24656":{"gid":24656,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6835/158884796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":158884796},{"type":"v1","addr":"172.21.15.18:6835","nonce":158884796}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6835/3636739922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3636739922},{"type":"v1","addr":"172.21.15.144:6835","nonce":3636739922}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24673":{"gid":24673,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6837/1126341753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":1126341753},{"type":"v1","addr":"172.21.15.144:6837","nonce":1126341753}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.18:6837/1539670694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1539670694},{"type":"v1","addr":"172.21.15.18:6837","nonce":1539670694}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24688":{"gid":24688,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.144:6839/4027821922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":4027821922},{"type":"v1","addr":"172.21.15.144:6839","nonce":4027821922}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24716":{"gid":24716,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.18:6839/3798713532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":3798713532},{"type":"v1","addr":"172.21.15.18:6839","nonce":3798713532}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24716,"qdb_cluster":[24716,24688,24686]},"id":1}]} 2024-09-21T06:39:22.686 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-21T06:39:22.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:22.686+0000 7f9c4861f640 1 -- 172.21.15.7:0/2289412655 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f9c2c0b6730 msgr2=0x7f9c2c0b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:22.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:22.686+0000 7f9c4861f640 1 --2- 172.21.15.7:0/2289412655 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f9c2c0b6730 0x7f9c2c0b8c40 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9c300058c0 tx=0x7f9c30005850 comp rx=0 tx=0).stop 2024-09-21T06:39:22.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:22.686+0000 7f9c4861f640 1 -- 172.21.15.7:0/2289412655 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c401048c0 msgr2=0x7f9c4019a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:22.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:22.686+0000 7f9c4861f640 1 --2- 172.21.15.7:0/2289412655 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c401048c0 0x7f9c4019a4e0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c032fd0 tx=0x7f9c3c004270 comp rx=0 tx=0).stop 2024-09-21T06:39:22.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:22.686+0000 7f9c4861f640 1 -- 172.21.15.7:0/2289412655 shutdown_connections 2024-09-21T06:39:22.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:22.686+0000 7f9c4861f640 1 --2- 172.21.15.7:0/2289412655 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f9c2c0b6730 0x7f9c2c0b8c40 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:22.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:22.686+0000 7f9c4861f640 1 --2- 172.21.15.7:0/2289412655 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9c4010de70 0x7f9c4019fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:22.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:22.686+0000 7f9c4861f640 1 --2- 172.21.15.7:0/2289412655 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9c401052a0 0x7f9c4019aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:22.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:22.686+0000 7f9c4861f640 1 --2- 172.21.15.7:0/2289412655 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9c401048c0 0x7f9c4019a4e0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:22.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:22.686+0000 7f9c4861f640 1 -- 172.21.15.7:0/2289412655 >> 172.21.15.7:0/2289412655 conn(0x7f9c40079760 msgr2=0x7f9c40100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:22.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:22.687+0000 7f9c4861f640 1 -- 172.21.15.7:0/2289412655 shutdown_connections 2024-09-21T06:39:22.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:22.687+0000 7f9c4861f640 1 -- 172.21.15.7:0/2289412655 wait complete. 2024-09-21T06:39:23.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:39:22 smithi144 ceph-mon[34653]: pgmap v414: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-21T06:39:23.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:39:22 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/2289412655' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:39:23.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:39:22 smithi007 ceph-mon[30983]: pgmap v414: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-21T06:39:23.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:39:22 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2289412655' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:39:23.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:39:22 smithi018 ceph-mon[34477]: pgmap v414: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-21T06:39:23.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:39:22 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/2289412655' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:39:23.458 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:39:23.719 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:39:24.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.188+0000 7ff2c28a3640 1 -- 172.21.15.7:0/709497837 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2bc109df0 msgr2=0x7ff2bc110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:24.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.188+0000 7ff2c28a3640 1 --2- 172.21.15.7:0/709497837 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2bc109df0 0x7ff2bc110620 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7ff2b4009ca0 tx=0x7ff2b402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:39:24.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.188+0000 7ff2c28a3640 1 -- 172.21.15.7:0/709497837 shutdown_connections 2024-09-21T06:39:24.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.188+0000 7ff2c28a3640 1 --2- 172.21.15.7:0/709497837 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2bc109df0 0x7ff2bc110620 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:24.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.188+0000 7ff2c28a3640 1 --2- 172.21.15.7:0/709497837 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff2bc1094a0 0x7ff2bc1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:24.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.188+0000 7ff2c28a3640 1 --2- 172.21.15.7:0/709497837 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2bc103b60 0x7ff2bc103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:24.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.188+0000 7ff2c28a3640 1 -- 172.21.15.7:0/709497837 >> 172.21.15.7:0/709497837 conn(0x7ff2bc07b850 msgr2=0x7ff2bc07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:24.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.188+0000 7ff2c28a3640 1 -- 172.21.15.7:0/709497837 shutdown_connections 2024-09-21T06:39:24.193 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.188+0000 7ff2c28a3640 1 -- 172.21.15.7:0/709497837 wait complete. 2024-09-21T06:39:24.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.189+0000 7ff2c28a3640 1 Processor -- start 2024-09-21T06:39:24.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.189+0000 7ff2c28a3640 1 -- start start 2024-09-21T06:39:24.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.189+0000 7ff2c28a3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2bc103b60 0x7ff2bc19c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:24.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.189+0000 7ff2c28a3640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff2bc1094a0 0x7ff2bc19cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:24.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.189+0000 7ff2c28a3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2bc109df0 0x7ff2bc1a1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:24.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.189+0000 7ff2c28a3640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff2bc113ab0 con 0x7ff2bc103b60 2024-09-21T06:39:24.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.189+0000 7ff2c28a3640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff2bc113930 con 0x7ff2bc109df0 2024-09-21T06:39:24.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.189+0000 7ff2c28a3640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff2bc113c30 con 0x7ff2bc1094a0 2024-09-21T06:39:24.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.189+0000 7ff2bbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2bc103b60 0x7ff2bc19c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:24.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.189+0000 7ff2bbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2bc103b60 0x7ff2bc19c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45982/0 (socket says 172.21.15.7:45982) 2024-09-21T06:39:24.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.189+0000 7ff2bbfff640 1 -- 172.21.15.7:0/406802626 learned_addr learned my addr 172.21.15.7:0/406802626 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:39:24.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.189+0000 7ff2c0e40640 1 --2- 172.21.15.7:0/406802626 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2bc109df0 0x7ff2bc1a1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:24.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.190+0000 7ff2bb7fe640 1 --2- 172.21.15.7:0/406802626 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff2bc1094a0 0x7ff2bc19cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:24.194 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.190+0000 7ff2bbfff640 1 -- 172.21.15.7:0/406802626 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff2bc1094a0 msgr2=0x7ff2bc19cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:24.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.190+0000 7ff2bbfff640 1 --2- 172.21.15.7:0/406802626 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff2bc1094a0 0x7ff2bc19cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:24.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.190+0000 7ff2bbfff640 1 -- 172.21.15.7:0/406802626 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2bc109df0 msgr2=0x7ff2bc1a1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:24.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.190+0000 7ff2bbfff640 1 --2- 172.21.15.7:0/406802626 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2bc109df0 0x7ff2bc1a1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:24.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.190+0000 7ff2bbfff640 1 -- 172.21.15.7:0/406802626 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2bc1a25f0 con 0x7ff2bc103b60 2024-09-21T06:39:24.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.190+0000 7ff2c0e40640 1 --2- 172.21.15.7:0/406802626 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2bc109df0 0x7ff2bc1a1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:39:24.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.190+0000 7ff2bbfff640 1 --2- 172.21.15.7:0/406802626 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2bc103b60 0x7ff2bc19c680 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac00e9f0 tx=0x7ff2ac00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:24.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.190+0000 7ff2b97fa640 1 -- 172.21.15.7:0/406802626 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2ac00cd80 con 0x7ff2bc103b60 2024-09-21T06:39:24.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.190+0000 7ff2c28a3640 1 -- 172.21.15.7:0/406802626 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2bc1a28e0 con 0x7ff2bc103b60 2024-09-21T06:39:24.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.190+0000 7ff2b97fa640 1 -- 172.21.15.7:0/406802626 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff2ac0108e0 con 0x7ff2bc103b60 2024-09-21T06:39:24.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.190+0000 7ff2b97fa640 1 -- 172.21.15.7:0/406802626 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2ac018980 con 0x7ff2bc103b60 2024-09-21T06:39:24.195 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.190+0000 7ff2c28a3640 1 -- 172.21.15.7:0/406802626 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2bc1a9040 con 0x7ff2bc103b60 2024-09-21T06:39:24.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.193+0000 7ff2c8e17740 1 Processor -- start 2024-09-21T06:39:24.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.194+0000 7ff2c8e17740 1 -- start start 2024-09-21T06:39:24.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.194+0000 7ff2c8e17740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56060f3e1070 0x56060f7886a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:24.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.194+0000 7ff2c8e17740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56060f3b81b0 0x56060f788be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:24.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.194+0000 7ff2b97fa640 1 -- 172.21.15.7:0/406802626 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7ff2ac010430 con 0x7ff2bc103b60 2024-09-21T06:39:24.197 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.194+0000 7ff2c8e17740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56060f3c0390 0x56060f789120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:24.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.194+0000 7ff2c8e17740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56060f6feea0 con 0x56060f3c0390 2024-09-21T06:39:24.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.194+0000 7ff2c8e17740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56060f6ee2d0 con 0x56060f3e1070 2024-09-21T06:39:24.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.194+0000 7ff2c8e17740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x56060f6f20e0 con 0x56060f3b81b0 2024-09-21T06:39:24.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.194+0000 7ff2bb7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56060f3c0390 0x56060f789120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:24.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.194+0000 7ff2bb7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56060f3c0390 0x56060f789120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45996/0 (socket says 172.21.15.7:45996) 2024-09-21T06:39:24.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.194+0000 7ff2bb7fe640 1 -- 172.21.15.7:0/2665810809 learned_addr learned my addr 172.21.15.7:0/2665810809 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:39:24.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.194+0000 7ff2c0e40640 1 --2- 172.21.15.7:0/2665810809 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56060f3e1070 0x56060f7886a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:24.198 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.194+0000 7ff2bbfff640 1 --2- 172.21.15.7:0/2665810809 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56060f3b81b0 0x56060f788be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:24.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.195+0000 7ff2c0e40640 1 -- 172.21.15.7:0/2665810809 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56060f3b81b0 msgr2=0x56060f788be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:24.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.195+0000 7ff2c0e40640 1 --2- 172.21.15.7:0/2665810809 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56060f3b81b0 0x56060f788be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:24.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.195+0000 7ff2c0e40640 1 -- 172.21.15.7:0/2665810809 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56060f3c0390 msgr2=0x56060f789120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:24.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.195+0000 7ff2c0e40640 1 --2- 172.21.15.7:0/2665810809 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56060f3c0390 0x56060f789120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:24.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.195+0000 7ff2c0e40640 1 -- 172.21.15.7:0/2665810809 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56060f44c650 con 0x56060f3e1070 2024-09-21T06:39:24.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.195+0000 7ff2bbfff640 1 --2- 172.21.15.7:0/2665810809 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56060f3b81b0 0x56060f788be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:39:24.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.195+0000 7ff2bb7fe640 1 --2- 172.21.15.7:0/2665810809 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56060f3c0390 0x56060f789120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:39:24.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.195+0000 7ff2c0e40640 1 --2- 172.21.15.7:0/2665810809 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56060f3e1070 0x56060f7886a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff2b4005e30 tx=0x7ff2b402f3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1eaf7ac0aab4eff server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:24.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.195+0000 7ff2b97fa640 1 --2- 172.21.15.7:0/406802626 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7ff2a40b6680 0x7ff2a40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:24.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.195+0000 7ff2a27fc640 1 -- 172.21.15.7:0/2665810809 <== mon.2 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b4031650 con 0x56060f3e1070 2024-09-21T06:39:24.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.195+0000 7ff2bbfff640 1 --2- 172.21.15.7:0/406802626 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7ff2a40b6680 0x7ff2a40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:24.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.195+0000 7ff2a27fc640 1 -- 172.21.15.7:0/2665810809 <== mon.2 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff2b4036040 con 0x56060f3e1070 2024-09-21T06:39:24.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.195+0000 7ff2a27fc640 1 -- 172.21.15.7:0/2665810809 <== mon.2 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b4004430 con 0x56060f3e1070 2024-09-21T06:39:24.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.195+0000 7ff2b97fa640 1 -- 172.21.15.7:0/406802626 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7ff2ac0e79a0 con 0x7ff2bc103b60 2024-09-21T06:39:24.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.196+0000 7ff2c8e17740 1 -- 172.21.15.7:0/2665810809 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56060f3e1070 msgr2=0x56060f7886a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:24.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.196+0000 7ff2bbfff640 1 --2- 172.21.15.7:0/406802626 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7ff2a40b6680 0x7ff2a40b8b90 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x56060f787320 tx=0x7ff2ac0a9040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:24.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.196+0000 7ff2c8e17740 1 --2- 172.21.15.7:0/2665810809 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56060f3e1070 0x56060f7886a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff2b4005e30 tx=0x7ff2b402f3c0 comp rx=0 tx=0).stop 2024-09-21T06:39:24.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.196+0000 7ff2c8e17740 1 -- 172.21.15.7:0/2665810809 shutdown_connections 2024-09-21T06:39:24.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.196+0000 7ff2c8e17740 1 --2- 172.21.15.7:0/2665810809 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56060f3c0390 0x56060f789120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:24.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.196+0000 7ff2c8e17740 1 --2- 172.21.15.7:0/2665810809 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56060f3b81b0 0x56060f788be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:24.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.196+0000 7ff2c8e17740 1 --2- 172.21.15.7:0/2665810809 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56060f3e1070 0x56060f7886a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:24.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.196+0000 7ff2c8e17740 1 -- 172.21.15.7:0/2665810809 >> 172.21.15.7:0/2665810809 conn(0x56060f3d5460 msgr2=0x56060f786590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:24.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.196+0000 7ff2c8e17740 1 -- 172.21.15.7:0/2665810809 shutdown_connections 2024-09-21T06:39:24.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.196+0000 7ff2c8e17740 1 -- 172.21.15.7:0/2665810809 wait complete. 2024-09-21T06:39:24.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.197+0000 7ff2c8e17740 1 -- start start 2024-09-21T06:39:24.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.197+0000 7ff2c8e17740 1 Processor -- start 2024-09-21T06:39:24.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.197+0000 7ff2c8e17740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56060f3b81b0 0x56060f793cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:24.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.197+0000 7ff2c8e17740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56060f3c0390 0x56060f794230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:24.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.197+0000 7ff2c8e17740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56060f3e1070 0x56060f79ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:24.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.197+0000 7ff2c8e17740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56060f54f700 con 0x56060f3b81b0 2024-09-21T06:39:24.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.197+0000 7ff2c8e17740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56060f689160 con 0x56060f3c0390 2024-09-21T06:39:24.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.197+0000 7ff2c8e17740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x56060f796ca0 con 0x56060f3e1070 2024-09-21T06:39:24.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.197+0000 7ff2c8e17740 10 client.0 _ll_register_callbacks cb 0x56060f6a29e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:39:24.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.198+0000 7ff2c0e40640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56060f3b81b0 0x56060f793cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:24.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.198+0000 7ff2c0e40640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56060f3b81b0 0x56060f793cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46008/0 (socket says 172.21.15.7:46008) 2024-09-21T06:39:24.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.198+0000 7ff2c0e40640 1 -- 172.21.15.7:0/4200928837 learned_addr learned my addr 172.21.15.7:0/4200928837 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:39:24.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.198+0000 7ff2bb7fe640 1 --2- 172.21.15.7:0/4200928837 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56060f3c0390 0x56060f794230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:24.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.198+0000 7ff2c0e40640 1 --2- 172.21.15.7:0/4200928837 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56060f3e1070 0x56060f79ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:24.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.198+0000 7ff2c0e40640 1 -- 172.21.15.7:0/4200928837 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56060f3e1070 msgr2=0x56060f79ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:24.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.198+0000 7ff2c0e40640 1 --2- 172.21.15.7:0/4200928837 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56060f3e1070 0x56060f79ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:24.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.198+0000 7ff2c0e40640 1 -- 172.21.15.7:0/4200928837 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56060f3c0390 msgr2=0x56060f794230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:24.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.198+0000 7ff2c0e40640 1 --2- 172.21.15.7:0/4200928837 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56060f3c0390 0x56060f794230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:24.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.198+0000 7ff2c0e40640 1 -- 172.21.15.7:0/4200928837 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56060f6b6c90 con 0x56060f3b81b0 2024-09-21T06:39:24.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.198+0000 7ff2bb7fe640 1 --2- 172.21.15.7:0/4200928837 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56060f3c0390 0x56060f794230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:39:24.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.198+0000 7ff2c0e40640 1 --2- 172.21.15.7:0/4200928837 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56060f3b81b0 0x56060f793cf0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7ff2b402b0b0 tx=0x7ff2b402b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c811736d431f8237 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:24.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.198+0000 7ff29b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:39:24.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.198+0000 7ff29b7fe640 1 -- 172.21.15.7:0/4200928837 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b4004190 con 0x56060f3b81b0 2024-09-21T06:39:24.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.198+0000 7ff29b7fe640 1 -- 172.21.15.7:0/4200928837 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7ff2b4004330 con 0x56060f3b81b0 2024-09-21T06:39:24.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.198+0000 7ff2c8e17740 1 -- 172.21.15.7:0/4200928837 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff2b4036040 con 0x56060f3b81b0 2024-09-21T06:39:24.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.198+0000 7ff29b7fe640 1 -- 172.21.15.7:0/4200928837 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff2b4004530 con 0x56060f3b81b0 2024-09-21T06:39:24.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.199+0000 7ff2c8e17740 10 client.16152 fetch_fsmap learned FSMap version 25 2024-09-21T06:39:24.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.199+0000 7ff2c8e17740 1 -- 172.21.15.7:0/4200928837 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56060f7a2980 con 0x56060f3b81b0 2024-09-21T06:39:24.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.199+0000 7ff29b7fe640 1 -- 172.21.15.7:0/4200928837 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff2b4036040 con 0x56060f3b81b0 2024-09-21T06:39:24.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.199+0000 7ff29b7fe640 1 -- 172.21.15.7:0/4200928837 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff2b4050070 con 0x56060f3b81b0 2024-09-21T06:39:24.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.199+0000 7ff2c8e17740 10 client.16152 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:39:24.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.199+0000 7ff2c8e17740 10 client.16152 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-21T06:39:24.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.199+0000 7ff2c8e17740 20 client.16152 populate_metadata read hostname 'smithi007' 2024-09-21T06:39:24.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.199+0000 7ff2c8e17740 1 --2- 172.21.15.7:0/4200928837 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x56060f39f9f0 0x56060f7a5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:24.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.199+0000 7ff2c8e17740 4 client.16152 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:39:24.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.199+0000 7ff2c8e17740 1 -- 172.21.15.7:0/4200928837 --> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56060f700df0 con 0x56060f39f9f0 2024-09-21T06:39:24.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.199+0000 7ff2bb7fe640 1 --2- 172.21.15.7:0/4200928837 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x56060f39f9f0 0x56060f7a5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:24.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.200+0000 7ff2bb7fe640 1 --2- 172.21.15.7:0/4200928837 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x56060f39f9f0 0x56060f7a5ce0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e56f88cde5427161 server_cookie=b999756cad758414 in_seq=0 out_seq=0 2024-09-21T06:39:24.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.200+0000 7ff29b7fe640 10 client.16152 ms_handle_connect on v2:172.21.15.18:6836/1539670694 2024-09-21T06:39:24.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.201+0000 7ff29b7fe640 1 -- 172.21.15.7:0/4200928837 <== mds.2 v2:172.21.15.18:6836/1539670694 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56060f700df0 con 0x56060f39f9f0 2024-09-21T06:39:24.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.201+0000 7ff29b7fe640 10 client.16152 handle_command_reply: tid=0 2024-09-21T06:39:24.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.201+0000 7ff2c8e17740 1 client.16152 shutdown 2024-09-21T06:39:24.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.201+0000 7ff2c8e17740 1 -- 172.21.15.7:0/4200928837 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56060f3b81b0 msgr2=0x56060f793cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:24.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.201+0000 7ff2c8e17740 1 --2- 172.21.15.7:0/4200928837 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56060f3b81b0 0x56060f793cf0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7ff2b402b0b0 tx=0x7ff2b402b040 comp rx=0 tx=0).stop 2024-09-21T06:39:24.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.201+0000 7ff2c8e17740 1 -- 172.21.15.7:0/4200928837 shutdown_connections 2024-09-21T06:39:24.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.201+0000 7ff2c8e17740 1 --2- 172.21.15.7:0/4200928837 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x56060f39f9f0 0x56060f7a5ce0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:24.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.201+0000 7ff2c8e17740 1 --2- 172.21.15.7:0/4200928837 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56060f3e1070 0x56060f79ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:24.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.201+0000 7ff2c8e17740 1 --2- 172.21.15.7:0/4200928837 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56060f3c0390 0x56060f794230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:24.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.201+0000 7ff29b7fe640 0 client.16152 ms_handle_reset on v2:172.21.15.18:6836/1539670694 2024-09-21T06:39:24.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.201+0000 7ff2c8e17740 1 --2- 172.21.15.7:0/4200928837 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56060f3b81b0 0x56060f793cf0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:24.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.201+0000 7ff2c8e17740 1 -- 172.21.15.7:0/4200928837 >> 172.21.15.7:0/4200928837 conn(0x56060f3d5460 msgr2=0x56060f78b830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:24.208 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.201+0000 7ff2c8e17740 1 -- 172.21.15.7:0/4200928837 shutdown_connections 2024-09-21T06:39:24.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.201+0000 7ff2c8e17740 1 -- 172.21.15.7:0/4200928837 wait complete. 2024-09-21T06:39:24.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.201+0000 7ff2c8e17740 20 client.16152 trim_cache size 0 max 16384 2024-09-21T06:39:24.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.215+0000 7ff2c8e17740 1 Processor -- start 2024-09-21T06:39:24.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.215+0000 7ff2c8e17740 1 -- start start 2024-09-21T06:39:24.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.215+0000 7ff2c8e17740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56060f39f9f0 0x56060f7941b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:24.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.215+0000 7ff2c8e17740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56060f3b81b0 0x56060f78b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:24.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.215+0000 7ff2c8e17740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56060f3c0390 0x56060f78bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:24.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.215+0000 7ff2c8e17740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff2bc1b3fb0 con 0x56060f3c0390 2024-09-21T06:39:24.219 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.215+0000 7ff2c8e17740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff2bc1b1880 con 0x56060f3b81b0 2024-09-21T06:39:24.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.215+0000 7ff2c8e17740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff2bc1af6b0 con 0x56060f39f9f0 2024-09-21T06:39:24.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.215+0000 7ff2c0e40640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56060f3c0390 0x56060f78bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:24.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.215+0000 7ff2c0e40640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56060f3c0390 0x56060f78bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46020/0 (socket says 172.21.15.7:46020) 2024-09-21T06:39:24.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.215+0000 7ff2c0e40640 1 -- 172.21.15.7:0/2384896498 learned_addr learned my addr 172.21.15.7:0/2384896498 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:39:24.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.215+0000 7ff2bb7fe640 1 --2- 172.21.15.7:0/2384896498 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56060f3b81b0 0x56060f78b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:24.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.215+0000 7ff2c0e40640 1 --2- 172.21.15.7:0/2384896498 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56060f39f9f0 0x56060f7941b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:24.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.215+0000 7ff2c0e40640 1 -- 172.21.15.7:0/2384896498 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56060f39f9f0 msgr2=0x56060f7941b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:24.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.215+0000 7ff2c0e40640 1 --2- 172.21.15.7:0/2384896498 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56060f39f9f0 0x56060f7941b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:24.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.215+0000 7ff2c0e40640 1 -- 172.21.15.7:0/2384896498 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56060f3b81b0 msgr2=0x56060f78b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:24.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.215+0000 7ff2c0e40640 1 --2- 172.21.15.7:0/2384896498 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56060f3b81b0 0x56060f78b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:24.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.215+0000 7ff2c0e40640 1 -- 172.21.15.7:0/2384896498 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56060f7947d0 con 0x56060f3c0390 2024-09-21T06:39:24.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.216+0000 7ff2c0e40640 1 --2- 172.21.15.7:0/2384896498 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56060f3c0390 0x56060f78bce0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7ff2b405d040 tx=0x7ff2b4000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=826bcd14dd1d16bf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:24.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.216+0000 7ff2a1ffb640 1 -- 172.21.15.7:0/2384896498 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b4032eb0 con 0x56060f3c0390 2024-09-21T06:39:24.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.216+0000 7ff2a1ffb640 1 -- 172.21.15.7:0/2384896498 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff2b4036020 con 0x56060f3c0390 2024-09-21T06:39:24.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.216+0000 7ff2a1ffb640 1 -- 172.21.15.7:0/2384896498 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b4004120 con 0x56060f3c0390 2024-09-21T06:39:24.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.217+0000 7ff2c8e17740 1 -- 172.21.15.7:0/2384896498 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56060f3c0390 msgr2=0x56060f78bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:24.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.217+0000 7ff2c8e17740 1 --2- 172.21.15.7:0/2384896498 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56060f3c0390 0x56060f78bce0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7ff2b405d040 tx=0x7ff2b4000f40 comp rx=0 tx=0).stop 2024-09-21T06:39:24.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.217+0000 7ff2c8e17740 1 -- 172.21.15.7:0/2384896498 shutdown_connections 2024-09-21T06:39:24.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.217+0000 7ff2c8e17740 1 --2- 172.21.15.7:0/2384896498 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56060f3c0390 0x56060f78bce0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:24.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.217+0000 7ff2c8e17740 1 --2- 172.21.15.7:0/2384896498 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56060f3b81b0 0x56060f78b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:24.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.217+0000 7ff2c8e17740 1 --2- 172.21.15.7:0/2384896498 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56060f39f9f0 0x56060f7941b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:24.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.217+0000 7ff2c8e17740 1 -- 172.21.15.7:0/2384896498 >> 172.21.15.7:0/2384896498 conn(0x56060f3d5460 msgr2=0x56060f793aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:24.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.217+0000 7ff2c8e17740 1 -- 172.21.15.7:0/2384896498 shutdown_connections 2024-09-21T06:39:24.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.217+0000 7ff2c8e17740 1 -- 172.21.15.7:0/2384896498 wait complete. 2024-09-21T06:39:24.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.217+0000 7ff2c8e17740 1 -- start start 2024-09-21T06:39:24.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.217+0000 7ff2c8e17740 1 Processor -- start 2024-09-21T06:39:24.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.218+0000 7ff2c8e17740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56060f39f9f0 0x56060f7a95f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:24.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.218+0000 7ff2c8e17740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56060f3b81b0 0x56060f7a6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:24.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.218+0000 7ff2c8e17740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56060f3c0390 0x56060f7a70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:24.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.218+0000 7ff2c8e17740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff2bc1afd40 con 0x56060f39f9f0 2024-09-21T06:39:24.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.218+0000 7ff2c8e17740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff2bc1b11b0 con 0x56060f3b81b0 2024-09-21T06:39:24.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.218+0000 7ff2c8e17740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff2bc1b0410 con 0x56060f3c0390 2024-09-21T06:39:24.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.218+0000 7ff2c8e17740 10 client.0 _ll_register_callbacks cb 0x7ff2b0004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:39:24.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.218+0000 7ff2c0e40640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56060f39f9f0 0x56060f7a95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:24.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.218+0000 7ff2c0e40640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56060f39f9f0 0x56060f7a95f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46026/0 (socket says 172.21.15.7:46026) 2024-09-21T06:39:24.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.218+0000 7ff2c0e40640 1 -- 172.21.15.7:0/942780948 learned_addr learned my addr 172.21.15.7:0/942780948 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:39:24.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.218+0000 7ff2bb7fe640 1 --2- 172.21.15.7:0/942780948 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56060f3b81b0 0x56060f7a6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:24.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.218+0000 7ff2c0e40640 1 --2- 172.21.15.7:0/942780948 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56060f3c0390 0x56060f7a70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:24.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.218+0000 7ff2c0e40640 1 -- 172.21.15.7:0/942780948 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56060f3c0390 msgr2=0x56060f7a70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:24.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.218+0000 7ff2c0e40640 1 --2- 172.21.15.7:0/942780948 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56060f3c0390 0x56060f7a70f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:24.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.218+0000 7ff2c0e40640 1 -- 172.21.15.7:0/942780948 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56060f3b81b0 msgr2=0x56060f7a6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:24.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.218+0000 7ff2c0e40640 1 --2- 172.21.15.7:0/942780948 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56060f3b81b0 0x56060f7a6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:24.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.218+0000 7ff2c0e40640 1 -- 172.21.15.7:0/942780948 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56060f7a7880 con 0x56060f39f9f0 2024-09-21T06:39:24.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.218+0000 7ff2c0e40640 1 --2- 172.21.15.7:0/942780948 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56060f39f9f0 0x56060f7a95f0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7ff2b4002230 tx=0x7ff2b40317e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d02d22a145c80d36 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:24.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.218+0000 7ff29b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:39:24.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.219+0000 7ff29b7fe640 1 -- 172.21.15.7:0/942780948 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2b40040e0 con 0x56060f39f9f0 2024-09-21T06:39:24.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.219+0000 7ff29b7fe640 1 -- 172.21.15.7:0/942780948 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7ff2b4004280 con 0x56060f39f9f0 2024-09-21T06:39:24.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.219+0000 7ff2c8e17740 1 -- 172.21.15.7:0/942780948 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff2b4036020 con 0x56060f39f9f0 2024-09-21T06:39:24.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.219+0000 7ff29b7fe640 1 -- 172.21.15.7:0/942780948 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff2b4030b40 con 0x56060f39f9f0 2024-09-21T06:39:24.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.219+0000 7ff2c8e17740 10 client.16158 fetch_fsmap learned FSMap version 25 2024-09-21T06:39:24.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.219+0000 7ff2c8e17740 1 -- 172.21.15.7:0/942780948 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56060f8104a0 con 0x56060f39f9f0 2024-09-21T06:39:24.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.219+0000 7ff29b7fe640 1 -- 172.21.15.7:0/942780948 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff2b4036020 con 0x56060f39f9f0 2024-09-21T06:39:24.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.219+0000 7ff29b7fe640 1 -- 172.21.15.7:0/942780948 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff2b4050070 con 0x56060f39f9f0 2024-09-21T06:39:24.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.219+0000 7ff2c8e17740 10 client.16158 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:39:24.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.219+0000 7ff2c8e17740 10 client.16158 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-21T06:39:24.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.219+0000 7ff2c8e17740 20 client.16158 populate_metadata read hostname 'smithi007' 2024-09-21T06:39:24.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.219+0000 7ff2c8e17740 1 --2- 172.21.15.7:0/942780948 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x56060f3e1070 0x56060f812a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:24.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.219+0000 7ff2c8e17740 4 client.16158 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:39:24.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.219+0000 7ff2c8e17740 1 -- 172.21.15.7:0/942780948 --> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56060f6fc8a0 con 0x56060f3e1070 2024-09-21T06:39:24.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.220+0000 7ff2bb7fe640 1 --2- 172.21.15.7:0/942780948 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x56060f3e1070 0x56060f812a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:24.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.220+0000 7ff29b7fe640 10 client.16158 ms_handle_connect on v2:172.21.15.18:6836/1539670694 2024-09-21T06:39:24.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.220+0000 7ff2bb7fe640 1 --2- 172.21.15.7:0/942780948 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x56060f3e1070 0x56060f812a10 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7095b856a89d483b server_cookie=4e00e4e30163a93a in_seq=0 out_seq=0 2024-09-21T06:39:24.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.220+0000 7ff29b7fe640 1 -- 172.21.15.7:0/942780948 <== mds.2 v2:172.21.15.18:6836/1539670694 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56060f6fc8a0 con 0x56060f3e1070 2024-09-21T06:39:24.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.220+0000 7ff29b7fe640 10 client.16158 handle_command_reply: tid=0 2024-09-21T06:39:24.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.220+0000 7ff2c8e17740 1 client.16158 shutdown 2024-09-21T06:39:24.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.220+0000 7ff2c8e17740 1 -- 172.21.15.7:0/942780948 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56060f39f9f0 msgr2=0x56060f7a95f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:24.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.220+0000 7ff2c8e17740 1 --2- 172.21.15.7:0/942780948 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56060f39f9f0 0x56060f7a95f0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7ff2b4002230 tx=0x7ff2b40317e0 comp rx=0 tx=0).stop 2024-09-21T06:39:24.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.221+0000 7ff2c8e17740 1 -- 172.21.15.7:0/942780948 shutdown_connections 2024-09-21T06:39:24.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.221+0000 7ff2c8e17740 1 --2- 172.21.15.7:0/942780948 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x56060f3e1070 0x56060f812a10 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:24.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.221+0000 7ff2c8e17740 1 --2- 172.21.15.7:0/942780948 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56060f3c0390 0x56060f7a70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:24.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.221+0000 7ff2c8e17740 1 --2- 172.21.15.7:0/942780948 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56060f3b81b0 0x56060f7a6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:24.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.221+0000 7ff2c8e17740 1 --2- 172.21.15.7:0/942780948 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56060f39f9f0 0x56060f7a95f0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:24.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.221+0000 7ff2c8e17740 1 -- 172.21.15.7:0/942780948 >> 172.21.15.7:0/942780948 conn(0x56060f3d5460 msgr2=0x56060f795130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:24.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.221+0000 7ff29b7fe640 0 client.16158 ms_handle_reset on v2:172.21.15.18:6836/1539670694 2024-09-21T06:39:24.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.221+0000 7ff2c8e17740 1 -- 172.21.15.7:0/942780948 shutdown_connections 2024-09-21T06:39:24.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.221+0000 7ff2c8e17740 1 -- 172.21.15.7:0/942780948 wait complete. 2024-09-21T06:39:24.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.221+0000 7ff2c8e17740 20 client.16158 trim_cache size 0 max 16384 2024-09-21T06:39:24.230 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:39:24.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.221+0000 7ff2c28a3640 1 -- 172.21.15.7:0/406802626 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7ff2a40b6680 msgr2=0x7ff2a40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:24.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.221+0000 7ff2c28a3640 1 --2- 172.21.15.7:0/406802626 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7ff2a40b6680 0x7ff2a40b8b90 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x56060f787320 tx=0x7ff2ac0a9040 comp rx=0 tx=0).stop 2024-09-21T06:39:24.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.221+0000 7ff2c28a3640 1 -- 172.21.15.7:0/406802626 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2bc103b60 msgr2=0x7ff2bc19c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:24.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.221+0000 7ff2c28a3640 1 --2- 172.21.15.7:0/406802626 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2bc103b60 0x7ff2bc19c680 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac00e9f0 tx=0x7ff2ac00eeb0 comp rx=0 tx=0).stop 2024-09-21T06:39:24.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.221+0000 7ff2c28a3640 1 -- 172.21.15.7:0/406802626 shutdown_connections 2024-09-21T06:39:24.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.221+0000 7ff2c28a3640 1 --2- 172.21.15.7:0/406802626 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7ff2a40b6680 0x7ff2a40b8b90 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:24.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.221+0000 7ff2c28a3640 1 --2- 172.21.15.7:0/406802626 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2bc109df0 0x7ff2bc1a1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:24.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.221+0000 7ff2c28a3640 1 --2- 172.21.15.7:0/406802626 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff2bc1094a0 0x7ff2bc19cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:24.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.221+0000 7ff2c28a3640 1 --2- 172.21.15.7:0/406802626 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff2bc103b60 0x7ff2bc19c680 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:24.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.221+0000 7ff2c28a3640 1 -- 172.21.15.7:0/406802626 >> 172.21.15.7:0/406802626 conn(0x7ff2bc07b850 msgr2=0x7ff2bc1072b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:24.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.222+0000 7ff2c28a3640 1 -- 172.21.15.7:0/406802626 shutdown_connections 2024-09-21T06:39:24.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:24.222+0000 7ff2c28a3640 1 -- 172.21.15.7:0/406802626 wait complete. 2024-09-21T06:39:25.051 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:39:25.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:39:24 smithi144 ceph-mon[34653]: pgmap v415: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:39:25.311 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:39:25.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:39:24 smithi007 ceph-mon[30983]: pgmap v415: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:39:25.368 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:39:24 smithi018 ceph-mon[34477]: pgmap v415: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:39:25.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.781+0000 7feac824c640 1 -- 172.21.15.7:0/1958180903 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feac01052a0 msgr2=0x7feac010d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:25.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.781+0000 7feac824c640 1 --2- 172.21.15.7:0/1958180903 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feac01052a0 0x7feac010d930 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7feab0009900 tx=0x7feab002a410 comp rx=0 tx=0).stop 2024-09-21T06:39:25.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.781+0000 7feac824c640 1 -- 172.21.15.7:0/1958180903 shutdown_connections 2024-09-21T06:39:25.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.781+0000 7feac824c640 1 --2- 172.21.15.7:0/1958180903 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feac010de70 0x7feac0110340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:25.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.781+0000 7feac824c640 1 --2- 172.21.15.7:0/1958180903 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feac01052a0 0x7feac010d930 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:25.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.781+0000 7feac824c640 1 --2- 172.21.15.7:0/1958180903 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feac01048c0 0x7feac0104cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:25.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.781+0000 7feac824c640 1 -- 172.21.15.7:0/1958180903 >> 172.21.15.7:0/1958180903 conn(0x7feac0079760 msgr2=0x7feac0079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:25.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.782+0000 7feac824c640 1 -- 172.21.15.7:0/1958180903 shutdown_connections 2024-09-21T06:39:25.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.782+0000 7feac824c640 1 -- 172.21.15.7:0/1958180903 wait complete. 2024-09-21T06:39:25.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.782+0000 7feac824c640 1 Processor -- start 2024-09-21T06:39:25.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.782+0000 7feac824c640 1 -- start start 2024-09-21T06:39:25.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.783+0000 7feac824c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feac01048c0 0x7feac019a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:25.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.783+0000 7feac824c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feac01052a0 0x7feac019aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:25.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.783+0000 7feac824c640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feac010de70 0x7feac019fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:25.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.783+0000 7feac824c640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7feac0113ab0 con 0x7feac01048c0 2024-09-21T06:39:25.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.783+0000 7feac824c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7feac0113930 con 0x7feac01052a0 2024-09-21T06:39:25.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.783+0000 7feac824c640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7feac0113c30 con 0x7feac010de70 2024-09-21T06:39:25.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.783+0000 7feac5fe8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feac01048c0 0x7feac019a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:25.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.783+0000 7feac5fe8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feac01048c0 0x7feac019a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46046/0 (socket says 172.21.15.7:46046) 2024-09-21T06:39:25.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.783+0000 7feac5fe8640 1 -- 172.21.15.7:0/1275270666 learned_addr learned my addr 172.21.15.7:0/1275270666 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:39:25.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.783+0000 7feac67e9640 1 --2- 172.21.15.7:0/1275270666 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feac010de70 0x7feac019fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:25.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.783+0000 7feac57e7640 1 --2- 172.21.15.7:0/1275270666 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feac01052a0 0x7feac019aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:25.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.783+0000 7feac5fe8640 1 -- 172.21.15.7:0/1275270666 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feac010de70 msgr2=0x7feac019fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:25.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.783+0000 7feac5fe8640 1 --2- 172.21.15.7:0/1275270666 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feac010de70 0x7feac019fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:25.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.783+0000 7feac5fe8640 1 -- 172.21.15.7:0/1275270666 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feac01052a0 msgr2=0x7feac019aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:25.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.783+0000 7feac5fe8640 1 --2- 172.21.15.7:0/1275270666 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feac01052a0 0x7feac019aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:25.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.783+0000 7feac5fe8640 1 -- 172.21.15.7:0/1275270666 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feac01a0410 con 0x7feac01048c0 2024-09-21T06:39:25.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.783+0000 7feac57e7640 1 --2- 172.21.15.7:0/1275270666 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feac01052a0 0x7feac019aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:39:25.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.783+0000 7feac67e9640 1 --2- 172.21.15.7:0/1275270666 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feac010de70 0x7feac019fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:39:25.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.783+0000 7feac5fe8640 1 --2- 172.21.15.7:0/1275270666 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feac01048c0 0x7feac019a4a0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7feabc00ea80 tx=0x7feabc00ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:25.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.783+0000 7feab6ffd640 1 -- 172.21.15.7:0/1275270666 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feabc00ce40 con 0x7feac01048c0 2024-09-21T06:39:25.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.784+0000 7feab6ffd640 1 -- 172.21.15.7:0/1275270666 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feabc011920 con 0x7feac01048c0 2024-09-21T06:39:25.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.784+0000 7feac824c640 1 -- 172.21.15.7:0/1275270666 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feac01a0700 con 0x7feac01048c0 2024-09-21T06:39:25.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.784+0000 7feab6ffd640 1 -- 172.21.15.7:0/1275270666 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feabc01aaa0 con 0x7feac01048c0 2024-09-21T06:39:25.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.784+0000 7feac824c640 1 -- 172.21.15.7:0/1275270666 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feac01026b0 con 0x7feac01048c0 2024-09-21T06:39:25.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.787+0000 7feace7c0740 1 Processor -- start 2024-09-21T06:39:25.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.787+0000 7feace7c0740 1 -- start start 2024-09-21T06:39:25.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.787+0000 7feace7c0740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a91db3070 0x557a9215a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:25.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.787+0000 7feace7c0740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a91d8a1b0 0x557a9215abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:25.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.787+0000 7feace7c0740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a91d92390 0x557a9215b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:25.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.787+0000 7feace7c0740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x557a920d0ea0 con 0x557a91db3070 2024-09-21T06:39:25.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.787+0000 7feace7c0740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x557a920c02d0 con 0x557a91d8a1b0 2024-09-21T06:39:25.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.787+0000 7feace7c0740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x557a920c40e0 con 0x557a91d92390 2024-09-21T06:39:25.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.787+0000 7feab6ffd640 1 -- 172.21.15.7:0/1275270666 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7feabc01ac40 con 0x7feac01048c0 2024-09-21T06:39:25.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.787+0000 7feac67e9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a91db3070 0x557a9215a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:25.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.787+0000 7feac67e9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a91db3070 0x557a9215a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46048/0 (socket says 172.21.15.7:46048) 2024-09-21T06:39:25.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.788+0000 7feac67e9640 1 -- 172.21.15.7:0/1473237540 learned_addr learned my addr 172.21.15.7:0/1473237540 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:39:25.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.788+0000 7feac57e7640 1 --2- 172.21.15.7:0/1473237540 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a91d92390 0x557a9215b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:25.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.788+0000 7feac5fe8640 1 --2- 172.21.15.7:0/1473237540 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a91d8a1b0 0x557a9215abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:25.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.788+0000 7feac67e9640 1 -- 172.21.15.7:0/1473237540 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a91d92390 msgr2=0x557a9215b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:25.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.788+0000 7feac67e9640 1 --2- 172.21.15.7:0/1473237540 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a91d92390 0x557a9215b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:25.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.788+0000 7feac67e9640 1 -- 172.21.15.7:0/1473237540 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a91d8a1b0 msgr2=0x557a9215abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:25.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.788+0000 7feac67e9640 1 --2- 172.21.15.7:0/1473237540 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a91d8a1b0 0x557a9215abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:25.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.788+0000 7feac67e9640 1 -- 172.21.15.7:0/1473237540 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a91e1e650 con 0x557a91db3070 2024-09-21T06:39:25.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.788+0000 7feac5fe8640 1 --2- 172.21.15.7:0/1473237540 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a91d8a1b0 0x557a9215abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:39:25.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.788+0000 7feac67e9640 1 --2- 172.21.15.7:0/1473237540 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a91db3070 0x557a9215a6a0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7feab8009cc0 tx=0x7feab80117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fdf313facb8c151 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:25.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.789+0000 7feaabfff640 1 -- 172.21.15.7:0/1473237540 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feab8012450 con 0x557a91db3070 2024-09-21T06:39:25.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.789+0000 7feab6ffd640 1 --2- 172.21.15.7:0/1275270666 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7feaac0baa90 0x7feaac0bcfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:25.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.789+0000 7feaabfff640 1 -- 172.21.15.7:0/1473237540 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feab8012aa0 con 0x557a91db3070 2024-09-21T06:39:25.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.789+0000 7feaabfff640 1 -- 172.21.15.7:0/1473237540 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feab800fbb0 con 0x557a91db3070 2024-09-21T06:39:25.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.789+0000 7feac5fe8640 1 --2- 172.21.15.7:0/1275270666 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7feaac0baa90 0x7feaac0bcfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:25.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.789+0000 7feab6ffd640 1 -- 172.21.15.7:0/1275270666 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7feabc0e7d10 con 0x7feac01048c0 2024-09-21T06:39:25.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.790+0000 7feac5fe8640 1 --2- 172.21.15.7:0/1275270666 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7feaac0baa90 0x7feaac0bcfa0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x557a92159320 tx=0x7feabc01a500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:25.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.790+0000 7feace7c0740 1 -- 172.21.15.7:0/1473237540 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a91db3070 msgr2=0x557a9215a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:25.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.790+0000 7feace7c0740 1 --2- 172.21.15.7:0/1473237540 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a91db3070 0x557a9215a6a0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7feab8009cc0 tx=0x7feab80117b0 comp rx=0 tx=0).stop 2024-09-21T06:39:25.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.790+0000 7feace7c0740 1 -- 172.21.15.7:0/1473237540 shutdown_connections 2024-09-21T06:39:25.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.790+0000 7feace7c0740 1 --2- 172.21.15.7:0/1473237540 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a91d92390 0x557a9215b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:25.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.790+0000 7feace7c0740 1 --2- 172.21.15.7:0/1473237540 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a91d8a1b0 0x557a9215abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:25.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.790+0000 7feace7c0740 1 --2- 172.21.15.7:0/1473237540 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a91db3070 0x557a9215a6a0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:25.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.790+0000 7feace7c0740 1 -- 172.21.15.7:0/1473237540 >> 172.21.15.7:0/1473237540 conn(0x557a91da7460 msgr2=0x557a92158590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:25.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.790+0000 7feace7c0740 1 -- 172.21.15.7:0/1473237540 shutdown_connections 2024-09-21T06:39:25.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.790+0000 7feace7c0740 1 -- 172.21.15.7:0/1473237540 wait complete. 2024-09-21T06:39:25.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.790+0000 7feace7c0740 1 -- start start 2024-09-21T06:39:25.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.790+0000 7feace7c0740 1 Processor -- start 2024-09-21T06:39:25.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.791+0000 7feace7c0740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a91d8a1b0 0x557a92165e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:25.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.791+0000 7feace7c0740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a91d92390 0x557a921663a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:25.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.791+0000 7feace7c0740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a91db3070 0x557a921721a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:25.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.791+0000 7feace7c0740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x557a91f21700 con 0x557a91d92390 2024-09-21T06:39:25.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.791+0000 7feace7c0740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x557a9205b160 con 0x557a91d8a1b0 2024-09-21T06:39:25.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.791+0000 7feace7c0740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x557a92168e80 con 0x557a91db3070 2024-09-21T06:39:25.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.791+0000 7feac57e7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a91d92390 0x557a921663a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:25.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.791+0000 7feace7c0740 10 client.0 _ll_register_callbacks cb 0x557a920749e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:39:25.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.791+0000 7feac57e7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a91d92390 0x557a921663a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46064/0 (socket says 172.21.15.7:46064) 2024-09-21T06:39:25.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.791+0000 7feac57e7640 1 -- 172.21.15.7:0/1701410275 learned_addr learned my addr 172.21.15.7:0/1701410275 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:39:25.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.791+0000 7feac67e9640 1 --2- 172.21.15.7:0/1701410275 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a91d8a1b0 0x557a92165e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:25.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.791+0000 7feac67e9640 1 --2- 172.21.15.7:0/1701410275 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a91db3070 0x557a921721a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:25.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.791+0000 7feac57e7640 1 -- 172.21.15.7:0/1701410275 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a91db3070 msgr2=0x557a921721a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:25.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.791+0000 7feac57e7640 1 --2- 172.21.15.7:0/1701410275 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a91db3070 0x557a921721a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:25.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.791+0000 7feac57e7640 1 -- 172.21.15.7:0/1701410275 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a91d8a1b0 msgr2=0x557a92165e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:25.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.791+0000 7feac57e7640 1 --2- 172.21.15.7:0/1701410275 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a91d8a1b0 0x557a92165e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:25.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.791+0000 7feac57e7640 1 -- 172.21.15.7:0/1701410275 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a92088c90 con 0x557a91d92390 2024-09-21T06:39:25.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.791+0000 7feac67e9640 1 --2- 172.21.15.7:0/1701410275 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a91db3070 0x557a921721a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:39:25.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.792+0000 7feac57e7640 1 --2- 172.21.15.7:0/1701410275 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a91d92390 0x557a921663a0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7feab0005ab0 tx=0x7feab0032eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb1eb365ecb06e53 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:25.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.792+0000 7feaa97fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:39:25.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.792+0000 7feaa97fa640 1 -- 172.21.15.7:0/1701410275 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feab0040070 con 0x557a91d92390 2024-09-21T06:39:25.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.792+0000 7feaa97fa640 1 -- 172.21.15.7:0/1701410275 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7feab0004040 con 0x557a91d92390 2024-09-21T06:39:25.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.792+0000 7feace7c0740 1 -- 172.21.15.7:0/1701410275 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feab8012aa0 con 0x557a91d92390 2024-09-21T06:39:25.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.792+0000 7feaa97fa640 1 -- 172.21.15.7:0/1701410275 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7feab0049020 con 0x557a91d92390 2024-09-21T06:39:25.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.792+0000 7feace7c0740 10 client.16170 fetch_fsmap learned FSMap version 25 2024-09-21T06:39:25.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.792+0000 7feace7c0740 1 -- 172.21.15.7:0/1701410275 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557a92174c60 con 0x557a91d92390 2024-09-21T06:39:25.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.792+0000 7feaa97fa640 1 -- 172.21.15.7:0/1701410275 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feab8012aa0 con 0x557a91d92390 2024-09-21T06:39:25.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.792+0000 7feaa97fa640 1 -- 172.21.15.7:0/1701410275 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7feab00048f0 con 0x557a91d92390 2024-09-21T06:39:25.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.793+0000 7feace7c0740 10 client.16170 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:39:25.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.793+0000 7feace7c0740 10 client.16170 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:39:25.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.793+0000 7feace7c0740 20 client.16170 populate_metadata read hostname 'smithi007' 2024-09-21T06:39:25.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.793+0000 7feace7c0740 1 --2- 172.21.15.7:0/1701410275 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x557a91d719f0 0x557a92178110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:25.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.793+0000 7feace7c0740 4 client.16170 mds_command: new command op to 24688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:39:25.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.793+0000 7feace7c0740 1 -- 172.21.15.7:0/1701410275 --> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557a920d2df0 con 0x557a91d719f0 2024-09-21T06:39:25.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.793+0000 7feac67e9640 1 --2- 172.21.15.7:0/1701410275 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x557a91d719f0 0x557a92178110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:25.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.793+0000 7feac67e9640 1 --2- 172.21.15.7:0/1701410275 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x557a91d719f0 0x557a92178110 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c8af66da4458a75b server_cookie=88d465e03d896aa5 in_seq=0 out_seq=0 2024-09-21T06:39:25.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.793+0000 7feaa97fa640 10 client.16170 ms_handle_connect on v2:172.21.15.144:6838/4027821922 2024-09-21T06:39:25.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.794+0000 7feaa97fa640 1 -- 172.21.15.7:0/1701410275 <== mds.1 v2:172.21.15.144:6838/4027821922 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557a920d2df0 con 0x557a91d719f0 2024-09-21T06:39:25.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.794+0000 7feaa97fa640 10 client.16170 handle_command_reply: tid=0 2024-09-21T06:39:25.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.794+0000 7feace7c0740 1 client.16170 shutdown 2024-09-21T06:39:25.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.794+0000 7feace7c0740 1 -- 172.21.15.7:0/1701410275 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a91d92390 msgr2=0x557a921663a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:25.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.794+0000 7feace7c0740 1 --2- 172.21.15.7:0/1701410275 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a91d92390 0x557a921663a0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7feab0005ab0 tx=0x7feab0032eb0 comp rx=0 tx=0).stop 2024-09-21T06:39:25.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.795+0000 7feace7c0740 1 -- 172.21.15.7:0/1701410275 shutdown_connections 2024-09-21T06:39:25.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.795+0000 7feace7c0740 1 --2- 172.21.15.7:0/1701410275 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x557a91d719f0 0x557a92178110 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:25.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.795+0000 7feace7c0740 1 --2- 172.21.15.7:0/1701410275 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a91db3070 0x557a921721a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:25.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.795+0000 7feace7c0740 1 --2- 172.21.15.7:0/1701410275 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a91d92390 0x557a921663a0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:25.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.795+0000 7feaa97fa640 0 client.16170 ms_handle_reset on v2:172.21.15.144:6838/4027821922 2024-09-21T06:39:25.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.795+0000 7feace7c0740 1 --2- 172.21.15.7:0/1701410275 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a91d8a1b0 0x557a92165e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:25.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.795+0000 7feace7c0740 1 -- 172.21.15.7:0/1701410275 >> 172.21.15.7:0/1701410275 conn(0x557a91da7460 msgr2=0x557a9215d880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:25.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.795+0000 7feace7c0740 1 -- 172.21.15.7:0/1701410275 shutdown_connections 2024-09-21T06:39:25.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.795+0000 7feace7c0740 1 -- 172.21.15.7:0/1701410275 wait complete. 2024-09-21T06:39:25.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.795+0000 7feace7c0740 20 client.16170 trim_cache size 0 max 16384 2024-09-21T06:39:25.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.808+0000 7feace7c0740 1 Processor -- start 2024-09-21T06:39:25.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.808+0000 7feace7c0740 1 -- start start 2024-09-21T06:39:25.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.808+0000 7feace7c0740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a91d8a1b0 0x557a9215deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:25.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.808+0000 7feace7c0740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a91d92390 0x557a921720a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:25.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.808+0000 7feace7c0740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a91db3070 0x557a92163050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:25.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.808+0000 7feace7c0740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7feac01afc40 con 0x557a91d8a1b0 2024-09-21T06:39:25.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.808+0000 7feace7c0740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7feac01ad510 con 0x557a91d92390 2024-09-21T06:39:25.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.808+0000 7feace7c0740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7feac01ab360 con 0x557a91db3070 2024-09-21T06:39:25.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.808+0000 7feac67e9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a91d8a1b0 0x557a9215deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:25.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.808+0000 7feac67e9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a91d8a1b0 0x557a9215deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46074/0 (socket says 172.21.15.7:46074) 2024-09-21T06:39:25.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.808+0000 7feac67e9640 1 -- 172.21.15.7:0/1545813916 learned_addr learned my addr 172.21.15.7:0/1545813916 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:39:25.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.809+0000 7feac67e9640 1 --2- 172.21.15.7:0/1545813916 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a91db3070 0x557a92163050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:25.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.809+0000 7feac57e7640 1 --2- 172.21.15.7:0/1545813916 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a91d92390 0x557a921720a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:25.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.809+0000 7feac67e9640 1 -- 172.21.15.7:0/1545813916 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a91db3070 msgr2=0x557a92163050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:25.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.809+0000 7feac67e9640 1 --2- 172.21.15.7:0/1545813916 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a91db3070 0x557a92163050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:25.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.809+0000 7feac67e9640 1 -- 172.21.15.7:0/1545813916 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a91d92390 msgr2=0x557a921720a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:25.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.809+0000 7feac67e9640 1 --2- 172.21.15.7:0/1545813916 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a91d92390 0x557a921720a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:25.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.809+0000 7feac67e9640 1 -- 172.21.15.7:0/1545813916 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a9215cc80 con 0x557a91d8a1b0 2024-09-21T06:39:25.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.809+0000 7feac57e7640 1 --2- 172.21.15.7:0/1545813916 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a91d92390 0x557a921720a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:39:25.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.809+0000 7feac67e9640 1 --2- 172.21.15.7:0/1545813916 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a91d8a1b0 0x557a9215deb0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7feab8009c90 tx=0x7feab8005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=805ddad5221e8fc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:25.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.809+0000 7feaab7fe640 1 -- 172.21.15.7:0/1545813916 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feab8005240 con 0x557a91d8a1b0 2024-09-21T06:39:25.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.809+0000 7feaab7fe640 1 -- 172.21.15.7:0/1545813916 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feab8009e30 con 0x557a91d8a1b0 2024-09-21T06:39:25.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.809+0000 7feaab7fe640 1 -- 172.21.15.7:0/1545813916 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feab80048c0 con 0x557a91d8a1b0 2024-09-21T06:39:25.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.810+0000 7feace7c0740 1 -- 172.21.15.7:0/1545813916 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a91d8a1b0 msgr2=0x557a9215deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:25.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.810+0000 7feace7c0740 1 --2- 172.21.15.7:0/1545813916 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a91d8a1b0 0x557a9215deb0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7feab8009c90 tx=0x7feab8005f90 comp rx=0 tx=0).stop 2024-09-21T06:39:25.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.810+0000 7feace7c0740 1 -- 172.21.15.7:0/1545813916 shutdown_connections 2024-09-21T06:39:25.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.810+0000 7feace7c0740 1 --2- 172.21.15.7:0/1545813916 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a91db3070 0x557a92163050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:25.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.810+0000 7feace7c0740 1 --2- 172.21.15.7:0/1545813916 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a91d92390 0x557a921720a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:25.816 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.810+0000 7feace7c0740 1 --2- 172.21.15.7:0/1545813916 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a91d8a1b0 0x557a9215deb0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:25.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.810+0000 7feace7c0740 1 -- 172.21.15.7:0/1545813916 >> 172.21.15.7:0/1545813916 conn(0x557a91da7460 msgr2=0x557a9215d7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:25.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.810+0000 7feace7c0740 1 -- 172.21.15.7:0/1545813916 shutdown_connections 2024-09-21T06:39:25.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.810+0000 7feace7c0740 1 -- 172.21.15.7:0/1545813916 wait complete. 2024-09-21T06:39:25.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.811+0000 7feace7c0740 1 -- start start 2024-09-21T06:39:25.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.811+0000 7feace7c0740 1 Processor -- start 2024-09-21T06:39:25.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.811+0000 7feace7c0740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a91d8a1b0 0x557a9216e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:25.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.811+0000 7feace7c0740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a91d92390 0x557a92169e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:25.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.811+0000 7feace7c0740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a91db3070 0x557a9216a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:25.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.811+0000 7feace7c0740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7feac01ab9d0 con 0x557a91d8a1b0 2024-09-21T06:39:25.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.811+0000 7feace7c0740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7feac01ace40 con 0x557a91d92390 2024-09-21T06:39:25.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.811+0000 7feace7c0740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7feac01ac0a0 con 0x557a91db3070 2024-09-21T06:39:25.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.811+0000 7feace7c0740 10 client.0 _ll_register_callbacks cb 0x7feab0009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:39:25.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.811+0000 7feac67e9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a91d8a1b0 0x557a9216e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:25.817 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.811+0000 7feac67e9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a91d8a1b0 0x557a9216e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46076/0 (socket says 172.21.15.7:46076) 2024-09-21T06:39:25.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.811+0000 7feac67e9640 1 -- 172.21.15.7:0/1162938383 learned_addr learned my addr 172.21.15.7:0/1162938383 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:39:25.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.812+0000 7feac57e7640 1 --2- 172.21.15.7:0/1162938383 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a91d92390 0x557a92169e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:25.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.812+0000 7feac67e9640 1 --2- 172.21.15.7:0/1162938383 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a91db3070 0x557a9216a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:25.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.812+0000 7feac67e9640 1 -- 172.21.15.7:0/1162938383 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a91db3070 msgr2=0x557a9216a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:25.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.812+0000 7feac67e9640 1 --2- 172.21.15.7:0/1162938383 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a91db3070 0x557a9216a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:25.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.812+0000 7feac67e9640 1 -- 172.21.15.7:0/1162938383 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a91d92390 msgr2=0x557a92169e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:25.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.812+0000 7feac67e9640 1 --2- 172.21.15.7:0/1162938383 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a91d92390 0x557a92169e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:25.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.812+0000 7feac67e9640 1 -- 172.21.15.7:0/1162938383 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a9216ac50 con 0x557a91d8a1b0 2024-09-21T06:39:25.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.812+0000 7feac67e9640 1 --2- 172.21.15.7:0/1162938383 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a91d8a1b0 0x557a9216e9e0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7feab800f520 tx=0x7feab8009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0ddbdcb783b7678 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:25.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.812+0000 7feaa97fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:39:25.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.812+0000 7feaa97fa640 1 -- 172.21.15.7:0/1162938383 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feab800fa00 con 0x557a91d8a1b0 2024-09-21T06:39:25.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.812+0000 7feaa97fa640 1 -- 172.21.15.7:0/1162938383 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7feab800fba0 con 0x557a91d8a1b0 2024-09-21T06:39:25.818 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.812+0000 7feace7c0740 1 -- 172.21.15.7:0/1162938383 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feab8009e30 con 0x557a91d8a1b0 2024-09-21T06:39:25.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.812+0000 7feaa97fa640 1 -- 172.21.15.7:0/1162938383 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7feab800fda0 con 0x557a91d8a1b0 2024-09-21T06:39:25.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.812+0000 7feace7c0740 10 client.16176 fetch_fsmap learned FSMap version 25 2024-09-21T06:39:25.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.812+0000 7feace7c0740 1 -- 172.21.15.7:0/1162938383 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557a921e2b10 con 0x557a91d8a1b0 2024-09-21T06:39:25.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.813+0000 7feaa97fa640 1 -- 172.21.15.7:0/1162938383 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feab8009e30 con 0x557a91d8a1b0 2024-09-21T06:39:25.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.813+0000 7feaa97fa640 1 -- 172.21.15.7:0/1162938383 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7feab8026040 con 0x557a91d8a1b0 2024-09-21T06:39:25.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.813+0000 7feace7c0740 10 client.16176 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:39:25.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.813+0000 7feace7c0740 10 client.16176 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:39:25.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.813+0000 7feace7c0740 20 client.16176 populate_metadata read hostname 'smithi007' 2024-09-21T06:39:25.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.813+0000 7feace7c0740 1 --2- 172.21.15.7:0/1162938383 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x557a91d46da0 0x557a921e5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:25.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.813+0000 7feace7c0740 4 client.16176 mds_command: new command op to 24688 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:39:25.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.813+0000 7feace7c0740 1 -- 172.21.15.7:0/1162938383 --> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557a920ce8a0 con 0x557a91d46da0 2024-09-21T06:39:25.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.813+0000 7feac57e7640 1 --2- 172.21.15.7:0/1162938383 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x557a91d46da0 0x557a921e5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:25.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.814+0000 7feac57e7640 1 --2- 172.21.15.7:0/1162938383 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x557a91d46da0 0x557a921e5050 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=29c0e174c520774d server_cookie=bd835cac8067def2 in_seq=0 out_seq=0 2024-09-21T06:39:25.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.814+0000 7feaa97fa640 10 client.16176 ms_handle_connect on v2:172.21.15.144:6838/4027821922 2024-09-21T06:39:25.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.814+0000 7feaa97fa640 1 -- 172.21.15.7:0/1162938383 <== mds.1 v2:172.21.15.144:6838/4027821922 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557a920ce8a0 con 0x557a91d46da0 2024-09-21T06:39:25.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.814+0000 7feaa97fa640 10 client.16176 handle_command_reply: tid=0 2024-09-21T06:39:25.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.814+0000 7feace7c0740 1 client.16176 shutdown 2024-09-21T06:39:25.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.814+0000 7feace7c0740 1 -- 172.21.15.7:0/1162938383 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a91d8a1b0 msgr2=0x557a9216e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:25.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.814+0000 7feace7c0740 1 --2- 172.21.15.7:0/1162938383 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a91d8a1b0 0x557a9216e9e0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7feab800f520 tx=0x7feab8009310 comp rx=0 tx=0).stop 2024-09-21T06:39:25.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.814+0000 7feace7c0740 1 -- 172.21.15.7:0/1162938383 shutdown_connections 2024-09-21T06:39:25.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.814+0000 7feace7c0740 1 --2- 172.21.15.7:0/1162938383 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x557a91d46da0 0x557a921e5050 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:25.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.814+0000 7feace7c0740 1 --2- 172.21.15.7:0/1162938383 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557a91db3070 0x557a9216a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:25.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.814+0000 7feace7c0740 1 --2- 172.21.15.7:0/1162938383 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557a91d92390 0x557a92169e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:25.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.814+0000 7feaa97fa640 0 client.16176 ms_handle_reset on v2:172.21.15.144:6838/4027821922 2024-09-21T06:39:25.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.814+0000 7feace7c0740 1 --2- 172.21.15.7:0/1162938383 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557a91d8a1b0 0x557a9216e9e0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:25.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.814+0000 7feace7c0740 1 -- 172.21.15.7:0/1162938383 >> 172.21.15.7:0/1162938383 conn(0x557a91da7460 msgr2=0x557a9215b6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:25.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.814+0000 7feace7c0740 1 -- 172.21.15.7:0/1162938383 shutdown_connections 2024-09-21T06:39:25.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.814+0000 7feace7c0740 1 -- 172.21.15.7:0/1162938383 wait complete. 2024-09-21T06:39:25.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.814+0000 7feace7c0740 20 client.16176 trim_cache size 0 max 16384 2024-09-21T06:39:25.821 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:39:25.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.815+0000 7feac824c640 1 -- 172.21.15.7:0/1275270666 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7feaac0baa90 msgr2=0x7feaac0bcfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:25.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.815+0000 7feac824c640 1 --2- 172.21.15.7:0/1275270666 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7feaac0baa90 0x7feaac0bcfa0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x557a92159320 tx=0x7feabc01a500 comp rx=0 tx=0).stop 2024-09-21T06:39:25.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.815+0000 7feac824c640 1 -- 172.21.15.7:0/1275270666 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feac01048c0 msgr2=0x7feac019a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:25.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.815+0000 7feac824c640 1 --2- 172.21.15.7:0/1275270666 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feac01048c0 0x7feac019a4a0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7feabc00ea80 tx=0x7feabc00ef40 comp rx=0 tx=0).stop 2024-09-21T06:39:25.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.815+0000 7feac824c640 1 -- 172.21.15.7:0/1275270666 shutdown_connections 2024-09-21T06:39:25.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.815+0000 7feac824c640 1 --2- 172.21.15.7:0/1275270666 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7feaac0baa90 0x7feaac0bcfa0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:25.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.815+0000 7feac824c640 1 --2- 172.21.15.7:0/1275270666 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feac010de70 0x7feac019fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:25.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.815+0000 7feac824c640 1 --2- 172.21.15.7:0/1275270666 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feac01052a0 0x7feac019aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:25.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.815+0000 7feac824c640 1 --2- 172.21.15.7:0/1275270666 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feac01048c0 0x7feac019a4a0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:25.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.815+0000 7feac824c640 1 -- 172.21.15.7:0/1275270666 >> 172.21.15.7:0/1275270666 conn(0x7feac0079760 msgr2=0x7feac0100890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:25.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.815+0000 7feac824c640 1 -- 172.21.15.7:0/1275270666 shutdown_connections 2024-09-21T06:39:25.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:25.815+0000 7feac824c640 1 -- 172.21.15.7:0/1275270666 wait complete. 2024-09-21T06:39:26.688 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:39:26.959 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:39:27.216 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:39:26 smithi007 ceph-mon[30983]: pgmap v416: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-09-21T06:39:27.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:39:26 smithi144 ceph-mon[34653]: pgmap v416: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-09-21T06:39:27.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:39:26 smithi018 ceph-mon[34477]: pgmap v416: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-09-21T06:39:27.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.432+0000 7f59446b8640 1 -- 172.21.15.7:0/3695035007 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f593c102a60 msgr2=0x7f593c102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:27.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.432+0000 7f59446b8640 1 --2- 172.21.15.7:0/3695035007 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f593c102a60 0x7f593c102e70 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f5938009900 tx=0x7f593802a410 comp rx=0 tx=0).stop 2024-09-21T06:39:27.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.432+0000 7f59446b8640 1 -- 172.21.15.7:0/3695035007 shutdown_connections 2024-09-21T06:39:27.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.432+0000 7f59446b8640 1 --2- 172.21.15.7:0/3695035007 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f593c108cf0 0x7f593c10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:27.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.432+0000 7f59446b8640 1 --2- 172.21.15.7:0/3695035007 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f593c1083a0 0x7f593c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:27.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.432+0000 7f59446b8640 1 --2- 172.21.15.7:0/3695035007 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f593c102a60 0x7f593c102e70 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:27.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.432+0000 7f59446b8640 1 -- 172.21.15.7:0/3695035007 >> 172.21.15.7:0/3695035007 conn(0x7f593c079730 msgr2=0x7f593c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:27.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.432+0000 7f59446b8640 1 -- 172.21.15.7:0/3695035007 shutdown_connections 2024-09-21T06:39:27.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.432+0000 7f59446b8640 1 -- 172.21.15.7:0/3695035007 wait complete. 2024-09-21T06:39:27.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.433+0000 7f59446b8640 1 Processor -- start 2024-09-21T06:39:27.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.433+0000 7f59446b8640 1 -- start start 2024-09-21T06:39:27.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.434+0000 7f59446b8640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f593c102a60 0x7f593c19b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:27.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.434+0000 7f59446b8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f593c1083a0 0x7f593c19b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:27.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.434+0000 7f59446b8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f593c108cf0 0x7f593c19bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:27.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.434+0000 7f59446b8640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f593c112960 con 0x7f593c1083a0 2024-09-21T06:39:27.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.434+0000 7f59446b8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f593c1127e0 con 0x7f593c108cf0 2024-09-21T06:39:27.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.434+0000 7f59446b8640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f593c112ae0 con 0x7f593c102a60 2024-09-21T06:39:27.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.434+0000 7f5941c53640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f593c1083a0 0x7f593c19b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:27.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.434+0000 7f5941c53640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f593c1083a0 0x7f593c19b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46094/0 (socket says 172.21.15.7:46094) 2024-09-21T06:39:27.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.434+0000 7f5941c53640 1 -- 172.21.15.7:0/3644117840 learned_addr learned my addr 172.21.15.7:0/3644117840 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:39:27.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.434+0000 7f5942c55640 1 --2- 172.21.15.7:0/3644117840 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f593c108cf0 0x7f593c19bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:27.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.434+0000 7f5942454640 1 --2- 172.21.15.7:0/3644117840 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f593c102a60 0x7f593c19b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:27.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.434+0000 7f5941c53640 1 -- 172.21.15.7:0/3644117840 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f593c102a60 msgr2=0x7f593c19b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:27.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.434+0000 7f5941c53640 1 --2- 172.21.15.7:0/3644117840 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f593c102a60 0x7f593c19b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:27.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.434+0000 7f5941c53640 1 -- 172.21.15.7:0/3644117840 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f593c108cf0 msgr2=0x7f593c19bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:27.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.434+0000 7f5941c53640 1 --2- 172.21.15.7:0/3644117840 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f593c108cf0 0x7f593c19bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:27.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.434+0000 7f5941c53640 1 -- 172.21.15.7:0/3644117840 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f593c1a6560 con 0x7f593c1083a0 2024-09-21T06:39:27.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.434+0000 7f5942454640 1 --2- 172.21.15.7:0/3644117840 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f593c102a60 0x7f593c19b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:39:27.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.435+0000 7f5941c53640 1 --2- 172.21.15.7:0/3644117840 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f593c1083a0 0x7f593c19b790 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f592c00d770 tx=0x7f592c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:27.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.435+0000 7f59337fe640 1 -- 172.21.15.7:0/3644117840 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f592c017070 con 0x7f593c1083a0 2024-09-21T06:39:27.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.435+0000 7f59446b8640 1 -- 172.21.15.7:0/3644117840 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f593c1a6850 con 0x7f593c1083a0 2024-09-21T06:39:27.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.435+0000 7f59337fe640 1 -- 172.21.15.7:0/3644117840 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f592c009c30 con 0x7f593c1083a0 2024-09-21T06:39:27.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.435+0000 7f59446b8640 1 -- 172.21.15.7:0/3644117840 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f593c1a6d90 con 0x7f593c1083a0 2024-09-21T06:39:27.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.435+0000 7f59337fe640 1 -- 172.21.15.7:0/3644117840 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f592c00f620 con 0x7f593c1083a0 2024-09-21T06:39:27.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.438+0000 7f594ac2c740 1 Processor -- start 2024-09-21T06:39:27.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.438+0000 7f594ac2c740 1 -- start start 2024-09-21T06:39:27.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.438+0000 7f594ac2c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555fd3758070 0x555fd3aff6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:27.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.438+0000 7f594ac2c740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555fd372f1b0 0x555fd3affbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:27.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.438+0000 7f594ac2c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fd3737390 0x555fd3b00120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:27.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.438+0000 7f594ac2c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x555fd3a75ea0 con 0x555fd3737390 2024-09-21T06:39:27.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.438+0000 7f594ac2c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x555fd3a652d0 con 0x555fd3758070 2024-09-21T06:39:27.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.438+0000 7f594ac2c740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x555fd3a690e0 con 0x555fd372f1b0 2024-09-21T06:39:27.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.439+0000 7f5942c55640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555fd3758070 0x555fd3aff6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:27.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.439+0000 7f5942c55640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555fd3758070 0x555fd3aff6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.7:46654/0 (socket says 172.21.15.7:46654) 2024-09-21T06:39:27.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.439+0000 7f5942c55640 1 -- 172.21.15.7:0/1748824484 learned_addr learned my addr 172.21.15.7:0/1748824484 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:39:27.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.439+0000 7f5942454640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555fd372f1b0 0x555fd3affbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:27.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.439+0000 7f5942c55640 1 -- 172.21.15.7:0/1748824484 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555fd372f1b0 msgr2=0x555fd3affbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:27.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.439+0000 7f5942c55640 1 --2- 172.21.15.7:0/1748824484 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555fd372f1b0 0x555fd3affbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:27.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.439+0000 7f5942c55640 1 -- 172.21.15.7:0/1748824484 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fd3737390 msgr2=0x555fd3b00120 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T06:39:27.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.439+0000 7f5942c55640 1 --2- 172.21.15.7:0/1748824484 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fd3737390 0x555fd3b00120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:27.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.439+0000 7f5942c55640 1 -- 172.21.15.7:0/1748824484 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555fd37c3650 con 0x555fd3758070 2024-09-21T06:39:27.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.439+0000 7f59337fe640 1 -- 172.21.15.7:0/3644117840 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f592c01a070 con 0x7f593c1083a0 2024-09-21T06:39:27.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.439+0000 7f5942c55640 1 --2- 172.21.15.7:0/1748824484 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555fd3758070 0x555fd3aff6a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5934009fd0 tx=0x7f5934010800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fba092ab677bfc51 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:27.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.439+0000 7f5930ff9640 1 -- 172.21.15.7:0/1748824484 <== mon.2 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5934016070 con 0x555fd3758070 2024-09-21T06:39:27.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.439+0000 7f5930ff9640 1 -- 172.21.15.7:0/1748824484 <== mon.2 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5934012bc0 con 0x555fd3758070 2024-09-21T06:39:27.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.440+0000 7f5930ff9640 1 -- 172.21.15.7:0/1748824484 <== mon.2 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5934011b20 con 0x555fd3758070 2024-09-21T06:39:27.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.440+0000 7f59337fe640 1 --2- 172.21.15.7:0/3644117840 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f59280b6680 0x7f59280b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:27.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.440+0000 7f5942454640 1 --2- 172.21.15.7:0/3644117840 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f59280b6680 0x7f59280b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:27.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.440+0000 7f59337fe640 1 -- 172.21.15.7:0/3644117840 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f592c0e71a0 con 0x7f593c1083a0 2024-09-21T06:39:27.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.440+0000 7f594ac2c740 1 -- 172.21.15.7:0/1748824484 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555fd3758070 msgr2=0x555fd3aff6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:27.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.440+0000 7f594ac2c740 1 --2- 172.21.15.7:0/1748824484 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555fd3758070 0x555fd3aff6a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5934009fd0 tx=0x7f5934010800 comp rx=0 tx=0).stop 2024-09-21T06:39:27.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.441+0000 7f594ac2c740 1 -- 172.21.15.7:0/1748824484 shutdown_connections 2024-09-21T06:39:27.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.441+0000 7f594ac2c740 1 --2- 172.21.15.7:0/1748824484 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fd3737390 0x555fd3b00120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:27.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.441+0000 7f594ac2c740 1 --2- 172.21.15.7:0/1748824484 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555fd372f1b0 0x555fd3affbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:27.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.441+0000 7f594ac2c740 1 --2- 172.21.15.7:0/1748824484 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555fd3758070 0x555fd3aff6a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:27.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.441+0000 7f594ac2c740 1 -- 172.21.15.7:0/1748824484 >> 172.21.15.7:0/1748824484 conn(0x555fd374c460 msgr2=0x555fd3afd590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:27.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.441+0000 7f594ac2c740 1 -- 172.21.15.7:0/1748824484 shutdown_connections 2024-09-21T06:39:27.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.441+0000 7f594ac2c740 1 -- 172.21.15.7:0/1748824484 wait complete. 2024-09-21T06:39:27.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.441+0000 7f5942454640 1 --2- 172.21.15.7:0/3644117840 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f59280b6680 0x7f59280b8b90 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5938000c00 tx=0x7f59380058b0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:27.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.441+0000 7f594ac2c740 1 -- start start 2024-09-21T06:39:27.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.441+0000 7f594ac2c740 1 Processor -- start 2024-09-21T06:39:27.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.442+0000 7f594ac2c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fd372f1b0 0x555fd3b0f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:27.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.442+0000 7f594ac2c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555fd3737390 0x555fd3b0f690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:27.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.442+0000 7f594ac2c740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555fd3758070 0x555fd3b1b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:27.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.442+0000 7f594ac2c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x555fd38c6700 con 0x555fd372f1b0 2024-09-21T06:39:27.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.442+0000 7f594ac2c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x555fd3a00160 con 0x555fd3737390 2024-09-21T06:39:27.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.442+0000 7f594ac2c740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x555fd3b12180 con 0x555fd3758070 2024-09-21T06:39:27.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.442+0000 7f5942454640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fd372f1b0 0x555fd3b0f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:27.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.442+0000 7f5942454640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fd372f1b0 0x555fd3b0f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46098/0 (socket says 172.21.15.7:46098) 2024-09-21T06:39:27.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.442+0000 7f594ac2c740 10 client.0 _ll_register_callbacks cb 0x555fd3a199e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:39:27.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.442+0000 7f5942454640 1 -- 172.21.15.7:0/2494840842 learned_addr learned my addr 172.21.15.7:0/2494840842 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:39:27.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.442+0000 7f5941c53640 1 --2- 172.21.15.7:0/2494840842 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555fd3737390 0x555fd3b0f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:27.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.442+0000 7f5942c55640 1 --2- 172.21.15.7:0/2494840842 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555fd3758070 0x555fd3b1b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:27.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.442+0000 7f5942454640 1 -- 172.21.15.7:0/2494840842 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555fd3758070 msgr2=0x555fd3b1b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:27.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.442+0000 7f5942454640 1 --2- 172.21.15.7:0/2494840842 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555fd3758070 0x555fd3b1b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:27.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.442+0000 7f5942454640 1 -- 172.21.15.7:0/2494840842 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555fd3737390 msgr2=0x555fd3b0f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:27.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.442+0000 7f5942454640 1 --2- 172.21.15.7:0/2494840842 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555fd3737390 0x555fd3b0f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:27.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.442+0000 7f5942454640 1 -- 172.21.15.7:0/2494840842 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555fd3a2dc90 con 0x555fd372f1b0 2024-09-21T06:39:27.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.442+0000 7f5941c53640 1 --2- 172.21.15.7:0/2494840842 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555fd3737390 0x555fd3b0f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:39:27.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.443+0000 7f5942454640 1 --2- 172.21.15.7:0/2494840842 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fd372f1b0 0x555fd3b0f150 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f5938032fd0 tx=0x7f5938009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcc10575d59acb82 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:27.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.443+0000 7f5925ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:39:27.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.443+0000 7f5925ffb640 1 -- 172.21.15.7:0/2494840842 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f593804c070 con 0x555fd372f1b0 2024-09-21T06:39:27.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.443+0000 7f594ac2c740 1 -- 172.21.15.7:0/2494840842 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5934012bc0 con 0x555fd372f1b0 2024-09-21T06:39:27.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.443+0000 7f5925ffb640 1 -- 172.21.15.7:0/2494840842 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f5938005460 con 0x555fd372f1b0 2024-09-21T06:39:27.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.443+0000 7f5925ffb640 1 -- 172.21.15.7:0/2494840842 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5938058050 con 0x555fd372f1b0 2024-09-21T06:39:27.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.443+0000 7f594ac2c740 10 client.16185 fetch_fsmap learned FSMap version 25 2024-09-21T06:39:27.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.443+0000 7f594ac2c740 1 -- 172.21.15.7:0/2494840842 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x555fd3b1dee0 con 0x555fd372f1b0 2024-09-21T06:39:27.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.443+0000 7f5925ffb640 1 -- 172.21.15.7:0/2494840842 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5934012bc0 con 0x555fd372f1b0 2024-09-21T06:39:27.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.444+0000 7f5925ffb640 1 -- 172.21.15.7:0/2494840842 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f5938003850 con 0x555fd372f1b0 2024-09-21T06:39:27.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.444+0000 7f594ac2c740 10 client.16185 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:39:27.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.444+0000 7f594ac2c740 10 client.16185 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:39:27.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.444+0000 7f594ac2c740 20 client.16185 populate_metadata read hostname 'smithi007' 2024-09-21T06:39:27.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.444+0000 7f594ac2c740 1 --2- 172.21.15.7:0/2494840842 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x555fd37169f0 0x555fd3b21600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:27.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.444+0000 7f594ac2c740 4 client.16185 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:39:27.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.444+0000 7f594ac2c740 1 -- 172.21.15.7:0/2494840842 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555fd3a77df0 con 0x555fd37169f0 2024-09-21T06:39:27.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.444+0000 7f5941c53640 1 --2- 172.21.15.7:0/2494840842 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x555fd37169f0 0x555fd3b21600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:27.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.445+0000 7f5941c53640 1 --2- 172.21.15.7:0/2494840842 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x555fd37169f0 0x555fd3b21600 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7aca384efd468 server_cookie=5ef282728adbf63c in_seq=0 out_seq=0 2024-09-21T06:39:27.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.445+0000 7f5925ffb640 10 client.16185 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:39:27.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.445+0000 7f5925ffb640 1 -- 172.21.15.7:0/2494840842 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555fd3a77df0 con 0x555fd37169f0 2024-09-21T06:39:27.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.445+0000 7f5925ffb640 10 client.16185 handle_command_reply: tid=0 2024-09-21T06:39:27.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.445+0000 7f594ac2c740 1 client.16185 shutdown 2024-09-21T06:39:27.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.446+0000 7f594ac2c740 1 -- 172.21.15.7:0/2494840842 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fd372f1b0 msgr2=0x555fd3b0f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:27.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.446+0000 7f594ac2c740 1 --2- 172.21.15.7:0/2494840842 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fd372f1b0 0x555fd3b0f150 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f5938032fd0 tx=0x7f5938009260 comp rx=0 tx=0).stop 2024-09-21T06:39:27.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.446+0000 7f594ac2c740 1 -- 172.21.15.7:0/2494840842 shutdown_connections 2024-09-21T06:39:27.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.446+0000 7f594ac2c740 1 --2- 172.21.15.7:0/2494840842 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x555fd37169f0 0x555fd3b21600 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:27.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.446+0000 7f594ac2c740 1 --2- 172.21.15.7:0/2494840842 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555fd3758070 0x555fd3b1b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:27.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.446+0000 7f594ac2c740 1 --2- 172.21.15.7:0/2494840842 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555fd3737390 0x555fd3b0f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:27.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.446+0000 7f594ac2c740 1 --2- 172.21.15.7:0/2494840842 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fd372f1b0 0x555fd3b0f150 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:27.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.446+0000 7f594ac2c740 1 -- 172.21.15.7:0/2494840842 >> 172.21.15.7:0/2494840842 conn(0x555fd374c460 msgr2=0x555fd3b01090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:27.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.446+0000 7f5925ffb640 0 client.16185 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:39:27.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.446+0000 7f594ac2c740 1 -- 172.21.15.7:0/2494840842 shutdown_connections 2024-09-21T06:39:27.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.446+0000 7f594ac2c740 1 -- 172.21.15.7:0/2494840842 wait complete. 2024-09-21T06:39:27.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.446+0000 7f594ac2c740 20 client.16185 trim_cache size 0 max 16384 2024-09-21T06:39:27.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.459+0000 7f594ac2c740 1 Processor -- start 2024-09-21T06:39:27.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.459+0000 7f594ac2c740 1 -- start start 2024-09-21T06:39:27.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.460+0000 7f594ac2c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555fd372f1b0 0x555fd3b0ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:27.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.460+0000 7f594ac2c740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555fd3737390 0x555fd3b0f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:27.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.460+0000 7f594ac2c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fd3758070 0x555fd3b0c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:27.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.460+0000 7f594ac2c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f593c1afcf0 con 0x555fd3758070 2024-09-21T06:39:27.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.460+0000 7f594ac2c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f593c1ad5c0 con 0x555fd372f1b0 2024-09-21T06:39:27.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.460+0000 7f594ac2c740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f593c1ab3f0 con 0x555fd3737390 2024-09-21T06:39:27.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.460+0000 7f5942c55640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fd3758070 0x555fd3b0c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:27.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.460+0000 7f5942c55640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fd3758070 0x555fd3b0c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46108/0 (socket says 172.21.15.7:46108) 2024-09-21T06:39:27.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.460+0000 7f5942c55640 1 -- 172.21.15.7:0/1791057612 learned_addr learned my addr 172.21.15.7:0/1791057612 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:39:27.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.460+0000 7f5941c53640 1 --2- 172.21.15.7:0/1791057612 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555fd3737390 0x555fd3b0f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:27.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.460+0000 7f5942454640 1 --2- 172.21.15.7:0/1791057612 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555fd372f1b0 0x555fd3b0ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:27.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.460+0000 7f5941c53640 1 -- 172.21.15.7:0/1791057612 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555fd372f1b0 msgr2=0x555fd3b0ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:27.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.460+0000 7f5941c53640 1 --2- 172.21.15.7:0/1791057612 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555fd372f1b0 0x555fd3b0ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:27.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.460+0000 7f5941c53640 1 -- 172.21.15.7:0/1791057612 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fd3758070 msgr2=0x555fd3b0c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:27.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.460+0000 7f5941c53640 1 --2- 172.21.15.7:0/1791057612 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fd3758070 0x555fd3b0c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:27.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.460+0000 7f5941c53640 1 -- 172.21.15.7:0/1791057612 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555fd3b10410 con 0x555fd3737390 2024-09-21T06:39:27.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.460+0000 7f5942c55640 1 --2- 172.21.15.7:0/1791057612 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fd3758070 0x555fd3b0c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:39:27.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.461+0000 7f5941c53640 1 --2- 172.21.15.7:0/1791057612 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555fd3737390 0x555fd3b0f440 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f592c0e4990 tx=0x7f592c094040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a690c32239b585df server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:27.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.461+0000 7f5927fff640 1 -- 172.21.15.7:0/1791057612 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f592c021040 con 0x555fd3737390 2024-09-21T06:39:27.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.461+0000 7f5927fff640 1 -- 172.21.15.7:0/1791057612 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f592c0ad790 con 0x555fd3737390 2024-09-21T06:39:27.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.461+0000 7f5927fff640 1 -- 172.21.15.7:0/1791057612 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f592c092e60 con 0x555fd3737390 2024-09-21T06:39:27.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.462+0000 7f594ac2c740 1 -- 172.21.15.7:0/1791057612 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555fd3737390 msgr2=0x555fd3b0f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:27.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.462+0000 7f594ac2c740 1 --2- 172.21.15.7:0/1791057612 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555fd3737390 0x555fd3b0f440 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f592c0e4990 tx=0x7f592c094040 comp rx=0 tx=0).stop 2024-09-21T06:39:27.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.462+0000 7f594ac2c740 1 -- 172.21.15.7:0/1791057612 shutdown_connections 2024-09-21T06:39:27.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.462+0000 7f594ac2c740 1 --2- 172.21.15.7:0/1791057612 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fd3758070 0x555fd3b0c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:27.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.462+0000 7f594ac2c740 1 --2- 172.21.15.7:0/1791057612 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555fd3737390 0x555fd3b0f440 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:27.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.462+0000 7f594ac2c740 1 --2- 172.21.15.7:0/1791057612 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555fd372f1b0 0x555fd3b0ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:27.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.462+0000 7f594ac2c740 1 -- 172.21.15.7:0/1791057612 >> 172.21.15.7:0/1791057612 conn(0x555fd374c460 msgr2=0x555fd3b0d9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:27.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.462+0000 7f594ac2c740 1 -- 172.21.15.7:0/1791057612 shutdown_connections 2024-09-21T06:39:27.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.462+0000 7f594ac2c740 1 -- 172.21.15.7:0/1791057612 wait complete. 2024-09-21T06:39:27.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.462+0000 7f594ac2c740 1 -- start start 2024-09-21T06:39:27.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.462+0000 7f594ac2c740 1 Processor -- start 2024-09-21T06:39:27.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.463+0000 7f594ac2c740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555fd372f1b0 0x555fd3b220d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:27.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.463+0000 7f594ac2c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fd3737390 0x555fd3b226b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:27.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.463+0000 7f594ac2c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555fd3758070 0x555fd3b84020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:27.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.463+0000 7f594ac2c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f593c1aba80 con 0x555fd3737390 2024-09-21T06:39:27.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.463+0000 7f594ac2c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f593c1acef0 con 0x555fd3758070 2024-09-21T06:39:27.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.463+0000 7f594ac2c740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f593c1ac150 con 0x555fd372f1b0 2024-09-21T06:39:27.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.463+0000 7f594ac2c740 10 client.0 _ll_register_callbacks cb 0x7f5938005e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:39:27.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.463+0000 7f5941c53640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fd3737390 0x555fd3b226b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:27.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.463+0000 7f5941c53640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fd3737390 0x555fd3b226b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46122/0 (socket says 172.21.15.7:46122) 2024-09-21T06:39:27.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.463+0000 7f5941c53640 1 -- 172.21.15.7:0/4294469731 learned_addr learned my addr 172.21.15.7:0/4294469731 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:39:27.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.463+0000 7f5942454640 1 --2- 172.21.15.7:0/4294469731 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555fd372f1b0 0x555fd3b220d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:27.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.463+0000 7f5942c55640 1 --2- 172.21.15.7:0/4294469731 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555fd3758070 0x555fd3b84020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:27.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.463+0000 7f5941c53640 1 -- 172.21.15.7:0/4294469731 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555fd372f1b0 msgr2=0x555fd3b220d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:27.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.463+0000 7f5941c53640 1 --2- 172.21.15.7:0/4294469731 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555fd372f1b0 0x555fd3b220d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:27.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.463+0000 7f5941c53640 1 -- 172.21.15.7:0/4294469731 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555fd3758070 msgr2=0x555fd3b84020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:27.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.463+0000 7f5941c53640 1 --2- 172.21.15.7:0/4294469731 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555fd3758070 0x555fd3b84020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:27.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.463+0000 7f5941c53640 1 -- 172.21.15.7:0/4294469731 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555fd3b84690 con 0x555fd3737390 2024-09-21T06:39:27.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.464+0000 7f5941c53640 1 --2- 172.21.15.7:0/4294469731 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fd3737390 0x555fd3b226b0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f592c0acd90 tx=0x7f592c00de80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86a367d80961e216 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:27.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.464+0000 7f5925ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:39:27.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.464+0000 7f5925ffb640 1 -- 172.21.15.7:0/4294469731 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f592c05c020 con 0x555fd3737390 2024-09-21T06:39:27.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.464+0000 7f5925ffb640 1 -- 172.21.15.7:0/4294469731 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f592c05c3c0 con 0x555fd3737390 2024-09-21T06:39:27.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.464+0000 7f594ac2c740 1 -- 172.21.15.7:0/4294469731 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f592c0ad790 con 0x555fd3737390 2024-09-21T06:39:27.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.464+0000 7f5925ffb640 1 -- 172.21.15.7:0/4294469731 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f592c021070 con 0x555fd3737390 2024-09-21T06:39:27.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.464+0000 7f594ac2c740 10 client.16191 fetch_fsmap learned FSMap version 25 2024-09-21T06:39:27.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.464+0000 7f594ac2c740 1 -- 172.21.15.7:0/4294469731 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x555fd3b8ba80 con 0x555fd3737390 2024-09-21T06:39:27.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.464+0000 7f5925ffb640 1 -- 172.21.15.7:0/4294469731 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f592c0ad790 con 0x555fd3737390 2024-09-21T06:39:27.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.464+0000 7f5925ffb640 1 -- 172.21.15.7:0/4294469731 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f592c0abd60 con 0x555fd3737390 2024-09-21T06:39:27.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.464+0000 7f594ac2c740 10 client.16191 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:39:27.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.464+0000 7f594ac2c740 10 client.16191 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:39:27.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.464+0000 7f594ac2c740 20 client.16191 populate_metadata read hostname 'smithi007' 2024-09-21T06:39:27.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.465+0000 7f594ac2c740 1 --2- 172.21.15.7:0/4294469731 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x555fd36ebda0 0x555fd3b8e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:27.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.465+0000 7f594ac2c740 4 client.16191 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:39:27.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.465+0000 7f594ac2c740 1 -- 172.21.15.7:0/4294469731 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555fd3a738a0 con 0x555fd36ebda0 2024-09-21T06:39:27.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.465+0000 7f5942454640 1 --2- 172.21.15.7:0/4294469731 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x555fd36ebda0 0x555fd3b8e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:27.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.465+0000 7f5942454640 1 --2- 172.21.15.7:0/4294469731 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x555fd36ebda0 0x555fd3b8e180 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aae817e72b54da45 server_cookie=916298a8faa0fc86 in_seq=0 out_seq=0 2024-09-21T06:39:27.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.465+0000 7f5925ffb640 10 client.16191 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:39:27.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.465+0000 7f5925ffb640 1 -- 172.21.15.7:0/4294469731 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555fd3a738a0 con 0x555fd36ebda0 2024-09-21T06:39:27.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.465+0000 7f5925ffb640 10 client.16191 handle_command_reply: tid=0 2024-09-21T06:39:27.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.465+0000 7f594ac2c740 1 client.16191 shutdown 2024-09-21T06:39:27.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.466+0000 7f594ac2c740 1 -- 172.21.15.7:0/4294469731 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fd3737390 msgr2=0x555fd3b226b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:27.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.466+0000 7f594ac2c740 1 --2- 172.21.15.7:0/4294469731 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fd3737390 0x555fd3b226b0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f592c0acd90 tx=0x7f592c00de80 comp rx=0 tx=0).stop 2024-09-21T06:39:27.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.466+0000 7f594ac2c740 1 -- 172.21.15.7:0/4294469731 shutdown_connections 2024-09-21T06:39:27.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.466+0000 7f594ac2c740 1 --2- 172.21.15.7:0/4294469731 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x555fd36ebda0 0x555fd3b8e180 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:27.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.466+0000 7f594ac2c740 1 --2- 172.21.15.7:0/4294469731 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555fd3758070 0x555fd3b84020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:27.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.466+0000 7f594ac2c740 1 --2- 172.21.15.7:0/4294469731 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555fd3737390 0x555fd3b226b0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:27.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.466+0000 7f594ac2c740 1 --2- 172.21.15.7:0/4294469731 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555fd372f1b0 0x555fd3b220d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:27.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.466+0000 7f594ac2c740 1 -- 172.21.15.7:0/4294469731 >> 172.21.15.7:0/4294469731 conn(0x555fd374c460 msgr2=0x555fd3b0d590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:27.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.466+0000 7f5925ffb640 0 client.16191 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:39:27.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.466+0000 7f594ac2c740 1 -- 172.21.15.7:0/4294469731 shutdown_connections 2024-09-21T06:39:27.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.466+0000 7f594ac2c740 1 -- 172.21.15.7:0/4294469731 wait complete. 2024-09-21T06:39:27.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.466+0000 7f594ac2c740 20 client.16191 trim_cache size 0 max 16384 2024-09-21T06:39:27.474 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:39:27.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.467+0000 7f59446b8640 1 -- 172.21.15.7:0/3644117840 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f59280b6680 msgr2=0x7f59280b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:27.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.467+0000 7f59446b8640 1 --2- 172.21.15.7:0/3644117840 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f59280b6680 0x7f59280b8b90 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5938000c00 tx=0x7f59380058b0 comp rx=0 tx=0).stop 2024-09-21T06:39:27.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.467+0000 7f59446b8640 1 -- 172.21.15.7:0/3644117840 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f593c1083a0 msgr2=0x7f593c19b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:27.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.467+0000 7f59446b8640 1 --2- 172.21.15.7:0/3644117840 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f593c1083a0 0x7f593c19b790 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f592c00d770 tx=0x7f592c00dc30 comp rx=0 tx=0).stop 2024-09-21T06:39:27.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.467+0000 7f59446b8640 1 -- 172.21.15.7:0/3644117840 shutdown_connections 2024-09-21T06:39:27.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.467+0000 7f59446b8640 1 --2- 172.21.15.7:0/3644117840 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f59280b6680 0x7f59280b8b90 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:27.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.467+0000 7f59446b8640 1 --2- 172.21.15.7:0/3644117840 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f593c108cf0 0x7f593c19bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:27.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.467+0000 7f59446b8640 1 --2- 172.21.15.7:0/3644117840 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f593c1083a0 0x7f593c19b790 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:27.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.467+0000 7f59446b8640 1 --2- 172.21.15.7:0/3644117840 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f593c102a60 0x7f593c19b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:27.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.467+0000 7f59446b8640 1 -- 172.21.15.7:0/3644117840 >> 172.21.15.7:0/3644117840 conn(0x7f593c079730 msgr2=0x7f593c101490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:27.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.467+0000 7f59446b8640 1 -- 172.21.15.7:0/3644117840 shutdown_connections 2024-09-21T06:39:27.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:27.467+0000 7f59446b8640 1 -- 172.21.15.7:0/3644117840 wait complete. 2024-09-21T06:39:29.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:39:28 smithi144 ceph-mon[34653]: pgmap v417: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6 op/s 2024-09-21T06:39:29.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:39:28 smithi007 ceph-mon[30983]: pgmap v417: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6 op/s 2024-09-21T06:39:29.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:39:28 smithi018 ceph-mon[34477]: pgmap v417: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6 op/s 2024-09-21T06:39:29.407 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:39:29.407 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:39:29.682 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:39:30.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.183+0000 7fe82e56e640 1 -- 172.21.15.7:0/847521886 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe828102ae0 msgr2=0x7fe828102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:30.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.183+0000 7fe82e56e640 1 --2- 172.21.15.7:0/847521886 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe828102ae0 0x7fe828102ef0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fe818009900 tx=0x7fe81802a410 comp rx=0 tx=0).stop 2024-09-21T06:39:30.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.183+0000 7fe82e56e640 1 -- 172.21.15.7:0/847521886 shutdown_connections 2024-09-21T06:39:30.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.183+0000 7fe82e56e640 1 --2- 172.21.15.7:0/847521886 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe828108d20 0x7fe82810f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:30.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.183+0000 7fe82e56e640 1 --2- 172.21.15.7:0/847521886 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe8281083d0 0x7fe8281087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:30.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.183+0000 7fe82e56e640 1 --2- 172.21.15.7:0/847521886 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe828102ae0 0x7fe828102ef0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:30.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.183+0000 7fe82e56e640 1 -- 172.21.15.7:0/847521886 >> 172.21.15.7:0/847521886 conn(0x7fe828079760 msgr2=0x7fe828079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:30.189 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.183+0000 7fe82e56e640 1 -- 172.21.15.7:0/847521886 shutdown_connections 2024-09-21T06:39:30.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.183+0000 7fe82e56e640 1 -- 172.21.15.7:0/847521886 wait complete. 2024-09-21T06:39:30.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.184+0000 7fe82e56e640 1 Processor -- start 2024-09-21T06:39:30.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.184+0000 7fe82e56e640 1 -- start start 2024-09-21T06:39:30.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.184+0000 7fe82e56e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe828102ae0 0x7fe82810ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:30.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.184+0000 7fe82e56e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8281083d0 0x7fe828110520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:30.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.184+0000 7fe82e56e640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe828108d20 0x7fe828110a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:30.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.184+0000 7fe82e56e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe828113ab0 con 0x7fe8281083d0 2024-09-21T06:39:30.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.184+0000 7fe82e56e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe828113930 con 0x7fe828102ae0 2024-09-21T06:39:30.190 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.184+0000 7fe82e56e640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe828113c30 con 0x7fe828108d20 2024-09-21T06:39:30.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.184+0000 7fe81ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8281083d0 0x7fe828110520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:30.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.184+0000 7fe81ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8281083d0 0x7fe828110520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46144/0 (socket says 172.21.15.7:46144) 2024-09-21T06:39:30.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.184+0000 7fe81ffff640 1 -- 172.21.15.7:0/4161660803 learned_addr learned my addr 172.21.15.7:0/4161660803 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:39:30.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.185+0000 7fe827fff640 1 --2- 172.21.15.7:0/4161660803 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe828102ae0 0x7fe82810ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:30.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.185+0000 7fe82cb0b640 1 --2- 172.21.15.7:0/4161660803 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe828108d20 0x7fe828110a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:30.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.185+0000 7fe81ffff640 1 -- 172.21.15.7:0/4161660803 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe828108d20 msgr2=0x7fe828110a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:30.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.185+0000 7fe81ffff640 1 --2- 172.21.15.7:0/4161660803 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe828108d20 0x7fe828110a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:30.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.185+0000 7fe81ffff640 1 -- 172.21.15.7:0/4161660803 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe828102ae0 msgr2=0x7fe82810ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:30.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.185+0000 7fe81ffff640 1 --2- 172.21.15.7:0/4161660803 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe828102ae0 0x7fe82810ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:30.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.185+0000 7fe81ffff640 1 -- 172.21.15.7:0/4161660803 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8281a8720 con 0x7fe8281083d0 2024-09-21T06:39:30.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.185+0000 7fe82cb0b640 1 --2- 172.21.15.7:0/4161660803 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe828108d20 0x7fe828110a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:39:30.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.185+0000 7fe81ffff640 1 --2- 172.21.15.7:0/4161660803 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8281083d0 0x7fe828110520 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fe81000e9f0 tx=0x7fe81000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:30.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.185+0000 7fe825ffb640 1 -- 172.21.15.7:0/4161660803 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe81000ccc0 con 0x7fe8281083d0 2024-09-21T06:39:30.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.185+0000 7fe82e56e640 1 -- 172.21.15.7:0/4161660803 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8281a8a10 con 0x7fe8281083d0 2024-09-21T06:39:30.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.185+0000 7fe825ffb640 1 -- 172.21.15.7:0/4161660803 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe8100054d0 con 0x7fe8281083d0 2024-09-21T06:39:30.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.185+0000 7fe825ffb640 1 -- 172.21.15.7:0/4161660803 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe810010430 con 0x7fe8281083d0 2024-09-21T06:39:30.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.185+0000 7fe82e56e640 1 -- 172.21.15.7:0/4161660803 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8281a8f50 con 0x7fe8281083d0 2024-09-21T06:39:30.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.188+0000 7fe825ffb640 1 -- 172.21.15.7:0/4161660803 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7fe8100046c0 con 0x7fe8281083d0 2024-09-21T06:39:30.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.188+0000 7fe834ae2740 1 Processor -- start 2024-09-21T06:39:30.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.188+0000 7fe834ae2740 1 -- start start 2024-09-21T06:39:30.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.188+0000 7fe834ae2740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55edcaf9a350 0x55edcb341430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:30.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.188+0000 7fe834ae2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55edcaf71490 0x55edcb341970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:30.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.188+0000 7fe834ae2740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55edcaf79670 0x55edcb341eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:30.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.188+0000 7fe834ae2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55edcb2b7e60 con 0x55edcaf71490 2024-09-21T06:39:30.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.188+0000 7fe834ae2740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55edcb2a7290 con 0x55edcaf9a350 2024-09-21T06:39:30.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.188+0000 7fe834ae2740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55edcb2ab0a0 con 0x55edcaf79670 2024-09-21T06:39:30.199 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.189+0000 7fe827fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55edcaf71490 0x55edcb341970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:30.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.189+0000 7fe827fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55edcaf71490 0x55edcb341970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46146/0 (socket says 172.21.15.7:46146) 2024-09-21T06:39:30.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.189+0000 7fe827fff640 1 -- 172.21.15.7:0/2185712635 learned_addr learned my addr 172.21.15.7:0/2185712635 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:39:30.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.189+0000 7fe82cb0b640 1 --2- 172.21.15.7:0/2185712635 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55edcaf9a350 0x55edcb341430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:30.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.189+0000 7fe81ffff640 1 --2- 172.21.15.7:0/2185712635 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55edcaf79670 0x55edcb341eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:30.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.189+0000 7fe827fff640 1 -- 172.21.15.7:0/2185712635 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55edcaf79670 msgr2=0x55edcb341eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:30.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.189+0000 7fe827fff640 1 --2- 172.21.15.7:0/2185712635 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55edcaf79670 0x55edcb341eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:30.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.189+0000 7fe827fff640 1 -- 172.21.15.7:0/2185712635 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55edcaf9a350 msgr2=0x55edcb341430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:30.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.189+0000 7fe827fff640 1 --2- 172.21.15.7:0/2185712635 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55edcaf9a350 0x55edcb341430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:30.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.189+0000 7fe827fff640 1 -- 172.21.15.7:0/2185712635 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edcb005930 con 0x55edcaf71490 2024-09-21T06:39:30.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.189+0000 7fe81ffff640 1 --2- 172.21.15.7:0/2185712635 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55edcaf79670 0x55edcb341eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:39:30.200 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.189+0000 7fe82cb0b640 1 --2- 172.21.15.7:0/2185712635 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55edcaf9a350 0x55edcb341430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:39:30.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.189+0000 7fe825ffb640 1 --2- 172.21.15.7:0/4161660803 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fe8140b6680 0x7fe8140b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:30.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.189+0000 7fe827fff640 1 --2- 172.21.15.7:0/2185712635 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55edcaf71490 0x55edcb341970 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fe81802a930 tx=0x7fe818032ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2756f8b2e067e6bf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:30.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.190+0000 7fe82cb0b640 1 --2- 172.21.15.7:0/4161660803 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fe8140b6680 0x7fe8140b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:30.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.190+0000 7fe825ffb640 1 -- 172.21.15.7:0/4161660803 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fe8100e7ba0 con 0x7fe8281083d0 2024-09-21T06:39:30.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.190+0000 7fe81e7fc640 1 -- 172.21.15.7:0/2185712635 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe81803f070 con 0x55edcaf71490 2024-09-21T06:39:30.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.190+0000 7fe81e7fc640 1 -- 172.21.15.7:0/2185712635 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe818004030 con 0x55edcaf71490 2024-09-21T06:39:30.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.190+0000 7fe81e7fc640 1 -- 172.21.15.7:0/2185712635 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe818035070 con 0x55edcaf71490 2024-09-21T06:39:30.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.191+0000 7fe834ae2740 1 -- 172.21.15.7:0/2185712635 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55edcaf71490 msgr2=0x55edcb341970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:30.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.191+0000 7fe82cb0b640 1 --2- 172.21.15.7:0/4161660803 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fe8140b6680 0x7fe8140b8b90 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe820005fd0 tx=0x7fe820009500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:30.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.191+0000 7fe834ae2740 1 --2- 172.21.15.7:0/2185712635 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55edcaf71490 0x55edcb341970 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fe81802a930 tx=0x7fe818032ba0 comp rx=0 tx=0).stop 2024-09-21T06:39:30.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.191+0000 7fe834ae2740 1 -- 172.21.15.7:0/2185712635 shutdown_connections 2024-09-21T06:39:30.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.191+0000 7fe834ae2740 1 --2- 172.21.15.7:0/2185712635 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55edcaf79670 0x55edcb341eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:30.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.191+0000 7fe834ae2740 1 --2- 172.21.15.7:0/2185712635 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55edcaf71490 0x55edcb341970 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:30.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.191+0000 7fe834ae2740 1 --2- 172.21.15.7:0/2185712635 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55edcaf9a350 0x55edcb341430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:30.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.191+0000 7fe834ae2740 1 -- 172.21.15.7:0/2185712635 >> 172.21.15.7:0/2185712635 conn(0x55edcaf8e740 msgr2=0x55edcb33f320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:30.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.191+0000 7fe834ae2740 1 -- 172.21.15.7:0/2185712635 shutdown_connections 2024-09-21T06:39:30.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.191+0000 7fe834ae2740 1 -- 172.21.15.7:0/2185712635 wait complete. 2024-09-21T06:39:30.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.191+0000 7fe834ae2740 1 -- start start 2024-09-21T06:39:30.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.191+0000 7fe834ae2740 1 Processor -- start 2024-09-21T06:39:30.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.192+0000 7fe834ae2740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55edcaf71490 0x55edcb34d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:30.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.192+0000 7fe834ae2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55edcaf79670 0x55edcb34d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:30.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.192+0000 7fe834ae2740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55edcaf9a350 0x55edcb358ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:30.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.192+0000 7fe834ae2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55edcb108890 con 0x55edcaf79670 2024-09-21T06:39:30.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.192+0000 7fe834ae2740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55edcb241d40 con 0x55edcaf9a350 2024-09-21T06:39:30.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.192+0000 7fe834ae2740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55edcb34fbb0 con 0x55edcaf71490 2024-09-21T06:39:30.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.192+0000 7fe834ae2740 10 client.0 _ll_register_callbacks cb 0x55edcb2a5c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:39:30.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.192+0000 7fe81ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55edcaf79670 0x55edcb34d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:30.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.192+0000 7fe81ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55edcaf79670 0x55edcb34d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46158/0 (socket says 172.21.15.7:46158) 2024-09-21T06:39:30.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.192+0000 7fe81ffff640 1 -- 172.21.15.7:0/2612318411 learned_addr learned my addr 172.21.15.7:0/2612318411 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:39:30.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.192+0000 7fe82cb0b640 1 --2- 172.21.15.7:0/2612318411 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55edcaf9a350 0x55edcb358ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:30.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.192+0000 7fe827fff640 1 --2- 172.21.15.7:0/2612318411 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55edcaf71490 0x55edcb34d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:30.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.192+0000 7fe81ffff640 1 -- 172.21.15.7:0/2612318411 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55edcaf71490 msgr2=0x55edcb34d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:30.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.192+0000 7fe81ffff640 1 --2- 172.21.15.7:0/2612318411 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55edcaf71490 0x55edcb34d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:30.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.192+0000 7fe81ffff640 1 -- 172.21.15.7:0/2612318411 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55edcaf9a350 msgr2=0x55edcb358ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:30.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.192+0000 7fe81ffff640 1 --2- 172.21.15.7:0/2612318411 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55edcaf9a350 0x55edcb358ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:30.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.192+0000 7fe81ffff640 1 -- 172.21.15.7:0/2612318411 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55edcb359460 con 0x55edcaf79670 2024-09-21T06:39:30.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.193+0000 7fe81ffff640 1 --2- 172.21.15.7:0/2612318411 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55edcaf79670 0x55edcb34d550 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fe81000c6a0 tx=0x7fe8100a99f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebdcf8dfc13e132d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:30.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.193+0000 7fe8077fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:39:30.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.193+0000 7fe8077fe640 1 -- 172.21.15.7:0/2612318411 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8100ad200 con 0x55edcaf79670 2024-09-21T06:39:30.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.193+0000 7fe8077fe640 1 -- 172.21.15.7:0/2612318411 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fe8100b21b0 con 0x55edcaf79670 2024-09-21T06:39:30.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.193+0000 7fe834ae2740 1 -- 172.21.15.7:0/2612318411 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe818004030 con 0x55edcaf79670 2024-09-21T06:39:30.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.193+0000 7fe8077fe640 1 -- 172.21.15.7:0/2612318411 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe810005680 con 0x55edcaf79670 2024-09-21T06:39:30.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.193+0000 7fe834ae2740 10 client.16203 fetch_fsmap learned FSMap version 25 2024-09-21T06:39:30.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.193+0000 7fe834ae2740 1 -- 172.21.15.7:0/2612318411 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55edcb35bd90 con 0x55edcaf79670 2024-09-21T06:39:30.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.193+0000 7fe8077fe640 1 -- 172.21.15.7:0/2612318411 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe818004030 con 0x55edcaf79670 2024-09-21T06:39:30.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.193+0000 7fe8077fe640 1 -- 172.21.15.7:0/2612318411 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fe810005000 con 0x55edcaf79670 2024-09-21T06:39:30.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.194+0000 7fe834ae2740 10 client.16203 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:39:30.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.194+0000 7fe834ae2740 10 client.16203 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:39:30.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.194+0000 7fe834ae2740 20 client.16203 populate_metadata read hostname 'smithi007' 2024-09-21T06:39:30.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.194+0000 7fe834ae2740 1 --2- 172.21.15.7:0/2612318411 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55edcaf58cd0 0x55edcb35f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:30.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.194+0000 7fe834ae2740 4 client.16203 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:39:30.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.194+0000 7fe834ae2740 1 -- 172.21.15.7:0/2612318411 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55edcb2b9db0 con 0x55edcaf58cd0 2024-09-21T06:39:30.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.194+0000 7fe827fff640 1 --2- 172.21.15.7:0/2612318411 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55edcaf58cd0 0x55edcb35f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:30.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.195+0000 7fe8077fe640 10 client.16203 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:39:30.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.195+0000 7fe827fff640 1 --2- 172.21.15.7:0/2612318411 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55edcaf58cd0 0x55edcb35f320 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a8d48f3d92c3f02 server_cookie=fc5161fc14ae5d71 in_seq=0 out_seq=0 2024-09-21T06:39:30.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.195+0000 7fe8077fe640 1 -- 172.21.15.7:0/2612318411 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55edcb2b9db0 con 0x55edcaf58cd0 2024-09-21T06:39:30.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.195+0000 7fe8077fe640 10 client.16203 handle_command_reply: tid=0 2024-09-21T06:39:30.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.195+0000 7fe834ae2740 1 client.16203 shutdown 2024-09-21T06:39:30.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.196+0000 7fe834ae2740 1 -- 172.21.15.7:0/2612318411 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55edcaf79670 msgr2=0x55edcb34d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:30.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.196+0000 7fe834ae2740 1 --2- 172.21.15.7:0/2612318411 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55edcaf79670 0x55edcb34d550 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fe81000c6a0 tx=0x7fe8100a99f0 comp rx=0 tx=0).stop 2024-09-21T06:39:30.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.196+0000 7fe834ae2740 1 -- 172.21.15.7:0/2612318411 shutdown_connections 2024-09-21T06:39:30.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.196+0000 7fe834ae2740 1 --2- 172.21.15.7:0/2612318411 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55edcaf58cd0 0x55edcb35f320 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:30.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.196+0000 7fe834ae2740 1 --2- 172.21.15.7:0/2612318411 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55edcaf9a350 0x55edcb358ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:30.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.196+0000 7fe834ae2740 1 --2- 172.21.15.7:0/2612318411 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55edcaf79670 0x55edcb34d550 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:30.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.196+0000 7fe8077fe640 0 client.16203 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:39:30.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.196+0000 7fe834ae2740 1 --2- 172.21.15.7:0/2612318411 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55edcaf71490 0x55edcb34d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:30.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.196+0000 7fe834ae2740 1 -- 172.21.15.7:0/2612318411 >> 172.21.15.7:0/2612318411 conn(0x55edcaf8e740 msgr2=0x55edcb3445c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:30.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.196+0000 7fe834ae2740 1 -- 172.21.15.7:0/2612318411 shutdown_connections 2024-09-21T06:39:30.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.196+0000 7fe834ae2740 1 -- 172.21.15.7:0/2612318411 wait complete. 2024-09-21T06:39:30.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.196+0000 7fe834ae2740 20 client.16203 trim_cache size 0 max 16384 2024-09-21T06:39:30.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.213+0000 7fe834ae2740 1 Processor -- start 2024-09-21T06:39:30.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.213+0000 7fe834ae2740 1 -- start start 2024-09-21T06:39:30.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.214+0000 7fe834ae2740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55edcaf71490 0x55edcb358dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:30.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.214+0000 7fe834ae2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55edcaf79670 0x55edcb34c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:30.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.214+0000 7fe834ae2740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55edcaf9a350 0x55edcb342b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:30.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.214+0000 7fe834ae2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe8281b3e90 con 0x55edcaf79670 2024-09-21T06:39:30.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.214+0000 7fe834ae2740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe8281b1760 con 0x55edcaf9a350 2024-09-21T06:39:30.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.214+0000 7fe834ae2740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe8281af590 con 0x55edcaf71490 2024-09-21T06:39:30.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.214+0000 7fe81ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55edcaf79670 0x55edcb34c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:30.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.214+0000 7fe81ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55edcaf79670 0x55edcb34c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46160/0 (socket says 172.21.15.7:46160) 2024-09-21T06:39:30.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.214+0000 7fe81ffff640 1 -- 172.21.15.7:0/3458901088 learned_addr learned my addr 172.21.15.7:0/3458901088 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:39:30.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.214+0000 7fe827fff640 1 --2- 172.21.15.7:0/3458901088 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55edcaf71490 0x55edcb358dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:30.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.214+0000 7fe82cb0b640 1 --2- 172.21.15.7:0/3458901088 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55edcaf9a350 0x55edcb342b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:30.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.214+0000 7fe81ffff640 1 -- 172.21.15.7:0/3458901088 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55edcaf71490 msgr2=0x55edcb358dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:30.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.214+0000 7fe81ffff640 1 --2- 172.21.15.7:0/3458901088 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55edcaf71490 0x55edcb358dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:30.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.214+0000 7fe81ffff640 1 -- 172.21.15.7:0/3458901088 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55edcaf9a350 msgr2=0x55edcb342b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:30.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.214+0000 7fe81ffff640 1 --2- 172.21.15.7:0/3458901088 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55edcaf9a350 0x55edcb342b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:30.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.214+0000 7fe81ffff640 1 -- 172.21.15.7:0/3458901088 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edcb339520 con 0x55edcaf79670 2024-09-21T06:39:30.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.214+0000 7fe81ffff640 1 --2- 172.21.15.7:0/3458901088 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55edcaf79670 0x55edcb34c6a0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fe810005820 tx=0x7fe8100a92d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5986cd49dc38e19 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:30.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.214+0000 7fe81dffb640 1 -- 172.21.15.7:0/3458901088 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8100c7030 con 0x55edcaf79670 2024-09-21T06:39:30.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.215+0000 7fe81dffb640 1 -- 172.21.15.7:0/3458901088 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe8100ad5a0 con 0x55edcaf79670 2024-09-21T06:39:30.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.215+0000 7fe81dffb640 1 -- 172.21.15.7:0/3458901088 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8100ae190 con 0x55edcaf79670 2024-09-21T06:39:30.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.215+0000 7fe834ae2740 1 -- 172.21.15.7:0/3458901088 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55edcaf79670 msgr2=0x55edcb34c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:30.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.215+0000 7fe834ae2740 1 --2- 172.21.15.7:0/3458901088 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55edcaf79670 0x55edcb34c6a0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fe810005820 tx=0x7fe8100a92d0 comp rx=0 tx=0).stop 2024-09-21T06:39:30.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.215+0000 7fe834ae2740 1 -- 172.21.15.7:0/3458901088 shutdown_connections 2024-09-21T06:39:30.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.215+0000 7fe834ae2740 1 --2- 172.21.15.7:0/3458901088 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55edcaf9a350 0x55edcb342b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:30.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.215+0000 7fe834ae2740 1 --2- 172.21.15.7:0/3458901088 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55edcaf79670 0x55edcb34c6a0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:30.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.215+0000 7fe834ae2740 1 --2- 172.21.15.7:0/3458901088 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55edcaf71490 0x55edcb358dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:30.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.215+0000 7fe834ae2740 1 -- 172.21.15.7:0/3458901088 >> 172.21.15.7:0/3458901088 conn(0x55edcaf8e740 msgr2=0x55edcb342460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:30.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.215+0000 7fe834ae2740 1 -- 172.21.15.7:0/3458901088 shutdown_connections 2024-09-21T06:39:30.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.215+0000 7fe834ae2740 1 -- 172.21.15.7:0/3458901088 wait complete. 2024-09-21T06:39:30.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.216+0000 7fe834ae2740 1 -- start start 2024-09-21T06:39:30.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.216+0000 7fe834ae2740 1 Processor -- start 2024-09-21T06:39:30.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.216+0000 7fe834ae2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55edcaf71490 0x55edcb351720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:30.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.216+0000 7fe834ae2740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55edcaf79670 0x55edcb351d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:30.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.216+0000 7fe834ae2740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55edcaf9a350 0x55edcb3c2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:30.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.216+0000 7fe834ae2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe8281afc20 con 0x55edcaf71490 2024-09-21T06:39:30.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.216+0000 7fe834ae2740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe8281b1090 con 0x55edcaf79670 2024-09-21T06:39:30.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.216+0000 7fe834ae2740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe8281b02f0 con 0x55edcaf9a350 2024-09-21T06:39:30.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.216+0000 7fe834ae2740 10 client.0 _ll_register_callbacks cb 0x7fe81000cef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:39:30.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.217+0000 7fe827fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55edcaf71490 0x55edcb351720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:30.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.217+0000 7fe827fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55edcaf71490 0x55edcb351720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46162/0 (socket says 172.21.15.7:46162) 2024-09-21T06:39:30.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.217+0000 7fe827fff640 1 -- 172.21.15.7:0/4186102385 learned_addr learned my addr 172.21.15.7:0/4186102385 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:39:30.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.217+0000 7fe82cb0b640 1 --2- 172.21.15.7:0/4186102385 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55edcaf9a350 0x55edcb3c2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:30.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.217+0000 7fe81ffff640 1 --2- 172.21.15.7:0/4186102385 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55edcaf79670 0x55edcb351d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:30.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.217+0000 7fe827fff640 1 -- 172.21.15.7:0/4186102385 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55edcaf9a350 msgr2=0x55edcb3c2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:30.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.217+0000 7fe827fff640 1 --2- 172.21.15.7:0/4186102385 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55edcaf9a350 0x55edcb3c2cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:30.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.217+0000 7fe827fff640 1 -- 172.21.15.7:0/4186102385 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55edcaf79670 msgr2=0x55edcb351d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:30.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.217+0000 7fe827fff640 1 --2- 172.21.15.7:0/4186102385 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55edcaf79670 0x55edcb351d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:30.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.217+0000 7fe827fff640 1 -- 172.21.15.7:0/4186102385 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55edcb3c3320 con 0x55edcaf71490 2024-09-21T06:39:30.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.217+0000 7fe827fff640 1 --2- 172.21.15.7:0/4186102385 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55edcaf71490 0x55edcb351720 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fe818009900 tx=0x7fe818005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cc36ff292c97d77 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:30.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.217+0000 7fe8077fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:39:30.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.217+0000 7fe8077fe640 1 -- 172.21.15.7:0/4186102385 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe81803f040 con 0x55edcaf71490 2024-09-21T06:39:30.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.217+0000 7fe8077fe640 1 -- 172.21.15.7:0/4186102385 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fe8180316a0 con 0x55edcaf71490 2024-09-21T06:39:30.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.217+0000 7fe834ae2740 1 -- 172.21.15.7:0/4186102385 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe8100ad5a0 con 0x55edcaf71490 2024-09-21T06:39:30.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.217+0000 7fe8077fe640 1 -- 172.21.15.7:0/4186102385 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe818062050 con 0x55edcaf71490 2024-09-21T06:39:30.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.218+0000 7fe834ae2740 10 client.16209 fetch_fsmap learned FSMap version 25 2024-09-21T06:39:30.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.218+0000 7fe834ae2740 1 -- 172.21.15.7:0/4186102385 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55edcb3ca6a0 con 0x55edcaf71490 2024-09-21T06:39:30.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.218+0000 7fe8077fe640 1 -- 172.21.15.7:0/4186102385 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe8100ad5a0 con 0x55edcaf71490 2024-09-21T06:39:30.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.218+0000 7fe8077fe640 1 -- 172.21.15.7:0/4186102385 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fe818004b40 con 0x55edcaf71490 2024-09-21T06:39:30.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.218+0000 7fe834ae2740 10 client.16209 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:39:30.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.218+0000 7fe834ae2740 10 client.16209 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:39:30.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.218+0000 7fe834ae2740 20 client.16209 populate_metadata read hostname 'smithi007' 2024-09-21T06:39:30.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.218+0000 7fe834ae2740 1 --2- 172.21.15.7:0/4186102385 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55edcaf2e080 0x55edcb3cc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:30.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.218+0000 7fe834ae2740 4 client.16209 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:39:30.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.218+0000 7fe834ae2740 1 -- 172.21.15.7:0/4186102385 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55edcb2b5860 con 0x55edcaf2e080 2024-09-21T06:39:30.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.218+0000 7fe81ffff640 1 --2- 172.21.15.7:0/4186102385 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55edcaf2e080 0x55edcb3cc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:30.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.219+0000 7fe81ffff640 1 --2- 172.21.15.7:0/4186102385 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55edcaf2e080 0x55edcb3cc9f0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d21dfa6313ce71a2 server_cookie=dcea86415e81c687 in_seq=0 out_seq=0 2024-09-21T06:39:30.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.219+0000 7fe8077fe640 10 client.16209 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:39:30.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.220+0000 7fe8077fe640 1 -- 172.21.15.7:0/4186102385 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55edcb2b5860 con 0x55edcaf2e080 2024-09-21T06:39:30.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.220+0000 7fe8077fe640 10 client.16209 handle_command_reply: tid=0 2024-09-21T06:39:30.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.220+0000 7fe834ae2740 1 client.16209 shutdown 2024-09-21T06:39:30.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.220+0000 7fe834ae2740 1 -- 172.21.15.7:0/4186102385 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55edcaf71490 msgr2=0x55edcb351720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:30.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.220+0000 7fe834ae2740 1 --2- 172.21.15.7:0/4186102385 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55edcaf71490 0x55edcb351720 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fe818009900 tx=0x7fe818005a20 comp rx=0 tx=0).stop 2024-09-21T06:39:30.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.220+0000 7fe834ae2740 1 -- 172.21.15.7:0/4186102385 shutdown_connections 2024-09-21T06:39:30.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.220+0000 7fe834ae2740 1 --2- 172.21.15.7:0/4186102385 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55edcaf2e080 0x55edcb3cc9f0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:30.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.221+0000 7fe834ae2740 1 --2- 172.21.15.7:0/4186102385 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55edcaf9a350 0x55edcb3c2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:30.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.221+0000 7fe8077fe640 0 client.16209 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:39:30.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.221+0000 7fe834ae2740 1 --2- 172.21.15.7:0/4186102385 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55edcaf79670 0x55edcb351d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:30.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.221+0000 7fe834ae2740 1 --2- 172.21.15.7:0/4186102385 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55edcaf71490 0x55edcb351720 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:30.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.221+0000 7fe834ae2740 1 -- 172.21.15.7:0/4186102385 >> 172.21.15.7:0/4186102385 conn(0x55edcaf8e740 msgr2=0x55edcb342e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:30.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.221+0000 7fe834ae2740 1 -- 172.21.15.7:0/4186102385 shutdown_connections 2024-09-21T06:39:30.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.221+0000 7fe834ae2740 1 -- 172.21.15.7:0/4186102385 wait complete. 2024-09-21T06:39:30.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.221+0000 7fe834ae2740 20 client.16209 trim_cache size 0 max 16384 2024-09-21T06:39:30.227 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:39:30.227 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0, 2024-09-21T06:39:30.227 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_tag": "13441782-2231-4713-8ebd-068a941de47f", 2024-09-21T06:39:30.227 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": "asynchronous" 2024-09-21T06:39:30.227 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:39:30.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.222+0000 7fe82e56e640 1 -- 172.21.15.7:0/4161660803 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fe8140b6680 msgr2=0x7fe8140b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:30.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.222+0000 7fe82e56e640 1 --2- 172.21.15.7:0/4161660803 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fe8140b6680 0x7fe8140b8b90 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe820005fd0 tx=0x7fe820009500 comp rx=0 tx=0).stop 2024-09-21T06:39:30.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.222+0000 7fe82e56e640 1 -- 172.21.15.7:0/4161660803 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8281083d0 msgr2=0x7fe828110520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:30.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.222+0000 7fe82e56e640 1 --2- 172.21.15.7:0/4161660803 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8281083d0 0x7fe828110520 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fe81000e9f0 tx=0x7fe81000eeb0 comp rx=0 tx=0).stop 2024-09-21T06:39:30.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.222+0000 7fe82e56e640 1 -- 172.21.15.7:0/4161660803 shutdown_connections 2024-09-21T06:39:30.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.222+0000 7fe82e56e640 1 --2- 172.21.15.7:0/4161660803 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fe8140b6680 0x7fe8140b8b90 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:30.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.222+0000 7fe82e56e640 1 --2- 172.21.15.7:0/4161660803 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe828108d20 0x7fe828110a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:30.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.222+0000 7fe82e56e640 1 --2- 172.21.15.7:0/4161660803 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe8281083d0 0x7fe828110520 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:30.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.222+0000 7fe82e56e640 1 --2- 172.21.15.7:0/4161660803 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe828102ae0 0x7fe82810ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:30.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.222+0000 7fe82e56e640 1 -- 172.21.15.7:0/4161660803 >> 172.21.15.7:0/4161660803 conn(0x7fe828079760 msgr2=0x7fe828101520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:30.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.222+0000 7fe82e56e640 1 -- 172.21.15.7:0/4161660803 shutdown_connections 2024-09-21T06:39:30.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:30.222+0000 7fe82e56e640 1 -- 172.21.15.7:0/4161660803 wait complete. 2024-09-21T06:39:31.025 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:39:31.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:39:30 smithi007 ceph-mon[30983]: pgmap v418: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:39:31.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:39:30 smithi007 ceph-mon[30983]: scrub queued for path: / 2024-09-21T06:39:31.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:39:30 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T06:39:31.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:39:30 smithi007 ceph-mon[30983]: scrub summary: active paths [/] 2024-09-21T06:39:31.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:39:30 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T06:39:31.282 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:39:31.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:39:30 smithi144 ceph-mon[34653]: pgmap v418: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:39:31.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:39:30 smithi144 ceph-mon[34653]: scrub queued for path: / 2024-09-21T06:39:31.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:39:30 smithi144 ceph-mon[34653]: scrub summary: idle+waiting paths [/] 2024-09-21T06:39:31.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:39:30 smithi144 ceph-mon[34653]: scrub summary: active paths [/] 2024-09-21T06:39:31.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:39:30 smithi144 ceph-mon[34653]: scrub summary: idle+waiting paths [/] 2024-09-21T06:39:31.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:39:30 smithi018 ceph-mon[34477]: pgmap v418: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:39:31.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:39:30 smithi018 ceph-mon[34477]: scrub queued for path: / 2024-09-21T06:39:31.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:39:30 smithi018 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-21T06:39:31.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:39:30 smithi018 ceph-mon[34477]: scrub summary: active paths [/] 2024-09-21T06:39:31.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:39:30 smithi018 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-21T06:39:31.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.776+0000 7fd339f53640 1 -- 172.21.15.7:0/1762655981 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd334108d20 msgr2=0x7fd33410f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:31.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.776+0000 7fd339f53640 1 --2- 172.21.15.7:0/1762655981 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd334108d20 0x7fd33410f550 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fd32c009ca0 tx=0x7fd32c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:39:31.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.776+0000 7fd339f53640 1 -- 172.21.15.7:0/1762655981 shutdown_connections 2024-09-21T06:39:31.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.776+0000 7fd339f53640 1 --2- 172.21.15.7:0/1762655981 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd334108d20 0x7fd33410f550 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:31.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.776+0000 7fd339f53640 1 --2- 172.21.15.7:0/1762655981 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd3341083d0 0x7fd3341087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:31.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.776+0000 7fd339f53640 1 --2- 172.21.15.7:0/1762655981 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd334102a90 0x7fd334102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:31.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.776+0000 7fd339f53640 1 -- 172.21.15.7:0/1762655981 >> 172.21.15.7:0/1762655981 conn(0x7fd334079750 msgr2=0x7fd334079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:31.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.776+0000 7fd339f53640 1 -- 172.21.15.7:0/1762655981 shutdown_connections 2024-09-21T06:39:31.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.776+0000 7fd339f53640 1 -- 172.21.15.7:0/1762655981 wait complete. 2024-09-21T06:39:31.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.777+0000 7fd339f53640 1 Processor -- start 2024-09-21T06:39:31.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.777+0000 7fd339f53640 1 -- start start 2024-09-21T06:39:31.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.778+0000 7fd339f53640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd334102a90 0x7fd3340ff5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:31.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.778+0000 7fd339f53640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd3341083d0 0x7fd3340ffb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:31.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.778+0000 7fd339f53640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd334108d20 0x7fd334100070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:31.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.778+0000 7fd339f53640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd334112990 con 0x7fd3341083d0 2024-09-21T06:39:31.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.778+0000 7fd339f53640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd334112810 con 0x7fd334108d20 2024-09-21T06:39:31.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.778+0000 7fd339f53640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd334112b10 con 0x7fd334102a90 2024-09-21T06:39:31.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.778+0000 7fd32affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd3341083d0 0x7fd3340ffb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:31.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.778+0000 7fd32affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd3341083d0 0x7fd3340ffb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41972/0 (socket says 172.21.15.7:41972) 2024-09-21T06:39:31.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.778+0000 7fd32affd640 1 -- 172.21.15.7:0/2255339556 learned_addr learned my addr 172.21.15.7:0/2255339556 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:39:31.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.778+0000 7fd3337fe640 1 --2- 172.21.15.7:0/2255339556 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd334102a90 0x7fd3340ff5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:31.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.778+0000 7fd333fff640 1 --2- 172.21.15.7:0/2255339556 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd334108d20 0x7fd334100070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:31.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.778+0000 7fd32affd640 1 -- 172.21.15.7:0/2255339556 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd334102a90 msgr2=0x7fd3340ff5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:31.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.778+0000 7fd32affd640 1 --2- 172.21.15.7:0/2255339556 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd334102a90 0x7fd3340ff5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:31.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.778+0000 7fd32affd640 1 -- 172.21.15.7:0/2255339556 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd334108d20 msgr2=0x7fd334100070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:31.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.778+0000 7fd32affd640 1 --2- 172.21.15.7:0/2255339556 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd334108d20 0x7fd334100070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:31.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.778+0000 7fd32affd640 1 -- 172.21.15.7:0/2255339556 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3341a8790 con 0x7fd3341083d0 2024-09-21T06:39:31.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.778+0000 7fd32affd640 1 --2- 172.21.15.7:0/2255339556 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd3341083d0 0x7fd3340ffb30 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fd31c00d740 tx=0x7fd31c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:31.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.779+0000 7fd3317fa640 1 -- 172.21.15.7:0/2255339556 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd31c017070 con 0x7fd3341083d0 2024-09-21T06:39:31.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.779+0000 7fd3317fa640 1 -- 172.21.15.7:0/2255339556 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd31c00de50 con 0x7fd3341083d0 2024-09-21T06:39:31.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.779+0000 7fd339f53640 1 -- 172.21.15.7:0/2255339556 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3341a8a80 con 0x7fd3341083d0 2024-09-21T06:39:31.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.779+0000 7fd3317fa640 1 -- 172.21.15.7:0/2255339556 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd31c004ce0 con 0x7fd3341083d0 2024-09-21T06:39:31.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.779+0000 7fd339f53640 1 -- 172.21.15.7:0/2255339556 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3341a8fc0 con 0x7fd3341083d0 2024-09-21T06:39:31.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.782+0000 7fd3404c7740 1 Processor -- start 2024-09-21T06:39:31.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.782+0000 7fd3404c7740 1 -- start start 2024-09-21T06:39:31.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.782+0000 7fd3404c7740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f51d5b5070 0x55f51d95c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:31.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.782+0000 7fd3404c7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f51d58c1b0 0x55f51d95c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:31.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.782+0000 7fd3404c7740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f51d594390 0x55f51d95ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:31.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.782+0000 7fd3404c7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f51d8d2e50 con 0x55f51d58c1b0 2024-09-21T06:39:31.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.782+0000 7fd3404c7740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f51d8c2280 con 0x55f51d5b5070 2024-09-21T06:39:31.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.782+0000 7fd3404c7740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55f51d8c6090 con 0x55f51d594390 2024-09-21T06:39:31.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.782+0000 7fd3337fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f51d58c1b0 0x55f51d95c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:31.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.782+0000 7fd3317fa640 1 -- 172.21.15.7:0/2255339556 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7fd31c004e80 con 0x7fd3341083d0 2024-09-21T06:39:31.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.782+0000 7fd3337fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f51d58c1b0 0x55f51d95c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41976/0 (socket says 172.21.15.7:41976) 2024-09-21T06:39:31.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.782+0000 7fd3337fe640 1 -- 172.21.15.7:0/2727063454 learned_addr learned my addr 172.21.15.7:0/2727063454 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:39:31.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.782+0000 7fd333fff640 1 --2- 172.21.15.7:0/2727063454 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f51d5b5070 0x55f51d95c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:31.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.782+0000 7fd3337fe640 1 -- 172.21.15.7:0/2727063454 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f51d594390 msgr2=0x55f51d95ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:31.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.782+0000 7fd3337fe640 1 --2- 172.21.15.7:0/2727063454 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f51d594390 0x55f51d95ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:31.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.782+0000 7fd3337fe640 1 -- 172.21.15.7:0/2727063454 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f51d5b5070 msgr2=0x55f51d95c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:31.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.782+0000 7fd3337fe640 1 --2- 172.21.15.7:0/2727063454 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f51d5b5070 0x55f51d95c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:31.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.782+0000 7fd3337fe640 1 -- 172.21.15.7:0/2727063454 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f51d620650 con 0x55f51d58c1b0 2024-09-21T06:39:31.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.782+0000 7fd333fff640 1 --2- 172.21.15.7:0/2727063454 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f51d5b5070 0x55f51d95c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:39:31.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.783+0000 7fd3337fe640 1 --2- 172.21.15.7:0/2727063454 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f51d58c1b0 0x55f51d95c7b0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fd32400bcb0 tx=0x7fd3240107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab637ca6f38e3a44 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:31.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.783+0000 7fd329ffb640 1 -- 172.21.15.7:0/2727063454 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd32401c480 con 0x55f51d58c1b0 2024-09-21T06:39:31.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.783+0000 7fd329ffb640 1 -- 172.21.15.7:0/2727063454 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd32401cad0 con 0x55f51d58c1b0 2024-09-21T06:39:31.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.783+0000 7fd329ffb640 1 -- 172.21.15.7:0/2727063454 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd324011c30 con 0x55f51d58c1b0 2024-09-21T06:39:31.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.783+0000 7fd3317fa640 1 --2- 172.21.15.7:0/2255339556 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fd3200b6700 0x7fd3200b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:31.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.783+0000 7fd333fff640 1 --2- 172.21.15.7:0/2255339556 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fd3200b6700 0x7fd3200b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:31.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.783+0000 7fd3317fa640 1 -- 172.21.15.7:0/2255339556 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fd31c0e6e90 con 0x7fd3341083d0 2024-09-21T06:39:31.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.784+0000 7fd3404c7740 1 -- 172.21.15.7:0/2727063454 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f51d58c1b0 msgr2=0x55f51d95c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:31.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.784+0000 7fd3404c7740 1 --2- 172.21.15.7:0/2727063454 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f51d58c1b0 0x55f51d95c7b0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fd32400bcb0 tx=0x7fd3240107a0 comp rx=0 tx=0).stop 2024-09-21T06:39:31.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.784+0000 7fd333fff640 1 --2- 172.21.15.7:0/2255339556 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fd3200b6700 0x7fd3200b8c10 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd32c006010 tx=0x7fd32c009480 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:31.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.784+0000 7fd3404c7740 1 -- 172.21.15.7:0/2727063454 shutdown_connections 2024-09-21T06:39:31.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.784+0000 7fd3404c7740 1 --2- 172.21.15.7:0/2727063454 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f51d594390 0x55f51d95ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:31.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.784+0000 7fd3404c7740 1 --2- 172.21.15.7:0/2727063454 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f51d58c1b0 0x55f51d95c7b0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:31.830 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:39:31.830 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T06:39:31.830 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": { 2024-09-21T06:39:31.831 INFO:teuthology.orchestra.run.smithi007.stdout: "13441782-2231-4713-8ebd-068a941de47f": { 2024-09-21T06:39:31.831 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:39:31.831 INFO:teuthology.orchestra.run.smithi007.stdout: "tag": "13441782-2231-4713-8ebd-068a941de47f", 2024-09-21T06:39:31.831 INFO:teuthology.orchestra.run.smithi007.stdout: "options": "recursive,force" 2024-09-21T06:39:31.831 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:39:31.831 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:39:31.831 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_stats": { 2024-09-21T06:39:31.831 INFO:teuthology.orchestra.run.smithi007.stdout: "d7b6a90c-9ae1-4e02-93ad-335a7e9df1d7": { 2024-09-21T06:39:31.831 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:39:19.226139+0000", 2024-09-21T06:39:31.831 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:39:31.831 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:39:31.831 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:39:31.831 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:39:31.831 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:39:31.832 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:39:31.832 INFO:teuthology.orchestra.run.smithi007.stdout: "b0327167-8c41-4286-8afc-7f0780972fd7": { 2024-09-21T06:39:31.832 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:38:36.828657+0000", 2024-09-21T06:39:31.832 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:39:31.832 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:39:31.832 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:39:31.832 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:39:31.832 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:39:31.832 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:39:31.832 INFO:teuthology.orchestra.run.smithi007.stdout: "13441782-2231-4713-8ebd-068a941de47f": { 2024-09-21T06:39:31.832 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:39:30.219006+0000", 2024-09-21T06:39:31.832 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:39:31.832 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:39:31.832 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:39:31.832 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:39:31.833 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:39:31.833 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:39:31.833 INFO:teuthology.orchestra.run.smithi007.stdout: "5cbaaba2-6ab1-4f83-abd6-8c6eef4b5c42": { 2024-09-21T06:39:31.833 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:37:46.566272+0000", 2024-09-21T06:39:31.833 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:39:31.833 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:39:31.833 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:39:31.833 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:39:31.833 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:39:31.833 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:39:31.833 INFO:teuthology.orchestra.run.smithi007.stdout: "6231e9c1-14a2-40b5-be3c-76d87a0d733b": { 2024-09-21T06:39:31.833 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:37:02.484812+0000", 2024-09-21T06:39:31.833 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:39:31.833 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:39:31.833 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:39:31.833 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:39:31.834 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:39:31.834 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:39:31.834 INFO:teuthology.orchestra.run.smithi007.stdout: "0b89345c-1f00-4efe-8ee9-4cb17e43584c": { 2024-09-21T06:39:31.834 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:36:19.500334+0000", 2024-09-21T06:39:31.834 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:39:31.834 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:39:31.834 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:39:31.834 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:39:31.834 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:39:31.834 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:39:31.834 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:39:31.834 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:39:31.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.784+0000 7fd3404c7740 1 --2- 172.21.15.7:0/2727063454 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f51d5b5070 0x55f51d95c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:31.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.784+0000 7fd3404c7740 1 -- 172.21.15.7:0/2727063454 >> 172.21.15.7:0/2727063454 conn(0x55f51d5a9460 msgr2=0x55f51d95a160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:31.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.784+0000 7fd3404c7740 1 -- 172.21.15.7:0/2727063454 shutdown_connections 2024-09-21T06:39:31.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.784+0000 7fd3404c7740 1 -- 172.21.15.7:0/2727063454 wait complete. 2024-09-21T06:39:31.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.784+0000 7fd3404c7740 1 -- start start 2024-09-21T06:39:31.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.785+0000 7fd3404c7740 1 Processor -- start 2024-09-21T06:39:31.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.785+0000 7fd3404c7740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f51d58c1b0 0x55f51d9679b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:31.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.785+0000 7fd3404c7740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f51d594390 0x55f51d967ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:31.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.785+0000 7fd3404c7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f51d5b5070 0x55f51d973d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:31.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.785+0000 7fd3404c7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55f51d723700 con 0x55f51d5b5070 2024-09-21T06:39:31.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.785+0000 7fd3404c7740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55f51d85d110 con 0x55f51d594390 2024-09-21T06:39:31.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.785+0000 7fd3404c7740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55f51d96aa50 con 0x55f51d58c1b0 2024-09-21T06:39:31.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.785+0000 7fd3404c7740 10 client.0 _ll_register_callbacks cb 0x55f51d876990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:39:31.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.785+0000 7fd333fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f51d5b5070 0x55f51d973d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:31.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.785+0000 7fd333fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f51d5b5070 0x55f51d973d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41990/0 (socket says 172.21.15.7:41990) 2024-09-21T06:39:31.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.785+0000 7fd333fff640 1 -- 172.21.15.7:0/488543231 learned_addr learned my addr 172.21.15.7:0/488543231 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:39:31.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.785+0000 7fd3337fe640 1 --2- 172.21.15.7:0/488543231 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f51d58c1b0 0x55f51d9679b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:31.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.785+0000 7fd32affd640 1 --2- 172.21.15.7:0/488543231 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f51d594390 0x55f51d967ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:31.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.786+0000 7fd333fff640 1 -- 172.21.15.7:0/488543231 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f51d58c1b0 msgr2=0x55f51d9679b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:31.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.786+0000 7fd333fff640 1 --2- 172.21.15.7:0/488543231 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f51d58c1b0 0x55f51d9679b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:31.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.786+0000 7fd333fff640 1 -- 172.21.15.7:0/488543231 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f51d594390 msgr2=0x55f51d967ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:31.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.786+0000 7fd333fff640 1 --2- 172.21.15.7:0/488543231 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f51d594390 0x55f51d967ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:31.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.786+0000 7fd333fff640 1 -- 172.21.15.7:0/488543231 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f51d88ac40 con 0x55f51d5b5070 2024-09-21T06:39:31.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.786+0000 7fd333fff640 1 --2- 172.21.15.7:0/488543231 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f51d5b5070 0x55f51d973d40 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fd32c009860 tx=0x7fd32c02a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=557f19bf40ebce27 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:31.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.786+0000 7fd312ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:39:31.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.786+0000 7fd312ffd640 1 -- 172.21.15.7:0/488543231 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd32c003d00 con 0x55f51d5b5070 2024-09-21T06:39:31.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.786+0000 7fd312ffd640 1 -- 172.21.15.7:0/488543231 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fd32c004040 con 0x55f51d5b5070 2024-09-21T06:39:31.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.786+0000 7fd3404c7740 1 -- 172.21.15.7:0/488543231 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd32401cad0 con 0x55f51d5b5070 2024-09-21T06:39:31.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.786+0000 7fd312ffd640 1 -- 172.21.15.7:0/488543231 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd32c004240 con 0x55f51d5b5070 2024-09-21T06:39:31.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.786+0000 7fd3404c7740 10 client.16221 fetch_fsmap learned FSMap version 25 2024-09-21T06:39:31.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.786+0000 7fd3404c7740 1 -- 172.21.15.7:0/488543231 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f51d976790 con 0x55f51d5b5070 2024-09-21T06:39:31.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.786+0000 7fd312ffd640 1 -- 172.21.15.7:0/488543231 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd32401cad0 con 0x55f51d5b5070 2024-09-21T06:39:31.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.787+0000 7fd312ffd640 1 -- 172.21.15.7:0/488543231 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd32c051070 con 0x55f51d5b5070 2024-09-21T06:39:31.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.787+0000 7fd3404c7740 10 client.16221 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:39:31.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.787+0000 7fd3404c7740 10 client.16221 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:39:31.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.787+0000 7fd3404c7740 20 client.16221 populate_metadata read hostname 'smithi007' 2024-09-21T06:39:31.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.787+0000 7fd3404c7740 1 --2- 172.21.15.7:0/488543231 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55f51d5739f0 0x55f51d979c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:31.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.787+0000 7fd3404c7740 4 client.16221 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:39:31.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.787+0000 7fd3404c7740 1 -- 172.21.15.7:0/488543231 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f51d8d4da0 con 0x55f51d5739f0 2024-09-21T06:39:31.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.787+0000 7fd3337fe640 1 --2- 172.21.15.7:0/488543231 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55f51d5739f0 0x55f51d979c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:31.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.788+0000 7fd3337fe640 1 --2- 172.21.15.7:0/488543231 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55f51d5739f0 0x55f51d979c30 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=236bf4777b4e78ad server_cookie=a8559610f48acdc6 in_seq=0 out_seq=0 2024-09-21T06:39:31.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.788+0000 7fd312ffd640 10 client.16221 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:39:31.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.788+0000 7fd312ffd640 1 -- 172.21.15.7:0/488543231 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f51d8d4da0 con 0x55f51d5739f0 2024-09-21T06:39:31.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.788+0000 7fd312ffd640 10 client.16221 handle_command_reply: tid=0 2024-09-21T06:39:31.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.788+0000 7fd3404c7740 1 client.16221 shutdown 2024-09-21T06:39:31.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.789+0000 7fd3404c7740 1 -- 172.21.15.7:0/488543231 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f51d5b5070 msgr2=0x55f51d973d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:31.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.789+0000 7fd3404c7740 1 --2- 172.21.15.7:0/488543231 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f51d5b5070 0x55f51d973d40 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fd32c009860 tx=0x7fd32c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:39:31.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.789+0000 7fd3404c7740 1 -- 172.21.15.7:0/488543231 shutdown_connections 2024-09-21T06:39:31.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.789+0000 7fd3404c7740 1 --2- 172.21.15.7:0/488543231 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55f51d5739f0 0x55f51d979c30 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:31.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.789+0000 7fd3404c7740 1 --2- 172.21.15.7:0/488543231 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f51d5b5070 0x55f51d973d40 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:31.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.789+0000 7fd3404c7740 1 --2- 172.21.15.7:0/488543231 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f51d594390 0x55f51d967ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:31.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.789+0000 7fd312ffd640 0 client.16221 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:39:31.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.789+0000 7fd3404c7740 1 --2- 172.21.15.7:0/488543231 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f51d58c1b0 0x55f51d9679b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:31.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.789+0000 7fd3404c7740 1 -- 172.21.15.7:0/488543231 >> 172.21.15.7:0/488543231 conn(0x55f51d5a9460 msgr2=0x55f51d95f450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:31.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.789+0000 7fd3404c7740 1 -- 172.21.15.7:0/488543231 shutdown_connections 2024-09-21T06:39:31.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.789+0000 7fd3404c7740 1 -- 172.21.15.7:0/488543231 wait complete. 2024-09-21T06:39:31.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.789+0000 7fd3404c7740 20 client.16221 trim_cache size 0 max 16384 2024-09-21T06:39:31.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.806+0000 7fd3404c7740 1 Processor -- start 2024-09-21T06:39:31.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.807+0000 7fd3404c7740 1 -- start start 2024-09-21T06:39:31.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.807+0000 7fd3404c7740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f51d58c1b0 0x55f51d95fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:31.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.807+0000 7fd3404c7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f51d594390 0x55f51d97f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:31.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.807+0000 7fd3404c7740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f51d5b5070 0x55f51d97f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:31.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.807+0000 7fd3404c7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd3341b3ff0 con 0x55f51d594390 2024-09-21T06:39:31.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.807+0000 7fd3404c7740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd3341b18c0 con 0x55f51d58c1b0 2024-09-21T06:39:31.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.807+0000 7fd3404c7740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd3341af710 con 0x55f51d5b5070 2024-09-21T06:39:31.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.807+0000 7fd32affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f51d594390 0x55f51d97f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:31.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.807+0000 7fd32affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f51d594390 0x55f51d97f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41996/0 (socket says 172.21.15.7:41996) 2024-09-21T06:39:31.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.807+0000 7fd32affd640 1 -- 172.21.15.7:0/1905855310 learned_addr learned my addr 172.21.15.7:0/1905855310 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:39:31.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.807+0000 7fd3337fe640 1 --2- 172.21.15.7:0/1905855310 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f51d58c1b0 0x55f51d95fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:31.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.807+0000 7fd333fff640 1 --2- 172.21.15.7:0/1905855310 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f51d5b5070 0x55f51d97f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:31.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.807+0000 7fd32affd640 1 -- 172.21.15.7:0/1905855310 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f51d5b5070 msgr2=0x55f51d97f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:31.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.807+0000 7fd32affd640 1 --2- 172.21.15.7:0/1905855310 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f51d5b5070 0x55f51d97f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:31.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.807+0000 7fd32affd640 1 -- 172.21.15.7:0/1905855310 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f51d58c1b0 msgr2=0x55f51d95fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:31.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.807+0000 7fd32affd640 1 --2- 172.21.15.7:0/1905855310 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f51d58c1b0 0x55f51d95fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:31.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.807+0000 7fd32affd640 1 -- 172.21.15.7:0/1905855310 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f51d968c70 con 0x55f51d594390 2024-09-21T06:39:31.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.807+0000 7fd333fff640 1 --2- 172.21.15.7:0/1905855310 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f51d5b5070 0x55f51d97f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:39:31.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.808+0000 7fd32affd640 1 --2- 172.21.15.7:0/1905855310 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f51d594390 0x55f51d97f390 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fd31c0a9400 tx=0x7fd31c0ac8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a0e6d7aca34731 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:31.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.808+0000 7fd3297fa640 1 -- 172.21.15.7:0/1905855310 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd31c020040 con 0x55f51d594390 2024-09-21T06:39:31.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.808+0000 7fd3297fa640 1 -- 172.21.15.7:0/1905855310 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd31c0b67a0 con 0x55f51d594390 2024-09-21T06:39:31.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.808+0000 7fd3297fa640 1 -- 172.21.15.7:0/1905855310 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd31c0d0300 con 0x55f51d594390 2024-09-21T06:39:31.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.808+0000 7fd3404c7740 1 -- 172.21.15.7:0/1905855310 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f51d594390 msgr2=0x55f51d97f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:31.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.808+0000 7fd3404c7740 1 --2- 172.21.15.7:0/1905855310 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f51d594390 0x55f51d97f390 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fd31c0a9400 tx=0x7fd31c0ac8a0 comp rx=0 tx=0).stop 2024-09-21T06:39:31.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.809+0000 7fd3404c7740 1 -- 172.21.15.7:0/1905855310 shutdown_connections 2024-09-21T06:39:31.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.809+0000 7fd3404c7740 1 --2- 172.21.15.7:0/1905855310 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f51d5b5070 0x55f51d97f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:31.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.809+0000 7fd3404c7740 1 --2- 172.21.15.7:0/1905855310 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f51d594390 0x55f51d97f390 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:31.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.809+0000 7fd3404c7740 1 --2- 172.21.15.7:0/1905855310 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f51d58c1b0 0x55f51d95fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:31.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.809+0000 7fd3404c7740 1 -- 172.21.15.7:0/1905855310 >> 172.21.15.7:0/1905855310 conn(0x55f51d5a9460 msgr2=0x55f51d95f370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:31.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.809+0000 7fd3404c7740 1 -- 172.21.15.7:0/1905855310 shutdown_connections 2024-09-21T06:39:31.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.809+0000 7fd3404c7740 1 -- 172.21.15.7:0/1905855310 wait complete. 2024-09-21T06:39:31.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.809+0000 7fd3404c7740 1 -- start start 2024-09-21T06:39:31.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.809+0000 7fd3404c7740 1 Processor -- start 2024-09-21T06:39:31.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.809+0000 7fd3404c7740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f51d58c1b0 0x55f51d96c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:31.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.810+0000 7fd3404c7740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f51d594390 0x55f51d96c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:31.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.810+0000 7fd3404c7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f51d5b5070 0x55f51d9e3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:31.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.810+0000 7fd3404c7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd3341afd80 con 0x55f51d5b5070 2024-09-21T06:39:31.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.810+0000 7fd3404c7740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd3341b11f0 con 0x55f51d594390 2024-09-21T06:39:31.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.810+0000 7fd3404c7740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd3341b0450 con 0x55f51d58c1b0 2024-09-21T06:39:31.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.810+0000 7fd3404c7740 10 client.0 _ll_register_callbacks cb 0x7fd32c009360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:39:31.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.810+0000 7fd333fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f51d5b5070 0x55f51d9e3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:31.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.810+0000 7fd3337fe640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f51d58c1b0 0x55f51d96c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:31.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.810+0000 7fd32affd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f51d594390 0x55f51d96c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:31.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.810+0000 7fd3337fe640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f51d58c1b0 0x55f51d96c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.7:45696/0 (socket says 172.21.15.7:45696) 2024-09-21T06:39:31.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.810+0000 7fd333fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f51d5b5070 0x55f51d9e3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42006/0 (socket says 172.21.15.7:42006) 2024-09-21T06:39:31.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.810+0000 7fd3337fe640 1 -- 172.21.15.7:0/2749697504 learned_addr learned my addr 172.21.15.7:0/2749697504 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:39:31.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.810+0000 7fd3337fe640 1 -- 172.21.15.7:0/2749697504 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f51d594390 msgr2=0x55f51d96c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:31.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.810+0000 7fd3337fe640 1 --2- 172.21.15.7:0/2749697504 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f51d594390 0x55f51d96c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:31.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.810+0000 7fd3337fe640 1 -- 172.21.15.7:0/2749697504 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f51d5b5070 msgr2=0x55f51d9e3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:39:31.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.810+0000 7fd3337fe640 1 --2- 172.21.15.7:0/2749697504 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f51d5b5070 0x55f51d9e3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:31.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.810+0000 7fd3337fe640 1 -- 172.21.15.7:0/2749697504 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f51d9e3b50 con 0x55f51d58c1b0 2024-09-21T06:39:31.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.810+0000 7fd333fff640 1 --2- 172.21.15.7:0/2749697504 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f51d5b5070 0x55f51d9e3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:39:31.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.810+0000 7fd32affd640 1 --2- 172.21.15.7:0/2749697504 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f51d594390 0x55f51d96c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:39:31.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.810+0000 7fd3337fe640 1 --2- 172.21.15.7:0/2749697504 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f51d58c1b0 0x55f51d96c430 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd32400bc80 tx=0x7fd3240115c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41b147e8350bcb0b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:39:31.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.810+0000 7fd312ffd640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-21T06:39:31.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.811+0000 7fd312ffd640 1 -- 172.21.15.7:0/2749697504 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd324005450 con 0x55f51d58c1b0 2024-09-21T06:39:31.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.811+0000 7fd3404c7740 1 -- 172.21.15.7:0/2749697504 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd31c0b67a0 con 0x55f51d58c1b0 2024-09-21T06:39:31.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.811+0000 7fd312ffd640 1 -- 172.21.15.7:0/2749697504 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fd3240055f0 con 0x55f51d58c1b0 2024-09-21T06:39:31.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.811+0000 7fd312ffd640 1 -- 172.21.15.7:0/2749697504 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd324034030 con 0x55f51d58c1b0 2024-09-21T06:39:31.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.811+0000 7fd3404c7740 10 client.25735 fetch_fsmap learned FSMap version 25 2024-09-21T06:39:31.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.811+0000 7fd3404c7740 1 -- 172.21.15.7:0/2749697504 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f51d9e4de0 con 0x55f51d58c1b0 2024-09-21T06:39:31.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.811+0000 7fd312ffd640 1 -- 172.21.15.7:0/2749697504 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd31c0b67a0 con 0x55f51d58c1b0 2024-09-21T06:39:31.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.811+0000 7fd312ffd640 1 -- 172.21.15.7:0/2749697504 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd324003970 con 0x55f51d58c1b0 2024-09-21T06:39:31.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.811+0000 7fd3404c7740 10 client.25735 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:39:31.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.811+0000 7fd3404c7740 10 client.25735 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:39:31.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.811+0000 7fd3404c7740 20 client.25735 populate_metadata read hostname 'smithi007' 2024-09-21T06:39:31.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.811+0000 7fd3404c7740 1 --2- 172.21.15.7:0/2749697504 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55f51d548da0 0x55f51d9e7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:39:31.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.811+0000 7fd3404c7740 4 client.25735 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:39:31.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.811+0000 7fd3404c7740 1 -- 172.21.15.7:0/2749697504 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f51d8d0850 con 0x55f51d548da0 2024-09-21T06:39:31.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.812+0000 7fd32affd640 1 --2- 172.21.15.7:0/2749697504 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55f51d548da0 0x55f51d9e7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:39:31.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.812+0000 7fd32affd640 1 --2- 172.21.15.7:0/2749697504 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55f51d548da0 0x55f51d9e7270 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec5bbaac430dbe4c server_cookie=5173137bee3d6ffd in_seq=0 out_seq=0 2024-09-21T06:39:31.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.812+0000 7fd312ffd640 10 client.25735 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:39:31.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.813+0000 7fd312ffd640 1 -- 172.21.15.7:0/2749697504 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1990 (crc 0 0 0) 0x55f51d8d0850 con 0x55f51d548da0 2024-09-21T06:39:31.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.813+0000 7fd312ffd640 10 client.25735 handle_command_reply: tid=0 2024-09-21T06:39:31.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.813+0000 7fd3404c7740 1 client.25735 shutdown 2024-09-21T06:39:31.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.813+0000 7fd3404c7740 1 -- 172.21.15.7:0/2749697504 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f51d58c1b0 msgr2=0x55f51d96c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:31.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.813+0000 7fd3404c7740 1 --2- 172.21.15.7:0/2749697504 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f51d58c1b0 0x55f51d96c430 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd32400bc80 tx=0x7fd3240115c0 comp rx=0 tx=0).stop 2024-09-21T06:39:31.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.813+0000 7fd3404c7740 1 -- 172.21.15.7:0/2749697504 shutdown_connections 2024-09-21T06:39:31.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.813+0000 7fd3404c7740 1 --2- 172.21.15.7:0/2749697504 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55f51d548da0 0x55f51d9e7270 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:31.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.813+0000 7fd3404c7740 1 --2- 172.21.15.7:0/2749697504 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55f51d5b5070 0x55f51d9e3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:31.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.813+0000 7fd3404c7740 1 --2- 172.21.15.7:0/2749697504 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55f51d594390 0x55f51d96c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:31.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.813+0000 7fd3404c7740 1 --2- 172.21.15.7:0/2749697504 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55f51d58c1b0 0x55f51d96c430 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:31.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.813+0000 7fd312ffd640 0 client.25735 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:39:31.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.813+0000 7fd3404c7740 1 -- 172.21.15.7:0/2749697504 >> 172.21.15.7:0/2749697504 conn(0x55f51d5a9460 msgr2=0x55f51d965e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:31.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.813+0000 7fd3404c7740 1 -- 172.21.15.7:0/2749697504 shutdown_connections 2024-09-21T06:39:31.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.813+0000 7fd3404c7740 1 -- 172.21.15.7:0/2749697504 wait complete. 2024-09-21T06:39:31.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.813+0000 7fd3404c7740 20 client.25735 trim_cache size 0 max 16384 2024-09-21T06:39:31.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.814+0000 7fd339f53640 1 -- 172.21.15.7:0/2255339556 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fd3200b6700 msgr2=0x7fd3200b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:31.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.814+0000 7fd339f53640 1 --2- 172.21.15.7:0/2255339556 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fd3200b6700 0x7fd3200b8c10 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd32c006010 tx=0x7fd32c009480 comp rx=0 tx=0).stop 2024-09-21T06:39:31.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.814+0000 7fd339f53640 1 -- 172.21.15.7:0/2255339556 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd3341083d0 msgr2=0x7fd3340ffb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:39:31.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.814+0000 7fd339f53640 1 --2- 172.21.15.7:0/2255339556 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd3341083d0 0x7fd3340ffb30 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fd31c00d740 tx=0x7fd31c00dc00 comp rx=0 tx=0).stop 2024-09-21T06:39:31.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.814+0000 7fd339f53640 1 -- 172.21.15.7:0/2255339556 shutdown_connections 2024-09-21T06:39:31.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.814+0000 7fd339f53640 1 --2- 172.21.15.7:0/2255339556 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fd3200b6700 0x7fd3200b8c10 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:31.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.814+0000 7fd339f53640 1 --2- 172.21.15.7:0/2255339556 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd334108d20 0x7fd334100070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:31.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.814+0000 7fd339f53640 1 --2- 172.21.15.7:0/2255339556 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd3341083d0 0x7fd3340ffb30 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:31.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.814+0000 7fd339f53640 1 --2- 172.21.15.7:0/2255339556 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd334102a90 0x7fd3340ff5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:39:31.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.814+0000 7fd339f53640 1 -- 172.21.15.7:0/2255339556 >> 172.21.15.7:0/2255339556 conn(0x7fd334079750 msgr2=0x7fd33406bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:39:31.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.814+0000 7fd339f53640 1 -- 172.21.15.7:0/2255339556 shutdown_connections 2024-09-21T06:39:31.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:39:31.814+0000 7fd339f53640 1 -- 172.21.15.7:0/2255339556 wait complete. 2024-09-21T06:39:32.647 INFO:tasks.cephfs.filesystem:scrub status for tag:13441782-2231-4713-8ebd-068a941de47f - {'path': '/', 'tag': '13441782-2231-4713-8ebd-068a941de47f', 'options': 'recursive,force'} 2024-09-21T06:39:33.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:39:32 smithi144 ceph-mon[34653]: pgmap v419: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 7 op/s 2024-09-21T06:39:33.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:39:32 smithi007 ceph-mon[30983]: pgmap v419: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 7 op/s 2024-09-21T06:39:33.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:39:32 smithi018 ceph-mon[34477]: pgmap v419: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 7 op/s 2024-09-21T06:39:35.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:39:34 smithi144 ceph-mon[34653]: pgmap v420: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 8 op/s 2024-09-21T06:39:35.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:39:34 smithi144 ceph-mon[34653]: scrub summary: idle 2024-09-21T06:39:35.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:39:34 smithi007 ceph-mon[30983]: pgmap v420: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 8 op/s 2024-09-21T06:39:35.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:39:34 smithi007 ceph-mon[30983]: scrub summary: idle 2024-09-21T06:39:35.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:39:34 smithi018 ceph-mon[34477]: pgmap v420: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 8 op/s 2024-09-21T06:39:35.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:39:34 smithi018 ceph-mon[34477]: scrub summary: idle 2024-09-21T06:39:36.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:39:35 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:39:36.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:39:35 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:39:36.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:39:35 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:39:36.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:39:35 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:39:36.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:39:35 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:39:36.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:39:35 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:39:36.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:39:35 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:39:36.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:39:35 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:39:36.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:39:35 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:39:36.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:39:35 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:39:36.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:39:35 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:39:36.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:39:35 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:39:37.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:39:36 smithi144 ceph-mon[34653]: pgmap v421: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-09-21T06:39:37.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:39:36 smithi007 ceph-mon[30983]: pgmap v421: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-09-21T06:39:37.370 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:39:36 smithi018 ceph-mon[34477]: pgmap v421: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-09-21T06:39:39.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:39:38 smithi144 ceph-mon[34653]: pgmap v422: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6 op/s 2024-09-21T06:39:39.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:39:38 smithi007 ceph-mon[30983]: pgmap v422: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6 op/s 2024-09-21T06:39:39.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:39:38 smithi018 ceph-mon[34477]: pgmap v422: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6 op/s 2024-09-21T06:39:40.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:39:40 smithi007 ceph-mon[30983]: pgmap v423: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:39:40.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:39:40 smithi018 ceph-mon[34477]: pgmap v423: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:39:40.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:39:40 smithi144 ceph-mon[34653]: pgmap v423: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:39:42.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:39:42 smithi144 ceph-mon[34653]: pgmap v424: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6 op/s 2024-09-21T06:39:42.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:39:42 smithi007 ceph-mon[30983]: pgmap v424: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6 op/s 2024-09-21T06:39:42.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:39:42 smithi018 ceph-mon[34477]: pgmap v424: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6 op/s 2024-09-21T06:39:44.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:39:44 smithi007 ceph-mon[30983]: pgmap v425: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 7 op/s 2024-09-21T06:39:44.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:39:44 smithi018 ceph-mon[34477]: pgmap v425: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 7 op/s 2024-09-21T06:39:44.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:39:44 smithi144 ceph-mon[34653]: pgmap v425: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 7 op/s 2024-09-21T06:39:46.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:39:46 smithi007 ceph-mon[30983]: pgmap v426: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:39:46.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:39:46 smithi018 ceph-mon[34477]: pgmap v426: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:39:46.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:39:46 smithi144 ceph-mon[34653]: pgmap v426: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:39:48.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:39:48 smithi007 ceph-mon[30983]: pgmap v427: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:39:48.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:39:48 smithi018 ceph-mon[34477]: pgmap v427: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:39:48.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:39:48 smithi144 ceph-mon[34653]: pgmap v427: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:39:50.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:39:50 smithi007 ceph-mon[30983]: pgmap v428: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:39:50.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:39:50 smithi018 ceph-mon[34477]: pgmap v428: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:39:50.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:39:50 smithi144 ceph-mon[34653]: pgmap v428: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:39:52.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:39:52 smithi007 ceph-mon[30983]: pgmap v429: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:39:52.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:39:52 smithi018 ceph-mon[34477]: pgmap v429: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:39:52.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:39:52 smithi144 ceph-mon[34653]: pgmap v429: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:39:54.589 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:39:54 smithi007 ceph-mon[30983]: pgmap v430: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:39:54.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:39:54 smithi018 ceph-mon[34477]: pgmap v430: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:39:54.786 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:39:54 smithi144 ceph-mon[34653]: pgmap v430: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:39:56.589 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:39:56 smithi007 ceph-mon[30983]: pgmap v431: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:39:56.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:39:56 smithi018 ceph-mon[34477]: pgmap v431: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:39:56.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:39:56 smithi144 ceph-mon[34653]: pgmap v431: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:39:58.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:39:58 smithi007 ceph-mon[30983]: pgmap v432: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:39:58.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:39:58 smithi018 ceph-mon[34477]: pgmap v432: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:39:58.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:39:58 smithi144 ceph-mon[34653]: pgmap v432: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:40:00.587 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:40:00 smithi144 ceph-mon[34653]: pgmap v433: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:40:00.587 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:40:00 smithi144 ceph-mon[34653]: overall HEALTH_OK 2024-09-21T06:40:00.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:40:00 smithi007 ceph-mon[30983]: pgmap v433: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:40:00.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:40:00 smithi007 ceph-mon[30983]: overall HEALTH_OK 2024-09-21T06:40:00.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:40:00 smithi018 ceph-mon[34477]: pgmap v433: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:40:00.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:40:00 smithi018 ceph-mon[34477]: overall HEALTH_OK 2024-09-21T06:40:02.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:40:02 smithi007 ceph-mon[30983]: pgmap v434: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:40:02.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:40:02 smithi018 ceph-mon[34477]: pgmap v434: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:40:02.648 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:40:02.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:40:02 smithi144 ceph-mon[34653]: pgmap v434: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:40:02.926 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:40:03.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.563+0000 7f1a4a650640 1 -- 172.21.15.7:0/1991966072 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a441083a0 msgr2=0x7f1a441087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:03.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.563+0000 7f1a4a650640 1 --2- 172.21.15.7:0/1991966072 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a441083a0 0x7f1a441087b0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f1a38009900 tx=0x7f1a3802a410 comp rx=0 tx=0).stop 2024-09-21T06:40:03.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.563+0000 7f1a4a650640 1 -- 172.21.15.7:0/1991966072 shutdown_connections 2024-09-21T06:40:03.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.563+0000 7f1a4a650640 1 --2- 172.21.15.7:0/1991966072 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a44108cf0 0x7f1a4410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:03.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.563+0000 7f1a4a650640 1 --2- 172.21.15.7:0/1991966072 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a441083a0 0x7f1a441087b0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:03.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.563+0000 7f1a4a650640 1 --2- 172.21.15.7:0/1991966072 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a44102a60 0x7f1a44102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:03.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.563+0000 7f1a4a650640 1 -- 172.21.15.7:0/1991966072 >> 172.21.15.7:0/1991966072 conn(0x7f1a44079730 msgr2=0x7f1a44079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:03.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.563+0000 7f1a4a650640 1 -- 172.21.15.7:0/1991966072 shutdown_connections 2024-09-21T06:40:03.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.563+0000 7f1a4a650640 1 -- 172.21.15.7:0/1991966072 wait complete. 2024-09-21T06:40:03.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.564+0000 7f1a4a650640 1 Processor -- start 2024-09-21T06:40:03.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.564+0000 7f1a4a650640 1 -- start start 2024-09-21T06:40:03.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.564+0000 7f1a4a650640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a44102a60 0x7f1a4419b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:03.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.564+0000 7f1a4a650640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a441083a0 0x7f1a4419b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:03.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.564+0000 7f1a4a650640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a44108cf0 0x7f1a4419bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:03.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.564+0000 7f1a4a650640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1a44112960 con 0x7f1a44108cf0 2024-09-21T06:40:03.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.564+0000 7f1a4a650640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1a441127e0 con 0x7f1a441083a0 2024-09-21T06:40:03.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.564+0000 7f1a4a650640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1a44112ae0 con 0x7f1a44102a60 2024-09-21T06:40:03.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.564+0000 7f1a48bed640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a44108cf0 0x7f1a4419bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:03.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.564+0000 7f1a48bed640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a44108cf0 0x7f1a4419bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59164/0 (socket says 172.21.15.7:59164) 2024-09-21T06:40:03.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.564+0000 7f1a48bed640 1 -- 172.21.15.7:0/266125007 learned_addr learned my addr 172.21.15.7:0/266125007 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:40:03.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.565+0000 7f1a43fff640 1 --2- 172.21.15.7:0/266125007 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a44102a60 0x7f1a4419b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:03.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.565+0000 7f1a437fe640 1 --2- 172.21.15.7:0/266125007 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a441083a0 0x7f1a4419b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:03.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.565+0000 7f1a48bed640 1 -- 172.21.15.7:0/266125007 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a44102a60 msgr2=0x7f1a4419b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:03.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.565+0000 7f1a48bed640 1 --2- 172.21.15.7:0/266125007 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a44102a60 0x7f1a4419b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:03.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.565+0000 7f1a48bed640 1 -- 172.21.15.7:0/266125007 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a441083a0 msgr2=0x7f1a4419b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:03.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.565+0000 7f1a48bed640 1 --2- 172.21.15.7:0/266125007 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a441083a0 0x7f1a4419b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:03.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.565+0000 7f1a48bed640 1 -- 172.21.15.7:0/266125007 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a441a65a0 con 0x7f1a44108cf0 2024-09-21T06:40:03.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.565+0000 7f1a437fe640 1 --2- 172.21.15.7:0/266125007 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a441083a0 0x7f1a4419b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:40:03.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.565+0000 7f1a48bed640 1 --2- 172.21.15.7:0/266125007 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a44108cf0 0x7f1a4419bd10 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c00eaa0 tx=0x7f1a3c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:03.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.565+0000 7f1a417fa640 1 -- 172.21.15.7:0/266125007 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a3c00cdb0 con 0x7f1a44108cf0 2024-09-21T06:40:03.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.565+0000 7f1a417fa640 1 -- 172.21.15.7:0/266125007 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a3c005020 con 0x7f1a44108cf0 2024-09-21T06:40:03.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.565+0000 7f1a4a650640 1 -- 172.21.15.7:0/266125007 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a441a6890 con 0x7f1a44108cf0 2024-09-21T06:40:03.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.565+0000 7f1a417fa640 1 -- 172.21.15.7:0/266125007 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a3c0116d0 con 0x7f1a44108cf0 2024-09-21T06:40:03.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.565+0000 7f1a4a650640 1 -- 172.21.15.7:0/266125007 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a441a6df0 con 0x7f1a44108cf0 2024-09-21T06:40:03.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.568+0000 7f1a417fa640 1 -- 172.21.15.7:0/266125007 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f1a3c0051d0 con 0x7f1a44108cf0 2024-09-21T06:40:03.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.568+0000 7f1a50bc4740 1 Processor -- start 2024-09-21T06:40:03.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.568+0000 7f1a50bc4740 1 -- start start 2024-09-21T06:40:03.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.569+0000 7f1a50bc4740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575711db070 0x557571582270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:03.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.569+0000 7f1a50bc4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575711b21b0 0x5575715827b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:03.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.569+0000 7f1a50bc4740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575711ba390 0x557571582cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:03.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.569+0000 7f1a50bc4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5575714f8e50 con 0x5575711b21b0 2024-09-21T06:40:03.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.569+0000 7f1a50bc4740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5575714e8280 con 0x5575711db070 2024-09-21T06:40:03.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.569+0000 7f1a50bc4740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5575714ec090 con 0x5575711ba390 2024-09-21T06:40:03.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.569+0000 7f1a43fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575711b21b0 0x5575715827b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:03.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.569+0000 7f1a43fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575711b21b0 0x5575715827b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59180/0 (socket says 172.21.15.7:59180) 2024-09-21T06:40:03.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.569+0000 7f1a43fff640 1 -- 172.21.15.7:0/2019891993 learned_addr learned my addr 172.21.15.7:0/2019891993 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:40:03.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.569+0000 7f1a437fe640 1 --2- 172.21.15.7:0/2019891993 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575711ba390 0x557571582cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:03.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.569+0000 7f1a417fa640 1 --2- 172.21.15.7:0/266125007 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f1a2c0b6700 0x7f1a2c0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:03.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.569+0000 7f1a437fe640 1 --2- 172.21.15.7:0/2019891993 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575711db070 0x557571582270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:03.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.569+0000 7f1a48bed640 1 --2- 172.21.15.7:0/266125007 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f1a2c0b6700 0x7f1a2c0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:03.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.569+0000 7f1a437fe640 1 -- 172.21.15.7:0/2019891993 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575711db070 msgr2=0x557571582270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:03.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.569+0000 7f1a417fa640 1 -- 172.21.15.7:0/266125007 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f1a3c0e7720 con 0x7f1a44108cf0 2024-09-21T06:40:03.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.569+0000 7f1a437fe640 1 --2- 172.21.15.7:0/2019891993 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575711db070 0x557571582270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:03.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.569+0000 7f1a437fe640 1 -- 172.21.15.7:0/2019891993 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575711b21b0 msgr2=0x5575715827b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:03.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.569+0000 7f1a437fe640 1 --2- 172.21.15.7:0/2019891993 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575711b21b0 0x5575715827b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:03.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.569+0000 7f1a437fe640 1 -- 172.21.15.7:0/2019891993 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557571246650 con 0x5575711ba390 2024-09-21T06:40:03.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.569+0000 7f1a43fff640 1 --2- 172.21.15.7:0/2019891993 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575711b21b0 0x5575715827b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:40:03.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.570+0000 7f1a437fe640 1 --2- 172.21.15.7:0/2019891993 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575711ba390 0x557571582cf0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1a38006010 tx=0x7f1a380058d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=386e9691e704f963 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:03.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.570+0000 7f1a48bed640 1 --2- 172.21.15.7:0/266125007 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f1a2c0b6700 0x7f1a2c0b8c10 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c0aa880 tx=0x7f1a3c07a2c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:03.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.570+0000 7f1a2a7fc640 1 -- 172.21.15.7:0/2019891993 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a38035040 con 0x5575711ba390 2024-09-21T06:40:03.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.570+0000 7f1a2a7fc640 1 -- 172.21.15.7:0/2019891993 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a380035f0 con 0x5575711ba390 2024-09-21T06:40:03.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.570+0000 7f1a2a7fc640 1 -- 172.21.15.7:0/2019891993 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a380044e0 con 0x5575711ba390 2024-09-21T06:40:03.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.571+0000 7f1a50bc4740 1 -- 172.21.15.7:0/2019891993 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575711ba390 msgr2=0x557571582cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:03.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.571+0000 7f1a50bc4740 1 --2- 172.21.15.7:0/2019891993 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575711ba390 0x557571582cf0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1a38006010 tx=0x7f1a380058d0 comp rx=0 tx=0).stop 2024-09-21T06:40:03.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.571+0000 7f1a50bc4740 1 -- 172.21.15.7:0/2019891993 shutdown_connections 2024-09-21T06:40:03.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.571+0000 7f1a50bc4740 1 --2- 172.21.15.7:0/2019891993 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575711ba390 0x557571582cf0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:03.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.571+0000 7f1a50bc4740 1 --2- 172.21.15.7:0/2019891993 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575711b21b0 0x5575715827b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:03.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.571+0000 7f1a50bc4740 1 --2- 172.21.15.7:0/2019891993 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575711db070 0x557571582270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:03.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.571+0000 7f1a50bc4740 1 -- 172.21.15.7:0/2019891993 >> 172.21.15.7:0/2019891993 conn(0x5575711cf460 msgr2=0x557571580160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:03.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.571+0000 7f1a50bc4740 1 -- 172.21.15.7:0/2019891993 shutdown_connections 2024-09-21T06:40:03.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.571+0000 7f1a50bc4740 1 -- 172.21.15.7:0/2019891993 wait complete. 2024-09-21T06:40:03.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.571+0000 7f1a50bc4740 1 -- start start 2024-09-21T06:40:03.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.571+0000 7f1a50bc4740 1 Processor -- start 2024-09-21T06:40:03.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.572+0000 7f1a50bc4740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575711b21b0 0x55757158d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:03.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.572+0000 7f1a50bc4740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575711ba390 0x55757158def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:03.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.572+0000 7f1a50bc4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575711db070 0x557571599ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:03.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.572+0000 7f1a50bc4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x557571349700 con 0x5575711db070 2024-09-21T06:40:03.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.572+0000 7f1a50bc4740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x557571483110 con 0x5575711b21b0 2024-09-21T06:40:03.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.572+0000 7f1a50bc4740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5575715909f0 con 0x5575711ba390 2024-09-21T06:40:03.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.572+0000 7f1a50bc4740 10 client.0 _ll_register_callbacks cb 0x55757149c990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:40:03.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.572+0000 7f1a437fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575711db070 0x557571599ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:03.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.572+0000 7f1a437fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575711db070 0x557571599ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59188/0 (socket says 172.21.15.7:59188) 2024-09-21T06:40:03.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.572+0000 7f1a437fe640 1 -- 172.21.15.7:0/1939428645 learned_addr learned my addr 172.21.15.7:0/1939428645 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:40:03.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.572+0000 7f1a43fff640 1 --2- 172.21.15.7:0/1939428645 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575711ba390 0x55757158def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:03.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.572+0000 7f1a437fe640 1 --2- 172.21.15.7:0/1939428645 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575711b21b0 0x55757158d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:03.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.572+0000 7f1a437fe640 1 -- 172.21.15.7:0/1939428645 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575711ba390 msgr2=0x55757158def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:03.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.572+0000 7f1a437fe640 1 --2- 172.21.15.7:0/1939428645 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575711ba390 0x55757158def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:03.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.572+0000 7f1a437fe640 1 -- 172.21.15.7:0/1939428645 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575711b21b0 msgr2=0x55757158d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:03.700 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.572+0000 7f1a437fe640 1 --2- 172.21.15.7:0/1939428645 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575711b21b0 0x55757158d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:03.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.572+0000 7f1a437fe640 1 -- 172.21.15.7:0/1939428645 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575714b0c40 con 0x5575711db070 2024-09-21T06:40:03.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.573+0000 7f1a437fe640 1 --2- 172.21.15.7:0/1939428645 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575711db070 0x557571599ce0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f1a38032fd0 tx=0x7f1a38003ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea6c07648b065325 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:03.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.573+0000 7f1a237fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:40:03.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.573+0000 7f1a237fe640 1 -- 172.21.15.7:0/1939428645 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a38055060 con 0x5575711db070 2024-09-21T06:40:03.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.573+0000 7f1a237fe640 1 -- 172.21.15.7:0/1939428645 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f1a38004270 con 0x5575711db070 2024-09-21T06:40:03.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.573+0000 7f1a50bc4740 1 -- 172.21.15.7:0/1939428645 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a380035f0 con 0x5575711db070 2024-09-21T06:40:03.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.573+0000 7f1a237fe640 1 -- 172.21.15.7:0/1939428645 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1a38035030 con 0x5575711db070 2024-09-21T06:40:03.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.573+0000 7f1a50bc4740 10 client.16239 fetch_fsmap learned FSMap version 25 2024-09-21T06:40:03.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.573+0000 7f1a50bc4740 1 -- 172.21.15.7:0/1939428645 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55757159c780 con 0x5575711db070 2024-09-21T06:40:03.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.573+0000 7f1a237fe640 1 -- 172.21.15.7:0/1939428645 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a380035f0 con 0x5575711db070 2024-09-21T06:40:03.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.573+0000 7f1a237fe640 1 -- 172.21.15.7:0/1939428645 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f1a3803a040 con 0x5575711db070 2024-09-21T06:40:03.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.573+0000 7f1a50bc4740 10 client.16239 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:40:03.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.573+0000 7f1a50bc4740 10 client.16239 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:40:03.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.574+0000 7f1a50bc4740 20 client.16239 populate_metadata read hostname 'smithi007' 2024-09-21T06:40:03.701 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.574+0000 7f1a50bc4740 1 --2- 172.21.15.7:0/1939428645 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5575711999f0 0x55757159fae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:03.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.574+0000 7f1a50bc4740 4 client.16239 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:40:03.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.574+0000 7f1a50bc4740 1 -- 172.21.15.7:0/1939428645 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5575714fada0 con 0x5575711999f0 2024-09-21T06:40:03.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.574+0000 7f1a43fff640 1 --2- 172.21.15.7:0/1939428645 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5575711999f0 0x55757159fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:03.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.574+0000 7f1a43fff640 1 --2- 172.21.15.7:0/1939428645 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5575711999f0 0x55757159fae0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65eb1c26c55f876a server_cookie=e733449690ee964b in_seq=0 out_seq=0 2024-09-21T06:40:03.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.574+0000 7f1a237fe640 10 client.16239 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:40:03.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.575+0000 7f1a237fe640 1 -- 172.21.15.7:0/1939428645 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5575714fada0 con 0x5575711999f0 2024-09-21T06:40:03.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.575+0000 7f1a237fe640 10 client.16239 handle_command_reply: tid=0 2024-09-21T06:40:03.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.575+0000 7f1a50bc4740 1 client.16239 shutdown 2024-09-21T06:40:03.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.575+0000 7f1a50bc4740 1 -- 172.21.15.7:0/1939428645 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575711db070 msgr2=0x557571599ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:03.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.575+0000 7f1a50bc4740 1 --2- 172.21.15.7:0/1939428645 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575711db070 0x557571599ce0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f1a38032fd0 tx=0x7f1a38003ed0 comp rx=0 tx=0).stop 2024-09-21T06:40:03.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.575+0000 7f1a50bc4740 1 -- 172.21.15.7:0/1939428645 shutdown_connections 2024-09-21T06:40:03.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.576+0000 7f1a50bc4740 1 --2- 172.21.15.7:0/1939428645 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5575711999f0 0x55757159fae0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:03.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.576+0000 7f1a50bc4740 1 --2- 172.21.15.7:0/1939428645 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575711db070 0x557571599ce0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:03.702 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.576+0000 7f1a50bc4740 1 --2- 172.21.15.7:0/1939428645 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575711ba390 0x55757158def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:03.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.576+0000 7f1a50bc4740 1 --2- 172.21.15.7:0/1939428645 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575711b21b0 0x55757158d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:03.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.576+0000 7f1a237fe640 0 client.16239 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:40:03.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.576+0000 7f1a50bc4740 1 -- 172.21.15.7:0/1939428645 >> 172.21.15.7:0/1939428645 conn(0x5575711cf460 msgr2=0x557571585450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:03.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.576+0000 7f1a50bc4740 1 -- 172.21.15.7:0/1939428645 shutdown_connections 2024-09-21T06:40:03.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.576+0000 7f1a50bc4740 1 -- 172.21.15.7:0/1939428645 wait complete. 2024-09-21T06:40:03.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.576+0000 7f1a50bc4740 20 client.16239 trim_cache size 0 max 16384 2024-09-21T06:40:03.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.593+0000 7f1a50bc4740 1 Processor -- start 2024-09-21T06:40:03.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.593+0000 7f1a50bc4740 1 -- start start 2024-09-21T06:40:03.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.594+0000 7f1a50bc4740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575711b21b0 0x55757158f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:03.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.594+0000 7f1a50bc4740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575711ba390 0x557571599c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:03.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.594+0000 7f1a50bc4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575711db070 0x55757158aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:03.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.594+0000 7f1a50bc4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1a441b1de0 con 0x5575711db070 2024-09-21T06:40:03.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.594+0000 7f1a50bc4740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1a441af6b0 con 0x5575711ba390 2024-09-21T06:40:03.703 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.594+0000 7f1a50bc4740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1a441ad500 con 0x5575711b21b0 2024-09-21T06:40:03.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.594+0000 7f1a437fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575711db070 0x55757158aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:03.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.594+0000 7f1a437fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575711db070 0x55757158aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59198/0 (socket says 172.21.15.7:59198) 2024-09-21T06:40:03.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.594+0000 7f1a437fe640 1 -- 172.21.15.7:0/1290696108 learned_addr learned my addr 172.21.15.7:0/1290696108 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:40:03.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.594+0000 7f1a437fe640 1 --2- 172.21.15.7:0/1290696108 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575711b21b0 0x55757158f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:03.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.594+0000 7f1a43fff640 1 --2- 172.21.15.7:0/1290696108 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575711ba390 0x557571599c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:03.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.594+0000 7f1a437fe640 1 -- 172.21.15.7:0/1290696108 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575711b21b0 msgr2=0x55757158f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:03.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.594+0000 7f1a437fe640 1 --2- 172.21.15.7:0/1290696108 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575711b21b0 0x55757158f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:03.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.594+0000 7f1a437fe640 1 -- 172.21.15.7:0/1290696108 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575711ba390 msgr2=0x557571599c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:03.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.594+0000 7f1a437fe640 1 --2- 172.21.15.7:0/1290696108 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575711ba390 0x557571599c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:03.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.594+0000 7f1a437fe640 1 -- 172.21.15.7:0/1290696108 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557571580d20 con 0x5575711db070 2024-09-21T06:40:03.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.594+0000 7f1a437fe640 1 --2- 172.21.15.7:0/1290696108 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575711db070 0x55757158aba0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f1a38003ea0 tx=0x7f1a38005f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=347e5b5d5547faac server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:03.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.594+0000 7f1a29ffb640 1 -- 172.21.15.7:0/1290696108 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a38055070 con 0x5575711db070 2024-09-21T06:40:03.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.595+0000 7f1a29ffb640 1 -- 172.21.15.7:0/1290696108 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a38009780 con 0x5575711db070 2024-09-21T06:40:03.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.595+0000 7f1a29ffb640 1 -- 172.21.15.7:0/1290696108 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a380042b0 con 0x5575711db070 2024-09-21T06:40:03.704 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.595+0000 7f1a50bc4740 1 -- 172.21.15.7:0/1290696108 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575711db070 msgr2=0x55757158aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:03.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.595+0000 7f1a50bc4740 1 --2- 172.21.15.7:0/1290696108 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575711db070 0x55757158aba0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f1a38003ea0 tx=0x7f1a38005f10 comp rx=0 tx=0).stop 2024-09-21T06:40:03.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.595+0000 7f1a50bc4740 1 -- 172.21.15.7:0/1290696108 shutdown_connections 2024-09-21T06:40:03.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.595+0000 7f1a50bc4740 1 --2- 172.21.15.7:0/1290696108 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575711db070 0x55757158aba0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:03.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.595+0000 7f1a50bc4740 1 --2- 172.21.15.7:0/1290696108 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575711ba390 0x557571599c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:03.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.595+0000 7f1a50bc4740 1 --2- 172.21.15.7:0/1290696108 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575711b21b0 0x55757158f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:03.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.595+0000 7f1a50bc4740 1 -- 172.21.15.7:0/1290696108 >> 172.21.15.7:0/1290696108 conn(0x5575711cf460 msgr2=0x55757158eed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:03.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.595+0000 7f1a50bc4740 1 -- 172.21.15.7:0/1290696108 shutdown_connections 2024-09-21T06:40:03.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.595+0000 7f1a50bc4740 1 -- 172.21.15.7:0/1290696108 wait complete. 2024-09-21T06:40:03.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.596+0000 7f1a50bc4740 1 -- start start 2024-09-21T06:40:03.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.596+0000 7f1a50bc4740 1 Processor -- start 2024-09-21T06:40:03.705 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.596+0000 7f1a50bc4740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575711b21b0 0x5575715a0db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:03.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.596+0000 7f1a50bc4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575711ba390 0x5575715a12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:03.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.596+0000 7f1a50bc4740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575711db070 0x557571609260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:03.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.596+0000 7f1a50bc4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1a441adb70 con 0x5575711ba390 2024-09-21T06:40:03.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.596+0000 7f1a50bc4740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1a441aefe0 con 0x5575711b21b0 2024-09-21T06:40:03.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.596+0000 7f1a50bc4740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1a441ae240 con 0x5575711db070 2024-09-21T06:40:03.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.596+0000 7f1a50bc4740 10 client.0 _ll_register_callbacks cb 0x7f1a3400b770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:40:03.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.596+0000 7f1a43fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575711ba390 0x5575715a12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:03.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.597+0000 7f1a43fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575711ba390 0x5575715a12f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59200/0 (socket says 172.21.15.7:59200) 2024-09-21T06:40:03.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.597+0000 7f1a43fff640 1 -- 172.21.15.7:0/2115619676 learned_addr learned my addr 172.21.15.7:0/2115619676 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:40:03.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.597+0000 7f1a437fe640 1 --2- 172.21.15.7:0/2115619676 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575711b21b0 0x5575715a0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:03.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.597+0000 7f1a437fe640 1 --2- 172.21.15.7:0/2115619676 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575711db070 0x557571609260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:03.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.597+0000 7f1a43fff640 1 -- 172.21.15.7:0/2115619676 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575711db070 msgr2=0x557571609260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:03.706 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.597+0000 7f1a43fff640 1 --2- 172.21.15.7:0/2115619676 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575711db070 0x557571609260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:03.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.597+0000 7f1a43fff640 1 -- 172.21.15.7:0/2115619676 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575711b21b0 msgr2=0x5575715a0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:03.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.597+0000 7f1a43fff640 1 --2- 172.21.15.7:0/2115619676 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575711b21b0 0x5575715a0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:03.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.597+0000 7f1a43fff640 1 -- 172.21.15.7:0/2115619676 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575715a1b20 con 0x5575711ba390 2024-09-21T06:40:03.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.597+0000 7f1a437fe640 1 --2- 172.21.15.7:0/2115619676 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575711db070 0x557571609260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:40:03.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.597+0000 7f1a43fff640 1 --2- 172.21.15.7:0/2115619676 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575711ba390 0x5575715a12f0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x5575714f8fa0 tx=0x7f1a3400bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50efcd679b6eb009 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:03.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.597+0000 7f1a237fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:40:03.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.597+0000 7f1a237fe640 1 -- 172.21.15.7:0/2115619676 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a34029060 con 0x5575711ba390 2024-09-21T06:40:03.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.597+0000 7f1a237fe640 1 -- 172.21.15.7:0/2115619676 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f1a3401d660 con 0x5575711ba390 2024-09-21T06:40:03.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.597+0000 7f1a50bc4740 1 -- 172.21.15.7:0/2115619676 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a38009780 con 0x5575711ba390 2024-09-21T06:40:03.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.598+0000 7f1a237fe640 1 -- 172.21.15.7:0/2115619676 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1a3401d860 con 0x5575711ba390 2024-09-21T06:40:03.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.598+0000 7f1a50bc4740 10 client.16245 fetch_fsmap learned FSMap version 25 2024-09-21T06:40:03.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.598+0000 7f1a50bc4740 1 -- 172.21.15.7:0/2115619676 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55757160a7f0 con 0x5575711ba390 2024-09-21T06:40:03.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.598+0000 7f1a237fe640 1 -- 172.21.15.7:0/2115619676 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a38009780 con 0x5575711ba390 2024-09-21T06:40:03.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.598+0000 7f1a237fe640 1 -- 172.21.15.7:0/2115619676 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f1a34011b10 con 0x5575711ba390 2024-09-21T06:40:03.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.598+0000 7f1a50bc4740 10 client.16245 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:40:03.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.598+0000 7f1a50bc4740 10 client.16245 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:40:03.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.598+0000 7f1a50bc4740 20 client.16245 populate_metadata read hostname 'smithi007' 2024-09-21T06:40:03.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.598+0000 7f1a50bc4740 1 --2- 172.21.15.7:0/2115619676 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55757116eda0 0x55757160cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:03.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.598+0000 7f1a50bc4740 4 client.16245 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:40:03.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.598+0000 7f1a50bc4740 1 -- 172.21.15.7:0/2115619676 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5575714f6850 con 0x55757116eda0 2024-09-21T06:40:03.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.598+0000 7f1a437fe640 1 --2- 172.21.15.7:0/2115619676 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55757116eda0 0x55757160cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:03.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.599+0000 7f1a237fe640 10 client.16245 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:40:03.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.599+0000 7f1a437fe640 1 --2- 172.21.15.7:0/2115619676 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55757116eda0 0x55757160cf90 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e23b4e6f3e4b3347 server_cookie=9b1d64bd610e81ee in_seq=0 out_seq=0 2024-09-21T06:40:03.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.599+0000 7f1a237fe640 1 -- 172.21.15.7:0/2115619676 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+1794 (crc 0 0 0) 0x5575714f6850 con 0x55757116eda0 2024-09-21T06:40:03.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.599+0000 7f1a237fe640 10 client.16245 handle_command_reply: tid=0 2024-09-21T06:40:03.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.599+0000 7f1a50bc4740 1 client.16245 shutdown 2024-09-21T06:40:03.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.599+0000 7f1a50bc4740 1 -- 172.21.15.7:0/2115619676 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575711ba390 msgr2=0x5575715a12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:03.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.599+0000 7f1a50bc4740 1 --2- 172.21.15.7:0/2115619676 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575711ba390 0x5575715a12f0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x5575714f8fa0 tx=0x7f1a3400bf90 comp rx=0 tx=0).stop 2024-09-21T06:40:03.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.599+0000 7f1a50bc4740 1 -- 172.21.15.7:0/2115619676 shutdown_connections 2024-09-21T06:40:03.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.599+0000 7f1a50bc4740 1 --2- 172.21.15.7:0/2115619676 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55757116eda0 0x55757160cf90 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:03.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.599+0000 7f1a50bc4740 1 --2- 172.21.15.7:0/2115619676 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575711db070 0x557571609260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:03.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.599+0000 7f1a50bc4740 1 --2- 172.21.15.7:0/2115619676 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575711ba390 0x5575715a12f0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:03.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.599+0000 7f1a50bc4740 1 --2- 172.21.15.7:0/2115619676 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575711b21b0 0x5575715a0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:03.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.599+0000 7f1a50bc4740 1 -- 172.21.15.7:0/2115619676 >> 172.21.15.7:0/2115619676 conn(0x5575711cf460 msgr2=0x55757158ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:03.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.599+0000 7f1a237fe640 0 client.16245 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:40:03.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.599+0000 7f1a50bc4740 1 -- 172.21.15.7:0/2115619676 shutdown_connections 2024-09-21T06:40:03.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.599+0000 7f1a50bc4740 1 -- 172.21.15.7:0/2115619676 wait complete. 2024-09-21T06:40:03.709 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.599+0000 7f1a50bc4740 20 client.16245 trim_cache size 0 max 16384 2024-09-21T06:40:03.709 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:40:03.709 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "no active scrubs running", 2024-09-21T06:40:03.710 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": {}, 2024-09-21T06:40:03.710 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_stats": { 2024-09-21T06:40:03.710 INFO:teuthology.orchestra.run.smithi007.stdout: "d7b6a90c-9ae1-4e02-93ad-335a7e9df1d7": { 2024-09-21T06:40:03.710 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:39:19.226139+0000", 2024-09-21T06:40:03.710 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:40:03.710 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:40:03.710 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:40:03.710 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:40:03.710 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:40:03.710 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:40:03.710 INFO:teuthology.orchestra.run.smithi007.stdout: "b0327167-8c41-4286-8afc-7f0780972fd7": { 2024-09-21T06:40:03.710 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:38:36.828657+0000", 2024-09-21T06:40:03.710 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:40:03.710 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:40:03.711 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:40:03.711 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:40:03.711 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:40:03.711 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:40:03.711 INFO:teuthology.orchestra.run.smithi007.stdout: "13441782-2231-4713-8ebd-068a941de47f": { 2024-09-21T06:40:03.711 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:39:30.219006+0000", 2024-09-21T06:40:03.711 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:40:03.711 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:40:03.711 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:40:03.711 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:40:03.711 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:40:03.711 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:40:03.711 INFO:teuthology.orchestra.run.smithi007.stdout: "5cbaaba2-6ab1-4f83-abd6-8c6eef4b5c42": { 2024-09-21T06:40:03.711 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:37:46.566272+0000", 2024-09-21T06:40:03.711 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:40:03.712 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:40:03.712 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:40:03.712 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:40:03.712 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:40:03.712 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:40:03.712 INFO:teuthology.orchestra.run.smithi007.stdout: "6231e9c1-14a2-40b5-be3c-76d87a0d733b": { 2024-09-21T06:40:03.712 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:37:02.484812+0000", 2024-09-21T06:40:03.712 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:40:03.712 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:40:03.712 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:40:03.712 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:40:03.712 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:40:03.712 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:40:03.712 INFO:teuthology.orchestra.run.smithi007.stdout: "0b89345c-1f00-4efe-8ee9-4cb17e43584c": { 2024-09-21T06:40:03.712 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:36:19.500334+0000", 2024-09-21T06:40:03.713 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:40:03.713 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:40:03.713 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:40:03.713 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:40:03.713 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:40:03.713 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:40:03.713 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:40:03.713 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:40:03.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.600+0000 7f1a4a650640 1 -- 172.21.15.7:0/266125007 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f1a2c0b6700 msgr2=0x7f1a2c0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:03.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.600+0000 7f1a4a650640 1 --2- 172.21.15.7:0/266125007 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f1a2c0b6700 0x7f1a2c0b8c10 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c0aa880 tx=0x7f1a3c07a2c0 comp rx=0 tx=0).stop 2024-09-21T06:40:03.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.600+0000 7f1a4a650640 1 -- 172.21.15.7:0/266125007 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a44108cf0 msgr2=0x7f1a4419bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:03.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.600+0000 7f1a4a650640 1 --2- 172.21.15.7:0/266125007 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a44108cf0 0x7f1a4419bd10 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c00eaa0 tx=0x7f1a3c00ef60 comp rx=0 tx=0).stop 2024-09-21T06:40:03.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.600+0000 7f1a4a650640 1 -- 172.21.15.7:0/266125007 shutdown_connections 2024-09-21T06:40:03.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.600+0000 7f1a4a650640 1 --2- 172.21.15.7:0/266125007 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f1a2c0b6700 0x7f1a2c0b8c10 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:03.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.600+0000 7f1a4a650640 1 --2- 172.21.15.7:0/266125007 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1a44108cf0 0x7f1a4419bd10 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:03.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.600+0000 7f1a4a650640 1 --2- 172.21.15.7:0/266125007 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a441083a0 0x7f1a4419b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:03.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.600+0000 7f1a4a650640 1 --2- 172.21.15.7:0/266125007 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1a44102a60 0x7f1a4419b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:03.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.600+0000 7f1a4a650640 1 -- 172.21.15.7:0/266125007 >> 172.21.15.7:0/266125007 conn(0x7f1a44079730 msgr2=0x7f1a441044c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:03.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.600+0000 7f1a4a650640 1 -- 172.21.15.7:0/266125007 shutdown_connections 2024-09-21T06:40:03.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:03.600+0000 7f1a4a650640 1 -- 172.21.15.7:0/266125007 wait complete. 2024-09-21T06:40:04.439 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:40:04.439 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:40:04.464 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:40:04 smithi007 ceph-mon[30983]: pgmap v435: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-21T06:40:04.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:40:04 smithi018 ceph-mon[34477]: pgmap v435: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-21T06:40:04.697 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:40:04.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:40:04 smithi144 ceph-mon[34653]: pgmap v435: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-21T06:40:05.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:05.221+0000 7effe8a1c640 1 -- 172.21.15.7:0/1262940684 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effe4104860 msgr2=0x7effe4104c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:05.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:05.221+0000 7effe8a1c640 1 --2- 172.21.15.7:0/1262940684 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effe4104860 0x7effe4104c70 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7effd4009ca0 tx=0x7effd402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:40:05.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:05.221+0000 7effe8a1c640 1 -- 172.21.15.7:0/1262940684 shutdown_connections 2024-09-21T06:40:05.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:05.221+0000 7effe8a1c640 1 --2- 172.21.15.7:0/1262940684 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7effe410de10 0x7effe41102f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:05.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:05.221+0000 7effe8a1c640 1 --2- 172.21.15.7:0/1262940684 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7effe4105290 0x7effe410d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:05.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:05.221+0000 7effe8a1c640 1 --2- 172.21.15.7:0/1262940684 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effe4104860 0x7effe4104c70 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:05.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:05.221+0000 7effe8a1c640 1 -- 172.21.15.7:0/1262940684 >> 172.21.15.7:0/1262940684 conn(0x7effe4079730 msgr2=0x7effe4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:05.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:05.221+0000 7effe8a1c640 1 -- 172.21.15.7:0/1262940684 shutdown_connections 2024-09-21T06:40:05.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:05.221+0000 7effe8a1c640 1 -- 172.21.15.7:0/1262940684 wait complete. 2024-09-21T06:40:05.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:05.222+0000 7effe8a1c640 1 Processor -- start 2024-09-21T06:40:05.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:05.222+0000 7effe8a1c640 1 -- start start 2024-09-21T06:40:05.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:05.223+0000 7effe8a1c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effe4104860 0x7effe419a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:05.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:05.223+0000 7effe8a1c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7effe4105290 0x7effe419aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:05.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:05.223+0000 7effe8a1c640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7effe410de10 0x7effe419fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:05.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:05.223+0000 7effe8a1c640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7effe4113a60 con 0x7effe4104860 2024-09-21T06:40:05.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:05.223+0000 7effe8a1c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7effe41138e0 con 0x7effe4105290 2024-09-21T06:40:05.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:05.223+0000 7effe8a1c640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7effe4113be0 con 0x7effe410de10 2024-09-21T06:40:05.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:05.223+0000 7effe259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effe4104860 0x7effe419a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:05.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:05.223+0000 7effe259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effe4104860 0x7effe419a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59226/0 (socket says 172.21.15.7:59226) 2024-09-21T06:40:05.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:05.223+0000 7effe259c640 1 -- 172.21.15.7:0/2390054410 learned_addr learned my addr 172.21.15.7:0/2390054410 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:40:05.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:05.223+0000 7effe1d9b640 1 --2- 172.21.15.7:0/2390054410 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7effe4105290 0x7effe419aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:05.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:05.223+0000 7effe2d9d640 1 --2- 172.21.15.7:0/2390054410 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7effe410de10 0x7effe419fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:05.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:05.223+0000 7effe259c640 1 -- 172.21.15.7:0/2390054410 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7effe410de10 msgr2=0x7effe419fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:05.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:05.223+0000 7effe259c640 1 --2- 172.21.15.7:0/2390054410 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7effe410de10 0x7effe419fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:05.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:05.223+0000 7effe259c640 1 -- 172.21.15.7:0/2390054410 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7effe4105290 msgr2=0x7effe419aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:05.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:05.223+0000 7effe259c640 1 --2- 172.21.15.7:0/2390054410 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7effe4105290 0x7effe419aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:05.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:05.223+0000 7effe259c640 1 -- 172.21.15.7:0/2390054410 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effe41a03e0 con 0x7effe4104860 2024-09-21T06:40:05.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:05.223+0000 7effe1d9b640 1 --2- 172.21.15.7:0/2390054410 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7effe4105290 0x7effe419aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:40:05.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:05.224+0000 7effe259c640 1 --2- 172.21.15.7:0/2390054410 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effe4104860 0x7effe419a470 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7effd402ade0 tx=0x7effd4031770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:05.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:05.224+0000 7effd37fe640 1 -- 172.21.15.7:0/2390054410 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd4003b70 con 0x7effe4104860 2024-09-21T06:40:05.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:05.224+0000 7effd37fe640 1 -- 172.21.15.7:0/2390054410 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7effd4003d10 con 0x7effe4104860 2024-09-21T06:40:05.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:05.224+0000 7effd37fe640 1 -- 172.21.15.7:0/2390054410 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd402fa50 con 0x7effe4104860 2024-09-21T06:40:05.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:05.224+0000 7effe8a1c640 1 -- 172.21.15.7:0/2390054410 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effe41a0670 con 0x7effe4104860 2024-09-21T06:40:05.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:05.224+0000 7effe8a1c640 1 -- 172.21.15.7:0/2390054410 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effe4102650 con 0x7effe4104860 2024-09-21T06:40:05.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:05.225+0000 7effe8a1c640 1 -- 172.21.15.7:0/2390054410 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effe4104c70 con 0x7effe4104860 2024-09-21T06:40:05.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:05.227+0000 7effd37fe640 1 -- 172.21.15.7:0/2390054410 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7effd4004580 con 0x7effe4104860 2024-09-21T06:40:05.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:05.228+0000 7effd37fe640 1 --2- 172.21.15.7:0/2390054410 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7effcc0b6700 0x7effcc0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:05.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:05.228+0000 7effe1d9b640 1 --2- 172.21.15.7:0/2390054410 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7effcc0b6700 0x7effcc0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:05.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:05.228+0000 7effd37fe640 1 -- 172.21.15.7:0/2390054410 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7effd4108b60 con 0x7effe4104860 2024-09-21T06:40:05.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:05.229+0000 7effe1d9b640 1 --2- 172.21.15.7:0/2390054410 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7effcc0b6700 0x7effcc0b8c10 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7effe41024c0 tx=0x7effd8005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:05.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:05.232+0000 7effd37fe640 1 -- 172.21.15.7:0/2390054410 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7effd40cf110 con 0x7effe4104860 2024-09-21T06:40:05.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:05.457+0000 7effe8a1c640 1 -- 172.21.15.7:0/2390054410 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7effe419b5a0 con 0x7effe4104860 2024-09-21T06:40:05.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:05.458+0000 7effd37fe640 1 -- 172.21.15.7:0/2390054410 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11899 (secure 0 0 0) 0x7effe419b5a0 con 0x7effe4104860 2024-09-21T06:40:05.460 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:40:05.460 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-21T06:36:10:753693+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2015971546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2015971546},{"type":"v1","addr":"172.21.15.7:6835","nonce":2015971546}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/2350816224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":2350816224},{"type":"v1","addr":"172.21.15.7:6837","nonce":2350816224}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14823,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/1669980572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":1669980572},{"type":"v1","addr":"172.21.15.7:6839","nonce":1669980572}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14835,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/2528308973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":2528308973},{"type":"v1","addr":"172.21.15.7:6841","nonce":2528308973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24623,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1337382979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1337382979},{"type":"v1","addr":"172.21.15.18:6833","nonce":1337382979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/2751454345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":2751454345},{"type":"v1","addr":"172.21.15.144:6833","nonce":2751454345}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:34:24.627168+0000","modified":"2024-09-21T06:36:10.737288+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24716,"mds_1":24688,"mds_2":24686},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24656":{"gid":24656,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6835/158884796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":158884796},{"type":"v1","addr":"172.21.15.18:6835","nonce":158884796}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6835/3636739922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3636739922},{"type":"v1","addr":"172.21.15.144:6835","nonce":3636739922}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24673":{"gid":24673,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6837/1126341753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":1126341753},{"type":"v1","addr":"172.21.15.144:6837","nonce":1126341753}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.18:6837/1539670694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1539670694},{"type":"v1","addr":"172.21.15.18:6837","nonce":1539670694}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24688":{"gid":24688,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.144:6839/4027821922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":4027821922},{"type":"v1","addr":"172.21.15.144:6839","nonce":4027821922}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24716":{"gid":24716,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.18:6839/3798713532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":3798713532},{"type":"v1","addr":"172.21.15.18:6839","nonce":3798713532}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24716,"qdb_cluster":[24716,24688,24686]},"id":1}]} 2024-09-21T06:40:05.460 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-21T06:40:05.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:05.460+0000 7effe8a1c640 1 -- 172.21.15.7:0/2390054410 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7effcc0b6700 msgr2=0x7effcc0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:05.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:05.460+0000 7effe8a1c640 1 --2- 172.21.15.7:0/2390054410 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7effcc0b6700 0x7effcc0b8c10 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7effe41024c0 tx=0x7effd8005f90 comp rx=0 tx=0).stop 2024-09-21T06:40:05.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:05.460+0000 7effe8a1c640 1 -- 172.21.15.7:0/2390054410 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effe4104860 msgr2=0x7effe419a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:05.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:05.460+0000 7effe8a1c640 1 --2- 172.21.15.7:0/2390054410 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effe4104860 0x7effe419a470 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7effd402ade0 tx=0x7effd4031770 comp rx=0 tx=0).stop 2024-09-21T06:40:05.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:05.460+0000 7effe8a1c640 1 -- 172.21.15.7:0/2390054410 shutdown_connections 2024-09-21T06:40:05.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:05.460+0000 7effe8a1c640 1 --2- 172.21.15.7:0/2390054410 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7effcc0b6700 0x7effcc0b8c10 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:05.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:05.460+0000 7effe8a1c640 1 --2- 172.21.15.7:0/2390054410 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7effe410de10 0x7effe419fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:05.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:05.460+0000 7effe8a1c640 1 --2- 172.21.15.7:0/2390054410 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7effe4105290 0x7effe419aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:05.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:05.460+0000 7effe8a1c640 1 --2- 172.21.15.7:0/2390054410 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7effe4104860 0x7effe419a470 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:05.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:05.460+0000 7effe8a1c640 1 -- 172.21.15.7:0/2390054410 >> 172.21.15.7:0/2390054410 conn(0x7effe4079730 msgr2=0x7effe41008f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:05.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:05.460+0000 7effe8a1c640 1 -- 172.21.15.7:0/2390054410 shutdown_connections 2024-09-21T06:40:05.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:05.461+0000 7effe8a1c640 1 -- 172.21.15.7:0/2390054410 wait complete. 2024-09-21T06:40:06.210 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:40:06.513 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:40:06.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:40:06 smithi007 ceph-mon[30983]: pgmap v436: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-09-21T06:40:06.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:40:06 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2390054410' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:40:06.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:40:06 smithi018 ceph-mon[34477]: pgmap v436: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-09-21T06:40:06.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:40:06 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/2390054410' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:40:06.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:40:06 smithi144 ceph-mon[34653]: pgmap v436: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-09-21T06:40:06.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:40:06 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/2390054410' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:40:07.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.017+0000 7f36c1c12640 1 -- 172.21.15.7:0/896438814 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36bc102290 msgr2=0x7f36bc1026a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:07.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.017+0000 7f36c1c12640 1 --2- 172.21.15.7:0/896438814 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36bc102290 0x7f36bc1026a0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f36ac009900 tx=0x7f36ac02a410 comp rx=0 tx=0).stop 2024-09-21T06:40:07.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.017+0000 7f36c1c12640 1 -- 172.21.15.7:0/896438814 shutdown_connections 2024-09-21T06:40:07.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.017+0000 7f36c1c12640 1 --2- 172.21.15.7:0/896438814 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36bc108520 0x7f36bc10ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:07.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.017+0000 7f36c1c12640 1 --2- 172.21.15.7:0/896438814 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36bc107bd0 0x7f36bc107fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:07.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.017+0000 7f36c1c12640 1 --2- 172.21.15.7:0/896438814 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36bc102290 0x7f36bc1026a0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:07.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.017+0000 7f36c1c12640 1 -- 172.21.15.7:0/896438814 >> 172.21.15.7:0/896438814 conn(0x7f36bc079ea0 msgr2=0x7f36bc07a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:07.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.017+0000 7f36c1c12640 1 -- 172.21.15.7:0/896438814 shutdown_connections 2024-09-21T06:40:07.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.017+0000 7f36c1c12640 1 -- 172.21.15.7:0/896438814 wait complete. 2024-09-21T06:40:07.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.018+0000 7f36c1c12640 1 Processor -- start 2024-09-21T06:40:07.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.018+0000 7f36c1c12640 1 -- start start 2024-09-21T06:40:07.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.018+0000 7f36c1c12640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36bc102290 0x7f36bc110640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:07.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.018+0000 7f36c1c12640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36bc107bd0 0x7f36bc110b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:07.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.018+0000 7f36c1c12640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36bc108520 0x7f36bc1110c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:07.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.018+0000 7f36c1c12640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f36bc113b50 con 0x7f36bc108520 2024-09-21T06:40:07.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.018+0000 7f36c1c12640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f36bc1139d0 con 0x7f36bc102290 2024-09-21T06:40:07.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.018+0000 7f36c1c12640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f36bc113cd0 con 0x7f36bc107bd0 2024-09-21T06:40:07.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.019+0000 7f36bbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36bc108520 0x7f36bc1110c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:07.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.019+0000 7f36bbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36bc108520 0x7f36bc1110c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59242/0 (socket says 172.21.15.7:59242) 2024-09-21T06:40:07.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.019+0000 7f36bbfff640 1 -- 172.21.15.7:0/1269949261 learned_addr learned my addr 172.21.15.7:0/1269949261 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:40:07.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.019+0000 7f36baffd640 1 --2- 172.21.15.7:0/1269949261 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36bc107bd0 0x7f36bc110b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:07.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.019+0000 7f36bb7fe640 1 --2- 172.21.15.7:0/1269949261 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36bc102290 0x7f36bc110640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:07.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.019+0000 7f36bbfff640 1 -- 172.21.15.7:0/1269949261 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36bc107bd0 msgr2=0x7f36bc110b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:07.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.019+0000 7f36bbfff640 1 --2- 172.21.15.7:0/1269949261 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36bc107bd0 0x7f36bc110b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:07.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.019+0000 7f36bbfff640 1 -- 172.21.15.7:0/1269949261 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36bc102290 msgr2=0x7f36bc110640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:07.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.019+0000 7f36bbfff640 1 --2- 172.21.15.7:0/1269949261 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36bc102290 0x7f36bc110640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:07.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.019+0000 7f36bbfff640 1 -- 172.21.15.7:0/1269949261 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36bc1a8800 con 0x7f36bc108520 2024-09-21T06:40:07.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.019+0000 7f36bbfff640 1 --2- 172.21.15.7:0/1269949261 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36bc108520 0x7f36bc1110c0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f36b400eb10 tx=0x7f36b400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:07.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.019+0000 7f36b8ff9640 1 -- 172.21.15.7:0/1269949261 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36b4004b20 con 0x7f36bc108520 2024-09-21T06:40:07.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.019+0000 7f36b8ff9640 1 -- 172.21.15.7:0/1269949261 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f36b4004cc0 con 0x7f36bc108520 2024-09-21T06:40:07.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.019+0000 7f36c1c12640 1 -- 172.21.15.7:0/1269949261 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36bc1a8af0 con 0x7f36bc108520 2024-09-21T06:40:07.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.019+0000 7f36b8ff9640 1 -- 172.21.15.7:0/1269949261 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36b4010670 con 0x7f36bc108520 2024-09-21T06:40:07.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.019+0000 7f36c1c12640 1 -- 172.21.15.7:0/1269949261 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36bc1a8fe0 con 0x7f36bc108520 2024-09-21T06:40:07.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.023+0000 7f36c8186740 1 Processor -- start 2024-09-21T06:40:07.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.023+0000 7f36b8ff9640 1 -- 172.21.15.7:0/1269949261 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f36b4005020 con 0x7f36bc108520 2024-09-21T06:40:07.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.023+0000 7f36c8186740 1 -- start start 2024-09-21T06:40:07.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.023+0000 7f36c8186740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a4a4bc3070 0x55a4a4f6a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:07.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.023+0000 7f36c8186740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a4a4b9a1b0 0x55a4a4f6abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:07.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.023+0000 7f36c8186740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a4a4ba2390 0x55a4a4f6b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:07.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.023+0000 7f36c8186740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55a4a4ee0ea0 con 0x55a4a4bc3070 2024-09-21T06:40:07.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.023+0000 7f36c8186740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a4a4ed02d0 con 0x55a4a4b9a1b0 2024-09-21T06:40:07.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.023+0000 7f36c8186740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55a4a4ed40e0 con 0x55a4a4ba2390 2024-09-21T06:40:07.030 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.023+0000 7f36baffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a4a4bc3070 0x55a4a4f6a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:07.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.023+0000 7f36baffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a4a4bc3070 0x55a4a4f6a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59258/0 (socket says 172.21.15.7:59258) 2024-09-21T06:40:07.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.024+0000 7f36baffd640 1 -- 172.21.15.7:0/3472190215 learned_addr learned my addr 172.21.15.7:0/3472190215 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:40:07.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.024+0000 7f36bb7fe640 1 --2- 172.21.15.7:0/3472190215 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a4a4b9a1b0 0x55a4a4f6abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:07.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.024+0000 7f36baffd640 1 -- 172.21.15.7:0/3472190215 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a4a4ba2390 msgr2=0x55a4a4f6b120 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T06:40:07.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.024+0000 7f36baffd640 1 --2- 172.21.15.7:0/3472190215 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a4a4ba2390 0x55a4a4f6b120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:07.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.024+0000 7f36baffd640 1 -- 172.21.15.7:0/3472190215 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a4a4b9a1b0 msgr2=0x55a4a4f6abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:07.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.024+0000 7f36baffd640 1 --2- 172.21.15.7:0/3472190215 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a4a4b9a1b0 0x55a4a4f6abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:07.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.024+0000 7f36baffd640 1 -- 172.21.15.7:0/3472190215 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4a4c2e650 con 0x55a4a4bc3070 2024-09-21T06:40:07.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.024+0000 7f36bb7fe640 1 --2- 172.21.15.7:0/3472190215 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a4a4b9a1b0 0x55a4a4f6abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:40:07.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.024+0000 7f36b8ff9640 1 --2- 172.21.15.7:0/1269949261 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f36a80b6680 0x7f36a80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:07.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.024+0000 7f36baffd640 1 --2- 172.21.15.7:0/3472190215 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a4a4bc3070 0x55a4a4f6a6a0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f36a400bc00 tx=0x7f36a40107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cd7306233f725ae server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:07.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.024+0000 7f36bb7fe640 1 --2- 172.21.15.7:0/1269949261 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f36a80b6680 0x7f36a80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:07.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.024+0000 7f36b8ff9640 1 -- 172.21.15.7:0/1269949261 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f36b40e7c50 con 0x7f36bc108520 2024-09-21T06:40:07.031 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.024+0000 7f36b1ffb640 1 -- 172.21.15.7:0/3472190215 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a4004030 con 0x55a4a4bc3070 2024-09-21T06:40:07.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.024+0000 7f36b1ffb640 1 -- 172.21.15.7:0/3472190215 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f36a40041d0 con 0x55a4a4bc3070 2024-09-21T06:40:07.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.024+0000 7f36b1ffb640 1 -- 172.21.15.7:0/3472190215 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a40116a0 con 0x55a4a4bc3070 2024-09-21T06:40:07.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.025+0000 7f36c8186740 1 -- 172.21.15.7:0/3472190215 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a4a4bc3070 msgr2=0x55a4a4f6a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:07.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.025+0000 7f36bb7fe640 1 --2- 172.21.15.7:0/1269949261 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f36a80b6680 0x7f36a80b8b90 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f36ac000c00 tx=0x7f36ac031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:07.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.025+0000 7f36c8186740 1 --2- 172.21.15.7:0/3472190215 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a4a4bc3070 0x55a4a4f6a6a0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f36a400bc00 tx=0x7f36a40107a0 comp rx=0 tx=0).stop 2024-09-21T06:40:07.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.025+0000 7f36c8186740 1 -- 172.21.15.7:0/3472190215 shutdown_connections 2024-09-21T06:40:07.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.025+0000 7f36c8186740 1 --2- 172.21.15.7:0/3472190215 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a4a4ba2390 0x55a4a4f6b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:07.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.025+0000 7f36c8186740 1 --2- 172.21.15.7:0/3472190215 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a4a4b9a1b0 0x55a4a4f6abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:07.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.025+0000 7f36c8186740 1 --2- 172.21.15.7:0/3472190215 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a4a4bc3070 0x55a4a4f6a6a0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:07.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.025+0000 7f36c8186740 1 -- 172.21.15.7:0/3472190215 >> 172.21.15.7:0/3472190215 conn(0x55a4a4bb7460 msgr2=0x55a4a4f68590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:07.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.026+0000 7f36c8186740 1 -- 172.21.15.7:0/3472190215 shutdown_connections 2024-09-21T06:40:07.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.026+0000 7f36c8186740 1 -- 172.21.15.7:0/3472190215 wait complete. 2024-09-21T06:40:07.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.026+0000 7f36c8186740 1 -- start start 2024-09-21T06:40:07.032 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.026+0000 7f36c8186740 1 Processor -- start 2024-09-21T06:40:07.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.027+0000 7f36c8186740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a4a4b9a1b0 0x55a4a4f75da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:07.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.027+0000 7f36c8186740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a4a4ba2390 0x55a4a4f762e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:07.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.027+0000 7f36c8186740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a4a4bc3070 0x55a4a4f82170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:07.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.027+0000 7f36c8186740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55a4a4d31700 con 0x55a4a4b9a1b0 2024-09-21T06:40:07.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.027+0000 7f36c8186740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a4a4e6b160 con 0x55a4a4ba2390 2024-09-21T06:40:07.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.027+0000 7f36c8186740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55a4a4f78e80 con 0x55a4a4bc3070 2024-09-21T06:40:07.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.027+0000 7f36c8186740 10 client.0 _ll_register_callbacks cb 0x55a4a4e849e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:40:07.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.027+0000 7f36bb7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a4a4b9a1b0 0x55a4a4f75da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:07.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.027+0000 7f36bb7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a4a4b9a1b0 0x55a4a4f75da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59268/0 (socket says 172.21.15.7:59268) 2024-09-21T06:40:07.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.027+0000 7f36bb7fe640 1 -- 172.21.15.7:0/1703892696 learned_addr learned my addr 172.21.15.7:0/1703892696 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:40:07.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.027+0000 7f36baffd640 1 --2- 172.21.15.7:0/1703892696 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a4a4ba2390 0x55a4a4f762e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:07.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.027+0000 7f36bbfff640 1 --2- 172.21.15.7:0/1703892696 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a4a4bc3070 0x55a4a4f82170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:07.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.027+0000 7f36bb7fe640 1 -- 172.21.15.7:0/1703892696 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a4a4bc3070 msgr2=0x55a4a4f82170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:07.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.027+0000 7f36bb7fe640 1 --2- 172.21.15.7:0/1703892696 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a4a4bc3070 0x55a4a4f82170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:07.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.027+0000 7f36bb7fe640 1 -- 172.21.15.7:0/1703892696 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a4a4ba2390 msgr2=0x55a4a4f762e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:07.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.027+0000 7f36bb7fe640 1 --2- 172.21.15.7:0/1703892696 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a4a4ba2390 0x55a4a4f762e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:07.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.027+0000 7f36bb7fe640 1 -- 172.21.15.7:0/1703892696 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4a4e98c90 con 0x55a4a4b9a1b0 2024-09-21T06:40:07.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.027+0000 7f36baffd640 1 --2- 172.21.15.7:0/1703892696 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a4a4ba2390 0x55a4a4f762e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:40:07.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.027+0000 7f36bb7fe640 1 --2- 172.21.15.7:0/1703892696 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a4a4b9a1b0 0x55a4a4f75da0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f36ac009900 tx=0x7f36ac009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd7c020d5ae8e3ab server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:07.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.027+0000 7f369affd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:40:07.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.028+0000 7f369affd640 1 -- 172.21.15.7:0/1703892696 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36ac04d070 con 0x55a4a4b9a1b0 2024-09-21T06:40:07.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.028+0000 7f369affd640 1 -- 172.21.15.7:0/1703892696 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f36ac005030 con 0x55a4a4b9a1b0 2024-09-21T06:40:07.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.028+0000 7f36c8186740 1 -- 172.21.15.7:0/1703892696 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f36a40041d0 con 0x55a4a4b9a1b0 2024-09-21T06:40:07.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.028+0000 7f369affd640 1 -- 172.21.15.7:0/1703892696 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f36ac035040 con 0x55a4a4b9a1b0 2024-09-21T06:40:07.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.028+0000 7f36c8186740 10 client.16263 fetch_fsmap learned FSMap version 25 2024-09-21T06:40:07.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.028+0000 7f36c8186740 1 -- 172.21.15.7:0/1703892696 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a4a4f84ba0 con 0x55a4a4b9a1b0 2024-09-21T06:40:07.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.028+0000 7f369affd640 1 -- 172.21.15.7:0/1703892696 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f36a40041d0 con 0x55a4a4b9a1b0 2024-09-21T06:40:07.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.028+0000 7f369affd640 1 -- 172.21.15.7:0/1703892696 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f36ac004cb0 con 0x55a4a4b9a1b0 2024-09-21T06:40:07.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.028+0000 7f36c8186740 10 client.16263 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:40:07.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.029+0000 7f36c8186740 10 client.16263 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-21T06:40:07.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.029+0000 7f36c8186740 20 client.16263 populate_metadata read hostname 'smithi007' 2024-09-21T06:40:07.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.029+0000 7f36c8186740 1 --2- 172.21.15.7:0/1703892696 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x55a4a4b819f0 0x55a4a4f88140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:07.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.029+0000 7f36c8186740 4 client.16263 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:40:07.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.029+0000 7f36c8186740 1 -- 172.21.15.7:0/1703892696 --> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a4a4ee2df0 con 0x55a4a4b819f0 2024-09-21T06:40:07.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.029+0000 7f36baffd640 1 --2- 172.21.15.7:0/1703892696 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x55a4a4b819f0 0x55a4a4f88140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:07.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.029+0000 7f36baffd640 1 --2- 172.21.15.7:0/1703892696 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x55a4a4b819f0 0x55a4a4f88140 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e29720a4d567579c server_cookie=732f7c6298621a5e in_seq=0 out_seq=0 2024-09-21T06:40:07.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.029+0000 7f369affd640 10 client.16263 ms_handle_connect on v2:172.21.15.18:6836/1539670694 2024-09-21T06:40:07.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.030+0000 7f369affd640 1 -- 172.21.15.7:0/1703892696 <== mds.2 v2:172.21.15.18:6836/1539670694 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a4a4ee2df0 con 0x55a4a4b819f0 2024-09-21T06:40:07.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.030+0000 7f369affd640 10 client.16263 handle_command_reply: tid=0 2024-09-21T06:40:07.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.030+0000 7f36c8186740 1 client.16263 shutdown 2024-09-21T06:40:07.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.030+0000 7f36c8186740 1 -- 172.21.15.7:0/1703892696 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a4a4b9a1b0 msgr2=0x55a4a4f75da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:07.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.030+0000 7f36c8186740 1 --2- 172.21.15.7:0/1703892696 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a4a4b9a1b0 0x55a4a4f75da0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f36ac009900 tx=0x7f36ac009260 comp rx=0 tx=0).stop 2024-09-21T06:40:07.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.030+0000 7f36c8186740 1 -- 172.21.15.7:0/1703892696 shutdown_connections 2024-09-21T06:40:07.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.030+0000 7f36c8186740 1 --2- 172.21.15.7:0/1703892696 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x55a4a4b819f0 0x55a4a4f88140 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:07.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.030+0000 7f36c8186740 1 --2- 172.21.15.7:0/1703892696 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a4a4bc3070 0x55a4a4f82170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:07.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.030+0000 7f36c8186740 1 --2- 172.21.15.7:0/1703892696 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a4a4ba2390 0x55a4a4f762e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:07.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.030+0000 7f36c8186740 1 --2- 172.21.15.7:0/1703892696 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a4a4b9a1b0 0x55a4a4f75da0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:07.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.030+0000 7f36c8186740 1 -- 172.21.15.7:0/1703892696 >> 172.21.15.7:0/1703892696 conn(0x55a4a4bb7460 msgr2=0x55a4a4f6d880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:07.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.031+0000 7f369affd640 0 client.16263 ms_handle_reset on v2:172.21.15.18:6836/1539670694 2024-09-21T06:40:07.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.031+0000 7f36c8186740 1 -- 172.21.15.7:0/1703892696 shutdown_connections 2024-09-21T06:40:07.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.031+0000 7f36c8186740 1 -- 172.21.15.7:0/1703892696 wait complete. 2024-09-21T06:40:07.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.031+0000 7f36c8186740 20 client.16263 trim_cache size 0 max 16384 2024-09-21T06:40:07.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.044+0000 7f36c8186740 1 Processor -- start 2024-09-21T06:40:07.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.044+0000 7f36c8186740 1 -- start start 2024-09-21T06:40:07.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.045+0000 7f36c8186740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a4a4b9a1b0 0x55a4a4f77c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:07.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.045+0000 7f36c8186740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a4a4ba2390 0x55a4a4f6bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:07.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.045+0000 7f36c8186740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a4a4bc3070 0x55a4a4f67bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:07.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.045+0000 7f36c8186740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f36bc1b3f70 con 0x55a4a4bc3070 2024-09-21T06:40:07.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.045+0000 7f36c8186740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f36bc1b1840 con 0x55a4a4b9a1b0 2024-09-21T06:40:07.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.045+0000 7f36c8186740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f36bc1af670 con 0x55a4a4ba2390 2024-09-21T06:40:07.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.045+0000 7f36bbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a4a4bc3070 0x55a4a4f67bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:07.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.045+0000 7f36bbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a4a4bc3070 0x55a4a4f67bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59276/0 (socket says 172.21.15.7:59276) 2024-09-21T06:40:07.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.045+0000 7f36bbfff640 1 -- 172.21.15.7:0/2079557235 learned_addr learned my addr 172.21.15.7:0/2079557235 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:40:07.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.045+0000 7f36baffd640 1 --2- 172.21.15.7:0/2079557235 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a4a4ba2390 0x55a4a4f6bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:07.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.045+0000 7f36bb7fe640 1 --2- 172.21.15.7:0/2079557235 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a4a4b9a1b0 0x55a4a4f77c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:07.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.045+0000 7f36bbfff640 1 -- 172.21.15.7:0/2079557235 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a4a4ba2390 msgr2=0x55a4a4f6bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:07.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.045+0000 7f36bbfff640 1 --2- 172.21.15.7:0/2079557235 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a4a4ba2390 0x55a4a4f6bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:07.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.045+0000 7f36bbfff640 1 -- 172.21.15.7:0/2079557235 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a4a4b9a1b0 msgr2=0x55a4a4f77c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:07.048 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.045+0000 7f36bbfff640 1 --2- 172.21.15.7:0/2079557235 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a4a4b9a1b0 0x55a4a4f77c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:07.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.045+0000 7f36bbfff640 1 -- 172.21.15.7:0/2079557235 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4a4f6c990 con 0x55a4a4bc3070 2024-09-21T06:40:07.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.045+0000 7f36bbfff640 1 --2- 172.21.15.7:0/2079557235 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a4a4bc3070 0x55a4a4f67bc0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f36b40e53e0 tx=0x7f36b400cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff06b9d1a90c046f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:07.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.045+0000 7f36b17fa640 1 -- 172.21.15.7:0/2079557235 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36b40b2070 con 0x55a4a4bc3070 2024-09-21T06:40:07.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.046+0000 7f36b17fa640 1 -- 172.21.15.7:0/2079557235 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f36b40ad650 con 0x55a4a4bc3070 2024-09-21T06:40:07.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.046+0000 7f36b17fa640 1 -- 172.21.15.7:0/2079557235 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36b40b7560 con 0x55a4a4bc3070 2024-09-21T06:40:07.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.046+0000 7f36c8186740 1 -- 172.21.15.7:0/2079557235 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a4a4bc3070 msgr2=0x55a4a4f67bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:07.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.046+0000 7f36c8186740 1 --2- 172.21.15.7:0/2079557235 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a4a4bc3070 0x55a4a4f67bc0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f36b40e53e0 tx=0x7f36b400cee0 comp rx=0 tx=0).stop 2024-09-21T06:40:07.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.046+0000 7f36c8186740 1 -- 172.21.15.7:0/2079557235 shutdown_connections 2024-09-21T06:40:07.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.046+0000 7f36c8186740 1 --2- 172.21.15.7:0/2079557235 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a4a4bc3070 0x55a4a4f67bc0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:07.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.046+0000 7f36c8186740 1 --2- 172.21.15.7:0/2079557235 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a4a4ba2390 0x55a4a4f6bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:07.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.046+0000 7f36c8186740 1 --2- 172.21.15.7:0/2079557235 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a4a4b9a1b0 0x55a4a4f77c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:07.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.046+0000 7f36c8186740 1 -- 172.21.15.7:0/2079557235 >> 172.21.15.7:0/2079557235 conn(0x55a4a4bb7460 msgr2=0x55a4a4f6b6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:07.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.046+0000 7f36c8186740 1 -- 172.21.15.7:0/2079557235 shutdown_connections 2024-09-21T06:40:07.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.046+0000 7f36c8186740 1 -- 172.21.15.7:0/2079557235 wait complete. 2024-09-21T06:40:07.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.047+0000 7f36c8186740 1 -- start start 2024-09-21T06:40:07.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.047+0000 7f36c8186740 1 Processor -- start 2024-09-21T06:40:07.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.047+0000 7f36c8186740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a4a4b9a1b0 0x55a4a4feacc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:07.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.047+0000 7f36c8186740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a4a4ba2390 0x55a4a4feb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:07.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.047+0000 7f36c8186740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a4a4bc3070 0x55a4a4f7df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:07.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.047+0000 7f36c8186740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f36bc1afd00 con 0x55a4a4b9a1b0 2024-09-21T06:40:07.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.047+0000 7f36c8186740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f36bc1b1170 con 0x55a4a4bc3070 2024-09-21T06:40:07.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.047+0000 7f36c8186740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f36bc1b03d0 con 0x55a4a4ba2390 2024-09-21T06:40:07.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.047+0000 7f36c8186740 10 client.0 _ll_register_callbacks cb 0x7f36ac005e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:40:07.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.048+0000 7f36bb7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a4a4b9a1b0 0x55a4a4feacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:07.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.048+0000 7f36bb7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a4a4b9a1b0 0x55a4a4feacc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59288/0 (socket says 172.21.15.7:59288) 2024-09-21T06:40:07.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.048+0000 7f36bb7fe640 1 -- 172.21.15.7:0/300498729 learned_addr learned my addr 172.21.15.7:0/300498729 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:40:07.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.048+0000 7f36baffd640 1 --2- 172.21.15.7:0/300498729 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a4a4ba2390 0x55a4a4feb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:07.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.048+0000 7f36bbfff640 1 --2- 172.21.15.7:0/300498729 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a4a4bc3070 0x55a4a4f7df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:07.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.048+0000 7f36bb7fe640 1 -- 172.21.15.7:0/300498729 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a4a4ba2390 msgr2=0x55a4a4feb2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:07.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.048+0000 7f36bb7fe640 1 --2- 172.21.15.7:0/300498729 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a4a4ba2390 0x55a4a4feb2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:07.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.048+0000 7f36bb7fe640 1 -- 172.21.15.7:0/300498729 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a4a4bc3070 msgr2=0x55a4a4f7df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:07.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.048+0000 7f36bb7fe640 1 --2- 172.21.15.7:0/300498729 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a4a4bc3070 0x55a4a4f7df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:07.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.048+0000 7f36bb7fe640 1 -- 172.21.15.7:0/300498729 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4a4f7e570 con 0x55a4a4b9a1b0 2024-09-21T06:40:07.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.048+0000 7f36baffd640 1 --2- 172.21.15.7:0/300498729 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a4a4ba2390 0x55a4a4feb2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:40:07.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.048+0000 7f36bb7fe640 1 --2- 172.21.15.7:0/300498729 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a4a4b9a1b0 0x55a4a4feacc0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f36ac003860 tx=0x7f36ac003b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9c0f6084fb0f838 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:07.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.048+0000 7f369affd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:40:07.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.048+0000 7f369affd640 1 -- 172.21.15.7:0/300498729 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36ac061070 con 0x55a4a4b9a1b0 2024-09-21T06:40:07.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.048+0000 7f36c8186740 1 -- 172.21.15.7:0/300498729 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f36b40ad650 con 0x55a4a4b9a1b0 2024-09-21T06:40:07.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.048+0000 7f369affd640 1 -- 172.21.15.7:0/300498729 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f36ac005040 con 0x55a4a4b9a1b0 2024-09-21T06:40:07.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.049+0000 7f369affd640 1 -- 172.21.15.7:0/300498729 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f36ac06d050 con 0x55a4a4b9a1b0 2024-09-21T06:40:07.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.049+0000 7f36c8186740 10 client.16269 fetch_fsmap learned FSMap version 25 2024-09-21T06:40:07.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.049+0000 7f36c8186740 1 -- 172.21.15.7:0/300498729 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a4a4ff2500 con 0x55a4a4b9a1b0 2024-09-21T06:40:07.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.049+0000 7f369affd640 1 -- 172.21.15.7:0/300498729 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f36b40ad650 con 0x55a4a4b9a1b0 2024-09-21T06:40:07.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.049+0000 7f369affd640 1 -- 172.21.15.7:0/300498729 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f36ac004a90 con 0x55a4a4b9a1b0 2024-09-21T06:40:07.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.049+0000 7f36c8186740 10 client.16269 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:40:07.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.049+0000 7f36c8186740 10 client.16269 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-21T06:40:07.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.049+0000 7f36c8186740 20 client.16269 populate_metadata read hostname 'smithi007' 2024-09-21T06:40:07.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.049+0000 7f36c8186740 1 --2- 172.21.15.7:0/300498729 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x55a4a4b56da0 0x55a4a4ff4c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:07.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.049+0000 7f36c8186740 4 client.16269 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:40:07.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.049+0000 7f36c8186740 1 -- 172.21.15.7:0/300498729 --> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a4a4ede8a0 con 0x55a4a4b56da0 2024-09-21T06:40:07.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.049+0000 7f36baffd640 1 --2- 172.21.15.7:0/300498729 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x55a4a4b56da0 0x55a4a4ff4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:07.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.050+0000 7f36baffd640 1 --2- 172.21.15.7:0/300498729 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x55a4a4b56da0 0x55a4a4ff4c90 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=cffd60a947b81355 server_cookie=6e1034551b7858b6 in_seq=0 out_seq=0 2024-09-21T06:40:07.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.050+0000 7f369affd640 10 client.16269 ms_handle_connect on v2:172.21.15.18:6836/1539670694 2024-09-21T06:40:07.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.050+0000 7f369affd640 1 -- 172.21.15.7:0/300498729 <== mds.2 v2:172.21.15.18:6836/1539670694 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a4a4ede8a0 con 0x55a4a4b56da0 2024-09-21T06:40:07.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.050+0000 7f369affd640 10 client.16269 handle_command_reply: tid=0 2024-09-21T06:40:07.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.050+0000 7f36c8186740 1 client.16269 shutdown 2024-09-21T06:40:07.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.050+0000 7f36c8186740 1 -- 172.21.15.7:0/300498729 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a4a4b9a1b0 msgr2=0x55a4a4feacc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:07.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.050+0000 7f36c8186740 1 --2- 172.21.15.7:0/300498729 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a4a4b9a1b0 0x55a4a4feacc0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f36ac003860 tx=0x7f36ac003b10 comp rx=0 tx=0).stop 2024-09-21T06:40:07.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.050+0000 7f36c8186740 1 -- 172.21.15.7:0/300498729 shutdown_connections 2024-09-21T06:40:07.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.050+0000 7f36c8186740 1 --2- 172.21.15.7:0/300498729 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x55a4a4b56da0 0x55a4a4ff4c90 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:07.056 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.050+0000 7f36c8186740 1 --2- 172.21.15.7:0/300498729 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a4a4bc3070 0x55a4a4f7df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:07.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.050+0000 7f36c8186740 1 --2- 172.21.15.7:0/300498729 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a4a4ba2390 0x55a4a4feb2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:07.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.050+0000 7f369affd640 0 client.16269 ms_handle_reset on v2:172.21.15.18:6836/1539670694 2024-09-21T06:40:07.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.050+0000 7f36c8186740 1 --2- 172.21.15.7:0/300498729 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a4a4b9a1b0 0x55a4a4feacc0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:07.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.050+0000 7f36c8186740 1 -- 172.21.15.7:0/300498729 >> 172.21.15.7:0/300498729 conn(0x55a4a4bb7460 msgr2=0x55a4a4f779e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:07.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.050+0000 7f36c8186740 1 -- 172.21.15.7:0/300498729 shutdown_connections 2024-09-21T06:40:07.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.050+0000 7f36c8186740 1 -- 172.21.15.7:0/300498729 wait complete. 2024-09-21T06:40:07.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.050+0000 7f36c8186740 20 client.16269 trim_cache size 0 max 16384 2024-09-21T06:40:07.057 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:40:07.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.051+0000 7f36c1c12640 1 -- 172.21.15.7:0/1269949261 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f36a80b6680 msgr2=0x7f36a80b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:07.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.051+0000 7f36c1c12640 1 --2- 172.21.15.7:0/1269949261 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f36a80b6680 0x7f36a80b8b90 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f36ac000c00 tx=0x7f36ac031400 comp rx=0 tx=0).stop 2024-09-21T06:40:07.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.051+0000 7f36c1c12640 1 -- 172.21.15.7:0/1269949261 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36bc108520 msgr2=0x7f36bc1110c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:07.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.051+0000 7f36c1c12640 1 --2- 172.21.15.7:0/1269949261 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36bc108520 0x7f36bc1110c0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f36b400eb10 tx=0x7f36b400c2d0 comp rx=0 tx=0).stop 2024-09-21T06:40:07.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.051+0000 7f36c1c12640 1 -- 172.21.15.7:0/1269949261 shutdown_connections 2024-09-21T06:40:07.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.051+0000 7f36c1c12640 1 --2- 172.21.15.7:0/1269949261 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f36a80b6680 0x7f36a80b8b90 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:07.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.051+0000 7f36c1c12640 1 --2- 172.21.15.7:0/1269949261 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36bc108520 0x7f36bc1110c0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:07.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.051+0000 7f36c1c12640 1 --2- 172.21.15.7:0/1269949261 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f36bc107bd0 0x7f36bc110b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:07.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.051+0000 7f36c1c12640 1 --2- 172.21.15.7:0/1269949261 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36bc102290 0x7f36bc110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:07.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.051+0000 7f36c1c12640 1 -- 172.21.15.7:0/1269949261 >> 172.21.15.7:0/1269949261 conn(0x7f36bc079ea0 msgr2=0x7f36bc105cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:07.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.051+0000 7f36c1c12640 1 -- 172.21.15.7:0/1269949261 shutdown_connections 2024-09-21T06:40:07.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:07.051+0000 7f36c1c12640 1 -- 172.21.15.7:0/1269949261 wait complete. 2024-09-21T06:40:07.827 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:40:08.086 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:40:08.503 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:40:08 smithi007 ceph-mon[30983]: pgmap v437: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-21T06:40:08.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.595+0000 7f79a71ad640 1 -- 172.21.15.7:0/709970969 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79a0103b60 msgr2=0x7f79a0103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:08.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.595+0000 7f79a71ad640 1 --2- 172.21.15.7:0/709970969 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79a0103b60 0x7f79a0103f70 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f7990009900 tx=0x7f799002a410 comp rx=0 tx=0).stop 2024-09-21T06:40:08.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.595+0000 7f79a71ad640 1 -- 172.21.15.7:0/709970969 shutdown_connections 2024-09-21T06:40:08.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.595+0000 7f79a71ad640 1 --2- 172.21.15.7:0/709970969 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f79a0109df0 0x7f79a0110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:08.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.595+0000 7f79a71ad640 1 --2- 172.21.15.7:0/709970969 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f79a01094a0 0x7f79a01098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:08.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.595+0000 7f79a71ad640 1 --2- 172.21.15.7:0/709970969 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79a0103b60 0x7f79a0103f70 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:08.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.595+0000 7f79a71ad640 1 -- 172.21.15.7:0/709970969 >> 172.21.15.7:0/709970969 conn(0x7f79a007b850 msgr2=0x7f79a007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:08.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.595+0000 7f79a71ad640 1 -- 172.21.15.7:0/709970969 shutdown_connections 2024-09-21T06:40:08.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.595+0000 7f79a71ad640 1 -- 172.21.15.7:0/709970969 wait complete. 2024-09-21T06:40:08.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.596+0000 7f79a71ad640 1 Processor -- start 2024-09-21T06:40:08.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.596+0000 7f79a71ad640 1 -- start start 2024-09-21T06:40:08.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.596+0000 7f79a71ad640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79a0103b60 0x7f79a019a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:08.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.596+0000 7f79a71ad640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f79a01094a0 0x7f79a019aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:08.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.596+0000 7f79a71ad640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f79a0109df0 0x7f79a019fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:08.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.596+0000 7f79a71ad640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f79a0113ab0 con 0x7f79a0103b60 2024-09-21T06:40:08.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.596+0000 7f79a71ad640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f79a0113930 con 0x7f79a01094a0 2024-09-21T06:40:08.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.596+0000 7f79a71ad640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f79a0113c30 con 0x7f79a0109df0 2024-09-21T06:40:08.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.596+0000 7f79a4f49640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79a0103b60 0x7f79a019a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:08.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.597+0000 7f79a4f49640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79a0103b60 0x7f79a019a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59314/0 (socket says 172.21.15.7:59314) 2024-09-21T06:40:08.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.597+0000 7f79a4f49640 1 -- 172.21.15.7:0/3718231269 learned_addr learned my addr 172.21.15.7:0/3718231269 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:40:08.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.597+0000 7f79a574a640 1 --2- 172.21.15.7:0/3718231269 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f79a0109df0 0x7f79a019fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:08.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.597+0000 7f799ffff640 1 --2- 172.21.15.7:0/3718231269 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f79a01094a0 0x7f79a019aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:08.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.597+0000 7f79a4f49640 1 -- 172.21.15.7:0/3718231269 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f79a0109df0 msgr2=0x7f79a019fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:08.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.597+0000 7f79a4f49640 1 --2- 172.21.15.7:0/3718231269 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f79a0109df0 0x7f79a019fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:08.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.597+0000 7f79a4f49640 1 -- 172.21.15.7:0/3718231269 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f79a01094a0 msgr2=0x7f79a019aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:08.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.597+0000 7f79a4f49640 1 --2- 172.21.15.7:0/3718231269 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f79a01094a0 0x7f79a019aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:08.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.597+0000 7f79a4f49640 1 -- 172.21.15.7:0/3718231269 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79a01a0410 con 0x7f79a0103b60 2024-09-21T06:40:08.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.597+0000 7f79a4f49640 1 --2- 172.21.15.7:0/3718231269 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79a0103b60 0x7f79a019a4a0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f7990005940 tx=0x7f7990004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:08.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.597+0000 7f799dffb640 1 -- 172.21.15.7:0/3718231269 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f799003f030 con 0x7f79a0103b60 2024-09-21T06:40:08.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.597+0000 7f79a71ad640 1 -- 172.21.15.7:0/3718231269 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79a01a06a0 con 0x7f79a0103b60 2024-09-21T06:40:08.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.597+0000 7f799dffb640 1 -- 172.21.15.7:0/3718231269 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7990003aa0 con 0x7f79a0103b60 2024-09-21T06:40:08.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.597+0000 7f799dffb640 1 -- 172.21.15.7:0/3718231269 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7990035070 con 0x7f79a0103b60 2024-09-21T06:40:08.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.598+0000 7f79a71ad640 1 -- 172.21.15.7:0/3718231269 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79a01a6e60 con 0x7f79a0103b60 2024-09-21T06:40:08.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.600+0000 7f79ad721740 1 Processor -- start 2024-09-21T06:40:08.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.600+0000 7f79ad721740 1 -- start start 2024-09-21T06:40:08.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.601+0000 7f799dffb640 1 -- 172.21.15.7:0/3718231269 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f7990042030 con 0x7f79a0103b60 2024-09-21T06:40:08.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.601+0000 7f79ad721740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556ff0f9f070 0x556ff13462c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:08.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.601+0000 7f79ad721740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ff0f761b0 0x556ff1346800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:08.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.601+0000 7f79ad721740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ff0f7e390 0x556ff1346d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:08.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.601+0000 7f79ad721740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x556ff12bcea0 con 0x556ff0f761b0 2024-09-21T06:40:08.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.601+0000 7f79ad721740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x556ff12ac2d0 con 0x556ff0f9f070 2024-09-21T06:40:08.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.601+0000 7f79ad721740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x556ff12b00e0 con 0x556ff0f7e390 2024-09-21T06:40:08.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.601+0000 7f79a4f49640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ff0f761b0 0x556ff1346800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:08.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.601+0000 7f79a574a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556ff0f9f070 0x556ff13462c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:08.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.601+0000 7f79a4f49640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ff0f761b0 0x556ff1346800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59328/0 (socket says 172.21.15.7:59328) 2024-09-21T06:40:08.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.601+0000 7f79a4f49640 1 -- 172.21.15.7:0/315599174 learned_addr learned my addr 172.21.15.7:0/315599174 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:40:08.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.601+0000 7f799ffff640 1 --2- 172.21.15.7:0/315599174 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ff0f7e390 0x556ff1346d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:08.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.601+0000 7f79a574a640 1 -- 172.21.15.7:0/315599174 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ff0f7e390 msgr2=0x556ff1346d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:08.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.601+0000 7f79a574a640 1 --2- 172.21.15.7:0/315599174 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ff0f7e390 0x556ff1346d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:08.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.601+0000 7f79a574a640 1 -- 172.21.15.7:0/315599174 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ff0f761b0 msgr2=0x556ff1346800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:08.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.601+0000 7f79a574a640 1 --2- 172.21.15.7:0/315599174 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ff0f761b0 0x556ff1346800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:08.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.601+0000 7f79a574a640 1 -- 172.21.15.7:0/315599174 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ff100a650 con 0x556ff0f9f070 2024-09-21T06:40:08.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.602+0000 7f799dffb640 1 --2- 172.21.15.7:0/3718231269 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f798c0b6680 0x7f798c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:08.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.602+0000 7f79a4f49640 1 --2- 172.21.15.7:0/3718231269 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f798c0b6680 0x7f798c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:08.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.602+0000 7f79a574a640 1 --2- 172.21.15.7:0/315599174 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556ff0f9f070 0x556ff13462c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7998009f00 tx=0x7f7998011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7970d99fda005f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:08.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.602+0000 7f799dffb640 1 -- 172.21.15.7:0/3718231269 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f7990107ce0 con 0x7f79a0103b60 2024-09-21T06:40:08.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.602+0000 7f7996ffd640 1 -- 172.21.15.7:0/315599174 <== mon.2 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7998004d20 con 0x556ff0f9f070 2024-09-21T06:40:08.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.602+0000 7f7996ffd640 1 -- 172.21.15.7:0/315599174 <== mon.2 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7998004030 con 0x556ff0f9f070 2024-09-21T06:40:08.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.602+0000 7f7996ffd640 1 -- 172.21.15.7:0/315599174 <== mon.2 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7998005280 con 0x556ff0f9f070 2024-09-21T06:40:08.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.603+0000 7f79ad721740 1 -- 172.21.15.7:0/315599174 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556ff0f9f070 msgr2=0x556ff13462c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:08.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.603+0000 7f79a4f49640 1 --2- 172.21.15.7:0/3718231269 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f798c0b6680 0x7f798c0b8b90 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f7990078fa0 tx=0x7f799010b7d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:08.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.603+0000 7f79ad721740 1 --2- 172.21.15.7:0/315599174 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556ff0f9f070 0x556ff13462c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7998009f00 tx=0x7f7998011810 comp rx=0 tx=0).stop 2024-09-21T06:40:08.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.603+0000 7f79ad721740 1 -- 172.21.15.7:0/315599174 shutdown_connections 2024-09-21T06:40:08.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.603+0000 7f79ad721740 1 --2- 172.21.15.7:0/315599174 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ff0f7e390 0x556ff1346d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:08.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.603+0000 7f79ad721740 1 --2- 172.21.15.7:0/315599174 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ff0f761b0 0x556ff1346800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:08.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.603+0000 7f79ad721740 1 --2- 172.21.15.7:0/315599174 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556ff0f9f070 0x556ff13462c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:08.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.603+0000 7f79ad721740 1 -- 172.21.15.7:0/315599174 >> 172.21.15.7:0/315599174 conn(0x556ff0f93460 msgr2=0x556ff13441b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:08.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.603+0000 7f79ad721740 1 -- 172.21.15.7:0/315599174 shutdown_connections 2024-09-21T06:40:08.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.603+0000 7f79ad721740 1 -- 172.21.15.7:0/315599174 wait complete. 2024-09-21T06:40:08.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.603+0000 7f79ad721740 1 -- start start 2024-09-21T06:40:08.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.604+0000 7f79ad721740 1 Processor -- start 2024-09-21T06:40:08.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.604+0000 7f79ad721740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ff0f761b0 0x556ff1351990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:08.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.604+0000 7f79ad721740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ff0f7e390 0x556ff1351ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:08.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.604+0000 7f79ad721740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556ff0f9f070 0x556ff135dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:08.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.604+0000 7f79ad721740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x556ff110d700 con 0x556ff0f7e390 2024-09-21T06:40:08.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.604+0000 7f79ad721740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x556ff1247160 con 0x556ff0f9f070 2024-09-21T06:40:08.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.604+0000 7f79ad721740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x556ff1354aa0 con 0x556ff0f761b0 2024-09-21T06:40:08.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.604+0000 7f79ad721740 10 client.0 _ll_register_callbacks cb 0x556ff12609e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:40:08.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.604+0000 7f799ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ff0f7e390 0x556ff1351ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:08.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.604+0000 7f799ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ff0f7e390 0x556ff1351ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59336/0 (socket says 172.21.15.7:59336) 2024-09-21T06:40:08.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.604+0000 7f79a574a640 1 --2- 172.21.15.7:0/1571715732 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ff0f761b0 0x556ff1351990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:08.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.604+0000 7f799ffff640 1 -- 172.21.15.7:0/1571715732 learned_addr learned my addr 172.21.15.7:0/1571715732 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:40:08.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.604+0000 7f79a574a640 1 --2- 172.21.15.7:0/1571715732 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556ff0f9f070 0x556ff135dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:08.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.605+0000 7f799ffff640 1 -- 172.21.15.7:0/1571715732 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ff0f761b0 msgr2=0x556ff1351990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:08.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.605+0000 7f799ffff640 1 --2- 172.21.15.7:0/1571715732 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ff0f761b0 0x556ff1351990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:08.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.605+0000 7f799ffff640 1 -- 172.21.15.7:0/1571715732 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556ff0f9f070 msgr2=0x556ff135dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:08.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.605+0000 7f799ffff640 1 --2- 172.21.15.7:0/1571715732 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556ff0f9f070 0x556ff135dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:08.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.605+0000 7f799ffff640 1 -- 172.21.15.7:0/1571715732 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ff1274c90 con 0x556ff0f7e390 2024-09-21T06:40:08.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.605+0000 7f799ffff640 1 --2- 172.21.15.7:0/1571715732 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ff0f7e390 0x556ff1351ed0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f798800bab0 tx=0x7f798800bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b99434177b81e0d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:08.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.605+0000 7f797ffff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:40:08.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.605+0000 7f797ffff640 1 -- 172.21.15.7:0/1571715732 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7988003e20 con 0x556ff0f7e390 2024-09-21T06:40:08.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.605+0000 7f797ffff640 1 -- 172.21.15.7:0/1571715732 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f7988011440 con 0x556ff0f7e390 2024-09-21T06:40:08.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.605+0000 7f79ad721740 1 -- 172.21.15.7:0/1571715732 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7998004030 con 0x556ff0f7e390 2024-09-21T06:40:08.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.605+0000 7f797ffff640 1 -- 172.21.15.7:0/1571715732 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7988011640 con 0x556ff0f7e390 2024-09-21T06:40:08.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.605+0000 7f79ad721740 10 client.16281 fetch_fsmap learned FSMap version 25 2024-09-21T06:40:08.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.605+0000 7f79ad721740 1 -- 172.21.15.7:0/1571715732 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x556ff13607d0 con 0x556ff0f7e390 2024-09-21T06:40:08.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.606+0000 7f797ffff640 1 -- 172.21.15.7:0/1571715732 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7998004030 con 0x556ff0f7e390 2024-09-21T06:40:08.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.606+0000 7f797ffff640 1 -- 172.21.15.7:0/1571715732 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f7988025890 con 0x556ff0f7e390 2024-09-21T06:40:08.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.606+0000 7f79ad721740 10 client.16281 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:40:08.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.606+0000 7f79ad721740 10 client.16281 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:40:08.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.606+0000 7f79ad721740 20 client.16281 populate_metadata read hostname 'smithi007' 2024-09-21T06:40:08.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.606+0000 7f79ad721740 1 --2- 172.21.15.7:0/1571715732 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x556ff0f5d9f0 0x556ff1363cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:08.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.606+0000 7f79ad721740 4 client.16281 mds_command: new command op to 24688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:40:08.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.606+0000 7f79ad721740 1 -- 172.21.15.7:0/1571715732 --> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556ff12bedf0 con 0x556ff0f5d9f0 2024-09-21T06:40:08.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.606+0000 7f79a574a640 1 --2- 172.21.15.7:0/1571715732 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x556ff0f5d9f0 0x556ff1363cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:08.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.607+0000 7f79a574a640 1 --2- 172.21.15.7:0/1571715732 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x556ff0f5d9f0 0x556ff1363cb0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b5ff6995cedf0f3c server_cookie=27fe1ed9193ea20c in_seq=0 out_seq=0 2024-09-21T06:40:08.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.607+0000 7f797ffff640 10 client.16281 ms_handle_connect on v2:172.21.15.144:6838/4027821922 2024-09-21T06:40:08.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.608+0000 7f797ffff640 1 -- 172.21.15.7:0/1571715732 <== mds.1 v2:172.21.15.144:6838/4027821922 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556ff12bedf0 con 0x556ff0f5d9f0 2024-09-21T06:40:08.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.608+0000 7f797ffff640 10 client.16281 handle_command_reply: tid=0 2024-09-21T06:40:08.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.608+0000 7f79ad721740 1 client.16281 shutdown 2024-09-21T06:40:08.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.608+0000 7f79ad721740 1 -- 172.21.15.7:0/1571715732 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ff0f7e390 msgr2=0x556ff1351ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:08.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.608+0000 7f79ad721740 1 --2- 172.21.15.7:0/1571715732 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ff0f7e390 0x556ff1351ed0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f798800bab0 tx=0x7f798800bf70 comp rx=0 tx=0).stop 2024-09-21T06:40:08.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.608+0000 7f79ad721740 1 -- 172.21.15.7:0/1571715732 shutdown_connections 2024-09-21T06:40:08.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.608+0000 7f79ad721740 1 --2- 172.21.15.7:0/1571715732 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x556ff0f5d9f0 0x556ff1363cb0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:08.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.608+0000 7f797ffff640 0 client.16281 ms_handle_reset on v2:172.21.15.144:6838/4027821922 2024-09-21T06:40:08.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.608+0000 7f79ad721740 1 --2- 172.21.15.7:0/1571715732 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556ff0f9f070 0x556ff135dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:08.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.608+0000 7f79ad721740 1 --2- 172.21.15.7:0/1571715732 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ff0f7e390 0x556ff1351ed0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:08.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.608+0000 7f79ad721740 1 --2- 172.21.15.7:0/1571715732 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ff0f761b0 0x556ff1351990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:08.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.608+0000 7f79ad721740 1 -- 172.21.15.7:0/1571715732 >> 172.21.15.7:0/1571715732 conn(0x556ff0f93460 msgr2=0x556ff13494a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:08.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.608+0000 7f79ad721740 1 -- 172.21.15.7:0/1571715732 shutdown_connections 2024-09-21T06:40:08.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.608+0000 7f79ad721740 1 -- 172.21.15.7:0/1571715732 wait complete. 2024-09-21T06:40:08.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.608+0000 7f79ad721740 20 client.16281 trim_cache size 0 max 16384 2024-09-21T06:40:08.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:40:08 smithi018 ceph-mon[34477]: pgmap v437: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-21T06:40:08.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.622+0000 7f79ad721740 1 Processor -- start 2024-09-21T06:40:08.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.622+0000 7f79ad721740 1 -- start start 2024-09-21T06:40:08.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.622+0000 7f79ad721740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ff0f5d9f0 0x556ff1351e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:08.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.622+0000 7f79ad721740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556ff0f761b0 0x556ff135dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:08.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.622+0000 7f79ad721740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ff0f7e390 0x556ff134eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:08.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.622+0000 7f79ad721740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f79a01b1e50 con 0x556ff0f5d9f0 2024-09-21T06:40:08.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.622+0000 7f79ad721740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f79a01af720 con 0x556ff0f761b0 2024-09-21T06:40:08.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.622+0000 7f79ad721740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f79a01ad550 con 0x556ff0f7e390 2024-09-21T06:40:08.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.622+0000 7f79a574a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ff0f5d9f0 0x556ff1351e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:08.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.622+0000 7f79a574a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ff0f5d9f0 0x556ff1351e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59344/0 (socket says 172.21.15.7:59344) 2024-09-21T06:40:08.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.622+0000 7f79a574a640 1 -- 172.21.15.7:0/2311001670 learned_addr learned my addr 172.21.15.7:0/2311001670 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:40:08.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.622+0000 7f799ffff640 1 --2- 172.21.15.7:0/2311001670 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556ff0f761b0 0x556ff135dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:08.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.622+0000 7f79a574a640 1 -- 172.21.15.7:0/2311001670 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ff0f7e390 msgr2=0x556ff134eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:08.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.622+0000 7f79a574a640 1 --2- 172.21.15.7:0/2311001670 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ff0f7e390 0x556ff134eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:08.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.622+0000 7f79a574a640 1 -- 172.21.15.7:0/2311001670 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556ff0f761b0 msgr2=0x556ff135dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:08.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.622+0000 7f79a574a640 1 --2- 172.21.15.7:0/2311001670 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556ff0f761b0 0x556ff135dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:08.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.622+0000 7f79a574a640 1 -- 172.21.15.7:0/2311001670 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ff1352c50 con 0x556ff0f5d9f0 2024-09-21T06:40:08.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.622+0000 7f79a574a640 1 --2- 172.21.15.7:0/2311001670 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ff0f5d9f0 0x556ff1351e50 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f7998011d10 tx=0x7f79980048d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc7074e10454c11d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:08.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.623+0000 7f79967fc640 1 -- 172.21.15.7:0/2311001670 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f799801e040 con 0x556ff0f5d9f0 2024-09-21T06:40:08.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.623+0000 7f79967fc640 1 -- 172.21.15.7:0/2311001670 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f799802d030 con 0x556ff0f5d9f0 2024-09-21T06:40:08.626 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.623+0000 7f79967fc640 1 -- 172.21.15.7:0/2311001670 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f799800f6e0 con 0x556ff0f5d9f0 2024-09-21T06:40:08.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.623+0000 7f79ad721740 1 -- 172.21.15.7:0/2311001670 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ff0f5d9f0 msgr2=0x556ff1351e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:08.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.623+0000 7f79ad721740 1 --2- 172.21.15.7:0/2311001670 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ff0f5d9f0 0x556ff1351e50 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f7998011d10 tx=0x7f79980048d0 comp rx=0 tx=0).stop 2024-09-21T06:40:08.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.623+0000 7f79ad721740 1 -- 172.21.15.7:0/2311001670 shutdown_connections 2024-09-21T06:40:08.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.623+0000 7f79ad721740 1 --2- 172.21.15.7:0/2311001670 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ff0f7e390 0x556ff134eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:08.628 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.623+0000 7f79ad721740 1 --2- 172.21.15.7:0/2311001670 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556ff0f761b0 0x556ff135dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:08.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.623+0000 7f79ad721740 1 --2- 172.21.15.7:0/2311001670 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ff0f5d9f0 0x556ff1351e50 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:08.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.623+0000 7f79ad721740 1 -- 172.21.15.7:0/2311001670 >> 172.21.15.7:0/2311001670 conn(0x556ff0f93460 msgr2=0x556ff1351740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:08.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.624+0000 7f79ad721740 1 -- 172.21.15.7:0/2311001670 shutdown_connections 2024-09-21T06:40:08.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.624+0000 7f79ad721740 1 -- 172.21.15.7:0/2311001670 wait complete. 2024-09-21T06:40:08.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.624+0000 7f79ad721740 1 -- start start 2024-09-21T06:40:08.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.624+0000 7f79ad721740 1 Processor -- start 2024-09-21T06:40:08.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.624+0000 7f79ad721740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ff0f5d9f0 0x556ff13c7e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:08.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.624+0000 7f79ad721740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556ff0f761b0 0x556ff13c8390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:08.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.624+0000 7f79ad721740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ff0f7e390 0x556ff1359cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:08.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.624+0000 7f79ad721740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f79a01adbe0 con 0x556ff0f7e390 2024-09-21T06:40:08.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.624+0000 7f79ad721740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f79a01af050 con 0x556ff0f761b0 2024-09-21T06:40:08.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.624+0000 7f79ad721740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f79a01ae2b0 con 0x556ff0f5d9f0 2024-09-21T06:40:08.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.625+0000 7f79ad721740 10 client.0 _ll_register_callbacks cb 0x7f7988004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:40:08.629 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.625+0000 7f79a574a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ff0f7e390 0x556ff1359cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:08.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.625+0000 7f79a574a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ff0f7e390 0x556ff1359cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59348/0 (socket says 172.21.15.7:59348) 2024-09-21T06:40:08.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.625+0000 7f79a574a640 1 -- 172.21.15.7:0/1927488203 learned_addr learned my addr 172.21.15.7:0/1927488203 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:40:08.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.625+0000 7f79a574a640 1 --2- 172.21.15.7:0/1927488203 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ff0f5d9f0 0x556ff13c7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:08.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.625+0000 7f799ffff640 1 --2- 172.21.15.7:0/1927488203 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556ff0f761b0 0x556ff13c8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:08.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.625+0000 7f79a574a640 1 -- 172.21.15.7:0/1927488203 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ff0f5d9f0 msgr2=0x556ff13c7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:08.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.625+0000 7f79a574a640 1 --2- 172.21.15.7:0/1927488203 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ff0f5d9f0 0x556ff13c7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:08.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.625+0000 7f79a574a640 1 -- 172.21.15.7:0/1927488203 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556ff0f761b0 msgr2=0x556ff13c8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:08.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.625+0000 7f79a574a640 1 --2- 172.21.15.7:0/1927488203 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556ff0f761b0 0x556ff13c8390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:08.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.625+0000 7f79a574a640 1 -- 172.21.15.7:0/1927488203 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ff135a230 con 0x556ff0f7e390 2024-09-21T06:40:08.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.625+0000 7f79a574a640 1 --2- 172.21.15.7:0/1927488203 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ff0f7e390 0x556ff1359cf0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f7998005a20 tx=0x7f799802b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b34ce1dd2bd025fd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:08.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.625+0000 7f797ffff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:40:08.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.625+0000 7f797ffff640 1 -- 172.21.15.7:0/1927488203 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7998004a00 con 0x556ff0f7e390 2024-09-21T06:40:08.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.625+0000 7f797ffff640 1 -- 172.21.15.7:0/1927488203 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f7998004ba0 con 0x556ff0f7e390 2024-09-21T06:40:08.630 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.625+0000 7f79ad721740 1 -- 172.21.15.7:0/1927488203 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f799802d030 con 0x556ff0f7e390 2024-09-21T06:40:08.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.626+0000 7f797ffff640 1 -- 172.21.15.7:0/1927488203 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7998004da0 con 0x556ff0f7e390 2024-09-21T06:40:08.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.626+0000 7f79ad721740 10 client.16287 fetch_fsmap learned FSMap version 25 2024-09-21T06:40:08.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.626+0000 7f79ad721740 1 -- 172.21.15.7:0/1927488203 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x556ff13d32b0 con 0x556ff0f7e390 2024-09-21T06:40:08.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.626+0000 7f797ffff640 1 -- 172.21.15.7:0/1927488203 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f799802d030 con 0x556ff0f7e390 2024-09-21T06:40:08.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.626+0000 7f797ffff640 1 -- 172.21.15.7:0/1927488203 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f7998024040 con 0x556ff0f7e390 2024-09-21T06:40:08.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.626+0000 7f79ad721740 10 client.16287 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:40:08.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.626+0000 7f79ad721740 10 client.16287 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:40:08.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.626+0000 7f79ad721740 20 client.16287 populate_metadata read hostname 'smithi007' 2024-09-21T06:40:08.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.626+0000 7f79ad721740 1 --2- 172.21.15.7:0/1927488203 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x556ff0f9f070 0x556ff13d57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:08.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.626+0000 7f79ad721740 4 client.16287 mds_command: new command op to 24688 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:40:08.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.626+0000 7f79ad721740 1 -- 172.21.15.7:0/1927488203 --> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556ff12ba8a0 con 0x556ff0f9f070 2024-09-21T06:40:08.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.626+0000 7f799ffff640 1 --2- 172.21.15.7:0/1927488203 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x556ff0f9f070 0x556ff13d57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:08.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.627+0000 7f799ffff640 1 --2- 172.21.15.7:0/1927488203 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x556ff0f9f070 0x556ff13d57d0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f885568f11da0364 server_cookie=cf309938c27798d8 in_seq=0 out_seq=0 2024-09-21T06:40:08.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.627+0000 7f797ffff640 10 client.16287 ms_handle_connect on v2:172.21.15.144:6838/4027821922 2024-09-21T06:40:08.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.627+0000 7f797ffff640 1 -- 172.21.15.7:0/1927488203 <== mds.1 v2:172.21.15.144:6838/4027821922 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556ff12ba8a0 con 0x556ff0f9f070 2024-09-21T06:40:08.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.627+0000 7f797ffff640 10 client.16287 handle_command_reply: tid=0 2024-09-21T06:40:08.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.627+0000 7f79ad721740 1 client.16287 shutdown 2024-09-21T06:40:08.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.627+0000 7f79ad721740 1 -- 172.21.15.7:0/1927488203 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ff0f7e390 msgr2=0x556ff1359cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:08.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.627+0000 7f79ad721740 1 --2- 172.21.15.7:0/1927488203 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ff0f7e390 0x556ff1359cf0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f7998005a20 tx=0x7f799802b040 comp rx=0 tx=0).stop 2024-09-21T06:40:08.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.627+0000 7f79ad721740 1 -- 172.21.15.7:0/1927488203 shutdown_connections 2024-09-21T06:40:08.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.627+0000 7f79ad721740 1 --2- 172.21.15.7:0/1927488203 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x556ff0f9f070 0x556ff13d57d0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:08.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.627+0000 7f79ad721740 1 --2- 172.21.15.7:0/1927488203 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ff0f7e390 0x556ff1359cf0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:08.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.627+0000 7f797ffff640 0 client.16287 ms_handle_reset on v2:172.21.15.144:6838/4027821922 2024-09-21T06:40:08.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.627+0000 7f79ad721740 1 --2- 172.21.15.7:0/1927488203 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556ff0f761b0 0x556ff13c8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:08.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.627+0000 7f79ad721740 1 --2- 172.21.15.7:0/1927488203 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ff0f5d9f0 0x556ff13c7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:08.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.627+0000 7f79ad721740 1 -- 172.21.15.7:0/1927488203 >> 172.21.15.7:0/1927488203 conn(0x556ff0f93460 msgr2=0x556ff1352e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:08.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.627+0000 7f79ad721740 1 -- 172.21.15.7:0/1927488203 shutdown_connections 2024-09-21T06:40:08.633 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.628+0000 7f79ad721740 1 -- 172.21.15.7:0/1927488203 wait complete. 2024-09-21T06:40:08.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.628+0000 7f79ad721740 20 client.16287 trim_cache size 0 max 16384 2024-09-21T06:40:08.634 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:40:08.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.628+0000 7f79a71ad640 1 -- 172.21.15.7:0/3718231269 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f798c0b6680 msgr2=0x7f798c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:08.634 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.628+0000 7f79a71ad640 1 --2- 172.21.15.7:0/3718231269 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f798c0b6680 0x7f798c0b8b90 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f7990078fa0 tx=0x7f799010b7d0 comp rx=0 tx=0).stop 2024-09-21T06:40:08.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.628+0000 7f79a71ad640 1 -- 172.21.15.7:0/3718231269 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79a0103b60 msgr2=0x7f79a019a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:08.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.628+0000 7f79a71ad640 1 --2- 172.21.15.7:0/3718231269 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79a0103b60 0x7f79a019a4a0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f7990005940 tx=0x7f7990004270 comp rx=0 tx=0).stop 2024-09-21T06:40:08.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.628+0000 7f79a71ad640 1 -- 172.21.15.7:0/3718231269 shutdown_connections 2024-09-21T06:40:08.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.628+0000 7f79a71ad640 1 --2- 172.21.15.7:0/3718231269 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f798c0b6680 0x7f798c0b8b90 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:08.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.628+0000 7f79a71ad640 1 --2- 172.21.15.7:0/3718231269 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f79a0109df0 0x7f79a019fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:08.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.628+0000 7f79a71ad640 1 --2- 172.21.15.7:0/3718231269 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f79a01094a0 0x7f79a019aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:08.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.628+0000 7f79a71ad640 1 --2- 172.21.15.7:0/3718231269 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f79a0103b60 0x7f79a019a4a0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:08.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.628+0000 7f79a71ad640 1 -- 172.21.15.7:0/3718231269 >> 172.21.15.7:0/3718231269 conn(0x7f79a007b850 msgr2=0x7f79a0107550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:08.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.628+0000 7f79a71ad640 1 -- 172.21.15.7:0/3718231269 shutdown_connections 2024-09-21T06:40:08.635 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:08.628+0000 7f79a71ad640 1 -- 172.21.15.7:0/3718231269 wait complete. 2024-09-21T06:40:08.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:40:08 smithi144 ceph-mon[34653]: pgmap v437: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-21T06:40:09.397 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:40:09.656 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:40:10.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.130+0000 7f2b1f59e640 1 -- 172.21.15.7:0/1726046089 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b201047d0 msgr2=0x7f2b20104be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:10.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.130+0000 7f2b1f59e640 1 --2- 172.21.15.7:0/1726046089 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b201047d0 0x7f2b20104be0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f2b10009900 tx=0x7f2b1002a410 comp rx=0 tx=0).stop 2024-09-21T06:40:10.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.130+0000 7f2b1f59e640 1 -- 172.21.15.7:0/1726046089 shutdown_connections 2024-09-21T06:40:10.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.130+0000 7f2b1f59e640 1 --2- 172.21.15.7:0/1726046089 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b2010dc30 0x7f2b20110120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:10.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.130+0000 7f2b1f59e640 1 --2- 172.21.15.7:0/1726046089 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b20105120 0x7f2b2010d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:10.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.130+0000 7f2b1f59e640 1 --2- 172.21.15.7:0/1726046089 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b201047d0 0x7f2b20104be0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:10.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.130+0000 7f2b1f59e640 1 -- 172.21.15.7:0/1726046089 >> 172.21.15.7:0/1726046089 conn(0x7f2b200fe2d0 msgr2=0x7f2b20100720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:10.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.130+0000 7f2b1f59e640 1 -- 172.21.15.7:0/1726046089 shutdown_connections 2024-09-21T06:40:10.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.130+0000 7f2b1f59e640 1 -- 172.21.15.7:0/1726046089 wait complete. 2024-09-21T06:40:10.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.131+0000 7f2b1f59e640 1 Processor -- start 2024-09-21T06:40:10.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.131+0000 7f2b1f59e640 1 -- start start 2024-09-21T06:40:10.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.131+0000 7f2b1f59e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b201047d0 0x7f2b2019a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:10.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.132+0000 7f2b1f59e640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b20105120 0x7f2b2019a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:10.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.132+0000 7f2b1f59e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b2010dc30 0x7f2b2019fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:10.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.132+0000 7f2b1f59e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2b201138b0 con 0x7f2b2010dc30 2024-09-21T06:40:10.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.132+0000 7f2b1f59e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2b20113730 con 0x7f2b201047d0 2024-09-21T06:40:10.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.132+0000 7f2b1f59e640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2b20113a30 con 0x7f2b20105120 2024-09-21T06:40:10.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.132+0000 7f2b1ed9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b2010dc30 0x7f2b2019fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:10.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.132+0000 7f2b17fff640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b20105120 0x7f2b2019a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:10.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.132+0000 7f2b1ed9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b2010dc30 0x7f2b2019fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59362/0 (socket says 172.21.15.7:59362) 2024-09-21T06:40:10.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.132+0000 7f2b1ed9d640 1 -- 172.21.15.7:0/1864535860 learned_addr learned my addr 172.21.15.7:0/1864535860 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:40:10.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.132+0000 7f2b1e59c640 1 --2- 172.21.15.7:0/1864535860 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b201047d0 0x7f2b2019a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:10.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.132+0000 7f2b17fff640 1 -- 172.21.15.7:0/1864535860 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b201047d0 msgr2=0x7f2b2019a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:10.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.132+0000 7f2b17fff640 1 --2- 172.21.15.7:0/1864535860 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b201047d0 0x7f2b2019a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:10.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.132+0000 7f2b17fff640 1 -- 172.21.15.7:0/1864535860 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b2010dc30 msgr2=0x7f2b2019fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:10.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.132+0000 7f2b17fff640 1 --2- 172.21.15.7:0/1864535860 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b2010dc30 0x7f2b2019fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:10.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.132+0000 7f2b17fff640 1 -- 172.21.15.7:0/1864535860 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b201a01f0 con 0x7f2b20105120 2024-09-21T06:40:10.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.132+0000 7f2b1ed9d640 1 --2- 172.21.15.7:0/1864535860 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b2010dc30 0x7f2b2019fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:40:10.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.132+0000 7f2b17fff640 1 --2- 172.21.15.7:0/1864535860 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b20105120 0x7f2b2019a820 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2b2006b510 tx=0x7f2b0800ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:10.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.133+0000 7f2b177fe640 1 -- 172.21.15.7:0/1864535860 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b0800cc40 con 0x7f2b20105120 2024-09-21T06:40:10.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.133+0000 7f2b1f59e640 1 -- 172.21.15.7:0/1864535860 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b201a04e0 con 0x7f2b20105120 2024-09-21T06:40:10.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.133+0000 7f2b177fe640 1 -- 172.21.15.7:0/1864535860 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2b0800cde0 con 0x7f2b20105120 2024-09-21T06:40:10.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.133+0000 7f2b177fe640 1 -- 172.21.15.7:0/1864535860 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b08018760 con 0x7f2b20105120 2024-09-21T06:40:10.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.133+0000 7f2b1f59e640 1 -- 172.21.15.7:0/1864535860 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b201a6c40 con 0x7f2b20105120 2024-09-21T06:40:10.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.135+0000 7f2b2b177740 1 Processor -- start 2024-09-21T06:40:10.137 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.135+0000 7f2b2b177740 1 -- start start 2024-09-21T06:40:10.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.136+0000 7f2b2b177740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a1f2da6070 0x55a1f314d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:10.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.136+0000 7f2b2b177740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a1f2d7d1b0 0x55a1f314d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:10.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.136+0000 7f2b2b177740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a1f2d85390 0x55a1f314dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:10.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.136+0000 7f2b2b177740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55a1f30c3ea0 con 0x55a1f2da6070 2024-09-21T06:40:10.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.136+0000 7f2b2b177740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a1f30b32d0 con 0x55a1f2d7d1b0 2024-09-21T06:40:10.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.136+0000 7f2b2b177740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55a1f30b70e0 con 0x55a1f2d85390 2024-09-21T06:40:10.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.136+0000 7f2b1ed9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a1f2da6070 0x55a1f314d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:10.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.136+0000 7f2b1ed9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a1f2da6070 0x55a1f314d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59366/0 (socket says 172.21.15.7:59366) 2024-09-21T06:40:10.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.136+0000 7f2b1ed9d640 1 -- 172.21.15.7:0/458593612 learned_addr learned my addr 172.21.15.7:0/458593612 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:40:10.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.136+0000 7f2b1e59c640 1 --2- 172.21.15.7:0/458593612 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a1f2d7d1b0 0x55a1f314d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:10.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.136+0000 7f2b177fe640 1 -- 172.21.15.7:0/1864535860 <== mon.1 v2:172.21.15.144:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f2b08010430 con 0x7f2b20105120 2024-09-21T06:40:10.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.136+0000 7f2b1ed9d640 1 -- 172.21.15.7:0/458593612 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a1f2d85390 msgr2=0x55a1f314dee0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T06:40:10.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.136+0000 7f2b1ed9d640 1 --2- 172.21.15.7:0/458593612 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a1f2d85390 0x55a1f314dee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:10.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.136+0000 7f2b1ed9d640 1 -- 172.21.15.7:0/458593612 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a1f2d7d1b0 msgr2=0x55a1f314d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:10.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.136+0000 7f2b1ed9d640 1 --2- 172.21.15.7:0/458593612 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a1f2d7d1b0 0x55a1f314d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:10.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.136+0000 7f2b1ed9d640 1 -- 172.21.15.7:0/458593612 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1f2e11650 con 0x55a1f2da6070 2024-09-21T06:40:10.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.136+0000 7f2b1e59c640 1 --2- 172.21.15.7:0/458593612 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a1f2d7d1b0 0x55a1f314d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:40:10.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.137+0000 7f2b1ed9d640 1 --2- 172.21.15.7:0/458593612 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a1f2da6070 0x55a1f314d460 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f2b180118b0 tx=0x7f2b18011d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a95551791b5d32dc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:10.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.137+0000 7f2b14ff9640 1 -- 172.21.15.7:0/458593612 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b1801e070 con 0x55a1f2da6070 2024-09-21T06:40:10.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.137+0000 7f2b14ff9640 1 -- 172.21.15.7:0/458593612 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2b1800fe70 con 0x55a1f2da6070 2024-09-21T06:40:10.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.137+0000 7f2b14ff9640 1 -- 172.21.15.7:0/458593612 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b18019d00 con 0x55a1f2da6070 2024-09-21T06:40:10.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.137+0000 7f2b177fe640 1 --2- 172.21.15.7:0/1864535860 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f2b0c0b6680 0x7f2b0c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:10.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.137+0000 7f2b1e59c640 1 --2- 172.21.15.7:0/1864535860 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f2b0c0b6680 0x7f2b0c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:10.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.137+0000 7f2b177fe640 1 -- 172.21.15.7:0/1864535860 <== mon.1 v2:172.21.15.144:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f2b080e78d0 con 0x7f2b20105120 2024-09-21T06:40:10.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.138+0000 7f2b2b177740 1 -- 172.21.15.7:0/458593612 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a1f2da6070 msgr2=0x55a1f314d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:10.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.138+0000 7f2b1e59c640 1 --2- 172.21.15.7:0/1864535860 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f2b0c0b6680 0x7f2b0c0b8b90 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2b10031440 tx=0x7f2b10009560 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:10.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.138+0000 7f2b2b177740 1 --2- 172.21.15.7:0/458593612 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a1f2da6070 0x55a1f314d460 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f2b180118b0 tx=0x7f2b18011d70 comp rx=0 tx=0).stop 2024-09-21T06:40:10.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.138+0000 7f2b2b177740 1 -- 172.21.15.7:0/458593612 shutdown_connections 2024-09-21T06:40:10.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.138+0000 7f2b2b177740 1 --2- 172.21.15.7:0/458593612 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a1f2d85390 0x55a1f314dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:10.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.138+0000 7f2b2b177740 1 --2- 172.21.15.7:0/458593612 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a1f2d7d1b0 0x55a1f314d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:10.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.138+0000 7f2b2b177740 1 --2- 172.21.15.7:0/458593612 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a1f2da6070 0x55a1f314d460 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:10.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.138+0000 7f2b2b177740 1 -- 172.21.15.7:0/458593612 >> 172.21.15.7:0/458593612 conn(0x55a1f2d9a460 msgr2=0x55a1f314b350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:10.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.138+0000 7f2b2b177740 1 -- 172.21.15.7:0/458593612 shutdown_connections 2024-09-21T06:40:10.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.138+0000 7f2b2b177740 1 -- 172.21.15.7:0/458593612 wait complete. 2024-09-21T06:40:10.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.138+0000 7f2b2b177740 1 -- start start 2024-09-21T06:40:10.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.139+0000 7f2b2b177740 1 Processor -- start 2024-09-21T06:40:10.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.139+0000 7f2b2b177740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a1f2d7d1b0 0x55a1f3158b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:10.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.139+0000 7f2b2b177740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a1f2d85390 0x55a1f3159040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:10.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.139+0000 7f2b2b177740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a1f2da6070 0x55a1f3164f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:10.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.139+0000 7f2b2b177740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55a1f2f14700 con 0x55a1f2d7d1b0 2024-09-21T06:40:10.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.139+0000 7f2b2b177740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a1f304e160 con 0x55a1f2d85390 2024-09-21T06:40:10.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.139+0000 7f2b2b177740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55a1f315bc40 con 0x55a1f2da6070 2024-09-21T06:40:10.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.139+0000 7f2b2b177740 10 client.0 _ll_register_callbacks cb 0x55a1f30679e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:40:10.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.139+0000 7f2b1e59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a1f2d7d1b0 0x55a1f3158b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:10.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.139+0000 7f2b1e59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a1f2d7d1b0 0x55a1f3158b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59370/0 (socket says 172.21.15.7:59370) 2024-09-21T06:40:10.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.139+0000 7f2b1e59c640 1 -- 172.21.15.7:0/2794664134 learned_addr learned my addr 172.21.15.7:0/2794664134 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:40:10.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.139+0000 7f2b17fff640 1 --2- 172.21.15.7:0/2794664134 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a1f2d85390 0x55a1f3159040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:10.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.139+0000 7f2b1ed9d640 1 --2- 172.21.15.7:0/2794664134 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a1f2da6070 0x55a1f3164f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:10.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.139+0000 7f2b1e59c640 1 -- 172.21.15.7:0/2794664134 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a1f2da6070 msgr2=0x55a1f3164f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:10.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.139+0000 7f2b1e59c640 1 --2- 172.21.15.7:0/2794664134 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a1f2da6070 0x55a1f3164f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:10.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.139+0000 7f2b1e59c640 1 -- 172.21.15.7:0/2794664134 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a1f2d85390 msgr2=0x55a1f3159040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:10.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.139+0000 7f2b1e59c640 1 --2- 172.21.15.7:0/2794664134 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a1f2d85390 0x55a1f3159040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:10.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.139+0000 7f2b1e59c640 1 -- 172.21.15.7:0/2794664134 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1f307bc90 con 0x55a1f2d7d1b0 2024-09-21T06:40:10.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.140+0000 7f2b1e59c640 1 --2- 172.21.15.7:0/2794664134 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a1f2d7d1b0 0x55a1f3158b00 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f2b10032fd0 tx=0x7f2b10009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7859d9dc447692ef server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:10.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.140+0000 7f2b05ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:40:10.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.140+0000 7f2b05ffb640 1 -- 172.21.15.7:0/2794664134 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b1004d070 con 0x55a1f2d7d1b0 2024-09-21T06:40:10.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.140+0000 7f2b05ffb640 1 -- 172.21.15.7:0/2794664134 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f2b10004450 con 0x55a1f2d7d1b0 2024-09-21T06:40:10.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.140+0000 7f2b2b177740 1 -- 172.21.15.7:0/2794664134 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2b1800fe70 con 0x55a1f2d7d1b0 2024-09-21T06:40:10.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.140+0000 7f2b05ffb640 1 -- 172.21.15.7:0/2794664134 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2b10059050 con 0x55a1f2d7d1b0 2024-09-21T06:40:10.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.140+0000 7f2b2b177740 10 client.16299 fetch_fsmap learned FSMap version 25 2024-09-21T06:40:10.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.140+0000 7f2b2b177740 1 -- 172.21.15.7:0/2794664134 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a1f3167960 con 0x55a1f2d7d1b0 2024-09-21T06:40:10.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.140+0000 7f2b05ffb640 1 -- 172.21.15.7:0/2794664134 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2b1800fe70 con 0x55a1f2d7d1b0 2024-09-21T06:40:10.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.140+0000 7f2b05ffb640 1 -- 172.21.15.7:0/2794664134 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f2b10004cc0 con 0x55a1f2d7d1b0 2024-09-21T06:40:10.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.141+0000 7f2b2b177740 10 client.16299 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:40:10.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.141+0000 7f2b2b177740 10 client.16299 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:40:10.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.141+0000 7f2b2b177740 20 client.16299 populate_metadata read hostname 'smithi007' 2024-09-21T06:40:10.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.141+0000 7f2b2b177740 1 --2- 172.21.15.7:0/2794664134 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55a1f2d649f0 0x55a1f316ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:10.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.141+0000 7f2b2b177740 4 client.16299 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:40:10.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.141+0000 7f2b2b177740 1 -- 172.21.15.7:0/2794664134 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a1f30c5df0 con 0x55a1f2d649f0 2024-09-21T06:40:10.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.141+0000 7f2b17fff640 1 --2- 172.21.15.7:0/2794664134 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55a1f2d649f0 0x55a1f316ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:10.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.141+0000 7f2b17fff640 1 --2- 172.21.15.7:0/2794664134 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55a1f2d649f0 0x55a1f316ae10 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16ad8679d9f9a62e server_cookie=56c7b4a4472bc4aa in_seq=0 out_seq=0 2024-09-21T06:40:10.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.141+0000 7f2b05ffb640 10 client.16299 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:40:10.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.142+0000 7f2b05ffb640 1 -- 172.21.15.7:0/2794664134 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a1f30c5df0 con 0x55a1f2d649f0 2024-09-21T06:40:10.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.142+0000 7f2b05ffb640 10 client.16299 handle_command_reply: tid=0 2024-09-21T06:40:10.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.142+0000 7f2b2b177740 1 client.16299 shutdown 2024-09-21T06:40:10.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.142+0000 7f2b2b177740 1 -- 172.21.15.7:0/2794664134 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a1f2d7d1b0 msgr2=0x55a1f3158b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:10.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.142+0000 7f2b2b177740 1 --2- 172.21.15.7:0/2794664134 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a1f2d7d1b0 0x55a1f3158b00 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f2b10032fd0 tx=0x7f2b10009260 comp rx=0 tx=0).stop 2024-09-21T06:40:10.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.142+0000 7f2b2b177740 1 -- 172.21.15.7:0/2794664134 shutdown_connections 2024-09-21T06:40:10.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.142+0000 7f2b2b177740 1 --2- 172.21.15.7:0/2794664134 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55a1f2d649f0 0x55a1f316ae10 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:10.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.142+0000 7f2b2b177740 1 --2- 172.21.15.7:0/2794664134 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a1f2da6070 0x55a1f3164f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:10.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.142+0000 7f2b2b177740 1 --2- 172.21.15.7:0/2794664134 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a1f2d85390 0x55a1f3159040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:10.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.142+0000 7f2b05ffb640 0 client.16299 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:40:10.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.142+0000 7f2b2b177740 1 --2- 172.21.15.7:0/2794664134 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a1f2d7d1b0 0x55a1f3158b00 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:10.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.142+0000 7f2b2b177740 1 -- 172.21.15.7:0/2794664134 >> 172.21.15.7:0/2794664134 conn(0x55a1f2d9a460 msgr2=0x55a1f3150640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:10.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.143+0000 7f2b2b177740 1 -- 172.21.15.7:0/2794664134 shutdown_connections 2024-09-21T06:40:10.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.143+0000 7f2b2b177740 1 -- 172.21.15.7:0/2794664134 wait complete. 2024-09-21T06:40:10.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.143+0000 7f2b2b177740 20 client.16299 trim_cache size 0 max 16384 2024-09-21T06:40:10.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.156+0000 7f2b2b177740 1 Processor -- start 2024-09-21T06:40:10.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.156+0000 7f2b2b177740 1 -- start start 2024-09-21T06:40:10.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.156+0000 7f2b2b177740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a1f2d7d1b0 0x55a1f315a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:10.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.156+0000 7f2b2b177740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a1f2d85390 0x55a1f3164e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:10.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.156+0000 7f2b2b177740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a1f2da6070 0x55a1f3155cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:10.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.156+0000 7f2b2b177740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2b201b1ad0 con 0x55a1f2d7d1b0 2024-09-21T06:40:10.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.156+0000 7f2b2b177740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2b201af3a0 con 0x55a1f2d85390 2024-09-21T06:40:10.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.156+0000 7f2b2b177740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2b201ad1d0 con 0x55a1f2da6070 2024-09-21T06:40:10.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.156+0000 7f2b1e59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a1f2d7d1b0 0x55a1f315a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:10.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.156+0000 7f2b1e59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a1f2d7d1b0 0x55a1f315a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59372/0 (socket says 172.21.15.7:59372) 2024-09-21T06:40:10.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.156+0000 7f2b1e59c640 1 -- 172.21.15.7:0/137210646 learned_addr learned my addr 172.21.15.7:0/137210646 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:40:10.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.156+0000 7f2b17fff640 1 --2- 172.21.15.7:0/137210646 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a1f2d85390 0x55a1f3164e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:10.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.156+0000 7f2b1ed9d640 1 --2- 172.21.15.7:0/137210646 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a1f2da6070 0x55a1f3155cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:10.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.157+0000 7f2b1e59c640 1 -- 172.21.15.7:0/137210646 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a1f2da6070 msgr2=0x55a1f3155cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:10.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.157+0000 7f2b1e59c640 1 --2- 172.21.15.7:0/137210646 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a1f2da6070 0x55a1f3155cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:10.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.157+0000 7f2b1e59c640 1 -- 172.21.15.7:0/137210646 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a1f2d85390 msgr2=0x55a1f3164e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:10.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.157+0000 7f2b1e59c640 1 --2- 172.21.15.7:0/137210646 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a1f2d85390 0x55a1f3164e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:10.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.157+0000 7f2b1e59c640 1 -- 172.21.15.7:0/137210646 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1f315b6b0 con 0x55a1f2d7d1b0 2024-09-21T06:40:10.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.157+0000 7f2b17fff640 1 --2- 172.21.15.7:0/137210646 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a1f2d85390 0x55a1f3164e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:40:10.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.157+0000 7f2b1e59c640 1 --2- 172.21.15.7:0/137210646 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a1f2d7d1b0 0x55a1f315a730 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f2b10005f70 tx=0x7f2b10003a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=234e35cb3a231531 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:10.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.157+0000 7f2b07fff640 1 -- 172.21.15.7:0/137210646 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b1004d070 con 0x55a1f2d7d1b0 2024-09-21T06:40:10.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.157+0000 7f2b07fff640 1 -- 172.21.15.7:0/137210646 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2b10003e60 con 0x55a1f2d7d1b0 2024-09-21T06:40:10.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.157+0000 7f2b07fff640 1 -- 172.21.15.7:0/137210646 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b10035040 con 0x55a1f2d7d1b0 2024-09-21T06:40:10.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.158+0000 7f2b2b177740 1 -- 172.21.15.7:0/137210646 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a1f2d7d1b0 msgr2=0x55a1f315a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:10.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.158+0000 7f2b2b177740 1 --2- 172.21.15.7:0/137210646 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a1f2d7d1b0 0x55a1f315a730 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f2b10005f70 tx=0x7f2b10003a40 comp rx=0 tx=0).stop 2024-09-21T06:40:10.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.158+0000 7f2b2b177740 1 -- 172.21.15.7:0/137210646 shutdown_connections 2024-09-21T06:40:10.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.158+0000 7f2b2b177740 1 --2- 172.21.15.7:0/137210646 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a1f2da6070 0x55a1f3155cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:10.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.158+0000 7f2b2b177740 1 --2- 172.21.15.7:0/137210646 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a1f2d85390 0x55a1f3164e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:10.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.158+0000 7f2b2b177740 1 --2- 172.21.15.7:0/137210646 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a1f2d7d1b0 0x55a1f315a730 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:10.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.158+0000 7f2b2b177740 1 -- 172.21.15.7:0/137210646 >> 172.21.15.7:0/137210646 conn(0x55a1f2d9a460 msgr2=0x55a1f315a020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:10.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.158+0000 7f2b2b177740 1 -- 172.21.15.7:0/137210646 shutdown_connections 2024-09-21T06:40:10.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.158+0000 7f2b2b177740 1 -- 172.21.15.7:0/137210646 wait complete. 2024-09-21T06:40:10.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.158+0000 7f2b2b177740 1 -- start start 2024-09-21T06:40:10.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.158+0000 7f2b2b177740 1 Processor -- start 2024-09-21T06:40:10.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.159+0000 7f2b2b177740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a1f2d7d1b0 0x55a1f315ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:10.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.159+0000 7f2b2b177740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a1f2d85390 0x55a1f315d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:10.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.159+0000 7f2b2b177740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a1f2da6070 0x55a1f315d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:10.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.159+0000 7f2b2b177740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2b201ad860 con 0x55a1f2d7d1b0 2024-09-21T06:40:10.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.159+0000 7f2b2b177740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2b201aecd0 con 0x55a1f2d85390 2024-09-21T06:40:10.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.159+0000 7f2b2b177740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2b201adf30 con 0x55a1f2da6070 2024-09-21T06:40:10.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.159+0000 7f2b2b177740 10 client.0 _ll_register_callbacks cb 0x7f2b10005ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:40:10.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.159+0000 7f2b1e59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a1f2d7d1b0 0x55a1f315ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:10.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.159+0000 7f2b1e59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a1f2d7d1b0 0x55a1f315ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:59378/0 (socket says 172.21.15.7:59378) 2024-09-21T06:40:10.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.159+0000 7f2b1e59c640 1 -- 172.21.15.7:0/1195180870 learned_addr learned my addr 172.21.15.7:0/1195180870 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:40:10.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.159+0000 7f2b17fff640 1 --2- 172.21.15.7:0/1195180870 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a1f2d85390 0x55a1f315d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:10.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.159+0000 7f2b1ed9d640 1 --2- 172.21.15.7:0/1195180870 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a1f2da6070 0x55a1f315d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:10.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.159+0000 7f2b1e59c640 1 -- 172.21.15.7:0/1195180870 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a1f2da6070 msgr2=0x55a1f315d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:10.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.159+0000 7f2b1e59c640 1 --2- 172.21.15.7:0/1195180870 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a1f2da6070 0x55a1f315d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:10.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.159+0000 7f2b1e59c640 1 -- 172.21.15.7:0/1195180870 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a1f2d85390 msgr2=0x55a1f315d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:10.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.159+0000 7f2b1e59c640 1 --2- 172.21.15.7:0/1195180870 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a1f2d85390 0x55a1f315d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:10.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.159+0000 7f2b1e59c640 1 -- 172.21.15.7:0/1195180870 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1f31d47d0 con 0x55a1f2d7d1b0 2024-09-21T06:40:10.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.159+0000 7f2b1e59c640 1 --2- 172.21.15.7:0/1195180870 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a1f2d7d1b0 0x55a1f315ce50 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f2b10000c00 tx=0x7f2b10031860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=896cbf22df4081a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:10.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.159+0000 7f2b05ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:40:10.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.160+0000 7f2b05ffb640 1 -- 172.21.15.7:0/1195180870 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b1004d040 con 0x55a1f2d7d1b0 2024-09-21T06:40:10.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.160+0000 7f2b05ffb640 1 -- 172.21.15.7:0/1195180870 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f2b1003d650 con 0x55a1f2d7d1b0 2024-09-21T06:40:10.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.160+0000 7f2b2b177740 1 -- 172.21.15.7:0/1195180870 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2b10003e60 con 0x55a1f2d7d1b0 2024-09-21T06:40:10.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.160+0000 7f2b05ffb640 1 -- 172.21.15.7:0/1195180870 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2b1003d850 con 0x55a1f2d7d1b0 2024-09-21T06:40:10.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.160+0000 7f2b2b177740 10 client.16305 fetch_fsmap learned FSMap version 25 2024-09-21T06:40:10.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.160+0000 7f2b2b177740 1 -- 172.21.15.7:0/1195180870 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a1f31d5a30 con 0x55a1f2d7d1b0 2024-09-21T06:40:10.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.160+0000 7f2b05ffb640 1 -- 172.21.15.7:0/1195180870 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2b10003e60 con 0x55a1f2d7d1b0 2024-09-21T06:40:10.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.160+0000 7f2b05ffb640 1 -- 172.21.15.7:0/1195180870 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f2b10049a40 con 0x55a1f2d7d1b0 2024-09-21T06:40:10.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.160+0000 7f2b2b177740 10 client.16305 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:40:10.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.160+0000 7f2b2b177740 10 client.16305 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:40:10.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.160+0000 7f2b2b177740 20 client.16305 populate_metadata read hostname 'smithi007' 2024-09-21T06:40:10.165 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.160+0000 7f2b2b177740 1 --2- 172.21.15.7:0/1195180870 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55a1f2d39da0 0x55a1f31d8100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:10.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.160+0000 7f2b2b177740 4 client.16305 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:40:10.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.160+0000 7f2b2b177740 1 -- 172.21.15.7:0/1195180870 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a1f30c18a0 con 0x55a1f2d39da0 2024-09-21T06:40:10.166 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.161+0000 7f2b17fff640 1 --2- 172.21.15.7:0/1195180870 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55a1f2d39da0 0x55a1f31d8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:10.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.161+0000 7f2b17fff640 1 --2- 172.21.15.7:0/1195180870 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55a1f2d39da0 0x55a1f31d8100 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f577beee3b550a5e server_cookie=d13fcd4d22832662 in_seq=0 out_seq=0 2024-09-21T06:40:10.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.161+0000 7f2b05ffb640 10 client.16305 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:40:10.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.161+0000 7f2b05ffb640 1 -- 172.21.15.7:0/1195180870 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a1f30c18a0 con 0x55a1f2d39da0 2024-09-21T06:40:10.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.161+0000 7f2b05ffb640 10 client.16305 handle_command_reply: tid=0 2024-09-21T06:40:10.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.161+0000 7f2b2b177740 1 client.16305 shutdown 2024-09-21T06:40:10.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.162+0000 7f2b2b177740 1 -- 172.21.15.7:0/1195180870 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a1f2d7d1b0 msgr2=0x55a1f315ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:10.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.162+0000 7f2b2b177740 1 --2- 172.21.15.7:0/1195180870 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a1f2d7d1b0 0x55a1f315ce50 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f2b10000c00 tx=0x7f2b10031860 comp rx=0 tx=0).stop 2024-09-21T06:40:10.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.162+0000 7f2b2b177740 1 -- 172.21.15.7:0/1195180870 shutdown_connections 2024-09-21T06:40:10.167 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.162+0000 7f2b2b177740 1 --2- 172.21.15.7:0/1195180870 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55a1f2d39da0 0x55a1f31d8100 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:10.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.162+0000 7f2b2b177740 1 --2- 172.21.15.7:0/1195180870 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a1f2da6070 0x55a1f315d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:10.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.162+0000 7f2b2b177740 1 --2- 172.21.15.7:0/1195180870 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a1f2d85390 0x55a1f315d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:10.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.162+0000 7f2b2b177740 1 --2- 172.21.15.7:0/1195180870 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a1f2d7d1b0 0x55a1f315ce50 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:10.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.162+0000 7f2b05ffb640 0 client.16305 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:40:10.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.162+0000 7f2b2b177740 1 -- 172.21.15.7:0/1195180870 >> 172.21.15.7:0/1195180870 conn(0x55a1f2d9a460 msgr2=0x55a1f3159fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:10.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.162+0000 7f2b2b177740 1 -- 172.21.15.7:0/1195180870 shutdown_connections 2024-09-21T06:40:10.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.162+0000 7f2b2b177740 1 -- 172.21.15.7:0/1195180870 wait complete. 2024-09-21T06:40:10.168 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.162+0000 7f2b2b177740 20 client.16305 trim_cache size 0 max 16384 2024-09-21T06:40:10.168 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:40:10.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.162+0000 7f2b1f59e640 1 -- 172.21.15.7:0/1864535860 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f2b0c0b6680 msgr2=0x7f2b0c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:10.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.162+0000 7f2b1f59e640 1 --2- 172.21.15.7:0/1864535860 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f2b0c0b6680 0x7f2b0c0b8b90 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2b10031440 tx=0x7f2b10009560 comp rx=0 tx=0).stop 2024-09-21T06:40:10.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.162+0000 7f2b1f59e640 1 -- 172.21.15.7:0/1864535860 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b20105120 msgr2=0x7f2b2019a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:10.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.162+0000 7f2b1f59e640 1 --2- 172.21.15.7:0/1864535860 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b20105120 0x7f2b2019a820 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2b2006b510 tx=0x7f2b0800ee50 comp rx=0 tx=0).stop 2024-09-21T06:40:10.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.162+0000 7f2b1f59e640 1 -- 172.21.15.7:0/1864535860 shutdown_connections 2024-09-21T06:40:10.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.162+0000 7f2b1f59e640 1 --2- 172.21.15.7:0/1864535860 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f2b0c0b6680 0x7f2b0c0b8b90 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:10.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.162+0000 7f2b1f59e640 1 --2- 172.21.15.7:0/1864535860 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b2010dc30 0x7f2b2019fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:10.169 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.162+0000 7f2b1f59e640 1 --2- 172.21.15.7:0/1864535860 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b20105120 0x7f2b2019a820 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:10.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.162+0000 7f2b1f59e640 1 --2- 172.21.15.7:0/1864535860 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b201047d0 0x7f2b2019a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:10.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.162+0000 7f2b1f59e640 1 -- 172.21.15.7:0/1864535860 >> 172.21.15.7:0/1864535860 conn(0x7f2b200fe2d0 msgr2=0x7f2b20100ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:10.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.163+0000 7f2b1f59e640 1 -- 172.21.15.7:0/1864535860 shutdown_connections 2024-09-21T06:40:10.170 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:10.163+0000 7f2b1f59e640 1 -- 172.21.15.7:0/1864535860 wait complete. 2024-09-21T06:40:10.589 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:40:10 smithi007 ceph-mon[30983]: pgmap v438: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-21T06:40:10.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:40:10 smithi018 ceph-mon[34477]: pgmap v438: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-21T06:40:10.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:40:10 smithi144 ceph-mon[34653]: pgmap v438: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-21T06:40:11.884 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:40:11.884 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:40:12.154 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:40:12.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:40:12 smithi007 ceph-mon[30983]: pgmap v439: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-21T06:40:12.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:40:12 smithi018 ceph-mon[34477]: pgmap v439: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-21T06:40:12.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.708+0000 7efe65ca0640 1 -- 172.21.15.7:0/3098579530 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe60102a80 msgr2=0x7efe60102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:12.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.708+0000 7efe65ca0640 1 --2- 172.21.15.7:0/3098579530 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe60102a80 0x7efe60102e90 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7efe50009900 tx=0x7efe5002a3f0 comp rx=0 tx=0).stop 2024-09-21T06:40:12.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.708+0000 7efe65ca0640 1 -- 172.21.15.7:0/3098579530 shutdown_connections 2024-09-21T06:40:12.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.708+0000 7efe65ca0640 1 --2- 172.21.15.7:0/3098579530 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe60108d10 0x7efe6010f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:12.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.708+0000 7efe65ca0640 1 --2- 172.21.15.7:0/3098579530 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efe601083c0 0x7efe601087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:12.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.708+0000 7efe65ca0640 1 --2- 172.21.15.7:0/3098579530 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe60102a80 0x7efe60102e90 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:12.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.708+0000 7efe65ca0640 1 -- 172.21.15.7:0/3098579530 >> 172.21.15.7:0/3098579530 conn(0x7efe60079740 msgr2=0x7efe60079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:12.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.708+0000 7efe65ca0640 1 -- 172.21.15.7:0/3098579530 shutdown_connections 2024-09-21T06:40:12.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.708+0000 7efe65ca0640 1 -- 172.21.15.7:0/3098579530 wait complete. 2024-09-21T06:40:12.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.709+0000 7efe65ca0640 1 Processor -- start 2024-09-21T06:40:12.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.709+0000 7efe65ca0640 1 -- start start 2024-09-21T06:40:12.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.710+0000 7efe65ca0640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe60102a80 0x7efe6019a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:12.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.710+0000 7efe65ca0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe601083c0 0x7efe6019aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:12.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.710+0000 7efe65ca0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efe60108d10 0x7efe6019fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:12.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.710+0000 7efe65ca0640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7efe60113a90 con 0x7efe601083c0 2024-09-21T06:40:12.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.710+0000 7efe65ca0640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7efe60113910 con 0x7efe60108d10 2024-09-21T06:40:12.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.710+0000 7efe65ca0640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7efe60113c10 con 0x7efe60102a80 2024-09-21T06:40:12.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.710+0000 7efe5effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe601083c0 0x7efe6019aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:12.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.710+0000 7efe5effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe601083c0 0x7efe6019aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36452/0 (socket says 172.21.15.7:36452) 2024-09-21T06:40:12.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.710+0000 7efe5effd640 1 -- 172.21.15.7:0/49176251 learned_addr learned my addr 172.21.15.7:0/49176251 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:40:12.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.710+0000 7efe5f7fe640 1 --2- 172.21.15.7:0/49176251 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe60102a80 0x7efe6019a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:12.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.710+0000 7efe5ffff640 1 --2- 172.21.15.7:0/49176251 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efe60108d10 0x7efe6019fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:12.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.710+0000 7efe5effd640 1 -- 172.21.15.7:0/49176251 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe60102a80 msgr2=0x7efe6019a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:12.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.710+0000 7efe5effd640 1 --2- 172.21.15.7:0/49176251 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe60102a80 0x7efe6019a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:12.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.710+0000 7efe5effd640 1 -- 172.21.15.7:0/49176251 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efe60108d10 msgr2=0x7efe6019fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:12.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.710+0000 7efe5effd640 1 --2- 172.21.15.7:0/49176251 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efe60108d10 0x7efe6019fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:12.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.710+0000 7efe5effd640 1 -- 172.21.15.7:0/49176251 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe601a0310 con 0x7efe601083c0 2024-09-21T06:40:12.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.710+0000 7efe5ffff640 1 --2- 172.21.15.7:0/49176251 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efe60108d10 0x7efe6019fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:40:12.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.710+0000 7efe5effd640 1 --2- 172.21.15.7:0/49176251 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe601083c0 0x7efe6019aa00 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7efe5400e9c0 tx=0x7efe5400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:12.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.711+0000 7efe5cff9640 1 -- 172.21.15.7:0/49176251 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe5400cd80 con 0x7efe601083c0 2024-09-21T06:40:12.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.711+0000 7efe65ca0640 1 -- 172.21.15.7:0/49176251 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe601a0600 con 0x7efe601083c0 2024-09-21T06:40:12.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.711+0000 7efe5cff9640 1 -- 172.21.15.7:0/49176251 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efe540054d0 con 0x7efe601083c0 2024-09-21T06:40:12.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.711+0000 7efe5cff9640 1 -- 172.21.15.7:0/49176251 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe54010430 con 0x7efe601083c0 2024-09-21T06:40:12.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.711+0000 7efe65ca0640 1 -- 172.21.15.7:0/49176251 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe601a6e20 con 0x7efe601083c0 2024-09-21T06:40:12.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.714+0000 7efe5cff9640 1 -- 172.21.15.7:0/49176251 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7efe54004f90 con 0x7efe601083c0 2024-09-21T06:40:12.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.714+0000 7efe6c214740 1 Processor -- start 2024-09-21T06:40:12.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.714+0000 7efe6c214740 1 -- start start 2024-09-21T06:40:12.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.714+0000 7efe6c214740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558d1d819350 0x558d1dbc0430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:12.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.714+0000 7efe6c214740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558d1d7f0490 0x558d1dbc0970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:12.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.714+0000 7efe6c214740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558d1d7f8670 0x558d1dbc0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:12.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.714+0000 7efe6c214740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x558d1db36e60 con 0x558d1d7f8670 2024-09-21T06:40:12.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.714+0000 7efe6c214740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x558d1db26290 con 0x558d1d819350 2024-09-21T06:40:12.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.714+0000 7efe6c214740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x558d1db2a0a0 con 0x558d1d7f0490 2024-09-21T06:40:12.717 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.714+0000 7efe5cff9640 1 --2- 172.21.15.7:0/49176251 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7efe480b66b0 0x7efe480b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:12.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.715+0000 7efe5effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558d1d7f8670 0x558d1dbc0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:12.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.715+0000 7efe5effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558d1d7f8670 0x558d1dbc0eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36460/0 (socket says 172.21.15.7:36460) 2024-09-21T06:40:12.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.715+0000 7efe5effd640 1 -- 172.21.15.7:0/2261825926 learned_addr learned my addr 172.21.15.7:0/2261825926 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:40:12.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.715+0000 7efe5f7fe640 1 --2- 172.21.15.7:0/2261825926 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558d1d7f0490 0x558d1dbc0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:12.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.715+0000 7efe5ffff640 1 --2- 172.21.15.7:0/2261825926 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558d1d819350 0x558d1dbc0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:12.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.715+0000 7efe5ffff640 1 --2- 172.21.15.7:0/49176251 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7efe480b66b0 0x7efe480b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:12.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.715+0000 7efe5cff9640 1 -- 172.21.15.7:0/49176251 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7efe540e7b50 con 0x7efe601083c0 2024-09-21T06:40:12.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.715+0000 7efe5effd640 1 -- 172.21.15.7:0/2261825926 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558d1d7f0490 msgr2=0x558d1dbc0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:12.718 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.715+0000 7efe5effd640 1 --2- 172.21.15.7:0/2261825926 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558d1d7f0490 0x558d1dbc0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:12.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.715+0000 7efe5effd640 1 -- 172.21.15.7:0/2261825926 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558d1d819350 msgr2=0x558d1dbc0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:12.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.715+0000 7efe5effd640 1 --2- 172.21.15.7:0/2261825926 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558d1d819350 0x558d1dbc0430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:12.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.715+0000 7efe5effd640 1 -- 172.21.15.7:0/2261825926 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d1d884930 con 0x558d1d7f8670 2024-09-21T06:40:12.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.715+0000 7efe5effd640 1 --2- 172.21.15.7:0/2261825926 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558d1d7f8670 0x558d1dbc0eb0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7efe5400cfd0 tx=0x7efe5407ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e906549d9924cf30 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:12.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.715+0000 7efe5ffff640 1 --2- 172.21.15.7:0/49176251 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7efe480b66b0 0x7efe480b8bc0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7efe58007310 tx=0x7efe580072a0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:12.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.716+0000 7efe45ffb640 1 -- 172.21.15.7:0/2261825926 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe540ad390 con 0x558d1d7f8670 2024-09-21T06:40:12.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.716+0000 7efe45ffb640 1 -- 172.21.15.7:0/2261825926 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efe540046c0 con 0x558d1d7f8670 2024-09-21T06:40:12.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.716+0000 7efe45ffb640 1 -- 172.21.15.7:0/2261825926 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe540ad1b0 con 0x558d1d7f8670 2024-09-21T06:40:12.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.716+0000 7efe6c214740 1 -- 172.21.15.7:0/2261825926 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558d1d7f8670 msgr2=0x558d1dbc0eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:12.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.716+0000 7efe6c214740 1 --2- 172.21.15.7:0/2261825926 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558d1d7f8670 0x558d1dbc0eb0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7efe5400cfd0 tx=0x7efe5407ad20 comp rx=0 tx=0).stop 2024-09-21T06:40:12.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.717+0000 7efe6c214740 1 -- 172.21.15.7:0/2261825926 shutdown_connections 2024-09-21T06:40:12.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.717+0000 7efe6c214740 1 --2- 172.21.15.7:0/2261825926 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558d1d7f8670 0x558d1dbc0eb0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:12.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.717+0000 7efe6c214740 1 --2- 172.21.15.7:0/2261825926 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558d1d7f0490 0x558d1dbc0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:12.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.717+0000 7efe6c214740 1 --2- 172.21.15.7:0/2261825926 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558d1d819350 0x558d1dbc0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:12.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.717+0000 7efe6c214740 1 -- 172.21.15.7:0/2261825926 >> 172.21.15.7:0/2261825926 conn(0x558d1d80d740 msgr2=0x558d1dbbe320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:12.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.717+0000 7efe6c214740 1 -- 172.21.15.7:0/2261825926 shutdown_connections 2024-09-21T06:40:12.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.717+0000 7efe6c214740 1 -- 172.21.15.7:0/2261825926 wait complete. 2024-09-21T06:40:12.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.717+0000 7efe6c214740 1 -- start start 2024-09-21T06:40:12.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.717+0000 7efe6c214740 1 Processor -- start 2024-09-21T06:40:12.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.718+0000 7efe6c214740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558d1d7f0490 0x558d1dbcbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:12.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.718+0000 7efe6c214740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558d1d7f8670 0x558d1dbcc510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:12.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.718+0000 7efe6c214740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558d1d819350 0x558d1dbd7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:12.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.718+0000 7efe6c214740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x558d1d987890 con 0x558d1d7f8670 2024-09-21T06:40:12.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.718+0000 7efe6c214740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x558d1dac0d40 con 0x558d1d7f0490 2024-09-21T06:40:12.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.718+0000 7efe6c214740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x558d1dbcebb0 con 0x558d1d819350 2024-09-21T06:40:12.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.718+0000 7efe6c214740 10 client.0 _ll_register_callbacks cb 0x558d1db24c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:40:12.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.718+0000 7efe5effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558d1d7f8670 0x558d1dbcc510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:12.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.718+0000 7efe5effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558d1d7f8670 0x558d1dbcc510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36464/0 (socket says 172.21.15.7:36464) 2024-09-21T06:40:12.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.718+0000 7efe5effd640 1 -- 172.21.15.7:0/1381906097 learned_addr learned my addr 172.21.15.7:0/1381906097 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:40:12.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.718+0000 7efe5ffff640 1 --2- 172.21.15.7:0/1381906097 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558d1d819350 0x558d1dbd7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:12.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.718+0000 7efe5f7fe640 1 --2- 172.21.15.7:0/1381906097 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558d1d7f0490 0x558d1dbcbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:12.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.718+0000 7efe5effd640 1 -- 172.21.15.7:0/1381906097 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558d1d819350 msgr2=0x558d1dbd7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:12.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.718+0000 7efe5effd640 1 --2- 172.21.15.7:0/1381906097 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558d1d819350 0x558d1dbd7ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:12.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.718+0000 7efe5effd640 1 -- 172.21.15.7:0/1381906097 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558d1d7f0490 msgr2=0x558d1dbcbfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:12.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.718+0000 7efe5effd640 1 --2- 172.21.15.7:0/1381906097 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558d1d7f0490 0x558d1dbcbfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:12.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.718+0000 7efe5effd640 1 -- 172.21.15.7:0/1381906097 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d1dbd8460 con 0x558d1d7f8670 2024-09-21T06:40:12.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.718+0000 7efe5effd640 1 --2- 172.21.15.7:0/1381906097 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558d1d7f8670 0x558d1dbcc510 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7efe540a9aa0 tx=0x7efe540e57d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73dcca6f796b51d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:12.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.718+0000 7efe3effd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:40:12.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.719+0000 7efe3effd640 1 -- 172.21.15.7:0/1381906097 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe540ad1b0 con 0x558d1d7f8670 2024-09-21T06:40:12.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.719+0000 7efe3effd640 1 -- 172.21.15.7:0/1381906097 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7efe540b71d0 con 0x558d1d7f8670 2024-09-21T06:40:12.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.719+0000 7efe6c214740 1 -- 172.21.15.7:0/1381906097 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558d1db38db0 con 0x558d1d7f8670 2024-09-21T06:40:12.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.719+0000 7efe3effd640 1 -- 172.21.15.7:0/1381906097 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7efe540ad390 con 0x558d1d7f8670 2024-09-21T06:40:12.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.719+0000 7efe6c214740 10 client.16317 fetch_fsmap learned FSMap version 25 2024-09-21T06:40:12.724 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.719+0000 7efe6c214740 1 -- 172.21.15.7:0/1381906097 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558d1dbdad90 con 0x558d1d7f8670 2024-09-21T06:40:12.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.719+0000 7efe3effd640 1 -- 172.21.15.7:0/1381906097 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x558d1db38db0 con 0x558d1d7f8670 2024-09-21T06:40:12.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.719+0000 7efe3effd640 1 -- 172.21.15.7:0/1381906097 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7efe54079e70 con 0x558d1d7f8670 2024-09-21T06:40:12.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.719+0000 7efe6c214740 10 client.16317 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:40:12.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.719+0000 7efe6c214740 10 client.16317 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:40:12.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.719+0000 7efe6c214740 20 client.16317 populate_metadata read hostname 'smithi007' 2024-09-21T06:40:12.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.719+0000 7efe6c214740 1 --2- 172.21.15.7:0/1381906097 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x558d1d7d7cd0 0x558d1dbde0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:12.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.719+0000 7efe6c214740 4 client.16317 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:40:12.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.719+0000 7efe6c214740 1 -- 172.21.15.7:0/1381906097 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558d1db34860 con 0x558d1d7d7cd0 2024-09-21T06:40:12.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.720+0000 7efe5f7fe640 1 --2- 172.21.15.7:0/1381906097 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x558d1d7d7cd0 0x558d1dbde0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:12.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.720+0000 7efe5f7fe640 1 --2- 172.21.15.7:0/1381906097 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x558d1d7d7cd0 0x558d1dbde0f0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e9f38910bf8cd261 server_cookie=60c24045df0bd015 in_seq=0 out_seq=0 2024-09-21T06:40:12.725 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.720+0000 7efe3effd640 10 client.16317 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:40:12.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.721+0000 7efe3effd640 1 -- 172.21.15.7:0/1381906097 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558d1db34860 con 0x558d1d7d7cd0 2024-09-21T06:40:12.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.721+0000 7efe3effd640 10 client.16317 handle_command_reply: tid=0 2024-09-21T06:40:12.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.721+0000 7efe6c214740 1 client.16317 shutdown 2024-09-21T06:40:12.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.721+0000 7efe6c214740 1 -- 172.21.15.7:0/1381906097 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558d1d7f8670 msgr2=0x558d1dbcc510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:12.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.721+0000 7efe6c214740 1 --2- 172.21.15.7:0/1381906097 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558d1d7f8670 0x558d1dbcc510 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7efe540a9aa0 tx=0x7efe540e57d0 comp rx=0 tx=0).stop 2024-09-21T06:40:12.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.721+0000 7efe6c214740 1 -- 172.21.15.7:0/1381906097 shutdown_connections 2024-09-21T06:40:12.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.721+0000 7efe6c214740 1 --2- 172.21.15.7:0/1381906097 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x558d1d7d7cd0 0x558d1dbde0f0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:12.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.721+0000 7efe6c214740 1 --2- 172.21.15.7:0/1381906097 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558d1d819350 0x558d1dbd7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:12.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.721+0000 7efe6c214740 1 --2- 172.21.15.7:0/1381906097 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558d1d7f8670 0x558d1dbcc510 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:12.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.721+0000 7efe3effd640 0 client.16317 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:40:12.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.721+0000 7efe6c214740 1 --2- 172.21.15.7:0/1381906097 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558d1d7f0490 0x558d1dbcbfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:12.727 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.721+0000 7efe6c214740 1 -- 172.21.15.7:0/1381906097 >> 172.21.15.7:0/1381906097 conn(0x558d1d80d740 msgr2=0x558d1dbc1460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:12.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.721+0000 7efe6c214740 1 -- 172.21.15.7:0/1381906097 shutdown_connections 2024-09-21T06:40:12.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.721+0000 7efe6c214740 1 -- 172.21.15.7:0/1381906097 wait complete. 2024-09-21T06:40:12.728 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.722+0000 7efe6c214740 20 client.16317 trim_cache size 0 max 16384 2024-09-21T06:40:12.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.739+0000 7efe6c214740 1 Processor -- start 2024-09-21T06:40:12.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.739+0000 7efe6c214740 1 -- start start 2024-09-21T06:40:12.742 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.739+0000 7efe6c214740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558d1d7f0490 0x558d1dbc7580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:12.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.739+0000 7efe6c214740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558d1d7f8670 0x558d1dbc6550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:12.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.739+0000 7efe6c214740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558d1d819350 0x558d1dbbe2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:12.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.739+0000 7efe6c214740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7efe601afb20 con 0x558d1d819350 2024-09-21T06:40:12.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.739+0000 7efe6c214740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7efe601ad3f0 con 0x558d1d7f0490 2024-09-21T06:40:12.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.739+0000 7efe6c214740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7efe601ab240 con 0x558d1d7f8670 2024-09-21T06:40:12.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.740+0000 7efe5ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558d1d819350 0x558d1dbbe2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:12.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.740+0000 7efe5ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558d1d819350 0x558d1dbbe2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36468/0 (socket says 172.21.15.7:36468) 2024-09-21T06:40:12.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.740+0000 7efe5ffff640 1 -- 172.21.15.7:0/763016616 learned_addr learned my addr 172.21.15.7:0/763016616 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:40:12.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.740+0000 7efe5f7fe640 1 --2- 172.21.15.7:0/763016616 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558d1d7f0490 0x558d1dbc7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:12.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.740+0000 7efe5effd640 1 --2- 172.21.15.7:0/763016616 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558d1d7f8670 0x558d1dbc6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:12.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.740+0000 7efe5ffff640 1 -- 172.21.15.7:0/763016616 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558d1d7f8670 msgr2=0x558d1dbc6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:12.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.740+0000 7efe5ffff640 1 --2- 172.21.15.7:0/763016616 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558d1d7f8670 0x558d1dbc6550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:12.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.740+0000 7efe5ffff640 1 -- 172.21.15.7:0/763016616 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558d1d7f0490 msgr2=0x558d1dbc7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:12.743 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.740+0000 7efe5ffff640 1 --2- 172.21.15.7:0/763016616 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558d1d7f0490 0x558d1dbc7580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:12.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.740+0000 7efe5ffff640 1 -- 172.21.15.7:0/763016616 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d1dbcad30 con 0x558d1d819350 2024-09-21T06:40:12.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.740+0000 7efe5effd640 1 --2- 172.21.15.7:0/763016616 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558d1d7f8670 0x558d1dbc6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:40:12.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.740+0000 7efe5ffff640 1 --2- 172.21.15.7:0/763016616 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558d1d819350 0x558d1dbbe2b0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7efe58013930 tx=0x7efe58007670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b25b562ecb83baba server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:12.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.740+0000 7efe457fa640 1 -- 172.21.15.7:0/763016616 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe58025070 con 0x558d1d819350 2024-09-21T06:40:12.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.740+0000 7efe457fa640 1 -- 172.21.15.7:0/763016616 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efe5802a910 con 0x558d1d819350 2024-09-21T06:40:12.744 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.740+0000 7efe457fa640 1 -- 172.21.15.7:0/763016616 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe580217e0 con 0x558d1d819350 2024-09-21T06:40:12.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.741+0000 7efe6c214740 1 -- 172.21.15.7:0/763016616 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558d1d819350 msgr2=0x558d1dbbe2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:12.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.741+0000 7efe6c214740 1 --2- 172.21.15.7:0/763016616 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558d1d819350 0x558d1dbbe2b0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7efe58013930 tx=0x7efe58007670 comp rx=0 tx=0).stop 2024-09-21T06:40:12.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.741+0000 7efe6c214740 1 -- 172.21.15.7:0/763016616 shutdown_connections 2024-09-21T06:40:12.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.741+0000 7efe6c214740 1 --2- 172.21.15.7:0/763016616 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558d1d819350 0x558d1dbbe2b0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:12.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.741+0000 7efe6c214740 1 --2- 172.21.15.7:0/763016616 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558d1d7f8670 0x558d1dbc6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:12.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.741+0000 7efe6c214740 1 --2- 172.21.15.7:0/763016616 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558d1d7f0490 0x558d1dbc7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:12.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.741+0000 7efe6c214740 1 -- 172.21.15.7:0/763016616 >> 172.21.15.7:0/763016616 conn(0x558d1d80d740 msgr2=0x558d1dbbdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:12.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.741+0000 7efe6c214740 1 -- 172.21.15.7:0/763016616 shutdown_connections 2024-09-21T06:40:12.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.741+0000 7efe6c214740 1 -- 172.21.15.7:0/763016616 wait complete. 2024-09-21T06:40:12.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.742+0000 7efe6c214740 1 -- start start 2024-09-21T06:40:12.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.742+0000 7efe6c214740 1 Processor -- start 2024-09-21T06:40:12.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.742+0000 7efe6c214740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558d1d7f0490 0x558d1dbdfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:12.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.742+0000 7efe6c214740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558d1d7f8670 0x558d1dbe00b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:12.747 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.742+0000 7efe6c214740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558d1d819350 0x558d1dc41920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:12.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.742+0000 7efe6c214740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7efe601ab8b0 con 0x558d1d7f8670 2024-09-21T06:40:12.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.742+0000 7efe6c214740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7efe601acd20 con 0x558d1d819350 2024-09-21T06:40:12.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.742+0000 7efe6c214740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7efe601abf80 con 0x558d1d7f0490 2024-09-21T06:40:12.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.742+0000 7efe6c214740 10 client.0 _ll_register_callbacks cb 0x7efe58007e00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:40:12.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.742+0000 7efe5effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558d1d7f8670 0x558d1dbe00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:12.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.742+0000 7efe5effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558d1d7f8670 0x558d1dbe00b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36482/0 (socket says 172.21.15.7:36482) 2024-09-21T06:40:12.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.742+0000 7efe5effd640 1 -- 172.21.15.7:0/370217698 learned_addr learned my addr 172.21.15.7:0/370217698 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:40:12.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.742+0000 7efe5f7fe640 1 --2- 172.21.15.7:0/370217698 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558d1d7f0490 0x558d1dbdfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:12.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.743+0000 7efe5ffff640 1 --2- 172.21.15.7:0/370217698 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558d1d819350 0x558d1dc41920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:12.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.743+0000 7efe5effd640 1 -- 172.21.15.7:0/370217698 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558d1d7f0490 msgr2=0x558d1dbdfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:12.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.743+0000 7efe5effd640 1 --2- 172.21.15.7:0/370217698 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558d1d7f0490 0x558d1dbdfb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:12.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.743+0000 7efe5effd640 1 -- 172.21.15.7:0/370217698 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558d1d819350 msgr2=0x558d1dc41920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:12.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.743+0000 7efe5effd640 1 --2- 172.21.15.7:0/370217698 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558d1d819350 0x558d1dc41920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:12.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.743+0000 7efe5effd640 1 -- 172.21.15.7:0/370217698 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d1dc41f90 con 0x558d1d7f8670 2024-09-21T06:40:12.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.743+0000 7efe5effd640 1 --2- 172.21.15.7:0/370217698 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558d1d7f8670 0x558d1dbe00b0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7efe5407a240 tx=0x7efe54009770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8edbdb4dccfe453 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:12.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.743+0000 7efe3effd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:40:12.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.743+0000 7efe3effd640 1 -- 172.21.15.7:0/370217698 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe540ad1b0 con 0x558d1d7f8670 2024-09-21T06:40:12.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.743+0000 7efe3effd640 1 -- 172.21.15.7:0/370217698 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7efe540ac710 con 0x558d1d7f8670 2024-09-21T06:40:12.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.743+0000 7efe6c214740 1 -- 172.21.15.7:0/370217698 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efe5802a910 con 0x558d1d7f8670 2024-09-21T06:40:12.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.743+0000 7efe3effd640 1 -- 172.21.15.7:0/370217698 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7efe540ad550 con 0x558d1d7f8670 2024-09-21T06:40:12.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.743+0000 7efe6c214740 10 client.16323 fetch_fsmap learned FSMap version 25 2024-09-21T06:40:12.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.743+0000 7efe6c214740 1 -- 172.21.15.7:0/370217698 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558d1dc49310 con 0x558d1d7f8670 2024-09-21T06:40:12.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.744+0000 7efe3effd640 1 -- 172.21.15.7:0/370217698 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efe5802a910 con 0x558d1d7f8670 2024-09-21T06:40:12.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.744+0000 7efe3effd640 1 -- 172.21.15.7:0/370217698 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7efe540b36b0 con 0x558d1d7f8670 2024-09-21T06:40:12.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.744+0000 7efe6c214740 10 client.16323 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:40:12.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.744+0000 7efe6c214740 10 client.16323 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:40:12.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.744+0000 7efe6c214740 20 client.16323 populate_metadata read hostname 'smithi007' 2024-09-21T06:40:12.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.744+0000 7efe6c214740 1 --2- 172.21.15.7:0/370217698 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x558d1d7ad080 0x558d1dc4b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:12.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.744+0000 7efe6c214740 4 client.16323 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:40:12.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.744+0000 7efe6c214740 1 -- 172.21.15.7:0/370217698 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x558d1db31c90 con 0x558d1d7ad080 2024-09-21T06:40:12.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.744+0000 7efe5f7fe640 1 --2- 172.21.15.7:0/370217698 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x558d1d7ad080 0x558d1dc4b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:12.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.745+0000 7efe5f7fe640 1 --2- 172.21.15.7:0/370217698 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x558d1d7ad080 0x558d1dc4b850 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c384e63b8659c92 server_cookie=846d659b42a0032f in_seq=0 out_seq=0 2024-09-21T06:40:12.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.745+0000 7efe3effd640 10 client.16323 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:40:12.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.746+0000 7efe3effd640 1 -- 172.21.15.7:0/370217698 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x558d1db31c90 con 0x558d1d7ad080 2024-09-21T06:40:12.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.746+0000 7efe3effd640 10 client.16323 handle_command_reply: tid=0 2024-09-21T06:40:12.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.746+0000 7efe6c214740 1 client.16323 shutdown 2024-09-21T06:40:12.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.746+0000 7efe6c214740 1 -- 172.21.15.7:0/370217698 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558d1d7f8670 msgr2=0x558d1dbe00b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:12.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.746+0000 7efe6c214740 1 --2- 172.21.15.7:0/370217698 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558d1d7f8670 0x558d1dbe00b0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7efe5407a240 tx=0x7efe54009770 comp rx=0 tx=0).stop 2024-09-21T06:40:12.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.747+0000 7efe6c214740 1 -- 172.21.15.7:0/370217698 shutdown_connections 2024-09-21T06:40:12.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.747+0000 7efe6c214740 1 --2- 172.21.15.7:0/370217698 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x558d1d7ad080 0x558d1dc4b850 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:12.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.747+0000 7efe3effd640 0 client.16323 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:40:12.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.747+0000 7efe6c214740 1 --2- 172.21.15.7:0/370217698 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x558d1d819350 0x558d1dc41920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:12.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.747+0000 7efe6c214740 1 --2- 172.21.15.7:0/370217698 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x558d1d7f8670 0x558d1dbe00b0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:12.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.747+0000 7efe6c214740 1 --2- 172.21.15.7:0/370217698 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x558d1d7f0490 0x558d1dbdfb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:12.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.747+0000 7efe6c214740 1 -- 172.21.15.7:0/370217698 >> 172.21.15.7:0/370217698 conn(0x558d1d80d740 msgr2=0x558d1dbcd090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:12.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.747+0000 7efe6c214740 1 -- 172.21.15.7:0/370217698 shutdown_connections 2024-09-21T06:40:12.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.747+0000 7efe6c214740 1 -- 172.21.15.7:0/370217698 wait complete. 2024-09-21T06:40:12.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.747+0000 7efe6c214740 20 client.16323 trim_cache size 0 max 16384 2024-09-21T06:40:12.752 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:40:12.752 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0, 2024-09-21T06:40:12.752 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_tag": "62fca477-b241-45f5-8185-bc78aeb8b19f", 2024-09-21T06:40:12.752 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": "asynchronous" 2024-09-21T06:40:12.752 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:40:12.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.747+0000 7efe65ca0640 1 -- 172.21.15.7:0/49176251 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7efe480b66b0 msgr2=0x7efe480b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:12.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.747+0000 7efe65ca0640 1 --2- 172.21.15.7:0/49176251 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7efe480b66b0 0x7efe480b8bc0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7efe58007310 tx=0x7efe580072a0 comp rx=0 tx=0).stop 2024-09-21T06:40:12.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.747+0000 7efe65ca0640 1 -- 172.21.15.7:0/49176251 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe601083c0 msgr2=0x7efe6019aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:12.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.747+0000 7efe65ca0640 1 --2- 172.21.15.7:0/49176251 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe601083c0 0x7efe6019aa00 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7efe5400e9c0 tx=0x7efe5400ee80 comp rx=0 tx=0).stop 2024-09-21T06:40:12.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.748+0000 7efe65ca0640 1 -- 172.21.15.7:0/49176251 shutdown_connections 2024-09-21T06:40:12.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.748+0000 7efe65ca0640 1 --2- 172.21.15.7:0/49176251 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7efe480b66b0 0x7efe480b8bc0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:12.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.748+0000 7efe65ca0640 1 --2- 172.21.15.7:0/49176251 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efe60108d10 0x7efe6019fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:12.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.748+0000 7efe65ca0640 1 --2- 172.21.15.7:0/49176251 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7efe601083c0 0x7efe6019aa00 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:12.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.748+0000 7efe65ca0640 1 --2- 172.21.15.7:0/49176251 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7efe60102a80 0x7efe6019a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:12.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.748+0000 7efe65ca0640 1 -- 172.21.15.7:0/49176251 >> 172.21.15.7:0/49176251 conn(0x7efe60079740 msgr2=0x7efe60101530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:12.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.748+0000 7efe65ca0640 1 -- 172.21.15.7:0/49176251 shutdown_connections 2024-09-21T06:40:12.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:12.748+0000 7efe65ca0640 1 -- 172.21.15.7:0/49176251 wait complete. 2024-09-21T06:40:12.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:40:12 smithi144 ceph-mon[34653]: pgmap v439: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-21T06:40:13.535 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:40:13.817 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:40:14.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.301+0000 7f0eebdd3640 1 -- 172.21.15.7:0/1589382063 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ee41101a0 msgr2=0x7f0ee41125c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:14.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.301+0000 7f0eebdd3640 1 --2- 172.21.15.7:0/1589382063 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ee41101a0 0x7f0ee41125c0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f0edc009900 tx=0x7f0edc02a480 comp rx=0 tx=0).stop 2024-09-21T06:40:14.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.301+0000 7f0eebdd3640 1 -- 172.21.15.7:0/1589382063 shutdown_connections 2024-09-21T06:40:14.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.301+0000 7f0eebdd3640 1 --2- 172.21.15.7:0/1589382063 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ee41101a0 0x7f0ee41125c0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:14.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.301+0000 7f0eebdd3640 1 --2- 172.21.15.7:0/1589382063 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ee4102f40 0x7f0ee410fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:14.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.301+0000 7f0eebdd3640 1 --2- 172.21.15.7:0/1589382063 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0ee41025f0 0x7f0ee4102a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:14.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.301+0000 7f0eebdd3640 1 -- 172.21.15.7:0/1589382063 >> 172.21.15.7:0/1589382063 conn(0x7f0ee4079740 msgr2=0x7f0ee4079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:14.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.301+0000 7f0eebdd3640 1 -- 172.21.15.7:0/1589382063 shutdown_connections 2024-09-21T06:40:14.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.301+0000 7f0eebdd3640 1 -- 172.21.15.7:0/1589382063 wait complete. 2024-09-21T06:40:14.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.302+0000 7f0eebdd3640 1 Processor -- start 2024-09-21T06:40:14.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.302+0000 7f0eebdd3640 1 -- start start 2024-09-21T06:40:14.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.302+0000 7f0eebdd3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0ee41025f0 0x7f0ee419c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:14.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.302+0000 7f0eebdd3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ee4102f40 0x7f0ee419cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:14.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.302+0000 7f0eebdd3640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ee41101a0 0x7f0ee41a1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:14.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.302+0000 7f0eebdd3640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0ee4115c90 con 0x7f0ee4102f40 2024-09-21T06:40:14.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.302+0000 7f0eebdd3640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0ee4115b10 con 0x7f0ee41025f0 2024-09-21T06:40:14.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.302+0000 7f0eebdd3640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0ee4115e10 con 0x7f0ee41101a0 2024-09-21T06:40:14.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.302+0000 7f0ee936e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ee4102f40 0x7f0ee419cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:14.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.302+0000 7f0ee936e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ee4102f40 0x7f0ee419cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36490/0 (socket says 172.21.15.7:36490) 2024-09-21T06:40:14.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.302+0000 7f0ee936e640 1 -- 172.21.15.7:0/1504013530 learned_addr learned my addr 172.21.15.7:0/1504013530 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:40:14.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.302+0000 7f0ee9b6f640 1 --2- 172.21.15.7:0/1504013530 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0ee41025f0 0x7f0ee419c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:14.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.302+0000 7f0eea370640 1 --2- 172.21.15.7:0/1504013530 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ee41101a0 0x7f0ee41a1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:14.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.302+0000 7f0ee936e640 1 -- 172.21.15.7:0/1504013530 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ee41101a0 msgr2=0x7f0ee41a1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:14.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.302+0000 7f0ee936e640 1 --2- 172.21.15.7:0/1504013530 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ee41101a0 0x7f0ee41a1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:14.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.302+0000 7f0ee936e640 1 -- 172.21.15.7:0/1504013530 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0ee41025f0 msgr2=0x7f0ee419c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:14.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.302+0000 7f0ee936e640 1 --2- 172.21.15.7:0/1504013530 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0ee41025f0 0x7f0ee419c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:14.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.302+0000 7f0ee936e640 1 -- 172.21.15.7:0/1504013530 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ee41a2530 con 0x7f0ee4102f40 2024-09-21T06:40:14.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.302+0000 7f0eea370640 1 --2- 172.21.15.7:0/1504013530 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ee41101a0 0x7f0ee41a1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:40:14.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.303+0000 7f0ee936e640 1 --2- 172.21.15.7:0/1504013530 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ee4102f40 0x7f0ee419cb60 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f0ed800d950 tx=0x7f0ed800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:14.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.303+0000 7f0ee2ffd640 1 -- 172.21.15.7:0/1504013530 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ed8017070 con 0x7f0ee4102f40 2024-09-21T06:40:14.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.303+0000 7f0ee2ffd640 1 -- 172.21.15.7:0/1504013530 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ed8009c30 con 0x7f0ee4102f40 2024-09-21T06:40:14.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.303+0000 7f0eebdd3640 1 -- 172.21.15.7:0/1504013530 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ee41a2820 con 0x7f0ee4102f40 2024-09-21T06:40:14.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.303+0000 7f0ee2ffd640 1 -- 172.21.15.7:0/1504013530 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ed800f620 con 0x7f0ee4102f40 2024-09-21T06:40:14.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.303+0000 7f0eebdd3640 1 -- 172.21.15.7:0/1504013530 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ee41a8f80 con 0x7f0ee4102f40 2024-09-21T06:40:14.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.306+0000 7f0ef2347740 1 Processor -- start 2024-09-21T06:40:14.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.306+0000 7f0ef2347740 1 -- start start 2024-09-21T06:40:14.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.306+0000 7f0ee2ffd640 1 -- 172.21.15.7:0/1504013530 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f0ed8010460 con 0x7f0ee4102f40 2024-09-21T06:40:14.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.306+0000 7f0ef2347740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564c1f615070 0x564c1f9bc270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:14.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.306+0000 7f0ef2347740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564c1f5ec1b0 0x564c1f9bc7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:14.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.306+0000 7f0ef2347740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564c1f5f4390 0x564c1f9bccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:14.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.306+0000 7f0ef2347740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x564c1f932e50 con 0x564c1f5f4390 2024-09-21T06:40:14.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.306+0000 7f0ef2347740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x564c1f922280 con 0x564c1f5ec1b0 2024-09-21T06:40:14.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.306+0000 7f0ef2347740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x564c1f926090 con 0x564c1f615070 2024-09-21T06:40:14.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.306+0000 7f0ee936e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564c1f5f4390 0x564c1f9bccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:14.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.306+0000 7f0ee9b6f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564c1f5ec1b0 0x564c1f9bc7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:14.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.307+0000 7f0ee936e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564c1f5f4390 0x564c1f9bccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36500/0 (socket says 172.21.15.7:36500) 2024-09-21T06:40:14.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.307+0000 7f0ee936e640 1 -- 172.21.15.7:0/407555306 learned_addr learned my addr 172.21.15.7:0/407555306 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:40:14.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.307+0000 7f0eea370640 1 --2- 172.21.15.7:0/407555306 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564c1f615070 0x564c1f9bc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:14.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.307+0000 7f0ee9b6f640 1 -- 172.21.15.7:0/407555306 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564c1f615070 msgr2=0x564c1f9bc270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:14.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.307+0000 7f0ee9b6f640 1 --2- 172.21.15.7:0/407555306 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564c1f615070 0x564c1f9bc270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:14.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.307+0000 7f0ee9b6f640 1 -- 172.21.15.7:0/407555306 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564c1f5f4390 msgr2=0x564c1f9bccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:14.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.307+0000 7f0ee9b6f640 1 --2- 172.21.15.7:0/407555306 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564c1f5f4390 0x564c1f9bccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:14.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.307+0000 7f0ee9b6f640 1 -- 172.21.15.7:0/407555306 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c1f680650 con 0x564c1f5ec1b0 2024-09-21T06:40:14.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.307+0000 7f0ee9b6f640 1 --2- 172.21.15.7:0/407555306 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564c1f5ec1b0 0x564c1f9bc7b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0ed4009fb0 tx=0x7f0ed4003e00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4e45ffe07267658 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:14.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.307+0000 7f0ee2ffd640 1 --2- 172.21.15.7:0/1504013530 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f0ecc0b6700 0x7f0ecc0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:14.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.307+0000 7f0eea370640 1 --2- 172.21.15.7:0/1504013530 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f0ecc0b6700 0x7f0ecc0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:14.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.307+0000 7f0ecbfff640 1 -- 172.21.15.7:0/407555306 <== mon.2 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ed4004b20 con 0x564c1f5ec1b0 2024-09-21T06:40:14.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.307+0000 7f0ee2ffd640 1 -- 172.21.15.7:0/1504013530 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f0ed80e7260 con 0x7f0ee4102f40 2024-09-21T06:40:14.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.307+0000 7f0ecbfff640 1 -- 172.21.15.7:0/407555306 <== mon.2 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ed4004cc0 con 0x564c1f5ec1b0 2024-09-21T06:40:14.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.307+0000 7f0ecbfff640 1 -- 172.21.15.7:0/407555306 <== mon.2 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ed40126b0 con 0x564c1f5ec1b0 2024-09-21T06:40:14.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.308+0000 7f0ef2347740 1 -- 172.21.15.7:0/407555306 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564c1f5ec1b0 msgr2=0x564c1f9bc7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:14.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.308+0000 7f0eea370640 1 --2- 172.21.15.7:0/1504013530 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f0ecc0b6700 0x7f0ecc0b8c10 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f0edc031440 tx=0x7f0edc005a20 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:14.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.308+0000 7f0ef2347740 1 --2- 172.21.15.7:0/407555306 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564c1f5ec1b0 0x564c1f9bc7b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0ed4009fb0 tx=0x7f0ed4003e00 comp rx=0 tx=0).stop 2024-09-21T06:40:14.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.308+0000 7f0ef2347740 1 -- 172.21.15.7:0/407555306 shutdown_connections 2024-09-21T06:40:14.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.308+0000 7f0ef2347740 1 --2- 172.21.15.7:0/407555306 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564c1f5f4390 0x564c1f9bccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:14.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.308+0000 7f0ef2347740 1 --2- 172.21.15.7:0/407555306 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564c1f5ec1b0 0x564c1f9bc7b0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:14.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.308+0000 7f0ef2347740 1 --2- 172.21.15.7:0/407555306 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564c1f615070 0x564c1f9bc270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:14.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.308+0000 7f0ef2347740 1 -- 172.21.15.7:0/407555306 >> 172.21.15.7:0/407555306 conn(0x564c1f609460 msgr2=0x564c1f9ba160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:14.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.309+0000 7f0ef2347740 1 -- 172.21.15.7:0/407555306 shutdown_connections 2024-09-21T06:40:14.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.309+0000 7f0ef2347740 1 -- 172.21.15.7:0/407555306 wait complete. 2024-09-21T06:40:14.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.309+0000 7f0ef2347740 1 -- start start 2024-09-21T06:40:14.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.309+0000 7f0ef2347740 1 Processor -- start 2024-09-21T06:40:14.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.309+0000 7f0ef2347740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564c1f5ec1b0 0x564c1f9c7860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:14.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.309+0000 7f0ef2347740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564c1f5f4390 0x564c1f9c7da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:14.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.309+0000 7f0ef2347740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564c1f615070 0x564c1f9c82e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:14.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.309+0000 7f0ef2347740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x564c1f783700 con 0x564c1f5f4390 2024-09-21T06:40:14.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.309+0000 7f0ef2347740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x564c1f8bd110 con 0x564c1f5ec1b0 2024-09-21T06:40:14.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.309+0000 7f0ef2347740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x564c1f9caa50 con 0x564c1f615070 2024-09-21T06:40:14.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.310+0000 7f0ef2347740 10 client.0 _ll_register_callbacks cb 0x564c1f8d6990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:40:14.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.310+0000 7f0ee936e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564c1f5f4390 0x564c1f9c7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:14.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.310+0000 7f0ee936e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564c1f5f4390 0x564c1f9c7da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36502/0 (socket says 172.21.15.7:36502) 2024-09-21T06:40:14.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.310+0000 7f0ee936e640 1 -- 172.21.15.7:0/3750305613 learned_addr learned my addr 172.21.15.7:0/3750305613 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:40:14.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.310+0000 7f0eea370640 1 --2- 172.21.15.7:0/3750305613 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564c1f615070 0x564c1f9c82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:14.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.310+0000 7f0ee9b6f640 1 --2- 172.21.15.7:0/3750305613 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564c1f5ec1b0 0x564c1f9c7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:14.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.310+0000 7f0ee936e640 1 -- 172.21.15.7:0/3750305613 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564c1f615070 msgr2=0x564c1f9c82e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:14.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.310+0000 7f0ee936e640 1 --2- 172.21.15.7:0/3750305613 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564c1f615070 0x564c1f9c82e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:14.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.310+0000 7f0ee936e640 1 -- 172.21.15.7:0/3750305613 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564c1f5ec1b0 msgr2=0x564c1f9c7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:14.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.310+0000 7f0ee936e640 1 --2- 172.21.15.7:0/3750305613 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564c1f5ec1b0 0x564c1f9c7860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:14.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.310+0000 7f0ee936e640 1 -- 172.21.15.7:0/3750305613 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c1f8eac40 con 0x564c1f5f4390 2024-09-21T06:40:14.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.310+0000 7f0ee936e640 1 --2- 172.21.15.7:0/3750305613 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564c1f5f4390 0x564c1f9c7da0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f0ed80ace50 tx=0x7f0ed800bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f41136d55c3150d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:14.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.310+0000 7f0ec97fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:40:14.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.310+0000 7f0ec97fa640 1 -- 172.21.15.7:0/3750305613 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ed8020070 con 0x564c1f5f4390 2024-09-21T06:40:14.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.310+0000 7f0ef2347740 1 -- 172.21.15.7:0/3750305613 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ed4004cc0 con 0x564c1f5f4390 2024-09-21T06:40:14.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.310+0000 7f0ec97fa640 1 -- 172.21.15.7:0/3750305613 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f0ed8010750 con 0x564c1f5f4390 2024-09-21T06:40:14.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.310+0000 7f0ec97fa640 1 -- 172.21.15.7:0/3750305613 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0ed80a97a0 con 0x564c1f5f4390 2024-09-21T06:40:14.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.310+0000 7f0ef2347740 10 client.16335 fetch_fsmap learned FSMap version 25 2024-09-21T06:40:14.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.311+0000 7f0ef2347740 1 -- 172.21.15.7:0/3750305613 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564c1f9d6720 con 0x564c1f5f4390 2024-09-21T06:40:14.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.311+0000 7f0ec97fa640 1 -- 172.21.15.7:0/3750305613 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ed4004cc0 con 0x564c1f5f4390 2024-09-21T06:40:14.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.311+0000 7f0ec97fa640 1 -- 172.21.15.7:0/3750305613 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f0ed8010950 con 0x564c1f5f4390 2024-09-21T06:40:14.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.311+0000 7f0ef2347740 10 client.16335 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:40:14.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.311+0000 7f0ef2347740 10 client.16335 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:40:14.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.311+0000 7f0ef2347740 20 client.16335 populate_metadata read hostname 'smithi007' 2024-09-21T06:40:14.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.311+0000 7f0ef2347740 1 --2- 172.21.15.7:0/3750305613 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x564c1f5d39f0 0x564c1f9d9c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:14.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.311+0000 7f0ef2347740 4 client.16335 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:40:14.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.311+0000 7f0ef2347740 1 -- 172.21.15.7:0/3750305613 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564c1f934da0 con 0x564c1f5d39f0 2024-09-21T06:40:14.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.311+0000 7f0ee9b6f640 1 --2- 172.21.15.7:0/3750305613 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x564c1f5d39f0 0x564c1f9d9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:14.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.312+0000 7f0ec97fa640 10 client.16335 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:40:14.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.312+0000 7f0ee9b6f640 1 --2- 172.21.15.7:0/3750305613 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x564c1f5d39f0 0x564c1f9d9c00 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=558bf890daa96b43 server_cookie=b95f34c74d8a2381 in_seq=0 out_seq=0 2024-09-21T06:40:14.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.312+0000 7f0ec97fa640 1 -- 172.21.15.7:0/3750305613 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564c1f934da0 con 0x564c1f5d39f0 2024-09-21T06:40:14.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.312+0000 7f0ec97fa640 10 client.16335 handle_command_reply: tid=0 2024-09-21T06:40:14.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.313+0000 7f0ef2347740 1 client.16335 shutdown 2024-09-21T06:40:14.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.313+0000 7f0ef2347740 1 -- 172.21.15.7:0/3750305613 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564c1f5f4390 msgr2=0x564c1f9c7da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:14.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.313+0000 7f0ef2347740 1 --2- 172.21.15.7:0/3750305613 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564c1f5f4390 0x564c1f9c7da0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f0ed80ace50 tx=0x7f0ed800bf60 comp rx=0 tx=0).stop 2024-09-21T06:40:14.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.313+0000 7f0ef2347740 1 -- 172.21.15.7:0/3750305613 shutdown_connections 2024-09-21T06:40:14.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.313+0000 7f0ef2347740 1 --2- 172.21.15.7:0/3750305613 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x564c1f5d39f0 0x564c1f9d9c00 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:14.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.313+0000 7f0ef2347740 1 --2- 172.21.15.7:0/3750305613 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564c1f615070 0x564c1f9c82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:14.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.313+0000 7f0ef2347740 1 --2- 172.21.15.7:0/3750305613 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564c1f5f4390 0x564c1f9c7da0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:14.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.313+0000 7f0ef2347740 1 --2- 172.21.15.7:0/3750305613 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564c1f5ec1b0 0x564c1f9c7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:14.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.313+0000 7f0ec97fa640 0 client.16335 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:40:14.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.313+0000 7f0ef2347740 1 -- 172.21.15.7:0/3750305613 >> 172.21.15.7:0/3750305613 conn(0x564c1f609460 msgr2=0x564c1f9bf400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:14.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.313+0000 7f0ef2347740 1 -- 172.21.15.7:0/3750305613 shutdown_connections 2024-09-21T06:40:14.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.313+0000 7f0ef2347740 1 -- 172.21.15.7:0/3750305613 wait complete. 2024-09-21T06:40:14.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.313+0000 7f0ef2347740 20 client.16335 trim_cache size 0 max 16384 2024-09-21T06:40:14.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.332+0000 7f0ef2347740 1 Processor -- start 2024-09-21T06:40:14.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.332+0000 7f0ef2347740 1 -- start start 2024-09-21T06:40:14.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.332+0000 7f0ef2347740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564c1f5ec1b0 0x564c1f9c9420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:14.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.333+0000 7f0ef2347740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564c1f5f4390 0x564c1f9c4a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:14.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.333+0000 7f0ef2347740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564c1f615070 0x564c1f9c4f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:14.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.333+0000 7f0ef2347740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0ee41b4000 con 0x564c1f5ec1b0 2024-09-21T06:40:14.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.333+0000 7f0ef2347740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0ee41b18d0 con 0x564c1f5f4390 2024-09-21T06:40:14.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.333+0000 7f0ef2347740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0ee41af700 con 0x564c1f615070 2024-09-21T06:40:14.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.333+0000 7f0ee9b6f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564c1f5ec1b0 0x564c1f9c9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:14.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.333+0000 7f0ee9b6f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564c1f5ec1b0 0x564c1f9c9420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36512/0 (socket says 172.21.15.7:36512) 2024-09-21T06:40:14.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.333+0000 7f0ee9b6f640 1 -- 172.21.15.7:0/2138601697 learned_addr learned my addr 172.21.15.7:0/2138601697 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:40:14.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.333+0000 7f0ee936e640 1 --2- 172.21.15.7:0/2138601697 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564c1f5f4390 0x564c1f9c4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:14.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.333+0000 7f0eea370640 1 --2- 172.21.15.7:0/2138601697 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564c1f615070 0x564c1f9c4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:14.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.333+0000 7f0ee9b6f640 1 -- 172.21.15.7:0/2138601697 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564c1f615070 msgr2=0x564c1f9c4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:14.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.333+0000 7f0ee9b6f640 1 --2- 172.21.15.7:0/2138601697 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564c1f615070 0x564c1f9c4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:14.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.333+0000 7f0ee9b6f640 1 -- 172.21.15.7:0/2138601697 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564c1f5f4390 msgr2=0x564c1f9c4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:14.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.333+0000 7f0ee9b6f640 1 --2- 172.21.15.7:0/2138601697 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564c1f5f4390 0x564c1f9c4a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:14.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.333+0000 7f0ee9b6f640 1 -- 172.21.15.7:0/2138601697 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c1f9c5d60 con 0x564c1f5ec1b0 2024-09-21T06:40:14.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.333+0000 7f0ee9b6f640 1 --2- 172.21.15.7:0/2138601697 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564c1f5ec1b0 0x564c1f9c9420 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x564c1f9baef0 tx=0x7f0ed4004410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=413493fdc0eec942 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:14.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.335+0000 7f0ecb7fe640 1 -- 172.21.15.7:0/2138601697 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ed40046e0 con 0x564c1f5ec1b0 2024-09-21T06:40:14.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.335+0000 7f0ecb7fe640 1 -- 172.21.15.7:0/2138601697 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ed4004880 con 0x564c1f5ec1b0 2024-09-21T06:40:14.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.335+0000 7f0ecb7fe640 1 -- 172.21.15.7:0/2138601697 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ed40126b0 con 0x564c1f5ec1b0 2024-09-21T06:40:14.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.336+0000 7f0ef2347740 1 -- 172.21.15.7:0/2138601697 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564c1f5ec1b0 msgr2=0x564c1f9c9420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:14.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.336+0000 7f0ef2347740 1 --2- 172.21.15.7:0/2138601697 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564c1f5ec1b0 0x564c1f9c9420 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x564c1f9baef0 tx=0x7f0ed4004410 comp rx=0 tx=0).stop 2024-09-21T06:40:14.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.336+0000 7f0ef2347740 1 -- 172.21.15.7:0/2138601697 shutdown_connections 2024-09-21T06:40:14.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.336+0000 7f0ef2347740 1 --2- 172.21.15.7:0/2138601697 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564c1f615070 0x564c1f9c4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:14.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.336+0000 7f0ef2347740 1 --2- 172.21.15.7:0/2138601697 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564c1f5f4390 0x564c1f9c4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:14.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.336+0000 7f0ef2347740 1 --2- 172.21.15.7:0/2138601697 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564c1f5ec1b0 0x564c1f9c9420 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:14.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.336+0000 7f0ef2347740 1 -- 172.21.15.7:0/2138601697 >> 172.21.15.7:0/2138601697 conn(0x564c1f609460 msgr2=0x564c1f9c8d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:14.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.336+0000 7f0ef2347740 1 -- 172.21.15.7:0/2138601697 shutdown_connections 2024-09-21T06:40:14.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.336+0000 7f0ef2347740 1 -- 172.21.15.7:0/2138601697 wait complete. 2024-09-21T06:40:14.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.336+0000 7f0ef2347740 1 -- start start 2024-09-21T06:40:14.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.336+0000 7f0ef2347740 1 Processor -- start 2024-09-21T06:40:14.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.337+0000 7f0ef2347740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564c1f5ec1b0 0x564c1f9cbd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:14.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.337+0000 7f0ef2347740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564c1f5f4390 0x564c1f9cc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:14.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.337+0000 7f0ef2347740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564c1f615070 0x564c1f9cc800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:14.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.337+0000 7f0ef2347740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0ee41afd90 con 0x564c1f5ec1b0 2024-09-21T06:40:14.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.337+0000 7f0ef2347740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0ee41b1200 con 0x564c1f5f4390 2024-09-21T06:40:14.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.337+0000 7f0ef2347740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0ee41b0460 con 0x564c1f615070 2024-09-21T06:40:14.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.337+0000 7f0ef2347740 10 client.0 _ll_register_callbacks cb 0x7f0ed800df40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:40:14.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.337+0000 7f0ee9b6f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564c1f5ec1b0 0x564c1f9cbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:14.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.337+0000 7f0ee9b6f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564c1f5ec1b0 0x564c1f9cbd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36520/0 (socket says 172.21.15.7:36520) 2024-09-21T06:40:14.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.337+0000 7f0ee9b6f640 1 -- 172.21.15.7:0/3763414853 learned_addr learned my addr 172.21.15.7:0/3763414853 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:40:14.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.337+0000 7f0ee936e640 1 --2- 172.21.15.7:0/3763414853 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564c1f5f4390 0x564c1f9cc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:14.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.337+0000 7f0eea370640 1 --2- 172.21.15.7:0/3763414853 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564c1f615070 0x564c1f9cc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:14.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.337+0000 7f0ee9b6f640 1 -- 172.21.15.7:0/3763414853 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564c1f615070 msgr2=0x564c1f9cc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:14.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.337+0000 7f0ee9b6f640 1 --2- 172.21.15.7:0/3763414853 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564c1f615070 0x564c1f9cc800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:14.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.337+0000 7f0ee9b6f640 1 -- 172.21.15.7:0/3763414853 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564c1f5f4390 msgr2=0x564c1f9cc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:14.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.337+0000 7f0ee9b6f640 1 --2- 172.21.15.7:0/3763414853 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564c1f5f4390 0x564c1f9cc2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:14.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.337+0000 7f0ee9b6f640 1 -- 172.21.15.7:0/3763414853 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c1fa436d0 con 0x564c1f5ec1b0 2024-09-21T06:40:14.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.338+0000 7f0ee9b6f640 1 --2- 172.21.15.7:0/3763414853 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564c1f5ec1b0 0x564c1f9cbd80 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f0ed4009f80 tx=0x7f0ed4005c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f5f30e4e78a0516 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:14.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.338+0000 7f0ec97fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:40:14.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.338+0000 7f0ec97fa640 1 -- 172.21.15.7:0/3763414853 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ed4029df0 con 0x564c1f5ec1b0 2024-09-21T06:40:14.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.338+0000 7f0ec97fa640 1 -- 172.21.15.7:0/3763414853 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f0ed4029870 con 0x564c1f5ec1b0 2024-09-21T06:40:14.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.338+0000 7f0ef2347740 1 -- 172.21.15.7:0/3763414853 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564c1f930850 con 0x564c1f5ec1b0 2024-09-21T06:40:14.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.338+0000 7f0ec97fa640 1 -- 172.21.15.7:0/3763414853 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0ed4004480 con 0x564c1f5ec1b0 2024-09-21T06:40:14.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.338+0000 7f0ef2347740 10 client.16341 fetch_fsmap learned FSMap version 25 2024-09-21T06:40:14.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.338+0000 7f0ef2347740 1 -- 172.21.15.7:0/3763414853 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564c1fa44960 con 0x564c1f5ec1b0 2024-09-21T06:40:14.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.338+0000 7f0ec97fa640 1 -- 172.21.15.7:0/3763414853 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x564c1f930850 con 0x564c1f5ec1b0 2024-09-21T06:40:14.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.338+0000 7f0ec97fa640 1 -- 172.21.15.7:0/3763414853 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f0ed400f040 con 0x564c1f5ec1b0 2024-09-21T06:40:14.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.338+0000 7f0ef2347740 10 client.16341 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:40:14.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.338+0000 7f0ef2347740 10 client.16341 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:40:14.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.338+0000 7f0ef2347740 20 client.16341 populate_metadata read hostname 'smithi007' 2024-09-21T06:40:14.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.338+0000 7f0ef2347740 1 --2- 172.21.15.7:0/3763414853 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x564c1f5a8da0 0x564c1fa46f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:14.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.338+0000 7f0ef2347740 4 client.16341 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:40:14.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.338+0000 7f0ef2347740 1 -- 172.21.15.7:0/3763414853 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564c1f92dc80 con 0x564c1f5a8da0 2024-09-21T06:40:14.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.339+0000 7f0ee936e640 1 --2- 172.21.15.7:0/3763414853 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x564c1f5a8da0 0x564c1fa46f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:14.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.339+0000 7f0ec97fa640 10 client.16341 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:40:14.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.339+0000 7f0ee936e640 1 --2- 172.21.15.7:0/3763414853 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x564c1f5a8da0 0x564c1fa46f10 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=95744415b278aab server_cookie=32b662877d2488fc in_seq=0 out_seq=0 2024-09-21T06:40:14.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.340+0000 7f0ec97fa640 1 -- 172.21.15.7:0/3763414853 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2274 (crc 0 0 0) 0x564c1f92dc80 con 0x564c1f5a8da0 2024-09-21T06:40:14.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.340+0000 7f0ec97fa640 10 client.16341 handle_command_reply: tid=0 2024-09-21T06:40:14.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.340+0000 7f0ef2347740 1 client.16341 shutdown 2024-09-21T06:40:14.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.340+0000 7f0ef2347740 1 -- 172.21.15.7:0/3763414853 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564c1f5ec1b0 msgr2=0x564c1f9cbd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:14.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.340+0000 7f0ef2347740 1 --2- 172.21.15.7:0/3763414853 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564c1f5ec1b0 0x564c1f9cbd80 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f0ed4009f80 tx=0x7f0ed4005c50 comp rx=0 tx=0).stop 2024-09-21T06:40:14.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.340+0000 7f0ef2347740 1 -- 172.21.15.7:0/3763414853 shutdown_connections 2024-09-21T06:40:14.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.340+0000 7f0ef2347740 1 --2- 172.21.15.7:0/3763414853 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x564c1f5a8da0 0x564c1fa46f10 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:14.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.340+0000 7f0ef2347740 1 --2- 172.21.15.7:0/3763414853 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564c1f615070 0x564c1f9cc800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:14.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.340+0000 7f0ef2347740 1 --2- 172.21.15.7:0/3763414853 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564c1f5f4390 0x564c1f9cc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:14.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.340+0000 7f0ef2347740 1 --2- 172.21.15.7:0/3763414853 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564c1f5ec1b0 0x564c1f9cbd80 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:14.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.340+0000 7f0ec97fa640 0 client.16341 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:40:14.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.340+0000 7f0ef2347740 1 -- 172.21.15.7:0/3763414853 >> 172.21.15.7:0/3763414853 conn(0x564c1f609460 msgr2=0x564c1f9ba0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:14.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.340+0000 7f0ef2347740 1 -- 172.21.15.7:0/3763414853 shutdown_connections 2024-09-21T06:40:14.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.340+0000 7f0ef2347740 1 -- 172.21.15.7:0/3763414853 wait complete. 2024-09-21T06:40:14.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.340+0000 7f0ef2347740 20 client.16341 trim_cache size 0 max 16384 2024-09-21T06:40:14.345 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:40:14.345 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T06:40:14.345 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": { 2024-09-21T06:40:14.345 INFO:teuthology.orchestra.run.smithi007.stdout: "62fca477-b241-45f5-8185-bc78aeb8b19f": { 2024-09-21T06:40:14.345 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:40:14.345 INFO:teuthology.orchestra.run.smithi007.stdout: "tag": "62fca477-b241-45f5-8185-bc78aeb8b19f", 2024-09-21T06:40:14.345 INFO:teuthology.orchestra.run.smithi007.stdout: "options": "recursive,force" 2024-09-21T06:40:14.345 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:40:14.345 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:40:14.345 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_stats": { 2024-09-21T06:40:14.345 INFO:teuthology.orchestra.run.smithi007.stdout: "62fca477-b241-45f5-8185-bc78aeb8b19f": { 2024-09-21T06:40:14.345 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:40:12.744488+0000", 2024-09-21T06:40:14.345 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:40:14.346 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:40:14.346 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:40:14.346 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:40:14.346 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:40:14.346 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:40:14.346 INFO:teuthology.orchestra.run.smithi007.stdout: "d7b6a90c-9ae1-4e02-93ad-335a7e9df1d7": { 2024-09-21T06:40:14.346 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:39:19.226139+0000", 2024-09-21T06:40:14.346 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:40:14.346 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:40:14.346 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:40:14.346 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:40:14.346 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:40:14.346 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:40:14.346 INFO:teuthology.orchestra.run.smithi007.stdout: "b0327167-8c41-4286-8afc-7f0780972fd7": { 2024-09-21T06:40:14.346 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:38:36.828657+0000", 2024-09-21T06:40:14.347 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:40:14.347 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:40:14.347 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:40:14.347 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:40:14.347 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:40:14.347 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:40:14.347 INFO:teuthology.orchestra.run.smithi007.stdout: "13441782-2231-4713-8ebd-068a941de47f": { 2024-09-21T06:40:14.347 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:39:30.219006+0000", 2024-09-21T06:40:14.347 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:40:14.347 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:40:14.347 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:40:14.347 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:40:14.347 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:40:14.347 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:40:14.347 INFO:teuthology.orchestra.run.smithi007.stdout: "5cbaaba2-6ab1-4f83-abd6-8c6eef4b5c42": { 2024-09-21T06:40:14.348 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:37:46.566272+0000", 2024-09-21T06:40:14.348 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:40:14.348 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:40:14.348 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:40:14.348 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:40:14.348 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:40:14.348 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:40:14.348 INFO:teuthology.orchestra.run.smithi007.stdout: "6231e9c1-14a2-40b5-be3c-76d87a0d733b": { 2024-09-21T06:40:14.348 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:37:02.484812+0000", 2024-09-21T06:40:14.348 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:40:14.348 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:40:14.348 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:40:14.348 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:40:14.348 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:40:14.348 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:40:14.348 INFO:teuthology.orchestra.run.smithi007.stdout: "0b89345c-1f00-4efe-8ee9-4cb17e43584c": { 2024-09-21T06:40:14.349 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:36:19.500334+0000", 2024-09-21T06:40:14.349 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:40:14.349 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:40:14.349 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:40:14.349 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:40:14.349 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:40:14.349 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:40:14.349 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:40:14.349 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:40:14.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.341+0000 7f0eebdd3640 1 -- 172.21.15.7:0/1504013530 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f0ecc0b6700 msgr2=0x7f0ecc0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:14.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.341+0000 7f0eebdd3640 1 --2- 172.21.15.7:0/1504013530 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f0ecc0b6700 0x7f0ecc0b8c10 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f0edc031440 tx=0x7f0edc005a20 comp rx=0 tx=0).stop 2024-09-21T06:40:14.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.341+0000 7f0eebdd3640 1 -- 172.21.15.7:0/1504013530 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ee4102f40 msgr2=0x7f0ee419cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:14.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.341+0000 7f0eebdd3640 1 --2- 172.21.15.7:0/1504013530 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ee4102f40 0x7f0ee419cb60 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f0ed800d950 tx=0x7f0ed800de10 comp rx=0 tx=0).stop 2024-09-21T06:40:14.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.341+0000 7f0eebdd3640 1 -- 172.21.15.7:0/1504013530 shutdown_connections 2024-09-21T06:40:14.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.341+0000 7f0eebdd3640 1 --2- 172.21.15.7:0/1504013530 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f0ecc0b6700 0x7f0ecc0b8c10 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:14.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.341+0000 7f0eebdd3640 1 --2- 172.21.15.7:0/1504013530 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0ee41101a0 0x7f0ee41a1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:14.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.341+0000 7f0eebdd3640 1 --2- 172.21.15.7:0/1504013530 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0ee4102f40 0x7f0ee419cb60 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:14.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.341+0000 7f0eebdd3640 1 --2- 172.21.15.7:0/1504013530 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0ee41025f0 0x7f0ee419c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:14.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.341+0000 7f0eebdd3640 1 -- 172.21.15.7:0/1504013530 >> 172.21.15.7:0/1504013530 conn(0x7f0ee4079740 msgr2=0x7f0ee4109d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:14.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.341+0000 7f0eebdd3640 1 -- 172.21.15.7:0/1504013530 shutdown_connections 2024-09-21T06:40:14.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:14.341+0000 7f0eebdd3640 1 -- 172.21.15.7:0/1504013530 wait complete. 2024-09-21T06:40:14.589 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:40:14 smithi007 ceph-mon[30983]: scrub queued for path: / 2024-09-21T06:40:14.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:40:14 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T06:40:14.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:40:14 smithi007 ceph-mon[30983]: scrub summary: active paths [/] 2024-09-21T06:40:14.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:40:14 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T06:40:14.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:40:14 smithi007 ceph-mon[30983]: pgmap v440: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-21T06:40:14.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:40:14 smithi018 ceph-mon[34477]: scrub queued for path: / 2024-09-21T06:40:14.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:40:14 smithi018 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-21T06:40:14.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:40:14 smithi018 ceph-mon[34477]: scrub summary: active paths [/] 2024-09-21T06:40:14.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:40:14 smithi018 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-21T06:40:14.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:40:14 smithi018 ceph-mon[34477]: pgmap v440: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-21T06:40:14.786 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:40:14 smithi144 ceph-mon[34653]: scrub queued for path: / 2024-09-21T06:40:14.786 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:40:14 smithi144 ceph-mon[34653]: scrub summary: idle+waiting paths [/] 2024-09-21T06:40:14.786 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:40:14 smithi144 ceph-mon[34653]: scrub summary: active paths [/] 2024-09-21T06:40:14.786 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:40:14 smithi144 ceph-mon[34653]: scrub summary: idle+waiting paths [/] 2024-09-21T06:40:14.786 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:40:14 smithi144 ceph-mon[34653]: pgmap v440: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-21T06:40:15.096 INFO:tasks.cephfs.filesystem:scrub status for tag:62fca477-b241-45f5-8185-bc78aeb8b19f - {'path': '/', 'tag': '62fca477-b241-45f5-8185-bc78aeb8b19f', 'options': 'recursive,force'} 2024-09-21T06:40:15.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:40:15 smithi007 ceph-mon[30983]: scrub summary: idle 2024-09-21T06:40:15.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:40:15 smithi018 ceph-mon[34477]: scrub summary: idle 2024-09-21T06:40:15.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:40:15 smithi144 ceph-mon[34653]: scrub summary: idle 2024-09-21T06:40:16.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:40:16 smithi018 ceph-mon[34477]: pgmap v441: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 511 B/s wr, 5 op/s 2024-09-21T06:40:16.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:40:16 smithi144 ceph-mon[34653]: pgmap v441: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 511 B/s wr, 5 op/s 2024-09-21T06:40:16.839 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:40:16 smithi007 ceph-mon[30983]: pgmap v441: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 511 B/s wr, 5 op/s 2024-09-21T06:40:18.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:40:18 smithi018 ceph-mon[34477]: pgmap v442: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 511 B/s wr, 7 op/s 2024-09-21T06:40:18.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:40:18 smithi144 ceph-mon[34653]: pgmap v442: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 511 B/s wr, 7 op/s 2024-09-21T06:40:18.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:40:18 smithi007 ceph-mon[30983]: pgmap v442: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 511 B/s wr, 7 op/s 2024-09-21T06:40:20.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:40:20 smithi018 ceph-mon[34477]: pgmap v443: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-21T06:40:20.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:40:20 smithi144 ceph-mon[34653]: pgmap v443: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-21T06:40:20.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:40:20 smithi007 ceph-mon[30983]: pgmap v443: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-21T06:40:22.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:40:22 smithi018 ceph-mon[34477]: pgmap v444: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-21T06:40:22.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:40:22 smithi144 ceph-mon[34653]: pgmap v444: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-21T06:40:22.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:40:22 smithi007 ceph-mon[30983]: pgmap v444: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-21T06:40:24.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:40:24 smithi018 ceph-mon[34477]: pgmap v445: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T06:40:24.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:40:24 smithi144 ceph-mon[34653]: pgmap v445: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T06:40:24.839 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:40:24 smithi007 ceph-mon[30983]: pgmap v445: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T06:40:26.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:40:26 smithi018 ceph-mon[34477]: pgmap v446: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-21T06:40:26.642 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:40:26 smithi007 ceph-mon[30983]: pgmap v446: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-21T06:40:26.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:40:26 smithi144 ceph-mon[34653]: pgmap v446: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-21T06:40:28.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:40:28 smithi018 ceph-mon[34477]: pgmap v447: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-21T06:40:28.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:40:28 smithi144 ceph-mon[34653]: pgmap v447: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-21T06:40:28.839 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:40:28 smithi007 ceph-mon[30983]: pgmap v447: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-21T06:40:30.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:40:30 smithi018 ceph-mon[34477]: pgmap v448: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T06:40:30.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:40:30 smithi144 ceph-mon[34653]: pgmap v448: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T06:40:30.839 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:40:30 smithi007 ceph-mon[30983]: pgmap v448: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T06:40:32.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:40:32 smithi018 ceph-mon[34477]: pgmap v449: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-21T06:40:32.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:40:32 smithi144 ceph-mon[34653]: pgmap v449: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-21T06:40:32.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:40:32 smithi007 ceph-mon[30983]: pgmap v449: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-21T06:40:34.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:40:34 smithi018 ceph-mon[34477]: pgmap v450: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-21T06:40:34.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:40:34 smithi144 ceph-mon[34653]: pgmap v450: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-21T06:40:34.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:40:34 smithi007 ceph-mon[30983]: pgmap v450: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-21T06:40:36.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:40:36 smithi144 ceph-mon[34653]: pgmap v451: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:40:36.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:40:36 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:40:36.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:40:36 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:40:36.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:40:36 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:40:36.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:40:36 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:40:36.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:40:36 smithi007 ceph-mon[30983]: pgmap v451: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:40:36.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:40:36 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:40:36.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:40:36 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:40:36.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:40:36 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:40:36.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:40:36 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:40:36.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:40:36 smithi018 ceph-mon[34477]: pgmap v451: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:40:36.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:40:36 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:40:36.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:40:36 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:40:36.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:40:36 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:40:36.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:40:36 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:40:38.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:40:38 smithi144 ceph-mon[34653]: pgmap v452: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:40:38.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:40:38 smithi007 ceph-mon[30983]: pgmap v452: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:40:38.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:40:38 smithi018 ceph-mon[34477]: pgmap v452: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:40:40.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:40:40 smithi144 ceph-mon[34653]: pgmap v453: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:40:40.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:40:40 smithi007 ceph-mon[30983]: pgmap v453: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:40:40.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:40:40 smithi018 ceph-mon[34477]: pgmap v453: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:40:42.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:40:42 smithi144 ceph-mon[34653]: pgmap v454: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:40:42.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:40:42 smithi007 ceph-mon[30983]: pgmap v454: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:40:42.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:40:42 smithi018 ceph-mon[34477]: pgmap v454: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:40:44.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:40:44 smithi144 ceph-mon[34653]: pgmap v455: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:40:44.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:40:44 smithi007 ceph-mon[30983]: pgmap v455: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:40:44.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:40:44 smithi018 ceph-mon[34477]: pgmap v455: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:40:45.097 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:40:45.371 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:40:45.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.882+0000 7f7ff2bb6640 1 -- 172.21.15.7:0/3728165679 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7fec1027a0 msgr2=0x7f7fec102bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:45.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.882+0000 7f7ff2bb6640 1 --2- 172.21.15.7:0/3728165679 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7fec1027a0 0x7f7fec102bb0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f7fe4009930 tx=0x7f7fe402a420 comp rx=0 tx=0).stop 2024-09-21T06:40:45.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.882+0000 7f7ff2bb6640 1 -- 172.21.15.7:0/3728165679 shutdown_connections 2024-09-21T06:40:45.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.882+0000 7f7ff2bb6640 1 --2- 172.21.15.7:0/3728165679 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7fec107be0 0x7f7fec1080c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:45.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.882+0000 7f7ff2bb6640 1 --2- 172.21.15.7:0/3728165679 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fec1030f0 0x7f7fec107620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:45.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.882+0000 7f7ff2bb6640 1 --2- 172.21.15.7:0/3728165679 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7fec1027a0 0x7f7fec102bb0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:45.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.882+0000 7f7ff2bb6640 1 -- 172.21.15.7:0/3728165679 >> 172.21.15.7:0/3728165679 conn(0x7f7fec079730 msgr2=0x7f7fec079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:45.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.882+0000 7f7ff2bb6640 1 -- 172.21.15.7:0/3728165679 shutdown_connections 2024-09-21T06:40:45.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.882+0000 7f7ff2bb6640 1 -- 172.21.15.7:0/3728165679 wait complete. 2024-09-21T06:40:45.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.882+0000 7f7ff2bb6640 1 Processor -- start 2024-09-21T06:40:45.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.882+0000 7f7ff2bb6640 1 -- start start 2024-09-21T06:40:45.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.883+0000 7f7ff2bb6640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7fec1027a0 0x7f7fec1a0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:45.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.883+0000 7f7ff2bb6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7fec1030f0 0x7f7fec1a10c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:45.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.883+0000 7f7ff2bb6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fec107be0 0x7f7fec1a6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:45.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.883+0000 7f7ff2bb6640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7fec11a0b0 con 0x7f7fec1030f0 2024-09-21T06:40:45.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.883+0000 7f7ff2bb6640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7fec119f30 con 0x7f7fec107be0 2024-09-21T06:40:45.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.883+0000 7f7ff2bb6640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7fec11a230 con 0x7f7fec1027a0 2024-09-21T06:40:45.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.883+0000 7f7febfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7fec1030f0 0x7f7fec1a10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:45.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.883+0000 7f7febfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7fec1030f0 0x7f7fec1a10c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39332/0 (socket says 172.21.15.7:39332) 2024-09-21T06:40:45.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.883+0000 7f7febfff640 1 -- 172.21.15.7:0/75340825 learned_addr learned my addr 172.21.15.7:0/75340825 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:40:45.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.883+0000 7f7ff0952640 1 --2- 172.21.15.7:0/75340825 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7fec1027a0 0x7f7fec1a0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:45.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.883+0000 7f7febfff640 1 -- 172.21.15.7:0/75340825 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7fec1027a0 msgr2=0x7f7fec1a0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:45.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.883+0000 7f7febfff640 1 --2- 172.21.15.7:0/75340825 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7fec1027a0 0x7f7fec1a0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:45.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.883+0000 7f7febfff640 1 -- 172.21.15.7:0/75340825 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fec107be0 msgr2=0x7f7fec1a6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:45.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.883+0000 7f7ff1153640 1 --2- 172.21.15.7:0/75340825 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fec107be0 0x7f7fec1a6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:45.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.883+0000 7f7febfff640 1 --2- 172.21.15.7:0/75340825 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fec107be0 0x7f7fec1a6360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:45.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.883+0000 7f7febfff640 1 -- 172.21.15.7:0/75340825 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fec1a6a90 con 0x7f7fec1030f0 2024-09-21T06:40:45.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.883+0000 7f7ff1153640 1 --2- 172.21.15.7:0/75340825 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fec107be0 0x7f7fec1a6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:40:45.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.884+0000 7f7febfff640 1 --2- 172.21.15.7:0/75340825 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7fec1030f0 0x7f7fec1a10c0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f7fd400d950 tx=0x7f7fd400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:45.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.884+0000 7f7fe9ffb640 1 -- 172.21.15.7:0/75340825 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fd4017070 con 0x7f7fec1030f0 2024-09-21T06:40:45.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.884+0000 7f7ff2bb6640 1 -- 172.21.15.7:0/75340825 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fec1a6d80 con 0x7f7fec1030f0 2024-09-21T06:40:45.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.884+0000 7f7fe9ffb640 1 -- 172.21.15.7:0/75340825 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7fd4009c30 con 0x7f7fec1030f0 2024-09-21T06:40:45.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.884+0000 7f7fe9ffb640 1 -- 172.21.15.7:0/75340825 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fd40047a0 con 0x7f7fec1030f0 2024-09-21T06:40:45.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.884+0000 7f7ff2bb6640 1 -- 172.21.15.7:0/75340825 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fec1ad4e0 con 0x7f7fec1030f0 2024-09-21T06:40:45.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.887+0000 7f7fe9ffb640 1 -- 172.21.15.7:0/75340825 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f7fd4004020 con 0x7f7fec1030f0 2024-09-21T06:40:45.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.887+0000 7f7ff912a740 1 Processor -- start 2024-09-21T06:40:45.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.887+0000 7f7ff912a740 1 -- start start 2024-09-21T06:40:45.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.887+0000 7f7ff912a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aa28b64070 0x55aa28f0b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:45.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.887+0000 7f7ff912a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aa28b3b1b0 0x55aa28f0b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:45.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.887+0000 7f7ff912a740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aa28b43390 0x55aa28f0bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:45.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.887+0000 7f7ff912a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55aa28e81e50 con 0x55aa28b64070 2024-09-21T06:40:45.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.887+0000 7f7ff912a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55aa28e71280 con 0x55aa28b3b1b0 2024-09-21T06:40:45.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.887+0000 7f7ff912a740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55aa28e75090 con 0x55aa28b43390 2024-09-21T06:40:45.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.888+0000 7f7ff1153640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aa28b64070 0x55aa28f0b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:45.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.888+0000 7f7ff1153640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aa28b64070 0x55aa28f0b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39336/0 (socket says 172.21.15.7:39336) 2024-09-21T06:40:45.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.888+0000 7f7ff1153640 1 -- 172.21.15.7:0/560610008 learned_addr learned my addr 172.21.15.7:0/560610008 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:40:45.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.888+0000 7f7febfff640 1 --2- 172.21.15.7:0/560610008 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aa28b43390 0x55aa28f0bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:45.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.888+0000 7f7ff0952640 1 --2- 172.21.15.7:0/560610008 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aa28b3b1b0 0x55aa28f0b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:45.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.888+0000 7f7ff1153640 1 -- 172.21.15.7:0/560610008 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aa28b43390 msgr2=0x55aa28f0bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:45.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.888+0000 7f7ff1153640 1 --2- 172.21.15.7:0/560610008 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aa28b43390 0x55aa28f0bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:45.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.888+0000 7f7ff1153640 1 -- 172.21.15.7:0/560610008 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aa28b3b1b0 msgr2=0x55aa28f0b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:45.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.888+0000 7f7ff1153640 1 --2- 172.21.15.7:0/560610008 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aa28b3b1b0 0x55aa28f0b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:45.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.888+0000 7f7ff1153640 1 -- 172.21.15.7:0/560610008 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa28bcf650 con 0x55aa28b64070 2024-09-21T06:40:45.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.888+0000 7f7febfff640 1 --2- 172.21.15.7:0/560610008 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aa28b43390 0x55aa28f0bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:40:45.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.888+0000 7f7fe9ffb640 1 --2- 172.21.15.7:0/75340825 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f7fd80b6680 0x7f7fd80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:45.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.889+0000 7f7ff1153640 1 --2- 172.21.15.7:0/560610008 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aa28b64070 0x55aa28f0b270 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc009f10 tx=0x7f7fdc00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23b36e3da347fe32 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:45.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.889+0000 7f7ff0952640 1 --2- 172.21.15.7:0/75340825 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f7fd80b6680 0x7f7fd80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:45.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.889+0000 7f7fe9ffb640 1 -- 172.21.15.7:0/75340825 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f7fd40e73c0 con 0x7f7fec1030f0 2024-09-21T06:40:45.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.889+0000 7f7fe2ffd640 1 -- 172.21.15.7:0/560610008 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fdc003b70 con 0x55aa28b64070 2024-09-21T06:40:45.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.889+0000 7f7fe2ffd640 1 -- 172.21.15.7:0/560610008 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7fdc003d10 con 0x55aa28b64070 2024-09-21T06:40:45.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.889+0000 7f7fe2ffd640 1 -- 172.21.15.7:0/560610008 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fdc0119a0 con 0x55aa28b64070 2024-09-21T06:40:45.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.890+0000 7f7ff912a740 1 -- 172.21.15.7:0/560610008 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aa28b64070 msgr2=0x55aa28f0b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:45.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.890+0000 7f7ff912a740 1 --2- 172.21.15.7:0/560610008 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aa28b64070 0x55aa28f0b270 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc009f10 tx=0x7f7fdc00f730 comp rx=0 tx=0).stop 2024-09-21T06:40:45.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.890+0000 7f7ff0952640 1 --2- 172.21.15.7:0/75340825 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f7fd80b6680 0x7f7fd80b8b90 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f7fe4004770 tx=0x7f7fe4000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:45.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.890+0000 7f7ff912a740 1 -- 172.21.15.7:0/560610008 shutdown_connections 2024-09-21T06:40:45.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.890+0000 7f7ff912a740 1 --2- 172.21.15.7:0/560610008 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aa28b43390 0x55aa28f0bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:45.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.890+0000 7f7ff912a740 1 --2- 172.21.15.7:0/560610008 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aa28b3b1b0 0x55aa28f0b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:45.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.890+0000 7f7ff912a740 1 --2- 172.21.15.7:0/560610008 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aa28b64070 0x55aa28f0b270 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:45.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.890+0000 7f7ff912a740 1 -- 172.21.15.7:0/560610008 >> 172.21.15.7:0/560610008 conn(0x55aa28b58460 msgr2=0x55aa28f09160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:45.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.890+0000 7f7ff912a740 1 -- 172.21.15.7:0/560610008 shutdown_connections 2024-09-21T06:40:45.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.890+0000 7f7ff912a740 1 -- 172.21.15.7:0/560610008 wait complete. 2024-09-21T06:40:45.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.891+0000 7f7ff912a740 1 -- start start 2024-09-21T06:40:45.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.891+0000 7f7ff912a740 1 Processor -- start 2024-09-21T06:40:45.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.891+0000 7f7ff912a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aa28b3b1b0 0x55aa28f169e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:45.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.891+0000 7f7ff912a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aa28b43390 0x55aa28f16f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:45.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.891+0000 7f7ff912a740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aa28b64070 0x55aa28f22d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:45.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.891+0000 7f7ff912a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55aa28cd2700 con 0x55aa28b3b1b0 2024-09-21T06:40:45.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.891+0000 7f7ff912a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55aa28e0c110 con 0x55aa28b43390 2024-09-21T06:40:45.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.891+0000 7f7ff912a740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55aa28f19a50 con 0x55aa28b64070 2024-09-21T06:40:45.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.891+0000 7f7ff912a740 10 client.0 _ll_register_callbacks cb 0x55aa28e25990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:40:45.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.891+0000 7f7ff0952640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aa28b3b1b0 0x55aa28f169e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:45.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.891+0000 7f7ff0952640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aa28b3b1b0 0x55aa28f169e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39348/0 (socket says 172.21.15.7:39348) 2024-09-21T06:40:45.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.891+0000 7f7ff0952640 1 -- 172.21.15.7:0/2072310630 learned_addr learned my addr 172.21.15.7:0/2072310630 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:40:45.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.892+0000 7f7febfff640 1 --2- 172.21.15.7:0/2072310630 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aa28b43390 0x55aa28f16f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:45.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.892+0000 7f7ff1153640 1 --2- 172.21.15.7:0/2072310630 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aa28b64070 0x55aa28f22d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:45.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.892+0000 7f7ff0952640 1 -- 172.21.15.7:0/2072310630 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aa28b64070 msgr2=0x55aa28f22d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:45.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.892+0000 7f7ff0952640 1 --2- 172.21.15.7:0/2072310630 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aa28b64070 0x55aa28f22d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:45.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.892+0000 7f7ff0952640 1 -- 172.21.15.7:0/2072310630 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aa28b43390 msgr2=0x55aa28f16f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:45.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.892+0000 7f7ff0952640 1 --2- 172.21.15.7:0/2072310630 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aa28b43390 0x55aa28f16f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:45.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.892+0000 7f7ff0952640 1 -- 172.21.15.7:0/2072310630 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa28e39c40 con 0x55aa28b3b1b0 2024-09-21T06:40:45.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.892+0000 7f7ff1153640 1 --2- 172.21.15.7:0/2072310630 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aa28b64070 0x55aa28f22d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:40:45.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.892+0000 7f7febfff640 1 --2- 172.21.15.7:0/2072310630 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aa28b43390 0x55aa28f16f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:40:45.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.892+0000 7f7ff0952640 1 --2- 172.21.15.7:0/2072310630 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aa28b3b1b0 0x55aa28f169e0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f7fe40096c0 tx=0x7f7fe402a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b822096224a6e80a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:45.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.892+0000 7f7fcbfff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:40:45.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.892+0000 7f7fcbfff640 1 -- 172.21.15.7:0/2072310630 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fe404d070 con 0x55aa28b3b1b0 2024-09-21T06:40:45.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.892+0000 7f7fcbfff640 1 -- 172.21.15.7:0/2072310630 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f7fe4004460 con 0x55aa28b3b1b0 2024-09-21T06:40:45.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.892+0000 7f7ff912a740 1 -- 172.21.15.7:0/2072310630 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7fdc003d10 con 0x55aa28b3b1b0 2024-09-21T06:40:45.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.893+0000 7f7fcbfff640 1 -- 172.21.15.7:0/2072310630 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7fe4059050 con 0x55aa28b3b1b0 2024-09-21T06:40:45.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.893+0000 7f7ff912a740 10 client.16353 fetch_fsmap learned FSMap version 25 2024-09-21T06:40:45.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.893+0000 7f7ff912a740 1 -- 172.21.15.7:0/2072310630 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55aa28f25730 con 0x55aa28b3b1b0 2024-09-21T06:40:45.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.893+0000 7f7fcbfff640 1 -- 172.21.15.7:0/2072310630 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7fdc003d10 con 0x55aa28b3b1b0 2024-09-21T06:40:45.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.893+0000 7f7fcbfff640 1 -- 172.21.15.7:0/2072310630 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f7fe4003b50 con 0x55aa28b3b1b0 2024-09-21T06:40:45.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.893+0000 7f7ff912a740 10 client.16353 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:40:45.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.893+0000 7f7ff912a740 10 client.16353 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:40:45.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.893+0000 7f7ff912a740 20 client.16353 populate_metadata read hostname 'smithi007' 2024-09-21T06:40:45.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.893+0000 7f7ff912a740 1 --2- 172.21.15.7:0/2072310630 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55aa28b229f0 0x55aa28f28c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:45.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.893+0000 7f7ff912a740 4 client.16353 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:40:45.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.893+0000 7f7ff912a740 1 -- 172.21.15.7:0/2072310630 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aa28e83da0 con 0x55aa28b229f0 2024-09-21T06:40:45.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.893+0000 7f7febfff640 1 --2- 172.21.15.7:0/2072310630 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55aa28b229f0 0x55aa28f28c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:45.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.894+0000 7f7febfff640 1 --2- 172.21.15.7:0/2072310630 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55aa28b229f0 0x55aa28f28c50 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8aab6ce24e47791c server_cookie=5a32b3ad049ada20 in_seq=0 out_seq=0 2024-09-21T06:40:45.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.894+0000 7f7fcbfff640 10 client.16353 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:40:45.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.895+0000 7f7fcbfff640 1 -- 172.21.15.7:0/2072310630 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55aa28e83da0 con 0x55aa28b229f0 2024-09-21T06:40:45.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.895+0000 7f7fcbfff640 10 client.16353 handle_command_reply: tid=0 2024-09-21T06:40:45.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.895+0000 7f7ff912a740 1 client.16353 shutdown 2024-09-21T06:40:45.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.895+0000 7f7ff912a740 1 -- 172.21.15.7:0/2072310630 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aa28b3b1b0 msgr2=0x55aa28f169e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:45.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.895+0000 7f7ff912a740 1 --2- 172.21.15.7:0/2072310630 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aa28b3b1b0 0x55aa28f169e0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f7fe40096c0 tx=0x7f7fe402a420 comp rx=0 tx=0).stop 2024-09-21T06:40:45.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.895+0000 7f7ff912a740 1 -- 172.21.15.7:0/2072310630 shutdown_connections 2024-09-21T06:40:45.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.895+0000 7f7ff912a740 1 --2- 172.21.15.7:0/2072310630 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55aa28b229f0 0x55aa28f28c50 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:45.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.895+0000 7f7ff912a740 1 --2- 172.21.15.7:0/2072310630 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aa28b64070 0x55aa28f22d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:45.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.895+0000 7f7ff912a740 1 --2- 172.21.15.7:0/2072310630 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aa28b43390 0x55aa28f16f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:45.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.895+0000 7f7fcbfff640 0 client.16353 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:40:45.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.895+0000 7f7ff912a740 1 --2- 172.21.15.7:0/2072310630 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aa28b3b1b0 0x55aa28f169e0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:45.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.895+0000 7f7ff912a740 1 -- 172.21.15.7:0/2072310630 >> 172.21.15.7:0/2072310630 conn(0x55aa28b58460 msgr2=0x55aa28f0e450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:45.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.895+0000 7f7ff912a740 1 -- 172.21.15.7:0/2072310630 shutdown_connections 2024-09-21T06:40:45.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.895+0000 7f7ff912a740 1 -- 172.21.15.7:0/2072310630 wait complete. 2024-09-21T06:40:45.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.895+0000 7f7ff912a740 20 client.16353 trim_cache size 0 max 16384 2024-09-21T06:40:45.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.913+0000 7f7ff912a740 1 Processor -- start 2024-09-21T06:40:45.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.913+0000 7f7ff912a740 1 -- start start 2024-09-21T06:40:45.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.913+0000 7f7ff912a740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aa28b58460 0x55aa28f0c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:45.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.913+0000 7f7ff912a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aa28b3b1b0 0x55aa28f22c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:45.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.913+0000 7f7ff912a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aa28b43390 0x55aa28f13bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:45.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.913+0000 7f7ff912a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7fec1b8440 con 0x55aa28b3b1b0 2024-09-21T06:40:45.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.913+0000 7f7ff912a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7fec1b5d10 con 0x55aa28b43390 2024-09-21T06:40:45.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.913+0000 7f7ff912a740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7fec1b3b40 con 0x55aa28b58460 2024-09-21T06:40:45.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.913+0000 7f7febfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aa28b3b1b0 0x55aa28f22c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:45.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.913+0000 7f7febfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aa28b3b1b0 0x55aa28f22c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39352/0 (socket says 172.21.15.7:39352) 2024-09-21T06:40:45.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.913+0000 7f7febfff640 1 -- 172.21.15.7:0/4252243185 learned_addr learned my addr 172.21.15.7:0/4252243185 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:40:45.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.913+0000 7f7ff0952640 1 --2- 172.21.15.7:0/4252243185 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aa28b58460 0x55aa28f0c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:45.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.914+0000 7f7ff1153640 1 --2- 172.21.15.7:0/4252243185 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aa28b43390 0x55aa28f13bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:45.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.914+0000 7f7febfff640 1 -- 172.21.15.7:0/4252243185 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aa28b58460 msgr2=0x55aa28f0c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:45.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.914+0000 7f7febfff640 1 --2- 172.21.15.7:0/4252243185 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aa28b58460 0x55aa28f0c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:45.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.914+0000 7f7febfff640 1 -- 172.21.15.7:0/4252243185 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aa28b43390 msgr2=0x55aa28f13bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:45.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.914+0000 7f7febfff640 1 --2- 172.21.15.7:0/4252243185 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aa28b43390 0x55aa28f13bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:45.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.914+0000 7f7febfff640 1 -- 172.21.15.7:0/4252243185 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aa28f18fc0 con 0x55aa28b3b1b0 2024-09-21T06:40:45.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.914+0000 7f7febfff640 1 --2- 172.21.15.7:0/4252243185 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aa28b3b1b0 0x55aa28f22c40 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f7fd40acfb0 tx=0x7f7fd40e9850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56666f29647fbdb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:45.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.914+0000 7f7fe27fc640 1 -- 172.21.15.7:0/4252243185 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fd40ad9b0 con 0x55aa28b3b1b0 2024-09-21T06:40:45.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.914+0000 7f7fe27fc640 1 -- 172.21.15.7:0/4252243185 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7fd4009de0 con 0x55aa28b3b1b0 2024-09-21T06:40:45.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.914+0000 7f7fe27fc640 1 -- 172.21.15.7:0/4252243185 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fd40a96b0 con 0x55aa28b3b1b0 2024-09-21T06:40:45.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.915+0000 7f7ff912a740 1 -- 172.21.15.7:0/4252243185 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aa28b3b1b0 msgr2=0x55aa28f22c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:45.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.915+0000 7f7ff912a740 1 --2- 172.21.15.7:0/4252243185 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aa28b3b1b0 0x55aa28f22c40 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f7fd40acfb0 tx=0x7f7fd40e9850 comp rx=0 tx=0).stop 2024-09-21T06:40:45.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.915+0000 7f7ff912a740 1 -- 172.21.15.7:0/4252243185 shutdown_connections 2024-09-21T06:40:45.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.915+0000 7f7ff912a740 1 --2- 172.21.15.7:0/4252243185 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aa28b43390 0x55aa28f13bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:45.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.915+0000 7f7ff912a740 1 --2- 172.21.15.7:0/4252243185 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aa28b3b1b0 0x55aa28f22c40 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:45.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.915+0000 7f7ff912a740 1 --2- 172.21.15.7:0/4252243185 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aa28b58460 0x55aa28f0c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:45.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.915+0000 7f7ff912a740 1 -- 172.21.15.7:0/4252243185 >> 172.21.15.7:0/4252243185 conn(0x55aa28f170a0 msgr2=0x55aa28f0c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:45.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.915+0000 7f7ff912a740 1 -- 172.21.15.7:0/4252243185 shutdown_connections 2024-09-21T06:40:45.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.915+0000 7f7ff912a740 1 -- 172.21.15.7:0/4252243185 wait complete. 2024-09-21T06:40:45.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.916+0000 7f7ff912a740 1 -- start start 2024-09-21T06:40:45.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.916+0000 7f7ff912a740 1 Processor -- start 2024-09-21T06:40:45.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.916+0000 7f7ff912a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aa28b3b1b0 0x55aa28f1ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:45.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.916+0000 7f7ff912a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aa28b43390 0x55aa28f1b360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:45.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.916+0000 7f7ff912a740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aa28b58460 0x55aa28f1b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:45.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.916+0000 7f7ff912a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f7fec1b41d0 con 0x55aa28b43390 2024-09-21T06:40:45.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.916+0000 7f7ff912a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7fec1b5640 con 0x55aa28b3b1b0 2024-09-21T06:40:45.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.916+0000 7f7ff912a740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f7fec1b48a0 con 0x55aa28b58460 2024-09-21T06:40:45.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.916+0000 7f7ff912a740 10 client.0 _ll_register_callbacks cb 0x7f7fe4031be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:40:45.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.916+0000 7f7febfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aa28b43390 0x55aa28f1b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:45.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.916+0000 7f7febfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aa28b43390 0x55aa28f1b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39362/0 (socket says 172.21.15.7:39362) 2024-09-21T06:40:45.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.916+0000 7f7febfff640 1 -- 172.21.15.7:0/3932338906 learned_addr learned my addr 172.21.15.7:0/3932338906 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:40:45.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.917+0000 7f7ff0952640 1 --2- 172.21.15.7:0/3932338906 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aa28b3b1b0 0x55aa28f1ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:45.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.917+0000 7f7ff1153640 1 --2- 172.21.15.7:0/3932338906 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aa28b58460 0x55aa28f1b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:45.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.917+0000 7f7febfff640 1 -- 172.21.15.7:0/3932338906 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aa28b58460 msgr2=0x55aa28f1b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:45.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.917+0000 7f7febfff640 1 --2- 172.21.15.7:0/3932338906 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aa28b58460 0x55aa28f1b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:45.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.917+0000 7f7febfff640 1 -- 172.21.15.7:0/3932338906 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aa28b3b1b0 msgr2=0x55aa28f1ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:45.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.917+0000 7f7febfff640 1 --2- 172.21.15.7:0/3932338906 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aa28b3b1b0 0x55aa28f1ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:45.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.917+0000 7f7febfff640 1 -- 172.21.15.7:0/3932338906 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aa28f927c0 con 0x55aa28b43390 2024-09-21T06:40:45.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.917+0000 7f7ff1153640 1 --2- 172.21.15.7:0/3932338906 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aa28b58460 0x55aa28f1b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:40:45.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.917+0000 7f7ff0952640 1 --2- 172.21.15.7:0/3932338906 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aa28b3b1b0 0x55aa28f1ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:40:45.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.917+0000 7f7febfff640 1 --2- 172.21.15.7:0/3932338906 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aa28b43390 0x55aa28f1b360 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f7fd4000c00 tx=0x7f7fd40a97d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd1bc1551df81682 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:45.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.917+0000 7f7fcbfff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:40:45.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.917+0000 7f7fcbfff640 1 -- 172.21.15.7:0/3932338906 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fd40e5040 con 0x55aa28b43390 2024-09-21T06:40:45.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.917+0000 7f7fcbfff640 1 -- 172.21.15.7:0/3932338906 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f7fd40a8c00 con 0x55aa28b43390 2024-09-21T06:40:45.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.917+0000 7f7ff912a740 1 -- 172.21.15.7:0/3932338906 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7fd4009de0 con 0x55aa28b43390 2024-09-21T06:40:45.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.918+0000 7f7fcbfff640 1 -- 172.21.15.7:0/3932338906 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7fd40ad9b0 con 0x55aa28b43390 2024-09-21T06:40:45.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.918+0000 7f7ff912a740 10 client.16359 fetch_fsmap learned FSMap version 25 2024-09-21T06:40:45.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.918+0000 7f7ff912a740 1 -- 172.21.15.7:0/3932338906 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55aa28f93a50 con 0x55aa28b43390 2024-09-21T06:40:45.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.918+0000 7f7fcbfff640 1 -- 172.21.15.7:0/3932338906 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7fd4009de0 con 0x55aa28b43390 2024-09-21T06:40:45.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.918+0000 7f7fcbfff640 1 -- 172.21.15.7:0/3932338906 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f7fd4058a40 con 0x55aa28b43390 2024-09-21T06:40:45.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.918+0000 7f7ff912a740 10 client.16359 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:40:45.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.918+0000 7f7ff912a740 10 client.16359 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:40:45.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.918+0000 7f7ff912a740 20 client.16359 populate_metadata read hostname 'smithi007' 2024-09-21T06:40:45.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.918+0000 7f7ff912a740 1 --2- 172.21.15.7:0/3932338906 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55aa28b64070 0x55aa28f961d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:45.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.918+0000 7f7ff912a740 4 client.16359 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:40:45.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.918+0000 7f7ff912a740 1 -- 172.21.15.7:0/3932338906 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55aa28e7f850 con 0x55aa28b64070 2024-09-21T06:40:45.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.918+0000 7f7ff0952640 1 --2- 172.21.15.7:0/3932338906 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55aa28b64070 0x55aa28f961d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:45.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.919+0000 7f7ff0952640 1 --2- 172.21.15.7:0/3932338906 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55aa28b64070 0x55aa28f961d0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3db6f9d0f8baec04 server_cookie=5bf458619ddd1740 in_seq=0 out_seq=0 2024-09-21T06:40:45.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.919+0000 7f7fcbfff640 10 client.16359 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:40:45.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.919+0000 7f7fcbfff640 1 -- 172.21.15.7:0/3932338906 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2078 (crc 0 0 0) 0x55aa28e7f850 con 0x55aa28b64070 2024-09-21T06:40:45.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.919+0000 7f7fcbfff640 10 client.16359 handle_command_reply: tid=0 2024-09-21T06:40:45.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.919+0000 7f7ff912a740 1 client.16359 shutdown 2024-09-21T06:40:45.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.919+0000 7f7ff912a740 1 -- 172.21.15.7:0/3932338906 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aa28b43390 msgr2=0x55aa28f1b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:45.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.919+0000 7f7ff912a740 1 --2- 172.21.15.7:0/3932338906 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aa28b43390 0x55aa28f1b360 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f7fd4000c00 tx=0x7f7fd40a97d0 comp rx=0 tx=0).stop 2024-09-21T06:40:45.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.919+0000 7f7ff912a740 1 -- 172.21.15.7:0/3932338906 shutdown_connections 2024-09-21T06:40:45.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.919+0000 7f7ff912a740 1 --2- 172.21.15.7:0/3932338906 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55aa28b64070 0x55aa28f961d0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:45.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.919+0000 7f7ff912a740 1 --2- 172.21.15.7:0/3932338906 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55aa28b58460 0x55aa28f1b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:45.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.919+0000 7f7ff912a740 1 --2- 172.21.15.7:0/3932338906 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55aa28b43390 0x55aa28f1b360 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:45.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.919+0000 7f7ff912a740 1 --2- 172.21.15.7:0/3932338906 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55aa28b3b1b0 0x55aa28f1ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:45.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.919+0000 7f7ff912a740 1 -- 172.21.15.7:0/3932338906 >> 172.21.15.7:0/3932338906 conn(0x55aa28f170a0 msgr2=0x55aa28f0eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:45.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.919+0000 7f7fcbfff640 0 client.16359 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:40:45.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.920+0000 7f7ff912a740 1 -- 172.21.15.7:0/3932338906 shutdown_connections 2024-09-21T06:40:45.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.920+0000 7f7ff912a740 1 -- 172.21.15.7:0/3932338906 wait complete. 2024-09-21T06:40:45.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.920+0000 7f7ff912a740 20 client.16359 trim_cache size 0 max 16384 2024-09-21T06:40:45.927 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:40:45.927 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "no active scrubs running", 2024-09-21T06:40:45.927 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": {}, 2024-09-21T06:40:45.927 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_stats": { 2024-09-21T06:40:45.927 INFO:teuthology.orchestra.run.smithi007.stdout: "62fca477-b241-45f5-8185-bc78aeb8b19f": { 2024-09-21T06:40:45.927 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:40:12.744488+0000", 2024-09-21T06:40:45.928 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:40:45.928 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:40:45.928 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:40:45.928 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:40:45.928 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:40:45.928 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:40:45.929 INFO:teuthology.orchestra.run.smithi007.stdout: "d7b6a90c-9ae1-4e02-93ad-335a7e9df1d7": { 2024-09-21T06:40:45.929 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:39:19.226139+0000", 2024-09-21T06:40:45.929 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:40:45.929 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:40:45.929 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:40:45.929 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:40:45.929 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:40:45.929 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:40:45.930 INFO:teuthology.orchestra.run.smithi007.stdout: "b0327167-8c41-4286-8afc-7f0780972fd7": { 2024-09-21T06:40:45.930 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:38:36.828657+0000", 2024-09-21T06:40:45.930 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:40:45.930 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:40:45.930 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:40:45.930 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:40:45.930 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:40:45.930 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:40:45.930 INFO:teuthology.orchestra.run.smithi007.stdout: "13441782-2231-4713-8ebd-068a941de47f": { 2024-09-21T06:40:45.931 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:39:30.219006+0000", 2024-09-21T06:40:45.931 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:40:45.931 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:40:45.931 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:40:45.931 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:40:45.931 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:40:45.931 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:40:45.931 INFO:teuthology.orchestra.run.smithi007.stdout: "5cbaaba2-6ab1-4f83-abd6-8c6eef4b5c42": { 2024-09-21T06:40:45.931 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:37:46.566272+0000", 2024-09-21T06:40:45.932 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:40:45.932 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:40:45.932 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:40:45.932 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:40:45.932 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:40:45.932 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:40:45.932 INFO:teuthology.orchestra.run.smithi007.stdout: "6231e9c1-14a2-40b5-be3c-76d87a0d733b": { 2024-09-21T06:40:45.932 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:37:02.484812+0000", 2024-09-21T06:40:45.932 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:40:45.932 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:40:45.933 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:40:45.933 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:40:45.933 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:40:45.933 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:40:45.933 INFO:teuthology.orchestra.run.smithi007.stdout: "0b89345c-1f00-4efe-8ee9-4cb17e43584c": { 2024-09-21T06:40:45.933 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:36:19.500334+0000", 2024-09-21T06:40:45.933 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:40:45.933 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:40:45.933 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:40:45.934 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:40:45.934 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:40:45.934 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:40:45.934 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:40:45.934 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:40:45.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.920+0000 7f7ff2bb6640 1 -- 172.21.15.7:0/75340825 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f7fd80b6680 msgr2=0x7f7fd80b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:45.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.920+0000 7f7ff2bb6640 1 --2- 172.21.15.7:0/75340825 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f7fd80b6680 0x7f7fd80b8b90 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f7fe4004770 tx=0x7f7fe4000bc0 comp rx=0 tx=0).stop 2024-09-21T06:40:45.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.920+0000 7f7ff2bb6640 1 -- 172.21.15.7:0/75340825 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7fec1030f0 msgr2=0x7f7fec1a10c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:45.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.920+0000 7f7ff2bb6640 1 --2- 172.21.15.7:0/75340825 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7fec1030f0 0x7f7fec1a10c0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f7fd400d950 tx=0x7f7fd400de10 comp rx=0 tx=0).stop 2024-09-21T06:40:45.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.921+0000 7f7ff2bb6640 1 -- 172.21.15.7:0/75340825 shutdown_connections 2024-09-21T06:40:45.935 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.921+0000 7f7ff2bb6640 1 --2- 172.21.15.7:0/75340825 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f7fd80b6680 0x7f7fd80b8b90 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:45.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.921+0000 7f7ff2bb6640 1 --2- 172.21.15.7:0/75340825 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fec107be0 0x7f7fec1a6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:45.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.921+0000 7f7ff2bb6640 1 --2- 172.21.15.7:0/75340825 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f7fec1030f0 0x7f7fec1a10c0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:45.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.921+0000 7f7ff2bb6640 1 --2- 172.21.15.7:0/75340825 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f7fec1027a0 0x7f7fec1a0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:45.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.921+0000 7f7ff2bb6640 1 -- 172.21.15.7:0/75340825 >> 172.21.15.7:0/75340825 conn(0x7f7fec079730 msgr2=0x7f7fec1055f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:45.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.921+0000 7f7ff2bb6640 1 -- 172.21.15.7:0/75340825 shutdown_connections 2024-09-21T06:40:45.936 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:45.921+0000 7f7ff2bb6640 1 -- 172.21.15.7:0/75340825 wait complete. 2024-09-21T06:40:46.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:40:46 smithi144 ceph-mon[34653]: pgmap v456: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:40:46.839 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:40:46 smithi007 ceph-mon[30983]: pgmap v456: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:40:46.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:40:46 smithi018 ceph-mon[34477]: pgmap v456: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:40:46.973 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:40:46.973 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:40:47.244 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:40:47.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:47.739+0000 7fa006a93640 1 -- 172.21.15.7:0/1173781093 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa000110190 msgr2=0x7fa0001125b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:47.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:47.739+0000 7fa006a93640 1 --2- 172.21.15.7:0/1173781093 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa000110190 0x7fa0001125b0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f9ff8009ca0 tx=0x7f9ff802a950 comp rx=0 tx=0).stop 2024-09-21T06:40:47.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:47.739+0000 7fa006a93640 1 -- 172.21.15.7:0/1173781093 shutdown_connections 2024-09-21T06:40:47.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:47.739+0000 7fa006a93640 1 --2- 172.21.15.7:0/1173781093 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa000110190 0x7fa0001125b0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:47.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:47.739+0000 7fa006a93640 1 --2- 172.21.15.7:0/1173781093 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa000102f30 0x7fa00010fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:47.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:47.739+0000 7fa006a93640 1 --2- 172.21.15.7:0/1173781093 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa0001025e0 0x7fa0001029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:47.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:47.739+0000 7fa006a93640 1 -- 172.21.15.7:0/1173781093 >> 172.21.15.7:0/1173781093 conn(0x7fa000079710 msgr2=0x7fa000079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:47.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:47.739+0000 7fa006a93640 1 -- 172.21.15.7:0/1173781093 shutdown_connections 2024-09-21T06:40:47.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:47.739+0000 7fa006a93640 1 -- 172.21.15.7:0/1173781093 wait complete. 2024-09-21T06:40:47.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:47.739+0000 7fa006a93640 1 Processor -- start 2024-09-21T06:40:47.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:47.739+0000 7fa006a93640 1 -- start start 2024-09-21T06:40:47.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:47.740+0000 7fa006a93640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa0001025e0 0x7fa00019c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:47.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:47.740+0000 7fa006a93640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa000102f30 0x7fa00019cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:47.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:47.740+0000 7fa006a93640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa000110190 0x7fa0001a1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:47.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:47.740+0000 7fa006a93640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa000115c80 con 0x7fa000110190 2024-09-21T06:40:47.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:47.740+0000 7fa006a93640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa000115b00 con 0x7fa0001025e0 2024-09-21T06:40:47.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:47.740+0000 7fa006a93640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa000115e00 con 0x7fa000102f30 2024-09-21T06:40:47.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:47.740+0000 7fa005030640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa000110190 0x7fa0001a1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:47.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:47.740+0000 7fa005030640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa000110190 0x7fa0001a1e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39382/0 (socket says 172.21.15.7:39382) 2024-09-21T06:40:47.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:47.740+0000 7fa005030640 1 -- 172.21.15.7:0/921423673 learned_addr learned my addr 172.21.15.7:0/921423673 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:40:47.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:47.740+0000 7fa00482f640 1 --2- 172.21.15.7:0/921423673 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa0001025e0 0x7fa00019c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:47.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:47.740+0000 7f9ff7fff640 1 --2- 172.21.15.7:0/921423673 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa000102f30 0x7fa00019cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:47.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:47.740+0000 7fa005030640 1 -- 172.21.15.7:0/921423673 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa000102f30 msgr2=0x7fa00019cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:47.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:47.740+0000 7fa005030640 1 --2- 172.21.15.7:0/921423673 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa000102f30 0x7fa00019cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:47.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:47.740+0000 7fa005030640 1 -- 172.21.15.7:0/921423673 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa0001025e0 msgr2=0x7fa00019c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:47.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:47.740+0000 7fa005030640 1 --2- 172.21.15.7:0/921423673 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa0001025e0 0x7fa00019c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:47.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:47.740+0000 7fa005030640 1 -- 172.21.15.7:0/921423673 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0001a24e0 con 0x7fa000110190 2024-09-21T06:40:47.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:47.740+0000 7fa005030640 1 --2- 172.21.15.7:0/921423673 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa000110190 0x7fa0001a1e70 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f9ff8004af0 tx=0x7f9ff802f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:47.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:47.741+0000 7f9ff5ffb640 1 -- 172.21.15.7:0/921423673 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff8034040 con 0x7fa000110190 2024-09-21T06:40:47.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:47.741+0000 7f9ff5ffb640 1 -- 172.21.15.7:0/921423673 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9ff802fe80 con 0x7fa000110190 2024-09-21T06:40:47.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:47.741+0000 7fa006a93640 1 -- 172.21.15.7:0/921423673 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0001a2770 con 0x7fa000110190 2024-09-21T06:40:47.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:47.741+0000 7f9ff5ffb640 1 -- 172.21.15.7:0/921423673 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ff80046a0 con 0x7fa000110190 2024-09-21T06:40:47.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:47.741+0000 7fa006a93640 1 -- 172.21.15.7:0/921423673 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0001a2c50 con 0x7fa000110190 2024-09-21T06:40:47.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:47.742+0000 7fa006a93640 1 -- 172.21.15.7:0/921423673 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa00006c280 con 0x7fa000110190 2024-09-21T06:40:47.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:47.744+0000 7f9ff5ffb640 1 -- 172.21.15.7:0/921423673 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f9ff8037020 con 0x7fa000110190 2024-09-21T06:40:47.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:47.744+0000 7f9ff5ffb640 1 --2- 172.21.15.7:0/921423673 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f9fe80b66b0 0x7f9fe80b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:47.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:47.745+0000 7f9ff5ffb640 1 -- 172.21.15.7:0/921423673 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f9ff81086b0 con 0x7fa000110190 2024-09-21T06:40:47.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:47.745+0000 7fa00482f640 1 --2- 172.21.15.7:0/921423673 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f9fe80b66b0 0x7f9fe80b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:47.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:47.745+0000 7fa00482f640 1 --2- 172.21.15.7:0/921423673 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f9fe80b66b0 0x7f9fe80b8bc0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc009b60 tx=0x7f9ffc005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:47.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:47.748+0000 7f9ff5ffb640 1 -- 172.21.15.7:0/921423673 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9ff8083710 con 0x7fa000110190 2024-09-21T06:40:47.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:47.976+0000 7fa006a93640 1 -- 172.21.15.7:0/921423673 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa0001029f0 con 0x7fa000110190 2024-09-21T06:40:47.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:47.976+0000 7f9ff5ffb640 1 -- 172.21.15.7:0/921423673 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11899 (secure 0 0 0) 0x7f9ff80ceca0 con 0x7fa000110190 2024-09-21T06:40:47.979 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:40:47.979 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-21T06:36:10:753693+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2015971546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2015971546},{"type":"v1","addr":"172.21.15.7:6835","nonce":2015971546}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/2350816224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":2350816224},{"type":"v1","addr":"172.21.15.7:6837","nonce":2350816224}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14823,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/1669980572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":1669980572},{"type":"v1","addr":"172.21.15.7:6839","nonce":1669980572}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14835,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/2528308973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":2528308973},{"type":"v1","addr":"172.21.15.7:6841","nonce":2528308973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24623,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1337382979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1337382979},{"type":"v1","addr":"172.21.15.18:6833","nonce":1337382979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/2751454345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":2751454345},{"type":"v1","addr":"172.21.15.144:6833","nonce":2751454345}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:34:24.627168+0000","modified":"2024-09-21T06:36:10.737288+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24716,"mds_1":24688,"mds_2":24686},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24656":{"gid":24656,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6835/158884796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":158884796},{"type":"v1","addr":"172.21.15.18:6835","nonce":158884796}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6835/3636739922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3636739922},{"type":"v1","addr":"172.21.15.144:6835","nonce":3636739922}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24673":{"gid":24673,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6837/1126341753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":1126341753},{"type":"v1","addr":"172.21.15.144:6837","nonce":1126341753}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.18:6837/1539670694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1539670694},{"type":"v1","addr":"172.21.15.18:6837","nonce":1539670694}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24688":{"gid":24688,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.144:6839/4027821922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":4027821922},{"type":"v1","addr":"172.21.15.144:6839","nonce":4027821922}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24716":{"gid":24716,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.18:6839/3798713532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":3798713532},{"type":"v1","addr":"172.21.15.18:6839","nonce":3798713532}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24716,"qdb_cluster":[24716,24688,24686]},"id":1}]} 2024-09-21T06:40:47.979 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-21T06:40:47.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:47.979+0000 7fa006a93640 1 -- 172.21.15.7:0/921423673 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f9fe80b66b0 msgr2=0x7f9fe80b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:47.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:47.979+0000 7fa006a93640 1 --2- 172.21.15.7:0/921423673 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f9fe80b66b0 0x7f9fe80b8bc0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc009b60 tx=0x7f9ffc005f90 comp rx=0 tx=0).stop 2024-09-21T06:40:47.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:47.979+0000 7fa006a93640 1 -- 172.21.15.7:0/921423673 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa000110190 msgr2=0x7fa0001a1e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:47.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:47.979+0000 7fa006a93640 1 --2- 172.21.15.7:0/921423673 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa000110190 0x7fa0001a1e70 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f9ff8004af0 tx=0x7f9ff802f5d0 comp rx=0 tx=0).stop 2024-09-21T06:40:47.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:47.979+0000 7fa006a93640 1 -- 172.21.15.7:0/921423673 shutdown_connections 2024-09-21T06:40:47.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:47.979+0000 7fa006a93640 1 --2- 172.21.15.7:0/921423673 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f9fe80b66b0 0x7f9fe80b8bc0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:47.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:47.979+0000 7fa006a93640 1 --2- 172.21.15.7:0/921423673 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa000110190 0x7fa0001a1e70 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:47.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:47.979+0000 7fa006a93640 1 --2- 172.21.15.7:0/921423673 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa000102f30 0x7fa00019cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:47.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:47.979+0000 7fa006a93640 1 --2- 172.21.15.7:0/921423673 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa0001025e0 0x7fa00019c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:47.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:47.979+0000 7fa006a93640 1 -- 172.21.15.7:0/921423673 >> 172.21.15.7:0/921423673 conn(0x7fa000079710 msgr2=0x7fa000109d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:47.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:47.979+0000 7fa006a93640 1 -- 172.21.15.7:0/921423673 shutdown_connections 2024-09-21T06:40:47.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:47.979+0000 7fa006a93640 1 -- 172.21.15.7:0/921423673 wait complete. 2024-09-21T06:40:48.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:40:48 smithi007 ceph-mon[30983]: pgmap v457: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:40:48.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:40:48 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/921423673' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:40:48.694 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:40:48.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:40:48 smithi144 ceph-mon[34653]: pgmap v457: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:40:48.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:40:48 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/921423673' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:40:48.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:40:48 smithi018 ceph-mon[34477]: pgmap v457: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:40:48.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:40:48 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/921423673' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:40:48.955 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:40:49.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.451+0000 7f3d83179640 1 -- 172.21.15.7:0/956124574 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d7c1083a0 msgr2=0x7f3d7c1087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:49.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.451+0000 7f3d83179640 1 --2- 172.21.15.7:0/956124574 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d7c1083a0 0x7f3d7c1087b0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f3d64009ca0 tx=0x7f3d6402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:40:49.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.451+0000 7f3d83179640 1 -- 172.21.15.7:0/956124574 shutdown_connections 2024-09-21T06:40:49.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.451+0000 7f3d83179640 1 --2- 172.21.15.7:0/956124574 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d7c108cf0 0x7f3d7c10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:49.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.451+0000 7f3d83179640 1 --2- 172.21.15.7:0/956124574 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d7c1083a0 0x7f3d7c1087b0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:49.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.451+0000 7f3d83179640 1 --2- 172.21.15.7:0/956124574 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d7c102a60 0x7f3d7c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:49.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.451+0000 7f3d83179640 1 -- 172.21.15.7:0/956124574 >> 172.21.15.7:0/956124574 conn(0x7f3d7c079730 msgr2=0x7f3d7c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:49.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.451+0000 7f3d83179640 1 -- 172.21.15.7:0/956124574 shutdown_connections 2024-09-21T06:40:49.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.451+0000 7f3d83179640 1 -- 172.21.15.7:0/956124574 wait complete. 2024-09-21T06:40:49.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.452+0000 7f3d83179640 1 Processor -- start 2024-09-21T06:40:49.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.452+0000 7f3d83179640 1 -- start start 2024-09-21T06:40:49.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.452+0000 7f3d83179640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d7c102a60 0x7f3d7c199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:49.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.452+0000 7f3d83179640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d7c1083a0 0x7f3d7c199930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:49.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.452+0000 7f3d83179640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d7c108cf0 0x7f3d7c19ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:49.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.452+0000 7f3d83179640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3d7c112960 con 0x7f3d7c108cf0 2024-09-21T06:40:49.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.452+0000 7f3d83179640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3d7c1127e0 con 0x7f3d7c102a60 2024-09-21T06:40:49.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.452+0000 7f3d83179640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3d7c112ae0 con 0x7f3d7c1083a0 2024-09-21T06:40:49.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.452+0000 7f3d81716640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d7c108cf0 0x7f3d7c19ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:49.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.452+0000 7f3d81716640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d7c108cf0 0x7f3d7c19ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39400/0 (socket says 172.21.15.7:39400) 2024-09-21T06:40:49.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.452+0000 7f3d81716640 1 -- 172.21.15.7:0/3139146633 learned_addr learned my addr 172.21.15.7:0/3139146633 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:40:49.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.452+0000 7f3d7bfff640 1 --2- 172.21.15.7:0/3139146633 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d7c1083a0 0x7f3d7c199930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:49.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.452+0000 7f3d80f15640 1 --2- 172.21.15.7:0/3139146633 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d7c102a60 0x7f3d7c199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:49.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.453+0000 7f3d81716640 1 -- 172.21.15.7:0/3139146633 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d7c1083a0 msgr2=0x7f3d7c199930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:49.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.453+0000 7f3d81716640 1 --2- 172.21.15.7:0/3139146633 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d7c1083a0 0x7f3d7c199930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:49.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.453+0000 7f3d81716640 1 -- 172.21.15.7:0/3139146633 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d7c102a60 msgr2=0x7f3d7c199390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:49.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.453+0000 7f3d81716640 1 --2- 172.21.15.7:0/3139146633 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d7c102a60 0x7f3d7c199390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:49.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.453+0000 7f3d81716640 1 -- 172.21.15.7:0/3139146633 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d7c19f240 con 0x7f3d7c108cf0 2024-09-21T06:40:49.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.453+0000 7f3d81716640 1 --2- 172.21.15.7:0/3139146633 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d7c108cf0 0x7f3d7c19ebd0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c00c970 tx=0x7f3d6c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:49.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.453+0000 7f3d79ffb640 1 -- 172.21.15.7:0/3139146633 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d6c007bb0 con 0x7f3d7c108cf0 2024-09-21T06:40:49.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.453+0000 7f3d83179640 1 -- 172.21.15.7:0/3139146633 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d7c19f530 con 0x7f3d7c108cf0 2024-09-21T06:40:49.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.453+0000 7f3d79ffb640 1 -- 172.21.15.7:0/3139146633 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3d6c007d50 con 0x7f3d7c108cf0 2024-09-21T06:40:49.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.453+0000 7f3d79ffb640 1 -- 172.21.15.7:0/3139146633 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d6c018770 con 0x7f3d7c108cf0 2024-09-21T06:40:49.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.453+0000 7f3d83179640 1 -- 172.21.15.7:0/3139146633 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d7c1a5d50 con 0x7f3d7c108cf0 2024-09-21T06:40:49.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.456+0000 7f3d896ed740 1 Processor -- start 2024-09-21T06:40:49.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.456+0000 7f3d79ffb640 1 -- 172.21.15.7:0/3139146633 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f3d6c00f990 con 0x7f3d7c108cf0 2024-09-21T06:40:49.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.456+0000 7f3d896ed740 1 -- start start 2024-09-21T06:40:49.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.456+0000 7f3d896ed740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561a753b6070 0x561a7575d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:49.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.457+0000 7f3d896ed740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561a7538d1b0 0x561a7575d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:49.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.457+0000 7f3d896ed740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a75395390 0x561a7575dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:49.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.457+0000 7f3d896ed740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x561a756d3ea0 con 0x561a753b6070 2024-09-21T06:40:49.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.457+0000 7f3d896ed740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x561a756c32d0 con 0x561a7538d1b0 2024-09-21T06:40:49.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.457+0000 7f3d896ed740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x561a756c70e0 con 0x561a75395390 2024-09-21T06:40:49.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.457+0000 7f3d7bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561a753b6070 0x561a7575d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:49.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.457+0000 7f3d7bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561a753b6070 0x561a7575d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39406/0 (socket says 172.21.15.7:39406) 2024-09-21T06:40:49.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.457+0000 7f3d7bfff640 1 -- 172.21.15.7:0/270700224 learned_addr learned my addr 172.21.15.7:0/270700224 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:40:49.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.457+0000 7f3d7bfff640 1 --2- 172.21.15.7:0/270700224 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a75395390 0x561a7575dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:49.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.457+0000 7f3d80f15640 1 --2- 172.21.15.7:0/270700224 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561a7538d1b0 0x561a7575d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:49.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.457+0000 7f3d7bfff640 1 -- 172.21.15.7:0/270700224 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a75395390 msgr2=0x561a7575dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:49.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.457+0000 7f3d7bfff640 1 --2- 172.21.15.7:0/270700224 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a75395390 0x561a7575dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:49.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.457+0000 7f3d7bfff640 1 -- 172.21.15.7:0/270700224 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561a7538d1b0 msgr2=0x561a7575d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:49.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.457+0000 7f3d7bfff640 1 --2- 172.21.15.7:0/270700224 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561a7538d1b0 0x561a7575d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:49.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.457+0000 7f3d7bfff640 1 -- 172.21.15.7:0/270700224 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a75421650 con 0x561a753b6070 2024-09-21T06:40:49.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.457+0000 7f3d79ffb640 1 --2- 172.21.15.7:0/3139146633 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f3d680b66b0 0x7f3d680b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:49.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.457+0000 7f3d80f15640 1 --2- 172.21.15.7:0/3139146633 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f3d680b66b0 0x7f3d680b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:49.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.457+0000 7f3d7bfff640 1 --2- 172.21.15.7:0/270700224 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561a753b6070 0x561a7575d2c0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c06aaa0 tx=0x7f3d6402f310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cdef6569083306c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:49.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.457+0000 7f3d79ffb640 1 -- 172.21.15.7:0/3139146633 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f3d6c0e76a0 con 0x7f3d7c108cf0 2024-09-21T06:40:49.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.458+0000 7f3d72ffd640 1 -- 172.21.15.7:0/270700224 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d64031450 con 0x561a753b6070 2024-09-21T06:40:49.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.458+0000 7f3d72ffd640 1 -- 172.21.15.7:0/270700224 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3d64036040 con 0x561a753b6070 2024-09-21T06:40:49.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.458+0000 7f3d72ffd640 1 -- 172.21.15.7:0/270700224 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d640043b0 con 0x561a753b6070 2024-09-21T06:40:49.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.459+0000 7f3d896ed740 1 -- 172.21.15.7:0/270700224 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561a753b6070 msgr2=0x561a7575d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:49.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.459+0000 7f3d80f15640 1 --2- 172.21.15.7:0/3139146633 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f3d680b66b0 0x7f3d680b8bc0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x561a7575bf40 tx=0x7f3d7400b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:49.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.459+0000 7f3d896ed740 1 --2- 172.21.15.7:0/270700224 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561a753b6070 0x561a7575d2c0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c06aaa0 tx=0x7f3d6402f310 comp rx=0 tx=0).stop 2024-09-21T06:40:49.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.459+0000 7f3d896ed740 1 -- 172.21.15.7:0/270700224 shutdown_connections 2024-09-21T06:40:49.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.459+0000 7f3d896ed740 1 --2- 172.21.15.7:0/270700224 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a75395390 0x561a7575dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:49.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.459+0000 7f3d896ed740 1 --2- 172.21.15.7:0/270700224 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561a7538d1b0 0x561a7575d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:49.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.459+0000 7f3d896ed740 1 --2- 172.21.15.7:0/270700224 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561a753b6070 0x561a7575d2c0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:49.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.459+0000 7f3d896ed740 1 -- 172.21.15.7:0/270700224 >> 172.21.15.7:0/270700224 conn(0x561a753aa460 msgr2=0x561a7575b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:49.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.459+0000 7f3d896ed740 1 -- 172.21.15.7:0/270700224 shutdown_connections 2024-09-21T06:40:49.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.459+0000 7f3d896ed740 1 -- 172.21.15.7:0/270700224 wait complete. 2024-09-21T06:40:49.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.459+0000 7f3d896ed740 1 -- start start 2024-09-21T06:40:49.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.459+0000 7f3d896ed740 1 Processor -- start 2024-09-21T06:40:49.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.460+0000 7f3d896ed740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561a7538d1b0 0x561a7576ac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:49.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.460+0000 7f3d896ed740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a75395390 0x561a7576b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:49.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.460+0000 7f3d896ed740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561a753b6070 0x561a75776d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:49.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.460+0000 7f3d896ed740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x561a75524700 con 0x561a753b6070 2024-09-21T06:40:49.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.460+0000 7f3d896ed740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x561a7565e160 con 0x561a7538d1b0 2024-09-21T06:40:49.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.460+0000 7f3d896ed740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x561a7576da20 con 0x561a75395390 2024-09-21T06:40:49.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.460+0000 7f3d896ed740 10 client.0 _ll_register_callbacks cb 0x561a756779e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:40:49.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.460+0000 7f3d81716640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561a753b6070 0x561a75776d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:49.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.460+0000 7f3d81716640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561a753b6070 0x561a75776d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39414/0 (socket says 172.21.15.7:39414) 2024-09-21T06:40:49.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.460+0000 7f3d81716640 1 -- 172.21.15.7:0/385823387 learned_addr learned my addr 172.21.15.7:0/385823387 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:40:49.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.460+0000 7f3d7bfff640 1 --2- 172.21.15.7:0/385823387 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a75395390 0x561a7576b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:49.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.460+0000 7f3d80f15640 1 --2- 172.21.15.7:0/385823387 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561a7538d1b0 0x561a7576ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:49.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.460+0000 7f3d81716640 1 -- 172.21.15.7:0/385823387 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a75395390 msgr2=0x561a7576b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:49.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.460+0000 7f3d81716640 1 --2- 172.21.15.7:0/385823387 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a75395390 0x561a7576b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:49.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.460+0000 7f3d81716640 1 -- 172.21.15.7:0/385823387 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561a7538d1b0 msgr2=0x561a7576ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:49.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.460+0000 7f3d81716640 1 --2- 172.21.15.7:0/385823387 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561a7538d1b0 0x561a7576ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:49.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.460+0000 7f3d81716640 1 -- 172.21.15.7:0/385823387 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a7568bc90 con 0x561a753b6070 2024-09-21T06:40:49.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.460+0000 7f3d7bfff640 1 --2- 172.21.15.7:0/385823387 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a75395390 0x561a7576b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:40:49.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.461+0000 7f3d81716640 1 --2- 172.21.15.7:0/385823387 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561a753b6070 0x561a75776d50 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c0a9b20 tx=0x7f3d6c0b6d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdc7985f7eaec08e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:49.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.461+0000 7f3d5bfff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:40:49.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.461+0000 7f3d5bfff640 1 -- 172.21.15.7:0/385823387 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d6c0accc0 con 0x561a753b6070 2024-09-21T06:40:49.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.461+0000 7f3d5bfff640 1 -- 172.21.15.7:0/385823387 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f3d6c00f450 con 0x561a753b6070 2024-09-21T06:40:49.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.461+0000 7f3d896ed740 1 -- 172.21.15.7:0/385823387 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3d64036040 con 0x561a753b6070 2024-09-21T06:40:49.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.461+0000 7f3d5bfff640 1 -- 172.21.15.7:0/385823387 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3d6c0ad060 con 0x561a753b6070 2024-09-21T06:40:49.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.461+0000 7f3d896ed740 10 client.16377 fetch_fsmap learned FSMap version 25 2024-09-21T06:40:49.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.461+0000 7f3d896ed740 1 -- 172.21.15.7:0/385823387 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561a757798f0 con 0x561a753b6070 2024-09-21T06:40:49.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.461+0000 7f3d5bfff640 1 -- 172.21.15.7:0/385823387 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3d64036040 con 0x561a753b6070 2024-09-21T06:40:49.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.461+0000 7f3d5bfff640 1 -- 172.21.15.7:0/385823387 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f3d6c0b31c0 con 0x561a753b6070 2024-09-21T06:40:49.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.461+0000 7f3d896ed740 10 client.16377 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:40:49.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.461+0000 7f3d896ed740 10 client.16377 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-21T06:40:49.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.461+0000 7f3d896ed740 20 client.16377 populate_metadata read hostname 'smithi007' 2024-09-21T06:40:49.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.461+0000 7f3d896ed740 1 --2- 172.21.15.7:0/385823387 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x561a753749f0 0x561a7577cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:49.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.461+0000 7f3d896ed740 4 client.16377 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:40:49.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.461+0000 7f3d896ed740 1 -- 172.21.15.7:0/385823387 --> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561a756d5df0 con 0x561a753749f0 2024-09-21T06:40:49.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.462+0000 7f3d80f15640 1 --2- 172.21.15.7:0/385823387 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x561a753749f0 0x561a7577cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:49.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.462+0000 7f3d5bfff640 10 client.16377 ms_handle_connect on v2:172.21.15.18:6836/1539670694 2024-09-21T06:40:49.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.462+0000 7f3d80f15640 1 --2- 172.21.15.7:0/385823387 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x561a753749f0 0x561a7577cfe0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c80bdac96465b86f server_cookie=7c9dbf353e736e09 in_seq=0 out_seq=0 2024-09-21T06:40:49.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.463+0000 7f3d5bfff640 1 -- 172.21.15.7:0/385823387 <== mds.2 v2:172.21.15.18:6836/1539670694 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x561a756d5df0 con 0x561a753749f0 2024-09-21T06:40:49.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.463+0000 7f3d5bfff640 10 client.16377 handle_command_reply: tid=0 2024-09-21T06:40:49.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.463+0000 7f3d896ed740 1 client.16377 shutdown 2024-09-21T06:40:49.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.463+0000 7f3d896ed740 1 -- 172.21.15.7:0/385823387 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561a753b6070 msgr2=0x561a75776d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:49.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.463+0000 7f3d896ed740 1 --2- 172.21.15.7:0/385823387 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561a753b6070 0x561a75776d50 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c0a9b20 tx=0x7f3d6c0b6d60 comp rx=0 tx=0).stop 2024-09-21T06:40:49.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.463+0000 7f3d896ed740 1 -- 172.21.15.7:0/385823387 shutdown_connections 2024-09-21T06:40:49.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.463+0000 7f3d896ed740 1 --2- 172.21.15.7:0/385823387 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x561a753749f0 0x561a7577cfe0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:49.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.463+0000 7f3d896ed740 1 --2- 172.21.15.7:0/385823387 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561a753b6070 0x561a75776d50 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:49.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.463+0000 7f3d896ed740 1 --2- 172.21.15.7:0/385823387 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a75395390 0x561a7576b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:49.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.463+0000 7f3d896ed740 1 --2- 172.21.15.7:0/385823387 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561a7538d1b0 0x561a7576ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:49.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.463+0000 7f3d896ed740 1 -- 172.21.15.7:0/385823387 >> 172.21.15.7:0/385823387 conn(0x561a753aa460 msgr2=0x561a7575ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:49.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.463+0000 7f3d5bfff640 0 client.16377 ms_handle_reset on v2:172.21.15.18:6836/1539670694 2024-09-21T06:40:49.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.464+0000 7f3d896ed740 1 -- 172.21.15.7:0/385823387 shutdown_connections 2024-09-21T06:40:49.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.464+0000 7f3d896ed740 1 -- 172.21.15.7:0/385823387 wait complete. 2024-09-21T06:40:49.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.464+0000 7f3d896ed740 20 client.16377 trim_cache size 0 max 16384 2024-09-21T06:40:49.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.477+0000 7f3d896ed740 1 Processor -- start 2024-09-21T06:40:49.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.477+0000 7f3d896ed740 1 -- start start 2024-09-21T06:40:49.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.477+0000 7f3d896ed740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561a7538d1b0 0x561a75776cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:49.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.477+0000 7f3d896ed740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561a75395390 0x561a7575ab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:49.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.477+0000 7f3d896ed740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a753b6070 0x561a7575b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:49.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.477+0000 7f3d896ed740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3d7c1af910 con 0x561a7538d1b0 2024-09-21T06:40:49.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.477+0000 7f3d896ed740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3d7c1ad1e0 con 0x561a75395390 2024-09-21T06:40:49.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.477+0000 7f3d896ed740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3d7c1ab090 con 0x561a753b6070 2024-09-21T06:40:49.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.477+0000 7f3d80f15640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561a7538d1b0 0x561a75776cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:49.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.477+0000 7f3d80f15640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561a7538d1b0 0x561a75776cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39422/0 (socket says 172.21.15.7:39422) 2024-09-21T06:40:49.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.477+0000 7f3d80f15640 1 -- 172.21.15.7:0/286266774 learned_addr learned my addr 172.21.15.7:0/286266774 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:40:49.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.478+0000 7f3d7bfff640 1 --2- 172.21.15.7:0/286266774 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561a75395390 0x561a7575ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:49.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.478+0000 7f3d81716640 1 --2- 172.21.15.7:0/286266774 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a753b6070 0x561a7575b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:49.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.478+0000 7f3d80f15640 1 -- 172.21.15.7:0/286266774 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a753b6070 msgr2=0x561a7575b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:49.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.478+0000 7f3d80f15640 1 --2- 172.21.15.7:0/286266774 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a753b6070 0x561a7575b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:49.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.478+0000 7f3d80f15640 1 -- 172.21.15.7:0/286266774 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561a75395390 msgr2=0x561a7575ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:49.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.478+0000 7f3d80f15640 1 --2- 172.21.15.7:0/286266774 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561a75395390 0x561a7575ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:49.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.478+0000 7f3d80f15640 1 -- 172.21.15.7:0/286266774 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a7576bae0 con 0x561a7538d1b0 2024-09-21T06:40:49.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.478+0000 7f3d81716640 1 --2- 172.21.15.7:0/286266774 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a753b6070 0x561a7575b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:40:49.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.478+0000 7f3d7bfff640 1 --2- 172.21.15.7:0/286266774 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561a75395390 0x561a7575ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:40:49.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.478+0000 7f3d80f15640 1 --2- 172.21.15.7:0/286266774 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561a7538d1b0 0x561a75776cc0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f3d740039c0 tx=0x7f3d74004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fac739a2704cf5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:49.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.478+0000 7f3d727fc640 1 -- 172.21.15.7:0/286266774 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d7401ea40 con 0x561a7538d1b0 2024-09-21T06:40:49.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.478+0000 7f3d727fc640 1 -- 172.21.15.7:0/286266774 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3d7401ebe0 con 0x561a7538d1b0 2024-09-21T06:40:49.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.478+0000 7f3d727fc640 1 -- 172.21.15.7:0/286266774 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d7401d670 con 0x561a7538d1b0 2024-09-21T06:40:49.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.479+0000 7f3d896ed740 1 -- 172.21.15.7:0/286266774 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561a7538d1b0 msgr2=0x561a75776cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:49.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.479+0000 7f3d896ed740 1 --2- 172.21.15.7:0/286266774 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561a7538d1b0 0x561a75776cc0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f3d740039c0 tx=0x7f3d74004610 comp rx=0 tx=0).stop 2024-09-21T06:40:49.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.479+0000 7f3d896ed740 1 -- 172.21.15.7:0/286266774 shutdown_connections 2024-09-21T06:40:49.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.479+0000 7f3d896ed740 1 --2- 172.21.15.7:0/286266774 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a753b6070 0x561a7575b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:49.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.479+0000 7f3d896ed740 1 --2- 172.21.15.7:0/286266774 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561a75395390 0x561a7575ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:49.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.479+0000 7f3d896ed740 1 --2- 172.21.15.7:0/286266774 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561a7538d1b0 0x561a75776cc0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:49.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.479+0000 7f3d896ed740 1 -- 172.21.15.7:0/286266774 >> 172.21.15.7:0/286266774 conn(0x561a753aa460 msgr2=0x561a75769500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:49.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.479+0000 7f3d896ed740 1 -- 172.21.15.7:0/286266774 shutdown_connections 2024-09-21T06:40:49.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.479+0000 7f3d896ed740 1 -- 172.21.15.7:0/286266774 wait complete. 2024-09-21T06:40:49.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.479+0000 7f3d896ed740 1 -- start start 2024-09-21T06:40:49.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.480+0000 7f3d896ed740 1 Processor -- start 2024-09-21T06:40:49.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.480+0000 7f3d896ed740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561a7538d1b0 0x561a757809e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:49.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.480+0000 7f3d896ed740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561a75395390 0x561a7577df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:49.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.480+0000 7f3d896ed740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a753b6070 0x561a7577e620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:49.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.480+0000 7f3d896ed740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3d7c1ab6e0 con 0x561a75395390 2024-09-21T06:40:49.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.480+0000 7f3d896ed740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3d7c1acb10 con 0x561a7538d1b0 2024-09-21T06:40:49.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.480+0000 7f3d896ed740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3d7c1abd70 con 0x561a753b6070 2024-09-21T06:40:49.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.480+0000 7f3d896ed740 10 client.0 _ll_register_callbacks cb 0x7f3d6c007f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:40:49.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.480+0000 7f3d7bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561a75395390 0x561a7577df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:49.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.480+0000 7f3d7bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561a75395390 0x561a7577df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39432/0 (socket says 172.21.15.7:39432) 2024-09-21T06:40:49.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.480+0000 7f3d7bfff640 1 -- 172.21.15.7:0/3105152996 learned_addr learned my addr 172.21.15.7:0/3105152996 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:40:49.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.480+0000 7f3d80f15640 1 --2- 172.21.15.7:0/3105152996 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561a7538d1b0 0x561a757809e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:49.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.480+0000 7f3d81716640 1 --2- 172.21.15.7:0/3105152996 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a753b6070 0x561a7577e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:49.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.480+0000 7f3d7bfff640 1 -- 172.21.15.7:0/3105152996 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a753b6070 msgr2=0x561a7577e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:49.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.480+0000 7f3d7bfff640 1 --2- 172.21.15.7:0/3105152996 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a753b6070 0x561a7577e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:49.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.480+0000 7f3d7bfff640 1 -- 172.21.15.7:0/3105152996 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561a7538d1b0 msgr2=0x561a757809e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:49.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.480+0000 7f3d7bfff640 1 --2- 172.21.15.7:0/3105152996 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561a7538d1b0 0x561a757809e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:49.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.481+0000 7f3d7bfff640 1 -- 172.21.15.7:0/3105152996 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a757e6760 con 0x561a75395390 2024-09-21T06:40:49.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.481+0000 7f3d81716640 1 --2- 172.21.15.7:0/3105152996 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a753b6070 0x561a7577e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:40:49.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.481+0000 7f3d80f15640 1 --2- 172.21.15.7:0/3105152996 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561a7538d1b0 0x561a757809e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:40:49.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.481+0000 7f3d7bfff640 1 --2- 172.21.15.7:0/3105152996 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561a75395390 0x561a7577df10 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f3d64009ca0 tx=0x7f3d64031680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a56d49ddbe666967 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:49.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.481+0000 7f3d5bfff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:40:49.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.481+0000 7f3d5bfff640 1 -- 172.21.15.7:0/3105152996 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d6402f860 con 0x561a75395390 2024-09-21T06:40:49.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.481+0000 7f3d5bfff640 1 -- 172.21.15.7:0/3105152996 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f3d6402fa00 con 0x561a75395390 2024-09-21T06:40:49.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.481+0000 7f3d896ed740 1 -- 172.21.15.7:0/3105152996 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3d7401ebe0 con 0x561a75395390 2024-09-21T06:40:49.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.481+0000 7f3d5bfff640 1 -- 172.21.15.7:0/3105152996 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3d64009540 con 0x561a75395390 2024-09-21T06:40:49.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.481+0000 7f3d896ed740 10 client.16383 fetch_fsmap learned FSMap version 25 2024-09-21T06:40:49.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.481+0000 7f3d896ed740 1 -- 172.21.15.7:0/3105152996 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x561a757e78c0 con 0x561a75395390 2024-09-21T06:40:49.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.481+0000 7f3d5bfff640 1 -- 172.21.15.7:0/3105152996 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3d7401ebe0 con 0x561a75395390 2024-09-21T06:40:49.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.482+0000 7f3d5bfff640 1 -- 172.21.15.7:0/3105152996 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f3d64004260 con 0x561a75395390 2024-09-21T06:40:49.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.482+0000 7f3d896ed740 10 client.16383 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:40:49.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.482+0000 7f3d896ed740 10 client.16383 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-21T06:40:49.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.482+0000 7f3d896ed740 20 client.16383 populate_metadata read hostname 'smithi007' 2024-09-21T06:40:49.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.482+0000 7f3d896ed740 1 --2- 172.21.15.7:0/3105152996 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x561a75349da0 0x561a757e9d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:49.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.482+0000 7f3d896ed740 4 client.16383 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:40:49.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.482+0000 7f3d896ed740 1 -- 172.21.15.7:0/3105152996 --> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561a756d18a0 con 0x561a75349da0 2024-09-21T06:40:49.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.482+0000 7f3d80f15640 1 --2- 172.21.15.7:0/3105152996 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x561a75349da0 0x561a757e9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:49.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.483+0000 7f3d80f15640 1 --2- 172.21.15.7:0/3105152996 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x561a75349da0 0x561a757e9d60 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=741f7aabace0f76e server_cookie=c7e8570b2db727b9 in_seq=0 out_seq=0 2024-09-21T06:40:49.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.483+0000 7f3d5bfff640 10 client.16383 ms_handle_connect on v2:172.21.15.18:6836/1539670694 2024-09-21T06:40:49.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.483+0000 7f3d5bfff640 1 -- 172.21.15.7:0/3105152996 <== mds.2 v2:172.21.15.18:6836/1539670694 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561a756d18a0 con 0x561a75349da0 2024-09-21T06:40:49.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.483+0000 7f3d5bfff640 10 client.16383 handle_command_reply: tid=0 2024-09-21T06:40:49.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.483+0000 7f3d896ed740 1 client.16383 shutdown 2024-09-21T06:40:49.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.483+0000 7f3d896ed740 1 -- 172.21.15.7:0/3105152996 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561a75395390 msgr2=0x561a7577df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:49.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.483+0000 7f3d896ed740 1 --2- 172.21.15.7:0/3105152996 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561a75395390 0x561a7577df10 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f3d64009ca0 tx=0x7f3d64031680 comp rx=0 tx=0).stop 2024-09-21T06:40:49.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.483+0000 7f3d896ed740 1 -- 172.21.15.7:0/3105152996 shutdown_connections 2024-09-21T06:40:49.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.483+0000 7f3d896ed740 1 --2- 172.21.15.7:0/3105152996 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x561a75349da0 0x561a757e9d60 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:49.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.483+0000 7f3d5bfff640 0 client.16383 ms_handle_reset on v2:172.21.15.18:6836/1539670694 2024-09-21T06:40:49.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.483+0000 7f3d896ed740 1 --2- 172.21.15.7:0/3105152996 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x561a753b6070 0x561a7577e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:49.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.483+0000 7f3d896ed740 1 --2- 172.21.15.7:0/3105152996 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x561a75395390 0x561a7577df10 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:49.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.483+0000 7f3d896ed740 1 --2- 172.21.15.7:0/3105152996 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x561a7538d1b0 0x561a757809e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:49.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.483+0000 7f3d896ed740 1 -- 172.21.15.7:0/3105152996 >> 172.21.15.7:0/3105152996 conn(0x561a753aa460 msgr2=0x561a7575a970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:49.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.483+0000 7f3d896ed740 1 -- 172.21.15.7:0/3105152996 shutdown_connections 2024-09-21T06:40:49.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.483+0000 7f3d896ed740 1 -- 172.21.15.7:0/3105152996 wait complete. 2024-09-21T06:40:49.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.483+0000 7f3d896ed740 20 client.16383 trim_cache size 0 max 16384 2024-09-21T06:40:49.491 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:40:49.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.484+0000 7f3d83179640 1 -- 172.21.15.7:0/3139146633 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f3d680b66b0 msgr2=0x7f3d680b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:49.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.484+0000 7f3d83179640 1 --2- 172.21.15.7:0/3139146633 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f3d680b66b0 0x7f3d680b8bc0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x561a7575bf40 tx=0x7f3d7400b390 comp rx=0 tx=0).stop 2024-09-21T06:40:49.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.484+0000 7f3d83179640 1 -- 172.21.15.7:0/3139146633 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d7c108cf0 msgr2=0x7f3d7c19ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:49.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.484+0000 7f3d83179640 1 --2- 172.21.15.7:0/3139146633 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d7c108cf0 0x7f3d7c19ebd0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c00c970 tx=0x7f3d6c00ce30 comp rx=0 tx=0).stop 2024-09-21T06:40:49.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.484+0000 7f3d83179640 1 -- 172.21.15.7:0/3139146633 shutdown_connections 2024-09-21T06:40:49.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.484+0000 7f3d83179640 1 --2- 172.21.15.7:0/3139146633 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f3d680b66b0 0x7f3d680b8bc0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:49.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.484+0000 7f3d83179640 1 --2- 172.21.15.7:0/3139146633 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3d7c108cf0 0x7f3d7c19ebd0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:49.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.484+0000 7f3d83179640 1 --2- 172.21.15.7:0/3139146633 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3d7c1083a0 0x7f3d7c199930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:49.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.484+0000 7f3d83179640 1 --2- 172.21.15.7:0/3139146633 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d7c102a60 0x7f3d7c199390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:49.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.484+0000 7f3d83179640 1 -- 172.21.15.7:0/3139146633 >> 172.21.15.7:0/3139146633 conn(0x7f3d7c079730 msgr2=0x7f3d7c104460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:49.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.484+0000 7f3d83179640 1 -- 172.21.15.7:0/3139146633 shutdown_connections 2024-09-21T06:40:49.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:49.484+0000 7f3d83179640 1 -- 172.21.15.7:0/3139146633 wait complete. 2024-09-21T06:40:50.361 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:40:50.620 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:40:50.741 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:40:50 smithi007 ceph-mon[30983]: pgmap v458: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:40:50.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:40:50 smithi144 ceph-mon[34653]: pgmap v458: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:40:50.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:40:50 smithi018 ceph-mon[34477]: pgmap v458: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:40:51.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.096+0000 7fb963670640 1 -- 172.21.15.7:0/3449977079 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb95c103ba0 msgr2=0x7fb95c103fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:51.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.096+0000 7fb963670640 1 --2- 172.21.15.7:0/3449977079 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb95c103ba0 0x7fb95c103fb0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fb958009900 tx=0x7fb95802a410 comp rx=0 tx=0).stop 2024-09-21T06:40:51.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.096+0000 7fb963670640 1 -- 172.21.15.7:0/3449977079 shutdown_connections 2024-09-21T06:40:51.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.096+0000 7fb963670640 1 --2- 172.21.15.7:0/3449977079 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb95c109e30 0x7fb95c110660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:51.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.096+0000 7fb963670640 1 --2- 172.21.15.7:0/3449977079 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb95c1094e0 0x7fb95c1098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:51.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.096+0000 7fb963670640 1 --2- 172.21.15.7:0/3449977079 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb95c103ba0 0x7fb95c103fb0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:51.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.096+0000 7fb963670640 1 -- 172.21.15.7:0/3449977079 >> 172.21.15.7:0/3449977079 conn(0x7fb95c0ff610 msgr2=0x7fb95c101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:51.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.096+0000 7fb963670640 1 -- 172.21.15.7:0/3449977079 shutdown_connections 2024-09-21T06:40:51.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.096+0000 7fb963670640 1 -- 172.21.15.7:0/3449977079 wait complete. 2024-09-21T06:40:51.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.096+0000 7fb963670640 1 Processor -- start 2024-09-21T06:40:51.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.096+0000 7fb963670640 1 -- start start 2024-09-21T06:40:51.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.097+0000 7fb963670640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb95c103ba0 0x7fb95c19a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:51.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.097+0000 7fb963670640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb95c1094e0 0x7fb95c19aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:51.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.097+0000 7fb963670640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb95c109e30 0x7fb95c19fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:51.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.097+0000 7fb963670640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb95c113af0 con 0x7fb95c1094e0 2024-09-21T06:40:51.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.097+0000 7fb963670640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb95c113970 con 0x7fb95c109e30 2024-09-21T06:40:51.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.097+0000 7fb963670640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb95c113c70 con 0x7fb95c103ba0 2024-09-21T06:40:51.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.097+0000 7fb960c0b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb95c1094e0 0x7fb95c19aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:51.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.097+0000 7fb960c0b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb95c1094e0 0x7fb95c19aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41852/0 (socket says 172.21.15.7:41852) 2024-09-21T06:40:51.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.097+0000 7fb960c0b640 1 -- 172.21.15.7:0/3789879351 learned_addr learned my addr 172.21.15.7:0/3789879351 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:40:51.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.097+0000 7fb961c0d640 1 --2- 172.21.15.7:0/3789879351 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb95c109e30 0x7fb95c19fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:51.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.097+0000 7fb96140c640 1 --2- 172.21.15.7:0/3789879351 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb95c103ba0 0x7fb95c19a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:51.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.097+0000 7fb960c0b640 1 -- 172.21.15.7:0/3789879351 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb95c103ba0 msgr2=0x7fb95c19a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:51.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.097+0000 7fb960c0b640 1 --2- 172.21.15.7:0/3789879351 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb95c103ba0 0x7fb95c19a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:51.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.097+0000 7fb960c0b640 1 -- 172.21.15.7:0/3789879351 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb95c109e30 msgr2=0x7fb95c19fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:51.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.097+0000 7fb960c0b640 1 --2- 172.21.15.7:0/3789879351 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb95c109e30 0x7fb95c19fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:51.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.097+0000 7fb960c0b640 1 -- 172.21.15.7:0/3789879351 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb95c1a0390 con 0x7fb95c1094e0 2024-09-21T06:40:51.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.097+0000 7fb96140c640 1 --2- 172.21.15.7:0/3789879351 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb95c103ba0 0x7fb95c19a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:40:51.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.097+0000 7fb960c0b640 1 --2- 172.21.15.7:0/3789879351 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb95c1094e0 0x7fb95c19aa80 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fb94c00d950 tx=0x7fb94c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:51.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.098+0000 7fb9527fc640 1 -- 172.21.15.7:0/3789879351 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb94c017070 con 0x7fb95c1094e0 2024-09-21T06:40:51.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.098+0000 7fb9527fc640 1 -- 172.21.15.7:0/3789879351 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb94c009c30 con 0x7fb95c1094e0 2024-09-21T06:40:51.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.098+0000 7fb963670640 1 -- 172.21.15.7:0/3789879351 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb95c1a0680 con 0x7fb95c1094e0 2024-09-21T06:40:51.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.098+0000 7fb9527fc640 1 -- 172.21.15.7:0/3789879351 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb94c0047a0 con 0x7fb95c1094e0 2024-09-21T06:40:51.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.098+0000 7fb963670640 1 -- 172.21.15.7:0/3789879351 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb95c1a6ea0 con 0x7fb95c1094e0 2024-09-21T06:40:51.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.100+0000 7fb969be4740 1 Processor -- start 2024-09-21T06:40:51.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.101+0000 7fb969be4740 1 -- start start 2024-09-21T06:40:51.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.101+0000 7fb9527fc640 1 -- 172.21.15.7:0/3789879351 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7fb94c004020 con 0x7fb95c1094e0 2024-09-21T06:40:51.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.101+0000 7fb969be4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fbbf66b070 0x55fbbfa122c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:51.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.101+0000 7fb969be4740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fbbf6421b0 0x55fbbfa12800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:51.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.101+0000 7fb969be4740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fbbf64a390 0x55fbbfa12d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:51.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.101+0000 7fb969be4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55fbbf988ea0 con 0x55fbbf66b070 2024-09-21T06:40:51.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.101+0000 7fb969be4740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55fbbf9782d0 con 0x55fbbf64a390 2024-09-21T06:40:51.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.101+0000 7fb969be4740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55fbbf97c0e0 con 0x55fbbf6421b0 2024-09-21T06:40:51.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.101+0000 7fb961c0d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fbbf66b070 0x55fbbfa122c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:51.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.101+0000 7fb961c0d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fbbf66b070 0x55fbbfa122c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41860/0 (socket says 172.21.15.7:41860) 2024-09-21T06:40:51.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.101+0000 7fb961c0d640 1 -- 172.21.15.7:0/4063167608 learned_addr learned my addr 172.21.15.7:0/4063167608 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:40:51.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.101+0000 7fb960c0b640 1 --2- 172.21.15.7:0/4063167608 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fbbf64a390 0x55fbbfa12d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:51.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.101+0000 7fb96140c640 1 --2- 172.21.15.7:0/4063167608 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fbbf6421b0 0x55fbbfa12800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:51.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.101+0000 7fb961c0d640 1 -- 172.21.15.7:0/4063167608 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fbbf6421b0 msgr2=0x55fbbfa12800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:51.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.101+0000 7fb961c0d640 1 --2- 172.21.15.7:0/4063167608 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fbbf6421b0 0x55fbbfa12800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:51.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.101+0000 7fb961c0d640 1 -- 172.21.15.7:0/4063167608 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fbbf64a390 msgr2=0x55fbbfa12d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:51.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.101+0000 7fb961c0d640 1 --2- 172.21.15.7:0/4063167608 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fbbf64a390 0x55fbbfa12d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:51.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.101+0000 7fb961c0d640 1 -- 172.21.15.7:0/4063167608 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbbf6d6650 con 0x55fbbf66b070 2024-09-21T06:40:51.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.101+0000 7fb96140c640 1 --2- 172.21.15.7:0/4063167608 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fbbf6421b0 0x55fbbfa12800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:40:51.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.102+0000 7fb9527fc640 1 --2- 172.21.15.7:0/3789879351 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fb9480b66b0 0x7fb9480b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:51.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.102+0000 7fb961c0d640 1 --2- 172.21.15.7:0/4063167608 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fbbf66b070 0x55fbbfa122c0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fb954007ec0 tx=0x7fb95400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf54887b9049b94b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:51.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.102+0000 7fb96140c640 1 --2- 172.21.15.7:0/3789879351 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fb9480b66b0 0x7fb9480b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:51.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.102+0000 7fb9527fc640 1 -- 172.21.15.7:0/3789879351 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fb94c0e7340 con 0x7fb95c1094e0 2024-09-21T06:40:51.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.102+0000 7fb9477fe640 1 -- 172.21.15.7:0/4063167608 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb954010840 con 0x55fbbf66b070 2024-09-21T06:40:51.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.102+0000 7fb9477fe640 1 -- 172.21.15.7:0/4063167608 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb9540183f0 con 0x55fbbf66b070 2024-09-21T06:40:51.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.102+0000 7fb9477fe640 1 -- 172.21.15.7:0/4063167608 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb954017600 con 0x55fbbf66b070 2024-09-21T06:40:51.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.103+0000 7fb969be4740 1 -- 172.21.15.7:0/4063167608 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fbbf66b070 msgr2=0x55fbbfa122c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:51.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.103+0000 7fb96140c640 1 --2- 172.21.15.7:0/3789879351 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fb9480b66b0 0x7fb9480b8bc0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb958031440 tx=0x7fb958009640 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:51.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.103+0000 7fb969be4740 1 --2- 172.21.15.7:0/4063167608 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fbbf66b070 0x55fbbfa122c0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fb954007ec0 tx=0x7fb95400f790 comp rx=0 tx=0).stop 2024-09-21T06:40:51.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.103+0000 7fb969be4740 1 -- 172.21.15.7:0/4063167608 shutdown_connections 2024-09-21T06:40:51.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.103+0000 7fb969be4740 1 --2- 172.21.15.7:0/4063167608 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fbbf64a390 0x55fbbfa12d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:51.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.103+0000 7fb969be4740 1 --2- 172.21.15.7:0/4063167608 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fbbf6421b0 0x55fbbfa12800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:51.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.103+0000 7fb969be4740 1 --2- 172.21.15.7:0/4063167608 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fbbf66b070 0x55fbbfa122c0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:51.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.103+0000 7fb969be4740 1 -- 172.21.15.7:0/4063167608 >> 172.21.15.7:0/4063167608 conn(0x55fbbf65f460 msgr2=0x55fbbfa101b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:51.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.103+0000 7fb969be4740 1 -- 172.21.15.7:0/4063167608 shutdown_connections 2024-09-21T06:40:51.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.103+0000 7fb969be4740 1 -- 172.21.15.7:0/4063167608 wait complete. 2024-09-21T06:40:51.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.103+0000 7fb969be4740 1 -- start start 2024-09-21T06:40:51.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.103+0000 7fb969be4740 1 Processor -- start 2024-09-21T06:40:51.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.104+0000 7fb969be4740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fbbf6421b0 0x55fbbfa1d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:51.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.104+0000 7fb969be4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fbbf64a390 0x55fbbfa1de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:51.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.104+0000 7fb969be4740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fbbf66b070 0x55fbbfa1e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:51.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.104+0000 7fb969be4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55fbbf7d9700 con 0x55fbbf64a390 2024-09-21T06:40:51.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.104+0000 7fb969be4740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55fbbf913160 con 0x55fbbf66b070 2024-09-21T06:40:51.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.104+0000 7fb969be4740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55fbbfa20aa0 con 0x55fbbf6421b0 2024-09-21T06:40:51.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.104+0000 7fb969be4740 10 client.0 _ll_register_callbacks cb 0x55fbbf92c9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:40:51.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.104+0000 7fb960c0b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fbbf64a390 0x55fbbfa1de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:51.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.104+0000 7fb960c0b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fbbf64a390 0x55fbbfa1de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41870/0 (socket says 172.21.15.7:41870) 2024-09-21T06:40:51.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.104+0000 7fb960c0b640 1 -- 172.21.15.7:0/1991578626 learned_addr learned my addr 172.21.15.7:0/1991578626 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:40:51.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.104+0000 7fb961c0d640 1 --2- 172.21.15.7:0/1991578626 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fbbf66b070 0x55fbbfa1e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:51.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.104+0000 7fb960c0b640 1 -- 172.21.15.7:0/1991578626 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fbbf6421b0 msgr2=0x55fbbfa1d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:51.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.104+0000 7fb960c0b640 1 --2- 172.21.15.7:0/1991578626 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fbbf6421b0 0x55fbbfa1d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:51.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.104+0000 7fb960c0b640 1 -- 172.21.15.7:0/1991578626 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fbbf66b070 msgr2=0x55fbbfa1e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:51.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.104+0000 7fb960c0b640 1 --2- 172.21.15.7:0/1991578626 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fbbf66b070 0x55fbbfa1e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:51.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.104+0000 7fb960c0b640 1 -- 172.21.15.7:0/1991578626 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fbbf940c90 con 0x55fbbf64a390 2024-09-21T06:40:51.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.105+0000 7fb960c0b640 1 --2- 172.21.15.7:0/1991578626 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fbbf64a390 0x55fbbfa1de30 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fb94c009610 tx=0x7fb94c005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=debd45e63d7e9d18 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:51.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.105+0000 7fb944ff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:40:51.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.105+0000 7fb944ff9640 1 -- 172.21.15.7:0/1991578626 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb94c0a9880 con 0x55fbbf64a390 2024-09-21T06:40:51.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.105+0000 7fb944ff9640 1 -- 172.21.15.7:0/1991578626 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fb94c0a8b80 con 0x55fbbf64a390 2024-09-21T06:40:51.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.105+0000 7fb969be4740 1 -- 172.21.15.7:0/1991578626 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb9540183f0 con 0x55fbbf64a390 2024-09-21T06:40:51.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.105+0000 7fb944ff9640 1 -- 172.21.15.7:0/1991578626 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb94c0e4fc0 con 0x55fbbf64a390 2024-09-21T06:40:51.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.105+0000 7fb969be4740 10 client.16395 fetch_fsmap learned FSMap version 25 2024-09-21T06:40:51.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.105+0000 7fb969be4740 1 -- 172.21.15.7:0/1991578626 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55fbbfa2c740 con 0x55fbbf64a390 2024-09-21T06:40:51.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.105+0000 7fb944ff9640 1 -- 172.21.15.7:0/1991578626 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb9540183f0 con 0x55fbbf64a390 2024-09-21T06:40:51.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.105+0000 7fb944ff9640 1 -- 172.21.15.7:0/1991578626 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb94c0a8d80 con 0x55fbbf64a390 2024-09-21T06:40:51.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.105+0000 7fb969be4740 10 client.16395 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:40:51.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.105+0000 7fb969be4740 10 client.16395 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:40:51.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.105+0000 7fb969be4740 20 client.16395 populate_metadata read hostname 'smithi007' 2024-09-21T06:40:51.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.105+0000 7fb969be4740 1 --2- 172.21.15.7:0/1991578626 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x55fbbf6299f0 0x55fbbfa2fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:51.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.105+0000 7fb969be4740 4 client.16395 mds_command: new command op to 24688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:40:51.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.105+0000 7fb969be4740 1 -- 172.21.15.7:0/1991578626 --> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fbbf98adf0 con 0x55fbbf6299f0 2024-09-21T06:40:51.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.106+0000 7fb96140c640 1 --2- 172.21.15.7:0/1991578626 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x55fbbf6299f0 0x55fbbfa2fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:51.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.106+0000 7fb944ff9640 10 client.16395 ms_handle_connect on v2:172.21.15.144:6838/4027821922 2024-09-21T06:40:51.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.106+0000 7fb96140c640 1 --2- 172.21.15.7:0/1991578626 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x55fbbf6299f0 0x55fbbfa2fbf0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1f2463999f7cfa1d server_cookie=beab794edca74e9b in_seq=0 out_seq=0 2024-09-21T06:40:51.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.107+0000 7fb944ff9640 1 -- 172.21.15.7:0/1991578626 <== mds.1 v2:172.21.15.144:6838/4027821922 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fbbf98adf0 con 0x55fbbf6299f0 2024-09-21T06:40:51.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.107+0000 7fb944ff9640 10 client.16395 handle_command_reply: tid=0 2024-09-21T06:40:51.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.107+0000 7fb969be4740 1 client.16395 shutdown 2024-09-21T06:40:51.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.107+0000 7fb969be4740 1 -- 172.21.15.7:0/1991578626 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fbbf64a390 msgr2=0x55fbbfa1de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:51.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.107+0000 7fb969be4740 1 --2- 172.21.15.7:0/1991578626 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fbbf64a390 0x55fbbfa1de30 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fb94c009610 tx=0x7fb94c005bd0 comp rx=0 tx=0).stop 2024-09-21T06:40:51.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.107+0000 7fb969be4740 1 -- 172.21.15.7:0/1991578626 shutdown_connections 2024-09-21T06:40:51.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.107+0000 7fb969be4740 1 --2- 172.21.15.7:0/1991578626 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x55fbbf6299f0 0x55fbbfa2fbf0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:51.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.107+0000 7fb969be4740 1 --2- 172.21.15.7:0/1991578626 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fbbf66b070 0x55fbbfa1e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:51.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.107+0000 7fb969be4740 1 --2- 172.21.15.7:0/1991578626 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fbbf64a390 0x55fbbfa1de30 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:51.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.107+0000 7fb969be4740 1 --2- 172.21.15.7:0/1991578626 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fbbf6421b0 0x55fbbfa1d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:51.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.107+0000 7fb944ff9640 0 client.16395 ms_handle_reset on v2:172.21.15.144:6838/4027821922 2024-09-21T06:40:51.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.107+0000 7fb969be4740 1 -- 172.21.15.7:0/1991578626 >> 172.21.15.7:0/1991578626 conn(0x55fbbf65f460 msgr2=0x55fbbfa154a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:51.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.108+0000 7fb969be4740 1 -- 172.21.15.7:0/1991578626 shutdown_connections 2024-09-21T06:40:51.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.108+0000 7fb969be4740 1 -- 172.21.15.7:0/1991578626 wait complete. 2024-09-21T06:40:51.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.108+0000 7fb969be4740 20 client.16395 trim_cache size 0 max 16384 2024-09-21T06:40:51.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.121+0000 7fb969be4740 1 Processor -- start 2024-09-21T06:40:51.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.121+0000 7fb969be4740 1 -- start start 2024-09-21T06:40:51.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.121+0000 7fb969be4740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fbbf6421b0 0x55fbbfa13cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:51.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.121+0000 7fb969be4740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fbbf64a390 0x55fbbfa1f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:51.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.121+0000 7fb969be4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fbbf66b070 0x55fbbfa0f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:51.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.121+0000 7fb969be4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb95c1b1c90 con 0x55fbbf66b070 2024-09-21T06:40:51.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.121+0000 7fb969be4740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb95c1af560 con 0x55fbbf6421b0 2024-09-21T06:40:51.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.121+0000 7fb969be4740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb95c1ad3b0 con 0x55fbbf64a390 2024-09-21T06:40:51.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.121+0000 7fb961c0d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fbbf66b070 0x55fbbfa0f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:51.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.121+0000 7fb961c0d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fbbf66b070 0x55fbbfa0f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41874/0 (socket says 172.21.15.7:41874) 2024-09-21T06:40:51.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.121+0000 7fb961c0d640 1 -- 172.21.15.7:0/3589809293 learned_addr learned my addr 172.21.15.7:0/3589809293 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:40:51.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.121+0000 7fb96140c640 1 --2- 172.21.15.7:0/3589809293 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fbbf6421b0 0x55fbbfa13cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:51.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.122+0000 7fb960c0b640 1 --2- 172.21.15.7:0/3589809293 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fbbf64a390 0x55fbbfa1f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:51.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.122+0000 7fb961c0d640 1 -- 172.21.15.7:0/3589809293 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fbbf64a390 msgr2=0x55fbbfa1f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:51.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.122+0000 7fb961c0d640 1 --2- 172.21.15.7:0/3589809293 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fbbf64a390 0x55fbbfa1f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:51.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.122+0000 7fb961c0d640 1 -- 172.21.15.7:0/3589809293 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fbbf6421b0 msgr2=0x55fbbfa13cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:51.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.122+0000 7fb961c0d640 1 --2- 172.21.15.7:0/3589809293 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fbbf6421b0 0x55fbbfa13cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:51.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.122+0000 7fb961c0d640 1 -- 172.21.15.7:0/3589809293 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbbfa29c90 con 0x55fbbf66b070 2024-09-21T06:40:51.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.122+0000 7fb96140c640 1 --2- 172.21.15.7:0/3589809293 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fbbf6421b0 0x55fbbfa13cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:40:51.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.122+0000 7fb961c0d640 1 --2- 172.21.15.7:0/3589809293 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fbbf66b070 0x55fbbfa0f760 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fb954007ec0 tx=0x7fb954018cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4950c62d06c3a1cf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:51.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.122+0000 7fb946ffd640 1 -- 172.21.15.7:0/3589809293 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb954027070 con 0x55fbbf66b070 2024-09-21T06:40:51.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.122+0000 7fb946ffd640 1 -- 172.21.15.7:0/3589809293 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb954003e20 con 0x55fbbf66b070 2024-09-21T06:40:51.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.122+0000 7fb946ffd640 1 -- 172.21.15.7:0/3589809293 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb954010640 con 0x55fbbf66b070 2024-09-21T06:40:51.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.123+0000 7fb969be4740 1 -- 172.21.15.7:0/3589809293 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fbbf66b070 msgr2=0x55fbbfa0f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:51.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.123+0000 7fb969be4740 1 --2- 172.21.15.7:0/3589809293 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fbbf66b070 0x55fbbfa0f760 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fb954007ec0 tx=0x7fb954018cd0 comp rx=0 tx=0).stop 2024-09-21T06:40:51.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.123+0000 7fb969be4740 1 -- 172.21.15.7:0/3589809293 shutdown_connections 2024-09-21T06:40:51.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.123+0000 7fb969be4740 1 --2- 172.21.15.7:0/3589809293 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fbbf66b070 0x55fbbfa0f760 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:51.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.123+0000 7fb969be4740 1 --2- 172.21.15.7:0/3589809293 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fbbf64a390 0x55fbbfa1f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:51.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.123+0000 7fb969be4740 1 --2- 172.21.15.7:0/3589809293 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fbbf6421b0 0x55fbbfa13cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:51.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.123+0000 7fb969be4740 1 -- 172.21.15.7:0/3589809293 >> 172.21.15.7:0/3589809293 conn(0x55fbbf65f460 msgr2=0x55fbbfa1ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:51.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.123+0000 7fb969be4740 1 -- 172.21.15.7:0/3589809293 shutdown_connections 2024-09-21T06:40:51.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.123+0000 7fb969be4740 1 -- 172.21.15.7:0/3589809293 wait complete. 2024-09-21T06:40:51.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.123+0000 7fb969be4740 1 -- start start 2024-09-21T06:40:51.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.124+0000 7fb969be4740 1 Processor -- start 2024-09-21T06:40:51.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.124+0000 7fb969be4740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fbbf6421b0 0x55fbbfa22560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:51.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.124+0000 7fb969be4740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fbbf64a390 0x55fbbfa22b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:51.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.124+0000 7fb969be4740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fbbf66b070 0x55fbbfa93580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:51.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.124+0000 7fb969be4740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb95c1ada20 con 0x55fbbf6421b0 2024-09-21T06:40:51.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.124+0000 7fb969be4740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb95c1aee90 con 0x55fbbf64a390 2024-09-21T06:40:51.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.124+0000 7fb969be4740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb95c1ae0f0 con 0x55fbbf66b070 2024-09-21T06:40:51.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.124+0000 7fb969be4740 10 client.0 _ll_register_callbacks cb 0x7fb94c0046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:40:51.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.124+0000 7fb96140c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fbbf6421b0 0x55fbbfa22560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:51.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.124+0000 7fb960c0b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fbbf64a390 0x55fbbfa22b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:51.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.124+0000 7fb96140c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fbbf6421b0 0x55fbbfa22560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41880/0 (socket says 172.21.15.7:41880) 2024-09-21T06:40:51.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.124+0000 7fb96140c640 1 -- 172.21.15.7:0/879181996 learned_addr learned my addr 172.21.15.7:0/879181996 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:40:51.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.124+0000 7fb961c0d640 1 --2- 172.21.15.7:0/879181996 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fbbf66b070 0x55fbbfa93580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:51.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.125+0000 7fb960c0b640 1 -- 172.21.15.7:0/879181996 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fbbf66b070 msgr2=0x55fbbfa93580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:51.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.125+0000 7fb960c0b640 1 --2- 172.21.15.7:0/879181996 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fbbf66b070 0x55fbbfa93580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:51.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.125+0000 7fb960c0b640 1 -- 172.21.15.7:0/879181996 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fbbf6421b0 msgr2=0x55fbbfa22560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:51.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.125+0000 7fb960c0b640 1 --2- 172.21.15.7:0/879181996 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fbbf6421b0 0x55fbbfa22560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:51.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.125+0000 7fb960c0b640 1 -- 172.21.15.7:0/879181996 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fbbfa93bc0 con 0x55fbbf64a390 2024-09-21T06:40:51.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.125+0000 7fb96140c640 1 --2- 172.21.15.7:0/879181996 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fbbf6421b0 0x55fbbfa22560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:40:51.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.125+0000 7fb960c0b640 1 --2- 172.21.15.7:0/879181996 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fbbf64a390 0x55fbbfa22b00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb94c005c40 tx=0x7fb94c0eaa40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de3861a79648a6ff server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:51.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.125+0000 7fb944ff9640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-21T06:40:51.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.125+0000 7fb944ff9640 1 -- 172.21.15.7:0/879181996 <== mon.2 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb94c0ac9a0 con 0x55fbbf64a390 2024-09-21T06:40:51.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.125+0000 7fb944ff9640 1 -- 172.21.15.7:0/879181996 <== mon.2 v2:172.21.15.18:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fb94c0abf00 con 0x55fbbf64a390 2024-09-21T06:40:51.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.125+0000 7fb969be4740 1 -- 172.21.15.7:0/879181996 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb954003e20 con 0x55fbbf64a390 2024-09-21T06:40:51.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.125+0000 7fb944ff9640 1 -- 172.21.15.7:0/879181996 <== mon.2 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb94c0acb80 con 0x55fbbf64a390 2024-09-21T06:40:51.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.125+0000 7fb969be4740 10 client.26057 fetch_fsmap learned FSMap version 25 2024-09-21T06:40:51.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.125+0000 7fb969be4740 1 -- 172.21.15.7:0/879181996 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55fbbfa9aef0 con 0x55fbbf64a390 2024-09-21T06:40:51.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.125+0000 7fb944ff9640 1 -- 172.21.15.7:0/879181996 <== mon.2 v2:172.21.15.18:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb954003e20 con 0x55fbbf64a390 2024-09-21T06:40:51.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.126+0000 7fb944ff9640 1 -- 172.21.15.7:0/879181996 <== mon.2 v2:172.21.15.18:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb94c0ac100 con 0x55fbbf64a390 2024-09-21T06:40:51.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.126+0000 7fb969be4740 10 client.26057 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:40:51.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.126+0000 7fb969be4740 10 client.26057 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:40:51.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.126+0000 7fb969be4740 20 client.26057 populate_metadata read hostname 'smithi007' 2024-09-21T06:40:51.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.126+0000 7fb969be4740 1 --2- 172.21.15.7:0/879181996 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x55fbbf5feda0 0x55fbbfa9d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:51.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.126+0000 7fb969be4740 4 client.26057 mds_command: new command op to 24688 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:40:51.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.126+0000 7fb969be4740 1 -- 172.21.15.7:0/879181996 --> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fbbf9868a0 con 0x55fbbf5feda0 2024-09-21T06:40:51.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.126+0000 7fb96140c640 1 --2- 172.21.15.7:0/879181996 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x55fbbf5feda0 0x55fbbfa9d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:51.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.127+0000 7fb944ff9640 10 client.26057 ms_handle_connect on v2:172.21.15.144:6838/4027821922 2024-09-21T06:40:51.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.126+0000 7fb96140c640 1 --2- 172.21.15.7:0/879181996 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x55fbbf5feda0 0x55fbbfa9d5d0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c6774d37eb035641 server_cookie=7f44d0f800d51a7a in_seq=0 out_seq=0 2024-09-21T06:40:51.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.127+0000 7fb944ff9640 1 -- 172.21.15.7:0/879181996 <== mds.1 v2:172.21.15.144:6838/4027821922 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fbbf9868a0 con 0x55fbbf5feda0 2024-09-21T06:40:51.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.127+0000 7fb944ff9640 10 client.26057 handle_command_reply: tid=0 2024-09-21T06:40:51.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.127+0000 7fb969be4740 1 client.26057 shutdown 2024-09-21T06:40:51.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.127+0000 7fb969be4740 1 -- 172.21.15.7:0/879181996 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fbbf64a390 msgr2=0x55fbbfa22b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:51.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.127+0000 7fb969be4740 1 --2- 172.21.15.7:0/879181996 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fbbf64a390 0x55fbbfa22b00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb94c005c40 tx=0x7fb94c0eaa40 comp rx=0 tx=0).stop 2024-09-21T06:40:51.162 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:40:51.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.127+0000 7fb969be4740 1 -- 172.21.15.7:0/879181996 shutdown_connections 2024-09-21T06:40:51.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.127+0000 7fb969be4740 1 --2- 172.21.15.7:0/879181996 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x55fbbf5feda0 0x55fbbfa9d5d0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:51.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.127+0000 7fb969be4740 1 --2- 172.21.15.7:0/879181996 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fbbf66b070 0x55fbbfa93580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:51.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.127+0000 7fb969be4740 1 --2- 172.21.15.7:0/879181996 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fbbf64a390 0x55fbbfa22b00 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:51.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.127+0000 7fb969be4740 1 --2- 172.21.15.7:0/879181996 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fbbf6421b0 0x55fbbfa22560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:51.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.127+0000 7fb944ff9640 0 client.26057 ms_handle_reset on v2:172.21.15.144:6838/4027821922 2024-09-21T06:40:51.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.127+0000 7fb969be4740 1 -- 172.21.15.7:0/879181996 >> 172.21.15.7:0/879181996 conn(0x55fbbf65f460 msgr2=0x55fbbfa29410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:51.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.127+0000 7fb969be4740 1 -- 172.21.15.7:0/879181996 shutdown_connections 2024-09-21T06:40:51.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.127+0000 7fb969be4740 1 -- 172.21.15.7:0/879181996 wait complete. 2024-09-21T06:40:51.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.127+0000 7fb969be4740 20 client.26057 trim_cache size 0 max 16384 2024-09-21T06:40:51.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.128+0000 7fb963670640 1 -- 172.21.15.7:0/3789879351 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fb9480b66b0 msgr2=0x7fb9480b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:51.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.128+0000 7fb963670640 1 --2- 172.21.15.7:0/3789879351 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fb9480b66b0 0x7fb9480b8bc0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb958031440 tx=0x7fb958009640 comp rx=0 tx=0).stop 2024-09-21T06:40:51.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.128+0000 7fb963670640 1 -- 172.21.15.7:0/3789879351 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb95c1094e0 msgr2=0x7fb95c19aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:51.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.128+0000 7fb963670640 1 --2- 172.21.15.7:0/3789879351 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb95c1094e0 0x7fb95c19aa80 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fb94c00d950 tx=0x7fb94c00de10 comp rx=0 tx=0).stop 2024-09-21T06:40:51.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.128+0000 7fb963670640 1 -- 172.21.15.7:0/3789879351 shutdown_connections 2024-09-21T06:40:51.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.128+0000 7fb963670640 1 --2- 172.21.15.7:0/3789879351 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fb9480b66b0 0x7fb9480b8bc0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:51.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.128+0000 7fb963670640 1 --2- 172.21.15.7:0/3789879351 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb95c109e30 0x7fb95c19fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:51.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.128+0000 7fb963670640 1 --2- 172.21.15.7:0/3789879351 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb95c1094e0 0x7fb95c19aa80 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:51.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.128+0000 7fb963670640 1 --2- 172.21.15.7:0/3789879351 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb95c103ba0 0x7fb95c19a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:51.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.128+0000 7fb963670640 1 -- 172.21.15.7:0/3789879351 >> 172.21.15.7:0/3789879351 conn(0x7fb95c0ff610 msgr2=0x7fb95c101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:51.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.128+0000 7fb963670640 1 -- 172.21.15.7:0/3789879351 shutdown_connections 2024-09-21T06:40:51.164 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:51.128+0000 7fb963670640 1 -- 172.21.15.7:0/3789879351 wait complete. 2024-09-21T06:40:52.019 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:40:52.283 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:40:52.674 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:40:52 smithi007 ceph-mon[30983]: pgmap v459: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:40:52.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.767+0000 7f95fef03640 1 -- 172.21.15.7:0/3216143944 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95f8107bd0 msgr2=0x7f95f8107fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:52.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.767+0000 7f95fef03640 1 --2- 172.21.15.7:0/3216143944 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95f8107bd0 0x7f95f8107fe0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f95e4009900 tx=0x7f95e402a410 comp rx=0 tx=0).stop 2024-09-21T06:40:52.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.767+0000 7f95fef03640 1 -- 172.21.15.7:0/3216143944 shutdown_connections 2024-09-21T06:40:52.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.767+0000 7f95fef03640 1 --2- 172.21.15.7:0/3216143944 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f95f8108520 0x7f95f810ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:52.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.767+0000 7f95fef03640 1 --2- 172.21.15.7:0/3216143944 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95f8107bd0 0x7f95f8107fe0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:52.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.767+0000 7f95fef03640 1 --2- 172.21.15.7:0/3216143944 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f95f8102290 0x7f95f81026a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:52.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.767+0000 7f95fef03640 1 -- 172.21.15.7:0/3216143944 >> 172.21.15.7:0/3216143944 conn(0x7f95f8079ea0 msgr2=0x7f95f807a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:52.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.767+0000 7f95fef03640 1 -- 172.21.15.7:0/3216143944 shutdown_connections 2024-09-21T06:40:52.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.767+0000 7f95fef03640 1 -- 172.21.15.7:0/3216143944 wait complete. 2024-09-21T06:40:52.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.767+0000 7f95fef03640 1 Processor -- start 2024-09-21T06:40:52.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.768+0000 7f95fef03640 1 -- start start 2024-09-21T06:40:52.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.768+0000 7f95fef03640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f95f8102290 0x7f95f819b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:52.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.768+0000 7f95fef03640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95f8107bd0 0x7f95f819b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:52.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.768+0000 7f95fef03640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f95f8108520 0x7f95f819be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:52.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.768+0000 7f95fef03640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f95f8112a60 con 0x7f95f8107bd0 2024-09-21T06:40:52.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.768+0000 7f95fef03640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f95f81128e0 con 0x7f95f8102290 2024-09-21T06:40:52.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.768+0000 7f95fef03640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f95f8112be0 con 0x7f95f8108520 2024-09-21T06:40:52.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.768+0000 7f95f7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95f8107bd0 0x7f95f819b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:52.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.768+0000 7f95f7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95f8107bd0 0x7f95f819b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41900/0 (socket says 172.21.15.7:41900) 2024-09-21T06:40:52.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.768+0000 7f95f7fff640 1 -- 172.21.15.7:0/4218647949 learned_addr learned my addr 172.21.15.7:0/4218647949 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:40:52.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.768+0000 7f95fd4a0640 1 --2- 172.21.15.7:0/4218647949 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f95f8108520 0x7f95f819be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:52.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.768+0000 7f95fcc9f640 1 --2- 172.21.15.7:0/4218647949 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f95f8102290 0x7f95f819b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:52.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.768+0000 7f95f7fff640 1 -- 172.21.15.7:0/4218647949 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f95f8108520 msgr2=0x7f95f819be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:52.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.768+0000 7f95f7fff640 1 --2- 172.21.15.7:0/4218647949 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f95f8108520 0x7f95f819be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:52.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.768+0000 7f95f7fff640 1 -- 172.21.15.7:0/4218647949 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f95f8102290 msgr2=0x7f95f819b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:52.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.768+0000 7f95f7fff640 1 --2- 172.21.15.7:0/4218647949 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f95f8102290 0x7f95f819b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:52.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.768+0000 7f95f7fff640 1 -- 172.21.15.7:0/4218647949 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95f81a66a0 con 0x7f95f8107bd0 2024-09-21T06:40:52.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.769+0000 7f95f7fff640 1 --2- 172.21.15.7:0/4218647949 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95f8107bd0 0x7f95f819b950 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f95e402a930 tx=0x7f95e4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:52.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.769+0000 7f95f5ffb640 1 -- 172.21.15.7:0/4218647949 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95e403f030 con 0x7f95f8107bd0 2024-09-21T06:40:52.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.769+0000 7f95f5ffb640 1 -- 172.21.15.7:0/4218647949 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f95e4003aa0 con 0x7f95f8107bd0 2024-09-21T06:40:52.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.769+0000 7f95f5ffb640 1 -- 172.21.15.7:0/4218647949 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95e4035070 con 0x7f95f8107bd0 2024-09-21T06:40:52.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.769+0000 7f95fef03640 1 -- 172.21.15.7:0/4218647949 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95f81a6930 con 0x7f95f8107bd0 2024-09-21T06:40:52.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.769+0000 7f95fef03640 1 -- 172.21.15.7:0/4218647949 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95f81a6e10 con 0x7f95f8107bd0 2024-09-21T06:40:52.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.772+0000 7f9605477740 1 Processor -- start 2024-09-21T06:40:52.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.772+0000 7f9605477740 1 -- start start 2024-09-21T06:40:52.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.772+0000 7f95f5ffb640 1 -- 172.21.15.7:0/4218647949 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f95e4042030 con 0x7f95f8107bd0 2024-09-21T06:40:52.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.772+0000 7f9605477740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557418129070 0x5574184d02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:52.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.772+0000 7f9605477740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5574181001b0 0x5574184d0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:52.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.772+0000 7f9605477740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557418108390 0x5574184d0d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:52.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.772+0000 7f9605477740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x557418446ea0 con 0x5574181001b0 2024-09-21T06:40:52.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.772+0000 7f9605477740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5574184362d0 con 0x557418129070 2024-09-21T06:40:52.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.772+0000 7f9605477740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55741843a0e0 con 0x557418108390 2024-09-21T06:40:52.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.772+0000 7f95fcc9f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5574181001b0 0x5574184d0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:52.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.772+0000 7f95fcc9f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5574181001b0 0x5574184d0800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41916/0 (socket says 172.21.15.7:41916) 2024-09-21T06:40:52.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.772+0000 7f95fcc9f640 1 -- 172.21.15.7:0/4248979115 learned_addr learned my addr 172.21.15.7:0/4248979115 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:40:52.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.772+0000 7f95fd4a0640 1 --2- 172.21.15.7:0/4248979115 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557418129070 0x5574184d02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:52.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.773+0000 7f95f7fff640 1 --2- 172.21.15.7:0/4248979115 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557418108390 0x5574184d0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:52.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.773+0000 7f95fcc9f640 1 -- 172.21.15.7:0/4248979115 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557418108390 msgr2=0x5574184d0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:52.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.773+0000 7f95fcc9f640 1 --2- 172.21.15.7:0/4248979115 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557418108390 0x5574184d0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:52.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.773+0000 7f95fcc9f640 1 -- 172.21.15.7:0/4248979115 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557418129070 msgr2=0x5574184d02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:52.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.773+0000 7f95fcc9f640 1 --2- 172.21.15.7:0/4248979115 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557418129070 0x5574184d02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:52.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.773+0000 7f95fcc9f640 1 -- 172.21.15.7:0/4248979115 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557418194650 con 0x5574181001b0 2024-09-21T06:40:52.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.773+0000 7f95f5ffb640 1 --2- 172.21.15.7:0/4218647949 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f95e80b66b0 0x7f95e80b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:52.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.773+0000 7f95fcc9f640 1 --2- 172.21.15.7:0/4248979115 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5574181001b0 0x5574184d0800 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f95ec00bcb0 tx=0x7f95ec0107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80fa4e615e789ae1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:52.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.773+0000 7f95fd4a0640 1 --2- 172.21.15.7:0/4218647949 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f95e80b66b0 0x7f95e80b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:52.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.773+0000 7f95f5ffb640 1 -- 172.21.15.7:0/4218647949 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f95e4107b10 con 0x7f95f8107bd0 2024-09-21T06:40:52.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.773+0000 7f95e2ffd640 1 -- 172.21.15.7:0/4248979115 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95ec01c480 con 0x5574181001b0 2024-09-21T06:40:52.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.773+0000 7f95e2ffd640 1 -- 172.21.15.7:0/4248979115 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f95ec01cad0 con 0x5574181001b0 2024-09-21T06:40:52.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.773+0000 7f95e2ffd640 1 -- 172.21.15.7:0/4248979115 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95ec011ce0 con 0x5574181001b0 2024-09-21T06:40:52.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.774+0000 7f9605477740 1 -- 172.21.15.7:0/4248979115 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5574181001b0 msgr2=0x5574184d0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:52.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.774+0000 7f9605477740 1 --2- 172.21.15.7:0/4248979115 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5574181001b0 0x5574184d0800 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f95ec00bcb0 tx=0x7f95ec0107a0 comp rx=0 tx=0).stop 2024-09-21T06:40:52.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.774+0000 7f95fd4a0640 1 --2- 172.21.15.7:0/4218647949 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f95e80b66b0 0x7f95e80b8bc0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f95f0005fd0 tx=0x7f95f0009600 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:52.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.774+0000 7f9605477740 1 -- 172.21.15.7:0/4248979115 shutdown_connections 2024-09-21T06:40:52.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.774+0000 7f9605477740 1 --2- 172.21.15.7:0/4248979115 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557418108390 0x5574184d0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:52.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.774+0000 7f9605477740 1 --2- 172.21.15.7:0/4248979115 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5574181001b0 0x5574184d0800 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:52.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.774+0000 7f9605477740 1 --2- 172.21.15.7:0/4248979115 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557418129070 0x5574184d02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:52.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.774+0000 7f9605477740 1 -- 172.21.15.7:0/4248979115 >> 172.21.15.7:0/4248979115 conn(0x55741811d460 msgr2=0x5574184ce1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:52.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.774+0000 7f9605477740 1 -- 172.21.15.7:0/4248979115 shutdown_connections 2024-09-21T06:40:52.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.774+0000 7f9605477740 1 -- 172.21.15.7:0/4248979115 wait complete. 2024-09-21T06:40:52.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.775+0000 7f9605477740 1 -- start start 2024-09-21T06:40:52.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.775+0000 7f9605477740 1 Processor -- start 2024-09-21T06:40:52.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.775+0000 7f9605477740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5574181001b0 0x5574184dfd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:52.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.775+0000 7f9605477740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557418108390 0x5574184e0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:52.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.775+0000 7f9605477740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557418129070 0x5574184e0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:52.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.775+0000 7f9605477740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x557418297700 con 0x557418108390 2024-09-21T06:40:52.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.775+0000 7f9605477740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5574183d1160 con 0x557418129070 2024-09-21T06:40:52.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.775+0000 7f9605477740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5574184e2e00 con 0x5574181001b0 2024-09-21T06:40:52.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.775+0000 7f9605477740 10 client.0 _ll_register_callbacks cb 0x5574183ea9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:40:52.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.775+0000 7f95f7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557418108390 0x5574184e0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:52.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.775+0000 7f95f7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557418108390 0x5574184e0280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41924/0 (socket says 172.21.15.7:41924) 2024-09-21T06:40:52.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.776+0000 7f95f7fff640 1 -- 172.21.15.7:0/1885240667 learned_addr learned my addr 172.21.15.7:0/1885240667 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:40:52.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.776+0000 7f95fcc9f640 1 --2- 172.21.15.7:0/1885240667 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5574181001b0 0x5574184dfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:52.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.776+0000 7f95fd4a0640 1 --2- 172.21.15.7:0/1885240667 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557418129070 0x5574184e0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:52.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.776+0000 7f95f7fff640 1 -- 172.21.15.7:0/1885240667 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5574181001b0 msgr2=0x5574184dfd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:52.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.776+0000 7f95f7fff640 1 --2- 172.21.15.7:0/1885240667 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5574181001b0 0x5574184dfd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:52.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.776+0000 7f95f7fff640 1 -- 172.21.15.7:0/1885240667 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557418129070 msgr2=0x5574184e0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:52.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.776+0000 7f95f7fff640 1 --2- 172.21.15.7:0/1885240667 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557418129070 0x5574184e0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:52.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.776+0000 7f95f7fff640 1 -- 172.21.15.7:0/1885240667 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5574183fec90 con 0x557418108390 2024-09-21T06:40:52.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.776+0000 7f95f7fff640 1 --2- 172.21.15.7:0/1885240667 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557418108390 0x5574184e0280 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f95e4031440 tx=0x7f95e403b6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c6939ed6f11a2b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:52.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.776+0000 7f95d7fff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:40:52.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.776+0000 7f95d7fff640 1 -- 172.21.15.7:0/1885240667 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95e4049070 con 0x557418108390 2024-09-21T06:40:52.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.776+0000 7f95d7fff640 1 -- 172.21.15.7:0/1885240667 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f95e40d6f90 con 0x557418108390 2024-09-21T06:40:52.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.776+0000 7f9605477740 1 -- 172.21.15.7:0/1885240667 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f95ec01cad0 con 0x557418108390 2024-09-21T06:40:52.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.776+0000 7f95d7fff640 1 -- 172.21.15.7:0/1885240667 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f95e40cd220 con 0x557418108390 2024-09-21T06:40:52.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.776+0000 7f9605477740 10 client.16413 fetch_fsmap learned FSMap version 25 2024-09-21T06:40:52.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.776+0000 7f9605477740 1 -- 172.21.15.7:0/1885240667 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5574184eeb10 con 0x557418108390 2024-09-21T06:40:52.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.777+0000 7f95d7fff640 1 -- 172.21.15.7:0/1885240667 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f95ec01cad0 con 0x557418108390 2024-09-21T06:40:52.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.777+0000 7f95d7fff640 1 -- 172.21.15.7:0/1885240667 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f95e403bbb0 con 0x557418108390 2024-09-21T06:40:52.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.777+0000 7f9605477740 10 client.16413 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:40:52.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.777+0000 7f9605477740 10 client.16413 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:40:52.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.777+0000 7f9605477740 20 client.16413 populate_metadata read hostname 'smithi007' 2024-09-21T06:40:52.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.777+0000 7f9605477740 1 --2- 172.21.15.7:0/1885240667 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5574180e79f0 0x5574184f2160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:52.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.777+0000 7f9605477740 4 client.16413 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:40:52.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.777+0000 7f9605477740 1 -- 172.21.15.7:0/1885240667 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557418448df0 con 0x5574180e79f0 2024-09-21T06:40:52.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.777+0000 7f95fcc9f640 1 --2- 172.21.15.7:0/1885240667 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5574180e79f0 0x5574184f2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:52.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.778+0000 7f95d7fff640 10 client.16413 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:40:52.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.778+0000 7f95fcc9f640 1 --2- 172.21.15.7:0/1885240667 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5574180e79f0 0x5574184f2160 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ae77cd4bbcd7f02 server_cookie=9279528d6c52a731 in_seq=0 out_seq=0 2024-09-21T06:40:52.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.779+0000 7f95d7fff640 1 -- 172.21.15.7:0/1885240667 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557418448df0 con 0x5574180e79f0 2024-09-21T06:40:52.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.779+0000 7f95d7fff640 10 client.16413 handle_command_reply: tid=0 2024-09-21T06:40:52.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.779+0000 7f9605477740 1 client.16413 shutdown 2024-09-21T06:40:52.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.779+0000 7f9605477740 1 -- 172.21.15.7:0/1885240667 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557418108390 msgr2=0x5574184e0280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:52.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.779+0000 7f9605477740 1 --2- 172.21.15.7:0/1885240667 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557418108390 0x5574184e0280 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f95e4031440 tx=0x7f95e403b6b0 comp rx=0 tx=0).stop 2024-09-21T06:40:52.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.779+0000 7f9605477740 1 -- 172.21.15.7:0/1885240667 shutdown_connections 2024-09-21T06:40:52.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.779+0000 7f9605477740 1 --2- 172.21.15.7:0/1885240667 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5574180e79f0 0x5574184f2160 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:52.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.779+0000 7f9605477740 1 --2- 172.21.15.7:0/1885240667 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557418129070 0x5574184e0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:52.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.779+0000 7f9605477740 1 --2- 172.21.15.7:0/1885240667 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557418108390 0x5574184e0280 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:52.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.779+0000 7f9605477740 1 --2- 172.21.15.7:0/1885240667 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5574181001b0 0x5574184dfd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:52.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.779+0000 7f9605477740 1 -- 172.21.15.7:0/1885240667 >> 172.21.15.7:0/1885240667 conn(0x55741811d460 msgr2=0x5574184cc750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:52.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.779+0000 7f95d7fff640 0 client.16413 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:40:52.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.779+0000 7f9605477740 1 -- 172.21.15.7:0/1885240667 shutdown_connections 2024-09-21T06:40:52.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.779+0000 7f9605477740 1 -- 172.21.15.7:0/1885240667 wait complete. 2024-09-21T06:40:52.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.779+0000 7f9605477740 20 client.16413 trim_cache size 0 max 16384 2024-09-21T06:40:52.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:40:52 smithi144 ceph-mon[34653]: pgmap v459: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:40:52.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.792+0000 7f9605477740 1 Processor -- start 2024-09-21T06:40:52.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.793+0000 7f9605477740 1 -- start start 2024-09-21T06:40:52.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.793+0000 7f9605477740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5574181001b0 0x5574184d5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:52.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.793+0000 7f9605477740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557418108390 0x5574184dcf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:52.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.793+0000 7f9605477740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557418129070 0x5574184dd470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:52.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.793+0000 7f9605477740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f95f81afcb0 con 0x5574181001b0 2024-09-21T06:40:52.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.793+0000 7f9605477740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f95f81ad580 con 0x557418129070 2024-09-21T06:40:52.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.793+0000 7f9605477740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f95f81ab3b0 con 0x557418108390 2024-09-21T06:40:52.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.793+0000 7f95fcc9f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5574181001b0 0x5574184d5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:52.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.793+0000 7f95fcc9f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5574181001b0 0x5574184d5b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41938/0 (socket says 172.21.15.7:41938) 2024-09-21T06:40:52.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.793+0000 7f95fcc9f640 1 -- 172.21.15.7:0/723483773 learned_addr learned my addr 172.21.15.7:0/723483773 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:40:52.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.793+0000 7f95fd4a0640 1 --2- 172.21.15.7:0/723483773 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557418129070 0x5574184dd470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:52.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.793+0000 7f95f7fff640 1 --2- 172.21.15.7:0/723483773 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557418108390 0x5574184dcf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:52.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.793+0000 7f95fcc9f640 1 -- 172.21.15.7:0/723483773 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557418108390 msgr2=0x5574184dcf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:52.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.793+0000 7f95fcc9f640 1 --2- 172.21.15.7:0/723483773 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557418108390 0x5574184dcf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:52.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.793+0000 7f95fcc9f640 1 -- 172.21.15.7:0/723483773 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557418129070 msgr2=0x5574184dd470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:52.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.793+0000 7f95fcc9f640 1 --2- 172.21.15.7:0/723483773 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557418129070 0x5574184dd470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:52.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.793+0000 7f95fcc9f640 1 -- 172.21.15.7:0/723483773 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574184d10b0 con 0x5574181001b0 2024-09-21T06:40:52.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.793+0000 7f95f7fff640 1 --2- 172.21.15.7:0/723483773 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557418108390 0x5574184dcf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:40:52.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.793+0000 7f95fcc9f640 1 --2- 172.21.15.7:0/723483773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5574181001b0 0x5574184d5b70 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f95ec00bbd0 tx=0x7f95ec00b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6e4b16944e6bbbb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:52.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.794+0000 7f95e27fc640 1 -- 172.21.15.7:0/723483773 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95ec011970 con 0x5574181001b0 2024-09-21T06:40:52.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.794+0000 7f95e27fc640 1 -- 172.21.15.7:0/723483773 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f95ec005040 con 0x5574181001b0 2024-09-21T06:40:52.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.794+0000 7f95e27fc640 1 -- 172.21.15.7:0/723483773 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95ec003850 con 0x5574181001b0 2024-09-21T06:40:52.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.794+0000 7f9605477740 1 -- 172.21.15.7:0/723483773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5574181001b0 msgr2=0x5574184d5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:52.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.794+0000 7f9605477740 1 --2- 172.21.15.7:0/723483773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5574181001b0 0x5574184d5b70 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f95ec00bbd0 tx=0x7f95ec00b390 comp rx=0 tx=0).stop 2024-09-21T06:40:52.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.794+0000 7f9605477740 1 -- 172.21.15.7:0/723483773 shutdown_connections 2024-09-21T06:40:52.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.794+0000 7f9605477740 1 --2- 172.21.15.7:0/723483773 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557418129070 0x5574184dd470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:52.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.795+0000 7f9605477740 1 --2- 172.21.15.7:0/723483773 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557418108390 0x5574184dcf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:52.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.795+0000 7f9605477740 1 --2- 172.21.15.7:0/723483773 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5574181001b0 0x5574184d5b70 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:52.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.795+0000 7f9605477740 1 -- 172.21.15.7:0/723483773 >> 172.21.15.7:0/723483773 conn(0x55741811d460 msgr2=0x5574184d5460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:52.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.795+0000 7f9605477740 1 -- 172.21.15.7:0/723483773 shutdown_connections 2024-09-21T06:40:52.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.795+0000 7f9605477740 1 -- 172.21.15.7:0/723483773 wait complete. 2024-09-21T06:40:52.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.795+0000 7f9605477740 1 -- start start 2024-09-21T06:40:52.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.795+0000 7f9605477740 1 Processor -- start 2024-09-21T06:40:52.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.796+0000 7f9605477740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5574181001b0 0x5574184f56a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:52.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.796+0000 7f9605477740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557418108390 0x5574184f2b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:52.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.796+0000 7f9605477740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557418129070 0x5574184f30b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:52.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.796+0000 7f9605477740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f95f81aba40 con 0x5574181001b0 2024-09-21T06:40:52.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.796+0000 7f9605477740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f95f81aceb0 con 0x557418108390 2024-09-21T06:40:52.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.796+0000 7f9605477740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f95f81ac110 con 0x557418129070 2024-09-21T06:40:52.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.796+0000 7f9605477740 10 client.0 _ll_register_callbacks cb 0x7f95e4005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:40:52.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.796+0000 7f95fcc9f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5574181001b0 0x5574184f56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:52.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.796+0000 7f95fcc9f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5574181001b0 0x5574184f56a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41948/0 (socket says 172.21.15.7:41948) 2024-09-21T06:40:52.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.796+0000 7f95fcc9f640 1 -- 172.21.15.7:0/1765379243 learned_addr learned my addr 172.21.15.7:0/1765379243 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:40:52.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.796+0000 7f95fd4a0640 1 --2- 172.21.15.7:0/1765379243 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557418129070 0x5574184f30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:52.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.796+0000 7f95f7fff640 1 --2- 172.21.15.7:0/1765379243 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557418108390 0x5574184f2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:52.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.796+0000 7f95fcc9f640 1 -- 172.21.15.7:0/1765379243 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557418129070 msgr2=0x5574184f30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:52.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.796+0000 7f95fcc9f640 1 --2- 172.21.15.7:0/1765379243 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557418129070 0x5574184f30b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:52.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.796+0000 7f95fcc9f640 1 -- 172.21.15.7:0/1765379243 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557418108390 msgr2=0x5574184f2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:52.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.796+0000 7f95fcc9f640 1 --2- 172.21.15.7:0/1765379243 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557418108390 0x5574184f2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:52.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.796+0000 7f95fcc9f640 1 -- 172.21.15.7:0/1765379243 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5574184f35f0 con 0x5574181001b0 2024-09-21T06:40:52.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.796+0000 7f95fcc9f640 1 --2- 172.21.15.7:0/1765379243 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5574181001b0 0x5574184f56a0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f95ec010e20 tx=0x7f95ec00bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6618957217c006a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:52.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.796+0000 7f95d7fff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:40:52.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.796+0000 7f95d7fff640 1 -- 172.21.15.7:0/1765379243 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95ec005630 con 0x5574181001b0 2024-09-21T06:40:52.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.797+0000 7f95d7fff640 1 -- 172.21.15.7:0/1765379243 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f95ec0035f0 con 0x5574181001b0 2024-09-21T06:40:52.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.797+0000 7f9605477740 1 -- 172.21.15.7:0/1765379243 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f95ec005040 con 0x5574181001b0 2024-09-21T06:40:52.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.797+0000 7f95d7fff640 1 -- 172.21.15.7:0/1765379243 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f95ec0037f0 con 0x5574181001b0 2024-09-21T06:40:52.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.797+0000 7f9605477740 10 client.16419 fetch_fsmap learned FSMap version 25 2024-09-21T06:40:52.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.797+0000 7f9605477740 1 -- 172.21.15.7:0/1765379243 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55741855c620 con 0x5574181001b0 2024-09-21T06:40:52.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.797+0000 7f95d7fff640 1 -- 172.21.15.7:0/1765379243 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f95ec005040 con 0x5574181001b0 2024-09-21T06:40:52.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.797+0000 7f95d7fff640 1 -- 172.21.15.7:0/1765379243 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f95ec02c070 con 0x5574181001b0 2024-09-21T06:40:52.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.797+0000 7f9605477740 10 client.16419 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:40:52.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.797+0000 7f9605477740 10 client.16419 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:40:52.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.797+0000 7f9605477740 20 client.16419 populate_metadata read hostname 'smithi007' 2024-09-21T06:40:52.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.797+0000 7f9605477740 1 --2- 172.21.15.7:0/1765379243 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5574180bcda0 0x55741855ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:52.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.797+0000 7f9605477740 4 client.16419 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:40:52.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.797+0000 7f9605477740 1 -- 172.21.15.7:0/1765379243 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5574184448a0 con 0x5574180bcda0 2024-09-21T06:40:52.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.798+0000 7f95f7fff640 1 --2- 172.21.15.7:0/1765379243 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5574180bcda0 0x55741855ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:52.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.798+0000 7f95f7fff640 1 --2- 172.21.15.7:0/1765379243 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5574180bcda0 0x55741855ebd0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3f107db3ab51240 server_cookie=a49615e860a506 in_seq=0 out_seq=0 2024-09-21T06:40:52.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.798+0000 7f95d7fff640 10 client.16419 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:40:52.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.798+0000 7f95d7fff640 1 -- 172.21.15.7:0/1765379243 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5574184448a0 con 0x5574180bcda0 2024-09-21T06:40:52.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.798+0000 7f95d7fff640 10 client.16419 handle_command_reply: tid=0 2024-09-21T06:40:52.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.798+0000 7f9605477740 1 client.16419 shutdown 2024-09-21T06:40:52.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.798+0000 7f9605477740 1 -- 172.21.15.7:0/1765379243 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5574181001b0 msgr2=0x5574184f56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:52.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.798+0000 7f9605477740 1 --2- 172.21.15.7:0/1765379243 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5574181001b0 0x5574184f56a0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f95ec010e20 tx=0x7f95ec00bf00 comp rx=0 tx=0).stop 2024-09-21T06:40:52.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.798+0000 7f9605477740 1 -- 172.21.15.7:0/1765379243 shutdown_connections 2024-09-21T06:40:52.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.798+0000 7f9605477740 1 --2- 172.21.15.7:0/1765379243 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5574180bcda0 0x55741855ebd0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:52.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.798+0000 7f9605477740 1 --2- 172.21.15.7:0/1765379243 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557418129070 0x5574184f30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:52.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.798+0000 7f9605477740 1 --2- 172.21.15.7:0/1765379243 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557418108390 0x5574184f2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:52.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.798+0000 7f9605477740 1 --2- 172.21.15.7:0/1765379243 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5574181001b0 0x5574184f56a0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:52.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.798+0000 7f9605477740 1 -- 172.21.15.7:0/1765379243 >> 172.21.15.7:0/1765379243 conn(0x55741811d460 msgr2=0x5574184d1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:52.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.798+0000 7f95d7fff640 0 client.16419 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:40:52.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.799+0000 7f9605477740 1 -- 172.21.15.7:0/1765379243 shutdown_connections 2024-09-21T06:40:52.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.799+0000 7f9605477740 1 -- 172.21.15.7:0/1765379243 wait complete. 2024-09-21T06:40:52.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.799+0000 7f9605477740 20 client.16419 trim_cache size 0 max 16384 2024-09-21T06:40:52.805 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:40:52.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.799+0000 7f95fef03640 1 -- 172.21.15.7:0/4218647949 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f95e80b66b0 msgr2=0x7f95e80b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:52.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.799+0000 7f95fef03640 1 --2- 172.21.15.7:0/4218647949 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f95e80b66b0 0x7f95e80b8bc0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f95f0005fd0 tx=0x7f95f0009600 comp rx=0 tx=0).stop 2024-09-21T06:40:52.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.799+0000 7f95fef03640 1 -- 172.21.15.7:0/4218647949 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95f8107bd0 msgr2=0x7f95f819b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:52.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.799+0000 7f95fef03640 1 --2- 172.21.15.7:0/4218647949 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95f8107bd0 0x7f95f819b950 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f95e402a930 tx=0x7f95e4004270 comp rx=0 tx=0).stop 2024-09-21T06:40:52.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.799+0000 7f95fef03640 1 -- 172.21.15.7:0/4218647949 shutdown_connections 2024-09-21T06:40:52.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.799+0000 7f95fef03640 1 --2- 172.21.15.7:0/4218647949 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f95e80b66b0 0x7f95e80b8bc0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:52.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.799+0000 7f95fef03640 1 --2- 172.21.15.7:0/4218647949 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f95f8108520 0x7f95f819be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:52.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.799+0000 7f95fef03640 1 --2- 172.21.15.7:0/4218647949 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f95f8107bd0 0x7f95f819b950 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:52.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.799+0000 7f95fef03640 1 --2- 172.21.15.7:0/4218647949 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f95f8102290 0x7f95f819b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:52.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.799+0000 7f95fef03640 1 -- 172.21.15.7:0/4218647949 >> 172.21.15.7:0/4218647949 conn(0x7f95f8079ea0 msgr2=0x7f95f8103c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:52.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.800+0000 7f95fef03640 1 -- 172.21.15.7:0/4218647949 shutdown_connections 2024-09-21T06:40:52.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:52.800+0000 7f95fef03640 1 -- 172.21.15.7:0/4218647949 wait complete. 2024-09-21T06:40:52.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:40:52 smithi018 ceph-mon[34477]: pgmap v459: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:40:54.561 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:40:54.561 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:40:54.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:40:54 smithi144 ceph-mon[34653]: pgmap v460: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:40:54.832 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:40:54.839 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:40:54 smithi007 ceph-mon[30983]: pgmap v460: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:40:54.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:40:54 smithi018 ceph-mon[34477]: pgmap v460: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:40:55.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.337+0000 7fbdad6bb640 1 -- 172.21.15.7:0/1824001690 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbda81083a0 msgr2=0x7fbda81087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:55.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.337+0000 7fbdad6bb640 1 --2- 172.21.15.7:0/1824001690 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbda81083a0 0x7fbda81087b0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fbd90009900 tx=0x7fbd9002a410 comp rx=0 tx=0).stop 2024-09-21T06:40:55.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.337+0000 7fbdad6bb640 1 -- 172.21.15.7:0/1824001690 shutdown_connections 2024-09-21T06:40:55.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.337+0000 7fbdad6bb640 1 --2- 172.21.15.7:0/1824001690 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbda8108cf0 0x7fbda810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:55.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.337+0000 7fbdad6bb640 1 --2- 172.21.15.7:0/1824001690 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbda81083a0 0x7fbda81087b0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:55.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.337+0000 7fbdad6bb640 1 --2- 172.21.15.7:0/1824001690 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbda8102a60 0x7fbda8102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:55.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.337+0000 7fbdad6bb640 1 -- 172.21.15.7:0/1824001690 >> 172.21.15.7:0/1824001690 conn(0x7fbda8079730 msgr2=0x7fbda8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:55.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.337+0000 7fbdad6bb640 1 -- 172.21.15.7:0/1824001690 shutdown_connections 2024-09-21T06:40:55.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.337+0000 7fbdad6bb640 1 -- 172.21.15.7:0/1824001690 wait complete. 2024-09-21T06:40:55.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.338+0000 7fbdad6bb640 1 Processor -- start 2024-09-21T06:40:55.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.338+0000 7fbdad6bb640 1 -- start start 2024-09-21T06:40:55.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.338+0000 7fbdad6bb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbda8102a60 0x7fbda819b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:55.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.338+0000 7fbdad6bb640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbda81083a0 0x7fbda819b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:55.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.338+0000 7fbdad6bb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbda8108cf0 0x7fbda819bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:55.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.338+0000 7fbdad6bb640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbda8112960 con 0x7fbda8102a60 2024-09-21T06:40:55.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.338+0000 7fbdad6bb640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fbda81127e0 con 0x7fbda8108cf0 2024-09-21T06:40:55.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.338+0000 7fbdad6bb640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fbda8112ae0 con 0x7fbda81083a0 2024-09-21T06:40:55.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.338+0000 7fbda6ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbda8102a60 0x7fbda819b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:55.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.338+0000 7fbda6ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbda8102a60 0x7fbda819b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41968/0 (socket says 172.21.15.7:41968) 2024-09-21T06:40:55.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.338+0000 7fbda6ffd640 1 -- 172.21.15.7:0/2619553088 learned_addr learned my addr 172.21.15.7:0/2619553088 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:40:55.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.338+0000 7fbda77fe640 1 --2- 172.21.15.7:0/2619553088 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbda8108cf0 0x7fbda819bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:55.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.339+0000 7fbda67fc640 1 --2- 172.21.15.7:0/2619553088 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbda81083a0 0x7fbda819b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:55.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.339+0000 7fbda6ffd640 1 -- 172.21.15.7:0/2619553088 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbda81083a0 msgr2=0x7fbda819b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:55.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.339+0000 7fbda6ffd640 1 --2- 172.21.15.7:0/2619553088 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbda81083a0 0x7fbda819b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:55.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.339+0000 7fbda6ffd640 1 -- 172.21.15.7:0/2619553088 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbda8108cf0 msgr2=0x7fbda819bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:55.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.339+0000 7fbda6ffd640 1 --2- 172.21.15.7:0/2619553088 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbda8108cf0 0x7fbda819bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:55.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.339+0000 7fbda6ffd640 1 -- 172.21.15.7:0/2619553088 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbda81a6600 con 0x7fbda8102a60 2024-09-21T06:40:55.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.339+0000 7fbda6ffd640 1 --2- 172.21.15.7:0/2619553088 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbda8102a60 0x7fbda819b2f0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fbda000d950 tx=0x7fbda000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:55.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.339+0000 7fbd9ffff640 1 -- 172.21.15.7:0/2619553088 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbda0017070 con 0x7fbda8102a60 2024-09-21T06:40:55.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.339+0000 7fbd9ffff640 1 -- 172.21.15.7:0/2619553088 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbda0009c30 con 0x7fbda8102a60 2024-09-21T06:40:55.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.339+0000 7fbdad6bb640 1 -- 172.21.15.7:0/2619553088 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbda81a68f0 con 0x7fbda8102a60 2024-09-21T06:40:55.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.339+0000 7fbd9ffff640 1 -- 172.21.15.7:0/2619553088 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbda000f620 con 0x7fbda8102a60 2024-09-21T06:40:55.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.339+0000 7fbdad6bb640 1 -- 172.21.15.7:0/2619553088 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbda81a6e00 con 0x7fbda8102a60 2024-09-21T06:40:55.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.342+0000 7fbdb3c2f740 1 Processor -- start 2024-09-21T06:40:55.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.342+0000 7fbdb3c2f740 1 -- start start 2024-09-21T06:40:55.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.342+0000 7fbd9ffff640 1 -- 172.21.15.7:0/2619553088 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7fbda0010460 con 0x7fbda8102a60 2024-09-21T06:40:55.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.342+0000 7fbdb3c2f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d673ec8350 0x55d67426f430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:55.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.342+0000 7fbdb3c2f740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d673e9f490 0x55d67426f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:55.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.342+0000 7fbdb3c2f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d673ea7670 0x55d67426feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:55.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.342+0000 7fbdb3c2f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55d6741e5e60 con 0x55d673ea7670 2024-09-21T06:40:55.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.342+0000 7fbdb3c2f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55d6741d5290 con 0x55d673ec8350 2024-09-21T06:40:55.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.342+0000 7fbdb3c2f740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55d6741d90a0 con 0x55d673e9f490 2024-09-21T06:40:55.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.342+0000 7fbda67fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d673ea7670 0x55d67426feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:55.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.342+0000 7fbda67fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d673ea7670 0x55d67426feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41978/0 (socket says 172.21.15.7:41978) 2024-09-21T06:40:55.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.342+0000 7fbda67fc640 1 -- 172.21.15.7:0/458456565 learned_addr learned my addr 172.21.15.7:0/458456565 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:40:55.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.343+0000 7fbda6ffd640 1 --2- 172.21.15.7:0/458456565 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d673e9f490 0x55d67426f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:55.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.343+0000 7fbda77fe640 1 --2- 172.21.15.7:0/458456565 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d673ec8350 0x55d67426f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:55.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.343+0000 7fbda67fc640 1 -- 172.21.15.7:0/458456565 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d673e9f490 msgr2=0x55d67426f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:55.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.343+0000 7fbda67fc640 1 --2- 172.21.15.7:0/458456565 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d673e9f490 0x55d67426f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:55.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.343+0000 7fbda67fc640 1 -- 172.21.15.7:0/458456565 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d673ec8350 msgr2=0x55d67426f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:55.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.343+0000 7fbda67fc640 1 --2- 172.21.15.7:0/458456565 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d673ec8350 0x55d67426f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:55.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.343+0000 7fbda67fc640 1 -- 172.21.15.7:0/458456565 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d673f33930 con 0x55d673ea7670 2024-09-21T06:40:55.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.343+0000 7fbd9ffff640 1 --2- 172.21.15.7:0/2619553088 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fbd940b6680 0x7fbd940b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:55.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.343+0000 7fbda67fc640 1 --2- 172.21.15.7:0/458456565 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d673ea7670 0x55d67426feb0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fbda806aaa0 tx=0x7fbd90032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35cbd6e65be4cc9c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:55.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.343+0000 7fbda77fe640 1 --2- 172.21.15.7:0/2619553088 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fbd940b6680 0x7fbd940b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:55.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.343+0000 7fbd9ffff640 1 -- 172.21.15.7:0/2619553088 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fbda00e72f0 con 0x7fbda8102a60 2024-09-21T06:40:55.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.343+0000 7fbd9d7fa640 1 -- 172.21.15.7:0/458456565 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd9003f070 con 0x55d673ea7670 2024-09-21T06:40:55.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.343+0000 7fbd9d7fa640 1 -- 172.21.15.7:0/458456565 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd900316a0 con 0x55d673ea7670 2024-09-21T06:40:55.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.343+0000 7fbd9d7fa640 1 -- 172.21.15.7:0/458456565 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd90035070 con 0x55d673ea7670 2024-09-21T06:40:55.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.344+0000 7fbdb3c2f740 1 -- 172.21.15.7:0/458456565 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d673ea7670 msgr2=0x55d67426feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:55.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.344+0000 7fbdb3c2f740 1 --2- 172.21.15.7:0/458456565 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d673ea7670 0x55d67426feb0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fbda806aaa0 tx=0x7fbd90032ce0 comp rx=0 tx=0).stop 2024-09-21T06:40:55.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.344+0000 7fbda77fe640 1 --2- 172.21.15.7:0/2619553088 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fbd940b6680 0x7fbd940b8b90 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fbda806bf40 tx=0x7fbd9800a4d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:55.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.344+0000 7fbdb3c2f740 1 -- 172.21.15.7:0/458456565 shutdown_connections 2024-09-21T06:40:55.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.344+0000 7fbdb3c2f740 1 --2- 172.21.15.7:0/458456565 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d673ea7670 0x55d67426feb0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:55.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.344+0000 7fbdb3c2f740 1 --2- 172.21.15.7:0/458456565 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d673e9f490 0x55d67426f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:55.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.344+0000 7fbdb3c2f740 1 --2- 172.21.15.7:0/458456565 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d673ec8350 0x55d67426f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:55.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.344+0000 7fbdb3c2f740 1 -- 172.21.15.7:0/458456565 >> 172.21.15.7:0/458456565 conn(0x55d673ebc740 msgr2=0x55d67426d320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:55.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.344+0000 7fbdb3c2f740 1 -- 172.21.15.7:0/458456565 shutdown_connections 2024-09-21T06:40:55.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.344+0000 7fbdb3c2f740 1 -- 172.21.15.7:0/458456565 wait complete. 2024-09-21T06:40:55.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.345+0000 7fbdb3c2f740 1 -- start start 2024-09-21T06:40:55.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.345+0000 7fbdb3c2f740 1 Processor -- start 2024-09-21T06:40:55.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.345+0000 7fbdb3c2f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d673e9f490 0x55d67427b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:55.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.345+0000 7fbdb3c2f740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d673ea7670 0x55d67427b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:55.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.345+0000 7fbdb3c2f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d673ec8350 0x55d674286ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:55.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.345+0000 7fbdb3c2f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55d674036890 con 0x55d673ec8350 2024-09-21T06:40:55.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.345+0000 7fbdb3c2f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55d67416fd40 con 0x55d673e9f490 2024-09-21T06:40:55.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.345+0000 7fbdb3c2f740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55d67427dbb0 con 0x55d673ea7670 2024-09-21T06:40:55.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.345+0000 7fbdb3c2f740 10 client.0 _ll_register_callbacks cb 0x55d6741d3c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:40:55.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.345+0000 7fbda77fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d673ec8350 0x55d674286ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:55.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.345+0000 7fbda77fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d673ec8350 0x55d674286ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41984/0 (socket says 172.21.15.7:41984) 2024-09-21T06:40:55.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.345+0000 7fbda77fe640 1 -- 172.21.15.7:0/1570297130 learned_addr learned my addr 172.21.15.7:0/1570297130 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:40:55.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.346+0000 7fbda6ffd640 1 --2- 172.21.15.7:0/1570297130 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d673e9f490 0x55d67427b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:55.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.346+0000 7fbda67fc640 1 --2- 172.21.15.7:0/1570297130 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d673ea7670 0x55d67427b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:55.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.346+0000 7fbda77fe640 1 -- 172.21.15.7:0/1570297130 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d673ea7670 msgr2=0x55d67427b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:55.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.346+0000 7fbda77fe640 1 --2- 172.21.15.7:0/1570297130 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d673ea7670 0x55d67427b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:55.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.346+0000 7fbda77fe640 1 -- 172.21.15.7:0/1570297130 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d673e9f490 msgr2=0x55d67427b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:55.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.346+0000 7fbda77fe640 1 --2- 172.21.15.7:0/1570297130 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d673e9f490 0x55d67427b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:55.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.346+0000 7fbda77fe640 1 -- 172.21.15.7:0/1570297130 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d674287490 con 0x55d673ec8350 2024-09-21T06:40:55.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.346+0000 7fbda77fe640 1 --2- 172.21.15.7:0/1570297130 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d673ec8350 0x55d674286ea0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fbd9801cc00 tx=0x7fbd98004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec058f6391ff217f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:55.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.346+0000 7fbd8e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:40:55.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.346+0000 7fbd8e7fc640 1 -- 172.21.15.7:0/1570297130 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd9801cdb0 con 0x55d673ec8350 2024-09-21T06:40:55.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.346+0000 7fbdb3c2f740 1 -- 172.21.15.7:0/1570297130 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbd900316a0 con 0x55d673ec8350 2024-09-21T06:40:55.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.346+0000 7fbd8e7fc640 1 -- 172.21.15.7:0/1570297130 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fbd98016030 con 0x55d673ec8350 2024-09-21T06:40:55.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.346+0000 7fbd8e7fc640 1 -- 172.21.15.7:0/1570297130 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fbd98004b20 con 0x55d673ec8350 2024-09-21T06:40:55.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.346+0000 7fbdb3c2f740 10 client.16431 fetch_fsmap learned FSMap version 25 2024-09-21T06:40:55.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.346+0000 7fbdb3c2f740 1 -- 172.21.15.7:0/1570297130 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d674289e70 con 0x55d673ec8350 2024-09-21T06:40:55.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.347+0000 7fbd8e7fc640 1 -- 172.21.15.7:0/1570297130 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd900316a0 con 0x55d673ec8350 2024-09-21T06:40:55.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.347+0000 7fbd8e7fc640 1 -- 172.21.15.7:0/1570297130 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fbd98027950 con 0x55d673ec8350 2024-09-21T06:40:55.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.347+0000 7fbdb3c2f740 10 client.16431 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:40:55.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.347+0000 7fbdb3c2f740 10 client.16431 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:40:55.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.347+0000 7fbdb3c2f740 20 client.16431 populate_metadata read hostname 'smithi007' 2024-09-21T06:40:55.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.347+0000 7fbdb3c2f740 1 --2- 172.21.15.7:0/1570297130 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55d673e86cd0 0x55d67428d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:55.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.347+0000 7fbdb3c2f740 4 client.16431 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:40:55.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.347+0000 7fbdb3c2f740 1 -- 172.21.15.7:0/1570297130 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d6741e7db0 con 0x55d673e86cd0 2024-09-21T06:40:55.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.347+0000 7fbda6ffd640 1 --2- 172.21.15.7:0/1570297130 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55d673e86cd0 0x55d67428d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:55.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.348+0000 7fbd8e7fc640 10 client.16431 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:40:55.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.348+0000 7fbda6ffd640 1 --2- 172.21.15.7:0/1570297130 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55d673e86cd0 0x55d67428d3f0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b2ef9de457125649 server_cookie=cd6ba0ce74698a64 in_seq=0 out_seq=0 2024-09-21T06:40:55.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.348+0000 7fbd8e7fc640 1 -- 172.21.15.7:0/1570297130 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d6741e7db0 con 0x55d673e86cd0 2024-09-21T06:40:55.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.348+0000 7fbd8e7fc640 10 client.16431 handle_command_reply: tid=0 2024-09-21T06:40:55.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.348+0000 7fbdb3c2f740 1 client.16431 shutdown 2024-09-21T06:40:55.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.349+0000 7fbdb3c2f740 1 -- 172.21.15.7:0/1570297130 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d673ec8350 msgr2=0x55d674286ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:55.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.349+0000 7fbdb3c2f740 1 --2- 172.21.15.7:0/1570297130 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d673ec8350 0x55d674286ea0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fbd9801cc00 tx=0x7fbd98004ab0 comp rx=0 tx=0).stop 2024-09-21T06:40:55.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.349+0000 7fbdb3c2f740 1 -- 172.21.15.7:0/1570297130 shutdown_connections 2024-09-21T06:40:55.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.349+0000 7fbdb3c2f740 1 --2- 172.21.15.7:0/1570297130 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55d673e86cd0 0x55d67428d3f0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:55.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.349+0000 7fbdb3c2f740 1 --2- 172.21.15.7:0/1570297130 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d673ec8350 0x55d674286ea0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:55.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.349+0000 7fbd8e7fc640 0 client.16431 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:40:55.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.349+0000 7fbdb3c2f740 1 --2- 172.21.15.7:0/1570297130 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d673ea7670 0x55d67427b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:55.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.349+0000 7fbdb3c2f740 1 --2- 172.21.15.7:0/1570297130 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d673e9f490 0x55d67427b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:55.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.349+0000 7fbdb3c2f740 1 -- 172.21.15.7:0/1570297130 >> 172.21.15.7:0/1570297130 conn(0x55d673ebc740 msgr2=0x55d674272610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:55.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.349+0000 7fbdb3c2f740 1 -- 172.21.15.7:0/1570297130 shutdown_connections 2024-09-21T06:40:55.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.349+0000 7fbdb3c2f740 1 -- 172.21.15.7:0/1570297130 wait complete. 2024-09-21T06:40:55.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.349+0000 7fbdb3c2f740 20 client.16431 trim_cache size 0 max 16384 2024-09-21T06:40:55.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.367+0000 7fbdb3c2f740 1 Processor -- start 2024-09-21T06:40:55.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.367+0000 7fbdb3c2f740 1 -- start start 2024-09-21T06:40:55.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.367+0000 7fbdb3c2f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d673e9f490 0x55d6742765b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:55.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.367+0000 7fbdb3c2f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d673ea7670 0x55d674286da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:55.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.367+0000 7fbdb3c2f740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d673ec8350 0x55d674270e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:55.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.367+0000 7fbdb3c2f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbda81b1e00 con 0x55d673ea7670 2024-09-21T06:40:55.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.367+0000 7fbdb3c2f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fbda81af6d0 con 0x55d673e9f490 2024-09-21T06:40:55.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.367+0000 7fbdb3c2f740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fbda81ad520 con 0x55d673ec8350 2024-09-21T06:40:55.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.368+0000 7fbda67fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d673ea7670 0x55d674286da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:55.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.368+0000 7fbda67fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d673ea7670 0x55d674286da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41986/0 (socket says 172.21.15.7:41986) 2024-09-21T06:40:55.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.368+0000 7fbda67fc640 1 -- 172.21.15.7:0/739540396 learned_addr learned my addr 172.21.15.7:0/739540396 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:40:55.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.368+0000 7fbda77fe640 1 --2- 172.21.15.7:0/739540396 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d673ec8350 0x55d674270e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:55.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.368+0000 7fbda6ffd640 1 --2- 172.21.15.7:0/739540396 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d673e9f490 0x55d6742765b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:55.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.368+0000 7fbda67fc640 1 -- 172.21.15.7:0/739540396 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d673ec8350 msgr2=0x55d674270e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:55.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.368+0000 7fbda67fc640 1 --2- 172.21.15.7:0/739540396 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d673ec8350 0x55d674270e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:55.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.368+0000 7fbda67fc640 1 -- 172.21.15.7:0/739540396 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d673e9f490 msgr2=0x55d6742765b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:55.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.368+0000 7fbda67fc640 1 --2- 172.21.15.7:0/739540396 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d673e9f490 0x55d6742765b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:55.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.368+0000 7fbda67fc640 1 -- 172.21.15.7:0/739540396 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d67427c0c0 con 0x55d673ea7670 2024-09-21T06:40:55.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.368+0000 7fbda6ffd640 1 --2- 172.21.15.7:0/739540396 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d673e9f490 0x55d6742765b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:40:55.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.368+0000 7fbda67fc640 1 --2- 172.21.15.7:0/739540396 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d673ea7670 0x55d674286da0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fbd90009900 tx=0x7fbd90005ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=716814730a8e7ed0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:55.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.368+0000 7fbd9cff9640 1 -- 172.21.15.7:0/739540396 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd9004a020 con 0x55d673ea7670 2024-09-21T06:40:55.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.368+0000 7fbd9cff9640 1 -- 172.21.15.7:0/739540396 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd900316a0 con 0x55d673ea7670 2024-09-21T06:40:55.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.368+0000 7fbd9cff9640 1 -- 172.21.15.7:0/739540396 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd9003f070 con 0x55d673ea7670 2024-09-21T06:40:55.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.369+0000 7fbdb3c2f740 1 -- 172.21.15.7:0/739540396 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d673ea7670 msgr2=0x55d674286da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:55.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.369+0000 7fbdb3c2f740 1 --2- 172.21.15.7:0/739540396 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d673ea7670 0x55d674286da0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fbd90009900 tx=0x7fbd90005ee0 comp rx=0 tx=0).stop 2024-09-21T06:40:55.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.369+0000 7fbdb3c2f740 1 -- 172.21.15.7:0/739540396 shutdown_connections 2024-09-21T06:40:55.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.369+0000 7fbdb3c2f740 1 --2- 172.21.15.7:0/739540396 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d673ec8350 0x55d674270e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:55.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.369+0000 7fbdb3c2f740 1 --2- 172.21.15.7:0/739540396 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d673ea7670 0x55d674286da0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:55.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.369+0000 7fbdb3c2f740 1 --2- 172.21.15.7:0/739540396 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d673e9f490 0x55d6742765b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:55.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.369+0000 7fbdb3c2f740 1 -- 172.21.15.7:0/739540396 >> 172.21.15.7:0/739540396 conn(0x55d673ebc740 msgr2=0x55d67427c320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:55.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.369+0000 7fbdb3c2f740 1 -- 172.21.15.7:0/739540396 shutdown_connections 2024-09-21T06:40:55.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.370+0000 7fbdb3c2f740 1 -- 172.21.15.7:0/739540396 wait complete. 2024-09-21T06:40:55.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.370+0000 7fbdb3c2f740 1 -- start start 2024-09-21T06:40:55.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.370+0000 7fbdb3c2f740 1 Processor -- start 2024-09-21T06:40:55.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.370+0000 7fbdb3c2f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d673e9f490 0x55d6742836b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:55.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.370+0000 7fbdb3c2f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d673ea7670 0x55d67427ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:55.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.370+0000 7fbdb3c2f740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d673ec8350 0x55d67427f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:55.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.370+0000 7fbdb3c2f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbda81adb90 con 0x55d673e9f490 2024-09-21T06:40:55.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.370+0000 7fbdb3c2f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fbda81af000 con 0x55d673ea7670 2024-09-21T06:40:55.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.370+0000 7fbdb3c2f740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fbda81ae260 con 0x55d673ec8350 2024-09-21T06:40:55.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.370+0000 7fbdb3c2f740 10 client.0 _ll_register_callbacks cb 0x7fbd9800a8a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:40:55.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.370+0000 7fbda6ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d673e9f490 0x55d6742836b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:55.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.371+0000 7fbda6ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d673e9f490 0x55d6742836b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:41994/0 (socket says 172.21.15.7:41994) 2024-09-21T06:40:55.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.371+0000 7fbda6ffd640 1 -- 172.21.15.7:0/3092842770 learned_addr learned my addr 172.21.15.7:0/3092842770 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:40:55.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.371+0000 7fbda77fe640 1 --2- 172.21.15.7:0/3092842770 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d673ec8350 0x55d67427f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:55.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.371+0000 7fbda67fc640 1 --2- 172.21.15.7:0/3092842770 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d673ea7670 0x55d67427ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:55.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.371+0000 7fbda6ffd640 1 -- 172.21.15.7:0/3092842770 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d673ec8350 msgr2=0x55d67427f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:55.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.371+0000 7fbda6ffd640 1 --2- 172.21.15.7:0/3092842770 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d673ec8350 0x55d67427f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:55.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.371+0000 7fbda6ffd640 1 -- 172.21.15.7:0/3092842770 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d673ea7670 msgr2=0x55d67427ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:55.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.371+0000 7fbda6ffd640 1 --2- 172.21.15.7:0/3092842770 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d673ea7670 0x55d67427ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:55.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.371+0000 7fbda6ffd640 1 -- 172.21.15.7:0/3092842770 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d67427f940 con 0x55d673e9f490 2024-09-21T06:40:55.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.371+0000 7fbda6ffd640 1 --2- 172.21.15.7:0/3092842770 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d673e9f490 0x55d6742836b0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fbda00acee0 tx=0x7fbda000bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=204c5a416841fe37 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:55.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.371+0000 7fbd8e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:40:55.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.371+0000 7fbd8e7fc640 1 -- 172.21.15.7:0/3092842770 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbda0020040 con 0x55d673e9f490 2024-09-21T06:40:55.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.371+0000 7fbd8e7fc640 1 -- 172.21.15.7:0/3092842770 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fbda00a8d30 con 0x55d673e9f490 2024-09-21T06:40:55.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.371+0000 7fbdb3c2f740 1 -- 172.21.15.7:0/3092842770 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbd900316a0 con 0x55d673e9f490 2024-09-21T06:40:55.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.371+0000 7fbd8e7fc640 1 -- 172.21.15.7:0/3092842770 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fbda00acfb0 con 0x55d673e9f490 2024-09-21T06:40:55.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.372+0000 7fbdb3c2f740 10 client.16437 fetch_fsmap learned FSMap version 25 2024-09-21T06:40:55.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.372+0000 7fbdb3c2f740 1 -- 172.21.15.7:0/3092842770 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d6742f7e60 con 0x55d673e9f490 2024-09-21T06:40:55.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.372+0000 7fbd8e7fc640 1 -- 172.21.15.7:0/3092842770 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbd900316a0 con 0x55d673e9f490 2024-09-21T06:40:55.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.372+0000 7fbd8e7fc640 1 -- 172.21.15.7:0/3092842770 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fbda00d0b60 con 0x55d673e9f490 2024-09-21T06:40:55.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.372+0000 7fbdb3c2f740 10 client.16437 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:40:55.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.372+0000 7fbdb3c2f740 10 client.16437 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:40:55.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.372+0000 7fbdb3c2f740 20 client.16437 populate_metadata read hostname 'smithi007' 2024-09-21T06:40:55.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.372+0000 7fbdb3c2f740 1 --2- 172.21.15.7:0/3092842770 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55d673e5c080 0x55d6742fa5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:55.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.372+0000 7fbdb3c2f740 4 client.16437 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:40:55.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.372+0000 7fbdb3c2f740 1 -- 172.21.15.7:0/3092842770 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55d6741e3860 con 0x55d673e5c080 2024-09-21T06:40:55.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.372+0000 7fbda67fc640 1 --2- 172.21.15.7:0/3092842770 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55d673e5c080 0x55d6742fa5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:55.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.373+0000 7fbd8e7fc640 10 client.16437 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:40:55.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.373+0000 7fbda67fc640 1 --2- 172.21.15.7:0/3092842770 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55d673e5c080 0x55d6742fa5d0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a851e1f80e4ff388 server_cookie=12b16b2bb12091e6 in_seq=0 out_seq=0 2024-09-21T06:40:55.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.375+0000 7fbd8e7fc640 1 -- 172.21.15.7:0/3092842770 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55d6741e3860 con 0x55d673e5c080 2024-09-21T06:40:55.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.375+0000 7fbd8e7fc640 10 client.16437 handle_command_reply: tid=0 2024-09-21T06:40:55.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.375+0000 7fbdb3c2f740 1 client.16437 shutdown 2024-09-21T06:40:55.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.375+0000 7fbdb3c2f740 1 -- 172.21.15.7:0/3092842770 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d673e9f490 msgr2=0x55d6742836b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:55.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.375+0000 7fbdb3c2f740 1 --2- 172.21.15.7:0/3092842770 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d673e9f490 0x55d6742836b0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fbda00acee0 tx=0x7fbda000bf60 comp rx=0 tx=0).stop 2024-09-21T06:40:55.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.375+0000 7fbdb3c2f740 1 -- 172.21.15.7:0/3092842770 shutdown_connections 2024-09-21T06:40:55.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.375+0000 7fbdb3c2f740 1 --2- 172.21.15.7:0/3092842770 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55d673e5c080 0x55d6742fa5d0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:55.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.375+0000 7fbdb3c2f740 1 --2- 172.21.15.7:0/3092842770 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d673ec8350 0x55d67427f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:55.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.375+0000 7fbdb3c2f740 1 --2- 172.21.15.7:0/3092842770 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d673ea7670 0x55d67427ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:55.378 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.375+0000 7fbdb3c2f740 1 --2- 172.21.15.7:0/3092842770 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d673e9f490 0x55d6742836b0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:55.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.375+0000 7fbdb3c2f740 1 -- 172.21.15.7:0/3092842770 >> 172.21.15.7:0/3092842770 conn(0x55d673ebc740 msgr2=0x55d67427cc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:55.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.375+0000 7fbd8e7fc640 0 client.16437 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:40:55.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.375+0000 7fbdb3c2f740 1 -- 172.21.15.7:0/3092842770 shutdown_connections 2024-09-21T06:40:55.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.375+0000 7fbdb3c2f740 1 -- 172.21.15.7:0/3092842770 wait complete. 2024-09-21T06:40:55.379 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.375+0000 7fbdb3c2f740 20 client.16437 trim_cache size 0 max 16384 2024-09-21T06:40:55.379 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:40:55.379 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0, 2024-09-21T06:40:55.379 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_tag": "310a0ec8-44bb-49ed-a534-3bc91cb1ee9d", 2024-09-21T06:40:55.379 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": "asynchronous" 2024-09-21T06:40:55.379 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:40:55.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.376+0000 7fbdad6bb640 1 -- 172.21.15.7:0/2619553088 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fbd940b6680 msgr2=0x7fbd940b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:55.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.376+0000 7fbdad6bb640 1 --2- 172.21.15.7:0/2619553088 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fbd940b6680 0x7fbd940b8b90 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fbda806bf40 tx=0x7fbd9800a4d0 comp rx=0 tx=0).stop 2024-09-21T06:40:55.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.376+0000 7fbdad6bb640 1 -- 172.21.15.7:0/2619553088 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbda8102a60 msgr2=0x7fbda819b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:55.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.376+0000 7fbdad6bb640 1 --2- 172.21.15.7:0/2619553088 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbda8102a60 0x7fbda819b2f0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fbda000d950 tx=0x7fbda000de10 comp rx=0 tx=0).stop 2024-09-21T06:40:55.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.376+0000 7fbdad6bb640 1 -- 172.21.15.7:0/2619553088 shutdown_connections 2024-09-21T06:40:55.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.376+0000 7fbdad6bb640 1 --2- 172.21.15.7:0/2619553088 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fbd940b6680 0x7fbd940b8b90 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:55.380 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.376+0000 7fbdad6bb640 1 --2- 172.21.15.7:0/2619553088 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbda8108cf0 0x7fbda819bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:55.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.376+0000 7fbdad6bb640 1 --2- 172.21.15.7:0/2619553088 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbda81083a0 0x7fbda819b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:55.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.376+0000 7fbdad6bb640 1 --2- 172.21.15.7:0/2619553088 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbda8102a60 0x7fbda819b2f0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:55.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.376+0000 7fbdad6bb640 1 -- 172.21.15.7:0/2619553088 >> 172.21.15.7:0/2619553088 conn(0x7fbda8079730 msgr2=0x7fbda8104510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:55.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.376+0000 7fbdad6bb640 1 -- 172.21.15.7:0/2619553088 shutdown_connections 2024-09-21T06:40:55.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:55.376+0000 7fbdad6bb640 1 -- 172.21.15.7:0/2619553088 wait complete. 2024-09-21T06:40:56.137 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:40:56.398 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:40:56.661 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:40:56 smithi007 ceph-mon[30983]: pgmap v461: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:40:56.661 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:40:56 smithi007 ceph-mon[30983]: scrub queued for path: / 2024-09-21T06:40:56.661 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:40:56 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T06:40:56.661 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:40:56 smithi007 ceph-mon[30983]: scrub summary: active paths [/] 2024-09-21T06:40:56.661 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:40:56 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T06:40:56.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:40:56 smithi144 ceph-mon[34653]: pgmap v461: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:40:56.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:40:56 smithi144 ceph-mon[34653]: scrub queued for path: / 2024-09-21T06:40:56.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:40:56 smithi144 ceph-mon[34653]: scrub summary: idle+waiting paths [/] 2024-09-21T06:40:56.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:40:56 smithi144 ceph-mon[34653]: scrub summary: active paths [/] 2024-09-21T06:40:56.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:40:56 smithi144 ceph-mon[34653]: scrub summary: idle+waiting paths [/] 2024-09-21T06:40:56.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:40:56 smithi018 ceph-mon[34477]: pgmap v461: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:40:56.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:40:56 smithi018 ceph-mon[34477]: scrub queued for path: / 2024-09-21T06:40:56.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:40:56 smithi018 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-21T06:40:56.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:40:56 smithi018 ceph-mon[34477]: scrub summary: active paths [/] 2024-09-21T06:40:56.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:40:56 smithi018 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-21T06:40:56.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.878+0000 7fe4a706d640 1 -- 172.21.15.7:0/128969699 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe4a01083c0 msgr2=0x7fe4a01087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:56.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.878+0000 7fe4a706d640 1 --2- 172.21.15.7:0/128969699 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe4a01083c0 0x7fe4a01087d0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fe490009900 tx=0x7fe49002a410 comp rx=0 tx=0).stop 2024-09-21T06:40:56.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.878+0000 7fe4a706d640 1 -- 172.21.15.7:0/128969699 shutdown_connections 2024-09-21T06:40:56.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.878+0000 7fe4a706d640 1 --2- 172.21.15.7:0/128969699 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4a0108d10 0x7fe4a010f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:56.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.878+0000 7fe4a706d640 1 --2- 172.21.15.7:0/128969699 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe4a01083c0 0x7fe4a01087d0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:56.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.878+0000 7fe4a706d640 1 --2- 172.21.15.7:0/128969699 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe4a0102a80 0x7fe4a0102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:56.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.878+0000 7fe4a706d640 1 -- 172.21.15.7:0/128969699 >> 172.21.15.7:0/128969699 conn(0x7fe4a0079740 msgr2=0x7fe4a0079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:56.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.878+0000 7fe4a706d640 1 -- 172.21.15.7:0/128969699 shutdown_connections 2024-09-21T06:40:56.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.879+0000 7fe4a706d640 1 -- 172.21.15.7:0/128969699 wait complete. 2024-09-21T06:40:56.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.879+0000 7fe4a706d640 1 Processor -- start 2024-09-21T06:40:56.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.879+0000 7fe4a706d640 1 -- start start 2024-09-21T06:40:56.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.880+0000 7fe4a706d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe4a0102a80 0x7fe4a00ff690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:56.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.880+0000 7fe4a706d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe4a01083c0 0x7fe4a00ffbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:56.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.880+0000 7fe4a706d640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4a0108d10 0x7fe4a0100110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:56.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.880+0000 7fe4a706d640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe4a0112980 con 0x7fe4a01083c0 2024-09-21T06:40:56.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.880+0000 7fe4a706d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe4a0112800 con 0x7fe4a0102a80 2024-09-21T06:40:56.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.880+0000 7fe4a706d640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe4a0112b00 con 0x7fe4a0108d10 2024-09-21T06:40:56.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.880+0000 7fe497fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe4a01083c0 0x7fe4a00ffbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:56.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.880+0000 7fe497fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe4a01083c0 0x7fe4a00ffbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42012/0 (socket says 172.21.15.7:42012) 2024-09-21T06:40:56.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.880+0000 7fe497fff640 1 -- 172.21.15.7:0/929129254 learned_addr learned my addr 172.21.15.7:0/929129254 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:40:56.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.880+0000 7fe4a560a640 1 --2- 172.21.15.7:0/929129254 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4a0108d10 0x7fe4a0100110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:56.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.880+0000 7fe4a4e09640 1 --2- 172.21.15.7:0/929129254 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe4a0102a80 0x7fe4a00ff690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:56.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.880+0000 7fe497fff640 1 -- 172.21.15.7:0/929129254 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4a0108d10 msgr2=0x7fe4a0100110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:56.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.880+0000 7fe497fff640 1 --2- 172.21.15.7:0/929129254 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4a0108d10 0x7fe4a0100110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:56.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.880+0000 7fe497fff640 1 -- 172.21.15.7:0/929129254 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe4a0102a80 msgr2=0x7fe4a00ff690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:56.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.880+0000 7fe497fff640 1 --2- 172.21.15.7:0/929129254 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe4a0102a80 0x7fe4a00ff690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:56.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.880+0000 7fe497fff640 1 -- 172.21.15.7:0/929129254 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4a01a8740 con 0x7fe4a01083c0 2024-09-21T06:40:56.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.880+0000 7fe4a560a640 1 --2- 172.21.15.7:0/929129254 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4a0108d10 0x7fe4a0100110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:40:56.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.880+0000 7fe4a4e09640 1 --2- 172.21.15.7:0/929129254 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe4a0102a80 0x7fe4a00ff690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:40:56.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.880+0000 7fe497fff640 1 --2- 172.21.15.7:0/929129254 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe4a01083c0 0x7fe4a00ffbd0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fe490032fd0 tx=0x7fe490004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:56.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.881+0000 7fe495ffb640 1 -- 172.21.15.7:0/929129254 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe49003f030 con 0x7fe4a01083c0 2024-09-21T06:40:56.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.881+0000 7fe4a706d640 1 -- 172.21.15.7:0/929129254 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4a01a89d0 con 0x7fe4a01083c0 2024-09-21T06:40:56.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.881+0000 7fe495ffb640 1 -- 172.21.15.7:0/929129254 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe490004490 con 0x7fe4a01083c0 2024-09-21T06:40:56.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.881+0000 7fe495ffb640 1 -- 172.21.15.7:0/929129254 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe490035070 con 0x7fe4a01083c0 2024-09-21T06:40:56.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.881+0000 7fe4a706d640 1 -- 172.21.15.7:0/929129254 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4a01a8eb0 con 0x7fe4a01083c0 2024-09-21T06:40:56.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.883+0000 7fe4ad5e1740 1 Processor -- start 2024-09-21T06:40:56.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.883+0000 7fe4ad5e1740 1 -- start start 2024-09-21T06:40:56.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.884+0000 7fe4ad5e1740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55833f64f070 0x55833f9f6270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:56.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.884+0000 7fe4ad5e1740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55833f6261b0 0x55833f9f67b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:56.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.884+0000 7fe4ad5e1740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55833f62e390 0x55833f9f6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:56.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.884+0000 7fe4ad5e1740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55833f96ce50 con 0x55833f64f070 2024-09-21T06:40:56.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.884+0000 7fe4ad5e1740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55833f95c280 con 0x55833f62e390 2024-09-21T06:40:56.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.884+0000 7fe4ad5e1740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55833f960090 con 0x55833f6261b0 2024-09-21T06:40:56.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.884+0000 7fe495ffb640 1 -- 172.21.15.7:0/929129254 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7fe490042030 con 0x7fe4a01083c0 2024-09-21T06:40:56.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.884+0000 7fe4a560a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55833f64f070 0x55833f9f6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:56.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.884+0000 7fe4a560a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55833f64f070 0x55833f9f6270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42018/0 (socket says 172.21.15.7:42018) 2024-09-21T06:40:56.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.884+0000 7fe4a560a640 1 -- 172.21.15.7:0/3796050227 learned_addr learned my addr 172.21.15.7:0/3796050227 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:40:56.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.884+0000 7fe4a4e09640 1 --2- 172.21.15.7:0/3796050227 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55833f6261b0 0x55833f9f67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:56.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.884+0000 7fe497fff640 1 --2- 172.21.15.7:0/3796050227 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55833f62e390 0x55833f9f6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:56.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.884+0000 7fe4a560a640 1 -- 172.21.15.7:0/3796050227 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55833f6261b0 msgr2=0x55833f9f67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:56.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.884+0000 7fe4a560a640 1 --2- 172.21.15.7:0/3796050227 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55833f6261b0 0x55833f9f67b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:56.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.884+0000 7fe4a560a640 1 -- 172.21.15.7:0/3796050227 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55833f62e390 msgr2=0x55833f9f6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:56.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.884+0000 7fe4a560a640 1 --2- 172.21.15.7:0/3796050227 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55833f62e390 0x55833f9f6cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:56.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.884+0000 7fe4a560a640 1 -- 172.21.15.7:0/3796050227 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55833f6ba650 con 0x55833f64f070 2024-09-21T06:40:56.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.884+0000 7fe497fff640 1 --2- 172.21.15.7:0/3796050227 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55833f62e390 0x55833f9f6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:40:56.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.884+0000 7fe4a560a640 1 --2- 172.21.15.7:0/3796050227 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55833f64f070 0x55833f9f6270 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fe498009fb0 tx=0x7fe498010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ead35f040ad7334 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:56.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.885+0000 7fe486ffd640 1 -- 172.21.15.7:0/3796050227 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe498016070 con 0x55833f64f070 2024-09-21T06:40:56.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.885+0000 7fe486ffd640 1 -- 172.21.15.7:0/3796050227 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe498012bc0 con 0x55833f64f070 2024-09-21T06:40:56.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.885+0000 7fe486ffd640 1 -- 172.21.15.7:0/3796050227 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe49801bcb0 con 0x55833f64f070 2024-09-21T06:40:56.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.885+0000 7fe495ffb640 1 --2- 172.21.15.7:0/929129254 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fe4880b6680 0x7fe4880b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:56.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.885+0000 7fe4a4e09640 1 --2- 172.21.15.7:0/929129254 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fe4880b6680 0x7fe4880b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:56.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.885+0000 7fe495ffb640 1 -- 172.21.15.7:0/929129254 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fe490107c90 con 0x7fe4a01083c0 2024-09-21T06:40:56.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.886+0000 7fe4a4e09640 1 --2- 172.21.15.7:0/929129254 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fe4880b6680 0x7fe4880b8b90 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x55833f9f4ef0 tx=0x7fe49c00b5c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:56.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.886+0000 7fe4ad5e1740 1 -- 172.21.15.7:0/3796050227 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55833f64f070 msgr2=0x55833f9f6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:56.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.886+0000 7fe4ad5e1740 1 --2- 172.21.15.7:0/3796050227 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55833f64f070 0x55833f9f6270 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fe498009fb0 tx=0x7fe498010800 comp rx=0 tx=0).stop 2024-09-21T06:40:56.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.886+0000 7fe4ad5e1740 1 -- 172.21.15.7:0/3796050227 shutdown_connections 2024-09-21T06:40:56.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.886+0000 7fe4ad5e1740 1 --2- 172.21.15.7:0/3796050227 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55833f62e390 0x55833f9f6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:56.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.886+0000 7fe4ad5e1740 1 --2- 172.21.15.7:0/3796050227 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55833f6261b0 0x55833f9f67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:56.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.886+0000 7fe4ad5e1740 1 --2- 172.21.15.7:0/3796050227 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55833f64f070 0x55833f9f6270 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:56.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.886+0000 7fe4ad5e1740 1 -- 172.21.15.7:0/3796050227 >> 172.21.15.7:0/3796050227 conn(0x55833f643460 msgr2=0x55833f9f4160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:56.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.886+0000 7fe4ad5e1740 1 -- 172.21.15.7:0/3796050227 shutdown_connections 2024-09-21T06:40:56.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.886+0000 7fe4ad5e1740 1 -- 172.21.15.7:0/3796050227 wait complete. 2024-09-21T06:40:56.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.886+0000 7fe4ad5e1740 1 -- start start 2024-09-21T06:40:56.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.886+0000 7fe4ad5e1740 1 Processor -- start 2024-09-21T06:40:56.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.887+0000 7fe4ad5e1740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55833f6261b0 0x55833fa018d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:56.897 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.887+0000 7fe4ad5e1740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55833f62e390 0x55833fa01e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:56.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.887+0000 7fe4ad5e1740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55833f64f070 0x55833fa0dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:56.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.887+0000 7fe4ad5e1740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55833f7bd700 con 0x55833f6261b0 2024-09-21T06:40:56.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.887+0000 7fe4ad5e1740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55833f8f7110 con 0x55833f62e390 2024-09-21T06:40:56.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.887+0000 7fe4ad5e1740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55833fa04a50 con 0x55833f64f070 2024-09-21T06:40:56.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.887+0000 7fe4ad5e1740 10 client.0 _ll_register_callbacks cb 0x55833f910990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:40:56.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.887+0000 7fe4a4e09640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55833f6261b0 0x55833fa018d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:56.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.887+0000 7fe4a4e09640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55833f6261b0 0x55833fa018d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42022/0 (socket says 172.21.15.7:42022) 2024-09-21T06:40:56.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.887+0000 7fe4a4e09640 1 -- 172.21.15.7:0/1232758810 learned_addr learned my addr 172.21.15.7:0/1232758810 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:40:56.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.887+0000 7fe497fff640 1 --2- 172.21.15.7:0/1232758810 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55833f62e390 0x55833fa01e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:56.898 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.887+0000 7fe4a560a640 1 --2- 172.21.15.7:0/1232758810 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55833f64f070 0x55833fa0dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:56.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.887+0000 7fe4a4e09640 1 -- 172.21.15.7:0/1232758810 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55833f64f070 msgr2=0x55833fa0dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:56.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.887+0000 7fe4a4e09640 1 --2- 172.21.15.7:0/1232758810 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55833f64f070 0x55833fa0dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:56.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.887+0000 7fe4a4e09640 1 -- 172.21.15.7:0/1232758810 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55833f62e390 msgr2=0x55833fa01e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:56.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.887+0000 7fe4a4e09640 1 --2- 172.21.15.7:0/1232758810 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55833f62e390 0x55833fa01e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:56.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.887+0000 7fe4a4e09640 1 -- 172.21.15.7:0/1232758810 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55833f924c40 con 0x55833f6261b0 2024-09-21T06:40:56.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.888+0000 7fe4a4e09640 1 --2- 172.21.15.7:0/1232758810 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55833f6261b0 0x55833fa018d0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fe49c0043c0 tx=0x7fe49c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbde500091367130 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:56.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.888+0000 7fe47ffff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:40:56.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.888+0000 7fe47ffff640 1 -- 172.21.15.7:0/1232758810 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe49c01f800 con 0x55833f6261b0 2024-09-21T06:40:56.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.888+0000 7fe47ffff640 1 -- 172.21.15.7:0/1232758810 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fe49c01f9a0 con 0x55833f6261b0 2024-09-21T06:40:56.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.888+0000 7fe4ad5e1740 1 -- 172.21.15.7:0/1232758810 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe498012bc0 con 0x55833f6261b0 2024-09-21T06:40:56.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.888+0000 7fe47ffff640 1 -- 172.21.15.7:0/1232758810 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe49c02c020 con 0x55833f6261b0 2024-09-21T06:40:56.899 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.888+0000 7fe4ad5e1740 10 client.16449 fetch_fsmap learned FSMap version 25 2024-09-21T06:40:56.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.888+0000 7fe4ad5e1740 1 -- 172.21.15.7:0/1232758810 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55833fa106d0 con 0x55833f6261b0 2024-09-21T06:40:56.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.888+0000 7fe47ffff640 1 -- 172.21.15.7:0/1232758810 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe498012bc0 con 0x55833f6261b0 2024-09-21T06:40:56.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.889+0000 7fe47ffff640 1 -- 172.21.15.7:0/1232758810 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fe49c031bc0 con 0x55833f6261b0 2024-09-21T06:40:56.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.889+0000 7fe4ad5e1740 10 client.16449 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:40:56.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.889+0000 7fe4ad5e1740 10 client.16449 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:40:56.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.889+0000 7fe4ad5e1740 20 client.16449 populate_metadata read hostname 'smithi007' 2024-09-21T06:40:56.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.889+0000 7fe4ad5e1740 1 --2- 172.21.15.7:0/1232758810 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55833f60d9f0 0x55833fa13c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:56.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.889+0000 7fe4ad5e1740 4 client.16449 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:40:56.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.889+0000 7fe4ad5e1740 1 -- 172.21.15.7:0/1232758810 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55833f96eda0 con 0x55833f60d9f0 2024-09-21T06:40:56.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.889+0000 7fe497fff640 1 --2- 172.21.15.7:0/1232758810 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55833f60d9f0 0x55833fa13c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:56.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.889+0000 7fe497fff640 1 --2- 172.21.15.7:0/1232758810 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55833f60d9f0 0x55833fa13c10 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e9a13b1309de6da server_cookie=b6f94b8cf5bbc6a2 in_seq=0 out_seq=0 2024-09-21T06:40:56.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.889+0000 7fe47ffff640 10 client.16449 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:40:56.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.890+0000 7fe47ffff640 1 -- 172.21.15.7:0/1232758810 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55833f96eda0 con 0x55833f60d9f0 2024-09-21T06:40:56.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.890+0000 7fe47ffff640 10 client.16449 handle_command_reply: tid=0 2024-09-21T06:40:56.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.890+0000 7fe4ad5e1740 1 client.16449 shutdown 2024-09-21T06:40:56.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.890+0000 7fe4ad5e1740 1 -- 172.21.15.7:0/1232758810 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55833f6261b0 msgr2=0x55833fa018d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:56.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.890+0000 7fe4ad5e1740 1 --2- 172.21.15.7:0/1232758810 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55833f6261b0 0x55833fa018d0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fe49c0043c0 tx=0x7fe49c0046c0 comp rx=0 tx=0).stop 2024-09-21T06:40:56.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.890+0000 7fe4ad5e1740 1 -- 172.21.15.7:0/1232758810 shutdown_connections 2024-09-21T06:40:56.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.890+0000 7fe4ad5e1740 1 --2- 172.21.15.7:0/1232758810 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55833f60d9f0 0x55833fa13c10 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:56.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.890+0000 7fe4ad5e1740 1 --2- 172.21.15.7:0/1232758810 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55833f64f070 0x55833fa0dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:56.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.890+0000 7fe4ad5e1740 1 --2- 172.21.15.7:0/1232758810 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55833f62e390 0x55833fa01e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:56.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.890+0000 7fe47ffff640 0 client.16449 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:40:56.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.890+0000 7fe4ad5e1740 1 --2- 172.21.15.7:0/1232758810 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55833f6261b0 0x55833fa018d0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:56.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.890+0000 7fe4ad5e1740 1 -- 172.21.15.7:0/1232758810 >> 172.21.15.7:0/1232758810 conn(0x55833f643460 msgr2=0x55833f9f9450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:56.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.891+0000 7fe4ad5e1740 1 -- 172.21.15.7:0/1232758810 shutdown_connections 2024-09-21T06:40:56.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.891+0000 7fe4ad5e1740 1 -- 172.21.15.7:0/1232758810 wait complete. 2024-09-21T06:40:56.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.891+0000 7fe4ad5e1740 20 client.16449 trim_cache size 0 max 16384 2024-09-21T06:40:56.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.908+0000 7fe4ad5e1740 1 Processor -- start 2024-09-21T06:40:56.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.908+0000 7fe4ad5e1740 1 -- start start 2024-09-21T06:40:56.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.908+0000 7fe4ad5e1740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55833f6261b0 0x55833fa01d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:56.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.908+0000 7fe4ad5e1740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55833f62e390 0x55833fa0dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:56.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.908+0000 7fe4ad5e1740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55833f64f070 0x55833f9feac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:56.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.908+0000 7fe4ad5e1740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe4a01b3ff0 con 0x55833f62e390 2024-09-21T06:40:56.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.908+0000 7fe4ad5e1740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe4a01b18c0 con 0x55833f6261b0 2024-09-21T06:40:56.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.908+0000 7fe4ad5e1740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe4a01af6f0 con 0x55833f64f070 2024-09-21T06:40:56.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.908+0000 7fe497fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55833f62e390 0x55833fa0dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:56.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.908+0000 7fe497fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55833f62e390 0x55833fa0dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42026/0 (socket says 172.21.15.7:42026) 2024-09-21T06:40:56.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.908+0000 7fe497fff640 1 -- 172.21.15.7:0/660576933 learned_addr learned my addr 172.21.15.7:0/660576933 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:40:56.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.909+0000 7fe4a4e09640 1 --2- 172.21.15.7:0/660576933 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55833f6261b0 0x55833fa01d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:56.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.909+0000 7fe4a560a640 1 --2- 172.21.15.7:0/660576933 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55833f64f070 0x55833f9feac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:56.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.909+0000 7fe497fff640 1 -- 172.21.15.7:0/660576933 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55833f64f070 msgr2=0x55833f9feac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:56.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.909+0000 7fe497fff640 1 --2- 172.21.15.7:0/660576933 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55833f64f070 0x55833f9feac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:56.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.909+0000 7fe497fff640 1 -- 172.21.15.7:0/660576933 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55833f6261b0 msgr2=0x55833fa01d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:56.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.909+0000 7fe497fff640 1 --2- 172.21.15.7:0/660576933 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55833f6261b0 0x55833fa01d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:56.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.909+0000 7fe497fff640 1 -- 172.21.15.7:0/660576933 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55833fa00830 con 0x55833f62e390 2024-09-21T06:40:56.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.909+0000 7fe4a4e09640 1 --2- 172.21.15.7:0/660576933 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55833f6261b0 0x55833fa01d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:40:56.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.909+0000 7fe497fff640 1 --2- 172.21.15.7:0/660576933 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55833f62e390 0x55833fa0dc40 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fe490031440 tx=0x7fe490000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12044ee5699e92f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:56.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.909+0000 7fe4867fc640 1 -- 172.21.15.7:0/660576933 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe490049040 con 0x55833f62e390 2024-09-21T06:40:56.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.909+0000 7fe4867fc640 1 -- 172.21.15.7:0/660576933 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe4900cd690 con 0x55833f62e390 2024-09-21T06:40:56.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.909+0000 7fe4867fc640 1 -- 172.21.15.7:0/660576933 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4900c9df0 con 0x55833f62e390 2024-09-21T06:40:56.916 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.910+0000 7fe4ad5e1740 1 -- 172.21.15.7:0/660576933 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55833f62e390 msgr2=0x55833fa0dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:56.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.910+0000 7fe4ad5e1740 1 --2- 172.21.15.7:0/660576933 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55833f62e390 0x55833fa0dc40 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fe490031440 tx=0x7fe490000bc0 comp rx=0 tx=0).stop 2024-09-21T06:40:56.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.910+0000 7fe4ad5e1740 1 -- 172.21.15.7:0/660576933 shutdown_connections 2024-09-21T06:40:56.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.910+0000 7fe4ad5e1740 1 --2- 172.21.15.7:0/660576933 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55833f64f070 0x55833f9feac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:56.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.910+0000 7fe4ad5e1740 1 --2- 172.21.15.7:0/660576933 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55833f62e390 0x55833fa0dc40 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:56.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.910+0000 7fe4ad5e1740 1 --2- 172.21.15.7:0/660576933 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55833f6261b0 0x55833fa01d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:56.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.910+0000 7fe4ad5e1740 1 -- 172.21.15.7:0/660576933 >> 172.21.15.7:0/660576933 conn(0x55833f643460 msgr2=0x55833fa01680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:56.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.910+0000 7fe4ad5e1740 1 -- 172.21.15.7:0/660576933 shutdown_connections 2024-09-21T06:40:56.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.910+0000 7fe4ad5e1740 1 -- 172.21.15.7:0/660576933 wait complete. 2024-09-21T06:40:56.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.911+0000 7fe4ad5e1740 1 -- start start 2024-09-21T06:40:56.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.911+0000 7fe4ad5e1740 1 Processor -- start 2024-09-21T06:40:56.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.911+0000 7fe4ad5e1740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55833f6261b0 0x55833fa05ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:56.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.911+0000 7fe4ad5e1740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55833f62e390 0x55833fa06430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:56.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.911+0000 7fe4ad5e1740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55833f64f070 0x55833fa7d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:56.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.911+0000 7fe4ad5e1740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe4a01afd80 con 0x55833f64f070 2024-09-21T06:40:56.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.911+0000 7fe4ad5e1740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe4a01b11f0 con 0x55833f6261b0 2024-09-21T06:40:56.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.911+0000 7fe4ad5e1740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe4a01b0450 con 0x55833f62e390 2024-09-21T06:40:56.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.911+0000 7fe4ad5e1740 10 client.0 _ll_register_callbacks cb 0x7fe49c00b7e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:40:56.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.911+0000 7fe4a560a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55833f64f070 0x55833fa7d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:56.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.911+0000 7fe4a560a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55833f64f070 0x55833fa7d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42042/0 (socket says 172.21.15.7:42042) 2024-09-21T06:40:56.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.911+0000 7fe4a560a640 1 -- 172.21.15.7:0/1156348136 learned_addr learned my addr 172.21.15.7:0/1156348136 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:40:56.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.912+0000 7fe497fff640 1 --2- 172.21.15.7:0/1156348136 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55833f62e390 0x55833fa06430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:56.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.912+0000 7fe4a4e09640 1 --2- 172.21.15.7:0/1156348136 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55833f6261b0 0x55833fa05ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:56.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.912+0000 7fe4a560a640 1 -- 172.21.15.7:0/1156348136 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55833f62e390 msgr2=0x55833fa06430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:56.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.912+0000 7fe4a560a640 1 --2- 172.21.15.7:0/1156348136 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55833f62e390 0x55833fa06430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:56.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.912+0000 7fe4a560a640 1 -- 172.21.15.7:0/1156348136 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55833f6261b0 msgr2=0x55833fa05ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:40:56.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.912+0000 7fe4a560a640 1 --2- 172.21.15.7:0/1156348136 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55833f6261b0 0x55833fa05ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:56.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.912+0000 7fe4a560a640 1 -- 172.21.15.7:0/1156348136 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55833fa06c40 con 0x55833f64f070 2024-09-21T06:40:56.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.912+0000 7fe4a560a640 1 --2- 172.21.15.7:0/1156348136 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55833f64f070 0x55833fa7d5d0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fe498009f80 tx=0x7fe49801b690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21f2c7720c3da313 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:40:56.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.912+0000 7fe47ffff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:40:56.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.912+0000 7fe47ffff640 1 -- 172.21.15.7:0/1156348136 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe498016040 con 0x55833f64f070 2024-09-21T06:40:56.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.912+0000 7fe47ffff640 1 -- 172.21.15.7:0/1156348136 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fe498004c10 con 0x55833f64f070 2024-09-21T06:40:56.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.912+0000 7fe4ad5e1740 1 -- 172.21.15.7:0/1156348136 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe4900cd690 con 0x55833f64f070 2024-09-21T06:40:56.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.913+0000 7fe47ffff640 1 -- 172.21.15.7:0/1156348136 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe498035050 con 0x55833f64f070 2024-09-21T06:40:56.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.913+0000 7fe4ad5e1740 10 client.16455 fetch_fsmap learned FSMap version 25 2024-09-21T06:40:56.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.913+0000 7fe4ad5e1740 1 -- 172.21.15.7:0/1156348136 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55833fa7ea80 con 0x55833f64f070 2024-09-21T06:40:56.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.913+0000 7fe47ffff640 1 -- 172.21.15.7:0/1156348136 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe4900cd690 con 0x55833f64f070 2024-09-21T06:40:56.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.913+0000 7fe47ffff640 1 -- 172.21.15.7:0/1156348136 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fe49800f040 con 0x55833f64f070 2024-09-21T06:40:56.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.913+0000 7fe4ad5e1740 10 client.16455 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:40:56.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.913+0000 7fe4ad5e1740 10 client.16455 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:40:56.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.913+0000 7fe4ad5e1740 20 client.16455 populate_metadata read hostname 'smithi007' 2024-09-21T06:40:56.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.913+0000 7fe4ad5e1740 1 --2- 172.21.15.7:0/1156348136 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55833f5e2da0 0x55833fa81130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:40:56.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.913+0000 7fe4ad5e1740 4 client.16455 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:40:56.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.913+0000 7fe4ad5e1740 1 -- 172.21.15.7:0/1156348136 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55833f96a850 con 0x55833f5e2da0 2024-09-21T06:40:56.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.913+0000 7fe4a4e09640 1 --2- 172.21.15.7:0/1156348136 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55833f5e2da0 0x55833fa81130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:40:56.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.914+0000 7fe4a4e09640 1 --2- 172.21.15.7:0/1156348136 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55833f5e2da0 0x55833fa81130 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab1376ebe97de0e4 server_cookie=46ff021383c7e38f in_seq=0 out_seq=0 2024-09-21T06:40:56.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.914+0000 7fe47ffff640 10 client.16455 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:40:56.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.914+0000 7fe47ffff640 1 -- 172.21.15.7:0/1156348136 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2558 (crc 0 0 0) 0x55833f96a850 con 0x55833f5e2da0 2024-09-21T06:40:56.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.914+0000 7fe47ffff640 10 client.16455 handle_command_reply: tid=0 2024-09-21T06:40:56.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.914+0000 7fe4ad5e1740 1 client.16455 shutdown 2024-09-21T06:40:56.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.914+0000 7fe4ad5e1740 1 -- 172.21.15.7:0/1156348136 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55833f64f070 msgr2=0x55833fa7d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:56.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.914+0000 7fe4ad5e1740 1 --2- 172.21.15.7:0/1156348136 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55833f64f070 0x55833fa7d5d0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fe498009f80 tx=0x7fe49801b690 comp rx=0 tx=0).stop 2024-09-21T06:40:56.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.914+0000 7fe4ad5e1740 1 -- 172.21.15.7:0/1156348136 shutdown_connections 2024-09-21T06:40:56.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.914+0000 7fe4ad5e1740 1 --2- 172.21.15.7:0/1156348136 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55833f5e2da0 0x55833fa81130 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:56.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.914+0000 7fe4ad5e1740 1 --2- 172.21.15.7:0/1156348136 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55833f64f070 0x55833fa7d5d0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:56.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.915+0000 7fe4ad5e1740 1 --2- 172.21.15.7:0/1156348136 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55833f62e390 0x55833fa06430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:56.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.915+0000 7fe47ffff640 0 client.16455 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:40:56.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.915+0000 7fe4ad5e1740 1 --2- 172.21.15.7:0/1156348136 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55833f6261b0 0x55833fa05ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:56.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.915+0000 7fe4ad5e1740 1 -- 172.21.15.7:0/1156348136 >> 172.21.15.7:0/1156348136 conn(0x55833f643460 msgr2=0x55833f9f72a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:56.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.915+0000 7fe4ad5e1740 1 -- 172.21.15.7:0/1156348136 shutdown_connections 2024-09-21T06:40:56.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.915+0000 7fe4ad5e1740 1 -- 172.21.15.7:0/1156348136 wait complete. 2024-09-21T06:40:56.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.915+0000 7fe4ad5e1740 20 client.16455 trim_cache size 0 max 16384 2024-09-21T06:40:56.922 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:40:56.922 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T06:40:56.922 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": { 2024-09-21T06:40:56.923 INFO:teuthology.orchestra.run.smithi007.stdout: "310a0ec8-44bb-49ed-a534-3bc91cb1ee9d": { 2024-09-21T06:40:56.923 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:40:56.923 INFO:teuthology.orchestra.run.smithi007.stdout: "tag": "310a0ec8-44bb-49ed-a534-3bc91cb1ee9d", 2024-09-21T06:40:56.923 INFO:teuthology.orchestra.run.smithi007.stdout: "options": "recursive,force" 2024-09-21T06:40:56.923 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:40:56.923 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:40:56.923 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_stats": { 2024-09-21T06:40:56.923 INFO:teuthology.orchestra.run.smithi007.stdout: "62fca477-b241-45f5-8185-bc78aeb8b19f": { 2024-09-21T06:40:56.923 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:40:12.744488+0000", 2024-09-21T06:40:56.923 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:40:56.923 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:40:56.924 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:40:56.924 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:40:56.924 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:40:56.924 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:40:56.924 INFO:teuthology.orchestra.run.smithi007.stdout: "d7b6a90c-9ae1-4e02-93ad-335a7e9df1d7": { 2024-09-21T06:40:56.924 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:39:19.226139+0000", 2024-09-21T06:40:56.924 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:40:56.924 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:40:56.924 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:40:56.924 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:40:56.924 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:40:56.924 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:40:56.924 INFO:teuthology.orchestra.run.smithi007.stdout: "b0327167-8c41-4286-8afc-7f0780972fd7": { 2024-09-21T06:40:56.925 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:38:36.828657+0000", 2024-09-21T06:40:56.925 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:40:56.925 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:40:56.925 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:40:56.925 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:40:56.925 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:40:56.925 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:40:56.925 INFO:teuthology.orchestra.run.smithi007.stdout: "13441782-2231-4713-8ebd-068a941de47f": { 2024-09-21T06:40:56.925 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:39:30.219006+0000", 2024-09-21T06:40:56.925 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:40:56.925 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:40:56.925 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:40:56.926 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:40:56.926 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:40:56.926 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:40:56.926 INFO:teuthology.orchestra.run.smithi007.stdout: "5cbaaba2-6ab1-4f83-abd6-8c6eef4b5c42": { 2024-09-21T06:40:56.926 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:37:46.566272+0000", 2024-09-21T06:40:56.926 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:40:56.926 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:40:56.926 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:40:56.926 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:40:56.926 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:40:56.926 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:40:56.926 INFO:teuthology.orchestra.run.smithi007.stdout: "6231e9c1-14a2-40b5-be3c-76d87a0d733b": { 2024-09-21T06:40:56.927 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:37:02.484812+0000", 2024-09-21T06:40:56.927 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:40:56.927 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:40:56.927 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:40:56.927 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:40:56.927 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:40:56.927 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:40:56.927 INFO:teuthology.orchestra.run.smithi007.stdout: "310a0ec8-44bb-49ed-a534-3bc91cb1ee9d": { 2024-09-21T06:40:56.927 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:40:55.373968+0000", 2024-09-21T06:40:56.927 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:40:56.927 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:40:56.927 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:40:56.928 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:40:56.928 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:40:56.928 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:40:56.928 INFO:teuthology.orchestra.run.smithi007.stdout: "0b89345c-1f00-4efe-8ee9-4cb17e43584c": { 2024-09-21T06:40:56.928 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:36:19.500334+0000", 2024-09-21T06:40:56.928 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:40:56.928 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:40:56.928 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:40:56.928 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:40:56.928 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:40:56.928 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:40:56.928 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:40:56.928 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:40:56.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.915+0000 7fe4a706d640 1 -- 172.21.15.7:0/929129254 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fe4880b6680 msgr2=0x7fe4880b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:56.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.915+0000 7fe4a706d640 1 --2- 172.21.15.7:0/929129254 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fe4880b6680 0x7fe4880b8b90 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x55833f9f4ef0 tx=0x7fe49c00b5c0 comp rx=0 tx=0).stop 2024-09-21T06:40:56.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.915+0000 7fe4a706d640 1 -- 172.21.15.7:0/929129254 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe4a01083c0 msgr2=0x7fe4a00ffbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:40:56.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.915+0000 7fe4a706d640 1 --2- 172.21.15.7:0/929129254 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe4a01083c0 0x7fe4a00ffbd0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fe490032fd0 tx=0x7fe490004270 comp rx=0 tx=0).stop 2024-09-21T06:40:56.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.916+0000 7fe4a706d640 1 -- 172.21.15.7:0/929129254 shutdown_connections 2024-09-21T06:40:56.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.916+0000 7fe4a706d640 1 --2- 172.21.15.7:0/929129254 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fe4880b6680 0x7fe4880b8b90 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:56.929 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.916+0000 7fe4a706d640 1 --2- 172.21.15.7:0/929129254 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe4a0108d10 0x7fe4a0100110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:56.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.916+0000 7fe4a706d640 1 --2- 172.21.15.7:0/929129254 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe4a01083c0 0x7fe4a00ffbd0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:56.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.916+0000 7fe4a706d640 1 --2- 172.21.15.7:0/929129254 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe4a0102a80 0x7fe4a00ff690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:40:56.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.916+0000 7fe4a706d640 1 -- 172.21.15.7:0/929129254 >> 172.21.15.7:0/929129254 conn(0x7fe4a0079740 msgr2=0x7fe4a006bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:40:56.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.916+0000 7fe4a706d640 1 -- 172.21.15.7:0/929129254 shutdown_connections 2024-09-21T06:40:56.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:40:56.916+0000 7fe4a706d640 1 -- 172.21.15.7:0/929129254 wait complete. 2024-09-21T06:40:57.689 INFO:tasks.cephfs.filesystem:scrub status for tag:310a0ec8-44bb-49ed-a534-3bc91cb1ee9d - {'path': '/', 'tag': '310a0ec8-44bb-49ed-a534-3bc91cb1ee9d', 'options': 'recursive,force'} 2024-09-21T06:40:58.671 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:40:58 smithi018 ceph-mon[34477]: pgmap v462: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-21T06:40:58.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:40:58 smithi144 ceph-mon[34653]: pgmap v462: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-21T06:40:58.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:40:58 smithi007 ceph-mon[30983]: pgmap v462: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-21T06:41:00.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:41:00 smithi144 ceph-mon[34653]: pgmap v463: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:41:00.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:41:00 smithi144 ceph-mon[34653]: scrub summary: idle 2024-09-21T06:41:00.839 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:41:00 smithi007 ceph-mon[30983]: pgmap v463: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:41:00.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:41:00 smithi007 ceph-mon[30983]: scrub summary: idle 2024-09-21T06:41:00.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:41:00 smithi018 ceph-mon[34477]: pgmap v463: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:41:00.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:41:00 smithi018 ceph-mon[34477]: scrub summary: idle 2024-09-21T06:41:02.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:41:02 smithi144 ceph-mon[34653]: pgmap v464: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6 op/s 2024-09-21T06:41:02.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:41:02 smithi007 ceph-mon[30983]: pgmap v464: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6 op/s 2024-09-21T06:41:02.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:41:02 smithi018 ceph-mon[34477]: pgmap v464: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6 op/s 2024-09-21T06:41:04.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:41:04 smithi144 ceph-mon[34653]: pgmap v465: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-21T06:41:04.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:41:04 smithi007 ceph-mon[30983]: pgmap v465: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-21T06:41:04.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:41:04 smithi018 ceph-mon[34477]: pgmap v465: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-21T06:41:06.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:41:06 smithi144 ceph-mon[34653]: pgmap v466: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-21T06:41:06.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:41:06 smithi007 ceph-mon[30983]: pgmap v466: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-21T06:41:06.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:41:06 smithi018 ceph-mon[34477]: pgmap v466: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-21T06:41:08.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:41:08 smithi144 ceph-mon[34653]: pgmap v467: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-21T06:41:08.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:41:08 smithi007 ceph-mon[30983]: pgmap v467: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-21T06:41:08.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:41:08 smithi018 ceph-mon[34477]: pgmap v467: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-21T06:41:10.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:41:10 smithi144 ceph-mon[34653]: pgmap v468: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-21T06:41:10.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:41:10 smithi007 ceph-mon[30983]: pgmap v468: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-21T06:41:10.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:41:10 smithi018 ceph-mon[34477]: pgmap v468: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-21T06:41:12.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:41:12 smithi144 ceph-mon[34653]: pgmap v469: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-21T06:41:12.839 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:41:12 smithi007 ceph-mon[30983]: pgmap v469: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-21T06:41:12.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:41:12 smithi018 ceph-mon[34477]: pgmap v469: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-21T06:41:14.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:41:14 smithi144 ceph-mon[34653]: pgmap v470: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-21T06:41:14.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:41:14 smithi007 ceph-mon[30983]: pgmap v470: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-21T06:41:14.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:41:14 smithi018 ceph-mon[34477]: pgmap v470: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-21T06:41:16.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:41:16 smithi144 ceph-mon[34653]: pgmap v471: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 511 B/s wr, 5 op/s 2024-09-21T06:41:16.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:41:16 smithi007 ceph-mon[30983]: pgmap v471: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 511 B/s wr, 5 op/s 2024-09-21T06:41:16.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:41:16 smithi018 ceph-mon[34477]: pgmap v471: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 511 B/s wr, 5 op/s 2024-09-21T06:41:18.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:41:18 smithi144 ceph-mon[34653]: pgmap v472: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-21T06:41:18.839 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:41:18 smithi007 ceph-mon[30983]: pgmap v472: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-21T06:41:18.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:41:18 smithi018 ceph-mon[34477]: pgmap v472: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-21T06:41:20.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:41:20 smithi144 ceph-mon[34653]: pgmap v473: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-21T06:41:20.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:41:20 smithi007 ceph-mon[30983]: pgmap v473: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-21T06:41:20.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:41:20 smithi018 ceph-mon[34477]: pgmap v473: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-21T06:41:22.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:41:22 smithi144 ceph-mon[34653]: pgmap v474: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-21T06:41:22.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:41:22 smithi007 ceph-mon[30983]: pgmap v474: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-21T06:41:22.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:41:22 smithi018 ceph-mon[34477]: pgmap v474: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-21T06:41:24.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:41:24 smithi144 ceph-mon[34653]: pgmap v475: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:41:24.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:41:24 smithi007 ceph-mon[30983]: pgmap v475: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:41:24.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:41:24 smithi018 ceph-mon[34477]: pgmap v475: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:41:26.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:41:26 smithi144 ceph-mon[34653]: pgmap v476: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:41:26.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:41:26 smithi007 ceph-mon[30983]: pgmap v476: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:41:26.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:41:26 smithi018 ceph-mon[34477]: pgmap v476: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:41:27.690 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:41:27.972 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:41:28.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.524+0000 7fd9dc329640 1 -- 172.21.15.7:0/3083837631 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9d4103b90 msgr2=0x7fd9d4103fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:28.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.524+0000 7fd9dc329640 1 --2- 172.21.15.7:0/3083837631 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9d4103b90 0x7fd9d4103fa0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fd9d0009900 tx=0x7fd9d002a410 comp rx=0 tx=0).stop 2024-09-21T06:41:28.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.524+0000 7fd9dc329640 1 -- 172.21.15.7:0/3083837631 shutdown_connections 2024-09-21T06:41:28.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.524+0000 7fd9dc329640 1 --2- 172.21.15.7:0/3083837631 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd9d4109e20 0x7fd9d4110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:28.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.524+0000 7fd9dc329640 1 --2- 172.21.15.7:0/3083837631 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd9d41094d0 0x7fd9d41098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:28.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.524+0000 7fd9dc329640 1 --2- 172.21.15.7:0/3083837631 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9d4103b90 0x7fd9d4103fa0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:28.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.524+0000 7fd9dc329640 1 -- 172.21.15.7:0/3083837631 >> 172.21.15.7:0/3083837631 conn(0x7fd9d40ff600 msgr2=0x7fd9d4101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:28.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.524+0000 7fd9dc329640 1 -- 172.21.15.7:0/3083837631 shutdown_connections 2024-09-21T06:41:28.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.524+0000 7fd9dc329640 1 -- 172.21.15.7:0/3083837631 wait complete. 2024-09-21T06:41:28.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.525+0000 7fd9dc329640 1 Processor -- start 2024-09-21T06:41:28.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.525+0000 7fd9dc329640 1 -- start start 2024-09-21T06:41:28.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.525+0000 7fd9dc329640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd9d4103b90 0x7fd9d419a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:28.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.525+0000 7fd9dc329640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd9d41094d0 0x7fd9d419aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:28.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.525+0000 7fd9dc329640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9d4109e20 0x7fd9d419fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:28.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.525+0000 7fd9dc329640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd9d4113ae0 con 0x7fd9d4109e20 2024-09-21T06:41:28.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.525+0000 7fd9dc329640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd9d4113960 con 0x7fd9d4103b90 2024-09-21T06:41:28.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.525+0000 7fd9dc329640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd9d4113c60 con 0x7fd9d41094d0 2024-09-21T06:41:28.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.526+0000 7fd9da8c6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9d4109e20 0x7fd9d419fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:28.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.526+0000 7fd9da8c6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9d4109e20 0x7fd9d419fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58882/0 (socket says 172.21.15.7:58882) 2024-09-21T06:41:28.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.526+0000 7fd9da8c6640 1 -- 172.21.15.7:0/1078266618 learned_addr learned my addr 172.21.15.7:0/1078266618 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:41:28.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.526+0000 7fd9d98c4640 1 --2- 172.21.15.7:0/1078266618 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd9d41094d0 0x7fd9d419aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:28.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.526+0000 7fd9da0c5640 1 --2- 172.21.15.7:0/1078266618 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd9d4103b90 0x7fd9d419a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:28.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.526+0000 7fd9da8c6640 1 -- 172.21.15.7:0/1078266618 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd9d41094d0 msgr2=0x7fd9d419aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:28.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.526+0000 7fd9da8c6640 1 --2- 172.21.15.7:0/1078266618 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd9d41094d0 0x7fd9d419aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:28.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.526+0000 7fd9da8c6640 1 -- 172.21.15.7:0/1078266618 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd9d4103b90 msgr2=0x7fd9d419a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:28.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.526+0000 7fd9da8c6640 1 --2- 172.21.15.7:0/1078266618 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd9d4103b90 0x7fd9d419a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:28.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.526+0000 7fd9da8c6640 1 -- 172.21.15.7:0/1078266618 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9d41a0400 con 0x7fd9d4109e20 2024-09-21T06:41:28.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.526+0000 7fd9da8c6640 1 --2- 172.21.15.7:0/1078266618 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9d4109e20 0x7fd9d419fcd0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc00eaa0 tx=0x7fd9cc00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:28.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.526+0000 7fd9cb7fe640 1 -- 172.21.15.7:0/1078266618 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9cc00cdb0 con 0x7fd9d4109e20 2024-09-21T06:41:28.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.526+0000 7fd9cb7fe640 1 -- 172.21.15.7:0/1078266618 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd9cc005020 con 0x7fd9d4109e20 2024-09-21T06:41:28.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.526+0000 7fd9dc329640 1 -- 172.21.15.7:0/1078266618 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9d41a06f0 con 0x7fd9d4109e20 2024-09-21T06:41:28.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.526+0000 7fd9cb7fe640 1 -- 172.21.15.7:0/1078266618 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9cc0116d0 con 0x7fd9d4109e20 2024-09-21T06:41:28.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.526+0000 7fd9dc329640 1 -- 172.21.15.7:0/1078266618 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9d41a6e50 con 0x7fd9d4109e20 2024-09-21T06:41:28.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.530+0000 7fd9e289d740 1 Processor -- start 2024-09-21T06:41:28.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.530+0000 7fd9cb7fe640 1 -- 172.21.15.7:0/1078266618 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7fd9cc0051d0 con 0x7fd9d4109e20 2024-09-21T06:41:28.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.530+0000 7fd9e289d740 1 -- start start 2024-09-21T06:41:28.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.531+0000 7fd9e289d740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5628cf551070 0x5628cf8f8270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:28.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.531+0000 7fd9e289d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5628cf5281b0 0x5628cf8f87b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:28.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.531+0000 7fd9e289d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5628cf530390 0x5628cf8f8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:28.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.531+0000 7fd9e289d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5628cf86ee50 con 0x5628cf530390 2024-09-21T06:41:28.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.531+0000 7fd9e289d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5628cf85e280 con 0x5628cf5281b0 2024-09-21T06:41:28.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.531+0000 7fd9e289d740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5628cf862090 con 0x5628cf551070 2024-09-21T06:41:28.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.531+0000 7fd9d98c4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5628cf530390 0x5628cf8f8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:28.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.531+0000 7fd9d98c4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5628cf530390 0x5628cf8f8cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58892/0 (socket says 172.21.15.7:58892) 2024-09-21T06:41:28.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.531+0000 7fd9d98c4640 1 -- 172.21.15.7:0/2155993169 learned_addr learned my addr 172.21.15.7:0/2155993169 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:41:28.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.531+0000 7fd9d98c4640 1 --2- 172.21.15.7:0/2155993169 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5628cf551070 0x5628cf8f8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:28.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.531+0000 7fd9da0c5640 1 --2- 172.21.15.7:0/2155993169 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5628cf5281b0 0x5628cf8f87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:28.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.531+0000 7fd9cb7fe640 1 --2- 172.21.15.7:0/1078266618 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fd9c00b6680 0x7fd9c00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:28.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.531+0000 7fd9d98c4640 1 -- 172.21.15.7:0/2155993169 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5628cf551070 msgr2=0x5628cf8f8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:28.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.531+0000 7fd9d98c4640 1 --2- 172.21.15.7:0/2155993169 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5628cf551070 0x5628cf8f8270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:28.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.531+0000 7fd9d98c4640 1 -- 172.21.15.7:0/2155993169 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5628cf5281b0 msgr2=0x5628cf8f87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:28.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.531+0000 7fd9d98c4640 1 --2- 172.21.15.7:0/2155993169 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5628cf5281b0 0x5628cf8f87b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:28.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.531+0000 7fd9d98c4640 1 -- 172.21.15.7:0/2155993169 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628cf5bc650 con 0x5628cf530390 2024-09-21T06:41:28.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.532+0000 7fd9da8c6640 1 --2- 172.21.15.7:0/1078266618 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fd9c00b6680 0x7fd9c00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:28.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.532+0000 7fd9cb7fe640 1 -- 172.21.15.7:0/1078266618 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fd9cc0e7740 con 0x7fd9d4109e20 2024-09-21T06:41:28.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.532+0000 7fd9d98c4640 1 --2- 172.21.15.7:0/2155993169 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5628cf530390 0x5628cf8f8cf0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fd9c4011710 tx=0x7fd9c4005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebb9e3af43422184 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:28.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.532+0000 7fd9c8d9a640 1 -- 172.21.15.7:0/2155993169 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9c400f840 con 0x5628cf530390 2024-09-21T06:41:28.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.532+0000 7fd9c8d9a640 1 -- 172.21.15.7:0/2155993169 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd9c400fe90 con 0x5628cf530390 2024-09-21T06:41:28.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.532+0000 7fd9c8d9a640 1 -- 172.21.15.7:0/2155993169 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9c401fca0 con 0x5628cf530390 2024-09-21T06:41:28.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.532+0000 7fd9da8c6640 1 --2- 172.21.15.7:0/1078266618 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fd9c00b6680 0x7fd9c00b8b90 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc0ad3e0 tx=0x7fd9cc00e280 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:28.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.533+0000 7fd9e289d740 1 -- 172.21.15.7:0/2155993169 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5628cf530390 msgr2=0x5628cf8f8cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:28.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.533+0000 7fd9e289d740 1 --2- 172.21.15.7:0/2155993169 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5628cf530390 0x5628cf8f8cf0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fd9c4011710 tx=0x7fd9c4005850 comp rx=0 tx=0).stop 2024-09-21T06:41:28.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.533+0000 7fd9e289d740 1 -- 172.21.15.7:0/2155993169 shutdown_connections 2024-09-21T06:41:28.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.533+0000 7fd9e289d740 1 --2- 172.21.15.7:0/2155993169 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5628cf530390 0x5628cf8f8cf0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:28.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.533+0000 7fd9e289d740 1 --2- 172.21.15.7:0/2155993169 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5628cf5281b0 0x5628cf8f87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:28.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.533+0000 7fd9e289d740 1 --2- 172.21.15.7:0/2155993169 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5628cf551070 0x5628cf8f8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:28.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.533+0000 7fd9e289d740 1 -- 172.21.15.7:0/2155993169 >> 172.21.15.7:0/2155993169 conn(0x5628cf545460 msgr2=0x5628cf8f6160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:28.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.533+0000 7fd9e289d740 1 -- 172.21.15.7:0/2155993169 shutdown_connections 2024-09-21T06:41:28.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.533+0000 7fd9e289d740 1 -- 172.21.15.7:0/2155993169 wait complete. 2024-09-21T06:41:28.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.534+0000 7fd9e289d740 1 -- start start 2024-09-21T06:41:28.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.534+0000 7fd9e289d740 1 Processor -- start 2024-09-21T06:41:28.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.534+0000 7fd9e289d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5628cf5281b0 0x5628cf9038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:28.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.534+0000 7fd9e289d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5628cf530390 0x5628cf903e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:28.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.534+0000 7fd9e289d740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5628cf551070 0x5628cf914150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:28.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.534+0000 7fd9e289d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5628cf6bf700 con 0x5628cf530390 2024-09-21T06:41:28.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.534+0000 7fd9e289d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5628cf7f9110 con 0x5628cf5281b0 2024-09-21T06:41:28.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.534+0000 7fd9e289d740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5628cf90ae60 con 0x5628cf551070 2024-09-21T06:41:28.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.534+0000 7fd9e289d740 10 client.0 _ll_register_callbacks cb 0x5628cf812990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:41:28.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.534+0000 7fd9da0c5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5628cf530390 0x5628cf903e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:28.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.534+0000 7fd9da0c5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5628cf530390 0x5628cf903e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58904/0 (socket says 172.21.15.7:58904) 2024-09-21T06:41:28.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.534+0000 7fd9da0c5640 1 -- 172.21.15.7:0/4010095892 learned_addr learned my addr 172.21.15.7:0/4010095892 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:41:28.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.534+0000 7fd9d98c4640 1 --2- 172.21.15.7:0/4010095892 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5628cf551070 0x5628cf914150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:28.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.534+0000 7fd9d98c4640 1 --2- 172.21.15.7:0/4010095892 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5628cf5281b0 0x5628cf9038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:28.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.535+0000 7fd9da0c5640 1 -- 172.21.15.7:0/4010095892 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5628cf551070 msgr2=0x5628cf914150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:28.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.535+0000 7fd9da0c5640 1 --2- 172.21.15.7:0/4010095892 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5628cf551070 0x5628cf914150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:28.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.535+0000 7fd9da0c5640 1 -- 172.21.15.7:0/4010095892 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5628cf5281b0 msgr2=0x5628cf9038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:28.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.535+0000 7fd9da0c5640 1 --2- 172.21.15.7:0/4010095892 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5628cf5281b0 0x5628cf9038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:28.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.535+0000 7fd9da0c5640 1 -- 172.21.15.7:0/4010095892 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628cf826c40 con 0x5628cf530390 2024-09-21T06:41:28.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.535+0000 7fd9da0c5640 1 --2- 172.21.15.7:0/4010095892 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5628cf530390 0x5628cf903e20 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fd9d0009900 tx=0x7fd9d00316d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72911d8fe014f963 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:28.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.535+0000 7fd9bdffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:41:28.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.535+0000 7fd9bdffb640 1 -- 172.21.15.7:0/4010095892 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9d0035040 con 0x5628cf530390 2024-09-21T06:41:28.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.535+0000 7fd9bdffb640 1 -- 172.21.15.7:0/4010095892 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fd9d0004040 con 0x5628cf530390 2024-09-21T06:41:28.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.535+0000 7fd9e289d740 1 -- 172.21.15.7:0/4010095892 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd9c400fe90 con 0x5628cf530390 2024-09-21T06:41:28.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.535+0000 7fd9bdffb640 1 -- 172.21.15.7:0/4010095892 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd9d004b020 con 0x5628cf530390 2024-09-21T06:41:28.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.535+0000 7fd9e289d740 10 client.16467 fetch_fsmap learned FSMap version 25 2024-09-21T06:41:28.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.535+0000 7fd9e289d740 1 -- 172.21.15.7:0/4010095892 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5628cf916b30 con 0x5628cf530390 2024-09-21T06:41:28.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.536+0000 7fd9bdffb640 1 -- 172.21.15.7:0/4010095892 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd9d0032e10 con 0x5628cf530390 2024-09-21T06:41:28.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.536+0000 7fd9bdffb640 1 -- 172.21.15.7:0/4010095892 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd9d00047e0 con 0x5628cf530390 2024-09-21T06:41:28.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.536+0000 7fd9e289d740 10 client.16467 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:41:28.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.536+0000 7fd9e289d740 10 client.16467 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:41:28.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.536+0000 7fd9e289d740 20 client.16467 populate_metadata read hostname 'smithi007' 2024-09-21T06:41:28.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.536+0000 7fd9e289d740 1 --2- 172.21.15.7:0/4010095892 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5628cf50f9f0 0x5628cf91a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:28.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.536+0000 7fd9e289d740 4 client.16467 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:41:28.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.536+0000 7fd9e289d740 1 -- 172.21.15.7:0/4010095892 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fd9c400fe90 con 0x5628cf50f9f0 2024-09-21T06:41:28.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.536+0000 7fd9d98c4640 1 --2- 172.21.15.7:0/4010095892 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5628cf50f9f0 0x5628cf91a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:28.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.537+0000 7fd9d98c4640 1 --2- 172.21.15.7:0/4010095892 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5628cf50f9f0 0x5628cf91a250 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9eafaa67c327386 server_cookie=59ecf9eb4265236a in_seq=0 out_seq=0 2024-09-21T06:41:28.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.537+0000 7fd9bdffb640 10 client.16467 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:41:28.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.537+0000 7fd9bdffb640 1 -- 172.21.15.7:0/4010095892 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7fd9c400fe90 con 0x5628cf50f9f0 2024-09-21T06:41:28.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.537+0000 7fd9bdffb640 10 client.16467 handle_command_reply: tid=0 2024-09-21T06:41:28.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.537+0000 7fd9e289d740 1 client.16467 shutdown 2024-09-21T06:41:28.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.538+0000 7fd9e289d740 1 -- 172.21.15.7:0/4010095892 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5628cf530390 msgr2=0x5628cf903e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:28.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.538+0000 7fd9e289d740 1 --2- 172.21.15.7:0/4010095892 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5628cf530390 0x5628cf903e20 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fd9d0009900 tx=0x7fd9d00316d0 comp rx=0 tx=0).stop 2024-09-21T06:41:28.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.538+0000 7fd9e289d740 1 -- 172.21.15.7:0/4010095892 shutdown_connections 2024-09-21T06:41:28.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.538+0000 7fd9e289d740 1 --2- 172.21.15.7:0/4010095892 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5628cf50f9f0 0x5628cf91a250 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:28.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.538+0000 7fd9e289d740 1 --2- 172.21.15.7:0/4010095892 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5628cf551070 0x5628cf914150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:28.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.538+0000 7fd9e289d740 1 --2- 172.21.15.7:0/4010095892 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5628cf530390 0x5628cf903e20 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:28.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.538+0000 7fd9e289d740 1 --2- 172.21.15.7:0/4010095892 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5628cf5281b0 0x5628cf9038e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:28.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.538+0000 7fd9e289d740 1 -- 172.21.15.7:0/4010095892 >> 172.21.15.7:0/4010095892 conn(0x5628cf545460 msgr2=0x5628cf8fb400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:28.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.538+0000 7fd9bdffb640 0 client.16467 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:41:28.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.538+0000 7fd9e289d740 1 -- 172.21.15.7:0/4010095892 shutdown_connections 2024-09-21T06:41:28.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.538+0000 7fd9e289d740 1 -- 172.21.15.7:0/4010095892 wait complete. 2024-09-21T06:41:28.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.538+0000 7fd9e289d740 20 client.16467 trim_cache size 0 max 16384 2024-09-21T06:41:28.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.555+0000 7fd9e289d740 1 Processor -- start 2024-09-21T06:41:28.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.555+0000 7fd9e289d740 1 -- start start 2024-09-21T06:41:28.557 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:41:28 smithi007 ceph-mon[30983]: pgmap v477: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:41:28.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.556+0000 7fd9e289d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5628cf5281b0 0x5628cf8f99b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:28.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.556+0000 7fd9e289d740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5628cf530390 0x5628cf8f5710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:28.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.556+0000 7fd9e289d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5628cf551070 0x5628cf8f5c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:28.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.556+0000 7fd9e289d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd9d41afb70 con 0x5628cf5281b0 2024-09-21T06:41:28.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.556+0000 7fd9e289d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd9d41ad440 con 0x5628cf551070 2024-09-21T06:41:28.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.556+0000 7fd9e289d740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd9d41ab270 con 0x5628cf530390 2024-09-21T06:41:28.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.556+0000 7fd9d98c4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5628cf5281b0 0x5628cf8f99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:28.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.556+0000 7fd9d98c4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5628cf5281b0 0x5628cf8f99b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58914/0 (socket says 172.21.15.7:58914) 2024-09-21T06:41:28.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.556+0000 7fd9d98c4640 1 -- 172.21.15.7:0/469014540 learned_addr learned my addr 172.21.15.7:0/469014540 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:41:28.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.556+0000 7fd9da0c5640 1 --2- 172.21.15.7:0/469014540 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5628cf530390 0x5628cf8f5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:28.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.556+0000 7fd9d98c4640 1 --2- 172.21.15.7:0/469014540 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5628cf551070 0x5628cf8f5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:28.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.556+0000 7fd9d98c4640 1 -- 172.21.15.7:0/469014540 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5628cf530390 msgr2=0x5628cf8f5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:28.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.556+0000 7fd9d98c4640 1 --2- 172.21.15.7:0/469014540 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5628cf530390 0x5628cf8f5710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:28.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.556+0000 7fd9d98c4640 1 -- 172.21.15.7:0/469014540 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5628cf551070 msgr2=0x5628cf8f5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:28.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.556+0000 7fd9d98c4640 1 --2- 172.21.15.7:0/469014540 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5628cf551070 0x5628cf8f5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:28.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.556+0000 7fd9d98c4640 1 -- 172.21.15.7:0/469014540 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628cf8f0410 con 0x5628cf5281b0 2024-09-21T06:41:28.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.556+0000 7fd9da0c5640 1 --2- 172.21.15.7:0/469014540 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5628cf530390 0x5628cf8f5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:41:28.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.557+0000 7fd9d98c4640 1 --2- 172.21.15.7:0/469014540 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5628cf5281b0 0x5628cf8f99b0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fd9c4011550 tx=0x7fd9c4005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ccdd733a8a23d6b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:28.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.557+0000 7fd9bffff640 1 -- 172.21.15.7:0/469014540 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9c4025070 con 0x5628cf5281b0 2024-09-21T06:41:28.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.557+0000 7fd9bffff640 1 -- 172.21.15.7:0/469014540 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd9c4005180 con 0x5628cf5281b0 2024-09-21T06:41:28.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.557+0000 7fd9bffff640 1 -- 172.21.15.7:0/469014540 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9c400fa60 con 0x5628cf5281b0 2024-09-21T06:41:28.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.558+0000 7fd9e289d740 1 -- 172.21.15.7:0/469014540 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5628cf5281b0 msgr2=0x5628cf8f99b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:28.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.558+0000 7fd9e289d740 1 --2- 172.21.15.7:0/469014540 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5628cf5281b0 0x5628cf8f99b0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fd9c4011550 tx=0x7fd9c4005f90 comp rx=0 tx=0).stop 2024-09-21T06:41:28.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.558+0000 7fd9e289d740 1 -- 172.21.15.7:0/469014540 shutdown_connections 2024-09-21T06:41:28.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.558+0000 7fd9e289d740 1 --2- 172.21.15.7:0/469014540 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5628cf551070 0x5628cf8f5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:28.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.558+0000 7fd9e289d740 1 --2- 172.21.15.7:0/469014540 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5628cf530390 0x5628cf8f5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:28.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.558+0000 7fd9e289d740 1 --2- 172.21.15.7:0/469014540 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5628cf5281b0 0x5628cf8f99b0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:28.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.558+0000 7fd9e289d740 1 -- 172.21.15.7:0/469014540 >> 172.21.15.7:0/469014540 conn(0x5628cf545460 msgr2=0x5628cf8f92a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:28.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.558+0000 7fd9e289d740 1 -- 172.21.15.7:0/469014540 shutdown_connections 2024-09-21T06:41:28.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.558+0000 7fd9e289d740 1 -- 172.21.15.7:0/469014540 wait complete. 2024-09-21T06:41:28.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.559+0000 7fd9e289d740 1 -- start start 2024-09-21T06:41:28.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.559+0000 7fd9e289d740 1 Processor -- start 2024-09-21T06:41:28.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.559+0000 7fd9e289d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5628cf5281b0 0x5628cf91d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:28.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.559+0000 7fd9e289d740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5628cf530390 0x5628cf91dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:28.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.559+0000 7fd9e289d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5628cf551070 0x5628cf9094c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:28.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.559+0000 7fd9e289d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd9d41ab900 con 0x5628cf5281b0 2024-09-21T06:41:28.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.559+0000 7fd9e289d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd9d41acd70 con 0x5628cf551070 2024-09-21T06:41:28.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.559+0000 7fd9e289d740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd9d41abfd0 con 0x5628cf530390 2024-09-21T06:41:28.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.559+0000 7fd9e289d740 10 client.0 _ll_register_callbacks cb 0x7fd9d0009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:41:28.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.559+0000 7fd9d98c4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5628cf5281b0 0x5628cf91d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:28.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.559+0000 7fd9d98c4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5628cf5281b0 0x5628cf91d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58928/0 (socket says 172.21.15.7:58928) 2024-09-21T06:41:28.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.559+0000 7fd9d98c4640 1 -- 172.21.15.7:0/165835918 learned_addr learned my addr 172.21.15.7:0/165835918 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:41:28.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.560+0000 7fd9da0c5640 1 --2- 172.21.15.7:0/165835918 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5628cf530390 0x5628cf91dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:28.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.560+0000 7fd9d98c4640 1 --2- 172.21.15.7:0/165835918 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5628cf551070 0x5628cf9094c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:28.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.560+0000 7fd9d98c4640 1 -- 172.21.15.7:0/165835918 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5628cf530390 msgr2=0x5628cf91dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:28.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.560+0000 7fd9d98c4640 1 --2- 172.21.15.7:0/165835918 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5628cf530390 0x5628cf91dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:28.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.560+0000 7fd9d98c4640 1 -- 172.21.15.7:0/165835918 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5628cf551070 msgr2=0x5628cf9094c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:28.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.560+0000 7fd9d98c4640 1 --2- 172.21.15.7:0/165835918 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5628cf551070 0x5628cf9094c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:28.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.560+0000 7fd9d98c4640 1 -- 172.21.15.7:0/165835918 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628cf909c50 con 0x5628cf5281b0 2024-09-21T06:41:28.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.560+0000 7fd9d98c4640 1 --2- 172.21.15.7:0/165835918 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5628cf5281b0 0x5628cf91d620 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fd9c4011710 tx=0x7fd9c4009680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24e4ddaac796fbed server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:28.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.560+0000 7fd9bdffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:41:28.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.560+0000 7fd9bdffb640 1 -- 172.21.15.7:0/165835918 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9c4025070 con 0x5628cf5281b0 2024-09-21T06:41:28.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.560+0000 7fd9bdffb640 1 -- 172.21.15.7:0/165835918 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fd9c4005470 con 0x5628cf5281b0 2024-09-21T06:41:28.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.560+0000 7fd9e289d740 1 -- 172.21.15.7:0/165835918 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd9c4005180 con 0x5628cf5281b0 2024-09-21T06:41:28.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.561+0000 7fd9bdffb640 1 -- 172.21.15.7:0/165835918 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd9c4043030 con 0x5628cf5281b0 2024-09-21T06:41:28.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.561+0000 7fd9e289d740 10 client.16473 fetch_fsmap learned FSMap version 25 2024-09-21T06:41:28.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.561+0000 7fd9e289d740 1 -- 172.21.15.7:0/165835918 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5628cf91ce70 con 0x5628cf5281b0 2024-09-21T06:41:28.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.561+0000 7fd9bdffb640 1 -- 172.21.15.7:0/165835918 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd9c4005180 con 0x5628cf5281b0 2024-09-21T06:41:28.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.561+0000 7fd9bdffb640 1 -- 172.21.15.7:0/165835918 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd9c401d020 con 0x5628cf5281b0 2024-09-21T06:41:28.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.561+0000 7fd9e289d740 10 client.16473 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:41:28.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.561+0000 7fd9e289d740 10 client.16473 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:41:28.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.561+0000 7fd9e289d740 20 client.16473 populate_metadata read hostname 'smithi007' 2024-09-21T06:41:28.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.561+0000 7fd9e289d740 1 --2- 172.21.15.7:0/165835918 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5628cf4e4da0 0x5628cf98b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:28.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.561+0000 7fd9e289d740 4 client.16473 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:41:28.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.561+0000 7fd9e289d740 1 -- 172.21.15.7:0/165835918 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5628cf870da0 con 0x5628cf4e4da0 2024-09-21T06:41:28.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.561+0000 7fd9da0c5640 1 --2- 172.21.15.7:0/165835918 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5628cf4e4da0 0x5628cf98b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:28.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.562+0000 7fd9da0c5640 1 --2- 172.21.15.7:0/165835918 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5628cf4e4da0 0x5628cf98b240 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f0bf51cc7e2d13b2 server_cookie=ee84b1f8d971a3c6 in_seq=0 out_seq=0 2024-09-21T06:41:28.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.562+0000 7fd9bdffb640 10 client.16473 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:41:28.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.562+0000 7fd9bdffb640 1 -- 172.21.15.7:0/165835918 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2362 (crc 0 0 0) 0x5628cf870da0 con 0x5628cf4e4da0 2024-09-21T06:41:28.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.562+0000 7fd9bdffb640 10 client.16473 handle_command_reply: tid=0 2024-09-21T06:41:28.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.562+0000 7fd9e289d740 1 client.16473 shutdown 2024-09-21T06:41:28.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.562+0000 7fd9e289d740 1 -- 172.21.15.7:0/165835918 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5628cf5281b0 msgr2=0x5628cf91d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:28.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.562+0000 7fd9e289d740 1 --2- 172.21.15.7:0/165835918 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5628cf5281b0 0x5628cf91d620 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fd9c4011710 tx=0x7fd9c4009680 comp rx=0 tx=0).stop 2024-09-21T06:41:28.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.562+0000 7fd9e289d740 1 -- 172.21.15.7:0/165835918 shutdown_connections 2024-09-21T06:41:28.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.562+0000 7fd9e289d740 1 --2- 172.21.15.7:0/165835918 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5628cf4e4da0 0x5628cf98b240 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:28.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.562+0000 7fd9e289d740 1 --2- 172.21.15.7:0/165835918 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5628cf551070 0x5628cf9094c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:28.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.562+0000 7fd9e289d740 1 --2- 172.21.15.7:0/165835918 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5628cf530390 0x5628cf91dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:28.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.562+0000 7fd9e289d740 1 --2- 172.21.15.7:0/165835918 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5628cf5281b0 0x5628cf91d620 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:28.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.562+0000 7fd9e289d740 1 -- 172.21.15.7:0/165835918 >> 172.21.15.7:0/165835918 conn(0x5628cf545460 msgr2=0x5628cf904d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:28.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.563+0000 7fd9bdffb640 0 client.16473 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:41:28.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.563+0000 7fd9e289d740 1 -- 172.21.15.7:0/165835918 shutdown_connections 2024-09-21T06:41:28.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.563+0000 7fd9e289d740 1 -- 172.21.15.7:0/165835918 wait complete. 2024-09-21T06:41:28.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.563+0000 7fd9e289d740 20 client.16473 trim_cache size 0 max 16384 2024-09-21T06:41:28.570 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:41:28.570 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "no active scrubs running", 2024-09-21T06:41:28.571 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": {}, 2024-09-21T06:41:28.571 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_stats": { 2024-09-21T06:41:28.571 INFO:teuthology.orchestra.run.smithi007.stdout: "62fca477-b241-45f5-8185-bc78aeb8b19f": { 2024-09-21T06:41:28.571 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:40:12.744488+0000", 2024-09-21T06:41:28.571 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:41:28.571 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:41:28.571 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:41:28.571 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:41:28.571 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:41:28.571 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:41:28.571 INFO:teuthology.orchestra.run.smithi007.stdout: "d7b6a90c-9ae1-4e02-93ad-335a7e9df1d7": { 2024-09-21T06:41:28.571 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:39:19.226139+0000", 2024-09-21T06:41:28.571 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:41:28.571 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:41:28.572 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:41:28.572 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:41:28.572 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:41:28.572 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:41:28.572 INFO:teuthology.orchestra.run.smithi007.stdout: "b0327167-8c41-4286-8afc-7f0780972fd7": { 2024-09-21T06:41:28.572 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:38:36.828657+0000", 2024-09-21T06:41:28.572 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:41:28.572 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:41:28.572 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:41:28.572 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:41:28.572 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:41:28.572 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:41:28.572 INFO:teuthology.orchestra.run.smithi007.stdout: "13441782-2231-4713-8ebd-068a941de47f": { 2024-09-21T06:41:28.572 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:39:30.219006+0000", 2024-09-21T06:41:28.572 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:41:28.573 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:41:28.573 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:41:28.573 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:41:28.573 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:41:28.573 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:41:28.573 INFO:teuthology.orchestra.run.smithi007.stdout: "5cbaaba2-6ab1-4f83-abd6-8c6eef4b5c42": { 2024-09-21T06:41:28.573 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:37:46.566272+0000", 2024-09-21T06:41:28.573 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:41:28.573 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:41:28.573 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:41:28.573 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:41:28.573 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:41:28.573 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:41:28.573 INFO:teuthology.orchestra.run.smithi007.stdout: "6231e9c1-14a2-40b5-be3c-76d87a0d733b": { 2024-09-21T06:41:28.574 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:37:02.484812+0000", 2024-09-21T06:41:28.574 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:41:28.574 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:41:28.574 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:41:28.574 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:41:28.574 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:41:28.574 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:41:28.574 INFO:teuthology.orchestra.run.smithi007.stdout: "310a0ec8-44bb-49ed-a534-3bc91cb1ee9d": { 2024-09-21T06:41:28.574 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:40:55.373968+0000", 2024-09-21T06:41:28.574 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:41:28.574 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:41:28.574 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:41:28.574 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:41:28.574 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:41:28.575 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:41:28.575 INFO:teuthology.orchestra.run.smithi007.stdout: "0b89345c-1f00-4efe-8ee9-4cb17e43584c": { 2024-09-21T06:41:28.575 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:36:19.500334+0000", 2024-09-21T06:41:28.575 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:41:28.575 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:41:28.575 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:41:28.575 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:41:28.575 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:41:28.575 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:41:28.575 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:41:28.575 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:41:28.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.563+0000 7fd9dc329640 1 -- 172.21.15.7:0/1078266618 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fd9c00b6680 msgr2=0x7fd9c00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:28.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.564+0000 7fd9dc329640 1 --2- 172.21.15.7:0/1078266618 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fd9c00b6680 0x7fd9c00b8b90 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc0ad3e0 tx=0x7fd9cc00e280 comp rx=0 tx=0).stop 2024-09-21T06:41:28.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.564+0000 7fd9dc329640 1 -- 172.21.15.7:0/1078266618 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9d4109e20 msgr2=0x7fd9d419fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:28.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.564+0000 7fd9dc329640 1 --2- 172.21.15.7:0/1078266618 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9d4109e20 0x7fd9d419fcd0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc00eaa0 tx=0x7fd9cc00ef60 comp rx=0 tx=0).stop 2024-09-21T06:41:28.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.564+0000 7fd9dc329640 1 -- 172.21.15.7:0/1078266618 shutdown_connections 2024-09-21T06:41:28.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.564+0000 7fd9dc329640 1 --2- 172.21.15.7:0/1078266618 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fd9c00b6680 0x7fd9c00b8b90 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:28.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.564+0000 7fd9dc329640 1 --2- 172.21.15.7:0/1078266618 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd9d4109e20 0x7fd9d419fcd0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:28.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.564+0000 7fd9dc329640 1 --2- 172.21.15.7:0/1078266618 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd9d41094d0 0x7fd9d419aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:28.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.564+0000 7fd9dc329640 1 --2- 172.21.15.7:0/1078266618 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd9d4103b90 0x7fd9d419a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:28.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.564+0000 7fd9dc329640 1 -- 172.21.15.7:0/1078266618 >> 172.21.15.7:0/1078266618 conn(0x7fd9d40ff600 msgr2=0x7fd9d4101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:28.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.564+0000 7fd9dc329640 1 -- 172.21.15.7:0/1078266618 shutdown_connections 2024-09-21T06:41:28.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:28.564+0000 7fd9dc329640 1 -- 172.21.15.7:0/1078266618 wait complete. 2024-09-21T06:41:28.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:41:28 smithi144 ceph-mon[34653]: pgmap v477: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:41:28.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:41:28 smithi018 ceph-mon[34477]: pgmap v477: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:41:29.484 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:41:29.485 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:41:29.745 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:41:30.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:30.206+0000 7f2b420b5640 1 -- 172.21.15.7:0/1559118171 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b3c1083b0 msgr2=0x7f2b3c1087c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:30.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:30.206+0000 7f2b420b5640 1 --2- 172.21.15.7:0/1559118171 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b3c1083b0 0x7f2b3c1087c0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f2b30009900 tx=0x7f2b3002a410 comp rx=0 tx=0).stop 2024-09-21T06:41:30.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:30.206+0000 7f2b420b5640 1 -- 172.21.15.7:0/1559118171 shutdown_connections 2024-09-21T06:41:30.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:30.206+0000 7f2b420b5640 1 --2- 172.21.15.7:0/1559118171 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b3c108d00 0x7f2b3c10f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:30.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:30.206+0000 7f2b420b5640 1 --2- 172.21.15.7:0/1559118171 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b3c1083b0 0x7f2b3c1087c0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:30.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:30.206+0000 7f2b420b5640 1 --2- 172.21.15.7:0/1559118171 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b3c102a70 0x7f2b3c102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:30.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:30.206+0000 7f2b420b5640 1 -- 172.21.15.7:0/1559118171 >> 172.21.15.7:0/1559118171 conn(0x7f2b3c079730 msgr2=0x7f2b3c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:30.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:30.206+0000 7f2b420b5640 1 -- 172.21.15.7:0/1559118171 shutdown_connections 2024-09-21T06:41:30.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:30.206+0000 7f2b420b5640 1 -- 172.21.15.7:0/1559118171 wait complete. 2024-09-21T06:41:30.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:30.207+0000 7f2b420b5640 1 Processor -- start 2024-09-21T06:41:30.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:30.207+0000 7f2b420b5640 1 -- start start 2024-09-21T06:41:30.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:30.207+0000 7f2b420b5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b3c102a70 0x7f2b3c19a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:30.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:30.207+0000 7f2b420b5640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b3c1083b0 0x7f2b3c19aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:30.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:30.207+0000 7f2b420b5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b3c108d00 0x7f2b3c19fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:30.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:30.207+0000 7f2b420b5640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2b3c1129b0 con 0x7f2b3c102a70 2024-09-21T06:41:30.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:30.207+0000 7f2b420b5640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2b3c112830 con 0x7f2b3c108d00 2024-09-21T06:41:30.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:30.207+0000 7f2b420b5640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2b3c112b30 con 0x7f2b3c1083b0 2024-09-21T06:41:30.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:30.207+0000 7f2b3b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b3c102a70 0x7f2b3c19a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:30.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:30.207+0000 7f2b3b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b3c102a70 0x7f2b3c19a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58952/0 (socket says 172.21.15.7:58952) 2024-09-21T06:41:30.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:30.207+0000 7f2b3b7fe640 1 -- 172.21.15.7:0/3541949272 learned_addr learned my addr 172.21.15.7:0/3541949272 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:41:30.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:30.207+0000 7f2b3bfff640 1 --2- 172.21.15.7:0/3541949272 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b3c108d00 0x7f2b3c19fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:30.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:30.208+0000 7f2b3affd640 1 --2- 172.21.15.7:0/3541949272 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b3c1083b0 0x7f2b3c19aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:30.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:30.208+0000 7f2b3b7fe640 1 -- 172.21.15.7:0/3541949272 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b3c1083b0 msgr2=0x7f2b3c19aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:30.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:30.208+0000 7f2b3b7fe640 1 --2- 172.21.15.7:0/3541949272 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b3c1083b0 0x7f2b3c19aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:30.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:30.208+0000 7f2b3b7fe640 1 -- 172.21.15.7:0/3541949272 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b3c108d00 msgr2=0x7f2b3c19fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:30.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:30.208+0000 7f2b3b7fe640 1 --2- 172.21.15.7:0/3541949272 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b3c108d00 0x7f2b3c19fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:30.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:30.208+0000 7f2b3b7fe640 1 -- 172.21.15.7:0/3541949272 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b3c1a0460 con 0x7f2b3c102a70 2024-09-21T06:41:30.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:30.208+0000 7f2b3b7fe640 1 --2- 172.21.15.7:0/3541949272 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b3c102a70 0x7f2b3c19a4f0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f2b2c00b4a0 tx=0x7f2b2c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:30.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:30.208+0000 7f2b38ff9640 1 -- 172.21.15.7:0/3541949272 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b2c014070 con 0x7f2b3c102a70 2024-09-21T06:41:30.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:30.208+0000 7f2b38ff9640 1 -- 172.21.15.7:0/3541949272 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2b2c010ac0 con 0x7f2b3c102a70 2024-09-21T06:41:30.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:30.208+0000 7f2b38ff9640 1 -- 172.21.15.7:0/3541949272 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b2c017c30 con 0x7f2b3c102a70 2024-09-21T06:41:30.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:30.208+0000 7f2b420b5640 1 -- 172.21.15.7:0/3541949272 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b3c1a0750 con 0x7f2b3c102a70 2024-09-21T06:41:30.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:30.208+0000 7f2b420b5640 1 -- 172.21.15.7:0/3541949272 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b3c1a6eb0 con 0x7f2b3c102a70 2024-09-21T06:41:30.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:30.209+0000 7f2b420b5640 1 -- 172.21.15.7:0/3541949272 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b3c103cf0 con 0x7f2b3c102a70 2024-09-21T06:41:30.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:30.211+0000 7f2b38ff9640 1 -- 172.21.15.7:0/3541949272 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f2b2c017070 con 0x7f2b3c102a70 2024-09-21T06:41:30.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:30.212+0000 7f2b38ff9640 1 --2- 172.21.15.7:0/3541949272 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f2b240b6700 0x7f2b240b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:30.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:30.212+0000 7f2b3affd640 1 --2- 172.21.15.7:0/3541949272 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f2b240b6700 0x7f2b240b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:30.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:30.212+0000 7f2b38ff9640 1 -- 172.21.15.7:0/3541949272 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f2b2c0e6ca0 con 0x7f2b3c102a70 2024-09-21T06:41:30.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:30.213+0000 7f2b3affd640 1 --2- 172.21.15.7:0/3541949272 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f2b240b6700 0x7f2b240b8c10 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2b30000c00 tx=0x7f2b30031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:30.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:30.216+0000 7f2b38ff9640 1 -- 172.21.15.7:0/3541949272 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2b2c0ad290 con 0x7f2b3c102a70 2024-09-21T06:41:30.442 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:30.441+0000 7f2b420b5640 1 -- 172.21.15.7:0/3541949272 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2b3c102e80 con 0x7f2b3c102a70 2024-09-21T06:41:30.443 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:30.441+0000 7f2b38ff9640 1 -- 172.21.15.7:0/3541949272 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11899 (secure 0 0 0) 0x7f2b2c0b1670 con 0x7f2b3c102a70 2024-09-21T06:41:30.444 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:41:30.444 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-21T06:36:10:753693+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2015971546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2015971546},{"type":"v1","addr":"172.21.15.7:6835","nonce":2015971546}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/2350816224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":2350816224},{"type":"v1","addr":"172.21.15.7:6837","nonce":2350816224}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14823,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/1669980572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":1669980572},{"type":"v1","addr":"172.21.15.7:6839","nonce":1669980572}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14835,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/2528308973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":2528308973},{"type":"v1","addr":"172.21.15.7:6841","nonce":2528308973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24623,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1337382979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1337382979},{"type":"v1","addr":"172.21.15.18:6833","nonce":1337382979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/2751454345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":2751454345},{"type":"v1","addr":"172.21.15.144:6833","nonce":2751454345}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:34:24.627168+0000","modified":"2024-09-21T06:36:10.737288+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24716,"mds_1":24688,"mds_2":24686},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24656":{"gid":24656,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6835/158884796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":158884796},{"type":"v1","addr":"172.21.15.18:6835","nonce":158884796}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6835/3636739922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3636739922},{"type":"v1","addr":"172.21.15.144:6835","nonce":3636739922}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24673":{"gid":24673,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6837/1126341753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":1126341753},{"type":"v1","addr":"172.21.15.144:6837","nonce":1126341753}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.18:6837/1539670694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1539670694},{"type":"v1","addr":"172.21.15.18:6837","nonce":1539670694}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24688":{"gid":24688,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.144:6839/4027821922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":4027821922},{"type":"v1","addr":"172.21.15.144:6839","nonce":4027821922}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24716":{"gid":24716,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.18:6839/3798713532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":3798713532},{"type":"v1","addr":"172.21.15.18:6839","nonce":3798713532}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24716,"qdb_cluster":[24716,24688,24686]},"id":1}]} 2024-09-21T06:41:30.444 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-21T06:41:30.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:30.444+0000 7f2b420b5640 1 -- 172.21.15.7:0/3541949272 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f2b240b6700 msgr2=0x7f2b240b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:30.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:30.444+0000 7f2b420b5640 1 --2- 172.21.15.7:0/3541949272 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f2b240b6700 0x7f2b240b8c10 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2b30000c00 tx=0x7f2b30031400 comp rx=0 tx=0).stop 2024-09-21T06:41:30.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:30.444+0000 7f2b420b5640 1 -- 172.21.15.7:0/3541949272 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b3c102a70 msgr2=0x7f2b3c19a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:30.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:30.444+0000 7f2b420b5640 1 --2- 172.21.15.7:0/3541949272 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b3c102a70 0x7f2b3c19a4f0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f2b2c00b4a0 tx=0x7f2b2c00b960 comp rx=0 tx=0).stop 2024-09-21T06:41:30.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:30.444+0000 7f2b420b5640 1 -- 172.21.15.7:0/3541949272 shutdown_connections 2024-09-21T06:41:30.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:30.444+0000 7f2b420b5640 1 --2- 172.21.15.7:0/3541949272 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f2b240b6700 0x7f2b240b8c10 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:30.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:30.444+0000 7f2b420b5640 1 --2- 172.21.15.7:0/3541949272 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b3c108d00 0x7f2b3c19fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:30.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:30.444+0000 7f2b420b5640 1 --2- 172.21.15.7:0/3541949272 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b3c1083b0 0x7f2b3c19aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:30.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:30.444+0000 7f2b420b5640 1 --2- 172.21.15.7:0/3541949272 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b3c102a70 0x7f2b3c19a4f0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:30.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:30.444+0000 7f2b420b5640 1 -- 172.21.15.7:0/3541949272 >> 172.21.15.7:0/3541949272 conn(0x7f2b3c079730 msgr2=0x7f2b3c101980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:30.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:30.444+0000 7f2b420b5640 1 -- 172.21.15.7:0/3541949272 shutdown_connections 2024-09-21T06:41:30.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:30.444+0000 7f2b420b5640 1 -- 172.21.15.7:0/3541949272 wait complete. 2024-09-21T06:41:30.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:41:30 smithi144 ceph-mon[34653]: pgmap v478: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:41:30.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:41:30 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/3541949272' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:41:30.810 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:41:30 smithi007 ceph-mon[30983]: pgmap v478: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:41:30.810 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:41:30 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/3541949272' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:41:30.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:41:30 smithi018 ceph-mon[34477]: pgmap v478: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:41:30.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:41:30 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/3541949272' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:41:31.127 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:41:31.386 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:41:31.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.865+0000 7f67ee524640 1 -- 172.21.15.7:0/1160508256 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f67e8102a70 msgr2=0x7f67e8102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:31.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.865+0000 7f67ee524640 1 --2- 172.21.15.7:0/1160508256 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f67e8102a70 0x7f67e8102e80 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f67d8009900 tx=0x7f67d802a410 comp rx=0 tx=0).stop 2024-09-21T06:41:31.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.865+0000 7f67ee524640 1 -- 172.21.15.7:0/1160508256 shutdown_connections 2024-09-21T06:41:31.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.865+0000 7f67ee524640 1 --2- 172.21.15.7:0/1160508256 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67e8108d00 0x7f67e810f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:31.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.865+0000 7f67ee524640 1 --2- 172.21.15.7:0/1160508256 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f67e81083b0 0x7f67e81087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:31.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.865+0000 7f67ee524640 1 --2- 172.21.15.7:0/1160508256 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f67e8102a70 0x7f67e8102e80 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:31.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.865+0000 7f67ee524640 1 -- 172.21.15.7:0/1160508256 >> 172.21.15.7:0/1160508256 conn(0x7f67e8079710 msgr2=0x7f67e8079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:31.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.865+0000 7f67ee524640 1 -- 172.21.15.7:0/1160508256 shutdown_connections 2024-09-21T06:41:31.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.865+0000 7f67ee524640 1 -- 172.21.15.7:0/1160508256 wait complete. 2024-09-21T06:41:31.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.866+0000 7f67ee524640 1 Processor -- start 2024-09-21T06:41:31.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.866+0000 7f67ee524640 1 -- start start 2024-09-21T06:41:31.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.866+0000 7f67ee524640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f67e8102a70 0x7f67e80ff5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:31.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.866+0000 7f67ee524640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f67e81083b0 0x7f67e80ffb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:31.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.866+0000 7f67ee524640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67e8108d00 0x7f67e8100070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:31.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.866+0000 7f67ee524640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f67e81129c0 con 0x7f67e81083b0 2024-09-21T06:41:31.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.866+0000 7f67ee524640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f67e8112840 con 0x7f67e8108d00 2024-09-21T06:41:31.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.866+0000 7f67ee524640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f67e8112b40 con 0x7f67e8102a70 2024-09-21T06:41:31.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.866+0000 7f67e77fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f67e81083b0 0x7f67e80ffb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:31.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.866+0000 7f67e77fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f67e81083b0 0x7f67e80ffb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48986/0 (socket says 172.21.15.7:48986) 2024-09-21T06:41:31.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.866+0000 7f67e77fe640 1 -- 172.21.15.7:0/2948962264 learned_addr learned my addr 172.21.15.7:0/2948962264 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:41:31.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.867+0000 7f67e7fff640 1 --2- 172.21.15.7:0/2948962264 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f67e8102a70 0x7f67e80ff5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:31.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.867+0000 7f67ecac1640 1 --2- 172.21.15.7:0/2948962264 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67e8108d00 0x7f67e8100070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:31.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.867+0000 7f67e77fe640 1 -- 172.21.15.7:0/2948962264 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f67e8102a70 msgr2=0x7f67e80ff5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:31.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.867+0000 7f67e77fe640 1 --2- 172.21.15.7:0/2948962264 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f67e8102a70 0x7f67e80ff5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:31.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.867+0000 7f67e77fe640 1 -- 172.21.15.7:0/2948962264 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67e8108d00 msgr2=0x7f67e8100070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:31.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.867+0000 7f67e77fe640 1 --2- 172.21.15.7:0/2948962264 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67e8108d00 0x7f67e8100070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:31.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.867+0000 7f67e77fe640 1 -- 172.21.15.7:0/2948962264 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67e81a8760 con 0x7f67e81083b0 2024-09-21T06:41:31.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.867+0000 7f67e7fff640 1 --2- 172.21.15.7:0/2948962264 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f67e8102a70 0x7f67e80ff5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:41:31.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.867+0000 7f67e77fe640 1 --2- 172.21.15.7:0/2948962264 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f67e81083b0 0x7f67e80ffb30 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f67dc00e9c0 tx=0x7f67dc00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:31.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.867+0000 7f67e57fa640 1 -- 172.21.15.7:0/2948962264 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67dc00ccc0 con 0x7f67e81083b0 2024-09-21T06:41:31.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.867+0000 7f67e57fa640 1 -- 172.21.15.7:0/2948962264 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f67dc0054d0 con 0x7f67e81083b0 2024-09-21T06:41:31.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.867+0000 7f67ee524640 1 -- 172.21.15.7:0/2948962264 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67e81a8a50 con 0x7f67e81083b0 2024-09-21T06:41:31.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.867+0000 7f67e57fa640 1 -- 172.21.15.7:0/2948962264 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67dc010430 con 0x7f67e81083b0 2024-09-21T06:41:31.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.867+0000 7f67ee524640 1 -- 172.21.15.7:0/2948962264 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67e81a8f40 con 0x7f67e81083b0 2024-09-21T06:41:31.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.870+0000 7f67f4a98740 1 Processor -- start 2024-09-21T06:41:31.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.870+0000 7f67f4a98740 1 -- start start 2024-09-21T06:41:31.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.871+0000 7f67f4a98740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5604b84aa070 0x5604b88512c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:31.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.871+0000 7f67f4a98740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5604b84811b0 0x5604b8851800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:31.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.871+0000 7f67f4a98740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604b8489390 0x5604b8851d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:31.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.871+0000 7f67e57fa640 1 -- 172.21.15.7:0/2948962264 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f67dc005020 con 0x7f67e81083b0 2024-09-21T06:41:31.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.871+0000 7f67f4a98740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5604b87c7ea0 con 0x5604b84811b0 2024-09-21T06:41:31.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.871+0000 7f67f4a98740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5604b87b72d0 con 0x5604b8489390 2024-09-21T06:41:31.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.871+0000 7f67f4a98740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5604b87bb0e0 con 0x5604b84aa070 2024-09-21T06:41:31.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.871+0000 7f67e7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5604b84811b0 0x5604b8851800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:31.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.871+0000 7f67e7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5604b84811b0 0x5604b8851800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:48990/0 (socket says 172.21.15.7:48990) 2024-09-21T06:41:31.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.871+0000 7f67e7fff640 1 -- 172.21.15.7:0/4017990902 learned_addr learned my addr 172.21.15.7:0/4017990902 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:41:31.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.871+0000 7f67e77fe640 1 --2- 172.21.15.7:0/4017990902 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604b8489390 0x5604b8851d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:31.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.871+0000 7f67ecac1640 1 --2- 172.21.15.7:0/4017990902 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5604b84aa070 0x5604b88512c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:31.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.871+0000 7f67e7fff640 1 -- 172.21.15.7:0/4017990902 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5604b84aa070 msgr2=0x5604b88512c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:31.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.871+0000 7f67e7fff640 1 --2- 172.21.15.7:0/4017990902 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5604b84aa070 0x5604b88512c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:31.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.871+0000 7f67e7fff640 1 -- 172.21.15.7:0/4017990902 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604b8489390 msgr2=0x5604b8851d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:31.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.871+0000 7f67e7fff640 1 --2- 172.21.15.7:0/4017990902 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604b8489390 0x5604b8851d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:31.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.871+0000 7f67e7fff640 1 -- 172.21.15.7:0/4017990902 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604b8515650 con 0x5604b84811b0 2024-09-21T06:41:31.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.872+0000 7f67e7fff640 1 --2- 172.21.15.7:0/4017990902 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5604b84811b0 0x5604b8851800 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f67d8031440 tx=0x7f67d8032c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=157f1603bf00c0dc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:31.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.872+0000 7f67e57fa640 1 --2- 172.21.15.7:0/2948962264 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f67d00b6680 0x7f67d00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:31.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.872+0000 7f67ce7fc640 1 -- 172.21.15.7:0/4017990902 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67d803f070 con 0x5604b84811b0 2024-09-21T06:41:31.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.872+0000 7f67ce7fc640 1 -- 172.21.15.7:0/4017990902 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f67d80316a0 con 0x5604b84811b0 2024-09-21T06:41:31.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.872+0000 7f67ce7fc640 1 -- 172.21.15.7:0/4017990902 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67d8035070 con 0x5604b84811b0 2024-09-21T06:41:31.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.872+0000 7f67ecac1640 1 --2- 172.21.15.7:0/2948962264 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f67d00b6680 0x7f67d00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:31.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.872+0000 7f67e57fa640 1 -- 172.21.15.7:0/2948962264 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f67dc0e7b50 con 0x7f67e81083b0 2024-09-21T06:41:31.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.873+0000 7f67f4a98740 1 -- 172.21.15.7:0/4017990902 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5604b84811b0 msgr2=0x5604b8851800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:31.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.873+0000 7f67ecac1640 1 --2- 172.21.15.7:0/2948962264 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f67d00b6680 0x7f67d00b8b90 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f67e0005fd0 tx=0x7f67e0009500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:31.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.873+0000 7f67f4a98740 1 --2- 172.21.15.7:0/4017990902 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5604b84811b0 0x5604b8851800 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f67d8031440 tx=0x7f67d8032c30 comp rx=0 tx=0).stop 2024-09-21T06:41:31.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.873+0000 7f67f4a98740 1 -- 172.21.15.7:0/4017990902 shutdown_connections 2024-09-21T06:41:31.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.873+0000 7f67f4a98740 1 --2- 172.21.15.7:0/4017990902 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604b8489390 0x5604b8851d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:31.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.873+0000 7f67f4a98740 1 --2- 172.21.15.7:0/4017990902 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5604b84811b0 0x5604b8851800 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:31.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.873+0000 7f67f4a98740 1 --2- 172.21.15.7:0/4017990902 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5604b84aa070 0x5604b88512c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:31.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.873+0000 7f67f4a98740 1 -- 172.21.15.7:0/4017990902 >> 172.21.15.7:0/4017990902 conn(0x5604b849e460 msgr2=0x5604b884f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:31.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.873+0000 7f67f4a98740 1 -- 172.21.15.7:0/4017990902 shutdown_connections 2024-09-21T06:41:31.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.873+0000 7f67f4a98740 1 -- 172.21.15.7:0/4017990902 wait complete. 2024-09-21T06:41:31.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.873+0000 7f67f4a98740 1 -- start start 2024-09-21T06:41:31.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.874+0000 7f67f4a98740 1 Processor -- start 2024-09-21T06:41:31.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.874+0000 7f67f4a98740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5604b84811b0 0x5604b885c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:31.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.874+0000 7f67f4a98740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604b8489390 0x5604b885cec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:31.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.874+0000 7f67f4a98740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5604b84aa070 0x5604b8868d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:31.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.874+0000 7f67f4a98740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5604b8618700 con 0x5604b84811b0 2024-09-21T06:41:31.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.874+0000 7f67f4a98740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5604b8752160 con 0x5604b8489390 2024-09-21T06:41:31.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.874+0000 7f67f4a98740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5604b885fa40 con 0x5604b84aa070 2024-09-21T06:41:31.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.874+0000 7f67f4a98740 10 client.0 _ll_register_callbacks cb 0x5604b876b9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:41:31.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.874+0000 7f67e7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5604b84811b0 0x5604b885c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:31.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.874+0000 7f67e7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5604b84811b0 0x5604b885c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49006/0 (socket says 172.21.15.7:49006) 2024-09-21T06:41:31.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.874+0000 7f67e7fff640 1 -- 172.21.15.7:0/32552228 learned_addr learned my addr 172.21.15.7:0/32552228 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:41:31.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.874+0000 7f67e77fe640 1 --2- 172.21.15.7:0/32552228 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604b8489390 0x5604b885cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:31.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.874+0000 7f67ecac1640 1 --2- 172.21.15.7:0/32552228 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5604b84aa070 0x5604b8868d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:31.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.874+0000 7f67e7fff640 1 -- 172.21.15.7:0/32552228 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5604b84aa070 msgr2=0x5604b8868d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:31.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.874+0000 7f67e7fff640 1 --2- 172.21.15.7:0/32552228 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5604b84aa070 0x5604b8868d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:31.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.874+0000 7f67e7fff640 1 -- 172.21.15.7:0/32552228 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604b8489390 msgr2=0x5604b885cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:31.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.875+0000 7f67e7fff640 1 --2- 172.21.15.7:0/32552228 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604b8489390 0x5604b885cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:31.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.875+0000 7f67e7fff640 1 -- 172.21.15.7:0/32552228 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604b877fc90 con 0x5604b84811b0 2024-09-21T06:41:31.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.875+0000 7f67ecac1640 1 --2- 172.21.15.7:0/32552228 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5604b84aa070 0x5604b8868d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:41:31.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.875+0000 7f67e7fff640 1 --2- 172.21.15.7:0/32552228 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5604b84811b0 0x5604b885c980 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f67d8006010 tx=0x7f67d8032ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf7c5ac69c693632 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:31.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.875+0000 7f67c77fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:41:31.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.875+0000 7f67c77fe640 1 -- 172.21.15.7:0/32552228 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67d804a020 con 0x5604b84811b0 2024-09-21T06:41:31.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.875+0000 7f67c77fe640 1 -- 172.21.15.7:0/32552228 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f67d8004450 con 0x5604b84811b0 2024-09-21T06:41:31.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.875+0000 7f67f4a98740 1 -- 172.21.15.7:0/32552228 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f67d80316a0 con 0x5604b84811b0 2024-09-21T06:41:31.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.875+0000 7f67c77fe640 1 -- 172.21.15.7:0/32552228 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f67d8055050 con 0x5604b84811b0 2024-09-21T06:41:31.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.875+0000 7f67f4a98740 10 client.16491 fetch_fsmap learned FSMap version 25 2024-09-21T06:41:31.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.875+0000 7f67f4a98740 1 -- 172.21.15.7:0/32552228 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5604b886b750 con 0x5604b84811b0 2024-09-21T06:41:31.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.875+0000 7f67c77fe640 1 -- 172.21.15.7:0/32552228 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f67d80316a0 con 0x5604b84811b0 2024-09-21T06:41:31.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.876+0000 7f67c77fe640 1 -- 172.21.15.7:0/32552228 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f67d80048c0 con 0x5604b84811b0 2024-09-21T06:41:31.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.876+0000 7f67f4a98740 10 client.16491 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:41:31.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.876+0000 7f67f4a98740 10 client.16491 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-21T06:41:31.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.876+0000 7f67f4a98740 20 client.16491 populate_metadata read hostname 'smithi007' 2024-09-21T06:41:31.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.876+0000 7f67f4a98740 1 --2- 172.21.15.7:0/32552228 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x5604b84689f0 0x5604b886eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:31.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.876+0000 7f67f4a98740 4 client.16491 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:41:31.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.876+0000 7f67f4a98740 1 -- 172.21.15.7:0/32552228 --> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5604b87c9df0 con 0x5604b84689f0 2024-09-21T06:41:31.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.876+0000 7f67e77fe640 1 --2- 172.21.15.7:0/32552228 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x5604b84689f0 0x5604b886eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:31.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.876+0000 7f67e77fe640 1 --2- 172.21.15.7:0/32552228 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x5604b84689f0 0x5604b886eab0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=caefe67aec4cf135 server_cookie=5c6a094cf96b000 in_seq=0 out_seq=0 2024-09-21T06:41:31.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.876+0000 7f67c77fe640 10 client.16491 ms_handle_connect on v2:172.21.15.18:6836/1539670694 2024-09-21T06:41:31.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.877+0000 7f67c77fe640 1 -- 172.21.15.7:0/32552228 <== mds.2 v2:172.21.15.18:6836/1539670694 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5604b87c9df0 con 0x5604b84689f0 2024-09-21T06:41:31.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.877+0000 7f67c77fe640 10 client.16491 handle_command_reply: tid=0 2024-09-21T06:41:31.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.877+0000 7f67f4a98740 1 client.16491 shutdown 2024-09-21T06:41:31.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.877+0000 7f67f4a98740 1 -- 172.21.15.7:0/32552228 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5604b84811b0 msgr2=0x5604b885c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:31.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.877+0000 7f67f4a98740 1 --2- 172.21.15.7:0/32552228 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5604b84811b0 0x5604b885c980 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f67d8006010 tx=0x7f67d8032ee0 comp rx=0 tx=0).stop 2024-09-21T06:41:31.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.877+0000 7f67f4a98740 1 -- 172.21.15.7:0/32552228 shutdown_connections 2024-09-21T06:41:31.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.877+0000 7f67f4a98740 1 --2- 172.21.15.7:0/32552228 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x5604b84689f0 0x5604b886eab0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:31.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.877+0000 7f67f4a98740 1 --2- 172.21.15.7:0/32552228 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5604b84aa070 0x5604b8868d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:31.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.877+0000 7f67f4a98740 1 --2- 172.21.15.7:0/32552228 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604b8489390 0x5604b885cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:31.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.877+0000 7f67f4a98740 1 --2- 172.21.15.7:0/32552228 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5604b84811b0 0x5604b885c980 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:31.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.878+0000 7f67f4a98740 1 -- 172.21.15.7:0/32552228 >> 172.21.15.7:0/32552228 conn(0x5604b849e460 msgr2=0x5604b8854450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:31.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.878+0000 7f67c77fe640 0 client.16491 ms_handle_reset on v2:172.21.15.18:6836/1539670694 2024-09-21T06:41:31.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.878+0000 7f67f4a98740 1 -- 172.21.15.7:0/32552228 shutdown_connections 2024-09-21T06:41:31.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.878+0000 7f67f4a98740 1 -- 172.21.15.7:0/32552228 wait complete. 2024-09-21T06:41:31.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.878+0000 7f67f4a98740 20 client.16491 trim_cache size 0 max 16384 2024-09-21T06:41:31.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.891+0000 7f67f4a98740 1 Processor -- start 2024-09-21T06:41:31.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.891+0000 7f67f4a98740 1 -- start start 2024-09-21T06:41:31.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.892+0000 7f67f4a98740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604b84811b0 0x5604b885ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:31.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.892+0000 7f67f4a98740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5604b8489390 0x5604b88543c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:31.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.892+0000 7f67f4a98740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5604b84aa070 0x5604b8854900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:31.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.892+0000 7f67f4a98740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f67e81b3f30 con 0x5604b84aa070 2024-09-21T06:41:31.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.892+0000 7f67f4a98740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f67e81b1800 con 0x5604b84811b0 2024-09-21T06:41:31.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.892+0000 7f67f4a98740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f67e81af630 con 0x5604b8489390 2024-09-21T06:41:31.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.892+0000 7f67ecac1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5604b84aa070 0x5604b8854900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:31.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.892+0000 7f67ecac1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5604b84aa070 0x5604b8854900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49020/0 (socket says 172.21.15.7:49020) 2024-09-21T06:41:31.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.892+0000 7f67ecac1640 1 -- 172.21.15.7:0/4183469033 learned_addr learned my addr 172.21.15.7:0/4183469033 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:41:31.895 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.892+0000 7f67e77fe640 1 --2- 172.21.15.7:0/4183469033 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5604b8489390 0x5604b88543c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:31.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.892+0000 7f67e7fff640 1 --2- 172.21.15.7:0/4183469033 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604b84811b0 0x5604b885ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:31.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.892+0000 7f67ecac1640 1 -- 172.21.15.7:0/4183469033 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5604b8489390 msgr2=0x5604b88543c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:31.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.892+0000 7f67ecac1640 1 --2- 172.21.15.7:0/4183469033 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5604b8489390 0x5604b88543c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:31.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.892+0000 7f67ecac1640 1 -- 172.21.15.7:0/4183469033 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604b84811b0 msgr2=0x5604b885ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:31.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.892+0000 7f67ecac1640 1 --2- 172.21.15.7:0/4183469033 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604b84811b0 0x5604b885ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:31.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.892+0000 7f67ecac1640 1 -- 172.21.15.7:0/4183469033 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604b8869410 con 0x5604b84aa070 2024-09-21T06:41:31.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.892+0000 7f67e7fff640 1 --2- 172.21.15.7:0/4183469033 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604b84811b0 0x5604b885ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:41:31.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.892+0000 7f67ecac1640 1 --2- 172.21.15.7:0/4183469033 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5604b84aa070 0x5604b8854900 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f67e0005c40 tx=0x7f67e0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f05c65f0c2ea7fe server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:31.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.893+0000 7f67cdffb640 1 -- 172.21.15.7:0/4183469033 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67e002c070 con 0x5604b84aa070 2024-09-21T06:41:31.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.893+0000 7f67cdffb640 1 -- 172.21.15.7:0/4183469033 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f67e001e0d0 con 0x5604b84aa070 2024-09-21T06:41:31.896 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.893+0000 7f67cdffb640 1 -- 172.21.15.7:0/4183469033 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67e001c400 con 0x5604b84aa070 2024-09-21T06:41:31.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.894+0000 7f67f4a98740 1 -- 172.21.15.7:0/4183469033 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5604b84aa070 msgr2=0x5604b8854900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:31.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.894+0000 7f67f4a98740 1 --2- 172.21.15.7:0/4183469033 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5604b84aa070 0x5604b8854900 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f67e0005c40 tx=0x7f67e0016000 comp rx=0 tx=0).stop 2024-09-21T06:41:31.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.894+0000 7f67f4a98740 1 -- 172.21.15.7:0/4183469033 shutdown_connections 2024-09-21T06:41:31.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.894+0000 7f67f4a98740 1 --2- 172.21.15.7:0/4183469033 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5604b84aa070 0x5604b8854900 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:31.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.894+0000 7f67f4a98740 1 --2- 172.21.15.7:0/4183469033 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5604b8489390 0x5604b88543c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:31.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.894+0000 7f67f4a98740 1 --2- 172.21.15.7:0/4183469033 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604b84811b0 0x5604b885ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:31.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.894+0000 7f67f4a98740 1 -- 172.21.15.7:0/4183469033 >> 172.21.15.7:0/4183469033 conn(0x5604b849e460 msgr2=0x5604b885c730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:31.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.894+0000 7f67f4a98740 1 -- 172.21.15.7:0/4183469033 shutdown_connections 2024-09-21T06:41:31.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.894+0000 7f67f4a98740 1 -- 172.21.15.7:0/4183469033 wait complete. 2024-09-21T06:41:31.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.894+0000 7f67f4a98740 1 -- start start 2024-09-21T06:41:31.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.894+0000 7f67f4a98740 1 Processor -- start 2024-09-21T06:41:31.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.895+0000 7f67f4a98740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5604b84811b0 0x5604b88722a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:31.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.895+0000 7f67f4a98740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5604b8489390 0x5604b886f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:31.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.895+0000 7f67f4a98740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604b84aa070 0x5604b886fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:31.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.895+0000 7f67f4a98740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f67e81afcc0 con 0x5604b8489390 2024-09-21T06:41:31.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.895+0000 7f67f4a98740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f67e81b1130 con 0x5604b84aa070 2024-09-21T06:41:31.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.895+0000 7f67f4a98740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f67e81b0390 con 0x5604b84811b0 2024-09-21T06:41:31.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.895+0000 7f67f4a98740 10 client.0 _ll_register_callbacks cb 0x7f67dc0eb510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:41:31.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.895+0000 7f67e77fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5604b8489390 0x5604b886f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:31.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.895+0000 7f67e77fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5604b8489390 0x5604b886f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49030/0 (socket says 172.21.15.7:49030) 2024-09-21T06:41:31.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.895+0000 7f67e77fe640 1 -- 172.21.15.7:0/2708514929 learned_addr learned my addr 172.21.15.7:0/2708514929 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:41:31.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.895+0000 7f67e7fff640 1 --2- 172.21.15.7:0/2708514929 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5604b84811b0 0x5604b88722a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:31.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.895+0000 7f67ecac1640 1 --2- 172.21.15.7:0/2708514929 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604b84aa070 0x5604b886fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:31.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.895+0000 7f67e77fe640 1 -- 172.21.15.7:0/2708514929 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5604b84811b0 msgr2=0x5604b88722a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:31.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.895+0000 7f67e77fe640 1 --2- 172.21.15.7:0/2708514929 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5604b84811b0 0x5604b88722a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:31.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.895+0000 7f67e77fe640 1 -- 172.21.15.7:0/2708514929 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604b84aa070 msgr2=0x5604b886fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:31.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.895+0000 7f67e77fe640 1 --2- 172.21.15.7:0/2708514929 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604b84aa070 0x5604b886fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:31.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.895+0000 7f67e77fe640 1 -- 172.21.15.7:0/2708514929 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604b8870420 con 0x5604b8489390 2024-09-21T06:41:31.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.896+0000 7f67e77fe640 1 --2- 172.21.15.7:0/2708514929 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5604b8489390 0x5604b886f770 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f67dc004650 tx=0x7f67dc0ad8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d7590bb6d0c8b0a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:31.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.896+0000 7f67c77fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:41:31.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.896+0000 7f67c77fe640 1 -- 172.21.15.7:0/2708514929 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67dc0ec040 con 0x5604b8489390 2024-09-21T06:41:31.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.896+0000 7f67c77fe640 1 -- 172.21.15.7:0/2708514929 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f67dc0e55c0 con 0x5604b8489390 2024-09-21T06:41:31.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.896+0000 7f67f4a98740 1 -- 172.21.15.7:0/2708514929 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f67e001e0d0 con 0x5604b8489390 2024-09-21T06:41:31.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.896+0000 7f67c77fe640 1 -- 172.21.15.7:0/2708514929 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f67dc00ce60 con 0x5604b8489390 2024-09-21T06:41:31.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.896+0000 7f67f4a98740 10 client.16497 fetch_fsmap learned FSMap version 25 2024-09-21T06:41:31.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.896+0000 7f67f4a98740 1 -- 172.21.15.7:0/2708514929 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5604b88d9150 con 0x5604b8489390 2024-09-21T06:41:31.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.896+0000 7f67c77fe640 1 -- 172.21.15.7:0/2708514929 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f67e001e0d0 con 0x5604b8489390 2024-09-21T06:41:31.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.896+0000 7f67c77fe640 1 -- 172.21.15.7:0/2708514929 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f67dc0b21a0 con 0x5604b8489390 2024-09-21T06:41:31.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.896+0000 7f67f4a98740 10 client.16497 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:41:31.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.896+0000 7f67f4a98740 10 client.16497 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-21T06:41:31.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.896+0000 7f67f4a98740 20 client.16497 populate_metadata read hostname 'smithi007' 2024-09-21T06:41:31.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.896+0000 7f67f4a98740 1 --2- 172.21.15.7:0/2708514929 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x5604b843dda0 0x5604b88db8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:31.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.896+0000 7f67f4a98740 4 client.16497 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:41:31.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.896+0000 7f67f4a98740 1 -- 172.21.15.7:0/2708514929 --> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5604b87c58a0 con 0x5604b843dda0 2024-09-21T06:41:31.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.897+0000 7f67e7fff640 1 --2- 172.21.15.7:0/2708514929 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x5604b843dda0 0x5604b88db8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:31.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.897+0000 7f67c77fe640 10 client.16497 ms_handle_connect on v2:172.21.15.18:6836/1539670694 2024-09-21T06:41:31.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.897+0000 7f67e7fff640 1 --2- 172.21.15.7:0/2708514929 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x5604b843dda0 0x5604b88db8e0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9e778f12fcc88295 server_cookie=7f40d246f458e84c in_seq=0 out_seq=0 2024-09-21T06:41:31.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.897+0000 7f67c77fe640 1 -- 172.21.15.7:0/2708514929 <== mds.2 v2:172.21.15.18:6836/1539670694 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5604b87c58a0 con 0x5604b843dda0 2024-09-21T06:41:31.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.897+0000 7f67c77fe640 10 client.16497 handle_command_reply: tid=0 2024-09-21T06:41:31.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.897+0000 7f67f4a98740 1 client.16497 shutdown 2024-09-21T06:41:31.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.898+0000 7f67f4a98740 1 -- 172.21.15.7:0/2708514929 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5604b8489390 msgr2=0x5604b886f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:31.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.898+0000 7f67f4a98740 1 --2- 172.21.15.7:0/2708514929 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5604b8489390 0x5604b886f770 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f67dc004650 tx=0x7f67dc0ad8d0 comp rx=0 tx=0).stop 2024-09-21T06:41:31.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.898+0000 7f67f4a98740 1 -- 172.21.15.7:0/2708514929 shutdown_connections 2024-09-21T06:41:31.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.898+0000 7f67f4a98740 1 --2- 172.21.15.7:0/2708514929 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x5604b843dda0 0x5604b88db8e0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:31.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.898+0000 7f67f4a98740 1 --2- 172.21.15.7:0/2708514929 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5604b84aa070 0x5604b886fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:31.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.898+0000 7f67c77fe640 0 client.16497 ms_handle_reset on v2:172.21.15.18:6836/1539670694 2024-09-21T06:41:31.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.898+0000 7f67f4a98740 1 --2- 172.21.15.7:0/2708514929 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5604b8489390 0x5604b886f770 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:31.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.898+0000 7f67f4a98740 1 --2- 172.21.15.7:0/2708514929 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5604b84811b0 0x5604b88722a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:31.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.898+0000 7f67f4a98740 1 -- 172.21.15.7:0/2708514929 >> 172.21.15.7:0/2708514929 conn(0x5604b849e460 msgr2=0x5604b885ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:31.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.898+0000 7f67f4a98740 1 -- 172.21.15.7:0/2708514929 shutdown_connections 2024-09-21T06:41:31.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.898+0000 7f67f4a98740 1 -- 172.21.15.7:0/2708514929 wait complete. 2024-09-21T06:41:31.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.898+0000 7f67f4a98740 20 client.16497 trim_cache size 0 max 16384 2024-09-21T06:41:31.905 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:41:31.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.898+0000 7f67ee524640 1 -- 172.21.15.7:0/2948962264 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f67d00b6680 msgr2=0x7f67d00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:31.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.898+0000 7f67ee524640 1 --2- 172.21.15.7:0/2948962264 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f67d00b6680 0x7f67d00b8b90 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f67e0005fd0 tx=0x7f67e0009500 comp rx=0 tx=0).stop 2024-09-21T06:41:31.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.898+0000 7f67ee524640 1 -- 172.21.15.7:0/2948962264 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f67e81083b0 msgr2=0x7f67e80ffb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:31.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.898+0000 7f67ee524640 1 --2- 172.21.15.7:0/2948962264 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f67e81083b0 0x7f67e80ffb30 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f67dc00e9c0 tx=0x7f67dc00ee80 comp rx=0 tx=0).stop 2024-09-21T06:41:31.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.899+0000 7f67ee524640 1 -- 172.21.15.7:0/2948962264 shutdown_connections 2024-09-21T06:41:31.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.899+0000 7f67ee524640 1 --2- 172.21.15.7:0/2948962264 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f67d00b6680 0x7f67d00b8b90 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:31.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.899+0000 7f67ee524640 1 --2- 172.21.15.7:0/2948962264 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67e8108d00 0x7f67e8100070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:31.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.899+0000 7f67ee524640 1 --2- 172.21.15.7:0/2948962264 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f67e81083b0 0x7f67e80ffb30 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:31.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.899+0000 7f67ee524640 1 --2- 172.21.15.7:0/2948962264 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f67e8102a70 0x7f67e80ff5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:31.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.899+0000 7f67ee524640 1 -- 172.21.15.7:0/2948962264 >> 172.21.15.7:0/2948962264 conn(0x7f67e8079710 msgr2=0x7f67e8101a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:31.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.899+0000 7f67ee524640 1 -- 172.21.15.7:0/2948962264 shutdown_connections 2024-09-21T06:41:31.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:31.899+0000 7f67ee524640 1 -- 172.21.15.7:0/2948962264 wait complete. 2024-09-21T06:41:32.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:41:32 smithi007 ceph-mon[30983]: pgmap v479: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:41:32.636 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:41:32.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:41:32 smithi144 ceph-mon[34653]: pgmap v479: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:41:32.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:41:32 smithi018 ceph-mon[34477]: pgmap v479: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:41:32.896 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:41:33.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.543+0000 7fceab290640 1 -- 172.21.15.7:0/252346397 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcea4102a60 msgr2=0x7fcea4102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:33.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.543+0000 7fceab290640 1 --2- 172.21.15.7:0/252346397 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcea4102a60 0x7fcea4102e70 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fce94009900 tx=0x7fce9402a410 comp rx=0 tx=0).stop 2024-09-21T06:41:33.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.543+0000 7fceab290640 1 -- 172.21.15.7:0/252346397 shutdown_connections 2024-09-21T06:41:33.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.543+0000 7fceab290640 1 --2- 172.21.15.7:0/252346397 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcea4108cf0 0x7fcea410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:33.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.543+0000 7fceab290640 1 --2- 172.21.15.7:0/252346397 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcea41083a0 0x7fcea41087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:33.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.543+0000 7fceab290640 1 --2- 172.21.15.7:0/252346397 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcea4102a60 0x7fcea4102e70 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:33.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.543+0000 7fceab290640 1 -- 172.21.15.7:0/252346397 >> 172.21.15.7:0/252346397 conn(0x7fcea4079730 msgr2=0x7fcea4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:33.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.543+0000 7fceab290640 1 -- 172.21.15.7:0/252346397 shutdown_connections 2024-09-21T06:41:33.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.543+0000 7fceab290640 1 -- 172.21.15.7:0/252346397 wait complete. 2024-09-21T06:41:33.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.544+0000 7fceab290640 1 Processor -- start 2024-09-21T06:41:33.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.544+0000 7fceab290640 1 -- start start 2024-09-21T06:41:33.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.544+0000 7fceab290640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcea4102a60 0x7fcea4199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:33.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.544+0000 7fceab290640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcea41083a0 0x7fcea4199910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:33.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.544+0000 7fceab290640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcea4108cf0 0x7fcea419ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:33.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.544+0000 7fceab290640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fcea4112960 con 0x7fcea4108cf0 2024-09-21T06:41:33.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.544+0000 7fceab290640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcea41127e0 con 0x7fcea41083a0 2024-09-21T06:41:33.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.544+0000 7fceab290640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fcea4112ae0 con 0x7fcea4102a60 2024-09-21T06:41:33.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.545+0000 7fcea982d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcea4108cf0 0x7fcea419ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:33.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.545+0000 7fcea982d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcea4108cf0 0x7fcea419ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49054/0 (socket says 172.21.15.7:49054) 2024-09-21T06:41:33.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.545+0000 7fcea982d640 1 -- 172.21.15.7:0/1786522059 learned_addr learned my addr 172.21.15.7:0/1786522059 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:41:33.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.545+0000 7fcea882b640 1 --2- 172.21.15.7:0/1786522059 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcea41083a0 0x7fcea4199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:33.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.545+0000 7fcea902c640 1 --2- 172.21.15.7:0/1786522059 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcea4102a60 0x7fcea4199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:33.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.545+0000 7fcea982d640 1 -- 172.21.15.7:0/1786522059 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcea4102a60 msgr2=0x7fcea4199370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:33.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.545+0000 7fcea982d640 1 --2- 172.21.15.7:0/1786522059 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcea4102a60 0x7fcea4199370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:33.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.545+0000 7fcea982d640 1 -- 172.21.15.7:0/1786522059 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcea41083a0 msgr2=0x7fcea4199910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:33.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.545+0000 7fcea982d640 1 --2- 172.21.15.7:0/1786522059 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcea41083a0 0x7fcea4199910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:33.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.545+0000 7fcea982d640 1 -- 172.21.15.7:0/1786522059 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcea419f2e0 con 0x7fcea4108cf0 2024-09-21T06:41:33.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.545+0000 7fcea982d640 1 --2- 172.21.15.7:0/1786522059 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcea4108cf0 0x7fcea419ebb0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fce9c00eaa0 tx=0x7fce9c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:33.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.545+0000 7fce9a7fc640 1 -- 172.21.15.7:0/1786522059 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce9c00cdb0 con 0x7fcea4108cf0 2024-09-21T06:41:33.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.545+0000 7fce9a7fc640 1 -- 172.21.15.7:0/1786522059 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fce9c005020 con 0x7fcea4108cf0 2024-09-21T06:41:33.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.545+0000 7fceab290640 1 -- 172.21.15.7:0/1786522059 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcea419f5d0 con 0x7fcea4108cf0 2024-09-21T06:41:33.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.545+0000 7fce9a7fc640 1 -- 172.21.15.7:0/1786522059 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce9c0116d0 con 0x7fcea4108cf0 2024-09-21T06:41:33.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.546+0000 7fceab290640 1 -- 172.21.15.7:0/1786522059 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcea41a5d30 con 0x7fcea4108cf0 2024-09-21T06:41:33.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.548+0000 7fceb1804740 1 Processor -- start 2024-09-21T06:41:33.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.548+0000 7fce9a7fc640 1 -- 172.21.15.7:0/1786522059 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7fce9c0051d0 con 0x7fcea4108cf0 2024-09-21T06:41:33.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.548+0000 7fceb1804740 1 -- start start 2024-09-21T06:41:33.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.549+0000 7fceb1804740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560b27b83070 0x560b27f2a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:33.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.549+0000 7fceb1804740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560b27b5a1b0 0x560b27f2a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:33.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.549+0000 7fceb1804740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560b27b62390 0x560b27f2ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:33.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.549+0000 7fceb1804740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x560b27ea0ea0 con 0x560b27b62390 2024-09-21T06:41:33.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.549+0000 7fceb1804740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x560b27e902d0 con 0x560b27b83070 2024-09-21T06:41:33.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.549+0000 7fceb1804740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x560b27e940e0 con 0x560b27b5a1b0 2024-09-21T06:41:33.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.549+0000 7fcea882b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560b27b62390 0x560b27f2ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:33.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.549+0000 7fcea882b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560b27b62390 0x560b27f2ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49056/0 (socket says 172.21.15.7:49056) 2024-09-21T06:41:33.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.549+0000 7fcea882b640 1 -- 172.21.15.7:0/105511991 learned_addr learned my addr 172.21.15.7:0/105511991 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:41:33.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.549+0000 7fcea882b640 1 --2- 172.21.15.7:0/105511991 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560b27b83070 0x560b27f2a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:33.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.549+0000 7fce9a7fc640 1 --2- 172.21.15.7:0/1786522059 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fce900b6680 0x7fce900b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:33.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.549+0000 7fcea902c640 1 --2- 172.21.15.7:0/105511991 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560b27b5a1b0 0x560b27f2a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:33.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.549+0000 7fcea882b640 1 -- 172.21.15.7:0/105511991 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560b27b5a1b0 msgr2=0x560b27f2a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:33.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.549+0000 7fcea882b640 1 --2- 172.21.15.7:0/105511991 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560b27b5a1b0 0x560b27f2a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:33.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.549+0000 7fcea882b640 1 -- 172.21.15.7:0/105511991 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560b27b83070 msgr2=0x560b27f2a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:33.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.549+0000 7fcea882b640 1 --2- 172.21.15.7:0/105511991 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560b27b83070 0x560b27f2a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:33.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.549+0000 7fcea882b640 1 -- 172.21.15.7:0/105511991 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b27bee650 con 0x560b27b62390 2024-09-21T06:41:33.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.550+0000 7fcea982d640 1 --2- 172.21.15.7:0/1786522059 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fce900b6680 0x7fce900b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:33.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.550+0000 7fce9a7fc640 1 -- 172.21.15.7:0/1786522059 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fce9c0e7830 con 0x7fcea4108cf0 2024-09-21T06:41:33.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.550+0000 7fcea882b640 1 --2- 172.21.15.7:0/105511991 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560b27b62390 0x560b27f2ad40 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fcea0012770 tx=0x7fcea0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae6d73d7ededc48c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:33.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.550+0000 7fce8f7fe640 1 -- 172.21.15.7:0/105511991 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcea0012cf0 con 0x560b27b62390 2024-09-21T06:41:33.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.550+0000 7fce8f7fe640 1 -- 172.21.15.7:0/105511991 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcea0010770 con 0x560b27b62390 2024-09-21T06:41:33.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.550+0000 7fce8f7fe640 1 -- 172.21.15.7:0/105511991 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcea00044e0 con 0x560b27b62390 2024-09-21T06:41:33.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.551+0000 7fcea982d640 1 --2- 172.21.15.7:0/1786522059 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fce900b6680 0x7fce900b8b90 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fce9c0aa990 tx=0x7fce9c07a3d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:33.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.551+0000 7fceb1804740 1 -- 172.21.15.7:0/105511991 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560b27b62390 msgr2=0x560b27f2ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:33.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.551+0000 7fceb1804740 1 --2- 172.21.15.7:0/105511991 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560b27b62390 0x560b27f2ad40 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fcea0012770 tx=0x7fcea0004730 comp rx=0 tx=0).stop 2024-09-21T06:41:33.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.551+0000 7fceb1804740 1 -- 172.21.15.7:0/105511991 shutdown_connections 2024-09-21T06:41:33.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.551+0000 7fceb1804740 1 --2- 172.21.15.7:0/105511991 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560b27b62390 0x560b27f2ad40 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:33.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.551+0000 7fceb1804740 1 --2- 172.21.15.7:0/105511991 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560b27b5a1b0 0x560b27f2a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:33.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.551+0000 7fceb1804740 1 --2- 172.21.15.7:0/105511991 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560b27b83070 0x560b27f2a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:33.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.551+0000 7fceb1804740 1 -- 172.21.15.7:0/105511991 >> 172.21.15.7:0/105511991 conn(0x560b27b77460 msgr2=0x560b27f281b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:33.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.551+0000 7fceb1804740 1 -- 172.21.15.7:0/105511991 shutdown_connections 2024-09-21T06:41:33.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.551+0000 7fceb1804740 1 -- 172.21.15.7:0/105511991 wait complete. 2024-09-21T06:41:33.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.551+0000 7fceb1804740 1 -- start start 2024-09-21T06:41:33.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.552+0000 7fceb1804740 1 Processor -- start 2024-09-21T06:41:33.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.552+0000 7fceb1804740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560b27b5a1b0 0x560b27f38d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:33.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.552+0000 7fceb1804740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560b27b62390 0x560b27f392f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:33.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.552+0000 7fceb1804740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560b27b83070 0x560b27f43db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:33.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.552+0000 7fceb1804740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x560b27cf1700 con 0x560b27b62390 2024-09-21T06:41:33.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.552+0000 7fceb1804740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x560b27e2b160 con 0x560b27b83070 2024-09-21T06:41:33.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.552+0000 7fceb1804740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x560b27f38aa0 con 0x560b27b5a1b0 2024-09-21T06:41:33.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.552+0000 7fceb1804740 10 client.0 _ll_register_callbacks cb 0x560b27e449e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:41:33.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.552+0000 7fcea902c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560b27b62390 0x560b27f392f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:33.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.552+0000 7fcea902c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560b27b62390 0x560b27f392f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49058/0 (socket says 172.21.15.7:49058) 2024-09-21T06:41:33.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.552+0000 7fcea902c640 1 -- 172.21.15.7:0/283736836 learned_addr learned my addr 172.21.15.7:0/283736836 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:41:33.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.552+0000 7fcea882b640 1 --2- 172.21.15.7:0/283736836 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560b27b5a1b0 0x560b27f38d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:33.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.552+0000 7fcea882b640 1 --2- 172.21.15.7:0/283736836 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560b27b83070 0x560b27f43db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:33.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.553+0000 7fcea902c640 1 -- 172.21.15.7:0/283736836 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560b27b5a1b0 msgr2=0x560b27f38d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:33.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.553+0000 7fcea902c640 1 --2- 172.21.15.7:0/283736836 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560b27b5a1b0 0x560b27f38d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:33.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.553+0000 7fcea902c640 1 -- 172.21.15.7:0/283736836 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560b27b83070 msgr2=0x560b27f43db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:33.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.553+0000 7fcea902c640 1 --2- 172.21.15.7:0/283736836 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560b27b83070 0x560b27f43db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:33.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.553+0000 7fcea902c640 1 -- 172.21.15.7:0/283736836 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b27e58c90 con 0x560b27b62390 2024-09-21T06:41:33.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.553+0000 7fcea902c640 1 --2- 172.21.15.7:0/283736836 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560b27b62390 0x560b27f392f0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fce9402a930 tx=0x7fce940316d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b05478fab255e9f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:33.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.553+0000 7fce8cff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:41:33.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.553+0000 7fce8cff9640 1 -- 172.21.15.7:0/283736836 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce94035070 con 0x560b27b62390 2024-09-21T06:41:33.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.553+0000 7fce8cff9640 1 -- 172.21.15.7:0/283736836 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fce94004240 con 0x560b27b62390 2024-09-21T06:41:33.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.553+0000 7fceb1804740 1 -- 172.21.15.7:0/283736836 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcea0010770 con 0x560b27b62390 2024-09-21T06:41:33.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.553+0000 7fce8cff9640 1 -- 172.21.15.7:0/283736836 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fce94049030 con 0x560b27b62390 2024-09-21T06:41:33.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.553+0000 7fceb1804740 10 client.16509 fetch_fsmap learned FSMap version 25 2024-09-21T06:41:33.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.553+0000 7fceb1804740 1 -- 172.21.15.7:0/283736836 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560b27f46940 con 0x560b27b62390 2024-09-21T06:41:33.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.553+0000 7fce8cff9640 1 -- 172.21.15.7:0/283736836 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcea0010770 con 0x560b27b62390 2024-09-21T06:41:33.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.554+0000 7fce8cff9640 1 -- 172.21.15.7:0/283736836 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fce940047c0 con 0x560b27b62390 2024-09-21T06:41:33.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.554+0000 7fceb1804740 10 client.16509 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:41:33.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.554+0000 7fceb1804740 10 client.16509 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:41:33.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.554+0000 7fceb1804740 20 client.16509 populate_metadata read hostname 'smithi007' 2024-09-21T06:41:33.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.554+0000 7fceb1804740 1 --2- 172.21.15.7:0/283736836 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x560b27b419f0 0x560b27f49e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:33.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.554+0000 7fceb1804740 4 client.16509 mds_command: new command op to 24688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:41:33.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.554+0000 7fceb1804740 1 -- 172.21.15.7:0/283736836 --> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560b27ea2df0 con 0x560b27b419f0 2024-09-21T06:41:33.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.554+0000 7fcea882b640 1 --2- 172.21.15.7:0/283736836 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x560b27b419f0 0x560b27f49e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:33.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.554+0000 7fcea882b640 1 --2- 172.21.15.7:0/283736836 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x560b27b419f0 0x560b27f49e60 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d73ba4973c7a878f server_cookie=50f92f4f6b3eb523 in_seq=0 out_seq=0 2024-09-21T06:41:33.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.554+0000 7fce8cff9640 10 client.16509 ms_handle_connect on v2:172.21.15.144:6838/4027821922 2024-09-21T06:41:33.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.555+0000 7fce8cff9640 1 -- 172.21.15.7:0/283736836 <== mds.1 v2:172.21.15.144:6838/4027821922 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560b27ea2df0 con 0x560b27b419f0 2024-09-21T06:41:33.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.555+0000 7fce8cff9640 10 client.16509 handle_command_reply: tid=0 2024-09-21T06:41:33.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.555+0000 7fceb1804740 1 client.16509 shutdown 2024-09-21T06:41:33.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.555+0000 7fceb1804740 1 -- 172.21.15.7:0/283736836 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560b27b62390 msgr2=0x560b27f392f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:33.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.555+0000 7fceb1804740 1 --2- 172.21.15.7:0/283736836 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560b27b62390 0x560b27f392f0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fce9402a930 tx=0x7fce940316d0 comp rx=0 tx=0).stop 2024-09-21T06:41:33.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.555+0000 7fceb1804740 1 -- 172.21.15.7:0/283736836 shutdown_connections 2024-09-21T06:41:33.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.555+0000 7fceb1804740 1 --2- 172.21.15.7:0/283736836 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x560b27b419f0 0x560b27f49e60 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:33.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.555+0000 7fceb1804740 1 --2- 172.21.15.7:0/283736836 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560b27b83070 0x560b27f43db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:33.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.555+0000 7fceb1804740 1 --2- 172.21.15.7:0/283736836 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560b27b62390 0x560b27f392f0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:33.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.555+0000 7fce8cff9640 0 client.16509 ms_handle_reset on v2:172.21.15.144:6838/4027821922 2024-09-21T06:41:33.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.555+0000 7fceb1804740 1 --2- 172.21.15.7:0/283736836 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560b27b5a1b0 0x560b27f38d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:33.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.556+0000 7fceb1804740 1 -- 172.21.15.7:0/283736836 >> 172.21.15.7:0/283736836 conn(0x560b27b77460 msgr2=0x560b27f2d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:33.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.556+0000 7fceb1804740 1 -- 172.21.15.7:0/283736836 shutdown_connections 2024-09-21T06:41:33.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.556+0000 7fceb1804740 1 -- 172.21.15.7:0/283736836 wait complete. 2024-09-21T06:41:33.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.556+0000 7fceb1804740 20 client.16509 trim_cache size 0 max 16384 2024-09-21T06:41:33.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.570+0000 7fceb1804740 1 Processor -- start 2024-09-21T06:41:33.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.570+0000 7fceb1804740 1 -- start start 2024-09-21T06:41:33.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.570+0000 7fceb1804740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560b27b5a1b0 0x560b27f393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:33.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.570+0000 7fceb1804740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560b27b62390 0x560b27f43b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:33.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.570+0000 7fceb1804740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560b27b83070 0x560b27f44040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:33.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.570+0000 7fceb1804740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fcea41afbe0 con 0x560b27b83070 2024-09-21T06:41:33.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.570+0000 7fceb1804740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcea41ad4b0 con 0x560b27b62390 2024-09-21T06:41:33.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.570+0000 7fceb1804740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fcea41ab320 con 0x560b27b5a1b0 2024-09-21T06:41:33.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.570+0000 7fcea882b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560b27b83070 0x560b27f44040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:33.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.570+0000 7fcea902c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560b27b62390 0x560b27f43b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:33.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.570+0000 7fcea882b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560b27b83070 0x560b27f44040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49074/0 (socket says 172.21.15.7:49074) 2024-09-21T06:41:33.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.570+0000 7fcea882b640 1 -- 172.21.15.7:0/2300355072 learned_addr learned my addr 172.21.15.7:0/2300355072 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:41:33.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.570+0000 7fcea882b640 1 --2- 172.21.15.7:0/2300355072 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560b27b5a1b0 0x560b27f393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:33.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.571+0000 7fcea902c640 1 -- 172.21.15.7:0/2300355072 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560b27b5a1b0 msgr2=0x560b27f393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:33.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.571+0000 7fcea902c640 1 --2- 172.21.15.7:0/2300355072 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560b27b5a1b0 0x560b27f393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:33.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.571+0000 7fcea902c640 1 -- 172.21.15.7:0/2300355072 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560b27b83070 msgr2=0x560b27f44040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:33.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.571+0000 7fcea902c640 1 --2- 172.21.15.7:0/2300355072 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560b27b83070 0x560b27f44040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:33.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.571+0000 7fcea902c640 1 -- 172.21.15.7:0/2300355072 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b27f2c5b0 con 0x560b27b62390 2024-09-21T06:41:33.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.571+0000 7fcea902c640 1 --2- 172.21.15.7:0/2300355072 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560b27b62390 0x560b27f43b00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fce94031440 tx=0x7fce940058b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=439a2ba2eee61069 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:33.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.571+0000 7fce8effd640 1 -- 172.21.15.7:0/2300355072 <== mon.2 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce94035070 con 0x560b27b62390 2024-09-21T06:41:33.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.571+0000 7fce8effd640 1 -- 172.21.15.7:0/2300355072 <== mon.2 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fce94005dc0 con 0x560b27b62390 2024-09-21T06:41:33.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.571+0000 7fce8effd640 1 -- 172.21.15.7:0/2300355072 <== mon.2 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce94005030 con 0x560b27b62390 2024-09-21T06:41:33.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.572+0000 7fceb1804740 1 -- 172.21.15.7:0/2300355072 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560b27b62390 msgr2=0x560b27f43b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:33.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.572+0000 7fceb1804740 1 --2- 172.21.15.7:0/2300355072 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560b27b62390 0x560b27f43b00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fce94031440 tx=0x7fce940058b0 comp rx=0 tx=0).stop 2024-09-21T06:41:33.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.572+0000 7fceb1804740 1 -- 172.21.15.7:0/2300355072 shutdown_connections 2024-09-21T06:41:33.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.572+0000 7fceb1804740 1 --2- 172.21.15.7:0/2300355072 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560b27b83070 0x560b27f44040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:33.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.572+0000 7fceb1804740 1 --2- 172.21.15.7:0/2300355072 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560b27b62390 0x560b27f43b00 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:33.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.572+0000 7fceb1804740 1 --2- 172.21.15.7:0/2300355072 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560b27b5a1b0 0x560b27f393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:33.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.572+0000 7fceb1804740 1 -- 172.21.15.7:0/2300355072 >> 172.21.15.7:0/2300355072 conn(0x560b27b77460 msgr2=0x560b27f38cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:33.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.572+0000 7fceb1804740 1 -- 172.21.15.7:0/2300355072 shutdown_connections 2024-09-21T06:41:33.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.572+0000 7fceb1804740 1 -- 172.21.15.7:0/2300355072 wait complete. 2024-09-21T06:41:33.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.572+0000 7fceb1804740 1 -- start start 2024-09-21T06:41:33.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.573+0000 7fceb1804740 1 Processor -- start 2024-09-21T06:41:33.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.573+0000 7fceb1804740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560b27b5a1b0 0x560b27f3f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:33.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.573+0000 7fceb1804740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560b27b62390 0x560b27f3aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:33.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.573+0000 7fceb1804740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560b27b83070 0x560b27f3b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:33.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.573+0000 7fceb1804740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fcea41ab970 con 0x560b27b62390 2024-09-21T06:41:33.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.573+0000 7fceb1804740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcea41acde0 con 0x560b27b5a1b0 2024-09-21T06:41:33.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.573+0000 7fceb1804740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fcea41ac040 con 0x560b27b83070 2024-09-21T06:41:33.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.573+0000 7fceb1804740 10 client.0 _ll_register_callbacks cb 0x7fce94009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:41:33.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.573+0000 7fcea902c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560b27b62390 0x560b27f3aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:33.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.573+0000 7fcea882b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560b27b5a1b0 0x560b27f3f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:33.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.573+0000 7fcea902c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560b27b62390 0x560b27f3aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49090/0 (socket says 172.21.15.7:49090) 2024-09-21T06:41:33.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.573+0000 7fcea902c640 1 -- 172.21.15.7:0/3786151868 learned_addr learned my addr 172.21.15.7:0/3786151868 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:41:33.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.573+0000 7fcea882b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560b27b5a1b0 0x560b27f3f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.7:46642/0 (socket says 172.21.15.7:46642) 2024-09-21T06:41:33.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.574+0000 7fcea882b640 1 --2- 172.21.15.7:0/3786151868 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560b27b83070 0x560b27f3b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:33.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.574+0000 7fcea902c640 1 -- 172.21.15.7:0/3786151868 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560b27b83070 msgr2=0x560b27f3b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:33.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.574+0000 7fcea902c640 1 --2- 172.21.15.7:0/3786151868 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560b27b83070 0x560b27f3b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:33.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.574+0000 7fcea902c640 1 -- 172.21.15.7:0/3786151868 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560b27b5a1b0 msgr2=0x560b27f3f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:33.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.574+0000 7fcea902c640 1 --2- 172.21.15.7:0/3786151868 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560b27b5a1b0 0x560b27f3f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:33.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.574+0000 7fcea902c640 1 -- 172.21.15.7:0/3786151868 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b27fb5c40 con 0x560b27b62390 2024-09-21T06:41:33.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.574+0000 7fcea882b640 1 --2- 172.21.15.7:0/3786151868 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560b27b5a1b0 0x560b27f3f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:41:33.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.574+0000 7fcea902c640 1 --2- 172.21.15.7:0/3786151868 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560b27b62390 0x560b27f3aa40 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fce94003700 tx=0x7fce940316b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=398b222154afc082 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:33.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.574+0000 7fce8cff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:41:33.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.574+0000 7fce8cff9640 1 -- 172.21.15.7:0/3786151868 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce94035070 con 0x560b27b62390 2024-09-21T06:41:33.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.574+0000 7fce8cff9640 1 -- 172.21.15.7:0/3786151868 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fce94004dd0 con 0x560b27b62390 2024-09-21T06:41:33.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.574+0000 7fceb1804740 1 -- 172.21.15.7:0/3786151868 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fce94005dc0 con 0x560b27b62390 2024-09-21T06:41:33.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.574+0000 7fce8cff9640 1 -- 172.21.15.7:0/3786151868 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fce94067050 con 0x560b27b62390 2024-09-21T06:41:33.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.574+0000 7fceb1804740 10 client.16515 fetch_fsmap learned FSMap version 25 2024-09-21T06:41:33.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.574+0000 7fceb1804740 1 -- 172.21.15.7:0/3786151868 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560b27fb6d90 con 0x560b27b62390 2024-09-21T06:41:33.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.575+0000 7fce8cff9640 1 -- 172.21.15.7:0/3786151868 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fce94005dc0 con 0x560b27b62390 2024-09-21T06:41:33.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.575+0000 7fce8cff9640 1 -- 172.21.15.7:0/3786151868 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fce94060060 con 0x560b27b62390 2024-09-21T06:41:33.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.575+0000 7fceb1804740 10 client.16515 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:41:33.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.575+0000 7fceb1804740 10 client.16515 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:41:33.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.575+0000 7fceb1804740 20 client.16515 populate_metadata read hostname 'smithi007' 2024-09-21T06:41:33.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.575+0000 7fceb1804740 1 --2- 172.21.15.7:0/3786151868 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x560b27b16da0 0x560b27fb9430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:33.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.575+0000 7fceb1804740 4 client.16515 mds_command: new command op to 24688 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:41:33.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.575+0000 7fceb1804740 1 -- 172.21.15.7:0/3786151868 --> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560b27e9e8a0 con 0x560b27b16da0 2024-09-21T06:41:33.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.575+0000 7fcea882b640 1 --2- 172.21.15.7:0/3786151868 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x560b27b16da0 0x560b27fb9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:33.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.576+0000 7fce8cff9640 10 client.16515 ms_handle_connect on v2:172.21.15.144:6838/4027821922 2024-09-21T06:41:33.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.576+0000 7fcea882b640 1 --2- 172.21.15.7:0/3786151868 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x560b27b16da0 0x560b27fb9430 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f3f01cd5622d6292 server_cookie=af75732751e34116 in_seq=0 out_seq=0 2024-09-21T06:41:33.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.576+0000 7fce8cff9640 1 -- 172.21.15.7:0/3786151868 <== mds.1 v2:172.21.15.144:6838/4027821922 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560b27e9e8a0 con 0x560b27b16da0 2024-09-21T06:41:33.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.576+0000 7fce8cff9640 10 client.16515 handle_command_reply: tid=0 2024-09-21T06:41:33.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.576+0000 7fceb1804740 1 client.16515 shutdown 2024-09-21T06:41:33.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.576+0000 7fceb1804740 1 -- 172.21.15.7:0/3786151868 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560b27b62390 msgr2=0x560b27f3aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:33.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.576+0000 7fceb1804740 1 --2- 172.21.15.7:0/3786151868 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560b27b62390 0x560b27f3aa40 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fce94003700 tx=0x7fce940316b0 comp rx=0 tx=0).stop 2024-09-21T06:41:33.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.576+0000 7fceb1804740 1 -- 172.21.15.7:0/3786151868 shutdown_connections 2024-09-21T06:41:33.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.576+0000 7fceb1804740 1 --2- 172.21.15.7:0/3786151868 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x560b27b16da0 0x560b27fb9430 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:33.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.576+0000 7fceb1804740 1 --2- 172.21.15.7:0/3786151868 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560b27b83070 0x560b27f3b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:33.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.576+0000 7fceb1804740 1 --2- 172.21.15.7:0/3786151868 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560b27b62390 0x560b27f3aa40 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:33.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.576+0000 7fceb1804740 1 --2- 172.21.15.7:0/3786151868 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560b27b5a1b0 0x560b27f3f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:33.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.576+0000 7fceb1804740 1 -- 172.21.15.7:0/3786151868 >> 172.21.15.7:0/3786151868 conn(0x560b27b77460 msgr2=0x560b27f43b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:33.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.576+0000 7fce8cff9640 0 client.16515 ms_handle_reset on v2:172.21.15.144:6838/4027821922 2024-09-21T06:41:33.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.576+0000 7fceb1804740 1 -- 172.21.15.7:0/3786151868 shutdown_connections 2024-09-21T06:41:33.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.576+0000 7fceb1804740 1 -- 172.21.15.7:0/3786151868 wait complete. 2024-09-21T06:41:33.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.577+0000 7fceb1804740 20 client.16515 trim_cache size 0 max 16384 2024-09-21T06:41:33.583 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:41:33.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.577+0000 7fceab290640 1 -- 172.21.15.7:0/1786522059 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fce900b6680 msgr2=0x7fce900b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:33.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.577+0000 7fceab290640 1 --2- 172.21.15.7:0/1786522059 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fce900b6680 0x7fce900b8b90 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fce9c0aa990 tx=0x7fce9c07a3d0 comp rx=0 tx=0).stop 2024-09-21T06:41:33.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.577+0000 7fceab290640 1 -- 172.21.15.7:0/1786522059 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcea4108cf0 msgr2=0x7fcea419ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:33.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.577+0000 7fceab290640 1 --2- 172.21.15.7:0/1786522059 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcea4108cf0 0x7fcea419ebb0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fce9c00eaa0 tx=0x7fce9c00ef60 comp rx=0 tx=0).stop 2024-09-21T06:41:33.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.577+0000 7fceab290640 1 -- 172.21.15.7:0/1786522059 shutdown_connections 2024-09-21T06:41:33.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.577+0000 7fceab290640 1 --2- 172.21.15.7:0/1786522059 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fce900b6680 0x7fce900b8b90 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:33.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.577+0000 7fceab290640 1 --2- 172.21.15.7:0/1786522059 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcea4108cf0 0x7fcea419ebb0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:33.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.577+0000 7fceab290640 1 --2- 172.21.15.7:0/1786522059 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcea41083a0 0x7fcea4199910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:33.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.577+0000 7fceab290640 1 --2- 172.21.15.7:0/1786522059 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcea4102a60 0x7fcea4199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:33.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.577+0000 7fceab290640 1 -- 172.21.15.7:0/1786522059 >> 172.21.15.7:0/1786522059 conn(0x7fcea4079730 msgr2=0x7fcea4101440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:33.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.577+0000 7fceab290640 1 -- 172.21.15.7:0/1786522059 shutdown_connections 2024-09-21T06:41:33.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:33.577+0000 7fceab290640 1 -- 172.21.15.7:0/1786522059 wait complete. 2024-09-21T06:41:34.269 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:41:34.529 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:41:34.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:41:34 smithi007 ceph-mon[30983]: pgmap v480: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:41:34.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:41:34 smithi144 ceph-mon[34653]: pgmap v480: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:41:34.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:41:34 smithi018 ceph-mon[34477]: pgmap v480: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:41:35.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.035+0000 7fc76d8e6640 1 -- 172.21.15.7:0/1686335811 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc768102ac0 msgr2=0x7fc768102ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:35.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.035+0000 7fc76d8e6640 1 --2- 172.21.15.7:0/1686335811 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc768102ac0 0x7fc768102ed0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fc760009900 tx=0x7fc76002a410 comp rx=0 tx=0).stop 2024-09-21T06:41:35.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.035+0000 7fc76d8e6640 1 -- 172.21.15.7:0/1686335811 shutdown_connections 2024-09-21T06:41:35.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.035+0000 7fc76d8e6640 1 --2- 172.21.15.7:0/1686335811 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc768108d00 0x7fc76810f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:35.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.035+0000 7fc76d8e6640 1 --2- 172.21.15.7:0/1686335811 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc7681083b0 0x7fc7681087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:35.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.035+0000 7fc76d8e6640 1 --2- 172.21.15.7:0/1686335811 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc768102ac0 0x7fc768102ed0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:35.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.035+0000 7fc76d8e6640 1 -- 172.21.15.7:0/1686335811 >> 172.21.15.7:0/1686335811 conn(0x7fc768079790 msgr2=0x7fc768079ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:35.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.035+0000 7fc76d8e6640 1 -- 172.21.15.7:0/1686335811 shutdown_connections 2024-09-21T06:41:35.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.035+0000 7fc76d8e6640 1 -- 172.21.15.7:0/1686335811 wait complete. 2024-09-21T06:41:35.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.036+0000 7fc76d8e6640 1 Processor -- start 2024-09-21T06:41:35.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.036+0000 7fc76d8e6640 1 -- start start 2024-09-21T06:41:35.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.037+0000 7fc76d8e6640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc768102ac0 0x7fc7680ff650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:35.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.037+0000 7fc76d8e6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7681083b0 0x7fc7680ffb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:35.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.037+0000 7fc76d8e6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc768108d00 0x7fc7681000d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:35.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.037+0000 7fc76d8e6640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc7681129c0 con 0x7fc7681083b0 2024-09-21T06:41:35.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.037+0000 7fc76d8e6640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc768112840 con 0x7fc768108d00 2024-09-21T06:41:35.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.037+0000 7fc76d8e6640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc768112b40 con 0x7fc768102ac0 2024-09-21T06:41:35.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.037+0000 7fc7667fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7681083b0 0x7fc7680ffb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:35.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.037+0000 7fc7667fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7681083b0 0x7fc7680ffb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49110/0 (socket says 172.21.15.7:49110) 2024-09-21T06:41:35.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.037+0000 7fc7667fc640 1 -- 172.21.15.7:0/523179500 learned_addr learned my addr 172.21.15.7:0/523179500 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:41:35.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.037+0000 7fc766ffd640 1 --2- 172.21.15.7:0/523179500 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc768102ac0 0x7fc7680ff650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:35.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.037+0000 7fc7677fe640 1 --2- 172.21.15.7:0/523179500 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc768108d00 0x7fc7681000d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:35.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.037+0000 7fc7667fc640 1 -- 172.21.15.7:0/523179500 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc768102ac0 msgr2=0x7fc7680ff650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:35.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.037+0000 7fc7667fc640 1 --2- 172.21.15.7:0/523179500 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc768102ac0 0x7fc7680ff650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:35.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.037+0000 7fc7667fc640 1 -- 172.21.15.7:0/523179500 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc768108d00 msgr2=0x7fc7681000d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:35.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.037+0000 7fc7667fc640 1 --2- 172.21.15.7:0/523179500 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc768108d00 0x7fc7681000d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:35.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.037+0000 7fc7667fc640 1 -- 172.21.15.7:0/523179500 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7681a8760 con 0x7fc7681083b0 2024-09-21T06:41:35.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.038+0000 7fc7667fc640 1 --2- 172.21.15.7:0/523179500 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7681083b0 0x7fc7680ffb90 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fc75000d750 tx=0x7fc75000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:35.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.038+0000 7fc76c8e4640 1 -- 172.21.15.7:0/523179500 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc750017070 con 0x7fc7681083b0 2024-09-21T06:41:35.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.038+0000 7fc76c8e4640 1 -- 172.21.15.7:0/523179500 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc7500054d0 con 0x7fc7681083b0 2024-09-21T06:41:35.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.038+0000 7fc76d8e6640 1 -- 172.21.15.7:0/523179500 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7681a8a50 con 0x7fc7681083b0 2024-09-21T06:41:35.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.038+0000 7fc76c8e4640 1 -- 172.21.15.7:0/523179500 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc750004c30 con 0x7fc7681083b0 2024-09-21T06:41:35.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.038+0000 7fc76d8e6640 1 -- 172.21.15.7:0/523179500 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7681a8f90 con 0x7fc7681083b0 2024-09-21T06:41:35.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.040+0000 7fc76c8e4640 1 -- 172.21.15.7:0/523179500 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7fc750010460 con 0x7fc7681083b0 2024-09-21T06:41:35.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.041+0000 7fc773e5a740 1 Processor -- start 2024-09-21T06:41:35.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.041+0000 7fc773e5a740 1 -- start start 2024-09-21T06:41:35.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.041+0000 7fc773e5a740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564543421070 0x5645437c86a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:35.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.041+0000 7fc773e5a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645433f81b0 0x5645437c8be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:35.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.041+0000 7fc773e5a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564543400390 0x5645437c9120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:35.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.041+0000 7fc773e5a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56454373eea0 con 0x5645433f81b0 2024-09-21T06:41:35.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.041+0000 7fc773e5a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56454372e2d0 con 0x564543400390 2024-09-21T06:41:35.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.041+0000 7fc773e5a740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5645437320e0 con 0x564543421070 2024-09-21T06:41:35.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.041+0000 7fc766ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645433f81b0 0x5645437c8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:35.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.041+0000 7fc766ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645433f81b0 0x5645437c8be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49124/0 (socket says 172.21.15.7:49124) 2024-09-21T06:41:35.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.041+0000 7fc766ffd640 1 -- 172.21.15.7:0/679600133 learned_addr learned my addr 172.21.15.7:0/679600133 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:41:35.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.041+0000 7fc7667fc640 1 --2- 172.21.15.7:0/679600133 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564543400390 0x5645437c9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:35.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.041+0000 7fc7677fe640 1 --2- 172.21.15.7:0/679600133 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564543421070 0x5645437c86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:35.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.041+0000 7fc76c8e4640 1 --2- 172.21.15.7:0/523179500 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fc7540b6700 0x7fc7540b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:35.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.042+0000 7fc766ffd640 1 -- 172.21.15.7:0/679600133 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564543421070 msgr2=0x5645437c86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:35.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.042+0000 7fc766ffd640 1 --2- 172.21.15.7:0/679600133 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564543421070 0x5645437c86a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:35.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.042+0000 7fc766ffd640 1 -- 172.21.15.7:0/679600133 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564543400390 msgr2=0x5645437c9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:35.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.042+0000 7fc766ffd640 1 --2- 172.21.15.7:0/679600133 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564543400390 0x5645437c9120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:35.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.042+0000 7fc766ffd640 1 -- 172.21.15.7:0/679600133 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56454348c650 con 0x5645433f81b0 2024-09-21T06:41:35.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.042+0000 7fc7677fe640 1 --2- 172.21.15.7:0/523179500 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fc7540b6700 0x7fc7540b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:35.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.042+0000 7fc766ffd640 1 --2- 172.21.15.7:0/679600133 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645433f81b0 0x5645437c8be0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fc760009900 tx=0x7fc760032bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ffa63835f4e778f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:35.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.042+0000 7fc76c8e4640 1 -- 172.21.15.7:0/523179500 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fc7500e6f90 con 0x7fc7681083b0 2024-09-21T06:41:35.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.042+0000 7fc75dffb640 1 -- 172.21.15.7:0/679600133 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc760040070 con 0x5645433f81b0 2024-09-21T06:41:35.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.042+0000 7fc75dffb640 1 -- 172.21.15.7:0/679600133 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc760004030 con 0x5645433f81b0 2024-09-21T06:41:35.046 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.042+0000 7fc75dffb640 1 -- 172.21.15.7:0/679600133 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc760035040 con 0x5645433f81b0 2024-09-21T06:41:35.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.043+0000 7fc773e5a740 1 -- 172.21.15.7:0/679600133 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645433f81b0 msgr2=0x5645437c8be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:35.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.043+0000 7fc7677fe640 1 --2- 172.21.15.7:0/523179500 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fc7540b6700 0x7fc7540b8c10 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc758005fd0 tx=0x7fc758014040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:35.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.043+0000 7fc773e5a740 1 --2- 172.21.15.7:0/679600133 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645433f81b0 0x5645437c8be0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fc760009900 tx=0x7fc760032bd0 comp rx=0 tx=0).stop 2024-09-21T06:41:35.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.043+0000 7fc773e5a740 1 -- 172.21.15.7:0/679600133 shutdown_connections 2024-09-21T06:41:35.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.043+0000 7fc773e5a740 1 --2- 172.21.15.7:0/679600133 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564543400390 0x5645437c9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:35.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.043+0000 7fc773e5a740 1 --2- 172.21.15.7:0/679600133 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645433f81b0 0x5645437c8be0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:35.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.043+0000 7fc773e5a740 1 --2- 172.21.15.7:0/679600133 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564543421070 0x5645437c86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:35.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.043+0000 7fc773e5a740 1 -- 172.21.15.7:0/679600133 >> 172.21.15.7:0/679600133 conn(0x564543415460 msgr2=0x5645437c6590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:35.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.043+0000 7fc773e5a740 1 -- 172.21.15.7:0/679600133 shutdown_connections 2024-09-21T06:41:35.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.043+0000 7fc773e5a740 1 -- 172.21.15.7:0/679600133 wait complete. 2024-09-21T06:41:35.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.044+0000 7fc773e5a740 1 -- start start 2024-09-21T06:41:35.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.044+0000 7fc773e5a740 1 Processor -- start 2024-09-21T06:41:35.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.044+0000 7fc773e5a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5645433f81b0 0x5645437d3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:35.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.044+0000 7fc773e5a740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564543400390 0x5645437d4280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:35.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.044+0000 7fc773e5a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564543421070 0x5645437d4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:35.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.044+0000 7fc773e5a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56454358f700 con 0x564543421070 2024-09-21T06:41:35.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.044+0000 7fc773e5a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5645436c9160 con 0x5645433f81b0 2024-09-21T06:41:35.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.044+0000 7fc773e5a740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5645437d6e20 con 0x564543400390 2024-09-21T06:41:35.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.044+0000 7fc773e5a740 10 client.0 _ll_register_callbacks cb 0x5645436e29e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:41:35.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.044+0000 7fc7677fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564543421070 0x5645437d4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:35.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.044+0000 7fc766ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5645433f81b0 0x5645437d3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:35.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.044+0000 7fc7677fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564543421070 0x5645437d4800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49132/0 (socket says 172.21.15.7:49132) 2024-09-21T06:41:35.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.044+0000 7fc7677fe640 1 -- 172.21.15.7:0/1987754901 learned_addr learned my addr 172.21.15.7:0/1987754901 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:41:35.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.045+0000 7fc7667fc640 1 --2- 172.21.15.7:0/1987754901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564543400390 0x5645437d4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:35.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.045+0000 7fc7677fe640 1 -- 172.21.15.7:0/1987754901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564543400390 msgr2=0x5645437d4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:35.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.045+0000 7fc7677fe640 1 --2- 172.21.15.7:0/1987754901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564543400390 0x5645437d4280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:35.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.045+0000 7fc7677fe640 1 -- 172.21.15.7:0/1987754901 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5645433f81b0 msgr2=0x5645437d3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:35.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.045+0000 7fc7677fe640 1 --2- 172.21.15.7:0/1987754901 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5645433f81b0 0x5645437d3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:35.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.045+0000 7fc7677fe640 1 -- 172.21.15.7:0/1987754901 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5645436f6c90 con 0x564543421070 2024-09-21T06:41:35.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.045+0000 7fc766ffd640 1 --2- 172.21.15.7:0/1987754901 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5645433f81b0 0x5645437d3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:41:35.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.045+0000 7fc7677fe640 1 --2- 172.21.15.7:0/1987754901 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564543421070 0x5645437d4800 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fc758010910 tx=0x7fc758009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bebe9cd92d5f7438 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:35.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.045+0000 7fc746ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:41:35.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.045+0000 7fc746ffd640 1 -- 172.21.15.7:0/1987754901 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc758004d20 con 0x564543421070 2024-09-21T06:41:35.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.045+0000 7fc746ffd640 1 -- 172.21.15.7:0/1987754901 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fc75801e6f0 con 0x564543421070 2024-09-21T06:41:35.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.045+0000 7fc773e5a740 1 -- 172.21.15.7:0/1987754901 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc760004030 con 0x564543421070 2024-09-21T06:41:35.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.045+0000 7fc746ffd640 1 -- 172.21.15.7:0/1987754901 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc75801e8f0 con 0x564543421070 2024-09-21T06:41:35.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.045+0000 7fc773e5a740 10 client.16527 fetch_fsmap learned FSMap version 25 2024-09-21T06:41:35.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.045+0000 7fc773e5a740 1 -- 172.21.15.7:0/1987754901 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5645437e2bd0 con 0x564543421070 2024-09-21T06:41:35.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.046+0000 7fc746ffd640 1 -- 172.21.15.7:0/1987754901 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc760004030 con 0x564543421070 2024-09-21T06:41:35.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.046+0000 7fc746ffd640 1 -- 172.21.15.7:0/1987754901 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fc758025070 con 0x564543421070 2024-09-21T06:41:35.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.046+0000 7fc773e5a740 10 client.16527 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:41:35.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.046+0000 7fc773e5a740 10 client.16527 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:41:35.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.046+0000 7fc773e5a740 20 client.16527 populate_metadata read hostname 'smithi007' 2024-09-21T06:41:35.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.046+0000 7fc773e5a740 1 --2- 172.21.15.7:0/1987754901 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5645433df9f0 0x5645437e6180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:35.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.046+0000 7fc773e5a740 4 client.16527 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:41:35.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.046+0000 7fc773e5a740 1 -- 172.21.15.7:0/1987754901 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564543740df0 con 0x5645433df9f0 2024-09-21T06:41:35.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.046+0000 7fc766ffd640 1 --2- 172.21.15.7:0/1987754901 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5645433df9f0 0x5645437e6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:35.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.047+0000 7fc766ffd640 1 --2- 172.21.15.7:0/1987754901 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5645433df9f0 0x5645437e6180 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f88258d309257709 server_cookie=f73928003601a15f in_seq=0 out_seq=0 2024-09-21T06:41:35.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.047+0000 7fc746ffd640 10 client.16527 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:41:35.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.047+0000 7fc746ffd640 1 -- 172.21.15.7:0/1987754901 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564543740df0 con 0x5645433df9f0 2024-09-21T06:41:35.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.047+0000 7fc746ffd640 10 client.16527 handle_command_reply: tid=0 2024-09-21T06:41:35.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.048+0000 7fc773e5a740 1 client.16527 shutdown 2024-09-21T06:41:35.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.048+0000 7fc773e5a740 1 -- 172.21.15.7:0/1987754901 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564543421070 msgr2=0x5645437d4800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:35.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.048+0000 7fc773e5a740 1 --2- 172.21.15.7:0/1987754901 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564543421070 0x5645437d4800 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fc758010910 tx=0x7fc758009500 comp rx=0 tx=0).stop 2024-09-21T06:41:35.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.048+0000 7fc773e5a740 1 -- 172.21.15.7:0/1987754901 shutdown_connections 2024-09-21T06:41:35.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.048+0000 7fc773e5a740 1 --2- 172.21.15.7:0/1987754901 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5645433df9f0 0x5645437e6180 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:35.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.048+0000 7fc773e5a740 1 --2- 172.21.15.7:0/1987754901 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564543421070 0x5645437d4800 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:35.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.048+0000 7fc773e5a740 1 --2- 172.21.15.7:0/1987754901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564543400390 0x5645437d4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:35.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.048+0000 7fc773e5a740 1 --2- 172.21.15.7:0/1987754901 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5645433f81b0 0x5645437d3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:35.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.048+0000 7fc773e5a740 1 -- 172.21.15.7:0/1987754901 >> 172.21.15.7:0/1987754901 conn(0x564543415460 msgr2=0x5645437cb830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:35.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.048+0000 7fc746ffd640 0 client.16527 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:41:35.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.048+0000 7fc773e5a740 1 -- 172.21.15.7:0/1987754901 shutdown_connections 2024-09-21T06:41:35.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.048+0000 7fc773e5a740 1 -- 172.21.15.7:0/1987754901 wait complete. 2024-09-21T06:41:35.054 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.048+0000 7fc773e5a740 20 client.16527 trim_cache size 0 max 16384 2024-09-21T06:41:35.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.061+0000 7fc773e5a740 1 Processor -- start 2024-09-21T06:41:35.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.061+0000 7fc773e5a740 1 -- start start 2024-09-21T06:41:35.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.061+0000 7fc773e5a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645433f81b0 0x5645437ca090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:35.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.062+0000 7fc773e5a740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564543400390 0x5645437d5970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:35.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.062+0000 7fc773e5a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564543421070 0x5645437c5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:35.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.062+0000 7fc773e5a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc7681b3ef0 con 0x5645433f81b0 2024-09-21T06:41:35.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.062+0000 7fc773e5a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc7681b17c0 con 0x564543421070 2024-09-21T06:41:35.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.062+0000 7fc773e5a740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc7681af5f0 con 0x564543400390 2024-09-21T06:41:35.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.062+0000 7fc766ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645433f81b0 0x5645437ca090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:35.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.062+0000 7fc766ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645433f81b0 0x5645437ca090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49134/0 (socket says 172.21.15.7:49134) 2024-09-21T06:41:35.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.062+0000 7fc766ffd640 1 -- 172.21.15.7:0/1796127116 learned_addr learned my addr 172.21.15.7:0/1796127116 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:41:35.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.062+0000 7fc7667fc640 1 --2- 172.21.15.7:0/1796127116 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564543400390 0x5645437d5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:35.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.062+0000 7fc766ffd640 1 -- 172.21.15.7:0/1796127116 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564543400390 msgr2=0x5645437d5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:35.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.062+0000 7fc766ffd640 1 --2- 172.21.15.7:0/1796127116 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564543400390 0x5645437d5970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:35.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.062+0000 7fc766ffd640 1 -- 172.21.15.7:0/1796127116 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564543421070 msgr2=0x5645437c5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:35.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.062+0000 7fc766ffd640 1 --2- 172.21.15.7:0/1796127116 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564543421070 0x5645437c5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:35.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.062+0000 7fc766ffd640 1 -- 172.21.15.7:0/1796127116 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5645437c7350 con 0x5645433f81b0 2024-09-21T06:41:35.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.062+0000 7fc7667fc640 1 --2- 172.21.15.7:0/1796127116 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564543400390 0x5645437d5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:41:35.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.062+0000 7fc766ffd640 1 --2- 172.21.15.7:0/1796127116 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645433f81b0 0x5645437ca090 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fc760005150 tx=0x7fc760005180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=defa986b307286c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:35.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.062+0000 7fc75d7fa640 1 -- 172.21.15.7:0/1796127116 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc760040040 con 0x5645433f81b0 2024-09-21T06:41:35.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.062+0000 7fc75d7fa640 1 -- 172.21.15.7:0/1796127116 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc7600042e0 con 0x5645433f81b0 2024-09-21T06:41:35.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.062+0000 7fc75d7fa640 1 -- 172.21.15.7:0/1796127116 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc760035040 con 0x5645433f81b0 2024-09-21T06:41:35.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.063+0000 7fc773e5a740 1 -- 172.21.15.7:0/1796127116 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645433f81b0 msgr2=0x5645437ca090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:35.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.063+0000 7fc773e5a740 1 --2- 172.21.15.7:0/1796127116 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645433f81b0 0x5645437ca090 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fc760005150 tx=0x7fc760005180 comp rx=0 tx=0).stop 2024-09-21T06:41:35.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.063+0000 7fc773e5a740 1 -- 172.21.15.7:0/1796127116 shutdown_connections 2024-09-21T06:41:35.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.063+0000 7fc773e5a740 1 --2- 172.21.15.7:0/1796127116 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564543421070 0x5645437c5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:35.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.063+0000 7fc773e5a740 1 --2- 172.21.15.7:0/1796127116 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564543400390 0x5645437d5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:35.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.063+0000 7fc773e5a740 1 --2- 172.21.15.7:0/1796127116 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5645433f81b0 0x5645437ca090 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:35.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.063+0000 7fc773e5a740 1 -- 172.21.15.7:0/1796127116 >> 172.21.15.7:0/1796127116 conn(0x564543415460 msgr2=0x5645437d5260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:35.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.063+0000 7fc773e5a740 1 -- 172.21.15.7:0/1796127116 shutdown_connections 2024-09-21T06:41:35.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.063+0000 7fc773e5a740 1 -- 172.21.15.7:0/1796127116 wait complete. 2024-09-21T06:41:35.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.063+0000 7fc773e5a740 1 -- start start 2024-09-21T06:41:35.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.064+0000 7fc773e5a740 1 Processor -- start 2024-09-21T06:41:35.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.064+0000 7fc773e5a740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5645433f81b0 0x5645437dc5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:35.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.064+0000 7fc773e5a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564543400390 0x5645437d7a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:35.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.064+0000 7fc773e5a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564543421070 0x5645437d7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:35.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.064+0000 7fc773e5a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc7681afc80 con 0x564543400390 2024-09-21T06:41:35.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.064+0000 7fc773e5a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc7681b10f0 con 0x564543421070 2024-09-21T06:41:35.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.064+0000 7fc773e5a740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc7681b0350 con 0x5645433f81b0 2024-09-21T06:41:35.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.064+0000 7fc773e5a740 10 client.0 _ll_register_callbacks cb 0x7fc758009e50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:41:35.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.064+0000 7fc7667fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564543400390 0x5645437d7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:35.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.064+0000 7fc7667fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564543400390 0x5645437d7a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49136/0 (socket says 172.21.15.7:49136) 2024-09-21T06:41:35.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.064+0000 7fc7667fc640 1 -- 172.21.15.7:0/3601770702 learned_addr learned my addr 172.21.15.7:0/3601770702 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:41:35.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.064+0000 7fc766ffd640 1 --2- 172.21.15.7:0/3601770702 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5645433f81b0 0x5645437dc5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:35.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.064+0000 7fc7677fe640 1 --2- 172.21.15.7:0/3601770702 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564543421070 0x5645437d7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:35.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.064+0000 7fc7667fc640 1 -- 172.21.15.7:0/3601770702 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5645433f81b0 msgr2=0x5645437dc5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:35.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.065+0000 7fc7667fc640 1 --2- 172.21.15.7:0/3601770702 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5645433f81b0 0x5645437dc5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:35.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.065+0000 7fc7667fc640 1 -- 172.21.15.7:0/3601770702 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564543421070 msgr2=0x5645437d7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:35.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.065+0000 7fc7667fc640 1 --2- 172.21.15.7:0/3601770702 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564543421070 0x5645437d7fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:35.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.065+0000 7fc7667fc640 1 -- 172.21.15.7:0/3601770702 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5645437d8500 con 0x564543400390 2024-09-21T06:41:35.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.065+0000 7fc7667fc640 1 --2- 172.21.15.7:0/3601770702 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564543400390 0x5645437d7a80 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fc7500ea820 tx=0x7fc7500a8f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43a921f91b4788fa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:35.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.065+0000 7fc746ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:41:35.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.065+0000 7fc746ffd640 1 -- 172.21.15.7:0/3601770702 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc750020040 con 0x564543400390 2024-09-21T06:41:35.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.065+0000 7fc746ffd640 1 -- 172.21.15.7:0/3601770702 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fc7500ac190 con 0x564543400390 2024-09-21T06:41:35.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.065+0000 7fc773e5a740 1 -- 172.21.15.7:0/3601770702 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5645437cf8f0 con 0x564543400390 2024-09-21T06:41:35.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.065+0000 7fc746ffd640 1 -- 172.21.15.7:0/3601770702 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc7500e4c00 con 0x564543400390 2024-09-21T06:41:35.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.065+0000 7fc773e5a740 10 client.16533 fetch_fsmap learned FSMap version 25 2024-09-21T06:41:35.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.065+0000 7fc773e5a740 1 -- 172.21.15.7:0/3601770702 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564543850700 con 0x564543400390 2024-09-21T06:41:35.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.065+0000 7fc746ffd640 1 -- 172.21.15.7:0/3601770702 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5645437cf8f0 con 0x564543400390 2024-09-21T06:41:35.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.065+0000 7fc746ffd640 1 -- 172.21.15.7:0/3601770702 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fc7500a8880 con 0x564543400390 2024-09-21T06:41:35.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.066+0000 7fc773e5a740 10 client.16533 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:41:35.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.066+0000 7fc773e5a740 10 client.16533 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:41:35.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.066+0000 7fc773e5a740 20 client.16533 populate_metadata read hostname 'smithi007' 2024-09-21T06:41:35.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.066+0000 7fc773e5a740 1 --2- 172.21.15.7:0/3601770702 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5645433b4da0 0x564543852f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:35.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.066+0000 7fc773e5a740 4 client.16533 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:41:35.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.066+0000 7fc773e5a740 1 -- 172.21.15.7:0/3601770702 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5645437c19e0 con 0x5645433b4da0 2024-09-21T06:41:35.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.066+0000 7fc766ffd640 1 --2- 172.21.15.7:0/3601770702 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5645433b4da0 0x564543852f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:35.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.066+0000 7fc766ffd640 1 --2- 172.21.15.7:0/3601770702 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5645433b4da0 0x564543852f40 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab0ca715eb2b4b01 server_cookie=8d6e94a6780a883f in_seq=0 out_seq=0 2024-09-21T06:41:35.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.066+0000 7fc746ffd640 10 client.16533 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:41:35.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.066+0000 7fc746ffd640 1 -- 172.21.15.7:0/3601770702 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5645437c19e0 con 0x5645433b4da0 2024-09-21T06:41:35.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.066+0000 7fc746ffd640 10 client.16533 handle_command_reply: tid=0 2024-09-21T06:41:35.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.067+0000 7fc773e5a740 1 client.16533 shutdown 2024-09-21T06:41:35.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.067+0000 7fc773e5a740 1 -- 172.21.15.7:0/3601770702 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564543400390 msgr2=0x5645437d7a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:35.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.067+0000 7fc773e5a740 1 --2- 172.21.15.7:0/3601770702 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564543400390 0x5645437d7a80 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fc7500ea820 tx=0x7fc7500a8f00 comp rx=0 tx=0).stop 2024-09-21T06:41:35.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.067+0000 7fc773e5a740 1 -- 172.21.15.7:0/3601770702 shutdown_connections 2024-09-21T06:41:35.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.067+0000 7fc773e5a740 1 --2- 172.21.15.7:0/3601770702 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5645433b4da0 0x564543852f40 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:35.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.067+0000 7fc773e5a740 1 --2- 172.21.15.7:0/3601770702 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564543421070 0x5645437d7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:35.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.067+0000 7fc773e5a740 1 --2- 172.21.15.7:0/3601770702 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564543400390 0x5645437d7a80 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:35.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.067+0000 7fc773e5a740 1 --2- 172.21.15.7:0/3601770702 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5645433f81b0 0x5645437dc5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:35.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.067+0000 7fc773e5a740 1 -- 172.21.15.7:0/3601770702 >> 172.21.15.7:0/3601770702 conn(0x564543415460 msgr2=0x5645437c95c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:35.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.067+0000 7fc746ffd640 0 client.16533 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:41:35.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.067+0000 7fc773e5a740 1 -- 172.21.15.7:0/3601770702 shutdown_connections 2024-09-21T06:41:35.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.067+0000 7fc773e5a740 1 -- 172.21.15.7:0/3601770702 wait complete. 2024-09-21T06:41:35.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.067+0000 7fc773e5a740 20 client.16533 trim_cache size 0 max 16384 2024-09-21T06:41:35.074 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:41:35.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.068+0000 7fc76d8e6640 1 -- 172.21.15.7:0/523179500 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fc7540b6700 msgr2=0x7fc7540b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:35.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.068+0000 7fc76d8e6640 1 --2- 172.21.15.7:0/523179500 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fc7540b6700 0x7fc7540b8c10 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc758005fd0 tx=0x7fc758014040 comp rx=0 tx=0).stop 2024-09-21T06:41:35.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.068+0000 7fc76d8e6640 1 -- 172.21.15.7:0/523179500 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7681083b0 msgr2=0x7fc7680ffb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:35.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.068+0000 7fc76d8e6640 1 --2- 172.21.15.7:0/523179500 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7681083b0 0x7fc7680ffb90 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fc75000d750 tx=0x7fc75000dc10 comp rx=0 tx=0).stop 2024-09-21T06:41:35.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.068+0000 7fc76d8e6640 1 -- 172.21.15.7:0/523179500 shutdown_connections 2024-09-21T06:41:35.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.068+0000 7fc76d8e6640 1 --2- 172.21.15.7:0/523179500 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fc7540b6700 0x7fc7540b8c10 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:35.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.068+0000 7fc76d8e6640 1 --2- 172.21.15.7:0/523179500 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc768108d00 0x7fc7681000d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:35.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.068+0000 7fc76d8e6640 1 --2- 172.21.15.7:0/523179500 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc7681083b0 0x7fc7680ffb90 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:35.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.068+0000 7fc76d8e6640 1 --2- 172.21.15.7:0/523179500 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc768102ac0 0x7fc7680ff650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:35.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.068+0000 7fc76d8e6640 1 -- 172.21.15.7:0/523179500 >> 172.21.15.7:0/523179500 conn(0x7fc768079790 msgr2=0x7fc768101ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:35.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.068+0000 7fc76d8e6640 1 -- 172.21.15.7:0/523179500 shutdown_connections 2024-09-21T06:41:35.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:35.068+0000 7fc76d8e6640 1 -- 172.21.15.7:0/523179500 wait complete. 2024-09-21T06:41:36.782 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:41:36.783 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:41:36.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:41:36 smithi144 ceph-mon[34653]: pgmap v481: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:41:36.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:41:36 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:41:36.807 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:41:36 smithi007 ceph-mon[30983]: pgmap v481: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:41:36.807 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:41:36 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:41:36.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:41:36 smithi018 ceph-mon[34477]: pgmap v481: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:41:36.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:41:36 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:41:37.039 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:41:37.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.530+0000 7f6d53ea0640 1 -- 172.21.15.7:0/528000444 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d4c108530 msgr2=0x7f6d4c10ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:37.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.530+0000 7f6d53ea0640 1 --2- 172.21.15.7:0/528000444 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d4c108530 0x7f6d4c10ed60 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f6d44009ca0 tx=0x7f6d4402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:41:37.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.530+0000 7f6d53ea0640 1 -- 172.21.15.7:0/528000444 shutdown_connections 2024-09-21T06:41:37.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.530+0000 7f6d53ea0640 1 --2- 172.21.15.7:0/528000444 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d4c108530 0x7f6d4c10ed60 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:37.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.530+0000 7f6d53ea0640 1 --2- 172.21.15.7:0/528000444 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d4c107be0 0x7f6d4c107ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:37.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.530+0000 7f6d53ea0640 1 --2- 172.21.15.7:0/528000444 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d4c1022a0 0x7f6d4c1026b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:37.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.530+0000 7f6d53ea0640 1 -- 172.21.15.7:0/528000444 >> 172.21.15.7:0/528000444 conn(0x7f6d4c079ec0 msgr2=0x7f6d4c07a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:37.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.530+0000 7f6d53ea0640 1 -- 172.21.15.7:0/528000444 shutdown_connections 2024-09-21T06:41:37.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.530+0000 7f6d53ea0640 1 -- 172.21.15.7:0/528000444 wait complete. 2024-09-21T06:41:37.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.531+0000 7f6d53ea0640 1 Processor -- start 2024-09-21T06:41:37.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.531+0000 7f6d53ea0640 1 -- start start 2024-09-21T06:41:37.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.531+0000 7f6d53ea0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d4c1022a0 0x7f6d4c19a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:37.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.531+0000 7f6d53ea0640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d4c107be0 0x7f6d4c19aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:37.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.531+0000 7f6d53ea0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d4c108530 0x7f6d4c19fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:37.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.531+0000 7f6d53ea0640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6d4c113b60 con 0x7f6d4c108530 2024-09-21T06:41:37.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.531+0000 7f6d53ea0640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6d4c1139e0 con 0x7f6d4c1022a0 2024-09-21T06:41:37.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.531+0000 7f6d53ea0640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6d4c113ce0 con 0x7f6d4c107be0 2024-09-21T06:41:37.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.531+0000 7f6d5243d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d4c108530 0x7f6d4c19fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:37.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.531+0000 7f6d5243d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d4c108530 0x7f6d4c19fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49156/0 (socket says 172.21.15.7:49156) 2024-09-21T06:41:37.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.531+0000 7f6d51c3c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d4c1022a0 0x7f6d4c19a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:37.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.531+0000 7f6d5243d640 1 -- 172.21.15.7:0/62848446 learned_addr learned my addr 172.21.15.7:0/62848446 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:41:37.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.531+0000 7f6d5143b640 1 --2- 172.21.15.7:0/62848446 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d4c107be0 0x7f6d4c19aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:37.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.532+0000 7f6d5243d640 1 -- 172.21.15.7:0/62848446 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d4c107be0 msgr2=0x7f6d4c19aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:37.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.532+0000 7f6d5243d640 1 --2- 172.21.15.7:0/62848446 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d4c107be0 0x7f6d4c19aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:37.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.532+0000 7f6d5243d640 1 -- 172.21.15.7:0/62848446 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d4c1022a0 msgr2=0x7f6d4c19a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:37.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.532+0000 7f6d5243d640 1 --2- 172.21.15.7:0/62848446 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d4c1022a0 0x7f6d4c19a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:37.547 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.532+0000 7f6d5243d640 1 -- 172.21.15.7:0/62848446 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d4c1a0440 con 0x7f6d4c108530 2024-09-21T06:41:37.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.532+0000 7f6d5243d640 1 --2- 172.21.15.7:0/62848446 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d4c108530 0x7f6d4c19fd10 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f6d44005cc0 tx=0x7f6d4402f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:37.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.535+0000 7f6d4affd640 1 -- 172.21.15.7:0/62848446 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d44003bf0 con 0x7f6d4c108530 2024-09-21T06:41:37.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.535+0000 7f6d4affd640 1 -- 172.21.15.7:0/62848446 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6d44003d90 con 0x7f6d4c108530 2024-09-21T06:41:37.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.535+0000 7f6d4affd640 1 -- 172.21.15.7:0/62848446 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d4402fbc0 con 0x7f6d4c108530 2024-09-21T06:41:37.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.535+0000 7f6d53ea0640 1 -- 172.21.15.7:0/62848446 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d4c1a06d0 con 0x7f6d4c108530 2024-09-21T06:41:37.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.535+0000 7f6d53ea0640 1 -- 172.21.15.7:0/62848446 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d4c1a6e90 con 0x7f6d4c108530 2024-09-21T06:41:37.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.538+0000 7f6d5a414740 1 Processor -- start 2024-09-21T06:41:37.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.538+0000 7f6d4affd640 1 -- 172.21.15.7:0/62848446 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f6d4402fd60 con 0x7f6d4c108530 2024-09-21T06:41:37.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.538+0000 7f6d5a414740 1 -- start start 2024-09-21T06:41:37.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.538+0000 7f6d5a414740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a92555d350 0x55a925904430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:37.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.538+0000 7f6d5a414740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a925534490 0x55a925904970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:37.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.538+0000 7f6d5a414740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a92553c670 0x55a925904eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:37.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.538+0000 7f6d5a414740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55a92587ae60 con 0x55a925534490 2024-09-21T06:41:37.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.538+0000 7f6d5a414740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a92586a290 con 0x55a92553c670 2024-09-21T06:41:37.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.538+0000 7f6d5a414740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55a92586e0a0 con 0x55a92555d350 2024-09-21T06:41:37.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.538+0000 7f6d51c3c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a925534490 0x55a925904970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:37.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.539+0000 7f6d5143b640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a92555d350 0x55a925904430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:37.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.539+0000 7f6d51c3c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a925534490 0x55a925904970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49172/0 (socket says 172.21.15.7:49172) 2024-09-21T06:41:37.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.539+0000 7f6d51c3c640 1 -- 172.21.15.7:0/4237556695 learned_addr learned my addr 172.21.15.7:0/4237556695 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:41:37.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.539+0000 7f6d5143b640 1 --2- 172.21.15.7:0/4237556695 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a92553c670 0x55a925904eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:37.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.539+0000 7f6d4affd640 1 --2- 172.21.15.7:0/62848446 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f6d340b6700 0x7f6d340b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:37.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.539+0000 7f6d51c3c640 1 -- 172.21.15.7:0/4237556695 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a92555d350 msgr2=0x55a925904430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:37.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.539+0000 7f6d51c3c640 1 --2- 172.21.15.7:0/4237556695 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a92555d350 0x55a925904430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:37.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.539+0000 7f6d51c3c640 1 -- 172.21.15.7:0/4237556695 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a92553c670 msgr2=0x55a925904eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:37.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.539+0000 7f6d51c3c640 1 --2- 172.21.15.7:0/4237556695 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a92553c670 0x55a925904eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:37.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.539+0000 7f6d51c3c640 1 -- 172.21.15.7:0/4237556695 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9255c8930 con 0x55a925534490 2024-09-21T06:41:37.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.539+0000 7f6d5143b640 1 --2- 172.21.15.7:0/4237556695 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a92555d350 0x55a925904430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:41:37.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.539+0000 7f6d5243d640 1 --2- 172.21.15.7:0/62848446 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f6d340b6700 0x7f6d340b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:37.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.539+0000 7f6d4affd640 1 -- 172.21.15.7:0/62848446 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f6d44108a40 con 0x7f6d4c108530 2024-09-21T06:41:37.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.539+0000 7f6d51c3c640 1 --2- 172.21.15.7:0/4237556695 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a925534490 0x55a925904970 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c00bd10 tx=0x7f6d3c0107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b766a0ac8800f11 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:37.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.539+0000 7f6d33fff640 1 -- 172.21.15.7:0/4237556695 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d3c004030 con 0x55a925534490 2024-09-21T06:41:37.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.539+0000 7f6d33fff640 1 -- 172.21.15.7:0/4237556695 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6d3c0035f0 con 0x55a925534490 2024-09-21T06:41:37.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.539+0000 7f6d33fff640 1 -- 172.21.15.7:0/4237556695 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d3c011680 con 0x55a925534490 2024-09-21T06:41:37.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.540+0000 7f6d5a414740 1 -- 172.21.15.7:0/4237556695 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a925534490 msgr2=0x55a925904970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:37.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.540+0000 7f6d5243d640 1 --2- 172.21.15.7:0/62848446 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f6d340b6700 0x7f6d340b8c10 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6d440cbba0 tx=0x7f6d4409b6f0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:37.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.540+0000 7f6d5a414740 1 --2- 172.21.15.7:0/4237556695 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a925534490 0x55a925904970 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c00bd10 tx=0x7f6d3c0107a0 comp rx=0 tx=0).stop 2024-09-21T06:41:37.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.540+0000 7f6d5a414740 1 -- 172.21.15.7:0/4237556695 shutdown_connections 2024-09-21T06:41:37.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.540+0000 7f6d5a414740 1 --2- 172.21.15.7:0/4237556695 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a92553c670 0x55a925904eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:37.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.540+0000 7f6d5a414740 1 --2- 172.21.15.7:0/4237556695 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a925534490 0x55a925904970 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:37.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.540+0000 7f6d5a414740 1 --2- 172.21.15.7:0/4237556695 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a92555d350 0x55a925904430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:37.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.540+0000 7f6d5a414740 1 -- 172.21.15.7:0/4237556695 >> 172.21.15.7:0/4237556695 conn(0x55a925551740 msgr2=0x55a925902320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:37.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.540+0000 7f6d5a414740 1 -- 172.21.15.7:0/4237556695 shutdown_connections 2024-09-21T06:41:37.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.541+0000 7f6d5a414740 1 -- 172.21.15.7:0/4237556695 wait complete. 2024-09-21T06:41:37.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.541+0000 7f6d5a414740 1 -- start start 2024-09-21T06:41:37.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.541+0000 7f6d5a414740 1 Processor -- start 2024-09-21T06:41:37.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.541+0000 7f6d5a414740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a925534490 0x55a925910000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:37.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.541+0000 7f6d5a414740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a92553c670 0x55a925910540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:37.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.541+0000 7f6d5a414740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a92555d350 0x55a92591bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:37.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.542+0000 7f6d5a414740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55a9256cb890 con 0x55a925534490 2024-09-21T06:41:37.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.542+0000 7f6d5a414740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a925804d40 con 0x55a92555d350 2024-09-21T06:41:37.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.542+0000 7f6d5a414740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55a925912c10 con 0x55a92553c670 2024-09-21T06:41:37.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.542+0000 7f6d5a414740 10 client.0 _ll_register_callbacks cb 0x55a925868c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:41:37.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.542+0000 7f6d5143b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a925534490 0x55a925910000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:37.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.542+0000 7f6d5143b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a925534490 0x55a925910000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49180/0 (socket says 172.21.15.7:49180) 2024-09-21T06:41:37.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.542+0000 7f6d5143b640 1 -- 172.21.15.7:0/1242059835 learned_addr learned my addr 172.21.15.7:0/1242059835 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:41:37.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.542+0000 7f6d51c3c640 1 --2- 172.21.15.7:0/1242059835 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a92553c670 0x55a925910540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:37.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.542+0000 7f6d5143b640 1 --2- 172.21.15.7:0/1242059835 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a92555d350 0x55a92591bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:37.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.542+0000 7f6d5143b640 1 -- 172.21.15.7:0/1242059835 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a92553c670 msgr2=0x55a925910540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:37.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.542+0000 7f6d5143b640 1 --2- 172.21.15.7:0/1242059835 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a92553c670 0x55a925910540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:37.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.542+0000 7f6d5143b640 1 -- 172.21.15.7:0/1242059835 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a92555d350 msgr2=0x55a92591bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:37.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.542+0000 7f6d5143b640 1 --2- 172.21.15.7:0/1242059835 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a92555d350 0x55a92591bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:37.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.542+0000 7f6d5143b640 1 -- 172.21.15.7:0/1242059835 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a92591c4f0 con 0x55a925534490 2024-09-21T06:41:37.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.542+0000 7f6d51c3c640 1 --2- 172.21.15.7:0/1242059835 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a92553c670 0x55a925910540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:41:37.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.542+0000 7f6d5143b640 1 --2- 172.21.15.7:0/1242059835 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a925534490 0x55a925910000 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f6d40004420 tx=0x7f6d40016040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49f86ae00080d739 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:37.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.542+0000 7f6d317fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:41:37.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.542+0000 7f6d317fa640 1 -- 172.21.15.7:0/1242059835 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d40005220 con 0x55a925534490 2024-09-21T06:41:37.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.542+0000 7f6d317fa640 1 -- 172.21.15.7:0/1242059835 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f6d400053c0 con 0x55a925534490 2024-09-21T06:41:37.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.542+0000 7f6d5a414740 1 -- 172.21.15.7:0/1242059835 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6d3c0035f0 con 0x55a925534490 2024-09-21T06:41:37.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.543+0000 7f6d317fa640 1 -- 172.21.15.7:0/1242059835 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6d400055c0 con 0x55a925534490 2024-09-21T06:41:37.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.543+0000 7f6d5a414740 10 client.16545 fetch_fsmap learned FSMap version 25 2024-09-21T06:41:37.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.543+0000 7f6d5a414740 1 -- 172.21.15.7:0/1242059835 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a92591ee60 con 0x55a925534490 2024-09-21T06:41:37.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.543+0000 7f6d317fa640 1 -- 172.21.15.7:0/1242059835 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6d3c0035f0 con 0x55a925534490 2024-09-21T06:41:37.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.543+0000 7f6d317fa640 1 -- 172.21.15.7:0/1242059835 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f6d40012920 con 0x55a925534490 2024-09-21T06:41:37.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.543+0000 7f6d5a414740 10 client.16545 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:41:37.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.543+0000 7f6d5a414740 10 client.16545 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:41:37.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.543+0000 7f6d5a414740 20 client.16545 populate_metadata read hostname 'smithi007' 2024-09-21T06:41:37.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.543+0000 7f6d5a414740 1 --2- 172.21.15.7:0/1242059835 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55a92551bcd0 0x55a9259222f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:37.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.543+0000 7f6d5a414740 4 client.16545 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:41:37.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.543+0000 7f6d5a414740 1 -- 172.21.15.7:0/1242059835 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a92587cdb0 con 0x55a92551bcd0 2024-09-21T06:41:37.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.544+0000 7f6d51c3c640 1 --2- 172.21.15.7:0/1242059835 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55a92551bcd0 0x55a9259222f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:37.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.544+0000 7f6d51c3c640 1 --2- 172.21.15.7:0/1242059835 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55a92551bcd0 0x55a9259222f0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=241bada299db00cf server_cookie=df021ea80c508b73 in_seq=0 out_seq=0 2024-09-21T06:41:37.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.544+0000 7f6d317fa640 10 client.16545 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:41:37.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.545+0000 7f6d317fa640 1 -- 172.21.15.7:0/1242059835 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a92587cdb0 con 0x55a92551bcd0 2024-09-21T06:41:37.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.545+0000 7f6d317fa640 10 client.16545 handle_command_reply: tid=0 2024-09-21T06:41:37.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.545+0000 7f6d5a414740 1 client.16545 shutdown 2024-09-21T06:41:37.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.545+0000 7f6d5a414740 1 -- 172.21.15.7:0/1242059835 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a925534490 msgr2=0x55a925910000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:37.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.545+0000 7f6d5a414740 1 --2- 172.21.15.7:0/1242059835 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a925534490 0x55a925910000 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f6d40004420 tx=0x7f6d40016040 comp rx=0 tx=0).stop 2024-09-21T06:41:37.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.545+0000 7f6d5a414740 1 -- 172.21.15.7:0/1242059835 shutdown_connections 2024-09-21T06:41:37.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.545+0000 7f6d5a414740 1 --2- 172.21.15.7:0/1242059835 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55a92551bcd0 0x55a9259222f0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:37.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.545+0000 7f6d5a414740 1 --2- 172.21.15.7:0/1242059835 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a92555d350 0x55a92591bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:37.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.545+0000 7f6d5a414740 1 --2- 172.21.15.7:0/1242059835 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a92553c670 0x55a925910540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:37.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.545+0000 7f6d317fa640 0 client.16545 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:41:37.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.545+0000 7f6d5a414740 1 --2- 172.21.15.7:0/1242059835 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a925534490 0x55a925910000 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:37.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.545+0000 7f6d5a414740 1 -- 172.21.15.7:0/1242059835 >> 172.21.15.7:0/1242059835 conn(0x55a925551740 msgr2=0x55a9259075c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:37.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.545+0000 7f6d5a414740 1 -- 172.21.15.7:0/1242059835 shutdown_connections 2024-09-21T06:41:37.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.545+0000 7f6d5a414740 1 -- 172.21.15.7:0/1242059835 wait complete. 2024-09-21T06:41:37.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.545+0000 7f6d5a414740 20 client.16545 trim_cache size 0 max 16384 2024-09-21T06:41:37.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.563+0000 7f6d5a414740 1 Processor -- start 2024-09-21T06:41:37.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.563+0000 7f6d5a414740 1 -- start start 2024-09-21T06:41:37.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.563+0000 7f6d5a414740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a92551bcd0 0x55a925907c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:37.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.563+0000 7f6d5a414740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a925534490 0x55a92591be60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:37.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.563+0000 7f6d5a414740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a92553c670 0x55a9259094c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:37.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.563+0000 7f6d5a414740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6d4c1b1de0 con 0x55a92551bcd0 2024-09-21T06:41:37.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.563+0000 7f6d5a414740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6d4c1af6b0 con 0x55a925534490 2024-09-21T06:41:37.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.563+0000 7f6d5a414740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6d4c1ad4e0 con 0x55a92553c670 2024-09-21T06:41:37.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.563+0000 7f6d5143b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a92551bcd0 0x55a925907c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:37.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.563+0000 7f6d5143b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a92551bcd0 0x55a925907c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49188/0 (socket says 172.21.15.7:49188) 2024-09-21T06:41:37.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.563+0000 7f6d5143b640 1 -- 172.21.15.7:0/2790599531 learned_addr learned my addr 172.21.15.7:0/2790599531 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:41:37.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.563+0000 7f6d51c3c640 1 --2- 172.21.15.7:0/2790599531 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a925534490 0x55a92591be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:37.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.564+0000 7f6d5143b640 1 -- 172.21.15.7:0/2790599531 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a92553c670 msgr2=0x55a9259094c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:37.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.564+0000 7f6d5143b640 1 --2- 172.21.15.7:0/2790599531 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a92553c670 0x55a9259094c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:37.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.564+0000 7f6d5143b640 1 -- 172.21.15.7:0/2790599531 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a925534490 msgr2=0x55a92591be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:37.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.564+0000 7f6d5143b640 1 --2- 172.21.15.7:0/2790599531 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a925534490 0x55a92591be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:37.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.564+0000 7f6d5143b640 1 -- 172.21.15.7:0/2790599531 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a925901a70 con 0x55a92551bcd0 2024-09-21T06:41:37.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.564+0000 7f6d5143b640 1 --2- 172.21.15.7:0/2790599531 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a92551bcd0 0x55a925907c40 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f6d40015040 tx=0x7f6d4000bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e9642043b37c3d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:37.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.564+0000 7f6d337fe640 1 -- 172.21.15.7:0/2790599531 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d40030070 con 0x55a92551bcd0 2024-09-21T06:41:37.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.564+0000 7f6d337fe640 1 -- 172.21.15.7:0/2790599531 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6d40012070 con 0x55a92551bcd0 2024-09-21T06:41:37.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.564+0000 7f6d337fe640 1 -- 172.21.15.7:0/2790599531 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d40004990 con 0x55a92551bcd0 2024-09-21T06:41:37.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.565+0000 7f6d5a414740 1 -- 172.21.15.7:0/2790599531 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a92551bcd0 msgr2=0x55a925907c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:37.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.565+0000 7f6d5a414740 1 --2- 172.21.15.7:0/2790599531 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a92551bcd0 0x55a925907c40 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f6d40015040 tx=0x7f6d4000bee0 comp rx=0 tx=0).stop 2024-09-21T06:41:37.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.565+0000 7f6d5a414740 1 -- 172.21.15.7:0/2790599531 shutdown_connections 2024-09-21T06:41:37.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.565+0000 7f6d5a414740 1 --2- 172.21.15.7:0/2790599531 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a92553c670 0x55a9259094c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:37.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.565+0000 7f6d5a414740 1 --2- 172.21.15.7:0/2790599531 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a925534490 0x55a92591be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:37.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.565+0000 7f6d5a414740 1 --2- 172.21.15.7:0/2790599531 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a92551bcd0 0x55a925907c40 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:37.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.565+0000 7f6d5a414740 1 -- 172.21.15.7:0/2790599531 >> 172.21.15.7:0/2790599531 conn(0x55a925551740 msgr2=0x55a925907530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:37.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.565+0000 7f6d5a414740 1 -- 172.21.15.7:0/2790599531 shutdown_connections 2024-09-21T06:41:37.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.565+0000 7f6d5a414740 1 -- 172.21.15.7:0/2790599531 wait complete. 2024-09-21T06:41:37.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.565+0000 7f6d5a414740 1 -- start start 2024-09-21T06:41:37.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.565+0000 7f6d5a414740 1 Processor -- start 2024-09-21T06:41:37.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.566+0000 7f6d5a414740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a92551bcd0 0x55a925918330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:37.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.566+0000 7f6d5a414740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a925534490 0x55a9259188d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:37.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.566+0000 7f6d5a414740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a92553c670 0x55a925913030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:37.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.566+0000 7f6d5a414740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6d4c1adb70 con 0x55a92553c670 2024-09-21T06:41:37.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.566+0000 7f6d5a414740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6d4c1aefe0 con 0x55a92551bcd0 2024-09-21T06:41:37.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.566+0000 7f6d5a414740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6d4c1ae240 con 0x55a925534490 2024-09-21T06:41:37.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.566+0000 7f6d5a414740 10 client.0 _ll_register_callbacks cb 0x7f6d4000ba20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:41:37.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.566+0000 7f6d5143b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a92553c670 0x55a925913030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:37.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.566+0000 7f6d5143b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a92553c670 0x55a925913030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49200/0 (socket says 172.21.15.7:49200) 2024-09-21T06:41:37.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.566+0000 7f6d5143b640 1 -- 172.21.15.7:0/3016105955 learned_addr learned my addr 172.21.15.7:0/3016105955 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:41:37.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.566+0000 7f6d5143b640 1 --2- 172.21.15.7:0/3016105955 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a92551bcd0 0x55a925918330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:37.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.566+0000 7f6d51c3c640 1 --2- 172.21.15.7:0/3016105955 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a925534490 0x55a9259188d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:37.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.566+0000 7f6d5143b640 1 -- 172.21.15.7:0/3016105955 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a925534490 msgr2=0x55a9259188d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:37.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.566+0000 7f6d5143b640 1 --2- 172.21.15.7:0/3016105955 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a925534490 0x55a9259188d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:37.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.566+0000 7f6d5143b640 1 -- 172.21.15.7:0/3016105955 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a92551bcd0 msgr2=0x55a925918330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:37.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.566+0000 7f6d5143b640 1 --2- 172.21.15.7:0/3016105955 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a92551bcd0 0x55a925918330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:37.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.566+0000 7f6d5143b640 1 -- 172.21.15.7:0/3016105955 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9259137c0 con 0x55a92553c670 2024-09-21T06:41:37.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.567+0000 7f6d5143b640 1 --2- 172.21.15.7:0/3016105955 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a92553c670 0x55a925913030 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x55a92591d4a0 tx=0x7f6d40012df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d931687b10c293e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:37.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.567+0000 7f6d317fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:41:37.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.567+0000 7f6d317fa640 1 -- 172.21.15.7:0/3016105955 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d4003d020 con 0x55a92553c670 2024-09-21T06:41:37.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.567+0000 7f6d317fa640 1 -- 172.21.15.7:0/3016105955 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f6d400046c0 con 0x55a92553c670 2024-09-21T06:41:37.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.567+0000 7f6d5a414740 1 -- 172.21.15.7:0/3016105955 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6d40012070 con 0x55a92553c670 2024-09-21T06:41:37.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.567+0000 7f6d317fa640 1 -- 172.21.15.7:0/3016105955 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6d40030040 con 0x55a92553c670 2024-09-21T06:41:37.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.567+0000 7f6d5a414740 10 client.16551 fetch_fsmap learned FSMap version 25 2024-09-21T06:41:37.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.567+0000 7f6d5a414740 1 -- 172.21.15.7:0/3016105955 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a92598d8b0 con 0x55a92553c670 2024-09-21T06:41:37.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.567+0000 7f6d317fa640 1 -- 172.21.15.7:0/3016105955 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6d40012070 con 0x55a92553c670 2024-09-21T06:41:37.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.567+0000 7f6d317fa640 1 -- 172.21.15.7:0/3016105955 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f6d40036070 con 0x55a92553c670 2024-09-21T06:41:37.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.568+0000 7f6d5a414740 10 client.16551 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:41:37.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.568+0000 7f6d5a414740 10 client.16551 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:41:37.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.568+0000 7f6d5a414740 20 client.16551 populate_metadata read hostname 'smithi007' 2024-09-21T06:41:37.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.568+0000 7f6d5a414740 1 --2- 172.21.15.7:0/3016105955 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55a92555d350 0x55a92598ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:37.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.568+0000 7f6d5a414740 4 client.16551 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:41:37.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.568+0000 7f6d5a414740 1 -- 172.21.15.7:0/3016105955 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55a925878860 con 0x55a92555d350 2024-09-21T06:41:37.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.568+0000 7f6d51c3c640 1 --2- 172.21.15.7:0/3016105955 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55a92555d350 0x55a92598ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:37.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.568+0000 7f6d317fa640 10 client.16551 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:41:37.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.568+0000 7f6d51c3c640 1 --2- 172.21.15.7:0/3016105955 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55a92555d350 0x55a92598ff70 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9fd928d054aaed47 server_cookie=1bf0ac40bbb76c1a in_seq=0 out_seq=0 2024-09-21T06:41:37.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.571+0000 7f6d317fa640 1 -- 172.21.15.7:0/3016105955 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55a925878860 con 0x55a92555d350 2024-09-21T06:41:37.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.571+0000 7f6d317fa640 10 client.16551 handle_command_reply: tid=0 2024-09-21T06:41:37.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.571+0000 7f6d5a414740 1 client.16551 shutdown 2024-09-21T06:41:37.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.571+0000 7f6d5a414740 1 -- 172.21.15.7:0/3016105955 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a92553c670 msgr2=0x55a925913030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:37.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.571+0000 7f6d5a414740 1 --2- 172.21.15.7:0/3016105955 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a92553c670 0x55a925913030 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x55a92591d4a0 tx=0x7f6d40012df0 comp rx=0 tx=0).stop 2024-09-21T06:41:37.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.571+0000 7f6d5a414740 1 -- 172.21.15.7:0/3016105955 shutdown_connections 2024-09-21T06:41:37.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.571+0000 7f6d5a414740 1 --2- 172.21.15.7:0/3016105955 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55a92555d350 0x55a92598ff70 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:37.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.571+0000 7f6d5a414740 1 --2- 172.21.15.7:0/3016105955 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a92553c670 0x55a925913030 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:37.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.571+0000 7f6d5a414740 1 --2- 172.21.15.7:0/3016105955 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a925534490 0x55a9259188d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:37.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.571+0000 7f6d317fa640 0 client.16551 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:41:37.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.571+0000 7f6d5a414740 1 --2- 172.21.15.7:0/3016105955 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a92551bcd0 0x55a925918330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:37.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.571+0000 7f6d5a414740 1 -- 172.21.15.7:0/3016105955 >> 172.21.15.7:0/3016105955 conn(0x55a925551740 msgr2=0x55a925901c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:37.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.571+0000 7f6d5a414740 1 -- 172.21.15.7:0/3016105955 shutdown_connections 2024-09-21T06:41:37.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.571+0000 7f6d5a414740 1 -- 172.21.15.7:0/3016105955 wait complete. 2024-09-21T06:41:37.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.571+0000 7f6d5a414740 20 client.16551 trim_cache size 0 max 16384 2024-09-21T06:41:37.576 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:41:37.576 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0, 2024-09-21T06:41:37.576 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_tag": "a1ae5b3b-f158-44be-8ef4-d70e9ba879cc", 2024-09-21T06:41:37.576 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": "asynchronous" 2024-09-21T06:41:37.576 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:41:37.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.572+0000 7f6d53ea0640 1 -- 172.21.15.7:0/62848446 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f6d340b6700 msgr2=0x7f6d340b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:37.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.572+0000 7f6d53ea0640 1 --2- 172.21.15.7:0/62848446 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f6d340b6700 0x7f6d340b8c10 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6d440cbba0 tx=0x7f6d4409b6f0 comp rx=0 tx=0).stop 2024-09-21T06:41:37.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.572+0000 7f6d53ea0640 1 -- 172.21.15.7:0/62848446 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d4c108530 msgr2=0x7f6d4c19fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:37.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.572+0000 7f6d53ea0640 1 --2- 172.21.15.7:0/62848446 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d4c108530 0x7f6d4c19fd10 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f6d44005cc0 tx=0x7f6d4402f380 comp rx=0 tx=0).stop 2024-09-21T06:41:37.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.572+0000 7f6d53ea0640 1 -- 172.21.15.7:0/62848446 shutdown_connections 2024-09-21T06:41:37.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.572+0000 7f6d53ea0640 1 --2- 172.21.15.7:0/62848446 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f6d340b6700 0x7f6d340b8c10 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:37.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.572+0000 7f6d53ea0640 1 --2- 172.21.15.7:0/62848446 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6d4c108530 0x7f6d4c19fd10 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:37.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.572+0000 7f6d53ea0640 1 --2- 172.21.15.7:0/62848446 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6d4c107be0 0x7f6d4c19aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:37.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.572+0000 7f6d53ea0640 1 --2- 172.21.15.7:0/62848446 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d4c1022a0 0x7f6d4c19a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:37.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.572+0000 7f6d53ea0640 1 -- 172.21.15.7:0/62848446 >> 172.21.15.7:0/62848446 conn(0x7f6d4c079ec0 msgr2=0x7f6d4c105bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:37.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.572+0000 7f6d53ea0640 1 -- 172.21.15.7:0/62848446 shutdown_connections 2024-09-21T06:41:37.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:37.572+0000 7f6d53ea0640 1 -- 172.21.15.7:0/62848446 wait complete. 2024-09-21T06:41:37.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:41:37 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:41:37.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:41:37 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:41:37.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:41:37 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:41:37.839 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:41:37 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:41:37.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:41:37 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:41:37.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:41:37 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:41:37.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:41:37 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:41:37.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:41:37 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:41:37.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:41:37 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:41:38.279 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:41:38.577 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:41:38.698 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:41:38 smithi007 ceph-mon[30983]: pgmap v482: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:41:38.698 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:41:38 smithi007 ceph-mon[30983]: scrub queued for path: / 2024-09-21T06:41:38.698 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:41:38 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T06:41:38.699 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:41:38 smithi007 ceph-mon[30983]: scrub summary: active paths [/] 2024-09-21T06:41:38.699 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:41:38 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T06:41:38.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:41:38 smithi018 ceph-mon[34477]: pgmap v482: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:41:38.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:41:38 smithi018 ceph-mon[34477]: scrub queued for path: / 2024-09-21T06:41:38.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:41:38 smithi018 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-21T06:41:38.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:41:38 smithi018 ceph-mon[34477]: scrub summary: active paths [/] 2024-09-21T06:41:38.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:41:38 smithi018 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-21T06:41:39.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:41:38 smithi144 ceph-mon[34653]: pgmap v482: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:41:39.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:41:38 smithi144 ceph-mon[34653]: scrub queued for path: / 2024-09-21T06:41:39.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:41:38 smithi144 ceph-mon[34653]: scrub summary: idle+waiting paths [/] 2024-09-21T06:41:39.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:41:38 smithi144 ceph-mon[34653]: scrub summary: active paths [/] 2024-09-21T06:41:39.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:41:38 smithi144 ceph-mon[34653]: scrub summary: idle+waiting paths [/] 2024-09-21T06:41:39.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.101+0000 7fe3409bd640 1 -- 172.21.15.7:0/3260081676 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe33c108d10 msgr2=0x7fe33c10f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:39.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.101+0000 7fe3409bd640 1 --2- 172.21.15.7:0/3260081676 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe33c108d10 0x7fe33c10f540 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fe334009ca0 tx=0x7fe33402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:41:39.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.101+0000 7fe3409bd640 1 -- 172.21.15.7:0/3260081676 shutdown_connections 2024-09-21T06:41:39.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.101+0000 7fe3409bd640 1 --2- 172.21.15.7:0/3260081676 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe33c108d10 0x7fe33c10f540 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:39.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.101+0000 7fe3409bd640 1 --2- 172.21.15.7:0/3260081676 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe33c1083c0 0x7fe33c1087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:39.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.101+0000 7fe3409bd640 1 --2- 172.21.15.7:0/3260081676 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe33c102a80 0x7fe33c102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:39.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.101+0000 7fe3409bd640 1 -- 172.21.15.7:0/3260081676 >> 172.21.15.7:0/3260081676 conn(0x7fe33c079740 msgr2=0x7fe33c079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:39.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.101+0000 7fe3409bd640 1 -- 172.21.15.7:0/3260081676 shutdown_connections 2024-09-21T06:41:39.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.101+0000 7fe3409bd640 1 -- 172.21.15.7:0/3260081676 wait complete. 2024-09-21T06:41:39.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.102+0000 7fe3409bd640 1 Processor -- start 2024-09-21T06:41:39.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.102+0000 7fe3409bd640 1 -- start start 2024-09-21T06:41:39.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.102+0000 7fe3409bd640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe33c102a80 0x7fe33c199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:39.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.102+0000 7fe3409bd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe33c1083c0 0x7fe33c1998f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:39.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.102+0000 7fe3409bd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe33c108d10 0x7fe33c19eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:39.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.102+0000 7fe3409bd640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe33c112980 con 0x7fe33c108d10 2024-09-21T06:41:39.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.102+0000 7fe3409bd640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe33c112800 con 0x7fe33c1083c0 2024-09-21T06:41:39.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.102+0000 7fe3409bd640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe33c112b00 con 0x7fe33c102a80 2024-09-21T06:41:39.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.102+0000 7fe33ad9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe33c108d10 0x7fe33c19eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:39.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.102+0000 7fe33ad9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe33c108d10 0x7fe33c19eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49208/0 (socket says 172.21.15.7:49208) 2024-09-21T06:41:39.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.102+0000 7fe33ad9d640 1 -- 172.21.15.7:0/2284817614 learned_addr learned my addr 172.21.15.7:0/2284817614 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:41:39.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.103+0000 7fe33a59c640 1 --2- 172.21.15.7:0/2284817614 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe33c102a80 0x7fe33c199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:39.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.103+0000 7fe339d9b640 1 --2- 172.21.15.7:0/2284817614 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe33c1083c0 0x7fe33c1998f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:39.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.103+0000 7fe33ad9d640 1 -- 172.21.15.7:0/2284817614 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe33c102a80 msgr2=0x7fe33c199350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:39.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.103+0000 7fe33ad9d640 1 --2- 172.21.15.7:0/2284817614 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe33c102a80 0x7fe33c199350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:39.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.103+0000 7fe33ad9d640 1 -- 172.21.15.7:0/2284817614 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe33c1083c0 msgr2=0x7fe33c1998f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:39.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.103+0000 7fe33ad9d640 1 --2- 172.21.15.7:0/2284817614 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe33c1083c0 0x7fe33c1998f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:39.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.103+0000 7fe33ad9d640 1 -- 172.21.15.7:0/2284817614 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe33c19f2c0 con 0x7fe33c108d10 2024-09-21T06:41:39.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.103+0000 7fe33ad9d640 1 --2- 172.21.15.7:0/2284817614 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe33c108d10 0x7fe33c19eb90 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fe334005cc0 tx=0x7fe334031700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:39.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.103+0000 7fe32b7fe640 1 -- 172.21.15.7:0/2284817614 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe334003b70 con 0x7fe33c108d10 2024-09-21T06:41:39.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.103+0000 7fe32b7fe640 1 -- 172.21.15.7:0/2284817614 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe3340318f0 con 0x7fe33c108d10 2024-09-21T06:41:39.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.103+0000 7fe3409bd640 1 -- 172.21.15.7:0/2284817614 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe33c19f550 con 0x7fe33c108d10 2024-09-21T06:41:39.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.103+0000 7fe32b7fe640 1 -- 172.21.15.7:0/2284817614 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe33402f950 con 0x7fe33c108d10 2024-09-21T06:41:39.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.103+0000 7fe3409bd640 1 -- 172.21.15.7:0/2284817614 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe33c1a5d10 con 0x7fe33c108d10 2024-09-21T06:41:39.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.106+0000 7fe346f31740 1 Processor -- start 2024-09-21T06:41:39.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.106+0000 7fe32b7fe640 1 -- 172.21.15.7:0/2284817614 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7fe33402fb50 con 0x7fe33c108d10 2024-09-21T06:41:39.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.106+0000 7fe346f31740 1 -- start start 2024-09-21T06:41:39.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.107+0000 7fe346f31740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560bafded070 0x560bb0194650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:39.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.107+0000 7fe346f31740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560bafdc41b0 0x560bb0194b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:39.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.107+0000 7fe346f31740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560bafdcc390 0x560bb01950d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:39.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.107+0000 7fe346f31740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x560bb010ae50 con 0x560bafdcc390 2024-09-21T06:41:39.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.107+0000 7fe346f31740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x560bb00fa280 con 0x560bafded070 2024-09-21T06:41:39.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.107+0000 7fe346f31740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x560bb00fe090 con 0x560bafdc41b0 2024-09-21T06:41:39.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.107+0000 7fe339d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560bafdcc390 0x560bb01950d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:39.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.107+0000 7fe339d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560bafdcc390 0x560bb01950d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49222/0 (socket says 172.21.15.7:49222) 2024-09-21T06:41:39.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.107+0000 7fe339d9b640 1 -- 172.21.15.7:0/1919502203 learned_addr learned my addr 172.21.15.7:0/1919502203 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:41:39.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.107+0000 7fe339d9b640 1 --2- 172.21.15.7:0/1919502203 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560bafded070 0x560bb0194650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:39.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.107+0000 7fe33a59c640 1 --2- 172.21.15.7:0/1919502203 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560bafdc41b0 0x560bb0194b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:39.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.107+0000 7fe339d9b640 1 -- 172.21.15.7:0/1919502203 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560bafdc41b0 msgr2=0x560bb0194b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:39.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.107+0000 7fe339d9b640 1 --2- 172.21.15.7:0/1919502203 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560bafdc41b0 0x560bb0194b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:39.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.107+0000 7fe32b7fe640 1 --2- 172.21.15.7:0/2284817614 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fe3240b6680 0x7fe3240b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:39.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.107+0000 7fe339d9b640 1 -- 172.21.15.7:0/1919502203 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560bafded070 msgr2=0x560bb0194650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:39.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.107+0000 7fe339d9b640 1 --2- 172.21.15.7:0/1919502203 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560bafded070 0x560bb0194650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:39.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.107+0000 7fe339d9b640 1 -- 172.21.15.7:0/1919502203 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560bafe58650 con 0x560bafdcc390 2024-09-21T06:41:39.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.107+0000 7fe33ad9d640 1 --2- 172.21.15.7:0/2284817614 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fe3240b6680 0x7fe3240b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:39.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.108+0000 7fe339d9b640 1 --2- 172.21.15.7:0/1919502203 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560bafdcc390 0x560bb01950d0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fe3300058c0 tx=0x7fe330005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41663b63b7f25ef1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:39.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.108+0000 7fe32b7fe640 1 -- 172.21.15.7:0/2284817614 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fe334108740 con 0x7fe33c108d10 2024-09-21T06:41:39.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.108+0000 7fe328ff9640 1 -- 172.21.15.7:0/1919502203 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe330004030 con 0x560bafdcc390 2024-09-21T06:41:39.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.108+0000 7fe328ff9640 1 -- 172.21.15.7:0/1919502203 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe3300054d0 con 0x560bafdcc390 2024-09-21T06:41:39.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.108+0000 7fe328ff9640 1 -- 172.21.15.7:0/1919502203 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe330004b20 con 0x560bafdcc390 2024-09-21T06:41:39.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.109+0000 7fe346f31740 1 -- 172.21.15.7:0/1919502203 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560bafdcc390 msgr2=0x560bb01950d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:39.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.109+0000 7fe346f31740 1 --2- 172.21.15.7:0/1919502203 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560bafdcc390 0x560bb01950d0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fe3300058c0 tx=0x7fe330005850 comp rx=0 tx=0).stop 2024-09-21T06:41:39.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.109+0000 7fe33ad9d640 1 --2- 172.21.15.7:0/2284817614 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fe3240b6680 0x7fe3240b8b90 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe3340cb8a0 tx=0x7fe33409b3f0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:39.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.109+0000 7fe346f31740 1 -- 172.21.15.7:0/1919502203 shutdown_connections 2024-09-21T06:41:39.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.109+0000 7fe346f31740 1 --2- 172.21.15.7:0/1919502203 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560bafdcc390 0x560bb01950d0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:39.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.109+0000 7fe346f31740 1 --2- 172.21.15.7:0/1919502203 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560bafdc41b0 0x560bb0194b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:39.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.109+0000 7fe346f31740 1 --2- 172.21.15.7:0/1919502203 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560bafded070 0x560bb0194650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:39.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.109+0000 7fe346f31740 1 -- 172.21.15.7:0/1919502203 >> 172.21.15.7:0/1919502203 conn(0x560bafde1460 msgr2=0x560bb0192540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:39.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.109+0000 7fe346f31740 1 -- 172.21.15.7:0/1919502203 shutdown_connections 2024-09-21T06:41:39.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.109+0000 7fe346f31740 1 -- 172.21.15.7:0/1919502203 wait complete. 2024-09-21T06:41:39.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.109+0000 7fe346f31740 1 -- start start 2024-09-21T06:41:39.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.109+0000 7fe346f31740 1 Processor -- start 2024-09-21T06:41:39.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.110+0000 7fe346f31740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560bafdc41b0 0x560bb019fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:39.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.110+0000 7fe346f31740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560bafdcc390 0x560bb01a02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:39.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.110+0000 7fe346f31740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560bafded070 0x560bb01ac150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:39.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.110+0000 7fe346f31740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x560baff5b700 con 0x560bafdcc390 2024-09-21T06:41:39.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.110+0000 7fe346f31740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x560bb0095110 con 0x560bafdc41b0 2024-09-21T06:41:39.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.110+0000 7fe346f31740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x560bb01a2e30 con 0x560bafded070 2024-09-21T06:41:39.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.110+0000 7fe346f31740 10 client.0 _ll_register_callbacks cb 0x560bb00ae990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:41:39.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.110+0000 7fe33a59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560bafdcc390 0x560bb01a02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:39.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.110+0000 7fe33a59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560bafdcc390 0x560bb01a02c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49232/0 (socket says 172.21.15.7:49232) 2024-09-21T06:41:39.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.110+0000 7fe33a59c640 1 -- 172.21.15.7:0/87360561 learned_addr learned my addr 172.21.15.7:0/87360561 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:41:39.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.110+0000 7fe339d9b640 1 --2- 172.21.15.7:0/87360561 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560bafded070 0x560bb01ac150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:39.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.110+0000 7fe339d9b640 1 --2- 172.21.15.7:0/87360561 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560bafdc41b0 0x560bb019fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:39.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.110+0000 7fe33a59c640 1 -- 172.21.15.7:0/87360561 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560bafded070 msgr2=0x560bb01ac150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:39.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.110+0000 7fe33a59c640 1 --2- 172.21.15.7:0/87360561 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560bafded070 0x560bb01ac150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:39.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.110+0000 7fe33a59c640 1 -- 172.21.15.7:0/87360561 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560bafdc41b0 msgr2=0x560bb019fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:39.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.110+0000 7fe33a59c640 1 --2- 172.21.15.7:0/87360561 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560bafdc41b0 0x560bb019fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:39.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.110+0000 7fe33a59c640 1 -- 172.21.15.7:0/87360561 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560bb00c2c40 con 0x560bafdcc390 2024-09-21T06:41:39.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.110+0000 7fe339d9b640 1 --2- 172.21.15.7:0/87360561 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560bafded070 0x560bb01ac150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:41:39.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.111+0000 7fe33a59c640 1 --2- 172.21.15.7:0/87360561 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560bafdcc390 0x560bb01a02c0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fe32c012740 tx=0x7fe32c012c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94f7ce315e275328 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:39.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.111+0000 7fe321ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:41:39.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.111+0000 7fe321ffb640 1 -- 172.21.15.7:0/87360561 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe32c00f920 con 0x560bafdcc390 2024-09-21T06:41:39.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.111+0000 7fe321ffb640 1 -- 172.21.15.7:0/87360561 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fe32c00fac0 con 0x560bafdcc390 2024-09-21T06:41:39.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.111+0000 7fe346f31740 1 -- 172.21.15.7:0/87360561 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe3300054d0 con 0x560bafdcc390 2024-09-21T06:41:39.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.111+0000 7fe321ffb640 1 -- 172.21.15.7:0/87360561 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe32c00fcc0 con 0x560bafdcc390 2024-09-21T06:41:39.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.111+0000 7fe346f31740 10 client.16563 fetch_fsmap learned FSMap version 25 2024-09-21T06:41:39.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.111+0000 7fe346f31740 1 -- 172.21.15.7:0/87360561 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560bb01aec50 con 0x560bafdcc390 2024-09-21T06:41:39.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.111+0000 7fe321ffb640 1 -- 172.21.15.7:0/87360561 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe3300054d0 con 0x560bafdcc390 2024-09-21T06:41:39.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.111+0000 7fe321ffb640 1 -- 172.21.15.7:0/87360561 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fe32c010430 con 0x560bafdcc390 2024-09-21T06:41:39.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.112+0000 7fe346f31740 10 client.16563 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:41:39.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.112+0000 7fe346f31740 10 client.16563 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:41:39.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.112+0000 7fe346f31740 20 client.16563 populate_metadata read hostname 'smithi007' 2024-09-21T06:41:39.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.112+0000 7fe346f31740 1 --2- 172.21.15.7:0/87360561 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x560bafdab9f0 0x560bb01b2150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:39.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.112+0000 7fe346f31740 4 client.16563 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:41:39.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.112+0000 7fe346f31740 1 -- 172.21.15.7:0/87360561 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560bb010cda0 con 0x560bafdab9f0 2024-09-21T06:41:39.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.112+0000 7fe339d9b640 1 --2- 172.21.15.7:0/87360561 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x560bafdab9f0 0x560bb01b2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:39.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.112+0000 7fe339d9b640 1 --2- 172.21.15.7:0/87360561 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x560bafdab9f0 0x560bb01b2150 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1689900e687b6876 server_cookie=eaad1e806caa5580 in_seq=0 out_seq=0 2024-09-21T06:41:39.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.112+0000 7fe321ffb640 10 client.16563 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:41:39.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.113+0000 7fe321ffb640 1 -- 172.21.15.7:0/87360561 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560bb010cda0 con 0x560bafdab9f0 2024-09-21T06:41:39.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.113+0000 7fe321ffb640 10 client.16563 handle_command_reply: tid=0 2024-09-21T06:41:39.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.113+0000 7fe346f31740 1 client.16563 shutdown 2024-09-21T06:41:39.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.113+0000 7fe346f31740 1 -- 172.21.15.7:0/87360561 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560bafdcc390 msgr2=0x560bb01a02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:39.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.113+0000 7fe346f31740 1 --2- 172.21.15.7:0/87360561 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560bafdcc390 0x560bb01a02c0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fe32c012740 tx=0x7fe32c012c00 comp rx=0 tx=0).stop 2024-09-21T06:41:39.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.113+0000 7fe346f31740 1 -- 172.21.15.7:0/87360561 shutdown_connections 2024-09-21T06:41:39.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.113+0000 7fe346f31740 1 --2- 172.21.15.7:0/87360561 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x560bafdab9f0 0x560bb01b2150 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:39.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.113+0000 7fe346f31740 1 --2- 172.21.15.7:0/87360561 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560bafded070 0x560bb01ac150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:39.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.113+0000 7fe346f31740 1 --2- 172.21.15.7:0/87360561 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560bafdcc390 0x560bb01a02c0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:39.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.113+0000 7fe346f31740 1 --2- 172.21.15.7:0/87360561 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560bafdc41b0 0x560bb019fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:39.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.113+0000 7fe346f31740 1 -- 172.21.15.7:0/87360561 >> 172.21.15.7:0/87360561 conn(0x560bafde1460 msgr2=0x560bb01977e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:39.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.113+0000 7fe321ffb640 0 client.16563 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:41:39.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.114+0000 7fe346f31740 1 -- 172.21.15.7:0/87360561 shutdown_connections 2024-09-21T06:41:39.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.114+0000 7fe346f31740 1 -- 172.21.15.7:0/87360561 wait complete. 2024-09-21T06:41:39.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.114+0000 7fe346f31740 20 client.16563 trim_cache size 0 max 16384 2024-09-21T06:41:39.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.131+0000 7fe346f31740 1 Processor -- start 2024-09-21T06:41:39.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.131+0000 7fe346f31740 1 -- start start 2024-09-21T06:41:39.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.131+0000 7fe346f31740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560bafdc41b0 0x560bb0197e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:39.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.132+0000 7fe346f31740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560bafdcc390 0x560bb01ac050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:39.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.132+0000 7fe346f31740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560bafded070 0x560bb019cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:39.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.132+0000 7fe346f31740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe33c1b1de0 con 0x560bafdcc390 2024-09-21T06:41:39.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.132+0000 7fe346f31740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe33c1af6b0 con 0x560bafded070 2024-09-21T06:41:39.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.132+0000 7fe346f31740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe33c1ad540 con 0x560bafdc41b0 2024-09-21T06:41:39.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.132+0000 7fe33a59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560bafdcc390 0x560bb01ac050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:39.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.132+0000 7fe33a59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560bafdcc390 0x560bb01ac050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49234/0 (socket says 172.21.15.7:49234) 2024-09-21T06:41:39.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.132+0000 7fe33a59c640 1 -- 172.21.15.7:0/184551593 learned_addr learned my addr 172.21.15.7:0/184551593 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:41:39.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.132+0000 7fe339d9b640 1 --2- 172.21.15.7:0/184551593 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560bafdc41b0 0x560bb0197e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:39.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.132+0000 7fe339d9b640 1 --2- 172.21.15.7:0/184551593 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560bafded070 0x560bb019cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:39.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.132+0000 7fe33a59c640 1 -- 172.21.15.7:0/184551593 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560bafdc41b0 msgr2=0x560bb0197e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:39.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.132+0000 7fe33a59c640 1 --2- 172.21.15.7:0/184551593 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560bafdc41b0 0x560bb0197e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:39.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.132+0000 7fe33a59c640 1 -- 172.21.15.7:0/184551593 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560bafded070 msgr2=0x560bb019cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:39.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.132+0000 7fe33a59c640 1 --2- 172.21.15.7:0/184551593 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560bafded070 0x560bb019cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:39.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.132+0000 7fe33a59c640 1 -- 172.21.15.7:0/184551593 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560bb01983a0 con 0x560bafdcc390 2024-09-21T06:41:39.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.132+0000 7fe33a59c640 1 --2- 172.21.15.7:0/184551593 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560bafdcc390 0x560bb01ac050 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fe32c009f70 tx=0x7fe32c009fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a90e6abb3ecb45a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:39.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.132+0000 7fe323fff640 1 -- 172.21.15.7:0/184551593 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe32c02b070 con 0x560bafdcc390 2024-09-21T06:41:39.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.132+0000 7fe323fff640 1 -- 172.21.15.7:0/184551593 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe32c012e50 con 0x560bafdcc390 2024-09-21T06:41:39.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.132+0000 7fe323fff640 1 -- 172.21.15.7:0/184551593 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe32c005600 con 0x560bafdcc390 2024-09-21T06:41:39.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.133+0000 7fe346f31740 1 -- 172.21.15.7:0/184551593 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560bafdcc390 msgr2=0x560bb01ac050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:39.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.133+0000 7fe346f31740 1 --2- 172.21.15.7:0/184551593 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560bafdcc390 0x560bb01ac050 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fe32c009f70 tx=0x7fe32c009fa0 comp rx=0 tx=0).stop 2024-09-21T06:41:39.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.133+0000 7fe346f31740 1 -- 172.21.15.7:0/184551593 shutdown_connections 2024-09-21T06:41:39.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.133+0000 7fe346f31740 1 --2- 172.21.15.7:0/184551593 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560bafded070 0x560bb019cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:39.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.133+0000 7fe346f31740 1 --2- 172.21.15.7:0/184551593 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560bafdcc390 0x560bb01ac050 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:39.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.133+0000 7fe346f31740 1 --2- 172.21.15.7:0/184551593 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560bafdc41b0 0x560bb0197e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:39.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.133+0000 7fe346f31740 1 -- 172.21.15.7:0/184551593 >> 172.21.15.7:0/184551593 conn(0x560bafde1460 msgr2=0x560bb0197750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:39.140 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.133+0000 7fe346f31740 1 -- 172.21.15.7:0/184551593 shutdown_connections 2024-09-21T06:41:39.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.133+0000 7fe346f31740 1 -- 172.21.15.7:0/184551593 wait complete. 2024-09-21T06:41:39.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.134+0000 7fe346f31740 1 -- start start 2024-09-21T06:41:39.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.134+0000 7fe346f31740 1 Processor -- start 2024-09-21T06:41:39.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.134+0000 7fe346f31740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560bafdc41b0 0x560bb01a8540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:39.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.134+0000 7fe346f31740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560bafdcc390 0x560bb01a39f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:39.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.134+0000 7fe346f31740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560bafded070 0x560bb01a3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:39.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.134+0000 7fe346f31740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe33c1adb90 con 0x560bafdc41b0 2024-09-21T06:41:39.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.134+0000 7fe346f31740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe33c1aefe0 con 0x560bafded070 2024-09-21T06:41:39.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.134+0000 7fe346f31740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe33c1ae240 con 0x560bafdcc390 2024-09-21T06:41:39.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.134+0000 7fe346f31740 10 client.0 _ll_register_callbacks cb 0x7fe32c009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:41:39.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.134+0000 7fe339d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560bafdc41b0 0x560bb01a8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:39.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.134+0000 7fe339d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560bafdc41b0 0x560bb01a8540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49236/0 (socket says 172.21.15.7:49236) 2024-09-21T06:41:39.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.134+0000 7fe339d9b640 1 -- 172.21.15.7:0/2436892123 learned_addr learned my addr 172.21.15.7:0/2436892123 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:41:39.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.134+0000 7fe339d9b640 1 --2- 172.21.15.7:0/2436892123 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560bafded070 0x560bb01a3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:39.141 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.134+0000 7fe33a59c640 1 --2- 172.21.15.7:0/2436892123 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560bafdcc390 0x560bb01a39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:39.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.135+0000 7fe339d9b640 1 -- 172.21.15.7:0/2436892123 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560bafdcc390 msgr2=0x560bb01a39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:39.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.135+0000 7fe339d9b640 1 --2- 172.21.15.7:0/2436892123 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560bafdcc390 0x560bb01a39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:39.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.135+0000 7fe339d9b640 1 -- 172.21.15.7:0/2436892123 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560bafded070 msgr2=0x560bb01a3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:41:39.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.135+0000 7fe339d9b640 1 --2- 172.21.15.7:0/2436892123 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560bafded070 0x560bb01a3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:39.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.135+0000 7fe339d9b640 1 -- 172.21.15.7:0/2436892123 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560bb01a4470 con 0x560bafdc41b0 2024-09-21T06:41:39.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.135+0000 7fe33a59c640 1 --2- 172.21.15.7:0/2436892123 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560bafdcc390 0x560bb01a39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:41:39.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.135+0000 7fe339d9b640 1 --2- 172.21.15.7:0/2436892123 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560bafdc41b0 0x560bb01a8540 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fe33000f790 tx=0x7fe32c009e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=896e9e2f54ee1f19 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:41:39.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.135+0000 7fe321ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:41:39.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.135+0000 7fe321ffb640 1 -- 172.21.15.7:0/2436892123 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe33002a040 con 0x560bafdc41b0 2024-09-21T06:41:39.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.135+0000 7fe321ffb640 1 -- 172.21.15.7:0/2436892123 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fe330011100 con 0x560bafdc41b0 2024-09-21T06:41:39.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.135+0000 7fe346f31740 1 -- 172.21.15.7:0/2436892123 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe32c012e50 con 0x560bafdc41b0 2024-09-21T06:41:39.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.135+0000 7fe321ffb640 1 -- 172.21.15.7:0/2436892123 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe330011300 con 0x560bafdc41b0 2024-09-21T06:41:39.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.135+0000 7fe346f31740 10 client.16569 fetch_fsmap learned FSMap version 25 2024-09-21T06:41:39.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.135+0000 7fe346f31740 1 -- 172.21.15.7:0/2436892123 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560bb021c700 con 0x560bafdc41b0 2024-09-21T06:41:39.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.135+0000 7fe321ffb640 1 -- 172.21.15.7:0/2436892123 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe32c012e50 con 0x560bafdc41b0 2024-09-21T06:41:39.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.136+0000 7fe321ffb640 1 -- 172.21.15.7:0/2436892123 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fe33001f8f0 con 0x560bafdc41b0 2024-09-21T06:41:39.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.136+0000 7fe346f31740 10 client.16569 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:41:39.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.136+0000 7fe346f31740 10 client.16569 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:41:39.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.136+0000 7fe346f31740 20 client.16569 populate_metadata read hostname 'smithi007' 2024-09-21T06:41:39.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.136+0000 7fe346f31740 1 --2- 172.21.15.7:0/2436892123 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x560bafd80da0 0x560bb021eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:41:39.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.136+0000 7fe346f31740 4 client.16569 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:41:39.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.136+0000 7fe346f31740 1 -- 172.21.15.7:0/2436892123 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "scrub status"}) -- 0x560bb0108850 con 0x560bafd80da0 2024-09-21T06:41:39.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.136+0000 7fe33a59c640 1 --2- 172.21.15.7:0/2436892123 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x560bafd80da0 0x560bb021eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:41:39.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.136+0000 7fe33a59c640 1 --2- 172.21.15.7:0/2436892123 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x560bafd80da0 0x560bb021eca0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb3736d6bf0960e9 server_cookie=c05d7eddf2f55a55 in_seq=0 out_seq=0 2024-09-21T06:41:39.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.136+0000 7fe321ffb640 10 client.16569 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:41:39.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.137+0000 7fe321ffb640 1 -- 172.21.15.7:0/2436892123 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2842 (crc 0 0 0) 0x560bb0108850 con 0x560bafd80da0 2024-09-21T06:41:39.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.137+0000 7fe321ffb640 10 client.16569 handle_command_reply: tid=0 2024-09-21T06:41:39.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.137+0000 7fe346f31740 1 client.16569 shutdown 2024-09-21T06:41:39.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.137+0000 7fe346f31740 1 -- 172.21.15.7:0/2436892123 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560bafdc41b0 msgr2=0x560bb01a8540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:39.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.137+0000 7fe346f31740 1 --2- 172.21.15.7:0/2436892123 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560bafdc41b0 0x560bb01a8540 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fe33000f790 tx=0x7fe32c009e90 comp rx=0 tx=0).stop 2024-09-21T06:41:39.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.137+0000 7fe346f31740 1 -- 172.21.15.7:0/2436892123 shutdown_connections 2024-09-21T06:41:39.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.137+0000 7fe346f31740 1 --2- 172.21.15.7:0/2436892123 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x560bafd80da0 0x560bb021eca0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:39.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.137+0000 7fe346f31740 1 --2- 172.21.15.7:0/2436892123 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560bafded070 0x560bb01a3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:39.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.137+0000 7fe346f31740 1 --2- 172.21.15.7:0/2436892123 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560bafdcc390 0x560bb01a39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:39.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.137+0000 7fe346f31740 1 --2- 172.21.15.7:0/2436892123 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560bafdc41b0 0x560bb01a8540 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:39.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.137+0000 7fe346f31740 1 -- 172.21.15.7:0/2436892123 >> 172.21.15.7:0/2436892123 conn(0x560bafde1460 msgr2=0x560bb0195680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:39.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.137+0000 7fe321ffb640 0 client.16569 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:41:39.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.137+0000 7fe346f31740 1 -- 172.21.15.7:0/2436892123 shutdown_connections 2024-09-21T06:41:39.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.137+0000 7fe346f31740 1 -- 172.21.15.7:0/2436892123 wait complete. 2024-09-21T06:41:39.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.137+0000 7fe346f31740 20 client.16569 trim_cache size 0 max 16384 2024-09-21T06:41:39.145 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:41:39.145 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T06:41:39.145 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": { 2024-09-21T06:41:39.145 INFO:teuthology.orchestra.run.smithi007.stdout: "a1ae5b3b-f158-44be-8ef4-d70e9ba879cc": { 2024-09-21T06:41:39.145 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:41:39.145 INFO:teuthology.orchestra.run.smithi007.stdout: "tag": "a1ae5b3b-f158-44be-8ef4-d70e9ba879cc", 2024-09-21T06:41:39.145 INFO:teuthology.orchestra.run.smithi007.stdout: "options": "recursive,force" 2024-09-21T06:41:39.145 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:41:39.145 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:41:39.145 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_stats": { 2024-09-21T06:41:39.145 INFO:teuthology.orchestra.run.smithi007.stdout: "62fca477-b241-45f5-8185-bc78aeb8b19f": { 2024-09-21T06:41:39.146 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:40:12.744488+0000", 2024-09-21T06:41:39.146 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:41:39.146 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:41:39.146 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:41:39.146 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:41:39.146 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:41:39.146 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:41:39.146 INFO:teuthology.orchestra.run.smithi007.stdout: "a1ae5b3b-f158-44be-8ef4-d70e9ba879cc": { 2024-09-21T06:41:39.146 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:41:37.568453+0000", 2024-09-21T06:41:39.146 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:41:39.146 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:41:39.146 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:41:39.146 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:41:39.147 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:41:39.147 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:41:39.147 INFO:teuthology.orchestra.run.smithi007.stdout: "d7b6a90c-9ae1-4e02-93ad-335a7e9df1d7": { 2024-09-21T06:41:39.147 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:39:19.226139+0000", 2024-09-21T06:41:39.147 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:41:39.147 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:41:39.147 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:41:39.147 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:41:39.147 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:41:39.147 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:41:39.147 INFO:teuthology.orchestra.run.smithi007.stdout: "b0327167-8c41-4286-8afc-7f0780972fd7": { 2024-09-21T06:41:39.147 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:38:36.828657+0000", 2024-09-21T06:41:39.147 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:41:39.148 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:41:39.148 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:41:39.148 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:41:39.148 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:41:39.148 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:41:39.148 INFO:teuthology.orchestra.run.smithi007.stdout: "13441782-2231-4713-8ebd-068a941de47f": { 2024-09-21T06:41:39.148 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:39:30.219006+0000", 2024-09-21T06:41:39.148 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:41:39.148 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:41:39.148 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:41:39.148 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:41:39.148 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:41:39.149 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:41:39.149 INFO:teuthology.orchestra.run.smithi007.stdout: "5cbaaba2-6ab1-4f83-abd6-8c6eef4b5c42": { 2024-09-21T06:41:39.149 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:37:46.566272+0000", 2024-09-21T06:41:39.149 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:41:39.149 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:41:39.149 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:41:39.149 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:41:39.149 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:41:39.149 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:41:39.149 INFO:teuthology.orchestra.run.smithi007.stdout: "6231e9c1-14a2-40b5-be3c-76d87a0d733b": { 2024-09-21T06:41:39.149 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:37:02.484812+0000", 2024-09-21T06:41:39.149 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:41:39.149 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:41:39.149 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:41:39.150 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:41:39.150 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:41:39.150 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:41:39.150 INFO:teuthology.orchestra.run.smithi007.stdout: "310a0ec8-44bb-49ed-a534-3bc91cb1ee9d": { 2024-09-21T06:41:39.150 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:40:55.373968+0000", 2024-09-21T06:41:39.150 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:41:39.150 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:41:39.150 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:41:39.150 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:41:39.150 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:41:39.150 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:41:39.150 INFO:teuthology.orchestra.run.smithi007.stdout: "0b89345c-1f00-4efe-8ee9-4cb17e43584c": { 2024-09-21T06:41:39.150 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:36:19.500334+0000", 2024-09-21T06:41:39.150 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:41:39.151 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:41:39.151 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:41:39.151 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:41:39.151 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:41:39.151 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:41:39.151 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:41:39.151 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:41:39.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.138+0000 7fe3409bd640 1 -- 172.21.15.7:0/2284817614 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fe3240b6680 msgr2=0x7fe3240b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:39.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.138+0000 7fe3409bd640 1 --2- 172.21.15.7:0/2284817614 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fe3240b6680 0x7fe3240b8b90 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe3340cb8a0 tx=0x7fe33409b3f0 comp rx=0 tx=0).stop 2024-09-21T06:41:39.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.138+0000 7fe3409bd640 1 -- 172.21.15.7:0/2284817614 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe33c108d10 msgr2=0x7fe33c19eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:41:39.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.138+0000 7fe3409bd640 1 --2- 172.21.15.7:0/2284817614 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe33c108d10 0x7fe33c19eb90 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fe334005cc0 tx=0x7fe334031700 comp rx=0 tx=0).stop 2024-09-21T06:41:39.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.138+0000 7fe3409bd640 1 -- 172.21.15.7:0/2284817614 shutdown_connections 2024-09-21T06:41:39.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.138+0000 7fe3409bd640 1 --2- 172.21.15.7:0/2284817614 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fe3240b6680 0x7fe3240b8b90 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:39.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.138+0000 7fe3409bd640 1 --2- 172.21.15.7:0/2284817614 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe33c108d10 0x7fe33c19eb90 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:39.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.138+0000 7fe3409bd640 1 --2- 172.21.15.7:0/2284817614 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe33c1083c0 0x7fe33c1998f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:39.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.138+0000 7fe3409bd640 1 --2- 172.21.15.7:0/2284817614 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe33c102a80 0x7fe33c199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:41:39.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.138+0000 7fe3409bd640 1 -- 172.21.15.7:0/2284817614 >> 172.21.15.7:0/2284817614 conn(0x7fe33c079740 msgr2=0x7fe33c1043d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:41:39.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.138+0000 7fe3409bd640 1 -- 172.21.15.7:0/2284817614 shutdown_connections 2024-09-21T06:41:39.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:41:39.138+0000 7fe3409bd640 1 -- 172.21.15.7:0/2284817614 wait complete. 2024-09-21T06:41:39.769 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:41:39 smithi007 ceph-mon[30983]: scrub summary: idle 2024-09-21T06:41:39.797 INFO:tasks.cephfs.filesystem:scrub status for tag:a1ae5b3b-f158-44be-8ef4-d70e9ba879cc - {'path': '/', 'tag': 'a1ae5b3b-f158-44be-8ef4-d70e9ba879cc', 'options': 'recursive,force'} 2024-09-21T06:41:39.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:41:39 smithi018 ceph-mon[34477]: scrub summary: idle 2024-09-21T06:41:40.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:41:39 smithi144 ceph-mon[34653]: scrub summary: idle 2024-09-21T06:41:40.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:41:40 smithi007 ceph-mon[30983]: pgmap v483: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-21T06:41:40.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:41:40 smithi018 ceph-mon[34477]: pgmap v483: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-21T06:41:41.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:41:40 smithi144 ceph-mon[34653]: pgmap v483: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-21T06:41:42.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:41:42 smithi007 ceph-mon[30983]: pgmap v484: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-09-21T06:41:42.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:41:42 smithi018 ceph-mon[34477]: pgmap v484: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-09-21T06:41:43.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:41:42 smithi144 ceph-mon[34653]: pgmap v484: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2024-09-21T06:41:44.839 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:41:44 smithi007 ceph-mon[30983]: pgmap v485: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:41:44.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:41:44 smithi018 ceph-mon[34477]: pgmap v485: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:41:45.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:41:44 smithi144 ceph-mon[34653]: pgmap v485: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:41:46.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:41:46 smithi007 ceph-mon[30983]: pgmap v486: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-09-21T06:41:46.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:41:46 smithi018 ceph-mon[34477]: pgmap v486: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-09-21T06:41:47.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:41:46 smithi144 ceph-mon[34653]: pgmap v486: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-09-21T06:41:48.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:41:48 smithi007 ceph-mon[30983]: pgmap v487: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6 op/s 2024-09-21T06:41:48.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:41:48 smithi018 ceph-mon[34477]: pgmap v487: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6 op/s 2024-09-21T06:41:49.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:41:48 smithi144 ceph-mon[34653]: pgmap v487: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6 op/s 2024-09-21T06:41:50.839 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:41:50 smithi007 ceph-mon[30983]: pgmap v488: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:41:50.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:41:50 smithi018 ceph-mon[34477]: pgmap v488: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:41:51.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:41:50 smithi144 ceph-mon[34653]: pgmap v488: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:41:52.839 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:41:52 smithi007 ceph-mon[30983]: pgmap v489: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2024-09-21T06:41:52.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:41:52 smithi018 ceph-mon[34477]: pgmap v489: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2024-09-21T06:41:53.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:41:52 smithi144 ceph-mon[34653]: pgmap v489: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2024-09-21T06:41:55.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:41:54 smithi018 ceph-mon[34477]: pgmap v490: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s 2024-09-21T06:41:55.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:41:54 smithi144 ceph-mon[34653]: pgmap v490: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s 2024-09-21T06:41:55.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:41:54 smithi007 ceph-mon[30983]: pgmap v490: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s 2024-09-21T06:41:57.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:41:56 smithi018 ceph-mon[34477]: pgmap v491: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:41:57.142 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:41:56 smithi007 ceph-mon[30983]: pgmap v491: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:41:57.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:41:56 smithi144 ceph-mon[34653]: pgmap v491: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:41:59.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:41:58 smithi018 ceph-mon[34477]: pgmap v492: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:41:59.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:41:58 smithi144 ceph-mon[34653]: pgmap v492: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:41:59.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:41:58 smithi007 ceph-mon[30983]: pgmap v492: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:42:01.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:42:00 smithi018 ceph-mon[34477]: pgmap v493: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:42:01.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:42:00 smithi144 ceph-mon[34653]: pgmap v493: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:42:01.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:42:00 smithi007 ceph-mon[30983]: pgmap v493: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:42:03.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:42:02 smithi018 ceph-mon[34477]: pgmap v494: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-21T06:42:03.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:42:02 smithi144 ceph-mon[34653]: pgmap v494: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-21T06:42:03.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:42:02 smithi007 ceph-mon[30983]: pgmap v494: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-21T06:42:05.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:42:04 smithi018 ceph-mon[34477]: pgmap v495: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-21T06:42:05.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:42:04 smithi144 ceph-mon[34653]: pgmap v495: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-21T06:42:05.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:42:04 smithi007 ceph-mon[30983]: pgmap v495: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-21T06:42:07.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:42:06 smithi018 ceph-mon[34477]: pgmap v496: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-09-21T06:42:07.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:42:06 smithi144 ceph-mon[34653]: pgmap v496: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-09-21T06:42:07.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:42:06 smithi007 ceph-mon[30983]: pgmap v496: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-09-21T06:42:09.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:42:08 smithi018 ceph-mon[34477]: pgmap v497: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-21T06:42:09.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:42:08 smithi144 ceph-mon[34653]: pgmap v497: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-21T06:42:09.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:42:08 smithi007 ceph-mon[30983]: pgmap v497: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-21T06:42:09.799 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:42:10.078 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:42:10.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.582+0000 7fa1f6165640 1 -- 172.21.15.7:0/3929152923 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1f0102a60 msgr2=0x7fa1f0102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:10.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.582+0000 7fa1f6165640 1 --2- 172.21.15.7:0/3929152923 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1f0102a60 0x7fa1f0102e70 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fa1e0009900 tx=0x7fa1e002a410 comp rx=0 tx=0).stop 2024-09-21T06:42:10.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.582+0000 7fa1f6165640 1 -- 172.21.15.7:0/3929152923 shutdown_connections 2024-09-21T06:42:10.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.582+0000 7fa1f6165640 1 --2- 172.21.15.7:0/3929152923 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1f0108cf0 0x7fa1f010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:10.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.582+0000 7fa1f6165640 1 --2- 172.21.15.7:0/3929152923 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1f01083a0 0x7fa1f01087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:10.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.582+0000 7fa1f6165640 1 --2- 172.21.15.7:0/3929152923 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1f0102a60 0x7fa1f0102e70 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:10.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.582+0000 7fa1f6165640 1 -- 172.21.15.7:0/3929152923 >> 172.21.15.7:0/3929152923 conn(0x7fa1f0079730 msgr2=0x7fa1f0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:10.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.582+0000 7fa1f6165640 1 -- 172.21.15.7:0/3929152923 shutdown_connections 2024-09-21T06:42:10.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.582+0000 7fa1f6165640 1 -- 172.21.15.7:0/3929152923 wait complete. 2024-09-21T06:42:10.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.582+0000 7fa1f6165640 1 Processor -- start 2024-09-21T06:42:10.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.583+0000 7fa1f6165640 1 -- start start 2024-09-21T06:42:10.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.583+0000 7fa1f6165640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1f0102a60 0x7fa1f019a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:10.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.583+0000 7fa1f6165640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1f01083a0 0x7fa1f019aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:10.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.583+0000 7fa1f6165640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1f0108cf0 0x7fa1f019fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:10.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.583+0000 7fa1f6165640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f0112960 con 0x7fa1f0102a60 2024-09-21T06:42:10.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.583+0000 7fa1f6165640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f01127e0 con 0x7fa1f01083a0 2024-09-21T06:42:10.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.583+0000 7fa1f6165640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f0112ae0 con 0x7fa1f0108cf0 2024-09-21T06:42:10.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.583+0000 7fa1ef7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1f0102a60 0x7fa1f019a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:10.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.583+0000 7fa1ef7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1f0102a60 0x7fa1f019a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35866/0 (socket says 172.21.15.7:35866) 2024-09-21T06:42:10.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.583+0000 7fa1ef7fe640 1 -- 172.21.15.7:0/2153693639 learned_addr learned my addr 172.21.15.7:0/2153693639 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:42:10.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.583+0000 7fa1eeffd640 1 --2- 172.21.15.7:0/2153693639 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1f01083a0 0x7fa1f019aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:10.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.583+0000 7fa1effff640 1 --2- 172.21.15.7:0/2153693639 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1f0108cf0 0x7fa1f019fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:10.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.583+0000 7fa1ef7fe640 1 -- 172.21.15.7:0/2153693639 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1f0108cf0 msgr2=0x7fa1f019fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:10.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.583+0000 7fa1ef7fe640 1 --2- 172.21.15.7:0/2153693639 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1f0108cf0 0x7fa1f019fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:10.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.583+0000 7fa1ef7fe640 1 -- 172.21.15.7:0/2153693639 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1f01083a0 msgr2=0x7fa1f019aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:10.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.583+0000 7fa1ef7fe640 1 --2- 172.21.15.7:0/2153693639 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1f01083a0 0x7fa1f019aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:10.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.583+0000 7fa1ef7fe640 1 -- 172.21.15.7:0/2153693639 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1f01a04b0 con 0x7fa1f0102a60 2024-09-21T06:42:10.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.584+0000 7fa1ef7fe640 1 --2- 172.21.15.7:0/2153693639 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1f0102a60 0x7fa1f019a540 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fa1e0005940 tx=0x7fa1e0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:10.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.584+0000 7fa1ecff9640 1 -- 172.21.15.7:0/2153693639 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e003f030 con 0x7fa1f0102a60 2024-09-21T06:42:10.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.584+0000 7fa1f6165640 1 -- 172.21.15.7:0/2153693639 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1f01a0740 con 0x7fa1f0102a60 2024-09-21T06:42:10.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.584+0000 7fa1ecff9640 1 -- 172.21.15.7:0/2153693639 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa1e0003aa0 con 0x7fa1f0102a60 2024-09-21T06:42:10.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.584+0000 7fa1ecff9640 1 -- 172.21.15.7:0/2153693639 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e0035070 con 0x7fa1f0102a60 2024-09-21T06:42:10.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.584+0000 7fa1f6165640 1 -- 172.21.15.7:0/2153693639 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1f01a6f00 con 0x7fa1f0102a60 2024-09-21T06:42:10.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.587+0000 7fa1fc6d9740 1 Processor -- start 2024-09-21T06:42:10.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.587+0000 7fa1ecff9640 1 -- 172.21.15.7:0/2153693639 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7fa1e0042030 con 0x7fa1f0102a60 2024-09-21T06:42:10.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.587+0000 7fa1fc6d9740 1 -- start start 2024-09-21T06:42:10.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.587+0000 7fa1fc6d9740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557efb63f070 0x557efb9e6650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:10.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.587+0000 7fa1fc6d9740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557efb6161b0 0x557efb9e6b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:10.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.587+0000 7fa1fc6d9740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557efb61e390 0x557efb9e70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:10.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.587+0000 7fa1fc6d9740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x557efb95ce50 con 0x557efb61e390 2024-09-21T06:42:10.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.587+0000 7fa1fc6d9740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x557efb94c280 con 0x557efb6161b0 2024-09-21T06:42:10.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.587+0000 7fa1fc6d9740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x557efb950090 con 0x557efb63f070 2024-09-21T06:42:10.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.587+0000 7fa1eeffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557efb61e390 0x557efb9e70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:10.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.587+0000 7fa1eeffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557efb61e390 0x557efb9e70d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35872/0 (socket says 172.21.15.7:35872) 2024-09-21T06:42:10.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.587+0000 7fa1eeffd640 1 -- 172.21.15.7:0/4020800626 learned_addr learned my addr 172.21.15.7:0/4020800626 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:42:10.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.587+0000 7fa1ef7fe640 1 --2- 172.21.15.7:0/4020800626 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557efb6161b0 0x557efb9e6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:10.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.587+0000 7fa1effff640 1 --2- 172.21.15.7:0/4020800626 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557efb63f070 0x557efb9e6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:10.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.588+0000 7fa1eeffd640 1 -- 172.21.15.7:0/4020800626 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557efb63f070 msgr2=0x557efb9e6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:10.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.588+0000 7fa1eeffd640 1 --2- 172.21.15.7:0/4020800626 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557efb63f070 0x557efb9e6650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:10.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.588+0000 7fa1eeffd640 1 -- 172.21.15.7:0/4020800626 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557efb6161b0 msgr2=0x557efb9e6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:10.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.588+0000 7fa1eeffd640 1 --2- 172.21.15.7:0/4020800626 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557efb6161b0 0x557efb9e6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:10.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.588+0000 7fa1eeffd640 1 -- 172.21.15.7:0/4020800626 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557efb6aa650 con 0x557efb61e390 2024-09-21T06:42:10.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.588+0000 7fa1ef7fe640 1 --2- 172.21.15.7:0/4020800626 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557efb6161b0 0x557efb9e6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:42:10.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.588+0000 7fa1ecff9640 1 --2- 172.21.15.7:0/2153693639 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa1d80b6680 0x7fa1d80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:10.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.588+0000 7fa1eeffd640 1 --2- 172.21.15.7:0/4020800626 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557efb61e390 0x557efb9e70d0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fa1e4009c60 tx=0x7fa1e4011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e49e93233b2b13b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:10.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.588+0000 7fa1effff640 1 --2- 172.21.15.7:0/2153693639 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa1d80b6680 0x7fa1d80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:10.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.588+0000 7fa1ecff9640 1 -- 172.21.15.7:0/2153693639 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fa1e0107d90 con 0x7fa1f0102a60 2024-09-21T06:42:10.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.588+0000 7fa1d5ffb640 1 -- 172.21.15.7:0/4020800626 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e4004230 con 0x557efb61e390 2024-09-21T06:42:10.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.588+0000 7fa1d5ffb640 1 -- 172.21.15.7:0/4020800626 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa1e40043d0 con 0x557efb61e390 2024-09-21T06:42:10.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.588+0000 7fa1d5ffb640 1 -- 172.21.15.7:0/4020800626 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e4004cb0 con 0x557efb61e390 2024-09-21T06:42:10.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.589+0000 7fa1fc6d9740 1 -- 172.21.15.7:0/4020800626 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557efb61e390 msgr2=0x557efb9e70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:10.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.589+0000 7fa1effff640 1 --2- 172.21.15.7:0/2153693639 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa1d80b6680 0x7fa1d80b8b90 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa1e8005fd0 tx=0x7fa1e80095a0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:10.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.589+0000 7fa1fc6d9740 1 --2- 172.21.15.7:0/4020800626 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557efb61e390 0x557efb9e70d0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fa1e4009c60 tx=0x7fa1e4011810 comp rx=0 tx=0).stop 2024-09-21T06:42:10.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.589+0000 7fa1fc6d9740 1 -- 172.21.15.7:0/4020800626 shutdown_connections 2024-09-21T06:42:10.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.589+0000 7fa1fc6d9740 1 --2- 172.21.15.7:0/4020800626 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557efb61e390 0x557efb9e70d0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:10.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.589+0000 7fa1fc6d9740 1 --2- 172.21.15.7:0/4020800626 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557efb6161b0 0x557efb9e6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:10.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.589+0000 7fa1fc6d9740 1 --2- 172.21.15.7:0/4020800626 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557efb63f070 0x557efb9e6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:10.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.589+0000 7fa1fc6d9740 1 -- 172.21.15.7:0/4020800626 >> 172.21.15.7:0/4020800626 conn(0x557efb633460 msgr2=0x557efb9e4540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:10.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.589+0000 7fa1fc6d9740 1 -- 172.21.15.7:0/4020800626 shutdown_connections 2024-09-21T06:42:10.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.589+0000 7fa1fc6d9740 1 -- 172.21.15.7:0/4020800626 wait complete. 2024-09-21T06:42:10.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.590+0000 7fa1fc6d9740 1 -- start start 2024-09-21T06:42:10.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.590+0000 7fa1fc6d9740 1 Processor -- start 2024-09-21T06:42:10.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.590+0000 7fa1fc6d9740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557efb6161b0 0x557efb9edbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:10.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.590+0000 7fa1fc6d9740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557efb61e390 0x557efb9ee110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:10.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.590+0000 7fa1fc6d9740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557efb63f070 0x557efb9ee650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:10.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.590+0000 7fa1fc6d9740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x557efb7ad700 con 0x557efb61e390 2024-09-21T06:42:10.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.590+0000 7fa1fc6d9740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x557efb8e7110 con 0x557efb6161b0 2024-09-21T06:42:10.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.590+0000 7fa1fc6d9740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x557efb9fd5c0 con 0x557efb63f070 2024-09-21T06:42:10.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.590+0000 7fa1fc6d9740 10 client.0 _ll_register_callbacks cb 0x557efb900990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:42:10.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.590+0000 7fa1eeffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557efb61e390 0x557efb9ee110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:10.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.590+0000 7fa1ef7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557efb6161b0 0x557efb9edbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:10.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.590+0000 7fa1eeffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557efb61e390 0x557efb9ee110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35880/0 (socket says 172.21.15.7:35880) 2024-09-21T06:42:10.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.590+0000 7fa1eeffd640 1 -- 172.21.15.7:0/3008702208 learned_addr learned my addr 172.21.15.7:0/3008702208 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:42:10.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.591+0000 7fa1effff640 1 --2- 172.21.15.7:0/3008702208 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557efb63f070 0x557efb9ee650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:10.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.591+0000 7fa1ef7fe640 1 -- 172.21.15.7:0/3008702208 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557efb63f070 msgr2=0x557efb9ee650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:10.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.591+0000 7fa1ef7fe640 1 --2- 172.21.15.7:0/3008702208 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557efb63f070 0x557efb9ee650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:10.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.591+0000 7fa1ef7fe640 1 -- 172.21.15.7:0/3008702208 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557efb61e390 msgr2=0x557efb9ee110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:10.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.591+0000 7fa1ef7fe640 1 --2- 172.21.15.7:0/3008702208 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557efb61e390 0x557efb9ee110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:10.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.591+0000 7fa1ef7fe640 1 -- 172.21.15.7:0/3008702208 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557efb914c40 con 0x557efb6161b0 2024-09-21T06:42:10.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.591+0000 7fa1eeffd640 1 --2- 172.21.15.7:0/3008702208 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557efb61e390 0x557efb9ee110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:42:10.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.591+0000 7fa1ef7fe640 1 --2- 172.21.15.7:0/3008702208 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557efb6161b0 0x557efb9edbd0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa1e0105580 tx=0x7fa1e0009620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb47c0d33a6d7977 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:10.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.591+0000 7fa1ceffd640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-21T06:42:10.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.591+0000 7fa1ceffd640 1 -- 172.21.15.7:0/3008702208 <== mon.2 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e0049070 con 0x557efb6161b0 2024-09-21T06:42:10.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.591+0000 7fa1ceffd640 1 -- 172.21.15.7:0/3008702208 <== mon.2 v2:172.21.15.18:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fa1e00f10b0 con 0x557efb6161b0 2024-09-21T06:42:10.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.591+0000 7fa1fc6d9740 1 -- 172.21.15.7:0/3008702208 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa1e40043d0 con 0x557efb6161b0 2024-09-21T06:42:10.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.591+0000 7fa1ceffd640 1 -- 172.21.15.7:0/3008702208 <== mon.2 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa1e00cda50 con 0x557efb6161b0 2024-09-21T06:42:10.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.591+0000 7fa1fc6d9740 10 client.26222 fetch_fsmap learned FSMap version 25 2024-09-21T06:42:10.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.592+0000 7fa1fc6d9740 1 -- 172.21.15.7:0/3008702208 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557efba09200 con 0x557efb6161b0 2024-09-21T06:42:10.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.592+0000 7fa1ceffd640 1 -- 172.21.15.7:0/3008702208 <== mon.2 v2:172.21.15.18:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa1e40043d0 con 0x557efb6161b0 2024-09-21T06:42:10.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.592+0000 7fa1ceffd640 1 -- 172.21.15.7:0/3008702208 <== mon.2 v2:172.21.15.18:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa1e00d7210 con 0x557efb6161b0 2024-09-21T06:42:10.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.592+0000 7fa1fc6d9740 10 client.26222 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:42:10.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.592+0000 7fa1fc6d9740 10 client.26222 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:42:10.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.592+0000 7fa1fc6d9740 20 client.26222 populate_metadata read hostname 'smithi007' 2024-09-21T06:42:10.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.592+0000 7fa1fc6d9740 1 --2- 172.21.15.7:0/3008702208 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x557efb5fd9f0 0x557efba0c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:10.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.592+0000 7fa1fc6d9740 4 client.26222 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:42:10.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.592+0000 7fa1fc6d9740 1 -- 172.21.15.7:0/3008702208 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557efb95eda0 con 0x557efb5fd9f0 2024-09-21T06:42:10.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.592+0000 7fa1eeffd640 1 --2- 172.21.15.7:0/3008702208 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x557efb5fd9f0 0x557efba0c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:10.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.593+0000 7fa1eeffd640 1 --2- 172.21.15.7:0/3008702208 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x557efb5fd9f0 0x557efba0c670 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6293a81d8db75e63 server_cookie=55c46495ca3f33ef in_seq=0 out_seq=0 2024-09-21T06:42:10.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.593+0000 7fa1ceffd640 10 client.26222 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:42:10.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.594+0000 7fa1ceffd640 1 -- 172.21.15.7:0/3008702208 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557efb95eda0 con 0x557efb5fd9f0 2024-09-21T06:42:10.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.594+0000 7fa1ceffd640 10 client.26222 handle_command_reply: tid=0 2024-09-21T06:42:10.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.594+0000 7fa1fc6d9740 1 client.26222 shutdown 2024-09-21T06:42:10.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.594+0000 7fa1fc6d9740 1 -- 172.21.15.7:0/3008702208 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557efb6161b0 msgr2=0x557efb9edbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:10.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.594+0000 7fa1fc6d9740 1 --2- 172.21.15.7:0/3008702208 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557efb6161b0 0x557efb9edbd0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa1e0105580 tx=0x7fa1e0009620 comp rx=0 tx=0).stop 2024-09-21T06:42:10.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.594+0000 7fa1fc6d9740 1 -- 172.21.15.7:0/3008702208 shutdown_connections 2024-09-21T06:42:10.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.594+0000 7fa1fc6d9740 1 --2- 172.21.15.7:0/3008702208 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x557efb5fd9f0 0x557efba0c670 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:10.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.594+0000 7fa1fc6d9740 1 --2- 172.21.15.7:0/3008702208 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557efb63f070 0x557efb9ee650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:10.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.594+0000 7fa1fc6d9740 1 --2- 172.21.15.7:0/3008702208 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557efb61e390 0x557efb9ee110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:10.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.594+0000 7fa1fc6d9740 1 --2- 172.21.15.7:0/3008702208 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557efb6161b0 0x557efb9edbd0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:10.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.594+0000 7fa1ceffd640 0 client.26222 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:42:10.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.594+0000 7fa1fc6d9740 1 -- 172.21.15.7:0/3008702208 >> 172.21.15.7:0/3008702208 conn(0x557efb633460 msgr2=0x557efb9e8040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:10.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.594+0000 7fa1fc6d9740 1 -- 172.21.15.7:0/3008702208 shutdown_connections 2024-09-21T06:42:10.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.594+0000 7fa1fc6d9740 1 -- 172.21.15.7:0/3008702208 wait complete. 2024-09-21T06:42:10.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.594+0000 7fa1fc6d9740 20 client.26222 trim_cache size 0 max 16384 2024-09-21T06:42:10.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.611+0000 7fa1fc6d9740 1 Processor -- start 2024-09-21T06:42:10.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.611+0000 7fa1fc6d9740 1 -- start start 2024-09-21T06:42:10.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.612+0000 7fa1fc6d9740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557efb6161b0 0x557efb9e7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:10.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.612+0000 7fa1fc6d9740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557efb61e390 0x557efba11e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:10.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.612+0000 7fa1fc6d9740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557efb63f070 0x557efba12370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:10.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.612+0000 7fa1fc6d9740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f01afba0 con 0x557efb6161b0 2024-09-21T06:42:10.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.612+0000 7fa1fc6d9740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f01ad470 con 0x557efb61e390 2024-09-21T06:42:10.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.612+0000 7fa1fc6d9740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f01ab2c0 con 0x557efb63f070 2024-09-21T06:42:10.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.612+0000 7fa1ef7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557efb6161b0 0x557efb9e7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:10.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.612+0000 7fa1ef7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557efb6161b0 0x557efb9e7d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35890/0 (socket says 172.21.15.7:35890) 2024-09-21T06:42:10.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.612+0000 7fa1ef7fe640 1 -- 172.21.15.7:0/2046743771 learned_addr learned my addr 172.21.15.7:0/2046743771 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:42:10.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.612+0000 7fa1effff640 1 --2- 172.21.15.7:0/2046743771 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557efb63f070 0x557efba12370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:10.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.612+0000 7fa1eeffd640 1 --2- 172.21.15.7:0/2046743771 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557efb61e390 0x557efba11e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:10.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.612+0000 7fa1ef7fe640 1 -- 172.21.15.7:0/2046743771 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557efb63f070 msgr2=0x557efba12370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:10.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.612+0000 7fa1ef7fe640 1 --2- 172.21.15.7:0/2046743771 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557efb63f070 0x557efba12370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:10.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.612+0000 7fa1ef7fe640 1 -- 172.21.15.7:0/2046743771 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557efb61e390 msgr2=0x557efba11e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:10.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.612+0000 7fa1ef7fe640 1 --2- 172.21.15.7:0/2046743771 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557efb61e390 0x557efba11e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:10.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.612+0000 7fa1ef7fe640 1 -- 172.21.15.7:0/2046743771 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557efb9eee90 con 0x557efb6161b0 2024-09-21T06:42:10.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.612+0000 7fa1eeffd640 1 --2- 172.21.15.7:0/2046743771 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557efb61e390 0x557efba11e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:42:10.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.613+0000 7fa1ef7fe640 1 --2- 172.21.15.7:0/2046743771 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557efb6161b0 0x557efb9e7d90 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fa1e00caef0 tx=0x7fa1e00ca390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0de51d024247cdc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:10.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.613+0000 7fa1d57fa640 1 -- 172.21.15.7:0/2046743771 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e0049030 con 0x557efb6161b0 2024-09-21T06:42:10.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.613+0000 7fa1d57fa640 1 -- 172.21.15.7:0/2046743771 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa1e00b50d0 con 0x557efb6161b0 2024-09-21T06:42:10.616 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.613+0000 7fa1d57fa640 1 -- 172.21.15.7:0/2046743771 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e00cd3f0 con 0x557efb6161b0 2024-09-21T06:42:10.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.613+0000 7fa1fc6d9740 1 -- 172.21.15.7:0/2046743771 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557efb6161b0 msgr2=0x557efb9e7d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:10.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.613+0000 7fa1fc6d9740 1 --2- 172.21.15.7:0/2046743771 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557efb6161b0 0x557efb9e7d90 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fa1e00caef0 tx=0x7fa1e00ca390 comp rx=0 tx=0).stop 2024-09-21T06:42:10.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.614+0000 7fa1fc6d9740 1 -- 172.21.15.7:0/2046743771 shutdown_connections 2024-09-21T06:42:10.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.614+0000 7fa1fc6d9740 1 --2- 172.21.15.7:0/2046743771 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557efb63f070 0x557efba12370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:10.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.614+0000 7fa1fc6d9740 1 --2- 172.21.15.7:0/2046743771 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557efb61e390 0x557efba11e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:10.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.614+0000 7fa1fc6d9740 1 --2- 172.21.15.7:0/2046743771 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557efb6161b0 0x557efb9e7d90 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:10.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.614+0000 7fa1fc6d9740 1 -- 172.21.15.7:0/2046743771 >> 172.21.15.7:0/2046743771 conn(0x557efb633460 msgr2=0x557efb9e7680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:10.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.614+0000 7fa1fc6d9740 1 -- 172.21.15.7:0/2046743771 shutdown_connections 2024-09-21T06:42:10.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.614+0000 7fa1fc6d9740 1 -- 172.21.15.7:0/2046743771 wait complete. 2024-09-21T06:42:10.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.614+0000 7fa1fc6d9740 1 -- start start 2024-09-21T06:42:10.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.614+0000 7fa1fc6d9740 1 Processor -- start 2024-09-21T06:42:10.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.615+0000 7fa1fc6d9740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557efb6161b0 0x557efba02d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:10.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.615+0000 7fa1fc6d9740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557efb61e390 0x557efb9ff1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:10.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.615+0000 7fa1fc6d9740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557efb63f070 0x557efb9ff720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:10.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.615+0000 7fa1fc6d9740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f01ab930 con 0x557efb61e390 2024-09-21T06:42:10.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.615+0000 7fa1fc6d9740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f01acda0 con 0x557efb6161b0 2024-09-21T06:42:10.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.615+0000 7fa1fc6d9740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f01ac000 con 0x557efb63f070 2024-09-21T06:42:10.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.615+0000 7fa1fc6d9740 10 client.0 _ll_register_callbacks cb 0x7fa1e0009290 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:42:10.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.615+0000 7fa1eeffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557efb61e390 0x557efb9ff1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:10.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.615+0000 7fa1eeffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557efb61e390 0x557efb9ff1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35906/0 (socket says 172.21.15.7:35906) 2024-09-21T06:42:10.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.615+0000 7fa1eeffd640 1 -- 172.21.15.7:0/2058701942 learned_addr learned my addr 172.21.15.7:0/2058701942 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:42:10.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.615+0000 7fa1effff640 1 --2- 172.21.15.7:0/2058701942 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557efb63f070 0x557efb9ff720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:10.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.615+0000 7fa1ef7fe640 1 --2- 172.21.15.7:0/2058701942 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557efb6161b0 0x557efba02d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:10.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.615+0000 7fa1eeffd640 1 -- 172.21.15.7:0/2058701942 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557efb63f070 msgr2=0x557efb9ff720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:10.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.615+0000 7fa1eeffd640 1 --2- 172.21.15.7:0/2058701942 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557efb63f070 0x557efb9ff720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:10.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.615+0000 7fa1eeffd640 1 -- 172.21.15.7:0/2058701942 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557efb6161b0 msgr2=0x557efba02d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:10.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.615+0000 7fa1eeffd640 1 --2- 172.21.15.7:0/2058701942 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557efb6161b0 0x557efba02d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:10.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.615+0000 7fa1eeffd640 1 -- 172.21.15.7:0/2058701942 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557efb9ffc60 con 0x557efb61e390 2024-09-21T06:42:10.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.615+0000 7fa1eeffd640 1 --2- 172.21.15.7:0/2058701942 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557efb61e390 0x557efb9ff1e0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fa1e4000c00 tx=0x7fa1e4009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6f5888d67dc99da server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:10.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.615+0000 7fa1ceffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:42:10.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.615+0000 7fa1ceffd640 1 -- 172.21.15.7:0/2058701942 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e401e040 con 0x557efb61e390 2024-09-21T06:42:10.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.616+0000 7fa1ceffd640 1 -- 172.21.15.7:0/2058701942 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fa1e4019b90 con 0x557efb61e390 2024-09-21T06:42:10.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.616+0000 7fa1fc6d9740 1 -- 172.21.15.7:0/2058701942 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa1e00b50d0 con 0x557efb61e390 2024-09-21T06:42:10.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.616+0000 7fa1ceffd640 1 -- 172.21.15.7:0/2058701942 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa1e4019d90 con 0x557efb61e390 2024-09-21T06:42:10.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.616+0000 7fa1fc6d9740 10 client.16587 fetch_fsmap learned FSMap version 25 2024-09-21T06:42:10.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.616+0000 7fa1fc6d9740 1 -- 172.21.15.7:0/2058701942 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557efba77c70 con 0x557efb61e390 2024-09-21T06:42:10.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.616+0000 7fa1ceffd640 1 -- 172.21.15.7:0/2058701942 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa1e00b50d0 con 0x557efb61e390 2024-09-21T06:42:10.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.616+0000 7fa1ceffd640 1 -- 172.21.15.7:0/2058701942 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa1e4024040 con 0x557efb61e390 2024-09-21T06:42:10.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.616+0000 7fa1fc6d9740 10 client.16587 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:42:10.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.616+0000 7fa1fc6d9740 10 client.16587 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:42:10.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.616+0000 7fa1fc6d9740 20 client.16587 populate_metadata read hostname 'smithi007' 2024-09-21T06:42:10.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.616+0000 7fa1fc6d9740 1 --2- 172.21.15.7:0/2058701942 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x557efb5d2da0 0x557efba7a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:10.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.616+0000 7fa1fc6d9740 4 client.16587 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:42:10.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.616+0000 7fa1fc6d9740 1 -- 172.21.15.7:0/2058701942 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557efb95a850 con 0x557efb5d2da0 2024-09-21T06:42:10.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.617+0000 7fa1ef7fe640 1 --2- 172.21.15.7:0/2058701942 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x557efb5d2da0 0x557efba7a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:10.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.617+0000 7fa1ceffd640 10 client.16587 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:42:10.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.617+0000 7fa1ef7fe640 1 --2- 172.21.15.7:0/2058701942 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x557efb5d2da0 0x557efba7a2c0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e41921b4cb86d7c8 server_cookie=9085c2df3964d13f in_seq=0 out_seq=0 2024-09-21T06:42:10.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.617+0000 7fa1ceffd640 1 -- 172.21.15.7:0/2058701942 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2646 (crc 0 0 0) 0x557efb95a850 con 0x557efb5d2da0 2024-09-21T06:42:10.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.617+0000 7fa1ceffd640 10 client.16587 handle_command_reply: tid=0 2024-09-21T06:42:10.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.617+0000 7fa1fc6d9740 1 client.16587 shutdown 2024-09-21T06:42:10.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.618+0000 7fa1fc6d9740 1 -- 172.21.15.7:0/2058701942 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557efb61e390 msgr2=0x557efb9ff1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:10.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.618+0000 7fa1fc6d9740 1 --2- 172.21.15.7:0/2058701942 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557efb61e390 0x557efb9ff1e0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fa1e4000c00 tx=0x7fa1e4009ed0 comp rx=0 tx=0).stop 2024-09-21T06:42:10.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.618+0000 7fa1fc6d9740 1 -- 172.21.15.7:0/2058701942 shutdown_connections 2024-09-21T06:42:10.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.618+0000 7fa1fc6d9740 1 --2- 172.21.15.7:0/2058701942 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x557efb5d2da0 0x557efba7a2c0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:10.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.618+0000 7fa1fc6d9740 1 --2- 172.21.15.7:0/2058701942 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x557efb63f070 0x557efb9ff720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:10.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.618+0000 7fa1ceffd640 0 client.16587 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:42:10.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.618+0000 7fa1fc6d9740 1 --2- 172.21.15.7:0/2058701942 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x557efb61e390 0x557efb9ff1e0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:10.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.618+0000 7fa1fc6d9740 1 --2- 172.21.15.7:0/2058701942 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557efb6161b0 0x557efba02d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:10.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.618+0000 7fa1fc6d9740 1 -- 172.21.15.7:0/2058701942 >> 172.21.15.7:0/2058701942 conn(0x557efb633460 msgr2=0x557efb9ef060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:10.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.618+0000 7fa1fc6d9740 1 -- 172.21.15.7:0/2058701942 shutdown_connections 2024-09-21T06:42:10.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.618+0000 7fa1fc6d9740 1 -- 172.21.15.7:0/2058701942 wait complete. 2024-09-21T06:42:10.625 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.618+0000 7fa1fc6d9740 20 client.16587 trim_cache size 0 max 16384 2024-09-21T06:42:10.625 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:42:10.625 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "no active scrubs running", 2024-09-21T06:42:10.625 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": {}, 2024-09-21T06:42:10.625 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_stats": { 2024-09-21T06:42:10.625 INFO:teuthology.orchestra.run.smithi007.stdout: "62fca477-b241-45f5-8185-bc78aeb8b19f": { 2024-09-21T06:42:10.625 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:40:12.744488+0000", 2024-09-21T06:42:10.625 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:42:10.625 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:42:10.625 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:42:10.625 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:42:10.626 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:42:10.626 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:42:10.626 INFO:teuthology.orchestra.run.smithi007.stdout: "a1ae5b3b-f158-44be-8ef4-d70e9ba879cc": { 2024-09-21T06:42:10.626 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:41:37.568453+0000", 2024-09-21T06:42:10.626 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:42:10.626 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:42:10.626 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:42:10.626 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:42:10.626 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:42:10.626 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:42:10.626 INFO:teuthology.orchestra.run.smithi007.stdout: "d7b6a90c-9ae1-4e02-93ad-335a7e9df1d7": { 2024-09-21T06:42:10.627 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:39:19.226139+0000", 2024-09-21T06:42:10.627 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:42:10.627 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:42:10.627 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:42:10.627 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:42:10.627 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:42:10.627 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:42:10.627 INFO:teuthology.orchestra.run.smithi007.stdout: "b0327167-8c41-4286-8afc-7f0780972fd7": { 2024-09-21T06:42:10.627 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:38:36.828657+0000", 2024-09-21T06:42:10.627 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:42:10.627 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:42:10.627 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:42:10.627 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:42:10.627 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:42:10.628 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:42:10.628 INFO:teuthology.orchestra.run.smithi007.stdout: "13441782-2231-4713-8ebd-068a941de47f": { 2024-09-21T06:42:10.628 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:39:30.219006+0000", 2024-09-21T06:42:10.628 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:42:10.628 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:42:10.628 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:42:10.628 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:42:10.628 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:42:10.628 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:42:10.628 INFO:teuthology.orchestra.run.smithi007.stdout: "5cbaaba2-6ab1-4f83-abd6-8c6eef4b5c42": { 2024-09-21T06:42:10.628 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:37:46.566272+0000", 2024-09-21T06:42:10.628 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:42:10.628 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:42:10.628 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:42:10.628 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:42:10.629 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:42:10.629 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:42:10.629 INFO:teuthology.orchestra.run.smithi007.stdout: "6231e9c1-14a2-40b5-be3c-76d87a0d733b": { 2024-09-21T06:42:10.629 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:37:02.484812+0000", 2024-09-21T06:42:10.629 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:42:10.629 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:42:10.629 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:42:10.629 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:42:10.629 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:42:10.629 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:42:10.629 INFO:teuthology.orchestra.run.smithi007.stdout: "310a0ec8-44bb-49ed-a534-3bc91cb1ee9d": { 2024-09-21T06:42:10.629 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:40:55.373968+0000", 2024-09-21T06:42:10.629 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:42:10.629 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:42:10.630 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:42:10.630 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:42:10.630 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:42:10.630 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:42:10.630 INFO:teuthology.orchestra.run.smithi007.stdout: "0b89345c-1f00-4efe-8ee9-4cb17e43584c": { 2024-09-21T06:42:10.630 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:36:19.500334+0000", 2024-09-21T06:42:10.630 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:42:10.630 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:42:10.630 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:42:10.630 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:42:10.630 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:42:10.630 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:42:10.630 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:42:10.631 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:42:10.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.618+0000 7fa1f6165640 1 -- 172.21.15.7:0/2153693639 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa1d80b6680 msgr2=0x7fa1d80b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:10.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.618+0000 7fa1f6165640 1 --2- 172.21.15.7:0/2153693639 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa1d80b6680 0x7fa1d80b8b90 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa1e8005fd0 tx=0x7fa1e80095a0 comp rx=0 tx=0).stop 2024-09-21T06:42:10.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.618+0000 7fa1f6165640 1 -- 172.21.15.7:0/2153693639 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1f0102a60 msgr2=0x7fa1f019a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:10.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.618+0000 7fa1f6165640 1 --2- 172.21.15.7:0/2153693639 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1f0102a60 0x7fa1f019a540 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fa1e0005940 tx=0x7fa1e0004270 comp rx=0 tx=0).stop 2024-09-21T06:42:10.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.618+0000 7fa1f6165640 1 -- 172.21.15.7:0/2153693639 shutdown_connections 2024-09-21T06:42:10.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.618+0000 7fa1f6165640 1 --2- 172.21.15.7:0/2153693639 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa1d80b6680 0x7fa1d80b8b90 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:10.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.618+0000 7fa1f6165640 1 --2- 172.21.15.7:0/2153693639 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1f0108cf0 0x7fa1f019fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:10.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.618+0000 7fa1f6165640 1 --2- 172.21.15.7:0/2153693639 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1f01083a0 0x7fa1f019aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:10.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.619+0000 7fa1f6165640 1 --2- 172.21.15.7:0/2153693639 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1f0102a60 0x7fa1f019a540 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:10.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.619+0000 7fa1f6165640 1 -- 172.21.15.7:0/2153693639 >> 172.21.15.7:0/2153693639 conn(0x7fa1f0079730 msgr2=0x7fa1f01067e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:10.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.619+0000 7fa1f6165640 1 -- 172.21.15.7:0/2153693639 shutdown_connections 2024-09-21T06:42:10.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:10.619+0000 7fa1f6165640 1 -- 172.21.15.7:0/2153693639 wait complete. 2024-09-21T06:42:11.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:42:10 smithi018 ceph-mon[34477]: pgmap v498: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-21T06:42:11.132 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:42:10 smithi007 ceph-mon[30983]: pgmap v498: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-21T06:42:11.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:42:10 smithi144 ceph-mon[34653]: pgmap v498: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-21T06:42:11.482 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:42:11.482 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:42:11.747 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:42:12.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:12.240+0000 7f967723d640 1 -- 172.21.15.7:0/2247453855 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96701083c0 msgr2=0x7f96701087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:12.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:12.240+0000 7f967723d640 1 --2- 172.21.15.7:0/2247453855 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96701083c0 0x7f96701087d0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f9664009900 tx=0x7f966402a3f0 comp rx=0 tx=0).stop 2024-09-21T06:42:12.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:12.240+0000 7f967723d640 1 -- 172.21.15.7:0/2247453855 shutdown_connections 2024-09-21T06:42:12.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:12.240+0000 7f967723d640 1 --2- 172.21.15.7:0/2247453855 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9670108d10 0x7f967010f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:12.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:12.240+0000 7f967723d640 1 --2- 172.21.15.7:0/2247453855 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f96701083c0 0x7f96701087d0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:12.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:12.240+0000 7f967723d640 1 --2- 172.21.15.7:0/2247453855 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9670102a80 0x7f9670102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:12.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:12.240+0000 7f967723d640 1 -- 172.21.15.7:0/2247453855 >> 172.21.15.7:0/2247453855 conn(0x7f9670079740 msgr2=0x7f9670079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:12.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:12.240+0000 7f967723d640 1 -- 172.21.15.7:0/2247453855 shutdown_connections 2024-09-21T06:42:12.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:12.240+0000 7f967723d640 1 -- 172.21.15.7:0/2247453855 wait complete. 2024-09-21T06:42:12.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:12.241+0000 7f967723d640 1 Processor -- start 2024-09-21T06:42:12.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:12.241+0000 7f967723d640 1 -- start start 2024-09-21T06:42:12.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:12.241+0000 7f967723d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9670102a80 0x7f96701990a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:12.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:12.241+0000 7f967723d640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96701083c0 0x7f96701995e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:12.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:12.241+0000 7f967723d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9670108d10 0x7f9670199b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:12.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:12.241+0000 7f967723d640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9670112980 con 0x7f9670102a80 2024-09-21T06:42:12.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:12.241+0000 7f967723d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9670112800 con 0x7f9670108d10 2024-09-21T06:42:12.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:12.241+0000 7f967723d640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9670112b00 con 0x7f96701083c0 2024-09-21T06:42:12.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:12.241+0000 7f9674fd9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9670102a80 0x7f96701990a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:12.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:12.241+0000 7f9674fd9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9670102a80 0x7f96701990a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35920/0 (socket says 172.21.15.7:35920) 2024-09-21T06:42:12.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:12.241+0000 7f9674fd9640 1 -- 172.21.15.7:0/1438151058 learned_addr learned my addr 172.21.15.7:0/1438151058 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:42:12.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:12.242+0000 7f96757da640 1 --2- 172.21.15.7:0/1438151058 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9670108d10 0x7f9670199b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:12.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:12.242+0000 7f966ffff640 1 --2- 172.21.15.7:0/1438151058 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96701083c0 0x7f96701995e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:12.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:12.242+0000 7f9674fd9640 1 -- 172.21.15.7:0/1438151058 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96701083c0 msgr2=0x7f96701995e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:12.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:12.242+0000 7f9674fd9640 1 --2- 172.21.15.7:0/1438151058 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96701083c0 0x7f96701995e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:12.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:12.242+0000 7f9674fd9640 1 -- 172.21.15.7:0/1438151058 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9670108d10 msgr2=0x7f9670199b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:12.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:12.242+0000 7f9674fd9640 1 --2- 172.21.15.7:0/1438151058 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9670108d10 0x7f9670199b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:12.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:12.242+0000 7f9674fd9640 1 -- 172.21.15.7:0/1438151058 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96701a87a0 con 0x7f9670102a80 2024-09-21T06:42:12.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:12.242+0000 7f9674fd9640 1 --2- 172.21.15.7:0/1438151058 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9670102a80 0x7f96701990a0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f966000d980 tx=0x7f966000de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:12.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:12.242+0000 7f966dffb640 1 -- 172.21.15.7:0/1438151058 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9660017030 con 0x7f9670102a80 2024-09-21T06:42:12.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:12.242+0000 7f967723d640 1 -- 172.21.15.7:0/1438151058 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96701a8a90 con 0x7f9670102a80 2024-09-21T06:42:12.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:12.242+0000 7f966dffb640 1 -- 172.21.15.7:0/1438151058 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9660004020 con 0x7f9670102a80 2024-09-21T06:42:12.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:12.242+0000 7f966dffb640 1 -- 172.21.15.7:0/1438151058 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9660005630 con 0x7f9670102a80 2024-09-21T06:42:12.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:12.243+0000 7f967723d640 1 -- 172.21.15.7:0/1438151058 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96701a8fa0 con 0x7f9670102a80 2024-09-21T06:42:12.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:12.244+0000 7f967723d640 1 -- 172.21.15.7:0/1438151058 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9670103d00 con 0x7f9670102a80 2024-09-21T06:42:12.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:12.245+0000 7f966dffb640 1 -- 172.21.15.7:0/1438151058 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f9660009a30 con 0x7f9670102a80 2024-09-21T06:42:12.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:12.246+0000 7f966dffb640 1 --2- 172.21.15.7:0/1438151058 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f96580b6680 0x7f96580b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:12.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:12.246+0000 7f966ffff640 1 --2- 172.21.15.7:0/1438151058 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f96580b6680 0x7f96580b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:12.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:12.246+0000 7f966dffb640 1 -- 172.21.15.7:0/1438151058 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f96600e7020 con 0x7f9670102a80 2024-09-21T06:42:12.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:12.247+0000 7f966ffff640 1 --2- 172.21.15.7:0/1438151058 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f96580b6680 0x7f96580b8b90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f9664000c00 tx=0x7f9664031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:12.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:12.251+0000 7f966dffb640 1 -- 172.21.15.7:0/1438151058 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f96600ad6b0 con 0x7f9670102a80 2024-09-21T06:42:12.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:12.477+0000 7f967723d640 1 -- 172.21.15.7:0/1438151058 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f967002e640 con 0x7f9670102a80 2024-09-21T06:42:12.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:12.479+0000 7f966dffb640 1 -- 172.21.15.7:0/1438151058 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11899 (secure 0 0 0) 0x7f96600b1a90 con 0x7f9670102a80 2024-09-21T06:42:12.481 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:42:12.481 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-21T06:36:10:753693+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2015971546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2015971546},{"type":"v1","addr":"172.21.15.7:6835","nonce":2015971546}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/2350816224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":2350816224},{"type":"v1","addr":"172.21.15.7:6837","nonce":2350816224}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14823,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/1669980572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":1669980572},{"type":"v1","addr":"172.21.15.7:6839","nonce":1669980572}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14835,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/2528308973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":2528308973},{"type":"v1","addr":"172.21.15.7:6841","nonce":2528308973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24623,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1337382979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1337382979},{"type":"v1","addr":"172.21.15.18:6833","nonce":1337382979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/2751454345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":2751454345},{"type":"v1","addr":"172.21.15.144:6833","nonce":2751454345}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:34:24.627168+0000","modified":"2024-09-21T06:36:10.737288+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24716,"mds_1":24688,"mds_2":24686},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24656":{"gid":24656,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6835/158884796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":158884796},{"type":"v1","addr":"172.21.15.18:6835","nonce":158884796}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6835/3636739922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3636739922},{"type":"v1","addr":"172.21.15.144:6835","nonce":3636739922}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24673":{"gid":24673,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6837/1126341753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":1126341753},{"type":"v1","addr":"172.21.15.144:6837","nonce":1126341753}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.18:6837/1539670694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1539670694},{"type":"v1","addr":"172.21.15.18:6837","nonce":1539670694}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24688":{"gid":24688,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.144:6839/4027821922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":4027821922},{"type":"v1","addr":"172.21.15.144:6839","nonce":4027821922}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24716":{"gid":24716,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.18:6839/3798713532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":3798713532},{"type":"v1","addr":"172.21.15.18:6839","nonce":3798713532}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24716,"qdb_cluster":[24716,24688,24686]},"id":1}]} 2024-09-21T06:42:12.481 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-21T06:42:12.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:12.481+0000 7f967723d640 1 -- 172.21.15.7:0/1438151058 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f96580b6680 msgr2=0x7f96580b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:12.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:12.481+0000 7f967723d640 1 --2- 172.21.15.7:0/1438151058 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f96580b6680 0x7f96580b8b90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f9664000c00 tx=0x7f9664031400 comp rx=0 tx=0).stop 2024-09-21T06:42:12.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:12.481+0000 7f967723d640 1 -- 172.21.15.7:0/1438151058 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9670102a80 msgr2=0x7f96701990a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:12.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:12.481+0000 7f967723d640 1 --2- 172.21.15.7:0/1438151058 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9670102a80 0x7f96701990a0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f966000d980 tx=0x7f966000de40 comp rx=0 tx=0).stop 2024-09-21T06:42:12.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:12.481+0000 7f967723d640 1 -- 172.21.15.7:0/1438151058 shutdown_connections 2024-09-21T06:42:12.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:12.481+0000 7f967723d640 1 --2- 172.21.15.7:0/1438151058 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f96580b6680 0x7f96580b8b90 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:12.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:12.481+0000 7f967723d640 1 --2- 172.21.15.7:0/1438151058 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9670108d10 0x7f9670199b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:12.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:12.481+0000 7f967723d640 1 --2- 172.21.15.7:0/1438151058 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f96701083c0 0x7f96701995e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:12.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:12.481+0000 7f967723d640 1 --2- 172.21.15.7:0/1438151058 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9670102a80 0x7f96701990a0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:12.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:12.481+0000 7f967723d640 1 -- 172.21.15.7:0/1438151058 >> 172.21.15.7:0/1438151058 conn(0x7f9670079740 msgr2=0x7f96701043f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:12.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:12.481+0000 7f967723d640 1 -- 172.21.15.7:0/1438151058 shutdown_connections 2024-09-21T06:42:12.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:12.481+0000 7f967723d640 1 -- 172.21.15.7:0/1438151058 wait complete. 2024-09-21T06:42:13.137 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:42:12 smithi007 ceph-mon[30983]: pgmap v499: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-21T06:42:13.137 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:42:12 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/1438151058' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:42:13.171 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:42:13.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:42:12 smithi144 ceph-mon[34653]: pgmap v499: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-21T06:42:13.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:42:12 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/1438151058' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:42:13.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:42:12 smithi018 ceph-mon[34477]: pgmap v499: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-21T06:42:13.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:42:12 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/1438151058' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:42:13.437 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:42:13.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.959+0000 7f8ed4877640 1 -- 172.21.15.7:0/2872766892 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ed01083a0 msgr2=0x7f8ed01087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:13.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.959+0000 7f8ed4877640 1 --2- 172.21.15.7:0/2872766892 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ed01083a0 0x7f8ed01087b0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f8ec4009900 tx=0x7f8ec402a3f0 comp rx=0 tx=0).stop 2024-09-21T06:42:13.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.959+0000 7f8ed4877640 1 -- 172.21.15.7:0/2872766892 shutdown_connections 2024-09-21T06:42:13.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.959+0000 7f8ed4877640 1 --2- 172.21.15.7:0/2872766892 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8ed0108cf0 0x7f8ed010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:13.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.959+0000 7f8ed4877640 1 --2- 172.21.15.7:0/2872766892 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ed01083a0 0x7f8ed01087b0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:13.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.959+0000 7f8ed4877640 1 --2- 172.21.15.7:0/2872766892 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ed0102a60 0x7f8ed0102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:13.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.959+0000 7f8ed4877640 1 -- 172.21.15.7:0/2872766892 >> 172.21.15.7:0/2872766892 conn(0x7f8ed0079730 msgr2=0x7f8ed0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:13.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.960+0000 7f8ed4877640 1 -- 172.21.15.7:0/2872766892 shutdown_connections 2024-09-21T06:42:13.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.960+0000 7f8ed4877640 1 -- 172.21.15.7:0/2872766892 wait complete. 2024-09-21T06:42:13.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.960+0000 7f8ed4877640 1 Processor -- start 2024-09-21T06:42:13.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.961+0000 7f8ed4877640 1 -- start start 2024-09-21T06:42:13.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.961+0000 7f8ed4877640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8ed0102a60 0x7f8ed019a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:13.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.961+0000 7f8ed4877640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ed01083a0 0x7f8ed019a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:13.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.961+0000 7f8ed4877640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ed0108cf0 0x7f8ed019fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:13.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.961+0000 7f8ed4877640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8ed0112960 con 0x7f8ed0108cf0 2024-09-21T06:42:13.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.961+0000 7f8ed4877640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8ed01127e0 con 0x7f8ed0102a60 2024-09-21T06:42:13.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.961+0000 7f8ed4877640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8ed0112ae0 con 0x7f8ed01083a0 2024-09-21T06:42:13.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.961+0000 7f8eced9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ed0108cf0 0x7f8ed019fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:13.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.961+0000 7f8eced9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ed0108cf0 0x7f8ed019fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35936/0 (socket says 172.21.15.7:35936) 2024-09-21T06:42:13.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.961+0000 7f8ece59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8ed0102a60 0x7f8ed019a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:13.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.961+0000 7f8eced9d640 1 -- 172.21.15.7:0/1094515675 learned_addr learned my addr 172.21.15.7:0/1094515675 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:42:13.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.961+0000 7f8ecdd9b640 1 --2- 172.21.15.7:0/1094515675 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ed01083a0 0x7f8ed019a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:13.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.961+0000 7f8eced9d640 1 -- 172.21.15.7:0/1094515675 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ed01083a0 msgr2=0x7f8ed019a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:13.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.961+0000 7f8eced9d640 1 --2- 172.21.15.7:0/1094515675 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ed01083a0 0x7f8ed019a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:13.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.961+0000 7f8eced9d640 1 -- 172.21.15.7:0/1094515675 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8ed0102a60 msgr2=0x7f8ed019a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:13.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.961+0000 7f8eced9d640 1 --2- 172.21.15.7:0/1094515675 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8ed0102a60 0x7f8ed019a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:13.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.961+0000 7f8eced9d640 1 -- 172.21.15.7:0/1094515675 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ed01a02b0 con 0x7f8ed0108cf0 2024-09-21T06:42:13.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.962+0000 7f8eced9d640 1 --2- 172.21.15.7:0/1094515675 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ed0108cf0 0x7f8ed019fc40 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f8ec800cce0 tx=0x7f8ec800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:13.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.962+0000 7f8ebf7fe640 1 -- 172.21.15.7:0/1094515675 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ec800f450 con 0x7f8ed0108cf0 2024-09-21T06:42:13.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.962+0000 7f8ebf7fe640 1 -- 172.21.15.7:0/1094515675 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ec800faa0 con 0x7f8ed0108cf0 2024-09-21T06:42:13.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.962+0000 7f8ed4877640 1 -- 172.21.15.7:0/1094515675 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ed01a05a0 con 0x7f8ed0108cf0 2024-09-21T06:42:13.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.962+0000 7f8ebf7fe640 1 -- 172.21.15.7:0/1094515675 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ec8018a80 con 0x7f8ed0108cf0 2024-09-21T06:42:13.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.962+0000 7f8ed4877640 1 -- 172.21.15.7:0/1094515675 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ed01a6dc0 con 0x7f8ed0108cf0 2024-09-21T06:42:13.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.965+0000 7f8ebf7fe640 1 -- 172.21.15.7:0/1094515675 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f8ec80213f0 con 0x7f8ed0108cf0 2024-09-21T06:42:13.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.965+0000 7f8edadeb740 1 Processor -- start 2024-09-21T06:42:13.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.965+0000 7f8edadeb740 1 -- start start 2024-09-21T06:42:13.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.965+0000 7f8edadeb740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cfc9bf5070 0x55cfc9f9c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:13.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.965+0000 7f8edadeb740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cfc9bcc1b0 0x55cfc9f9cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:13.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.965+0000 7f8edadeb740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cfc9bd4390 0x55cfc9f9d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:13.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.965+0000 7f8edadeb740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55cfc9f12ea0 con 0x55cfc9bf5070 2024-09-21T06:42:13.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.965+0000 7f8edadeb740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55cfc9f022d0 con 0x55cfc9bd4390 2024-09-21T06:42:13.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.965+0000 7f8edadeb740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55cfc9f060e0 con 0x55cfc9bcc1b0 2024-09-21T06:42:13.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.965+0000 7f8ecdd9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cfc9bf5070 0x55cfc9f9c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:13.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.965+0000 7f8ecdd9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cfc9bf5070 0x55cfc9f9c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35952/0 (socket says 172.21.15.7:35952) 2024-09-21T06:42:13.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.965+0000 7f8ecdd9b640 1 -- 172.21.15.7:0/3158569361 learned_addr learned my addr 172.21.15.7:0/3158569361 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:42:13.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.966+0000 7f8ece59c640 1 --2- 172.21.15.7:0/3158569361 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cfc9bcc1b0 0x55cfc9f9cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:13.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.966+0000 7f8ecdd9b640 1 --2- 172.21.15.7:0/3158569361 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cfc9bd4390 0x55cfc9f9d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:13.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.966+0000 7f8ecdd9b640 1 -- 172.21.15.7:0/3158569361 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cfc9bcc1b0 msgr2=0x55cfc9f9cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:13.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.966+0000 7f8ecdd9b640 1 --2- 172.21.15.7:0/3158569361 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cfc9bcc1b0 0x55cfc9f9cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:13.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.966+0000 7f8ebf7fe640 1 --2- 172.21.15.7:0/1094515675 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f8eb80b6730 0x7f8eb80b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:13.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.966+0000 7f8ecdd9b640 1 -- 172.21.15.7:0/3158569361 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cfc9bd4390 msgr2=0x55cfc9f9d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:13.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.966+0000 7f8ecdd9b640 1 --2- 172.21.15.7:0/3158569361 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cfc9bd4390 0x55cfc9f9d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:13.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.966+0000 7f8ecdd9b640 1 -- 172.21.15.7:0/3158569361 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfc9c60650 con 0x55cfc9bf5070 2024-09-21T06:42:13.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.966+0000 7f8eced9d640 1 --2- 172.21.15.7:0/1094515675 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f8eb80b6730 0x7f8eb80b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:13.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.966+0000 7f8ecdd9b640 1 --2- 172.21.15.7:0/3158569361 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cfc9bf5070 0x55cfc9f9c6a0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f8ec4005ab0 tx=0x7f8ec4005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cee47614b67e603 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:13.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.966+0000 7f8ebf7fe640 1 -- 172.21.15.7:0/1094515675 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f8ec80e7aa0 con 0x7f8ed0108cf0 2024-09-21T06:42:13.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.966+0000 7f8ebcff9640 1 -- 172.21.15.7:0/3158569361 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ec4043020 con 0x55cfc9bf5070 2024-09-21T06:42:13.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.966+0000 7f8ebcff9640 1 -- 172.21.15.7:0/3158569361 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ec4031870 con 0x55cfc9bf5070 2024-09-21T06:42:13.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.966+0000 7f8ebcff9640 1 -- 172.21.15.7:0/3158569361 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ec4035050 con 0x55cfc9bf5070 2024-09-21T06:42:13.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.967+0000 7f8edadeb740 1 -- 172.21.15.7:0/3158569361 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cfc9bf5070 msgr2=0x55cfc9f9c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:13.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.967+0000 7f8eced9d640 1 --2- 172.21.15.7:0/1094515675 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f8eb80b6730 0x7f8eb80b8c40 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f8ec80ad920 tx=0x7f8ec8012000 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:13.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.967+0000 7f8edadeb740 1 --2- 172.21.15.7:0/3158569361 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cfc9bf5070 0x55cfc9f9c6a0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f8ec4005ab0 tx=0x7f8ec4005a20 comp rx=0 tx=0).stop 2024-09-21T06:42:13.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.967+0000 7f8edadeb740 1 -- 172.21.15.7:0/3158569361 shutdown_connections 2024-09-21T06:42:13.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.967+0000 7f8edadeb740 1 --2- 172.21.15.7:0/3158569361 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cfc9bd4390 0x55cfc9f9d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:13.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.967+0000 7f8edadeb740 1 --2- 172.21.15.7:0/3158569361 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cfc9bcc1b0 0x55cfc9f9cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:13.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.967+0000 7f8edadeb740 1 --2- 172.21.15.7:0/3158569361 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cfc9bf5070 0x55cfc9f9c6a0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:13.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.967+0000 7f8edadeb740 1 -- 172.21.15.7:0/3158569361 >> 172.21.15.7:0/3158569361 conn(0x55cfc9be9460 msgr2=0x55cfc9f9a590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:13.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.968+0000 7f8edadeb740 1 -- 172.21.15.7:0/3158569361 shutdown_connections 2024-09-21T06:42:13.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.968+0000 7f8edadeb740 1 -- 172.21.15.7:0/3158569361 wait complete. 2024-09-21T06:42:13.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.968+0000 7f8edadeb740 1 -- start start 2024-09-21T06:42:13.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.968+0000 7f8edadeb740 1 Processor -- start 2024-09-21T06:42:13.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.968+0000 7f8edadeb740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cfc9bcc1b0 0x55cfc9fa7d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:13.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.968+0000 7f8edadeb740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cfc9bd4390 0x55cfc9fa82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:13.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.968+0000 7f8edadeb740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cfc9bf5070 0x55cfc9fb4110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:13.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.968+0000 7f8edadeb740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55cfc9d63700 con 0x55cfc9bd4390 2024-09-21T06:42:13.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.968+0000 7f8edadeb740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55cfc9e9d160 con 0x55cfc9bcc1b0 2024-09-21T06:42:13.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.968+0000 7f8edadeb740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55cfc9faae20 con 0x55cfc9bf5070 2024-09-21T06:42:13.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.969+0000 7f8edadeb740 10 client.0 _ll_register_callbacks cb 0x55cfc9eb69e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:42:13.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.969+0000 7f8ece59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cfc9bd4390 0x55cfc9fa82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:13.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.969+0000 7f8ece59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cfc9bd4390 0x55cfc9fa82a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35962/0 (socket says 172.21.15.7:35962) 2024-09-21T06:42:13.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.969+0000 7f8ece59c640 1 -- 172.21.15.7:0/2539516623 learned_addr learned my addr 172.21.15.7:0/2539516623 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:42:13.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.969+0000 7f8ecdd9b640 1 --2- 172.21.15.7:0/2539516623 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cfc9bf5070 0x55cfc9fb4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:13.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.969+0000 7f8ecdd9b640 1 --2- 172.21.15.7:0/2539516623 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cfc9bcc1b0 0x55cfc9fa7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:13.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.969+0000 7f8ece59c640 1 -- 172.21.15.7:0/2539516623 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cfc9bf5070 msgr2=0x55cfc9fb4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:13.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.969+0000 7f8ece59c640 1 --2- 172.21.15.7:0/2539516623 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cfc9bf5070 0x55cfc9fb4110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:13.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.969+0000 7f8ece59c640 1 -- 172.21.15.7:0/2539516623 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cfc9bcc1b0 msgr2=0x55cfc9fa7d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:13.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.969+0000 7f8ece59c640 1 --2- 172.21.15.7:0/2539516623 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cfc9bcc1b0 0x55cfc9fa7d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:13.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.969+0000 7f8ece59c640 1 -- 172.21.15.7:0/2539516623 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cfc9ecac90 con 0x55cfc9bd4390 2024-09-21T06:42:13.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.969+0000 7f8ece59c640 1 --2- 172.21.15.7:0/2539516623 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cfc9bd4390 0x55cfc9fa82a0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f8ec0010a50 tx=0x7f8ec0010f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bb63df4a4646107 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:13.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.969+0000 7f8eb5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:42:13.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.969+0000 7f8eb5ffb640 1 -- 172.21.15.7:0/2539516623 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ec001e060 con 0x55cfc9bd4390 2024-09-21T06:42:13.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.969+0000 7f8eb5ffb640 1 -- 172.21.15.7:0/2539516623 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f8ec000fbd0 con 0x55cfc9bd4390 2024-09-21T06:42:13.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.969+0000 7f8edadeb740 1 -- 172.21.15.7:0/2539516623 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ec4031870 con 0x55cfc9bd4390 2024-09-21T06:42:13.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.970+0000 7f8eb5ffb640 1 -- 172.21.15.7:0/2539516623 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8ec000fdd0 con 0x55cfc9bd4390 2024-09-21T06:42:13.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.970+0000 7f8edadeb740 10 client.16605 fetch_fsmap learned FSMap version 25 2024-09-21T06:42:13.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.970+0000 7f8edadeb740 1 -- 172.21.15.7:0/2539516623 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55cfc9fb6b90 con 0x55cfc9bd4390 2024-09-21T06:42:13.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.970+0000 7f8eb5ffb640 1 -- 172.21.15.7:0/2539516623 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ec4031870 con 0x55cfc9bd4390 2024-09-21T06:42:13.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.970+0000 7f8eb5ffb640 1 -- 172.21.15.7:0/2539516623 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f8ec000e4d0 con 0x55cfc9bd4390 2024-09-21T06:42:13.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.970+0000 7f8edadeb740 10 client.16605 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:42:13.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.970+0000 7f8edadeb740 10 client.16605 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-21T06:42:13.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.970+0000 7f8edadeb740 20 client.16605 populate_metadata read hostname 'smithi007' 2024-09-21T06:42:13.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.970+0000 7f8edadeb740 1 --2- 172.21.15.7:0/2539516623 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x55cfc9bb39f0 0x55cfc9fba0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:13.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.970+0000 7f8edadeb740 4 client.16605 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:42:13.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.970+0000 7f8edadeb740 1 -- 172.21.15.7:0/2539516623 --> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cfc9f14df0 con 0x55cfc9bb39f0 2024-09-21T06:42:13.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.970+0000 7f8ecdd9b640 1 --2- 172.21.15.7:0/2539516623 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x55cfc9bb39f0 0x55cfc9fba0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:13.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.971+0000 7f8eb5ffb640 10 client.16605 ms_handle_connect on v2:172.21.15.18:6836/1539670694 2024-09-21T06:42:13.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.971+0000 7f8ecdd9b640 1 --2- 172.21.15.7:0/2539516623 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x55cfc9bb39f0 0x55cfc9fba0e0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3ada93555c9416e2 server_cookie=eded5a81bbf0341f in_seq=0 out_seq=0 2024-09-21T06:42:13.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.972+0000 7f8eb5ffb640 1 -- 172.21.15.7:0/2539516623 <== mds.2 v2:172.21.15.18:6836/1539670694 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cfc9f14df0 con 0x55cfc9bb39f0 2024-09-21T06:42:13.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.972+0000 7f8eb5ffb640 10 client.16605 handle_command_reply: tid=0 2024-09-21T06:42:13.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.972+0000 7f8edadeb740 1 client.16605 shutdown 2024-09-21T06:42:13.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.972+0000 7f8edadeb740 1 -- 172.21.15.7:0/2539516623 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cfc9bd4390 msgr2=0x55cfc9fa82a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:13.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.972+0000 7f8edadeb740 1 --2- 172.21.15.7:0/2539516623 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cfc9bd4390 0x55cfc9fa82a0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f8ec0010a50 tx=0x7f8ec0010f10 comp rx=0 tx=0).stop 2024-09-21T06:42:13.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.972+0000 7f8edadeb740 1 -- 172.21.15.7:0/2539516623 shutdown_connections 2024-09-21T06:42:13.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.972+0000 7f8edadeb740 1 --2- 172.21.15.7:0/2539516623 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x55cfc9bb39f0 0x55cfc9fba0e0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:13.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.972+0000 7f8eb5ffb640 0 client.16605 ms_handle_reset on v2:172.21.15.18:6836/1539670694 2024-09-21T06:42:13.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.972+0000 7f8edadeb740 1 --2- 172.21.15.7:0/2539516623 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cfc9bf5070 0x55cfc9fb4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:13.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.972+0000 7f8edadeb740 1 --2- 172.21.15.7:0/2539516623 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cfc9bd4390 0x55cfc9fa82a0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:13.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.972+0000 7f8edadeb740 1 --2- 172.21.15.7:0/2539516623 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cfc9bcc1b0 0x55cfc9fa7d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:13.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.972+0000 7f8edadeb740 1 -- 172.21.15.7:0/2539516623 >> 172.21.15.7:0/2539516623 conn(0x55cfc9be9460 msgr2=0x55cfc9f9f880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:13.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.972+0000 7f8edadeb740 1 -- 172.21.15.7:0/2539516623 shutdown_connections 2024-09-21T06:42:13.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.972+0000 7f8edadeb740 1 -- 172.21.15.7:0/2539516623 wait complete. 2024-09-21T06:42:13.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.972+0000 7f8edadeb740 20 client.16605 trim_cache size 0 max 16384 2024-09-21T06:42:13.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.985+0000 7f8edadeb740 1 Processor -- start 2024-09-21T06:42:13.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.985+0000 7f8edadeb740 1 -- start start 2024-09-21T06:42:13.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.986+0000 7f8edadeb740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cfc9bb39f0 0x55cfc9f9e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:13.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.986+0000 7f8edadeb740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cfc9bcc1b0 0x55cfc9fa9990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:13.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.986+0000 7f8edadeb740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cfc9bd4390 0x55cfc9f99bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:13.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.986+0000 7f8edadeb740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8ed01b1b20 con 0x55cfc9bb39f0 2024-09-21T06:42:13.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.986+0000 7f8edadeb740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8ed01af3f0 con 0x55cfc9bd4390 2024-09-21T06:42:13.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.986+0000 7f8edadeb740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8ed01ad240 con 0x55cfc9bcc1b0 2024-09-21T06:42:13.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.986+0000 7f8ecdd9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cfc9bb39f0 0x55cfc9f9e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:13.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.986+0000 7f8ecdd9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cfc9bb39f0 0x55cfc9f9e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35970/0 (socket says 172.21.15.7:35970) 2024-09-21T06:42:13.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.986+0000 7f8ecdd9b640 1 -- 172.21.15.7:0/1734045586 learned_addr learned my addr 172.21.15.7:0/1734045586 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:42:13.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.986+0000 7f8ecdd9b640 1 -- 172.21.15.7:0/1734045586 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cfc9bcc1b0 msgr2=0x55cfc9fa9990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:13.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.986+0000 7f8ecdd9b640 1 --2- 172.21.15.7:0/1734045586 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cfc9bcc1b0 0x55cfc9fa9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:13.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.986+0000 7f8ecdd9b640 1 -- 172.21.15.7:0/1734045586 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cfc9bd4390 msgr2=0x55cfc9f99bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:13.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.986+0000 7f8ecdd9b640 1 --2- 172.21.15.7:0/1734045586 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cfc9bd4390 0x55cfc9f99bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:13.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.986+0000 7f8ecdd9b640 1 -- 172.21.15.7:0/1734045586 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfc9f9e990 con 0x55cfc9bb39f0 2024-09-21T06:42:13.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.986+0000 7f8ecdd9b640 1 --2- 172.21.15.7:0/1734045586 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cfc9bb39f0 0x55cfc9f9e090 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f8ec4009900 tx=0x7f8ec4031ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d324bb9f54a443ad server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:13.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.986+0000 7f8eb7fff640 1 -- 172.21.15.7:0/1734045586 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ec4035040 con 0x55cfc9bb39f0 2024-09-21T06:42:13.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.986+0000 7f8eb7fff640 1 -- 172.21.15.7:0/1734045586 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ec40035f0 con 0x55cfc9bb39f0 2024-09-21T06:42:13.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.986+0000 7f8eb7fff640 1 -- 172.21.15.7:0/1734045586 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ec4043040 con 0x55cfc9bb39f0 2024-09-21T06:42:13.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.987+0000 7f8edadeb740 1 -- 172.21.15.7:0/1734045586 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cfc9bb39f0 msgr2=0x55cfc9f9e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:13.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.987+0000 7f8edadeb740 1 --2- 172.21.15.7:0/1734045586 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cfc9bb39f0 0x55cfc9f9e090 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f8ec4009900 tx=0x7f8ec4031ec0 comp rx=0 tx=0).stop 2024-09-21T06:42:13.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.987+0000 7f8edadeb740 1 -- 172.21.15.7:0/1734045586 shutdown_connections 2024-09-21T06:42:13.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.987+0000 7f8edadeb740 1 --2- 172.21.15.7:0/1734045586 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cfc9bd4390 0x55cfc9f99bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:13.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.987+0000 7f8edadeb740 1 --2- 172.21.15.7:0/1734045586 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cfc9bcc1b0 0x55cfc9fa9990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:13.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.987+0000 7f8edadeb740 1 --2- 172.21.15.7:0/1734045586 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cfc9bb39f0 0x55cfc9f9e090 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:13.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.987+0000 7f8edadeb740 1 -- 172.21.15.7:0/1734045586 >> 172.21.15.7:0/1734045586 conn(0x55cfc9be9460 msgr2=0x55cfc9fa9280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:13.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.987+0000 7f8edadeb740 1 -- 172.21.15.7:0/1734045586 shutdown_connections 2024-09-21T06:42:13.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.987+0000 7f8edadeb740 1 -- 172.21.15.7:0/1734045586 wait complete. 2024-09-21T06:42:13.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.988+0000 7f8edadeb740 1 -- start start 2024-09-21T06:42:13.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.988+0000 7f8edadeb740 1 Processor -- start 2024-09-21T06:42:13.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.988+0000 7f8edadeb740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cfc9bb39f0 0x55cfc9fb0710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:13.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.988+0000 7f8edadeb740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cfc9bcc1b0 0x55cfc9fabbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:13.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.988+0000 7f8edadeb740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cfc9bd4390 0x55cfc9fac100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:13.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.988+0000 7f8edadeb740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8ed01ad8b0 con 0x55cfc9bb39f0 2024-09-21T06:42:13.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.988+0000 7f8edadeb740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8ed01aed20 con 0x55cfc9bcc1b0 2024-09-21T06:42:13.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.988+0000 7f8edadeb740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8ed01adf80 con 0x55cfc9bd4390 2024-09-21T06:42:13.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.988+0000 7f8edadeb740 10 client.0 _ll_register_callbacks cb 0x7f8ec000a820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:42:13.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.988+0000 7f8ecdd9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cfc9bb39f0 0x55cfc9fb0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:13.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.988+0000 7f8ecdd9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cfc9bb39f0 0x55cfc9fb0710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35976/0 (socket says 172.21.15.7:35976) 2024-09-21T06:42:13.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.988+0000 7f8ecdd9b640 1 -- 172.21.15.7:0/331468360 learned_addr learned my addr 172.21.15.7:0/331468360 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:42:13.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.988+0000 7f8ece59c640 1 --2- 172.21.15.7:0/331468360 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cfc9bcc1b0 0x55cfc9fabbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:13.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.989+0000 7f8ecdd9b640 1 --2- 172.21.15.7:0/331468360 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cfc9bd4390 0x55cfc9fac100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:13.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.989+0000 7f8ecdd9b640 1 -- 172.21.15.7:0/331468360 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cfc9bd4390 msgr2=0x55cfc9fac100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:13.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.989+0000 7f8ecdd9b640 1 --2- 172.21.15.7:0/331468360 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cfc9bd4390 0x55cfc9fac100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:13.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.989+0000 7f8ecdd9b640 1 -- 172.21.15.7:0/331468360 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cfc9bcc1b0 msgr2=0x55cfc9fabbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:13.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.989+0000 7f8ecdd9b640 1 --2- 172.21.15.7:0/331468360 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cfc9bcc1b0 0x55cfc9fabbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:13.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.989+0000 7f8ecdd9b640 1 -- 172.21.15.7:0/331468360 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cfc9fac740 con 0x55cfc9bb39f0 2024-09-21T06:42:13.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.989+0000 7f8ecdd9b640 1 --2- 172.21.15.7:0/331468360 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cfc9bb39f0 0x55cfc9fb0710 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f8ec40096c0 tx=0x7f8ec4031550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e93052cf225d69c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:13.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.989+0000 7f8eb5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:42:13.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.989+0000 7f8eb5ffb640 1 -- 172.21.15.7:0/331468360 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ec4043040 con 0x55cfc9bb39f0 2024-09-21T06:42:13.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.989+0000 7f8eb5ffb640 1 -- 172.21.15.7:0/331468360 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f8ec40037a0 con 0x55cfc9bb39f0 2024-09-21T06:42:13.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.989+0000 7f8edadeb740 1 -- 172.21.15.7:0/331468360 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ec40035f0 con 0x55cfc9bb39f0 2024-09-21T06:42:13.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.989+0000 7f8eb5ffb640 1 -- 172.21.15.7:0/331468360 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8ec4035040 con 0x55cfc9bb39f0 2024-09-21T06:42:13.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.989+0000 7f8edadeb740 10 client.16611 fetch_fsmap learned FSMap version 25 2024-09-21T06:42:13.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.989+0000 7f8edadeb740 1 -- 172.21.15.7:0/331468360 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55cfca024890 con 0x55cfc9bb39f0 2024-09-21T06:42:13.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.989+0000 7f8eb5ffb640 1 -- 172.21.15.7:0/331468360 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ec40035f0 con 0x55cfc9bb39f0 2024-09-21T06:42:13.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.990+0000 7f8eb5ffb640 1 -- 172.21.15.7:0/331468360 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f8ec403ac60 con 0x55cfc9bb39f0 2024-09-21T06:42:13.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.990+0000 7f8edadeb740 10 client.16611 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:42:13.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.990+0000 7f8edadeb740 10 client.16611 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-21T06:42:13.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.990+0000 7f8edadeb740 20 client.16611 populate_metadata read hostname 'smithi007' 2024-09-21T06:42:13.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.990+0000 7f8edadeb740 1 --2- 172.21.15.7:0/331468360 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x55cfc9bf5070 0x55cfca026a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:13.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.990+0000 7f8edadeb740 4 client.16611 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:42:13.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.990+0000 7f8edadeb740 1 -- 172.21.15.7:0/331468360 --> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55cfc9f108a0 con 0x55cfc9bf5070 2024-09-21T06:42:13.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.990+0000 7f8ece59c640 1 --2- 172.21.15.7:0/331468360 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x55cfc9bf5070 0x55cfca026a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:13.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.990+0000 7f8ece59c640 1 --2- 172.21.15.7:0/331468360 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x55cfc9bf5070 0x55cfca026a70 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=24afa4a4fc06afa0 server_cookie=ecd7fb96fc30c3ba in_seq=0 out_seq=0 2024-09-21T06:42:13.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.990+0000 7f8eb5ffb640 10 client.16611 ms_handle_connect on v2:172.21.15.18:6836/1539670694 2024-09-21T06:42:13.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.991+0000 7f8eb5ffb640 1 -- 172.21.15.7:0/331468360 <== mds.2 v2:172.21.15.18:6836/1539670694 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55cfc9f108a0 con 0x55cfc9bf5070 2024-09-21T06:42:13.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.991+0000 7f8eb5ffb640 10 client.16611 handle_command_reply: tid=0 2024-09-21T06:42:13.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.991+0000 7f8edadeb740 1 client.16611 shutdown 2024-09-21T06:42:13.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.991+0000 7f8edadeb740 1 -- 172.21.15.7:0/331468360 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cfc9bb39f0 msgr2=0x55cfc9fb0710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:13.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.991+0000 7f8edadeb740 1 --2- 172.21.15.7:0/331468360 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cfc9bb39f0 0x55cfc9fb0710 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f8ec40096c0 tx=0x7f8ec4031550 comp rx=0 tx=0).stop 2024-09-21T06:42:13.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.991+0000 7f8edadeb740 1 -- 172.21.15.7:0/331468360 shutdown_connections 2024-09-21T06:42:13.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.991+0000 7f8edadeb740 1 --2- 172.21.15.7:0/331468360 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x55cfc9bf5070 0x55cfca026a70 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:13.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.991+0000 7f8edadeb740 1 --2- 172.21.15.7:0/331468360 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cfc9bd4390 0x55cfc9fac100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:13.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.991+0000 7f8eb5ffb640 0 client.16611 ms_handle_reset on v2:172.21.15.18:6836/1539670694 2024-09-21T06:42:13.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.991+0000 7f8edadeb740 1 --2- 172.21.15.7:0/331468360 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cfc9bcc1b0 0x55cfc9fabbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:13.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.991+0000 7f8edadeb740 1 --2- 172.21.15.7:0/331468360 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cfc9bb39f0 0x55cfc9fb0710 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:13.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.991+0000 7f8edadeb740 1 -- 172.21.15.7:0/331468360 >> 172.21.15.7:0/331468360 conn(0x55cfc9be9460 msgr2=0x55cfc9f9de60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:13.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.991+0000 7f8edadeb740 1 -- 172.21.15.7:0/331468360 shutdown_connections 2024-09-21T06:42:13.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.991+0000 7f8edadeb740 1 -- 172.21.15.7:0/331468360 wait complete. 2024-09-21T06:42:13.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.991+0000 7f8edadeb740 20 client.16611 trim_cache size 0 max 16384 2024-09-21T06:42:13.998 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:42:13.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.992+0000 7f8ed4877640 1 -- 172.21.15.7:0/1094515675 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f8eb80b6730 msgr2=0x7f8eb80b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:13.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.992+0000 7f8ed4877640 1 --2- 172.21.15.7:0/1094515675 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f8eb80b6730 0x7f8eb80b8c40 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f8ec80ad920 tx=0x7f8ec8012000 comp rx=0 tx=0).stop 2024-09-21T06:42:13.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.992+0000 7f8ed4877640 1 -- 172.21.15.7:0/1094515675 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ed0108cf0 msgr2=0x7f8ed019fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:13.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.992+0000 7f8ed4877640 1 --2- 172.21.15.7:0/1094515675 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ed0108cf0 0x7f8ed019fc40 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f8ec800cce0 tx=0x7f8ec800a620 comp rx=0 tx=0).stop 2024-09-21T06:42:13.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.992+0000 7f8ed4877640 1 -- 172.21.15.7:0/1094515675 shutdown_connections 2024-09-21T06:42:13.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.992+0000 7f8ed4877640 1 --2- 172.21.15.7:0/1094515675 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f8eb80b6730 0x7f8eb80b8c40 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:13.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.992+0000 7f8ed4877640 1 --2- 172.21.15.7:0/1094515675 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8ed0108cf0 0x7f8ed019fc40 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:13.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.992+0000 7f8ed4877640 1 --2- 172.21.15.7:0/1094515675 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8ed01083a0 0x7f8ed019a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:13.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.992+0000 7f8ed4877640 1 --2- 172.21.15.7:0/1094515675 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8ed0102a60 0x7f8ed019a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:13.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.992+0000 7f8ed4877640 1 -- 172.21.15.7:0/1094515675 >> 172.21.15.7:0/1094515675 conn(0x7f8ed0079730 msgr2=0x7f8ed006b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:13.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.992+0000 7f8ed4877640 1 -- 172.21.15.7:0/1094515675 shutdown_connections 2024-09-21T06:42:13.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:13.992+0000 7f8ed4877640 1 -- 172.21.15.7:0/1094515675 wait complete. 2024-09-21T06:42:14.675 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:42:14.934 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:42:15.056 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:42:14 smithi007 ceph-mon[30983]: pgmap v500: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-21T06:42:15.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:42:14 smithi144 ceph-mon[34653]: pgmap v500: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-21T06:42:15.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:42:14 smithi018 ceph-mon[34477]: pgmap v500: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-09-21T06:42:15.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.468+0000 7fafd647b640 1 -- 172.21.15.7:0/925018680 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fafd0102ae0 msgr2=0x7fafd0102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:15.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.468+0000 7fafd647b640 1 --2- 172.21.15.7:0/925018680 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fafd0102ae0 0x7fafd0102ef0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fafc0009900 tx=0x7fafc002a420 comp rx=0 tx=0).stop 2024-09-21T06:42:15.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.468+0000 7fafd647b640 1 -- 172.21.15.7:0/925018680 shutdown_connections 2024-09-21T06:42:15.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.468+0000 7fafd647b640 1 --2- 172.21.15.7:0/925018680 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fafd0108d70 0x7fafd010f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:15.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.468+0000 7fafd647b640 1 --2- 172.21.15.7:0/925018680 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fafd0108420 0x7fafd0108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:15.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.468+0000 7fafd647b640 1 --2- 172.21.15.7:0/925018680 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fafd0102ae0 0x7fafd0102ef0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:15.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.468+0000 7fafd647b640 1 -- 172.21.15.7:0/925018680 >> 172.21.15.7:0/925018680 conn(0x7fafd0079770 msgr2=0x7fafd0079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:15.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.468+0000 7fafd647b640 1 -- 172.21.15.7:0/925018680 shutdown_connections 2024-09-21T06:42:15.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.468+0000 7fafd647b640 1 -- 172.21.15.7:0/925018680 wait complete. 2024-09-21T06:42:15.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.469+0000 7fafd647b640 1 Processor -- start 2024-09-21T06:42:15.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.469+0000 7fafd647b640 1 -- start start 2024-09-21T06:42:15.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.469+0000 7fafd647b640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fafd0102ae0 0x7fafd0199170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:15.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.469+0000 7fafd647b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fafd0108420 0x7fafd01996b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:15.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.469+0000 7fafd647b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fafd0108d70 0x7fafd0199bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:15.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.469+0000 7fafd647b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fafd0112a70 con 0x7fafd0108d70 2024-09-21T06:42:15.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.469+0000 7fafd647b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fafd01128f0 con 0x7fafd0108420 2024-09-21T06:42:15.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.469+0000 7fafd647b640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fafd0112bf0 con 0x7fafd0102ae0 2024-09-21T06:42:15.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.469+0000 7fafd4a18640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fafd0108d70 0x7fafd0199bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:15.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.469+0000 7fafd4a18640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fafd0108d70 0x7fafd0199bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35980/0 (socket says 172.21.15.7:35980) 2024-09-21T06:42:15.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.469+0000 7fafd4a18640 1 -- 172.21.15.7:0/2634132863 learned_addr learned my addr 172.21.15.7:0/2634132863 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:42:15.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.469+0000 7fafc7fff640 1 --2- 172.21.15.7:0/2634132863 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fafd0108420 0x7fafd01996b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:15.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.469+0000 7fafcffff640 1 --2- 172.21.15.7:0/2634132863 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fafd0102ae0 0x7fafd0199170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:15.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.470+0000 7fafd4a18640 1 -- 172.21.15.7:0/2634132863 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fafd0102ae0 msgr2=0x7fafd0199170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:15.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.470+0000 7fafd4a18640 1 --2- 172.21.15.7:0/2634132863 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fafd0102ae0 0x7fafd0199170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:15.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.470+0000 7fafd4a18640 1 -- 172.21.15.7:0/2634132863 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fafd0108420 msgr2=0x7fafd01996b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:15.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.470+0000 7fafd4a18640 1 --2- 172.21.15.7:0/2634132863 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fafd0108420 0x7fafd01996b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:15.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.470+0000 7fafd4a18640 1 -- 172.21.15.7:0/2634132863 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafd01a8820 con 0x7fafd0108d70 2024-09-21T06:42:15.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.470+0000 7fafd4a18640 1 --2- 172.21.15.7:0/2634132863 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fafd0108d70 0x7fafd0199bf0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fafc800eaa0 tx=0x7fafc800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:15.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.470+0000 7fafcdffb640 1 -- 172.21.15.7:0/2634132863 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc8004d20 con 0x7fafd0108d70 2024-09-21T06:42:15.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.470+0000 7fafcdffb640 1 -- 172.21.15.7:0/2634132863 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fafc8005020 con 0x7fafd0108d70 2024-09-21T06:42:15.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.470+0000 7fafd647b640 1 -- 172.21.15.7:0/2634132863 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafd01a8b10 con 0x7fafd0108d70 2024-09-21T06:42:15.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.470+0000 7fafcdffb640 1 -- 172.21.15.7:0/2634132863 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc80116b0 con 0x7fafd0108d70 2024-09-21T06:42:15.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.470+0000 7fafd647b640 1 -- 172.21.15.7:0/2634132863 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafd01a9050 con 0x7fafd0108d70 2024-09-21T06:42:15.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.473+0000 7fafdc9ef740 1 Processor -- start 2024-09-21T06:42:15.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.473+0000 7fafcdffb640 1 -- 172.21.15.7:0/2634132863 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7fafc80051d0 con 0x7fafd0108d70 2024-09-21T06:42:15.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.473+0000 7fafdc9ef740 1 -- start start 2024-09-21T06:42:15.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.473+0000 7fafdc9ef740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562e770aa070 0x562e774516a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:15.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.473+0000 7fafdc9ef740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562e770811b0 0x562e77451be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:15.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.473+0000 7fafdc9ef740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562e77089390 0x562e77452120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:15.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.473+0000 7fafdc9ef740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x562e773c7ea0 con 0x562e77089390 2024-09-21T06:42:15.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.473+0000 7fafdc9ef740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x562e773b72d0 con 0x562e770aa070 2024-09-21T06:42:15.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.473+0000 7fafdc9ef740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x562e773bb0e0 con 0x562e770811b0 2024-09-21T06:42:15.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.474+0000 7fafc7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562e77089390 0x562e77452120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:15.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.474+0000 7fafc7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562e77089390 0x562e77452120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:35996/0 (socket says 172.21.15.7:35996) 2024-09-21T06:42:15.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.474+0000 7fafc7fff640 1 -- 172.21.15.7:0/2696703812 learned_addr learned my addr 172.21.15.7:0/2696703812 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:42:15.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.474+0000 7fafcffff640 1 --2- 172.21.15.7:0/2696703812 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562e770811b0 0x562e77451be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:15.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.474+0000 7fafc7fff640 1 --2- 172.21.15.7:0/2696703812 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562e770aa070 0x562e774516a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:15.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.474+0000 7fafc7fff640 1 -- 172.21.15.7:0/2696703812 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562e770811b0 msgr2=0x562e77451be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:15.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.474+0000 7fafc7fff640 1 --2- 172.21.15.7:0/2696703812 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562e770811b0 0x562e77451be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:15.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.474+0000 7fafc7fff640 1 -- 172.21.15.7:0/2696703812 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562e770aa070 msgr2=0x562e774516a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:15.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.474+0000 7fafc7fff640 1 --2- 172.21.15.7:0/2696703812 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562e770aa070 0x562e774516a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:15.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.474+0000 7fafc7fff640 1 -- 172.21.15.7:0/2696703812 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e77115650 con 0x562e77089390 2024-09-21T06:42:15.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.474+0000 7fafcdffb640 1 --2- 172.21.15.7:0/2634132863 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fafbc0b6700 0x7fafbc0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:15.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.474+0000 7fafc7fff640 1 --2- 172.21.15.7:0/2696703812 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562e77089390 0x562e77452120 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fafb8009330 tx=0x7fafb80094d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb5e33feddda58b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:15.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.474+0000 7fafcffff640 1 --2- 172.21.15.7:0/2634132863 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fafbc0b6700 0x7fafbc0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:15.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.474+0000 7fafcdffb640 1 -- 172.21.15.7:0/2634132863 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fafc80e7780 con 0x7fafd0108d70 2024-09-21T06:42:15.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.474+0000 7fafc67fc640 1 -- 172.21.15.7:0/2696703812 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb8017e60 con 0x562e77089390 2024-09-21T06:42:15.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.475+0000 7fafc67fc640 1 -- 172.21.15.7:0/2696703812 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fafb801d070 con 0x562e77089390 2024-09-21T06:42:15.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.475+0000 7fafc67fc640 1 -- 172.21.15.7:0/2696703812 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb80188c0 con 0x562e77089390 2024-09-21T06:42:15.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.475+0000 7fafdc9ef740 1 -- 172.21.15.7:0/2696703812 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562e77089390 msgr2=0x562e77452120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:15.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.475+0000 7fafcffff640 1 --2- 172.21.15.7:0/2634132863 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fafbc0b6700 0x7fafbc0b8c10 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fafc0000c00 tx=0x7fafc0031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:15.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.475+0000 7fafdc9ef740 1 --2- 172.21.15.7:0/2696703812 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562e77089390 0x562e77452120 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fafb8009330 tx=0x7fafb80094d0 comp rx=0 tx=0).stop 2024-09-21T06:42:15.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.476+0000 7fafdc9ef740 1 -- 172.21.15.7:0/2696703812 shutdown_connections 2024-09-21T06:42:15.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.476+0000 7fafdc9ef740 1 --2- 172.21.15.7:0/2696703812 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562e77089390 0x562e77452120 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:15.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.476+0000 7fafdc9ef740 1 --2- 172.21.15.7:0/2696703812 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562e770811b0 0x562e77451be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:15.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.476+0000 7fafdc9ef740 1 --2- 172.21.15.7:0/2696703812 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562e770aa070 0x562e774516a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:15.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.476+0000 7fafdc9ef740 1 -- 172.21.15.7:0/2696703812 >> 172.21.15.7:0/2696703812 conn(0x562e7709e460 msgr2=0x562e7744f590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:15.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.476+0000 7fafdc9ef740 1 -- 172.21.15.7:0/2696703812 shutdown_connections 2024-09-21T06:42:15.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.476+0000 7fafdc9ef740 1 -- 172.21.15.7:0/2696703812 wait complete. 2024-09-21T06:42:15.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.476+0000 7fafdc9ef740 1 -- start start 2024-09-21T06:42:15.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.476+0000 7fafdc9ef740 1 Processor -- start 2024-09-21T06:42:15.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.477+0000 7fafdc9ef740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562e770811b0 0x562e7745ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:15.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.477+0000 7fafdc9ef740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562e77089390 0x562e7745d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:15.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.477+0000 7fafdc9ef740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562e770aa070 0x562e7745d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:15.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.477+0000 7fafdc9ef740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x562e77218700 con 0x562e770811b0 2024-09-21T06:42:15.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.477+0000 7fafdc9ef740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x562e77352160 con 0x562e770aa070 2024-09-21T06:42:15.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.477+0000 7fafdc9ef740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x562e7745fe20 con 0x562e77089390 2024-09-21T06:42:15.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.477+0000 7fafdc9ef740 10 client.0 _ll_register_callbacks cb 0x562e7736b9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:42:15.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.477+0000 7fafcffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562e770811b0 0x562e7745ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:15.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.477+0000 7fafcffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562e770811b0 0x562e7745ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36006/0 (socket says 172.21.15.7:36006) 2024-09-21T06:42:15.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.477+0000 7fafcffff640 1 -- 172.21.15.7:0/2474673838 learned_addr learned my addr 172.21.15.7:0/2474673838 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:42:15.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.477+0000 7fafc7fff640 1 --2- 172.21.15.7:0/2474673838 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562e77089390 0x562e7745d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:15.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.477+0000 7fafd4a18640 1 --2- 172.21.15.7:0/2474673838 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562e770aa070 0x562e7745d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:15.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.477+0000 7fafcffff640 1 -- 172.21.15.7:0/2474673838 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562e77089390 msgr2=0x562e7745d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:15.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.477+0000 7fafcffff640 1 --2- 172.21.15.7:0/2474673838 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562e77089390 0x562e7745d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:15.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.477+0000 7fafcffff640 1 -- 172.21.15.7:0/2474673838 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562e770aa070 msgr2=0x562e7745d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:15.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.477+0000 7fafcffff640 1 --2- 172.21.15.7:0/2474673838 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562e770aa070 0x562e7745d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:15.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.477+0000 7fafcffff640 1 -- 172.21.15.7:0/2474673838 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e7737fc90 con 0x562e770811b0 2024-09-21T06:42:15.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.477+0000 7fafd4a18640 1 --2- 172.21.15.7:0/2474673838 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562e770aa070 0x562e7745d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:42:15.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.477+0000 7fafcffff640 1 --2- 172.21.15.7:0/2474673838 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562e770811b0 0x562e7745ccc0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fafc0032fd0 tx=0x7fafc0009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8d741bfb4e15e5b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:15.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.477+0000 7fafaf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:42:15.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.478+0000 7fafaf7fe640 1 -- 172.21.15.7:0/2474673838 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc004d030 con 0x562e770811b0 2024-09-21T06:42:15.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.478+0000 7fafaf7fe640 1 -- 172.21.15.7:0/2474673838 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fafc00038c0 con 0x562e770811b0 2024-09-21T06:42:15.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.478+0000 7fafdc9ef740 1 -- 172.21.15.7:0/2474673838 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fafb801d070 con 0x562e770811b0 2024-09-21T06:42:15.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.478+0000 7fafaf7fe640 1 -- 172.21.15.7:0/2474673838 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fafc0057030 con 0x562e770811b0 2024-09-21T06:42:15.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.478+0000 7fafdc9ef740 10 client.16623 fetch_fsmap learned FSMap version 25 2024-09-21T06:42:15.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.478+0000 7fafdc9ef740 1 -- 172.21.15.7:0/2474673838 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562e7746baa0 con 0x562e770811b0 2024-09-21T06:42:15.492 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.478+0000 7fafaf7fe640 1 -- 172.21.15.7:0/2474673838 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fafb801d070 con 0x562e770811b0 2024-09-21T06:42:15.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.478+0000 7fafaf7fe640 1 -- 172.21.15.7:0/2474673838 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fafc003dab0 con 0x562e770811b0 2024-09-21T06:42:15.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.478+0000 7fafdc9ef740 10 client.16623 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:42:15.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.478+0000 7fafdc9ef740 10 client.16623 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:42:15.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.478+0000 7fafdc9ef740 20 client.16623 populate_metadata read hostname 'smithi007' 2024-09-21T06:42:15.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.478+0000 7fafdc9ef740 1 --2- 172.21.15.7:0/2474673838 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x562e770689f0 0x562e7746f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:15.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.478+0000 7fafdc9ef740 4 client.16623 mds_command: new command op to 24688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:42:15.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.478+0000 7fafdc9ef740 1 -- 172.21.15.7:0/2474673838 --> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562e773c9df0 con 0x562e770689f0 2024-09-21T06:42:15.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.479+0000 7fafc7fff640 1 --2- 172.21.15.7:0/2474673838 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x562e770689f0 0x562e7746f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:15.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.479+0000 7fafaf7fe640 10 client.16623 ms_handle_connect on v2:172.21.15.144:6838/4027821922 2024-09-21T06:42:15.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.479+0000 7fafc7fff640 1 --2- 172.21.15.7:0/2474673838 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x562e770689f0 0x562e7746f000 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c70989ee6a5a4718 server_cookie=8c9c3716955acbc7 in_seq=0 out_seq=0 2024-09-21T06:42:15.493 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.480+0000 7fafaf7fe640 1 -- 172.21.15.7:0/2474673838 <== mds.1 v2:172.21.15.144:6838/4027821922 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562e773c9df0 con 0x562e770689f0 2024-09-21T06:42:15.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.480+0000 7fafaf7fe640 10 client.16623 handle_command_reply: tid=0 2024-09-21T06:42:15.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.480+0000 7fafdc9ef740 1 client.16623 shutdown 2024-09-21T06:42:15.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.480+0000 7fafdc9ef740 1 -- 172.21.15.7:0/2474673838 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562e770811b0 msgr2=0x562e7745ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:15.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.480+0000 7fafdc9ef740 1 --2- 172.21.15.7:0/2474673838 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562e770811b0 0x562e7745ccc0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fafc0032fd0 tx=0x7fafc0009260 comp rx=0 tx=0).stop 2024-09-21T06:42:15.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.481+0000 7fafdc9ef740 1 -- 172.21.15.7:0/2474673838 shutdown_connections 2024-09-21T06:42:15.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.481+0000 7fafdc9ef740 1 --2- 172.21.15.7:0/2474673838 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x562e770689f0 0x562e7746f000 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:15.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.481+0000 7fafdc9ef740 1 --2- 172.21.15.7:0/2474673838 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562e770aa070 0x562e7745d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:15.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.481+0000 7fafdc9ef740 1 --2- 172.21.15.7:0/2474673838 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562e77089390 0x562e7745d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:15.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.481+0000 7fafdc9ef740 1 --2- 172.21.15.7:0/2474673838 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562e770811b0 0x562e7745ccc0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:15.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.481+0000 7fafaf7fe640 0 client.16623 ms_handle_reset on v2:172.21.15.144:6838/4027821922 2024-09-21T06:42:15.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.481+0000 7fafdc9ef740 1 -- 172.21.15.7:0/2474673838 >> 172.21.15.7:0/2474673838 conn(0x562e7709e460 msgr2=0x562e77454880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:15.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.481+0000 7fafdc9ef740 1 -- 172.21.15.7:0/2474673838 shutdown_connections 2024-09-21T06:42:15.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.481+0000 7fafdc9ef740 1 -- 172.21.15.7:0/2474673838 wait complete. 2024-09-21T06:42:15.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.481+0000 7fafdc9ef740 20 client.16623 trim_cache size 0 max 16384 2024-09-21T06:42:15.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.494+0000 7fafdc9ef740 1 Processor -- start 2024-09-21T06:42:15.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.494+0000 7fafdc9ef740 1 -- start start 2024-09-21T06:42:15.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.494+0000 7fafdc9ef740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562e770811b0 0x562e77453090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:15.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.494+0000 7fafdc9ef740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562e77089390 0x562e7745e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:15.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.494+0000 7fafdc9ef740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562e770aa070 0x562e7744ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:15.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.494+0000 7fafdc9ef740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fafd01b3f40 con 0x562e770aa070 2024-09-21T06:42:15.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.494+0000 7fafdc9ef740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fafd01b1810 con 0x562e77089390 2024-09-21T06:42:15.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.494+0000 7fafdc9ef740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fafd01af640 con 0x562e770811b0 2024-09-21T06:42:15.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.494+0000 7fafd4a18640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562e770aa070 0x562e7744ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:15.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.494+0000 7fafd4a18640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562e770aa070 0x562e7744ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36016/0 (socket says 172.21.15.7:36016) 2024-09-21T06:42:15.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.494+0000 7fafd4a18640 1 -- 172.21.15.7:0/2806740481 learned_addr learned my addr 172.21.15.7:0/2806740481 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:42:15.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.494+0000 7fafcffff640 1 --2- 172.21.15.7:0/2806740481 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562e770811b0 0x562e77453090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:15.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.494+0000 7fafc7fff640 1 --2- 172.21.15.7:0/2806740481 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562e77089390 0x562e7745e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:15.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.495+0000 7fafd4a18640 1 -- 172.21.15.7:0/2806740481 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562e770811b0 msgr2=0x562e77453090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:15.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.495+0000 7fafd4a18640 1 --2- 172.21.15.7:0/2806740481 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562e770811b0 0x562e77453090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:15.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.495+0000 7fafd4a18640 1 -- 172.21.15.7:0/2806740481 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562e77089390 msgr2=0x562e7745e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:15.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.495+0000 7fafd4a18640 1 --2- 172.21.15.7:0/2806740481 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562e77089390 0x562e7745e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:15.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.495+0000 7fafd4a18640 1 -- 172.21.15.7:0/2806740481 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562e77453990 con 0x562e770aa070 2024-09-21T06:42:15.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.495+0000 7fafcffff640 1 --2- 172.21.15.7:0/2806740481 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562e770811b0 0x562e77453090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:42:15.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.495+0000 7fafd4a18640 1 --2- 172.21.15.7:0/2806740481 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562e770aa070 0x562e7744ebc0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fafc80ad370 tx=0x7fafc80acea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f13d0d6e79893707 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:15.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.495+0000 7fafc5ffb640 1 -- 172.21.15.7:0/2806740481 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc801f070 con 0x562e770aa070 2024-09-21T06:42:15.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.495+0000 7fafc5ffb640 1 -- 172.21.15.7:0/2806740481 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fafc80b2150 con 0x562e770aa070 2024-09-21T06:42:15.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.495+0000 7fafc5ffb640 1 -- 172.21.15.7:0/2806740481 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc80b6330 con 0x562e770aa070 2024-09-21T06:42:15.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.496+0000 7fafdc9ef740 1 -- 172.21.15.7:0/2806740481 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562e770aa070 msgr2=0x562e7744ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:15.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.496+0000 7fafdc9ef740 1 --2- 172.21.15.7:0/2806740481 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562e770aa070 0x562e7744ebc0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fafc80ad370 tx=0x7fafc80acea0 comp rx=0 tx=0).stop 2024-09-21T06:42:15.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.496+0000 7fafdc9ef740 1 -- 172.21.15.7:0/2806740481 shutdown_connections 2024-09-21T06:42:15.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.496+0000 7fafdc9ef740 1 --2- 172.21.15.7:0/2806740481 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562e770aa070 0x562e7744ebc0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:15.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.496+0000 7fafdc9ef740 1 --2- 172.21.15.7:0/2806740481 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562e77089390 0x562e7745e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:15.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.496+0000 7fafdc9ef740 1 --2- 172.21.15.7:0/2806740481 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562e770811b0 0x562e77453090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:15.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.496+0000 7fafdc9ef740 1 -- 172.21.15.7:0/2806740481 >> 172.21.15.7:0/2806740481 conn(0x562e7709e460 msgr2=0x562e7745e1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:15.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.496+0000 7fafdc9ef740 1 -- 172.21.15.7:0/2806740481 shutdown_connections 2024-09-21T06:42:15.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.496+0000 7fafdc9ef740 1 -- 172.21.15.7:0/2806740481 wait complete. 2024-09-21T06:42:15.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.496+0000 7fafdc9ef740 1 -- start start 2024-09-21T06:42:15.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.496+0000 7fafdc9ef740 1 Processor -- start 2024-09-21T06:42:15.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.497+0000 7fafdc9ef740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562e770811b0 0x562e77465a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:15.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.497+0000 7fafdc9ef740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562e77089390 0x562e77460f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:15.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.497+0000 7fafdc9ef740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562e770aa070 0x562e77461670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:15.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.497+0000 7fafdc9ef740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fafd01afcd0 con 0x562e770811b0 2024-09-21T06:42:15.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.497+0000 7fafdc9ef740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fafd01b1140 con 0x562e77089390 2024-09-21T06:42:15.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.497+0000 7fafdc9ef740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fafd01b03a0 con 0x562e770aa070 2024-09-21T06:42:15.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.497+0000 7fafdc9ef740 10 client.0 _ll_register_callbacks cb 0x7fafc0005890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:42:15.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.497+0000 7fafcffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562e770811b0 0x562e77465a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:15.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.497+0000 7fafcffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562e770811b0 0x562e77465a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36030/0 (socket says 172.21.15.7:36030) 2024-09-21T06:42:15.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.497+0000 7fafcffff640 1 -- 172.21.15.7:0/4096957095 learned_addr learned my addr 172.21.15.7:0/4096957095 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:42:15.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.497+0000 7fafc7fff640 1 --2- 172.21.15.7:0/4096957095 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562e77089390 0x562e77460f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:15.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.497+0000 7fafd4a18640 1 --2- 172.21.15.7:0/4096957095 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562e770aa070 0x562e77461670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:15.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.497+0000 7fafcffff640 1 -- 172.21.15.7:0/4096957095 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562e770aa070 msgr2=0x562e77461670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:15.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.497+0000 7fafcffff640 1 --2- 172.21.15.7:0/4096957095 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562e770aa070 0x562e77461670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:15.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.497+0000 7fafcffff640 1 -- 172.21.15.7:0/4096957095 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562e77089390 msgr2=0x562e77460f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:15.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.497+0000 7fafcffff640 1 --2- 172.21.15.7:0/4096957095 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562e77089390 0x562e77460f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:15.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.497+0000 7fafcffff640 1 -- 172.21.15.7:0/4096957095 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562e774d89c0 con 0x562e770811b0 2024-09-21T06:42:15.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.498+0000 7fafcffff640 1 --2- 172.21.15.7:0/4096957095 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562e770811b0 0x562e77465a70 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fafc0005940 tx=0x7fafc0049c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3701aa6fc0b35019 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:15.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.498+0000 7fafaf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:42:15.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.498+0000 7fafaf7fe640 1 -- 172.21.15.7:0/4096957095 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc0060070 con 0x562e770811b0 2024-09-21T06:42:15.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.498+0000 7fafaf7fe640 1 -- 172.21.15.7:0/4096957095 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fafc00038c0 con 0x562e770811b0 2024-09-21T06:42:15.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.498+0000 7fafdc9ef740 1 -- 172.21.15.7:0/4096957095 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fafc80b2150 con 0x562e770811b0 2024-09-21T06:42:15.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.498+0000 7fafaf7fe640 1 -- 172.21.15.7:0/4096957095 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fafc006c050 con 0x562e770811b0 2024-09-21T06:42:15.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.498+0000 7fafdc9ef740 10 client.16629 fetch_fsmap learned FSMap version 25 2024-09-21T06:42:15.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.498+0000 7fafdc9ef740 1 -- 172.21.15.7:0/4096957095 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562e774d9ba0 con 0x562e770811b0 2024-09-21T06:42:15.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.498+0000 7fafaf7fe640 1 -- 172.21.15.7:0/4096957095 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fafc80b2150 con 0x562e770811b0 2024-09-21T06:42:15.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.498+0000 7fafaf7fe640 1 -- 172.21.15.7:0/4096957095 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fafc00053e0 con 0x562e770811b0 2024-09-21T06:42:15.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.498+0000 7fafdc9ef740 10 client.16629 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:42:15.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.498+0000 7fafdc9ef740 10 client.16629 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:42:15.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.498+0000 7fafdc9ef740 20 client.16629 populate_metadata read hostname 'smithi007' 2024-09-21T06:42:15.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.498+0000 7fafdc9ef740 1 --2- 172.21.15.7:0/4096957095 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x562e7703dda0 0x562e774dc390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:15.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.498+0000 7fafdc9ef740 4 client.16629 mds_command: new command op to 24688 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:42:15.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.498+0000 7fafdc9ef740 1 -- 172.21.15.7:0/4096957095 --> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562e773c58a0 con 0x562e7703dda0 2024-09-21T06:42:15.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.499+0000 7fafc7fff640 1 --2- 172.21.15.7:0/4096957095 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x562e7703dda0 0x562e774dc390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:15.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.499+0000 7fafaf7fe640 10 client.16629 ms_handle_connect on v2:172.21.15.144:6838/4027821922 2024-09-21T06:42:15.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.499+0000 7fafc7fff640 1 --2- 172.21.15.7:0/4096957095 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x562e7703dda0 0x562e774dc390 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1e29dd83a474f4c0 server_cookie=33451b942f176cab in_seq=0 out_seq=0 2024-09-21T06:42:15.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.500+0000 7fafaf7fe640 1 -- 172.21.15.7:0/4096957095 <== mds.1 v2:172.21.15.144:6838/4027821922 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562e773c58a0 con 0x562e7703dda0 2024-09-21T06:42:15.506 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.500+0000 7fafaf7fe640 10 client.16629 handle_command_reply: tid=0 2024-09-21T06:42:15.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.500+0000 7fafdc9ef740 1 client.16629 shutdown 2024-09-21T06:42:15.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.500+0000 7fafdc9ef740 1 -- 172.21.15.7:0/4096957095 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562e770811b0 msgr2=0x562e77465a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:15.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.500+0000 7fafdc9ef740 1 --2- 172.21.15.7:0/4096957095 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562e770811b0 0x562e77465a70 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fafc0005940 tx=0x7fafc0049c30 comp rx=0 tx=0).stop 2024-09-21T06:42:15.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.500+0000 7fafdc9ef740 1 -- 172.21.15.7:0/4096957095 shutdown_connections 2024-09-21T06:42:15.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.500+0000 7fafdc9ef740 1 --2- 172.21.15.7:0/4096957095 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x562e7703dda0 0x562e774dc390 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:15.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.500+0000 7fafdc9ef740 1 --2- 172.21.15.7:0/4096957095 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562e770aa070 0x562e77461670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:15.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.500+0000 7fafaf7fe640 0 client.16629 ms_handle_reset on v2:172.21.15.144:6838/4027821922 2024-09-21T06:42:15.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.500+0000 7fafdc9ef740 1 --2- 172.21.15.7:0/4096957095 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562e77089390 0x562e77460f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:15.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.500+0000 7fafdc9ef740 1 --2- 172.21.15.7:0/4096957095 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562e770811b0 0x562e77465a70 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:15.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.500+0000 7fafdc9ef740 1 -- 172.21.15.7:0/4096957095 >> 172.21.15.7:0/4096957095 conn(0x562e7709e460 msgr2=0x562e77452e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:15.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.500+0000 7fafdc9ef740 1 -- 172.21.15.7:0/4096957095 shutdown_connections 2024-09-21T06:42:15.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.500+0000 7fafdc9ef740 1 -- 172.21.15.7:0/4096957095 wait complete. 2024-09-21T06:42:15.507 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.500+0000 7fafdc9ef740 20 client.16629 trim_cache size 0 max 16384 2024-09-21T06:42:15.508 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:42:15.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.501+0000 7fafd647b640 1 -- 172.21.15.7:0/2634132863 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fafbc0b6700 msgr2=0x7fafbc0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:15.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.501+0000 7fafd647b640 1 --2- 172.21.15.7:0/2634132863 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fafbc0b6700 0x7fafbc0b8c10 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fafc0000c00 tx=0x7fafc0031400 comp rx=0 tx=0).stop 2024-09-21T06:42:15.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.501+0000 7fafd647b640 1 -- 172.21.15.7:0/2634132863 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fafd0108d70 msgr2=0x7fafd0199bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:15.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.501+0000 7fafd647b640 1 --2- 172.21.15.7:0/2634132863 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fafd0108d70 0x7fafd0199bf0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fafc800eaa0 tx=0x7fafc800eea0 comp rx=0 tx=0).stop 2024-09-21T06:42:15.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.501+0000 7fafd647b640 1 -- 172.21.15.7:0/2634132863 shutdown_connections 2024-09-21T06:42:15.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.501+0000 7fafd647b640 1 --2- 172.21.15.7:0/2634132863 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fafbc0b6700 0x7fafbc0b8c10 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:15.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.501+0000 7fafd647b640 1 --2- 172.21.15.7:0/2634132863 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fafd0108d70 0x7fafd0199bf0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:15.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.501+0000 7fafd647b640 1 --2- 172.21.15.7:0/2634132863 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fafd0108420 0x7fafd01996b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:15.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.501+0000 7fafd647b640 1 --2- 172.21.15.7:0/2634132863 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fafd0102ae0 0x7fafd0199170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:15.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.501+0000 7fafd647b640 1 -- 172.21.15.7:0/2634132863 >> 172.21.15.7:0/2634132863 conn(0x7fafd0079770 msgr2=0x7fafd0106510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:15.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.501+0000 7fafd647b640 1 -- 172.21.15.7:0/2634132863 shutdown_connections 2024-09-21T06:42:15.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:15.501+0000 7fafd647b640 1 -- 172.21.15.7:0/2634132863 wait complete. 2024-09-21T06:42:16.202 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:42:16.459 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:42:16.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.938+0000 7f21d3e3e640 1 -- 172.21.15.7:0/2407522066 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21cc1083a0 msgr2=0x7f21cc1087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:16.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.938+0000 7f21d3e3e640 1 --2- 172.21.15.7:0/2407522066 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21cc1083a0 0x7f21cc1087b0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f21bc009900 tx=0x7f21bc02a410 comp rx=0 tx=0).stop 2024-09-21T06:42:16.940 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.938+0000 7f21d3e3e640 1 -- 172.21.15.7:0/2407522066 shutdown_connections 2024-09-21T06:42:16.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.938+0000 7f21d3e3e640 1 --2- 172.21.15.7:0/2407522066 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21cc108cf0 0x7f21cc10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:16.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.938+0000 7f21d3e3e640 1 --2- 172.21.15.7:0/2407522066 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21cc1083a0 0x7f21cc1087b0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:16.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.938+0000 7f21d3e3e640 1 --2- 172.21.15.7:0/2407522066 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21cc102a60 0x7f21cc102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:16.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.938+0000 7f21d3e3e640 1 -- 172.21.15.7:0/2407522066 >> 172.21.15.7:0/2407522066 conn(0x7f21cc079730 msgr2=0x7f21cc079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:16.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.938+0000 7f21d3e3e640 1 -- 172.21.15.7:0/2407522066 shutdown_connections 2024-09-21T06:42:16.941 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.938+0000 7f21d3e3e640 1 -- 172.21.15.7:0/2407522066 wait complete. 2024-09-21T06:42:16.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.939+0000 7f21d3e3e640 1 Processor -- start 2024-09-21T06:42:16.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.939+0000 7f21d3e3e640 1 -- start start 2024-09-21T06:42:16.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.939+0000 7f21d3e3e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21cc102a60 0x7f21cc19b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:16.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.939+0000 7f21d3e3e640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21cc1083a0 0x7f21cc19b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:16.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.939+0000 7f21d3e3e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21cc108cf0 0x7f21cc19be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:16.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.939+0000 7f21d3e3e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f21cc112960 con 0x7f21cc108cf0 2024-09-21T06:42:16.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.939+0000 7f21d3e3e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f21cc1127e0 con 0x7f21cc102a60 2024-09-21T06:42:16.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.939+0000 7f21d3e3e640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f21cc112ae0 con 0x7f21cc1083a0 2024-09-21T06:42:16.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.940+0000 7f21d23db640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21cc108cf0 0x7f21cc19be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:16.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.940+0000 7f21d1bda640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21cc102a60 0x7f21cc19b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:16.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.940+0000 7f21d23db640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21cc108cf0 0x7f21cc19be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36038/0 (socket says 172.21.15.7:36038) 2024-09-21T06:42:16.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.940+0000 7f21d23db640 1 -- 172.21.15.7:0/2324317750 learned_addr learned my addr 172.21.15.7:0/2324317750 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:42:16.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.940+0000 7f21d13d9640 1 --2- 172.21.15.7:0/2324317750 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21cc1083a0 0x7f21cc19b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:16.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.940+0000 7f21d23db640 1 -- 172.21.15.7:0/2324317750 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21cc1083a0 msgr2=0x7f21cc19b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:16.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.940+0000 7f21d23db640 1 --2- 172.21.15.7:0/2324317750 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21cc1083a0 0x7f21cc19b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:16.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.940+0000 7f21d23db640 1 -- 172.21.15.7:0/2324317750 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21cc102a60 msgr2=0x7f21cc19b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:16.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.940+0000 7f21d23db640 1 --2- 172.21.15.7:0/2324317750 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21cc102a60 0x7f21cc19b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:16.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.940+0000 7f21d23db640 1 -- 172.21.15.7:0/2324317750 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21cc1a6620 con 0x7f21cc108cf0 2024-09-21T06:42:16.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.940+0000 7f21d13d9640 1 --2- 172.21.15.7:0/2324317750 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21cc1083a0 0x7f21cc19b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:42:16.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.940+0000 7f21d23db640 1 --2- 172.21.15.7:0/2324317750 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21cc108cf0 0x7f21cc19be10 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f21c400d750 tx=0x7f21c400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:16.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.940+0000 7f21c2ffd640 1 -- 172.21.15.7:0/2324317750 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c4017070 con 0x7f21cc108cf0 2024-09-21T06:42:16.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.940+0000 7f21d3e3e640 1 -- 172.21.15.7:0/2324317750 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21cc1a6910 con 0x7f21cc108cf0 2024-09-21T06:42:16.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.940+0000 7f21c2ffd640 1 -- 172.21.15.7:0/2324317750 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f21c40054d0 con 0x7f21cc108cf0 2024-09-21T06:42:16.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.940+0000 7f21c2ffd640 1 -- 172.21.15.7:0/2324317750 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c4004c60 con 0x7f21cc108cf0 2024-09-21T06:42:16.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.940+0000 7f21d3e3e640 1 -- 172.21.15.7:0/2324317750 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21cc1a6e20 con 0x7f21cc108cf0 2024-09-21T06:42:16.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.943+0000 7f21da3b2740 1 Processor -- start 2024-09-21T06:42:16.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.943+0000 7f21c2ffd640 1 -- 172.21.15.7:0/2324317750 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f21c4009bd0 con 0x7f21cc108cf0 2024-09-21T06:42:16.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.944+0000 7f21da3b2740 1 -- start start 2024-09-21T06:42:16.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.944+0000 7f21da3b2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56411b9e5070 0x56411bd8c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:16.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.944+0000 7f21da3b2740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56411b9bc1b0 0x56411bd8cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:16.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.944+0000 7f21da3b2740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56411b9c4390 0x56411bd8d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:16.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.944+0000 7f21da3b2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56411bd02ea0 con 0x56411b9e5070 2024-09-21T06:42:16.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.944+0000 7f21da3b2740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56411bcf22d0 con 0x56411b9bc1b0 2024-09-21T06:42:16.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.944+0000 7f21da3b2740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x56411bcf60e0 con 0x56411b9c4390 2024-09-21T06:42:16.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.944+0000 7f21d13d9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56411b9e5070 0x56411bd8c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:16.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.944+0000 7f21d13d9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56411b9e5070 0x56411bd8c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36048/0 (socket says 172.21.15.7:36048) 2024-09-21T06:42:16.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.944+0000 7f21d13d9640 1 -- 172.21.15.7:0/3421330002 learned_addr learned my addr 172.21.15.7:0/3421330002 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:42:16.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.944+0000 7f21d1bda640 1 --2- 172.21.15.7:0/3421330002 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56411b9bc1b0 0x56411bd8cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:16.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.945+0000 7f21d13d9640 1 --2- 172.21.15.7:0/3421330002 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56411b9c4390 0x56411bd8d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:16.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.945+0000 7f21c2ffd640 1 --2- 172.21.15.7:0/2324317750 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f21b80b66b0 0x7f21b80b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:16.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.945+0000 7f21d13d9640 1 -- 172.21.15.7:0/3421330002 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56411b9c4390 msgr2=0x56411bd8d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:16.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.945+0000 7f21d13d9640 1 --2- 172.21.15.7:0/3421330002 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56411b9c4390 0x56411bd8d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:16.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.945+0000 7f21d13d9640 1 -- 172.21.15.7:0/3421330002 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56411b9bc1b0 msgr2=0x56411bd8cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:16.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.945+0000 7f21d13d9640 1 --2- 172.21.15.7:0/3421330002 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56411b9bc1b0 0x56411bd8cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:16.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.945+0000 7f21d13d9640 1 -- 172.21.15.7:0/3421330002 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56411ba50650 con 0x56411b9e5070 2024-09-21T06:42:16.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.945+0000 7f21d23db640 1 --2- 172.21.15.7:0/2324317750 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f21b80b66b0 0x7f21b80b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:16.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.945+0000 7f21c2ffd640 1 -- 172.21.15.7:0/2324317750 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f21c40e6ff0 con 0x7f21cc108cf0 2024-09-21T06:42:16.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.945+0000 7f21d13d9640 1 --2- 172.21.15.7:0/3421330002 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56411b9e5070 0x56411bd8c6a0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f21bc031440 tx=0x7f21bc009560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72ec76b8b91cba9b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:16.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.945+0000 7f21b7fff640 1 -- 172.21.15.7:0/3421330002 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21bc035050 con 0x56411b9e5070 2024-09-21T06:42:16.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.945+0000 7f21b7fff640 1 -- 172.21.15.7:0/3421330002 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f21bc041070 con 0x56411b9e5070 2024-09-21T06:42:16.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.945+0000 7f21b7fff640 1 -- 172.21.15.7:0/3421330002 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21bc0055b0 con 0x56411b9e5070 2024-09-21T06:42:16.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.946+0000 7f21da3b2740 1 -- 172.21.15.7:0/3421330002 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56411b9e5070 msgr2=0x56411bd8c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:16.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.946+0000 7f21da3b2740 1 --2- 172.21.15.7:0/3421330002 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56411b9e5070 0x56411bd8c6a0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f21bc031440 tx=0x7f21bc009560 comp rx=0 tx=0).stop 2024-09-21T06:42:16.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.946+0000 7f21d23db640 1 --2- 172.21.15.7:0/2324317750 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f21b80b66b0 0x7f21b80b8bc0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f21c40aa130 tx=0x7f21c400df60 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:16.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.946+0000 7f21da3b2740 1 -- 172.21.15.7:0/3421330002 shutdown_connections 2024-09-21T06:42:16.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.946+0000 7f21da3b2740 1 --2- 172.21.15.7:0/3421330002 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56411b9c4390 0x56411bd8d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:16.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.946+0000 7f21da3b2740 1 --2- 172.21.15.7:0/3421330002 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56411b9bc1b0 0x56411bd8cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:16.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.946+0000 7f21da3b2740 1 --2- 172.21.15.7:0/3421330002 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56411b9e5070 0x56411bd8c6a0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:16.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.946+0000 7f21da3b2740 1 -- 172.21.15.7:0/3421330002 >> 172.21.15.7:0/3421330002 conn(0x56411b9d9460 msgr2=0x56411bd8a590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:16.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.946+0000 7f21da3b2740 1 -- 172.21.15.7:0/3421330002 shutdown_connections 2024-09-21T06:42:16.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.946+0000 7f21da3b2740 1 -- 172.21.15.7:0/3421330002 wait complete. 2024-09-21T06:42:16.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.947+0000 7f21da3b2740 1 -- start start 2024-09-21T06:42:16.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.947+0000 7f21da3b2740 1 Processor -- start 2024-09-21T06:42:16.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.947+0000 7f21da3b2740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56411b9bc1b0 0x56411bd97d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:16.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.947+0000 7f21da3b2740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56411b9c4390 0x56411bd982a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:16.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.947+0000 7f21da3b2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56411b9e5070 0x56411bda4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:16.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.947+0000 7f21da3b2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56411bb53700 con 0x56411b9e5070 2024-09-21T06:42:16.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.947+0000 7f21da3b2740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56411bc8d160 con 0x56411b9c4390 2024-09-21T06:42:16.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.947+0000 7f21da3b2740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x56411bd9ae20 con 0x56411b9bc1b0 2024-09-21T06:42:16.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.948+0000 7f21da3b2740 10 client.0 _ll_register_callbacks cb 0x56411bca69e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:42:16.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.948+0000 7f21d13d9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56411b9e5070 0x56411bda4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:16.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.948+0000 7f21d13d9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56411b9e5070 0x56411bda4170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36060/0 (socket says 172.21.15.7:36060) 2024-09-21T06:42:16.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.948+0000 7f21d13d9640 1 -- 172.21.15.7:0/493766008 learned_addr learned my addr 172.21.15.7:0/493766008 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:42:16.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.948+0000 7f21d13d9640 1 --2- 172.21.15.7:0/493766008 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56411b9bc1b0 0x56411bd97d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:16.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.948+0000 7f21d1bda640 1 --2- 172.21.15.7:0/493766008 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56411b9c4390 0x56411bd982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:16.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.948+0000 7f21d13d9640 1 -- 172.21.15.7:0/493766008 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56411b9bc1b0 msgr2=0x56411bd97d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:16.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.948+0000 7f21d13d9640 1 --2- 172.21.15.7:0/493766008 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56411b9bc1b0 0x56411bd97d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:16.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.948+0000 7f21d13d9640 1 -- 172.21.15.7:0/493766008 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56411b9c4390 msgr2=0x56411bd982a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:16.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.948+0000 7f21d13d9640 1 --2- 172.21.15.7:0/493766008 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56411b9c4390 0x56411bd982a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:16.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.948+0000 7f21d13d9640 1 -- 172.21.15.7:0/493766008 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56411bcbac90 con 0x56411b9e5070 2024-09-21T06:42:16.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.948+0000 7f21d13d9640 1 --2- 172.21.15.7:0/493766008 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56411b9e5070 0x56411bda4170 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f21bc005790 tx=0x7f21bc0052d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cbb36addb1aa07c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:16.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.948+0000 7f21b57fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:42:16.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.948+0000 7f21b57fa640 1 -- 172.21.15.7:0/493766008 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21bc035070 con 0x56411b9e5070 2024-09-21T06:42:16.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.949+0000 7f21b57fa640 1 -- 172.21.15.7:0/493766008 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f21bc004020 con 0x56411b9e5070 2024-09-21T06:42:16.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.949+0000 7f21da3b2740 1 -- 172.21.15.7:0/493766008 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f21bc041070 con 0x56411b9e5070 2024-09-21T06:42:16.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.949+0000 7f21b57fa640 1 -- 172.21.15.7:0/493766008 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f21bc058030 con 0x56411b9e5070 2024-09-21T06:42:16.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.949+0000 7f21da3b2740 10 client.16641 fetch_fsmap learned FSMap version 25 2024-09-21T06:42:16.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.949+0000 7f21da3b2740 1 -- 172.21.15.7:0/493766008 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56411bda6b30 con 0x56411b9e5070 2024-09-21T06:42:16.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.949+0000 7f21b57fa640 1 -- 172.21.15.7:0/493766008 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f21bc041070 con 0x56411b9e5070 2024-09-21T06:42:16.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.949+0000 7f21b57fa640 1 -- 172.21.15.7:0/493766008 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f21bc0035f0 con 0x56411b9e5070 2024-09-21T06:42:16.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.949+0000 7f21da3b2740 10 client.16641 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:42:16.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.949+0000 7f21da3b2740 10 client.16641 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:42:16.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.949+0000 7f21da3b2740 20 client.16641 populate_metadata read hostname 'smithi007' 2024-09-21T06:42:16.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.949+0000 7f21da3b2740 1 --2- 172.21.15.7:0/493766008 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x56411b9a39f0 0x56411bda9e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:16.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.949+0000 7f21da3b2740 4 client.16641 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:42:16.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.949+0000 7f21da3b2740 1 -- 172.21.15.7:0/493766008 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56411bd04df0 con 0x56411b9a39f0 2024-09-21T06:42:16.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.950+0000 7f21d1bda640 1 --2- 172.21.15.7:0/493766008 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x56411b9a39f0 0x56411bda9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:16.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.950+0000 7f21d1bda640 1 --2- 172.21.15.7:0/493766008 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x56411b9a39f0 0x56411bda9e90 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=74183879f3ea4c3 server_cookie=d6f948dfb45ea7b in_seq=0 out_seq=0 2024-09-21T06:42:16.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.950+0000 7f21b57fa640 10 client.16641 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:42:16.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.951+0000 7f21b57fa640 1 -- 172.21.15.7:0/493766008 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56411bd04df0 con 0x56411b9a39f0 2024-09-21T06:42:16.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.951+0000 7f21b57fa640 10 client.16641 handle_command_reply: tid=0 2024-09-21T06:42:16.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.951+0000 7f21da3b2740 1 client.16641 shutdown 2024-09-21T06:42:16.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.951+0000 7f21da3b2740 1 -- 172.21.15.7:0/493766008 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56411b9e5070 msgr2=0x56411bda4170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:16.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.951+0000 7f21da3b2740 1 --2- 172.21.15.7:0/493766008 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56411b9e5070 0x56411bda4170 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f21bc005790 tx=0x7f21bc0052d0 comp rx=0 tx=0).stop 2024-09-21T06:42:16.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.951+0000 7f21da3b2740 1 -- 172.21.15.7:0/493766008 shutdown_connections 2024-09-21T06:42:16.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.951+0000 7f21da3b2740 1 --2- 172.21.15.7:0/493766008 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x56411b9a39f0 0x56411bda9e90 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:16.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.951+0000 7f21da3b2740 1 --2- 172.21.15.7:0/493766008 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56411b9e5070 0x56411bda4170 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:16.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.951+0000 7f21b57fa640 0 client.16641 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:42:16.956 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.951+0000 7f21da3b2740 1 --2- 172.21.15.7:0/493766008 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56411b9c4390 0x56411bd982a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:16.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.951+0000 7f21da3b2740 1 --2- 172.21.15.7:0/493766008 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56411b9bc1b0 0x56411bd97d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:16.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.951+0000 7f21da3b2740 1 -- 172.21.15.7:0/493766008 >> 172.21.15.7:0/493766008 conn(0x56411b9d9460 msgr2=0x56411bd8f880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:16.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.951+0000 7f21da3b2740 1 -- 172.21.15.7:0/493766008 shutdown_connections 2024-09-21T06:42:16.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.951+0000 7f21da3b2740 1 -- 172.21.15.7:0/493766008 wait complete. 2024-09-21T06:42:16.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.951+0000 7f21da3b2740 20 client.16641 trim_cache size 0 max 16384 2024-09-21T06:42:16.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.965+0000 7f21da3b2740 1 Processor -- start 2024-09-21T06:42:16.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.965+0000 7f21da3b2740 1 -- start start 2024-09-21T06:42:16.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.965+0000 7f21da3b2740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56411b9a39f0 0x56411bd8e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:16.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.965+0000 7f21da3b2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56411b9bc1b0 0x56411bd99990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:16.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.965+0000 7f21da3b2740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56411b9c4390 0x56411bd89bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:16.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.965+0000 7f21da3b2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f21cc1b1cd0 con 0x56411b9bc1b0 2024-09-21T06:42:16.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.965+0000 7f21da3b2740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f21cc1af5a0 con 0x56411b9c4390 2024-09-21T06:42:16.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.965+0000 7f21da3b2740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f21cc1ad3f0 con 0x56411b9a39f0 2024-09-21T06:42:16.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.965+0000 7f21d1bda640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56411b9bc1b0 0x56411bd99990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:16.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.965+0000 7f21d1bda640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56411b9bc1b0 0x56411bd99990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36076/0 (socket says 172.21.15.7:36076) 2024-09-21T06:42:16.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.965+0000 7f21d1bda640 1 -- 172.21.15.7:0/180863140 learned_addr learned my addr 172.21.15.7:0/180863140 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:42:16.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.965+0000 7f21d13d9640 1 --2- 172.21.15.7:0/180863140 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56411b9c4390 0x56411bd89bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:16.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.965+0000 7f21d13d9640 1 --2- 172.21.15.7:0/180863140 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56411b9a39f0 0x56411bd8e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:16.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.965+0000 7f21d1bda640 1 -- 172.21.15.7:0/180863140 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56411b9a39f0 msgr2=0x56411bd8e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:16.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.965+0000 7f21d1bda640 1 --2- 172.21.15.7:0/180863140 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56411b9a39f0 0x56411bd8e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:16.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.965+0000 7f21d1bda640 1 -- 172.21.15.7:0/180863140 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56411b9c4390 msgr2=0x56411bd89bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:16.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.965+0000 7f21d1bda640 1 --2- 172.21.15.7:0/180863140 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56411b9c4390 0x56411bd89bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:16.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.965+0000 7f21d1bda640 1 -- 172.21.15.7:0/180863140 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56411bd99020 con 0x56411b9bc1b0 2024-09-21T06:42:16.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.966+0000 7f21d1bda640 1 --2- 172.21.15.7:0/180863140 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56411b9bc1b0 0x56411bd99990 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f21c8012770 tx=0x7f21c8012c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bf74a7bc09a7130 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:16.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.966+0000 7f21b77fe640 1 -- 172.21.15.7:0/180863140 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c8012d60 con 0x56411b9bc1b0 2024-09-21T06:42:16.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.966+0000 7f21b77fe640 1 -- 172.21.15.7:0/180863140 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f21c8011d90 con 0x56411b9bc1b0 2024-09-21T06:42:16.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.966+0000 7f21b77fe640 1 -- 172.21.15.7:0/180863140 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21c801ed80 con 0x56411b9bc1b0 2024-09-21T06:42:16.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.967+0000 7f21da3b2740 1 -- 172.21.15.7:0/180863140 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56411b9bc1b0 msgr2=0x56411bd99990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:16.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.967+0000 7f21da3b2740 1 --2- 172.21.15.7:0/180863140 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56411b9bc1b0 0x56411bd99990 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f21c8012770 tx=0x7f21c8012c30 comp rx=0 tx=0).stop 2024-09-21T06:42:16.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.967+0000 7f21da3b2740 1 -- 172.21.15.7:0/180863140 shutdown_connections 2024-09-21T06:42:16.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.967+0000 7f21da3b2740 1 --2- 172.21.15.7:0/180863140 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56411b9c4390 0x56411bd89bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:16.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.967+0000 7f21da3b2740 1 --2- 172.21.15.7:0/180863140 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56411b9bc1b0 0x56411bd99990 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:16.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.967+0000 7f21da3b2740 1 --2- 172.21.15.7:0/180863140 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56411b9a39f0 0x56411bd8e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:16.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.967+0000 7f21da3b2740 1 -- 172.21.15.7:0/180863140 >> 172.21.15.7:0/180863140 conn(0x56411b9d9460 msgr2=0x56411bd99280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:16.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.967+0000 7f21da3b2740 1 -- 172.21.15.7:0/180863140 shutdown_connections 2024-09-21T06:42:16.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.967+0000 7f21da3b2740 1 -- 172.21.15.7:0/180863140 wait complete. 2024-09-21T06:42:16.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.967+0000 7f21da3b2740 1 -- start start 2024-09-21T06:42:16.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.968+0000 7f21da3b2740 1 Processor -- start 2024-09-21T06:42:16.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.968+0000 7f21da3b2740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56411b9a39f0 0x56411be0f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:16.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.968+0000 7f21da3b2740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56411b9bc1b0 0x56411be0fb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:16.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.968+0000 7f21da3b2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56411b9c4390 0x56411be10070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:16.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.968+0000 7f21da3b2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f21cc1ada60 con 0x56411b9c4390 2024-09-21T06:42:16.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.968+0000 7f21da3b2740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f21cc1aeed0 con 0x56411b9a39f0 2024-09-21T06:42:16.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.968+0000 7f21da3b2740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f21cc1ae130 con 0x56411b9bc1b0 2024-09-21T06:42:16.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.968+0000 7f21da3b2740 10 client.0 _ll_register_callbacks cb 0x7f21c8009aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:42:16.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.968+0000 7f21d13d9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56411b9c4390 0x56411be10070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:16.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.968+0000 7f21d13d9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56411b9c4390 0x56411be10070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36080/0 (socket says 172.21.15.7:36080) 2024-09-21T06:42:16.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.968+0000 7f21d13d9640 1 -- 172.21.15.7:0/847995756 learned_addr learned my addr 172.21.15.7:0/847995756 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:42:16.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.968+0000 7f21d13d9640 1 --2- 172.21.15.7:0/847995756 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56411b9a39f0 0x56411be0f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:16.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.968+0000 7f21d1bda640 1 --2- 172.21.15.7:0/847995756 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56411b9bc1b0 0x56411be0fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:16.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.969+0000 7f21d13d9640 1 -- 172.21.15.7:0/847995756 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56411b9bc1b0 msgr2=0x56411be0fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:16.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.969+0000 7f21d13d9640 1 --2- 172.21.15.7:0/847995756 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56411b9bc1b0 0x56411be0fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:16.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.969+0000 7f21d13d9640 1 -- 172.21.15.7:0/847995756 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56411b9a39f0 msgr2=0x56411be0f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:16.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.969+0000 7f21d13d9640 1 --2- 172.21.15.7:0/847995756 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56411b9a39f0 0x56411be0f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:16.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.969+0000 7f21d13d9640 1 -- 172.21.15.7:0/847995756 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56411bdab190 con 0x56411b9c4390 2024-09-21T06:42:16.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.969+0000 7f21d13d9640 1 --2- 172.21.15.7:0/847995756 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56411b9c4390 0x56411be10070 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f21bc006010 tx=0x7f21bc0052d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a421ef14cf49e06 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:16.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.969+0000 7f21b57fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:42:16.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.969+0000 7f21b57fa640 1 -- 172.21.15.7:0/847995756 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21bc035070 con 0x56411b9c4390 2024-09-21T06:42:16.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.969+0000 7f21b57fa640 1 -- 172.21.15.7:0/847995756 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f21bc0035f0 con 0x56411b9c4390 2024-09-21T06:42:16.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.969+0000 7f21da3b2740 1 -- 172.21.15.7:0/847995756 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f21c8011d90 con 0x56411b9c4390 2024-09-21T06:42:16.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.969+0000 7f21b57fa640 1 -- 172.21.15.7:0/847995756 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f21bc0037f0 con 0x56411b9c4390 2024-09-21T06:42:16.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.969+0000 7f21da3b2740 10 client.16647 fetch_fsmap learned FSMap version 25 2024-09-21T06:42:16.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.969+0000 7f21da3b2740 1 -- 172.21.15.7:0/847995756 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56411be18de0 con 0x56411b9c4390 2024-09-21T06:42:16.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.969+0000 7f21b57fa640 1 -- 172.21.15.7:0/847995756 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f21c8011d90 con 0x56411b9c4390 2024-09-21T06:42:16.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.970+0000 7f21b57fa640 1 -- 172.21.15.7:0/847995756 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f21bc004780 con 0x56411b9c4390 2024-09-21T06:42:16.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.970+0000 7f21da3b2740 10 client.16647 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:42:16.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.970+0000 7f21da3b2740 10 client.16647 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:42:16.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.970+0000 7f21da3b2740 20 client.16647 populate_metadata read hostname 'smithi007' 2024-09-21T06:42:16.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.970+0000 7f21da3b2740 1 --2- 172.21.15.7:0/847995756 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x56411b9e5070 0x56411be1b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:16.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.970+0000 7f21da3b2740 4 client.16647 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:42:16.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.970+0000 7f21da3b2740 1 -- 172.21.15.7:0/847995756 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56411bd008a0 con 0x56411b9e5070 2024-09-21T06:42:16.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.970+0000 7f21d1bda640 1 --2- 172.21.15.7:0/847995756 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x56411b9e5070 0x56411be1b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:16.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.970+0000 7f21b57fa640 10 client.16647 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:42:16.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.970+0000 7f21d1bda640 1 --2- 172.21.15.7:0/847995756 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x56411b9e5070 0x56411be1b450 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc5131ff7c1100b6 server_cookie=76921dff0b9b401 in_seq=0 out_seq=0 2024-09-21T06:42:16.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.971+0000 7f21b57fa640 1 -- 172.21.15.7:0/847995756 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56411bd008a0 con 0x56411b9e5070 2024-09-21T06:42:16.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.971+0000 7f21b57fa640 10 client.16647 handle_command_reply: tid=0 2024-09-21T06:42:16.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.971+0000 7f21da3b2740 1 client.16647 shutdown 2024-09-21T06:42:16.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.971+0000 7f21da3b2740 1 -- 172.21.15.7:0/847995756 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56411b9c4390 msgr2=0x56411be10070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:16.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.971+0000 7f21da3b2740 1 --2- 172.21.15.7:0/847995756 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56411b9c4390 0x56411be10070 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f21bc006010 tx=0x7f21bc0052d0 comp rx=0 tx=0).stop 2024-09-21T06:42:16.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.971+0000 7f21da3b2740 1 -- 172.21.15.7:0/847995756 shutdown_connections 2024-09-21T06:42:16.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.971+0000 7f21da3b2740 1 --2- 172.21.15.7:0/847995756 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x56411b9e5070 0x56411be1b450 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:16.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.971+0000 7f21da3b2740 1 --2- 172.21.15.7:0/847995756 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56411b9c4390 0x56411be10070 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:16.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.971+0000 7f21da3b2740 1 --2- 172.21.15.7:0/847995756 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56411b9bc1b0 0x56411be0fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:16.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.971+0000 7f21da3b2740 1 --2- 172.21.15.7:0/847995756 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56411b9a39f0 0x56411be0f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:16.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.971+0000 7f21b57fa640 0 client.16647 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:42:16.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.971+0000 7f21da3b2740 1 -- 172.21.15.7:0/847995756 >> 172.21.15.7:0/847995756 conn(0x56411b9d9460 msgr2=0x56411bd8de60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:16.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.971+0000 7f21da3b2740 1 -- 172.21.15.7:0/847995756 shutdown_connections 2024-09-21T06:42:16.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.971+0000 7f21da3b2740 1 -- 172.21.15.7:0/847995756 wait complete. 2024-09-21T06:42:16.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.971+0000 7f21da3b2740 20 client.16647 trim_cache size 0 max 16384 2024-09-21T06:42:16.977 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:42:16.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.972+0000 7f21d3e3e640 1 -- 172.21.15.7:0/2324317750 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f21b80b66b0 msgr2=0x7f21b80b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:16.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.972+0000 7f21d3e3e640 1 --2- 172.21.15.7:0/2324317750 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f21b80b66b0 0x7f21b80b8bc0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f21c40aa130 tx=0x7f21c400df60 comp rx=0 tx=0).stop 2024-09-21T06:42:16.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.972+0000 7f21d3e3e640 1 -- 172.21.15.7:0/2324317750 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21cc108cf0 msgr2=0x7f21cc19be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:16.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.972+0000 7f21d3e3e640 1 --2- 172.21.15.7:0/2324317750 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21cc108cf0 0x7f21cc19be10 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f21c400d750 tx=0x7f21c400dc10 comp rx=0 tx=0).stop 2024-09-21T06:42:16.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.972+0000 7f21d3e3e640 1 -- 172.21.15.7:0/2324317750 shutdown_connections 2024-09-21T06:42:16.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.972+0000 7f21d3e3e640 1 --2- 172.21.15.7:0/2324317750 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f21b80b66b0 0x7f21b80b8bc0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:16.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.972+0000 7f21d3e3e640 1 --2- 172.21.15.7:0/2324317750 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f21cc108cf0 0x7f21cc19be10 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:16.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.972+0000 7f21d3e3e640 1 --2- 172.21.15.7:0/2324317750 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f21cc1083a0 0x7f21cc19b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:16.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.972+0000 7f21d3e3e640 1 --2- 172.21.15.7:0/2324317750 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21cc102a60 0x7f21cc19b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:16.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.972+0000 7f21d3e3e640 1 -- 172.21.15.7:0/2324317750 >> 172.21.15.7:0/2324317750 conn(0x7f21cc079730 msgr2=0x7f21cc104510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:16.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.972+0000 7f21d3e3e640 1 -- 172.21.15.7:0/2324317750 shutdown_connections 2024-09-21T06:42:16.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:16.972+0000 7f21d3e3e640 1 -- 172.21.15.7:0/2324317750 wait complete. 2024-09-21T06:42:17.273 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:42:16 smithi007 ceph-mon[30983]: pgmap v501: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T06:42:17.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:42:16 smithi144 ceph-mon[34653]: pgmap v501: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T06:42:17.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:42:16 smithi018 ceph-mon[34477]: pgmap v501: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T06:42:18.670 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:42:18.670 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:42:18.945 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:42:19.066 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:42:18 smithi007 ceph-mon[30983]: pgmap v502: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-21T06:42:19.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:42:18 smithi144 ceph-mon[34653]: pgmap v502: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-21T06:42:19.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:42:18 smithi018 ceph-mon[34477]: pgmap v502: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-21T06:42:19.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.432+0000 7f4c50f8e640 1 -- 172.21.15.7:0/1578752960 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c4c102a60 msgr2=0x7f4c4c102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:19.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.432+0000 7f4c50f8e640 1 --2- 172.21.15.7:0/1578752960 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c4c102a60 0x7f4c4c102e70 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c009900 tx=0x7f4c3c02a410 comp rx=0 tx=0).stop 2024-09-21T06:42:19.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.432+0000 7f4c50f8e640 1 -- 172.21.15.7:0/1578752960 shutdown_connections 2024-09-21T06:42:19.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.432+0000 7f4c50f8e640 1 --2- 172.21.15.7:0/1578752960 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4c4c108cf0 0x7f4c4c10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:19.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.432+0000 7f4c50f8e640 1 --2- 172.21.15.7:0/1578752960 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c4c1083a0 0x7f4c4c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:19.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.432+0000 7f4c50f8e640 1 --2- 172.21.15.7:0/1578752960 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c4c102a60 0x7f4c4c102e70 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:19.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.432+0000 7f4c50f8e640 1 -- 172.21.15.7:0/1578752960 >> 172.21.15.7:0/1578752960 conn(0x7f4c4c079730 msgr2=0x7f4c4c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:19.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.432+0000 7f4c50f8e640 1 -- 172.21.15.7:0/1578752960 shutdown_connections 2024-09-21T06:42:19.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.432+0000 7f4c50f8e640 1 -- 172.21.15.7:0/1578752960 wait complete. 2024-09-21T06:42:19.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.433+0000 7f4c50f8e640 1 Processor -- start 2024-09-21T06:42:19.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.433+0000 7f4c50f8e640 1 -- start start 2024-09-21T06:42:19.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.434+0000 7f4c50f8e640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c4c102a60 0x7f4c4c199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:19.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.434+0000 7f4c50f8e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c4c1083a0 0x7f4c4c199910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:19.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.434+0000 7f4c50f8e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4c4c108cf0 0x7f4c4c19ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:19.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.434+0000 7f4c50f8e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4c4c112960 con 0x7f4c4c1083a0 2024-09-21T06:42:19.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.434+0000 7f4c50f8e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4c4c1127e0 con 0x7f4c4c108cf0 2024-09-21T06:42:19.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.434+0000 7f4c50f8e640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4c4c112ae0 con 0x7f4c4c102a60 2024-09-21T06:42:19.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.434+0000 7f4c41d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c4c1083a0 0x7f4c4c199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:19.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.434+0000 7f4c41d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c4c1083a0 0x7f4c4c199910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36090/0 (socket says 172.21.15.7:36090) 2024-09-21T06:42:19.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.434+0000 7f4c41d9b640 1 -- 172.21.15.7:0/3164382597 learned_addr learned my addr 172.21.15.7:0/3164382597 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:42:19.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.434+0000 7f4c4a59c640 1 --2- 172.21.15.7:0/3164382597 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c4c102a60 0x7f4c4c199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:19.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.434+0000 7f4c4ad9d640 1 --2- 172.21.15.7:0/3164382597 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4c4c108cf0 0x7f4c4c19ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:19.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.434+0000 7f4c41d9b640 1 -- 172.21.15.7:0/3164382597 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c4c102a60 msgr2=0x7f4c4c199370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:19.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.434+0000 7f4c41d9b640 1 --2- 172.21.15.7:0/3164382597 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c4c102a60 0x7f4c4c199370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:19.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.434+0000 7f4c41d9b640 1 -- 172.21.15.7:0/3164382597 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4c4c108cf0 msgr2=0x7f4c4c19ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:19.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.434+0000 7f4c41d9b640 1 --2- 172.21.15.7:0/3164382597 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4c4c108cf0 0x7f4c4c19ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:19.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.434+0000 7f4c41d9b640 1 -- 172.21.15.7:0/3164382597 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c4c19f2e0 con 0x7f4c4c1083a0 2024-09-21T06:42:19.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.434+0000 7f4c4ad9d640 1 --2- 172.21.15.7:0/3164382597 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4c4c108cf0 0x7f4c4c19ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:42:19.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.434+0000 7f4c41d9b640 1 --2- 172.21.15.7:0/3164382597 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c4c1083a0 0x7f4c4c199910 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f4c3400d770 tx=0x7f4c3400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:19.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.435+0000 7f4c43fff640 1 -- 172.21.15.7:0/3164382597 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c34017070 con 0x7f4c4c1083a0 2024-09-21T06:42:19.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.435+0000 7f4c50f8e640 1 -- 172.21.15.7:0/3164382597 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c4c19f5d0 con 0x7f4c4c1083a0 2024-09-21T06:42:19.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.435+0000 7f4c43fff640 1 -- 172.21.15.7:0/3164382597 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c34009c30 con 0x7f4c4c1083a0 2024-09-21T06:42:19.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.435+0000 7f4c43fff640 1 -- 172.21.15.7:0/3164382597 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c3400f620 con 0x7f4c4c1083a0 2024-09-21T06:42:19.441 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.435+0000 7f4c50f8e640 1 -- 172.21.15.7:0/3164382597 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c4c1a5d30 con 0x7f4c4c1083a0 2024-09-21T06:42:19.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.437+0000 7f4c57502740 1 Processor -- start 2024-09-21T06:42:19.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.438+0000 7f4c57502740 1 -- start start 2024-09-21T06:42:19.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.438+0000 7f4c57502740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559513e31350 0x5595141d8430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:19.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.438+0000 7f4c57502740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559513e08490 0x5595141d8970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:19.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.438+0000 7f4c57502740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559513e10670 0x5595141d8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:19.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.438+0000 7f4c57502740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55951414ee60 con 0x559513e31350 2024-09-21T06:42:19.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.438+0000 7f4c57502740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55951413e290 con 0x559513e08490 2024-09-21T06:42:19.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.438+0000 7f4c57502740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5595141420a0 con 0x559513e10670 2024-09-21T06:42:19.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.438+0000 7f4c4ad9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559513e31350 0x5595141d8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:19.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.438+0000 7f4c43fff640 1 -- 172.21.15.7:0/3164382597 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f4c3401a070 con 0x7f4c4c1083a0 2024-09-21T06:42:19.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.438+0000 7f4c4ad9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559513e31350 0x5595141d8430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36096/0 (socket says 172.21.15.7:36096) 2024-09-21T06:42:19.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.438+0000 7f4c4ad9d640 1 -- 172.21.15.7:0/1289937057 learned_addr learned my addr 172.21.15.7:0/1289937057 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:42:19.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.438+0000 7f4c4a59c640 1 --2- 172.21.15.7:0/1289937057 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559513e08490 0x5595141d8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:19.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.439+0000 7f4c41d9b640 1 --2- 172.21.15.7:0/1289937057 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559513e10670 0x5595141d8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:19.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.439+0000 7f4c4ad9d640 1 -- 172.21.15.7:0/1289937057 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559513e10670 msgr2=0x5595141d8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:19.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.439+0000 7f4c4ad9d640 1 --2- 172.21.15.7:0/1289937057 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559513e10670 0x5595141d8eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:19.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.439+0000 7f4c4ad9d640 1 -- 172.21.15.7:0/1289937057 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559513e08490 msgr2=0x5595141d8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:19.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.439+0000 7f4c4ad9d640 1 --2- 172.21.15.7:0/1289937057 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559513e08490 0x5595141d8970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:19.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.439+0000 7f4c4ad9d640 1 -- 172.21.15.7:0/1289937057 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559513e9c930 con 0x559513e31350 2024-09-21T06:42:19.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.439+0000 7f4c41d9b640 1 --2- 172.21.15.7:0/1289937057 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559513e10670 0x5595141d8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:42:19.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.439+0000 7f4c4ad9d640 1 --2- 172.21.15.7:0/1289937057 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559513e31350 0x5595141d8430 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f4c4400f410 tx=0x7f4c4400f8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb3425834c47efba server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:19.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.439+0000 7f4c40d99640 1 -- 172.21.15.7:0/1289937057 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c44015070 con 0x559513e31350 2024-09-21T06:42:19.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.439+0000 7f4c40d99640 1 -- 172.21.15.7:0/1289937057 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c44011bb0 con 0x559513e31350 2024-09-21T06:42:19.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.439+0000 7f4c40d99640 1 -- 172.21.15.7:0/1289937057 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c44010c00 con 0x559513e31350 2024-09-21T06:42:19.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.439+0000 7f4c43fff640 1 --2- 172.21.15.7:0/3164382597 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f4c380b6680 0x7f4c380b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:19.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.439+0000 7f4c4a59c640 1 --2- 172.21.15.7:0/3164382597 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f4c380b6680 0x7f4c380b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:19.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.439+0000 7f4c43fff640 1 -- 172.21.15.7:0/3164382597 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f4c340e71d0 con 0x7f4c4c1083a0 2024-09-21T06:42:19.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.440+0000 7f4c57502740 1 -- 172.21.15.7:0/1289937057 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559513e31350 msgr2=0x5595141d8430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:19.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.440+0000 7f4c57502740 1 --2- 172.21.15.7:0/1289937057 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559513e31350 0x5595141d8430 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f4c4400f410 tx=0x7f4c4400f8d0 comp rx=0 tx=0).stop 2024-09-21T06:42:19.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.440+0000 7f4c4a59c640 1 --2- 172.21.15.7:0/3164382597 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f4c380b6680 0x7f4c380b8b90 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c031440 tx=0x7f4c3c009610 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:19.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.440+0000 7f4c57502740 1 -- 172.21.15.7:0/1289937057 shutdown_connections 2024-09-21T06:42:19.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.440+0000 7f4c57502740 1 --2- 172.21.15.7:0/1289937057 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559513e10670 0x5595141d8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:19.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.440+0000 7f4c57502740 1 --2- 172.21.15.7:0/1289937057 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559513e08490 0x5595141d8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:19.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.440+0000 7f4c57502740 1 --2- 172.21.15.7:0/1289937057 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559513e31350 0x5595141d8430 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:19.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.440+0000 7f4c57502740 1 -- 172.21.15.7:0/1289937057 >> 172.21.15.7:0/1289937057 conn(0x559513e25740 msgr2=0x5595141d6320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:19.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.440+0000 7f4c57502740 1 -- 172.21.15.7:0/1289937057 shutdown_connections 2024-09-21T06:42:19.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.440+0000 7f4c57502740 1 -- 172.21.15.7:0/1289937057 wait complete. 2024-09-21T06:42:19.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.441+0000 7f4c57502740 1 -- start start 2024-09-21T06:42:19.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.441+0000 7f4c57502740 1 Processor -- start 2024-09-21T06:42:19.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.441+0000 7f4c57502740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559513e08490 0x5595141e61a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:19.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.441+0000 7f4c57502740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559513e10670 0x5595141e66e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:19.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.441+0000 7f4c57502740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559513e31350 0x5595141f20d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:19.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.441+0000 7f4c57502740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x559513f9f890 con 0x559513e08490 2024-09-21T06:42:19.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.441+0000 7f4c57502740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5595140d8d40 con 0x559513e10670 2024-09-21T06:42:19.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.441+0000 7f4c57502740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5595141e8d70 con 0x559513e31350 2024-09-21T06:42:19.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.441+0000 7f4c4a59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559513e08490 0x5595141e61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:19.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.441+0000 7f4c4a59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559513e08490 0x5595141e61a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36102/0 (socket says 172.21.15.7:36102) 2024-09-21T06:42:19.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.441+0000 7f4c4a59c640 1 -- 172.21.15.7:0/1739875407 learned_addr learned my addr 172.21.15.7:0/1739875407 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:42:19.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.441+0000 7f4c57502740 10 client.0 _ll_register_callbacks cb 0x55951413cc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:42:19.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.441+0000 7f4c41d9b640 1 --2- 172.21.15.7:0/1739875407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559513e10670 0x5595141e66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:19.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.441+0000 7f4c4ad9d640 1 --2- 172.21.15.7:0/1739875407 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559513e31350 0x5595141f20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:19.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.442+0000 7f4c4a59c640 1 -- 172.21.15.7:0/1739875407 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559513e31350 msgr2=0x5595141f20d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:19.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.442+0000 7f4c4a59c640 1 --2- 172.21.15.7:0/1739875407 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559513e31350 0x5595141f20d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:19.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.442+0000 7f4c4a59c640 1 -- 172.21.15.7:0/1739875407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559513e10670 msgr2=0x5595141e66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:19.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.442+0000 7f4c4a59c640 1 --2- 172.21.15.7:0/1739875407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559513e10670 0x5595141e66e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:19.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.442+0000 7f4c4a59c640 1 -- 172.21.15.7:0/1739875407 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595141f2610 con 0x559513e08490 2024-09-21T06:42:19.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.442+0000 7f4c4ad9d640 1 --2- 172.21.15.7:0/1739875407 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559513e31350 0x5595141f20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:42:19.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.442+0000 7f4c4a59c640 1 --2- 172.21.15.7:0/1739875407 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559513e08490 0x5595141e61a0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c009900 tx=0x7f4c3c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=914e224b7c24ecea server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:19.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.442+0000 7f4c31ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:42:19.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.442+0000 7f4c31ffb640 1 -- 172.21.15.7:0/1739875407 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c3c04d070 con 0x559513e08490 2024-09-21T06:42:19.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.442+0000 7f4c31ffb640 1 -- 172.21.15.7:0/1739875407 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f4c3c005030 con 0x559513e08490 2024-09-21T06:42:19.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.442+0000 7f4c57502740 1 -- 172.21.15.7:0/1739875407 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c44011bb0 con 0x559513e08490 2024-09-21T06:42:19.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.442+0000 7f4c31ffb640 1 -- 172.21.15.7:0/1739875407 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4c3c059050 con 0x559513e08490 2024-09-21T06:42:19.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.442+0000 7f4c57502740 10 client.16659 fetch_fsmap learned FSMap version 25 2024-09-21T06:42:19.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.442+0000 7f4c57502740 1 -- 172.21.15.7:0/1739875407 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5595141f4e90 con 0x559513e08490 2024-09-21T06:42:19.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.443+0000 7f4c31ffb640 1 -- 172.21.15.7:0/1739875407 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c44011bb0 con 0x559513e08490 2024-09-21T06:42:19.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.443+0000 7f4c31ffb640 1 -- 172.21.15.7:0/1739875407 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f4c3c0035f0 con 0x559513e08490 2024-09-21T06:42:19.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.443+0000 7f4c57502740 10 client.16659 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:42:19.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.443+0000 7f4c57502740 10 client.16659 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:42:19.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.443+0000 7f4c57502740 20 client.16659 populate_metadata read hostname 'smithi007' 2024-09-21T06:42:19.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.443+0000 7f4c57502740 1 --2- 172.21.15.7:0/1739875407 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x559513defcd0 0x5595141f83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:19.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.443+0000 7f4c57502740 4 client.16659 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:42:19.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.443+0000 7f4c57502740 1 -- 172.21.15.7:0/1739875407 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559514150db0 con 0x559513defcd0 2024-09-21T06:42:19.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.443+0000 7f4c41d9b640 1 --2- 172.21.15.7:0/1739875407 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x559513defcd0 0x5595141f83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:19.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.444+0000 7f4c41d9b640 1 --2- 172.21.15.7:0/1739875407 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x559513defcd0 0x5595141f83b0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f62018ef120d50af server_cookie=97f589009217430f in_seq=0 out_seq=0 2024-09-21T06:42:19.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.444+0000 7f4c31ffb640 10 client.16659 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:42:19.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.444+0000 7f4c31ffb640 1 -- 172.21.15.7:0/1739875407 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559514150db0 con 0x559513defcd0 2024-09-21T06:42:19.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.444+0000 7f4c31ffb640 10 client.16659 handle_command_reply: tid=0 2024-09-21T06:42:19.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.444+0000 7f4c57502740 1 client.16659 shutdown 2024-09-21T06:42:19.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.444+0000 7f4c57502740 1 -- 172.21.15.7:0/1739875407 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559513e08490 msgr2=0x5595141e61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:19.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.444+0000 7f4c57502740 1 --2- 172.21.15.7:0/1739875407 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559513e08490 0x5595141e61a0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c009900 tx=0x7f4c3c009260 comp rx=0 tx=0).stop 2024-09-21T06:42:19.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.445+0000 7f4c57502740 1 -- 172.21.15.7:0/1739875407 shutdown_connections 2024-09-21T06:42:19.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.445+0000 7f4c57502740 1 --2- 172.21.15.7:0/1739875407 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x559513defcd0 0x5595141f83b0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:19.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.445+0000 7f4c57502740 1 --2- 172.21.15.7:0/1739875407 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559513e31350 0x5595141f20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:19.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.445+0000 7f4c57502740 1 --2- 172.21.15.7:0/1739875407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559513e10670 0x5595141e66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:19.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.445+0000 7f4c31ffb640 0 client.16659 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:42:19.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.445+0000 7f4c57502740 1 --2- 172.21.15.7:0/1739875407 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559513e08490 0x5595141e61a0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:19.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.445+0000 7f4c57502740 1 -- 172.21.15.7:0/1739875407 >> 172.21.15.7:0/1739875407 conn(0x559513e25740 msgr2=0x5595141d9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:19.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.445+0000 7f4c57502740 1 -- 172.21.15.7:0/1739875407 shutdown_connections 2024-09-21T06:42:19.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.445+0000 7f4c57502740 1 -- 172.21.15.7:0/1739875407 wait complete. 2024-09-21T06:42:19.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.445+0000 7f4c57502740 20 client.16659 trim_cache size 0 max 16384 2024-09-21T06:42:19.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.462+0000 7f4c57502740 1 Processor -- start 2024-09-21T06:42:19.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.462+0000 7f4c57502740 1 -- start start 2024-09-21T06:42:19.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.462+0000 7f4c57502740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559513e08490 0x5595141e5830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:19.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.462+0000 7f4c57502740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559513e10670 0x5595141e7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:19.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.462+0000 7f4c57502740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559513e31350 0x5595141e3190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:19.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.463+0000 7f4c57502740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4c4c1afbd0 con 0x559513e10670 2024-09-21T06:42:19.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.463+0000 7f4c57502740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4c4c1ad4a0 con 0x559513e31350 2024-09-21T06:42:19.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.463+0000 7f4c57502740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4c4c1ab2f0 con 0x559513e08490 2024-09-21T06:42:19.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.463+0000 7f4c41d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559513e10670 0x5595141e7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:19.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.463+0000 7f4c41d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559513e10670 0x5595141e7bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36114/0 (socket says 172.21.15.7:36114) 2024-09-21T06:42:19.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.463+0000 7f4c41d9b640 1 -- 172.21.15.7:0/421362749 learned_addr learned my addr 172.21.15.7:0/421362749 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:42:19.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.463+0000 7f4c4a59c640 1 --2- 172.21.15.7:0/421362749 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559513e08490 0x5595141e5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:19.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.463+0000 7f4c4ad9d640 1 --2- 172.21.15.7:0/421362749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559513e31350 0x5595141e3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:19.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.463+0000 7f4c41d9b640 1 -- 172.21.15.7:0/421362749 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559513e08490 msgr2=0x5595141e5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:19.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.463+0000 7f4c41d9b640 1 --2- 172.21.15.7:0/421362749 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559513e08490 0x5595141e5830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:19.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.463+0000 7f4c41d9b640 1 -- 172.21.15.7:0/421362749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559513e31350 msgr2=0x5595141e3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:19.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.463+0000 7f4c41d9b640 1 --2- 172.21.15.7:0/421362749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559513e31350 0x5595141e3190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:19.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.463+0000 7f4c41d9b640 1 -- 172.21.15.7:0/421362749 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595141e44a0 con 0x559513e10670 2024-09-21T06:42:19.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.463+0000 7f4c4ad9d640 1 --2- 172.21.15.7:0/421362749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559513e31350 0x5595141e3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:42:19.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.463+0000 7f4c41d9b640 1 --2- 172.21.15.7:0/421362749 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559513e10670 0x5595141e7bd0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f4c340a9690 tx=0x7f4c340e9660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=123a8c23baa342c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:19.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.463+0000 7f4c33fff640 1 -- 172.21.15.7:0/421362749 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c34098070 con 0x559513e10670 2024-09-21T06:42:19.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.463+0000 7f4c33fff640 1 -- 172.21.15.7:0/421362749 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c340e7020 con 0x559513e10670 2024-09-21T06:42:19.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.463+0000 7f4c33fff640 1 -- 172.21.15.7:0/421362749 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c34021040 con 0x559513e10670 2024-09-21T06:42:19.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.464+0000 7f4c57502740 1 -- 172.21.15.7:0/421362749 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559513e10670 msgr2=0x5595141e7bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:19.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.464+0000 7f4c57502740 1 --2- 172.21.15.7:0/421362749 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559513e10670 0x5595141e7bd0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f4c340a9690 tx=0x7f4c340e9660 comp rx=0 tx=0).stop 2024-09-21T06:42:19.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.464+0000 7f4c57502740 1 -- 172.21.15.7:0/421362749 shutdown_connections 2024-09-21T06:42:19.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.464+0000 7f4c57502740 1 --2- 172.21.15.7:0/421362749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559513e31350 0x5595141e3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:19.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.464+0000 7f4c57502740 1 --2- 172.21.15.7:0/421362749 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559513e10670 0x5595141e7bd0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:19.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.464+0000 7f4c57502740 1 --2- 172.21.15.7:0/421362749 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559513e08490 0x5595141e5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:19.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.464+0000 7f4c57502740 1 -- 172.21.15.7:0/421362749 >> 172.21.15.7:0/421362749 conn(0x559513e25740 msgr2=0x5595141e74c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:19.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.464+0000 7f4c57502740 1 -- 172.21.15.7:0/421362749 shutdown_connections 2024-09-21T06:42:19.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.464+0000 7f4c57502740 1 -- 172.21.15.7:0/421362749 wait complete. 2024-09-21T06:42:19.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.465+0000 7f4c57502740 1 -- start start 2024-09-21T06:42:19.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.465+0000 7f4c57502740 1 Processor -- start 2024-09-21T06:42:19.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.465+0000 7f4c57502740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559513e08490 0x5595141ee560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:19.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.465+0000 7f4c57502740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559513e10670 0x5595141eaa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:19.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.465+0000 7f4c57502740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559513e31350 0x5595141eaf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:19.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.465+0000 7f4c57502740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f4c4c1ab960 con 0x559513e31350 2024-09-21T06:42:19.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.465+0000 7f4c57502740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4c4c1acdd0 con 0x559513e08490 2024-09-21T06:42:19.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.465+0000 7f4c57502740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f4c4c1ac030 con 0x559513e10670 2024-09-21T06:42:19.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.465+0000 7f4c57502740 10 client.0 _ll_register_callbacks cb 0x7f4c3c005db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:42:19.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.465+0000 7f4c4ad9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559513e31350 0x5595141eaf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:19.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.465+0000 7f4c4ad9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559513e31350 0x5595141eaf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36124/0 (socket says 172.21.15.7:36124) 2024-09-21T06:42:19.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.465+0000 7f4c4ad9d640 1 -- 172.21.15.7:0/4072188911 learned_addr learned my addr 172.21.15.7:0/4072188911 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:42:19.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.465+0000 7f4c4a59c640 1 --2- 172.21.15.7:0/4072188911 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559513e08490 0x5595141ee560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:19.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.465+0000 7f4c41d9b640 1 --2- 172.21.15.7:0/4072188911 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559513e10670 0x5595141eaa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:19.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.466+0000 7f4c4ad9d640 1 -- 172.21.15.7:0/4072188911 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559513e10670 msgr2=0x5595141eaa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:19.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.466+0000 7f4c4ad9d640 1 --2- 172.21.15.7:0/4072188911 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559513e10670 0x5595141eaa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:19.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.466+0000 7f4c4ad9d640 1 -- 172.21.15.7:0/4072188911 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559513e08490 msgr2=0x5595141ee560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:19.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.466+0000 7f4c4ad9d640 1 --2- 172.21.15.7:0/4072188911 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559513e08490 0x5595141ee560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:19.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.466+0000 7f4c4ad9d640 1 -- 172.21.15.7:0/4072188911 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595141eb4a0 con 0x559513e31350 2024-09-21T06:42:19.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.466+0000 7f4c4a59c640 1 --2- 172.21.15.7:0/4072188911 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559513e08490 0x5595141ee560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:42:19.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.466+0000 7f4c4ad9d640 1 --2- 172.21.15.7:0/4072188911 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559513e31350 0x5595141eaf60 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f4c4400f3e0 tx=0x7f4c44004c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eface164bf67e07 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:19.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.466+0000 7f4c31ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:42:19.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.466+0000 7f4c31ffb640 1 -- 172.21.15.7:0/4072188911 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c44015040 con 0x559513e31350 2024-09-21T06:42:19.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.466+0000 7f4c31ffb640 1 -- 172.21.15.7:0/4072188911 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f4c44011500 con 0x559513e31350 2024-09-21T06:42:19.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.466+0000 7f4c57502740 1 -- 172.21.15.7:0/4072188911 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c340e7020 con 0x559513e31350 2024-09-21T06:42:19.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.466+0000 7f4c31ffb640 1 -- 172.21.15.7:0/4072188911 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4c4402b020 con 0x559513e31350 2024-09-21T06:42:19.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.466+0000 7f4c57502740 10 client.16665 fetch_fsmap learned FSMap version 25 2024-09-21T06:42:19.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.466+0000 7f4c57502740 1 -- 172.21.15.7:0/4072188911 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5595142639c0 con 0x559513e31350 2024-09-21T06:42:19.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.467+0000 7f4c31ffb640 1 -- 172.21.15.7:0/4072188911 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c340e7020 con 0x559513e31350 2024-09-21T06:42:19.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.467+0000 7f4c31ffb640 1 -- 172.21.15.7:0/4072188911 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f4c440053e0 con 0x559513e31350 2024-09-21T06:42:19.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.467+0000 7f4c57502740 10 client.16665 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:42:19.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.467+0000 7f4c57502740 10 client.16665 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:42:19.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.467+0000 7f4c57502740 20 client.16665 populate_metadata read hostname 'smithi007' 2024-09-21T06:42:19.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.467+0000 7f4c57502740 1 --2- 172.21.15.7:0/4072188911 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x559513dc5080 0x559514265e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:19.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.467+0000 7f4c57502740 4 client.16665 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:42:19.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.467+0000 7f4c57502740 1 -- 172.21.15.7:0/4072188911 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55951414c860 con 0x559513dc5080 2024-09-21T06:42:19.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.467+0000 7f4c4a59c640 1 --2- 172.21.15.7:0/4072188911 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x559513dc5080 0x559514265e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:19.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.468+0000 7f4c4a59c640 1 --2- 172.21.15.7:0/4072188911 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x559513dc5080 0x559514265e50 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a87662a246b422d1 server_cookie=2bde09644cfd9333 in_seq=0 out_seq=0 2024-09-21T06:42:19.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.468+0000 7f4c31ffb640 10 client.16665 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:42:19.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.469+0000 7f4c31ffb640 1 -- 172.21.15.7:0/4072188911 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55951414c860 con 0x559513dc5080 2024-09-21T06:42:19.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.469+0000 7f4c31ffb640 10 client.16665 handle_command_reply: tid=0 2024-09-21T06:42:19.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.469+0000 7f4c57502740 1 client.16665 shutdown 2024-09-21T06:42:19.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.469+0000 7f4c57502740 1 -- 172.21.15.7:0/4072188911 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559513e31350 msgr2=0x5595141eaf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:19.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.469+0000 7f4c57502740 1 --2- 172.21.15.7:0/4072188911 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559513e31350 0x5595141eaf60 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f4c4400f3e0 tx=0x7f4c44004c10 comp rx=0 tx=0).stop 2024-09-21T06:42:19.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.470+0000 7f4c57502740 1 -- 172.21.15.7:0/4072188911 shutdown_connections 2024-09-21T06:42:19.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.470+0000 7f4c57502740 1 --2- 172.21.15.7:0/4072188911 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x559513dc5080 0x559514265e50 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:19.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.470+0000 7f4c57502740 1 --2- 172.21.15.7:0/4072188911 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559513e31350 0x5595141eaf60 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:19.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.470+0000 7f4c57502740 1 --2- 172.21.15.7:0/4072188911 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559513e10670 0x5595141eaa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:19.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.470+0000 7f4c31ffb640 0 client.16665 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:42:19.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.470+0000 7f4c57502740 1 --2- 172.21.15.7:0/4072188911 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559513e08490 0x5595141ee560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:19.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.470+0000 7f4c57502740 1 -- 172.21.15.7:0/4072188911 >> 172.21.15.7:0/4072188911 conn(0x559513e25740 msgr2=0x5595141d9460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:19.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.470+0000 7f4c57502740 1 -- 172.21.15.7:0/4072188911 shutdown_connections 2024-09-21T06:42:19.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.470+0000 7f4c57502740 1 -- 172.21.15.7:0/4072188911 wait complete. 2024-09-21T06:42:19.475 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.470+0000 7f4c57502740 20 client.16665 trim_cache size 0 max 16384 2024-09-21T06:42:19.476 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:42:19.476 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0, 2024-09-21T06:42:19.476 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_tag": "ef9eaabd-003a-44fb-8373-c854a9e15a71", 2024-09-21T06:42:19.476 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": "asynchronous" 2024-09-21T06:42:19.476 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:42:19.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.471+0000 7f4c50f8e640 1 -- 172.21.15.7:0/3164382597 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f4c380b6680 msgr2=0x7f4c380b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:19.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.471+0000 7f4c50f8e640 1 --2- 172.21.15.7:0/3164382597 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f4c380b6680 0x7f4c380b8b90 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c031440 tx=0x7f4c3c009610 comp rx=0 tx=0).stop 2024-09-21T06:42:19.476 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.471+0000 7f4c50f8e640 1 -- 172.21.15.7:0/3164382597 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c4c1083a0 msgr2=0x7f4c4c199910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:19.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.471+0000 7f4c50f8e640 1 --2- 172.21.15.7:0/3164382597 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c4c1083a0 0x7f4c4c199910 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f4c3400d770 tx=0x7f4c3400dc30 comp rx=0 tx=0).stop 2024-09-21T06:42:19.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.471+0000 7f4c50f8e640 1 -- 172.21.15.7:0/3164382597 shutdown_connections 2024-09-21T06:42:19.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.471+0000 7f4c50f8e640 1 --2- 172.21.15.7:0/3164382597 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f4c380b6680 0x7f4c380b8b90 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:19.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.471+0000 7f4c50f8e640 1 --2- 172.21.15.7:0/3164382597 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4c4c108cf0 0x7f4c4c19ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:19.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.471+0000 7f4c50f8e640 1 --2- 172.21.15.7:0/3164382597 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f4c4c1083a0 0x7f4c4c199910 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:19.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.471+0000 7f4c50f8e640 1 --2- 172.21.15.7:0/3164382597 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f4c4c102a60 0x7f4c4c199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:19.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.471+0000 7f4c50f8e640 1 -- 172.21.15.7:0/3164382597 >> 172.21.15.7:0/3164382597 conn(0x7f4c4c079730 msgr2=0x7f4c4c1014a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:19.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.471+0000 7f4c50f8e640 1 -- 172.21.15.7:0/3164382597 shutdown_connections 2024-09-21T06:42:19.477 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:19.471+0000 7f4c50f8e640 1 -- 172.21.15.7:0/3164382597 wait complete. 2024-09-21T06:42:20.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:42:19 smithi007 ceph-mon[30983]: scrub queued for path: / 2024-09-21T06:42:20.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:42:19 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T06:42:20.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:42:19 smithi007 ceph-mon[30983]: scrub summary: active paths [/] 2024-09-21T06:42:20.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:42:19 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T06:42:20.146 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:42:20.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:42:19 smithi144 ceph-mon[34653]: scrub queued for path: / 2024-09-21T06:42:20.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:42:19 smithi144 ceph-mon[34653]: scrub summary: idle+waiting paths [/] 2024-09-21T06:42:20.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:42:19 smithi144 ceph-mon[34653]: scrub summary: active paths [/] 2024-09-21T06:42:20.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:42:19 smithi144 ceph-mon[34653]: scrub summary: idle+waiting paths [/] 2024-09-21T06:42:20.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:42:19 smithi018 ceph-mon[34477]: scrub queued for path: / 2024-09-21T06:42:20.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:42:19 smithi018 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-21T06:42:20.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:42:19 smithi018 ceph-mon[34477]: scrub summary: active paths [/] 2024-09-21T06:42:20.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:42:19 smithi018 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-21T06:42:20.403 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:42:20.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.947+0000 7fc861301640 1 -- 172.21.15.7:0/2627835667 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc85c108d20 msgr2=0x7fc85c10f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:20.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.947+0000 7fc861301640 1 --2- 172.21.15.7:0/2627835667 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc85c108d20 0x7fc85c10f550 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fc854009ca0 tx=0x7fc85402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:42:20.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.947+0000 7fc861301640 1 -- 172.21.15.7:0/2627835667 shutdown_connections 2024-09-21T06:42:20.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.947+0000 7fc861301640 1 --2- 172.21.15.7:0/2627835667 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc85c108d20 0x7fc85c10f550 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:20.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.947+0000 7fc861301640 1 --2- 172.21.15.7:0/2627835667 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc85c1083d0 0x7fc85c1087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:20.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.947+0000 7fc861301640 1 --2- 172.21.15.7:0/2627835667 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc85c102ae0 0x7fc85c102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:20.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.947+0000 7fc861301640 1 -- 172.21.15.7:0/2627835667 >> 172.21.15.7:0/2627835667 conn(0x7fc85c079760 msgr2=0x7fc85c079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:20.957 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.947+0000 7fc861301640 1 -- 172.21.15.7:0/2627835667 shutdown_connections 2024-09-21T06:42:20.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.947+0000 7fc861301640 1 -- 172.21.15.7:0/2627835667 wait complete. 2024-09-21T06:42:20.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.948+0000 7fc861301640 1 Processor -- start 2024-09-21T06:42:20.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.948+0000 7fc861301640 1 -- start start 2024-09-21T06:42:20.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.949+0000 7fc861301640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc85c102ae0 0x7fc85c199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:20.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.949+0000 7fc861301640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc85c1083d0 0x7fc85c1998a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:20.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.949+0000 7fc861301640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc85c108d20 0x7fc85c19eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:20.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.949+0000 7fc861301640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc85c112990 con 0x7fc85c1083d0 2024-09-21T06:42:20.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.949+0000 7fc861301640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc85c112810 con 0x7fc85c102ae0 2024-09-21T06:42:20.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.949+0000 7fc861301640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc85c112b10 con 0x7fc85c108d20 2024-09-21T06:42:20.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.949+0000 7fc85a7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc85c1083d0 0x7fc85c1998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:20.958 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.949+0000 7fc85a7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc85c1083d0 0x7fc85c1998a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49220/0 (socket says 172.21.15.7:49220) 2024-09-21T06:42:20.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.949+0000 7fc85a7fc640 1 -- 172.21.15.7:0/2755397239 learned_addr learned my addr 172.21.15.7:0/2755397239 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:42:20.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.949+0000 7fc85affd640 1 --2- 172.21.15.7:0/2755397239 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc85c102ae0 0x7fc85c199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:20.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.949+0000 7fc85b7fe640 1 --2- 172.21.15.7:0/2755397239 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc85c108d20 0x7fc85c19eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:20.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.949+0000 7fc85a7fc640 1 -- 172.21.15.7:0/2755397239 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc85c108d20 msgr2=0x7fc85c19eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:20.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.949+0000 7fc85a7fc640 1 --2- 172.21.15.7:0/2755397239 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc85c108d20 0x7fc85c19eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:20.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.949+0000 7fc85a7fc640 1 -- 172.21.15.7:0/2755397239 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc85c102ae0 msgr2=0x7fc85c199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:20.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.949+0000 7fc85a7fc640 1 --2- 172.21.15.7:0/2755397239 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc85c102ae0 0x7fc85c199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:20.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.949+0000 7fc85a7fc640 1 -- 172.21.15.7:0/2755397239 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc85c19f270 con 0x7fc85c1083d0 2024-09-21T06:42:20.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.949+0000 7fc85a7fc640 1 --2- 172.21.15.7:0/2755397239 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc85c1083d0 0x7fc85c1998a0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fc84400d770 tx=0x7fc84400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:20.959 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.950+0000 7fc853fff640 1 -- 172.21.15.7:0/2755397239 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc844017070 con 0x7fc85c1083d0 2024-09-21T06:42:20.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.950+0000 7fc853fff640 1 -- 172.21.15.7:0/2755397239 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc844009c30 con 0x7fc85c1083d0 2024-09-21T06:42:20.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.950+0000 7fc861301640 1 -- 172.21.15.7:0/2755397239 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc85c19f560 con 0x7fc85c1083d0 2024-09-21T06:42:20.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.950+0000 7fc853fff640 1 -- 172.21.15.7:0/2755397239 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc84400f620 con 0x7fc85c1083d0 2024-09-21T06:42:20.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.950+0000 7fc861301640 1 -- 172.21.15.7:0/2755397239 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc85c1a5cc0 con 0x7fc85c1083d0 2024-09-21T06:42:20.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.953+0000 7fc867875740 1 Processor -- start 2024-09-21T06:42:20.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.953+0000 7fc867875740 1 -- start start 2024-09-21T06:42:20.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.953+0000 7fc867875740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563b607c6070 0x563b60b6d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:20.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.953+0000 7fc867875740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563b6079d1b0 0x563b60b6db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:20.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.953+0000 7fc867875740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563b607a5390 0x563b60b6e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:20.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.953+0000 7fc867875740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x563b60ae3e50 con 0x563b607c6070 2024-09-21T06:42:20.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.953+0000 7fc867875740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x563b60ad3280 con 0x563b607a5390 2024-09-21T06:42:20.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.953+0000 7fc867875740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x563b60ad7090 con 0x563b6079d1b0 2024-09-21T06:42:20.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.953+0000 7fc853fff640 1 -- 172.21.15.7:0/2755397239 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7fc84401a070 con 0x7fc85c1083d0 2024-09-21T06:42:20.960 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.954+0000 7fc85b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563b607c6070 0x563b60b6d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:20.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.954+0000 7fc85b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563b607c6070 0x563b60b6d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49224/0 (socket says 172.21.15.7:49224) 2024-09-21T06:42:20.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.954+0000 7fc85b7fe640 1 -- 172.21.15.7:0/2497612486 learned_addr learned my addr 172.21.15.7:0/2497612486 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:42:20.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.954+0000 7fc85affd640 1 --2- 172.21.15.7:0/2497612486 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563b6079d1b0 0x563b60b6db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:20.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.954+0000 7fc85a7fc640 1 --2- 172.21.15.7:0/2497612486 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563b607a5390 0x563b60b6e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:20.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.954+0000 7fc85b7fe640 1 -- 172.21.15.7:0/2497612486 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563b6079d1b0 msgr2=0x563b60b6db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:20.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.954+0000 7fc85b7fe640 1 --2- 172.21.15.7:0/2497612486 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563b6079d1b0 0x563b60b6db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:20.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.954+0000 7fc85b7fe640 1 -- 172.21.15.7:0/2497612486 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563b607a5390 msgr2=0x563b60b6e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:20.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.954+0000 7fc85b7fe640 1 --2- 172.21.15.7:0/2497612486 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563b607a5390 0x563b60b6e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:20.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.954+0000 7fc85b7fe640 1 -- 172.21.15.7:0/2497612486 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b60831650 con 0x563b607c6070 2024-09-21T06:42:20.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.954+0000 7fc85a7fc640 1 --2- 172.21.15.7:0/2497612486 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563b607a5390 0x563b60b6e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:42:20.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.954+0000 7fc85b7fe640 1 --2- 172.21.15.7:0/2497612486 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563b607c6070 0x563b60b6d650 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fc854005cc0 tx=0x7fc85402f420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f9687d6090824b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:20.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.954+0000 7fc8517fa640 1 -- 172.21.15.7:0/2497612486 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc854031cf0 con 0x563b607c6070 2024-09-21T06:42:20.961 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.955+0000 7fc8517fa640 1 -- 172.21.15.7:0/2497612486 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc854036040 con 0x563b607c6070 2024-09-21T06:42:20.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.955+0000 7fc8517fa640 1 -- 172.21.15.7:0/2497612486 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc854004040 con 0x563b607c6070 2024-09-21T06:42:20.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.955+0000 7fc853fff640 1 --2- 172.21.15.7:0/2755397239 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fc8480b6700 0x7fc8480b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:20.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.955+0000 7fc85affd640 1 --2- 172.21.15.7:0/2755397239 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fc8480b6700 0x7fc8480b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:20.962 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.955+0000 7fc853fff640 1 -- 172.21.15.7:0/2755397239 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fc8440e72c0 con 0x7fc85c1083d0 2024-09-21T06:42:20.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.955+0000 7fc867875740 1 -- 172.21.15.7:0/2497612486 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563b607c6070 msgr2=0x563b60b6d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:20.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.955+0000 7fc85affd640 1 --2- 172.21.15.7:0/2755397239 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fc8480b6700 0x7fc8480b8c10 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x563b60b6c2d0 tx=0x7fc84c005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:20.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.955+0000 7fc867875740 1 --2- 172.21.15.7:0/2497612486 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563b607c6070 0x563b60b6d650 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fc854005cc0 tx=0x7fc85402f420 comp rx=0 tx=0).stop 2024-09-21T06:42:20.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.956+0000 7fc867875740 1 -- 172.21.15.7:0/2497612486 shutdown_connections 2024-09-21T06:42:20.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.956+0000 7fc867875740 1 --2- 172.21.15.7:0/2497612486 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563b607a5390 0x563b60b6e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:20.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.956+0000 7fc867875740 1 --2- 172.21.15.7:0/2497612486 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563b6079d1b0 0x563b60b6db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:20.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.956+0000 7fc867875740 1 --2- 172.21.15.7:0/2497612486 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563b607c6070 0x563b60b6d650 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:20.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.956+0000 7fc867875740 1 -- 172.21.15.7:0/2497612486 >> 172.21.15.7:0/2497612486 conn(0x563b607ba460 msgr2=0x563b60b6b540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:20.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.956+0000 7fc867875740 1 -- 172.21.15.7:0/2497612486 shutdown_connections 2024-09-21T06:42:20.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.956+0000 7fc867875740 1 -- 172.21.15.7:0/2497612486 wait complete. 2024-09-21T06:42:20.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.956+0000 7fc867875740 1 -- start start 2024-09-21T06:42:20.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.956+0000 7fc867875740 1 Processor -- start 2024-09-21T06:42:20.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.957+0000 7fc867875740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563b6079d1b0 0x563b60b7ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:20.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.957+0000 7fc867875740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563b607a5390 0x563b60b7b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:20.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.957+0000 7fc867875740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563b607c6070 0x563b60b7b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:20.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.957+0000 7fc867875740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x563b60934700 con 0x563b607a5390 2024-09-21T06:42:20.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.957+0000 7fc867875740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x563b60a6e110 con 0x563b6079d1b0 2024-09-21T06:42:20.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.957+0000 7fc867875740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x563b60b7df30 con 0x563b607c6070 2024-09-21T06:42:20.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.957+0000 7fc867875740 10 client.0 _ll_register_callbacks cb 0x563b60a87990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:42:20.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.957+0000 7fc85a7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563b607a5390 0x563b60b7b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:20.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.957+0000 7fc85a7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563b607a5390 0x563b60b7b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49226/0 (socket says 172.21.15.7:49226) 2024-09-21T06:42:20.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.957+0000 7fc85a7fc640 1 -- 172.21.15.7:0/1436099596 learned_addr learned my addr 172.21.15.7:0/1436099596 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:42:20.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.957+0000 7fc85b7fe640 1 --2- 172.21.15.7:0/1436099596 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563b607c6070 0x563b60b7b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:20.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.957+0000 7fc85affd640 1 --2- 172.21.15.7:0/1436099596 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563b6079d1b0 0x563b60b7ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:20.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.957+0000 7fc85a7fc640 1 -- 172.21.15.7:0/1436099596 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563b607c6070 msgr2=0x563b60b7b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:20.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.957+0000 7fc85a7fc640 1 --2- 172.21.15.7:0/1436099596 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563b607c6070 0x563b60b7b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:20.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.957+0000 7fc85a7fc640 1 -- 172.21.15.7:0/1436099596 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563b6079d1b0 msgr2=0x563b60b7ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:20.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.957+0000 7fc85a7fc640 1 --2- 172.21.15.7:0/1436099596 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563b6079d1b0 0x563b60b7ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:20.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.957+0000 7fc85a7fc640 1 -- 172.21.15.7:0/1436099596 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b60a9bc40 con 0x563b607a5390 2024-09-21T06:42:20.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.957+0000 7fc85affd640 1 --2- 172.21.15.7:0/1436099596 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563b6079d1b0 0x563b60b7ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:42:20.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.957+0000 7fc85a7fc640 1 --2- 172.21.15.7:0/1436099596 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563b607a5390 0x563b60b7b3d0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fc8440ace70 tx=0x7fc8440a9140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=704f35aaff5dbfe0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:20.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.957+0000 7fc8427fc640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:42:20.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.958+0000 7fc8427fc640 1 -- 172.21.15.7:0/1436099596 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc844021070 con 0x563b607a5390 2024-09-21T06:42:20.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.958+0000 7fc8427fc640 1 -- 172.21.15.7:0/1436099596 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fc8440abe40 con 0x563b607a5390 2024-09-21T06:42:20.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.958+0000 7fc867875740 1 -- 172.21.15.7:0/1436099596 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc854036040 con 0x563b607a5390 2024-09-21T06:42:20.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.958+0000 7fc8427fc640 1 -- 172.21.15.7:0/1436099596 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc8440ac8e0 con 0x563b607a5390 2024-09-21T06:42:20.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.958+0000 7fc867875740 10 client.16677 fetch_fsmap learned FSMap version 25 2024-09-21T06:42:20.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.958+0000 7fc867875740 1 -- 172.21.15.7:0/1436099596 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563b60b89b60 con 0x563b607a5390 2024-09-21T06:42:20.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.958+0000 7fc8427fc640 1 -- 172.21.15.7:0/1436099596 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc854036040 con 0x563b607a5390 2024-09-21T06:42:20.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.958+0000 7fc8427fc640 1 -- 172.21.15.7:0/1436099596 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fc8440ac060 con 0x563b607a5390 2024-09-21T06:42:20.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.958+0000 7fc867875740 10 client.16677 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:42:20.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.958+0000 7fc867875740 10 client.16677 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:42:20.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.958+0000 7fc867875740 20 client.16677 populate_metadata read hostname 'smithi007' 2024-09-21T06:42:20.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.958+0000 7fc867875740 1 --2- 172.21.15.7:0/1436099596 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x563b607849f0 0x563b60b8d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:20.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.958+0000 7fc867875740 4 client.16677 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:42:20.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.958+0000 7fc867875740 1 -- 172.21.15.7:0/1436099596 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563b60ae5da0 con 0x563b607849f0 2024-09-21T06:42:20.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.959+0000 7fc85affd640 1 --2- 172.21.15.7:0/1436099596 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x563b607849f0 0x563b60b8d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:20.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.959+0000 7fc8427fc640 10 client.16677 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:42:20.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.959+0000 7fc85affd640 1 --2- 172.21.15.7:0/1436099596 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x563b607849f0 0x563b60b8d090 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc53a0615b41a2c3 server_cookie=15de4c569352ac96 in_seq=0 out_seq=0 2024-09-21T06:42:20.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.960+0000 7fc8427fc640 1 -- 172.21.15.7:0/1436099596 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563b60ae5da0 con 0x563b607849f0 2024-09-21T06:42:20.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.960+0000 7fc8427fc640 10 client.16677 handle_command_reply: tid=0 2024-09-21T06:42:20.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.960+0000 7fc867875740 1 client.16677 shutdown 2024-09-21T06:42:20.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.960+0000 7fc867875740 1 -- 172.21.15.7:0/1436099596 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563b607a5390 msgr2=0x563b60b7b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:20.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.960+0000 7fc867875740 1 --2- 172.21.15.7:0/1436099596 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563b607a5390 0x563b60b7b3d0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fc8440ace70 tx=0x7fc8440a9140 comp rx=0 tx=0).stop 2024-09-21T06:42:20.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.960+0000 7fc867875740 1 -- 172.21.15.7:0/1436099596 shutdown_connections 2024-09-21T06:42:20.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.960+0000 7fc867875740 1 --2- 172.21.15.7:0/1436099596 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x563b607849f0 0x563b60b8d090 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:20.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.960+0000 7fc867875740 1 --2- 172.21.15.7:0/1436099596 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563b607c6070 0x563b60b7b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:20.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.960+0000 7fc867875740 1 --2- 172.21.15.7:0/1436099596 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563b607a5390 0x563b60b7b3d0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:20.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.960+0000 7fc867875740 1 --2- 172.21.15.7:0/1436099596 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563b6079d1b0 0x563b60b7ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:20.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.960+0000 7fc867875740 1 -- 172.21.15.7:0/1436099596 >> 172.21.15.7:0/1436099596 conn(0x563b607ba460 msgr2=0x563b60b69b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:20.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.960+0000 7fc8427fc640 0 client.16677 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:42:20.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.960+0000 7fc867875740 1 -- 172.21.15.7:0/1436099596 shutdown_connections 2024-09-21T06:42:20.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.960+0000 7fc867875740 1 -- 172.21.15.7:0/1436099596 wait complete. 2024-09-21T06:42:20.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.960+0000 7fc867875740 20 client.16677 trim_cache size 0 max 16384 2024-09-21T06:42:20.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.978+0000 7fc867875740 1 Processor -- start 2024-09-21T06:42:20.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.978+0000 7fc867875740 1 -- start start 2024-09-21T06:42:20.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.978+0000 7fc867875740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563b6079d1b0 0x563b60b7cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:20.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.978+0000 7fc867875740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563b607a5390 0x563b60b6ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:20.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.978+0000 7fc867875740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563b607c6070 0x563b60b78080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:20.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.978+0000 7fc867875740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc85c1afc00 con 0x563b6079d1b0 2024-09-21T06:42:20.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.978+0000 7fc867875740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc85c1ad4d0 con 0x563b607a5390 2024-09-21T06:42:20.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.978+0000 7fc867875740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc85c1ab300 con 0x563b607c6070 2024-09-21T06:42:20.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.978+0000 7fc85affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563b6079d1b0 0x563b60b7cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:20.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.978+0000 7fc85affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563b6079d1b0 0x563b60b7cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49228/0 (socket says 172.21.15.7:49228) 2024-09-21T06:42:20.982 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.978+0000 7fc85affd640 1 -- 172.21.15.7:0/2971438405 learned_addr learned my addr 172.21.15.7:0/2971438405 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:42:20.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.978+0000 7fc85a7fc640 1 --2- 172.21.15.7:0/2971438405 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563b607a5390 0x563b60b6ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:20.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.979+0000 7fc85b7fe640 1 --2- 172.21.15.7:0/2971438405 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563b607c6070 0x563b60b78080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:20.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.979+0000 7fc85affd640 1 -- 172.21.15.7:0/2971438405 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563b607c6070 msgr2=0x563b60b78080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:20.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.979+0000 7fc85affd640 1 --2- 172.21.15.7:0/2971438405 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563b607c6070 0x563b60b78080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:20.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.979+0000 7fc85affd640 1 -- 172.21.15.7:0/2971438405 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563b607a5390 msgr2=0x563b60b6ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:20.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.979+0000 7fc85affd640 1 --2- 172.21.15.7:0/2971438405 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563b607a5390 0x563b60b6ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:20.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.979+0000 7fc85affd640 1 -- 172.21.15.7:0/2971438405 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b60b70470 con 0x563b6079d1b0 2024-09-21T06:42:20.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.979+0000 7fc85a7fc640 1 --2- 172.21.15.7:0/2971438405 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563b607a5390 0x563b60b6ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:42:20.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.979+0000 7fc85affd640 1 --2- 172.21.15.7:0/2971438405 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563b6079d1b0 0x563b60b7cd70 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x563b60b8d7c0 tx=0x7fc84c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd10d54e4407a351 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:20.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.979+0000 7fc850ff9640 1 -- 172.21.15.7:0/2971438405 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc84c02f040 con 0x563b6079d1b0 2024-09-21T06:42:20.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.979+0000 7fc850ff9640 1 -- 172.21.15.7:0/2971438405 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc84c0035f0 con 0x563b6079d1b0 2024-09-21T06:42:20.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.979+0000 7fc850ff9640 1 -- 172.21.15.7:0/2971438405 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc84c02d680 con 0x563b6079d1b0 2024-09-21T06:42:20.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.980+0000 7fc867875740 1 -- 172.21.15.7:0/2971438405 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563b6079d1b0 msgr2=0x563b60b7cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:20.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.980+0000 7fc867875740 1 --2- 172.21.15.7:0/2971438405 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563b6079d1b0 0x563b60b7cd70 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x563b60b8d7c0 tx=0x7fc84c017000 comp rx=0 tx=0).stop 2024-09-21T06:42:20.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.980+0000 7fc867875740 1 -- 172.21.15.7:0/2971438405 shutdown_connections 2024-09-21T06:42:20.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.980+0000 7fc867875740 1 --2- 172.21.15.7:0/2971438405 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563b607c6070 0x563b60b78080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:20.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.980+0000 7fc867875740 1 --2- 172.21.15.7:0/2971438405 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563b607a5390 0x563b60b6ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:20.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.980+0000 7fc867875740 1 --2- 172.21.15.7:0/2971438405 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563b6079d1b0 0x563b60b7cd70 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:20.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.980+0000 7fc867875740 1 -- 172.21.15.7:0/2971438405 >> 172.21.15.7:0/2971438405 conn(0x563b607ba460 msgr2=0x563b60b6e680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:20.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.980+0000 7fc867875740 1 -- 172.21.15.7:0/2971438405 shutdown_connections 2024-09-21T06:42:20.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.980+0000 7fc867875740 1 -- 172.21.15.7:0/2971438405 wait complete. 2024-09-21T06:42:20.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.980+0000 7fc867875740 1 -- start start 2024-09-21T06:42:20.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.981+0000 7fc867875740 1 Processor -- start 2024-09-21T06:42:20.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.981+0000 7fc867875740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563b6079d1b0 0x563b60b7fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:20.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.981+0000 7fc867875740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563b607a5390 0x563b60b7fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:20.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.981+0000 7fc867875740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563b607c6070 0x563b60bf6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:20.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.981+0000 7fc867875740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc85c1ab990 con 0x563b6079d1b0 2024-09-21T06:42:20.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.981+0000 7fc867875740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc85c1ace00 con 0x563b607c6070 2024-09-21T06:42:20.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.981+0000 7fc867875740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc85c1ac060 con 0x563b607a5390 2024-09-21T06:42:20.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.981+0000 7fc85affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563b6079d1b0 0x563b60b7fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:20.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.981+0000 7fc867875740 10 client.0 _ll_register_callbacks cb 0x7fc844010b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:42:20.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.981+0000 7fc85affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563b6079d1b0 0x563b60b7fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:49238/0 (socket says 172.21.15.7:49238) 2024-09-21T06:42:20.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.981+0000 7fc85affd640 1 -- 172.21.15.7:0/1796729591 learned_addr learned my addr 172.21.15.7:0/1796729591 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:42:20.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.981+0000 7fc85b7fe640 1 --2- 172.21.15.7:0/1796729591 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563b607c6070 0x563b60bf6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:20.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.981+0000 7fc85a7fc640 1 --2- 172.21.15.7:0/1796729591 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563b607a5390 0x563b60b7fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:20.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.981+0000 7fc85affd640 1 -- 172.21.15.7:0/1796729591 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563b607a5390 msgr2=0x563b60b7fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:20.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.981+0000 7fc85affd640 1 --2- 172.21.15.7:0/1796729591 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563b607a5390 0x563b60b7fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:20.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.981+0000 7fc85affd640 1 -- 172.21.15.7:0/1796729591 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563b607c6070 msgr2=0x563b60bf6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:20.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.981+0000 7fc85affd640 1 --2- 172.21.15.7:0/1796729591 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563b607c6070 0x563b60bf6aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:20.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.981+0000 7fc85affd640 1 -- 172.21.15.7:0/1796729591 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b60bf70e0 con 0x563b6079d1b0 2024-09-21T06:42:20.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.981+0000 7fc85b7fe640 1 --2- 172.21.15.7:0/1796729591 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563b607c6070 0x563b60bf6aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:42:20.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.982+0000 7fc85affd640 1 --2- 172.21.15.7:0/1796729591 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563b6079d1b0 0x563b60b7fa50 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fc84c035040 tx=0x7fc84c004320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa23b8091583a051 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:20.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.982+0000 7fc8427fc640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:42:20.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.982+0000 7fc8427fc640 1 -- 172.21.15.7:0/1796729591 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc84c042060 con 0x563b6079d1b0 2024-09-21T06:42:20.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.982+0000 7fc8427fc640 1 -- 172.21.15.7:0/1796729591 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7fc84c0039a0 con 0x563b6079d1b0 2024-09-21T06:42:20.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.982+0000 7fc867875740 1 -- 172.21.15.7:0/1796729591 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc84c0035f0 con 0x563b6079d1b0 2024-09-21T06:42:20.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.982+0000 7fc8427fc640 1 -- 172.21.15.7:0/1796729591 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc84c02f040 con 0x563b6079d1b0 2024-09-21T06:42:20.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.982+0000 7fc867875740 10 client.16683 fetch_fsmap learned FSMap version 25 2024-09-21T06:42:20.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.982+0000 7fc867875740 1 -- 172.21.15.7:0/1796729591 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563b60bf8370 con 0x563b6079d1b0 2024-09-21T06:42:20.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.982+0000 7fc8427fc640 1 -- 172.21.15.7:0/1796729591 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc84c0035f0 con 0x563b6079d1b0 2024-09-21T06:42:20.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.982+0000 7fc8427fc640 1 -- 172.21.15.7:0/1796729591 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fc84c004960 con 0x563b6079d1b0 2024-09-21T06:42:20.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.983+0000 7fc867875740 10 client.16683 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:42:20.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.983+0000 7fc867875740 10 client.16683 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:42:20.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.983+0000 7fc867875740 20 client.16683 populate_metadata read hostname 'smithi007' 2024-09-21T06:42:20.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.983+0000 7fc867875740 1 --2- 172.21.15.7:0/1796729591 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x563b60759da0 0x563b60bfab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:20.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.983+0000 7fc867875740 4 client.16683 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:42:20.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.983+0000 7fc867875740 1 -- 172.21.15.7:0/1796729591 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563b60ae1850 con 0x563b60759da0 2024-09-21T06:42:20.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.983+0000 7fc85a7fc640 1 --2- 172.21.15.7:0/1796729591 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x563b60759da0 0x563b60bfab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:20.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.983+0000 7fc8427fc640 10 client.16683 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:42:20.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.983+0000 7fc85a7fc640 1 --2- 172.21.15.7:0/1796729591 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x563b60759da0 0x563b60bfab30 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef1823347701d210 server_cookie=48a1db2551ee98cb in_seq=0 out_seq=0 2024-09-21T06:42:20.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.984+0000 7fc8427fc640 1 -- 172.21.15.7:0/1796729591 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3126 (crc 0 0 0) 0x563b60ae1850 con 0x563b60759da0 2024-09-21T06:42:20.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.984+0000 7fc8427fc640 10 client.16683 handle_command_reply: tid=0 2024-09-21T06:42:20.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.984+0000 7fc867875740 1 client.16683 shutdown 2024-09-21T06:42:20.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.984+0000 7fc867875740 1 -- 172.21.15.7:0/1796729591 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563b6079d1b0 msgr2=0x563b60b7fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:20.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.984+0000 7fc867875740 1 --2- 172.21.15.7:0/1796729591 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563b6079d1b0 0x563b60b7fa50 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fc84c035040 tx=0x7fc84c004320 comp rx=0 tx=0).stop 2024-09-21T06:42:20.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.984+0000 7fc867875740 1 -- 172.21.15.7:0/1796729591 shutdown_connections 2024-09-21T06:42:20.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.984+0000 7fc867875740 1 --2- 172.21.15.7:0/1796729591 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x563b60759da0 0x563b60bfab30 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:20.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.984+0000 7fc8427fc640 0 client.16683 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:42:20.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.984+0000 7fc867875740 1 --2- 172.21.15.7:0/1796729591 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x563b607c6070 0x563b60bf6aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:20.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.984+0000 7fc867875740 1 --2- 172.21.15.7:0/1796729591 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x563b607a5390 0x563b60b7fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:20.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.984+0000 7fc867875740 1 --2- 172.21.15.7:0/1796729591 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x563b6079d1b0 0x563b60b7fa50 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:20.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.984+0000 7fc867875740 1 -- 172.21.15.7:0/1796729591 >> 172.21.15.7:0/1796729591 conn(0x563b607ba460 msgr2=0x563b60b7cad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:20.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.984+0000 7fc867875740 1 -- 172.21.15.7:0/1796729591 shutdown_connections 2024-09-21T06:42:20.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.984+0000 7fc867875740 1 -- 172.21.15.7:0/1796729591 wait complete. 2024-09-21T06:42:20.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.984+0000 7fc867875740 20 client.16683 trim_cache size 0 max 16384 2024-09-21T06:42:20.993 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:42:20.993 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T06:42:20.993 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": { 2024-09-21T06:42:20.993 INFO:teuthology.orchestra.run.smithi007.stdout: "ef9eaabd-003a-44fb-8373-c854a9e15a71": { 2024-09-21T06:42:20.993 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:42:20.993 INFO:teuthology.orchestra.run.smithi007.stdout: "tag": "ef9eaabd-003a-44fb-8373-c854a9e15a71", 2024-09-21T06:42:20.993 INFO:teuthology.orchestra.run.smithi007.stdout: "options": "recursive,force" 2024-09-21T06:42:20.993 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:42:20.993 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:42:20.993 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_stats": { 2024-09-21T06:42:20.994 INFO:teuthology.orchestra.run.smithi007.stdout: "ef9eaabd-003a-44fb-8373-c854a9e15a71": { 2024-09-21T06:42:20.994 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:42:19.467946+0000", 2024-09-21T06:42:20.994 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:42:20.994 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:42:20.994 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:42:20.994 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:42:20.994 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:42:20.994 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:42:20.994 INFO:teuthology.orchestra.run.smithi007.stdout: "62fca477-b241-45f5-8185-bc78aeb8b19f": { 2024-09-21T06:42:20.994 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:40:12.744488+0000", 2024-09-21T06:42:20.994 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:42:20.994 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:42:20.995 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:42:20.995 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:42:20.995 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:42:20.995 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:42:20.995 INFO:teuthology.orchestra.run.smithi007.stdout: "a1ae5b3b-f158-44be-8ef4-d70e9ba879cc": { 2024-09-21T06:42:20.995 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:41:37.568453+0000", 2024-09-21T06:42:20.995 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:42:20.995 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:42:20.995 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:42:20.995 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:42:20.995 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:42:20.995 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:42:20.996 INFO:teuthology.orchestra.run.smithi007.stdout: "d7b6a90c-9ae1-4e02-93ad-335a7e9df1d7": { 2024-09-21T06:42:20.996 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:39:19.226139+0000", 2024-09-21T06:42:20.996 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:42:20.996 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:42:20.996 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:42:20.996 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:42:20.996 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:42:20.996 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:42:20.996 INFO:teuthology.orchestra.run.smithi007.stdout: "b0327167-8c41-4286-8afc-7f0780972fd7": { 2024-09-21T06:42:20.996 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:38:36.828657+0000", 2024-09-21T06:42:20.996 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:42:20.996 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:42:20.997 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:42:20.997 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:42:20.997 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:42:20.997 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:42:20.997 INFO:teuthology.orchestra.run.smithi007.stdout: "13441782-2231-4713-8ebd-068a941de47f": { 2024-09-21T06:42:20.997 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:39:30.219006+0000", 2024-09-21T06:42:20.997 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:42:20.997 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:42:20.997 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:42:20.997 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:42:20.997 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:42:20.997 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:42:20.997 INFO:teuthology.orchestra.run.smithi007.stdout: "5cbaaba2-6ab1-4f83-abd6-8c6eef4b5c42": { 2024-09-21T06:42:20.998 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:37:46.566272+0000", 2024-09-21T06:42:20.998 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:42:20.998 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:42:20.998 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:42:20.998 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:42:20.998 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:42:20.998 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:42:20.998 INFO:teuthology.orchestra.run.smithi007.stdout: "6231e9c1-14a2-40b5-be3c-76d87a0d733b": { 2024-09-21T06:42:20.998 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:37:02.484812+0000", 2024-09-21T06:42:20.998 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:42:20.998 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:42:20.998 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:42:20.998 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:42:20.998 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:42:20.999 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:42:20.999 INFO:teuthology.orchestra.run.smithi007.stdout: "310a0ec8-44bb-49ed-a534-3bc91cb1ee9d": { 2024-09-21T06:42:20.999 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:40:55.373968+0000", 2024-09-21T06:42:20.999 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:42:20.999 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:42:20.999 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:42:20.999 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:42:20.999 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:42:20.999 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:42:20.999 INFO:teuthology.orchestra.run.smithi007.stdout: "0b89345c-1f00-4efe-8ee9-4cb17e43584c": { 2024-09-21T06:42:20.999 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:36:19.500334+0000", 2024-09-21T06:42:20.999 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:42:20.999 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:42:21.000 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:42:21.000 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:42:21.000 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:42:21.000 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:42:21.000 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:42:21.000 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:42:21.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.985+0000 7fc861301640 1 -- 172.21.15.7:0/2755397239 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fc8480b6700 msgr2=0x7fc8480b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:21.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.985+0000 7fc861301640 1 --2- 172.21.15.7:0/2755397239 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fc8480b6700 0x7fc8480b8c10 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x563b60b6c2d0 tx=0x7fc84c005f90 comp rx=0 tx=0).stop 2024-09-21T06:42:21.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.985+0000 7fc861301640 1 -- 172.21.15.7:0/2755397239 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc85c1083d0 msgr2=0x7fc85c1998a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:21.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.985+0000 7fc861301640 1 --2- 172.21.15.7:0/2755397239 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc85c1083d0 0x7fc85c1998a0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fc84400d770 tx=0x7fc84400dc30 comp rx=0 tx=0).stop 2024-09-21T06:42:21.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.985+0000 7fc861301640 1 -- 172.21.15.7:0/2755397239 shutdown_connections 2024-09-21T06:42:21.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.985+0000 7fc861301640 1 --2- 172.21.15.7:0/2755397239 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fc8480b6700 0x7fc8480b8c10 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:21.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.985+0000 7fc861301640 1 --2- 172.21.15.7:0/2755397239 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc85c108d20 0x7fc85c19eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:21.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.985+0000 7fc861301640 1 --2- 172.21.15.7:0/2755397239 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc85c1083d0 0x7fc85c1998a0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:21.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.985+0000 7fc861301640 1 --2- 172.21.15.7:0/2755397239 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc85c102ae0 0x7fc85c199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:21.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.985+0000 7fc861301640 1 -- 172.21.15.7:0/2755397239 >> 172.21.15.7:0/2755397239 conn(0x7fc85c079760 msgr2=0x7fc85c1043a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:21.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.985+0000 7fc861301640 1 -- 172.21.15.7:0/2755397239 shutdown_connections 2024-09-21T06:42:21.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:20.985+0000 7fc861301640 1 -- 172.21.15.7:0/2755397239 wait complete. 2024-09-21T06:42:21.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:42:20 smithi144 ceph-mon[34653]: pgmap v503: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-21T06:42:21.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:42:20 smithi007 ceph-mon[30983]: pgmap v503: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-21T06:42:21.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:42:20 smithi018 ceph-mon[34477]: pgmap v503: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-21T06:42:21.749 INFO:tasks.cephfs.filesystem:scrub status for tag:ef9eaabd-003a-44fb-8373-c854a9e15a71 - {'path': '/', 'tag': 'ef9eaabd-003a-44fb-8373-c854a9e15a71', 'options': 'recursive,force'} 2024-09-21T06:42:23.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:42:22 smithi144 ceph-mon[34653]: pgmap v504: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-21T06:42:23.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:42:22 smithi007 ceph-mon[30983]: pgmap v504: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-21T06:42:23.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:42:22 smithi018 ceph-mon[34477]: pgmap v504: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-21T06:42:25.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:42:24 smithi144 ceph-mon[34653]: pgmap v505: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:42:25.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:42:24 smithi144 ceph-mon[34653]: scrub summary: idle 2024-09-21T06:42:25.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:42:24 smithi007 ceph-mon[30983]: pgmap v505: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:42:25.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:42:24 smithi007 ceph-mon[30983]: scrub summary: idle 2024-09-21T06:42:25.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:42:24 smithi018 ceph-mon[34477]: pgmap v505: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:42:25.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:42:24 smithi018 ceph-mon[34477]: scrub summary: idle 2024-09-21T06:42:27.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:42:26 smithi144 ceph-mon[34653]: pgmap v506: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-09-21T06:42:27.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:42:26 smithi007 ceph-mon[30983]: pgmap v506: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-09-21T06:42:27.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:42:26 smithi018 ceph-mon[34477]: pgmap v506: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-09-21T06:42:29.171 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:42:28 smithi018 ceph-mon[34477]: pgmap v507: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6 op/s 2024-09-21T06:42:29.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:42:28 smithi144 ceph-mon[34653]: pgmap v507: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6 op/s 2024-09-21T06:42:29.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:42:28 smithi007 ceph-mon[30983]: pgmap v507: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6 op/s 2024-09-21T06:42:31.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:42:30 smithi144 ceph-mon[34653]: pgmap v508: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:42:31.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:42:30 smithi007 ceph-mon[30983]: pgmap v508: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:42:31.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:42:30 smithi018 ceph-mon[34477]: pgmap v508: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:42:33.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:42:32 smithi144 ceph-mon[34653]: pgmap v509: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6 op/s 2024-09-21T06:42:33.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:42:32 smithi007 ceph-mon[30983]: pgmap v509: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6 op/s 2024-09-21T06:42:33.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:42:32 smithi018 ceph-mon[34477]: pgmap v509: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6 op/s 2024-09-21T06:42:35.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:42:34 smithi144 ceph-mon[34653]: pgmap v510: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 7 op/s 2024-09-21T06:42:35.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:42:34 smithi007 ceph-mon[30983]: pgmap v510: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 7 op/s 2024-09-21T06:42:35.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:42:34 smithi018 ceph-mon[34477]: pgmap v510: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 7 op/s 2024-09-21T06:42:37.287 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:42:36 smithi144 ceph-mon[34653]: pgmap v511: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:42:37.287 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:42:36 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:42:37.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:42:36 smithi007 ceph-mon[30983]: pgmap v511: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:42:37.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:42:36 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:42:37.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:42:36 smithi018 ceph-mon[34477]: pgmap v511: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:42:37.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:42:36 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:42:38.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:42:37 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:42:38.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:42:37 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:42:38.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:42:37 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:42:38.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:42:37 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:42:38.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:42:37 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:42:38.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:42:37 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:42:38.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:42:37 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:42:38.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:42:37 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:42:38.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:42:37 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:42:39.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:42:39 smithi144 ceph-mon[34653]: pgmap v512: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:42:39.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:42:39 smithi007 ceph-mon[30983]: pgmap v512: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:42:39.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:42:39 smithi018 ceph-mon[34477]: pgmap v512: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:42:41.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:42:41 smithi144 ceph-mon[34653]: pgmap v513: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:42:41.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:42:41 smithi007 ceph-mon[30983]: pgmap v513: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:42:41.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:42:41 smithi018 ceph-mon[34477]: pgmap v513: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:42:43.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:42:43 smithi144 ceph-mon[34653]: pgmap v514: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:42:43.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:42:43 smithi007 ceph-mon[30983]: pgmap v514: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:42:43.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:42:43 smithi018 ceph-mon[34477]: pgmap v514: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:42:45.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:42:45 smithi144 ceph-mon[34653]: pgmap v515: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-21T06:42:45.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:42:45 smithi007 ceph-mon[30983]: pgmap v515: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-21T06:42:45.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:42:45 smithi018 ceph-mon[34477]: pgmap v515: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-21T06:42:47.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:42:47 smithi144 ceph-mon[34653]: pgmap v516: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-21T06:42:47.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:42:47 smithi007 ceph-mon[30983]: pgmap v516: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-21T06:42:47.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:42:47 smithi018 ceph-mon[34477]: pgmap v516: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-21T06:42:49.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:42:49 smithi144 ceph-mon[34653]: pgmap v517: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-21T06:42:49.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:42:49 smithi007 ceph-mon[30983]: pgmap v517: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-21T06:42:49.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:42:49 smithi018 ceph-mon[34477]: pgmap v517: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-21T06:42:51.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:42:51 smithi144 ceph-mon[34653]: pgmap v518: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-21T06:42:51.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:42:51 smithi007 ceph-mon[30983]: pgmap v518: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-21T06:42:51.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:42:51 smithi018 ceph-mon[34477]: pgmap v518: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-21T06:42:51.751 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:42:52.025 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:42:52.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.492+0000 7faee6bae640 1 -- 172.21.15.7:0/1068489716 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faee01094c0 msgr2=0x7faee01098d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:52.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.492+0000 7faee6bae640 1 --2- 172.21.15.7:0/1068489716 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faee01094c0 0x7faee01098d0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7faed0009900 tx=0x7faed002a410 comp rx=0 tx=0).stop 2024-09-21T06:42:52.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.492+0000 7faee6bae640 1 -- 172.21.15.7:0/1068489716 shutdown_connections 2024-09-21T06:42:52.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.492+0000 7faee6bae640 1 --2- 172.21.15.7:0/1068489716 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faee0109e10 0x7faee0110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:52.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.492+0000 7faee6bae640 1 --2- 172.21.15.7:0/1068489716 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faee01094c0 0x7faee01098d0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:52.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.492+0000 7faee6bae640 1 --2- 172.21.15.7:0/1068489716 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faee0103b80 0x7faee0103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:52.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.492+0000 7faee6bae640 1 -- 172.21.15.7:0/1068489716 >> 172.21.15.7:0/1068489716 conn(0x7faee00ff610 msgr2=0x7faee0101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:52.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.492+0000 7faee6bae640 1 -- 172.21.15.7:0/1068489716 shutdown_connections 2024-09-21T06:42:52.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.492+0000 7faee6bae640 1 -- 172.21.15.7:0/1068489716 wait complete. 2024-09-21T06:42:52.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.493+0000 7faee6bae640 1 Processor -- start 2024-09-21T06:42:52.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.493+0000 7faee6bae640 1 -- start start 2024-09-21T06:42:52.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.493+0000 7faee6bae640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faee0103b80 0x7faee0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:52.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.493+0000 7faee6bae640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faee01094c0 0x7faee0075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:52.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.493+0000 7faee6bae640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faee0109e10 0x7faee0076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:52.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.493+0000 7faee6bae640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7faee0113b20 con 0x7faee01094c0 2024-09-21T06:42:52.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.493+0000 7faee6bae640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7faee01139a0 con 0x7faee0109e10 2024-09-21T06:42:52.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.493+0000 7faee6bae640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7faee0113ca0 con 0x7faee0103b80 2024-09-21T06:42:52.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.494+0000 7faedffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faee01094c0 0x7faee0075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:52.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.494+0000 7faedffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faee01094c0 0x7faee0075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53770/0 (socket says 172.21.15.7:53770) 2024-09-21T06:42:52.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.494+0000 7faee494a640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faee0103b80 0x7faee0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:52.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.494+0000 7faedffff640 1 -- 172.21.15.7:0/3932090449 learned_addr learned my addr 172.21.15.7:0/3932090449 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:42:52.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.494+0000 7faee514b640 1 --2- 172.21.15.7:0/3932090449 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faee0109e10 0x7faee0076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:52.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.494+0000 7faedffff640 1 -- 172.21.15.7:0/3932090449 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faee0103b80 msgr2=0x7faee0075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:52.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.494+0000 7faedffff640 1 --2- 172.21.15.7:0/3932090449 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faee0103b80 0x7faee0075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:52.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.494+0000 7faedffff640 1 -- 172.21.15.7:0/3932090449 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faee0109e10 msgr2=0x7faee0076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:52.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.494+0000 7faedffff640 1 --2- 172.21.15.7:0/3932090449 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faee0109e10 0x7faee0076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:52.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.494+0000 7faedffff640 1 -- 172.21.15.7:0/3932090449 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faee01a8750 con 0x7faee01094c0 2024-09-21T06:42:52.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.494+0000 7faedffff640 1 --2- 172.21.15.7:0/3932090449 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faee01094c0 0x7faee0075c50 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7faed0005ab0 tx=0x7faed0003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:52.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.494+0000 7faeddffb640 1 -- 172.21.15.7:0/3932090449 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed003f070 con 0x7faee01094c0 2024-09-21T06:42:52.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.494+0000 7faeddffb640 1 -- 172.21.15.7:0/3932090449 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faed0031b50 con 0x7faee01094c0 2024-09-21T06:42:52.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.494+0000 7faeddffb640 1 -- 172.21.15.7:0/3932090449 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed0035030 con 0x7faee01094c0 2024-09-21T06:42:52.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.494+0000 7faee6bae640 1 -- 172.21.15.7:0/3932090449 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faee01a89e0 con 0x7faee01094c0 2024-09-21T06:42:52.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.495+0000 7faee6bae640 1 -- 172.21.15.7:0/3932090449 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faee01a8f10 con 0x7faee01094c0 2024-09-21T06:42:52.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.498+0000 7faeed122740 1 Processor -- start 2024-09-21T06:42:52.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.498+0000 7faeed122740 1 -- start start 2024-09-21T06:42:52.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.498+0000 7faeed122740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5603dee04070 0x5603df1ab270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:52.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.498+0000 7faeed122740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5603deddb1b0 0x5603df1ab7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:52.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.498+0000 7faeed122740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5603dede3390 0x5603df1abcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:52.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.498+0000 7faeed122740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5603df121e50 con 0x5603deddb1b0 2024-09-21T06:42:52.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.498+0000 7faeed122740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5603df111280 con 0x5603dede3390 2024-09-21T06:42:52.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.498+0000 7faeed122740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5603df115090 con 0x5603dee04070 2024-09-21T06:42:52.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.498+0000 7faee494a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5603deddb1b0 0x5603df1ab7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:52.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.498+0000 7faee494a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5603deddb1b0 0x5603df1ab7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53782/0 (socket says 172.21.15.7:53782) 2024-09-21T06:42:52.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.498+0000 7faee494a640 1 -- 172.21.15.7:0/1766427874 learned_addr learned my addr 172.21.15.7:0/1766427874 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:42:52.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.498+0000 7faee514b640 1 --2- 172.21.15.7:0/1766427874 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5603dee04070 0x5603df1ab270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:52.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.499+0000 7faee494a640 1 -- 172.21.15.7:0/1766427874 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5603dee04070 msgr2=0x5603df1ab270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:52.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.499+0000 7faee494a640 1 --2- 172.21.15.7:0/1766427874 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5603dee04070 0x5603df1ab270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:52.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.499+0000 7faee494a640 1 -- 172.21.15.7:0/1766427874 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5603dede3390 msgr2=0x5603df1abcf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T06:42:52.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.499+0000 7faee494a640 1 --2- 172.21.15.7:0/1766427874 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5603dede3390 0x5603df1abcf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:52.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.499+0000 7faee494a640 1 -- 172.21.15.7:0/1766427874 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603dee6f650 con 0x5603deddb1b0 2024-09-21T06:42:52.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.499+0000 7faeddffb640 1 -- 172.21.15.7:0/3932090449 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7faed0042070 con 0x7faee01094c0 2024-09-21T06:42:52.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.499+0000 7faee514b640 1 --2- 172.21.15.7:0/1766427874 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5603dee04070 0x5603df1ab270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:42:52.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.499+0000 7faee494a640 1 --2- 172.21.15.7:0/1766427874 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5603deddb1b0 0x5603df1ab7b0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7faec8009c90 tx=0x7faec8011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=401c403dfd0b52a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:52.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.499+0000 7faed6ffd640 1 -- 172.21.15.7:0/1766427874 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec8005220 con 0x5603deddb1b0 2024-09-21T06:42:52.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.499+0000 7faed6ffd640 1 -- 172.21.15.7:0/1766427874 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faec8004c50 con 0x5603deddb1b0 2024-09-21T06:42:52.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.499+0000 7faed6ffd640 1 -- 172.21.15.7:0/1766427874 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec80197a0 con 0x5603deddb1b0 2024-09-21T06:42:52.504 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.500+0000 7faeddffb640 1 --2- 172.21.15.7:0/3932090449 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7faecc0b6700 0x7faecc0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:52.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.500+0000 7faee514b640 1 --2- 172.21.15.7:0/3932090449 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7faecc0b6700 0x7faecc0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:52.505 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.500+0000 7faeddffb640 1 -- 172.21.15.7:0/3932090449 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7faed0107970 con 0x7faee01094c0 2024-09-21T06:42:52.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.501+0000 7faeed122740 1 -- 172.21.15.7:0/1766427874 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5603deddb1b0 msgr2=0x5603df1ab7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:52.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.501+0000 7faee514b640 1 --2- 172.21.15.7:0/3932090449 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7faecc0b6700 0x7faecc0b8c10 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7faed8009fd0 tx=0x7faed8009500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:52.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.501+0000 7faeed122740 1 --2- 172.21.15.7:0/1766427874 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5603deddb1b0 0x5603df1ab7b0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7faec8009c90 tx=0x7faec8011810 comp rx=0 tx=0).stop 2024-09-21T06:42:52.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.501+0000 7faeed122740 1 -- 172.21.15.7:0/1766427874 shutdown_connections 2024-09-21T06:42:52.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.501+0000 7faeed122740 1 --2- 172.21.15.7:0/1766427874 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5603dede3390 0x5603df1abcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:52.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.501+0000 7faeed122740 1 --2- 172.21.15.7:0/1766427874 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5603deddb1b0 0x5603df1ab7b0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:52.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.501+0000 7faeed122740 1 --2- 172.21.15.7:0/1766427874 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5603dee04070 0x5603df1ab270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:52.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.501+0000 7faeed122740 1 -- 172.21.15.7:0/1766427874 >> 172.21.15.7:0/1766427874 conn(0x5603dedf8460 msgr2=0x5603df1a9160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:52.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.501+0000 7faeed122740 1 -- 172.21.15.7:0/1766427874 shutdown_connections 2024-09-21T06:42:52.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.501+0000 7faeed122740 1 -- 172.21.15.7:0/1766427874 wait complete. 2024-09-21T06:42:52.508 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.501+0000 7faeed122740 1 -- start start 2024-09-21T06:42:52.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.501+0000 7faeed122740 1 Processor -- start 2024-09-21T06:42:52.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.502+0000 7faeed122740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5603deddb1b0 0x5603df1b69e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:52.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.502+0000 7faeed122740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5603dede3390 0x5603df1b6f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:52.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.502+0000 7faeed122740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5603dee04070 0x5603df1c2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:52.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.502+0000 7faeed122740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5603def72700 con 0x5603dee04070 2024-09-21T06:42:52.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.502+0000 7faeed122740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5603df0ac110 con 0x5603deddb1b0 2024-09-21T06:42:52.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.502+0000 7faeed122740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5603df1b9a50 con 0x5603dede3390 2024-09-21T06:42:52.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.502+0000 7faeed122740 10 client.0 _ll_register_callbacks cb 0x5603df0c5990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:42:52.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.502+0000 7faee514b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5603dee04070 0x5603df1c2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:52.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.502+0000 7faee514b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5603dee04070 0x5603df1c2da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53792/0 (socket says 172.21.15.7:53792) 2024-09-21T06:42:52.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.502+0000 7faee514b640 1 -- 172.21.15.7:0/3842837547 learned_addr learned my addr 172.21.15.7:0/3842837547 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:42:52.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.502+0000 7faee494a640 1 --2- 172.21.15.7:0/3842837547 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5603deddb1b0 0x5603df1b69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:52.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.502+0000 7faedffff640 1 --2- 172.21.15.7:0/3842837547 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5603dede3390 0x5603df1b6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:52.509 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.503+0000 7faee514b640 1 -- 172.21.15.7:0/3842837547 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5603dede3390 msgr2=0x5603df1b6f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:52.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.503+0000 7faee514b640 1 --2- 172.21.15.7:0/3842837547 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5603dede3390 0x5603df1b6f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:52.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.503+0000 7faee514b640 1 -- 172.21.15.7:0/3842837547 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5603deddb1b0 msgr2=0x5603df1b69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:52.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.503+0000 7faee514b640 1 --2- 172.21.15.7:0/3842837547 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5603deddb1b0 0x5603df1b69e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:52.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.503+0000 7faee514b640 1 -- 172.21.15.7:0/3842837547 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603df0d9c40 con 0x5603dee04070 2024-09-21T06:42:52.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.503+0000 7faee494a640 1 --2- 172.21.15.7:0/3842837547 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5603deddb1b0 0x5603df1b69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:42:52.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.503+0000 7faee514b640 1 --2- 172.21.15.7:0/3842837547 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5603dee04070 0x5603df1c2da0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7faed8011e30 tx=0x7faed8004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d571f9cf05dd050 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:52.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.503+0000 7faebffff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:42:52.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.503+0000 7faebffff640 1 -- 172.21.15.7:0/3842837547 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed801f9b0 con 0x5603dee04070 2024-09-21T06:42:52.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.503+0000 7faebffff640 1 -- 172.21.15.7:0/3842837547 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7faed801fb50 con 0x5603dee04070 2024-09-21T06:42:52.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.503+0000 7faeed122740 1 -- 172.21.15.7:0/3842837547 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faec8004c50 con 0x5603dee04070 2024-09-21T06:42:52.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.503+0000 7faebffff640 1 -- 172.21.15.7:0/3842837547 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7faed801fd50 con 0x5603dee04070 2024-09-21T06:42:52.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.503+0000 7faeed122740 10 client.16695 fetch_fsmap learned FSMap version 25 2024-09-21T06:42:52.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.503+0000 7faeed122740 1 -- 172.21.15.7:0/3842837547 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5603df1c5880 con 0x5603dee04070 2024-09-21T06:42:52.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.504+0000 7faebffff640 1 -- 172.21.15.7:0/3842837547 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faec8004c50 con 0x5603dee04070 2024-09-21T06:42:52.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.504+0000 7faebffff640 1 -- 172.21.15.7:0/3842837547 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7faed8026070 con 0x5603dee04070 2024-09-21T06:42:52.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.504+0000 7faeed122740 10 client.16695 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:42:52.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.504+0000 7faeed122740 10 client.16695 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:42:52.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.504+0000 7faeed122740 20 client.16695 populate_metadata read hostname 'smithi007' 2024-09-21T06:42:52.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.504+0000 7faeed122740 1 --2- 172.21.15.7:0/3842837547 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5603dedc29f0 0x5603df1c8d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:52.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.504+0000 7faeed122740 4 client.16695 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:42:52.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.504+0000 7faeed122740 1 -- 172.21.15.7:0/3842837547 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5603df123da0 con 0x5603dedc29f0 2024-09-21T06:42:52.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.504+0000 7faee494a640 1 --2- 172.21.15.7:0/3842837547 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5603dedc29f0 0x5603df1c8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:52.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.505+0000 7faebffff640 10 client.16695 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:42:52.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.505+0000 7faee494a640 1 --2- 172.21.15.7:0/3842837547 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5603dedc29f0 0x5603df1c8d30 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=139d2d379992ce50 server_cookie=cb035d4b67b9fb0e in_seq=0 out_seq=0 2024-09-21T06:42:52.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.505+0000 7faebffff640 1 -- 172.21.15.7:0/3842837547 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5603df123da0 con 0x5603dedc29f0 2024-09-21T06:42:52.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.505+0000 7faebffff640 10 client.16695 handle_command_reply: tid=0 2024-09-21T06:42:52.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.505+0000 7faeed122740 1 client.16695 shutdown 2024-09-21T06:42:52.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.506+0000 7faeed122740 1 -- 172.21.15.7:0/3842837547 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5603dee04070 msgr2=0x5603df1c2da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:52.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.506+0000 7faeed122740 1 --2- 172.21.15.7:0/3842837547 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5603dee04070 0x5603df1c2da0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7faed8011e30 tx=0x7faed8004ab0 comp rx=0 tx=0).stop 2024-09-21T06:42:52.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.506+0000 7faeed122740 1 -- 172.21.15.7:0/3842837547 shutdown_connections 2024-09-21T06:42:52.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.506+0000 7faeed122740 1 --2- 172.21.15.7:0/3842837547 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5603dedc29f0 0x5603df1c8d30 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:52.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.506+0000 7faeed122740 1 --2- 172.21.15.7:0/3842837547 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5603dee04070 0x5603df1c2da0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:52.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.506+0000 7faeed122740 1 --2- 172.21.15.7:0/3842837547 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5603dede3390 0x5603df1b6f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:52.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.506+0000 7faeed122740 1 --2- 172.21.15.7:0/3842837547 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5603deddb1b0 0x5603df1b69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:52.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.506+0000 7faeed122740 1 -- 172.21.15.7:0/3842837547 >> 172.21.15.7:0/3842837547 conn(0x5603dedf8460 msgr2=0x5603df1ae400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:52.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.506+0000 7faebffff640 0 client.16695 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:42:52.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.506+0000 7faeed122740 1 -- 172.21.15.7:0/3842837547 shutdown_connections 2024-09-21T06:42:52.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.506+0000 7faeed122740 1 -- 172.21.15.7:0/3842837547 wait complete. 2024-09-21T06:42:52.513 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.506+0000 7faeed122740 20 client.16695 trim_cache size 0 max 16384 2024-09-21T06:42:52.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.524+0000 7faeed122740 1 Processor -- start 2024-09-21T06:42:52.526 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.524+0000 7faeed122740 1 -- start start 2024-09-21T06:42:52.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.524+0000 7faeed122740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5603deddb1b0 0x5603df1b5260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:52.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.524+0000 7faeed122740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5603dede3390 0x5603df1ae370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:52.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.524+0000 7faeed122740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5603dee04070 0x5603df1ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:52.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.524+0000 7faeed122740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7faee01b3fd0 con 0x5603deddb1b0 2024-09-21T06:42:52.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.524+0000 7faeed122740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7faee01b18a0 con 0x5603dee04070 2024-09-21T06:42:52.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.524+0000 7faeed122740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7faee01af6f0 con 0x5603dede3390 2024-09-21T06:42:52.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.524+0000 7faee494a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5603deddb1b0 0x5603df1b5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:52.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.524+0000 7faee494a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5603deddb1b0 0x5603df1b5260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53800/0 (socket says 172.21.15.7:53800) 2024-09-21T06:42:52.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.524+0000 7faee494a640 1 -- 172.21.15.7:0/1716405449 learned_addr learned my addr 172.21.15.7:0/1716405449 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:42:52.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.524+0000 7faee514b640 1 --2- 172.21.15.7:0/1716405449 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5603dee04070 0x5603df1ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:52.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.524+0000 7faedffff640 1 --2- 172.21.15.7:0/1716405449 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5603dede3390 0x5603df1ae370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:52.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.525+0000 7faee494a640 1 -- 172.21.15.7:0/1716405449 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5603dede3390 msgr2=0x5603df1ae370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:52.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.525+0000 7faee494a640 1 --2- 172.21.15.7:0/1716405449 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5603dede3390 0x5603df1ae370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:52.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.525+0000 7faee494a640 1 -- 172.21.15.7:0/1716405449 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5603dee04070 msgr2=0x5603df1ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:52.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.525+0000 7faee494a640 1 --2- 172.21.15.7:0/1716405449 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5603dee04070 0x5603df1ae8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:52.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.525+0000 7faee494a640 1 -- 172.21.15.7:0/1716405449 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603df1b4ee0 con 0x5603deddb1b0 2024-09-21T06:42:52.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.525+0000 7faee514b640 1 --2- 172.21.15.7:0/1716405449 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5603dee04070 0x5603df1ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:42:52.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.525+0000 7faee494a640 1 --2- 172.21.15.7:0/1716405449 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5603deddb1b0 0x5603df1b5260 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7faec8009250 tx=0x7faec8005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ee87283e1cd14b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:52.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.525+0000 7faed67fc640 1 -- 172.21.15.7:0/1716405449 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec80049d0 con 0x5603deddb1b0 2024-09-21T06:42:52.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.525+0000 7faed67fc640 1 -- 172.21.15.7:0/1716405449 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faec8030020 con 0x5603deddb1b0 2024-09-21T06:42:52.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.525+0000 7faed67fc640 1 -- 172.21.15.7:0/1716405449 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faec80054f0 con 0x5603deddb1b0 2024-09-21T06:42:52.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.526+0000 7faeed122740 1 -- 172.21.15.7:0/1716405449 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5603deddb1b0 msgr2=0x5603df1b5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:52.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.526+0000 7faeed122740 1 --2- 172.21.15.7:0/1716405449 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5603deddb1b0 0x5603df1b5260 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7faec8009250 tx=0x7faec8005f90 comp rx=0 tx=0).stop 2024-09-21T06:42:52.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.526+0000 7faeed122740 1 -- 172.21.15.7:0/1716405449 shutdown_connections 2024-09-21T06:42:52.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.526+0000 7faeed122740 1 --2- 172.21.15.7:0/1716405449 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5603dee04070 0x5603df1ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:52.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.526+0000 7faeed122740 1 --2- 172.21.15.7:0/1716405449 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5603dede3390 0x5603df1ae370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:52.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.526+0000 7faeed122740 1 --2- 172.21.15.7:0/1716405449 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5603deddb1b0 0x5603df1b5260 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:52.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.526+0000 7faeed122740 1 -- 172.21.15.7:0/1716405449 >> 172.21.15.7:0/1716405449 conn(0x5603dedf8460 msgr2=0x5603df1b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:52.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.526+0000 7faeed122740 1 -- 172.21.15.7:0/1716405449 shutdown_connections 2024-09-21T06:42:52.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.526+0000 7faeed122740 1 -- 172.21.15.7:0/1716405449 wait complete. 2024-09-21T06:42:52.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.526+0000 7faeed122740 1 -- start start 2024-09-21T06:42:52.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.527+0000 7faeed122740 1 Processor -- start 2024-09-21T06:42:52.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.527+0000 7faeed122740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5603deddb1b0 0x5603df1bf1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:52.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.527+0000 7faeed122740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5603dede3390 0x5603df1ba6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:52.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.527+0000 7faeed122740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5603dee04070 0x5603df1babe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:52.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.527+0000 7faeed122740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7faee01afd60 con 0x5603dede3390 2024-09-21T06:42:52.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.527+0000 7faeed122740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7faee01b11d0 con 0x5603dee04070 2024-09-21T06:42:52.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.527+0000 7faeed122740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7faee01b0430 con 0x5603deddb1b0 2024-09-21T06:42:52.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.527+0000 7faeed122740 10 client.0 _ll_register_callbacks cb 0x7faed8009be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:42:52.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.527+0000 7faedffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5603dede3390 0x5603df1ba6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:52.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.527+0000 7faedffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5603dede3390 0x5603df1ba6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53814/0 (socket says 172.21.15.7:53814) 2024-09-21T06:42:52.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.527+0000 7faedffff640 1 -- 172.21.15.7:0/1568696358 learned_addr learned my addr 172.21.15.7:0/1568696358 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:42:52.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.527+0000 7faee494a640 1 --2- 172.21.15.7:0/1568696358 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5603deddb1b0 0x5603df1bf1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:52.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.527+0000 7faee514b640 1 --2- 172.21.15.7:0/1568696358 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5603dee04070 0x5603df1babe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:52.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.528+0000 7faedffff640 1 -- 172.21.15.7:0/1568696358 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5603deddb1b0 msgr2=0x5603df1bf1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:52.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.528+0000 7faedffff640 1 --2- 172.21.15.7:0/1568696358 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5603deddb1b0 0x5603df1bf1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:52.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.528+0000 7faedffff640 1 -- 172.21.15.7:0/1568696358 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5603dee04070 msgr2=0x5603df1babe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:52.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.528+0000 7faedffff640 1 --2- 172.21.15.7:0/1568696358 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5603dee04070 0x5603df1babe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:52.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.528+0000 7faedffff640 1 -- 172.21.15.7:0/1568696358 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603df1bb120 con 0x5603dede3390 2024-09-21T06:42:52.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.528+0000 7faee514b640 1 --2- 172.21.15.7:0/1568696358 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5603dee04070 0x5603df1babe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:42:52.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.528+0000 7faedffff640 1 --2- 172.21.15.7:0/1568696358 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5603dede3390 0x5603df1ba6a0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7faed00c9e30 tx=0x7faed0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af37fa5acb4db03a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:52.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.528+0000 7faebffff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:42:52.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.528+0000 7faebffff640 1 -- 172.21.15.7:0/1568696358 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faed00b8070 con 0x5603dede3390 2024-09-21T06:42:52.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.528+0000 7faebffff640 1 -- 172.21.15.7:0/1568696358 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7faed00d6df0 con 0x5603dede3390 2024-09-21T06:42:52.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.528+0000 7faeed122740 1 -- 172.21.15.7:0/1568696358 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faec8030020 con 0x5603dede3390 2024-09-21T06:42:52.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.528+0000 7faebffff640 1 -- 172.21.15.7:0/1568696358 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7faed00e8050 con 0x5603dede3390 2024-09-21T06:42:52.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.528+0000 7faeed122740 10 client.16701 fetch_fsmap learned FSMap version 25 2024-09-21T06:42:52.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.528+0000 7faeed122740 1 -- 172.21.15.7:0/1568696358 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5603df2333a0 con 0x5603dede3390 2024-09-21T06:42:52.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.528+0000 7faebffff640 1 -- 172.21.15.7:0/1568696358 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faec8030020 con 0x5603dede3390 2024-09-21T06:42:52.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.529+0000 7faebffff640 1 -- 172.21.15.7:0/1568696358 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7faed00ceb90 con 0x5603dede3390 2024-09-21T06:42:52.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.529+0000 7faeed122740 10 client.16701 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:42:52.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.529+0000 7faeed122740 10 client.16701 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:42:52.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.529+0000 7faeed122740 20 client.16701 populate_metadata read hostname 'smithi007' 2024-09-21T06:42:52.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.529+0000 7faeed122740 1 --2- 172.21.15.7:0/1568696358 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5603ded97da0 0x5603df235b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:52.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.529+0000 7faeed122740 4 client.16701 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:42:52.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.529+0000 7faeed122740 1 -- 172.21.15.7:0/1568696358 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5603df11f850 con 0x5603ded97da0 2024-09-21T06:42:52.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.529+0000 7faee494a640 1 --2- 172.21.15.7:0/1568696358 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5603ded97da0 0x5603df235b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:52.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.529+0000 7faebffff640 10 client.16701 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:42:52.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.529+0000 7faee494a640 1 --2- 172.21.15.7:0/1568696358 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5603ded97da0 0x5603df235b60 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb193865fd294c97 server_cookie=167d862d3bf26a60 in_seq=0 out_seq=0 2024-09-21T06:42:52.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.530+0000 7faebffff640 1 -- 172.21.15.7:0/1568696358 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+2930 (crc 0 0 0) 0x5603df11f850 con 0x5603ded97da0 2024-09-21T06:42:52.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.530+0000 7faebffff640 10 client.16701 handle_command_reply: tid=0 2024-09-21T06:42:52.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.530+0000 7faeed122740 1 client.16701 shutdown 2024-09-21T06:42:52.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.530+0000 7faeed122740 1 -- 172.21.15.7:0/1568696358 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5603dede3390 msgr2=0x5603df1ba6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:52.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.530+0000 7faeed122740 1 --2- 172.21.15.7:0/1568696358 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5603dede3390 0x5603df1ba6a0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7faed00c9e30 tx=0x7faed0000bc0 comp rx=0 tx=0).stop 2024-09-21T06:42:52.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.530+0000 7faeed122740 1 -- 172.21.15.7:0/1568696358 shutdown_connections 2024-09-21T06:42:52.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.530+0000 7faeed122740 1 --2- 172.21.15.7:0/1568696358 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5603ded97da0 0x5603df235b60 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:52.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.530+0000 7faeed122740 1 --2- 172.21.15.7:0/1568696358 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5603dee04070 0x5603df1babe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:52.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.530+0000 7faebffff640 0 client.16701 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:42:52.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.530+0000 7faeed122740 1 --2- 172.21.15.7:0/1568696358 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5603dede3390 0x5603df1ba6a0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:52.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.530+0000 7faeed122740 1 --2- 172.21.15.7:0/1568696358 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5603deddb1b0 0x5603df1bf1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:52.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.530+0000 7faeed122740 1 -- 172.21.15.7:0/1568696358 >> 172.21.15.7:0/1568696358 conn(0x5603dedf8460 msgr2=0x5603df1b5220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:52.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.530+0000 7faeed122740 1 -- 172.21.15.7:0/1568696358 shutdown_connections 2024-09-21T06:42:52.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.530+0000 7faeed122740 1 -- 172.21.15.7:0/1568696358 wait complete. 2024-09-21T06:42:52.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.530+0000 7faeed122740 20 client.16701 trim_cache size 0 max 16384 2024-09-21T06:42:52.538 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:42:52.538 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "no active scrubs running", 2024-09-21T06:42:52.538 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": {}, 2024-09-21T06:42:52.538 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_stats": { 2024-09-21T06:42:52.538 INFO:teuthology.orchestra.run.smithi007.stdout: "ef9eaabd-003a-44fb-8373-c854a9e15a71": { 2024-09-21T06:42:52.538 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:42:19.467946+0000", 2024-09-21T06:42:52.538 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:42:52.538 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:42:52.538 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:42:52.538 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:42:52.538 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:42:52.538 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:42:52.539 INFO:teuthology.orchestra.run.smithi007.stdout: "62fca477-b241-45f5-8185-bc78aeb8b19f": { 2024-09-21T06:42:52.539 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:40:12.744488+0000", 2024-09-21T06:42:52.539 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:42:52.539 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:42:52.539 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:42:52.539 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:42:52.539 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:42:52.539 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:42:52.539 INFO:teuthology.orchestra.run.smithi007.stdout: "a1ae5b3b-f158-44be-8ef4-d70e9ba879cc": { 2024-09-21T06:42:52.539 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:41:37.568453+0000", 2024-09-21T06:42:52.539 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:42:52.539 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:42:52.539 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:42:52.539 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:42:52.539 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:42:52.540 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:42:52.540 INFO:teuthology.orchestra.run.smithi007.stdout: "d7b6a90c-9ae1-4e02-93ad-335a7e9df1d7": { 2024-09-21T06:42:52.540 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:39:19.226139+0000", 2024-09-21T06:42:52.540 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:42:52.540 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:42:52.540 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:42:52.540 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:42:52.540 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:42:52.540 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:42:52.540 INFO:teuthology.orchestra.run.smithi007.stdout: "b0327167-8c41-4286-8afc-7f0780972fd7": { 2024-09-21T06:42:52.540 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:38:36.828657+0000", 2024-09-21T06:42:52.540 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:42:52.540 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:42:52.540 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:42:52.541 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:42:52.541 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:42:52.541 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:42:52.541 INFO:teuthology.orchestra.run.smithi007.stdout: "13441782-2231-4713-8ebd-068a941de47f": { 2024-09-21T06:42:52.541 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:39:30.219006+0000", 2024-09-21T06:42:52.541 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:42:52.541 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:42:52.541 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:42:52.541 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:42:52.541 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:42:52.542 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:42:52.542 INFO:teuthology.orchestra.run.smithi007.stdout: "5cbaaba2-6ab1-4f83-abd6-8c6eef4b5c42": { 2024-09-21T06:42:52.542 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:37:46.566272+0000", 2024-09-21T06:42:52.542 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:42:52.542 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:42:52.542 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:42:52.542 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:42:52.542 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:42:52.542 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:42:52.542 INFO:teuthology.orchestra.run.smithi007.stdout: "6231e9c1-14a2-40b5-be3c-76d87a0d733b": { 2024-09-21T06:42:52.542 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:37:02.484812+0000", 2024-09-21T06:42:52.542 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:42:52.542 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:42:52.542 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:42:52.542 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:42:52.543 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:42:52.543 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:42:52.543 INFO:teuthology.orchestra.run.smithi007.stdout: "310a0ec8-44bb-49ed-a534-3bc91cb1ee9d": { 2024-09-21T06:42:52.543 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:40:55.373968+0000", 2024-09-21T06:42:52.543 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:42:52.543 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:42:52.543 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:42:52.543 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:42:52.543 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:42:52.543 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:42:52.543 INFO:teuthology.orchestra.run.smithi007.stdout: "0b89345c-1f00-4efe-8ee9-4cb17e43584c": { 2024-09-21T06:42:52.543 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:36:19.500334+0000", 2024-09-21T06:42:52.543 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:42:52.543 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:42:52.543 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:42:52.544 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:42:52.544 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:42:52.544 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:42:52.544 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:42:52.544 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:42:52.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.531+0000 7faee6bae640 1 -- 172.21.15.7:0/3932090449 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7faecc0b6700 msgr2=0x7faecc0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:52.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.531+0000 7faee6bae640 1 --2- 172.21.15.7:0/3932090449 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7faecc0b6700 0x7faecc0b8c10 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7faed8009fd0 tx=0x7faed8009500 comp rx=0 tx=0).stop 2024-09-21T06:42:52.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.531+0000 7faee6bae640 1 -- 172.21.15.7:0/3932090449 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faee01094c0 msgr2=0x7faee0075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:52.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.531+0000 7faee6bae640 1 --2- 172.21.15.7:0/3932090449 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faee01094c0 0x7faee0075c50 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7faed0005ab0 tx=0x7faed0003b90 comp rx=0 tx=0).stop 2024-09-21T06:42:52.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.531+0000 7faee6bae640 1 -- 172.21.15.7:0/3932090449 shutdown_connections 2024-09-21T06:42:52.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.531+0000 7faee6bae640 1 --2- 172.21.15.7:0/3932090449 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7faecc0b6700 0x7faecc0b8c10 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:52.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.531+0000 7faee6bae640 1 --2- 172.21.15.7:0/3932090449 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faee0109e10 0x7faee0076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:52.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.531+0000 7faee6bae640 1 --2- 172.21.15.7:0/3932090449 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7faee01094c0 0x7faee0075c50 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:52.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.531+0000 7faee6bae640 1 --2- 172.21.15.7:0/3932090449 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7faee0103b80 0x7faee0075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:52.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.531+0000 7faee6bae640 1 -- 172.21.15.7:0/3932090449 >> 172.21.15.7:0/3932090449 conn(0x7faee00ff610 msgr2=0x7faee0108b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:52.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.531+0000 7faee6bae640 1 -- 172.21.15.7:0/3932090449 shutdown_connections 2024-09-21T06:42:52.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:52.531+0000 7faee6bae640 1 -- 172.21.15.7:0/3932090449 wait complete. 2024-09-21T06:42:53.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:42:53 smithi144 ceph-mon[34653]: pgmap v519: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-21T06:42:53.287 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:42:53 smithi007 ceph-mon[30983]: pgmap v519: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-21T06:42:53.317 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:42:53.317 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:42:53.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:42:53 smithi018 ceph-mon[34477]: pgmap v519: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-21T06:42:53.579 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:42:54.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:54.057+0000 7f2907fc7640 1 -- 172.21.15.7:0/914417990 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2900108d20 msgr2=0x7f290010f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:54.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:54.057+0000 7f2907fc7640 1 --2- 172.21.15.7:0/914417990 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2900108d20 0x7f290010f550 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f28f8009ca0 tx=0x7f28f802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:42:54.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:54.057+0000 7f2907fc7640 1 -- 172.21.15.7:0/914417990 shutdown_connections 2024-09-21T06:42:54.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:54.057+0000 7f2907fc7640 1 --2- 172.21.15.7:0/914417990 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2900108d20 0x7f290010f550 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:54.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:54.058+0000 7f2907fc7640 1 --2- 172.21.15.7:0/914417990 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f29001083d0 0x7f29001087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:54.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:54.058+0000 7f2907fc7640 1 --2- 172.21.15.7:0/914417990 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2900102ae0 0x7f2900102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:54.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:54.058+0000 7f2907fc7640 1 -- 172.21.15.7:0/914417990 >> 172.21.15.7:0/914417990 conn(0x7f2900079760 msgr2=0x7f2900079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:54.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:54.058+0000 7f2907fc7640 1 -- 172.21.15.7:0/914417990 shutdown_connections 2024-09-21T06:42:54.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:54.058+0000 7f2907fc7640 1 -- 172.21.15.7:0/914417990 wait complete. 2024-09-21T06:42:54.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:54.058+0000 7f2907fc7640 1 Processor -- start 2024-09-21T06:42:54.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:54.058+0000 7f2907fc7640 1 -- start start 2024-09-21T06:42:54.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:54.059+0000 7f2907fc7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2900102ae0 0x7f290019b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:54.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:54.059+0000 7f2907fc7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29001083d0 0x7f290019b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:54.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:54.059+0000 7f2907fc7640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2900108d20 0x7f290019bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:54.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:54.059+0000 7f2907fc7640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2900112990 con 0x7f2900102ae0 2024-09-21T06:42:54.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:54.059+0000 7f2907fc7640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2900112810 con 0x7f29001083d0 2024-09-21T06:42:54.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:54.059+0000 7f2907fc7640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2900112b10 con 0x7f2900108d20 2024-09-21T06:42:54.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:54.059+0000 7f2905d63640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2900102ae0 0x7f290019b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:54.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:54.059+0000 7f2905d63640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2900102ae0 0x7f290019b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53836/0 (socket says 172.21.15.7:53836) 2024-09-21T06:42:54.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:54.059+0000 7f2905d63640 1 -- 172.21.15.7:0/1333168253 learned_addr learned my addr 172.21.15.7:0/1333168253 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:42:54.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:54.059+0000 7f2905562640 1 --2- 172.21.15.7:0/1333168253 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29001083d0 0x7f290019b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:54.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:54.059+0000 7f2906564640 1 --2- 172.21.15.7:0/1333168253 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2900108d20 0x7f290019bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:54.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:54.059+0000 7f2905d63640 1 -- 172.21.15.7:0/1333168253 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2900108d20 msgr2=0x7f290019bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:54.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:54.059+0000 7f2905d63640 1 --2- 172.21.15.7:0/1333168253 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2900108d20 0x7f290019bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:54.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:54.059+0000 7f2905d63640 1 -- 172.21.15.7:0/1333168253 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29001083d0 msgr2=0x7f290019b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:54.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:54.059+0000 7f2905d63640 1 --2- 172.21.15.7:0/1333168253 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29001083d0 0x7f290019b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:54.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:54.059+0000 7f2905d63640 1 -- 172.21.15.7:0/1333168253 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29001a6400 con 0x7f2900102ae0 2024-09-21T06:42:54.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:54.059+0000 7f2905d63640 1 --2- 172.21.15.7:0/1333168253 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2900102ae0 0x7f290019b200 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f28fc00d950 tx=0x7f28fc00dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:54.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:54.059+0000 7f28f6ffd640 1 -- 172.21.15.7:0/1333168253 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28fc017070 con 0x7f2900102ae0 2024-09-21T06:42:54.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:54.060+0000 7f28f6ffd640 1 -- 172.21.15.7:0/1333168253 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f28fc00de80 con 0x7f2900102ae0 2024-09-21T06:42:54.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:54.060+0000 7f28f6ffd640 1 -- 172.21.15.7:0/1333168253 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28fc00f620 con 0x7f2900102ae0 2024-09-21T06:42:54.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:54.060+0000 7f2907fc7640 1 -- 172.21.15.7:0/1333168253 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29001a66f0 con 0x7f2900102ae0 2024-09-21T06:42:54.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:54.060+0000 7f2907fc7640 1 -- 172.21.15.7:0/1333168253 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29001a6c30 con 0x7f2900102ae0 2024-09-21T06:42:54.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:54.061+0000 7f2907fc7640 1 -- 172.21.15.7:0/1333168253 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2900103d10 con 0x7f2900102ae0 2024-09-21T06:42:54.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:54.063+0000 7f28f6ffd640 1 -- 172.21.15.7:0/1333168253 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f28fc009c30 con 0x7f2900102ae0 2024-09-21T06:42:54.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:54.064+0000 7f28f6ffd640 1 --2- 172.21.15.7:0/1333168253 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f28ec0b66b0 0x7f28ec0b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:54.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:54.064+0000 7f2905562640 1 --2- 172.21.15.7:0/1333168253 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f28ec0b66b0 0x7f28ec0b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:54.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:54.064+0000 7f28f6ffd640 1 -- 172.21.15.7:0/1333168253 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f28fc0e72c0 con 0x7f2900102ae0 2024-09-21T06:42:54.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:54.064+0000 7f2905562640 1 --2- 172.21.15.7:0/1333168253 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f28ec0b66b0 0x7f28ec0b8bc0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f2900105f20 tx=0x7f28f000a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:54.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:54.068+0000 7f28f6ffd640 1 -- 172.21.15.7:0/1333168253 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f28fc0ad870 con 0x7f2900102ae0 2024-09-21T06:42:54.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:54.293+0000 7f2907fc7640 1 -- 172.21.15.7:0/1333168253 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2900102ef0 con 0x7f2900102ae0 2024-09-21T06:42:54.296 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:42:54 smithi007 ceph-mon[30983]: pgmap v520: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-21T06:42:54.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:54.293+0000 7f28f6ffd640 1 -- 172.21.15.7:0/1333168253 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11899 (secure 0 0 0) 0x7f28fc0b1c50 con 0x7f2900102ae0 2024-09-21T06:42:54.297 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:42:54.297 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-21T06:36:10:753693+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2015971546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2015971546},{"type":"v1","addr":"172.21.15.7:6835","nonce":2015971546}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/2350816224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":2350816224},{"type":"v1","addr":"172.21.15.7:6837","nonce":2350816224}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14823,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/1669980572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":1669980572},{"type":"v1","addr":"172.21.15.7:6839","nonce":1669980572}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14835,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/2528308973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":2528308973},{"type":"v1","addr":"172.21.15.7:6841","nonce":2528308973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24623,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1337382979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1337382979},{"type":"v1","addr":"172.21.15.18:6833","nonce":1337382979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/2751454345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":2751454345},{"type":"v1","addr":"172.21.15.144:6833","nonce":2751454345}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:34:24.627168+0000","modified":"2024-09-21T06:36:10.737288+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24716,"mds_1":24688,"mds_2":24686},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24656":{"gid":24656,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6835/158884796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":158884796},{"type":"v1","addr":"172.21.15.18:6835","nonce":158884796}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6835/3636739922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3636739922},{"type":"v1","addr":"172.21.15.144:6835","nonce":3636739922}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24673":{"gid":24673,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6837/1126341753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":1126341753},{"type":"v1","addr":"172.21.15.144:6837","nonce":1126341753}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.18:6837/1539670694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1539670694},{"type":"v1","addr":"172.21.15.18:6837","nonce":1539670694}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24688":{"gid":24688,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.144:6839/4027821922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":4027821922},{"type":"v1","addr":"172.21.15.144:6839","nonce":4027821922}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24716":{"gid":24716,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.18:6839/3798713532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":3798713532},{"type":"v1","addr":"172.21.15.18:6839","nonce":3798713532}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24716,"qdb_cluster":[24716,24688,24686]},"id":1}]} 2024-09-21T06:42:54.297 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-21T06:42:54.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:54.296+0000 7f2907fc7640 1 -- 172.21.15.7:0/1333168253 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f28ec0b66b0 msgr2=0x7f28ec0b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:54.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:54.296+0000 7f2907fc7640 1 --2- 172.21.15.7:0/1333168253 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f28ec0b66b0 0x7f28ec0b8bc0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f2900105f20 tx=0x7f28f000a2d0 comp rx=0 tx=0).stop 2024-09-21T06:42:54.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:54.296+0000 7f2907fc7640 1 -- 172.21.15.7:0/1333168253 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2900102ae0 msgr2=0x7f290019b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:54.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:54.296+0000 7f2907fc7640 1 --2- 172.21.15.7:0/1333168253 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2900102ae0 0x7f290019b200 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f28fc00d950 tx=0x7f28fc00dd50 comp rx=0 tx=0).stop 2024-09-21T06:42:54.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:54.296+0000 7f2907fc7640 1 -- 172.21.15.7:0/1333168253 shutdown_connections 2024-09-21T06:42:54.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:54.296+0000 7f2907fc7640 1 --2- 172.21.15.7:0/1333168253 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f28ec0b66b0 0x7f28ec0b8bc0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:54.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:54.296+0000 7f2907fc7640 1 --2- 172.21.15.7:0/1333168253 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2900108d20 0x7f290019bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:54.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:54.296+0000 7f2907fc7640 1 --2- 172.21.15.7:0/1333168253 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29001083d0 0x7f290019b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:54.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:54.296+0000 7f2907fc7640 1 --2- 172.21.15.7:0/1333168253 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2900102ae0 0x7f290019b200 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:54.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:54.296+0000 7f2907fc7640 1 -- 172.21.15.7:0/1333168253 >> 172.21.15.7:0/1333168253 conn(0x7f2900079760 msgr2=0x7f29001043e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:54.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:54.296+0000 7f2907fc7640 1 -- 172.21.15.7:0/1333168253 shutdown_connections 2024-09-21T06:42:54.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:54.296+0000 7f2907fc7640 1 -- 172.21.15.7:0/1333168253 wait complete. 2024-09-21T06:42:54.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:42:54 smithi018 ceph-mon[34477]: pgmap v520: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-21T06:42:54.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:42:54 smithi144 ceph-mon[34653]: pgmap v520: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-21T06:42:54.870 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:42:55.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:42:55 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/1333168253' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:42:55.135 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:42:55.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:42:55 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/1333168253' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:42:55.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:42:55 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/1333168253' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:42:55.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.642+0000 7f2f8e514640 1 -- 172.21.15.7:0/32328552 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f88105380 msgr2=0x7f2f8810d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:55.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.642+0000 7f2f8e514640 1 --2- 172.21.15.7:0/32328552 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f88105380 0x7f2f8810d8d0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c009900 tx=0x7f2f7c02a410 comp rx=0 tx=0).stop 2024-09-21T06:42:55.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.642+0000 7f2f8e514640 1 -- 172.21.15.7:0/32328552 shutdown_connections 2024-09-21T06:42:55.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.642+0000 7f2f8e514640 1 --2- 172.21.15.7:0/32328552 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2f8810de60 0x7f2f88110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:55.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.642+0000 7f2f8e514640 1 --2- 172.21.15.7:0/32328552 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f88105380 0x7f2f8810d8d0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:55.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.642+0000 7f2f8e514640 1 --2- 172.21.15.7:0/32328552 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f88104a30 0x7f2f88104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:55.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.642+0000 7f2f8e514640 1 -- 172.21.15.7:0/32328552 >> 172.21.15.7:0/32328552 conn(0x7f2f88079760 msgr2=0x7f2f88079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:55.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.642+0000 7f2f8e514640 1 -- 172.21.15.7:0/32328552 shutdown_connections 2024-09-21T06:42:55.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.642+0000 7f2f8e514640 1 -- 172.21.15.7:0/32328552 wait complete. 2024-09-21T06:42:55.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.643+0000 7f2f8e514640 1 Processor -- start 2024-09-21T06:42:55.645 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.643+0000 7f2f8e514640 1 -- start start 2024-09-21T06:42:55.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.643+0000 7f2f8e514640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f88104a30 0x7f2f88102770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:55.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.643+0000 7f2f8e514640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2f88105380 0x7f2f88102cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:55.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.643+0000 7f2f8e514640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f8810de60 0x7f2f881031f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:55.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.643+0000 7f2f8e514640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2f88113b00 con 0x7f2f8810de60 2024-09-21T06:42:55.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.643+0000 7f2f8e514640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2f88113980 con 0x7f2f88105380 2024-09-21T06:42:55.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.643+0000 7f2f8e514640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2f88113c80 con 0x7f2f88104a30 2024-09-21T06:42:55.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.644+0000 7f2f8cab1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f8810de60 0x7f2f881031f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:55.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.644+0000 7f2f8cab1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f8810de60 0x7f2f881031f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53848/0 (socket says 172.21.15.7:53848) 2024-09-21T06:42:55.647 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.644+0000 7f2f8cab1640 1 -- 172.21.15.7:0/3089903084 learned_addr learned my addr 172.21.15.7:0/3089903084 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:42:55.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.644+0000 7f2f877fe640 1 --2- 172.21.15.7:0/3089903084 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2f88105380 0x7f2f88102cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:55.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.644+0000 7f2f87fff640 1 --2- 172.21.15.7:0/3089903084 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f88104a30 0x7f2f88102770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:55.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.644+0000 7f2f8cab1640 1 -- 172.21.15.7:0/3089903084 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f88104a30 msgr2=0x7f2f88102770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:55.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.644+0000 7f2f8cab1640 1 --2- 172.21.15.7:0/3089903084 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f88104a30 0x7f2f88102770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:55.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.644+0000 7f2f8cab1640 1 -- 172.21.15.7:0/3089903084 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2f88105380 msgr2=0x7f2f88102cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:55.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.644+0000 7f2f8cab1640 1 --2- 172.21.15.7:0/3089903084 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2f88105380 0x7f2f88102cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:55.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.644+0000 7f2f8cab1640 1 -- 172.21.15.7:0/3089903084 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f881a8810 con 0x7f2f8810de60 2024-09-21T06:42:55.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.644+0000 7f2f8cab1640 1 --2- 172.21.15.7:0/3089903084 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f8810de60 0x7f2f881031f0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f2f8000eaa0 tx=0x7f2f8000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:55.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.644+0000 7f2f857fa640 1 -- 172.21.15.7:0/3089903084 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f80004d20 con 0x7f2f8810de60 2024-09-21T06:42:55.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.644+0000 7f2f8e514640 1 -- 172.21.15.7:0/3089903084 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f881a8b00 con 0x7f2f8810de60 2024-09-21T06:42:55.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.644+0000 7f2f857fa640 1 -- 172.21.15.7:0/3089903084 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2f80005020 con 0x7f2f8810de60 2024-09-21T06:42:55.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.644+0000 7f2f857fa640 1 -- 172.21.15.7:0/3089903084 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f800116b0 con 0x7f2f8810de60 2024-09-21T06:42:55.648 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.644+0000 7f2f8e514640 1 -- 172.21.15.7:0/3089903084 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f881a9010 con 0x7f2f8810de60 2024-09-21T06:42:55.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.647+0000 7f2f94a88740 1 Processor -- start 2024-09-21T06:42:55.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.647+0000 7f2f857fa640 1 -- 172.21.15.7:0/3089903084 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f2f800051d0 con 0x7f2f8810de60 2024-09-21T06:42:55.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.647+0000 7f2f94a88740 1 -- start start 2024-09-21T06:42:55.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.647+0000 7f2f94a88740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562bf0496070 0x562bf083d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:55.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.647+0000 7f2f94a88740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562bf046d1b0 0x562bf083d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:55.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.648+0000 7f2f94a88740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562bf0475390 0x562bf083dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:55.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.648+0000 7f2f94a88740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x562bf07b3ea0 con 0x562bf0475390 2024-09-21T06:42:55.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.648+0000 7f2f94a88740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x562bf07a32d0 con 0x562bf046d1b0 2024-09-21T06:42:55.650 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.648+0000 7f2f94a88740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x562bf07a70e0 con 0x562bf0496070 2024-09-21T06:42:55.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.648+0000 7f2f877fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562bf0475390 0x562bf083dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:55.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.648+0000 7f2f877fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562bf0475390 0x562bf083dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53856/0 (socket says 172.21.15.7:53856) 2024-09-21T06:42:55.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.648+0000 7f2f877fe640 1 -- 172.21.15.7:0/3902242462 learned_addr learned my addr 172.21.15.7:0/3902242462 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:42:55.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.648+0000 7f2f877fe640 1 --2- 172.21.15.7:0/3902242462 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562bf0496070 0x562bf083d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:55.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.648+0000 7f2f87fff640 1 --2- 172.21.15.7:0/3902242462 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562bf046d1b0 0x562bf083d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:55.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.648+0000 7f2f877fe640 1 -- 172.21.15.7:0/3902242462 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562bf0496070 msgr2=0x562bf083d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:55.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.648+0000 7f2f877fe640 1 --2- 172.21.15.7:0/3902242462 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562bf0496070 0x562bf083d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:55.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.648+0000 7f2f877fe640 1 -- 172.21.15.7:0/3902242462 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562bf046d1b0 msgr2=0x562bf083d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:55.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.648+0000 7f2f877fe640 1 --2- 172.21.15.7:0/3902242462 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562bf046d1b0 0x562bf083d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:55.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.648+0000 7f2f877fe640 1 -- 172.21.15.7:0/3902242462 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562bf0501650 con 0x562bf0475390 2024-09-21T06:42:55.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.648+0000 7f2f87fff640 1 --2- 172.21.15.7:0/3902242462 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562bf046d1b0 0x562bf083d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:42:55.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.648+0000 7f2f857fa640 1 --2- 172.21.15.7:0/3089903084 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f2f700b6680 0x7f2f700b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:55.651 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.648+0000 7f2f877fe640 1 --2- 172.21.15.7:0/3902242462 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562bf0475390 0x562bf083dd40 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c0057c0 tx=0x7f2f7c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd57e43fb53789e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:55.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.649+0000 7f2f87fff640 1 --2- 172.21.15.7:0/3089903084 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f2f700b6680 0x7f2f700b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:55.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.649+0000 7f2f857fa640 1 -- 172.21.15.7:0/3089903084 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f2f800e7840 con 0x7f2f8810de60 2024-09-21T06:42:55.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.649+0000 7f2f6e7fc640 1 -- 172.21.15.7:0/3902242462 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f7c035070 con 0x562bf0475390 2024-09-21T06:42:55.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.649+0000 7f2f6e7fc640 1 -- 172.21.15.7:0/3902242462 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2f7c005030 con 0x562bf0475390 2024-09-21T06:42:55.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.649+0000 7f2f6e7fc640 1 -- 172.21.15.7:0/3902242462 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f7c0044e0 con 0x562bf0475390 2024-09-21T06:42:55.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.650+0000 7f2f94a88740 1 -- 172.21.15.7:0/3902242462 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562bf0475390 msgr2=0x562bf083dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:55.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.650+0000 7f2f87fff640 1 --2- 172.21.15.7:0/3089903084 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f2f700b6680 0x7f2f700b8b90 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x562bf083bf40 tx=0x7f2f78008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:55.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.650+0000 7f2f94a88740 1 --2- 172.21.15.7:0/3902242462 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562bf0475390 0x562bf083dd40 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c0057c0 tx=0x7f2f7c000bc0 comp rx=0 tx=0).stop 2024-09-21T06:42:55.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.650+0000 7f2f94a88740 1 -- 172.21.15.7:0/3902242462 shutdown_connections 2024-09-21T06:42:55.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.650+0000 7f2f94a88740 1 --2- 172.21.15.7:0/3902242462 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562bf0475390 0x562bf083dd40 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:55.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.650+0000 7f2f94a88740 1 --2- 172.21.15.7:0/3902242462 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562bf046d1b0 0x562bf083d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:55.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.650+0000 7f2f94a88740 1 --2- 172.21.15.7:0/3902242462 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562bf0496070 0x562bf083d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:55.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.650+0000 7f2f94a88740 1 -- 172.21.15.7:0/3902242462 >> 172.21.15.7:0/3902242462 conn(0x562bf048a460 msgr2=0x562bf083b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:55.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.650+0000 7f2f94a88740 1 -- 172.21.15.7:0/3902242462 shutdown_connections 2024-09-21T06:42:55.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.650+0000 7f2f94a88740 1 -- 172.21.15.7:0/3902242462 wait complete. 2024-09-21T06:42:55.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.650+0000 7f2f94a88740 1 -- start start 2024-09-21T06:42:55.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.650+0000 7f2f94a88740 1 Processor -- start 2024-09-21T06:42:55.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.651+0000 7f2f94a88740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562bf046d1b0 0x562bf08489d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:55.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.651+0000 7f2f94a88740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562bf0475390 0x562bf0848f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:55.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.651+0000 7f2f94a88740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562bf0496070 0x562bf0854d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:55.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.651+0000 7f2f94a88740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x562bf0604700 con 0x562bf0475390 2024-09-21T06:42:55.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.651+0000 7f2f94a88740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x562bf073e160 con 0x562bf0496070 2024-09-21T06:42:55.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.651+0000 7f2f94a88740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x562bf084ba40 con 0x562bf046d1b0 2024-09-21T06:42:55.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.651+0000 7f2f94a88740 10 client.0 _ll_register_callbacks cb 0x562bf07579e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:42:55.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.651+0000 7f2f877fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562bf0475390 0x562bf0848f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:55.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.651+0000 7f2f877fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562bf0475390 0x562bf0848f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53860/0 (socket says 172.21.15.7:53860) 2024-09-21T06:42:55.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.651+0000 7f2f877fe640 1 -- 172.21.15.7:0/3635613693 learned_addr learned my addr 172.21.15.7:0/3635613693 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:42:55.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.651+0000 7f2f87fff640 1 --2- 172.21.15.7:0/3635613693 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562bf046d1b0 0x562bf08489d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:55.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.651+0000 7f2f8cab1640 1 --2- 172.21.15.7:0/3635613693 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562bf0496070 0x562bf0854d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:55.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.651+0000 7f2f877fe640 1 -- 172.21.15.7:0/3635613693 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562bf046d1b0 msgr2=0x562bf08489d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:55.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.651+0000 7f2f877fe640 1 --2- 172.21.15.7:0/3635613693 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562bf046d1b0 0x562bf08489d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:55.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.651+0000 7f2f877fe640 1 -- 172.21.15.7:0/3635613693 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562bf0496070 msgr2=0x562bf0854d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:55.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.651+0000 7f2f877fe640 1 --2- 172.21.15.7:0/3635613693 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562bf0496070 0x562bf0854d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:55.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.651+0000 7f2f877fe640 1 -- 172.21.15.7:0/3635613693 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562bf076bc90 con 0x562bf0475390 2024-09-21T06:42:55.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.652+0000 7f2f877fe640 1 --2- 172.21.15.7:0/3635613693 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562bf0475390 0x562bf0848f10 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c02a450 tx=0x7f2f7c031520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8199ac9d19ee66c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:55.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.652+0000 7f2f677fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:42:55.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.652+0000 7f2f677fe640 1 -- 172.21.15.7:0/3635613693 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f7c035050 con 0x562bf0475390 2024-09-21T06:42:55.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.652+0000 7f2f677fe640 1 -- 172.21.15.7:0/3635613693 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f2f7c0053e0 con 0x562bf0475390 2024-09-21T06:42:55.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.652+0000 7f2f94a88740 1 -- 172.21.15.7:0/3635613693 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f7c005030 con 0x562bf0475390 2024-09-21T06:42:55.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.652+0000 7f2f677fe640 1 -- 172.21.15.7:0/3635613693 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2f7c058050 con 0x562bf0475390 2024-09-21T06:42:55.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.652+0000 7f2f94a88740 10 client.16719 fetch_fsmap learned FSMap version 25 2024-09-21T06:42:55.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.652+0000 7f2f94a88740 1 -- 172.21.15.7:0/3635613693 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562bf08577e0 con 0x562bf0475390 2024-09-21T06:42:55.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.652+0000 7f2f677fe640 1 -- 172.21.15.7:0/3635613693 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2f7c005030 con 0x562bf0475390 2024-09-21T06:42:55.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.652+0000 7f2f677fe640 1 -- 172.21.15.7:0/3635613693 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f2f7c004c70 con 0x562bf0475390 2024-09-21T06:42:55.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.652+0000 7f2f94a88740 10 client.16719 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:42:55.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.652+0000 7f2f94a88740 10 client.16719 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-21T06:42:55.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.652+0000 7f2f94a88740 20 client.16719 populate_metadata read hostname 'smithi007' 2024-09-21T06:42:55.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.653+0000 7f2f94a88740 1 --2- 172.21.15.7:0/3635613693 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x562bf04549f0 0x562bf085ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:55.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.653+0000 7f2f94a88740 4 client.16719 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:42:55.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.653+0000 7f2f94a88740 1 -- 172.21.15.7:0/3635613693 --> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562bf07b5df0 con 0x562bf04549f0 2024-09-21T06:42:55.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.653+0000 7f2f87fff640 1 --2- 172.21.15.7:0/3635613693 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x562bf04549f0 0x562bf085ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:55.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.653+0000 7f2f677fe640 10 client.16719 ms_handle_connect on v2:172.21.15.18:6836/1539670694 2024-09-21T06:42:55.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.653+0000 7f2f87fff640 1 --2- 172.21.15.7:0/3635613693 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x562bf04549f0 0x562bf085ab40 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1548a3e5d2de69f8 server_cookie=9ff6c6f78528db51 in_seq=0 out_seq=0 2024-09-21T06:42:55.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.654+0000 7f2f677fe640 1 -- 172.21.15.7:0/3635613693 <== mds.2 v2:172.21.15.18:6836/1539670694 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562bf07b5df0 con 0x562bf04549f0 2024-09-21T06:42:55.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.654+0000 7f2f677fe640 10 client.16719 handle_command_reply: tid=0 2024-09-21T06:42:55.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.654+0000 7f2f94a88740 1 client.16719 shutdown 2024-09-21T06:42:55.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.654+0000 7f2f94a88740 1 -- 172.21.15.7:0/3635613693 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562bf0475390 msgr2=0x562bf0848f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:55.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.654+0000 7f2f94a88740 1 --2- 172.21.15.7:0/3635613693 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562bf0475390 0x562bf0848f10 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c02a450 tx=0x7f2f7c031520 comp rx=0 tx=0).stop 2024-09-21T06:42:55.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.655+0000 7f2f94a88740 1 -- 172.21.15.7:0/3635613693 shutdown_connections 2024-09-21T06:42:55.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.655+0000 7f2f94a88740 1 --2- 172.21.15.7:0/3635613693 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x562bf04549f0 0x562bf085ab40 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:55.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.655+0000 7f2f94a88740 1 --2- 172.21.15.7:0/3635613693 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562bf0496070 0x562bf0854d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:55.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.655+0000 7f2f94a88740 1 --2- 172.21.15.7:0/3635613693 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562bf0475390 0x562bf0848f10 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:55.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.655+0000 7f2f677fe640 0 client.16719 ms_handle_reset on v2:172.21.15.18:6836/1539670694 2024-09-21T06:42:55.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.655+0000 7f2f94a88740 1 --2- 172.21.15.7:0/3635613693 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562bf046d1b0 0x562bf08489d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:55.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.655+0000 7f2f94a88740 1 -- 172.21.15.7:0/3635613693 >> 172.21.15.7:0/3635613693 conn(0x562bf048a460 msgr2=0x562bf0840450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:55.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.655+0000 7f2f94a88740 1 -- 172.21.15.7:0/3635613693 shutdown_connections 2024-09-21T06:42:55.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.655+0000 7f2f94a88740 1 -- 172.21.15.7:0/3635613693 wait complete. 2024-09-21T06:42:55.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.655+0000 7f2f94a88740 20 client.16719 trim_cache size 0 max 16384 2024-09-21T06:42:55.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.668+0000 7f2f94a88740 1 Processor -- start 2024-09-21T06:42:55.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.668+0000 7f2f94a88740 1 -- start start 2024-09-21T06:42:55.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.668+0000 7f2f94a88740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562bf048a460 0x562bf083ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:55.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.668+0000 7f2f94a88740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562bf046d1b0 0x562bf0854cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:55.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.668+0000 7f2f94a88740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562bf0475390 0x562bf0845bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:55.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.668+0000 7f2f94a88740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2f881b40b0 con 0x562bf048a460 2024-09-21T06:42:55.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.668+0000 7f2f94a88740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2f881b1980 con 0x562bf046d1b0 2024-09-21T06:42:55.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.668+0000 7f2f94a88740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2f881af7d0 con 0x562bf0475390 2024-09-21T06:42:55.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.668+0000 7f2f87fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562bf048a460 0x562bf083ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:55.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.668+0000 7f2f87fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562bf048a460 0x562bf083ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53872/0 (socket says 172.21.15.7:53872) 2024-09-21T06:42:55.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.668+0000 7f2f87fff640 1 -- 172.21.15.7:0/3932250961 learned_addr learned my addr 172.21.15.7:0/3932250961 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:42:55.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.669+0000 7f2f8cab1640 1 --2- 172.21.15.7:0/3932250961 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562bf0475390 0x562bf0845bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:55.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.669+0000 7f2f877fe640 1 --2- 172.21.15.7:0/3932250961 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562bf046d1b0 0x562bf0854cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:55.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.669+0000 7f2f87fff640 1 -- 172.21.15.7:0/3932250961 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562bf0475390 msgr2=0x562bf0845bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:55.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.669+0000 7f2f87fff640 1 --2- 172.21.15.7:0/3932250961 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562bf0475390 0x562bf0845bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:55.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.669+0000 7f2f87fff640 1 -- 172.21.15.7:0/3932250961 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562bf046d1b0 msgr2=0x562bf0854cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:55.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.669+0000 7f2f87fff640 1 --2- 172.21.15.7:0/3932250961 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562bf046d1b0 0x562bf0854cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:55.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.669+0000 7f2f87fff640 1 -- 172.21.15.7:0/3932250961 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562bf0849c90 con 0x562bf048a460 2024-09-21T06:42:55.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.669+0000 7f2f87fff640 1 --2- 172.21.15.7:0/3932250961 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562bf048a460 0x562bf083ea00 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f2f881041c0 tx=0x7f2f78014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e625cb27de080b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:55.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.669+0000 7f2f6dffb640 1 -- 172.21.15.7:0/3932250961 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f7802f070 con 0x562bf048a460 2024-09-21T06:42:55.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.669+0000 7f2f6dffb640 1 -- 172.21.15.7:0/3932250961 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2f7801a040 con 0x562bf048a460 2024-09-21T06:42:55.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.669+0000 7f2f6dffb640 1 -- 172.21.15.7:0/3932250961 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f78022dc0 con 0x562bf048a460 2024-09-21T06:42:55.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.670+0000 7f2f94a88740 1 -- 172.21.15.7:0/3932250961 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562bf048a460 msgr2=0x562bf083ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:55.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.670+0000 7f2f94a88740 1 --2- 172.21.15.7:0/3932250961 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562bf048a460 0x562bf083ea00 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f2f881041c0 tx=0x7f2f78014000 comp rx=0 tx=0).stop 2024-09-21T06:42:55.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.670+0000 7f2f94a88740 1 -- 172.21.15.7:0/3932250961 shutdown_connections 2024-09-21T06:42:55.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.670+0000 7f2f94a88740 1 --2- 172.21.15.7:0/3932250961 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562bf0475390 0x562bf0845bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:55.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.670+0000 7f2f94a88740 1 --2- 172.21.15.7:0/3932250961 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562bf046d1b0 0x562bf0854cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:55.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.670+0000 7f2f94a88740 1 --2- 172.21.15.7:0/3932250961 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562bf048a460 0x562bf083ea00 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:55.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.670+0000 7f2f94a88740 1 -- 172.21.15.7:0/3932250961 >> 172.21.15.7:0/3932250961 conn(0x562bf0849090 msgr2=0x562bf083e2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:55.675 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.670+0000 7f2f94a88740 1 -- 172.21.15.7:0/3932250961 shutdown_connections 2024-09-21T06:42:55.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.670+0000 7f2f94a88740 1 -- 172.21.15.7:0/3932250961 wait complete. 2024-09-21T06:42:55.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.670+0000 7f2f94a88740 1 -- start start 2024-09-21T06:42:55.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.671+0000 7f2f94a88740 1 Processor -- start 2024-09-21T06:42:55.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.671+0000 7f2f94a88740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562bf046d1b0 0x562bf085be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:55.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.671+0000 7f2f94a88740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562bf0475390 0x562bf085c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:55.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.671+0000 7f2f94a88740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562bf048a460 0x562bf08c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:55.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.671+0000 7f2f94a88740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2f881afe40 con 0x562bf046d1b0 2024-09-21T06:42:55.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.671+0000 7f2f94a88740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2f881b12b0 con 0x562bf048a460 2024-09-21T06:42:55.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.671+0000 7f2f94a88740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2f881b0510 con 0x562bf0475390 2024-09-21T06:42:55.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.671+0000 7f2f87fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562bf046d1b0 0x562bf085be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:55.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.671+0000 7f2f94a88740 10 client.0 _ll_register_callbacks cb 0x7f2f7c032e20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:42:55.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.671+0000 7f2f87fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562bf046d1b0 0x562bf085be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53884/0 (socket says 172.21.15.7:53884) 2024-09-21T06:42:55.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.671+0000 7f2f87fff640 1 -- 172.21.15.7:0/581689276 learned_addr learned my addr 172.21.15.7:0/581689276 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:42:55.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.671+0000 7f2f877fe640 1 --2- 172.21.15.7:0/581689276 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562bf0475390 0x562bf085c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:55.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.671+0000 7f2f8cab1640 1 --2- 172.21.15.7:0/581689276 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562bf048a460 0x562bf08c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:55.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.671+0000 7f2f87fff640 1 -- 172.21.15.7:0/581689276 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562bf0475390 msgr2=0x562bf085c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:55.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.671+0000 7f2f87fff640 1 --2- 172.21.15.7:0/581689276 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562bf0475390 0x562bf085c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:55.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.671+0000 7f2f87fff640 1 -- 172.21.15.7:0/581689276 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562bf048a460 msgr2=0x562bf08c42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:55.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.671+0000 7f2f87fff640 1 --2- 172.21.15.7:0/581689276 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562bf048a460 0x562bf08c42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:55.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.671+0000 7f2f87fff640 1 -- 172.21.15.7:0/581689276 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562bf085cc50 con 0x562bf046d1b0 2024-09-21T06:42:55.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.672+0000 7f2f87fff640 1 --2- 172.21.15.7:0/581689276 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562bf046d1b0 0x562bf085be70 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f2f78004700 tx=0x7f2f78011c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=333c8e70cc65b785 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:55.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.672+0000 7f2f677fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:42:55.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.672+0000 7f2f677fe640 1 -- 172.21.15.7:0/581689276 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f78038060 con 0x562bf046d1b0 2024-09-21T06:42:55.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.672+0000 7f2f677fe640 1 -- 172.21.15.7:0/581689276 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f2f78028040 con 0x562bf046d1b0 2024-09-21T06:42:55.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.672+0000 7f2f94a88740 1 -- 172.21.15.7:0/581689276 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f7801a040 con 0x562bf046d1b0 2024-09-21T06:42:55.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.672+0000 7f2f677fe640 1 -- 172.21.15.7:0/581689276 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2f7802f050 con 0x562bf046d1b0 2024-09-21T06:42:55.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.672+0000 7f2f94a88740 10 client.16725 fetch_fsmap learned FSMap version 25 2024-09-21T06:42:55.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.672+0000 7f2f94a88740 1 -- 172.21.15.7:0/581689276 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562bf08c5850 con 0x562bf046d1b0 2024-09-21T06:42:55.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.672+0000 7f2f677fe640 1 -- 172.21.15.7:0/581689276 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2f7801a040 con 0x562bf046d1b0 2024-09-21T06:42:55.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.672+0000 7f2f677fe640 1 -- 172.21.15.7:0/581689276 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f2f780143e0 con 0x562bf046d1b0 2024-09-21T06:42:55.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.672+0000 7f2f94a88740 10 client.16725 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:42:55.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.672+0000 7f2f94a88740 10 client.16725 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-21T06:42:55.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.672+0000 7f2f94a88740 20 client.16725 populate_metadata read hostname 'smithi007' 2024-09-21T06:42:55.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.673+0000 7f2f94a88740 1 --2- 172.21.15.7:0/581689276 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x562bf0496070 0x562bf08c7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:55.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.673+0000 7f2f94a88740 4 client.16725 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:42:55.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.673+0000 7f2f94a88740 1 -- 172.21.15.7:0/581689276 --> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562bf07b18a0 con 0x562bf0496070 2024-09-21T06:42:55.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.673+0000 7f2f877fe640 1 --2- 172.21.15.7:0/581689276 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x562bf0496070 0x562bf08c7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:55.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.673+0000 7f2f877fe640 1 --2- 172.21.15.7:0/581689276 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x562bf0496070 0x562bf08c7fe0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fb19768d9d0ac2c0 server_cookie=ac86c53ad5e4f237 in_seq=0 out_seq=0 2024-09-21T06:42:55.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.673+0000 7f2f677fe640 10 client.16725 ms_handle_connect on v2:172.21.15.18:6836/1539670694 2024-09-21T06:42:55.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.673+0000 7f2f677fe640 1 -- 172.21.15.7:0/581689276 <== mds.2 v2:172.21.15.18:6836/1539670694 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562bf07b18a0 con 0x562bf0496070 2024-09-21T06:42:55.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.673+0000 7f2f677fe640 10 client.16725 handle_command_reply: tid=0 2024-09-21T06:42:55.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.673+0000 7f2f94a88740 1 client.16725 shutdown 2024-09-21T06:42:55.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.674+0000 7f2f94a88740 1 -- 172.21.15.7:0/581689276 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562bf046d1b0 msgr2=0x562bf085be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:55.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.674+0000 7f2f94a88740 1 --2- 172.21.15.7:0/581689276 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562bf046d1b0 0x562bf085be70 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f2f78004700 tx=0x7f2f78011c50 comp rx=0 tx=0).stop 2024-09-21T06:42:55.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.674+0000 7f2f94a88740 1 -- 172.21.15.7:0/581689276 shutdown_connections 2024-09-21T06:42:55.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.674+0000 7f2f94a88740 1 --2- 172.21.15.7:0/581689276 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x562bf0496070 0x562bf08c7fe0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:55.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.674+0000 7f2f677fe640 0 client.16725 ms_handle_reset on v2:172.21.15.18:6836/1539670694 2024-09-21T06:42:55.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.674+0000 7f2f94a88740 1 --2- 172.21.15.7:0/581689276 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562bf048a460 0x562bf08c42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:55.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.674+0000 7f2f94a88740 1 --2- 172.21.15.7:0/581689276 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562bf0475390 0x562bf085c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:55.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.674+0000 7f2f94a88740 1 --2- 172.21.15.7:0/581689276 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562bf046d1b0 0x562bf085be70 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:55.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.674+0000 7f2f94a88740 1 -- 172.21.15.7:0/581689276 >> 172.21.15.7:0/581689276 conn(0x562bf0849090 msgr2=0x562bf083ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:55.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.674+0000 7f2f94a88740 1 -- 172.21.15.7:0/581689276 shutdown_connections 2024-09-21T06:42:55.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.674+0000 7f2f94a88740 1 -- 172.21.15.7:0/581689276 wait complete. 2024-09-21T06:42:55.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.674+0000 7f2f94a88740 20 client.16725 trim_cache size 0 max 16384 2024-09-21T06:42:55.680 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:42:55.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.674+0000 7f2f8e514640 1 -- 172.21.15.7:0/3089903084 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f2f700b6680 msgr2=0x7f2f700b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:55.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.674+0000 7f2f8e514640 1 --2- 172.21.15.7:0/3089903084 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f2f700b6680 0x7f2f700b8b90 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x562bf083bf40 tx=0x7f2f78008040 comp rx=0 tx=0).stop 2024-09-21T06:42:55.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.674+0000 7f2f8e514640 1 -- 172.21.15.7:0/3089903084 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f8810de60 msgr2=0x7f2f881031f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:55.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.674+0000 7f2f8e514640 1 --2- 172.21.15.7:0/3089903084 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f8810de60 0x7f2f881031f0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f2f8000eaa0 tx=0x7f2f8000eea0 comp rx=0 tx=0).stop 2024-09-21T06:42:55.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.675+0000 7f2f8e514640 1 -- 172.21.15.7:0/3089903084 shutdown_connections 2024-09-21T06:42:55.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.675+0000 7f2f8e514640 1 --2- 172.21.15.7:0/3089903084 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f2f700b6680 0x7f2f700b8b90 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:55.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.675+0000 7f2f8e514640 1 --2- 172.21.15.7:0/3089903084 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2f8810de60 0x7f2f881031f0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:55.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.675+0000 7f2f8e514640 1 --2- 172.21.15.7:0/3089903084 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2f88105380 0x7f2f88102cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:55.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.675+0000 7f2f8e514640 1 --2- 172.21.15.7:0/3089903084 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2f88104a30 0x7f2f88102770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:55.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.675+0000 7f2f8e514640 1 -- 172.21.15.7:0/3089903084 >> 172.21.15.7:0/3089903084 conn(0x7f2f88079760 msgr2=0x7f2f880ff790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:55.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.675+0000 7f2f8e514640 1 -- 172.21.15.7:0/3089903084 shutdown_connections 2024-09-21T06:42:55.682 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:55.675+0000 7f2f8e514640 1 -- 172.21.15.7:0/3089903084 wait complete. 2024-09-21T06:42:56.321 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:42:56 smithi007 ceph-mon[30983]: pgmap v521: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:42:56.349 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:42:56.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:42:56 smithi018 ceph-mon[34477]: pgmap v521: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:42:56.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:42:56 smithi144 ceph-mon[34653]: pgmap v521: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:42:56.608 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:42:57.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.069+0000 7f15b7741640 1 -- 172.21.15.7:0/3378999875 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f15b0102f40 msgr2=0x7f15b010fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:57.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.069+0000 7f15b7741640 1 --2- 172.21.15.7:0/3378999875 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f15b0102f40 0x7f15b010fc60 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f15a0009900 tx=0x7f15a002a480 comp rx=0 tx=0).stop 2024-09-21T06:42:57.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.069+0000 7f15b7741640 1 -- 172.21.15.7:0/3378999875 shutdown_connections 2024-09-21T06:42:57.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.069+0000 7f15b7741640 1 --2- 172.21.15.7:0/3378999875 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15b01101a0 0x7f15b01125c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:57.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.069+0000 7f15b7741640 1 --2- 172.21.15.7:0/3378999875 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f15b0102f40 0x7f15b010fc60 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:57.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.069+0000 7f15b7741640 1 --2- 172.21.15.7:0/3378999875 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f15b01025f0 0x7f15b0102a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:57.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.069+0000 7f15b7741640 1 -- 172.21.15.7:0/3378999875 >> 172.21.15.7:0/3378999875 conn(0x7f15b0079740 msgr2=0x7f15b0079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:57.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.069+0000 7f15b7741640 1 -- 172.21.15.7:0/3378999875 shutdown_connections 2024-09-21T06:42:57.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.069+0000 7f15b7741640 1 -- 172.21.15.7:0/3378999875 wait complete. 2024-09-21T06:42:57.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.070+0000 7f15b7741640 1 Processor -- start 2024-09-21T06:42:57.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.070+0000 7f15b7741640 1 -- start start 2024-09-21T06:42:57.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.070+0000 7f15b7741640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f15b01025f0 0x7f15b019c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:57.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.070+0000 7f15b7741640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f15b0102f40 0x7f15b019ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:57.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.070+0000 7f15b7741640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15b01101a0 0x7f15b01a1f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:57.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.070+0000 7f15b7741640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f15b0115c90 con 0x7f15b01025f0 2024-09-21T06:42:57.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.070+0000 7f15b7741640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f15b0115b10 con 0x7f15b01101a0 2024-09-21T06:42:57.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.070+0000 7f15b7741640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f15b0115e10 con 0x7f15b0102f40 2024-09-21T06:42:57.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.070+0000 7f15b54dd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f15b01025f0 0x7f15b019c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:57.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.070+0000 7f15b54dd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f15b01025f0 0x7f15b019c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53900/0 (socket says 172.21.15.7:53900) 2024-09-21T06:42:57.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.070+0000 7f15b54dd640 1 -- 172.21.15.7:0/2352652784 learned_addr learned my addr 172.21.15.7:0/2352652784 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:42:57.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.070+0000 7f15b5cde640 1 --2- 172.21.15.7:0/2352652784 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15b01101a0 0x7f15b01a1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:57.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.070+0000 7f15b4cdc640 1 --2- 172.21.15.7:0/2352652784 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f15b0102f40 0x7f15b019ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:57.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.070+0000 7f15b54dd640 1 -- 172.21.15.7:0/2352652784 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f15b0102f40 msgr2=0x7f15b019ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:57.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.070+0000 7f15b54dd640 1 --2- 172.21.15.7:0/2352652784 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f15b0102f40 0x7f15b019ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:57.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.071+0000 7f15b54dd640 1 -- 172.21.15.7:0/2352652784 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15b01101a0 msgr2=0x7f15b01a1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:57.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.071+0000 7f15b54dd640 1 --2- 172.21.15.7:0/2352652784 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15b01101a0 0x7f15b01a1f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:57.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.071+0000 7f15b54dd640 1 -- 172.21.15.7:0/2352652784 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15b01a2690 con 0x7f15b01025f0 2024-09-21T06:42:57.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.071+0000 7f15b4cdc640 1 --2- 172.21.15.7:0/2352652784 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f15b0102f40 0x7f15b019ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:42:57.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.071+0000 7f15b54dd640 1 --2- 172.21.15.7:0/2352652784 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f15b01025f0 0x7f15b019c720 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f15ac00d770 tx=0x7f15ac00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:57.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.071+0000 7f15a67fc640 1 -- 172.21.15.7:0/2352652784 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15ac017070 con 0x7f15b01025f0 2024-09-21T06:42:57.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.071+0000 7f15a67fc640 1 -- 172.21.15.7:0/2352652784 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f15ac0054d0 con 0x7f15b01025f0 2024-09-21T06:42:57.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.071+0000 7f15b7741640 1 -- 172.21.15.7:0/2352652784 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15b01a2980 con 0x7f15b01025f0 2024-09-21T06:42:57.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.071+0000 7f15a67fc640 1 -- 172.21.15.7:0/2352652784 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15ac004c30 con 0x7f15b01025f0 2024-09-21T06:42:57.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.071+0000 7f15b7741640 1 -- 172.21.15.7:0/2352652784 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15b01a90e0 con 0x7f15b01025f0 2024-09-21T06:42:57.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.074+0000 7f15a67fc640 1 -- 172.21.15.7:0/2352652784 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f15ac004e10 con 0x7f15b01025f0 2024-09-21T06:42:57.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.074+0000 7f15bdcb5740 1 Processor -- start 2024-09-21T06:42:57.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.074+0000 7f15bdcb5740 1 -- start start 2024-09-21T06:42:57.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.074+0000 7f15bdcb5740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5560119ed070 0x556011d946a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:57.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.074+0000 7f15bdcb5740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5560119c41b0 0x556011d94be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:57.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.074+0000 7f15bdcb5740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5560119cc390 0x556011d95120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:57.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.074+0000 7f15bdcb5740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x556011d0aea0 con 0x5560119cc390 2024-09-21T06:42:57.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.074+0000 7f15bdcb5740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x556011cfa2d0 con 0x5560119c41b0 2024-09-21T06:42:57.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.074+0000 7f15bdcb5740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x556011cfe0e0 con 0x5560119ed070 2024-09-21T06:42:57.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.075+0000 7f15b4cdc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5560119cc390 0x556011d95120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:57.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.075+0000 7f15b54dd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5560119c41b0 0x556011d94be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:57.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.075+0000 7f15b4cdc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5560119cc390 0x556011d95120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53914/0 (socket says 172.21.15.7:53914) 2024-09-21T06:42:57.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.075+0000 7f15b4cdc640 1 -- 172.21.15.7:0/2877999167 learned_addr learned my addr 172.21.15.7:0/2877999167 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:42:57.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.075+0000 7f15b5cde640 1 --2- 172.21.15.7:0/2877999167 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5560119ed070 0x556011d946a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:57.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.075+0000 7f15a67fc640 1 --2- 172.21.15.7:0/2352652784 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f159c0b6680 0x7f159c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:57.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.075+0000 7f15b4cdc640 1 -- 172.21.15.7:0/2877999167 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5560119ed070 msgr2=0x556011d946a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:57.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.075+0000 7f15b4cdc640 1 --2- 172.21.15.7:0/2877999167 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5560119ed070 0x556011d946a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:57.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.075+0000 7f15b4cdc640 1 -- 172.21.15.7:0/2877999167 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5560119c41b0 msgr2=0x556011d94be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:57.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.075+0000 7f15b4cdc640 1 --2- 172.21.15.7:0/2877999167 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5560119c41b0 0x556011d94be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:57.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.075+0000 7f15b4cdc640 1 -- 172.21.15.7:0/2877999167 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556011a58650 con 0x5560119cc390 2024-09-21T06:42:57.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.075+0000 7f15b5cde640 1 --2- 172.21.15.7:0/2352652784 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f159c0b6680 0x7f159c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:57.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.075+0000 7f15a67fc640 1 -- 172.21.15.7:0/2352652784 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f15ac0e71d0 con 0x7f15b01025f0 2024-09-21T06:42:57.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.075+0000 7f15b4cdc640 1 --2- 172.21.15.7:0/2877999167 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5560119cc390 0x556011d95120 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f15a002a9a0 tx=0x7f15a0032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15b38952252aff9d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:57.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.075+0000 7f159b7fe640 1 -- 172.21.15.7:0/2877999167 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a003f070 con 0x5560119cc390 2024-09-21T06:42:57.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.075+0000 7f159b7fe640 1 -- 172.21.15.7:0/2877999167 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f15a00316a0 con 0x5560119cc390 2024-09-21T06:42:57.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.076+0000 7f159b7fe640 1 -- 172.21.15.7:0/2877999167 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a0035070 con 0x5560119cc390 2024-09-21T06:42:57.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.076+0000 7f15bdcb5740 1 -- 172.21.15.7:0/2877999167 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5560119cc390 msgr2=0x556011d95120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:57.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.076+0000 7f15b5cde640 1 --2- 172.21.15.7:0/2352652784 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f159c0b6680 0x7f159c0b8b90 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f15a8005fd0 tx=0x7f15a8004a40 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:57.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.076+0000 7f15bdcb5740 1 --2- 172.21.15.7:0/2877999167 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5560119cc390 0x556011d95120 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f15a002a9a0 tx=0x7f15a0032ce0 comp rx=0 tx=0).stop 2024-09-21T06:42:57.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.076+0000 7f15bdcb5740 1 -- 172.21.15.7:0/2877999167 shutdown_connections 2024-09-21T06:42:57.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.076+0000 7f15bdcb5740 1 --2- 172.21.15.7:0/2877999167 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5560119cc390 0x556011d95120 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:57.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.076+0000 7f15bdcb5740 1 --2- 172.21.15.7:0/2877999167 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5560119c41b0 0x556011d94be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:57.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.076+0000 7f15bdcb5740 1 --2- 172.21.15.7:0/2877999167 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5560119ed070 0x556011d946a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:57.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.076+0000 7f15bdcb5740 1 -- 172.21.15.7:0/2877999167 >> 172.21.15.7:0/2877999167 conn(0x5560119e1460 msgr2=0x556011d92590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:57.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.076+0000 7f15bdcb5740 1 -- 172.21.15.7:0/2877999167 shutdown_connections 2024-09-21T06:42:57.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.077+0000 7f15bdcb5740 1 -- 172.21.15.7:0/2877999167 wait complete. 2024-09-21T06:42:57.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.077+0000 7f15bdcb5740 1 -- start start 2024-09-21T06:42:57.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.077+0000 7f15bdcb5740 1 Processor -- start 2024-09-21T06:42:57.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.077+0000 7f15bdcb5740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5560119c41b0 0x556011d9fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:57.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.077+0000 7f15bdcb5740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5560119cc390 0x556011da02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:57.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.077+0000 7f15bdcb5740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5560119ed070 0x556011dac140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:57.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.078+0000 7f15bdcb5740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x556011b5b700 con 0x5560119ed070 2024-09-21T06:42:57.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.078+0000 7f15bdcb5740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x556011c95160 con 0x5560119c41b0 2024-09-21T06:42:57.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.078+0000 7f15bdcb5740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x556011da2e20 con 0x5560119cc390 2024-09-21T06:42:57.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.078+0000 7f15bdcb5740 10 client.0 _ll_register_callbacks cb 0x556011cae9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:42:57.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.078+0000 7f15b5cde640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5560119ed070 0x556011dac140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:57.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.078+0000 7f15b5cde640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5560119ed070 0x556011dac140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53928/0 (socket says 172.21.15.7:53928) 2024-09-21T06:42:57.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.078+0000 7f15b5cde640 1 -- 172.21.15.7:0/744879617 learned_addr learned my addr 172.21.15.7:0/744879617 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:42:57.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.078+0000 7f15b54dd640 1 --2- 172.21.15.7:0/744879617 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5560119c41b0 0x556011d9fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:57.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.078+0000 7f15b4cdc640 1 --2- 172.21.15.7:0/744879617 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5560119cc390 0x556011da02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:57.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.078+0000 7f15b5cde640 1 -- 172.21.15.7:0/744879617 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5560119cc390 msgr2=0x556011da02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:57.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.078+0000 7f15b5cde640 1 --2- 172.21.15.7:0/744879617 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5560119cc390 0x556011da02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:57.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.078+0000 7f15b5cde640 1 -- 172.21.15.7:0/744879617 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5560119c41b0 msgr2=0x556011d9fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:57.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.078+0000 7f15b5cde640 1 --2- 172.21.15.7:0/744879617 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5560119c41b0 0x556011d9fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:57.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.078+0000 7f15b5cde640 1 -- 172.21.15.7:0/744879617 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556011cc2c90 con 0x5560119ed070 2024-09-21T06:42:57.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.078+0000 7f15b5cde640 1 --2- 172.21.15.7:0/744879617 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5560119ed070 0x556011dac140 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f15a8010830 tx=0x7f15a8004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4b2055ed438f798 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:57.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.078+0000 7f1598ff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:42:57.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.078+0000 7f1598ff9640 1 -- 172.21.15.7:0/744879617 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a80119c0 con 0x5560119ed070 2024-09-21T06:42:57.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.078+0000 7f1598ff9640 1 -- 172.21.15.7:0/744879617 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f15a8011b60 con 0x5560119ed070 2024-09-21T06:42:57.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.078+0000 7f15bdcb5740 1 -- 172.21.15.7:0/744879617 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f15a00316a0 con 0x5560119ed070 2024-09-21T06:42:57.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.079+0000 7f1598ff9640 1 -- 172.21.15.7:0/744879617 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f15a802c020 con 0x5560119ed070 2024-09-21T06:42:57.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.079+0000 7f15bdcb5740 10 client.16737 fetch_fsmap learned FSMap version 25 2024-09-21T06:42:57.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.079+0000 7f15bdcb5740 1 -- 172.21.15.7:0/744879617 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x556011daec40 con 0x5560119ed070 2024-09-21T06:42:57.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.079+0000 7f1598ff9640 1 -- 172.21.15.7:0/744879617 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f15a00316a0 con 0x5560119ed070 2024-09-21T06:42:57.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.079+0000 7f1598ff9640 1 -- 172.21.15.7:0/744879617 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f15a801e3f0 con 0x5560119ed070 2024-09-21T06:42:57.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.079+0000 7f15bdcb5740 10 client.16737 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:42:57.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.079+0000 7f15bdcb5740 10 client.16737 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:42:57.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.079+0000 7f15bdcb5740 20 client.16737 populate_metadata read hostname 'smithi007' 2024-09-21T06:42:57.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.079+0000 7f15bdcb5740 1 --2- 172.21.15.7:0/744879617 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x5560119ab9f0 0x556011db21e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:57.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.079+0000 7f15bdcb5740 4 client.16737 mds_command: new command op to 24688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:42:57.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.079+0000 7f15bdcb5740 1 -- 172.21.15.7:0/744879617 --> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556011d0cdf0 con 0x5560119ab9f0 2024-09-21T06:42:57.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.080+0000 7f15b54dd640 1 --2- 172.21.15.7:0/744879617 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x5560119ab9f0 0x556011db21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:57.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.080+0000 7f1598ff9640 10 client.16737 ms_handle_connect on v2:172.21.15.144:6838/4027821922 2024-09-21T06:42:57.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.080+0000 7f15b54dd640 1 --2- 172.21.15.7:0/744879617 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x5560119ab9f0 0x556011db21e0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3411d8d3af1da058 server_cookie=625ce402f7891f02 in_seq=0 out_seq=0 2024-09-21T06:42:57.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.081+0000 7f1598ff9640 1 -- 172.21.15.7:0/744879617 <== mds.1 v2:172.21.15.144:6838/4027821922 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556011d0cdf0 con 0x5560119ab9f0 2024-09-21T06:42:57.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.081+0000 7f1598ff9640 10 client.16737 handle_command_reply: tid=0 2024-09-21T06:42:57.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.081+0000 7f15bdcb5740 1 client.16737 shutdown 2024-09-21T06:42:57.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.081+0000 7f15bdcb5740 1 -- 172.21.15.7:0/744879617 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5560119ed070 msgr2=0x556011dac140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:57.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.081+0000 7f15bdcb5740 1 --2- 172.21.15.7:0/744879617 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5560119ed070 0x556011dac140 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f15a8010830 tx=0x7f15a8004ab0 comp rx=0 tx=0).stop 2024-09-21T06:42:57.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.081+0000 7f15bdcb5740 1 -- 172.21.15.7:0/744879617 shutdown_connections 2024-09-21T06:42:57.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.081+0000 7f15bdcb5740 1 --2- 172.21.15.7:0/744879617 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x5560119ab9f0 0x556011db21e0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:57.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.081+0000 7f15bdcb5740 1 --2- 172.21.15.7:0/744879617 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5560119ed070 0x556011dac140 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:57.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.081+0000 7f15bdcb5740 1 --2- 172.21.15.7:0/744879617 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5560119cc390 0x556011da02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:57.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.081+0000 7f15bdcb5740 1 --2- 172.21.15.7:0/744879617 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5560119c41b0 0x556011d9fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:57.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.081+0000 7f15bdcb5740 1 -- 172.21.15.7:0/744879617 >> 172.21.15.7:0/744879617 conn(0x5560119e1460 msgr2=0x556011d97830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:57.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.081+0000 7f1598ff9640 0 client.16737 ms_handle_reset on v2:172.21.15.144:6838/4027821922 2024-09-21T06:42:57.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.081+0000 7f15bdcb5740 1 -- 172.21.15.7:0/744879617 shutdown_connections 2024-09-21T06:42:57.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.081+0000 7f15bdcb5740 1 -- 172.21.15.7:0/744879617 wait complete. 2024-09-21T06:42:57.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.081+0000 7f15bdcb5740 20 client.16737 trim_cache size 0 max 16384 2024-09-21T06:42:57.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.094+0000 7f15bdcb5740 1 Processor -- start 2024-09-21T06:42:57.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.094+0000 7f15bdcb5740 1 -- start start 2024-09-21T06:42:57.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.095+0000 7f15bdcb5740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5560119c41b0 0x556011da0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:57.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.095+0000 7f15bdcb5740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5560119cc390 0x556011dac040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:57.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.095+0000 7f15bdcb5740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5560119ed070 0x556011d9cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:57.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.095+0000 7f15bdcb5740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f15b01b3f50 con 0x5560119c41b0 2024-09-21T06:42:57.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.095+0000 7f15bdcb5740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f15b01b1820 con 0x5560119ed070 2024-09-21T06:42:57.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.095+0000 7f15bdcb5740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f15b01af670 con 0x5560119cc390 2024-09-21T06:42:57.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.095+0000 7f15b54dd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5560119c41b0 0x556011da0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:57.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.095+0000 7f15b54dd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5560119c41b0 0x556011da0240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53930/0 (socket says 172.21.15.7:53930) 2024-09-21T06:42:57.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.095+0000 7f15b54dd640 1 -- 172.21.15.7:0/904785200 learned_addr learned my addr 172.21.15.7:0/904785200 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:42:57.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.095+0000 7f15b54dd640 1 -- 172.21.15.7:0/904785200 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5560119cc390 msgr2=0x556011dac040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:57.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.095+0000 7f15b4cdc640 1 --2- 172.21.15.7:0/904785200 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5560119cc390 0x556011dac040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:57.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.095+0000 7f15b54dd640 1 --2- 172.21.15.7:0/904785200 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5560119cc390 0x556011dac040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:57.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.095+0000 7f15b5cde640 1 --2- 172.21.15.7:0/904785200 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5560119ed070 0x556011d9cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:57.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.095+0000 7f15b54dd640 1 -- 172.21.15.7:0/904785200 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5560119ed070 msgr2=0x556011d9cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:57.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.095+0000 7f15b54dd640 1 --2- 172.21.15.7:0/904785200 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5560119ed070 0x556011d9cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:57.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.095+0000 7f15b54dd640 1 -- 172.21.15.7:0/904785200 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5560119abc20 con 0x5560119c41b0 2024-09-21T06:42:57.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.095+0000 7f15b5cde640 1 --2- 172.21.15.7:0/904785200 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5560119ed070 0x556011d9cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:42:57.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.095+0000 7f15b54dd640 1 --2- 172.21.15.7:0/904785200 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5560119c41b0 0x556011da0240 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f15ac00d740 tx=0x7f15ac094040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ef80c46a1fca56a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:57.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.095+0000 7f159affd640 1 -- 172.21.15.7:0/904785200 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15ac020040 con 0x5560119c41b0 2024-09-21T06:42:57.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.095+0000 7f159affd640 1 -- 172.21.15.7:0/904785200 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f15ac092e50 con 0x5560119c41b0 2024-09-21T06:42:57.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.095+0000 7f159affd640 1 -- 172.21.15.7:0/904785200 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15ac0ad780 con 0x5560119c41b0 2024-09-21T06:42:57.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.096+0000 7f15bdcb5740 1 -- 172.21.15.7:0/904785200 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5560119c41b0 msgr2=0x556011da0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:57.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.096+0000 7f15bdcb5740 1 --2- 172.21.15.7:0/904785200 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5560119c41b0 0x556011da0240 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f15ac00d740 tx=0x7f15ac094040 comp rx=0 tx=0).stop 2024-09-21T06:42:57.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.096+0000 7f15bdcb5740 1 -- 172.21.15.7:0/904785200 shutdown_connections 2024-09-21T06:42:57.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.096+0000 7f15bdcb5740 1 --2- 172.21.15.7:0/904785200 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5560119ed070 0x556011d9cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:57.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.096+0000 7f15bdcb5740 1 --2- 172.21.15.7:0/904785200 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5560119cc390 0x556011dac040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:57.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.096+0000 7f15bdcb5740 1 --2- 172.21.15.7:0/904785200 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5560119c41b0 0x556011da0240 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:57.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.096+0000 7f15bdcb5740 1 -- 172.21.15.7:0/904785200 >> 172.21.15.7:0/904785200 conn(0x5560119e1460 msgr2=0x556011d9fb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:57.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.096+0000 7f15bdcb5740 1 -- 172.21.15.7:0/904785200 shutdown_connections 2024-09-21T06:42:57.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.096+0000 7f15bdcb5740 1 -- 172.21.15.7:0/904785200 wait complete. 2024-09-21T06:42:57.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.097+0000 7f15bdcb5740 1 -- start start 2024-09-21T06:42:57.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.097+0000 7f15bdcb5740 1 Processor -- start 2024-09-21T06:42:57.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.097+0000 7f15bdcb5740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5560119c41b0 0x556011da89a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:57.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.097+0000 7f15bdcb5740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5560119cc390 0x556011da3e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:57.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.097+0000 7f15bdcb5740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5560119ed070 0x556011da44a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:57.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.097+0000 7f15bdcb5740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f15b01afce0 con 0x5560119cc390 2024-09-21T06:42:57.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.097+0000 7f15bdcb5740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f15b01b1150 con 0x5560119c41b0 2024-09-21T06:42:57.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.097+0000 7f15bdcb5740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f15b01b03b0 con 0x5560119ed070 2024-09-21T06:42:57.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.097+0000 7f15bdcb5740 10 client.0 _ll_register_callbacks cb 0x7f15a8009d40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:42:57.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.097+0000 7f15b4cdc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5560119cc390 0x556011da3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:57.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.097+0000 7f15b4cdc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5560119cc390 0x556011da3e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53942/0 (socket says 172.21.15.7:53942) 2024-09-21T06:42:57.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.097+0000 7f15b4cdc640 1 -- 172.21.15.7:0/3833840214 learned_addr learned my addr 172.21.15.7:0/3833840214 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:42:57.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.097+0000 7f15b54dd640 1 --2- 172.21.15.7:0/3833840214 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5560119c41b0 0x556011da89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:57.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.097+0000 7f15b5cde640 1 --2- 172.21.15.7:0/3833840214 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5560119ed070 0x556011da44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:57.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.098+0000 7f15b4cdc640 1 -- 172.21.15.7:0/3833840214 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5560119ed070 msgr2=0x556011da44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:57.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.098+0000 7f15b4cdc640 1 --2- 172.21.15.7:0/3833840214 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5560119ed070 0x556011da44a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:57.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.098+0000 7f15b4cdc640 1 -- 172.21.15.7:0/3833840214 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5560119c41b0 msgr2=0x556011da89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:57.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.098+0000 7f15b4cdc640 1 --2- 172.21.15.7:0/3833840214 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5560119c41b0 0x556011da89a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:57.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.098+0000 7f15b4cdc640 1 -- 172.21.15.7:0/3833840214 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556011da4c30 con 0x5560119cc390 2024-09-21T06:42:57.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.098+0000 7f15b5cde640 1 --2- 172.21.15.7:0/3833840214 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5560119ed070 0x556011da44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:42:57.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.098+0000 7f15b4cdc640 1 --2- 172.21.15.7:0/3833840214 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5560119cc390 0x556011da3e50 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f15a0005310 tx=0x7f15a0032f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bd7db6881ae511b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:57.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.098+0000 7f1598ff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:42:57.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.098+0000 7f1598ff9640 1 -- 172.21.15.7:0/3833840214 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a0052060 con 0x5560119cc390 2024-09-21T06:42:57.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.098+0000 7f1598ff9640 1 -- 172.21.15.7:0/3833840214 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f15a0004240 con 0x5560119cc390 2024-09-21T06:42:57.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.098+0000 7f15bdcb5740 1 -- 172.21.15.7:0/3833840214 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f15ac092e50 con 0x5560119cc390 2024-09-21T06:42:57.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.098+0000 7f1598ff9640 1 -- 172.21.15.7:0/3833840214 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f15a003f050 con 0x5560119cc390 2024-09-21T06:42:57.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.098+0000 7f15bdcb5740 10 client.16743 fetch_fsmap learned FSMap version 25 2024-09-21T06:42:57.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.098+0000 7f15bdcb5740 1 -- 172.21.15.7:0/3833840214 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x556011e1cb60 con 0x5560119cc390 2024-09-21T06:42:57.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.098+0000 7f1598ff9640 1 -- 172.21.15.7:0/3833840214 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f15ac092e50 con 0x5560119cc390 2024-09-21T06:42:57.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.099+0000 7f1598ff9640 1 -- 172.21.15.7:0/3833840214 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f15a004c070 con 0x5560119cc390 2024-09-21T06:42:57.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.099+0000 7f15bdcb5740 10 client.16743 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:42:57.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.099+0000 7f15bdcb5740 10 client.16743 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:42:57.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.099+0000 7f15bdcb5740 20 client.16743 populate_metadata read hostname 'smithi007' 2024-09-21T06:42:57.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.099+0000 7f15bdcb5740 1 --2- 172.21.15.7:0/3833840214 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x556011980da0 0x556011e1ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:57.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.099+0000 7f15bdcb5740 4 client.16743 mds_command: new command op to 24688 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:42:57.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.099+0000 7f15bdcb5740 1 -- 172.21.15.7:0/3833840214 --> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556011d088a0 con 0x556011980da0 2024-09-21T06:42:57.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.099+0000 7f15b54dd640 1 --2- 172.21.15.7:0/3833840214 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x556011980da0 0x556011e1ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:57.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.099+0000 7f1598ff9640 10 client.16743 ms_handle_connect on v2:172.21.15.144:6838/4027821922 2024-09-21T06:42:57.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.099+0000 7f15b54dd640 1 --2- 172.21.15.7:0/3833840214 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x556011980da0 0x556011e1ee50 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3f8f2de623e0fca0 server_cookie=e4324b48b31398aa in_seq=0 out_seq=0 2024-09-21T06:42:57.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.100+0000 7f1598ff9640 1 -- 172.21.15.7:0/3833840214 <== mds.1 v2:172.21.15.144:6838/4027821922 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556011d088a0 con 0x556011980da0 2024-09-21T06:42:57.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.100+0000 7f1598ff9640 10 client.16743 handle_command_reply: tid=0 2024-09-21T06:42:57.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.100+0000 7f15bdcb5740 1 client.16743 shutdown 2024-09-21T06:42:57.125 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:42:57.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.100+0000 7f15bdcb5740 1 -- 172.21.15.7:0/3833840214 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5560119cc390 msgr2=0x556011da3e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:57.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.100+0000 7f15bdcb5740 1 --2- 172.21.15.7:0/3833840214 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5560119cc390 0x556011da3e50 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f15a0005310 tx=0x7f15a0032f90 comp rx=0 tx=0).stop 2024-09-21T06:42:57.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.100+0000 7f15bdcb5740 1 -- 172.21.15.7:0/3833840214 shutdown_connections 2024-09-21T06:42:57.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.100+0000 7f15bdcb5740 1 --2- 172.21.15.7:0/3833840214 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x556011980da0 0x556011e1ee50 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:57.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.100+0000 7f15bdcb5740 1 --2- 172.21.15.7:0/3833840214 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5560119ed070 0x556011da44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:57.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.100+0000 7f15bdcb5740 1 --2- 172.21.15.7:0/3833840214 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5560119cc390 0x556011da3e50 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:57.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.100+0000 7f1598ff9640 0 client.16743 ms_handle_reset on v2:172.21.15.144:6838/4027821922 2024-09-21T06:42:57.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.100+0000 7f15bdcb5740 1 --2- 172.21.15.7:0/3833840214 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5560119c41b0 0x556011da89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:57.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.100+0000 7f15bdcb5740 1 -- 172.21.15.7:0/3833840214 >> 172.21.15.7:0/3833840214 conn(0x5560119e1460 msgr2=0x556011d956d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:57.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.100+0000 7f15bdcb5740 1 -- 172.21.15.7:0/3833840214 shutdown_connections 2024-09-21T06:42:57.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.100+0000 7f15bdcb5740 1 -- 172.21.15.7:0/3833840214 wait complete. 2024-09-21T06:42:57.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.100+0000 7f15bdcb5740 20 client.16743 trim_cache size 0 max 16384 2024-09-21T06:42:57.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.101+0000 7f15b7741640 1 -- 172.21.15.7:0/2352652784 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f159c0b6680 msgr2=0x7f159c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:57.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.101+0000 7f15b7741640 1 --2- 172.21.15.7:0/2352652784 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f159c0b6680 0x7f159c0b8b90 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f15a8005fd0 tx=0x7f15a8004a40 comp rx=0 tx=0).stop 2024-09-21T06:42:57.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.101+0000 7f15b7741640 1 -- 172.21.15.7:0/2352652784 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f15b01025f0 msgr2=0x7f15b019c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:57.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.101+0000 7f15b7741640 1 --2- 172.21.15.7:0/2352652784 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f15b01025f0 0x7f15b019c720 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f15ac00d770 tx=0x7f15ac00dc30 comp rx=0 tx=0).stop 2024-09-21T06:42:57.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.101+0000 7f15b7741640 1 -- 172.21.15.7:0/2352652784 shutdown_connections 2024-09-21T06:42:57.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.101+0000 7f15b7741640 1 --2- 172.21.15.7:0/2352652784 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f159c0b6680 0x7f159c0b8b90 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:57.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.101+0000 7f15b7741640 1 --2- 172.21.15.7:0/2352652784 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f15b01101a0 0x7f15b01a1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:57.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.101+0000 7f15b7741640 1 --2- 172.21.15.7:0/2352652784 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f15b0102f40 0x7f15b019ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:57.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.101+0000 7f15b7741640 1 --2- 172.21.15.7:0/2352652784 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f15b01025f0 0x7f15b019c720 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:57.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.101+0000 7f15b7741640 1 -- 172.21.15.7:0/2352652784 >> 172.21.15.7:0/2352652784 conn(0x7f15b0079740 msgr2=0x7f15b0108ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:57.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.101+0000 7f15b7741640 1 -- 172.21.15.7:0/2352652784 shutdown_connections 2024-09-21T06:42:57.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:57.101+0000 7f15b7741640 1 -- 172.21.15.7:0/2352652784 wait complete. 2024-09-21T06:42:57.794 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:42:58.051 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:42:58.460 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:42:58 smithi007 ceph-mon[30983]: pgmap v522: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:42:58.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.554+0000 7f2b4c383640 1 -- 172.21.15.7:0/3370757570 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b44108d20 msgr2=0x7f2b4406bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:58.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.554+0000 7f2b4c383640 1 --2- 172.21.15.7:0/3370757570 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b44108d20 0x7f2b4406bb40 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c009ca0 tx=0x7f2b3c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:42:58.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.554+0000 7f2b4c383640 1 -- 172.21.15.7:0/3370757570 shutdown_connections 2024-09-21T06:42:58.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.554+0000 7f2b4c383640 1 --2- 172.21.15.7:0/3370757570 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b44108d20 0x7f2b4406bb40 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:58.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.554+0000 7f2b4c383640 1 --2- 172.21.15.7:0/3370757570 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b441083d0 0x7f2b441087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:58.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.554+0000 7f2b4c383640 1 --2- 172.21.15.7:0/3370757570 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b44102ae0 0x7f2b44102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:58.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.554+0000 7f2b4c383640 1 -- 172.21.15.7:0/3370757570 >> 172.21.15.7:0/3370757570 conn(0x7f2b44079760 msgr2=0x7f2b44079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:58.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.554+0000 7f2b4c383640 1 -- 172.21.15.7:0/3370757570 shutdown_connections 2024-09-21T06:42:58.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.554+0000 7f2b4c383640 1 -- 172.21.15.7:0/3370757570 wait complete. 2024-09-21T06:42:58.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.554+0000 7f2b4c383640 1 Processor -- start 2024-09-21T06:42:58.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.555+0000 7f2b4c383640 1 -- start start 2024-09-21T06:42:58.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.555+0000 7f2b4c383640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b44102ae0 0x7f2b4419c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:58.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.555+0000 7f2b4c383640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b441083d0 0x7f2b4419cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:58.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.555+0000 7f2b4c383640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b44108d20 0x7f2b441a1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:58.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.555+0000 7f2b4c383640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2b44115cf0 con 0x7f2b44102ae0 2024-09-21T06:42:58.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.555+0000 7f2b4c383640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2b44115b70 con 0x7f2b44108d20 2024-09-21T06:42:58.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.555+0000 7f2b4c383640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2b44115e70 con 0x7f2b441083d0 2024-09-21T06:42:58.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.555+0000 7f2b4a11f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b44102ae0 0x7f2b4419c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:58.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.555+0000 7f2b4a11f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b44102ae0 0x7f2b4419c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53964/0 (socket says 172.21.15.7:53964) 2024-09-21T06:42:58.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.555+0000 7f2b4a11f640 1 -- 172.21.15.7:0/402793496 learned_addr learned my addr 172.21.15.7:0/402793496 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:42:58.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.555+0000 7f2b4991e640 1 --2- 172.21.15.7:0/402793496 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b441083d0 0x7f2b4419cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:58.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.555+0000 7f2b4a920640 1 --2- 172.21.15.7:0/402793496 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b44108d20 0x7f2b441a1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:58.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.555+0000 7f2b4a11f640 1 -- 172.21.15.7:0/402793496 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b441083d0 msgr2=0x7f2b4419cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:58.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.555+0000 7f2b4a11f640 1 --2- 172.21.15.7:0/402793496 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b441083d0 0x7f2b4419cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:58.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.555+0000 7f2b4a11f640 1 -- 172.21.15.7:0/402793496 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b44108d20 msgr2=0x7f2b441a1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:58.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.555+0000 7f2b4a11f640 1 --2- 172.21.15.7:0/402793496 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b44108d20 0x7f2b441a1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:58.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.555+0000 7f2b4a11f640 1 -- 172.21.15.7:0/402793496 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b441a2550 con 0x7f2b44102ae0 2024-09-21T06:42:58.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.556+0000 7f2b4a11f640 1 --2- 172.21.15.7:0/402793496 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b44102ae0 0x7f2b4419c5e0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f2b4000e9f0 tx=0x7f2b4000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:58.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.556+0000 7f2b3b7fe640 1 -- 172.21.15.7:0/402793496 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b4000cd80 con 0x7f2b44102ae0 2024-09-21T06:42:58.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.556+0000 7f2b4c383640 1 -- 172.21.15.7:0/402793496 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b441a2840 con 0x7f2b44102ae0 2024-09-21T06:42:58.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.556+0000 7f2b3b7fe640 1 -- 172.21.15.7:0/402793496 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2b400108e0 con 0x7f2b44102ae0 2024-09-21T06:42:58.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.556+0000 7f2b3b7fe640 1 -- 172.21.15.7:0/402793496 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b40018980 con 0x7f2b44102ae0 2024-09-21T06:42:58.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.556+0000 7f2b4c383640 1 -- 172.21.15.7:0/402793496 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b441a8fa0 con 0x7f2b44102ae0 2024-09-21T06:42:58.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.558+0000 7f2b528f7740 1 Processor -- start 2024-09-21T06:42:58.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.559+0000 7f2b528f7740 1 -- start start 2024-09-21T06:42:58.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.559+0000 7f2b3b7fe640 1 -- 172.21.15.7:0/402793496 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f2b40010430 con 0x7f2b44102ae0 2024-09-21T06:42:58.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.559+0000 7f2b528f7740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e3df47b070 0x55e3df8222c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:58.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.559+0000 7f2b528f7740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e3df4521b0 0x55e3df822800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:58.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.559+0000 7f2b528f7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3df45a390 0x55e3df822d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:58.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.559+0000 7f2b528f7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e3df798ea0 con 0x55e3df45a390 2024-09-21T06:42:58.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.559+0000 7f2b528f7740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55e3df7882d0 con 0x55e3df4521b0 2024-09-21T06:42:58.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.559+0000 7f2b528f7740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55e3df78c0e0 con 0x55e3df47b070 2024-09-21T06:42:58.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.559+0000 7f2b4a920640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e3df47b070 0x55e3df8222c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:58.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.559+0000 7f2b4a11f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e3df4521b0 0x55e3df822800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:58.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.559+0000 7f2b4a920640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e3df47b070 0x55e3df8222c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.7:33136/0 (socket says 172.21.15.7:33136) 2024-09-21T06:42:58.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.559+0000 7f2b4a920640 1 -- 172.21.15.7:0/3384661147 learned_addr learned my addr 172.21.15.7:0/3384661147 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:42:58.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.559+0000 7f2b4991e640 1 --2- 172.21.15.7:0/3384661147 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3df45a390 0x55e3df822d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:58.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.560+0000 7f2b4a920640 1 -- 172.21.15.7:0/3384661147 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e3df4521b0 msgr2=0x55e3df822800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:58.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.560+0000 7f2b4a920640 1 --2- 172.21.15.7:0/3384661147 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e3df4521b0 0x55e3df822800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:58.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.560+0000 7f2b4a920640 1 -- 172.21.15.7:0/3384661147 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3df45a390 msgr2=0x55e3df822d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:58.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.560+0000 7f2b4a920640 1 --2- 172.21.15.7:0/3384661147 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3df45a390 0x55e3df822d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:58.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.560+0000 7f2b4a920640 1 -- 172.21.15.7:0/3384661147 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3df4e6650 con 0x55e3df47b070 2024-09-21T06:42:58.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.560+0000 7f2b4a920640 1 --2- 172.21.15.7:0/3384661147 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e3df47b070 0x55e3df8222c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c005cc0 tx=0x7f2b3c02f420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17a58d0c0d084360 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:58.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.560+0000 7f2b3b7fe640 1 --2- 172.21.15.7:0/402793496 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f2b300b6680 0x7f2b300b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:58.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.560+0000 7f2b38d9a640 1 -- 172.21.15.7:0/3384661147 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b3c031cf0 con 0x55e3df47b070 2024-09-21T06:42:58.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.560+0000 7f2b38d9a640 1 -- 172.21.15.7:0/3384661147 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2b3c036040 con 0x55e3df47b070 2024-09-21T06:42:58.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.560+0000 7f2b38d9a640 1 -- 172.21.15.7:0/3384661147 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b3c004040 con 0x55e3df47b070 2024-09-21T06:42:58.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.560+0000 7f2b4a11f640 1 --2- 172.21.15.7:0/402793496 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f2b300b6680 0x7f2b300b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:58.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.561+0000 7f2b3b7fe640 1 -- 172.21.15.7:0/402793496 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f2b400e7a60 con 0x7f2b44102ae0 2024-09-21T06:42:58.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.561+0000 7f2b528f7740 1 -- 172.21.15.7:0/3384661147 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e3df47b070 msgr2=0x55e3df8222c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:58.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.561+0000 7f2b528f7740 1 --2- 172.21.15.7:0/3384661147 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e3df47b070 0x55e3df8222c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c005cc0 tx=0x7f2b3c02f420 comp rx=0 tx=0).stop 2024-09-21T06:42:58.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.561+0000 7f2b4a11f640 1 --2- 172.21.15.7:0/402793496 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f2b300b6680 0x7f2b300b8b90 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x55e3df820f40 tx=0x7f2b400eb4a0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:58.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.561+0000 7f2b528f7740 1 -- 172.21.15.7:0/3384661147 shutdown_connections 2024-09-21T06:42:58.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.561+0000 7f2b528f7740 1 --2- 172.21.15.7:0/3384661147 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3df45a390 0x55e3df822d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:58.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.561+0000 7f2b528f7740 1 --2- 172.21.15.7:0/3384661147 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e3df4521b0 0x55e3df822800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:58.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.561+0000 7f2b528f7740 1 --2- 172.21.15.7:0/3384661147 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e3df47b070 0x55e3df8222c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:58.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.561+0000 7f2b528f7740 1 -- 172.21.15.7:0/3384661147 >> 172.21.15.7:0/3384661147 conn(0x55e3df46f460 msgr2=0x55e3df8201b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:58.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.561+0000 7f2b528f7740 1 -- 172.21.15.7:0/3384661147 shutdown_connections 2024-09-21T06:42:58.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.562+0000 7f2b528f7740 1 -- 172.21.15.7:0/3384661147 wait complete. 2024-09-21T06:42:58.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.562+0000 7f2b528f7740 1 -- start start 2024-09-21T06:42:58.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.562+0000 7f2b528f7740 1 Processor -- start 2024-09-21T06:42:58.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.562+0000 7f2b528f7740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e3df4521b0 0x55e3df82d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:58.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.562+0000 7f2b528f7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3df45a390 0x55e3df82dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:58.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.562+0000 7f2b528f7740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e3df47b070 0x55e3df839d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:58.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.562+0000 7f2b528f7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e3df5e9700 con 0x55e3df45a390 2024-09-21T06:42:58.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.562+0000 7f2b528f7740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55e3df723160 con 0x55e3df4521b0 2024-09-21T06:42:58.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.562+0000 7f2b528f7740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55e3df830a40 con 0x55e3df47b070 2024-09-21T06:42:58.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.562+0000 7f2b528f7740 10 client.0 _ll_register_callbacks cb 0x55e3df73c9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:42:58.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.562+0000 7f2b4991e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3df45a390 0x55e3df82dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:58.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.562+0000 7f2b4991e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3df45a390 0x55e3df82dea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53986/0 (socket says 172.21.15.7:53986) 2024-09-21T06:42:58.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.562+0000 7f2b4991e640 1 -- 172.21.15.7:0/404343646 learned_addr learned my addr 172.21.15.7:0/404343646 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:42:58.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.563+0000 7f2b4a920640 1 --2- 172.21.15.7:0/404343646 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e3df47b070 0x55e3df839d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:58.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.563+0000 7f2b4a920640 1 --2- 172.21.15.7:0/404343646 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e3df4521b0 0x55e3df82d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:58.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.563+0000 7f2b4991e640 1 -- 172.21.15.7:0/404343646 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e3df47b070 msgr2=0x55e3df839d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:58.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.563+0000 7f2b4991e640 1 --2- 172.21.15.7:0/404343646 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e3df47b070 0x55e3df839d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:58.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.563+0000 7f2b4991e640 1 -- 172.21.15.7:0/404343646 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e3df4521b0 msgr2=0x55e3df82d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:58.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.563+0000 7f2b4991e640 1 --2- 172.21.15.7:0/404343646 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e3df4521b0 0x55e3df82d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:58.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.563+0000 7f2b4991e640 1 -- 172.21.15.7:0/404343646 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3df750c90 con 0x55e3df45a390 2024-09-21T06:42:58.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.563+0000 7f2b4a920640 1 --2- 172.21.15.7:0/404343646 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e3df47b070 0x55e3df839d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:42:58.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.563+0000 7f2b4991e640 1 --2- 172.21.15.7:0/404343646 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3df45a390 0x55e3df82dea0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f2b34012720 tx=0x7f2b34012be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88e22278c903f848 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:58.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.563+0000 7f2b2dffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:42:58.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.563+0000 7f2b2dffb640 1 -- 172.21.15.7:0/404343646 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b3400f920 con 0x55e3df45a390 2024-09-21T06:42:58.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.563+0000 7f2b2dffb640 1 -- 172.21.15.7:0/404343646 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f2b3400fac0 con 0x55e3df45a390 2024-09-21T06:42:58.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.563+0000 7f2b528f7740 1 -- 172.21.15.7:0/404343646 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2b3c036040 con 0x55e3df45a390 2024-09-21T06:42:58.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.563+0000 7f2b2dffb640 1 -- 172.21.15.7:0/404343646 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2b34021030 con 0x55e3df45a390 2024-09-21T06:42:58.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.563+0000 7f2b528f7740 10 client.16755 fetch_fsmap learned FSMap version 25 2024-09-21T06:42:58.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.563+0000 7f2b528f7740 1 -- 172.21.15.7:0/404343646 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e3df83c7c0 con 0x55e3df45a390 2024-09-21T06:42:58.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.564+0000 7f2b2dffb640 1 -- 172.21.15.7:0/404343646 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2b3c036040 con 0x55e3df45a390 2024-09-21T06:42:58.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.564+0000 7f2b2dffb640 1 -- 172.21.15.7:0/404343646 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f2b34005120 con 0x55e3df45a390 2024-09-21T06:42:58.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.564+0000 7f2b528f7740 10 client.16755 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:42:58.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.564+0000 7f2b528f7740 10 client.16755 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:42:58.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.564+0000 7f2b528f7740 20 client.16755 populate_metadata read hostname 'smithi007' 2024-09-21T06:42:58.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.564+0000 7f2b528f7740 1 --2- 172.21.15.7:0/404343646 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55e3df4399f0 0x55e3df83fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:58.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.564+0000 7f2b528f7740 4 client.16755 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:42:58.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.564+0000 7f2b528f7740 1 -- 172.21.15.7:0/404343646 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e3df79adf0 con 0x55e3df4399f0 2024-09-21T06:42:58.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.564+0000 7f2b4a920640 1 --2- 172.21.15.7:0/404343646 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55e3df4399f0 0x55e3df83fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:58.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.565+0000 7f2b2dffb640 10 client.16755 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:42:58.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.565+0000 7f2b4a920640 1 --2- 172.21.15.7:0/404343646 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55e3df4399f0 0x55e3df83fd40 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be5d136127d54f24 server_cookie=e26e0f6e45b97a31 in_seq=0 out_seq=0 2024-09-21T06:42:58.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.565+0000 7f2b2dffb640 1 -- 172.21.15.7:0/404343646 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e3df79adf0 con 0x55e3df4399f0 2024-09-21T06:42:58.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.565+0000 7f2b2dffb640 10 client.16755 handle_command_reply: tid=0 2024-09-21T06:42:58.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.565+0000 7f2b528f7740 1 client.16755 shutdown 2024-09-21T06:42:58.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.566+0000 7f2b528f7740 1 -- 172.21.15.7:0/404343646 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3df45a390 msgr2=0x55e3df82dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:58.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.566+0000 7f2b528f7740 1 --2- 172.21.15.7:0/404343646 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3df45a390 0x55e3df82dea0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f2b34012720 tx=0x7f2b34012be0 comp rx=0 tx=0).stop 2024-09-21T06:42:58.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.566+0000 7f2b528f7740 1 -- 172.21.15.7:0/404343646 shutdown_connections 2024-09-21T06:42:58.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.566+0000 7f2b528f7740 1 --2- 172.21.15.7:0/404343646 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55e3df4399f0 0x55e3df83fd40 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:58.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.566+0000 7f2b528f7740 1 --2- 172.21.15.7:0/404343646 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e3df47b070 0x55e3df839d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:58.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.566+0000 7f2b528f7740 1 --2- 172.21.15.7:0/404343646 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3df45a390 0x55e3df82dea0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:58.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.566+0000 7f2b528f7740 1 --2- 172.21.15.7:0/404343646 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e3df4521b0 0x55e3df82d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:58.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.566+0000 7f2b528f7740 1 -- 172.21.15.7:0/404343646 >> 172.21.15.7:0/404343646 conn(0x55e3df46f460 msgr2=0x55e3df825450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:58.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.566+0000 7f2b2dffb640 0 client.16755 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:42:58.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.566+0000 7f2b528f7740 1 -- 172.21.15.7:0/404343646 shutdown_connections 2024-09-21T06:42:58.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.566+0000 7f2b528f7740 1 -- 172.21.15.7:0/404343646 wait complete. 2024-09-21T06:42:58.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.566+0000 7f2b528f7740 20 client.16755 trim_cache size 0 max 16384 2024-09-21T06:42:58.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.579+0000 7f2b528f7740 1 Processor -- start 2024-09-21T06:42:58.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.579+0000 7f2b528f7740 1 -- start start 2024-09-21T06:42:58.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.579+0000 7f2b528f7740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e3df4521b0 0x55e3df82c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:58.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.579+0000 7f2b528f7740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e3df45a390 0x55e3df825ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:58.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.579+0000 7f2b528f7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3df47b070 0x55e3df839c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:58.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.579+0000 7f2b528f7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2b441b4030 con 0x55e3df47b070 2024-09-21T06:42:58.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.579+0000 7f2b528f7740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2b441b1900 con 0x55e3df4521b0 2024-09-21T06:42:58.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.579+0000 7f2b528f7740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2b441af730 con 0x55e3df45a390 2024-09-21T06:42:58.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.580+0000 7f2b4a920640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3df47b070 0x55e3df839c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:58.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.580+0000 7f2b4a920640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3df47b070 0x55e3df839c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:53996/0 (socket says 172.21.15.7:53996) 2024-09-21T06:42:58.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.580+0000 7f2b4a920640 1 -- 172.21.15.7:0/719127750 learned_addr learned my addr 172.21.15.7:0/719127750 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:42:58.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.580+0000 7f2b4a920640 1 --2- 172.21.15.7:0/719127750 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e3df4521b0 0x55e3df82c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:58.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.580+0000 7f2b4991e640 1 --2- 172.21.15.7:0/719127750 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e3df45a390 0x55e3df825ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:58.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.580+0000 7f2b4a920640 1 -- 172.21.15.7:0/719127750 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e3df45a390 msgr2=0x55e3df825ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:58.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.580+0000 7f2b4a920640 1 --2- 172.21.15.7:0/719127750 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e3df45a390 0x55e3df825ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:58.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.580+0000 7f2b4a920640 1 -- 172.21.15.7:0/719127750 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e3df4521b0 msgr2=0x55e3df82c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:58.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.580+0000 7f2b4a920640 1 --2- 172.21.15.7:0/719127750 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e3df4521b0 0x55e3df82c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:58.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.580+0000 7f2b4a920640 1 -- 172.21.15.7:0/719127750 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3df82ea00 con 0x55e3df47b070 2024-09-21T06:42:58.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.580+0000 7f2b4a920640 1 --2- 172.21.15.7:0/719127750 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3df47b070 0x55e3df839c60 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c02f490 tx=0x7f2b3c003c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c0204a040f3e6b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:58.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.580+0000 7f2b2ffff640 1 -- 172.21.15.7:0/719127750 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b3c04a040 con 0x55e3df47b070 2024-09-21T06:42:58.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.580+0000 7f2b2ffff640 1 -- 172.21.15.7:0/719127750 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2b3c036040 con 0x55e3df47b070 2024-09-21T06:42:58.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.580+0000 7f2b2ffff640 1 -- 172.21.15.7:0/719127750 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b3c0046f0 con 0x55e3df47b070 2024-09-21T06:42:58.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.581+0000 7f2b528f7740 1 -- 172.21.15.7:0/719127750 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3df47b070 msgr2=0x55e3df839c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:58.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.581+0000 7f2b528f7740 1 --2- 172.21.15.7:0/719127750 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3df47b070 0x55e3df839c60 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c02f490 tx=0x7f2b3c003c30 comp rx=0 tx=0).stop 2024-09-21T06:42:58.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.581+0000 7f2b528f7740 1 -- 172.21.15.7:0/719127750 shutdown_connections 2024-09-21T06:42:58.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.581+0000 7f2b528f7740 1 --2- 172.21.15.7:0/719127750 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3df47b070 0x55e3df839c60 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:58.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.581+0000 7f2b528f7740 1 --2- 172.21.15.7:0/719127750 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e3df45a390 0x55e3df825ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:58.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.581+0000 7f2b528f7740 1 --2- 172.21.15.7:0/719127750 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e3df4521b0 0x55e3df82c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:58.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.581+0000 7f2b528f7740 1 -- 172.21.15.7:0/719127750 >> 172.21.15.7:0/719127750 conn(0x55e3df46f460 msgr2=0x55e3df8253c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:58.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.581+0000 7f2b528f7740 1 -- 172.21.15.7:0/719127750 shutdown_connections 2024-09-21T06:42:58.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.581+0000 7f2b528f7740 1 -- 172.21.15.7:0/719127750 wait complete. 2024-09-21T06:42:58.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.582+0000 7f2b528f7740 1 -- start start 2024-09-21T06:42:58.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.582+0000 7f2b528f7740 1 Processor -- start 2024-09-21T06:42:58.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.582+0000 7f2b528f7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3df4521b0 0x55e3df831da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:58.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.582+0000 7f2b528f7740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e3df45a390 0x55e3df8322e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:58.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.582+0000 7f2b528f7740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e3df47b070 0x55e3df832820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:58.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.582+0000 7f2b528f7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2b441afdc0 con 0x55e3df4521b0 2024-09-21T06:42:58.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.582+0000 7f2b528f7740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2b441b1230 con 0x55e3df47b070 2024-09-21T06:42:58.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.582+0000 7f2b528f7740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2b441b0490 con 0x55e3df45a390 2024-09-21T06:42:58.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.582+0000 7f2b528f7740 10 client.0 _ll_register_callbacks cb 0x7f2b34009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:42:58.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.582+0000 7f2b4a920640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3df4521b0 0x55e3df831da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:58.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.582+0000 7f2b4a920640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3df4521b0 0x55e3df831da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:54002/0 (socket says 172.21.15.7:54002) 2024-09-21T06:42:58.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.582+0000 7f2b4a920640 1 -- 172.21.15.7:0/3564103019 learned_addr learned my addr 172.21.15.7:0/3564103019 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:42:58.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.582+0000 7f2b4a920640 1 --2- 172.21.15.7:0/3564103019 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e3df47b070 0x55e3df832820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:58.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.583+0000 7f2b4991e640 1 --2- 172.21.15.7:0/3564103019 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e3df45a390 0x55e3df8322e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:58.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.583+0000 7f2b4a920640 1 -- 172.21.15.7:0/3564103019 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e3df45a390 msgr2=0x55e3df8322e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:58.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.583+0000 7f2b4a920640 1 --2- 172.21.15.7:0/3564103019 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e3df45a390 0x55e3df8322e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:58.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.583+0000 7f2b4a920640 1 -- 172.21.15.7:0/3564103019 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e3df47b070 msgr2=0x55e3df832820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:42:58.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.583+0000 7f2b4a920640 1 --2- 172.21.15.7:0/3564103019 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e3df47b070 0x55e3df832820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:58.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.583+0000 7f2b4a920640 1 -- 172.21.15.7:0/3564103019 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3df8a9800 con 0x55e3df4521b0 2024-09-21T06:42:58.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.583+0000 7f2b4991e640 1 --2- 172.21.15.7:0/3564103019 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e3df45a390 0x55e3df8322e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:42:58.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.583+0000 7f2b4a920640 1 --2- 172.21.15.7:0/3564103019 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3df4521b0 0x55e3df831da0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c02f500 tx=0x7f2b3c0021f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aed841ad3425e14 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:42:58.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.583+0000 7f2b2dffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:42:58.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.583+0000 7f2b2dffb640 1 -- 172.21.15.7:0/3564103019 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b3c032d80 con 0x55e3df4521b0 2024-09-21T06:42:58.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.583+0000 7f2b2dffb640 1 -- 172.21.15.7:0/3564103019 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f2b3c004000 con 0x55e3df4521b0 2024-09-21T06:42:58.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.583+0000 7f2b528f7740 1 -- 172.21.15.7:0/3564103019 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2b3c036040 con 0x55e3df4521b0 2024-09-21T06:42:58.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.583+0000 7f2b2dffb640 1 -- 172.21.15.7:0/3564103019 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2b3c004200 con 0x55e3df4521b0 2024-09-21T06:42:58.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.583+0000 7f2b528f7740 10 client.16761 fetch_fsmap learned FSMap version 25 2024-09-21T06:42:58.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.583+0000 7f2b528f7740 1 -- 172.21.15.7:0/3564103019 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e3df8aaa80 con 0x55e3df4521b0 2024-09-21T06:42:58.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.583+0000 7f2b2dffb640 1 -- 172.21.15.7:0/3564103019 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2b3c036040 con 0x55e3df4521b0 2024-09-21T06:42:58.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.584+0000 7f2b2dffb640 1 -- 172.21.15.7:0/3564103019 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f2b3c02f5c0 con 0x55e3df4521b0 2024-09-21T06:42:58.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.584+0000 7f2b528f7740 10 client.16761 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:42:58.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.584+0000 7f2b528f7740 10 client.16761 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:42:58.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.584+0000 7f2b528f7740 20 client.16761 populate_metadata read hostname 'smithi007' 2024-09-21T06:42:58.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.584+0000 7f2b528f7740 1 --2- 172.21.15.7:0/3564103019 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55e3df40eda0 0x55e3df8acc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:42:58.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.584+0000 7f2b528f7740 4 client.16761 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:42:58.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.584+0000 7f2b528f7740 1 -- 172.21.15.7:0/3564103019 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e3df7968a0 con 0x55e3df40eda0 2024-09-21T06:42:58.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.584+0000 7f2b4991e640 1 --2- 172.21.15.7:0/3564103019 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55e3df40eda0 0x55e3df8acc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:42:58.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.584+0000 7f2b2dffb640 10 client.16761 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:42:58.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.584+0000 7f2b4991e640 1 --2- 172.21.15.7:0/3564103019 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55e3df40eda0 0x55e3df8acc60 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=216d71742ab1cd1e server_cookie=6854a999fb4487c7 in_seq=0 out_seq=0 2024-09-21T06:42:58.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.585+0000 7f2b2dffb640 1 -- 172.21.15.7:0/3564103019 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e3df7968a0 con 0x55e3df40eda0 2024-09-21T06:42:58.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.585+0000 7f2b2dffb640 10 client.16761 handle_command_reply: tid=0 2024-09-21T06:42:58.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.585+0000 7f2b528f7740 1 client.16761 shutdown 2024-09-21T06:42:58.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.585+0000 7f2b528f7740 1 -- 172.21.15.7:0/3564103019 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3df4521b0 msgr2=0x55e3df831da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:58.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.585+0000 7f2b528f7740 1 --2- 172.21.15.7:0/3564103019 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3df4521b0 0x55e3df831da0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c02f500 tx=0x7f2b3c0021f0 comp rx=0 tx=0).stop 2024-09-21T06:42:58.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.585+0000 7f2b528f7740 1 -- 172.21.15.7:0/3564103019 shutdown_connections 2024-09-21T06:42:58.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.585+0000 7f2b528f7740 1 --2- 172.21.15.7:0/3564103019 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55e3df40eda0 0x55e3df8acc60 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:58.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.585+0000 7f2b528f7740 1 --2- 172.21.15.7:0/3564103019 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e3df47b070 0x55e3df832820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:58.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.585+0000 7f2b528f7740 1 --2- 172.21.15.7:0/3564103019 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e3df45a390 0x55e3df8322e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:58.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.585+0000 7f2b528f7740 1 --2- 172.21.15.7:0/3564103019 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e3df4521b0 0x55e3df831da0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:58.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.585+0000 7f2b2dffb640 0 client.16761 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:42:58.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.585+0000 7f2b528f7740 1 -- 172.21.15.7:0/3564103019 >> 172.21.15.7:0/3564103019 conn(0x55e3df46f460 msgr2=0x55e3df81f970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:58.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.585+0000 7f2b528f7740 1 -- 172.21.15.7:0/3564103019 shutdown_connections 2024-09-21T06:42:58.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.585+0000 7f2b528f7740 1 -- 172.21.15.7:0/3564103019 wait complete. 2024-09-21T06:42:58.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.585+0000 7f2b528f7740 20 client.16761 trim_cache size 0 max 16384 2024-09-21T06:42:58.592 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:42:58.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.586+0000 7f2b4c383640 1 -- 172.21.15.7:0/402793496 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f2b300b6680 msgr2=0x7f2b300b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:58.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.586+0000 7f2b4c383640 1 --2- 172.21.15.7:0/402793496 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f2b300b6680 0x7f2b300b8b90 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x55e3df820f40 tx=0x7f2b400eb4a0 comp rx=0 tx=0).stop 2024-09-21T06:42:58.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.586+0000 7f2b4c383640 1 -- 172.21.15.7:0/402793496 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b44102ae0 msgr2=0x7f2b4419c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:42:58.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.586+0000 7f2b4c383640 1 --2- 172.21.15.7:0/402793496 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b44102ae0 0x7f2b4419c5e0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f2b4000e9f0 tx=0x7f2b4000eeb0 comp rx=0 tx=0).stop 2024-09-21T06:42:58.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.586+0000 7f2b4c383640 1 -- 172.21.15.7:0/402793496 shutdown_connections 2024-09-21T06:42:58.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.586+0000 7f2b4c383640 1 --2- 172.21.15.7:0/402793496 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f2b300b6680 0x7f2b300b8b90 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:58.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.586+0000 7f2b4c383640 1 --2- 172.21.15.7:0/402793496 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b44108d20 0x7f2b441a1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:58.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.586+0000 7f2b4c383640 1 --2- 172.21.15.7:0/402793496 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2b441083d0 0x7f2b4419cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:58.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.586+0000 7f2b4c383640 1 --2- 172.21.15.7:0/402793496 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2b44102ae0 0x7f2b4419c5e0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:42:58.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.586+0000 7f2b4c383640 1 -- 172.21.15.7:0/402793496 >> 172.21.15.7:0/402793496 conn(0x7f2b44079760 msgr2=0x7f2b44104d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:42:58.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.586+0000 7f2b4c383640 1 -- 172.21.15.7:0/402793496 shutdown_connections 2024-09-21T06:42:58.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:42:58.586+0000 7f2b4c383640 1 -- 172.21.15.7:0/402793496 wait complete. 2024-09-21T06:42:58.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:42:58 smithi018 ceph-mon[34477]: pgmap v522: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:42:58.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:42:58 smithi144 ceph-mon[34653]: pgmap v522: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:43:00.364 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:43:00.365 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:43:00.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:43:00 smithi018 ceph-mon[34477]: pgmap v523: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:43:00.627 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:43:00.748 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:43:00 smithi007 ceph-mon[30983]: pgmap v523: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:43:00.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:43:00 smithi144 ceph-mon[34653]: pgmap v523: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:43:01.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.115+0000 7f1c9e326640 1 -- 172.21.15.7:0/1935980401 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1c981083c0 msgr2=0x7f1c981087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:01.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.115+0000 7f1c9e326640 1 --2- 172.21.15.7:0/1935980401 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1c981083c0 0x7f1c981087d0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c009900 tx=0x7f1c8c02a410 comp rx=0 tx=0).stop 2024-09-21T06:43:01.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.115+0000 7f1c9e326640 1 -- 172.21.15.7:0/1935980401 shutdown_connections 2024-09-21T06:43:01.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.115+0000 7f1c9e326640 1 --2- 172.21.15.7:0/1935980401 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1c98108d10 0x7f1c9810f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:01.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.115+0000 7f1c9e326640 1 --2- 172.21.15.7:0/1935980401 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1c981083c0 0x7f1c981087d0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:01.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.115+0000 7f1c9e326640 1 --2- 172.21.15.7:0/1935980401 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c98102a80 0x7f1c98102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:01.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.115+0000 7f1c9e326640 1 -- 172.21.15.7:0/1935980401 >> 172.21.15.7:0/1935980401 conn(0x7f1c98079740 msgr2=0x7f1c98079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:01.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.115+0000 7f1c9e326640 1 -- 172.21.15.7:0/1935980401 shutdown_connections 2024-09-21T06:43:01.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.115+0000 7f1c9e326640 1 -- 172.21.15.7:0/1935980401 wait complete. 2024-09-21T06:43:01.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.116+0000 7f1c9e326640 1 Processor -- start 2024-09-21T06:43:01.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.116+0000 7f1c9e326640 1 -- start start 2024-09-21T06:43:01.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.117+0000 7f1c9e326640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1c98102a80 0x7f1c980ff690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:01.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.117+0000 7f1c9e326640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1c981083c0 0x7f1c980ffbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:01.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.117+0000 7f1c9e326640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c98108d10 0x7f1c98100110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:01.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.117+0000 7f1c9e326640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1c98112980 con 0x7f1c98102a80 2024-09-21T06:43:01.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.117+0000 7f1c9e326640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1c98112800 con 0x7f1c98108d10 2024-09-21T06:43:01.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.117+0000 7f1c9e326640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1c98112b00 con 0x7f1c981083c0 2024-09-21T06:43:01.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.117+0000 7f1c97fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1c98102a80 0x7f1c980ff690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:01.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.117+0000 7f1c97fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1c98102a80 0x7f1c980ff690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52864/0 (socket says 172.21.15.7:52864) 2024-09-21T06:43:01.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.117+0000 7f1c97fff640 1 -- 172.21.15.7:0/846234537 learned_addr learned my addr 172.21.15.7:0/846234537 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:43:01.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.117+0000 7f1c977fe640 1 --2- 172.21.15.7:0/846234537 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1c981083c0 0x7f1c980ffbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:01.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.117+0000 7f1c9c8c3640 1 --2- 172.21.15.7:0/846234537 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c98108d10 0x7f1c98100110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:01.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.117+0000 7f1c97fff640 1 -- 172.21.15.7:0/846234537 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1c981083c0 msgr2=0x7f1c980ffbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:01.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.117+0000 7f1c97fff640 1 --2- 172.21.15.7:0/846234537 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1c981083c0 0x7f1c980ffbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:01.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.117+0000 7f1c97fff640 1 -- 172.21.15.7:0/846234537 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c98108d10 msgr2=0x7f1c98100110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:01.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.117+0000 7f1c97fff640 1 --2- 172.21.15.7:0/846234537 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c98108d10 0x7f1c98100110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:01.122 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.117+0000 7f1c97fff640 1 -- 172.21.15.7:0/846234537 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c981a8740 con 0x7f1c98102a80 2024-09-21T06:43:01.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.117+0000 7f1c9c8c3640 1 --2- 172.21.15.7:0/846234537 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c98108d10 0x7f1c98100110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:43:01.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.117+0000 7f1c97fff640 1 --2- 172.21.15.7:0/846234537 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1c98102a80 0x7f1c980ff690 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f1c8800d950 tx=0x7f1c8800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:01.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.117+0000 7f1c957fa640 1 -- 172.21.15.7:0/846234537 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c88017070 con 0x7f1c98102a80 2024-09-21T06:43:01.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.118+0000 7f1c9e326640 1 -- 172.21.15.7:0/846234537 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c981a8a30 con 0x7f1c98102a80 2024-09-21T06:43:01.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.118+0000 7f1c957fa640 1 -- 172.21.15.7:0/846234537 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1c88009c30 con 0x7f1c98102a80 2024-09-21T06:43:01.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.118+0000 7f1c957fa640 1 -- 172.21.15.7:0/846234537 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c8800f620 con 0x7f1c98102a80 2024-09-21T06:43:01.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.118+0000 7f1c9e326640 1 -- 172.21.15.7:0/846234537 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c981a8f90 con 0x7f1c98102a80 2024-09-21T06:43:01.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.121+0000 7f1ca489a740 1 Processor -- start 2024-09-21T06:43:01.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.121+0000 7f1ca489a740 1 -- start start 2024-09-21T06:43:01.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.121+0000 7f1c957fa640 1 -- 172.21.15.7:0/846234537 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f1c88010460 con 0x7f1c98102a80 2024-09-21T06:43:01.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.121+0000 7f1ca489a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564f00483350 0x564f0082a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:01.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.121+0000 7f1ca489a740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564f0045a490 0x564f0082a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:01.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.121+0000 7f1ca489a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f00462670 0x564f0082aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:01.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.121+0000 7f1ca489a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x564f007a0e60 con 0x564f00462670 2024-09-21T06:43:01.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.121+0000 7f1ca489a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x564f00790290 con 0x564f00483350 2024-09-21T06:43:01.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.121+0000 7f1ca489a740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x564f007940a0 con 0x564f0045a490 2024-09-21T06:43:01.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.121+0000 7f1c977fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f00462670 0x564f0082aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:01.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.121+0000 7f1c977fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f00462670 0x564f0082aeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52880/0 (socket says 172.21.15.7:52880) 2024-09-21T06:43:01.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.121+0000 7f1c977fe640 1 -- 172.21.15.7:0/3230958320 learned_addr learned my addr 172.21.15.7:0/3230958320 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:43:01.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.121+0000 7f1c9c8c3640 1 --2- 172.21.15.7:0/3230958320 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564f00483350 0x564f0082a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:01.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.121+0000 7f1c97fff640 1 --2- 172.21.15.7:0/3230958320 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564f0045a490 0x564f0082a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:01.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.122+0000 7f1c977fe640 1 -- 172.21.15.7:0/3230958320 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564f0045a490 msgr2=0x564f0082a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:01.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.122+0000 7f1c977fe640 1 --2- 172.21.15.7:0/3230958320 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564f0045a490 0x564f0082a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:01.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.122+0000 7f1c977fe640 1 -- 172.21.15.7:0/3230958320 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564f00483350 msgr2=0x564f0082a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:01.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.122+0000 7f1c977fe640 1 --2- 172.21.15.7:0/3230958320 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564f00483350 0x564f0082a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:01.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.122+0000 7f1c977fe640 1 -- 172.21.15.7:0/3230958320 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f004ee930 con 0x564f00462670 2024-09-21T06:43:01.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.122+0000 7f1c957fa640 1 --2- 172.21.15.7:0/846234537 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f1c800b6680 0x7f1c800b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:01.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.122+0000 7f1c977fe640 1 --2- 172.21.15.7:0/3230958320 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f00462670 0x564f0082aeb0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c009900 tx=0x7f1c8c032c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf61ad58cdf3783a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:01.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.122+0000 7f1c9c8c3640 1 --2- 172.21.15.7:0/846234537 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f1c800b6680 0x7f1c800b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:01.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.122+0000 7f1c957fa640 1 -- 172.21.15.7:0/846234537 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f1c880e73a0 con 0x7f1c98102a80 2024-09-21T06:43:01.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.122+0000 7f1c7e7fc640 1 -- 172.21.15.7:0/3230958320 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c8c03f070 con 0x564f00462670 2024-09-21T06:43:01.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.122+0000 7f1c7e7fc640 1 -- 172.21.15.7:0/3230958320 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1c8c032e40 con 0x564f00462670 2024-09-21T06:43:01.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.122+0000 7f1c7e7fc640 1 -- 172.21.15.7:0/3230958320 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c8c035070 con 0x564f00462670 2024-09-21T06:43:01.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.123+0000 7f1ca489a740 1 -- 172.21.15.7:0/3230958320 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f00462670 msgr2=0x564f0082aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:01.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.123+0000 7f1c9c8c3640 1 --2- 172.21.15.7:0/846234537 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f1c800b6680 0x7f1c800b8b90 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f1c90005fd0 tx=0x7f1c90009700 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:01.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.123+0000 7f1ca489a740 1 --2- 172.21.15.7:0/3230958320 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f00462670 0x564f0082aeb0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c009900 tx=0x7f1c8c032c50 comp rx=0 tx=0).stop 2024-09-21T06:43:01.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.123+0000 7f1ca489a740 1 -- 172.21.15.7:0/3230958320 shutdown_connections 2024-09-21T06:43:01.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.123+0000 7f1ca489a740 1 --2- 172.21.15.7:0/3230958320 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f00462670 0x564f0082aeb0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:01.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.123+0000 7f1ca489a740 1 --2- 172.21.15.7:0/3230958320 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564f0045a490 0x564f0082a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:01.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.123+0000 7f1ca489a740 1 --2- 172.21.15.7:0/3230958320 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564f00483350 0x564f0082a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:01.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.123+0000 7f1ca489a740 1 -- 172.21.15.7:0/3230958320 >> 172.21.15.7:0/3230958320 conn(0x564f00477740 msgr2=0x564f00828320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:01.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.123+0000 7f1ca489a740 1 -- 172.21.15.7:0/3230958320 shutdown_connections 2024-09-21T06:43:01.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.123+0000 7f1ca489a740 1 -- 172.21.15.7:0/3230958320 wait complete. 2024-09-21T06:43:01.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.124+0000 7f1ca489a740 1 -- start start 2024-09-21T06:43:01.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.124+0000 7f1ca489a740 1 Processor -- start 2024-09-21T06:43:01.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.124+0000 7f1ca489a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564f0045a490 0x564f00836050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:01.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.124+0000 7f1ca489a740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564f00462670 0x564f008365f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:01.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.124+0000 7f1ca489a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f00483350 0x564f00841ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:01.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.124+0000 7f1ca489a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x564f005f1890 con 0x564f00483350 2024-09-21T06:43:01.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.124+0000 7f1ca489a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x564f0072ad40 con 0x564f0045a490 2024-09-21T06:43:01.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.124+0000 7f1ca489a740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x564f00838bb0 con 0x564f00462670 2024-09-21T06:43:01.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.124+0000 7f1ca489a740 10 client.0 _ll_register_callbacks cb 0x564f0078ec80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:43:01.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.124+0000 7f1c9c8c3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f00483350 0x564f00841ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:01.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.124+0000 7f1c9c8c3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f00483350 0x564f00841ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52888/0 (socket says 172.21.15.7:52888) 2024-09-21T06:43:01.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.124+0000 7f1c9c8c3640 1 -- 172.21.15.7:0/772883624 learned_addr learned my addr 172.21.15.7:0/772883624 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:43:01.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.125+0000 7f1c977fe640 1 --2- 172.21.15.7:0/772883624 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564f00462670 0x564f008365f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:01.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.125+0000 7f1c97fff640 1 --2- 172.21.15.7:0/772883624 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564f0045a490 0x564f00836050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:01.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.125+0000 7f1c9c8c3640 1 -- 172.21.15.7:0/772883624 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564f00462670 msgr2=0x564f008365f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:01.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.125+0000 7f1c9c8c3640 1 --2- 172.21.15.7:0/772883624 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564f00462670 0x564f008365f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:01.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.125+0000 7f1c9c8c3640 1 -- 172.21.15.7:0/772883624 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564f0045a490 msgr2=0x564f00836050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:01.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.125+0000 7f1c9c8c3640 1 --2- 172.21.15.7:0/772883624 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564f0045a490 0x564f00836050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:01.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.125+0000 7f1c9c8c3640 1 -- 172.21.15.7:0/772883624 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f00842510 con 0x564f00483350 2024-09-21T06:43:01.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.125+0000 7f1c9c8c3640 1 --2- 172.21.15.7:0/772883624 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f00483350 0x564f00841ed0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f1c90013fd0 tx=0x7f1c90004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6841465789decefa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:01.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.125+0000 7f1c777fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:43:01.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.125+0000 7f1c777fe640 1 -- 172.21.15.7:0/772883624 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c9001e6d0 con 0x564f00483350 2024-09-21T06:43:01.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.125+0000 7f1c777fe640 1 -- 172.21.15.7:0/772883624 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f1c9001e870 con 0x564f00483350 2024-09-21T06:43:01.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.125+0000 7f1ca489a740 1 -- 172.21.15.7:0/772883624 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564f007a2db0 con 0x564f00483350 2024-09-21T06:43:01.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.125+0000 7f1c777fe640 1 -- 172.21.15.7:0/772883624 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1c9001ea70 con 0x564f00483350 2024-09-21T06:43:01.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.125+0000 7f1ca489a740 10 client.16773 fetch_fsmap learned FSMap version 25 2024-09-21T06:43:01.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.125+0000 7f1ca489a740 1 -- 172.21.15.7:0/772883624 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564f00844ef0 con 0x564f00483350 2024-09-21T06:43:01.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.126+0000 7f1c777fe640 1 -- 172.21.15.7:0/772883624 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x564f007a2db0 con 0x564f00483350 2024-09-21T06:43:01.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.126+0000 7f1c777fe640 1 -- 172.21.15.7:0/772883624 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f1c90027430 con 0x564f00483350 2024-09-21T06:43:01.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.126+0000 7f1ca489a740 10 client.16773 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:43:01.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.126+0000 7f1ca489a740 10 client.16773 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:43:01.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.126+0000 7f1ca489a740 20 client.16773 populate_metadata read hostname 'smithi007' 2024-09-21T06:43:01.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.126+0000 7f1ca489a740 1 --2- 172.21.15.7:0/772883624 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x564f00441cd0 0x564f00848480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:01.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.126+0000 7f1ca489a740 4 client.16773 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:43:01.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.126+0000 7f1ca489a740 1 -- 172.21.15.7:0/772883624 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564f0079e860 con 0x564f00441cd0 2024-09-21T06:43:01.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.126+0000 7f1c97fff640 1 --2- 172.21.15.7:0/772883624 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x564f00441cd0 0x564f00848480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:01.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.127+0000 7f1c97fff640 1 --2- 172.21.15.7:0/772883624 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x564f00441cd0 0x564f00848480 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58258eb632e40545 server_cookie=f6da0cb0ef8ad28 in_seq=0 out_seq=0 2024-09-21T06:43:01.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.127+0000 7f1c777fe640 10 client.16773 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:43:01.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.128+0000 7f1c777fe640 1 -- 172.21.15.7:0/772883624 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564f0079e860 con 0x564f00441cd0 2024-09-21T06:43:01.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.128+0000 7f1c777fe640 10 client.16773 handle_command_reply: tid=0 2024-09-21T06:43:01.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.128+0000 7f1ca489a740 1 client.16773 shutdown 2024-09-21T06:43:01.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.128+0000 7f1ca489a740 1 -- 172.21.15.7:0/772883624 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f00483350 msgr2=0x564f00841ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:01.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.128+0000 7f1ca489a740 1 --2- 172.21.15.7:0/772883624 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f00483350 0x564f00841ed0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f1c90013fd0 tx=0x7f1c90004a40 comp rx=0 tx=0).stop 2024-09-21T06:43:01.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.128+0000 7f1ca489a740 1 -- 172.21.15.7:0/772883624 shutdown_connections 2024-09-21T06:43:01.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.128+0000 7f1ca489a740 1 --2- 172.21.15.7:0/772883624 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x564f00441cd0 0x564f00848480 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:01.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.128+0000 7f1ca489a740 1 --2- 172.21.15.7:0/772883624 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f00483350 0x564f00841ed0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:01.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.128+0000 7f1ca489a740 1 --2- 172.21.15.7:0/772883624 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564f00462670 0x564f008365f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:01.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.128+0000 7f1ca489a740 1 --2- 172.21.15.7:0/772883624 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564f0045a490 0x564f00836050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:01.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.128+0000 7f1ca489a740 1 -- 172.21.15.7:0/772883624 >> 172.21.15.7:0/772883624 conn(0x564f00477740 msgr2=0x564f0082d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:01.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.128+0000 7f1c777fe640 0 client.16773 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:43:01.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.128+0000 7f1ca489a740 1 -- 172.21.15.7:0/772883624 shutdown_connections 2024-09-21T06:43:01.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.128+0000 7f1ca489a740 1 -- 172.21.15.7:0/772883624 wait complete. 2024-09-21T06:43:01.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.128+0000 7f1ca489a740 20 client.16773 trim_cache size 0 max 16384 2024-09-21T06:43:01.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.146+0000 7f1ca489a740 1 Processor -- start 2024-09-21T06:43:01.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.146+0000 7f1ca489a740 1 -- start start 2024-09-21T06:43:01.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.146+0000 7f1ca489a740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564f0045a490 0x564f0082bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:01.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.146+0000 7f1ca489a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564f00462670 0x564f0082f690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:01.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.146+0000 7f1ca489a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f00483350 0x564f0082fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:01.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.146+0000 7f1ca489a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1c981b3f30 con 0x564f00483350 2024-09-21T06:43:01.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.146+0000 7f1ca489a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1c981b1800 con 0x564f00462670 2024-09-21T06:43:01.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.146+0000 7f1ca489a740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1c981af630 con 0x564f0045a490 2024-09-21T06:43:01.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.146+0000 7f1c9c8c3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f00483350 0x564f0082fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:01.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.146+0000 7f1c9c8c3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f00483350 0x564f0082fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52894/0 (socket says 172.21.15.7:52894) 2024-09-21T06:43:01.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.146+0000 7f1c9c8c3640 1 -- 172.21.15.7:0/2000031026 learned_addr learned my addr 172.21.15.7:0/2000031026 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:43:01.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.146+0000 7f1c977fe640 1 --2- 172.21.15.7:0/2000031026 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564f00462670 0x564f0082f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:01.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.146+0000 7f1c97fff640 1 --2- 172.21.15.7:0/2000031026 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564f0045a490 0x564f0082bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:01.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.147+0000 7f1c9c8c3640 1 -- 172.21.15.7:0/2000031026 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564f0045a490 msgr2=0x564f0082bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:01.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.147+0000 7f1c9c8c3640 1 --2- 172.21.15.7:0/2000031026 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564f0045a490 0x564f0082bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:01.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.147+0000 7f1c9c8c3640 1 -- 172.21.15.7:0/2000031026 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564f00462670 msgr2=0x564f0082f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:01.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.147+0000 7f1c9c8c3640 1 --2- 172.21.15.7:0/2000031026 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564f00462670 0x564f0082f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:01.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.147+0000 7f1c9c8c3640 1 -- 172.21.15.7:0/2000031026 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f00828860 con 0x564f00483350 2024-09-21T06:43:01.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.147+0000 7f1c9c8c3640 1 --2- 172.21.15.7:0/2000031026 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f00483350 0x564f0082fbd0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f1c90009890 tx=0x7f1c90028fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddd776ee6227e07c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:01.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.147+0000 7f1c7dffb640 1 -- 172.21.15.7:0/2000031026 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c90027e60 con 0x564f00483350 2024-09-21T06:43:01.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.147+0000 7f1c7dffb640 1 -- 172.21.15.7:0/2000031026 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1c90036070 con 0x564f00483350 2024-09-21T06:43:01.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.147+0000 7f1c7dffb640 1 -- 172.21.15.7:0/2000031026 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c9001e8c0 con 0x564f00483350 2024-09-21T06:43:01.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.148+0000 7f1ca489a740 1 -- 172.21.15.7:0/2000031026 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f00483350 msgr2=0x564f0082fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:01.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.148+0000 7f1ca489a740 1 --2- 172.21.15.7:0/2000031026 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f00483350 0x564f0082fbd0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f1c90009890 tx=0x7f1c90028fb0 comp rx=0 tx=0).stop 2024-09-21T06:43:01.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.148+0000 7f1ca489a740 1 -- 172.21.15.7:0/2000031026 shutdown_connections 2024-09-21T06:43:01.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.148+0000 7f1ca489a740 1 --2- 172.21.15.7:0/2000031026 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f00483350 0x564f0082fbd0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:01.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.148+0000 7f1ca489a740 1 --2- 172.21.15.7:0/2000031026 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564f00462670 0x564f0082f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:01.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.148+0000 7f1ca489a740 1 --2- 172.21.15.7:0/2000031026 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564f0045a490 0x564f0082bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:01.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.148+0000 7f1ca489a740 1 -- 172.21.15.7:0/2000031026 >> 172.21.15.7:0/2000031026 conn(0x564f00477740 msgr2=0x564f0082b460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:01.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.148+0000 7f1ca489a740 1 -- 172.21.15.7:0/2000031026 shutdown_connections 2024-09-21T06:43:01.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.148+0000 7f1ca489a740 1 -- 172.21.15.7:0/2000031026 wait complete. 2024-09-21T06:43:01.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.148+0000 7f1ca489a740 1 -- start start 2024-09-21T06:43:01.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.149+0000 7f1ca489a740 1 Processor -- start 2024-09-21T06:43:01.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.149+0000 7f1ca489a740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564f0045a490 0x564f0083a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:01.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.149+0000 7f1ca489a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564f00462670 0x564f0083a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:01.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.149+0000 7f1ca489a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f00483350 0x564f008b1e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:01.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.149+0000 7f1ca489a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1c981afcc0 con 0x564f00483350 2024-09-21T06:43:01.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.149+0000 7f1ca489a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1c981b1130 con 0x564f00462670 2024-09-21T06:43:01.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.149+0000 7f1ca489a740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1c981b0390 con 0x564f0045a490 2024-09-21T06:43:01.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.149+0000 7f1ca489a740 10 client.0 _ll_register_callbacks cb 0x7f1c90009c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:43:01.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.149+0000 7f1c9c8c3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f00483350 0x564f008b1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:01.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.149+0000 7f1c9c8c3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f00483350 0x564f008b1e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52902/0 (socket says 172.21.15.7:52902) 2024-09-21T06:43:01.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.149+0000 7f1c9c8c3640 1 -- 172.21.15.7:0/3149742289 learned_addr learned my addr 172.21.15.7:0/3149742289 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:43:01.154 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.149+0000 7f1c977fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564f00462670 0x564f0083a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:01.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.149+0000 7f1c97fff640 1 --2- 172.21.15.7:0/3149742289 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564f0045a490 0x564f0083a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:01.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.149+0000 7f1c9c8c3640 1 -- 172.21.15.7:0/3149742289 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564f0045a490 msgr2=0x564f0083a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:01.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.149+0000 7f1c9c8c3640 1 --2- 172.21.15.7:0/3149742289 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564f0045a490 0x564f0083a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:01.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.149+0000 7f1c9c8c3640 1 -- 172.21.15.7:0/3149742289 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564f00462670 msgr2=0x564f0083a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:01.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.149+0000 7f1c9c8c3640 1 --2- 172.21.15.7:0/3149742289 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564f00462670 0x564f0083a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:01.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.149+0000 7f1c9c8c3640 1 -- 172.21.15.7:0/3149742289 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f008b2380 con 0x564f00483350 2024-09-21T06:43:01.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.150+0000 7f1c9c8c3640 1 --2- 172.21.15.7:0/3149742289 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f00483350 0x564f008b1e40 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f1c90027940 tx=0x7f1c900276e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67e84c85685021eb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:01.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.150+0000 7f1c777fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:43:01.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.150+0000 7f1c777fe640 1 -- 172.21.15.7:0/3149742289 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c90047060 con 0x564f00483350 2024-09-21T06:43:01.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.150+0000 7f1c777fe640 1 -- 172.21.15.7:0/3149742289 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f1c9001e840 con 0x564f00483350 2024-09-21T06:43:01.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.150+0000 7f1ca489a740 1 -- 172.21.15.7:0/3149742289 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1c90036070 con 0x564f00483350 2024-09-21T06:43:01.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.150+0000 7f1c777fe640 1 -- 172.21.15.7:0/3149742289 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1c90027e60 con 0x564f00483350 2024-09-21T06:43:01.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.150+0000 7f1ca489a740 10 client.16779 fetch_fsmap learned FSMap version 25 2024-09-21T06:43:01.155 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.150+0000 7f1ca489a740 1 -- 172.21.15.7:0/3149742289 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564f008b3570 con 0x564f00483350 2024-09-21T06:43:01.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.150+0000 7f1c777fe640 1 -- 172.21.15.7:0/3149742289 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1c90036070 con 0x564f00483350 2024-09-21T06:43:01.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.150+0000 7f1c777fe640 1 -- 172.21.15.7:0/3149742289 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f1c90031970 con 0x564f00483350 2024-09-21T06:43:01.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.150+0000 7f1ca489a740 10 client.16779 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:43:01.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.151+0000 7f1ca489a740 10 client.16779 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:43:01.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.151+0000 7f1ca489a740 20 client.16779 populate_metadata read hostname 'smithi007' 2024-09-21T06:43:01.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.151+0000 7f1ca489a740 1 --2- 172.21.15.7:0/3149742289 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x564f00417080 0x564f008b5be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:01.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.151+0000 7f1ca489a740 4 client.16779 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:43:01.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.151+0000 7f1ca489a740 1 -- 172.21.15.7:0/3149742289 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x564f0079bc90 con 0x564f00417080 2024-09-21T06:43:01.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.151+0000 7f1c97fff640 1 --2- 172.21.15.7:0/3149742289 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x564f00417080 0x564f008b5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:01.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.151+0000 7f1c97fff640 1 --2- 172.21.15.7:0/3149742289 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x564f00417080 0x564f008b5be0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac381823fc942440 server_cookie=916e2a9569a4ad3 in_seq=0 out_seq=0 2024-09-21T06:43:01.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.151+0000 7f1c777fe640 10 client.16779 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:43:01.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.153+0000 7f1c777fe640 1 -- 172.21.15.7:0/3149742289 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x564f0079bc90 con 0x564f00417080 2024-09-21T06:43:01.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.153+0000 7f1c777fe640 10 client.16779 handle_command_reply: tid=0 2024-09-21T06:43:01.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.153+0000 7f1ca489a740 1 client.16779 shutdown 2024-09-21T06:43:01.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.153+0000 7f1ca489a740 1 -- 172.21.15.7:0/3149742289 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f00483350 msgr2=0x564f008b1e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:01.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.153+0000 7f1ca489a740 1 --2- 172.21.15.7:0/3149742289 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f00483350 0x564f008b1e40 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f1c90027940 tx=0x7f1c900276e0 comp rx=0 tx=0).stop 2024-09-21T06:43:01.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.153+0000 7f1ca489a740 1 -- 172.21.15.7:0/3149742289 shutdown_connections 2024-09-21T06:43:01.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.153+0000 7f1ca489a740 1 --2- 172.21.15.7:0/3149742289 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x564f00417080 0x564f008b5be0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:01.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.153+0000 7f1ca489a740 1 --2- 172.21.15.7:0/3149742289 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564f00483350 0x564f008b1e40 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:01.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.153+0000 7f1ca489a740 1 --2- 172.21.15.7:0/3149742289 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564f00462670 0x564f0083a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:01.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.153+0000 7f1ca489a740 1 --2- 172.21.15.7:0/3149742289 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564f0045a490 0x564f0083a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:01.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.153+0000 7f1ca489a740 1 -- 172.21.15.7:0/3149742289 >> 172.21.15.7:0/3149742289 conn(0x564f00477740 msgr2=0x564f00837250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:01.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.153+0000 7f1c777fe640 0 client.16779 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:43:01.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.154+0000 7f1ca489a740 1 -- 172.21.15.7:0/3149742289 shutdown_connections 2024-09-21T06:43:01.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.154+0000 7f1ca489a740 1 -- 172.21.15.7:0/3149742289 wait complete. 2024-09-21T06:43:01.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.154+0000 7f1ca489a740 20 client.16779 trim_cache size 0 max 16384 2024-09-21T06:43:01.158 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:43:01.159 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0, 2024-09-21T06:43:01.159 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_tag": "b466f071-ab32-427c-a0ed-73edea33145e", 2024-09-21T06:43:01.159 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": "asynchronous" 2024-09-21T06:43:01.159 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:43:01.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.154+0000 7f1c9e326640 1 -- 172.21.15.7:0/846234537 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f1c800b6680 msgr2=0x7f1c800b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:01.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.154+0000 7f1c9e326640 1 --2- 172.21.15.7:0/846234537 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f1c800b6680 0x7f1c800b8b90 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f1c90005fd0 tx=0x7f1c90009700 comp rx=0 tx=0).stop 2024-09-21T06:43:01.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.154+0000 7f1c9e326640 1 -- 172.21.15.7:0/846234537 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1c98102a80 msgr2=0x7f1c980ff690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:01.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.154+0000 7f1c9e326640 1 --2- 172.21.15.7:0/846234537 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1c98102a80 0x7f1c980ff690 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f1c8800d950 tx=0x7f1c8800de10 comp rx=0 tx=0).stop 2024-09-21T06:43:01.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.154+0000 7f1c9e326640 1 -- 172.21.15.7:0/846234537 shutdown_connections 2024-09-21T06:43:01.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.154+0000 7f1c9e326640 1 --2- 172.21.15.7:0/846234537 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f1c800b6680 0x7f1c800b8b90 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:01.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.154+0000 7f1c9e326640 1 --2- 172.21.15.7:0/846234537 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c98108d10 0x7f1c98100110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:01.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.154+0000 7f1c9e326640 1 --2- 172.21.15.7:0/846234537 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1c981083c0 0x7f1c980ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:01.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.154+0000 7f1c9e326640 1 --2- 172.21.15.7:0/846234537 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1c98102a80 0x7f1c980ff690 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:01.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.154+0000 7f1c9e326640 1 -- 172.21.15.7:0/846234537 >> 172.21.15.7:0/846234537 conn(0x7f1c98079740 msgr2=0x7f1c9806bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:01.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.154+0000 7f1c9e326640 1 -- 172.21.15.7:0/846234537 shutdown_connections 2024-09-21T06:43:01.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:01.154+0000 7f1c9e326640 1 -- 172.21.15.7:0/846234537 wait complete. 2024-09-21T06:43:01.863 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:43:02.125 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:43:02.562 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:43:02 smithi007 ceph-mon[30983]: scrub queued for path: / 2024-09-21T06:43:02.562 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:43:02 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T06:43:02.562 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:43:02 smithi007 ceph-mon[30983]: scrub summary: active paths [/] 2024-09-21T06:43:02.563 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:43:02 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T06:43:02.563 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:43:02 smithi007 ceph-mon[30983]: pgmap v524: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 682 B/s wr, 6 op/s 2024-09-21T06:43:02.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.580+0000 7f5349d66640 1 -- 172.21.15.7:0/2706977305 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5344109df0 msgr2=0x7f5344110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:02.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.580+0000 7f5349d66640 1 --2- 172.21.15.7:0/2706977305 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5344109df0 0x7f5344110620 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f533c009ca0 tx=0x7f533c02a8e0 comp rx=0 tx=0).stop 2024-09-21T06:43:02.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.580+0000 7f5349d66640 1 -- 172.21.15.7:0/2706977305 shutdown_connections 2024-09-21T06:43:02.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.580+0000 7f5349d66640 1 --2- 172.21.15.7:0/2706977305 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5344109df0 0x7f5344110620 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:02.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.580+0000 7f5349d66640 1 --2- 172.21.15.7:0/2706977305 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f53441094a0 0x7f53441098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:02.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.580+0000 7f5349d66640 1 --2- 172.21.15.7:0/2706977305 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5344103b60 0x7f5344103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:02.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.580+0000 7f5349d66640 1 -- 172.21.15.7:0/2706977305 >> 172.21.15.7:0/2706977305 conn(0x7f534407b850 msgr2=0x7f534407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:02.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.580+0000 7f5349d66640 1 -- 172.21.15.7:0/2706977305 shutdown_connections 2024-09-21T06:43:02.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.580+0000 7f5349d66640 1 -- 172.21.15.7:0/2706977305 wait complete. 2024-09-21T06:43:02.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.581+0000 7f5349d66640 1 Processor -- start 2024-09-21T06:43:02.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.581+0000 7f5349d66640 1 -- start start 2024-09-21T06:43:02.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.581+0000 7f5349d66640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5344103b60 0x7f534419a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:02.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.581+0000 7f5349d66640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53441094a0 0x7f534419aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:02.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.581+0000 7f5349d66640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5344109df0 0x7f534419fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:02.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.581+0000 7f5349d66640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5344113b30 con 0x7f5344109df0 2024-09-21T06:43:02.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.581+0000 7f5349d66640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f53441139b0 con 0x7f5344103b60 2024-09-21T06:43:02.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.581+0000 7f5349d66640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5344113cb0 con 0x7f53441094a0 2024-09-21T06:43:02.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.581+0000 7f5343fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5344109df0 0x7f534419fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:02.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.581+0000 7f5343fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5344109df0 0x7f534419fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52928/0 (socket says 172.21.15.7:52928) 2024-09-21T06:43:02.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.581+0000 7f5343fff640 1 -- 172.21.15.7:0/1399952891 learned_addr learned my addr 172.21.15.7:0/1399952891 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:43:02.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.581+0000 7f53437fe640 1 --2- 172.21.15.7:0/1399952891 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5344103b60 0x7f534419a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:02.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.582+0000 7f5342ffd640 1 --2- 172.21.15.7:0/1399952891 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53441094a0 0x7f534419aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:02.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.582+0000 7f5343fff640 1 -- 172.21.15.7:0/1399952891 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53441094a0 msgr2=0x7f534419aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:02.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.582+0000 7f5343fff640 1 --2- 172.21.15.7:0/1399952891 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53441094a0 0x7f534419aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:02.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.582+0000 7f5343fff640 1 -- 172.21.15.7:0/1399952891 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5344103b60 msgr2=0x7f534419a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:02.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.582+0000 7f5343fff640 1 --2- 172.21.15.7:0/1399952891 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5344103b60 0x7f534419a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:02.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.582+0000 7f5343fff640 1 -- 172.21.15.7:0/1399952891 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53441a0450 con 0x7f5344109df0 2024-09-21T06:43:02.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.582+0000 7f53437fe640 1 --2- 172.21.15.7:0/1399952891 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5344103b60 0x7f534419a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:43:02.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.582+0000 7f5343fff640 1 --2- 172.21.15.7:0/1399952891 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5344109df0 0x7f534419fd20 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f533c005cc0 tx=0x7f533c031e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:02.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.582+0000 7f5340ff9640 1 -- 172.21.15.7:0/1399952891 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f533c003cf0 con 0x7f5344109df0 2024-09-21T06:43:02.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.582+0000 7f5349d66640 1 -- 172.21.15.7:0/1399952891 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53441a06e0 con 0x7f5344109df0 2024-09-21T06:43:02.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.582+0000 7f5340ff9640 1 -- 172.21.15.7:0/1399952891 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f533c0044f0 con 0x7f5344109df0 2024-09-21T06:43:02.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.582+0000 7f5340ff9640 1 -- 172.21.15.7:0/1399952891 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f533c030c60 con 0x7f5344109df0 2024-09-21T06:43:02.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.582+0000 7f5349d66640 1 -- 172.21.15.7:0/1399952891 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53441a6ea0 con 0x7f5344109df0 2024-09-21T06:43:02.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.585+0000 7f53502da740 1 Processor -- start 2024-09-21T06:43:02.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.585+0000 7f5340ff9640 1 -- 172.21.15.7:0/1399952891 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f533c004040 con 0x7f5344109df0 2024-09-21T06:43:02.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.586+0000 7f53502da740 1 -- start start 2024-09-21T06:43:02.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.586+0000 7f53502da740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c7855de070 0x55c785985650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:02.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.586+0000 7f53502da740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c7855b51b0 0x55c785985b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:02.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.586+0000 7f53502da740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c7855bd390 0x55c7859860d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:02.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.586+0000 7f53502da740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55c7858fbe50 con 0x55c7855b51b0 2024-09-21T06:43:02.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.586+0000 7f53502da740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55c7858eb280 con 0x55c7855de070 2024-09-21T06:43:02.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.586+0000 7f53502da740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55c7858ef090 con 0x55c7855bd390 2024-09-21T06:43:02.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.586+0000 7f53437fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c7855b51b0 0x55c785985b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:02.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.586+0000 7f53437fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c7855b51b0 0x55c785985b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52932/0 (socket says 172.21.15.7:52932) 2024-09-21T06:43:02.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.586+0000 7f53437fe640 1 -- 172.21.15.7:0/3074963680 learned_addr learned my addr 172.21.15.7:0/3074963680 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:43:02.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.586+0000 7f5342ffd640 1 --2- 172.21.15.7:0/3074963680 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c7855de070 0x55c785985650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:02.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.586+0000 7f53437fe640 1 -- 172.21.15.7:0/3074963680 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c7855bd390 msgr2=0x55c7859860d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:02.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.586+0000 7f53437fe640 1 --2- 172.21.15.7:0/3074963680 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c7855bd390 0x55c7859860d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:02.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.586+0000 7f53437fe640 1 -- 172.21.15.7:0/3074963680 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c7855de070 msgr2=0x55c785985650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:02.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.586+0000 7f53437fe640 1 --2- 172.21.15.7:0/3074963680 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c7855de070 0x55c785985650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:02.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.586+0000 7f53437fe640 1 -- 172.21.15.7:0/3074963680 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c785649650 con 0x55c7855b51b0 2024-09-21T06:43:02.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.586+0000 7f5342ffd640 1 --2- 172.21.15.7:0/3074963680 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c7855de070 0x55c785985650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:43:02.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.586+0000 7f5340ff9640 1 --2- 172.21.15.7:0/1399952891 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f532c0b6680 0x7f532c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:02.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.587+0000 7f5342ffd640 1 --2- 172.21.15.7:0/1399952891 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f532c0b6680 0x7f532c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:02.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.587+0000 7f53437fe640 1 --2- 172.21.15.7:0/3074963680 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c7855b51b0 0x55c785985b90 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f5334009df0 tx=0x7f533400e5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeeeb94639d320dc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:02.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.587+0000 7f5340ff9640 1 -- 172.21.15.7:0/1399952891 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f533c108820 con 0x7f5344109df0 2024-09-21T06:43:02.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.587+0000 7f5329ffb640 1 -- 172.21.15.7:0/3074963680 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5334017070 con 0x55c7855b51b0 2024-09-21T06:43:02.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.587+0000 7f5329ffb640 1 -- 172.21.15.7:0/3074963680 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f533400ee60 con 0x55c7855b51b0 2024-09-21T06:43:02.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.587+0000 7f5329ffb640 1 -- 172.21.15.7:0/3074963680 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5334012790 con 0x55c7855b51b0 2024-09-21T06:43:02.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.588+0000 7f53502da740 1 -- 172.21.15.7:0/3074963680 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c7855b51b0 msgr2=0x55c785985b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:02.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.588+0000 7f5342ffd640 1 --2- 172.21.15.7:0/1399952891 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f532c0b6680 0x7f532c0b8b90 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f5344107130 tx=0x7f53380095e0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:02.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.588+0000 7f53502da740 1 --2- 172.21.15.7:0/3074963680 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c7855b51b0 0x55c785985b90 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f5334009df0 tx=0x7f533400e5a0 comp rx=0 tx=0).stop 2024-09-21T06:43:02.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.588+0000 7f53502da740 1 -- 172.21.15.7:0/3074963680 shutdown_connections 2024-09-21T06:43:02.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.588+0000 7f53502da740 1 --2- 172.21.15.7:0/3074963680 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c7855bd390 0x55c7859860d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:02.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.588+0000 7f53502da740 1 --2- 172.21.15.7:0/3074963680 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c7855b51b0 0x55c785985b90 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:02.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.588+0000 7f53502da740 1 --2- 172.21.15.7:0/3074963680 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c7855de070 0x55c785985650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:02.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.588+0000 7f53502da740 1 -- 172.21.15.7:0/3074963680 >> 172.21.15.7:0/3074963680 conn(0x55c7855d2460 msgr2=0x55c785983540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:02.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.588+0000 7f53502da740 1 -- 172.21.15.7:0/3074963680 shutdown_connections 2024-09-21T06:43:02.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.588+0000 7f53502da740 1 -- 172.21.15.7:0/3074963680 wait complete. 2024-09-21T06:43:02.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.588+0000 7f53502da740 1 -- start start 2024-09-21T06:43:02.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.589+0000 7f53502da740 1 Processor -- start 2024-09-21T06:43:02.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.589+0000 7f53502da740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c7855b51b0 0x55c785995090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:02.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.589+0000 7f53502da740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c7855bd390 0x55c7859955d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:02.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.589+0000 7f53502da740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c7855de070 0x55c785995b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:02.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.589+0000 7f53502da740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55c78574c700 con 0x55c7855bd390 2024-09-21T06:43:02.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.589+0000 7f53502da740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55c785886110 con 0x55c7855b51b0 2024-09-21T06:43:02.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.589+0000 7f53502da740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55c785998190 con 0x55c7855de070 2024-09-21T06:43:02.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.589+0000 7f53502da740 10 client.0 _ll_register_callbacks cb 0x55c78589f990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:43:02.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.589+0000 7f5342ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c7855bd390 0x55c7859955d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:02.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.589+0000 7f5342ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c7855bd390 0x55c7859955d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52944/0 (socket says 172.21.15.7:52944) 2024-09-21T06:43:02.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.589+0000 7f5342ffd640 1 -- 172.21.15.7:0/3405802864 learned_addr learned my addr 172.21.15.7:0/3405802864 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:43:02.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.589+0000 7f53437fe640 1 --2- 172.21.15.7:0/3405802864 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c7855b51b0 0x55c785995090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:02.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.589+0000 7f5343fff640 1 --2- 172.21.15.7:0/3405802864 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c7855de070 0x55c785995b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:02.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.590+0000 7f5342ffd640 1 -- 172.21.15.7:0/3405802864 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c7855de070 msgr2=0x55c785995b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:02.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.590+0000 7f5342ffd640 1 --2- 172.21.15.7:0/3405802864 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c7855de070 0x55c785995b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:02.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.590+0000 7f5342ffd640 1 -- 172.21.15.7:0/3405802864 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c7855b51b0 msgr2=0x55c785995090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:02.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.590+0000 7f5342ffd640 1 --2- 172.21.15.7:0/3405802864 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c7855b51b0 0x55c785995090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:02.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.590+0000 7f5342ffd640 1 -- 172.21.15.7:0/3405802864 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c7858b3c40 con 0x55c7855bd390 2024-09-21T06:43:02.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.590+0000 7f5342ffd640 1 --2- 172.21.15.7:0/3405802864 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c7855bd390 0x55c7859955d0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f5338010b70 tx=0x7f53380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc6699f536749408 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:02.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.590+0000 7f5322ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:43:02.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.590+0000 7f5322ffd640 1 -- 172.21.15.7:0/3405802864 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f533802b060 con 0x55c7855bd390 2024-09-21T06:43:02.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.590+0000 7f5322ffd640 1 -- 172.21.15.7:0/3405802864 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f533801eb90 con 0x55c7855bd390 2024-09-21T06:43:02.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.590+0000 7f53502da740 1 -- 172.21.15.7:0/3405802864 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f533400ee60 con 0x55c7855bd390 2024-09-21T06:43:02.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.590+0000 7f5322ffd640 1 -- 172.21.15.7:0/3405802864 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f533801ed90 con 0x55c7855bd390 2024-09-21T06:43:02.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.590+0000 7f53502da740 10 client.16791 fetch_fsmap learned FSMap version 25 2024-09-21T06:43:02.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.590+0000 7f53502da740 1 -- 172.21.15.7:0/3405802864 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c7859a3eb0 con 0x55c7855bd390 2024-09-21T06:43:02.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.590+0000 7f5322ffd640 1 -- 172.21.15.7:0/3405802864 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f533400ee60 con 0x55c7855bd390 2024-09-21T06:43:02.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.591+0000 7f5322ffd640 1 -- 172.21.15.7:0/3405802864 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f533801a040 con 0x55c7855bd390 2024-09-21T06:43:02.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.591+0000 7f53502da740 10 client.16791 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:43:02.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.591+0000 7f53502da740 10 client.16791 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:43:02.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.591+0000 7f53502da740 20 client.16791 populate_metadata read hostname 'smithi007' 2024-09-21T06:43:02.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.591+0000 7f53502da740 1 --2- 172.21.15.7:0/3405802864 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55c78559c9f0 0x55c7859a7400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:02.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.591+0000 7f53502da740 4 client.16791 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:43:02.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.591+0000 7f53502da740 1 -- 172.21.15.7:0/3405802864 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c7858fdda0 con 0x55c78559c9f0 2024-09-21T06:43:02.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.591+0000 7f53437fe640 1 --2- 172.21.15.7:0/3405802864 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55c78559c9f0 0x55c7859a7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:02.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.592+0000 7f5322ffd640 10 client.16791 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:43:02.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.592+0000 7f53437fe640 1 --2- 172.21.15.7:0/3405802864 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55c78559c9f0 0x55c7859a7400 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c752daa383d83ab5 server_cookie=72b8b8a7afe4d4d6 in_seq=0 out_seq=0 2024-09-21T06:43:02.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.592+0000 7f5322ffd640 1 -- 172.21.15.7:0/3405802864 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c7858fdda0 con 0x55c78559c9f0 2024-09-21T06:43:02.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.592+0000 7f5322ffd640 10 client.16791 handle_command_reply: tid=0 2024-09-21T06:43:02.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.592+0000 7f53502da740 1 client.16791 shutdown 2024-09-21T06:43:02.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.593+0000 7f53502da740 1 -- 172.21.15.7:0/3405802864 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c7855bd390 msgr2=0x55c7859955d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:02.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.593+0000 7f53502da740 1 --2- 172.21.15.7:0/3405802864 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c7855bd390 0x55c7859955d0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f5338010b70 tx=0x7f53380046c0 comp rx=0 tx=0).stop 2024-09-21T06:43:02.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.593+0000 7f53502da740 1 -- 172.21.15.7:0/3405802864 shutdown_connections 2024-09-21T06:43:02.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.593+0000 7f53502da740 1 --2- 172.21.15.7:0/3405802864 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55c78559c9f0 0x55c7859a7400 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:02.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.593+0000 7f5322ffd640 0 client.16791 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:43:02.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.593+0000 7f53502da740 1 --2- 172.21.15.7:0/3405802864 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c7855de070 0x55c785995b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:02.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.593+0000 7f53502da740 1 --2- 172.21.15.7:0/3405802864 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c7855bd390 0x55c7859955d0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:02.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.593+0000 7f53502da740 1 --2- 172.21.15.7:0/3405802864 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c7855b51b0 0x55c785995090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:02.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.593+0000 7f53502da740 1 -- 172.21.15.7:0/3405802864 >> 172.21.15.7:0/3405802864 conn(0x55c7855d2460 msgr2=0x55c785981b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:02.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.593+0000 7f53502da740 1 -- 172.21.15.7:0/3405802864 shutdown_connections 2024-09-21T06:43:02.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.593+0000 7f53502da740 1 -- 172.21.15.7:0/3405802864 wait complete. 2024-09-21T06:43:02.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.593+0000 7f53502da740 20 client.16791 trim_cache size 0 max 16384 2024-09-21T06:43:02.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.610+0000 7f53502da740 1 Processor -- start 2024-09-21T06:43:02.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.610+0000 7f53502da740 1 -- start start 2024-09-21T06:43:02.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.610+0000 7f53502da740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c78559c9f0 0x55c785982e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:02.613 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.610+0000 7f53502da740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c7855b51b0 0x55c7859833a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:02.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.610+0000 7f53502da740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c7855bd390 0x55c785992280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:02.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.610+0000 7f53502da740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f53441afc70 con 0x55c78559c9f0 2024-09-21T06:43:02.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.611+0000 7f53502da740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f53441ad540 con 0x55c7855bd390 2024-09-21T06:43:02.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.611+0000 7f53502da740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f53441ab390 con 0x55c7855b51b0 2024-09-21T06:43:02.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.611+0000 7f53437fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c78559c9f0 0x55c785982e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:02.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.611+0000 7f53437fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c78559c9f0 0x55c785982e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52956/0 (socket says 172.21.15.7:52956) 2024-09-21T06:43:02.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.611+0000 7f53437fe640 1 -- 172.21.15.7:0/2782713131 learned_addr learned my addr 172.21.15.7:0/2782713131 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:43:02.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.611+0000 7f5342ffd640 1 --2- 172.21.15.7:0/2782713131 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c7855b51b0 0x55c7859833a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:02.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.611+0000 7f5343fff640 1 --2- 172.21.15.7:0/2782713131 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c7855bd390 0x55c785992280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:02.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.611+0000 7f53437fe640 1 -- 172.21.15.7:0/2782713131 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c7855b51b0 msgr2=0x55c7859833a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:02.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.611+0000 7f53437fe640 1 --2- 172.21.15.7:0/2782713131 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c7855b51b0 0x55c7859833a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:02.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.611+0000 7f53437fe640 1 -- 172.21.15.7:0/2782713131 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c7855bd390 msgr2=0x55c785992280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:02.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.611+0000 7f53437fe640 1 --2- 172.21.15.7:0/2782713131 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c7855bd390 0x55c785992280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:02.614 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.611+0000 7f53437fe640 1 -- 172.21.15.7:0/2782713131 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c78598b410 con 0x55c78559c9f0 2024-09-21T06:43:02.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.611+0000 7f5343fff640 1 --2- 172.21.15.7:0/2782713131 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c7855bd390 0x55c785992280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:43:02.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.611+0000 7f53437fe640 1 --2- 172.21.15.7:0/2782713131 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c78559c9f0 0x55c785982e60 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x55c7859842d0 tx=0x7f5334008ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8efb45e7e99394b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:02.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.611+0000 7f53297fa640 1 -- 172.21.15.7:0/2782713131 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f533400ee60 con 0x55c78559c9f0 2024-09-21T06:43:02.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.611+0000 7f53297fa640 1 -- 172.21.15.7:0/2782713131 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5334004510 con 0x55c78559c9f0 2024-09-21T06:43:02.615 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.612+0000 7f53297fa640 1 -- 172.21.15.7:0/2782713131 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5334017040 con 0x55c78559c9f0 2024-09-21T06:43:02.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.612+0000 7f53502da740 1 -- 172.21.15.7:0/2782713131 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c78559c9f0 msgr2=0x55c785982e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:02.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.612+0000 7f53502da740 1 --2- 172.21.15.7:0/2782713131 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c78559c9f0 0x55c785982e60 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x55c7859842d0 tx=0x7f5334008ff0 comp rx=0 tx=0).stop 2024-09-21T06:43:02.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.612+0000 7f53502da740 1 -- 172.21.15.7:0/2782713131 shutdown_connections 2024-09-21T06:43:02.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.612+0000 7f53502da740 1 --2- 172.21.15.7:0/2782713131 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c7855bd390 0x55c785992280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:02.618 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.612+0000 7f53502da740 1 --2- 172.21.15.7:0/2782713131 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c7855b51b0 0x55c7859833a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:02.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.612+0000 7f53502da740 1 --2- 172.21.15.7:0/2782713131 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c78559c9f0 0x55c785982e60 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:02.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.612+0000 7f53502da740 1 -- 172.21.15.7:0/2782713131 >> 172.21.15.7:0/2782713131 conn(0x55c7855d2460 msgr2=0x55c785993910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:02.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.612+0000 7f53502da740 1 -- 172.21.15.7:0/2782713131 shutdown_connections 2024-09-21T06:43:02.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.612+0000 7f53502da740 1 -- 172.21.15.7:0/2782713131 wait complete. 2024-09-21T06:43:02.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.613+0000 7f53502da740 1 -- start start 2024-09-21T06:43:02.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.613+0000 7f53502da740 1 Processor -- start 2024-09-21T06:43:02.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.613+0000 7f53502da740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c78559c9f0 0x55c78599dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:02.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.613+0000 7f53502da740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c7855b51b0 0x55c785999290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:02.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.613+0000 7f53502da740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c7855bd390 0x55c785999980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:02.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.613+0000 7f53502da740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f53441aba00 con 0x55c78559c9f0 2024-09-21T06:43:02.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.613+0000 7f53502da740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f53441ace70 con 0x55c7855bd390 2024-09-21T06:43:02.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.613+0000 7f53502da740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f53441ac0d0 con 0x55c7855b51b0 2024-09-21T06:43:02.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.613+0000 7f53502da740 10 client.0 _ll_register_callbacks cb 0x7f5338009950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:43:02.619 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.613+0000 7f53437fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c78559c9f0 0x55c78599dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:02.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.613+0000 7f53437fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c78559c9f0 0x55c78599dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:52964/0 (socket says 172.21.15.7:52964) 2024-09-21T06:43:02.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.614+0000 7f53437fe640 1 -- 172.21.15.7:0/841755131 learned_addr learned my addr 172.21.15.7:0/841755131 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:43:02.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.614+0000 7f5343fff640 1 --2- 172.21.15.7:0/841755131 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c7855bd390 0x55c785999980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:02.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.614+0000 7f5342ffd640 1 --2- 172.21.15.7:0/841755131 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c7855b51b0 0x55c785999290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:02.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.614+0000 7f53437fe640 1 -- 172.21.15.7:0/841755131 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c7855b51b0 msgr2=0x55c785999290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:02.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.614+0000 7f53437fe640 1 --2- 172.21.15.7:0/841755131 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c7855b51b0 0x55c785999290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:02.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.614+0000 7f53437fe640 1 -- 172.21.15.7:0/841755131 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c7855bd390 msgr2=0x55c785999980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:02.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.614+0000 7f53437fe640 1 --2- 172.21.15.7:0/841755131 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c7855bd390 0x55c785999980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:02.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.614+0000 7f53437fe640 1 -- 172.21.15.7:0/841755131 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c785a10dc0 con 0x55c78559c9f0 2024-09-21T06:43:02.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.614+0000 7f5343fff640 1 --2- 172.21.15.7:0/841755131 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c7855bd390 0x55c785999980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:43:02.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.614+0000 7f53437fe640 1 --2- 172.21.15.7:0/841755131 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c78559c9f0 0x55c78599dde0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f5334009930 tx=0x7f5334009960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c02d496039a6ab5d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:02.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.614+0000 7f5322ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:43:02.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.614+0000 7f5322ffd640 1 -- 172.21.15.7:0/841755131 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5334017040 con 0x55c78559c9f0 2024-09-21T06:43:02.620 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.614+0000 7f5322ffd640 1 -- 172.21.15.7:0/841755131 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(77..77 src has 1..77) ==== 8368+0+0 (secure 0 0 0) 0x7f533402b040 con 0x55c78559c9f0 2024-09-21T06:43:02.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.614+0000 7f53502da740 1 -- 172.21.15.7:0/841755131 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5334004510 con 0x55c78559c9f0 2024-09-21T06:43:02.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.614+0000 7f5322ffd640 1 -- 172.21.15.7:0/841755131 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5334005c70 con 0x55c78559c9f0 2024-09-21T06:43:02.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.614+0000 7f53502da740 10 client.16797 fetch_fsmap learned FSMap version 25 2024-09-21T06:43:02.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.614+0000 7f53502da740 1 -- 172.21.15.7:0/841755131 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c785a11e30 con 0x55c78559c9f0 2024-09-21T06:43:02.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.615+0000 7f5322ffd640 1 -- 172.21.15.7:0/841755131 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5334004510 con 0x55c78559c9f0 2024-09-21T06:43:02.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.615+0000 7f5322ffd640 1 -- 172.21.15.7:0/841755131 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f5334038030 con 0x55c78559c9f0 2024-09-21T06:43:02.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.615+0000 7f53502da740 10 client.16797 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:43:02.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.615+0000 7f53502da740 10 client.16797 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:43:02.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.615+0000 7f53502da740 20 client.16797 populate_metadata read hostname 'smithi007' 2024-09-21T06:43:02.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.615+0000 7f53502da740 1 --2- 172.21.15.7:0/841755131 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55c7855de070 0x55c785a14220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:02.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.615+0000 7f53502da740 4 client.16797 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:43:02.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.615+0000 7f53502da740 1 -- 172.21.15.7:0/841755131 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55c7858f9850 con 0x55c7855de070 2024-09-21T06:43:02.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.615+0000 7f5342ffd640 1 --2- 172.21.15.7:0/841755131 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55c7855de070 0x55c785a14220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:02.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.616+0000 7f5322ffd640 10 client.16797 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:43:02.621 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.616+0000 7f5342ffd640 1 --2- 172.21.15.7:0/841755131 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55c7855de070 0x55c785a14220 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c940085770ca8eb7 server_cookie=f2dbe9953c1cd0f7 in_seq=0 out_seq=0 2024-09-21T06:43:02.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.616+0000 7f5322ffd640 1 -- 172.21.15.7:0/841755131 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3410 (crc 0 0 0) 0x55c7858f9850 con 0x55c7855de070 2024-09-21T06:43:02.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.616+0000 7f5322ffd640 10 client.16797 handle_command_reply: tid=0 2024-09-21T06:43:02.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.616+0000 7f53502da740 1 client.16797 shutdown 2024-09-21T06:43:02.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.616+0000 7f53502da740 1 -- 172.21.15.7:0/841755131 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c78559c9f0 msgr2=0x55c78599dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:02.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.616+0000 7f53502da740 1 --2- 172.21.15.7:0/841755131 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c78559c9f0 0x55c78599dde0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f5334009930 tx=0x7f5334009960 comp rx=0 tx=0).stop 2024-09-21T06:43:02.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.616+0000 7f53502da740 1 -- 172.21.15.7:0/841755131 shutdown_connections 2024-09-21T06:43:02.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.616+0000 7f53502da740 1 --2- 172.21.15.7:0/841755131 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55c7855de070 0x55c785a14220 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:02.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.616+0000 7f53502da740 1 --2- 172.21.15.7:0/841755131 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c7855bd390 0x55c785999980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:02.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.616+0000 7f53502da740 1 --2- 172.21.15.7:0/841755131 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c7855b51b0 0x55c785999290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:02.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.616+0000 7f53502da740 1 --2- 172.21.15.7:0/841755131 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c78559c9f0 0x55c78599dde0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:02.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.616+0000 7f53502da740 1 -- 172.21.15.7:0/841755131 >> 172.21.15.7:0/841755131 conn(0x55c7855d2460 msgr2=0x55c7859a03e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:02.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.616+0000 7f5322ffd640 0 client.16797 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:43:02.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.616+0000 7f53502da740 1 -- 172.21.15.7:0/841755131 shutdown_connections 2024-09-21T06:43:02.622 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.616+0000 7f53502da740 1 -- 172.21.15.7:0/841755131 wait complete. 2024-09-21T06:43:02.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.616+0000 7f53502da740 20 client.16797 trim_cache size 0 max 16384 2024-09-21T06:43:02.623 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:43:02 smithi018 ceph-mon[34477]: scrub queued for path: / 2024-09-21T06:43:02.623 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:43:02 smithi018 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-21T06:43:02.623 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:43:02 smithi018 ceph-mon[34477]: scrub summary: active paths [/] 2024-09-21T06:43:02.623 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:43:02 smithi018 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-21T06:43:02.623 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:43:02 smithi018 ceph-mon[34477]: pgmap v524: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 682 B/s wr, 6 op/s 2024-09-21T06:43:02.624 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:43:02.624 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T06:43:02.624 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": { 2024-09-21T06:43:02.624 INFO:teuthology.orchestra.run.smithi007.stdout: "b466f071-ab32-427c-a0ed-73edea33145e": { 2024-09-21T06:43:02.624 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:43:02.624 INFO:teuthology.orchestra.run.smithi007.stdout: "tag": "b466f071-ab32-427c-a0ed-73edea33145e", 2024-09-21T06:43:02.624 INFO:teuthology.orchestra.run.smithi007.stdout: "options": "recursive,force" 2024-09-21T06:43:02.624 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:43:02.624 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:43:02.624 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_stats": { 2024-09-21T06:43:02.624 INFO:teuthology.orchestra.run.smithi007.stdout: "ef9eaabd-003a-44fb-8373-c854a9e15a71": { 2024-09-21T06:43:02.624 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:42:19.467946+0000", 2024-09-21T06:43:02.624 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:43:02.624 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:43:02.625 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:43:02.625 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:43:02.625 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:43:02.625 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:43:02.625 INFO:teuthology.orchestra.run.smithi007.stdout: "b466f071-ab32-427c-a0ed-73edea33145e": { 2024-09-21T06:43:02.625 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:43:01.151440+0000", 2024-09-21T06:43:02.625 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:43:02.625 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:43:02.625 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:43:02.625 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:43:02.625 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:43:02.625 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:43:02.625 INFO:teuthology.orchestra.run.smithi007.stdout: "62fca477-b241-45f5-8185-bc78aeb8b19f": { 2024-09-21T06:43:02.625 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:40:12.744488+0000", 2024-09-21T06:43:02.626 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:43:02.626 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:43:02.626 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:43:02.626 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:43:02.626 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:43:02.626 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:43:02.626 INFO:teuthology.orchestra.run.smithi007.stdout: "a1ae5b3b-f158-44be-8ef4-d70e9ba879cc": { 2024-09-21T06:43:02.626 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:41:37.568453+0000", 2024-09-21T06:43:02.626 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:43:02.626 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:43:02.626 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:43:02.626 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:43:02.626 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:43:02.626 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:43:02.627 INFO:teuthology.orchestra.run.smithi007.stdout: "d7b6a90c-9ae1-4e02-93ad-335a7e9df1d7": { 2024-09-21T06:43:02.627 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:39:19.226139+0000", 2024-09-21T06:43:02.627 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:43:02.627 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:43:02.627 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:43:02.627 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:43:02.627 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:43:02.627 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:43:02.627 INFO:teuthology.orchestra.run.smithi007.stdout: "b0327167-8c41-4286-8afc-7f0780972fd7": { 2024-09-21T06:43:02.627 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:38:36.828657+0000", 2024-09-21T06:43:02.627 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:43:02.627 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:43:02.627 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:43:02.627 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:43:02.627 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:43:02.628 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:43:02.628 INFO:teuthology.orchestra.run.smithi007.stdout: "13441782-2231-4713-8ebd-068a941de47f": { 2024-09-21T06:43:02.628 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:39:30.219006+0000", 2024-09-21T06:43:02.628 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:43:02.628 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:43:02.628 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:43:02.628 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:43:02.628 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:43:02.628 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:43:02.628 INFO:teuthology.orchestra.run.smithi007.stdout: "5cbaaba2-6ab1-4f83-abd6-8c6eef4b5c42": { 2024-09-21T06:43:02.628 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:37:46.566272+0000", 2024-09-21T06:43:02.628 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:43:02.628 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:43:02.628 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:43:02.628 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:43:02.629 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:43:02.629 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:43:02.629 INFO:teuthology.orchestra.run.smithi007.stdout: "6231e9c1-14a2-40b5-be3c-76d87a0d733b": { 2024-09-21T06:43:02.629 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:37:02.484812+0000", 2024-09-21T06:43:02.629 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:43:02.629 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:43:02.629 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:43:02.629 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:43:02.629 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:43:02.629 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:43:02.629 INFO:teuthology.orchestra.run.smithi007.stdout: "310a0ec8-44bb-49ed-a534-3bc91cb1ee9d": { 2024-09-21T06:43:02.629 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:40:55.373968+0000", 2024-09-21T06:43:02.629 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:43:02.629 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:43:02.629 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:43:02.630 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:43:02.630 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:43:02.630 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:43:02.630 INFO:teuthology.orchestra.run.smithi007.stdout: "0b89345c-1f00-4efe-8ee9-4cb17e43584c": { 2024-09-21T06:43:02.630 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:36:19.500334+0000", 2024-09-21T06:43:02.630 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:43:02.630 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:43:02.630 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:43:02.630 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:43:02.630 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:43:02.630 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:43:02.630 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:43:02.630 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:43:02.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.617+0000 7f5349d66640 1 -- 172.21.15.7:0/1399952891 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f532c0b6680 msgr2=0x7f532c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:02.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.617+0000 7f5349d66640 1 --2- 172.21.15.7:0/1399952891 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f532c0b6680 0x7f532c0b8b90 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f5344107130 tx=0x7f53380095e0 comp rx=0 tx=0).stop 2024-09-21T06:43:02.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.617+0000 7f5349d66640 1 -- 172.21.15.7:0/1399952891 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5344109df0 msgr2=0x7f534419fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:02.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.617+0000 7f5349d66640 1 --2- 172.21.15.7:0/1399952891 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5344109df0 0x7f534419fd20 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f533c005cc0 tx=0x7f533c031e40 comp rx=0 tx=0).stop 2024-09-21T06:43:02.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.617+0000 7f5349d66640 1 -- 172.21.15.7:0/1399952891 shutdown_connections 2024-09-21T06:43:02.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.617+0000 7f5349d66640 1 --2- 172.21.15.7:0/1399952891 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f532c0b6680 0x7f532c0b8b90 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:02.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.617+0000 7f5349d66640 1 --2- 172.21.15.7:0/1399952891 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5344109df0 0x7f534419fd20 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:02.631 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.617+0000 7f5349d66640 1 --2- 172.21.15.7:0/1399952891 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f53441094a0 0x7f534419aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:02.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.617+0000 7f5349d66640 1 --2- 172.21.15.7:0/1399952891 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5344103b60 0x7f534419a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:02.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.617+0000 7f5349d66640 1 -- 172.21.15.7:0/1399952891 >> 172.21.15.7:0/1399952891 conn(0x7f534407b850 msgr2=0x7f53441074b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:02.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.617+0000 7f5349d66640 1 -- 172.21.15.7:0/1399952891 shutdown_connections 2024-09-21T06:43:02.632 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:02.617+0000 7f5349d66640 1 -- 172.21.15.7:0/1399952891 wait complete. 2024-09-21T06:43:02.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:43:02 smithi144 ceph-mon[34653]: scrub queued for path: / 2024-09-21T06:43:02.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:43:02 smithi144 ceph-mon[34653]: scrub summary: idle+waiting paths [/] 2024-09-21T06:43:02.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:43:02 smithi144 ceph-mon[34653]: scrub summary: active paths [/] 2024-09-21T06:43:02.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:43:02 smithi144 ceph-mon[34653]: scrub summary: idle+waiting paths [/] 2024-09-21T06:43:02.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:43:02 smithi144 ceph-mon[34653]: pgmap v524: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 682 B/s wr, 6 op/s 2024-09-21T06:43:03.392 INFO:tasks.cephfs.filesystem:scrub status for tag:b466f071-ab32-427c-a0ed-73edea33145e - {'path': '/', 'tag': 'b466f071-ab32-427c-a0ed-73edea33145e', 'options': 'recursive,force'} 2024-09-21T06:43:04.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:43:04 smithi018 ceph-mon[34477]: pgmap v525: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-21T06:43:04.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:43:04 smithi144 ceph-mon[34653]: pgmap v525: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-21T06:43:04.839 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:43:04 smithi007 ceph-mon[30983]: pgmap v525: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-21T06:43:05.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:43:05 smithi018 ceph-mon[34477]: scrub summary: idle 2024-09-21T06:43:05.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:43:05 smithi144 ceph-mon[34653]: scrub summary: idle 2024-09-21T06:43:05.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:43:05 smithi007 ceph-mon[30983]: scrub summary: idle 2024-09-21T06:43:06.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:43:06 smithi018 ceph-mon[34477]: pgmap v526: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-21T06:43:06.786 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:43:06 smithi144 ceph-mon[34653]: pgmap v526: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-21T06:43:06.839 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:43:06 smithi007 ceph-mon[30983]: pgmap v526: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-21T06:43:08.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:43:08 smithi018 ceph-mon[34477]: pgmap v527: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-21T06:43:08.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:43:08 smithi144 ceph-mon[34653]: pgmap v527: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-21T06:43:08.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:43:08 smithi007 ceph-mon[30983]: pgmap v527: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-21T06:43:10.619 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:43:10 smithi018 ceph-mon[34477]: pgmap v528: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-21T06:43:10.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:43:10 smithi144 ceph-mon[34653]: pgmap v528: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-21T06:43:10.839 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:43:10 smithi007 ceph-mon[30983]: pgmap v528: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-21T06:43:11.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:43:11 smithi144 ceph-mon[34653]: osdmap e78: 12 total, 12 up, 12 in 2024-09-21T06:43:11.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:43:11 smithi007 ceph-mon[30983]: osdmap e78: 12 total, 12 up, 12 in 2024-09-21T06:43:11.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:43:11 smithi018 ceph-mon[34477]: osdmap e78: 12 total, 12 up, 12 in 2024-09-21T06:43:12.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:43:12 smithi144 ceph-mon[34653]: pgmap v530: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-09-21T06:43:12.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:43:12 smithi007 ceph-mon[30983]: pgmap v530: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-09-21T06:43:12.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:43:12 smithi018 ceph-mon[34477]: pgmap v530: 97 pgs: 97 active+clean; 3.3 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-09-21T06:43:14.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:43:14 smithi144 ceph-mon[34653]: pgmap v531: 97 pgs: 97 active+clean; 3.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-21T06:43:14.839 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:43:14 smithi007 ceph-mon[30983]: pgmap v531: 97 pgs: 97 active+clean; 3.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-21T06:43:14.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:43:14 smithi018 ceph-mon[34477]: pgmap v531: 97 pgs: 97 active+clean; 3.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-21T06:43:16.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:43:16 smithi144 ceph-mon[34653]: pgmap v532: 97 pgs: 97 active+clean; 3.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-21T06:43:16.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:43:16 smithi007 ceph-mon[30983]: pgmap v532: 97 pgs: 97 active+clean; 3.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-21T06:43:16.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:43:16 smithi018 ceph-mon[34477]: pgmap v532: 97 pgs: 97 active+clean; 3.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-21T06:43:19.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:43:18 smithi018 ceph-mon[34477]: pgmap v533: 97 pgs: 97 active+clean; 3.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-21T06:43:19.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:43:18 smithi018 ceph-mon[34477]: osdmap e79: 12 total, 12 up, 12 in 2024-09-21T06:43:19.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:43:18 smithi144 ceph-mon[34653]: pgmap v533: 97 pgs: 97 active+clean; 3.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-21T06:43:19.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:43:18 smithi144 ceph-mon[34653]: osdmap e79: 12 total, 12 up, 12 in 2024-09-21T06:43:19.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:43:18 smithi007 ceph-mon[30983]: pgmap v533: 97 pgs: 97 active+clean; 3.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-21T06:43:19.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:43:18 smithi007 ceph-mon[30983]: osdmap e79: 12 total, 12 up, 12 in 2024-09-21T06:43:21.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:43:20 smithi018 ceph-mon[34477]: pgmap v535: 97 pgs: 97 active+clean; 3.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 229 B/s wr, 6 op/s 2024-09-21T06:43:21.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:43:20 smithi144 ceph-mon[34653]: pgmap v535: 97 pgs: 97 active+clean; 3.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 229 B/s wr, 6 op/s 2024-09-21T06:43:21.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:43:20 smithi007 ceph-mon[30983]: pgmap v535: 97 pgs: 97 active+clean; 3.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 229 B/s wr, 6 op/s 2024-09-21T06:43:23.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:43:22 smithi144 ceph-mon[34653]: pgmap v536: 97 pgs: 97 active+clean; 3.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-21T06:43:23.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:43:22 smithi007 ceph-mon[30983]: pgmap v536: 97 pgs: 97 active+clean; 3.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-21T06:43:23.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:43:22 smithi018 ceph-mon[34477]: pgmap v536: 97 pgs: 97 active+clean; 3.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-21T06:43:25.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:43:24 smithi144 ceph-mon[34653]: pgmap v537: 97 pgs: 97 active+clean; 3.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-21T06:43:25.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:43:24 smithi007 ceph-mon[30983]: pgmap v537: 97 pgs: 97 active+clean; 3.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-21T06:43:25.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:43:24 smithi018 ceph-mon[34477]: pgmap v537: 97 pgs: 97 active+clean; 3.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-21T06:43:27.142 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:43:26 smithi007 ceph-mon[30983]: pgmap v538: 97 pgs: 97 active+clean; 3.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-21T06:43:27.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:43:26 smithi144 ceph-mon[34653]: pgmap v538: 97 pgs: 97 active+clean; 3.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-21T06:43:27.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:43:26 smithi018 ceph-mon[34477]: pgmap v538: 97 pgs: 97 active+clean; 3.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-21T06:43:29.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:43:28 smithi144 ceph-mon[34653]: pgmap v539: 97 pgs: 97 active+clean; 3.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-21T06:43:29.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:43:28 smithi007 ceph-mon[30983]: pgmap v539: 97 pgs: 97 active+clean; 3.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-21T06:43:29.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:43:28 smithi018 ceph-mon[34477]: pgmap v539: 97 pgs: 97 active+clean; 3.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-21T06:43:31.171 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:43:30 smithi018 ceph-mon[34477]: pgmap v540: 97 pgs: 97 active+clean; 3.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-09-21T06:43:31.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:43:30 smithi144 ceph-mon[34653]: pgmap v540: 97 pgs: 97 active+clean; 3.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-09-21T06:43:31.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:43:30 smithi007 ceph-mon[30983]: pgmap v540: 97 pgs: 97 active+clean; 3.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-09-21T06:43:33.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:43:32 smithi144 ceph-mon[34653]: pgmap v541: 97 pgs: 97 active+clean; 3.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:43:33.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:43:32 smithi007 ceph-mon[30983]: pgmap v541: 97 pgs: 97 active+clean; 3.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:43:33.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:43:32 smithi018 ceph-mon[34477]: pgmap v541: 97 pgs: 97 active+clean; 3.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:43:33.393 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:43:33.670 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:43:34.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.140+0000 7f3f2b9da640 1 -- 172.21.15.7:0/2854650326 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f24109e00 msgr2=0x7f3f24110630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:34.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.140+0000 7f3f2b9da640 1 --2- 172.21.15.7:0/2854650326 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f24109e00 0x7f3f24110630 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c009ca0 tx=0x7f3f1c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:43:34.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.140+0000 7f3f2b9da640 1 -- 172.21.15.7:0/2854650326 shutdown_connections 2024-09-21T06:43:34.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.140+0000 7f3f2b9da640 1 --2- 172.21.15.7:0/2854650326 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f24109e00 0x7f3f24110630 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:34.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.140+0000 7f3f2b9da640 1 --2- 172.21.15.7:0/2854650326 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f241094b0 0x7f3f241098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:34.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.140+0000 7f3f2b9da640 1 --2- 172.21.15.7:0/2854650326 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f24103bc0 0x7f3f24103fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:34.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.140+0000 7f3f2b9da640 1 -- 172.21.15.7:0/2854650326 >> 172.21.15.7:0/2854650326 conn(0x7f3f2407b910 msgr2=0x7f3f2407bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:34.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.141+0000 7f3f2b9da640 1 -- 172.21.15.7:0/2854650326 shutdown_connections 2024-09-21T06:43:34.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.141+0000 7f3f2b9da640 1 -- 172.21.15.7:0/2854650326 wait complete. 2024-09-21T06:43:34.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.141+0000 7f3f2b9da640 1 Processor -- start 2024-09-21T06:43:34.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.141+0000 7f3f2b9da640 1 -- start start 2024-09-21T06:43:34.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.142+0000 7f3f2b9da640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f24103bc0 0x7f3f2419a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:34.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.142+0000 7f3f2b9da640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f241094b0 0x7f3f2419a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:34.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.142+0000 7f3f2b9da640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f24109e00 0x7f3f2419fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:34.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.142+0000 7f3f2b9da640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3f24113ac0 con 0x7f3f241094b0 2024-09-21T06:43:34.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.142+0000 7f3f2b9da640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3f24113940 con 0x7f3f24103bc0 2024-09-21T06:43:34.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.142+0000 7f3f2b9da640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3f24113c40 con 0x7f3f24109e00 2024-09-21T06:43:34.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.142+0000 7f3f28f75640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f241094b0 0x7f3f2419a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:34.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.142+0000 7f3f28f75640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f241094b0 0x7f3f2419a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46832/0 (socket says 172.21.15.7:46832) 2024-09-21T06:43:34.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.142+0000 7f3f28f75640 1 -- 172.21.15.7:0/1616866482 learned_addr learned my addr 172.21.15.7:0/1616866482 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:43:34.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.142+0000 7f3f29f77640 1 --2- 172.21.15.7:0/1616866482 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f24109e00 0x7f3f2419fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:34.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.142+0000 7f3f29776640 1 --2- 172.21.15.7:0/1616866482 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f24103bc0 0x7f3f2419a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:34.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.142+0000 7f3f28f75640 1 -- 172.21.15.7:0/1616866482 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f24109e00 msgr2=0x7f3f2419fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:34.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.142+0000 7f3f28f75640 1 --2- 172.21.15.7:0/1616866482 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f24109e00 0x7f3f2419fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:34.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.142+0000 7f3f28f75640 1 -- 172.21.15.7:0/1616866482 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f24103bc0 msgr2=0x7f3f2419a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:34.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.142+0000 7f3f28f75640 1 --2- 172.21.15.7:0/1616866482 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f24103bc0 0x7f3f2419a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:34.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.142+0000 7f3f28f75640 1 -- 172.21.15.7:0/1616866482 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f241a0300 con 0x7f3f241094b0 2024-09-21T06:43:34.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.142+0000 7f3f29776640 1 --2- 172.21.15.7:0/1616866482 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f24103bc0 0x7f3f2419a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:43:34.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.142+0000 7f3f28f75640 1 --2- 172.21.15.7:0/1616866482 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f241094b0 0x7f3f2419a9f0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f3f1400c8c0 tx=0x7f3f1400cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:34.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.143+0000 7f3f1a7fc640 1 -- 172.21.15.7:0/1616866482 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f14007bb0 con 0x7f3f241094b0 2024-09-21T06:43:34.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.143+0000 7f3f2b9da640 1 -- 172.21.15.7:0/1616866482 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f241a05f0 con 0x7f3f241094b0 2024-09-21T06:43:34.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.143+0000 7f3f1a7fc640 1 -- 172.21.15.7:0/1616866482 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f14007d50 con 0x7f3f241094b0 2024-09-21T06:43:34.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.143+0000 7f3f1a7fc640 1 -- 172.21.15.7:0/1616866482 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f140187c0 con 0x7f3f241094b0 2024-09-21T06:43:34.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.143+0000 7f3f2b9da640 1 -- 172.21.15.7:0/1616866482 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f241a6e10 con 0x7f3f241094b0 2024-09-21T06:43:34.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.146+0000 7f3f31f4e740 1 Processor -- start 2024-09-21T06:43:34.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.146+0000 7f3f31f4e740 1 -- start start 2024-09-21T06:43:34.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.147+0000 7f3f1a7fc640 1 -- 172.21.15.7:0/1616866482 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f3f1400fa20 con 0x7f3f241094b0 2024-09-21T06:43:34.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.147+0000 7f3f31f4e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56400b61d070 0x56400b9c4650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:34.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.147+0000 7f3f31f4e740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56400b5f41b0 0x56400b9c4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:34.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.147+0000 7f3f31f4e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56400b5fc390 0x56400b9c50d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:34.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.147+0000 7f3f31f4e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56400b93ae50 con 0x56400b5fc390 2024-09-21T06:43:34.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.147+0000 7f3f31f4e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56400b92a280 con 0x56400b61d070 2024-09-21T06:43:34.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.147+0000 7f3f31f4e740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x56400b92e090 con 0x56400b5f41b0 2024-09-21T06:43:34.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.147+0000 7f3f28f75640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56400b5fc390 0x56400b9c50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:34.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.147+0000 7f3f29776640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56400b5f41b0 0x56400b9c4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:34.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.147+0000 7f3f28f75640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56400b5fc390 0x56400b9c50d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46844/0 (socket says 172.21.15.7:46844) 2024-09-21T06:43:34.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.147+0000 7f3f28f75640 1 -- 172.21.15.7:0/1694733776 learned_addr learned my addr 172.21.15.7:0/1694733776 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:43:34.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.147+0000 7f3f29f77640 1 --2- 172.21.15.7:0/1694733776 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56400b61d070 0x56400b9c4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:34.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.147+0000 7f3f28f75640 1 -- 172.21.15.7:0/1694733776 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56400b5f41b0 msgr2=0x56400b9c4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:34.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.147+0000 7f3f28f75640 1 --2- 172.21.15.7:0/1694733776 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56400b5f41b0 0x56400b9c4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:34.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.147+0000 7f3f28f75640 1 -- 172.21.15.7:0/1694733776 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56400b61d070 msgr2=0x56400b9c4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:34.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.147+0000 7f3f28f75640 1 --2- 172.21.15.7:0/1694733776 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56400b61d070 0x56400b9c4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:34.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.147+0000 7f3f28f75640 1 -- 172.21.15.7:0/1694733776 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56400b688650 con 0x56400b5fc390 2024-09-21T06:43:34.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.147+0000 7f3f29776640 1 --2- 172.21.15.7:0/1694733776 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56400b5f41b0 0x56400b9c4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:43:34.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.148+0000 7f3f28f75640 1 --2- 172.21.15.7:0/1694733776 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56400b5fc390 0x56400b9c50d0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f3f140e4e90 tx=0x7f3f140edcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d5d268567a43555 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:34.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.148+0000 7f3f1a7fc640 1 --2- 172.21.15.7:0/1616866482 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f3f100b66b0 0x7f3f100b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:34.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.148+0000 7f3f0f7fe640 1 -- 172.21.15.7:0/1694733776 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f140f6070 con 0x56400b5fc390 2024-09-21T06:43:34.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.148+0000 7f3f29f77640 1 --2- 172.21.15.7:0/1616866482 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f3f100b66b0 0x7f3f100b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:34.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.148+0000 7f3f1a7fc640 1 -- 172.21.15.7:0/1616866482 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8412+0+0 (secure 0 0 0) 0x7f3f140e7760 con 0x7f3f241094b0 2024-09-21T06:43:34.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.148+0000 7f3f0f7fe640 1 -- 172.21.15.7:0/1694733776 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f140ad130 con 0x56400b5fc390 2024-09-21T06:43:34.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.148+0000 7f3f0f7fe640 1 -- 172.21.15.7:0/1694733776 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f140ad3f0 con 0x56400b5fc390 2024-09-21T06:43:34.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.149+0000 7f3f31f4e740 1 -- 172.21.15.7:0/1694733776 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56400b5fc390 msgr2=0x56400b9c50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:34.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.149+0000 7f3f29f77640 1 --2- 172.21.15.7:0/1616866482 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f3f100b66b0 0x7f3f100b8bc0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c006010 tx=0x7f3f1c02f310 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:34.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.149+0000 7f3f31f4e740 1 --2- 172.21.15.7:0/1694733776 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56400b5fc390 0x56400b9c50d0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f3f140e4e90 tx=0x7f3f140edcd0 comp rx=0 tx=0).stop 2024-09-21T06:43:34.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.149+0000 7f3f31f4e740 1 -- 172.21.15.7:0/1694733776 shutdown_connections 2024-09-21T06:43:34.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.149+0000 7f3f31f4e740 1 --2- 172.21.15.7:0/1694733776 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56400b5fc390 0x56400b9c50d0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:34.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.149+0000 7f3f31f4e740 1 --2- 172.21.15.7:0/1694733776 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56400b5f41b0 0x56400b9c4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:34.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.149+0000 7f3f31f4e740 1 --2- 172.21.15.7:0/1694733776 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56400b61d070 0x56400b9c4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:34.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.149+0000 7f3f31f4e740 1 -- 172.21.15.7:0/1694733776 >> 172.21.15.7:0/1694733776 conn(0x56400b611460 msgr2=0x56400b9c2540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:34.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.149+0000 7f3f31f4e740 1 -- 172.21.15.7:0/1694733776 shutdown_connections 2024-09-21T06:43:34.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.149+0000 7f3f31f4e740 1 -- 172.21.15.7:0/1694733776 wait complete. 2024-09-21T06:43:34.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.150+0000 7f3f31f4e740 1 -- start start 2024-09-21T06:43:34.153 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.150+0000 7f3f31f4e740 1 Processor -- start 2024-09-21T06:43:34.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.150+0000 7f3f31f4e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56400b5f41b0 0x56400b9cfcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:34.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.150+0000 7f3f31f4e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56400b5fc390 0x56400b9d0230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:34.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.150+0000 7f3f31f4e740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56400b61d070 0x56400b9dc150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:34.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.150+0000 7f3f31f4e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56400b78b700 con 0x56400b5f41b0 2024-09-21T06:43:34.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.150+0000 7f3f31f4e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56400b8c5110 con 0x56400b5fc390 2024-09-21T06:43:34.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.150+0000 7f3f31f4e740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x56400b9d2e30 con 0x56400b61d070 2024-09-21T06:43:34.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.150+0000 7f3f31f4e740 10 client.0 _ll_register_callbacks cb 0x56400b8de990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:43:34.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.150+0000 7f3f29776640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56400b5f41b0 0x56400b9cfcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:34.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.150+0000 7f3f29776640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56400b5f41b0 0x56400b9cfcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46848/0 (socket says 172.21.15.7:46848) 2024-09-21T06:43:34.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.150+0000 7f3f29776640 1 -- 172.21.15.7:0/2825344031 learned_addr learned my addr 172.21.15.7:0/2825344031 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:43:34.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.150+0000 7f3f28f75640 1 --2- 172.21.15.7:0/2825344031 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56400b5fc390 0x56400b9d0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:34.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.151+0000 7f3f29f77640 1 --2- 172.21.15.7:0/2825344031 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56400b61d070 0x56400b9dc150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:34.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.151+0000 7f3f29776640 1 -- 172.21.15.7:0/2825344031 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56400b61d070 msgr2=0x56400b9dc150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:34.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.151+0000 7f3f29776640 1 --2- 172.21.15.7:0/2825344031 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56400b61d070 0x56400b9dc150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:34.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.151+0000 7f3f29776640 1 -- 172.21.15.7:0/2825344031 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56400b5fc390 msgr2=0x56400b9d0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:34.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.151+0000 7f3f29776640 1 --2- 172.21.15.7:0/2825344031 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56400b5fc390 0x56400b9d0230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:34.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.151+0000 7f3f29776640 1 -- 172.21.15.7:0/2825344031 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56400b8f2c40 con 0x56400b5f41b0 2024-09-21T06:43:34.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.151+0000 7f3f29f77640 1 --2- 172.21.15.7:0/2825344031 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56400b61d070 0x56400b9dc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:43:34.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.151+0000 7f3f29776640 1 --2- 172.21.15.7:0/2825344031 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56400b5f41b0 0x56400b9cfcf0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f3f2000bf30 tx=0x7f3f200128e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc1ca6dc09ad9dbd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:34.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.151+0000 7f3f0cff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:43:34.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.151+0000 7f3f0cff9640 1 -- 172.21.15.7:0/2825344031 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f20005220 con 0x56400b5f41b0 2024-09-21T06:43:34.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.151+0000 7f3f0cff9640 1 -- 172.21.15.7:0/2825344031 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8412+0+0 (secure 0 0 0) 0x7f3f200053c0 con 0x56400b5f41b0 2024-09-21T06:43:34.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.151+0000 7f3f31f4e740 1 -- 172.21.15.7:0/2825344031 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3f140ad130 con 0x56400b5f41b0 2024-09-21T06:43:34.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.151+0000 7f3f0cff9640 1 -- 172.21.15.7:0/2825344031 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3f200055c0 con 0x56400b5f41b0 2024-09-21T06:43:34.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.151+0000 7f3f31f4e740 10 client.16809 fetch_fsmap learned FSMap version 25 2024-09-21T06:43:34.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.151+0000 7f3f31f4e740 1 -- 172.21.15.7:0/2825344031 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56400b9debb0 con 0x56400b5f41b0 2024-09-21T06:43:34.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.152+0000 7f3f0cff9640 1 -- 172.21.15.7:0/2825344031 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f140ad130 con 0x56400b5f41b0 2024-09-21T06:43:34.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.152+0000 7f3f0cff9640 1 -- 172.21.15.7:0/2825344031 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f3f20022030 con 0x56400b5f41b0 2024-09-21T06:43:34.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.152+0000 7f3f31f4e740 10 client.16809 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:43:34.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.152+0000 7f3f31f4e740 10 client.16809 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:43:34.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.152+0000 7f3f31f4e740 20 client.16809 populate_metadata read hostname 'smithi007' 2024-09-21T06:43:34.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.152+0000 7f3f31f4e740 1 --2- 172.21.15.7:0/2825344031 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x56400b5db9f0 0x56400b9e2160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:34.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.152+0000 7f3f31f4e740 4 client.16809 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:43:34.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.152+0000 7f3f31f4e740 1 -- 172.21.15.7:0/2825344031 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56400b93cda0 con 0x56400b5db9f0 2024-09-21T06:43:34.158 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.152+0000 7f3f28f75640 1 --2- 172.21.15.7:0/2825344031 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x56400b5db9f0 0x56400b9e2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:34.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.153+0000 7f3f0cff9640 10 client.16809 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:43:34.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.153+0000 7f3f28f75640 1 --2- 172.21.15.7:0/2825344031 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x56400b5db9f0 0x56400b9e2160 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7bfd741489d871b server_cookie=32ab95f2735526df in_seq=0 out_seq=0 2024-09-21T06:43:34.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.153+0000 7f3f0cff9640 1 -- 172.21.15.7:0/2825344031 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56400b93cda0 con 0x56400b5db9f0 2024-09-21T06:43:34.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.153+0000 7f3f0cff9640 10 client.16809 handle_command_reply: tid=0 2024-09-21T06:43:34.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.154+0000 7f3f31f4e740 1 client.16809 shutdown 2024-09-21T06:43:34.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.154+0000 7f3f31f4e740 1 -- 172.21.15.7:0/2825344031 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56400b5f41b0 msgr2=0x56400b9cfcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:34.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.154+0000 7f3f31f4e740 1 --2- 172.21.15.7:0/2825344031 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56400b5f41b0 0x56400b9cfcf0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f3f2000bf30 tx=0x7f3f200128e0 comp rx=0 tx=0).stop 2024-09-21T06:43:34.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.154+0000 7f3f31f4e740 1 -- 172.21.15.7:0/2825344031 shutdown_connections 2024-09-21T06:43:34.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.154+0000 7f3f31f4e740 1 --2- 172.21.15.7:0/2825344031 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x56400b5db9f0 0x56400b9e2160 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:34.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.154+0000 7f3f31f4e740 1 --2- 172.21.15.7:0/2825344031 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56400b61d070 0x56400b9dc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:34.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.154+0000 7f3f31f4e740 1 --2- 172.21.15.7:0/2825344031 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56400b5fc390 0x56400b9d0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:34.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.154+0000 7f3f31f4e740 1 --2- 172.21.15.7:0/2825344031 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56400b5f41b0 0x56400b9cfcf0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:34.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.154+0000 7f3f31f4e740 1 -- 172.21.15.7:0/2825344031 >> 172.21.15.7:0/2825344031 conn(0x56400b611460 msgr2=0x56400b9c77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:34.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.154+0000 7f3f0cff9640 0 client.16809 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:43:34.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.154+0000 7f3f31f4e740 1 -- 172.21.15.7:0/2825344031 shutdown_connections 2024-09-21T06:43:34.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.154+0000 7f3f31f4e740 1 -- 172.21.15.7:0/2825344031 wait complete. 2024-09-21T06:43:34.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.154+0000 7f3f31f4e740 20 client.16809 trim_cache size 0 max 16384 2024-09-21T06:43:34.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.172+0000 7f3f31f4e740 1 Processor -- start 2024-09-21T06:43:34.173 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.172+0000 7f3f31f4e740 1 -- start start 2024-09-21T06:43:34.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.172+0000 7f3f31f4e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56400b5f41b0 0x56400b9d01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:34.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.172+0000 7f3f31f4e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56400b5fc390 0x56400b9dc050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:34.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.172+0000 7f3f31f4e740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56400b61d070 0x56400b9c1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:34.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.172+0000 7f3f31f4e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3f241b1d80 con 0x56400b5fc390 2024-09-21T06:43:34.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.172+0000 7f3f31f4e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3f241af650 con 0x56400b5f41b0 2024-09-21T06:43:34.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.172+0000 7f3f31f4e740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3f241ad4c0 con 0x56400b61d070 2024-09-21T06:43:34.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.172+0000 7f3f28f75640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56400b5fc390 0x56400b9dc050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:34.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.172+0000 7f3f28f75640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56400b5fc390 0x56400b9dc050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46852/0 (socket says 172.21.15.7:46852) 2024-09-21T06:43:34.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.172+0000 7f3f28f75640 1 -- 172.21.15.7:0/2014830953 learned_addr learned my addr 172.21.15.7:0/2014830953 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:43:34.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.172+0000 7f3f29776640 1 --2- 172.21.15.7:0/2014830953 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56400b5f41b0 0x56400b9d01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:34.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.172+0000 7f3f29f77640 1 --2- 172.21.15.7:0/2014830953 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56400b61d070 0x56400b9c1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:34.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.172+0000 7f3f28f75640 1 -- 172.21.15.7:0/2014830953 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56400b61d070 msgr2=0x56400b9c1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:34.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.172+0000 7f3f28f75640 1 --2- 172.21.15.7:0/2014830953 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56400b61d070 0x56400b9c1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:34.175 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.172+0000 7f3f28f75640 1 -- 172.21.15.7:0/2014830953 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56400b5f41b0 msgr2=0x56400b9d01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:34.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.172+0000 7f3f28f75640 1 --2- 172.21.15.7:0/2014830953 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56400b5f41b0 0x56400b9d01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:34.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.172+0000 7f3f28f75640 1 -- 172.21.15.7:0/2014830953 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56400b9c6ec0 con 0x56400b5fc390 2024-09-21T06:43:34.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.173+0000 7f3f28f75640 1 --2- 172.21.15.7:0/2014830953 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56400b5fc390 0x56400b9dc050 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f3f140a9bf0 tx=0x7f3f140a94c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75d238a4a1c24e26 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:34.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.173+0000 7f3f0effd640 1 -- 172.21.15.7:0/2014830953 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f140f6040 con 0x56400b5fc390 2024-09-21T06:43:34.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.173+0000 7f3f0effd640 1 -- 172.21.15.7:0/2014830953 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f140ad130 con 0x56400b5fc390 2024-09-21T06:43:34.176 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.173+0000 7f3f0effd640 1 -- 172.21.15.7:0/2014830953 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f140acd90 con 0x56400b5fc390 2024-09-21T06:43:34.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.173+0000 7f3f31f4e740 1 -- 172.21.15.7:0/2014830953 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56400b5fc390 msgr2=0x56400b9dc050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:34.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.173+0000 7f3f31f4e740 1 --2- 172.21.15.7:0/2014830953 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56400b5fc390 0x56400b9dc050 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f3f140a9bf0 tx=0x7f3f140a94c0 comp rx=0 tx=0).stop 2024-09-21T06:43:34.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.174+0000 7f3f31f4e740 1 -- 172.21.15.7:0/2014830953 shutdown_connections 2024-09-21T06:43:34.178 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.174+0000 7f3f31f4e740 1 --2- 172.21.15.7:0/2014830953 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56400b61d070 0x56400b9c1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:34.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.174+0000 7f3f31f4e740 1 --2- 172.21.15.7:0/2014830953 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56400b5fc390 0x56400b9dc050 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:34.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.174+0000 7f3f31f4e740 1 --2- 172.21.15.7:0/2014830953 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56400b5f41b0 0x56400b9d01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:34.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.174+0000 7f3f31f4e740 1 -- 172.21.15.7:0/2014830953 >> 172.21.15.7:0/2014830953 conn(0x56400b611460 msgr2=0x56400b9cfaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:34.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.174+0000 7f3f31f4e740 1 -- 172.21.15.7:0/2014830953 shutdown_connections 2024-09-21T06:43:34.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.174+0000 7f3f31f4e740 1 -- 172.21.15.7:0/2014830953 wait complete. 2024-09-21T06:43:34.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.174+0000 7f3f31f4e740 1 -- start start 2024-09-21T06:43:34.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.174+0000 7f3f31f4e740 1 Processor -- start 2024-09-21T06:43:34.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.175+0000 7f3f31f4e740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56400b5f41b0 0x56400b9d85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:34.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.175+0000 7f3f31f4e740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56400b5fc390 0x56400b9d3a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:34.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.175+0000 7f3f31f4e740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56400b61d070 0x56400b9d3f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:34.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.175+0000 7f3f31f4e740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3f241adb10 con 0x56400b5f41b0 2024-09-21T06:43:34.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.175+0000 7f3f31f4e740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3f241aef80 con 0x56400b61d070 2024-09-21T06:43:34.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.175+0000 7f3f31f4e740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3f241ae1e0 con 0x56400b5fc390 2024-09-21T06:43:34.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.175+0000 7f3f31f4e740 10 client.0 _ll_register_callbacks cb 0x7f3f2000b8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:43:34.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.175+0000 7f3f29776640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56400b5f41b0 0x56400b9d85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:34.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.175+0000 7f3f29776640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56400b5f41b0 0x56400b9d85a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46856/0 (socket says 172.21.15.7:46856) 2024-09-21T06:43:34.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.175+0000 7f3f29776640 1 -- 172.21.15.7:0/3771763147 learned_addr learned my addr 172.21.15.7:0/3771763147 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:43:34.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.175+0000 7f3f29f77640 1 --2- 172.21.15.7:0/3771763147 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56400b61d070 0x56400b9d3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:34.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.175+0000 7f3f28f75640 1 --2- 172.21.15.7:0/3771763147 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56400b5fc390 0x56400b9d3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:34.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.175+0000 7f3f29776640 1 -- 172.21.15.7:0/3771763147 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56400b5fc390 msgr2=0x56400b9d3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:34.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.175+0000 7f3f29776640 1 --2- 172.21.15.7:0/3771763147 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56400b5fc390 0x56400b9d3a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:34.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.175+0000 7f3f29776640 1 -- 172.21.15.7:0/3771763147 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56400b61d070 msgr2=0x56400b9d3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:34.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.175+0000 7f3f29776640 1 --2- 172.21.15.7:0/3771763147 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56400b61d070 0x56400b9d3f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:34.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.175+0000 7f3f29776640 1 -- 172.21.15.7:0/3771763147 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56400b9d44d0 con 0x56400b5f41b0 2024-09-21T06:43:34.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.175+0000 7f3f29776640 1 --2- 172.21.15.7:0/3771763147 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56400b5f41b0 0x56400b9d85a0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f3f2000bf30 tx=0x7f3f20005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e48b70926aecfcc4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:34.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.175+0000 7f3f0cff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:43:34.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.176+0000 7f3f0cff9640 1 -- 172.21.15.7:0/3771763147 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f20032060 con 0x56400b5f41b0 2024-09-21T06:43:34.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.176+0000 7f3f0cff9640 1 -- 172.21.15.7:0/3771763147 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8412+0+0 (secure 0 0 0) 0x7f3f20023900 con 0x56400b5f41b0 2024-09-21T06:43:34.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.176+0000 7f3f31f4e740 1 -- 172.21.15.7:0/3771763147 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3f140ad130 con 0x56400b5f41b0 2024-09-21T06:43:34.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.176+0000 7f3f0cff9640 1 -- 172.21.15.7:0/3771763147 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3f20023b00 con 0x56400b5f41b0 2024-09-21T06:43:34.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.176+0000 7f3f31f4e740 10 client.16815 fetch_fsmap learned FSMap version 25 2024-09-21T06:43:34.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.176+0000 7f3f31f4e740 1 -- 172.21.15.7:0/3771763147 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56400ba4c7e0 con 0x56400b5f41b0 2024-09-21T06:43:34.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.176+0000 7f3f0cff9640 1 -- 172.21.15.7:0/3771763147 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f140ad130 con 0x56400b5f41b0 2024-09-21T06:43:34.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.176+0000 7f3f0cff9640 1 -- 172.21.15.7:0/3771763147 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f3f20035020 con 0x56400b5f41b0 2024-09-21T06:43:34.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.176+0000 7f3f31f4e740 10 client.16815 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:43:34.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.176+0000 7f3f31f4e740 10 client.16815 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:43:34.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.176+0000 7f3f31f4e740 20 client.16815 populate_metadata read hostname 'smithi007' 2024-09-21T06:43:34.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.176+0000 7f3f31f4e740 1 --2- 172.21.15.7:0/3771763147 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x56400b5b0da0 0x56400ba4f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:34.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.176+0000 7f3f31f4e740 4 client.16815 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:43:34.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.176+0000 7f3f31f4e740 1 -- 172.21.15.7:0/3771763147 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56400b938850 con 0x56400b5b0da0 2024-09-21T06:43:34.181 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.177+0000 7f3f28f75640 1 --2- 172.21.15.7:0/3771763147 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x56400b5b0da0 0x56400ba4f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:34.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.177+0000 7f3f0cff9640 10 client.16815 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:43:34.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.177+0000 7f3f28f75640 1 --2- 172.21.15.7:0/3771763147 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x56400b5b0da0 0x56400ba4f000 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4230c4171671be24 server_cookie=e38b9b9436fb7052 in_seq=0 out_seq=0 2024-09-21T06:43:34.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.177+0000 7f3f0cff9640 1 -- 172.21.15.7:0/3771763147 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3214 (crc 0 0 0) 0x56400b938850 con 0x56400b5b0da0 2024-09-21T06:43:34.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.177+0000 7f3f0cff9640 10 client.16815 handle_command_reply: tid=0 2024-09-21T06:43:34.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.177+0000 7f3f31f4e740 1 client.16815 shutdown 2024-09-21T06:43:34.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.177+0000 7f3f31f4e740 1 -- 172.21.15.7:0/3771763147 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56400b5f41b0 msgr2=0x56400b9d85a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:34.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.177+0000 7f3f31f4e740 1 --2- 172.21.15.7:0/3771763147 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56400b5f41b0 0x56400b9d85a0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f3f2000bf30 tx=0x7f3f20005800 comp rx=0 tx=0).stop 2024-09-21T06:43:34.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.178+0000 7f3f31f4e740 1 -- 172.21.15.7:0/3771763147 shutdown_connections 2024-09-21T06:43:34.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.178+0000 7f3f31f4e740 1 --2- 172.21.15.7:0/3771763147 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x56400b5b0da0 0x56400ba4f000 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:34.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.178+0000 7f3f0cff9640 0 client.16815 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:43:34.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.178+0000 7f3f31f4e740 1 --2- 172.21.15.7:0/3771763147 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56400b61d070 0x56400b9d3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:34.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.178+0000 7f3f31f4e740 1 --2- 172.21.15.7:0/3771763147 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56400b5fc390 0x56400b9d3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:34.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.178+0000 7f3f31f4e740 1 --2- 172.21.15.7:0/3771763147 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56400b5f41b0 0x56400b9d85a0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:34.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.178+0000 7f3f31f4e740 1 -- 172.21.15.7:0/3771763147 >> 172.21.15.7:0/3771763147 conn(0x56400b611460 msgr2=0x56400b9c5680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:34.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.178+0000 7f3f31f4e740 1 -- 172.21.15.7:0/3771763147 shutdown_connections 2024-09-21T06:43:34.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.178+0000 7f3f31f4e740 1 -- 172.21.15.7:0/3771763147 wait complete. 2024-09-21T06:43:34.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.178+0000 7f3f31f4e740 20 client.16815 trim_cache size 0 max 16384 2024-09-21T06:43:34.184 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:43:34.184 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "no active scrubs running", 2024-09-21T06:43:34.184 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": {}, 2024-09-21T06:43:34.184 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_stats": { 2024-09-21T06:43:34.184 INFO:teuthology.orchestra.run.smithi007.stdout: "ef9eaabd-003a-44fb-8373-c854a9e15a71": { 2024-09-21T06:43:34.184 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:42:19.467946+0000", 2024-09-21T06:43:34.184 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:43:34.184 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:43:34.184 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:43:34.184 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:43:34.184 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:43:34.185 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:43:34.185 INFO:teuthology.orchestra.run.smithi007.stdout: "b466f071-ab32-427c-a0ed-73edea33145e": { 2024-09-21T06:43:34.185 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:43:01.151440+0000", 2024-09-21T06:43:34.185 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:43:34.185 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:43:34.185 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:43:34.185 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:43:34.185 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:43:34.185 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:43:34.185 INFO:teuthology.orchestra.run.smithi007.stdout: "62fca477-b241-45f5-8185-bc78aeb8b19f": { 2024-09-21T06:43:34.185 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:40:12.744488+0000", 2024-09-21T06:43:34.185 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:43:34.185 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:43:34.185 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:43:34.185 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:43:34.186 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:43:34.186 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:43:34.186 INFO:teuthology.orchestra.run.smithi007.stdout: "a1ae5b3b-f158-44be-8ef4-d70e9ba879cc": { 2024-09-21T06:43:34.186 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:41:37.568453+0000", 2024-09-21T06:43:34.186 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:43:34.186 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:43:34.186 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:43:34.186 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:43:34.186 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:43:34.186 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:43:34.186 INFO:teuthology.orchestra.run.smithi007.stdout: "d7b6a90c-9ae1-4e02-93ad-335a7e9df1d7": { 2024-09-21T06:43:34.186 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:39:19.226139+0000", 2024-09-21T06:43:34.186 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:43:34.186 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:43:34.187 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:43:34.187 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:43:34.187 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:43:34.187 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:43:34.187 INFO:teuthology.orchestra.run.smithi007.stdout: "b0327167-8c41-4286-8afc-7f0780972fd7": { 2024-09-21T06:43:34.187 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:38:36.828657+0000", 2024-09-21T06:43:34.187 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:43:34.187 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:43:34.187 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:43:34.187 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:43:34.187 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:43:34.187 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:43:34.187 INFO:teuthology.orchestra.run.smithi007.stdout: "13441782-2231-4713-8ebd-068a941de47f": { 2024-09-21T06:43:34.187 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:39:30.219006+0000", 2024-09-21T06:43:34.187 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:43:34.188 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:43:34.188 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:43:34.188 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:43:34.188 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:43:34.188 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:43:34.188 INFO:teuthology.orchestra.run.smithi007.stdout: "5cbaaba2-6ab1-4f83-abd6-8c6eef4b5c42": { 2024-09-21T06:43:34.188 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:37:46.566272+0000", 2024-09-21T06:43:34.188 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:43:34.188 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:43:34.188 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:43:34.188 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:43:34.188 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:43:34.188 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:43:34.188 INFO:teuthology.orchestra.run.smithi007.stdout: "6231e9c1-14a2-40b5-be3c-76d87a0d733b": { 2024-09-21T06:43:34.189 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:37:02.484812+0000", 2024-09-21T06:43:34.189 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:43:34.189 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:43:34.189 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:43:34.189 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:43:34.189 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:43:34.189 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:43:34.189 INFO:teuthology.orchestra.run.smithi007.stdout: "310a0ec8-44bb-49ed-a534-3bc91cb1ee9d": { 2024-09-21T06:43:34.189 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:40:55.373968+0000", 2024-09-21T06:43:34.189 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:43:34.189 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:43:34.189 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:43:34.189 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:43:34.189 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:43:34.189 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:43:34.190 INFO:teuthology.orchestra.run.smithi007.stdout: "0b89345c-1f00-4efe-8ee9-4cb17e43584c": { 2024-09-21T06:43:34.190 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:36:19.500334+0000", 2024-09-21T06:43:34.190 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:43:34.190 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:43:34.190 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:43:34.190 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:43:34.190 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:43:34.190 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:43:34.190 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:43:34.190 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:43:34.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.178+0000 7f3f2b9da640 1 -- 172.21.15.7:0/1616866482 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f3f100b66b0 msgr2=0x7f3f100b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:34.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.178+0000 7f3f2b9da640 1 --2- 172.21.15.7:0/1616866482 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f3f100b66b0 0x7f3f100b8bc0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c006010 tx=0x7f3f1c02f310 comp rx=0 tx=0).stop 2024-09-21T06:43:34.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.178+0000 7f3f2b9da640 1 -- 172.21.15.7:0/1616866482 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f241094b0 msgr2=0x7f3f2419a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:34.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.179+0000 7f3f2b9da640 1 --2- 172.21.15.7:0/1616866482 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f241094b0 0x7f3f2419a9f0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f3f1400c8c0 tx=0x7f3f1400cd80 comp rx=0 tx=0).stop 2024-09-21T06:43:34.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.179+0000 7f3f2b9da640 1 -- 172.21.15.7:0/1616866482 shutdown_connections 2024-09-21T06:43:34.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.179+0000 7f3f2b9da640 1 --2- 172.21.15.7:0/1616866482 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f3f100b66b0 0x7f3f100b8bc0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:34.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.179+0000 7f3f2b9da640 1 --2- 172.21.15.7:0/1616866482 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3f24109e00 0x7f3f2419fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:34.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.179+0000 7f3f2b9da640 1 --2- 172.21.15.7:0/1616866482 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3f241094b0 0x7f3f2419a9f0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:34.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.179+0000 7f3f2b9da640 1 --2- 172.21.15.7:0/1616866482 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f24103bc0 0x7f3f2419a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:34.191 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.179+0000 7f3f2b9da640 1 -- 172.21.15.7:0/1616866482 >> 172.21.15.7:0/1616866482 conn(0x7f3f2407b910 msgr2=0x7f3f24105480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:34.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.179+0000 7f3f2b9da640 1 -- 172.21.15.7:0/1616866482 shutdown_connections 2024-09-21T06:43:34.192 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:34.179+0000 7f3f2b9da640 1 -- 172.21.15.7:0/1616866482 wait complete. 2024-09-21T06:43:34.947 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:43:34.947 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:43:35.206 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:43:35.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:43:34 smithi144 ceph-mon[34653]: pgmap v542: 97 pgs: 97 active+clean; 3.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:43:35.328 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:43:34 smithi007 ceph-mon[30983]: pgmap v542: 97 pgs: 97 active+clean; 3.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:43:35.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:43:34 smithi018 ceph-mon[34477]: pgmap v542: 97 pgs: 97 active+clean; 3.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:43:35.707 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:35.705+0000 7fb12db3f640 1 -- 172.21.15.7:0/2617688581 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb128108d10 msgr2=0x7fb12810f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:35.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:35.705+0000 7fb12db3f640 1 --2- 172.21.15.7:0/2617688581 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb128108d10 0x7fb12810f540 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fb120009ca0 tx=0x7fb12002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:43:35.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:35.705+0000 7fb12db3f640 1 -- 172.21.15.7:0/2617688581 shutdown_connections 2024-09-21T06:43:35.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:35.705+0000 7fb12db3f640 1 --2- 172.21.15.7:0/2617688581 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb128108d10 0x7fb12810f540 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:35.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:35.705+0000 7fb12db3f640 1 --2- 172.21.15.7:0/2617688581 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb1281083c0 0x7fb1281087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:35.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:35.705+0000 7fb12db3f640 1 --2- 172.21.15.7:0/2617688581 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb128102a80 0x7fb128102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:35.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:35.705+0000 7fb12db3f640 1 -- 172.21.15.7:0/2617688581 >> 172.21.15.7:0/2617688581 conn(0x7fb128079740 msgr2=0x7fb128079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:35.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:35.705+0000 7fb12db3f640 1 -- 172.21.15.7:0/2617688581 shutdown_connections 2024-09-21T06:43:35.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:35.705+0000 7fb12db3f640 1 -- 172.21.15.7:0/2617688581 wait complete. 2024-09-21T06:43:35.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:35.706+0000 7fb12db3f640 1 Processor -- start 2024-09-21T06:43:35.708 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:35.706+0000 7fb12db3f640 1 -- start start 2024-09-21T06:43:35.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:35.706+0000 7fb12db3f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb128102a80 0x7fb128199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:35.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:35.706+0000 7fb12db3f640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1281083c0 0x7fb1281998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:35.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:35.706+0000 7fb12db3f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb128108d10 0x7fb12819eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:35.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:35.706+0000 7fb12db3f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb128112980 con 0x7fb128102a80 2024-09-21T06:43:35.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:35.706+0000 7fb12db3f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb128112800 con 0x7fb128108d10 2024-09-21T06:43:35.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:35.706+0000 7fb12db3f640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb128112b00 con 0x7fb1281083c0 2024-09-21T06:43:35.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:35.706+0000 7fb1277fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb128102a80 0x7fb128199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:35.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:35.706+0000 7fb1277fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb128102a80 0x7fb128199310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46886/0 (socket says 172.21.15.7:46886) 2024-09-21T06:43:35.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:35.706+0000 7fb1277fe640 1 -- 172.21.15.7:0/2307019830 learned_addr learned my addr 172.21.15.7:0/2307019830 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:43:35.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:35.707+0000 7fb126ffd640 1 --2- 172.21.15.7:0/2307019830 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1281083c0 0x7fb1281998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:35.710 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:35.707+0000 7fb127fff640 1 --2- 172.21.15.7:0/2307019830 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb128108d10 0x7fb12819eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:35.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:35.707+0000 7fb1277fe640 1 -- 172.21.15.7:0/2307019830 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1281083c0 msgr2=0x7fb1281998b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:35.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:35.707+0000 7fb1277fe640 1 --2- 172.21.15.7:0/2307019830 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1281083c0 0x7fb1281998b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:35.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:35.707+0000 7fb1277fe640 1 -- 172.21.15.7:0/2307019830 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb128108d10 msgr2=0x7fb12819eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:35.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:35.707+0000 7fb1277fe640 1 --2- 172.21.15.7:0/2307019830 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb128108d10 0x7fb12819eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:35.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:35.707+0000 7fb1277fe640 1 -- 172.21.15.7:0/2307019830 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb12819f280 con 0x7fb128102a80 2024-09-21T06:43:35.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:35.707+0000 7fb127fff640 1 --2- 172.21.15.7:0/2307019830 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb128108d10 0x7fb12819eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:43:35.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:35.707+0000 7fb1277fe640 1 --2- 172.21.15.7:0/2307019830 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb128102a80 0x7fb128199310 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fb11800c970 tx=0x7fb11800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:35.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:35.707+0000 7fb124ff9640 1 -- 172.21.15.7:0/2307019830 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb118007bb0 con 0x7fb128102a80 2024-09-21T06:43:35.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:35.707+0000 7fb12db3f640 1 -- 172.21.15.7:0/2307019830 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb12819f570 con 0x7fb128102a80 2024-09-21T06:43:35.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:35.707+0000 7fb124ff9640 1 -- 172.21.15.7:0/2307019830 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb118007d50 con 0x7fb128102a80 2024-09-21T06:43:35.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:35.707+0000 7fb124ff9640 1 -- 172.21.15.7:0/2307019830 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb11800f450 con 0x7fb128102a80 2024-09-21T06:43:35.711 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:35.707+0000 7fb12db3f640 1 -- 172.21.15.7:0/2307019830 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb12806bb40 con 0x7fb128102a80 2024-09-21T06:43:35.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:35.708+0000 7fb12db3f640 1 -- 172.21.15.7:0/2307019830 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb128103d00 con 0x7fb128102a80 2024-09-21T06:43:35.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:35.711+0000 7fb124ff9640 1 -- 172.21.15.7:0/2307019830 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7fb118004f00 con 0x7fb128102a80 2024-09-21T06:43:35.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:35.712+0000 7fb124ff9640 1 --2- 172.21.15.7:0/2307019830 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fb1140b6680 0x7fb1140b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:35.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:35.712+0000 7fb126ffd640 1 --2- 172.21.15.7:0/2307019830 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fb1140b6680 0x7fb1140b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:35.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:35.712+0000 7fb124ff9640 1 -- 172.21.15.7:0/2307019830 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8412+0+0 (secure 0 0 0) 0x7fb1180e7830 con 0x7fb128102a80 2024-09-21T06:43:35.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:35.712+0000 7fb126ffd640 1 --2- 172.21.15.7:0/2307019830 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fb1140b6680 0x7fb1140b8b90 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fb128105e90 tx=0x7fb11000b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:35.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:35.715+0000 7fb124ff9640 1 -- 172.21.15.7:0/2307019830 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb118014030 con 0x7fb128102a80 2024-09-21T06:43:35.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:35.946+0000 7fb12db3f640 1 -- 172.21.15.7:0/2307019830 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb12819a440 con 0x7fb128102a80 2024-09-21T06:43:35.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:35.947+0000 7fb124ff9640 1 -- 172.21.15.7:0/2307019830 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11899 (secure 0 0 0) 0x7fb12819a440 con 0x7fb128102a80 2024-09-21T06:43:35.949 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:43:35.949 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-21T06:36:10:753693+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2015971546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2015971546},{"type":"v1","addr":"172.21.15.7:6835","nonce":2015971546}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/2350816224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":2350816224},{"type":"v1","addr":"172.21.15.7:6837","nonce":2350816224}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14823,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/1669980572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":1669980572},{"type":"v1","addr":"172.21.15.7:6839","nonce":1669980572}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14835,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/2528308973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":2528308973},{"type":"v1","addr":"172.21.15.7:6841","nonce":2528308973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24623,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1337382979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1337382979},{"type":"v1","addr":"172.21.15.18:6833","nonce":1337382979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/2751454345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":2751454345},{"type":"v1","addr":"172.21.15.144:6833","nonce":2751454345}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:34:24.627168+0000","modified":"2024-09-21T06:36:10.737288+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24716,"mds_1":24688,"mds_2":24686},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24656":{"gid":24656,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6835/158884796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":158884796},{"type":"v1","addr":"172.21.15.18:6835","nonce":158884796}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6835/3636739922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3636739922},{"type":"v1","addr":"172.21.15.144:6835","nonce":3636739922}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24673":{"gid":24673,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6837/1126341753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":1126341753},{"type":"v1","addr":"172.21.15.144:6837","nonce":1126341753}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.18:6837/1539670694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1539670694},{"type":"v1","addr":"172.21.15.18:6837","nonce":1539670694}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24688":{"gid":24688,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.144:6839/4027821922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":4027821922},{"type":"v1","addr":"172.21.15.144:6839","nonce":4027821922}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24716":{"gid":24716,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.18:6839/3798713532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":3798713532},{"type":"v1","addr":"172.21.15.18:6839","nonce":3798713532}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24716,"qdb_cluster":[24716,24688,24686]},"id":1}]} 2024-09-21T06:43:35.949 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-21T06:43:35.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:35.951+0000 7fb12db3f640 1 -- 172.21.15.7:0/2307019830 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fb1140b6680 msgr2=0x7fb1140b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:35.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:35.951+0000 7fb12db3f640 1 --2- 172.21.15.7:0/2307019830 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fb1140b6680 0x7fb1140b8b90 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fb128105e90 tx=0x7fb11000b390 comp rx=0 tx=0).stop 2024-09-21T06:43:35.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:35.951+0000 7fb12db3f640 1 -- 172.21.15.7:0/2307019830 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb128102a80 msgr2=0x7fb128199310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:35.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:35.951+0000 7fb12db3f640 1 --2- 172.21.15.7:0/2307019830 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb128102a80 0x7fb128199310 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fb11800c970 tx=0x7fb11800ce30 comp rx=0 tx=0).stop 2024-09-21T06:43:35.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:35.951+0000 7fb12db3f640 1 -- 172.21.15.7:0/2307019830 shutdown_connections 2024-09-21T06:43:35.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:35.951+0000 7fb12db3f640 1 --2- 172.21.15.7:0/2307019830 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fb1140b6680 0x7fb1140b8b90 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:35.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:35.951+0000 7fb12db3f640 1 --2- 172.21.15.7:0/2307019830 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb128108d10 0x7fb12819eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:35.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:35.951+0000 7fb12db3f640 1 --2- 172.21.15.7:0/2307019830 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb1281083c0 0x7fb1281998b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:35.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:35.951+0000 7fb12db3f640 1 --2- 172.21.15.7:0/2307019830 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb128102a80 0x7fb128199310 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:35.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:35.951+0000 7fb12db3f640 1 -- 172.21.15.7:0/2307019830 >> 172.21.15.7:0/2307019830 conn(0x7fb128079740 msgr2=0x7fb128104390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:35.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:35.951+0000 7fb12db3f640 1 -- 172.21.15.7:0/2307019830 shutdown_connections 2024-09-21T06:43:35.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:35.951+0000 7fb12db3f640 1 -- 172.21.15.7:0/2307019830 wait complete. 2024-09-21T06:43:36.677 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:43:36.936 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:43:37.057 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:43:36 smithi007 ceph-mon[30983]: pgmap v543: 97 pgs: 97 active+clean; 3.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:43:37.058 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:43:36 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2307019830' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:43:37.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:43:36 smithi144 ceph-mon[34653]: pgmap v543: 97 pgs: 97 active+clean; 3.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:43:37.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:43:36 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/2307019830' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:43:37.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:43:36 smithi018 ceph-mon[34477]: pgmap v543: 97 pgs: 97 active+clean; 3.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:43:37.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:43:36 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/2307019830' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:43:37.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.458+0000 7fa37789b640 1 -- 172.21.15.7:0/444820228 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa370110260 msgr2=0x7fa370112680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:37.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.458+0000 7fa37789b640 1 --2- 172.21.15.7:0/444820228 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa370110260 0x7fa370112680 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fa368009ca0 tx=0x7fa36802a950 comp rx=0 tx=0).stop 2024-09-21T06:43:37.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.458+0000 7fa37789b640 1 -- 172.21.15.7:0/444820228 shutdown_connections 2024-09-21T06:43:37.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.458+0000 7fa37789b640 1 --2- 172.21.15.7:0/444820228 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa370110260 0x7fa370112680 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:37.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.458+0000 7fa37789b640 1 --2- 172.21.15.7:0/444820228 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa370103000 0x7fa37010fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:37.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.458+0000 7fa37789b640 1 --2- 172.21.15.7:0/444820228 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3701026b0 0x7fa370102ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:37.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.458+0000 7fa37789b640 1 -- 172.21.15.7:0/444820228 >> 172.21.15.7:0/444820228 conn(0x7fa370079790 msgr2=0x7fa370079ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:37.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.459+0000 7fa37789b640 1 -- 172.21.15.7:0/444820228 shutdown_connections 2024-09-21T06:43:37.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.459+0000 7fa37789b640 1 -- 172.21.15.7:0/444820228 wait complete. 2024-09-21T06:43:37.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.459+0000 7fa37789b640 1 Processor -- start 2024-09-21T06:43:37.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.459+0000 7fa37789b640 1 -- start start 2024-09-21T06:43:37.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.460+0000 7fa37789b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3701026b0 0x7fa37019c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:37.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.460+0000 7fa37789b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa370103000 0x7fa37019cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:37.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.460+0000 7fa37789b640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa370110260 0x7fa3701a1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:37.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.460+0000 7fa37789b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa370115ca0 con 0x7fa370103000 2024-09-21T06:43:37.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.460+0000 7fa37789b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa370115b20 con 0x7fa3701026b0 2024-09-21T06:43:37.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.460+0000 7fa37789b640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa370115e20 con 0x7fa370110260 2024-09-21T06:43:37.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.460+0000 7fa374e36640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa370103000 0x7fa37019cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:37.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.460+0000 7fa374e36640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa370103000 0x7fa37019cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46902/0 (socket says 172.21.15.7:46902) 2024-09-21T06:43:37.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.460+0000 7fa374e36640 1 -- 172.21.15.7:0/875251822 learned_addr learned my addr 172.21.15.7:0/875251822 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:43:37.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.460+0000 7fa375637640 1 --2- 172.21.15.7:0/875251822 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3701026b0 0x7fa37019c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:37.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.460+0000 7fa375e38640 1 --2- 172.21.15.7:0/875251822 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa370110260 0x7fa3701a1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:37.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.460+0000 7fa374e36640 1 -- 172.21.15.7:0/875251822 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa370110260 msgr2=0x7fa3701a1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:37.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.460+0000 7fa374e36640 1 --2- 172.21.15.7:0/875251822 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa370110260 0x7fa3701a1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:37.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.460+0000 7fa374e36640 1 -- 172.21.15.7:0/875251822 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3701026b0 msgr2=0x7fa37019c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:37.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.460+0000 7fa374e36640 1 --2- 172.21.15.7:0/875251822 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3701026b0 0x7fa37019c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:37.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.460+0000 7fa374e36640 1 -- 172.21.15.7:0/875251822 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3701a2600 con 0x7fa370103000 2024-09-21T06:43:37.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.460+0000 7fa375637640 1 --2- 172.21.15.7:0/875251822 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3701026b0 0x7fa37019c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:43:37.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.460+0000 7fa374e36640 1 --2- 172.21.15.7:0/875251822 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa370103000 0x7fa37019cc30 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fa36000e9f0 tx=0x7fa36000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:37.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.461+0000 7fa3667fc640 1 -- 172.21.15.7:0/875251822 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa36000cd80 con 0x7fa370103000 2024-09-21T06:43:37.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.461+0000 7fa3667fc640 1 -- 172.21.15.7:0/875251822 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3600108e0 con 0x7fa370103000 2024-09-21T06:43:37.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.461+0000 7fa37789b640 1 -- 172.21.15.7:0/875251822 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3701a28f0 con 0x7fa370103000 2024-09-21T06:43:37.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.461+0000 7fa3667fc640 1 -- 172.21.15.7:0/875251822 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa360018980 con 0x7fa370103000 2024-09-21T06:43:37.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.461+0000 7fa37789b640 1 -- 172.21.15.7:0/875251822 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3701a9050 con 0x7fa370103000 2024-09-21T06:43:37.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.464+0000 7fa37de0f740 1 Processor -- start 2024-09-21T06:43:37.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.464+0000 7fa37de0f740 1 -- start start 2024-09-21T06:43:37.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.464+0000 7fa37de0f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575e6ba7070 0x5575e6f4e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:37.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.464+0000 7fa37de0f740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575e6b7e1b0 0x5575e6f4ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:37.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.464+0000 7fa37de0f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575e6b86390 0x5575e6f4f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:37.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.464+0000 7fa37de0f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5575e6ec4ea0 con 0x5575e6ba7070 2024-09-21T06:43:37.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.464+0000 7fa37de0f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5575e6eb42d0 con 0x5575e6b86390 2024-09-21T06:43:37.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.464+0000 7fa37de0f740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5575e6eb80e0 con 0x5575e6b7e1b0 2024-09-21T06:43:37.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.464+0000 7fa3667fc640 1 -- 172.21.15.7:0/875251822 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7fa360018b20 con 0x7fa370103000 2024-09-21T06:43:37.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.464+0000 7fa375e38640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575e6ba7070 0x5575e6f4e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:37.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.464+0000 7fa375637640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575e6b7e1b0 0x5575e6f4ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:37.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.464+0000 7fa375e38640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575e6ba7070 0x5575e6f4e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46914/0 (socket says 172.21.15.7:46914) 2024-09-21T06:43:37.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.464+0000 7fa375e38640 1 -- 172.21.15.7:0/2136207348 learned_addr learned my addr 172.21.15.7:0/2136207348 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:43:37.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.465+0000 7fa374e36640 1 --2- 172.21.15.7:0/2136207348 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575e6b86390 0x5575e6f4f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:37.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.465+0000 7fa375637640 1 -- 172.21.15.7:0/2136207348 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575e6b86390 msgr2=0x5575e6f4f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:37.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.465+0000 7fa375637640 1 --2- 172.21.15.7:0/2136207348 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575e6b86390 0x5575e6f4f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:37.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.465+0000 7fa375637640 1 -- 172.21.15.7:0/2136207348 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575e6ba7070 msgr2=0x5575e6f4e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:37.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.465+0000 7fa375637640 1 --2- 172.21.15.7:0/2136207348 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575e6ba7070 0x5575e6f4e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:37.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.465+0000 7fa375637640 1 -- 172.21.15.7:0/2136207348 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575e6c12650 con 0x5575e6b7e1b0 2024-09-21T06:43:37.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.465+0000 7fa375e38640 1 --2- 172.21.15.7:0/2136207348 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575e6ba7070 0x5575e6f4e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:43:37.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.465+0000 7fa375637640 1 --2- 172.21.15.7:0/2136207348 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575e6b7e1b0 0x5575e6f4ebe0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa36c009fd0 tx=0x7fa36c0118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb7b9efcd41b2fd1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:37.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.465+0000 7fa35b7fe640 1 -- 172.21.15.7:0/2136207348 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa36c004030 con 0x5575e6b7e1b0 2024-09-21T06:43:37.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.466+0000 7fa3667fc640 1 --2- 172.21.15.7:0/875251822 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa35c0b6700 0x7fa35c0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:37.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.466+0000 7fa35b7fe640 1 -- 172.21.15.7:0/2136207348 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa36c0054d0 con 0x5575e6b7e1b0 2024-09-21T06:43:37.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.466+0000 7fa35b7fe640 1 -- 172.21.15.7:0/2136207348 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa36c004c40 con 0x5575e6b7e1b0 2024-09-21T06:43:37.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.466+0000 7fa375e38640 1 --2- 172.21.15.7:0/875251822 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa35c0b6700 0x7fa35c0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:37.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.466+0000 7fa3667fc640 1 -- 172.21.15.7:0/875251822 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8412+0+0 (secure 0 0 0) 0x7fa3600e79a0 con 0x7fa370103000 2024-09-21T06:43:37.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.467+0000 7fa375e38640 1 --2- 172.21.15.7:0/875251822 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa35c0b6700 0x7fa35c0b8c10 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fa3680094e0 tx=0x7fa368005c50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:37.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.467+0000 7fa37de0f740 1 -- 172.21.15.7:0/2136207348 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575e6b7e1b0 msgr2=0x5575e6f4ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:37.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.467+0000 7fa37de0f740 1 --2- 172.21.15.7:0/2136207348 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575e6b7e1b0 0x5575e6f4ebe0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa36c009fd0 tx=0x7fa36c0118d0 comp rx=0 tx=0).stop 2024-09-21T06:43:37.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.467+0000 7fa37de0f740 1 -- 172.21.15.7:0/2136207348 shutdown_connections 2024-09-21T06:43:37.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.467+0000 7fa37de0f740 1 --2- 172.21.15.7:0/2136207348 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575e6b86390 0x5575e6f4f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:37.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.467+0000 7fa37de0f740 1 --2- 172.21.15.7:0/2136207348 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575e6b7e1b0 0x5575e6f4ebe0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:37.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.467+0000 7fa37de0f740 1 --2- 172.21.15.7:0/2136207348 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575e6ba7070 0x5575e6f4e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:37.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.467+0000 7fa37de0f740 1 -- 172.21.15.7:0/2136207348 >> 172.21.15.7:0/2136207348 conn(0x5575e6b9b460 msgr2=0x5575e6f4c590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:37.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.467+0000 7fa37de0f740 1 -- 172.21.15.7:0/2136207348 shutdown_connections 2024-09-21T06:43:37.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.467+0000 7fa37de0f740 1 -- 172.21.15.7:0/2136207348 wait complete. 2024-09-21T06:43:37.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.468+0000 7fa37de0f740 1 -- start start 2024-09-21T06:43:37.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.468+0000 7fa37de0f740 1 Processor -- start 2024-09-21T06:43:37.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.468+0000 7fa37de0f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575e6b7e1b0 0x5575e6f59ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:37.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.468+0000 7fa37de0f740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575e6b86390 0x5575e6f5a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:37.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.468+0000 7fa37de0f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575e6ba7070 0x5575e6f5a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:37.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.468+0000 7fa37de0f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5575e6d15700 con 0x5575e6ba7070 2024-09-21T06:43:37.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.468+0000 7fa37de0f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5575e6e4f160 con 0x5575e6b7e1b0 2024-09-21T06:43:37.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.468+0000 7fa37de0f740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5575e6f5ce80 con 0x5575e6b86390 2024-09-21T06:43:37.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.468+0000 7fa375637640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575e6b7e1b0 0x5575e6f59ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:37.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.468+0000 7fa375637640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575e6b7e1b0 0x5575e6f59ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.7:39776/0 (socket says 172.21.15.7:39776) 2024-09-21T06:43:37.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.468+0000 7fa375637640 1 -- 172.21.15.7:0/1895074778 learned_addr learned my addr 172.21.15.7:0/1895074778 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:43:37.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.468+0000 7fa375e38640 1 --2- 172.21.15.7:0/1895074778 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575e6ba7070 0x5575e6f5a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:37.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.468+0000 7fa37de0f740 10 client.0 _ll_register_callbacks cb 0x5575e6e689e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:43:37.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.469+0000 7fa374e36640 1 --2- 172.21.15.7:0/1895074778 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575e6b86390 0x5575e6f5a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:37.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.469+0000 7fa375e38640 1 -- 172.21.15.7:0/1895074778 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575e6b86390 msgr2=0x5575e6f5a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:37.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.469+0000 7fa375e38640 1 --2- 172.21.15.7:0/1895074778 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575e6b86390 0x5575e6f5a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:37.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.469+0000 7fa375e38640 1 -- 172.21.15.7:0/1895074778 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575e6b7e1b0 msgr2=0x5575e6f59ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:37.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.469+0000 7fa375e38640 1 --2- 172.21.15.7:0/1895074778 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575e6b7e1b0 0x5575e6f59ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:37.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.469+0000 7fa375e38640 1 -- 172.21.15.7:0/1895074778 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575e6e7cc90 con 0x5575e6ba7070 2024-09-21T06:43:37.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.469+0000 7fa375637640 1 --2- 172.21.15.7:0/1895074778 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575e6b7e1b0 0x5575e6f59ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:43:37.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.469+0000 7fa375e38640 1 --2- 172.21.15.7:0/1895074778 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575e6ba7070 0x5575e6f5a760 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fa36802ae70 tx=0x7fa3680095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d73de434e3d3710 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:37.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.469+0000 7fa358ff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:43:37.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.469+0000 7fa358ff9640 1 -- 172.21.15.7:0/1895074778 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa368056060 con 0x5575e6ba7070 2024-09-21T06:43:37.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.469+0000 7fa37de0f740 1 -- 172.21.15.7:0/1895074778 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa36c0054d0 con 0x5575e6ba7070 2024-09-21T06:43:37.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.469+0000 7fa358ff9640 1 -- 172.21.15.7:0/1895074778 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8412+0+0 (secure 0 0 0) 0x7fa368003e40 con 0x5575e6ba7070 2024-09-21T06:43:37.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.470+0000 7fa358ff9640 1 -- 172.21.15.7:0/1895074778 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa368034040 con 0x5575e6ba7070 2024-09-21T06:43:37.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.470+0000 7fa37de0f740 10 client.16833 fetch_fsmap learned FSMap version 25 2024-09-21T06:43:37.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.470+0000 7fa37de0f740 1 -- 172.21.15.7:0/1895074778 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5575e6f68ac0 con 0x5575e6ba7070 2024-09-21T06:43:37.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.470+0000 7fa358ff9640 1 -- 172.21.15.7:0/1895074778 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa36c0054d0 con 0x5575e6ba7070 2024-09-21T06:43:37.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.470+0000 7fa358ff9640 1 -- 172.21.15.7:0/1895074778 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa368059020 con 0x5575e6ba7070 2024-09-21T06:43:37.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.470+0000 7fa37de0f740 10 client.16833 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:43:37.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.470+0000 7fa37de0f740 10 client.16833 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-21T06:43:37.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.470+0000 7fa37de0f740 20 client.16833 populate_metadata read hostname 'smithi007' 2024-09-21T06:43:37.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.470+0000 7fa37de0f740 1 --2- 172.21.15.7:0/1895074778 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x5575e6b659f0 0x5575e6f6c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:37.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.470+0000 7fa37de0f740 4 client.16833 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:43:37.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.470+0000 7fa37de0f740 1 -- 172.21.15.7:0/1895074778 --> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5575e6ec6df0 con 0x5575e6b659f0 2024-09-21T06:43:37.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.471+0000 7fa375637640 1 --2- 172.21.15.7:0/1895074778 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x5575e6b659f0 0x5575e6f6c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:37.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.471+0000 7fa358ff9640 10 client.16833 ms_handle_connect on v2:172.21.15.18:6836/1539670694 2024-09-21T06:43:37.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.471+0000 7fa375637640 1 --2- 172.21.15.7:0/1895074778 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x5575e6b659f0 0x5575e6f6c0b0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=319b0205a8d81c45 server_cookie=ad292bf99f6a216e in_seq=0 out_seq=0 2024-09-21T06:43:37.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.472+0000 7fa358ff9640 1 -- 172.21.15.7:0/1895074778 <== mds.2 v2:172.21.15.18:6836/1539670694 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5575e6ec6df0 con 0x5575e6b659f0 2024-09-21T06:43:37.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.472+0000 7fa358ff9640 10 client.16833 handle_command_reply: tid=0 2024-09-21T06:43:37.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.472+0000 7fa37de0f740 1 client.16833 shutdown 2024-09-21T06:43:37.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.472+0000 7fa37de0f740 1 -- 172.21.15.7:0/1895074778 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575e6ba7070 msgr2=0x5575e6f5a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:37.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.472+0000 7fa37de0f740 1 --2- 172.21.15.7:0/1895074778 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575e6ba7070 0x5575e6f5a760 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fa36802ae70 tx=0x7fa3680095c0 comp rx=0 tx=0).stop 2024-09-21T06:43:37.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.472+0000 7fa37de0f740 1 -- 172.21.15.7:0/1895074778 shutdown_connections 2024-09-21T06:43:37.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.472+0000 7fa37de0f740 1 --2- 172.21.15.7:0/1895074778 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x5575e6b659f0 0x5575e6f6c0b0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:37.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.472+0000 7fa37de0f740 1 --2- 172.21.15.7:0/1895074778 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575e6ba7070 0x5575e6f5a760 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:37.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.472+0000 7fa37de0f740 1 --2- 172.21.15.7:0/1895074778 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575e6b86390 0x5575e6f5a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:37.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.472+0000 7fa37de0f740 1 --2- 172.21.15.7:0/1895074778 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575e6b7e1b0 0x5575e6f59ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:37.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.472+0000 7fa37de0f740 1 -- 172.21.15.7:0/1895074778 >> 172.21.15.7:0/1895074778 conn(0x5575e6b9b460 msgr2=0x5575e6f51850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:37.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.472+0000 7fa358ff9640 0 client.16833 ms_handle_reset on v2:172.21.15.18:6836/1539670694 2024-09-21T06:43:37.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.472+0000 7fa37de0f740 1 -- 172.21.15.7:0/1895074778 shutdown_connections 2024-09-21T06:43:37.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.472+0000 7fa37de0f740 1 -- 172.21.15.7:0/1895074778 wait complete. 2024-09-21T06:43:37.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.472+0000 7fa37de0f740 20 client.16833 trim_cache size 0 max 16384 2024-09-21T06:43:37.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.486+0000 7fa37de0f740 1 Processor -- start 2024-09-21T06:43:37.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.486+0000 7fa37de0f740 1 -- start start 2024-09-21T06:43:37.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.486+0000 7fa37de0f740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575e6b7e1b0 0x5575e6f5b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:37.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.486+0000 7fa37de0f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575e6b86390 0x5575e6f56ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:37.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.486+0000 7fa37de0f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575e6ba7070 0x5575e6f57410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:37.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.486+0000 7fa37de0f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa3701b4120 con 0x5575e6b86390 2024-09-21T06:43:37.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.486+0000 7fa37de0f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa3701b19f0 con 0x5575e6ba7070 2024-09-21T06:43:37.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.486+0000 7fa37de0f740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa3701af860 con 0x5575e6b7e1b0 2024-09-21T06:43:37.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.487+0000 7fa374e36640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575e6b86390 0x5575e6f56ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:37.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.487+0000 7fa375e38640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575e6ba7070 0x5575e6f57410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:37.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.487+0000 7fa374e36640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575e6b86390 0x5575e6f56ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46942/0 (socket says 172.21.15.7:46942) 2024-09-21T06:43:37.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.487+0000 7fa374e36640 1 -- 172.21.15.7:0/2078627712 learned_addr learned my addr 172.21.15.7:0/2078627712 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:43:37.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.487+0000 7fa375637640 1 --2- 172.21.15.7:0/2078627712 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575e6b7e1b0 0x5575e6f5b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:37.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.487+0000 7fa375e38640 1 -- 172.21.15.7:0/2078627712 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575e6b7e1b0 msgr2=0x5575e6f5b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:37.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.487+0000 7fa375e38640 1 --2- 172.21.15.7:0/2078627712 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575e6b7e1b0 0x5575e6f5b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:37.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.487+0000 7fa375e38640 1 -- 172.21.15.7:0/2078627712 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575e6b86390 msgr2=0x5575e6f56ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:37.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.487+0000 7fa375e38640 1 --2- 172.21.15.7:0/2078627712 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575e6b86390 0x5575e6f56ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:37.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.487+0000 7fa375e38640 1 -- 172.21.15.7:0/2078627712 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575e6f5afa0 con 0x5575e6ba7070 2024-09-21T06:43:37.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.487+0000 7fa375e38640 1 --2- 172.21.15.7:0/2078627712 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575e6ba7070 0x5575e6f57410 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa368030890 tx=0x7fa36802a950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f1e4a527ecd28c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:37.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.487+0000 7fa35affd640 1 -- 172.21.15.7:0/2078627712 <== mon.2 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa368056040 con 0x5575e6ba7070 2024-09-21T06:43:37.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.487+0000 7fa35affd640 1 -- 172.21.15.7:0/2078627712 <== mon.2 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa368003d40 con 0x5575e6ba7070 2024-09-21T06:43:37.491 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.487+0000 7fa35affd640 1 -- 172.21.15.7:0/2078627712 <== mon.2 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3680306a0 con 0x5575e6ba7070 2024-09-21T06:43:37.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.488+0000 7fa37de0f740 1 -- 172.21.15.7:0/2078627712 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575e6ba7070 msgr2=0x5575e6f57410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:37.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.488+0000 7fa37de0f740 1 --2- 172.21.15.7:0/2078627712 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575e6ba7070 0x5575e6f57410 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa368030890 tx=0x7fa36802a950 comp rx=0 tx=0).stop 2024-09-21T06:43:37.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.488+0000 7fa37de0f740 1 -- 172.21.15.7:0/2078627712 shutdown_connections 2024-09-21T06:43:37.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.488+0000 7fa37de0f740 1 --2- 172.21.15.7:0/2078627712 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575e6ba7070 0x5575e6f57410 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:37.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.488+0000 7fa37de0f740 1 --2- 172.21.15.7:0/2078627712 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575e6b86390 0x5575e6f56ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:37.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.488+0000 7fa37de0f740 1 --2- 172.21.15.7:0/2078627712 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575e6b7e1b0 0x5575e6f5b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:37.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.488+0000 7fa37de0f740 1 -- 172.21.15.7:0/2078627712 >> 172.21.15.7:0/2078627712 conn(0x5575e6b9b460 msgr2=0x5575e6f5b200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:37.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.489+0000 7fa37de0f740 1 -- 172.21.15.7:0/2078627712 shutdown_connections 2024-09-21T06:43:37.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.489+0000 7fa37de0f740 1 -- 172.21.15.7:0/2078627712 wait complete. 2024-09-21T06:43:37.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.489+0000 7fa37de0f740 1 -- start start 2024-09-21T06:43:37.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.489+0000 7fa37de0f740 1 Processor -- start 2024-09-21T06:43:37.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.490+0000 7fa37de0f740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575e6b7e1b0 0x5575e6f62970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:37.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.490+0000 7fa37de0f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575e6b86390 0x5575e6f5de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:37.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.490+0000 7fa37de0f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575e6ba7070 0x5575e6f5e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:37.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.490+0000 7fa37de0f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa3701afeb0 con 0x5575e6b86390 2024-09-21T06:43:37.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.490+0000 7fa37de0f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa3701b1320 con 0x5575e6ba7070 2024-09-21T06:43:37.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.490+0000 7fa37de0f740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa3701b0580 con 0x5575e6b7e1b0 2024-09-21T06:43:37.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.490+0000 7fa37de0f740 10 client.0 _ll_register_callbacks cb 0x7fa368009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:43:37.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.490+0000 7fa375637640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575e6b7e1b0 0x5575e6f62970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:37.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.490+0000 7fa375637640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575e6b7e1b0 0x5575e6f62970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.7:36396/0 (socket says 172.21.15.7:36396) 2024-09-21T06:43:37.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.490+0000 7fa374e36640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575e6b86390 0x5575e6f5de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:37.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.490+0000 7fa375637640 1 -- 172.21.15.7:0/1428256233 learned_addr learned my addr 172.21.15.7:0/1428256233 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:43:37.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.490+0000 7fa375e38640 1 --2- 172.21.15.7:0/1428256233 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575e6ba7070 0x5575e6f5e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:37.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.490+0000 7fa375637640 1 -- 172.21.15.7:0/1428256233 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575e6ba7070 msgr2=0x5575e6f5e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:37.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.490+0000 7fa375637640 1 --2- 172.21.15.7:0/1428256233 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575e6ba7070 0x5575e6f5e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:37.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.490+0000 7fa375637640 1 -- 172.21.15.7:0/1428256233 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575e6b86390 msgr2=0x5575e6f5de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:37.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.490+0000 7fa375637640 1 --2- 172.21.15.7:0/1428256233 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575e6b86390 0x5575e6f5de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:37.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.490+0000 7fa375637640 1 -- 172.21.15.7:0/1428256233 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575e6f5ebc0 con 0x5575e6b7e1b0 2024-09-21T06:43:37.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.490+0000 7fa375e38640 1 --2- 172.21.15.7:0/1428256233 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575e6ba7070 0x5575e6f5e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:43:37.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.490+0000 7fa375637640 1 --2- 172.21.15.7:0/1428256233 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575e6b7e1b0 0x5575e6f62970 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa36c004600 tx=0x7fa36c009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b522866306de7df server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:37.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.490+0000 7fa358ff9640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-21T06:43:37.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.491+0000 7fa358ff9640 1 -- 172.21.15.7:0/1428256233 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa36c02f020 con 0x5575e6b7e1b0 2024-09-21T06:43:37.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.491+0000 7fa358ff9640 1 -- 172.21.15.7:0/1428256233 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8412+0+0 (secure 0 0 0) 0x7fa36c00fad0 con 0x5575e6b7e1b0 2024-09-21T06:43:37.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.491+0000 7fa37de0f740 1 -- 172.21.15.7:0/1428256233 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa368003d40 con 0x5575e6b7e1b0 2024-09-21T06:43:37.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.491+0000 7fa358ff9640 1 -- 172.21.15.7:0/1428256233 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa36c03a050 con 0x5575e6b7e1b0 2024-09-21T06:43:37.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.491+0000 7fa37de0f740 10 client.26254 fetch_fsmap learned FSMap version 25 2024-09-21T06:43:37.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.491+0000 7fa37de0f740 1 -- 172.21.15.7:0/1428256233 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5575e6fd6a30 con 0x5575e6b7e1b0 2024-09-21T06:43:37.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.491+0000 7fa358ff9640 1 -- 172.21.15.7:0/1428256233 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa368003d40 con 0x5575e6b7e1b0 2024-09-21T06:43:37.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.491+0000 7fa358ff9640 1 -- 172.21.15.7:0/1428256233 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa36c024410 con 0x5575e6b7e1b0 2024-09-21T06:43:37.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.491+0000 7fa37de0f740 10 client.26254 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:43:37.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.491+0000 7fa37de0f740 10 client.26254 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-21T06:43:37.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.491+0000 7fa37de0f740 20 client.26254 populate_metadata read hostname 'smithi007' 2024-09-21T06:43:37.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.491+0000 7fa37de0f740 1 --2- 172.21.15.7:0/1428256233 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x5575e6b3ada0 0x5575e6fd90b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:37.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.492+0000 7fa37de0f740 4 client.26254 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:43:37.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.492+0000 7fa37de0f740 1 -- 172.21.15.7:0/1428256233 --> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5575e6ec28a0 con 0x5575e6b3ada0 2024-09-21T06:43:37.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.492+0000 7fa374e36640 1 --2- 172.21.15.7:0/1428256233 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x5575e6b3ada0 0x5575e6fd90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:37.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.492+0000 7fa358ff9640 10 client.26254 ms_handle_connect on v2:172.21.15.18:6836/1539670694 2024-09-21T06:43:37.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.492+0000 7fa374e36640 1 --2- 172.21.15.7:0/1428256233 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x5575e6b3ada0 0x5575e6fd90b0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ad7cb000f41fac6 server_cookie=3682779104e67e20 in_seq=0 out_seq=0 2024-09-21T06:43:37.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.493+0000 7fa358ff9640 1 -- 172.21.15.7:0/1428256233 <== mds.2 v2:172.21.15.18:6836/1539670694 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5575e6ec28a0 con 0x5575e6b3ada0 2024-09-21T06:43:37.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.493+0000 7fa358ff9640 10 client.26254 handle_command_reply: tid=0 2024-09-21T06:43:37.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.493+0000 7fa37de0f740 1 client.26254 shutdown 2024-09-21T06:43:37.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.493+0000 7fa37de0f740 1 -- 172.21.15.7:0/1428256233 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575e6b7e1b0 msgr2=0x5575e6f62970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:37.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.493+0000 7fa37de0f740 1 --2- 172.21.15.7:0/1428256233 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575e6b7e1b0 0x5575e6f62970 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa36c004600 tx=0x7fa36c009310 comp rx=0 tx=0).stop 2024-09-21T06:43:37.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.493+0000 7fa37de0f740 1 -- 172.21.15.7:0/1428256233 shutdown_connections 2024-09-21T06:43:37.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.493+0000 7fa37de0f740 1 --2- 172.21.15.7:0/1428256233 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x5575e6b3ada0 0x5575e6fd90b0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:37.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.493+0000 7fa37de0f740 1 --2- 172.21.15.7:0/1428256233 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575e6ba7070 0x5575e6f5e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:37.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.493+0000 7fa37de0f740 1 --2- 172.21.15.7:0/1428256233 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575e6b86390 0x5575e6f5de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:37.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.493+0000 7fa358ff9640 0 client.26254 ms_handle_reset on v2:172.21.15.18:6836/1539670694 2024-09-21T06:43:37.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.493+0000 7fa37de0f740 1 --2- 172.21.15.7:0/1428256233 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575e6b7e1b0 0x5575e6f62970 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:37.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.493+0000 7fa37de0f740 1 -- 172.21.15.7:0/1428256233 >> 172.21.15.7:0/1428256233 conn(0x5575e6b9b460 msgr2=0x5575e6f4f680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:37.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.493+0000 7fa37de0f740 1 -- 172.21.15.7:0/1428256233 shutdown_connections 2024-09-21T06:43:37.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.493+0000 7fa37de0f740 1 -- 172.21.15.7:0/1428256233 wait complete. 2024-09-21T06:43:37.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.493+0000 7fa37de0f740 20 client.26254 trim_cache size 0 max 16384 2024-09-21T06:43:37.500 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:43:37.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.494+0000 7fa37789b640 1 -- 172.21.15.7:0/875251822 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa35c0b6700 msgr2=0x7fa35c0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:37.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.494+0000 7fa37789b640 1 --2- 172.21.15.7:0/875251822 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa35c0b6700 0x7fa35c0b8c10 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fa3680094e0 tx=0x7fa368005c50 comp rx=0 tx=0).stop 2024-09-21T06:43:37.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.494+0000 7fa37789b640 1 -- 172.21.15.7:0/875251822 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa370103000 msgr2=0x7fa37019cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:37.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.494+0000 7fa37789b640 1 --2- 172.21.15.7:0/875251822 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa370103000 0x7fa37019cc30 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fa36000e9f0 tx=0x7fa36000eeb0 comp rx=0 tx=0).stop 2024-09-21T06:43:37.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.494+0000 7fa37789b640 1 -- 172.21.15.7:0/875251822 shutdown_connections 2024-09-21T06:43:37.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.494+0000 7fa37789b640 1 --2- 172.21.15.7:0/875251822 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa35c0b6700 0x7fa35c0b8c10 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:37.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.494+0000 7fa37789b640 1 --2- 172.21.15.7:0/875251822 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa370110260 0x7fa3701a1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:37.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.494+0000 7fa37789b640 1 --2- 172.21.15.7:0/875251822 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa370103000 0x7fa37019cc30 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:37.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.494+0000 7fa37789b640 1 --2- 172.21.15.7:0/875251822 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3701026b0 0x7fa37019c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:37.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.494+0000 7fa37789b640 1 -- 172.21.15.7:0/875251822 >> 172.21.15.7:0/875251822 conn(0x7fa370079790 msgr2=0x7fa370109d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:37.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.494+0000 7fa37789b640 1 -- 172.21.15.7:0/875251822 shutdown_connections 2024-09-21T06:43:37.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:37.494+0000 7fa37789b640 1 -- 172.21.15.7:0/875251822 wait complete. 2024-09-21T06:43:38.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:43:37 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:43:38.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:43:37 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T06:43:38.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:43:37 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T06:43:38.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:43:37 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T06:43:38.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:43:37 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T06:43:38.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:43:37 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T06:43:38.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:43:37 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T06:43:38.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:43:37 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T06:43:38.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:43:37 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T06:43:38.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:43:37 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T06:43:38.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:43:37 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T06:43:38.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:43:37 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T06:43:38.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:43:37 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T06:43:38.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:43:37 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:43:38.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:43:37 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:43:38.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:43:37 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:43:38.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:43:37 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:43:38.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:43:37 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T06:43:38.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:43:37 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T06:43:38.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:43:37 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T06:43:38.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:43:37 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T06:43:38.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:43:37 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T06:43:38.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:43:37 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T06:43:38.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:43:37 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T06:43:38.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:43:37 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T06:43:38.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:43:37 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T06:43:38.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:43:37 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T06:43:38.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:43:37 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T06:43:38.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:43:37 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T06:43:38.341 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:43:37 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:43:38.341 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:43:37 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:43:38.341 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:43:37 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:43:38.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:43:37 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:43:38.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:43:37 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T06:43:38.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:43:37 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T06:43:38.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:43:37 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T06:43:38.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:43:37 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T06:43:38.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:43:37 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T06:43:38.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:43:37 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T06:43:38.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:43:37 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T06:43:38.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:43:37 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T06:43:38.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:43:37 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T06:43:38.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:43:37 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T06:43:38.370 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:43:37 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T06:43:38.370 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:43:37 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T06:43:38.370 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:43:37 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:43:38.370 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:43:37 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:43:38.370 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:43:37 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:43:38.371 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:43:38.629 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:43:39.013 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:43:38 smithi007 ceph-mon[30983]: pgmap v544: 97 pgs: 97 active+clean; 3.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:43:39.013 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:43:38 smithi007 ceph-mon[30983]: Adjusting osd_memory_target on smithi144 to 176.0M 2024-09-21T06:43:39.013 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:43:38 smithi007 ceph-mon[30983]: Adjusting osd_memory_target on smithi018 to 177.0M 2024-09-21T06:43:39.013 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:43:38 smithi007 ceph-mon[30983]: Unable to set osd_memory_target on smithi144 to 184574566: error parsing value: Value '184574566' is below minimum 939524096 2024-09-21T06:43:39.013 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:43:38 smithi007 ceph-mon[30983]: Unable to set osd_memory_target on smithi018 to 185699942: error parsing value: Value '185699942' is below minimum 939524096 2024-09-21T06:43:39.013 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:43:38 smithi007 ceph-mon[30983]: Adjusting osd_memory_target on smithi007 to 177.0M 2024-09-21T06:43:39.013 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:43:38 smithi007 ceph-mon[30983]: Unable to set osd_memory_target on smithi007 to 185688473: error parsing value: Value '185688473' is below minimum 939524096 2024-09-21T06:43:39.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.105+0000 7f9cc4acd640 1 -- 172.21.15.7:0/264290522 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9cc0109df0 msgr2=0x7f9cc0110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:39.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.105+0000 7f9cc4acd640 1 --2- 172.21.15.7:0/264290522 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9cc0109df0 0x7f9cc0110620 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f9cb8009ca0 tx=0x7f9cb802a8e0 comp rx=0 tx=0).stop 2024-09-21T06:43:39.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.106+0000 7f9cc4acd640 1 -- 172.21.15.7:0/264290522 shutdown_connections 2024-09-21T06:43:39.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.106+0000 7f9cc4acd640 1 --2- 172.21.15.7:0/264290522 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9cc0109df0 0x7f9cc0110620 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:39.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.106+0000 7f9cc4acd640 1 --2- 172.21.15.7:0/264290522 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9cc01094a0 0x7f9cc01098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:39.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.106+0000 7f9cc4acd640 1 --2- 172.21.15.7:0/264290522 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9cc0103b60 0x7f9cc0103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:39.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.106+0000 7f9cc4acd640 1 -- 172.21.15.7:0/264290522 >> 172.21.15.7:0/264290522 conn(0x7f9cc007b850 msgr2=0x7f9cc007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:39.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.106+0000 7f9cc4acd640 1 -- 172.21.15.7:0/264290522 shutdown_connections 2024-09-21T06:43:39.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.106+0000 7f9cc4acd640 1 -- 172.21.15.7:0/264290522 wait complete. 2024-09-21T06:43:39.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.107+0000 7f9cc4acd640 1 Processor -- start 2024-09-21T06:43:39.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.107+0000 7f9cc4acd640 1 -- start start 2024-09-21T06:43:39.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.107+0000 7f9cc4acd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9cc0103b60 0x7f9cc019a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:39.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.107+0000 7f9cc4acd640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9cc01094a0 0x7f9cc019aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:39.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.107+0000 7f9cc4acd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9cc0109df0 0x7f9cc019fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:39.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.107+0000 7f9cc4acd640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9cc0113af0 con 0x7f9cc0109df0 2024-09-21T06:43:39.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.107+0000 7f9cc4acd640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9cc0113970 con 0x7f9cc0103b60 2024-09-21T06:43:39.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.107+0000 7f9cc4acd640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9cc0113c70 con 0x7f9cc01094a0 2024-09-21T06:43:39.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.107+0000 7f9cbed9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9cc0109df0 0x7f9cc019fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:39.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.107+0000 7f9cbed9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9cc0109df0 0x7f9cc019fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46976/0 (socket says 172.21.15.7:46976) 2024-09-21T06:43:39.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.107+0000 7f9cbed9d640 1 -- 172.21.15.7:0/538754068 learned_addr learned my addr 172.21.15.7:0/538754068 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:43:39.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.107+0000 7f9cbe59c640 1 --2- 172.21.15.7:0/538754068 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9cc0103b60 0x7f9cc019a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:39.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.107+0000 7f9cbdd9b640 1 --2- 172.21.15.7:0/538754068 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9cc01094a0 0x7f9cc019aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:39.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.108+0000 7f9cbed9d640 1 -- 172.21.15.7:0/538754068 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9cc01094a0 msgr2=0x7f9cc019aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:39.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.108+0000 7f9cbed9d640 1 --2- 172.21.15.7:0/538754068 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9cc01094a0 0x7f9cc019aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:39.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.108+0000 7f9cbed9d640 1 -- 172.21.15.7:0/538754068 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9cc0103b60 msgr2=0x7f9cc019a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:39.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.108+0000 7f9cbed9d640 1 --2- 172.21.15.7:0/538754068 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9cc0103b60 0x7f9cc019a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:39.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.108+0000 7f9cbed9d640 1 -- 172.21.15.7:0/538754068 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cc01a0410 con 0x7f9cc0109df0 2024-09-21T06:43:39.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.108+0000 7f9cbed9d640 1 --2- 172.21.15.7:0/538754068 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9cc0109df0 0x7f9cc019fce0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f9cb8005cc0 tx=0x7f9cb80039f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:39.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.108+0000 7f9caf7fe640 1 -- 172.21.15.7:0/538754068 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb8003de0 con 0x7f9cc0109df0 2024-09-21T06:43:39.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.108+0000 7f9cc4acd640 1 -- 172.21.15.7:0/538754068 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cc01a06a0 con 0x7f9cc0109df0 2024-09-21T06:43:39.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.108+0000 7f9caf7fe640 1 -- 172.21.15.7:0/538754068 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9cb80044f0 con 0x7f9cc0109df0 2024-09-21T06:43:39.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.108+0000 7f9caf7fe640 1 -- 172.21.15.7:0/538754068 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb8030cb0 con 0x7f9cc0109df0 2024-09-21T06:43:39.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.108+0000 7f9cc4acd640 1 -- 172.21.15.7:0/538754068 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cc01a6e60 con 0x7f9cc0109df0 2024-09-21T06:43:39.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.110+0000 7f9ccb041740 1 Processor -- start 2024-09-21T06:43:39.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.111+0000 7f9caf7fe640 1 -- 172.21.15.7:0/538754068 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f9cb8004040 con 0x7f9cc0109df0 2024-09-21T06:43:39.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.111+0000 7f9ccb041740 1 -- start start 2024-09-21T06:43:39.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.112+0000 7f9ccb041740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560b36714070 0x560b36abb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:39.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.112+0000 7f9ccb041740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560b366eb1b0 0x560b36abb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:39.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.112+0000 7f9ccb041740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560b366f3390 0x560b36abbd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:39.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.112+0000 7f9ccb041740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x560b36a31ea0 con 0x560b366eb1b0 2024-09-21T06:43:39.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.112+0000 7f9ccb041740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x560b36a212d0 con 0x560b36714070 2024-09-21T06:43:39.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.112+0000 7f9ccb041740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x560b36a250e0 con 0x560b366f3390 2024-09-21T06:43:39.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.112+0000 7f9cbe59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560b366eb1b0 0x560b36abb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:39.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.112+0000 7f9cbe59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560b366eb1b0 0x560b36abb800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46978/0 (socket says 172.21.15.7:46978) 2024-09-21T06:43:39.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.112+0000 7f9cbe59c640 1 -- 172.21.15.7:0/3127083487 learned_addr learned my addr 172.21.15.7:0/3127083487 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:43:39.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.112+0000 7f9cbdd9b640 1 --2- 172.21.15.7:0/3127083487 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560b366f3390 0x560b36abbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:39.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.112+0000 7f9cbdd9b640 1 --2- 172.21.15.7:0/3127083487 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560b36714070 0x560b36abb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:39.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.112+0000 7f9cbe59c640 1 -- 172.21.15.7:0/3127083487 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560b366f3390 msgr2=0x560b36abbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:39.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.112+0000 7f9cbe59c640 1 --2- 172.21.15.7:0/3127083487 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560b366f3390 0x560b36abbd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:39.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.112+0000 7f9cbe59c640 1 -- 172.21.15.7:0/3127083487 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560b36714070 msgr2=0x560b36abb2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:39.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.112+0000 7f9cbe59c640 1 --2- 172.21.15.7:0/3127083487 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560b36714070 0x560b36abb2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:39.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.112+0000 7f9cbe59c640 1 -- 172.21.15.7:0/3127083487 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b3677f650 con 0x560b366eb1b0 2024-09-21T06:43:39.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.112+0000 7f9caf7fe640 1 --2- 172.21.15.7:0/538754068 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f9ca80b6680 0x7f9ca80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:39.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.112+0000 7f9cbdd9b640 1 --2- 172.21.15.7:0/538754068 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f9ca80b6680 0x7f9ca80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:39.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.113+0000 7f9cbe59c640 1 --2- 172.21.15.7:0/3127083487 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560b366eb1b0 0x560b36abb800 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f9cb000bd50 tx=0x7f9cb00107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4c4d392d92bd60c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:39.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.113+0000 7f9caf7fe640 1 -- 172.21.15.7:0/538754068 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8412+0+0 (secure 0 0 0) 0x7f9cb8108a80 con 0x7f9cc0109df0 2024-09-21T06:43:39.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.113+0000 7f9cacff9640 1 -- 172.21.15.7:0/3127083487 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb0005220 con 0x560b366eb1b0 2024-09-21T06:43:39.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.113+0000 7f9cacff9640 1 -- 172.21.15.7:0/3127083487 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9cb000be40 con 0x560b366eb1b0 2024-09-21T06:43:39.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.113+0000 7f9cacff9640 1 -- 172.21.15.7:0/3127083487 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb00117c0 con 0x560b366eb1b0 2024-09-21T06:43:39.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.114+0000 7f9ccb041740 1 -- 172.21.15.7:0/3127083487 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560b366eb1b0 msgr2=0x560b36abb800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:39.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.114+0000 7f9ccb041740 1 --2- 172.21.15.7:0/3127083487 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560b366eb1b0 0x560b36abb800 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f9cb000bd50 tx=0x7f9cb00107a0 comp rx=0 tx=0).stop 2024-09-21T06:43:39.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.114+0000 7f9cbdd9b640 1 --2- 172.21.15.7:0/538754068 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f9ca80b6680 0x7f9ca80b8b90 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f9cc0109040 tx=0x7f9cb4009110 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:39.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.114+0000 7f9ccb041740 1 -- 172.21.15.7:0/3127083487 shutdown_connections 2024-09-21T06:43:39.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.114+0000 7f9ccb041740 1 --2- 172.21.15.7:0/3127083487 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560b366f3390 0x560b36abbd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:39.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.114+0000 7f9ccb041740 1 --2- 172.21.15.7:0/3127083487 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560b366eb1b0 0x560b36abb800 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:39.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.114+0000 7f9ccb041740 1 --2- 172.21.15.7:0/3127083487 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560b36714070 0x560b36abb2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:39.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.114+0000 7f9ccb041740 1 -- 172.21.15.7:0/3127083487 >> 172.21.15.7:0/3127083487 conn(0x560b36708460 msgr2=0x560b36ab91b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:39.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.114+0000 7f9ccb041740 1 -- 172.21.15.7:0/3127083487 shutdown_connections 2024-09-21T06:43:39.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.114+0000 7f9ccb041740 1 -- 172.21.15.7:0/3127083487 wait complete. 2024-09-21T06:43:39.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.114+0000 7f9ccb041740 1 -- start start 2024-09-21T06:43:39.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.115+0000 7f9ccb041740 1 Processor -- start 2024-09-21T06:43:39.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.115+0000 7f9ccb041740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560b366eb1b0 0x560b36ac6950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:39.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.115+0000 7f9ccb041740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560b366f3390 0x560b36ac6e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:39.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.115+0000 7f9ccb041740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560b36714070 0x560b36ac7410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:39.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.115+0000 7f9ccb041740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x560b36882700 con 0x560b366f3390 2024-09-21T06:43:39.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.115+0000 7f9ccb041740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x560b369bc160 con 0x560b36714070 2024-09-21T06:43:39.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.115+0000 7f9ccb041740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x560b36ac9aa0 con 0x560b366eb1b0 2024-09-21T06:43:39.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.115+0000 7f9ccb041740 10 client.0 _ll_register_callbacks cb 0x560b369d59e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:43:39.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.115+0000 7f9cbdd9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560b366f3390 0x560b36ac6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:39.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.115+0000 7f9cbdd9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560b366f3390 0x560b36ac6e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46982/0 (socket says 172.21.15.7:46982) 2024-09-21T06:43:39.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.115+0000 7f9cbdd9b640 1 -- 172.21.15.7:0/3858668032 learned_addr learned my addr 172.21.15.7:0/3858668032 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:43:39.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.115+0000 7f9cbed9d640 1 --2- 172.21.15.7:0/3858668032 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560b36714070 0x560b36ac7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:39.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.115+0000 7f9cbe59c640 1 --2- 172.21.15.7:0/3858668032 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560b366eb1b0 0x560b36ac6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:39.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.115+0000 7f9cbdd9b640 1 -- 172.21.15.7:0/3858668032 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560b366eb1b0 msgr2=0x560b36ac6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:39.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.115+0000 7f9cbdd9b640 1 --2- 172.21.15.7:0/3858668032 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560b366eb1b0 0x560b36ac6950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:39.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.115+0000 7f9cbdd9b640 1 -- 172.21.15.7:0/3858668032 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560b36714070 msgr2=0x560b36ac7410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:39.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.115+0000 7f9cbdd9b640 1 --2- 172.21.15.7:0/3858668032 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560b36714070 0x560b36ac7410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:39.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.115+0000 7f9cbdd9b640 1 -- 172.21.15.7:0/3858668032 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b369e9c90 con 0x560b366f3390 2024-09-21T06:43:39.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.115+0000 7f9cbe59c640 1 --2- 172.21.15.7:0/3858668032 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560b366eb1b0 0x560b36ac6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:43:39.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.116+0000 7f9cbdd9b640 1 --2- 172.21.15.7:0/3858668032 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560b366f3390 0x560b36ac6e90 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f9cb4017de0 tx=0x7f9cb40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75570accf5b1c6dd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:39.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.116+0000 7f9ca5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:43:39.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.116+0000 7f9ca5ffb640 1 -- 172.21.15.7:0/3858668032 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb4027070 con 0x560b366f3390 2024-09-21T06:43:39.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.116+0000 7f9ca5ffb640 1 -- 172.21.15.7:0/3858668032 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8412+0+0 (secure 0 0 0) 0x7f9cb4013d40 con 0x560b366f3390 2024-09-21T06:43:39.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.116+0000 7f9ccb041740 1 -- 172.21.15.7:0/3858668032 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560b36a33df0 con 0x560b366f3390 2024-09-21T06:43:39.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.116+0000 7f9ca5ffb640 1 -- 172.21.15.7:0/3858668032 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9cb40059c0 con 0x560b366f3390 2024-09-21T06:43:39.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.116+0000 7f9ccb041740 10 client.16851 fetch_fsmap learned FSMap version 25 2024-09-21T06:43:39.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.116+0000 7f9ccb041740 1 -- 172.21.15.7:0/3858668032 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560b36ad57d0 con 0x560b366f3390 2024-09-21T06:43:39.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.116+0000 7f9ca5ffb640 1 -- 172.21.15.7:0/3858668032 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x560b36a33df0 con 0x560b366f3390 2024-09-21T06:43:39.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.117+0000 7f9ca5ffb640 1 -- 172.21.15.7:0/3858668032 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9cb4022070 con 0x560b366f3390 2024-09-21T06:43:39.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.117+0000 7f9ccb041740 10 client.16851 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:43:39.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.117+0000 7f9ccb041740 10 client.16851 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:43:39.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.117+0000 7f9ccb041740 20 client.16851 populate_metadata read hostname 'smithi007' 2024-09-21T06:43:39.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.117+0000 7f9ccb041740 1 --2- 172.21.15.7:0/3858668032 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x560b366d29f0 0x560b36ad8d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:39.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.117+0000 7f9ccb041740 4 client.16851 mds_command: new command op to 24688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:43:39.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.117+0000 7f9ccb041740 1 -- 172.21.15.7:0/3858668032 --> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560b36a2f8a0 con 0x560b366d29f0 2024-09-21T06:43:39.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.117+0000 7f9cbe59c640 1 --2- 172.21.15.7:0/3858668032 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x560b366d29f0 0x560b36ad8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:39.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.118+0000 7f9cbe59c640 1 --2- 172.21.15.7:0/3858668032 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x560b366d29f0 0x560b36ad8d10 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=56160727a808e877 server_cookie=fa6969a053897ce4 in_seq=0 out_seq=0 2024-09-21T06:43:39.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.118+0000 7f9ca5ffb640 10 client.16851 ms_handle_connect on v2:172.21.15.144:6838/4027821922 2024-09-21T06:43:39.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.118+0000 7f9ca5ffb640 1 -- 172.21.15.7:0/3858668032 <== mds.1 v2:172.21.15.144:6838/4027821922 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560b36a2f8a0 con 0x560b366d29f0 2024-09-21T06:43:39.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.118+0000 7f9ca5ffb640 10 client.16851 handle_command_reply: tid=0 2024-09-21T06:43:39.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.118+0000 7f9ccb041740 1 client.16851 shutdown 2024-09-21T06:43:39.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.119+0000 7f9ccb041740 1 -- 172.21.15.7:0/3858668032 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560b366f3390 msgr2=0x560b36ac6e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:39.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.119+0000 7f9ccb041740 1 --2- 172.21.15.7:0/3858668032 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560b366f3390 0x560b36ac6e90 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f9cb4017de0 tx=0x7f9cb40046c0 comp rx=0 tx=0).stop 2024-09-21T06:43:39.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.119+0000 7f9ccb041740 1 -- 172.21.15.7:0/3858668032 shutdown_connections 2024-09-21T06:43:39.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.119+0000 7f9ccb041740 1 --2- 172.21.15.7:0/3858668032 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x560b366d29f0 0x560b36ad8d10 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:39.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.119+0000 7f9ccb041740 1 --2- 172.21.15.7:0/3858668032 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560b36714070 0x560b36ac7410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:39.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.119+0000 7f9ccb041740 1 --2- 172.21.15.7:0/3858668032 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560b366f3390 0x560b36ac6e90 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:39.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.119+0000 7f9ccb041740 1 --2- 172.21.15.7:0/3858668032 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560b366eb1b0 0x560b36ac6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:39.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.119+0000 7f9ccb041740 1 -- 172.21.15.7:0/3858668032 >> 172.21.15.7:0/3858668032 conn(0x560b36708460 msgr2=0x560b36abe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:39.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.119+0000 7f9ca5ffb640 0 client.16851 ms_handle_reset on v2:172.21.15.144:6838/4027821922 2024-09-21T06:43:39.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.119+0000 7f9ccb041740 1 -- 172.21.15.7:0/3858668032 shutdown_connections 2024-09-21T06:43:39.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.119+0000 7f9ccb041740 1 -- 172.21.15.7:0/3858668032 wait complete. 2024-09-21T06:43:39.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.119+0000 7f9ccb041740 20 client.16851 trim_cache size 0 max 16384 2024-09-21T06:43:39.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.132+0000 7f9ccb041740 1 Processor -- start 2024-09-21T06:43:39.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.132+0000 7f9ccb041740 1 -- start start 2024-09-21T06:43:39.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.132+0000 7f9ccb041740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560b366eb1b0 0x560b36ac8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:39.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.132+0000 7f9ccb041740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560b366f3390 0x560b36abca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:39.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.132+0000 7f9ccb041740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560b36714070 0x560b36ab8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:39.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.132+0000 7f9ccb041740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9cc01b1e70 con 0x560b366f3390 2024-09-21T06:43:39.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.132+0000 7f9ccb041740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9cc01af740 con 0x560b366eb1b0 2024-09-21T06:43:39.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.132+0000 7f9ccb041740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9cc01ad5b0 con 0x560b36714070 2024-09-21T06:43:39.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.132+0000 7f9cbdd9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560b366f3390 0x560b36abca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:39.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.132+0000 7f9cbdd9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560b366f3390 0x560b36abca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46994/0 (socket says 172.21.15.7:46994) 2024-09-21T06:43:39.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.132+0000 7f9cbdd9b640 1 -- 172.21.15.7:0/587975722 learned_addr learned my addr 172.21.15.7:0/587975722 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:43:39.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.132+0000 7f9cbe59c640 1 --2- 172.21.15.7:0/587975722 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560b366eb1b0 0x560b36ac8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:39.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.133+0000 7f9cbed9d640 1 --2- 172.21.15.7:0/587975722 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560b36714070 0x560b36ab8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:39.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.133+0000 7f9cbdd9b640 1 -- 172.21.15.7:0/587975722 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560b36714070 msgr2=0x560b36ab8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:39.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.133+0000 7f9cbdd9b640 1 --2- 172.21.15.7:0/587975722 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560b36714070 0x560b36ab8760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:39.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.133+0000 7f9cbdd9b640 1 -- 172.21.15.7:0/587975722 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560b366eb1b0 msgr2=0x560b36ac8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:39.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.133+0000 7f9cbdd9b640 1 --2- 172.21.15.7:0/587975722 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560b366eb1b0 0x560b36ac8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:39.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.133+0000 7f9cbdd9b640 1 -- 172.21.15.7:0/587975722 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b366d2c20 con 0x560b366f3390 2024-09-21T06:43:39.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.133+0000 7f9cbed9d640 1 --2- 172.21.15.7:0/587975722 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560b36714070 0x560b36ab8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:43:39.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.133+0000 7f9cbdd9b640 1 --2- 172.21.15.7:0/587975722 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560b366f3390 0x560b36abca00 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f9cb4009ce0 tx=0x7f9cb4009470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac03f78240cfcf36 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:39.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.133+0000 7f9ca7fff640 1 -- 172.21.15.7:0/587975722 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb4027050 con 0x560b366f3390 2024-09-21T06:43:39.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.133+0000 7f9ca7fff640 1 -- 172.21.15.7:0/587975722 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9cb401d070 con 0x560b366f3390 2024-09-21T06:43:39.142 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.133+0000 7f9ca7fff640 1 -- 172.21.15.7:0/587975722 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb4013e30 con 0x560b366f3390 2024-09-21T06:43:39.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.134+0000 7f9ccb041740 1 -- 172.21.15.7:0/587975722 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560b366f3390 msgr2=0x560b36abca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:39.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.134+0000 7f9ccb041740 1 --2- 172.21.15.7:0/587975722 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560b366f3390 0x560b36abca00 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f9cb4009ce0 tx=0x7f9cb4009470 comp rx=0 tx=0).stop 2024-09-21T06:43:39.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.134+0000 7f9ccb041740 1 -- 172.21.15.7:0/587975722 shutdown_connections 2024-09-21T06:43:39.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.134+0000 7f9ccb041740 1 --2- 172.21.15.7:0/587975722 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560b36714070 0x560b36ab8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:39.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.134+0000 7f9ccb041740 1 --2- 172.21.15.7:0/587975722 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560b366f3390 0x560b36abca00 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:39.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.134+0000 7f9ccb041740 1 --2- 172.21.15.7:0/587975722 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560b366eb1b0 0x560b36ac8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:39.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.134+0000 7f9ccb041740 1 -- 172.21.15.7:0/587975722 >> 172.21.15.7:0/587975722 conn(0x560b36708460 msgr2=0x560b36abc2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:39.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.134+0000 7f9ccb041740 1 -- 172.21.15.7:0/587975722 shutdown_connections 2024-09-21T06:43:39.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.134+0000 7f9ccb041740 1 -- 172.21.15.7:0/587975722 wait complete. 2024-09-21T06:43:39.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.134+0000 7f9ccb041740 1 -- start start 2024-09-21T06:43:39.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.134+0000 7f9ccb041740 1 Processor -- start 2024-09-21T06:43:39.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.135+0000 7f9ccb041740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560b366eb1b0 0x560b36acf430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:39.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.135+0000 7f9ccb041740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560b366f3390 0x560b36aca8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:39.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.135+0000 7f9ccb041740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560b36714070 0x560b36acae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:39.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.135+0000 7f9ccb041740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9cc01adc00 con 0x560b36714070 2024-09-21T06:43:39.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.135+0000 7f9ccb041740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9cc01af070 con 0x560b366eb1b0 2024-09-21T06:43:39.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.135+0000 7f9ccb041740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9cc01ae2d0 con 0x560b366f3390 2024-09-21T06:43:39.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.135+0000 7f9ccb041740 10 client.0 _ll_register_callbacks cb 0x7f9cb4017a60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:43:39.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.135+0000 7f9cbed9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560b36714070 0x560b36acae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:39.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.135+0000 7f9cbed9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560b36714070 0x560b36acae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:47000/0 (socket says 172.21.15.7:47000) 2024-09-21T06:43:39.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.135+0000 7f9cbed9d640 1 -- 172.21.15.7:0/602284283 learned_addr learned my addr 172.21.15.7:0/602284283 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:43:39.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.135+0000 7f9cbe59c640 1 --2- 172.21.15.7:0/602284283 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560b366eb1b0 0x560b36acf430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:39.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.135+0000 7f9cbdd9b640 1 --2- 172.21.15.7:0/602284283 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560b366f3390 0x560b36aca8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:39.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.135+0000 7f9cbed9d640 1 -- 172.21.15.7:0/602284283 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560b366f3390 msgr2=0x560b36aca8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:39.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.135+0000 7f9cbed9d640 1 --2- 172.21.15.7:0/602284283 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560b366f3390 0x560b36aca8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:39.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.135+0000 7f9cbed9d640 1 -- 172.21.15.7:0/602284283 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560b366eb1b0 msgr2=0x560b36acf430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:39.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.135+0000 7f9cbed9d640 1 --2- 172.21.15.7:0/602284283 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560b366eb1b0 0x560b36acf430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:39.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.135+0000 7f9cbed9d640 1 -- 172.21.15.7:0/602284283 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b36acb510 con 0x560b36714070 2024-09-21T06:43:39.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.135+0000 7f9cbdd9b640 1 --2- 172.21.15.7:0/602284283 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560b366f3390 0x560b36aca8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:43:39.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.135+0000 7f9cbed9d640 1 --2- 172.21.15.7:0/602284283 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560b36714070 0x560b36acae20 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f9cb8006010 tx=0x7f9cb8004900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d6b52046bfe62a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:39.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.135+0000 7f9ca5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:43:39.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.136+0000 7f9ca5ffb640 1 -- 172.21.15.7:0/602284283 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb80b9060 con 0x560b36714070 2024-09-21T06:43:39.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.136+0000 7f9ca5ffb640 1 -- 172.21.15.7:0/602284283 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8412+0+0 (secure 0 0 0) 0x7f9cb80cabb0 con 0x560b36714070 2024-09-21T06:43:39.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.136+0000 7f9ccb041740 1 -- 172.21.15.7:0/602284283 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9cb401d070 con 0x560b36714070 2024-09-21T06:43:39.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.136+0000 7f9ca5ffb640 1 -- 172.21.15.7:0/602284283 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9cb80ca0b0 con 0x560b36714070 2024-09-21T06:43:39.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.136+0000 7f9ccb041740 10 client.16857 fetch_fsmap learned FSMap version 25 2024-09-21T06:43:39.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.136+0000 7f9ccb041740 1 -- 172.21.15.7:0/602284283 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560b36b43540 con 0x560b36714070 2024-09-21T06:43:39.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.136+0000 7f9ca5ffb640 1 -- 172.21.15.7:0/602284283 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9cb401d070 con 0x560b36714070 2024-09-21T06:43:39.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.136+0000 7f9ca5ffb640 1 -- 172.21.15.7:0/602284283 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9cb80ca290 con 0x560b36714070 2024-09-21T06:43:39.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.136+0000 7f9ccb041740 10 client.16857 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:43:39.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.136+0000 7f9ccb041740 10 client.16857 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:43:39.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.136+0000 7f9ccb041740 20 client.16857 populate_metadata read hostname 'smithi007' 2024-09-21T06:43:39.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.136+0000 7f9ccb041740 1 --2- 172.21.15.7:0/602284283 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x560b366a7da0 0x560b36b45d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:39.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.136+0000 7f9ccb041740 4 client.16857 mds_command: new command op to 24688 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:43:39.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.136+0000 7f9ccb041740 1 -- 172.21.15.7:0/602284283 --> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560b36a2ccd0 con 0x560b366a7da0 2024-09-21T06:43:39.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.136+0000 7f9cbe59c640 1 --2- 172.21.15.7:0/602284283 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x560b366a7da0 0x560b36b45d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:39.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.137+0000 7f9cbe59c640 1 --2- 172.21.15.7:0/602284283 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x560b366a7da0 0x560b36b45d00 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d924ca8718490f3f server_cookie=d93679c82a143cc1 in_seq=0 out_seq=0 2024-09-21T06:43:39.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.137+0000 7f9ca5ffb640 10 client.16857 ms_handle_connect on v2:172.21.15.144:6838/4027821922 2024-09-21T06:43:39.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.137+0000 7f9ca5ffb640 1 -- 172.21.15.7:0/602284283 <== mds.1 v2:172.21.15.144:6838/4027821922 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560b36a2ccd0 con 0x560b366a7da0 2024-09-21T06:43:39.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.137+0000 7f9ca5ffb640 10 client.16857 handle_command_reply: tid=0 2024-09-21T06:43:39.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.137+0000 7f9ccb041740 1 client.16857 shutdown 2024-09-21T06:43:39.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.137+0000 7f9ccb041740 1 -- 172.21.15.7:0/602284283 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560b36714070 msgr2=0x560b36acae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:39.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.137+0000 7f9ccb041740 1 --2- 172.21.15.7:0/602284283 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560b36714070 0x560b36acae20 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f9cb8006010 tx=0x7f9cb8004900 comp rx=0 tx=0).stop 2024-09-21T06:43:39.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.137+0000 7f9ccb041740 1 -- 172.21.15.7:0/602284283 shutdown_connections 2024-09-21T06:43:39.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.137+0000 7f9ccb041740 1 --2- 172.21.15.7:0/602284283 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x560b366a7da0 0x560b36b45d00 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:39.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.137+0000 7f9ccb041740 1 --2- 172.21.15.7:0/602284283 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560b36714070 0x560b36acae20 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:39.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.137+0000 7f9ccb041740 1 --2- 172.21.15.7:0/602284283 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560b366f3390 0x560b36aca8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:39.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.137+0000 7f9ccb041740 1 --2- 172.21.15.7:0/602284283 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560b366eb1b0 0x560b36acf430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:39.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.137+0000 7f9ccb041740 1 -- 172.21.15.7:0/602284283 >> 172.21.15.7:0/602284283 conn(0x560b36708460 msgr2=0x560b36abcb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:39.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.137+0000 7f9ca5ffb640 0 client.16857 ms_handle_reset on v2:172.21.15.144:6838/4027821922 2024-09-21T06:43:39.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.138+0000 7f9ccb041740 1 -- 172.21.15.7:0/602284283 shutdown_connections 2024-09-21T06:43:39.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.138+0000 7f9ccb041740 1 -- 172.21.15.7:0/602284283 wait complete. 2024-09-21T06:43:39.150 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.138+0000 7f9ccb041740 20 client.16857 trim_cache size 0 max 16384 2024-09-21T06:43:39.151 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:43:39.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.138+0000 7f9cc4acd640 1 -- 172.21.15.7:0/538754068 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f9ca80b6680 msgr2=0x7f9ca80b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:39.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.138+0000 7f9cc4acd640 1 --2- 172.21.15.7:0/538754068 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f9ca80b6680 0x7f9ca80b8b90 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f9cc0109040 tx=0x7f9cb4009110 comp rx=0 tx=0).stop 2024-09-21T06:43:39.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.138+0000 7f9cc4acd640 1 -- 172.21.15.7:0/538754068 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9cc0109df0 msgr2=0x7f9cc019fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:39.151 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.138+0000 7f9cc4acd640 1 --2- 172.21.15.7:0/538754068 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9cc0109df0 0x7f9cc019fce0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f9cb8005cc0 tx=0x7f9cb80039f0 comp rx=0 tx=0).stop 2024-09-21T06:43:39.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.138+0000 7f9cc4acd640 1 -- 172.21.15.7:0/538754068 shutdown_connections 2024-09-21T06:43:39.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.138+0000 7f9cc4acd640 1 --2- 172.21.15.7:0/538754068 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f9ca80b6680 0x7f9ca80b8b90 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:39.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.138+0000 7f9cc4acd640 1 --2- 172.21.15.7:0/538754068 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9cc0109df0 0x7f9cc019fce0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:39.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.138+0000 7f9cc4acd640 1 --2- 172.21.15.7:0/538754068 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9cc01094a0 0x7f9cc019aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:39.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.138+0000 7f9cc4acd640 1 --2- 172.21.15.7:0/538754068 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9cc0103b60 0x7f9cc019a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:39.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.138+0000 7f9cc4acd640 1 -- 172.21.15.7:0/538754068 >> 172.21.15.7:0/538754068 conn(0x7f9cc007b850 msgr2=0x7f9cc01074f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:39.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.138+0000 7f9cc4acd640 1 -- 172.21.15.7:0/538754068 shutdown_connections 2024-09-21T06:43:39.152 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:39.138+0000 7f9cc4acd640 1 -- 172.21.15.7:0/538754068 wait complete. 2024-09-21T06:43:39.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:43:38 smithi144 ceph-mon[34653]: pgmap v544: 97 pgs: 97 active+clean; 3.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:43:39.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:43:38 smithi144 ceph-mon[34653]: Adjusting osd_memory_target on smithi144 to 176.0M 2024-09-21T06:43:39.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:43:38 smithi144 ceph-mon[34653]: Adjusting osd_memory_target on smithi018 to 177.0M 2024-09-21T06:43:39.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:43:38 smithi144 ceph-mon[34653]: Unable to set osd_memory_target on smithi144 to 184574566: error parsing value: Value '184574566' is below minimum 939524096 2024-09-21T06:43:39.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:43:38 smithi144 ceph-mon[34653]: Unable to set osd_memory_target on smithi018 to 185699942: error parsing value: Value '185699942' is below minimum 939524096 2024-09-21T06:43:39.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:43:38 smithi144 ceph-mon[34653]: Adjusting osd_memory_target on smithi007 to 177.0M 2024-09-21T06:43:39.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:43:38 smithi144 ceph-mon[34653]: Unable to set osd_memory_target on smithi007 to 185688473: error parsing value: Value '185688473' is below minimum 939524096 2024-09-21T06:43:39.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:43:38 smithi018 ceph-mon[34477]: pgmap v544: 97 pgs: 97 active+clean; 3.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:43:39.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:43:38 smithi018 ceph-mon[34477]: Adjusting osd_memory_target on smithi144 to 176.0M 2024-09-21T06:43:39.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:43:38 smithi018 ceph-mon[34477]: Adjusting osd_memory_target on smithi018 to 177.0M 2024-09-21T06:43:39.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:43:38 smithi018 ceph-mon[34477]: Unable to set osd_memory_target on smithi144 to 184574566: error parsing value: Value '184574566' is below minimum 939524096 2024-09-21T06:43:39.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:43:38 smithi018 ceph-mon[34477]: Unable to set osd_memory_target on smithi018 to 185699942: error parsing value: Value '185699942' is below minimum 939524096 2024-09-21T06:43:39.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:43:38 smithi018 ceph-mon[34477]: Adjusting osd_memory_target on smithi007 to 177.0M 2024-09-21T06:43:39.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:43:38 smithi018 ceph-mon[34477]: Unable to set osd_memory_target on smithi007 to 185688473: error parsing value: Value '185688473' is below minimum 939524096 2024-09-21T06:43:39.823 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:43:40.081 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:43:40.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.556+0000 7f51b6790640 1 -- 172.21.15.7:0/1500117241 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51b0108d20 msgr2=0x7f51b010f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:40.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.556+0000 7f51b6790640 1 --2- 172.21.15.7:0/1500117241 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51b0108d20 0x7f51b010f550 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f51a8009ca0 tx=0x7f51a802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:43:40.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.556+0000 7f51b6790640 1 -- 172.21.15.7:0/1500117241 shutdown_connections 2024-09-21T06:43:40.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.556+0000 7f51b6790640 1 --2- 172.21.15.7:0/1500117241 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51b0108d20 0x7f51b010f550 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:40.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.556+0000 7f51b6790640 1 --2- 172.21.15.7:0/1500117241 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f51b01083d0 0x7f51b01087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:40.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.556+0000 7f51b6790640 1 --2- 172.21.15.7:0/1500117241 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51b0102a90 0x7f51b0102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:40.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.556+0000 7f51b6790640 1 -- 172.21.15.7:0/1500117241 >> 172.21.15.7:0/1500117241 conn(0x7f51b0079750 msgr2=0x7f51b0079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:40.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.556+0000 7f51b6790640 1 -- 172.21.15.7:0/1500117241 shutdown_connections 2024-09-21T06:43:40.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.556+0000 7f51b6790640 1 -- 172.21.15.7:0/1500117241 wait complete. 2024-09-21T06:43:40.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.557+0000 7f51b6790640 1 Processor -- start 2024-09-21T06:43:40.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.557+0000 7f51b6790640 1 -- start start 2024-09-21T06:43:40.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.557+0000 7f51b6790640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f51b0102a90 0x7f51b01992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:40.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.557+0000 7f51b6790640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51b01083d0 0x7f51b0199870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:40.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.557+0000 7f51b6790640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51b0108d20 0x7f51b019eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:40.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.557+0000 7f51b6790640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f51b01129e0 con 0x7f51b0108d20 2024-09-21T06:43:40.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.557+0000 7f51b6790640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f51b0112860 con 0x7f51b0102a90 2024-09-21T06:43:40.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.557+0000 7f51b6790640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f51b0112b60 con 0x7f51b01083d0 2024-09-21T06:43:40.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.557+0000 7f51b4d2d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51b0108d20 0x7f51b019eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:40.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.557+0000 7f51b4d2d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51b0108d20 0x7f51b019eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56524/0 (socket says 172.21.15.7:56524) 2024-09-21T06:43:40.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.557+0000 7f51b4d2d640 1 -- 172.21.15.7:0/3040152686 learned_addr learned my addr 172.21.15.7:0/3040152686 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:43:40.591 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.558+0000 7f51affff640 1 --2- 172.21.15.7:0/3040152686 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f51b0102a90 0x7f51b01992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:40.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.558+0000 7f51af7fe640 1 --2- 172.21.15.7:0/3040152686 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51b01083d0 0x7f51b0199870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:40.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.558+0000 7f51b4d2d640 1 -- 172.21.15.7:0/3040152686 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51b01083d0 msgr2=0x7f51b0199870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:40.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.558+0000 7f51b4d2d640 1 --2- 172.21.15.7:0/3040152686 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51b01083d0 0x7f51b0199870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:40.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.558+0000 7f51b4d2d640 1 -- 172.21.15.7:0/3040152686 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f51b0102a90 msgr2=0x7f51b01992d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:40.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.558+0000 7f51b4d2d640 1 --2- 172.21.15.7:0/3040152686 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f51b0102a90 0x7f51b01992d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:40.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.558+0000 7f51b4d2d640 1 -- 172.21.15.7:0/3040152686 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51b019f240 con 0x7f51b0108d20 2024-09-21T06:43:40.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.558+0000 7f51affff640 1 --2- 172.21.15.7:0/3040152686 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f51b0102a90 0x7f51b01992d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:43:40.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.558+0000 7f51b4d2d640 1 --2- 172.21.15.7:0/3040152686 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51b0108d20 0x7f51b019eb10 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f51a8009430 tx=0x7f51a80317c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:40.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.558+0000 7f51ad7fa640 1 -- 172.21.15.7:0/3040152686 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a8003b70 con 0x7f51b0108d20 2024-09-21T06:43:40.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.558+0000 7f51ad7fa640 1 -- 172.21.15.7:0/3040152686 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f51a8003d10 con 0x7f51b0108d20 2024-09-21T06:43:40.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.558+0000 7f51b6790640 1 -- 172.21.15.7:0/3040152686 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51b019f4d0 con 0x7f51b0108d20 2024-09-21T06:43:40.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.558+0000 7f51ad7fa640 1 -- 172.21.15.7:0/3040152686 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a802fa30 con 0x7f51b0108d20 2024-09-21T06:43:40.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.558+0000 7f51b6790640 1 -- 172.21.15.7:0/3040152686 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51b01a5c90 con 0x7f51b0108d20 2024-09-21T06:43:40.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.561+0000 7f51bcd04740 1 Processor -- start 2024-09-21T06:43:40.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.561+0000 7f51ad7fa640 1 -- 172.21.15.7:0/3040152686 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f51a802fbd0 con 0x7f51b0108d20 2024-09-21T06:43:40.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.561+0000 7f51bcd04740 1 -- start start 2024-09-21T06:43:40.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.562+0000 7f51bcd04740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf7eaad070 0x55cf7ee546a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:40.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.562+0000 7f51bcd04740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cf7ea841b0 0x55cf7ee54be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:40.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.562+0000 7f51bcd04740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cf7ea8c390 0x55cf7ee55120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:40.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.562+0000 7f51bcd04740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55cf7edcaea0 con 0x55cf7eaad070 2024-09-21T06:43:40.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.562+0000 7f51bcd04740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55cf7edba2d0 con 0x55cf7ea8c390 2024-09-21T06:43:40.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.562+0000 7f51bcd04740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55cf7edbe0e0 con 0x55cf7ea841b0 2024-09-21T06:43:40.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.562+0000 7f51af7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf7eaad070 0x55cf7ee546a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:40.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.562+0000 7f51af7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf7eaad070 0x55cf7ee546a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56536/0 (socket says 172.21.15.7:56536) 2024-09-21T06:43:40.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.562+0000 7f51af7fe640 1 -- 172.21.15.7:0/3471611118 learned_addr learned my addr 172.21.15.7:0/3471611118 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:43:40.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.562+0000 7f51affff640 1 --2- 172.21.15.7:0/3471611118 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cf7ea841b0 0x55cf7ee54be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:40.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.562+0000 7f51af7fe640 1 --2- 172.21.15.7:0/3471611118 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cf7ea8c390 0x55cf7ee55120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:40.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.562+0000 7f51af7fe640 1 -- 172.21.15.7:0/3471611118 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cf7ea841b0 msgr2=0x55cf7ee54be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:40.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.562+0000 7f51af7fe640 1 --2- 172.21.15.7:0/3471611118 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cf7ea841b0 0x55cf7ee54be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:40.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.562+0000 7f51af7fe640 1 -- 172.21.15.7:0/3471611118 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cf7ea8c390 msgr2=0x55cf7ee55120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:40.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.562+0000 7f51af7fe640 1 --2- 172.21.15.7:0/3471611118 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cf7ea8c390 0x55cf7ee55120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:40.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.562+0000 7f51af7fe640 1 -- 172.21.15.7:0/3471611118 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf7eb18650 con 0x55cf7eaad070 2024-09-21T06:43:40.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.562+0000 7f51ad7fa640 1 --2- 172.21.15.7:0/3040152686 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f51980b6680 0x7f51980b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:40.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.562+0000 7f51af7fe640 1 --2- 172.21.15.7:0/3471611118 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf7eaad070 0x55cf7ee546a0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f51a40058a0 tx=0x7f51a400b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de6ee04008d148cc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:40.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.562+0000 7f51affff640 1 --2- 172.21.15.7:0/3040152686 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f51980b6680 0x7f51980b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:40.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.563+0000 7f51ad7fa640 1 -- 172.21.15.7:0/3040152686 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8412+0+0 (secure 0 0 0) 0x7f51a8108990 con 0x7f51b0108d20 2024-09-21T06:43:40.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.563+0000 7f51967fc640 1 -- 172.21.15.7:0/3471611118 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a4004030 con 0x55cf7eaad070 2024-09-21T06:43:40.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.563+0000 7f51967fc640 1 -- 172.21.15.7:0/3471611118 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f51a40054d0 con 0x55cf7eaad070 2024-09-21T06:43:40.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.563+0000 7f51967fc640 1 -- 172.21.15.7:0/3471611118 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a4004a20 con 0x55cf7eaad070 2024-09-21T06:43:40.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.563+0000 7f51bcd04740 1 -- 172.21.15.7:0/3471611118 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf7eaad070 msgr2=0x55cf7ee546a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:40.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.563+0000 7f51affff640 1 --2- 172.21.15.7:0/3040152686 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f51980b6680 0x7f51980b8b90 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x55cf7ee53320 tx=0x7f51a0005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:40.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.563+0000 7f51bcd04740 1 --2- 172.21.15.7:0/3471611118 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf7eaad070 0x55cf7ee546a0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f51a40058a0 tx=0x7f51a400b820 comp rx=0 tx=0).stop 2024-09-21T06:43:40.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.564+0000 7f51bcd04740 1 -- 172.21.15.7:0/3471611118 shutdown_connections 2024-09-21T06:43:40.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.564+0000 7f51bcd04740 1 --2- 172.21.15.7:0/3471611118 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cf7ea8c390 0x55cf7ee55120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:40.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.564+0000 7f51bcd04740 1 --2- 172.21.15.7:0/3471611118 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cf7ea841b0 0x55cf7ee54be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:40.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.564+0000 7f51bcd04740 1 --2- 172.21.15.7:0/3471611118 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf7eaad070 0x55cf7ee546a0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:40.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.564+0000 7f51bcd04740 1 -- 172.21.15.7:0/3471611118 >> 172.21.15.7:0/3471611118 conn(0x55cf7eaa1460 msgr2=0x55cf7ee52590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:40.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.564+0000 7f51bcd04740 1 -- 172.21.15.7:0/3471611118 shutdown_connections 2024-09-21T06:43:40.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.564+0000 7f51bcd04740 1 -- 172.21.15.7:0/3471611118 wait complete. 2024-09-21T06:43:40.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.564+0000 7f51bcd04740 1 -- start start 2024-09-21T06:43:40.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.564+0000 7f51bcd04740 1 Processor -- start 2024-09-21T06:43:40.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.565+0000 7f51bcd04740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf7ea841b0 0x55cf7ee61f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:40.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.565+0000 7f51bcd04740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cf7ea8c390 0x55cf7ee624b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:40.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.565+0000 7f51bcd04740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cf7eaad070 0x55cf7ee6e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:40.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.565+0000 7f51bcd04740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55cf7ec1b700 con 0x55cf7ea841b0 2024-09-21T06:43:40.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.565+0000 7f51bcd04740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55cf7ed55160 con 0x55cf7eaad070 2024-09-21T06:43:40.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.565+0000 7f51bcd04740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55cf7ee64fe0 con 0x55cf7ea8c390 2024-09-21T06:43:40.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.565+0000 7f51bcd04740 10 client.0 _ll_register_callbacks cb 0x55cf7ed6e9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:43:40.597 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:43:40.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.565+0000 7f51affff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf7ea841b0 0x55cf7ee61f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:40.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.565+0000 7f51affff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf7ea841b0 0x55cf7ee61f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56546/0 (socket says 172.21.15.7:56546) 2024-09-21T06:43:40.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.565+0000 7f51affff640 1 -- 172.21.15.7:0/708300738 learned_addr learned my addr 172.21.15.7:0/708300738 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:43:40.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.565+0000 7f51b4d2d640 1 --2- 172.21.15.7:0/708300738 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cf7eaad070 0x55cf7ee6e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:40.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.565+0000 7f51af7fe640 1 --2- 172.21.15.7:0/708300738 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cf7ea8c390 0x55cf7ee624b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:40.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.565+0000 7f51affff640 1 -- 172.21.15.7:0/708300738 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cf7ea8c390 msgr2=0x55cf7ee624b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:40.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.565+0000 7f51affff640 1 --2- 172.21.15.7:0/708300738 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cf7ea8c390 0x55cf7ee624b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:40.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.565+0000 7f51affff640 1 -- 172.21.15.7:0/708300738 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cf7eaad070 msgr2=0x55cf7ee6e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:40.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.565+0000 7f51affff640 1 --2- 172.21.15.7:0/708300738 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cf7eaad070 0x55cf7ee6e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:40.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.565+0000 7f51affff640 1 -- 172.21.15.7:0/708300738 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf7ed82c90 con 0x55cf7ea841b0 2024-09-21T06:43:40.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.565+0000 7f51af7fe640 1 --2- 172.21.15.7:0/708300738 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cf7ea8c390 0x55cf7ee624b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:43:40.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.565+0000 7f51affff640 1 --2- 172.21.15.7:0/708300738 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf7ea841b0 0x55cf7ee61f70 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f51a00209e0 tx=0x7f51a0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94d4a818d77fc66f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:40.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.565+0000 7f518f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:43:40.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.565+0000 7f518f7fe640 1 -- 172.21.15.7:0/708300738 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a002d060 con 0x55cf7ea841b0 2024-09-21T06:43:40.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.565+0000 7f51bcd04740 1 -- 172.21.15.7:0/708300738 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f51a40054d0 con 0x55cf7ea841b0 2024-09-21T06:43:40.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.565+0000 7f518f7fe640 1 -- 172.21.15.7:0/708300738 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8412+0+0 (secure 0 0 0) 0x7f51a0018030 con 0x55cf7ea841b0 2024-09-21T06:43:40.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.566+0000 7f518f7fe640 1 -- 172.21.15.7:0/708300738 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f51a0011b50 con 0x55cf7ea841b0 2024-09-21T06:43:40.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.566+0000 7f51bcd04740 10 client.16869 fetch_fsmap learned FSMap version 25 2024-09-21T06:43:40.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.566+0000 7f51bcd04740 1 -- 172.21.15.7:0/708300738 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55cf7ee70d90 con 0x55cf7ea841b0 2024-09-21T06:43:40.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.566+0000 7f518f7fe640 1 -- 172.21.15.7:0/708300738 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f51a40054d0 con 0x55cf7ea841b0 2024-09-21T06:43:40.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.566+0000 7f518f7fe640 1 -- 172.21.15.7:0/708300738 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f51a0030020 con 0x55cf7ea841b0 2024-09-21T06:43:40.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.566+0000 7f51bcd04740 10 client.16869 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:43:40.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.566+0000 7f51bcd04740 10 client.16869 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:43:40.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.566+0000 7f51bcd04740 20 client.16869 populate_metadata read hostname 'smithi007' 2024-09-21T06:43:40.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.566+0000 7f51bcd04740 1 --2- 172.21.15.7:0/708300738 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55cf7ea6b9f0 0x55cf7ee742f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:40.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.566+0000 7f51bcd04740 4 client.16869 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:43:40.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.566+0000 7f51bcd04740 1 -- 172.21.15.7:0/708300738 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cf7edccdf0 con 0x55cf7ea6b9f0 2024-09-21T06:43:40.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.566+0000 7f51af7fe640 1 --2- 172.21.15.7:0/708300738 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55cf7ea6b9f0 0x55cf7ee742f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:40.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.567+0000 7f51af7fe640 1 --2- 172.21.15.7:0/708300738 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55cf7ea6b9f0 0x55cf7ee742f0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d06e5e40ba25a66e server_cookie=a48bc0aa93ffa6c2 in_seq=0 out_seq=0 2024-09-21T06:43:40.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.567+0000 7f518f7fe640 10 client.16869 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:43:40.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.568+0000 7f518f7fe640 1 -- 172.21.15.7:0/708300738 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cf7edccdf0 con 0x55cf7ea6b9f0 2024-09-21T06:43:40.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.568+0000 7f518f7fe640 10 client.16869 handle_command_reply: tid=0 2024-09-21T06:43:40.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.568+0000 7f51bcd04740 1 client.16869 shutdown 2024-09-21T06:43:40.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.568+0000 7f51bcd04740 1 -- 172.21.15.7:0/708300738 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf7ea841b0 msgr2=0x55cf7ee61f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:40.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.568+0000 7f51bcd04740 1 --2- 172.21.15.7:0/708300738 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf7ea841b0 0x55cf7ee61f70 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f51a00209e0 tx=0x7f51a0004730 comp rx=0 tx=0).stop 2024-09-21T06:43:40.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.568+0000 7f51bcd04740 1 -- 172.21.15.7:0/708300738 shutdown_connections 2024-09-21T06:43:40.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.568+0000 7f51bcd04740 1 --2- 172.21.15.7:0/708300738 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55cf7ea6b9f0 0x55cf7ee742f0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:40.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.568+0000 7f51bcd04740 1 --2- 172.21.15.7:0/708300738 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cf7eaad070 0x55cf7ee6e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:40.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.568+0000 7f51bcd04740 1 --2- 172.21.15.7:0/708300738 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cf7ea8c390 0x55cf7ee624b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:40.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.568+0000 7f51bcd04740 1 --2- 172.21.15.7:0/708300738 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf7ea841b0 0x55cf7ee61f70 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:40.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.568+0000 7f51bcd04740 1 -- 172.21.15.7:0/708300738 >> 172.21.15.7:0/708300738 conn(0x55cf7eaa1460 msgr2=0x55cf7ee56090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:40.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.568+0000 7f518f7fe640 0 client.16869 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:43:40.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.568+0000 7f51bcd04740 1 -- 172.21.15.7:0/708300738 shutdown_connections 2024-09-21T06:43:40.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.568+0000 7f51bcd04740 1 -- 172.21.15.7:0/708300738 wait complete. 2024-09-21T06:43:40.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.568+0000 7f51bcd04740 20 client.16869 trim_cache size 0 max 16384 2024-09-21T06:43:40.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.581+0000 7f51bcd04740 1 Processor -- start 2024-09-21T06:43:40.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.581+0000 7f51bcd04740 1 -- start start 2024-09-21T06:43:40.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.581+0000 7f51bcd04740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cf7ea841b0 0x55cf7ee607f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:40.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.581+0000 7f51bcd04740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf7ea8c390 0x55cf7ee60d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:40.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.581+0000 7f51bcd04740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cf7eaad070 0x55cf7ee61d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:40.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.581+0000 7f51bcd04740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f51b01afbb0 con 0x55cf7ea8c390 2024-09-21T06:43:40.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.581+0000 7f51bcd04740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f51b01ad480 con 0x55cf7ea841b0 2024-09-21T06:43:40.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.581+0000 7f51bcd04740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f51b01ab2f0 con 0x55cf7eaad070 2024-09-21T06:43:40.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.582+0000 7f51af7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf7ea8c390 0x55cf7ee60d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:40.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.582+0000 7f51af7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf7ea8c390 0x55cf7ee60d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56560/0 (socket says 172.21.15.7:56560) 2024-09-21T06:43:40.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.582+0000 7f51af7fe640 1 -- 172.21.15.7:0/3798888491 learned_addr learned my addr 172.21.15.7:0/3798888491 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:43:40.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.582+0000 7f51b4d2d640 1 --2- 172.21.15.7:0/3798888491 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cf7eaad070 0x55cf7ee61d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:40.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.582+0000 7f51affff640 1 --2- 172.21.15.7:0/3798888491 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cf7ea841b0 0x55cf7ee607f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:40.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.582+0000 7f51af7fe640 1 -- 172.21.15.7:0/3798888491 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cf7eaad070 msgr2=0x55cf7ee61d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:40.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.582+0000 7f51af7fe640 1 --2- 172.21.15.7:0/3798888491 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cf7eaad070 0x55cf7ee61d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:40.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.582+0000 7f51af7fe640 1 -- 172.21.15.7:0/3798888491 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cf7ea841b0 msgr2=0x55cf7ee607f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:40.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.582+0000 7f51af7fe640 1 --2- 172.21.15.7:0/3798888491 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cf7ea841b0 0x55cf7ee607f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:40.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.582+0000 7f51af7fe640 1 -- 172.21.15.7:0/3798888491 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf7ee60470 con 0x55cf7ea8c390 2024-09-21T06:43:40.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.582+0000 7f51af7fe640 1 --2- 172.21.15.7:0/3798888491 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf7ea8c390 0x55cf7ee60d30 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f51a4005870 tx=0x7f51a4004490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=697c9783bf8dcaf5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:40.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.582+0000 7f5195ffb640 1 -- 172.21.15.7:0/3798888491 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a400bce0 con 0x55cf7ea8c390 2024-09-21T06:43:40.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.582+0000 7f5195ffb640 1 -- 172.21.15.7:0/3798888491 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f51a4005500 con 0x55cf7ea8c390 2024-09-21T06:43:40.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.582+0000 7f5195ffb640 1 -- 172.21.15.7:0/3798888491 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a4004b20 con 0x55cf7ea8c390 2024-09-21T06:43:40.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.583+0000 7f51bcd04740 1 -- 172.21.15.7:0/3798888491 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf7ea8c390 msgr2=0x55cf7ee60d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:40.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.583+0000 7f51bcd04740 1 --2- 172.21.15.7:0/3798888491 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf7ea8c390 0x55cf7ee60d30 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f51a4005870 tx=0x7f51a4004490 comp rx=0 tx=0).stop 2024-09-21T06:43:40.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.583+0000 7f51bcd04740 1 -- 172.21.15.7:0/3798888491 shutdown_connections 2024-09-21T06:43:40.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.583+0000 7f51bcd04740 1 --2- 172.21.15.7:0/3798888491 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cf7eaad070 0x55cf7ee61d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:40.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.583+0000 7f51bcd04740 1 --2- 172.21.15.7:0/3798888491 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf7ea8c390 0x55cf7ee60d30 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:40.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.583+0000 7f51bcd04740 1 --2- 172.21.15.7:0/3798888491 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cf7ea841b0 0x55cf7ee607f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:40.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.583+0000 7f51bcd04740 1 -- 172.21.15.7:0/3798888491 >> 172.21.15.7:0/3798888491 conn(0x55cf7eaa1460 msgr2=0x55cf7ee5a0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:40.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.583+0000 7f51bcd04740 1 -- 172.21.15.7:0/3798888491 shutdown_connections 2024-09-21T06:43:40.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.583+0000 7f51bcd04740 1 -- 172.21.15.7:0/3798888491 wait complete. 2024-09-21T06:43:40.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.584+0000 7f51bcd04740 1 -- start start 2024-09-21T06:43:40.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.584+0000 7f51bcd04740 1 Processor -- start 2024-09-21T06:43:40.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.584+0000 7f51bcd04740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cf7ea841b0 0x55cf7ee67150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:40.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.584+0000 7f51bcd04740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cf7ea8c390 0x55cf7ee67730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:40.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.584+0000 7f51bcd04740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf7eaad070 0x55cf7eed6d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:40.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.584+0000 7f51bcd04740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f51b01ab940 con 0x55cf7eaad070 2024-09-21T06:43:40.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.584+0000 7f51bcd04740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f51b01acdb0 con 0x55cf7ea841b0 2024-09-21T06:43:40.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.584+0000 7f51bcd04740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f51b01ac010 con 0x55cf7ea8c390 2024-09-21T06:43:40.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.584+0000 7f51bcd04740 10 client.0 _ll_register_callbacks cb 0x7f51a0009db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:43:40.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.584+0000 7f51b4d2d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf7eaad070 0x55cf7eed6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:40.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.584+0000 7f51affff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cf7ea841b0 0x55cf7ee67150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:40.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.584+0000 7f51b4d2d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf7eaad070 0x55cf7eed6d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56562/0 (socket says 172.21.15.7:56562) 2024-09-21T06:43:40.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.584+0000 7f51b4d2d640 1 -- 172.21.15.7:0/3126489941 learned_addr learned my addr 172.21.15.7:0/3126489941 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:43:40.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.585+0000 7f51b4d2d640 1 -- 172.21.15.7:0/3126489941 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cf7ea8c390 msgr2=0x55cf7ee67730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:40.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.585+0000 7f51b4d2d640 1 --2- 172.21.15.7:0/3126489941 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cf7ea8c390 0x55cf7ee67730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:40.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.585+0000 7f51b4d2d640 1 -- 172.21.15.7:0/3126489941 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cf7ea841b0 msgr2=0x55cf7ee67150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:40.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.585+0000 7f51b4d2d640 1 --2- 172.21.15.7:0/3126489941 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cf7ea841b0 0x55cf7ee67150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:40.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.585+0000 7f51b4d2d640 1 -- 172.21.15.7:0/3126489941 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf7eed7390 con 0x55cf7eaad070 2024-09-21T06:43:40.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.585+0000 7f51affff640 1 --2- 172.21.15.7:0/3126489941 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cf7ea841b0 0x55cf7ee67150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:43:40.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.585+0000 7f51b4d2d640 1 --2- 172.21.15.7:0/3126489941 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf7eaad070 0x55cf7eed6d20 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f51a81061b0 tx=0x7f51a80caf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d048ee2c06f8c2db server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:40.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.585+0000 7f518f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:43:40.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.585+0000 7f518f7fe640 1 -- 172.21.15.7:0/3126489941 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a80cdfc0 con 0x55cf7eaad070 2024-09-21T06:43:40.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.585+0000 7f518f7fe640 1 -- 172.21.15.7:0/3126489941 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8412+0+0 (secure 0 0 0) 0x7f51a80d7ff0 con 0x55cf7eaad070 2024-09-21T06:43:40.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.585+0000 7f51bcd04740 1 -- 172.21.15.7:0/3126489941 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f51a4005500 con 0x55cf7eaad070 2024-09-21T06:43:40.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.585+0000 7f518f7fe640 1 -- 172.21.15.7:0/3126489941 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f51a80ce360 con 0x55cf7eaad070 2024-09-21T06:43:40.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.585+0000 7f51bcd04740 10 client.16875 fetch_fsmap learned FSMap version 25 2024-09-21T06:43:40.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.585+0000 7f51bcd04740 1 -- 172.21.15.7:0/3126489941 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55cf7eede710 con 0x55cf7eaad070 2024-09-21T06:43:40.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.586+0000 7f518f7fe640 1 -- 172.21.15.7:0/3126489941 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f51a4005500 con 0x55cf7eaad070 2024-09-21T06:43:40.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.586+0000 7f518f7fe640 1 -- 172.21.15.7:0/3126489941 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f51a80cfca0 con 0x55cf7eaad070 2024-09-21T06:43:40.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.586+0000 7f51bcd04740 10 client.16875 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:43:40.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.586+0000 7f51bcd04740 10 client.16875 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:43:40.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.586+0000 7f51bcd04740 20 client.16875 populate_metadata read hostname 'smithi007' 2024-09-21T06:43:40.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.586+0000 7f51bcd04740 1 --2- 172.21.15.7:0/3126489941 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55cf7ea40da0 0x55cf7eee0e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:40.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.586+0000 7f51bcd04740 4 client.16875 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:43:40.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.586+0000 7f51bcd04740 1 -- 172.21.15.7:0/3126489941 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55cf7edc88a0 con 0x55cf7ea40da0 2024-09-21T06:43:40.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.586+0000 7f51affff640 1 --2- 172.21.15.7:0/3126489941 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55cf7ea40da0 0x55cf7eee0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:40.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.586+0000 7f51affff640 1 --2- 172.21.15.7:0/3126489941 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55cf7ea40da0 0x55cf7eee0e90 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc8d185e5444c920 server_cookie=88fe006a13a4b4b4 in_seq=0 out_seq=0 2024-09-21T06:43:40.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.586+0000 7f518f7fe640 10 client.16875 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:43:40.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.587+0000 7f518f7fe640 1 -- 172.21.15.7:0/3126489941 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55cf7edc88a0 con 0x55cf7ea40da0 2024-09-21T06:43:40.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.587+0000 7f518f7fe640 10 client.16875 handle_command_reply: tid=0 2024-09-21T06:43:40.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.587+0000 7f51bcd04740 1 client.16875 shutdown 2024-09-21T06:43:40.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.587+0000 7f51bcd04740 1 -- 172.21.15.7:0/3126489941 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf7eaad070 msgr2=0x55cf7eed6d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:40.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.587+0000 7f51bcd04740 1 --2- 172.21.15.7:0/3126489941 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf7eaad070 0x55cf7eed6d20 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f51a81061b0 tx=0x7f51a80caf70 comp rx=0 tx=0).stop 2024-09-21T06:43:40.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.587+0000 7f51bcd04740 1 -- 172.21.15.7:0/3126489941 shutdown_connections 2024-09-21T06:43:40.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.587+0000 7f51bcd04740 1 --2- 172.21.15.7:0/3126489941 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55cf7ea40da0 0x55cf7eee0e90 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:40.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.587+0000 7f51bcd04740 1 --2- 172.21.15.7:0/3126489941 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cf7eaad070 0x55cf7eed6d20 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:40.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.587+0000 7f51bcd04740 1 --2- 172.21.15.7:0/3126489941 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cf7ea8c390 0x55cf7ee67730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:40.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.587+0000 7f51bcd04740 1 --2- 172.21.15.7:0/3126489941 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cf7ea841b0 0x55cf7ee67150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:40.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.587+0000 7f51bcd04740 1 -- 172.21.15.7:0/3126489941 >> 172.21.15.7:0/3126489941 conn(0x55cf7eaa1460 msgr2=0x55cf7ee61d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:40.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.587+0000 7f518f7fe640 0 client.16875 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:43:40.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.587+0000 7f51bcd04740 1 -- 172.21.15.7:0/3126489941 shutdown_connections 2024-09-21T06:43:40.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.587+0000 7f51bcd04740 1 -- 172.21.15.7:0/3126489941 wait complete. 2024-09-21T06:43:40.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.587+0000 7f51bcd04740 20 client.16875 trim_cache size 0 max 16384 2024-09-21T06:43:40.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.588+0000 7f51b6790640 1 -- 172.21.15.7:0/3040152686 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f51980b6680 msgr2=0x7f51980b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:40.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.588+0000 7f51b6790640 1 --2- 172.21.15.7:0/3040152686 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f51980b6680 0x7f51980b8b90 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x55cf7ee53320 tx=0x7f51a0005f90 comp rx=0 tx=0).stop 2024-09-21T06:43:40.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.588+0000 7f51b6790640 1 -- 172.21.15.7:0/3040152686 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51b0108d20 msgr2=0x7f51b019eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:40.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.588+0000 7f51b6790640 1 --2- 172.21.15.7:0/3040152686 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51b0108d20 0x7f51b019eb10 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f51a8009430 tx=0x7f51a80317c0 comp rx=0 tx=0).stop 2024-09-21T06:43:40.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.588+0000 7f51b6790640 1 -- 172.21.15.7:0/3040152686 shutdown_connections 2024-09-21T06:43:40.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.588+0000 7f51b6790640 1 --2- 172.21.15.7:0/3040152686 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f51980b6680 0x7f51980b8b90 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:40.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.588+0000 7f51b6790640 1 --2- 172.21.15.7:0/3040152686 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f51b0108d20 0x7f51b019eb10 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:40.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.588+0000 7f51b6790640 1 --2- 172.21.15.7:0/3040152686 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f51b01083d0 0x7f51b0199870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:40.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.588+0000 7f51b6790640 1 --2- 172.21.15.7:0/3040152686 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f51b0102a90 0x7f51b01992d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:40.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.588+0000 7f51b6790640 1 -- 172.21.15.7:0/3040152686 >> 172.21.15.7:0/3040152686 conn(0x7f51b0079750 msgr2=0x7f51b01043a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:40.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.588+0000 7f51b6790640 1 -- 172.21.15.7:0/3040152686 shutdown_connections 2024-09-21T06:43:40.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:40.588+0000 7f51b6790640 1 -- 172.21.15.7:0/3040152686 wait complete. 2024-09-21T06:43:41.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:43:40 smithi144 ceph-mon[34653]: pgmap v545: 97 pgs: 97 active+clean; 3.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:43:41.287 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:43:40 smithi007 ceph-mon[30983]: pgmap v545: 97 pgs: 97 active+clean; 3.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:43:41.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:43:40 smithi018 ceph-mon[34477]: pgmap v545: 97 pgs: 97 active+clean; 3.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:43:42.317 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:43:42.318 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:43:42.590 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:43:42.991 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:43:42 smithi007 ceph-mon[30983]: pgmap v546: 97 pgs: 97 active+clean; 3.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:43:43.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.086+0000 7f01ea929640 1 -- 172.21.15.7:0/942576245 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01e41083c0 msgr2=0x7f01e41087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:43.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.086+0000 7f01ea929640 1 --2- 172.21.15.7:0/942576245 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01e41083c0 0x7f01e41087d0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f01d8009900 tx=0x7f01d802a410 comp rx=0 tx=0).stop 2024-09-21T06:43:43.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.086+0000 7f01ea929640 1 -- 172.21.15.7:0/942576245 shutdown_connections 2024-09-21T06:43:43.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.086+0000 7f01ea929640 1 --2- 172.21.15.7:0/942576245 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f01e4108d10 0x7f01e410f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:43.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.086+0000 7f01ea929640 1 --2- 172.21.15.7:0/942576245 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01e41083c0 0x7f01e41087d0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:43.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.086+0000 7f01ea929640 1 --2- 172.21.15.7:0/942576245 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01e4102a80 0x7f01e4102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:43.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.086+0000 7f01ea929640 1 -- 172.21.15.7:0/942576245 >> 172.21.15.7:0/942576245 conn(0x7f01e4079740 msgr2=0x7f01e4079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:43.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.086+0000 7f01ea929640 1 -- 172.21.15.7:0/942576245 shutdown_connections 2024-09-21T06:43:43.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.086+0000 7f01ea929640 1 -- 172.21.15.7:0/942576245 wait complete. 2024-09-21T06:43:43.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.086+0000 7f01ea929640 1 Processor -- start 2024-09-21T06:43:43.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.086+0000 7f01ea929640 1 -- start start 2024-09-21T06:43:43.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.087+0000 7f01ea929640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01e4102a80 0x7f01e4199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:43.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.087+0000 7f01ea929640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f01e41083c0 0x7f01e41998f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:43.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.087+0000 7f01ea929640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01e4108d10 0x7f01e419eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:43.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.087+0000 7f01ea929640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f01e4112980 con 0x7f01e4108d10 2024-09-21T06:43:43.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.087+0000 7f01ea929640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f01e4112800 con 0x7f01e41083c0 2024-09-21T06:43:43.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.087+0000 7f01ea929640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f01e4112b00 con 0x7f01e4102a80 2024-09-21T06:43:43.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.087+0000 7f01e8ec6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01e4108d10 0x7f01e419eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:43.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.087+0000 7f01e8ec6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01e4108d10 0x7f01e419eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56582/0 (socket says 172.21.15.7:56582) 2024-09-21T06:43:43.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.087+0000 7f01e8ec6640 1 -- 172.21.15.7:0/63981301 learned_addr learned my addr 172.21.15.7:0/63981301 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:43:43.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.087+0000 7f01e37fe640 1 --2- 172.21.15.7:0/63981301 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f01e41083c0 0x7f01e41998f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:43.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.087+0000 7f01e3fff640 1 --2- 172.21.15.7:0/63981301 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01e4102a80 0x7f01e4199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:43.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.087+0000 7f01e8ec6640 1 -- 172.21.15.7:0/63981301 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01e4102a80 msgr2=0x7f01e4199350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:43.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.087+0000 7f01e8ec6640 1 --2- 172.21.15.7:0/63981301 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01e4102a80 0x7f01e4199350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:43.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.087+0000 7f01e8ec6640 1 -- 172.21.15.7:0/63981301 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f01e41083c0 msgr2=0x7f01e41998f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:43.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.087+0000 7f01e8ec6640 1 --2- 172.21.15.7:0/63981301 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f01e41083c0 0x7f01e41998f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:43.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.087+0000 7f01e8ec6640 1 -- 172.21.15.7:0/63981301 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01e419f2c0 con 0x7f01e4108d10 2024-09-21T06:43:43.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.088+0000 7f01e8ec6640 1 --2- 172.21.15.7:0/63981301 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01e4108d10 0x7f01e419eb90 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f01dc00eaa0 tx=0x7f01dc00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:43.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.088+0000 7f01e17fa640 1 -- 172.21.15.7:0/63981301 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01dc00cdb0 con 0x7f01e4108d10 2024-09-21T06:43:43.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.088+0000 7f01e17fa640 1 -- 172.21.15.7:0/63981301 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f01dc005020 con 0x7f01e4108d10 2024-09-21T06:43:43.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.088+0000 7f01ea929640 1 -- 172.21.15.7:0/63981301 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01e419f5b0 con 0x7f01e4108d10 2024-09-21T06:43:43.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.088+0000 7f01e17fa640 1 -- 172.21.15.7:0/63981301 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01dc0116d0 con 0x7f01e4108d10 2024-09-21T06:43:43.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.088+0000 7f01ea929640 1 -- 172.21.15.7:0/63981301 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01e41a5d10 con 0x7f01e4108d10 2024-09-21T06:43:43.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.090+0000 7f01f0e9d740 1 Processor -- start 2024-09-21T06:43:43.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.090+0000 7f01e17fa640 1 -- 172.21.15.7:0/63981301 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f01dc0051d0 con 0x7f01e4108d10 2024-09-21T06:43:43.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.091+0000 7f01f0e9d740 1 -- start start 2024-09-21T06:43:43.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.091+0000 7f01f0e9d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc7f9aa350 0x55cc7fd51430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:43.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.091+0000 7f01f0e9d740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc7f981490 0x55cc7fd51970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:43.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.091+0000 7f01f0e9d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc7f989670 0x55cc7fd51eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:43.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.091+0000 7f01f0e9d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55cc7fcc7e60 con 0x55cc7f989670 2024-09-21T06:43:43.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.091+0000 7f01f0e9d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55cc7fcb7290 con 0x55cc7f9aa350 2024-09-21T06:43:43.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.091+0000 7f01f0e9d740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55cc7fcbb0a0 con 0x55cc7f981490 2024-09-21T06:43:43.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.091+0000 7f01e37fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc7f989670 0x55cc7fd51eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:43.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.091+0000 7f01e37fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc7f989670 0x55cc7fd51eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56586/0 (socket says 172.21.15.7:56586) 2024-09-21T06:43:43.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.091+0000 7f01e37fe640 1 -- 172.21.15.7:0/1296907601 learned_addr learned my addr 172.21.15.7:0/1296907601 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:43:43.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.091+0000 7f01e37fe640 1 --2- 172.21.15.7:0/1296907601 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc7f9aa350 0x55cc7fd51430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:43.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.091+0000 7f01e3fff640 1 --2- 172.21.15.7:0/1296907601 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc7f981490 0x55cc7fd51970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:43.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.091+0000 7f01e37fe640 1 -- 172.21.15.7:0/1296907601 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc7f981490 msgr2=0x55cc7fd51970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:43.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.091+0000 7f01e37fe640 1 --2- 172.21.15.7:0/1296907601 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc7f981490 0x55cc7fd51970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:43.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.091+0000 7f01e37fe640 1 -- 172.21.15.7:0/1296907601 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc7f9aa350 msgr2=0x55cc7fd51430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:43.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.091+0000 7f01e37fe640 1 --2- 172.21.15.7:0/1296907601 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc7f9aa350 0x55cc7fd51430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:43.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.091+0000 7f01e37fe640 1 -- 172.21.15.7:0/1296907601 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc7fa15930 con 0x55cc7f989670 2024-09-21T06:43:43.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.091+0000 7f01e17fa640 1 --2- 172.21.15.7:0/63981301 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f01cc0b6700 0x7f01cc0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:43.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.092+0000 7f01e3fff640 1 --2- 172.21.15.7:0/63981301 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f01cc0b6700 0x7f01cc0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:43.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.092+0000 7f01e37fe640 1 --2- 172.21.15.7:0/1296907601 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc7f989670 0x55cc7fd51eb0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f01d8005f70 tx=0x7f01d8005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae903322bfdc2fb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:43.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.092+0000 7f01e17fa640 1 -- 172.21.15.7:0/63981301 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8412+0+0 (secure 0 0 0) 0x7f01dc0e7800 con 0x7f01e4108d10 2024-09-21T06:43:43.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.092+0000 7f01ca7fc640 1 -- 172.21.15.7:0/1296907601 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d8035070 con 0x55cc7f989670 2024-09-21T06:43:43.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.092+0000 7f01ca7fc640 1 -- 172.21.15.7:0/1296907601 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f01d80035f0 con 0x55cc7f989670 2024-09-21T06:43:43.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.092+0000 7f01ca7fc640 1 -- 172.21.15.7:0/1296907601 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d80044e0 con 0x55cc7f989670 2024-09-21T06:43:43.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.093+0000 7f01f0e9d740 1 -- 172.21.15.7:0/1296907601 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc7f989670 msgr2=0x55cc7fd51eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:43.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.093+0000 7f01f0e9d740 1 --2- 172.21.15.7:0/1296907601 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc7f989670 0x55cc7fd51eb0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f01d8005f70 tx=0x7f01d8005780 comp rx=0 tx=0).stop 2024-09-21T06:43:43.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.093+0000 7f01e3fff640 1 --2- 172.21.15.7:0/63981301 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f01cc0b6700 0x7f01cc0b8c10 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f01d4005fd0 tx=0x7f01d4005c50 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:43.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.093+0000 7f01f0e9d740 1 -- 172.21.15.7:0/1296907601 shutdown_connections 2024-09-21T06:43:43.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.093+0000 7f01f0e9d740 1 --2- 172.21.15.7:0/1296907601 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc7f989670 0x55cc7fd51eb0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:43.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.093+0000 7f01f0e9d740 1 --2- 172.21.15.7:0/1296907601 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc7f981490 0x55cc7fd51970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:43.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.093+0000 7f01f0e9d740 1 --2- 172.21.15.7:0/1296907601 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc7f9aa350 0x55cc7fd51430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:43.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.093+0000 7f01f0e9d740 1 -- 172.21.15.7:0/1296907601 >> 172.21.15.7:0/1296907601 conn(0x55cc7f99e740 msgr2=0x55cc7fd4f320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:43.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.093+0000 7f01f0e9d740 1 -- 172.21.15.7:0/1296907601 shutdown_connections 2024-09-21T06:43:43.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.093+0000 7f01f0e9d740 1 -- 172.21.15.7:0/1296907601 wait complete. 2024-09-21T06:43:43.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.093+0000 7f01f0e9d740 1 -- start start 2024-09-21T06:43:43.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.094+0000 7f01f0e9d740 1 Processor -- start 2024-09-21T06:43:43.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.094+0000 7f01f0e9d740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc7f981490 0x55cc7fd5d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:43.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.094+0000 7f01f0e9d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc7f989670 0x55cc7fd5d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:43.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.094+0000 7f01f0e9d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc7f9aa350 0x55cc7fd68ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:43.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.094+0000 7f01f0e9d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55cc7fb18890 con 0x55cc7f989670 2024-09-21T06:43:43.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.094+0000 7f01f0e9d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55cc7fc51d40 con 0x55cc7f9aa350 2024-09-21T06:43:43.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.094+0000 7f01f0e9d740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55cc7fd5fbb0 con 0x55cc7f981490 2024-09-21T06:43:43.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.094+0000 7f01f0e9d740 10 client.0 _ll_register_callbacks cb 0x55cc7fcb5c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:43:43.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.094+0000 7f01e37fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc7f989670 0x55cc7fd5d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:43.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.094+0000 7f01e37fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc7f989670 0x55cc7fd5d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56592/0 (socket says 172.21.15.7:56592) 2024-09-21T06:43:43.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.094+0000 7f01e37fe640 1 -- 172.21.15.7:0/2479783938 learned_addr learned my addr 172.21.15.7:0/2479783938 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:43:43.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.094+0000 7f01e8ec6640 1 --2- 172.21.15.7:0/2479783938 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc7f9aa350 0x55cc7fd68ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:43.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.094+0000 7f01e3fff640 1 --2- 172.21.15.7:0/2479783938 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc7f981490 0x55cc7fd5d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:43.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.094+0000 7f01e37fe640 1 -- 172.21.15.7:0/2479783938 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc7f981490 msgr2=0x55cc7fd5d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:43.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.094+0000 7f01e37fe640 1 --2- 172.21.15.7:0/2479783938 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc7f981490 0x55cc7fd5d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:43.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.094+0000 7f01e37fe640 1 -- 172.21.15.7:0/2479783938 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc7f9aa350 msgr2=0x55cc7fd68ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:43.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.094+0000 7f01e37fe640 1 --2- 172.21.15.7:0/2479783938 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc7f9aa350 0x55cc7fd68ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:43.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.094+0000 7f01e37fe640 1 -- 172.21.15.7:0/2479783938 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc7fd69510 con 0x55cc7f989670 2024-09-21T06:43:43.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.094+0000 7f01e3fff640 1 --2- 172.21.15.7:0/2479783938 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc7f981490 0x55cc7fd5d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:43:43.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.095+0000 7f01e37fe640 1 --2- 172.21.15.7:0/2479783938 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc7f989670 0x55cc7fd5d5f0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f01d8031a60 tx=0x7f01d8005900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb56a35ffca8271a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:43.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.095+0000 7f01c37fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:43:43.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.095+0000 7f01c37fe640 1 -- 172.21.15.7:0/2479783938 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d804e020 con 0x55cc7f989670 2024-09-21T06:43:43.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.095+0000 7f01c37fe640 1 -- 172.21.15.7:0/2479783938 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8412+0+0 (secure 0 0 0) 0x7f01d8004410 con 0x55cc7f989670 2024-09-21T06:43:43.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.095+0000 7f01f0e9d740 1 -- 172.21.15.7:0/2479783938 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f01d80035f0 con 0x55cc7f989670 2024-09-21T06:43:43.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.095+0000 7f01c37fe640 1 -- 172.21.15.7:0/2479783938 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f01d8059050 con 0x55cc7f989670 2024-09-21T06:43:43.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.095+0000 7f01f0e9d740 10 client.16887 fetch_fsmap learned FSMap version 25 2024-09-21T06:43:43.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.095+0000 7f01f0e9d740 1 -- 172.21.15.7:0/2479783938 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55cc7fd6be40 con 0x55cc7f989670 2024-09-21T06:43:43.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.095+0000 7f01c37fe640 1 -- 172.21.15.7:0/2479783938 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f01d80035f0 con 0x55cc7f989670 2024-09-21T06:43:43.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.095+0000 7f01c37fe640 1 -- 172.21.15.7:0/2479783938 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f01d803d870 con 0x55cc7f989670 2024-09-21T06:43:43.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.095+0000 7f01f0e9d740 10 client.16887 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:43:43.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.095+0000 7f01f0e9d740 10 client.16887 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:43:43.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.095+0000 7f01f0e9d740 20 client.16887 populate_metadata read hostname 'smithi007' 2024-09-21T06:43:43.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.096+0000 7f01f0e9d740 1 --2- 172.21.15.7:0/2479783938 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55cc7f968cd0 0x55cc7fd6f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:43.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.096+0000 7f01f0e9d740 4 client.16887 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:43:43.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.096+0000 7f01f0e9d740 1 -- 172.21.15.7:0/2479783938 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cc7fcc9db0 con 0x55cc7f968cd0 2024-09-21T06:43:43.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.096+0000 7f01e3fff640 1 --2- 172.21.15.7:0/2479783938 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55cc7f968cd0 0x55cc7fd6f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:43.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.096+0000 7f01c37fe640 10 client.16887 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:43:43.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.096+0000 7f01e3fff640 1 --2- 172.21.15.7:0/2479783938 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55cc7f968cd0 0x55cc7fd6f1a0 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5edfe4a4feb9ee9c server_cookie=d618346445d139c in_seq=0 out_seq=0 2024-09-21T06:43:43.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.097+0000 7f01c37fe640 1 -- 172.21.15.7:0/2479783938 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cc7fcc9db0 con 0x55cc7f968cd0 2024-09-21T06:43:43.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.097+0000 7f01c37fe640 10 client.16887 handle_command_reply: tid=0 2024-09-21T06:43:43.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.097+0000 7f01f0e9d740 1 client.16887 shutdown 2024-09-21T06:43:43.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.097+0000 7f01f0e9d740 1 -- 172.21.15.7:0/2479783938 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc7f989670 msgr2=0x55cc7fd5d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:43.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.097+0000 7f01f0e9d740 1 --2- 172.21.15.7:0/2479783938 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc7f989670 0x55cc7fd5d5f0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f01d8031a60 tx=0x7f01d8005900 comp rx=0 tx=0).stop 2024-09-21T06:43:43.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.097+0000 7f01f0e9d740 1 -- 172.21.15.7:0/2479783938 shutdown_connections 2024-09-21T06:43:43.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.097+0000 7f01f0e9d740 1 --2- 172.21.15.7:0/2479783938 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55cc7f968cd0 0x55cc7fd6f1a0 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:43.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.097+0000 7f01f0e9d740 1 --2- 172.21.15.7:0/2479783938 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc7f9aa350 0x55cc7fd68ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:43.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.097+0000 7f01f0e9d740 1 --2- 172.21.15.7:0/2479783938 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc7f989670 0x55cc7fd5d5f0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:43.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.097+0000 7f01c37fe640 0 client.16887 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:43:43.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.097+0000 7f01f0e9d740 1 --2- 172.21.15.7:0/2479783938 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc7f981490 0x55cc7fd5d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:43.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.097+0000 7f01f0e9d740 1 -- 172.21.15.7:0/2479783938 >> 172.21.15.7:0/2479783938 conn(0x55cc7f99e740 msgr2=0x55cc7fd545c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:43.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.097+0000 7f01f0e9d740 1 -- 172.21.15.7:0/2479783938 shutdown_connections 2024-09-21T06:43:43.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.097+0000 7f01f0e9d740 1 -- 172.21.15.7:0/2479783938 wait complete. 2024-09-21T06:43:43.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.097+0000 7f01f0e9d740 20 client.16887 trim_cache size 0 max 16384 2024-09-21T06:43:43.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.115+0000 7f01f0e9d740 1 Processor -- start 2024-09-21T06:43:43.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.115+0000 7f01f0e9d740 1 -- start start 2024-09-21T06:43:43.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.115+0000 7f01f0e9d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc7f968cd0 0x55cc7fd56540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:43.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.115+0000 7f01f0e9d740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc7f981490 0x55cc7fd56a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:43.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.115+0000 7f01f0e9d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc7f989670 0x55cc7fd5a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:43.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.115+0000 7f01f0e9d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f01e41b0c80 con 0x55cc7f968cd0 2024-09-21T06:43:43.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.115+0000 7f01f0e9d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f01e41ae550 con 0x55cc7f989670 2024-09-21T06:43:43.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.116+0000 7f01f0e9d740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f01e41ac3c0 con 0x55cc7f981490 2024-09-21T06:43:43.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.116+0000 7f01e3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc7f968cd0 0x55cc7fd56540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:43.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.116+0000 7f01e3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc7f968cd0 0x55cc7fd56540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56600/0 (socket says 172.21.15.7:56600) 2024-09-21T06:43:43.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.116+0000 7f01e3fff640 1 -- 172.21.15.7:0/1864195757 learned_addr learned my addr 172.21.15.7:0/1864195757 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:43:43.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.116+0000 7f01e8ec6640 1 --2- 172.21.15.7:0/1864195757 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc7f989670 0x55cc7fd5a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:43.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.116+0000 7f01e3fff640 1 -- 172.21.15.7:0/1864195757 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc7f981490 msgr2=0x55cc7fd56a80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T06:43:43.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.116+0000 7f01e3fff640 1 --2- 172.21.15.7:0/1864195757 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc7f981490 0x55cc7fd56a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:43.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.116+0000 7f01e3fff640 1 -- 172.21.15.7:0/1864195757 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc7f989670 msgr2=0x55cc7fd5a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:43.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.116+0000 7f01e3fff640 1 --2- 172.21.15.7:0/1864195757 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc7f989670 0x55cc7fd5a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:43.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.116+0000 7f01e3fff640 1 -- 172.21.15.7:0/1864195757 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc7fd5bdb0 con 0x55cc7f968cd0 2024-09-21T06:43:43.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.116+0000 7f01e8ec6640 1 --2- 172.21.15.7:0/1864195757 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc7f989670 0x55cc7fd5a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:43:43.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.116+0000 7f01e3fff640 1 --2- 172.21.15.7:0/1864195757 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc7f968cd0 0x55cc7fd56540 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f01d40126c0 tx=0x7f01d4014070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c50e72355aabbee server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:43.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.116+0000 7f01c9ffb640 1 -- 172.21.15.7:0/1864195757 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d4035070 con 0x55cc7f968cd0 2024-09-21T06:43:43.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.116+0000 7f01c9ffb640 1 -- 172.21.15.7:0/1864195757 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f01d4020c80 con 0x55cc7f968cd0 2024-09-21T06:43:43.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.116+0000 7f01c9ffb640 1 -- 172.21.15.7:0/1864195757 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d4030e50 con 0x55cc7f968cd0 2024-09-21T06:43:43.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.117+0000 7f01f0e9d740 1 -- 172.21.15.7:0/1864195757 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc7f968cd0 msgr2=0x55cc7fd56540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:43.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.117+0000 7f01f0e9d740 1 --2- 172.21.15.7:0/1864195757 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc7f968cd0 0x55cc7fd56540 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f01d40126c0 tx=0x7f01d4014070 comp rx=0 tx=0).stop 2024-09-21T06:43:43.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.117+0000 7f01f0e9d740 1 -- 172.21.15.7:0/1864195757 shutdown_connections 2024-09-21T06:43:43.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.117+0000 7f01f0e9d740 1 --2- 172.21.15.7:0/1864195757 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc7f989670 0x55cc7fd5a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:43.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.117+0000 7f01f0e9d740 1 --2- 172.21.15.7:0/1864195757 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc7f981490 0x55cc7fd56a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:43.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.117+0000 7f01f0e9d740 1 --2- 172.21.15.7:0/1864195757 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc7f968cd0 0x55cc7fd56540 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:43.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.117+0000 7f01f0e9d740 1 -- 172.21.15.7:0/1864195757 >> 172.21.15.7:0/1864195757 conn(0x55cc7f99e740 msgr2=0x55cc7fd5d050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:43.123 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.117+0000 7f01f0e9d740 1 -- 172.21.15.7:0/1864195757 shutdown_connections 2024-09-21T06:43:43.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.117+0000 7f01f0e9d740 1 -- 172.21.15.7:0/1864195757 wait complete. 2024-09-21T06:43:43.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.118+0000 7f01f0e9d740 1 -- start start 2024-09-21T06:43:43.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.118+0000 7f01f0e9d740 1 Processor -- start 2024-09-21T06:43:43.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.118+0000 7f01f0e9d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc7f968cd0 0x55cc7fd70a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:43.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.118+0000 7f01f0e9d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc7f981490 0x55cc7fd71040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:43.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.118+0000 7f01f0e9d740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc7f989670 0x55cc7fdd28f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:43.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.118+0000 7f01f0e9d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f01e41aca10 con 0x55cc7f968cd0 2024-09-21T06:43:43.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.118+0000 7f01f0e9d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f01e41ade80 con 0x55cc7f981490 2024-09-21T06:43:43.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.118+0000 7f01f0e9d740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f01e41ad0e0 con 0x55cc7f989670 2024-09-21T06:43:43.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.118+0000 7f01f0e9d740 10 client.0 _ll_register_callbacks cb 0x7f01d8032d90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:43:43.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.118+0000 7f01e3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc7f968cd0 0x55cc7fd70a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:43.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.118+0000 7f01e3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc7f968cd0 0x55cc7fd70a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56604/0 (socket says 172.21.15.7:56604) 2024-09-21T06:43:43.124 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.118+0000 7f01e3fff640 1 -- 172.21.15.7:0/2724123900 learned_addr learned my addr 172.21.15.7:0/2724123900 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:43:43.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.118+0000 7f01e37fe640 1 --2- 172.21.15.7:0/2724123900 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc7f981490 0x55cc7fd71040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:43.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.119+0000 7f01e8ec6640 1 --2- 172.21.15.7:0/2724123900 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc7f989670 0x55cc7fdd28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:43.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.119+0000 7f01e3fff640 1 -- 172.21.15.7:0/2724123900 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc7f989670 msgr2=0x55cc7fdd28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:43.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.119+0000 7f01e3fff640 1 --2- 172.21.15.7:0/2724123900 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc7f989670 0x55cc7fdd28f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:43.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.119+0000 7f01e3fff640 1 -- 172.21.15.7:0/2724123900 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc7f981490 msgr2=0x55cc7fd71040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:43.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.119+0000 7f01e3fff640 1 --2- 172.21.15.7:0/2724123900 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc7f981490 0x55cc7fd71040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:43.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.119+0000 7f01e3fff640 1 -- 172.21.15.7:0/2724123900 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc7fdd2f60 con 0x55cc7f968cd0 2024-09-21T06:43:43.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.119+0000 7f01e8ec6640 1 --2- 172.21.15.7:0/2724123900 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc7f989670 0x55cc7fdd28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:43:43.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.119+0000 7f01e37fe640 1 --2- 172.21.15.7:0/2724123900 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc7f981490 0x55cc7fd71040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:43:43.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.119+0000 7f01e3fff640 1 --2- 172.21.15.7:0/2724123900 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc7f968cd0 0x55cc7fd70a80 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f01d40309d0 tx=0x7f01d400bd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a1996f563a6025c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:43.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.119+0000 7f01c37fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:43:43.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.119+0000 7f01c37fe640 1 -- 172.21.15.7:0/2724123900 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d403e020 con 0x55cc7f968cd0 2024-09-21T06:43:43.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.119+0000 7f01c37fe640 1 -- 172.21.15.7:0/2724123900 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8412+0+0 (secure 0 0 0) 0x7f01d4030630 con 0x55cc7f968cd0 2024-09-21T06:43:43.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.119+0000 7f01f0e9d740 1 -- 172.21.15.7:0/2724123900 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f01d4020c80 con 0x55cc7f968cd0 2024-09-21T06:43:43.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.119+0000 7f01c37fe640 1 -- 172.21.15.7:0/2724123900 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f01d4049050 con 0x55cc7f968cd0 2024-09-21T06:43:43.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.119+0000 7f01f0e9d740 10 client.16893 fetch_fsmap learned FSMap version 25 2024-09-21T06:43:43.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.119+0000 7f01f0e9d740 1 -- 172.21.15.7:0/2724123900 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55cc7fdda2a0 con 0x55cc7f968cd0 2024-09-21T06:43:43.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.120+0000 7f01c37fe640 1 -- 172.21.15.7:0/2724123900 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f01d4020c80 con 0x55cc7f968cd0 2024-09-21T06:43:43.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.120+0000 7f01c37fe640 1 -- 172.21.15.7:0/2724123900 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f01d40046c0 con 0x55cc7f968cd0 2024-09-21T06:43:43.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.120+0000 7f01f0e9d740 10 client.16893 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:43:43.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.120+0000 7f01f0e9d740 10 client.16893 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:43:43.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.120+0000 7f01f0e9d740 20 client.16893 populate_metadata read hostname 'smithi007' 2024-09-21T06:43:43.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.120+0000 7f01f0e9d740 1 --2- 172.21.15.7:0/2724123900 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55cc7f9aa350 0x55cc7fddc9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:43.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.120+0000 7f01f0e9d740 4 client.16893 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:43:43.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.120+0000 7f01f0e9d740 1 -- 172.21.15.7:0/2724123900 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55cc7fcc5860 con 0x55cc7f9aa350 2024-09-21T06:43:43.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.120+0000 7f01e37fe640 1 --2- 172.21.15.7:0/2724123900 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55cc7f9aa350 0x55cc7fddc9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:43.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.121+0000 7f01c37fe640 10 client.16893 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:43:43.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.120+0000 7f01e37fe640 1 --2- 172.21.15.7:0/2724123900 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55cc7f9aa350 0x55cc7fddc9d0 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=102fca21a23fe470 server_cookie=6d5d7aaf72cefda8 in_seq=0 out_seq=0 2024-09-21T06:43:43.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.122+0000 7f01c37fe640 1 -- 172.21.15.7:0/2724123900 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55cc7fcc5860 con 0x55cc7f9aa350 2024-09-21T06:43:43.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.122+0000 7f01c37fe640 10 client.16893 handle_command_reply: tid=0 2024-09-21T06:43:43.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.122+0000 7f01f0e9d740 1 client.16893 shutdown 2024-09-21T06:43:43.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.122+0000 7f01f0e9d740 1 -- 172.21.15.7:0/2724123900 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc7f968cd0 msgr2=0x55cc7fd70a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:43.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.122+0000 7f01f0e9d740 1 --2- 172.21.15.7:0/2724123900 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc7f968cd0 0x55cc7fd70a80 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f01d40309d0 tx=0x7f01d400bd40 comp rx=0 tx=0).stop 2024-09-21T06:43:43.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.123+0000 7f01f0e9d740 1 -- 172.21.15.7:0/2724123900 shutdown_connections 2024-09-21T06:43:43.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.123+0000 7f01f0e9d740 1 --2- 172.21.15.7:0/2724123900 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55cc7f9aa350 0x55cc7fddc9d0 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:43.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.123+0000 7f01f0e9d740 1 --2- 172.21.15.7:0/2724123900 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc7f989670 0x55cc7fdd28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:43.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.123+0000 7f01c37fe640 0 client.16893 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:43:43.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.123+0000 7f01f0e9d740 1 --2- 172.21.15.7:0/2724123900 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc7f981490 0x55cc7fd71040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:43.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.123+0000 7f01f0e9d740 1 --2- 172.21.15.7:0/2724123900 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc7f968cd0 0x55cc7fd70a80 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:43.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.123+0000 7f01f0e9d740 1 -- 172.21.15.7:0/2724123900 >> 172.21.15.7:0/2724123900 conn(0x55cc7f99e740 msgr2=0x55cc7fd5d050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:43.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.123+0000 7f01f0e9d740 1 -- 172.21.15.7:0/2724123900 shutdown_connections 2024-09-21T06:43:43.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.123+0000 7f01f0e9d740 1 -- 172.21.15.7:0/2724123900 wait complete. 2024-09-21T06:43:43.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.123+0000 7f01f0e9d740 20 client.16893 trim_cache size 0 max 16384 2024-09-21T06:43:43.129 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:43:43.129 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0, 2024-09-21T06:43:43.129 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_tag": "3c5b7f3f-e9b3-4d48-8154-2d7d4700992e", 2024-09-21T06:43:43.129 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": "asynchronous" 2024-09-21T06:43:43.129 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:43:43.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.123+0000 7f01ea929640 1 -- 172.21.15.7:0/63981301 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f01cc0b6700 msgr2=0x7f01cc0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:43.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.123+0000 7f01ea929640 1 --2- 172.21.15.7:0/63981301 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f01cc0b6700 0x7f01cc0b8c10 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f01d4005fd0 tx=0x7f01d4005c50 comp rx=0 tx=0).stop 2024-09-21T06:43:43.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.123+0000 7f01ea929640 1 -- 172.21.15.7:0/63981301 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01e4108d10 msgr2=0x7f01e419eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:43.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.123+0000 7f01ea929640 1 --2- 172.21.15.7:0/63981301 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01e4108d10 0x7f01e419eb90 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f01dc00eaa0 tx=0x7f01dc00ef60 comp rx=0 tx=0).stop 2024-09-21T06:43:43.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.124+0000 7f01ea929640 1 -- 172.21.15.7:0/63981301 shutdown_connections 2024-09-21T06:43:43.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.124+0000 7f01ea929640 1 --2- 172.21.15.7:0/63981301 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f01cc0b6700 0x7f01cc0b8c10 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:43.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.124+0000 7f01ea929640 1 --2- 172.21.15.7:0/63981301 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f01e4108d10 0x7f01e419eb90 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:43.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.124+0000 7f01ea929640 1 --2- 172.21.15.7:0/63981301 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f01e41083c0 0x7f01e41998f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:43.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.124+0000 7f01ea929640 1 --2- 172.21.15.7:0/63981301 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f01e4102a80 0x7f01e4199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:43.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.124+0000 7f01ea929640 1 -- 172.21.15.7:0/63981301 >> 172.21.15.7:0/63981301 conn(0x7f01e4079740 msgr2=0x7f01e4104480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:43.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.124+0000 7f01ea929640 1 -- 172.21.15.7:0/63981301 shutdown_connections 2024-09-21T06:43:43.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:43.124+0000 7f01ea929640 1 -- 172.21.15.7:0/63981301 wait complete. 2024-09-21T06:43:43.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:43:42 smithi144 ceph-mon[34653]: pgmap v546: 97 pgs: 97 active+clean; 3.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:43:43.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:43:42 smithi018 ceph-mon[34477]: pgmap v546: 97 pgs: 97 active+clean; 3.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:43:43.835 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:43:44.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:43:43 smithi007 ceph-mon[30983]: scrub queued for path: / 2024-09-21T06:43:44.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:43:43 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T06:43:44.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:43:43 smithi007 ceph-mon[30983]: scrub summary: active paths [/] 2024-09-21T06:43:44.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:43:43 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T06:43:44.104 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:43:44.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:43:43 smithi144 ceph-mon[34653]: scrub queued for path: / 2024-09-21T06:43:44.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:43:43 smithi144 ceph-mon[34653]: scrub summary: idle+waiting paths [/] 2024-09-21T06:43:44.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:43:43 smithi144 ceph-mon[34653]: scrub summary: active paths [/] 2024-09-21T06:43:44.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:43:43 smithi144 ceph-mon[34653]: scrub summary: idle+waiting paths [/] 2024-09-21T06:43:44.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:43:43 smithi018 ceph-mon[34477]: scrub queued for path: / 2024-09-21T06:43:44.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:43:43 smithi018 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-21T06:43:44.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:43:43 smithi018 ceph-mon[34477]: scrub summary: active paths [/] 2024-09-21T06:43:44.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:43:43 smithi018 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-21T06:43:44.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.679+0000 7fb9dfed4640 1 -- 172.21.15.7:0/1458824702 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb9d8108cf0 msgr2=0x7fb9d810f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:44.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.679+0000 7fb9dfed4640 1 --2- 172.21.15.7:0/1458824702 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb9d8108cf0 0x7fb9d810f520 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fb9d0009ca0 tx=0x7fb9d002a8e0 comp rx=0 tx=0).stop 2024-09-21T06:43:44.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.679+0000 7fb9dfed4640 1 -- 172.21.15.7:0/1458824702 shutdown_connections 2024-09-21T06:43:44.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.679+0000 7fb9dfed4640 1 --2- 172.21.15.7:0/1458824702 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb9d8108cf0 0x7fb9d810f520 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:44.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.679+0000 7fb9dfed4640 1 --2- 172.21.15.7:0/1458824702 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9d81083a0 0x7fb9d81087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:44.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.679+0000 7fb9dfed4640 1 --2- 172.21.15.7:0/1458824702 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9d8102a60 0x7fb9d8102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:44.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.679+0000 7fb9dfed4640 1 -- 172.21.15.7:0/1458824702 >> 172.21.15.7:0/1458824702 conn(0x7fb9d8079730 msgr2=0x7fb9d8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:44.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.679+0000 7fb9dfed4640 1 -- 172.21.15.7:0/1458824702 shutdown_connections 2024-09-21T06:43:44.681 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.679+0000 7fb9dfed4640 1 -- 172.21.15.7:0/1458824702 wait complete. 2024-09-21T06:43:44.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.679+0000 7fb9dfed4640 1 Processor -- start 2024-09-21T06:43:44.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.680+0000 7fb9dfed4640 1 -- start start 2024-09-21T06:43:44.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.680+0000 7fb9dfed4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb9d8102a60 0x7fb9d819a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:44.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.680+0000 7fb9dfed4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9d81083a0 0x7fb9d819aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:44.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.680+0000 7fb9dfed4640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9d8108cf0 0x7fb9d819fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:44.683 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.680+0000 7fb9dfed4640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb9d81129e0 con 0x7fb9d8102a60 2024-09-21T06:43:44.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.680+0000 7fb9dfed4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb9d8112860 con 0x7fb9d81083a0 2024-09-21T06:43:44.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.680+0000 7fb9dfed4640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb9d8112b60 con 0x7fb9d8108cf0 2024-09-21T06:43:44.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.680+0000 7fb9ddc70640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb9d8102a60 0x7fb9d819a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:44.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.680+0000 7fb9ddc70640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb9d8102a60 0x7fb9d819a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56626/0 (socket says 172.21.15.7:56626) 2024-09-21T06:43:44.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.680+0000 7fb9ddc70640 1 -- 172.21.15.7:0/3536268851 learned_addr learned my addr 172.21.15.7:0/3536268851 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:43:44.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.680+0000 7fb9dd46f640 1 --2- 172.21.15.7:0/3536268851 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9d81083a0 0x7fb9d819aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:44.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.680+0000 7fb9de471640 1 --2- 172.21.15.7:0/3536268851 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9d8108cf0 0x7fb9d819fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:44.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.680+0000 7fb9ddc70640 1 -- 172.21.15.7:0/3536268851 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9d8108cf0 msgr2=0x7fb9d819fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:44.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.680+0000 7fb9ddc70640 1 --2- 172.21.15.7:0/3536268851 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9d8108cf0 0x7fb9d819fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:44.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.680+0000 7fb9ddc70640 1 -- 172.21.15.7:0/3536268851 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9d81083a0 msgr2=0x7fb9d819aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:44.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.680+0000 7fb9ddc70640 1 --2- 172.21.15.7:0/3536268851 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9d81083a0 0x7fb9d819aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:44.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.680+0000 7fb9ddc70640 1 -- 172.21.15.7:0/3536268851 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9d81a0430 con 0x7fb9d8102a60 2024-09-21T06:43:44.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.680+0000 7fb9dd46f640 1 --2- 172.21.15.7:0/3536268851 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9d81083a0 0x7fb9d819aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:43:44.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.680+0000 7fb9de471640 1 --2- 172.21.15.7:0/3536268851 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9d8108cf0 0x7fb9d819fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:43:44.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.681+0000 7fb9ddc70640 1 --2- 172.21.15.7:0/3536268851 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb9d8102a60 0x7fb9d819a4c0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fb9d400b450 tx=0x7fb9d400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:44.684 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.681+0000 7fb9ceffd640 1 -- 172.21.15.7:0/3536268851 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d4015020 con 0x7fb9d8102a60 2024-09-21T06:43:44.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.681+0000 7fb9ceffd640 1 -- 172.21.15.7:0/3536268851 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb9d4011d40 con 0x7fb9d8102a60 2024-09-21T06:43:44.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.681+0000 7fb9ceffd640 1 -- 172.21.15.7:0/3536268851 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d400f340 con 0x7fb9d8102a60 2024-09-21T06:43:44.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.681+0000 7fb9dfed4640 1 -- 172.21.15.7:0/3536268851 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9d81a0720 con 0x7fb9d8102a60 2024-09-21T06:43:44.685 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.681+0000 7fb9dfed4640 1 -- 172.21.15.7:0/3536268851 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9d81a6e80 con 0x7fb9d8102a60 2024-09-21T06:43:44.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.684+0000 7fb9e6448740 1 Processor -- start 2024-09-21T06:43:44.686 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.684+0000 7fb9e6448740 1 -- start start 2024-09-21T06:43:44.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.685+0000 7fb9e6448740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a786853070 0x55a786bfa270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:44.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.685+0000 7fb9e6448740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a78682a1b0 0x55a786bfa7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:44.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.685+0000 7fb9e6448740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a786832390 0x55a786bfacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:44.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.685+0000 7fb9e6448740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55a786b70e50 con 0x55a78682a1b0 2024-09-21T06:43:44.687 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.685+0000 7fb9e6448740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a786b60280 con 0x55a786853070 2024-09-21T06:43:44.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.685+0000 7fb9e6448740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55a786b64090 con 0x55a786832390 2024-09-21T06:43:44.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.685+0000 7fb9ceffd640 1 -- 172.21.15.7:0/3536268851 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7fb9d4018020 con 0x7fb9d8102a60 2024-09-21T06:43:44.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.685+0000 7fb9ddc70640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a78682a1b0 0x55a786bfa7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:44.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.685+0000 7fb9ddc70640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a78682a1b0 0x55a786bfa7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56634/0 (socket says 172.21.15.7:56634) 2024-09-21T06:43:44.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.685+0000 7fb9ddc70640 1 -- 172.21.15.7:0/928279910 learned_addr learned my addr 172.21.15.7:0/928279910 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:43:44.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.685+0000 7fb9dd46f640 1 --2- 172.21.15.7:0/928279910 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a786832390 0x55a786bfacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:44.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.685+0000 7fb9de471640 1 --2- 172.21.15.7:0/928279910 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a786853070 0x55a786bfa270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:44.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.685+0000 7fb9ddc70640 1 -- 172.21.15.7:0/928279910 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a786832390 msgr2=0x55a786bfacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:44.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.685+0000 7fb9ddc70640 1 --2- 172.21.15.7:0/928279910 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a786832390 0x55a786bfacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:44.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.685+0000 7fb9ddc70640 1 -- 172.21.15.7:0/928279910 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a786853070 msgr2=0x55a786bfa270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:44.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.685+0000 7fb9ddc70640 1 --2- 172.21.15.7:0/928279910 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a786853070 0x55a786bfa270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:44.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.685+0000 7fb9ddc70640 1 -- 172.21.15.7:0/928279910 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7868be650 con 0x55a78682a1b0 2024-09-21T06:43:44.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.686+0000 7fb9ddc70640 1 --2- 172.21.15.7:0/928279910 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a78682a1b0 0x55a786bfa7b0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fb9d40e4890 tx=0x7fb9d40ef850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6097e099a3d72432 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:44.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.686+0000 7fb9c3fff640 1 -- 172.21.15.7:0/928279910 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d40fa070 con 0x55a78682a1b0 2024-09-21T06:43:44.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.686+0000 7fb9ceffd640 1 --2- 172.21.15.7:0/3536268851 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fb9c40b6700 0x7fb9c40b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:44.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.686+0000 7fb9c3fff640 1 -- 172.21.15.7:0/928279910 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb9d40e7ac0 con 0x55a78682a1b0 2024-09-21T06:43:44.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.686+0000 7fb9c3fff640 1 -- 172.21.15.7:0/928279910 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d40f59e0 con 0x55a78682a1b0 2024-09-21T06:43:44.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.686+0000 7fb9de471640 1 --2- 172.21.15.7:0/3536268851 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fb9c40b6700 0x7fb9c40b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:44.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.686+0000 7fb9ceffd640 1 -- 172.21.15.7:0/3536268851 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8412+0+0 (secure 0 0 0) 0x7fb9d40e7160 con 0x7fb9d8102a60 2024-09-21T06:43:44.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.687+0000 7fb9e6448740 1 -- 172.21.15.7:0/928279910 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a78682a1b0 msgr2=0x55a786bfa7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:44.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.687+0000 7fb9de471640 1 --2- 172.21.15.7:0/3536268851 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fb9c40b6700 0x7fb9c40b8c10 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb9d00094e0 tx=0x7fb9d0005d80 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:44.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.687+0000 7fb9e6448740 1 --2- 172.21.15.7:0/928279910 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a78682a1b0 0x55a786bfa7b0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fb9d40e4890 tx=0x7fb9d40ef850 comp rx=0 tx=0).stop 2024-09-21T06:43:44.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.687+0000 7fb9e6448740 1 -- 172.21.15.7:0/928279910 shutdown_connections 2024-09-21T06:43:44.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.687+0000 7fb9e6448740 1 --2- 172.21.15.7:0/928279910 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a786832390 0x55a786bfacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:44.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.687+0000 7fb9e6448740 1 --2- 172.21.15.7:0/928279910 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a78682a1b0 0x55a786bfa7b0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:44.690 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.687+0000 7fb9e6448740 1 --2- 172.21.15.7:0/928279910 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a786853070 0x55a786bfa270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:44.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.687+0000 7fb9e6448740 1 -- 172.21.15.7:0/928279910 >> 172.21.15.7:0/928279910 conn(0x55a786847460 msgr2=0x55a786bf8160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:44.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.687+0000 7fb9e6448740 1 -- 172.21.15.7:0/928279910 shutdown_connections 2024-09-21T06:43:44.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.687+0000 7fb9e6448740 1 -- 172.21.15.7:0/928279910 wait complete. 2024-09-21T06:43:44.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.688+0000 7fb9e6448740 1 -- start start 2024-09-21T06:43:44.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.688+0000 7fb9e6448740 1 Processor -- start 2024-09-21T06:43:44.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.688+0000 7fb9e6448740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a78682a1b0 0x55a786c05990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:44.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.688+0000 7fb9e6448740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a786832390 0x55a786c05ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:44.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.688+0000 7fb9e6448740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a786853070 0x55a786c11d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:44.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.688+0000 7fb9e6448740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55a7869c1700 con 0x55a786853070 2024-09-21T06:43:44.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.688+0000 7fb9e6448740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a786afb110 con 0x55a786832390 2024-09-21T06:43:44.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.688+0000 7fb9e6448740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55a786c08a50 con 0x55a78682a1b0 2024-09-21T06:43:44.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.688+0000 7fb9e6448740 10 client.0 _ll_register_callbacks cb 0x55a786b14990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:43:44.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.689+0000 7fb9de471640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a786853070 0x55a786c11d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:44.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.689+0000 7fb9dd46f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a786832390 0x55a786c05ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:44.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.689+0000 7fb9dd46f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a786832390 0x55a786c05ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.7:55216/0 (socket says 172.21.15.7:55216) 2024-09-21T06:43:44.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.689+0000 7fb9de471640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a786853070 0x55a786c11d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56644/0 (socket says 172.21.15.7:56644) 2024-09-21T06:43:44.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.689+0000 7fb9dd46f640 1 -- 172.21.15.7:0/3612665671 learned_addr learned my addr 172.21.15.7:0/3612665671 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:43:44.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.689+0000 7fb9dd46f640 1 -- 172.21.15.7:0/3612665671 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a78682a1b0 msgr2=0x55a786c05990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:44.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.689+0000 7fb9dd46f640 1 --2- 172.21.15.7:0/3612665671 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a78682a1b0 0x55a786c05990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:44.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.689+0000 7fb9dd46f640 1 -- 172.21.15.7:0/3612665671 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a786853070 msgr2=0x55a786c11d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:44.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.689+0000 7fb9dd46f640 1 --2- 172.21.15.7:0/3612665671 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a786853070 0x55a786c11d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:44.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.689+0000 7fb9dd46f640 1 -- 172.21.15.7:0/3612665671 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a786b28c40 con 0x55a786832390 2024-09-21T06:43:44.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.689+0000 7fb9dd46f640 1 --2- 172.21.15.7:0/3612665671 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a786832390 0x55a786c05ed0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb9c800bf70 tx=0x7fb9c80128e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d97d1e5264b26aed server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:44.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.689+0000 7fb9c17fa640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-21T06:43:44.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.689+0000 7fb9c17fa640 1 -- 172.21.15.7:0/3612665671 <== mon.2 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c80035f0 con 0x55a786832390 2024-09-21T06:43:44.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.689+0000 7fb9c17fa640 1 -- 172.21.15.7:0/3612665671 <== mon.2 v2:172.21.15.18:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8412+0+0 (secure 0 0 0) 0x7fb9c8003790 con 0x55a786832390 2024-09-21T06:43:44.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.689+0000 7fb9e6448740 1 -- 172.21.15.7:0/3612665671 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb9d40e7ac0 con 0x55a786832390 2024-09-21T06:43:44.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.690+0000 7fb9c17fa640 1 -- 172.21.15.7:0/3612665671 <== mon.2 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb9c8003990 con 0x55a786832390 2024-09-21T06:43:44.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.690+0000 7fb9e6448740 10 client.26513 fetch_fsmap learned FSMap version 25 2024-09-21T06:43:44.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.690+0000 7fb9e6448740 1 -- 172.21.15.7:0/3612665671 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a786c147f0 con 0x55a786832390 2024-09-21T06:43:44.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.690+0000 7fb9c17fa640 1 -- 172.21.15.7:0/3612665671 <== mon.2 v2:172.21.15.18:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb9d40e7ac0 con 0x55a786832390 2024-09-21T06:43:44.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.690+0000 7fb9c17fa640 1 -- 172.21.15.7:0/3612665671 <== mon.2 v2:172.21.15.18:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb9c8019070 con 0x55a786832390 2024-09-21T06:43:44.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.690+0000 7fb9e6448740 10 client.26513 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:43:44.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.690+0000 7fb9e6448740 10 client.26513 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:43:44.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.690+0000 7fb9e6448740 20 client.26513 populate_metadata read hostname 'smithi007' 2024-09-21T06:43:44.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.690+0000 7fb9e6448740 1 --2- 172.21.15.7:0/3612665671 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55a7868119f0 0x55a786c17e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:44.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.690+0000 7fb9e6448740 4 client.26513 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:43:44.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.690+0000 7fb9e6448740 1 -- 172.21.15.7:0/3612665671 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a786b72da0 con 0x55a7868119f0 2024-09-21T06:43:44.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.691+0000 7fb9ddc70640 1 --2- 172.21.15.7:0/3612665671 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55a7868119f0 0x55a786c17e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:44.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.691+0000 7fb9c17fa640 10 client.26513 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:43:44.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.691+0000 7fb9ddc70640 1 --2- 172.21.15.7:0/3612665671 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55a7868119f0 0x55a786c17e90 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c426b83e037c559d server_cookie=8a8da43807fc79da in_seq=0 out_seq=0 2024-09-21T06:43:44.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.692+0000 7fb9c17fa640 1 -- 172.21.15.7:0/3612665671 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a786b72da0 con 0x55a7868119f0 2024-09-21T06:43:44.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.692+0000 7fb9c17fa640 10 client.26513 handle_command_reply: tid=0 2024-09-21T06:43:44.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.692+0000 7fb9e6448740 1 client.26513 shutdown 2024-09-21T06:43:44.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.692+0000 7fb9e6448740 1 -- 172.21.15.7:0/3612665671 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a786832390 msgr2=0x55a786c05ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:44.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.692+0000 7fb9e6448740 1 --2- 172.21.15.7:0/3612665671 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a786832390 0x55a786c05ed0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb9c800bf70 tx=0x7fb9c80128e0 comp rx=0 tx=0).stop 2024-09-21T06:43:44.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.692+0000 7fb9e6448740 1 -- 172.21.15.7:0/3612665671 shutdown_connections 2024-09-21T06:43:44.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.692+0000 7fb9e6448740 1 --2- 172.21.15.7:0/3612665671 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55a7868119f0 0x55a786c17e90 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:44.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.692+0000 7fb9e6448740 1 --2- 172.21.15.7:0/3612665671 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a786853070 0x55a786c11d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:44.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.692+0000 7fb9e6448740 1 --2- 172.21.15.7:0/3612665671 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a786832390 0x55a786c05ed0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:44.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.692+0000 7fb9e6448740 1 --2- 172.21.15.7:0/3612665671 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a78682a1b0 0x55a786c05990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:44.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.692+0000 7fb9c17fa640 0 client.26513 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:43:44.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.692+0000 7fb9e6448740 1 -- 172.21.15.7:0/3612665671 >> 172.21.15.7:0/3612665671 conn(0x55a786847460 msgr2=0x55a786bfb2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:44.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.692+0000 7fb9e6448740 1 -- 172.21.15.7:0/3612665671 shutdown_connections 2024-09-21T06:43:44.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.692+0000 7fb9e6448740 1 -- 172.21.15.7:0/3612665671 wait complete. 2024-09-21T06:43:44.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.692+0000 7fb9e6448740 20 client.26513 trim_cache size 0 max 16384 2024-09-21T06:43:44.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.710+0000 7fb9e6448740 1 Processor -- start 2024-09-21T06:43:44.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.710+0000 7fb9e6448740 1 -- start start 2024-09-21T06:43:44.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.710+0000 7fb9e6448740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a78682a1b0 0x55a786c05740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:44.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.710+0000 7fb9e6448740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a786832390 0x55a786c05c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:44.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.710+0000 7fb9e6448740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a786853070 0x55a786c02b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:44.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.710+0000 7fb9e6448740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb9d81b1f00 con 0x55a78682a1b0 2024-09-21T06:43:44.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.710+0000 7fb9e6448740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb9d81af7d0 con 0x55a786832390 2024-09-21T06:43:44.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.710+0000 7fb9e6448740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb9d81ad640 con 0x55a786853070 2024-09-21T06:43:44.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.710+0000 7fb9ddc70640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a78682a1b0 0x55a786c05740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:44.712 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.710+0000 7fb9ddc70640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a78682a1b0 0x55a786c05740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56650/0 (socket says 172.21.15.7:56650) 2024-09-21T06:43:44.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.710+0000 7fb9dd46f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a786832390 0x55a786c05c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:44.713 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.710+0000 7fb9ddc70640 1 -- 172.21.15.7:0/1734480170 learned_addr learned my addr 172.21.15.7:0/1734480170 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:43:44.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.711+0000 7fb9dd46f640 1 -- 172.21.15.7:0/1734480170 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a786853070 msgr2=0x55a786c02b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:44.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.711+0000 7fb9dd46f640 1 --2- 172.21.15.7:0/1734480170 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a786853070 0x55a786c02b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:44.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.711+0000 7fb9dd46f640 1 -- 172.21.15.7:0/1734480170 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a78682a1b0 msgr2=0x55a786c05740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:44.714 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.711+0000 7fb9dd46f640 1 --2- 172.21.15.7:0/1734480170 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a78682a1b0 0x55a786c05740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:44.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.711+0000 7fb9dd46f640 1 -- 172.21.15.7:0/1734480170 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a786c03e90 con 0x55a786832390 2024-09-21T06:43:44.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.711+0000 7fb9ddc70640 1 --2- 172.21.15.7:0/1734480170 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a78682a1b0 0x55a786c05740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:43:44.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.711+0000 7fb9dd46f640 1 --2- 172.21.15.7:0/1734480170 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a786832390 0x55a786c05c80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb9c8010e60 tx=0x7fb9c8004380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad423b9479a4f556 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:44.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.711+0000 7fb9c37fe640 1 -- 172.21.15.7:0/1734480170 <== mon.2 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c8028070 con 0x55a786832390 2024-09-21T06:43:44.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.711+0000 7fb9c37fe640 1 -- 172.21.15.7:0/1734480170 <== mon.2 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb9c801b490 con 0x55a786832390 2024-09-21T06:43:44.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.711+0000 7fb9c37fe640 1 -- 172.21.15.7:0/1734480170 <== mon.2 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c801b860 con 0x55a786832390 2024-09-21T06:43:44.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.712+0000 7fb9e6448740 1 -- 172.21.15.7:0/1734480170 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a786832390 msgr2=0x55a786c05c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:44.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.712+0000 7fb9e6448740 1 --2- 172.21.15.7:0/1734480170 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a786832390 0x55a786c05c80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb9c8010e60 tx=0x7fb9c8004380 comp rx=0 tx=0).stop 2024-09-21T06:43:44.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.712+0000 7fb9e6448740 1 -- 172.21.15.7:0/1734480170 shutdown_connections 2024-09-21T06:43:44.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.712+0000 7fb9e6448740 1 --2- 172.21.15.7:0/1734480170 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a786853070 0x55a786c02b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:44.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.712+0000 7fb9e6448740 1 --2- 172.21.15.7:0/1734480170 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a786832390 0x55a786c05c80 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:44.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.712+0000 7fb9e6448740 1 --2- 172.21.15.7:0/1734480170 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a78682a1b0 0x55a786c05740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:44.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.712+0000 7fb9e6448740 1 -- 172.21.15.7:0/1734480170 >> 172.21.15.7:0/1734480170 conn(0x55a786847460 msgr2=0x55a786c04210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:44.715 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.712+0000 7fb9e6448740 1 -- 172.21.15.7:0/1734480170 shutdown_connections 2024-09-21T06:43:44.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.712+0000 7fb9e6448740 1 -- 172.21.15.7:0/1734480170 wait complete. 2024-09-21T06:43:44.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.712+0000 7fb9e6448740 1 -- start start 2024-09-21T06:43:44.716 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.713+0000 7fb9e6448740 1 Processor -- start 2024-09-21T06:43:44.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.713+0000 7fb9e6448740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a78682a1b0 0x55a786c09c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:44.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.713+0000 7fb9e6448740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a786832390 0x55a786c0a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:44.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.713+0000 7fb9e6448740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a786853070 0x55a786c0a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:44.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.713+0000 7fb9e6448740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb9d81adc90 con 0x55a786832390 2024-09-21T06:43:44.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.713+0000 7fb9e6448740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb9d81af100 con 0x55a78682a1b0 2024-09-21T06:43:44.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.713+0000 7fb9e6448740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb9d81ae360 con 0x55a786853070 2024-09-21T06:43:44.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.713+0000 7fb9e6448740 10 client.0 _ll_register_callbacks cb 0x7fb9c800b8e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:43:44.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.713+0000 7fb9dd46f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a786832390 0x55a786c0a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:44.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.713+0000 7fb9ddc70640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a78682a1b0 0x55a786c09c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:44.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.713+0000 7fb9ddc70640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a78682a1b0 0x55a786c09c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.7:55234/0 (socket says 172.21.15.7:55234) 2024-09-21T06:43:44.719 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.713+0000 7fb9ddc70640 1 -- 172.21.15.7:0/2919860885 learned_addr learned my addr 172.21.15.7:0/2919860885 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:43:44.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.713+0000 7fb9de471640 1 --2- 172.21.15.7:0/2919860885 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a786853070 0x55a786c0a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:44.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.714+0000 7fb9dd46f640 1 -- 172.21.15.7:0/2919860885 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a786853070 msgr2=0x55a786c0a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:44.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.714+0000 7fb9dd46f640 1 --2- 172.21.15.7:0/2919860885 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a786853070 0x55a786c0a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:44.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.714+0000 7fb9dd46f640 1 -- 172.21.15.7:0/2919860885 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a78682a1b0 msgr2=0x55a786c09c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:44.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.714+0000 7fb9dd46f640 1 --2- 172.21.15.7:0/2919860885 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a78682a1b0 0x55a786c09c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:44.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.714+0000 7fb9dd46f640 1 -- 172.21.15.7:0/2919860885 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a786c81850 con 0x55a786832390 2024-09-21T06:43:44.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.714+0000 7fb9ddc70640 1 --2- 172.21.15.7:0/2919860885 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a78682a1b0 0x55a786c09c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:43:44.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.714+0000 7fb9dd46f640 1 --2- 172.21.15.7:0/2919860885 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a786832390 0x55a786c0a170 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fb9c800bc90 tx=0x7fb9c8005600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc013066741f3f2a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:44.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.714+0000 7fb9c17fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:43:44.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.714+0000 7fb9c17fa640 1 -- 172.21.15.7:0/2919860885 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c8028040 con 0x55a786832390 2024-09-21T06:43:44.720 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.714+0000 7fb9e6448740 1 -- 172.21.15.7:0/2919860885 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb9c801b490 con 0x55a786832390 2024-09-21T06:43:44.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.714+0000 7fb9c17fa640 1 -- 172.21.15.7:0/2919860885 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8412+0+0 (secure 0 0 0) 0x7fb9c8010490 con 0x55a786832390 2024-09-21T06:43:44.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.714+0000 7fb9c17fa640 1 -- 172.21.15.7:0/2919860885 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb9c8010690 con 0x55a786832390 2024-09-21T06:43:44.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.714+0000 7fb9e6448740 10 client.16911 fetch_fsmap learned FSMap version 25 2024-09-21T06:43:44.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.714+0000 7fb9e6448740 1 -- 172.21.15.7:0/2919860885 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a786c82a70 con 0x55a786832390 2024-09-21T06:43:44.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.714+0000 7fb9c17fa640 1 -- 172.21.15.7:0/2919860885 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb9c801b490 con 0x55a786832390 2024-09-21T06:43:44.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.715+0000 7fb9c17fa640 1 -- 172.21.15.7:0/2919860885 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb9c8019070 con 0x55a786832390 2024-09-21T06:43:44.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.715+0000 7fb9e6448740 10 client.16911 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:43:44.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.715+0000 7fb9e6448740 10 client.16911 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:43:44.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.715+0000 7fb9e6448740 20 client.16911 populate_metadata read hostname 'smithi007' 2024-09-21T06:43:44.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.715+0000 7fb9e6448740 1 --2- 172.21.15.7:0/2919860885 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55a7867e6da0 0x55a786c85170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:44.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.715+0000 7fb9e6448740 4 client.16911 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:43:44.721 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.715+0000 7fb9e6448740 1 -- 172.21.15.7:0/2919860885 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a786b6e850 con 0x55a7867e6da0 2024-09-21T06:43:44.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.715+0000 7fb9ddc70640 1 --2- 172.21.15.7:0/2919860885 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55a7867e6da0 0x55a786c85170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:44.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.715+0000 7fb9c17fa640 10 client.16911 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:43:44.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.715+0000 7fb9ddc70640 1 --2- 172.21.15.7:0/2919860885 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55a7867e6da0 0x55a786c85170 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60ce3442805ace44 server_cookie=bba1bd318093d276 in_seq=0 out_seq=0 2024-09-21T06:43:44.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.716+0000 7fb9c17fa640 1 -- 172.21.15.7:0/2919860885 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3498 (crc 0 0 0) 0x55a786b6e850 con 0x55a7867e6da0 2024-09-21T06:43:44.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.716+0000 7fb9c17fa640 10 client.16911 handle_command_reply: tid=0 2024-09-21T06:43:44.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.716+0000 7fb9e6448740 1 client.16911 shutdown 2024-09-21T06:43:44.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.716+0000 7fb9e6448740 1 -- 172.21.15.7:0/2919860885 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a786832390 msgr2=0x55a786c0a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:44.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.716+0000 7fb9e6448740 1 --2- 172.21.15.7:0/2919860885 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a786832390 0x55a786c0a170 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fb9c800bc90 tx=0x7fb9c8005600 comp rx=0 tx=0).stop 2024-09-21T06:43:44.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.716+0000 7fb9e6448740 1 -- 172.21.15.7:0/2919860885 shutdown_connections 2024-09-21T06:43:44.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.716+0000 7fb9e6448740 1 --2- 172.21.15.7:0/2919860885 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55a7867e6da0 0x55a786c85170 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:44.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.716+0000 7fb9e6448740 1 --2- 172.21.15.7:0/2919860885 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a786853070 0x55a786c0a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:44.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.716+0000 7fb9e6448740 1 --2- 172.21.15.7:0/2919860885 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a786832390 0x55a786c0a170 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:44.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.716+0000 7fb9e6448740 1 --2- 172.21.15.7:0/2919860885 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a78682a1b0 0x55a786c09c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:44.722 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.716+0000 7fb9c17fa640 0 client.16911 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:43:44.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.716+0000 7fb9e6448740 1 -- 172.21.15.7:0/2919860885 >> 172.21.15.7:0/2919860885 conn(0x55a786847460 msgr2=0x55a786c05740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:44.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.716+0000 7fb9e6448740 1 -- 172.21.15.7:0/2919860885 shutdown_connections 2024-09-21T06:43:44.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.716+0000 7fb9e6448740 1 -- 172.21.15.7:0/2919860885 wait complete. 2024-09-21T06:43:44.723 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.716+0000 7fb9e6448740 20 client.16911 trim_cache size 0 max 16384 2024-09-21T06:43:44.723 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:43:44.723 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "no active scrubs running", 2024-09-21T06:43:44.723 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": {}, 2024-09-21T06:43:44.723 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_stats": { 2024-09-21T06:43:44.723 INFO:teuthology.orchestra.run.smithi007.stdout: "3c5b7f3f-e9b3-4d48-8154-2d7d4700992e": { 2024-09-21T06:43:44.723 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:43:43.120930+0000", 2024-09-21T06:43:44.723 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:43:44.723 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:43:44.724 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:43:44.724 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:43:44.724 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:43:44.724 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:43:44.724 INFO:teuthology.orchestra.run.smithi007.stdout: "ef9eaabd-003a-44fb-8373-c854a9e15a71": { 2024-09-21T06:43:44.724 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:42:19.467946+0000", 2024-09-21T06:43:44.724 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:43:44.724 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:43:44.724 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:43:44.724 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:43:44.724 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:43:44.724 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:43:44.724 INFO:teuthology.orchestra.run.smithi007.stdout: "b466f071-ab32-427c-a0ed-73edea33145e": { 2024-09-21T06:43:44.724 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:43:01.151440+0000", 2024-09-21T06:43:44.725 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:43:44.725 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:43:44.725 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:43:44.725 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:43:44.725 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:43:44.725 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:43:44.725 INFO:teuthology.orchestra.run.smithi007.stdout: "62fca477-b241-45f5-8185-bc78aeb8b19f": { 2024-09-21T06:43:44.725 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:40:12.744488+0000", 2024-09-21T06:43:44.725 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:43:44.725 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:43:44.725 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:43:44.725 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:43:44.725 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:43:44.725 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:43:44.725 INFO:teuthology.orchestra.run.smithi007.stdout: "a1ae5b3b-f158-44be-8ef4-d70e9ba879cc": { 2024-09-21T06:43:44.725 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:41:37.568453+0000", 2024-09-21T06:43:44.726 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:43:44.726 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:43:44.726 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:43:44.726 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:43:44.726 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:43:44.726 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:43:44.726 INFO:teuthology.orchestra.run.smithi007.stdout: "d7b6a90c-9ae1-4e02-93ad-335a7e9df1d7": { 2024-09-21T06:43:44.726 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:39:19.226139+0000", 2024-09-21T06:43:44.726 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:43:44.726 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:43:44.726 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:43:44.726 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:43:44.726 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:43:44.726 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:43:44.726 INFO:teuthology.orchestra.run.smithi007.stdout: "b0327167-8c41-4286-8afc-7f0780972fd7": { 2024-09-21T06:43:44.727 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:38:36.828657+0000", 2024-09-21T06:43:44.727 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:43:44.727 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:43:44.727 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:43:44.727 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:43:44.727 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:43:44.727 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:43:44.727 INFO:teuthology.orchestra.run.smithi007.stdout: "13441782-2231-4713-8ebd-068a941de47f": { 2024-09-21T06:43:44.727 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:39:30.219006+0000", 2024-09-21T06:43:44.727 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:43:44.727 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:43:44.727 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:43:44.727 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:43:44.727 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:43:44.728 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:43:44.728 INFO:teuthology.orchestra.run.smithi007.stdout: "5cbaaba2-6ab1-4f83-abd6-8c6eef4b5c42": { 2024-09-21T06:43:44.728 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:37:46.566272+0000", 2024-09-21T06:43:44.728 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:43:44.728 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:43:44.728 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:43:44.728 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:43:44.728 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:43:44.728 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:43:44.728 INFO:teuthology.orchestra.run.smithi007.stdout: "6231e9c1-14a2-40b5-be3c-76d87a0d733b": { 2024-09-21T06:43:44.728 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:37:02.484812+0000", 2024-09-21T06:43:44.728 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:43:44.728 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:43:44.728 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:43:44.729 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:43:44.729 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:43:44.729 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:43:44.729 INFO:teuthology.orchestra.run.smithi007.stdout: "310a0ec8-44bb-49ed-a534-3bc91cb1ee9d": { 2024-09-21T06:43:44.729 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:40:55.373968+0000", 2024-09-21T06:43:44.729 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:43:44.729 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:43:44.729 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:43:44.729 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:43:44.729 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:43:44.729 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:43:44.729 INFO:teuthology.orchestra.run.smithi007.stdout: "0b89345c-1f00-4efe-8ee9-4cb17e43584c": { 2024-09-21T06:43:44.729 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:36:19.500334+0000", 2024-09-21T06:43:44.729 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:43:44.729 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:43:44.730 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:43:44.730 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:43:44.730 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:43:44.730 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:43:44.730 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:43:44.730 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:43:44.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.717+0000 7fb9dfed4640 1 -- 172.21.15.7:0/3536268851 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fb9c40b6700 msgr2=0x7fb9c40b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:44.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.717+0000 7fb9dfed4640 1 --2- 172.21.15.7:0/3536268851 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fb9c40b6700 0x7fb9c40b8c10 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb9d00094e0 tx=0x7fb9d0005d80 comp rx=0 tx=0).stop 2024-09-21T06:43:44.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.717+0000 7fb9dfed4640 1 -- 172.21.15.7:0/3536268851 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb9d8102a60 msgr2=0x7fb9d819a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:44.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.717+0000 7fb9dfed4640 1 --2- 172.21.15.7:0/3536268851 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb9d8102a60 0x7fb9d819a4c0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fb9d400b450 tx=0x7fb9d400b910 comp rx=0 tx=0).stop 2024-09-21T06:43:44.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.717+0000 7fb9dfed4640 1 -- 172.21.15.7:0/3536268851 shutdown_connections 2024-09-21T06:43:44.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.717+0000 7fb9dfed4640 1 --2- 172.21.15.7:0/3536268851 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fb9c40b6700 0x7fb9c40b8c10 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:44.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.717+0000 7fb9dfed4640 1 --2- 172.21.15.7:0/3536268851 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb9d8108cf0 0x7fb9d819fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:44.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.717+0000 7fb9dfed4640 1 --2- 172.21.15.7:0/3536268851 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9d81083a0 0x7fb9d819aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:44.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.717+0000 7fb9dfed4640 1 --2- 172.21.15.7:0/3536268851 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb9d8102a60 0x7fb9d819a4c0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:44.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.717+0000 7fb9dfed4640 1 -- 172.21.15.7:0/3536268851 >> 172.21.15.7:0/3536268851 conn(0x7fb9d8079730 msgr2=0x7fb9d806b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:44.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.717+0000 7fb9dfed4640 1 -- 172.21.15.7:0/3536268851 shutdown_connections 2024-09-21T06:43:44.731 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:44.717+0000 7fb9dfed4640 1 -- 172.21.15.7:0/3536268851 wait complete. 2024-09-21T06:43:45.032 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:43:44 smithi007 ceph-mon[30983]: pgmap v547: 97 pgs: 97 active+clean; 3.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:43:45.032 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:43:44 smithi007 ceph-mon[30983]: scrub summary: idle 2024-09-21T06:43:45.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:43:44 smithi144 ceph-mon[34653]: pgmap v547: 97 pgs: 97 active+clean; 3.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:43:45.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:43:44 smithi144 ceph-mon[34653]: scrub summary: idle 2024-09-21T06:43:45.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:43:44 smithi018 ceph-mon[34477]: pgmap v547: 97 pgs: 97 active+clean; 3.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:43:45.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:43:44 smithi018 ceph-mon[34477]: scrub summary: idle 2024-09-21T06:43:45.428 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:43:45.429 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:43:45.687 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:43:46.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:46.177+0000 7f68ebef4640 1 -- 172.21.15.7:0/2363853025 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68e410de10 msgr2=0x7f68e4110300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:46.179 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:46.177+0000 7f68ebef4640 1 --2- 172.21.15.7:0/2363853025 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68e410de10 0x7f68e4110300 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f68dc009ca0 tx=0x7f68dc02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:43:46.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:46.177+0000 7f68ebef4640 1 -- 172.21.15.7:0/2363853025 shutdown_connections 2024-09-21T06:43:46.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:46.177+0000 7f68ebef4640 1 --2- 172.21.15.7:0/2363853025 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68e410de10 0x7f68e4110300 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:46.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:46.177+0000 7f68ebef4640 1 --2- 172.21.15.7:0/2363853025 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68e4105300 0x7f68e410d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:46.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:46.177+0000 7f68ebef4640 1 --2- 172.21.15.7:0/2363853025 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68e41049b0 0x7f68e4104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:46.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:46.177+0000 7f68ebef4640 1 -- 172.21.15.7:0/2363853025 >> 172.21.15.7:0/2363853025 conn(0x7f68e4079730 msgr2=0x7f68e4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:46.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:46.177+0000 7f68ebef4640 1 -- 172.21.15.7:0/2363853025 shutdown_connections 2024-09-21T06:43:46.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:46.177+0000 7f68ebef4640 1 -- 172.21.15.7:0/2363853025 wait complete. 2024-09-21T06:43:46.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:46.178+0000 7f68ebef4640 1 Processor -- start 2024-09-21T06:43:46.180 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:46.178+0000 7f68ebef4640 1 -- start start 2024-09-21T06:43:46.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:46.178+0000 7f68ebef4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68e41049b0 0x7f68e419a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:46.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:46.178+0000 7f68ebef4640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68e4105300 0x7f68e419aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:46.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:46.178+0000 7f68ebef4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68e410de10 0x7f68e419fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:46.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:46.178+0000 7f68ebef4640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f68e4113a90 con 0x7f68e41049b0 2024-09-21T06:43:46.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:46.178+0000 7f68ebef4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f68e4113910 con 0x7f68e410de10 2024-09-21T06:43:46.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:46.178+0000 7f68ebef4640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f68e4113c10 con 0x7f68e4105300 2024-09-21T06:43:46.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:46.178+0000 7f68e9c90640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68e41049b0 0x7f68e419a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:46.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:46.178+0000 7f68e9c90640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68e41049b0 0x7f68e419a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56662/0 (socket says 172.21.15.7:56662) 2024-09-21T06:43:46.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:46.178+0000 7f68e9c90640 1 -- 172.21.15.7:0/140914205 learned_addr learned my addr 172.21.15.7:0/140914205 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:43:46.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:46.178+0000 7f68ea491640 1 --2- 172.21.15.7:0/140914205 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68e410de10 0x7f68e419fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:46.182 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:46.178+0000 7f68e948f640 1 --2- 172.21.15.7:0/140914205 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68e4105300 0x7f68e419aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:46.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:46.179+0000 7f68e9c90640 1 -- 172.21.15.7:0/140914205 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68e4105300 msgr2=0x7f68e419aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:46.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:46.179+0000 7f68e9c90640 1 --2- 172.21.15.7:0/140914205 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68e4105300 0x7f68e419aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:46.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:46.179+0000 7f68e9c90640 1 -- 172.21.15.7:0/140914205 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68e410de10 msgr2=0x7f68e419fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:46.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:46.179+0000 7f68e9c90640 1 --2- 172.21.15.7:0/140914205 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68e410de10 0x7f68e419fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:46.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:46.179+0000 7f68e9c90640 1 -- 172.21.15.7:0/140914205 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68e41a0310 con 0x7f68e41049b0 2024-09-21T06:43:46.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:46.179+0000 7f68e9c90640 1 --2- 172.21.15.7:0/140914205 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68e41049b0 0x7f68e419a460 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f68e000d950 tx=0x7f68e000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:46.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:46.179+0000 7f68daffd640 1 -- 172.21.15.7:0/140914205 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68e0017070 con 0x7f68e41049b0 2024-09-21T06:43:46.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:46.179+0000 7f68ebef4640 1 -- 172.21.15.7:0/140914205 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68e41a0600 con 0x7f68e41049b0 2024-09-21T06:43:46.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:46.179+0000 7f68daffd640 1 -- 172.21.15.7:0/140914205 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f68e0009c30 con 0x7f68e41049b0 2024-09-21T06:43:46.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:46.179+0000 7f68daffd640 1 -- 172.21.15.7:0/140914205 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68e000f620 con 0x7f68e41049b0 2024-09-21T06:43:46.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:46.179+0000 7f68ebef4640 1 -- 172.21.15.7:0/140914205 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68e41025d0 con 0x7f68e41049b0 2024-09-21T06:43:46.183 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:46.180+0000 7f68ebef4640 1 -- 172.21.15.7:0/140914205 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68e406b560 con 0x7f68e41049b0 2024-09-21T06:43:46.184 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:46.183+0000 7f68daffd640 1 -- 172.21.15.7:0/140914205 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f68e001a070 con 0x7f68e41049b0 2024-09-21T06:43:46.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:46.183+0000 7f68daffd640 1 --2- 172.21.15.7:0/140914205 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f68d00b66b0 0x7f68d00b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:46.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:46.184+0000 7f68daffd640 1 -- 172.21.15.7:0/140914205 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8412+0+0 (secure 0 0 0) 0x7f68e00e70b0 con 0x7f68e41049b0 2024-09-21T06:43:46.185 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:46.184+0000 7f68e948f640 1 --2- 172.21.15.7:0/140914205 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f68d00b66b0 0x7f68d00b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:46.186 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:46.184+0000 7f68e948f640 1 --2- 172.21.15.7:0/140914205 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f68d00b66b0 0x7f68d00b8bc0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f68d4005e10 tx=0x7f68d4005da0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:46.188 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:46.187+0000 7f68daffd640 1 -- 172.21.15.7:0/140914205 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f68e00ad670 con 0x7f68e41049b0 2024-09-21T06:43:46.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:46.416+0000 7f68ebef4640 1 -- 172.21.15.7:0/140914205 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f68e4104dc0 con 0x7f68e41049b0 2024-09-21T06:43:46.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:46.417+0000 7f68daffd640 1 -- 172.21.15.7:0/140914205 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11899 (secure 0 0 0) 0x7f68e00b1a50 con 0x7f68e41049b0 2024-09-21T06:43:46.419 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:43:46.419 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-21T06:36:10:753693+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2015971546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2015971546},{"type":"v1","addr":"172.21.15.7:6835","nonce":2015971546}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/2350816224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":2350816224},{"type":"v1","addr":"172.21.15.7:6837","nonce":2350816224}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14823,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/1669980572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":1669980572},{"type":"v1","addr":"172.21.15.7:6839","nonce":1669980572}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14835,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/2528308973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":2528308973},{"type":"v1","addr":"172.21.15.7:6841","nonce":2528308973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24623,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1337382979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1337382979},{"type":"v1","addr":"172.21.15.18:6833","nonce":1337382979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/2751454345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":2751454345},{"type":"v1","addr":"172.21.15.144:6833","nonce":2751454345}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:34:24.627168+0000","modified":"2024-09-21T06:36:10.737288+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24716,"mds_1":24688,"mds_2":24686},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24656":{"gid":24656,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6835/158884796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":158884796},{"type":"v1","addr":"172.21.15.18:6835","nonce":158884796}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6835/3636739922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3636739922},{"type":"v1","addr":"172.21.15.144:6835","nonce":3636739922}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24673":{"gid":24673,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6837/1126341753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":1126341753},{"type":"v1","addr":"172.21.15.144:6837","nonce":1126341753}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.18:6837/1539670694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1539670694},{"type":"v1","addr":"172.21.15.18:6837","nonce":1539670694}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24688":{"gid":24688,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.144:6839/4027821922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":4027821922},{"type":"v1","addr":"172.21.15.144:6839","nonce":4027821922}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24716":{"gid":24716,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.18:6839/3798713532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":3798713532},{"type":"v1","addr":"172.21.15.18:6839","nonce":3798713532}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24716,"qdb_cluster":[24716,24688,24686]},"id":1}]} 2024-09-21T06:43:46.419 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-21T06:43:46.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:46.419+0000 7f68ebef4640 1 -- 172.21.15.7:0/140914205 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f68d00b66b0 msgr2=0x7f68d00b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:46.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:46.419+0000 7f68ebef4640 1 --2- 172.21.15.7:0/140914205 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f68d00b66b0 0x7f68d00b8bc0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f68d4005e10 tx=0x7f68d4005da0 comp rx=0 tx=0).stop 2024-09-21T06:43:46.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:46.419+0000 7f68ebef4640 1 -- 172.21.15.7:0/140914205 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68e41049b0 msgr2=0x7f68e419a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:46.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:46.419+0000 7f68ebef4640 1 --2- 172.21.15.7:0/140914205 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68e41049b0 0x7f68e419a460 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f68e000d950 tx=0x7f68e000de10 comp rx=0 tx=0).stop 2024-09-21T06:43:46.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:46.419+0000 7f68ebef4640 1 -- 172.21.15.7:0/140914205 shutdown_connections 2024-09-21T06:43:46.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:46.419+0000 7f68ebef4640 1 --2- 172.21.15.7:0/140914205 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f68d00b66b0 0x7f68d00b8bc0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:46.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:46.419+0000 7f68ebef4640 1 --2- 172.21.15.7:0/140914205 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68e410de10 0x7f68e419fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:46.421 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:46.419+0000 7f68ebef4640 1 --2- 172.21.15.7:0/140914205 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f68e4105300 0x7f68e419aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:46.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:46.419+0000 7f68ebef4640 1 --2- 172.21.15.7:0/140914205 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f68e41049b0 0x7f68e419a460 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:46.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:46.419+0000 7f68ebef4640 1 -- 172.21.15.7:0/140914205 >> 172.21.15.7:0/140914205 conn(0x7f68e4079730 msgr2=0x7f68e40ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:46.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:46.419+0000 7f68ebef4640 1 -- 172.21.15.7:0/140914205 shutdown_connections 2024-09-21T06:43:46.422 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:46.419+0000 7f68ebef4640 1 -- 172.21.15.7:0/140914205 wait complete. 2024-09-21T06:43:47.094 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:43:46 smithi007 ceph-mon[30983]: pgmap v548: 97 pgs: 97 active+clean; 3.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:43:47.094 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:43:46 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/140914205' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:43:47.127 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:43:47.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:43:46 smithi144 ceph-mon[34653]: pgmap v548: 97 pgs: 97 active+clean; 3.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:43:47.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:43:46 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/140914205' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:43:47.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:43:46 smithi018 ceph-mon[34477]: pgmap v548: 97 pgs: 97 active+clean; 3.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:43:47.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:43:46 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/140914205' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:43:47.389 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:43:47.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.872+0000 7f866180c640 1 -- 172.21.15.7:0/1789107364 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f865c108cf0 msgr2=0x7f865c10f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:47.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.872+0000 7f866180c640 1 --2- 172.21.15.7:0/1789107364 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f865c108cf0 0x7f865c10f520 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f8654009ca0 tx=0x7f865402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:43:47.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.872+0000 7f866180c640 1 -- 172.21.15.7:0/1789107364 shutdown_connections 2024-09-21T06:43:47.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.872+0000 7f866180c640 1 --2- 172.21.15.7:0/1789107364 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f865c108cf0 0x7f865c10f520 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:47.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.872+0000 7f866180c640 1 --2- 172.21.15.7:0/1789107364 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f865c1083a0 0x7f865c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:47.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.872+0000 7f866180c640 1 --2- 172.21.15.7:0/1789107364 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f865c102a60 0x7f865c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:47.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.872+0000 7f866180c640 1 -- 172.21.15.7:0/1789107364 >> 172.21.15.7:0/1789107364 conn(0x7f865c079730 msgr2=0x7f865c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:47.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.872+0000 7f866180c640 1 -- 172.21.15.7:0/1789107364 shutdown_connections 2024-09-21T06:43:47.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.872+0000 7f866180c640 1 -- 172.21.15.7:0/1789107364 wait complete. 2024-09-21T06:43:47.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.873+0000 7f866180c640 1 Processor -- start 2024-09-21T06:43:47.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.873+0000 7f866180c640 1 -- start start 2024-09-21T06:43:47.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.874+0000 7f866180c640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f865c102a60 0x7f865c0ff670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:47.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.874+0000 7f866180c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f865c1083a0 0x7f865c0ffbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:47.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.874+0000 7f866180c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f865c108cf0 0x7f865c1000f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:47.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.874+0000 7f866180c640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f865c112960 con 0x7f865c108cf0 2024-09-21T06:43:47.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.874+0000 7f866180c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f865c1127e0 con 0x7f865c1083a0 2024-09-21T06:43:47.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.874+0000 7f866180c640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f865c112ae0 con 0x7f865c102a60 2024-09-21T06:43:47.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.874+0000 7f865b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f865c108cf0 0x7f865c1000f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:47.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.874+0000 7f865b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f865c108cf0 0x7f865c1000f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56692/0 (socket says 172.21.15.7:56692) 2024-09-21T06:43:47.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.874+0000 7f865b7fe640 1 -- 172.21.15.7:0/3662567612 learned_addr learned my addr 172.21.15.7:0/3662567612 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:43:47.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.874+0000 7f865a7fc640 1 --2- 172.21.15.7:0/3662567612 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f865c1083a0 0x7f865c0ffbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:47.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.874+0000 7f865affd640 1 --2- 172.21.15.7:0/3662567612 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f865c102a60 0x7f865c0ff670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:47.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.874+0000 7f865b7fe640 1 -- 172.21.15.7:0/3662567612 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f865c102a60 msgr2=0x7f865c0ff670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:47.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.874+0000 7f865b7fe640 1 --2- 172.21.15.7:0/3662567612 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f865c102a60 0x7f865c0ff670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:47.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.874+0000 7f865b7fe640 1 -- 172.21.15.7:0/3662567612 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f865c1083a0 msgr2=0x7f865c0ffbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:47.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.874+0000 7f865b7fe640 1 --2- 172.21.15.7:0/3662567612 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f865c1083a0 0x7f865c0ffbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:47.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.874+0000 7f865b7fe640 1 -- 172.21.15.7:0/3662567612 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f865c1a8700 con 0x7f865c108cf0 2024-09-21T06:43:47.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.874+0000 7f865a7fc640 1 --2- 172.21.15.7:0/3662567612 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f865c1083a0 0x7f865c0ffbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:43:47.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.875+0000 7f865b7fe640 1 --2- 172.21.15.7:0/3662567612 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f865c108cf0 0x7f865c1000f0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f86540098d0 tx=0x7f86540317b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:47.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.875+0000 7f866080a640 1 -- 172.21.15.7:0/3662567612 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8654003b70 con 0x7f865c108cf0 2024-09-21T06:43:47.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.875+0000 7f866080a640 1 -- 172.21.15.7:0/3662567612 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8654003d10 con 0x7f865c108cf0 2024-09-21T06:43:47.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.875+0000 7f866080a640 1 -- 172.21.15.7:0/3662567612 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f865402fa20 con 0x7f865c108cf0 2024-09-21T06:43:47.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.875+0000 7f866180c640 1 -- 172.21.15.7:0/3662567612 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f865c1a8990 con 0x7f865c108cf0 2024-09-21T06:43:47.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.875+0000 7f866180c640 1 -- 172.21.15.7:0/3662567612 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f865c1a8ed0 con 0x7f865c108cf0 2024-09-21T06:43:47.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.878+0000 7f8667d80740 1 Processor -- start 2024-09-21T06:43:47.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.878+0000 7f866080a640 1 -- 172.21.15.7:0/3662567612 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f865402fc40 con 0x7f865c108cf0 2024-09-21T06:43:47.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.878+0000 7f8667d80740 1 -- start start 2024-09-21T06:43:47.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.878+0000 7f8667d80740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a579650070 0x55a5799f76a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:47.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.878+0000 7f8667d80740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a5796271b0 0x55a5799f7be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:47.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.878+0000 7f8667d80740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a57962f390 0x55a5799f8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:47.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.878+0000 7f8667d80740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55a57996dea0 con 0x55a57962f390 2024-09-21T06:43:47.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.878+0000 7f8667d80740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a57995d2d0 con 0x55a579650070 2024-09-21T06:43:47.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.878+0000 7f8667d80740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55a5799610e0 con 0x55a5796271b0 2024-09-21T06:43:47.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.878+0000 7f865a7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a57962f390 0x55a5799f8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:47.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.879+0000 7f865a7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a57962f390 0x55a5799f8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56702/0 (socket says 172.21.15.7:56702) 2024-09-21T06:43:47.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.879+0000 7f865a7fc640 1 -- 172.21.15.7:0/3794822403 learned_addr learned my addr 172.21.15.7:0/3794822403 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:43:47.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.879+0000 7f865affd640 1 --2- 172.21.15.7:0/3794822403 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a5796271b0 0x55a5799f7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:47.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.879+0000 7f865a7fc640 1 --2- 172.21.15.7:0/3794822403 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a579650070 0x55a5799f76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:47.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.879+0000 7f865a7fc640 1 -- 172.21.15.7:0/3794822403 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a5796271b0 msgr2=0x55a5799f7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:47.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.879+0000 7f865a7fc640 1 --2- 172.21.15.7:0/3794822403 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a5796271b0 0x55a5799f7be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:47.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.879+0000 7f865a7fc640 1 -- 172.21.15.7:0/3794822403 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a579650070 msgr2=0x55a5799f76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:47.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.879+0000 7f865a7fc640 1 --2- 172.21.15.7:0/3794822403 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a579650070 0x55a5799f76a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:47.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.879+0000 7f865a7fc640 1 -- 172.21.15.7:0/3794822403 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5796bb650 con 0x55a57962f390 2024-09-21T06:43:47.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.879+0000 7f866080a640 1 --2- 172.21.15.7:0/3662567612 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f86440b6680 0x7f86440b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:47.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.879+0000 7f865a7fc640 1 --2- 172.21.15.7:0/3794822403 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a57962f390 0x55a5799f8120 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f8650012800 tx=0x7f8650009700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=901a239507c5e76d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:47.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.879+0000 7f866080a640 1 -- 172.21.15.7:0/3662567612 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8412+0+0 (secure 0 0 0) 0x7f8654108a50 con 0x7f865c108cf0 2024-09-21T06:43:47.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.879+0000 7f865affd640 1 --2- 172.21.15.7:0/3662567612 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f86440b6680 0x7f86440b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:47.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.879+0000 7f8641ffb640 1 -- 172.21.15.7:0/3794822403 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8650012d80 con 0x55a57962f390 2024-09-21T06:43:47.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.880+0000 7f8641ffb640 1 -- 172.21.15.7:0/3794822403 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8650010c80 con 0x55a57962f390 2024-09-21T06:43:47.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.880+0000 7f8641ffb640 1 -- 172.21.15.7:0/3794822403 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f865001ebf0 con 0x55a57962f390 2024-09-21T06:43:47.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.880+0000 7f8667d80740 1 -- 172.21.15.7:0/3794822403 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a57962f390 msgr2=0x55a5799f8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:47.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.880+0000 7f865affd640 1 --2- 172.21.15.7:0/3662567612 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f86440b6680 0x7f86440b8b90 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x55a5799f6320 tx=0x7f864c00b500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:47.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.880+0000 7f8667d80740 1 --2- 172.21.15.7:0/3794822403 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a57962f390 0x55a5799f8120 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f8650012800 tx=0x7f8650009700 comp rx=0 tx=0).stop 2024-09-21T06:43:47.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.881+0000 7f8667d80740 1 -- 172.21.15.7:0/3794822403 shutdown_connections 2024-09-21T06:43:47.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.881+0000 7f8667d80740 1 --2- 172.21.15.7:0/3794822403 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a57962f390 0x55a5799f8120 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:47.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.881+0000 7f8667d80740 1 --2- 172.21.15.7:0/3794822403 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a5796271b0 0x55a5799f7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:47.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.881+0000 7f8667d80740 1 --2- 172.21.15.7:0/3794822403 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a579650070 0x55a5799f76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:47.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.881+0000 7f8667d80740 1 -- 172.21.15.7:0/3794822403 >> 172.21.15.7:0/3794822403 conn(0x55a579644460 msgr2=0x55a5799f5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:47.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.881+0000 7f8667d80740 1 -- 172.21.15.7:0/3794822403 shutdown_connections 2024-09-21T06:43:47.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.881+0000 7f8667d80740 1 -- 172.21.15.7:0/3794822403 wait complete. 2024-09-21T06:43:47.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.881+0000 7f8667d80740 1 -- start start 2024-09-21T06:43:47.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.881+0000 7f8667d80740 1 Processor -- start 2024-09-21T06:43:47.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.882+0000 7f8667d80740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5796271b0 0x55a579a02d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:47.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.882+0000 7f8667d80740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a57962f390 0x55a579a03260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:47.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.882+0000 7f8667d80740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a579650070 0x55a579a0f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:47.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.882+0000 7f8667d80740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55a5797be700 con 0x55a5796271b0 2024-09-21T06:43:47.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.882+0000 7f8667d80740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a5798f8160 con 0x55a57962f390 2024-09-21T06:43:47.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.882+0000 7f8667d80740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55a579a05e80 con 0x55a579650070 2024-09-21T06:43:47.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.882+0000 7f8667d80740 10 client.0 _ll_register_callbacks cb 0x55a5799119e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:43:47.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.882+0000 7f865affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5796271b0 0x55a579a02d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:47.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.882+0000 7f865affd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5796271b0 0x55a579a02d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56704/0 (socket says 172.21.15.7:56704) 2024-09-21T06:43:47.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.882+0000 7f865affd640 1 -- 172.21.15.7:0/1961233941 learned_addr learned my addr 172.21.15.7:0/1961233941 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:43:47.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.882+0000 7f865a7fc640 1 --2- 172.21.15.7:0/1961233941 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a57962f390 0x55a579a03260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:47.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.882+0000 7f865b7fe640 1 --2- 172.21.15.7:0/1961233941 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a579650070 0x55a579a0f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:47.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.882+0000 7f865affd640 1 -- 172.21.15.7:0/1961233941 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a579650070 msgr2=0x55a579a0f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:47.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.882+0000 7f865affd640 1 --2- 172.21.15.7:0/1961233941 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a579650070 0x55a579a0f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:47.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.882+0000 7f865affd640 1 -- 172.21.15.7:0/1961233941 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a57962f390 msgr2=0x55a579a03260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:47.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.882+0000 7f865affd640 1 --2- 172.21.15.7:0/1961233941 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a57962f390 0x55a579a03260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:47.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.882+0000 7f865affd640 1 -- 172.21.15.7:0/1961233941 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a579925c90 con 0x55a5796271b0 2024-09-21T06:43:47.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.882+0000 7f865b7fe640 1 --2- 172.21.15.7:0/1961233941 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a579650070 0x55a579a0f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:43:47.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.883+0000 7f865affd640 1 --2- 172.21.15.7:0/1961233941 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5796271b0 0x55a579a02d20 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f864c00b830 tx=0x7f864c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b8e6813d66cafb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:47.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.883+0000 7f863affd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:43:47.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.883+0000 7f863affd640 1 -- 172.21.15.7:0/1961233941 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f864c00f990 con 0x55a5796271b0 2024-09-21T06:43:47.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.883+0000 7f863affd640 1 -- 172.21.15.7:0/1961233941 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8412+0+0 (secure 0 0 0) 0x7f864c00fb30 con 0x55a5796271b0 2024-09-21T06:43:47.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.883+0000 7f8667d80740 1 -- 172.21.15.7:0/1961233941 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8650010c80 con 0x55a5796271b0 2024-09-21T06:43:47.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.883+0000 7f863affd640 1 -- 172.21.15.7:0/1961233941 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f864c00fd30 con 0x55a5796271b0 2024-09-21T06:43:47.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.883+0000 7f8667d80740 10 client.16929 fetch_fsmap learned FSMap version 25 2024-09-21T06:43:47.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.883+0000 7f8667d80740 1 -- 172.21.15.7:0/1961233941 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a579a11be0 con 0x55a5796271b0 2024-09-21T06:43:47.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.883+0000 7f863affd640 1 -- 172.21.15.7:0/1961233941 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8650010c80 con 0x55a5796271b0 2024-09-21T06:43:47.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.883+0000 7f863affd640 1 -- 172.21.15.7:0/1961233941 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f864c02f050 con 0x55a5796271b0 2024-09-21T06:43:47.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.883+0000 7f8667d80740 10 client.16929 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:43:47.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.883+0000 7f8667d80740 10 client.16929 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-21T06:43:47.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.883+0000 7f8667d80740 20 client.16929 populate_metadata read hostname 'smithi007' 2024-09-21T06:43:47.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.884+0000 7f8667d80740 1 --2- 172.21.15.7:0/1961233941 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x55a57960e9f0 0x55a579a15040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:47.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.884+0000 7f8667d80740 4 client.16929 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:43:47.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.884+0000 7f8667d80740 1 -- 172.21.15.7:0/1961233941 --> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a57996fdf0 con 0x55a57960e9f0 2024-09-21T06:43:47.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.884+0000 7f865a7fc640 1 --2- 172.21.15.7:0/1961233941 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x55a57960e9f0 0x55a579a15040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:47.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.884+0000 7f865a7fc640 1 --2- 172.21.15.7:0/1961233941 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x55a57960e9f0 0x55a579a15040 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=996d97b8ee53ef66 server_cookie=39b691bf9b5c2000 in_seq=0 out_seq=0 2024-09-21T06:43:47.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.884+0000 7f863affd640 10 client.16929 ms_handle_connect on v2:172.21.15.18:6836/1539670694 2024-09-21T06:43:47.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.885+0000 7f863affd640 1 -- 172.21.15.7:0/1961233941 <== mds.2 v2:172.21.15.18:6836/1539670694 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a57996fdf0 con 0x55a57960e9f0 2024-09-21T06:43:47.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.885+0000 7f863affd640 10 client.16929 handle_command_reply: tid=0 2024-09-21T06:43:47.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.885+0000 7f8667d80740 1 client.16929 shutdown 2024-09-21T06:43:47.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.885+0000 7f8667d80740 1 -- 172.21.15.7:0/1961233941 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5796271b0 msgr2=0x55a579a02d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:47.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.885+0000 7f8667d80740 1 --2- 172.21.15.7:0/1961233941 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5796271b0 0x55a579a02d20 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f864c00b830 tx=0x7f864c0046c0 comp rx=0 tx=0).stop 2024-09-21T06:43:47.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.885+0000 7f8667d80740 1 -- 172.21.15.7:0/1961233941 shutdown_connections 2024-09-21T06:43:47.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.885+0000 7f8667d80740 1 --2- 172.21.15.7:0/1961233941 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x55a57960e9f0 0x55a579a15040 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:47.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.885+0000 7f8667d80740 1 --2- 172.21.15.7:0/1961233941 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a579650070 0x55a579a0f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:47.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.885+0000 7f8667d80740 1 --2- 172.21.15.7:0/1961233941 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a57962f390 0x55a579a03260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:47.893 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.885+0000 7f8667d80740 1 --2- 172.21.15.7:0/1961233941 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5796271b0 0x55a579a02d20 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:47.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.885+0000 7f863affd640 0 client.16929 ms_handle_reset on v2:172.21.15.18:6836/1539670694 2024-09-21T06:43:47.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.885+0000 7f8667d80740 1 -- 172.21.15.7:0/1961233941 >> 172.21.15.7:0/1961233941 conn(0x55a579644460 msgr2=0x55a5799fa830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:47.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.886+0000 7f8667d80740 1 -- 172.21.15.7:0/1961233941 shutdown_connections 2024-09-21T06:43:47.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.886+0000 7f8667d80740 1 -- 172.21.15.7:0/1961233941 wait complete. 2024-09-21T06:43:47.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.886+0000 7f8667d80740 20 client.16929 trim_cache size 0 max 16384 2024-09-21T06:43:47.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.899+0000 7f8667d80740 1 Processor -- start 2024-09-21T06:43:47.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.899+0000 7f8667d80740 1 -- start start 2024-09-21T06:43:47.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.899+0000 7f8667d80740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a57960e9f0 0x55a579a04950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:47.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.899+0000 7f8667d80740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5796271b0 0x55a5799f4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:47.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.899+0000 7f8667d80740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a57962f390 0x55a5799f5100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:47.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.899+0000 7f8667d80740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f865c1b4030 con 0x55a5796271b0 2024-09-21T06:43:47.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.899+0000 7f8667d80740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f865c1b1900 con 0x55a57962f390 2024-09-21T06:43:47.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.899+0000 7f8667d80740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f865c1af770 con 0x55a57960e9f0 2024-09-21T06:43:47.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.899+0000 7f865a7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5796271b0 0x55a5799f4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:47.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.899+0000 7f865a7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5796271b0 0x55a5799f4bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56720/0 (socket says 172.21.15.7:56720) 2024-09-21T06:43:47.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.899+0000 7f865a7fc640 1 -- 172.21.15.7:0/3339465825 learned_addr learned my addr 172.21.15.7:0/3339465825 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:43:47.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.899+0000 7f865b7fe640 1 --2- 172.21.15.7:0/3339465825 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a57962f390 0x55a5799f5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:47.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.900+0000 7f865affd640 1 --2- 172.21.15.7:0/3339465825 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a57960e9f0 0x55a579a04950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:47.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.900+0000 7f865a7fc640 1 -- 172.21.15.7:0/3339465825 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a57960e9f0 msgr2=0x55a579a04950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:47.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.900+0000 7f865a7fc640 1 --2- 172.21.15.7:0/3339465825 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a57960e9f0 0x55a579a04950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:47.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.900+0000 7f865a7fc640 1 -- 172.21.15.7:0/3339465825 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a57962f390 msgr2=0x55a5799f5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:47.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.900+0000 7f865a7fc640 1 --2- 172.21.15.7:0/3339465825 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a57962f390 0x55a5799f5100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:47.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.900+0000 7f865a7fc640 1 -- 172.21.15.7:0/3339465825 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5799fd9d0 con 0x55a5796271b0 2024-09-21T06:43:47.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.900+0000 7f865affd640 1 --2- 172.21.15.7:0/3339465825 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a57960e9f0 0x55a579a04950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:43:47.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.900+0000 7f865a7fc640 1 --2- 172.21.15.7:0/3339465825 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5796271b0 0x55a5799f4bc0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f865001e880 tx=0x7f865001e770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbd8d97f63fe7ef1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:47.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.900+0000 7f86417fa640 1 -- 172.21.15.7:0/3339465825 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8650009a10 con 0x55a5796271b0 2024-09-21T06:43:47.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.900+0000 7f86417fa640 1 -- 172.21.15.7:0/3339465825 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8650010c50 con 0x55a5796271b0 2024-09-21T06:43:47.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.900+0000 7f86417fa640 1 -- 172.21.15.7:0/3339465825 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f865001ee40 con 0x55a5796271b0 2024-09-21T06:43:47.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.901+0000 7f8667d80740 1 -- 172.21.15.7:0/3339465825 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5796271b0 msgr2=0x55a5799f4bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:47.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.901+0000 7f8667d80740 1 --2- 172.21.15.7:0/3339465825 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5796271b0 0x55a5799f4bc0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f865001e880 tx=0x7f865001e770 comp rx=0 tx=0).stop 2024-09-21T06:43:47.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.901+0000 7f8667d80740 1 -- 172.21.15.7:0/3339465825 shutdown_connections 2024-09-21T06:43:47.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.901+0000 7f8667d80740 1 --2- 172.21.15.7:0/3339465825 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a57962f390 0x55a5799f5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:47.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.901+0000 7f8667d80740 1 --2- 172.21.15.7:0/3339465825 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a5796271b0 0x55a5799f4bc0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:47.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.901+0000 7f8667d80740 1 --2- 172.21.15.7:0/3339465825 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a57960e9f0 0x55a579a04950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:47.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.901+0000 7f8667d80740 1 -- 172.21.15.7:0/3339465825 >> 172.21.15.7:0/3339465825 conn(0x55a579644460 msgr2=0x55a579a04240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:47.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.901+0000 7f8667d80740 1 -- 172.21.15.7:0/3339465825 shutdown_connections 2024-09-21T06:43:47.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.901+0000 7f8667d80740 1 -- 172.21.15.7:0/3339465825 wait complete. 2024-09-21T06:43:47.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.901+0000 7f8667d80740 1 -- start start 2024-09-21T06:43:47.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.902+0000 7f8667d80740 1 Processor -- start 2024-09-21T06:43:47.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.902+0000 7f8667d80740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a57960e9f0 0x55a579a0b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:47.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.902+0000 7f8667d80740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a5796271b0 0x55a579a06c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:47.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.902+0000 7f8667d80740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a57962f390 0x55a579a07180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:47.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.902+0000 7f8667d80740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f865c1afdc0 con 0x55a57962f390 2024-09-21T06:43:47.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.902+0000 7f8667d80740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f865c1b1230 con 0x55a5796271b0 2024-09-21T06:43:47.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.902+0000 7f8667d80740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f865c1b0490 con 0x55a57960e9f0 2024-09-21T06:43:47.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.902+0000 7f8667d80740 10 client.0 _ll_register_callbacks cb 0x7f864c00b720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:43:47.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.902+0000 7f865b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a57962f390 0x55a579a07180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:47.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.902+0000 7f865b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a57962f390 0x55a579a07180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56732/0 (socket says 172.21.15.7:56732) 2024-09-21T06:43:47.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.902+0000 7f865b7fe640 1 -- 172.21.15.7:0/3513296478 learned_addr learned my addr 172.21.15.7:0/3513296478 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:43:47.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.902+0000 7f865a7fc640 1 --2- 172.21.15.7:0/3513296478 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a5796271b0 0x55a579a06c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:47.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.902+0000 7f865affd640 1 --2- 172.21.15.7:0/3513296478 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a57960e9f0 0x55a579a0b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:47.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.902+0000 7f865b7fe640 1 -- 172.21.15.7:0/3513296478 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a57960e9f0 msgr2=0x55a579a0b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:47.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.902+0000 7f865b7fe640 1 --2- 172.21.15.7:0/3513296478 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a57960e9f0 0x55a579a0b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:47.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.902+0000 7f865b7fe640 1 -- 172.21.15.7:0/3513296478 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a5796271b0 msgr2=0x55a579a06c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:47.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.902+0000 7f865b7fe640 1 --2- 172.21.15.7:0/3513296478 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a5796271b0 0x55a579a06c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:47.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.902+0000 7f865b7fe640 1 -- 172.21.15.7:0/3513296478 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a579a07770 con 0x55a57962f390 2024-09-21T06:43:47.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.903+0000 7f865b7fe640 1 --2- 172.21.15.7:0/3513296478 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a57962f390 0x55a579a07180 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f8654106270 tx=0x7f86540ce6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc3d8480a499c2b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:47.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.903+0000 7f863affd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:43:47.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.903+0000 7f863affd640 1 -- 172.21.15.7:0/3513296478 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86540ca080 con 0x55a57962f390 2024-09-21T06:43:47.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.903+0000 7f863affd640 1 -- 172.21.15.7:0/3513296478 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8412+0+0 (secure 0 0 0) 0x7f86540d80a0 con 0x55a57962f390 2024-09-21T06:43:47.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.903+0000 7f8667d80740 1 -- 172.21.15.7:0/3513296478 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8650010c50 con 0x55a57962f390 2024-09-21T06:43:47.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.903+0000 7f863affd640 1 -- 172.21.15.7:0/3513296478 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f86540ce420 con 0x55a57962f390 2024-09-21T06:43:47.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.903+0000 7f8667d80740 10 client.16935 fetch_fsmap learned FSMap version 25 2024-09-21T06:43:47.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.903+0000 7f8667d80740 1 -- 172.21.15.7:0/3513296478 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a579a7f770 con 0x55a57962f390 2024-09-21T06:43:47.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.903+0000 7f863affd640 1 -- 172.21.15.7:0/3513296478 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8650010c50 con 0x55a57962f390 2024-09-21T06:43:47.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.903+0000 7f863affd640 1 -- 172.21.15.7:0/3513296478 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f86540f4070 con 0x55a57962f390 2024-09-21T06:43:47.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.904+0000 7f8667d80740 10 client.16935 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:43:47.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.904+0000 7f8667d80740 10 client.16935 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-21T06:43:47.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.904+0000 7f8667d80740 20 client.16935 populate_metadata read hostname 'smithi007' 2024-09-21T06:43:47.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.904+0000 7f8667d80740 1 --2- 172.21.15.7:0/3513296478 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x55a579650070 0x55a579a81f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:47.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.904+0000 7f8667d80740 4 client.16935 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:43:47.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.904+0000 7f8667d80740 1 -- 172.21.15.7:0/3513296478 --> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a57996b8a0 con 0x55a579650070 2024-09-21T06:43:47.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.904+0000 7f865affd640 1 --2- 172.21.15.7:0/3513296478 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x55a579650070 0x55a579a81f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:47.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.904+0000 7f863affd640 10 client.16935 ms_handle_connect on v2:172.21.15.18:6836/1539670694 2024-09-21T06:43:47.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.904+0000 7f865affd640 1 --2- 172.21.15.7:0/3513296478 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x55a579650070 0x55a579a81f30 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=28ff79b0951f2bdf server_cookie=9241f6d90864c74b in_seq=0 out_seq=0 2024-09-21T06:43:47.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.904+0000 7f863affd640 1 -- 172.21.15.7:0/3513296478 <== mds.2 v2:172.21.15.18:6836/1539670694 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a57996b8a0 con 0x55a579650070 2024-09-21T06:43:47.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.904+0000 7f863affd640 10 client.16935 handle_command_reply: tid=0 2024-09-21T06:43:47.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.904+0000 7f8667d80740 1 client.16935 shutdown 2024-09-21T06:43:47.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.905+0000 7f8667d80740 1 -- 172.21.15.7:0/3513296478 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a57962f390 msgr2=0x55a579a07180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:47.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.905+0000 7f8667d80740 1 --2- 172.21.15.7:0/3513296478 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a57962f390 0x55a579a07180 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f8654106270 tx=0x7f86540ce6e0 comp rx=0 tx=0).stop 2024-09-21T06:43:47.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.905+0000 7f8667d80740 1 -- 172.21.15.7:0/3513296478 shutdown_connections 2024-09-21T06:43:47.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.905+0000 7f8667d80740 1 --2- 172.21.15.7:0/3513296478 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x55a579650070 0x55a579a81f30 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:47.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.905+0000 7f8667d80740 1 --2- 172.21.15.7:0/3513296478 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a57962f390 0x55a579a07180 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:47.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.905+0000 7f8667d80740 1 --2- 172.21.15.7:0/3513296478 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a5796271b0 0x55a579a06c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:47.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.905+0000 7f8667d80740 1 --2- 172.21.15.7:0/3513296478 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a57960e9f0 0x55a579a0b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:47.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.905+0000 7f8667d80740 1 -- 172.21.15.7:0/3513296478 >> 172.21.15.7:0/3513296478 conn(0x55a579644460 msgr2=0x55a5799f9090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:47.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.905+0000 7f863affd640 0 client.16935 ms_handle_reset on v2:172.21.15.18:6836/1539670694 2024-09-21T06:43:47.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.905+0000 7f8667d80740 1 -- 172.21.15.7:0/3513296478 shutdown_connections 2024-09-21T06:43:47.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.905+0000 7f8667d80740 1 -- 172.21.15.7:0/3513296478 wait complete. 2024-09-21T06:43:47.911 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.905+0000 7f8667d80740 20 client.16935 trim_cache size 0 max 16384 2024-09-21T06:43:47.912 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:43:47.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.905+0000 7f866180c640 1 -- 172.21.15.7:0/3662567612 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f86440b6680 msgr2=0x7f86440b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:47.912 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.905+0000 7f866180c640 1 --2- 172.21.15.7:0/3662567612 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f86440b6680 0x7f86440b8b90 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x55a5799f6320 tx=0x7f864c00b500 comp rx=0 tx=0).stop 2024-09-21T06:43:47.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.906+0000 7f866180c640 1 -- 172.21.15.7:0/3662567612 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f865c108cf0 msgr2=0x7f865c1000f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:47.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.906+0000 7f866180c640 1 --2- 172.21.15.7:0/3662567612 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f865c108cf0 0x7f865c1000f0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f86540098d0 tx=0x7f86540317b0 comp rx=0 tx=0).stop 2024-09-21T06:43:47.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.906+0000 7f866180c640 1 -- 172.21.15.7:0/3662567612 shutdown_connections 2024-09-21T06:43:47.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.906+0000 7f866180c640 1 --2- 172.21.15.7:0/3662567612 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f86440b6680 0x7f86440b8b90 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:47.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.906+0000 7f866180c640 1 --2- 172.21.15.7:0/3662567612 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f865c108cf0 0x7f865c1000f0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:47.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.906+0000 7f866180c640 1 --2- 172.21.15.7:0/3662567612 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f865c1083a0 0x7f865c0ffbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:47.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.906+0000 7f866180c640 1 --2- 172.21.15.7:0/3662567612 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f865c102a60 0x7f865c0ff670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:47.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.906+0000 7f866180c640 1 -- 172.21.15.7:0/3662567612 >> 172.21.15.7:0/3662567612 conn(0x7f865c079730 msgr2=0x7f865c06b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:47.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.906+0000 7f866180c640 1 -- 172.21.15.7:0/3662567612 shutdown_connections 2024-09-21T06:43:47.913 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:47.906+0000 7f866180c640 1 -- 172.21.15.7:0/3662567612 wait complete. 2024-09-21T06:43:48.599 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:43:48.856 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:43:49.241 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:43:48 smithi007 ceph-mon[30983]: pgmap v549: 97 pgs: 97 active+clean; 3.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2024-09-21T06:43:49.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:43:48 smithi144 ceph-mon[34653]: pgmap v549: 97 pgs: 97 active+clean; 3.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2024-09-21T06:43:49.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.334+0000 7f07ed8be640 1 -- 172.21.15.7:0/2016369615 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07e8105320 msgr2=0x7f07e810d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:49.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.334+0000 7f07ed8be640 1 --2- 172.21.15.7:0/2016369615 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07e8105320 0x7f07e810d870 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f07d0009900 tx=0x7f07d002a3f0 comp rx=0 tx=0).stop 2024-09-21T06:43:49.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.334+0000 7f07ed8be640 1 -- 172.21.15.7:0/2016369615 shutdown_connections 2024-09-21T06:43:49.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.334+0000 7f07ed8be640 1 --2- 172.21.15.7:0/2016369615 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f07e810de30 0x7f07e8110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:49.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.334+0000 7f07ed8be640 1 --2- 172.21.15.7:0/2016369615 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07e8105320 0x7f07e810d870 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:49.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.334+0000 7f07ed8be640 1 --2- 172.21.15.7:0/2016369615 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f07e81049d0 0x7f07e8104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:49.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.334+0000 7f07ed8be640 1 -- 172.21.15.7:0/2016369615 >> 172.21.15.7:0/2016369615 conn(0x7f07e8079740 msgr2=0x7f07e8079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:49.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.334+0000 7f07ed8be640 1 -- 172.21.15.7:0/2016369615 shutdown_connections 2024-09-21T06:43:49.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.335+0000 7f07ed8be640 1 -- 172.21.15.7:0/2016369615 wait complete. 2024-09-21T06:43:49.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.335+0000 7f07ed8be640 1 Processor -- start 2024-09-21T06:43:49.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.335+0000 7f07ed8be640 1 -- start start 2024-09-21T06:43:49.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.336+0000 7f07ed8be640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f07e81049d0 0x7f07e819a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:49.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.336+0000 7f07ed8be640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f07e8105320 0x7f07e819aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:49.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.336+0000 7f07ed8be640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07e810de30 0x7f07e819fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:49.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.336+0000 7f07ed8be640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f07e8113a90 con 0x7f07e810de30 2024-09-21T06:43:49.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.336+0000 7f07ed8be640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f07e8113910 con 0x7f07e81049d0 2024-09-21T06:43:49.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.336+0000 7f07ed8be640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f07e8113c10 con 0x7f07e8105320 2024-09-21T06:43:49.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.336+0000 7f07e77fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07e810de30 0x7f07e819fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:49.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.336+0000 7f07e77fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07e810de30 0x7f07e819fe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56748/0 (socket says 172.21.15.7:56748) 2024-09-21T06:43:49.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.336+0000 7f07e77fe640 1 -- 172.21.15.7:0/2207346037 learned_addr learned my addr 172.21.15.7:0/2207346037 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:43:49.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.336+0000 7f07e6ffd640 1 --2- 172.21.15.7:0/2207346037 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f07e81049d0 0x7f07e819a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:49.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.336+0000 7f07dffff640 1 --2- 172.21.15.7:0/2207346037 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f07e8105320 0x7f07e819aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:49.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.336+0000 7f07e77fe640 1 -- 172.21.15.7:0/2207346037 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f07e8105320 msgr2=0x7f07e819aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:49.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.336+0000 7f07e77fe640 1 --2- 172.21.15.7:0/2207346037 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f07e8105320 0x7f07e819aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:49.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.336+0000 7f07e77fe640 1 -- 172.21.15.7:0/2207346037 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f07e81049d0 msgr2=0x7f07e819a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:49.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.336+0000 7f07e77fe640 1 --2- 172.21.15.7:0/2207346037 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f07e81049d0 0x7f07e819a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:49.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.336+0000 7f07e77fe640 1 -- 172.21.15.7:0/2207346037 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07e81a04b0 con 0x7f07e810de30 2024-09-21T06:43:49.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.336+0000 7f07dffff640 1 --2- 172.21.15.7:0/2207346037 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f07e8105320 0x7f07e819aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:43:49.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.336+0000 7f07e77fe640 1 --2- 172.21.15.7:0/2207346037 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07e810de30 0x7f07e819fe40 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f07e000cce0 tx=0x7f07e000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:49.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.337+0000 7f07ec8bc640 1 -- 172.21.15.7:0/2207346037 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07e000f450 con 0x7f07e810de30 2024-09-21T06:43:49.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.337+0000 7f07ec8bc640 1 -- 172.21.15.7:0/2207346037 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f07e000faa0 con 0x7f07e810de30 2024-09-21T06:43:49.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.337+0000 7f07ed8be640 1 -- 172.21.15.7:0/2207346037 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07e81a07a0 con 0x7f07e810de30 2024-09-21T06:43:49.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.337+0000 7f07ec8bc640 1 -- 172.21.15.7:0/2207346037 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07e0018b70 con 0x7f07e810de30 2024-09-21T06:43:49.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.337+0000 7f07ed8be640 1 -- 172.21.15.7:0/2207346037 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07e81a0c90 con 0x7f07e810de30 2024-09-21T06:43:49.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.340+0000 7f07f3e32740 1 Processor -- start 2024-09-21T06:43:49.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.340+0000 7f07ec8bc640 1 -- 172.21.15.7:0/2207346037 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f07e0018d10 con 0x7f07e810de30 2024-09-21T06:43:49.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.340+0000 7f07f3e32740 1 -- start start 2024-09-21T06:43:49.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.340+0000 7f07f3e32740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5583dbbab070 0x5583dbf526a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:49.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.340+0000 7f07f3e32740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5583dbb821b0 0x5583dbf52be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:49.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.340+0000 7f07f3e32740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5583dbb8a390 0x5583dbf53120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:49.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.340+0000 7f07f3e32740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5583dbec8ea0 con 0x5583dbb821b0 2024-09-21T06:43:49.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.340+0000 7f07f3e32740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5583dbeb82d0 con 0x5583dbbab070 2024-09-21T06:43:49.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.340+0000 7f07f3e32740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5583dbebc0e0 con 0x5583dbb8a390 2024-09-21T06:43:49.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.340+0000 7f07e6ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5583dbb821b0 0x5583dbf52be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:49.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.340+0000 7f07e6ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5583dbb821b0 0x5583dbf52be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56762/0 (socket says 172.21.15.7:56762) 2024-09-21T06:43:49.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.340+0000 7f07e6ffd640 1 -- 172.21.15.7:0/2079430573 learned_addr learned my addr 172.21.15.7:0/2079430573 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:43:49.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.340+0000 7f07dffff640 1 --2- 172.21.15.7:0/2079430573 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5583dbbab070 0x5583dbf526a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:49.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.340+0000 7f07dffff640 1 --2- 172.21.15.7:0/2079430573 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5583dbb8a390 0x5583dbf53120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:49.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.340+0000 7f07e6ffd640 1 -- 172.21.15.7:0/2079430573 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5583dbb8a390 msgr2=0x5583dbf53120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:49.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.341+0000 7f07e6ffd640 1 --2- 172.21.15.7:0/2079430573 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5583dbb8a390 0x5583dbf53120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:49.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.341+0000 7f07e6ffd640 1 -- 172.21.15.7:0/2079430573 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5583dbbab070 msgr2=0x5583dbf526a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:49.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.341+0000 7f07e6ffd640 1 --2- 172.21.15.7:0/2079430573 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5583dbbab070 0x5583dbf526a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:49.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.341+0000 7f07e6ffd640 1 -- 172.21.15.7:0/2079430573 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583dbc16650 con 0x5583dbb821b0 2024-09-21T06:43:49.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.341+0000 7f07dffff640 1 --2- 172.21.15.7:0/2079430573 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5583dbb8a390 0x5583dbf53120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:43:49.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.341+0000 7f07e6ffd640 1 --2- 172.21.15.7:0/2079430573 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5583dbb821b0 0x5583dbf52be0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f07d800bc80 tx=0x7f07d800f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ada7d37913bccb4b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:49.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.341+0000 7f07ddffb640 1 -- 172.21.15.7:0/2079430573 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07d8015070 con 0x5583dbb821b0 2024-09-21T06:43:49.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.341+0000 7f07ec8bc640 1 --2- 172.21.15.7:0/2207346037 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f07d40b66b0 0x7f07d40b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:49.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.341+0000 7f07ddffb640 1 -- 172.21.15.7:0/2079430573 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f07d80118f0 con 0x5583dbb821b0 2024-09-21T06:43:49.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.341+0000 7f07ddffb640 1 -- 172.21.15.7:0/2079430573 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07d8010830 con 0x5583dbb821b0 2024-09-21T06:43:49.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.341+0000 7f07dffff640 1 --2- 172.21.15.7:0/2207346037 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f07d40b66b0 0x7f07d40b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:49.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.341+0000 7f07ec8bc640 1 -- 172.21.15.7:0/2207346037 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8412+0+0 (secure 0 0 0) 0x7f07e00e7b50 con 0x7f07e810de30 2024-09-21T06:43:49.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.342+0000 7f07f3e32740 1 -- 172.21.15.7:0/2079430573 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5583dbb821b0 msgr2=0x5583dbf52be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:49.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.342+0000 7f07dffff640 1 --2- 172.21.15.7:0/2207346037 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f07d40b66b0 0x7f07d40b8bc0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f07e807a060 tx=0x7f07d0031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:49.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.342+0000 7f07f3e32740 1 --2- 172.21.15.7:0/2079430573 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5583dbb821b0 0x5583dbf52be0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f07d800bc80 tx=0x7f07d800f730 comp rx=0 tx=0).stop 2024-09-21T06:43:49.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.342+0000 7f07f3e32740 1 -- 172.21.15.7:0/2079430573 shutdown_connections 2024-09-21T06:43:49.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.342+0000 7f07f3e32740 1 --2- 172.21.15.7:0/2079430573 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5583dbb8a390 0x5583dbf53120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:49.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.342+0000 7f07f3e32740 1 --2- 172.21.15.7:0/2079430573 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5583dbb821b0 0x5583dbf52be0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:49.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.342+0000 7f07f3e32740 1 --2- 172.21.15.7:0/2079430573 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5583dbbab070 0x5583dbf526a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:49.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.342+0000 7f07f3e32740 1 -- 172.21.15.7:0/2079430573 >> 172.21.15.7:0/2079430573 conn(0x5583dbb9f460 msgr2=0x5583dbf50590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:49.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.342+0000 7f07f3e32740 1 -- 172.21.15.7:0/2079430573 shutdown_connections 2024-09-21T06:43:49.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.342+0000 7f07f3e32740 1 -- 172.21.15.7:0/2079430573 wait complete. 2024-09-21T06:43:49.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.342+0000 7f07f3e32740 1 -- start start 2024-09-21T06:43:49.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.343+0000 7f07f3e32740 1 Processor -- start 2024-09-21T06:43:49.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.343+0000 7f07f3e32740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5583dbb821b0 0x5583dbf5ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:49.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.343+0000 7f07f3e32740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5583dbb8a390 0x5583dbf5e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:49.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.343+0000 7f07f3e32740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5583dbbab070 0x5583dbf6a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:49.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.343+0000 7f07f3e32740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5583dbd19700 con 0x5583dbb8a390 2024-09-21T06:43:49.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.343+0000 7f07f3e32740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5583dbe53160 con 0x5583dbbab070 2024-09-21T06:43:49.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.343+0000 7f07f3e32740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5583dbf60e80 con 0x5583dbb821b0 2024-09-21T06:43:49.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.343+0000 7f07f3e32740 10 client.0 _ll_register_callbacks cb 0x5583dbe6c9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:43:49.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.343+0000 7f07dffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5583dbb8a390 0x5583dbf5e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:49.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.343+0000 7f07dffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5583dbb8a390 0x5583dbf5e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56774/0 (socket says 172.21.15.7:56774) 2024-09-21T06:43:49.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.343+0000 7f07dffff640 1 -- 172.21.15.7:0/1203096865 learned_addr learned my addr 172.21.15.7:0/1203096865 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:43:49.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.343+0000 7f07e77fe640 1 --2- 172.21.15.7:0/1203096865 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5583dbbab070 0x5583dbf6a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:49.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.343+0000 7f07e6ffd640 1 --2- 172.21.15.7:0/1203096865 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5583dbb821b0 0x5583dbf5ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:49.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.344+0000 7f07dffff640 1 -- 172.21.15.7:0/1203096865 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5583dbb821b0 msgr2=0x5583dbf5ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:49.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.344+0000 7f07dffff640 1 --2- 172.21.15.7:0/1203096865 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5583dbb821b0 0x5583dbf5ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:49.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.344+0000 7f07dffff640 1 -- 172.21.15.7:0/1203096865 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5583dbbab070 msgr2=0x5583dbf6a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:49.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.344+0000 7f07dffff640 1 --2- 172.21.15.7:0/1203096865 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5583dbbab070 0x5583dbf6a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:49.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.344+0000 7f07dffff640 1 -- 172.21.15.7:0/1203096865 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583dbe80c90 con 0x5583dbb8a390 2024-09-21T06:43:49.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.344+0000 7f07dffff640 1 --2- 172.21.15.7:0/1203096865 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5583dbb8a390 0x5583dbf5e2f0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f07d0009900 tx=0x7f07d002a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6debf13a02a621c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:49.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.344+0000 7f07c6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:43:49.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.344+0000 7f07c6ffd640 1 -- 172.21.15.7:0/1203096865 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07d004d030 con 0x5583dbb8a390 2024-09-21T06:43:49.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.344+0000 7f07c6ffd640 1 -- 172.21.15.7:0/1203096865 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8412+0+0 (secure 0 0 0) 0x7f07d0003b40 con 0x5583dbb8a390 2024-09-21T06:43:49.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.344+0000 7f07f3e32740 1 -- 172.21.15.7:0/1203096865 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f07d80118f0 con 0x5583dbb8a390 2024-09-21T06:43:49.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.344+0000 7f07c6ffd640 1 -- 172.21.15.7:0/1203096865 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f07d0035040 con 0x5583dbb8a390 2024-09-21T06:43:49.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.344+0000 7f07f3e32740 10 client.16947 fetch_fsmap learned FSMap version 25 2024-09-21T06:43:49.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.344+0000 7f07f3e32740 1 -- 172.21.15.7:0/1203096865 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5583dbf6cbb0 con 0x5583dbb8a390 2024-09-21T06:43:49.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.344+0000 7f07c6ffd640 1 -- 172.21.15.7:0/1203096865 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f07d80118f0 con 0x5583dbb8a390 2024-09-21T06:43:49.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.345+0000 7f07c6ffd640 1 -- 172.21.15.7:0/1203096865 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f07d005a050 con 0x5583dbb8a390 2024-09-21T06:43:49.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.345+0000 7f07f3e32740 10 client.16947 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:43:49.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.345+0000 7f07f3e32740 10 client.16947 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:43:49.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.345+0000 7f07f3e32740 20 client.16947 populate_metadata read hostname 'smithi007' 2024-09-21T06:43:49.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.345+0000 7f07f3e32740 1 --2- 172.21.15.7:0/1203096865 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x5583dbb699f0 0x5583dbf70090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:49.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.345+0000 7f07f3e32740 4 client.16947 mds_command: new command op to 24688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:43:49.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.345+0000 7f07f3e32740 1 -- 172.21.15.7:0/1203096865 --> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5583dbecadf0 con 0x5583dbb699f0 2024-09-21T06:43:49.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.345+0000 7f07e6ffd640 1 --2- 172.21.15.7:0/1203096865 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x5583dbb699f0 0x5583dbf70090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:49.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.346+0000 7f07c6ffd640 10 client.16947 ms_handle_connect on v2:172.21.15.144:6838/4027821922 2024-09-21T06:43:49.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.346+0000 7f07e6ffd640 1 --2- 172.21.15.7:0/1203096865 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x5583dbb699f0 0x5583dbf70090 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=dc29ae93f865a51a server_cookie=bf0a5dba86f89a35 in_seq=0 out_seq=0 2024-09-21T06:43:49.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.346+0000 7f07c6ffd640 1 -- 172.21.15.7:0/1203096865 <== mds.1 v2:172.21.15.144:6838/4027821922 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5583dbecadf0 con 0x5583dbb699f0 2024-09-21T06:43:49.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.346+0000 7f07c6ffd640 10 client.16947 handle_command_reply: tid=0 2024-09-21T06:43:49.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.346+0000 7f07f3e32740 1 client.16947 shutdown 2024-09-21T06:43:49.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.347+0000 7f07f3e32740 1 -- 172.21.15.7:0/1203096865 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5583dbb8a390 msgr2=0x5583dbf5e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:49.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.347+0000 7f07f3e32740 1 --2- 172.21.15.7:0/1203096865 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5583dbb8a390 0x5583dbf5e2f0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f07d0009900 tx=0x7f07d002a3f0 comp rx=0 tx=0).stop 2024-09-21T06:43:49.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.347+0000 7f07f3e32740 1 -- 172.21.15.7:0/1203096865 shutdown_connections 2024-09-21T06:43:49.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.347+0000 7f07f3e32740 1 --2- 172.21.15.7:0/1203096865 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x5583dbb699f0 0x5583dbf70090 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:49.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.347+0000 7f07c6ffd640 0 client.16947 ms_handle_reset on v2:172.21.15.144:6838/4027821922 2024-09-21T06:43:49.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.347+0000 7f07f3e32740 1 --2- 172.21.15.7:0/1203096865 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5583dbbab070 0x5583dbf6a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:49.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.347+0000 7f07f3e32740 1 --2- 172.21.15.7:0/1203096865 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5583dbb8a390 0x5583dbf5e2f0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:49.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.347+0000 7f07f3e32740 1 --2- 172.21.15.7:0/1203096865 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5583dbb821b0 0x5583dbf5ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:49.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.347+0000 7f07f3e32740 1 -- 172.21.15.7:0/1203096865 >> 172.21.15.7:0/1203096865 conn(0x5583dbb9f460 msgr2=0x5583dbf55830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:49.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.347+0000 7f07f3e32740 1 -- 172.21.15.7:0/1203096865 shutdown_connections 2024-09-21T06:43:49.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.347+0000 7f07f3e32740 1 -- 172.21.15.7:0/1203096865 wait complete. 2024-09-21T06:43:49.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.347+0000 7f07f3e32740 20 client.16947 trim_cache size 0 max 16384 2024-09-21T06:43:49.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.361+0000 7f07f3e32740 1 Processor -- start 2024-09-21T06:43:49.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.361+0000 7f07f3e32740 1 -- start start 2024-09-21T06:43:49.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.361+0000 7f07f3e32740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5583dbb699f0 0x5583dbf55eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:49.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.361+0000 7f07f3e32740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5583dbb821b0 0x5583dbf6a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:49.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.361+0000 7f07f3e32740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5583dbb8a390 0x5583dbf4feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:49.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.361+0000 7f07f3e32740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f07e81b1de0 con 0x5583dbb8a390 2024-09-21T06:43:49.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.361+0000 7f07f3e32740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f07e81af6b0 con 0x5583dbb699f0 2024-09-21T06:43:49.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.361+0000 7f07f3e32740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f07e81ad520 con 0x5583dbb821b0 2024-09-21T06:43:49.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.361+0000 7f07e77fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5583dbb8a390 0x5583dbf4feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:49.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.361+0000 7f07e77fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5583dbb8a390 0x5583dbf4feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56776/0 (socket says 172.21.15.7:56776) 2024-09-21T06:43:49.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.361+0000 7f07e77fe640 1 -- 172.21.15.7:0/2096114910 learned_addr learned my addr 172.21.15.7:0/2096114910 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:43:49.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.361+0000 7f07e6ffd640 1 --2- 172.21.15.7:0/2096114910 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5583dbb699f0 0x5583dbf55eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:49.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.362+0000 7f07dffff640 1 --2- 172.21.15.7:0/2096114910 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5583dbb821b0 0x5583dbf6a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:49.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.362+0000 7f07e77fe640 1 -- 172.21.15.7:0/2096114910 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5583dbb821b0 msgr2=0x5583dbf6a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:49.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.362+0000 7f07e77fe640 1 --2- 172.21.15.7:0/2096114910 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5583dbb821b0 0x5583dbf6a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:49.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.362+0000 7f07e77fe640 1 -- 172.21.15.7:0/2096114910 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5583dbb699f0 msgr2=0x5583dbf55eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:49.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.362+0000 7f07e77fe640 1 --2- 172.21.15.7:0/2096114910 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5583dbb699f0 0x5583dbf55eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:49.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.362+0000 7f07e77fe640 1 -- 172.21.15.7:0/2096114910 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583dbf58a50 con 0x5583dbb8a390 2024-09-21T06:43:49.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.362+0000 7f07dffff640 1 --2- 172.21.15.7:0/2096114910 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5583dbb821b0 0x5583dbf6a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:43:49.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.362+0000 7f07e6ffd640 1 --2- 172.21.15.7:0/2096114910 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5583dbb699f0 0x5583dbf55eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:43:49.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.362+0000 7f07e77fe640 1 --2- 172.21.15.7:0/2096114910 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5583dbb8a390 0x5583dbf4feb0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f07e00e53c0 tx=0x7f07e0018400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac16de7b72783fe9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:49.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.362+0000 7f07dd7fa640 1 -- 172.21.15.7:0/2096114910 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07e00ad520 con 0x5583dbb8a390 2024-09-21T06:43:49.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.362+0000 7f07dd7fa640 1 -- 172.21.15.7:0/2096114910 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f07e00ae110 con 0x5583dbb8a390 2024-09-21T06:43:49.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.362+0000 7f07dd7fa640 1 -- 172.21.15.7:0/2096114910 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07e00e5720 con 0x5583dbb8a390 2024-09-21T06:43:49.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.363+0000 7f07f3e32740 1 -- 172.21.15.7:0/2096114910 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5583dbb8a390 msgr2=0x5583dbf4feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:49.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.363+0000 7f07f3e32740 1 --2- 172.21.15.7:0/2096114910 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5583dbb8a390 0x5583dbf4feb0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f07e00e53c0 tx=0x7f07e0018400 comp rx=0 tx=0).stop 2024-09-21T06:43:49.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.363+0000 7f07f3e32740 1 -- 172.21.15.7:0/2096114910 shutdown_connections 2024-09-21T06:43:49.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.363+0000 7f07f3e32740 1 --2- 172.21.15.7:0/2096114910 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5583dbb8a390 0x5583dbf4feb0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:49.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.363+0000 7f07f3e32740 1 --2- 172.21.15.7:0/2096114910 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5583dbb821b0 0x5583dbf6a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:49.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.363+0000 7f07f3e32740 1 --2- 172.21.15.7:0/2096114910 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5583dbb699f0 0x5583dbf55eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:49.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.363+0000 7f07f3e32740 1 -- 172.21.15.7:0/2096114910 >> 172.21.15.7:0/2096114910 conn(0x5583dbb9f460 msgr2=0x5583dbf557a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:49.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.363+0000 7f07f3e32740 1 -- 172.21.15.7:0/2096114910 shutdown_connections 2024-09-21T06:43:49.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.363+0000 7f07f3e32740 1 -- 172.21.15.7:0/2096114910 wait complete. 2024-09-21T06:43:49.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.364+0000 7f07f3e32740 1 -- start start 2024-09-21T06:43:49.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.364+0000 7f07f3e32740 1 Processor -- start 2024-09-21T06:43:49.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.364+0000 7f07f3e32740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5583dbb699f0 0x5583dbf62480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:49.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.364+0000 7f07f3e32740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5583dbb821b0 0x5583dbf629c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:49.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.364+0000 7f07f3e32740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5583dbb8a390 0x5583dbfd9a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:49.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.364+0000 7f07f3e32740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f07e81adb70 con 0x5583dbb699f0 2024-09-21T06:43:49.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.364+0000 7f07f3e32740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f07e81aefe0 con 0x5583dbb821b0 2024-09-21T06:43:49.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.364+0000 7f07f3e32740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f07e81ae240 con 0x5583dbb8a390 2024-09-21T06:43:49.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.364+0000 7f07f3e32740 10 client.0 _ll_register_callbacks cb 0x7f07d0041050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:43:49.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.364+0000 7f07e6ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5583dbb699f0 0x5583dbf62480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:49.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.364+0000 7f07e6ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5583dbb699f0 0x5583dbf62480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:56778/0 (socket says 172.21.15.7:56778) 2024-09-21T06:43:49.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.365+0000 7f07e6ffd640 1 -- 172.21.15.7:0/751379972 learned_addr learned my addr 172.21.15.7:0/751379972 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:43:49.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.365+0000 7f07dffff640 1 --2- 172.21.15.7:0/751379972 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5583dbb821b0 0x5583dbf629c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:49.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.365+0000 7f07e77fe640 1 --2- 172.21.15.7:0/751379972 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5583dbb8a390 0x5583dbfd9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:49.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.365+0000 7f07e6ffd640 1 -- 172.21.15.7:0/751379972 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5583dbb8a390 msgr2=0x5583dbfd9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:49.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.365+0000 7f07e6ffd640 1 --2- 172.21.15.7:0/751379972 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5583dbb8a390 0x5583dbfd9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:49.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.365+0000 7f07e6ffd640 1 -- 172.21.15.7:0/751379972 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5583dbb821b0 msgr2=0x5583dbf629c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:49.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.365+0000 7f07e6ffd640 1 --2- 172.21.15.7:0/751379972 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5583dbb821b0 0x5583dbf629c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:49.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.365+0000 7f07e6ffd640 1 -- 172.21.15.7:0/751379972 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583dbfd9fb0 con 0x5583dbb699f0 2024-09-21T06:43:49.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.365+0000 7f07dffff640 1 --2- 172.21.15.7:0/751379972 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5583dbb821b0 0x5583dbf629c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:43:49.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.365+0000 7f07e6ffd640 1 --2- 172.21.15.7:0/751379972 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5583dbb699f0 0x5583dbf62480 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f07d8005fd0 tx=0x7f07d800b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cc012c359213f38 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:49.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.365+0000 7f07c6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:43:49.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.365+0000 7f07c6ffd640 1 -- 172.21.15.7:0/751379972 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07d8015040 con 0x5583dbb699f0 2024-09-21T06:43:49.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.365+0000 7f07c6ffd640 1 -- 172.21.15.7:0/751379972 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8412+0+0 (secure 0 0 0) 0x7f07d8004400 con 0x5583dbb699f0 2024-09-21T06:43:49.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.365+0000 7f07f3e32740 1 -- 172.21.15.7:0/751379972 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f07e00ae110 con 0x5583dbb699f0 2024-09-21T06:43:49.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.365+0000 7f07c6ffd640 1 -- 172.21.15.7:0/751379972 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f07d8005040 con 0x5583dbb699f0 2024-09-21T06:43:49.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.366+0000 7f07f3e32740 10 client.16953 fetch_fsmap learned FSMap version 25 2024-09-21T06:43:49.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.366+0000 7f07f3e32740 1 -- 172.21.15.7:0/751379972 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5583dbfdb0a0 con 0x5583dbb699f0 2024-09-21T06:43:49.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.366+0000 7f07c6ffd640 1 -- 172.21.15.7:0/751379972 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f07e00ae110 con 0x5583dbb699f0 2024-09-21T06:43:49.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.366+0000 7f07c6ffd640 1 -- 172.21.15.7:0/751379972 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f07d8004c80 con 0x5583dbb699f0 2024-09-21T06:43:49.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.366+0000 7f07f3e32740 10 client.16953 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:43:49.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.366+0000 7f07f3e32740 10 client.16953 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:43:49.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.366+0000 7f07f3e32740 20 client.16953 populate_metadata read hostname 'smithi007' 2024-09-21T06:43:49.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.366+0000 7f07f3e32740 1 --2- 172.21.15.7:0/751379972 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x5583dbbab070 0x5583dbfdd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:49.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.366+0000 7f07f3e32740 4 client.16953 mds_command: new command op to 24688 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:43:49.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.366+0000 7f07f3e32740 1 -- 172.21.15.7:0/751379972 --> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5583dbec68a0 con 0x5583dbbab070 2024-09-21T06:43:49.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.366+0000 7f07dffff640 1 --2- 172.21.15.7:0/751379972 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x5583dbbab070 0x5583dbfdd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:49.372 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:43:48 smithi018 ceph-mon[34477]: pgmap v549: 97 pgs: 97 active+clean; 3.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2024-09-21T06:43:49.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.367+0000 7f07dffff640 1 --2- 172.21.15.7:0/751379972 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x5583dbbab070 0x5583dbfdd5d0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=452314e4efd70a1 server_cookie=5aa8b40088e1ad3c in_seq=0 out_seq=0 2024-09-21T06:43:49.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.367+0000 7f07c6ffd640 10 client.16953 ms_handle_connect on v2:172.21.15.144:6838/4027821922 2024-09-21T06:43:49.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.367+0000 7f07c6ffd640 1 -- 172.21.15.7:0/751379972 <== mds.1 v2:172.21.15.144:6838/4027821922 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5583dbec68a0 con 0x5583dbbab070 2024-09-21T06:43:49.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.367+0000 7f07c6ffd640 10 client.16953 handle_command_reply: tid=0 2024-09-21T06:43:49.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.367+0000 7f07f3e32740 1 client.16953 shutdown 2024-09-21T06:43:49.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.367+0000 7f07f3e32740 1 -- 172.21.15.7:0/751379972 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5583dbb699f0 msgr2=0x5583dbf62480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:49.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.367+0000 7f07f3e32740 1 --2- 172.21.15.7:0/751379972 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5583dbb699f0 0x5583dbf62480 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f07d8005fd0 tx=0x7f07d800b840 comp rx=0 tx=0).stop 2024-09-21T06:43:49.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.367+0000 7f07f3e32740 1 -- 172.21.15.7:0/751379972 shutdown_connections 2024-09-21T06:43:49.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.367+0000 7f07f3e32740 1 --2- 172.21.15.7:0/751379972 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x5583dbbab070 0x5583dbfdd5d0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:49.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.367+0000 7f07f3e32740 1 --2- 172.21.15.7:0/751379972 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5583dbb8a390 0x5583dbfd9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:49.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.367+0000 7f07f3e32740 1 --2- 172.21.15.7:0/751379972 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5583dbb821b0 0x5583dbf629c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:49.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.367+0000 7f07f3e32740 1 --2- 172.21.15.7:0/751379972 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5583dbb699f0 0x5583dbf62480 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:49.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.367+0000 7f07f3e32740 1 -- 172.21.15.7:0/751379972 >> 172.21.15.7:0/751379972 conn(0x5583dbb9f460 msgr2=0x5583dbf4fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:49.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.368+0000 7f07c6ffd640 0 client.16953 ms_handle_reset on v2:172.21.15.144:6838/4027821922 2024-09-21T06:43:49.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.368+0000 7f07f3e32740 1 -- 172.21.15.7:0/751379972 shutdown_connections 2024-09-21T06:43:49.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.368+0000 7f07f3e32740 1 -- 172.21.15.7:0/751379972 wait complete. 2024-09-21T06:43:49.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.368+0000 7f07f3e32740 20 client.16953 trim_cache size 0 max 16384 2024-09-21T06:43:49.375 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:43:49.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.368+0000 7f07ed8be640 1 -- 172.21.15.7:0/2207346037 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f07d40b66b0 msgr2=0x7f07d40b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:49.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.368+0000 7f07ed8be640 1 --2- 172.21.15.7:0/2207346037 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f07d40b66b0 0x7f07d40b8bc0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f07e807a060 tx=0x7f07d0031400 comp rx=0 tx=0).stop 2024-09-21T06:43:49.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.368+0000 7f07ed8be640 1 -- 172.21.15.7:0/2207346037 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07e810de30 msgr2=0x7f07e819fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:49.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.368+0000 7f07ed8be640 1 --2- 172.21.15.7:0/2207346037 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07e810de30 0x7f07e819fe40 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f07e000cce0 tx=0x7f07e000a620 comp rx=0 tx=0).stop 2024-09-21T06:43:49.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.368+0000 7f07ed8be640 1 -- 172.21.15.7:0/2207346037 shutdown_connections 2024-09-21T06:43:49.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.368+0000 7f07ed8be640 1 --2- 172.21.15.7:0/2207346037 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f07d40b66b0 0x7f07d40b8bc0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:49.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.368+0000 7f07ed8be640 1 --2- 172.21.15.7:0/2207346037 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f07e810de30 0x7f07e819fe40 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:49.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.368+0000 7f07ed8be640 1 --2- 172.21.15.7:0/2207346037 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f07e8105320 0x7f07e819aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:49.376 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.368+0000 7f07ed8be640 1 --2- 172.21.15.7:0/2207346037 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f07e81049d0 0x7f07e819a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:49.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.368+0000 7f07ed8be640 1 -- 172.21.15.7:0/2207346037 >> 172.21.15.7:0/2207346037 conn(0x7f07e8079740 msgr2=0x7f07e80ff8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:49.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.368+0000 7f07ed8be640 1 -- 172.21.15.7:0/2207346037 shutdown_connections 2024-09-21T06:43:49.377 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:49.368+0000 7f07ed8be640 1 -- 172.21.15.7:0/2207346037 wait complete. 2024-09-21T06:43:50.085 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:43:50.344 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:43:50.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.835+0000 7f5b26955640 1 -- 172.21.15.7:0/1174055271 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b20105300 msgr2=0x7f5b2010d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:50.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.835+0000 7f5b26955640 1 --2- 172.21.15.7:0/1174055271 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b20105300 0x7f5b2010d850 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f5b14009900 tx=0x7f5b1402a410 comp rx=0 tx=0).stop 2024-09-21T06:43:50.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.835+0000 7f5b26955640 1 -- 172.21.15.7:0/1174055271 shutdown_connections 2024-09-21T06:43:50.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.835+0000 7f5b26955640 1 --2- 172.21.15.7:0/1174055271 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b2010de10 0x7f5b20110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:50.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.835+0000 7f5b26955640 1 --2- 172.21.15.7:0/1174055271 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b20105300 0x7f5b2010d850 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:50.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.835+0000 7f5b26955640 1 --2- 172.21.15.7:0/1174055271 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5b201049b0 0x7f5b20104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:50.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.835+0000 7f5b26955640 1 -- 172.21.15.7:0/1174055271 >> 172.21.15.7:0/1174055271 conn(0x7f5b20079730 msgr2=0x7f5b20079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:50.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.835+0000 7f5b26955640 1 -- 172.21.15.7:0/1174055271 shutdown_connections 2024-09-21T06:43:50.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.835+0000 7f5b26955640 1 -- 172.21.15.7:0/1174055271 wait complete. 2024-09-21T06:43:50.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.836+0000 7f5b26955640 1 Processor -- start 2024-09-21T06:43:50.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.836+0000 7f5b26955640 1 -- start start 2024-09-21T06:43:50.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.837+0000 7f5b26955640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b201049b0 0x7f5b201026f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:50.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.837+0000 7f5b26955640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b20105300 0x7f5b20102c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:50.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.837+0000 7f5b26955640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5b2010de10 0x7f5b20103170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:50.840 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.837+0000 7f5b26955640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5b20113a70 con 0x7f5b201049b0 2024-09-21T06:43:50.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.837+0000 7f5b26955640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5b201138f0 con 0x7f5b2010de10 2024-09-21T06:43:50.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.837+0000 7f5b26955640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5b20113bf0 con 0x7f5b20105300 2024-09-21T06:43:50.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.837+0000 7f5b1ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b201049b0 0x7f5b201026f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:50.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.837+0000 7f5b1ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b201049b0 0x7f5b201026f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51392/0 (socket says 172.21.15.7:51392) 2024-09-21T06:43:50.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.837+0000 7f5b1ffff640 1 -- 172.21.15.7:0/3356789090 learned_addr learned my addr 172.21.15.7:0/3356789090 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:43:50.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.837+0000 7f5b24ef2640 1 --2- 172.21.15.7:0/3356789090 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5b2010de10 0x7f5b20103170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:50.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.837+0000 7f5b1ffff640 1 -- 172.21.15.7:0/3356789090 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b20105300 msgr2=0x7f5b20102c30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T06:43:50.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.837+0000 7f5b1ffff640 1 --2- 172.21.15.7:0/3356789090 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b20105300 0x7f5b20102c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:50.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.837+0000 7f5b1ffff640 1 -- 172.21.15.7:0/3356789090 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5b2010de10 msgr2=0x7f5b20103170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:50.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.837+0000 7f5b1ffff640 1 --2- 172.21.15.7:0/3356789090 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5b2010de10 0x7f5b20103170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:50.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.837+0000 7f5b1ffff640 1 -- 172.21.15.7:0/3356789090 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b201a8780 con 0x7f5b201049b0 2024-09-21T06:43:50.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.837+0000 7f5b1ffff640 1 --2- 172.21.15.7:0/3356789090 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b201049b0 0x7f5b201026f0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f5b1000e9c0 tx=0x7f5b1000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:50.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.837+0000 7f5b1d7fa640 1 -- 172.21.15.7:0/3356789090 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b1000cd80 con 0x7f5b201049b0 2024-09-21T06:43:50.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.838+0000 7f5b1d7fa640 1 -- 172.21.15.7:0/3356789090 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b100035f0 con 0x7f5b201049b0 2024-09-21T06:43:50.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.838+0000 7f5b26955640 1 -- 172.21.15.7:0/3356789090 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b201a8a70 con 0x7f5b201049b0 2024-09-21T06:43:50.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.838+0000 7f5b1d7fa640 1 -- 172.21.15.7:0/3356789090 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b10010690 con 0x7f5b201049b0 2024-09-21T06:43:50.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.838+0000 7f5b26955640 1 -- 172.21.15.7:0/3356789090 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b201a9000 con 0x7f5b201049b0 2024-09-21T06:43:50.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.840+0000 7f5b2cec9740 1 Processor -- start 2024-09-21T06:43:50.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.840+0000 7f5b2cec9740 1 -- start start 2024-09-21T06:43:50.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.840+0000 7f5b1d7fa640 1 -- 172.21.15.7:0/3356789090 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f5b100037a0 con 0x7f5b201049b0 2024-09-21T06:43:50.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.840+0000 7f5b2cec9740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5593ea250070 0x5593ea5f72c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:50.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.841+0000 7f5b2cec9740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593ea2271b0 0x5593ea5f7800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:50.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.841+0000 7f5b2cec9740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5593ea22f390 0x5593ea5f7d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:50.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.841+0000 7f5b2cec9740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5593ea56dea0 con 0x5593ea2271b0 2024-09-21T06:43:50.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.841+0000 7f5b2cec9740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5593ea55d2d0 con 0x5593ea250070 2024-09-21T06:43:50.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.841+0000 7f5b2cec9740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5593ea5610e0 con 0x5593ea22f390 2024-09-21T06:43:50.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.841+0000 7f5b1ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593ea2271b0 0x5593ea5f7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:50.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.841+0000 7f5b1ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593ea2271b0 0x5593ea5f7800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51394/0 (socket says 172.21.15.7:51394) 2024-09-21T06:43:50.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.841+0000 7f5b1ffff640 1 -- 172.21.15.7:0/1992944318 learned_addr learned my addr 172.21.15.7:0/1992944318 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:43:50.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.841+0000 7f5b1f7fe640 1 --2- 172.21.15.7:0/1992944318 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5593ea22f390 0x5593ea5f7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:50.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.841+0000 7f5b24ef2640 1 --2- 172.21.15.7:0/1992944318 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5593ea250070 0x5593ea5f72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:50.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.841+0000 7f5b1ffff640 1 -- 172.21.15.7:0/1992944318 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5593ea22f390 msgr2=0x5593ea5f7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:50.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.841+0000 7f5b1ffff640 1 --2- 172.21.15.7:0/1992944318 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5593ea22f390 0x5593ea5f7d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:50.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.841+0000 7f5b1ffff640 1 -- 172.21.15.7:0/1992944318 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5593ea250070 msgr2=0x5593ea5f72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:50.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.841+0000 7f5b1ffff640 1 --2- 172.21.15.7:0/1992944318 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5593ea250070 0x5593ea5f72c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:50.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.841+0000 7f5b1ffff640 1 -- 172.21.15.7:0/1992944318 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593ea2bb650 con 0x5593ea2271b0 2024-09-21T06:43:50.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.841+0000 7f5b1ffff640 1 --2- 172.21.15.7:0/1992944318 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593ea2271b0 0x5593ea5f7800 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f5b100e5230 tx=0x7f5b100ebc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10e53236aaf2ba3c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:50.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.842+0000 7f5b1d7fa640 1 --2- 172.21.15.7:0/3356789090 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f5b080b6700 0x7f5b080b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:50.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.842+0000 7f5b067fc640 1 -- 172.21.15.7:0/1992944318 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b100f7020 con 0x5593ea2271b0 2024-09-21T06:43:50.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.842+0000 7f5b24ef2640 1 --2- 172.21.15.7:0/3356789090 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f5b080b6700 0x7f5b080b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:50.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.842+0000 7f5b067fc640 1 -- 172.21.15.7:0/1992944318 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b100ad4d0 con 0x5593ea2271b0 2024-09-21T06:43:50.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.842+0000 7f5b067fc640 1 -- 172.21.15.7:0/1992944318 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b100ad130 con 0x5593ea2271b0 2024-09-21T06:43:50.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.842+0000 7f5b1d7fa640 1 -- 172.21.15.7:0/3356789090 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8412+0+0 (secure 0 0 0) 0x7f5b100e7b00 con 0x7f5b201049b0 2024-09-21T06:43:50.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.843+0000 7f5b2cec9740 1 -- 172.21.15.7:0/1992944318 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593ea2271b0 msgr2=0x5593ea5f7800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:50.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.843+0000 7f5b24ef2640 1 --2- 172.21.15.7:0/3356789090 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f5b080b6700 0x7f5b080b8c10 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f5b18005fd0 tx=0x7f5b180095a0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:50.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.843+0000 7f5b2cec9740 1 --2- 172.21.15.7:0/1992944318 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593ea2271b0 0x5593ea5f7800 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f5b100e5230 tx=0x7f5b100ebc40 comp rx=0 tx=0).stop 2024-09-21T06:43:50.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.843+0000 7f5b2cec9740 1 -- 172.21.15.7:0/1992944318 shutdown_connections 2024-09-21T06:43:50.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.843+0000 7f5b2cec9740 1 --2- 172.21.15.7:0/1992944318 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5593ea22f390 0x5593ea5f7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:50.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.843+0000 7f5b2cec9740 1 --2- 172.21.15.7:0/1992944318 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593ea2271b0 0x5593ea5f7800 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:50.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.843+0000 7f5b2cec9740 1 --2- 172.21.15.7:0/1992944318 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5593ea250070 0x5593ea5f72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:50.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.843+0000 7f5b2cec9740 1 -- 172.21.15.7:0/1992944318 >> 172.21.15.7:0/1992944318 conn(0x5593ea244460 msgr2=0x5593ea5f51b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:50.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.843+0000 7f5b2cec9740 1 -- 172.21.15.7:0/1992944318 shutdown_connections 2024-09-21T06:43:50.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.843+0000 7f5b2cec9740 1 -- 172.21.15.7:0/1992944318 wait complete. 2024-09-21T06:43:50.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.843+0000 7f5b2cec9740 1 -- start start 2024-09-21T06:43:50.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.844+0000 7f5b2cec9740 1 Processor -- start 2024-09-21T06:43:50.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.844+0000 7f5b2cec9740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593ea2271b0 0x5593ea602940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:50.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.844+0000 7f5b2cec9740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5593ea22f390 0x5593ea602e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:50.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.844+0000 7f5b2cec9740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5593ea250070 0x5593ea6033e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:50.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.844+0000 7f5b2cec9740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5593ea3be700 con 0x5593ea2271b0 2024-09-21T06:43:50.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.844+0000 7f5b2cec9740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5593ea4f8160 con 0x5593ea22f390 2024-09-21T06:43:50.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.844+0000 7f5b2cec9740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5593ea605aa0 con 0x5593ea250070 2024-09-21T06:43:50.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.844+0000 7f5b2cec9740 10 client.0 _ll_register_callbacks cb 0x5593ea5119e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:43:50.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.844+0000 7f5b1ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593ea2271b0 0x5593ea602940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:50.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.844+0000 7f5b1ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593ea2271b0 0x5593ea602940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51408/0 (socket says 172.21.15.7:51408) 2024-09-21T06:43:50.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.844+0000 7f5b1ffff640 1 -- 172.21.15.7:0/1343532590 learned_addr learned my addr 172.21.15.7:0/1343532590 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:43:50.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.844+0000 7f5b1f7fe640 1 --2- 172.21.15.7:0/1343532590 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5593ea22f390 0x5593ea602e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:50.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.844+0000 7f5b1ffff640 1 -- 172.21.15.7:0/1343532590 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5593ea250070 msgr2=0x5593ea6033e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:50.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.844+0000 7f5b24ef2640 1 --2- 172.21.15.7:0/1343532590 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5593ea250070 0x5593ea6033e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:50.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.844+0000 7f5b1ffff640 1 --2- 172.21.15.7:0/1343532590 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5593ea250070 0x5593ea6033e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:50.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.844+0000 7f5b1ffff640 1 -- 172.21.15.7:0/1343532590 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5593ea22f390 msgr2=0x5593ea602e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:50.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.844+0000 7f5b1ffff640 1 --2- 172.21.15.7:0/1343532590 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5593ea22f390 0x5593ea602e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:50.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.844+0000 7f5b1ffff640 1 -- 172.21.15.7:0/1343532590 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593ea525c90 con 0x5593ea2271b0 2024-09-21T06:43:50.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.844+0000 7f5b24ef2640 1 --2- 172.21.15.7:0/1343532590 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5593ea250070 0x5593ea6033e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:43:50.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.845+0000 7f5b1ffff640 1 --2- 172.21.15.7:0/1343532590 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593ea2271b0 0x5593ea602940 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f5b100058c0 tx=0x7f5b10003cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4cf1b8c7efa46e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:50.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.845+0000 7f5aff7fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:43:50.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.845+0000 7f5aff7fe640 1 -- 172.21.15.7:0/1343532590 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b100a0040 con 0x5593ea2271b0 2024-09-21T06:43:50.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.845+0000 7f5aff7fe640 1 -- 172.21.15.7:0/1343532590 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8412+0+0 (secure 0 0 0) 0x7f5b100a9c30 con 0x5593ea2271b0 2024-09-21T06:43:50.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.845+0000 7f5b2cec9740 1 -- 172.21.15.7:0/1343532590 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b100ad4d0 con 0x5593ea2271b0 2024-09-21T06:43:50.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.845+0000 7f5aff7fe640 1 -- 172.21.15.7:0/1343532590 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5b1009f3c0 con 0x5593ea2271b0 2024-09-21T06:43:50.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.845+0000 7f5b2cec9740 10 client.16965 fetch_fsmap learned FSMap version 25 2024-09-21T06:43:50.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.845+0000 7f5b2cec9740 1 -- 172.21.15.7:0/1343532590 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5593ea611750 con 0x5593ea2271b0 2024-09-21T06:43:50.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.845+0000 7f5aff7fe640 1 -- 172.21.15.7:0/1343532590 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b100ad4d0 con 0x5593ea2271b0 2024-09-21T06:43:50.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.845+0000 7f5aff7fe640 1 -- 172.21.15.7:0/1343532590 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f5b100b6f50 con 0x5593ea2271b0 2024-09-21T06:43:50.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.845+0000 7f5b2cec9740 10 client.16965 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:43:50.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.845+0000 7f5b2cec9740 10 client.16965 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:43:50.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.845+0000 7f5b2cec9740 20 client.16965 populate_metadata read hostname 'smithi007' 2024-09-21T06:43:50.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.845+0000 7f5b2cec9740 1 --2- 172.21.15.7:0/1343532590 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5593ea20e9f0 0x5593ea614ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:50.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.845+0000 7f5b2cec9740 4 client.16965 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:43:50.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.845+0000 7f5b2cec9740 1 -- 172.21.15.7:0/1343532590 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5593ea56fdf0 con 0x5593ea20e9f0 2024-09-21T06:43:50.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.846+0000 7f5b1f7fe640 1 --2- 172.21.15.7:0/1343532590 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5593ea20e9f0 0x5593ea614ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:50.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.846+0000 7f5aff7fe640 10 client.16965 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:43:50.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.846+0000 7f5b1f7fe640 1 --2- 172.21.15.7:0/1343532590 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5593ea20e9f0 0x5593ea614ab0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=76e627e024f12a9a server_cookie=963e60d9d999f2ac in_seq=0 out_seq=0 2024-09-21T06:43:50.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.847+0000 7f5aff7fe640 1 -- 172.21.15.7:0/1343532590 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5593ea56fdf0 con 0x5593ea20e9f0 2024-09-21T06:43:50.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.847+0000 7f5aff7fe640 10 client.16965 handle_command_reply: tid=0 2024-09-21T06:43:50.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.847+0000 7f5b2cec9740 1 client.16965 shutdown 2024-09-21T06:43:50.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.847+0000 7f5b2cec9740 1 -- 172.21.15.7:0/1343532590 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593ea2271b0 msgr2=0x5593ea602940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:50.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.847+0000 7f5b2cec9740 1 --2- 172.21.15.7:0/1343532590 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593ea2271b0 0x5593ea602940 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f5b100058c0 tx=0x7f5b10003cf0 comp rx=0 tx=0).stop 2024-09-21T06:43:50.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.847+0000 7f5b2cec9740 1 -- 172.21.15.7:0/1343532590 shutdown_connections 2024-09-21T06:43:50.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.847+0000 7f5b2cec9740 1 --2- 172.21.15.7:0/1343532590 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5593ea20e9f0 0x5593ea614ab0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:50.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.847+0000 7f5b2cec9740 1 --2- 172.21.15.7:0/1343532590 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5593ea250070 0x5593ea6033e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:50.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.847+0000 7f5b2cec9740 1 --2- 172.21.15.7:0/1343532590 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5593ea22f390 0x5593ea602e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:50.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.847+0000 7f5b2cec9740 1 --2- 172.21.15.7:0/1343532590 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593ea2271b0 0x5593ea602940 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:50.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.847+0000 7f5b2cec9740 1 -- 172.21.15.7:0/1343532590 >> 172.21.15.7:0/1343532590 conn(0x5593ea244460 msgr2=0x5593ea5f82f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:50.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.847+0000 7f5aff7fe640 0 client.16965 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:43:50.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.847+0000 7f5b2cec9740 1 -- 172.21.15.7:0/1343532590 shutdown_connections 2024-09-21T06:43:50.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.848+0000 7f5b2cec9740 1 -- 172.21.15.7:0/1343532590 wait complete. 2024-09-21T06:43:50.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.848+0000 7f5b2cec9740 20 client.16965 trim_cache size 0 max 16384 2024-09-21T06:43:50.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.861+0000 7f5b2cec9740 1 Processor -- start 2024-09-21T06:43:50.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.861+0000 7f5b2cec9740 1 -- start start 2024-09-21T06:43:50.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.861+0000 7f5b2cec9740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593ea2271b0 0x5593ea602e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:50.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.861+0000 7f5b2cec9740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5593ea22f390 0x5593ea5f4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:50.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.861+0000 7f5b2cec9740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5593ea250070 0x5593ea5f4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:50.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.861+0000 7f5b2cec9740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5b201b4190 con 0x5593ea2271b0 2024-09-21T06:43:50.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.861+0000 7f5b2cec9740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5b201b1a60 con 0x5593ea250070 2024-09-21T06:43:50.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.861+0000 7f5b2cec9740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5b201af8d0 con 0x5593ea22f390 2024-09-21T06:43:50.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.861+0000 7f5b1ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593ea2271b0 0x5593ea602e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:50.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.861+0000 7f5b1ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593ea2271b0 0x5593ea602e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51420/0 (socket says 172.21.15.7:51420) 2024-09-21T06:43:50.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.861+0000 7f5b1ffff640 1 -- 172.21.15.7:0/4274403553 learned_addr learned my addr 172.21.15.7:0/4274403553 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:43:50.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.861+0000 7f5b24ef2640 1 --2- 172.21.15.7:0/4274403553 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5593ea250070 0x5593ea5f4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:50.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.861+0000 7f5b1ffff640 1 -- 172.21.15.7:0/4274403553 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5593ea22f390 msgr2=0x5593ea5f4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:50.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.861+0000 7f5b1ffff640 1 --2- 172.21.15.7:0/4274403553 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5593ea22f390 0x5593ea5f4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:50.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.861+0000 7f5b1ffff640 1 -- 172.21.15.7:0/4274403553 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5593ea250070 msgr2=0x5593ea5f4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:50.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.861+0000 7f5b1ffff640 1 --2- 172.21.15.7:0/4274403553 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5593ea250070 0x5593ea5f4ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:50.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.861+0000 7f5b1ffff640 1 -- 172.21.15.7:0/4274403553 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593ea5f95b0 con 0x5593ea2271b0 2024-09-21T06:43:50.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.861+0000 7f5b24ef2640 1 --2- 172.21.15.7:0/4274403553 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5593ea250070 0x5593ea5f4ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:43:50.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.862+0000 7f5b1ffff640 1 --2- 172.21.15.7:0/4274403553 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593ea2271b0 0x5593ea602e00 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f5b1000cfd0 tx=0x7f5b100eb420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c814e981898c21a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:50.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.862+0000 7f5b05ffb640 1 -- 172.21.15.7:0/4274403553 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b100f7070 con 0x5593ea2271b0 2024-09-21T06:43:50.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.862+0000 7f5b05ffb640 1 -- 172.21.15.7:0/4274403553 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b100ad4d0 con 0x5593ea2271b0 2024-09-21T06:43:50.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.862+0000 7f5b05ffb640 1 -- 172.21.15.7:0/4274403553 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b1009e350 con 0x5593ea2271b0 2024-09-21T06:43:50.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.862+0000 7f5b2cec9740 1 -- 172.21.15.7:0/4274403553 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593ea2271b0 msgr2=0x5593ea602e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:50.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.863+0000 7f5b2cec9740 1 --2- 172.21.15.7:0/4274403553 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593ea2271b0 0x5593ea602e00 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f5b1000cfd0 tx=0x7f5b100eb420 comp rx=0 tx=0).stop 2024-09-21T06:43:50.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.863+0000 7f5b2cec9740 1 -- 172.21.15.7:0/4274403553 shutdown_connections 2024-09-21T06:43:50.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.863+0000 7f5b2cec9740 1 --2- 172.21.15.7:0/4274403553 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5593ea250070 0x5593ea5f4ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:50.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.863+0000 7f5b2cec9740 1 --2- 172.21.15.7:0/4274403553 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5593ea22f390 0x5593ea5f4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:50.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.863+0000 7f5b2cec9740 1 --2- 172.21.15.7:0/4274403553 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593ea2271b0 0x5593ea602e00 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:50.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.863+0000 7f5b2cec9740 1 -- 172.21.15.7:0/4274403553 >> 172.21.15.7:0/4274403553 conn(0x5593ea244460 msgr2=0x5593ea6026f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:50.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.863+0000 7f5b2cec9740 1 -- 172.21.15.7:0/4274403553 shutdown_connections 2024-09-21T06:43:50.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.863+0000 7f5b2cec9740 1 -- 172.21.15.7:0/4274403553 wait complete. 2024-09-21T06:43:50.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.863+0000 7f5b2cec9740 1 -- start start 2024-09-21T06:43:50.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.863+0000 7f5b2cec9740 1 Processor -- start 2024-09-21T06:43:50.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.864+0000 7f5b2cec9740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593ea2271b0 0x5593ea618520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:50.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.864+0000 7f5b2cec9740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5593ea22f390 0x5593ea615a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:50.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.864+0000 7f5b2cec9740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5593ea250070 0x5593ea616180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:50.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.864+0000 7f5b2cec9740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5b201aff20 con 0x5593ea2271b0 2024-09-21T06:43:50.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.864+0000 7f5b2cec9740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5b201b1390 con 0x5593ea250070 2024-09-21T06:43:50.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.864+0000 7f5b2cec9740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5b201b05f0 con 0x5593ea22f390 2024-09-21T06:43:50.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.864+0000 7f5b2cec9740 10 client.0 _ll_register_callbacks cb 0x7f5b18009440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:43:50.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.864+0000 7f5b1ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593ea2271b0 0x5593ea618520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:50.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.864+0000 7f5b1ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593ea2271b0 0x5593ea618520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51436/0 (socket says 172.21.15.7:51436) 2024-09-21T06:43:50.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.864+0000 7f5b1ffff640 1 -- 172.21.15.7:0/2128267255 learned_addr learned my addr 172.21.15.7:0/2128267255 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:43:50.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.864+0000 7f5b1f7fe640 1 --2- 172.21.15.7:0/2128267255 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5593ea22f390 0x5593ea615a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:50.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.864+0000 7f5b24ef2640 1 --2- 172.21.15.7:0/2128267255 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5593ea250070 0x5593ea616180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:50.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.864+0000 7f5b1ffff640 1 -- 172.21.15.7:0/2128267255 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5593ea22f390 msgr2=0x5593ea615a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:50.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.864+0000 7f5b1ffff640 1 --2- 172.21.15.7:0/2128267255 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5593ea22f390 0x5593ea615a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:50.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.864+0000 7f5b1ffff640 1 -- 172.21.15.7:0/2128267255 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5593ea250070 msgr2=0x5593ea616180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:50.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.864+0000 7f5b1ffff640 1 --2- 172.21.15.7:0/2128267255 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5593ea250070 0x5593ea616180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:50.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.864+0000 7f5b1ffff640 1 -- 172.21.15.7:0/2128267255 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593ea67e230 con 0x5593ea2271b0 2024-09-21T06:43:50.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.864+0000 7f5b1f7fe640 1 --2- 172.21.15.7:0/2128267255 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5593ea22f390 0x5593ea615a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:43:50.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.864+0000 7f5b1ffff640 1 --2- 172.21.15.7:0/2128267255 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593ea2271b0 0x5593ea618520 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f5b100a9f90 tx=0x7f5b10009700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba29441b6dca8e98 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:50.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.864+0000 7f5aff7fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:43:50.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.864+0000 7f5aff7fe640 1 -- 172.21.15.7:0/2128267255 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b100f7030 con 0x5593ea2271b0 2024-09-21T06:43:50.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.864+0000 7f5aff7fe640 1 -- 172.21.15.7:0/2128267255 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8412+0+0 (secure 0 0 0) 0x7f5b100a9c30 con 0x5593ea2271b0 2024-09-21T06:43:50.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.865+0000 7f5b2cec9740 1 -- 172.21.15.7:0/2128267255 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b100ad4d0 con 0x5593ea2271b0 2024-09-21T06:43:50.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.865+0000 7f5aff7fe640 1 -- 172.21.15.7:0/2128267255 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5b1009ea90 con 0x5593ea2271b0 2024-09-21T06:43:50.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.865+0000 7f5b2cec9740 10 client.16971 fetch_fsmap learned FSMap version 25 2024-09-21T06:43:50.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.865+0000 7f5b2cec9740 1 -- 172.21.15.7:0/2128267255 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5593ea67e230 con 0x5593ea2271b0 2024-09-21T06:43:50.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.865+0000 7f5aff7fe640 1 -- 172.21.15.7:0/2128267255 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b100ad4d0 con 0x5593ea2271b0 2024-09-21T06:43:50.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.865+0000 7f5aff7fe640 1 -- 172.21.15.7:0/2128267255 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f5b100e5540 con 0x5593ea2271b0 2024-09-21T06:43:50.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.865+0000 7f5b2cec9740 10 client.16971 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:43:50.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.865+0000 7f5b2cec9740 10 client.16971 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:43:50.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.865+0000 7f5b2cec9740 20 client.16971 populate_metadata read hostname 'smithi007' 2024-09-21T06:43:50.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.865+0000 7f5b2cec9740 1 --2- 172.21.15.7:0/2128267255 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5593ea1e3da0 0x5593ea681680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:50.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.865+0000 7f5b2cec9740 4 client.16971 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:43:50.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.865+0000 7f5b2cec9740 1 -- 172.21.15.7:0/2128267255 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5593ea56b8a0 con 0x5593ea1e3da0 2024-09-21T06:43:50.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.865+0000 7f5b1f7fe640 1 --2- 172.21.15.7:0/2128267255 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5593ea1e3da0 0x5593ea681680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:50.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.866+0000 7f5aff7fe640 10 client.16971 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:43:50.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.866+0000 7f5b1f7fe640 1 --2- 172.21.15.7:0/2128267255 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5593ea1e3da0 0x5593ea681680 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e9008eeaa34f106c server_cookie=135c85b7712be30e in_seq=0 out_seq=0 2024-09-21T06:43:50.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.866+0000 7f5aff7fe640 1 -- 172.21.15.7:0/2128267255 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5593ea56b8a0 con 0x5593ea1e3da0 2024-09-21T06:43:50.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.866+0000 7f5aff7fe640 10 client.16971 handle_command_reply: tid=0 2024-09-21T06:43:50.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.866+0000 7f5b2cec9740 1 client.16971 shutdown 2024-09-21T06:43:50.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.866+0000 7f5b2cec9740 1 -- 172.21.15.7:0/2128267255 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593ea2271b0 msgr2=0x5593ea618520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:50.874 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.866+0000 7f5b2cec9740 1 --2- 172.21.15.7:0/2128267255 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593ea2271b0 0x5593ea618520 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f5b100a9f90 tx=0x7f5b10009700 comp rx=0 tx=0).stop 2024-09-21T06:43:50.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.866+0000 7f5b2cec9740 1 -- 172.21.15.7:0/2128267255 shutdown_connections 2024-09-21T06:43:50.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.866+0000 7f5b2cec9740 1 --2- 172.21.15.7:0/2128267255 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5593ea1e3da0 0x5593ea681680 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:50.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.866+0000 7f5b2cec9740 1 --2- 172.21.15.7:0/2128267255 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5593ea250070 0x5593ea616180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:50.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.866+0000 7f5b2cec9740 1 --2- 172.21.15.7:0/2128267255 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5593ea22f390 0x5593ea615a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:50.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.866+0000 7f5b2cec9740 1 --2- 172.21.15.7:0/2128267255 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5593ea2271b0 0x5593ea618520 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:50.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.866+0000 7f5b2cec9740 1 -- 172.21.15.7:0/2128267255 >> 172.21.15.7:0/2128267255 conn(0x5593ea244460 msgr2=0x5593ea60dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:50.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.866+0000 7f5aff7fe640 0 client.16971 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:43:50.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.866+0000 7f5b2cec9740 1 -- 172.21.15.7:0/2128267255 shutdown_connections 2024-09-21T06:43:50.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.866+0000 7f5b2cec9740 1 -- 172.21.15.7:0/2128267255 wait complete. 2024-09-21T06:43:50.875 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.866+0000 7f5b2cec9740 20 client.16971 trim_cache size 0 max 16384 2024-09-21T06:43:50.875 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:43:50.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.867+0000 7f5b26955640 1 -- 172.21.15.7:0/3356789090 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f5b080b6700 msgr2=0x7f5b080b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:50.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.867+0000 7f5b26955640 1 --2- 172.21.15.7:0/3356789090 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f5b080b6700 0x7f5b080b8c10 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f5b18005fd0 tx=0x7f5b180095a0 comp rx=0 tx=0).stop 2024-09-21T06:43:50.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.867+0000 7f5b26955640 1 -- 172.21.15.7:0/3356789090 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b201049b0 msgr2=0x7f5b201026f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:50.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.867+0000 7f5b26955640 1 --2- 172.21.15.7:0/3356789090 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b201049b0 0x7f5b201026f0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f5b1000e9c0 tx=0x7f5b1000ee80 comp rx=0 tx=0).stop 2024-09-21T06:43:50.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.867+0000 7f5b26955640 1 -- 172.21.15.7:0/3356789090 shutdown_connections 2024-09-21T06:43:50.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.867+0000 7f5b26955640 1 --2- 172.21.15.7:0/3356789090 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f5b080b6700 0x7f5b080b8c10 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:50.876 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.867+0000 7f5b26955640 1 --2- 172.21.15.7:0/3356789090 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5b2010de10 0x7f5b20103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:50.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.867+0000 7f5b26955640 1 --2- 172.21.15.7:0/3356789090 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5b20105300 0x7f5b20102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:50.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.867+0000 7f5b26955640 1 --2- 172.21.15.7:0/3356789090 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5b201049b0 0x7f5b201026f0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:50.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.867+0000 7f5b26955640 1 -- 172.21.15.7:0/3356789090 >> 172.21.15.7:0/3356789090 conn(0x7f5b20079730 msgr2=0x7f5b20100880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:50.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.867+0000 7f5b26955640 1 -- 172.21.15.7:0/3356789090 shutdown_connections 2024-09-21T06:43:50.877 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:50.867+0000 7f5b26955640 1 -- 172.21.15.7:0/3356789090 wait complete. 2024-09-21T06:43:51.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:43:50 smithi007 ceph-mon[30983]: pgmap v550: 97 pgs: 97 active+clean; 3.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:43:51.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:43:50 smithi144 ceph-mon[34653]: pgmap v550: 97 pgs: 97 active+clean; 3.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:43:51.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:43:50 smithi018 ceph-mon[34477]: pgmap v550: 97 pgs: 97 active+clean; 3.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:43:52.580 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:43:52.581 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:43:52.852 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:43:53.262 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:43:52 smithi007 ceph-mon[30983]: pgmap v551: 97 pgs: 97 active+clean; 3.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6 op/s 2024-09-21T06:43:53.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:43:52 smithi144 ceph-mon[34653]: pgmap v551: 97 pgs: 97 active+clean; 3.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6 op/s 2024-09-21T06:43:53.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.356+0000 7f3655e27640 1 -- 172.21.15.7:0/2766982734 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3650108d10 msgr2=0x7f365010f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:53.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.356+0000 7f3655e27640 1 --2- 172.21.15.7:0/2766982734 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3650108d10 0x7f365010f540 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f3648009ca0 tx=0x7f364802a8e0 comp rx=0 tx=0).stop 2024-09-21T06:43:53.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.356+0000 7f3655e27640 1 -- 172.21.15.7:0/2766982734 shutdown_connections 2024-09-21T06:43:53.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.356+0000 7f3655e27640 1 --2- 172.21.15.7:0/2766982734 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3650108d10 0x7f365010f540 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:53.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.356+0000 7f3655e27640 1 --2- 172.21.15.7:0/2766982734 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36501083c0 0x7f36501087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:53.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.356+0000 7f3655e27640 1 --2- 172.21.15.7:0/2766982734 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3650102a80 0x7f3650102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:53.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.356+0000 7f3655e27640 1 -- 172.21.15.7:0/2766982734 >> 172.21.15.7:0/2766982734 conn(0x7f3650079740 msgr2=0x7f3650079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:53.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.356+0000 7f3655e27640 1 -- 172.21.15.7:0/2766982734 shutdown_connections 2024-09-21T06:43:53.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.356+0000 7f3655e27640 1 -- 172.21.15.7:0/2766982734 wait complete. 2024-09-21T06:43:53.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.356+0000 7f3655e27640 1 Processor -- start 2024-09-21T06:43:53.359 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.356+0000 7f3655e27640 1 -- start start 2024-09-21T06:43:53.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.357+0000 7f3655e27640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3650102a80 0x7f365019a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:53.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.357+0000 7f3655e27640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36501083c0 0x7f365019aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:53.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.357+0000 7f3655e27640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3650108d10 0x7f365019fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:53.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.357+0000 7f3655e27640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3650113b10 con 0x7f36501083c0 2024-09-21T06:43:53.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.357+0000 7f3655e27640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3650113990 con 0x7f3650108d10 2024-09-21T06:43:53.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.357+0000 7f3655e27640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3650113c90 con 0x7f3650102a80 2024-09-21T06:43:53.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.357+0000 7f3647fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36501083c0 0x7f365019aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:53.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.357+0000 7f3647fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36501083c0 0x7f365019aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51454/0 (socket says 172.21.15.7:51454) 2024-09-21T06:43:53.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.357+0000 7f3647fff640 1 -- 172.21.15.7:0/450418880 learned_addr learned my addr 172.21.15.7:0/450418880 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:43:53.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.357+0000 7f364ffff640 1 --2- 172.21.15.7:0/450418880 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3650108d10 0x7f365019fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:53.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.357+0000 7f3647fff640 1 -- 172.21.15.7:0/450418880 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3650102a80 msgr2=0x7f365019a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:53.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.357+0000 7f3647fff640 1 --2- 172.21.15.7:0/450418880 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3650102a80 0x7f365019a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:53.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.357+0000 7f3647fff640 1 -- 172.21.15.7:0/450418880 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3650108d10 msgr2=0x7f365019fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:53.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.357+0000 7f3647fff640 1 --2- 172.21.15.7:0/450418880 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3650108d10 0x7f365019fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:53.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.357+0000 7f3647fff640 1 -- 172.21.15.7:0/450418880 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36501a0410 con 0x7f36501083c0 2024-09-21T06:43:53.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.357+0000 7f3647fff640 1 --2- 172.21.15.7:0/450418880 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36501083c0 0x7f365019aa40 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f363800e9c0 tx=0x7f363800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:53.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.358+0000 7f364d7fa640 1 -- 172.21.15.7:0/450418880 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f363800cd80 con 0x7f36501083c0 2024-09-21T06:43:53.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.358+0000 7f364d7fa640 1 -- 172.21.15.7:0/450418880 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f36380054d0 con 0x7f36501083c0 2024-09-21T06:43:53.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.358+0000 7f3655e27640 1 -- 172.21.15.7:0/450418880 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36501a0700 con 0x7f36501083c0 2024-09-21T06:43:53.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.358+0000 7f364d7fa640 1 -- 172.21.15.7:0/450418880 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3638010430 con 0x7f36501083c0 2024-09-21T06:43:53.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.358+0000 7f3655e27640 1 -- 172.21.15.7:0/450418880 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36501a6ee0 con 0x7f36501083c0 2024-09-21T06:43:53.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.360+0000 7f365c39b740 1 Processor -- start 2024-09-21T06:43:53.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.360+0000 7f365c39b740 1 -- start start 2024-09-21T06:43:53.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.361+0000 7f365c39b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562197715350 0x562197abc430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:53.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.361+0000 7f365c39b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5621976ec490 0x562197abc970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:53.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.361+0000 7f365c39b740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5621976f4670 0x562197abceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:53.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.361+0000 7f365c39b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x562197a32e60 con 0x562197715350 2024-09-21T06:43:53.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.361+0000 7f365c39b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x562197a22290 con 0x5621976ec490 2024-09-21T06:43:53.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.361+0000 7f365c39b740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x562197a260a0 con 0x5621976f4670 2024-09-21T06:43:53.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.361+0000 7f364ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562197715350 0x562197abc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:53.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.361+0000 7f364ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562197715350 0x562197abc430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51470/0 (socket says 172.21.15.7:51470) 2024-09-21T06:43:53.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.361+0000 7f364d7fa640 1 -- 172.21.15.7:0/450418880 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f3638005020 con 0x7f36501083c0 2024-09-21T06:43:53.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.361+0000 7f364ffff640 1 -- 172.21.15.7:0/1660869101 learned_addr learned my addr 172.21.15.7:0/1660869101 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:43:53.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.361+0000 7f364f7fe640 1 --2- 172.21.15.7:0/1660869101 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5621976ec490 0x562197abc970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:53.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.361+0000 7f364ffff640 1 -- 172.21.15.7:0/1660869101 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5621976f4670 msgr2=0x562197abceb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T06:43:53.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.361+0000 7f364ffff640 1 --2- 172.21.15.7:0/1660869101 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5621976f4670 0x562197abceb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:53.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.361+0000 7f364ffff640 1 -- 172.21.15.7:0/1660869101 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5621976ec490 msgr2=0x562197abc970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:53.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.361+0000 7f364ffff640 1 --2- 172.21.15.7:0/1660869101 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5621976ec490 0x562197abc970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:53.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.361+0000 7f364ffff640 1 -- 172.21.15.7:0/1660869101 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562197780930 con 0x562197715350 2024-09-21T06:43:53.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.361+0000 7f364ffff640 1 --2- 172.21.15.7:0/1660869101 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562197715350 0x562197abc430 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f3648031470 tx=0x7f36480314a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a67ac5faf31ac9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:53.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.362+0000 7f3645ffb640 1 -- 172.21.15.7:0/1660869101 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3648031ad0 con 0x562197715350 2024-09-21T06:43:53.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.362+0000 7f3645ffb640 1 -- 172.21.15.7:0/1660869101 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3648036040 con 0x562197715350 2024-09-21T06:43:53.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.362+0000 7f3645ffb640 1 -- 172.21.15.7:0/1660869101 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3648004540 con 0x562197715350 2024-09-21T06:43:53.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.362+0000 7f364d7fa640 1 --2- 172.21.15.7:0/450418880 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f363c0b6700 0x7f363c0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:53.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.362+0000 7f364f7fe640 1 --2- 172.21.15.7:0/450418880 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f363c0b6700 0x7f363c0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:53.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.362+0000 7f364d7fa640 1 -- 172.21.15.7:0/450418880 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8412+0+0 (secure 0 0 0) 0x7f36380e7bf0 con 0x7f36501083c0 2024-09-21T06:43:53.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.363+0000 7f365c39b740 1 -- 172.21.15.7:0/1660869101 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562197715350 msgr2=0x562197abc430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:53.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.363+0000 7f364f7fe640 1 --2- 172.21.15.7:0/450418880 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f363c0b6700 0x7f363c0b8c10 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x562197abb0b0 tx=0x7f36400090e0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:53.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.363+0000 7f365c39b740 1 --2- 172.21.15.7:0/1660869101 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562197715350 0x562197abc430 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f3648031470 tx=0x7f36480314a0 comp rx=0 tx=0).stop 2024-09-21T06:43:53.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.363+0000 7f365c39b740 1 -- 172.21.15.7:0/1660869101 shutdown_connections 2024-09-21T06:43:53.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.363+0000 7f365c39b740 1 --2- 172.21.15.7:0/1660869101 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5621976f4670 0x562197abceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:53.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.363+0000 7f365c39b740 1 --2- 172.21.15.7:0/1660869101 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5621976ec490 0x562197abc970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:53.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.363+0000 7f365c39b740 1 --2- 172.21.15.7:0/1660869101 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562197715350 0x562197abc430 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:53.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.363+0000 7f365c39b740 1 -- 172.21.15.7:0/1660869101 >> 172.21.15.7:0/1660869101 conn(0x562197709740 msgr2=0x562197aba320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:53.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.363+0000 7f365c39b740 1 -- 172.21.15.7:0/1660869101 shutdown_connections 2024-09-21T06:43:53.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.363+0000 7f365c39b740 1 -- 172.21.15.7:0/1660869101 wait complete. 2024-09-21T06:43:53.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.363+0000 7f365c39b740 1 -- start start 2024-09-21T06:43:53.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.363+0000 7f365c39b740 1 Processor -- start 2024-09-21T06:43:53.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.364+0000 7f365c39b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5621976ec490 0x562197acc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:53.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.364+0000 7f365c39b740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5621976f4670 0x562197acc930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:53.369 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.364+0000 7f365c39b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562197715350 0x562197ad82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:53.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.364+0000 7f365c39b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x562197883890 con 0x562197715350 2024-09-21T06:43:53.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.364+0000 7f365c39b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5621979bcd40 con 0x5621976ec490 2024-09-21T06:43:53.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.364+0000 7f365c39b740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x562197acef10 con 0x5621976f4670 2024-09-21T06:43:53.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.364+0000 7f365c39b740 10 client.0 _ll_register_callbacks cb 0x562197a20c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:43:53.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.364+0000 7f364ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562197715350 0x562197ad82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:53.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.364+0000 7f364f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5621976ec490 0x562197acc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:53.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.364+0000 7f364f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5621976ec490 0x562197acc3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.7:55492/0 (socket says 172.21.15.7:55492) 2024-09-21T06:43:53.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.364+0000 7f364ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562197715350 0x562197ad82a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51482/0 (socket says 172.21.15.7:51482) 2024-09-21T06:43:53.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.364+0000 7f364f7fe640 1 -- 172.21.15.7:0/3449729918 learned_addr learned my addr 172.21.15.7:0/3449729918 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:43:53.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.364+0000 7f3647fff640 1 --2- 172.21.15.7:0/3449729918 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5621976f4670 0x562197acc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:53.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.364+0000 7f364f7fe640 1 -- 172.21.15.7:0/3449729918 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5621976f4670 msgr2=0x562197acc930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:53.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.364+0000 7f364f7fe640 1 --2- 172.21.15.7:0/3449729918 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5621976f4670 0x562197acc930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:53.370 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.364+0000 7f364f7fe640 1 -- 172.21.15.7:0/3449729918 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562197715350 msgr2=0x562197ad82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:53.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.364+0000 7f364f7fe640 1 --2- 172.21.15.7:0/3449729918 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562197715350 0x562197ad82a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:53.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.364+0000 7f364f7fe640 1 -- 172.21.15.7:0/3449729918 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562197ad8830 con 0x5621976ec490 2024-09-21T06:43:53.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.365+0000 7f364f7fe640 1 --2- 172.21.15.7:0/3449729918 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5621976ec490 0x562197acc3f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3640015700 tx=0x7f36400047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12f769f096bb0620 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:53.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.365+0000 7f362effd640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-21T06:43:53.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.365+0000 7f362effd640 1 -- 172.21.15.7:0/3449729918 <== mon.2 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3640023020 con 0x5621976ec490 2024-09-21T06:43:53.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.365+0000 7f362effd640 1 -- 172.21.15.7:0/3449729918 <== mon.2 v2:172.21.15.18:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8412+0+0 (secure 0 0 0) 0x7f3640013610 con 0x5621976ec490 2024-09-21T06:43:53.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.365+0000 7f365c39b740 1 -- 172.21.15.7:0/3449729918 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3648036040 con 0x5621976ec490 2024-09-21T06:43:53.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.365+0000 7f362effd640 1 -- 172.21.15.7:0/3449729918 <== mon.2 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f364002e050 con 0x5621976ec490 2024-09-21T06:43:53.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.365+0000 7f365c39b740 10 client.26582 fetch_fsmap learned FSMap version 25 2024-09-21T06:43:53.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.365+0000 7f365c39b740 1 -- 172.21.15.7:0/3449729918 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562197adb1c0 con 0x5621976ec490 2024-09-21T06:43:53.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.365+0000 7f362effd640 1 -- 172.21.15.7:0/3449729918 <== mon.2 v2:172.21.15.18:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3648036040 con 0x5621976ec490 2024-09-21T06:43:53.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.366+0000 7f362effd640 1 -- 172.21.15.7:0/3449729918 <== mon.2 v2:172.21.15.18:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f364001e030 con 0x5621976ec490 2024-09-21T06:43:53.371 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.366+0000 7f365c39b740 10 client.26582 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:43:53.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.366+0000 7f365c39b740 10 client.26582 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:43:53.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.366+0000 7f365c39b740 20 client.26582 populate_metadata read hostname 'smithi007' 2024-09-21T06:43:53.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.366+0000 7f365c39b740 1 --2- 172.21.15.7:0/3449729918 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5621976d3cd0 0x562197ade6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:53.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.366+0000 7f365c39b740 4 client.26582 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:43:53.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.366+0000 7f365c39b740 1 -- 172.21.15.7:0/3449729918 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562197a34db0 con 0x5621976d3cd0 2024-09-21T06:43:53.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.366+0000 7f3647fff640 1 --2- 172.21.15.7:0/3449729918 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5621976d3cd0 0x562197ade6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:53.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.366+0000 7f3647fff640 1 --2- 172.21.15.7:0/3449729918 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5621976d3cd0 0x562197ade6e0 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4397c3da331876f2 server_cookie=3b1b1ba574fc6e44 in_seq=0 out_seq=0 2024-09-21T06:43:53.372 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.366+0000 7f362effd640 10 client.26582 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:43:53.373 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:43:52 smithi018 ceph-mon[34477]: pgmap v551: 97 pgs: 97 active+clean; 3.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6 op/s 2024-09-21T06:43:53.373 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.367+0000 7f362effd640 1 -- 172.21.15.7:0/3449729918 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562197a34db0 con 0x5621976d3cd0 2024-09-21T06:43:53.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.367+0000 7f362effd640 10 client.26582 handle_command_reply: tid=0 2024-09-21T06:43:53.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.367+0000 7f365c39b740 1 client.26582 shutdown 2024-09-21T06:43:53.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.367+0000 7f365c39b740 1 -- 172.21.15.7:0/3449729918 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5621976ec490 msgr2=0x562197acc3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:53.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.367+0000 7f365c39b740 1 --2- 172.21.15.7:0/3449729918 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5621976ec490 0x562197acc3f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3640015700 tx=0x7f36400047c0 comp rx=0 tx=0).stop 2024-09-21T06:43:53.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.367+0000 7f365c39b740 1 -- 172.21.15.7:0/3449729918 shutdown_connections 2024-09-21T06:43:53.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.367+0000 7f365c39b740 1 --2- 172.21.15.7:0/3449729918 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5621976d3cd0 0x562197ade6e0 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:53.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.367+0000 7f365c39b740 1 --2- 172.21.15.7:0/3449729918 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562197715350 0x562197ad82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:53.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.367+0000 7f365c39b740 1 --2- 172.21.15.7:0/3449729918 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5621976f4670 0x562197acc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:53.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.367+0000 7f362effd640 0 client.26582 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:43:53.374 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.367+0000 7f365c39b740 1 --2- 172.21.15.7:0/3449729918 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5621976ec490 0x562197acc3f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:53.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.367+0000 7f365c39b740 1 -- 172.21.15.7:0/3449729918 >> 172.21.15.7:0/3449729918 conn(0x562197709740 msgr2=0x562197abde20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:53.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.368+0000 7f365c39b740 1 -- 172.21.15.7:0/3449729918 shutdown_connections 2024-09-21T06:43:53.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.368+0000 7f365c39b740 1 -- 172.21.15.7:0/3449729918 wait complete. 2024-09-21T06:43:53.375 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.368+0000 7f365c39b740 20 client.26582 trim_cache size 0 max 16384 2024-09-21T06:43:53.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.385+0000 7f365c39b740 1 Processor -- start 2024-09-21T06:43:53.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.385+0000 7f365c39b740 1 -- start start 2024-09-21T06:43:53.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.386+0000 7f365c39b740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5621976ec490 0x562197ad81a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:53.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.386+0000 7f365c39b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5621976f4670 0x562197acaa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:53.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.386+0000 7f365c39b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562197715350 0x562197acafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:53.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.386+0000 7f365c39b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f36501afcc0 con 0x5621976f4670 2024-09-21T06:43:53.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.386+0000 7f365c39b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f36501ad590 con 0x562197715350 2024-09-21T06:43:53.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.386+0000 7f365c39b740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f36501ab400 con 0x5621976ec490 2024-09-21T06:43:53.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.386+0000 7f3647fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5621976f4670 0x562197acaa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:53.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.386+0000 7f3647fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5621976f4670 0x562197acaa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51494/0 (socket says 172.21.15.7:51494) 2024-09-21T06:43:53.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.386+0000 7f3647fff640 1 -- 172.21.15.7:0/1077174363 learned_addr learned my addr 172.21.15.7:0/1077174363 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:43:53.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.386+0000 7f364ffff640 1 --2- 172.21.15.7:0/1077174363 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562197715350 0x562197acafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:53.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.386+0000 7f364f7fe640 1 --2- 172.21.15.7:0/1077174363 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5621976ec490 0x562197ad81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:53.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.386+0000 7f3647fff640 1 -- 172.21.15.7:0/1077174363 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5621976ec490 msgr2=0x562197ad81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:53.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.386+0000 7f3647fff640 1 --2- 172.21.15.7:0/1077174363 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5621976ec490 0x562197ad81a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:53.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.386+0000 7f3647fff640 1 -- 172.21.15.7:0/1077174363 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562197715350 msgr2=0x562197acafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:53.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.386+0000 7f3647fff640 1 --2- 172.21.15.7:0/1077174363 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562197715350 0x562197acafb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:53.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.386+0000 7f3647fff640 1 -- 172.21.15.7:0/1077174363 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562197ab59e0 con 0x5621976f4670 2024-09-21T06:43:53.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.386+0000 7f364f7fe640 1 --2- 172.21.15.7:0/1077174363 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5621976ec490 0x562197ad81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:43:53.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.386+0000 7f364ffff640 1 --2- 172.21.15.7:0/1077174363 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562197715350 0x562197acafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:43:53.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.386+0000 7f3647fff640 1 --2- 172.21.15.7:0/1077174363 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5621976f4670 0x562197acaa70 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f36380aad20 tx=0x7f363800efd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=814f2d596519f6e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:53.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.386+0000 7f36457fa640 1 -- 172.21.15.7:0/1077174363 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36380ad220 con 0x5621976f4670 2024-09-21T06:43:53.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.386+0000 7f36457fa640 1 -- 172.21.15.7:0/1077174363 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f36380046c0 con 0x5621976f4670 2024-09-21T06:43:53.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.386+0000 7f36457fa640 1 -- 172.21.15.7:0/1077174363 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36380a9220 con 0x5621976f4670 2024-09-21T06:43:53.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.387+0000 7f365c39b740 1 -- 172.21.15.7:0/1077174363 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5621976f4670 msgr2=0x562197acaa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:53.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.387+0000 7f365c39b740 1 --2- 172.21.15.7:0/1077174363 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5621976f4670 0x562197acaa70 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f36380aad20 tx=0x7f363800efd0 comp rx=0 tx=0).stop 2024-09-21T06:43:53.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.387+0000 7f365c39b740 1 -- 172.21.15.7:0/1077174363 shutdown_connections 2024-09-21T06:43:53.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.387+0000 7f365c39b740 1 --2- 172.21.15.7:0/1077174363 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562197715350 0x562197acafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:53.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.387+0000 7f365c39b740 1 --2- 172.21.15.7:0/1077174363 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5621976f4670 0x562197acaa70 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:53.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.387+0000 7f365c39b740 1 --2- 172.21.15.7:0/1077174363 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5621976ec490 0x562197ad81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:53.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.387+0000 7f365c39b740 1 -- 172.21.15.7:0/1077174363 >> 172.21.15.7:0/1077174363 conn(0x562197709740 msgr2=0x562197ac7330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:53.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.387+0000 7f365c39b740 1 -- 172.21.15.7:0/1077174363 shutdown_connections 2024-09-21T06:43:53.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.387+0000 7f365c39b740 1 -- 172.21.15.7:0/1077174363 wait complete. 2024-09-21T06:43:53.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.388+0000 7f365c39b740 1 -- start start 2024-09-21T06:43:53.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.388+0000 7f365c39b740 1 Processor -- start 2024-09-21T06:43:53.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.388+0000 7f365c39b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5621976ec490 0x562197ad49d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:53.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.388+0000 7f365c39b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5621976f4670 0x562197ad0e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:53.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.388+0000 7f365c39b740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562197715350 0x562197ad13d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:53.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.388+0000 7f365c39b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f36501aba50 con 0x5621976ec490 2024-09-21T06:43:53.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.388+0000 7f365c39b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f36501acec0 con 0x5621976f4670 2024-09-21T06:43:53.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.388+0000 7f365c39b740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f36501ac120 con 0x562197715350 2024-09-21T06:43:53.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.388+0000 7f365c39b740 10 client.0 _ll_register_callbacks cb 0x7f36400096d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:43:53.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.388+0000 7f364f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5621976ec490 0x562197ad49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:53.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.388+0000 7f364f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5621976ec490 0x562197ad49d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51510/0 (socket says 172.21.15.7:51510) 2024-09-21T06:43:53.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.388+0000 7f364f7fe640 1 -- 172.21.15.7:0/2798570915 learned_addr learned my addr 172.21.15.7:0/2798570915 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:43:53.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.389+0000 7f3647fff640 1 --2- 172.21.15.7:0/2798570915 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5621976f4670 0x562197ad0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:53.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.389+0000 7f364ffff640 1 --2- 172.21.15.7:0/2798570915 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562197715350 0x562197ad13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:53.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.389+0000 7f364f7fe640 1 -- 172.21.15.7:0/2798570915 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562197715350 msgr2=0x562197ad13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:53.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.389+0000 7f364f7fe640 1 --2- 172.21.15.7:0/2798570915 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562197715350 0x562197ad13d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:53.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.389+0000 7f364f7fe640 1 -- 172.21.15.7:0/2798570915 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5621976f4670 msgr2=0x562197ad0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:53.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.389+0000 7f364f7fe640 1 --2- 172.21.15.7:0/2798570915 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5621976f4670 0x562197ad0e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:53.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.389+0000 7f364f7fe640 1 -- 172.21.15.7:0/2798570915 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562197ad1b40 con 0x5621976ec490 2024-09-21T06:43:53.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.389+0000 7f364ffff640 1 --2- 172.21.15.7:0/2798570915 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562197715350 0x562197ad13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:43:53.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.389+0000 7f364f7fe640 1 --2- 172.21.15.7:0/2798570915 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5621976ec490 0x562197ad49d0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f3640004790 tx=0x7f36400134e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d4f2175f700746b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:53.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.389+0000 7f362effd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:43:53.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.389+0000 7f362effd640 1 -- 172.21.15.7:0/2798570915 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3640036020 con 0x5621976ec490 2024-09-21T06:43:53.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.389+0000 7f362effd640 1 -- 172.21.15.7:0/2798570915 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8412+0+0 (secure 0 0 0) 0x7f36400059e0 con 0x5621976ec490 2024-09-21T06:43:53.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.389+0000 7f365c39b740 1 -- 172.21.15.7:0/2798570915 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562197a30860 con 0x5621976ec490 2024-09-21T06:43:53.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.389+0000 7f362effd640 1 -- 172.21.15.7:0/2798570915 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3640023040 con 0x5621976ec490 2024-09-21T06:43:53.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.389+0000 7f365c39b740 10 client.16989 fetch_fsmap learned FSMap version 25 2024-09-21T06:43:53.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.389+0000 7f365c39b740 1 -- 172.21.15.7:0/2798570915 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x562197b49fb0 con 0x5621976ec490 2024-09-21T06:43:53.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.390+0000 7f362effd640 1 -- 172.21.15.7:0/2798570915 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x562197a30860 con 0x5621976ec490 2024-09-21T06:43:53.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.390+0000 7f362effd640 1 -- 172.21.15.7:0/2798570915 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f364001e030 con 0x5621976ec490 2024-09-21T06:43:53.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.390+0000 7f365c39b740 10 client.16989 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:43:53.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.390+0000 7f365c39b740 10 client.16989 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:43:53.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.390+0000 7f365c39b740 20 client.16989 populate_metadata read hostname 'smithi007' 2024-09-21T06:43:53.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.390+0000 7f365c39b740 1 --2- 172.21.15.7:0/2798570915 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5621976a9080 0x562197b4c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:53.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.390+0000 7f365c39b740 4 client.16989 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:43:53.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.390+0000 7f365c39b740 1 -- 172.21.15.7:0/2798570915 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x562197a2dc90 con 0x5621976a9080 2024-09-21T06:43:53.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.390+0000 7f3647fff640 1 --2- 172.21.15.7:0/2798570915 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5621976a9080 0x562197b4c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:53.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.391+0000 7f362effd640 10 client.16989 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:43:53.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.391+0000 7f3647fff640 1 --2- 172.21.15.7:0/2798570915 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5621976a9080 0x562197b4c7c0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd6c0938a9f5f708 server_cookie=713cf36e6c31a5d7 in_seq=0 out_seq=0 2024-09-21T06:43:53.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.392+0000 7f362effd640 1 -- 172.21.15.7:0/2798570915 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x562197a2dc90 con 0x5621976a9080 2024-09-21T06:43:53.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.392+0000 7f362effd640 10 client.16989 handle_command_reply: tid=0 2024-09-21T06:43:53.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.392+0000 7f365c39b740 1 client.16989 shutdown 2024-09-21T06:43:53.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.392+0000 7f365c39b740 1 -- 172.21.15.7:0/2798570915 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5621976ec490 msgr2=0x562197ad49d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:53.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.392+0000 7f365c39b740 1 --2- 172.21.15.7:0/2798570915 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5621976ec490 0x562197ad49d0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f3640004790 tx=0x7f36400134e0 comp rx=0 tx=0).stop 2024-09-21T06:43:53.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.393+0000 7f365c39b740 1 -- 172.21.15.7:0/2798570915 shutdown_connections 2024-09-21T06:43:53.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.393+0000 7f365c39b740 1 --2- 172.21.15.7:0/2798570915 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5621976a9080 0x562197b4c7c0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:53.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.393+0000 7f365c39b740 1 --2- 172.21.15.7:0/2798570915 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562197715350 0x562197ad13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:53.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.393+0000 7f365c39b740 1 --2- 172.21.15.7:0/2798570915 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5621976f4670 0x562197ad0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:53.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.393+0000 7f362effd640 0 client.16989 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:43:53.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.393+0000 7f365c39b740 1 --2- 172.21.15.7:0/2798570915 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5621976ec490 0x562197ad49d0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:53.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.393+0000 7f365c39b740 1 -- 172.21.15.7:0/2798570915 >> 172.21.15.7:0/2798570915 conn(0x562197709740 msgr2=0x562197abd460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:53.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.393+0000 7f365c39b740 1 -- 172.21.15.7:0/2798570915 shutdown_connections 2024-09-21T06:43:53.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.393+0000 7f365c39b740 1 -- 172.21.15.7:0/2798570915 wait complete. 2024-09-21T06:43:53.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.393+0000 7f365c39b740 20 client.16989 trim_cache size 0 max 16384 2024-09-21T06:43:53.399 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:43:53.399 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0, 2024-09-21T06:43:53.399 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_tag": "dd792920-08a1-482d-8961-5c6a6f131599", 2024-09-21T06:43:53.399 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": "asynchronous" 2024-09-21T06:43:53.400 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:43:53.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.393+0000 7f3655e27640 1 -- 172.21.15.7:0/450418880 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f363c0b6700 msgr2=0x7f363c0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:53.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.393+0000 7f3655e27640 1 --2- 172.21.15.7:0/450418880 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f363c0b6700 0x7f363c0b8c10 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x562197abb0b0 tx=0x7f36400090e0 comp rx=0 tx=0).stop 2024-09-21T06:43:53.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.393+0000 7f3655e27640 1 -- 172.21.15.7:0/450418880 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36501083c0 msgr2=0x7f365019aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:53.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.393+0000 7f3655e27640 1 --2- 172.21.15.7:0/450418880 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36501083c0 0x7f365019aa40 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f363800e9c0 tx=0x7f363800ee80 comp rx=0 tx=0).stop 2024-09-21T06:43:53.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.394+0000 7f3655e27640 1 -- 172.21.15.7:0/450418880 shutdown_connections 2024-09-21T06:43:53.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.394+0000 7f3655e27640 1 --2- 172.21.15.7:0/450418880 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f363c0b6700 0x7f363c0b8c10 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:53.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.394+0000 7f3655e27640 1 --2- 172.21.15.7:0/450418880 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3650108d10 0x7f365019fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:53.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.394+0000 7f3655e27640 1 --2- 172.21.15.7:0/450418880 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f36501083c0 0x7f365019aa40 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:53.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.394+0000 7f3655e27640 1 --2- 172.21.15.7:0/450418880 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3650102a80 0x7f365019a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:53.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.394+0000 7f3655e27640 1 -- 172.21.15.7:0/450418880 >> 172.21.15.7:0/450418880 conn(0x7f3650079740 msgr2=0x7f3650104390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:53.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.394+0000 7f3655e27640 1 -- 172.21.15.7:0/450418880 shutdown_connections 2024-09-21T06:43:53.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:53.394+0000 7f3655e27640 1 -- 172.21.15.7:0/450418880 wait complete. 2024-09-21T06:43:54.107 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:43:54.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:43:53 smithi144 ceph-mon[34653]: scrub queued for path: / 2024-09-21T06:43:54.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:43:53 smithi144 ceph-mon[34653]: scrub summary: idle+waiting paths [/] 2024-09-21T06:43:54.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:43:53 smithi144 ceph-mon[34653]: scrub summary: active paths [/] 2024-09-21T06:43:54.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:43:53 smithi144 ceph-mon[34653]: scrub summary: idle+waiting paths [/] 2024-09-21T06:43:54.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:43:53 smithi007 ceph-mon[30983]: scrub queued for path: / 2024-09-21T06:43:54.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:43:53 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T06:43:54.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:43:53 smithi007 ceph-mon[30983]: scrub summary: active paths [/] 2024-09-21T06:43:54.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:43:53 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T06:43:54.365 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:43:54.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:43:53 smithi018 ceph-mon[34477]: scrub queued for path: / 2024-09-21T06:43:54.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:43:53 smithi018 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-21T06:43:54.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:43:53 smithi018 ceph-mon[34477]: scrub summary: active paths [/] 2024-09-21T06:43:54.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:43:53 smithi018 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-21T06:43:54.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.983+0000 7f65d3d46640 1 -- 172.21.15.7:0/2766043373 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65cc1094f0 msgr2=0x7f65cc109900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:54.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.983+0000 7f65d3d46640 1 --2- 172.21.15.7:0/2766043373 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65cc1094f0 0x7f65cc109900 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f65bc009900 tx=0x7f65bc02a410 comp rx=0 tx=0).stop 2024-09-21T06:43:54.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.983+0000 7f65d3d46640 1 -- 172.21.15.7:0/2766043373 shutdown_connections 2024-09-21T06:43:54.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.983+0000 7f65d3d46640 1 --2- 172.21.15.7:0/2766043373 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65cc109e40 0x7f65cc110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:54.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.983+0000 7f65d3d46640 1 --2- 172.21.15.7:0/2766043373 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65cc1094f0 0x7f65cc109900 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:54.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.983+0000 7f65d3d46640 1 --2- 172.21.15.7:0/2766043373 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f65cc103bb0 0x7f65cc103fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:54.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.983+0000 7f65d3d46640 1 -- 172.21.15.7:0/2766043373 >> 172.21.15.7:0/2766043373 conn(0x7f65cc0ff600 msgr2=0x7f65cc101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:54.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.983+0000 7f65d3d46640 1 -- 172.21.15.7:0/2766043373 shutdown_connections 2024-09-21T06:43:54.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.983+0000 7f65d3d46640 1 -- 172.21.15.7:0/2766043373 wait complete. 2024-09-21T06:43:54.989 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.984+0000 7f65d3d46640 1 Processor -- start 2024-09-21T06:43:54.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.984+0000 7f65d3d46640 1 -- start start 2024-09-21T06:43:54.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.984+0000 7f65d3d46640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65cc103bb0 0x7f65cc19a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:54.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.984+0000 7f65d3d46640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65cc1094f0 0x7f65cc19aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:54.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.984+0000 7f65d3d46640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f65cc109e40 0x7f65cc19fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:54.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.984+0000 7f65d3d46640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f65cc113b00 con 0x7f65cc1094f0 2024-09-21T06:43:54.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.984+0000 7f65d3d46640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f65cc113980 con 0x7f65cc109e40 2024-09-21T06:43:54.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.984+0000 7f65d3d46640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f65cc113c80 con 0x7f65cc103bb0 2024-09-21T06:43:54.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.984+0000 7f65d12e1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65cc1094f0 0x7f65cc19aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:54.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.984+0000 7f65d12e1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65cc1094f0 0x7f65cc19aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51532/0 (socket says 172.21.15.7:51532) 2024-09-21T06:43:54.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.984+0000 7f65d12e1640 1 -- 172.21.15.7:0/1705715144 learned_addr learned my addr 172.21.15.7:0/1705715144 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:43:54.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.984+0000 7f65d22e3640 1 --2- 172.21.15.7:0/1705715144 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f65cc109e40 0x7f65cc19fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:54.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.984+0000 7f65d1ae2640 1 --2- 172.21.15.7:0/1705715144 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65cc103bb0 0x7f65cc19a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:54.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.984+0000 7f65d12e1640 1 -- 172.21.15.7:0/1705715144 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65cc103bb0 msgr2=0x7f65cc19a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:54.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.984+0000 7f65d12e1640 1 --2- 172.21.15.7:0/1705715144 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65cc103bb0 0x7f65cc19a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:54.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.984+0000 7f65d12e1640 1 -- 172.21.15.7:0/1705715144 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f65cc109e40 msgr2=0x7f65cc19fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:54.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.984+0000 7f65d12e1640 1 --2- 172.21.15.7:0/1705715144 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f65cc109e40 0x7f65cc19fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:54.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.984+0000 7f65d12e1640 1 -- 172.21.15.7:0/1705715144 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65cc1a04a0 con 0x7f65cc1094f0 2024-09-21T06:43:54.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.984+0000 7f65d1ae2640 1 --2- 172.21.15.7:0/1705715144 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65cc103bb0 0x7f65cc19a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:43:54.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.985+0000 7f65d12e1640 1 --2- 172.21.15.7:0/1705715144 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65cc1094f0 0x7f65cc19aad0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f65bc006010 tx=0x7f65bc004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:54.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.985+0000 7f65c2ffd640 1 -- 172.21.15.7:0/1705715144 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65bc03f030 con 0x7f65cc1094f0 2024-09-21T06:43:54.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.985+0000 7f65c2ffd640 1 -- 172.21.15.7:0/1705715144 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f65bc003aa0 con 0x7f65cc1094f0 2024-09-21T06:43:54.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.985+0000 7f65d3d46640 1 -- 172.21.15.7:0/1705715144 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65cc1a0730 con 0x7f65cc1094f0 2024-09-21T06:43:54.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.985+0000 7f65c2ffd640 1 -- 172.21.15.7:0/1705715144 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65bc035070 con 0x7f65cc1094f0 2024-09-21T06:43:54.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.985+0000 7f65d3d46640 1 -- 172.21.15.7:0/1705715144 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65cc1a6ef0 con 0x7f65cc1094f0 2024-09-21T06:43:54.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.987+0000 7f65da2ba740 1 Processor -- start 2024-09-21T06:43:54.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.988+0000 7f65da2ba740 1 -- start start 2024-09-21T06:43:54.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.988+0000 7f65c2ffd640 1 -- 172.21.15.7:0/1705715144 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f65bc042030 con 0x7f65cc1094f0 2024-09-21T06:43:54.995 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.988+0000 7f65da2ba740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562242277070 0x56224261e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:54.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.988+0000 7f65da2ba740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56224224e1b0 0x56224261eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:54.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.988+0000 7f65da2ba740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562242256390 0x56224261f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:54.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.988+0000 7f65da2ba740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x562242594e50 con 0x562242277070 2024-09-21T06:43:54.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.988+0000 7f65da2ba740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x562242584280 con 0x562242256390 2024-09-21T06:43:54.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.988+0000 7f65da2ba740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x562242588090 con 0x56224224e1b0 2024-09-21T06:43:54.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.988+0000 7f65d22e3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562242277070 0x56224261e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:54.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.988+0000 7f65d22e3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562242277070 0x56224261e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51536/0 (socket says 172.21.15.7:51536) 2024-09-21T06:43:54.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.988+0000 7f65d22e3640 1 -- 172.21.15.7:0/3888493112 learned_addr learned my addr 172.21.15.7:0/3888493112 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:43:54.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.988+0000 7f65d1ae2640 1 --2- 172.21.15.7:0/3888493112 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56224224e1b0 0x56224261eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:54.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.988+0000 7f65d12e1640 1 --2- 172.21.15.7:0/3888493112 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562242256390 0x56224261f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:54.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.989+0000 7f65d22e3640 1 -- 172.21.15.7:0/3888493112 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56224224e1b0 msgr2=0x56224261eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:54.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.989+0000 7f65d22e3640 1 --2- 172.21.15.7:0/3888493112 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56224224e1b0 0x56224261eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:54.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.989+0000 7f65d22e3640 1 -- 172.21.15.7:0/3888493112 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562242256390 msgr2=0x56224261f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:54.996 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.989+0000 7f65d22e3640 1 --2- 172.21.15.7:0/3888493112 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562242256390 0x56224261f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:54.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.989+0000 7f65d22e3640 1 -- 172.21.15.7:0/3888493112 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622422e2650 con 0x562242277070 2024-09-21T06:43:54.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.989+0000 7f65d22e3640 1 --2- 172.21.15.7:0/3888493112 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562242277070 0x56224261e650 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f65c4009e60 tx=0x7f65c4010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3032cbdded3f454 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:54.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.989+0000 7f65c2ffd640 1 --2- 172.21.15.7:0/1705715144 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f65b80b6680 0x7f65b80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:54.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.989+0000 7f65b7fff640 1 -- 172.21.15.7:0/3888493112 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c4016070 con 0x562242277070 2024-09-21T06:43:54.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.989+0000 7f65d1ae2640 1 --2- 172.21.15.7:0/1705715144 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f65b80b6680 0x7f65b80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:54.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.989+0000 7f65b7fff640 1 -- 172.21.15.7:0/3888493112 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f65c4004d20 con 0x562242277070 2024-09-21T06:43:54.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.989+0000 7f65b7fff640 1 -- 172.21.15.7:0/3888493112 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c40126b0 con 0x562242277070 2024-09-21T06:43:54.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.989+0000 7f65c2ffd640 1 -- 172.21.15.7:0/1705715144 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8412+0+0 (secure 0 0 0) 0x7f65bc107930 con 0x7f65cc1094f0 2024-09-21T06:43:54.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.990+0000 7f65da2ba740 1 -- 172.21.15.7:0/3888493112 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562242277070 msgr2=0x56224261e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:54.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.990+0000 7f65d1ae2640 1 --2- 172.21.15.7:0/1705715144 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f65b80b6680 0x7f65b80b8b90 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x56224261d2d0 tx=0x7f65c8005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:54.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.990+0000 7f65da2ba740 1 --2- 172.21.15.7:0/3888493112 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562242277070 0x56224261e650 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f65c4009e60 tx=0x7f65c4010740 comp rx=0 tx=0).stop 2024-09-21T06:43:54.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.990+0000 7f65da2ba740 1 -- 172.21.15.7:0/3888493112 shutdown_connections 2024-09-21T06:43:54.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.990+0000 7f65da2ba740 1 --2- 172.21.15.7:0/3888493112 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562242256390 0x56224261f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:54.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.990+0000 7f65da2ba740 1 --2- 172.21.15.7:0/3888493112 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56224224e1b0 0x56224261eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:54.997 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.990+0000 7f65da2ba740 1 --2- 172.21.15.7:0/3888493112 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562242277070 0x56224261e650 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:54.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.990+0000 7f65da2ba740 1 -- 172.21.15.7:0/3888493112 >> 172.21.15.7:0/3888493112 conn(0x56224226b460 msgr2=0x56224261c540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:54.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.990+0000 7f65da2ba740 1 -- 172.21.15.7:0/3888493112 shutdown_connections 2024-09-21T06:43:54.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.990+0000 7f65da2ba740 1 -- 172.21.15.7:0/3888493112 wait complete. 2024-09-21T06:43:54.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.991+0000 7f65da2ba740 1 -- start start 2024-09-21T06:43:54.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.991+0000 7f65da2ba740 1 Processor -- start 2024-09-21T06:43:54.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.991+0000 7f65da2ba740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56224224e1b0 0x56224262e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:54.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.991+0000 7f65da2ba740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562242256390 0x56224262e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:54.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.991+0000 7f65da2ba740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562242277070 0x56224263a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:54.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.991+0000 7f65da2ba740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5622423e5700 con 0x56224224e1b0 2024-09-21T06:43:54.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.991+0000 7f65da2ba740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56224251f110 con 0x562242256390 2024-09-21T06:43:54.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.991+0000 7f65da2ba740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x562242631190 con 0x562242277070 2024-09-21T06:43:54.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.991+0000 7f65da2ba740 10 client.0 _ll_register_callbacks cb 0x562242538990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:43:54.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.991+0000 7f65d1ae2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56224224e1b0 0x56224262e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:54.998 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.991+0000 7f65d1ae2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56224224e1b0 0x56224262e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51544/0 (socket says 172.21.15.7:51544) 2024-09-21T06:43:54.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.991+0000 7f65d1ae2640 1 -- 172.21.15.7:0/3080068977 learned_addr learned my addr 172.21.15.7:0/3080068977 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:43:54.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.992+0000 7f65d22e3640 1 --2- 172.21.15.7:0/3080068977 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562242277070 0x56224263a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:54.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.992+0000 7f65d12e1640 1 --2- 172.21.15.7:0/3080068977 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562242256390 0x56224262e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:54.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.992+0000 7f65d1ae2640 1 -- 172.21.15.7:0/3080068977 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562242277070 msgr2=0x56224263a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:54.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.992+0000 7f65d1ae2640 1 --2- 172.21.15.7:0/3080068977 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562242277070 0x56224263a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:54.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.992+0000 7f65d1ae2640 1 -- 172.21.15.7:0/3080068977 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562242256390 msgr2=0x56224262e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:54.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.992+0000 7f65d1ae2640 1 --2- 172.21.15.7:0/3080068977 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562242256390 0x56224262e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:54.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.992+0000 7f65d1ae2640 1 -- 172.21.15.7:0/3080068977 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56224254cc40 con 0x56224224e1b0 2024-09-21T06:43:54.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.992+0000 7f65d12e1640 1 --2- 172.21.15.7:0/3080068977 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562242256390 0x56224262e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:43:54.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.992+0000 7f65d1ae2640 1 --2- 172.21.15.7:0/3080068977 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56224224e1b0 0x56224262e0f0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f65c80042e0 tx=0x7f65c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f82f82a58d9a450d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:54.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.992+0000 7f65b57fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:43:54.999 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.992+0000 7f65b57fa640 1 -- 172.21.15.7:0/3080068977 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c8020620 con 0x56224224e1b0 2024-09-21T06:43:55.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.992+0000 7f65b57fa640 1 -- 172.21.15.7:0/3080068977 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8412+0+0 (secure 0 0 0) 0x7f65c80207c0 con 0x56224224e1b0 2024-09-21T06:43:55.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.992+0000 7f65da2ba740 1 -- 172.21.15.7:0/3080068977 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f65c4004d20 con 0x56224224e1b0 2024-09-21T06:43:55.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.993+0000 7f65b57fa640 1 -- 172.21.15.7:0/3080068977 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f65c80209c0 con 0x56224224e1b0 2024-09-21T06:43:55.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.993+0000 7f65da2ba740 10 client.17001 fetch_fsmap learned FSMap version 25 2024-09-21T06:43:55.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.993+0000 7f65da2ba740 1 -- 172.21.15.7:0/3080068977 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56224263cf10 con 0x56224224e1b0 2024-09-21T06:43:55.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.993+0000 7f65b57fa640 1 -- 172.21.15.7:0/3080068977 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f65c4004d20 con 0x56224224e1b0 2024-09-21T06:43:55.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.993+0000 7f65b57fa640 1 -- 172.21.15.7:0/3080068977 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f65c8030020 con 0x56224224e1b0 2024-09-21T06:43:55.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.993+0000 7f65da2ba740 10 client.17001 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:43:55.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.993+0000 7f65da2ba740 10 client.17001 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:43:55.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.993+0000 7f65da2ba740 20 client.17001 populate_metadata read hostname 'smithi007' 2024-09-21T06:43:55.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.993+0000 7f65da2ba740 1 --2- 172.21.15.7:0/3080068977 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5622422359f0 0x5622426403f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:55.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.993+0000 7f65da2ba740 4 client.17001 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:43:55.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.993+0000 7f65da2ba740 1 -- 172.21.15.7:0/3080068977 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562242596da0 con 0x5622422359f0 2024-09-21T06:43:55.000 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.993+0000 7f65d12e1640 1 --2- 172.21.15.7:0/3080068977 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5622422359f0 0x5622426403f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:55.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.994+0000 7f65d12e1640 1 --2- 172.21.15.7:0/3080068977 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5622422359f0 0x5622426403f0 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e9ed5d5695640097 server_cookie=2b917b6b0a361deb in_seq=0 out_seq=0 2024-09-21T06:43:55.001 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.994+0000 7f65b57fa640 10 client.17001 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:43:55.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.994+0000 7f65b57fa640 1 -- 172.21.15.7:0/3080068977 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562242596da0 con 0x5622422359f0 2024-09-21T06:43:55.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.994+0000 7f65b57fa640 10 client.17001 handle_command_reply: tid=0 2024-09-21T06:43:55.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.995+0000 7f65da2ba740 1 client.17001 shutdown 2024-09-21T06:43:55.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.995+0000 7f65da2ba740 1 -- 172.21.15.7:0/3080068977 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56224224e1b0 msgr2=0x56224262e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:55.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.995+0000 7f65da2ba740 1 --2- 172.21.15.7:0/3080068977 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56224224e1b0 0x56224262e0f0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f65c80042e0 tx=0x7f65c80046c0 comp rx=0 tx=0).stop 2024-09-21T06:43:55.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.995+0000 7f65da2ba740 1 -- 172.21.15.7:0/3080068977 shutdown_connections 2024-09-21T06:43:55.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.995+0000 7f65da2ba740 1 --2- 172.21.15.7:0/3080068977 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5622422359f0 0x5622426403f0 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:55.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.995+0000 7f65da2ba740 1 --2- 172.21.15.7:0/3080068977 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562242277070 0x56224263a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:55.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.995+0000 7f65da2ba740 1 --2- 172.21.15.7:0/3080068977 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562242256390 0x56224262e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:55.002 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.995+0000 7f65da2ba740 1 --2- 172.21.15.7:0/3080068977 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56224224e1b0 0x56224262e0f0 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:55.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.995+0000 7f65b57fa640 0 client.17001 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:43:55.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.995+0000 7f65da2ba740 1 -- 172.21.15.7:0/3080068977 >> 172.21.15.7:0/3080068977 conn(0x56224226b460 msgr2=0x56224261ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:55.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.995+0000 7f65da2ba740 1 -- 172.21.15.7:0/3080068977 shutdown_connections 2024-09-21T06:43:55.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.995+0000 7f65da2ba740 1 -- 172.21.15.7:0/3080068977 wait complete. 2024-09-21T06:43:55.003 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:54.995+0000 7f65da2ba740 20 client.17001 trim_cache size 0 max 16384 2024-09-21T06:43:55.003 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:43:54 smithi007 ceph-mon[30983]: pgmap v552: 97 pgs: 97 active+clean; 3.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:43:55.003 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:43:54 smithi007 ceph-mon[30983]: scrub summary: idle 2024-09-21T06:43:55.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.015+0000 7f65da2ba740 1 Processor -- start 2024-09-21T06:43:55.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.015+0000 7f65da2ba740 1 -- start start 2024-09-21T06:43:55.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.015+0000 7f65da2ba740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56224224e1b0 0x56224262e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:55.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.015+0000 7f65da2ba740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562242256390 0x5622426237f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:55.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.015+0000 7f65da2ba740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562242277070 0x562242623d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:55.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.015+0000 7f65da2ba740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f65cc1afca0 con 0x56224224e1b0 2024-09-21T06:43:55.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.015+0000 7f65da2ba740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f65cc1ad570 con 0x562242277070 2024-09-21T06:43:55.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.015+0000 7f65da2ba740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f65cc1ab3e0 con 0x562242256390 2024-09-21T06:43:55.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.015+0000 7f65d1ae2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56224224e1b0 0x56224262e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:55.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.015+0000 7f65d1ae2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56224224e1b0 0x56224262e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51560/0 (socket says 172.21.15.7:51560) 2024-09-21T06:43:55.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.015+0000 7f65d1ae2640 1 -- 172.21.15.7:0/939208091 learned_addr learned my addr 172.21.15.7:0/939208091 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:43:55.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.015+0000 7f65d22e3640 1 --2- 172.21.15.7:0/939208091 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562242277070 0x562242623d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:55.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.015+0000 7f65d12e1640 1 --2- 172.21.15.7:0/939208091 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562242256390 0x5622426237f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:55.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.016+0000 7f65d1ae2640 1 -- 172.21.15.7:0/939208091 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562242256390 msgr2=0x5622426237f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:55.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.016+0000 7f65d1ae2640 1 --2- 172.21.15.7:0/939208091 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562242256390 0x5622426237f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:55.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.016+0000 7f65d1ae2640 1 -- 172.21.15.7:0/939208091 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562242277070 msgr2=0x562242623d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:55.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.016+0000 7f65d1ae2640 1 --2- 172.21.15.7:0/939208091 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562242277070 0x562242623d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:55.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.016+0000 7f65d1ae2640 1 -- 172.21.15.7:0/939208091 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56224262d050 con 0x56224224e1b0 2024-09-21T06:43:55.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.016+0000 7f65d1ae2640 1 --2- 172.21.15.7:0/939208091 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56224224e1b0 0x56224262e5b0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f65c8000c00 tx=0x7f65c8013dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a82eacd07fef5f79 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:55.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.016+0000 7f65b77fe640 1 -- 172.21.15.7:0/939208091 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c8028600 con 0x56224224e1b0 2024-09-21T06:43:55.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.016+0000 7f65b77fe640 1 -- 172.21.15.7:0/939208091 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f65c8020b60 con 0x56224224e1b0 2024-09-21T06:43:55.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.016+0000 7f65b77fe640 1 -- 172.21.15.7:0/939208091 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c80287d0 con 0x56224224e1b0 2024-09-21T06:43:55.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.017+0000 7f65da2ba740 1 -- 172.21.15.7:0/939208091 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56224224e1b0 msgr2=0x56224262e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:55.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.017+0000 7f65da2ba740 1 --2- 172.21.15.7:0/939208091 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56224224e1b0 0x56224262e5b0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f65c8000c00 tx=0x7f65c8013dc0 comp rx=0 tx=0).stop 2024-09-21T06:43:55.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.017+0000 7f65da2ba740 1 -- 172.21.15.7:0/939208091 shutdown_connections 2024-09-21T06:43:55.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.017+0000 7f65da2ba740 1 --2- 172.21.15.7:0/939208091 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x562242277070 0x562242623d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:55.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.017+0000 7f65da2ba740 1 --2- 172.21.15.7:0/939208091 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562242256390 0x5622426237f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:55.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.017+0000 7f65da2ba740 1 --2- 172.21.15.7:0/939208091 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56224224e1b0 0x56224262e5b0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:55.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.017+0000 7f65da2ba740 1 -- 172.21.15.7:0/939208091 >> 172.21.15.7:0/939208091 conn(0x56224226b460 msgr2=0x56224262dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:55.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.017+0000 7f65da2ba740 1 -- 172.21.15.7:0/939208091 shutdown_connections 2024-09-21T06:43:55.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.017+0000 7f65da2ba740 1 -- 172.21.15.7:0/939208091 wait complete. 2024-09-21T06:43:55.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.017+0000 7f65da2ba740 1 -- start start 2024-09-21T06:43:55.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.017+0000 7f65da2ba740 1 Processor -- start 2024-09-21T06:43:55.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.018+0000 7f65da2ba740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56224224e1b0 0x5622426327a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:55.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.018+0000 7f65da2ba740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562242256390 0x562242632ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:55.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.018+0000 7f65da2ba740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562242277070 0x5622426a9db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:55.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.018+0000 7f65da2ba740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f65cc1aba30 con 0x562242277070 2024-09-21T06:43:55.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.018+0000 7f65da2ba740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f65cc1acea0 con 0x56224224e1b0 2024-09-21T06:43:55.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.018+0000 7f65da2ba740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f65cc1ac100 con 0x562242256390 2024-09-21T06:43:55.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.018+0000 7f65da2ba740 10 client.0 _ll_register_callbacks cb 0x7f65c80099f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:43:55.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.018+0000 7f65d22e3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562242277070 0x5622426a9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:55.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.018+0000 7f65d22e3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562242277070 0x5622426a9db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51568/0 (socket says 172.21.15.7:51568) 2024-09-21T06:43:55.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.018+0000 7f65d22e3640 1 -- 172.21.15.7:0/1156389688 learned_addr learned my addr 172.21.15.7:0/1156389688 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:43:55.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.018+0000 7f65d1ae2640 1 --2- 172.21.15.7:0/1156389688 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56224224e1b0 0x5622426327a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:55.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.018+0000 7f65d12e1640 1 --2- 172.21.15.7:0/1156389688 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562242256390 0x562242632ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:55.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.018+0000 7f65d22e3640 1 -- 172.21.15.7:0/1156389688 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562242256390 msgr2=0x562242632ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:55.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.018+0000 7f65d22e3640 1 --2- 172.21.15.7:0/1156389688 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562242256390 0x562242632ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:55.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.018+0000 7f65d22e3640 1 -- 172.21.15.7:0/1156389688 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56224224e1b0 msgr2=0x5622426327a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:55.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.018+0000 7f65d22e3640 1 --2- 172.21.15.7:0/1156389688 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56224224e1b0 0x5622426327a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:55.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.018+0000 7f65d22e3640 1 -- 172.21.15.7:0/1156389688 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622426335b0 con 0x562242277070 2024-09-21T06:43:55.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.018+0000 7f65d1ae2640 1 --2- 172.21.15.7:0/1156389688 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56224224e1b0 0x5622426327a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:43:55.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.019+0000 7f65d22e3640 1 --2- 172.21.15.7:0/1156389688 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562242277070 0x5622426a9db0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f65c4009e60 tx=0x7f65c4012660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42772f9b33d15e94 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:55.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.019+0000 7f65b57fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:43:55.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.019+0000 7f65b57fa640 1 -- 172.21.15.7:0/1156389688 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c4016040 con 0x562242277070 2024-09-21T06:43:55.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.019+0000 7f65da2ba740 1 -- 172.21.15.7:0/1156389688 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f65c8020b60 con 0x562242277070 2024-09-21T06:43:55.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.019+0000 7f65b57fa640 1 -- 172.21.15.7:0/1156389688 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8412+0+0 (secure 0 0 0) 0x7f65c4012be0 con 0x562242277070 2024-09-21T06:43:55.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.019+0000 7f65b57fa640 1 -- 172.21.15.7:0/1156389688 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f65c4034050 con 0x562242277070 2024-09-21T06:43:55.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.019+0000 7f65da2ba740 10 client.17007 fetch_fsmap learned FSMap version 25 2024-09-21T06:43:55.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.019+0000 7f65da2ba740 1 -- 172.21.15.7:0/1156389688 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5622426ab360 con 0x562242277070 2024-09-21T06:43:55.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.019+0000 7f65b57fa640 1 -- 172.21.15.7:0/1156389688 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f65c8020b60 con 0x562242277070 2024-09-21T06:43:55.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.019+0000 7f65b57fa640 1 -- 172.21.15.7:0/1156389688 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f65c400f040 con 0x562242277070 2024-09-21T06:43:55.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.019+0000 7f65da2ba740 10 client.17007 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:43:55.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.019+0000 7f65da2ba740 10 client.17007 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:43:55.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.019+0000 7f65da2ba740 20 client.17007 populate_metadata read hostname 'smithi007' 2024-09-21T06:43:55.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.020+0000 7f65da2ba740 1 --2- 172.21.15.7:0/1156389688 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x56224220ada0 0x5622426ad7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:55.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.020+0000 7f65da2ba740 4 client.17007 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:43:55.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.020+0000 7f65da2ba740 1 -- 172.21.15.7:0/1156389688 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562242592850 con 0x56224220ada0 2024-09-21T06:43:55.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.020+0000 7f65d1ae2640 1 --2- 172.21.15.7:0/1156389688 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x56224220ada0 0x5622426ad7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:55.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.020+0000 7f65d1ae2640 1 --2- 172.21.15.7:0/1156389688 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x56224220ada0 0x5622426ad7d0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f1a5c011ab364390 server_cookie=c85dcfea6c86774d in_seq=0 out_seq=0 2024-09-21T06:43:55.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.020+0000 7f65b57fa640 10 client.17007 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:43:55.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.021+0000 7f65b57fa640 1 -- 172.21.15.7:0/1156389688 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3782 (crc 0 0 0) 0x562242592850 con 0x56224220ada0 2024-09-21T06:43:55.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.021+0000 7f65b57fa640 10 client.17007 handle_command_reply: tid=0 2024-09-21T06:43:55.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.021+0000 7f65da2ba740 1 client.17007 shutdown 2024-09-21T06:43:55.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.021+0000 7f65da2ba740 1 -- 172.21.15.7:0/1156389688 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562242277070 msgr2=0x5622426a9db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:55.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.021+0000 7f65da2ba740 1 --2- 172.21.15.7:0/1156389688 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562242277070 0x5622426a9db0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f65c4009e60 tx=0x7f65c4012660 comp rx=0 tx=0).stop 2024-09-21T06:43:55.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.021+0000 7f65da2ba740 1 -- 172.21.15.7:0/1156389688 shutdown_connections 2024-09-21T06:43:55.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.021+0000 7f65da2ba740 1 --2- 172.21.15.7:0/1156389688 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x56224220ada0 0x5622426ad7d0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:55.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.021+0000 7f65da2ba740 1 --2- 172.21.15.7:0/1156389688 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x562242277070 0x5622426a9db0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:55.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.021+0000 7f65b57fa640 0 client.17007 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:43:55.027 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.021+0000 7f65da2ba740 1 --2- 172.21.15.7:0/1156389688 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x562242256390 0x562242632ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:55.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.021+0000 7f65da2ba740 1 --2- 172.21.15.7:0/1156389688 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56224224e1b0 0x5622426327a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:55.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.021+0000 7f65da2ba740 1 -- 172.21.15.7:0/1156389688 >> 172.21.15.7:0/1156389688 conn(0x56224226b460 msgr2=0x5622426237f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:55.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.021+0000 7f65da2ba740 1 -- 172.21.15.7:0/1156389688 shutdown_connections 2024-09-21T06:43:55.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.021+0000 7f65da2ba740 1 -- 172.21.15.7:0/1156389688 wait complete. 2024-09-21T06:43:55.028 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.021+0000 7f65da2ba740 20 client.17007 trim_cache size 0 max 16384 2024-09-21T06:43:55.028 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:43:55.028 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "no active scrubs running", 2024-09-21T06:43:55.028 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": {}, 2024-09-21T06:43:55.028 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_stats": { 2024-09-21T06:43:55.028 INFO:teuthology.orchestra.run.smithi007.stdout: "3c5b7f3f-e9b3-4d48-8154-2d7d4700992e": { 2024-09-21T06:43:55.029 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:43:43.120930+0000", 2024-09-21T06:43:55.029 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:43:55.029 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:43:55.029 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:43:55.029 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:43:55.029 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:43:55.029 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:43:55.029 INFO:teuthology.orchestra.run.smithi007.stdout: "ef9eaabd-003a-44fb-8373-c854a9e15a71": { 2024-09-21T06:43:55.029 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:42:19.467946+0000", 2024-09-21T06:43:55.029 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:43:55.029 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:43:55.029 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:43:55.029 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:43:55.029 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:43:55.029 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:43:55.030 INFO:teuthology.orchestra.run.smithi007.stdout: "b466f071-ab32-427c-a0ed-73edea33145e": { 2024-09-21T06:43:55.030 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:43:01.151440+0000", 2024-09-21T06:43:55.030 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:43:55.030 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:43:55.030 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:43:55.030 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:43:55.030 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:43:55.030 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:43:55.030 INFO:teuthology.orchestra.run.smithi007.stdout: "62fca477-b241-45f5-8185-bc78aeb8b19f": { 2024-09-21T06:43:55.030 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:40:12.744488+0000", 2024-09-21T06:43:55.030 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:43:55.030 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:43:55.030 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:43:55.030 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:43:55.031 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:43:55.031 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:43:55.031 INFO:teuthology.orchestra.run.smithi007.stdout: "a1ae5b3b-f158-44be-8ef4-d70e9ba879cc": { 2024-09-21T06:43:55.031 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:41:37.568453+0000", 2024-09-21T06:43:55.031 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:43:55.031 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:43:55.031 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:43:55.031 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:43:55.031 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:43:55.031 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:43:55.031 INFO:teuthology.orchestra.run.smithi007.stdout: "d7b6a90c-9ae1-4e02-93ad-335a7e9df1d7": { 2024-09-21T06:43:55.031 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:39:19.226139+0000", 2024-09-21T06:43:55.031 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:43:55.032 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:43:55.032 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:43:55.032 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:43:55.032 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:43:55.032 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:43:55.032 INFO:teuthology.orchestra.run.smithi007.stdout: "b0327167-8c41-4286-8afc-7f0780972fd7": { 2024-09-21T06:43:55.032 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:38:36.828657+0000", 2024-09-21T06:43:55.032 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:43:55.032 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:43:55.032 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:43:55.032 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:43:55.032 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:43:55.032 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:43:55.032 INFO:teuthology.orchestra.run.smithi007.stdout: "13441782-2231-4713-8ebd-068a941de47f": { 2024-09-21T06:43:55.032 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:39:30.219006+0000", 2024-09-21T06:43:55.033 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:43:55.033 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:43:55.033 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:43:55.033 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:43:55.033 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:43:55.033 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:43:55.033 INFO:teuthology.orchestra.run.smithi007.stdout: "5cbaaba2-6ab1-4f83-abd6-8c6eef4b5c42": { 2024-09-21T06:43:55.033 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:37:46.566272+0000", 2024-09-21T06:43:55.033 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:43:55.033 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:43:55.033 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:43:55.033 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:43:55.033 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:43:55.033 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:43:55.034 INFO:teuthology.orchestra.run.smithi007.stdout: "dd792920-08a1-482d-8961-5c6a6f131599": { 2024-09-21T06:43:55.034 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:43:53.390806+0000", 2024-09-21T06:43:55.034 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:43:55.034 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:43:55.034 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:43:55.034 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:43:55.034 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:43:55.034 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:43:55.034 INFO:teuthology.orchestra.run.smithi007.stdout: "6231e9c1-14a2-40b5-be3c-76d87a0d733b": { 2024-09-21T06:43:55.034 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:37:02.484812+0000", 2024-09-21T06:43:55.034 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:43:55.034 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:43:55.034 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:43:55.035 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:43:55.035 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:43:55.035 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:43:55.035 INFO:teuthology.orchestra.run.smithi007.stdout: "310a0ec8-44bb-49ed-a534-3bc91cb1ee9d": { 2024-09-21T06:43:55.035 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:40:55.373968+0000", 2024-09-21T06:43:55.035 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:43:55.035 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:43:55.035 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:43:55.035 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:43:55.035 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:43:55.035 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:43:55.035 INFO:teuthology.orchestra.run.smithi007.stdout: "0b89345c-1f00-4efe-8ee9-4cb17e43584c": { 2024-09-21T06:43:55.035 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:36:19.500334+0000", 2024-09-21T06:43:55.035 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:43:55.036 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:43:55.036 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:43:55.036 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:43:55.036 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:43:55.036 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:43:55.036 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:43:55.036 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:43:55.036 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.022+0000 7f65d3d46640 1 -- 172.21.15.7:0/1705715144 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f65b80b6680 msgr2=0x7f65b80b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:55.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.022+0000 7f65d3d46640 1 --2- 172.21.15.7:0/1705715144 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f65b80b6680 0x7f65b80b8b90 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x56224261d2d0 tx=0x7f65c8005f90 comp rx=0 tx=0).stop 2024-09-21T06:43:55.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.022+0000 7f65d3d46640 1 -- 172.21.15.7:0/1705715144 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65cc1094f0 msgr2=0x7f65cc19aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:55.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.022+0000 7f65d3d46640 1 --2- 172.21.15.7:0/1705715144 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65cc1094f0 0x7f65cc19aad0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f65bc006010 tx=0x7f65bc004060 comp rx=0 tx=0).stop 2024-09-21T06:43:55.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.022+0000 7f65d3d46640 1 -- 172.21.15.7:0/1705715144 shutdown_connections 2024-09-21T06:43:55.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.022+0000 7f65d3d46640 1 --2- 172.21.15.7:0/1705715144 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f65b80b6680 0x7f65b80b8b90 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:55.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.022+0000 7f65d3d46640 1 --2- 172.21.15.7:0/1705715144 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f65cc109e40 0x7f65cc19fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:55.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.022+0000 7f65d3d46640 1 --2- 172.21.15.7:0/1705715144 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f65cc1094f0 0x7f65cc19aad0 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:55.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.022+0000 7f65d3d46640 1 --2- 172.21.15.7:0/1705715144 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f65cc103bb0 0x7f65cc19a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:55.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.022+0000 7f65d3d46640 1 -- 172.21.15.7:0/1705715144 >> 172.21.15.7:0/1705715144 conn(0x7f65cc0ff600 msgr2=0x7f65cc101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:55.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.022+0000 7f65d3d46640 1 -- 172.21.15.7:0/1705715144 shutdown_connections 2024-09-21T06:43:55.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:55.022+0000 7f65d3d46640 1 -- 172.21.15.7:0/1705715144 wait complete. 2024-09-21T06:43:55.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:43:54 smithi144 ceph-mon[34653]: pgmap v552: 97 pgs: 97 active+clean; 3.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:43:55.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:43:54 smithi144 ceph-mon[34653]: scrub summary: idle 2024-09-21T06:43:55.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:43:54 smithi018 ceph-mon[34477]: pgmap v552: 97 pgs: 97 active+clean; 3.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:43:55.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:43:54 smithi018 ceph-mon[34477]: scrub summary: idle 2024-09-21T06:43:55.843 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:43:55.843 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:43:56.104 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:43:56.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:56.566+0000 7fa1fe81f640 1 -- 172.21.15.7:0/1244087323 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1f8108cf0 msgr2=0x7fa1f810f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:56.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:56.566+0000 7fa1fe81f640 1 --2- 172.21.15.7:0/1244087323 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1f8108cf0 0x7fa1f810f520 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fa1f0009ca0 tx=0x7fa1f002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:43:56.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:56.567+0000 7fa1fe81f640 1 -- 172.21.15.7:0/1244087323 shutdown_connections 2024-09-21T06:43:56.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:56.567+0000 7fa1fe81f640 1 --2- 172.21.15.7:0/1244087323 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1f8108cf0 0x7fa1f810f520 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:56.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:56.567+0000 7fa1fe81f640 1 --2- 172.21.15.7:0/1244087323 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1f81083a0 0x7fa1f81087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:56.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:56.567+0000 7fa1fe81f640 1 --2- 172.21.15.7:0/1244087323 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1f8102a60 0x7fa1f8102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:56.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:56.567+0000 7fa1fe81f640 1 -- 172.21.15.7:0/1244087323 >> 172.21.15.7:0/1244087323 conn(0x7fa1f8079730 msgr2=0x7fa1f8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:56.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:56.567+0000 7fa1fe81f640 1 -- 172.21.15.7:0/1244087323 shutdown_connections 2024-09-21T06:43:56.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:56.567+0000 7fa1fe81f640 1 -- 172.21.15.7:0/1244087323 wait complete. 2024-09-21T06:43:56.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:56.567+0000 7fa1fe81f640 1 Processor -- start 2024-09-21T06:43:56.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:56.567+0000 7fa1fe81f640 1 -- start start 2024-09-21T06:43:56.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:56.568+0000 7fa1fe81f640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1f8102a60 0x7fa1f819b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:56.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:56.568+0000 7fa1fe81f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1f81083a0 0x7fa1f819b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:56.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:56.568+0000 7fa1fe81f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1f8108cf0 0x7fa1f819bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:56.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:56.568+0000 7fa1fe81f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f8112960 con 0x7fa1f81083a0 2024-09-21T06:43:56.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:56.568+0000 7fa1fe81f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f81127e0 con 0x7fa1f8108cf0 2024-09-21T06:43:56.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:56.568+0000 7fa1fe81f640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f8112ae0 con 0x7fa1f8102a60 2024-09-21T06:43:56.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:56.568+0000 7fa1f77fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1f81083a0 0x7fa1f819b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:56.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:56.568+0000 7fa1f77fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1f81083a0 0x7fa1f819b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51592/0 (socket says 172.21.15.7:51592) 2024-09-21T06:43:56.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:56.568+0000 7fa1f77fe640 1 -- 172.21.15.7:0/574141369 learned_addr learned my addr 172.21.15.7:0/574141369 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:43:56.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:56.568+0000 7fa1f7fff640 1 --2- 172.21.15.7:0/574141369 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1f8102a60 0x7fa1f819b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:56.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:56.568+0000 7fa1fcdbc640 1 --2- 172.21.15.7:0/574141369 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1f8108cf0 0x7fa1f819bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:56.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:56.568+0000 7fa1f77fe640 1 -- 172.21.15.7:0/574141369 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1f8102a60 msgr2=0x7fa1f819b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:56.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:56.568+0000 7fa1f77fe640 1 --2- 172.21.15.7:0/574141369 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1f8102a60 0x7fa1f819b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:56.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:56.568+0000 7fa1f77fe640 1 -- 172.21.15.7:0/574141369 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1f8108cf0 msgr2=0x7fa1f819bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:56.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:56.568+0000 7fa1f77fe640 1 --2- 172.21.15.7:0/574141369 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1f8108cf0 0x7fa1f819bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:56.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:56.568+0000 7fa1f77fe640 1 -- 172.21.15.7:0/574141369 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1f81a6500 con 0x7fa1f81083a0 2024-09-21T06:43:56.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:56.569+0000 7fa1f77fe640 1 --2- 172.21.15.7:0/574141369 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1f81083a0 0x7fa1f819b7b0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec00d770 tx=0x7fa1ec00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:56.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:56.569+0000 7fa1f57fa640 1 -- 172.21.15.7:0/574141369 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1ec017070 con 0x7fa1f81083a0 2024-09-21T06:43:56.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:56.569+0000 7fa1f57fa640 1 -- 172.21.15.7:0/574141369 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa1ec009c30 con 0x7fa1f81083a0 2024-09-21T06:43:56.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:56.569+0000 7fa1fe81f640 1 -- 172.21.15.7:0/574141369 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1f81a67f0 con 0x7fa1f81083a0 2024-09-21T06:43:56.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:56.569+0000 7fa1f57fa640 1 -- 172.21.15.7:0/574141369 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1ec00f620 con 0x7fa1f81083a0 2024-09-21T06:43:56.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:56.569+0000 7fa1fe81f640 1 -- 172.21.15.7:0/574141369 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1f81a6d80 con 0x7fa1f81083a0 2024-09-21T06:43:56.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:56.570+0000 7fa1fe81f640 1 -- 172.21.15.7:0/574141369 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1f8102e70 con 0x7fa1f81083a0 2024-09-21T06:43:56.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:56.572+0000 7fa1f57fa640 1 -- 172.21.15.7:0/574141369 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7fa1ec01a070 con 0x7fa1f81083a0 2024-09-21T06:43:56.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:56.573+0000 7fa1f57fa640 1 --2- 172.21.15.7:0/574141369 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa1e00b6730 0x7fa1e00b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:56.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:56.573+0000 7fa1f7fff640 1 --2- 172.21.15.7:0/574141369 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa1e00b6730 0x7fa1e00b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:56.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:56.573+0000 7fa1f57fa640 1 -- 172.21.15.7:0/574141369 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8412+0+0 (secure 0 0 0) 0x7fa1ec0e6f90 con 0x7fa1f81083a0 2024-09-21T06:43:56.575 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:56.574+0000 7fa1f7fff640 1 --2- 172.21.15.7:0/574141369 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa1e00b6730 0x7fa1e00b8c40 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa1f806b9c0 tx=0x7fa1e800b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:56.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:56.576+0000 7fa1f57fa640 1 -- 172.21.15.7:0/574141369 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa1ec0b19b0 con 0x7fa1f81083a0 2024-09-21T06:43:56.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:56.803+0000 7fa1fe81f640 1 -- 172.21.15.7:0/574141369 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa1f806b270 con 0x7fa1f81083a0 2024-09-21T06:43:56.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:56.803+0000 7fa1f57fa640 1 -- 172.21.15.7:0/574141369 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11899 (secure 0 0 0) 0x7fa1ec0b68f0 con 0x7fa1f81083a0 2024-09-21T06:43:56.805 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:43:56.805 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-21T06:36:10:753693+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2015971546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2015971546},{"type":"v1","addr":"172.21.15.7:6835","nonce":2015971546}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/2350816224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":2350816224},{"type":"v1","addr":"172.21.15.7:6837","nonce":2350816224}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14823,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/1669980572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":1669980572},{"type":"v1","addr":"172.21.15.7:6839","nonce":1669980572}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14835,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/2528308973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":2528308973},{"type":"v1","addr":"172.21.15.7:6841","nonce":2528308973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24623,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1337382979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1337382979},{"type":"v1","addr":"172.21.15.18:6833","nonce":1337382979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/2751454345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":2751454345},{"type":"v1","addr":"172.21.15.144:6833","nonce":2751454345}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:34:24.627168+0000","modified":"2024-09-21T06:36:10.737288+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24716,"mds_1":24688,"mds_2":24686},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24656":{"gid":24656,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6835/158884796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":158884796},{"type":"v1","addr":"172.21.15.18:6835","nonce":158884796}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6835/3636739922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3636739922},{"type":"v1","addr":"172.21.15.144:6835","nonce":3636739922}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24673":{"gid":24673,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6837/1126341753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":1126341753},{"type":"v1","addr":"172.21.15.144:6837","nonce":1126341753}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.18:6837/1539670694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1539670694},{"type":"v1","addr":"172.21.15.18:6837","nonce":1539670694}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24688":{"gid":24688,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.144:6839/4027821922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":4027821922},{"type":"v1","addr":"172.21.15.144:6839","nonce":4027821922}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24716":{"gid":24716,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.18:6839/3798713532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":3798713532},{"type":"v1","addr":"172.21.15.18:6839","nonce":3798713532}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24716,"qdb_cluster":[24716,24688,24686]},"id":1}]} 2024-09-21T06:43:56.806 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-21T06:43:56.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:56.806+0000 7fa1fe81f640 1 -- 172.21.15.7:0/574141369 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa1e00b6730 msgr2=0x7fa1e00b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:56.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:56.806+0000 7fa1fe81f640 1 --2- 172.21.15.7:0/574141369 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa1e00b6730 0x7fa1e00b8c40 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa1f806b9c0 tx=0x7fa1e800b390 comp rx=0 tx=0).stop 2024-09-21T06:43:56.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:56.806+0000 7fa1fe81f640 1 -- 172.21.15.7:0/574141369 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1f81083a0 msgr2=0x7fa1f819b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:56.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:56.806+0000 7fa1fe81f640 1 --2- 172.21.15.7:0/574141369 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1f81083a0 0x7fa1f819b7b0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec00d770 tx=0x7fa1ec00dc30 comp rx=0 tx=0).stop 2024-09-21T06:43:56.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:56.806+0000 7fa1fe81f640 1 -- 172.21.15.7:0/574141369 shutdown_connections 2024-09-21T06:43:56.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:56.806+0000 7fa1fe81f640 1 --2- 172.21.15.7:0/574141369 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa1e00b6730 0x7fa1e00b8c40 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:56.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:56.806+0000 7fa1fe81f640 1 --2- 172.21.15.7:0/574141369 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1f8108cf0 0x7fa1f819bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:56.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:56.806+0000 7fa1fe81f640 1 --2- 172.21.15.7:0/574141369 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1f81083a0 0x7fa1f819b7b0 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:56.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:56.806+0000 7fa1fe81f640 1 --2- 172.21.15.7:0/574141369 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1f8102a60 0x7fa1f819b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:56.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:56.806+0000 7fa1fe81f640 1 -- 172.21.15.7:0/574141369 >> 172.21.15.7:0/574141369 conn(0x7fa1f8079730 msgr2=0x7fa1f8104410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:56.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:56.806+0000 7fa1fe81f640 1 -- 172.21.15.7:0/574141369 shutdown_connections 2024-09-21T06:43:56.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:56.806+0000 7fa1fe81f640 1 -- 172.21.15.7:0/574141369 wait complete. 2024-09-21T06:43:57.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:43:56 smithi007 ceph-mon[30983]: pgmap v553: 97 pgs: 97 active+clean; 3.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-09-21T06:43:57.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:43:56 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/574141369' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:43:57.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:43:56 smithi144 ceph-mon[34653]: pgmap v553: 97 pgs: 97 active+clean; 3.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-09-21T06:43:57.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:43:56 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/574141369' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:43:57.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:43:56 smithi018 ceph-mon[34477]: pgmap v553: 97 pgs: 97 active+clean; 3.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-09-21T06:43:57.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:43:56 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/574141369' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:43:57.510 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:43:57.768 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:43:58.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.270+0000 7f040af58640 1 -- 172.21.15.7:0/2443599170 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0404103b80 msgr2=0x7f0404103f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:58.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.270+0000 7f040af58640 1 --2- 172.21.15.7:0/2443599170 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0404103b80 0x7f0404103f90 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f03f8009900 tx=0x7f03f802a3f0 comp rx=0 tx=0).stop 2024-09-21T06:43:58.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.270+0000 7f040af58640 1 -- 172.21.15.7:0/2443599170 shutdown_connections 2024-09-21T06:43:58.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.270+0000 7f040af58640 1 --2- 172.21.15.7:0/2443599170 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0404109e10 0x7f0404110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:58.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.270+0000 7f040af58640 1 --2- 172.21.15.7:0/2443599170 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f04041094c0 0x7f04041098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:58.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.271+0000 7f040af58640 1 --2- 172.21.15.7:0/2443599170 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0404103b80 0x7f0404103f90 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:58.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.271+0000 7f040af58640 1 -- 172.21.15.7:0/2443599170 >> 172.21.15.7:0/2443599170 conn(0x7f04040ff610 msgr2=0x7f0404101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:58.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.271+0000 7f040af58640 1 -- 172.21.15.7:0/2443599170 shutdown_connections 2024-09-21T06:43:58.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.271+0000 7f040af58640 1 -- 172.21.15.7:0/2443599170 wait complete. 2024-09-21T06:43:58.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.271+0000 7f040af58640 1 Processor -- start 2024-09-21T06:43:58.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.271+0000 7f040af58640 1 -- start start 2024-09-21T06:43:58.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.272+0000 7f040af58640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0404103b80 0x7f040419a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:58.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.272+0000 7f040af58640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04041094c0 0x7f040419a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:58.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.272+0000 7f040af58640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0404109e10 0x7f040419fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:58.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.272+0000 7f040af58640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0404113ad0 con 0x7f0404109e10 2024-09-21T06:43:58.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.272+0000 7f040af58640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0404113950 con 0x7f0404103b80 2024-09-21T06:43:58.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.272+0000 7f040af58640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0404113c50 con 0x7f04041094c0 2024-09-21T06:43:58.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.272+0000 7f04094f5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0404109e10 0x7f040419fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:58.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.272+0000 7f04094f5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0404109e10 0x7f040419fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51606/0 (socket says 172.21.15.7:51606) 2024-09-21T06:43:58.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.272+0000 7f0408cf4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0404103b80 0x7f040419a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:58.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.272+0000 7f04094f5640 1 -- 172.21.15.7:0/1470657653 learned_addr learned my addr 172.21.15.7:0/1470657653 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:43:58.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.272+0000 7f0403fff640 1 --2- 172.21.15.7:0/1470657653 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04041094c0 0x7f040419a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:58.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.272+0000 7f04094f5640 1 -- 172.21.15.7:0/1470657653 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04041094c0 msgr2=0x7f040419a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:58.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.272+0000 7f04094f5640 1 --2- 172.21.15.7:0/1470657653 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04041094c0 0x7f040419a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:58.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.272+0000 7f04094f5640 1 -- 172.21.15.7:0/1470657653 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0404103b80 msgr2=0x7f040419a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:58.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.272+0000 7f04094f5640 1 --2- 172.21.15.7:0/1470657653 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0404103b80 0x7f040419a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:58.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.272+0000 7f04094f5640 1 -- 172.21.15.7:0/1470657653 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04041a02d0 con 0x7f0404109e10 2024-09-21T06:43:58.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.272+0000 7f04094f5640 1 --2- 172.21.15.7:0/1470657653 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0404109e10 0x7f040419fc60 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f03fc00cce0 tx=0x7f03fc00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:58.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.273+0000 7f0401ffb640 1 -- 172.21.15.7:0/1470657653 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03fc00f450 con 0x7f0404109e10 2024-09-21T06:43:58.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.273+0000 7f040af58640 1 -- 172.21.15.7:0/1470657653 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04041a05c0 con 0x7f0404109e10 2024-09-21T06:43:58.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.273+0000 7f0401ffb640 1 -- 172.21.15.7:0/1470657653 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f03fc00faa0 con 0x7f0404109e10 2024-09-21T06:43:58.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.273+0000 7f0401ffb640 1 -- 172.21.15.7:0/1470657653 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03fc018a80 con 0x7f0404109e10 2024-09-21T06:43:58.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.273+0000 7f040af58640 1 -- 172.21.15.7:0/1470657653 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04041a6de0 con 0x7f0404109e10 2024-09-21T06:43:58.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.276+0000 7f0401ffb640 1 -- 172.21.15.7:0/1470657653 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f03fc00fc50 con 0x7f0404109e10 2024-09-21T06:43:58.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.276+0000 7f04114cc740 1 Processor -- start 2024-09-21T06:43:58.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.276+0000 7f04114cc740 1 -- start start 2024-09-21T06:43:58.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.276+0000 7f04114cc740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a19121d070 0x55a1915c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:58.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.276+0000 7f04114cc740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a1911f41b0 0x55a1915c4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:58.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.276+0000 7f04114cc740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a1911fc390 0x55a1915c4d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:58.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.276+0000 7f04114cc740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55a19153aea0 con 0x55a1911f41b0 2024-09-21T06:43:58.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.276+0000 7f04114cc740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a19152a2d0 con 0x55a1911fc390 2024-09-21T06:43:58.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.276+0000 7f04114cc740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55a19152e0e0 con 0x55a19121d070 2024-09-21T06:43:58.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.276+0000 7f0403fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a1911fc390 0x55a1915c4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:58.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.276+0000 7f0403fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a1911fc390 0x55a1915c4d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.7:55608/0 (socket says 172.21.15.7:55608) 2024-09-21T06:43:58.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.276+0000 7f0403fff640 1 -- 172.21.15.7:0/2737644404 learned_addr learned my addr 172.21.15.7:0/2737644404 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:43:58.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.276+0000 7f0403fff640 1 --2- 172.21.15.7:0/2737644404 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a19121d070 0x55a1915c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:58.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.277+0000 7f0403fff640 1 -- 172.21.15.7:0/2737644404 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a1911fc390 msgr2=0x55a1915c4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:58.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.277+0000 7f0401ffb640 1 --2- 172.21.15.7:0/1470657653 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f03f40b66b0 0x7f03f40b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:58.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.277+0000 7f0403fff640 1 --2- 172.21.15.7:0/2737644404 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a1911fc390 0x55a1915c4d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:58.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.277+0000 7f0403fff640 1 -- 172.21.15.7:0/2737644404 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a1911f41b0 msgr2=0x55a1915c4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:58.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.277+0000 7f0403fff640 1 --2- 172.21.15.7:0/2737644404 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a1911f41b0 0x55a1915c4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:58.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.277+0000 7f0403fff640 1 -- 172.21.15.7:0/2737644404 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a191288650 con 0x55a19121d070 2024-09-21T06:43:58.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.277+0000 7f04094f5640 1 --2- 172.21.15.7:0/1470657653 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f03f40b66b0 0x7f03f40b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:58.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.277+0000 7f0403fff640 1 --2- 172.21.15.7:0/2737644404 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a19121d070 0x55a1915c42c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f03f0011780 tx=0x7f03f000a2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc55665fa4168cb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:58.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.277+0000 7f0401ffb640 1 -- 172.21.15.7:0/1470657653 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8412+0+0 (secure 0 0 0) 0x7f03fc0e7a60 con 0x7f0404109e10 2024-09-21T06:43:58.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.277+0000 7f03eeffd640 1 -- 172.21.15.7:0/2737644404 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03f0011260 con 0x55a19121d070 2024-09-21T06:43:58.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.277+0000 7f03eeffd640 1 -- 172.21.15.7:0/2737644404 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f03f00054d0 con 0x55a19121d070 2024-09-21T06:43:58.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.277+0000 7f03eeffd640 1 -- 172.21.15.7:0/2737644404 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03f000d740 con 0x55a19121d070 2024-09-21T06:43:58.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.278+0000 7f04114cc740 1 -- 172.21.15.7:0/2737644404 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a19121d070 msgr2=0x55a1915c42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:58.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.278+0000 7f04114cc740 1 --2- 172.21.15.7:0/2737644404 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a19121d070 0x55a1915c42c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f03f0011780 tx=0x7f03f000a2d0 comp rx=0 tx=0).stop 2024-09-21T06:43:58.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.278+0000 7f04094f5640 1 --2- 172.21.15.7:0/1470657653 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f03f40b66b0 0x7f03f40b8bc0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f03fc0ad620 tx=0x7f03fc071e00 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:58.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.278+0000 7f04114cc740 1 -- 172.21.15.7:0/2737644404 shutdown_connections 2024-09-21T06:43:58.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.278+0000 7f04114cc740 1 --2- 172.21.15.7:0/2737644404 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a1911fc390 0x55a1915c4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:58.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.278+0000 7f04114cc740 1 --2- 172.21.15.7:0/2737644404 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a1911f41b0 0x55a1915c4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:58.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.278+0000 7f04114cc740 1 --2- 172.21.15.7:0/2737644404 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a19121d070 0x55a1915c42c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:58.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.278+0000 7f04114cc740 1 -- 172.21.15.7:0/2737644404 >> 172.21.15.7:0/2737644404 conn(0x55a191211460 msgr2=0x55a1915c21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:58.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.278+0000 7f04114cc740 1 -- 172.21.15.7:0/2737644404 shutdown_connections 2024-09-21T06:43:58.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.278+0000 7f04114cc740 1 -- 172.21.15.7:0/2737644404 wait complete. 2024-09-21T06:43:58.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.279+0000 7f04114cc740 1 -- start start 2024-09-21T06:43:58.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.279+0000 7f04114cc740 1 Processor -- start 2024-09-21T06:43:58.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.279+0000 7f04114cc740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a1911f41b0 0x55a1915cfa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:58.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.279+0000 7f04114cc740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a1911fc390 0x55a1915cff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:58.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.279+0000 7f04114cc740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a19121d070 0x55a1915dbd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:58.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.279+0000 7f04114cc740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55a19138b700 con 0x55a1911f41b0 2024-09-21T06:43:58.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.279+0000 7f04114cc740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a1914c5160 con 0x55a19121d070 2024-09-21T06:43:58.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.279+0000 7f04114cc740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55a1915d2aa0 con 0x55a1911fc390 2024-09-21T06:43:58.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.279+0000 7f04114cc740 10 client.0 _ll_register_callbacks cb 0x55a1914de9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:43:58.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.279+0000 7f0403fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a1911f41b0 0x55a1915cfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:58.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.279+0000 7f0403fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a1911f41b0 0x55a1915cfa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51628/0 (socket says 172.21.15.7:51628) 2024-09-21T06:43:58.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.279+0000 7f0403fff640 1 -- 172.21.15.7:0/776047346 learned_addr learned my addr 172.21.15.7:0/776047346 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:43:58.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.280+0000 7f0408cf4640 1 --2- 172.21.15.7:0/776047346 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a1911fc390 0x55a1915cff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:58.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.280+0000 7f0403fff640 1 --2- 172.21.15.7:0/776047346 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a19121d070 0x55a1915dbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:58.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.280+0000 7f0403fff640 1 -- 172.21.15.7:0/776047346 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a1911fc390 msgr2=0x55a1915cff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:58.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.280+0000 7f0403fff640 1 --2- 172.21.15.7:0/776047346 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a1911fc390 0x55a1915cff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:58.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.280+0000 7f0403fff640 1 -- 172.21.15.7:0/776047346 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a19121d070 msgr2=0x55a1915dbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:58.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.280+0000 7f0403fff640 1 --2- 172.21.15.7:0/776047346 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a19121d070 0x55a1915dbd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:58.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.280+0000 7f0403fff640 1 -- 172.21.15.7:0/776047346 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1914f2c90 con 0x55a1911f41b0 2024-09-21T06:43:58.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.280+0000 7f0403fff640 1 --2- 172.21.15.7:0/776047346 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a1911f41b0 0x55a1915cfa40 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f03f000ac80 tx=0x7f03f000ac10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eeaa1d9a0a562376 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:58.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.280+0000 7f03e3fff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:43:58.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.280+0000 7f03e3fff640 1 -- 172.21.15.7:0/776047346 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03f000a630 con 0x55a1911f41b0 2024-09-21T06:43:58.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.280+0000 7f03e3fff640 1 -- 172.21.15.7:0/776047346 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8412+0+0 (secure 0 0 0) 0x7f03f000d710 con 0x55a1911f41b0 2024-09-21T06:43:58.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.280+0000 7f04114cc740 1 -- 172.21.15.7:0/776047346 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f03f00054d0 con 0x55a1911f41b0 2024-09-21T06:43:58.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.280+0000 7f03e3fff640 1 -- 172.21.15.7:0/776047346 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f03f0036050 con 0x55a1911f41b0 2024-09-21T06:43:58.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.281+0000 7f04114cc740 10 client.17022 fetch_fsmap learned FSMap version 25 2024-09-21T06:43:58.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.281+0000 7f04114cc740 1 -- 172.21.15.7:0/776047346 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a1915de880 con 0x55a1911f41b0 2024-09-21T06:43:58.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.281+0000 7f03e3fff640 1 -- 172.21.15.7:0/776047346 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f03f00054d0 con 0x55a1911f41b0 2024-09-21T06:43:58.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.281+0000 7f03e3fff640 1 -- 172.21.15.7:0/776047346 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f03f001e6f0 con 0x55a1911f41b0 2024-09-21T06:43:58.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.281+0000 7f04114cc740 10 client.17022 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:43:58.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.281+0000 7f04114cc740 10 client.17022 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-21T06:43:58.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.281+0000 7f04114cc740 20 client.17022 populate_metadata read hostname 'smithi007' 2024-09-21T06:43:58.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.281+0000 7f04114cc740 1 --2- 172.21.15.7:0/776047346 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x55a1911db9f0 0x55a1915e1be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:58.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.281+0000 7f04114cc740 4 client.17022 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:43:58.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.281+0000 7f04114cc740 1 -- 172.21.15.7:0/776047346 --> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a19153cdf0 con 0x55a1911db9f0 2024-09-21T06:43:58.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.281+0000 7f0408cf4640 1 --2- 172.21.15.7:0/776047346 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x55a1911db9f0 0x55a1915e1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:58.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.282+0000 7f03e3fff640 10 client.17022 ms_handle_connect on v2:172.21.15.18:6836/1539670694 2024-09-21T06:43:58.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.282+0000 7f0408cf4640 1 --2- 172.21.15.7:0/776047346 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x55a1911db9f0 0x55a1915e1be0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5d93185451f9ac82 server_cookie=61e93fdb291b32fb in_seq=0 out_seq=0 2024-09-21T06:43:58.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.283+0000 7f03e3fff640 1 -- 172.21.15.7:0/776047346 <== mds.2 v2:172.21.15.18:6836/1539670694 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a19153cdf0 con 0x55a1911db9f0 2024-09-21T06:43:58.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.283+0000 7f03e3fff640 10 client.17022 handle_command_reply: tid=0 2024-09-21T06:43:58.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.283+0000 7f04114cc740 1 client.17022 shutdown 2024-09-21T06:43:58.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.283+0000 7f04114cc740 1 -- 172.21.15.7:0/776047346 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a1911f41b0 msgr2=0x55a1915cfa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:58.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.283+0000 7f04114cc740 1 --2- 172.21.15.7:0/776047346 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a1911f41b0 0x55a1915cfa40 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f03f000ac80 tx=0x7f03f000ac10 comp rx=0 tx=0).stop 2024-09-21T06:43:58.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.283+0000 7f04114cc740 1 -- 172.21.15.7:0/776047346 shutdown_connections 2024-09-21T06:43:58.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.283+0000 7f04114cc740 1 --2- 172.21.15.7:0/776047346 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x55a1911db9f0 0x55a1915e1be0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:58.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.283+0000 7f04114cc740 1 --2- 172.21.15.7:0/776047346 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a19121d070 0x55a1915dbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:58.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.283+0000 7f03e3fff640 0 client.17022 ms_handle_reset on v2:172.21.15.18:6836/1539670694 2024-09-21T06:43:58.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.283+0000 7f04114cc740 1 --2- 172.21.15.7:0/776047346 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a1911fc390 0x55a1915cff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:58.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.283+0000 7f04114cc740 1 --2- 172.21.15.7:0/776047346 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a1911f41b0 0x55a1915cfa40 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:58.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.283+0000 7f04114cc740 1 -- 172.21.15.7:0/776047346 >> 172.21.15.7:0/776047346 conn(0x55a191211460 msgr2=0x55a1915c74a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:58.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.283+0000 7f04114cc740 1 -- 172.21.15.7:0/776047346 shutdown_connections 2024-09-21T06:43:58.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.283+0000 7f04114cc740 1 -- 172.21.15.7:0/776047346 wait complete. 2024-09-21T06:43:58.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.283+0000 7f04114cc740 20 client.17022 trim_cache size 0 max 16384 2024-09-21T06:43:58.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.299+0000 7f04114cc740 1 Processor -- start 2024-09-21T06:43:58.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.299+0000 7f04114cc740 1 -- start start 2024-09-21T06:43:58.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.299+0000 7f04114cc740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a1911db9f0 0x55a1915c7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:58.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.299+0000 7f04114cc740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a1911f41b0 0x55a1915ccc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:58.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.299+0000 7f04114cc740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a1911fc390 0x55a1915cd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:58.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.300+0000 7f04114cc740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f04041b1cb0 con 0x55a1911fc390 2024-09-21T06:43:58.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.300+0000 7f04114cc740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f04041af580 con 0x55a1911db9f0 2024-09-21T06:43:58.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.300+0000 7f04114cc740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f04041ad3f0 con 0x55a1911f41b0 2024-09-21T06:43:58.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.300+0000 7f0403fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a1911fc390 0x55a1915cd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:58.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.300+0000 7f0403fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a1911fc390 0x55a1915cd170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51634/0 (socket says 172.21.15.7:51634) 2024-09-21T06:43:58.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.300+0000 7f0403fff640 1 -- 172.21.15.7:0/193405046 learned_addr learned my addr 172.21.15.7:0/193405046 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:43:58.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.300+0000 7f0403fff640 1 --2- 172.21.15.7:0/193405046 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a1911db9f0 0x55a1915c7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:58.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.300+0000 7f0403fff640 1 -- 172.21.15.7:0/193405046 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a1911f41b0 msgr2=0x55a1915ccc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:58.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.300+0000 7f0403fff640 1 --2- 172.21.15.7:0/193405046 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a1911f41b0 0x55a1915ccc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:58.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.300+0000 7f0403fff640 1 -- 172.21.15.7:0/193405046 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a1911db9f0 msgr2=0x55a1915c7aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:58.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.300+0000 7f0403fff640 1 --2- 172.21.15.7:0/193405046 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a1911db9f0 0x55a1915c7aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:58.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.300+0000 7f0403fff640 1 -- 172.21.15.7:0/193405046 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1915d0ae0 con 0x55a1911fc390 2024-09-21T06:43:58.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.300+0000 7f0403fff640 1 --2- 172.21.15.7:0/193405046 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a1911fc390 0x55a1915cd170 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f03f000a350 tx=0x7f03f0004f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5548bc70dfaf9e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:58.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.301+0000 7f03ee7fc640 1 -- 172.21.15.7:0/193405046 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03f000a630 con 0x55a1911fc390 2024-09-21T06:43:58.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.301+0000 7f03ee7fc640 1 -- 172.21.15.7:0/193405046 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f03f001e8f0 con 0x55a1911fc390 2024-09-21T06:43:58.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.301+0000 7f03ee7fc640 1 -- 172.21.15.7:0/193405046 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03f0005470 con 0x55a1911fc390 2024-09-21T06:43:58.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.302+0000 7f04114cc740 1 -- 172.21.15.7:0/193405046 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a1911fc390 msgr2=0x55a1915cd170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:58.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.302+0000 7f04114cc740 1 --2- 172.21.15.7:0/193405046 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a1911fc390 0x55a1915cd170 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f03f000a350 tx=0x7f03f0004f10 comp rx=0 tx=0).stop 2024-09-21T06:43:58.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.302+0000 7f04114cc740 1 -- 172.21.15.7:0/193405046 shutdown_connections 2024-09-21T06:43:58.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.302+0000 7f04114cc740 1 --2- 172.21.15.7:0/193405046 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a1911fc390 0x55a1915cd170 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:58.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.302+0000 7f04114cc740 1 --2- 172.21.15.7:0/193405046 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a1911f41b0 0x55a1915ccc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:58.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.302+0000 7f04114cc740 1 --2- 172.21.15.7:0/193405046 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a1911db9f0 0x55a1915c7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:58.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.302+0000 7f04114cc740 1 -- 172.21.15.7:0/193405046 >> 172.21.15.7:0/193405046 conn(0x55a191211460 msgr2=0x55a1915c7390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:58.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.302+0000 7f04114cc740 1 -- 172.21.15.7:0/193405046 shutdown_connections 2024-09-21T06:43:58.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.302+0000 7f04114cc740 1 -- 172.21.15.7:0/193405046 wait complete. 2024-09-21T06:43:58.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.302+0000 7f04114cc740 1 -- start start 2024-09-21T06:43:58.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.302+0000 7f04114cc740 1 Processor -- start 2024-09-21T06:43:58.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.303+0000 7f04114cc740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a1911db9f0 0x55a1915e51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:58.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.303+0000 7f04114cc740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a1911f41b0 0x55a1915e26a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:58.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.303+0000 7f04114cc740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a1911fc390 0x55a1915e2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:58.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.303+0000 7f04114cc740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f04041ada40 con 0x55a1911fc390 2024-09-21T06:43:58.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.303+0000 7f04114cc740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f04041aeeb0 con 0x55a1911f41b0 2024-09-21T06:43:58.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.303+0000 7f04114cc740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f04041ae110 con 0x55a1911db9f0 2024-09-21T06:43:58.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.303+0000 7f04114cc740 10 client.0 _ll_register_callbacks cb 0x7f03f000aa70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:43:58.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.303+0000 7f0403fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a1911fc390 0x55a1915e2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:58.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.303+0000 7f0403fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a1911fc390 0x55a1915e2be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51642/0 (socket says 172.21.15.7:51642) 2024-09-21T06:43:58.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.303+0000 7f0403fff640 1 -- 172.21.15.7:0/1257919858 learned_addr learned my addr 172.21.15.7:0/1257919858 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:43:58.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.303+0000 7f0403fff640 1 --2- 172.21.15.7:0/1257919858 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a1911db9f0 0x55a1915e51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:58.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.303+0000 7f0408cf4640 1 --2- 172.21.15.7:0/1257919858 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a1911f41b0 0x55a1915e26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:58.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.303+0000 7f0403fff640 1 -- 172.21.15.7:0/1257919858 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a1911db9f0 msgr2=0x55a1915e51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:58.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.303+0000 7f0403fff640 1 --2- 172.21.15.7:0/1257919858 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a1911db9f0 0x55a1915e51d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:58.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.303+0000 7f0403fff640 1 -- 172.21.15.7:0/1257919858 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a1911f41b0 msgr2=0x55a1915e26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:58.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.303+0000 7f0403fff640 1 --2- 172.21.15.7:0/1257919858 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a1911f41b0 0x55a1915e26a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:58.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.303+0000 7f0403fff640 1 -- 172.21.15.7:0/1257919858 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1915e3150 con 0x55a1911fc390 2024-09-21T06:43:58.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.303+0000 7f0403fff640 1 --2- 172.21.15.7:0/1257919858 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a1911fc390 0x55a1915e2be0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x55a1915e8040 tx=0x7f03f003c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c01b2343eae7118d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:58.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.303+0000 7f03e3fff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:43:58.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.304+0000 7f03e3fff640 1 -- 172.21.15.7:0/1257919858 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03f000a630 con 0x55a1911fc390 2024-09-21T06:43:58.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.304+0000 7f03e3fff640 1 -- 172.21.15.7:0/1257919858 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8412+0+0 (secure 0 0 0) 0x7f03f0005420 con 0x55a1911fc390 2024-09-21T06:43:58.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.304+0000 7f04114cc740 1 -- 172.21.15.7:0/1257919858 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f03f001e8f0 con 0x55a1911fc390 2024-09-21T06:43:58.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.304+0000 7f03e3fff640 1 -- 172.21.15.7:0/1257919858 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f03f0030340 con 0x55a1911fc390 2024-09-21T06:43:58.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.304+0000 7f04114cc740 10 client.17028 fetch_fsmap learned FSMap version 25 2024-09-21T06:43:58.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.304+0000 7f04114cc740 1 -- 172.21.15.7:0/1257919858 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a19164c080 con 0x55a1911fc390 2024-09-21T06:43:58.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.304+0000 7f03e3fff640 1 -- 172.21.15.7:0/1257919858 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f03f001e8f0 con 0x55a1911fc390 2024-09-21T06:43:58.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.304+0000 7f03e3fff640 1 -- 172.21.15.7:0/1257919858 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f03f000dae0 con 0x55a1911fc390 2024-09-21T06:43:58.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.304+0000 7f04114cc740 10 client.17028 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:43:58.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.304+0000 7f04114cc740 10 client.17028 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-21T06:43:58.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.304+0000 7f04114cc740 20 client.17028 populate_metadata read hostname 'smithi007' 2024-09-21T06:43:58.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.304+0000 7f04114cc740 1 --2- 172.21.15.7:0/1257919858 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x55a19121d070 0x55a19164e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:58.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.304+0000 7f04114cc740 4 client.17028 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:43:58.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.304+0000 7f04114cc740 1 -- 172.21.15.7:0/1257919858 --> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a1915388a0 con 0x55a19121d070 2024-09-21T06:43:58.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.305+0000 7f0408cf4640 1 --2- 172.21.15.7:0/1257919858 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x55a19121d070 0x55a19164e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:58.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.305+0000 7f0408cf4640 1 --2- 172.21.15.7:0/1257919858 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x55a19121d070 0x55a19164e720 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d30c05d9a87b6657 server_cookie=76f1e45529c58378 in_seq=0 out_seq=0 2024-09-21T06:43:58.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.305+0000 7f03e3fff640 10 client.17028 ms_handle_connect on v2:172.21.15.18:6836/1539670694 2024-09-21T06:43:58.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.305+0000 7f03e3fff640 1 -- 172.21.15.7:0/1257919858 <== mds.2 v2:172.21.15.18:6836/1539670694 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a1915388a0 con 0x55a19121d070 2024-09-21T06:43:58.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.305+0000 7f03e3fff640 10 client.17028 handle_command_reply: tid=0 2024-09-21T06:43:58.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.305+0000 7f04114cc740 1 client.17028 shutdown 2024-09-21T06:43:58.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.306+0000 7f04114cc740 1 -- 172.21.15.7:0/1257919858 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a1911fc390 msgr2=0x55a1915e2be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:58.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.306+0000 7f04114cc740 1 --2- 172.21.15.7:0/1257919858 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a1911fc390 0x55a1915e2be0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x55a1915e8040 tx=0x7f03f003c040 comp rx=0 tx=0).stop 2024-09-21T06:43:58.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.306+0000 7f04114cc740 1 -- 172.21.15.7:0/1257919858 shutdown_connections 2024-09-21T06:43:58.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.306+0000 7f04114cc740 1 --2- 172.21.15.7:0/1257919858 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x55a19121d070 0x55a19164e720 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:58.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.306+0000 7f04114cc740 1 --2- 172.21.15.7:0/1257919858 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a1911fc390 0x55a1915e2be0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:58.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.306+0000 7f04114cc740 1 --2- 172.21.15.7:0/1257919858 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a1911f41b0 0x55a1915e26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:58.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.306+0000 7f04114cc740 1 --2- 172.21.15.7:0/1257919858 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a1911db9f0 0x55a1915e51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:58.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.306+0000 7f04114cc740 1 -- 172.21.15.7:0/1257919858 >> 172.21.15.7:0/1257919858 conn(0x55a191211460 msgr2=0x55a1915c7390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:58.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.306+0000 7f03e3fff640 0 client.17028 ms_handle_reset on v2:172.21.15.18:6836/1539670694 2024-09-21T06:43:58.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.306+0000 7f04114cc740 1 -- 172.21.15.7:0/1257919858 shutdown_connections 2024-09-21T06:43:58.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.306+0000 7f04114cc740 1 -- 172.21.15.7:0/1257919858 wait complete. 2024-09-21T06:43:58.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.306+0000 7f04114cc740 20 client.17028 trim_cache size 0 max 16384 2024-09-21T06:43:58.313 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:43:58.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.307+0000 7f040af58640 1 -- 172.21.15.7:0/1470657653 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f03f40b66b0 msgr2=0x7f03f40b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:58.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.307+0000 7f040af58640 1 --2- 172.21.15.7:0/1470657653 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f03f40b66b0 0x7f03f40b8bc0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f03fc0ad620 tx=0x7f03fc071e00 comp rx=0 tx=0).stop 2024-09-21T06:43:58.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.307+0000 7f040af58640 1 -- 172.21.15.7:0/1470657653 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0404109e10 msgr2=0x7f040419fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:58.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.307+0000 7f040af58640 1 --2- 172.21.15.7:0/1470657653 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0404109e10 0x7f040419fc60 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f03fc00cce0 tx=0x7f03fc00a620 comp rx=0 tx=0).stop 2024-09-21T06:43:58.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.307+0000 7f040af58640 1 -- 172.21.15.7:0/1470657653 shutdown_connections 2024-09-21T06:43:58.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.307+0000 7f040af58640 1 --2- 172.21.15.7:0/1470657653 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f03f40b66b0 0x7f03f40b8bc0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:58.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.307+0000 7f040af58640 1 --2- 172.21.15.7:0/1470657653 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0404109e10 0x7f040419fc60 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:58.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.307+0000 7f040af58640 1 --2- 172.21.15.7:0/1470657653 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f04041094c0 0x7f040419a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:58.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.307+0000 7f040af58640 1 --2- 172.21.15.7:0/1470657653 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0404103b80 0x7f040419a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:58.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.307+0000 7f040af58640 1 -- 172.21.15.7:0/1470657653 >> 172.21.15.7:0/1470657653 conn(0x7f04040ff610 msgr2=0x7f0404101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:58.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.307+0000 7f040af58640 1 -- 172.21.15.7:0/1470657653 shutdown_connections 2024-09-21T06:43:58.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:58.307+0000 7f040af58640 1 -- 172.21.15.7:0/1470657653 wait complete. 2024-09-21T06:43:58.998 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:43:59.263 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:43:59.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:43:58 smithi144 ceph-mon[34653]: pgmap v554: 97 pgs: 97 active+clean; 3.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 7 op/s 2024-09-21T06:43:59.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:43:58 smithi007 ceph-mon[30983]: pgmap v554: 97 pgs: 97 active+clean; 3.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 7 op/s 2024-09-21T06:43:59.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:43:58 smithi018 ceph-mon[34477]: pgmap v554: 97 pgs: 97 active+clean; 3.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 7 op/s 2024-09-21T06:43:59.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.773+0000 7f381b616640 1 -- 172.21.15.7:0/2565944647 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38141094c0 msgr2=0x7f38141098d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:59.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.773+0000 7f381b616640 1 --2- 172.21.15.7:0/2565944647 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38141094c0 0x7f38141098d0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f3804009900 tx=0x7f380402a410 comp rx=0 tx=0).stop 2024-09-21T06:43:59.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.773+0000 7f381b616640 1 -- 172.21.15.7:0/2565944647 shutdown_connections 2024-09-21T06:43:59.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.773+0000 7f381b616640 1 --2- 172.21.15.7:0/2565944647 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3814109e10 0x7f3814110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:59.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.773+0000 7f381b616640 1 --2- 172.21.15.7:0/2565944647 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38141094c0 0x7f38141098d0 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:59.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.773+0000 7f381b616640 1 --2- 172.21.15.7:0/2565944647 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3814103b80 0x7f3814103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:59.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.773+0000 7f381b616640 1 -- 172.21.15.7:0/2565944647 >> 172.21.15.7:0/2565944647 conn(0x7f38140ff610 msgr2=0x7f3814101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:59.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.773+0000 7f381b616640 1 -- 172.21.15.7:0/2565944647 shutdown_connections 2024-09-21T06:43:59.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.773+0000 7f381b616640 1 -- 172.21.15.7:0/2565944647 wait complete. 2024-09-21T06:43:59.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.774+0000 7f381b616640 1 Processor -- start 2024-09-21T06:43:59.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.774+0000 7f381b616640 1 -- start start 2024-09-21T06:43:59.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.774+0000 7f381b616640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3814103b80 0x7f3814075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:59.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.774+0000 7f381b616640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38141094c0 0x7f3814075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:59.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.774+0000 7f381b616640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3814109e10 0x7f3814076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:59.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.774+0000 7f381b616640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3814113ad0 con 0x7f38141094c0 2024-09-21T06:43:59.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.774+0000 7f381b616640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3814113950 con 0x7f3814109e10 2024-09-21T06:43:59.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.774+0000 7f381b616640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3814113c50 con 0x7f3814103b80 2024-09-21T06:43:59.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.774+0000 7f3818bb1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38141094c0 0x7f3814075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:59.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.774+0000 7f3818bb1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38141094c0 0x7f3814075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51668/0 (socket says 172.21.15.7:51668) 2024-09-21T06:43:59.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.774+0000 7f3818bb1640 1 -- 172.21.15.7:0/2999983049 learned_addr learned my addr 172.21.15.7:0/2999983049 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:43:59.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.775+0000 7f3819bb3640 1 --2- 172.21.15.7:0/2999983049 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3814109e10 0x7f3814076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:59.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.775+0000 7f38193b2640 1 --2- 172.21.15.7:0/2999983049 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3814103b80 0x7f3814075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:59.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.775+0000 7f3818bb1640 1 -- 172.21.15.7:0/2999983049 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3814103b80 msgr2=0x7f3814075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:59.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.775+0000 7f3818bb1640 1 --2- 172.21.15.7:0/2999983049 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3814103b80 0x7f3814075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:59.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.775+0000 7f3818bb1640 1 -- 172.21.15.7:0/2999983049 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3814109e10 msgr2=0x7f3814076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:59.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.775+0000 7f3818bb1640 1 --2- 172.21.15.7:0/2999983049 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3814109e10 0x7f3814076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:59.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.775+0000 7f3818bb1640 1 -- 172.21.15.7:0/2999983049 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38141a8780 con 0x7f38141094c0 2024-09-21T06:43:59.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.775+0000 7f3818bb1640 1 --2- 172.21.15.7:0/2999983049 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38141094c0 0x7f3814075c50 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f380402a930 tx=0x7f3804004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:59.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.775+0000 7f380a7fc640 1 -- 172.21.15.7:0/2999983049 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f380403f030 con 0x7f38141094c0 2024-09-21T06:43:59.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.775+0000 7f380a7fc640 1 -- 172.21.15.7:0/2999983049 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3804003aa0 con 0x7f38141094c0 2024-09-21T06:43:59.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.775+0000 7f381b616640 1 -- 172.21.15.7:0/2999983049 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38141a8a10 con 0x7f38141094c0 2024-09-21T06:43:59.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.775+0000 7f380a7fc640 1 -- 172.21.15.7:0/2999983049 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3804035070 con 0x7f38141094c0 2024-09-21T06:43:59.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.775+0000 7f381b616640 1 -- 172.21.15.7:0/2999983049 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38141a8ef0 con 0x7f38141094c0 2024-09-21T06:43:59.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.778+0000 7f3821b8a740 1 Processor -- start 2024-09-21T06:43:59.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.778+0000 7f380a7fc640 1 -- 172.21.15.7:0/2999983049 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f3804042030 con 0x7f38141094c0 2024-09-21T06:43:59.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.778+0000 7f3821b8a740 1 -- start start 2024-09-21T06:43:59.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.778+0000 7f3821b8a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5630ea5a7070 0x5630ea94e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:59.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.778+0000 7f3821b8a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5630ea57e1b0 0x5630ea94e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:59.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.778+0000 7f3821b8a740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5630ea586390 0x5630ea94ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:59.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.778+0000 7f3821b8a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5630ea8c4ea0 con 0x5630ea5a7070 2024-09-21T06:43:59.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.778+0000 7f3821b8a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5630ea8b42d0 con 0x5630ea57e1b0 2024-09-21T06:43:59.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.778+0000 7f3821b8a740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5630ea8b80e0 con 0x5630ea586390 2024-09-21T06:43:59.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.779+0000 7f3819bb3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5630ea5a7070 0x5630ea94e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:59.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.779+0000 7f3819bb3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5630ea5a7070 0x5630ea94e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51682/0 (socket says 172.21.15.7:51682) 2024-09-21T06:43:59.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.779+0000 7f3819bb3640 1 -- 172.21.15.7:0/3087078998 learned_addr learned my addr 172.21.15.7:0/3087078998 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:43:59.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.779+0000 7f38193b2640 1 --2- 172.21.15.7:0/3087078998 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5630ea57e1b0 0x5630ea94e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:59.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.779+0000 7f3818bb1640 1 --2- 172.21.15.7:0/3087078998 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5630ea586390 0x5630ea94ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:59.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.779+0000 7f3819bb3640 1 -- 172.21.15.7:0/3087078998 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5630ea586390 msgr2=0x5630ea94ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:59.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.779+0000 7f3819bb3640 1 --2- 172.21.15.7:0/3087078998 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5630ea586390 0x5630ea94ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:59.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.779+0000 7f3819bb3640 1 -- 172.21.15.7:0/3087078998 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5630ea57e1b0 msgr2=0x5630ea94e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:59.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.779+0000 7f3819bb3640 1 --2- 172.21.15.7:0/3087078998 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5630ea57e1b0 0x5630ea94e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:59.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.779+0000 7f3819bb3640 1 -- 172.21.15.7:0/3087078998 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630ea612650 con 0x5630ea5a7070 2024-09-21T06:43:59.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.779+0000 7f3818bb1640 1 --2- 172.21.15.7:0/3087078998 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5630ea586390 0x5630ea94ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:43:59.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.779+0000 7f380a7fc640 1 --2- 172.21.15.7:0/2999983049 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f38000b6680 0x7f38000b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:59.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.779+0000 7f3819bb3640 1 --2- 172.21.15.7:0/3087078998 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5630ea5a7070 0x5630ea94e2c0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f380c010370 tx=0x7f380c010830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73a6afadba16912c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:59.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.779+0000 7f38193b2640 1 --2- 172.21.15.7:0/2999983049 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f38000b6680 0x7f38000b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:59.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.779+0000 7f380a7fc640 1 -- 172.21.15.7:0/2999983049 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8412+0+0 (secure 0 0 0) 0x7f3804107d20 con 0x7f38141094c0 2024-09-21T06:43:59.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.780+0000 7f37ff7fe640 1 -- 172.21.15.7:0/3087078998 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f380c016070 con 0x5630ea5a7070 2024-09-21T06:43:59.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.780+0000 7f37ff7fe640 1 -- 172.21.15.7:0/3087078998 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f380c004d20 con 0x5630ea5a7070 2024-09-21T06:43:59.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.780+0000 7f37ff7fe640 1 -- 172.21.15.7:0/3087078998 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f380c005420 con 0x5630ea5a7070 2024-09-21T06:43:59.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.780+0000 7f3821b8a740 1 -- 172.21.15.7:0/3087078998 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5630ea5a7070 msgr2=0x5630ea94e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:59.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.780+0000 7f38193b2640 1 --2- 172.21.15.7:0/2999983049 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f38000b6680 0x7f38000b8b90 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f3810004650 tx=0x7f381000b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:59.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.780+0000 7f3821b8a740 1 --2- 172.21.15.7:0/3087078998 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5630ea5a7070 0x5630ea94e2c0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f380c010370 tx=0x7f380c010830 comp rx=0 tx=0).stop 2024-09-21T06:43:59.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.781+0000 7f3821b8a740 1 -- 172.21.15.7:0/3087078998 shutdown_connections 2024-09-21T06:43:59.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.781+0000 7f3821b8a740 1 --2- 172.21.15.7:0/3087078998 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5630ea586390 0x5630ea94ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:59.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.781+0000 7f3821b8a740 1 --2- 172.21.15.7:0/3087078998 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5630ea57e1b0 0x5630ea94e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:59.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.781+0000 7f3821b8a740 1 --2- 172.21.15.7:0/3087078998 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5630ea5a7070 0x5630ea94e2c0 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:59.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.781+0000 7f3821b8a740 1 -- 172.21.15.7:0/3087078998 >> 172.21.15.7:0/3087078998 conn(0x5630ea59b460 msgr2=0x5630ea94c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:59.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.781+0000 7f3821b8a740 1 -- 172.21.15.7:0/3087078998 shutdown_connections 2024-09-21T06:43:59.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.781+0000 7f3821b8a740 1 -- 172.21.15.7:0/3087078998 wait complete. 2024-09-21T06:43:59.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.781+0000 7f3821b8a740 1 -- start start 2024-09-21T06:43:59.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.781+0000 7f3821b8a740 1 Processor -- start 2024-09-21T06:43:59.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.782+0000 7f3821b8a740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5630ea57e1b0 0x5630ea959a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:59.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.782+0000 7f3821b8a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5630ea586390 0x5630ea959f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:59.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.782+0000 7f3821b8a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5630ea5a7070 0x5630ea965dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:59.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.782+0000 7f3821b8a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5630ea715700 con 0x5630ea5a7070 2024-09-21T06:43:59.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.782+0000 7f3821b8a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5630ea84f160 con 0x5630ea586390 2024-09-21T06:43:59.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.782+0000 7f3821b8a740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5630ea95caa0 con 0x5630ea57e1b0 2024-09-21T06:43:59.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.782+0000 7f3821b8a740 10 client.0 _ll_register_callbacks cb 0x5630ea8689e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:43:59.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.782+0000 7f3819bb3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5630ea5a7070 0x5630ea965dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:59.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.782+0000 7f3819bb3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5630ea5a7070 0x5630ea965dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51684/0 (socket says 172.21.15.7:51684) 2024-09-21T06:43:59.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.782+0000 7f3819bb3640 1 -- 172.21.15.7:0/1365956545 learned_addr learned my addr 172.21.15.7:0/1365956545 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:43:59.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.782+0000 7f3818bb1640 1 --2- 172.21.15.7:0/1365956545 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5630ea586390 0x5630ea959f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:59.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.782+0000 7f38193b2640 1 --2- 172.21.15.7:0/1365956545 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5630ea57e1b0 0x5630ea959a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:59.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.782+0000 7f3819bb3640 1 -- 172.21.15.7:0/1365956545 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5630ea57e1b0 msgr2=0x5630ea959a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:59.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.782+0000 7f3819bb3640 1 --2- 172.21.15.7:0/1365956545 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5630ea57e1b0 0x5630ea959a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:59.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.782+0000 7f3819bb3640 1 -- 172.21.15.7:0/1365956545 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5630ea586390 msgr2=0x5630ea959f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:59.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.782+0000 7f3819bb3640 1 --2- 172.21.15.7:0/1365956545 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5630ea586390 0x5630ea959f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:59.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.782+0000 7f3819bb3640 1 -- 172.21.15.7:0/1365956545 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630ea87cc90 con 0x5630ea5a7070 2024-09-21T06:43:59.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.782+0000 7f3818bb1640 1 --2- 172.21.15.7:0/1365956545 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5630ea586390 0x5630ea959f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:43:59.791 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.782+0000 7f3819bb3640 1 --2- 172.21.15.7:0/1365956545 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5630ea5a7070 0x5630ea965dc0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f380c006010 tx=0x7f380c004c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=914b36cafcca1842 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:59.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.782+0000 7f37fcff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:43:59.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.783+0000 7f37fcff9640 1 -- 172.21.15.7:0/1365956545 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f380c029060 con 0x5630ea5a7070 2024-09-21T06:43:59.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.783+0000 7f37fcff9640 1 -- 172.21.15.7:0/1365956545 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8412+0+0 (secure 0 0 0) 0x7f380c004040 con 0x5630ea5a7070 2024-09-21T06:43:59.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.783+0000 7f3821b8a740 1 -- 172.21.15.7:0/1365956545 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f380c004d20 con 0x5630ea5a7070 2024-09-21T06:43:59.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.783+0000 7f37fcff9640 1 -- 172.21.15.7:0/1365956545 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f380c016070 con 0x5630ea5a7070 2024-09-21T06:43:59.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.783+0000 7f3821b8a740 10 client.17040 fetch_fsmap learned FSMap version 25 2024-09-21T06:43:59.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.783+0000 7f3821b8a740 1 -- 172.21.15.7:0/1365956545 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5630ea9687b0 con 0x5630ea5a7070 2024-09-21T06:43:59.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.783+0000 7f37fcff9640 1 -- 172.21.15.7:0/1365956545 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f380c004d20 con 0x5630ea5a7070 2024-09-21T06:43:59.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.783+0000 7f37fcff9640 1 -- 172.21.15.7:0/1365956545 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f380c02c020 con 0x5630ea5a7070 2024-09-21T06:43:59.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.783+0000 7f3821b8a740 10 client.17040 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:43:59.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.783+0000 7f3821b8a740 10 client.17040 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:43:59.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.783+0000 7f3821b8a740 20 client.17040 populate_metadata read hostname 'smithi007' 2024-09-21T06:43:59.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.783+0000 7f3821b8a740 1 --2- 172.21.15.7:0/1365956545 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x5630ea5659f0 0x5630ea96bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:59.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.783+0000 7f3821b8a740 4 client.17040 mds_command: new command op to 24688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:43:59.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.783+0000 7f3821b8a740 1 -- 172.21.15.7:0/1365956545 --> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5630ea8c6df0 con 0x5630ea5659f0 2024-09-21T06:43:59.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.784+0000 7f38193b2640 1 --2- 172.21.15.7:0/1365956545 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x5630ea5659f0 0x5630ea96bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:59.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.784+0000 7f38193b2640 1 --2- 172.21.15.7:0/1365956545 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x5630ea5659f0 0x5630ea96bbc0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ffbbb03bf7737dcc server_cookie=312088f3597ce694 in_seq=0 out_seq=0 2024-09-21T06:43:59.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.784+0000 7f37fcff9640 10 client.17040 ms_handle_connect on v2:172.21.15.144:6838/4027821922 2024-09-21T06:43:59.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.785+0000 7f37fcff9640 1 -- 172.21.15.7:0/1365956545 <== mds.1 v2:172.21.15.144:6838/4027821922 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5630ea8c6df0 con 0x5630ea5659f0 2024-09-21T06:43:59.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.785+0000 7f37fcff9640 10 client.17040 handle_command_reply: tid=0 2024-09-21T06:43:59.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.785+0000 7f3821b8a740 1 client.17040 shutdown 2024-09-21T06:43:59.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.785+0000 7f3821b8a740 1 -- 172.21.15.7:0/1365956545 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5630ea5a7070 msgr2=0x5630ea965dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:59.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.785+0000 7f3821b8a740 1 --2- 172.21.15.7:0/1365956545 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5630ea5a7070 0x5630ea965dc0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f380c006010 tx=0x7f380c004c70 comp rx=0 tx=0).stop 2024-09-21T06:43:59.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.785+0000 7f3821b8a740 1 -- 172.21.15.7:0/1365956545 shutdown_connections 2024-09-21T06:43:59.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.785+0000 7f3821b8a740 1 --2- 172.21.15.7:0/1365956545 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x5630ea5659f0 0x5630ea96bbc0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:59.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.785+0000 7f3821b8a740 1 --2- 172.21.15.7:0/1365956545 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5630ea5a7070 0x5630ea965dc0 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:59.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.785+0000 7f3821b8a740 1 --2- 172.21.15.7:0/1365956545 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5630ea586390 0x5630ea959f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:59.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.785+0000 7f37fcff9640 0 client.17040 ms_handle_reset on v2:172.21.15.144:6838/4027821922 2024-09-21T06:43:59.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.785+0000 7f3821b8a740 1 --2- 172.21.15.7:0/1365956545 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5630ea57e1b0 0x5630ea959a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:59.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.785+0000 7f3821b8a740 1 -- 172.21.15.7:0/1365956545 >> 172.21.15.7:0/1365956545 conn(0x5630ea59b460 msgr2=0x5630ea9514a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:59.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.785+0000 7f3821b8a740 1 -- 172.21.15.7:0/1365956545 shutdown_connections 2024-09-21T06:43:59.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.785+0000 7f3821b8a740 1 -- 172.21.15.7:0/1365956545 wait complete. 2024-09-21T06:43:59.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.786+0000 7f3821b8a740 20 client.17040 trim_cache size 0 max 16384 2024-09-21T06:43:59.801 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.799+0000 7f3821b8a740 1 Processor -- start 2024-09-21T06:43:59.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.799+0000 7f3821b8a740 1 -- start start 2024-09-21T06:43:59.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.799+0000 7f3821b8a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5630ea57e1b0 0x5630ea951ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:59.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.799+0000 7f3821b8a740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5630ea586390 0x5630ea965d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:59.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.799+0000 7f3821b8a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5630ea5a7070 0x5630ea9597d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:59.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.799+0000 7f3821b8a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f38141b40b0 con 0x5630ea5a7070 2024-09-21T06:43:59.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.799+0000 7f3821b8a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f38141b1980 con 0x5630ea57e1b0 2024-09-21T06:43:59.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.799+0000 7f3821b8a740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f38141af7f0 con 0x5630ea586390 2024-09-21T06:43:59.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.799+0000 7f3819bb3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5630ea5a7070 0x5630ea9597d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:59.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.799+0000 7f3819bb3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5630ea5a7070 0x5630ea9597d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51686/0 (socket says 172.21.15.7:51686) 2024-09-21T06:43:59.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.799+0000 7f3819bb3640 1 -- 172.21.15.7:0/4294757173 learned_addr learned my addr 172.21.15.7:0/4294757173 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:43:59.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.800+0000 7f38193b2640 1 --2- 172.21.15.7:0/4294757173 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5630ea57e1b0 0x5630ea951ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:59.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.800+0000 7f3818bb1640 1 --2- 172.21.15.7:0/4294757173 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5630ea586390 0x5630ea965d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:59.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.800+0000 7f3819bb3640 1 -- 172.21.15.7:0/4294757173 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5630ea586390 msgr2=0x5630ea965d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:59.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.800+0000 7f3819bb3640 1 --2- 172.21.15.7:0/4294757173 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5630ea586390 0x5630ea965d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:59.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.800+0000 7f3819bb3640 1 -- 172.21.15.7:0/4294757173 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5630ea57e1b0 msgr2=0x5630ea951ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:59.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.800+0000 7f3819bb3640 1 --2- 172.21.15.7:0/4294757173 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5630ea57e1b0 0x5630ea951ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:59.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.800+0000 7f3819bb3640 1 -- 172.21.15.7:0/4294757173 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630ea95ace0 con 0x5630ea5a7070 2024-09-21T06:43:59.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.800+0000 7f38193b2640 1 --2- 172.21.15.7:0/4294757173 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5630ea57e1b0 0x5630ea951ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:43:59.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.800+0000 7f3819bb3640 1 --2- 172.21.15.7:0/4294757173 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5630ea5a7070 0x5630ea9597d0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f380c005f40 tx=0x7f380c013f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce15e628c71ea516 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:59.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.800+0000 7f37feffd640 1 -- 172.21.15.7:0/4294757173 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f380c029070 con 0x5630ea5a7070 2024-09-21T06:43:59.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.800+0000 7f37feffd640 1 -- 172.21.15.7:0/4294757173 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f380c004ce0 con 0x5630ea5a7070 2024-09-21T06:43:59.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.800+0000 7f37feffd640 1 -- 172.21.15.7:0/4294757173 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f380c005a40 con 0x5630ea5a7070 2024-09-21T06:43:59.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.801+0000 7f3821b8a740 1 -- 172.21.15.7:0/4294757173 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5630ea5a7070 msgr2=0x5630ea9597d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:59.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.801+0000 7f3821b8a740 1 --2- 172.21.15.7:0/4294757173 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5630ea5a7070 0x5630ea9597d0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f380c005f40 tx=0x7f380c013f20 comp rx=0 tx=0).stop 2024-09-21T06:43:59.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.801+0000 7f3821b8a740 1 -- 172.21.15.7:0/4294757173 shutdown_connections 2024-09-21T06:43:59.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.801+0000 7f3821b8a740 1 --2- 172.21.15.7:0/4294757173 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5630ea5a7070 0x5630ea9597d0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:59.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.801+0000 7f3821b8a740 1 --2- 172.21.15.7:0/4294757173 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5630ea586390 0x5630ea965d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:59.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.801+0000 7f3821b8a740 1 --2- 172.21.15.7:0/4294757173 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5630ea57e1b0 0x5630ea951ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:59.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.801+0000 7f3821b8a740 1 -- 172.21.15.7:0/4294757173 >> 172.21.15.7:0/4294757173 conn(0x5630ea59b460 msgr2=0x5630ea9513c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:59.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.801+0000 7f3821b8a740 1 -- 172.21.15.7:0/4294757173 shutdown_connections 2024-09-21T06:43:59.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.801+0000 7f3821b8a740 1 -- 172.21.15.7:0/4294757173 wait complete. 2024-09-21T06:43:59.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.801+0000 7f3821b8a740 1 -- start start 2024-09-21T06:43:59.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.801+0000 7f3821b8a740 1 Processor -- start 2024-09-21T06:43:59.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.802+0000 7f3821b8a740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5630ea57e1b0 0x5630ea96cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:59.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.802+0000 7f3821b8a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5630ea586390 0x5630ea96d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:59.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.802+0000 7f3821b8a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5630ea5a7070 0x5630ea96d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:59.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.802+0000 7f3821b8a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f38141afe40 con 0x5630ea586390 2024-09-21T06:43:59.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.802+0000 7f3821b8a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f38141b12b0 con 0x5630ea5a7070 2024-09-21T06:43:59.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.802+0000 7f3821b8a740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f38141b0510 con 0x5630ea57e1b0 2024-09-21T06:43:59.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.802+0000 7f3821b8a740 10 client.0 _ll_register_callbacks cb 0x7f3810004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:43:59.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.802+0000 7f3818bb1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5630ea586390 0x5630ea96d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:59.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.802+0000 7f3818bb1640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5630ea586390 0x5630ea96d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51694/0 (socket says 172.21.15.7:51694) 2024-09-21T06:43:59.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.802+0000 7f3818bb1640 1 -- 172.21.15.7:0/2405214389 learned_addr learned my addr 172.21.15.7:0/2405214389 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:43:59.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.802+0000 7f38193b2640 1 --2- 172.21.15.7:0/2405214389 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5630ea57e1b0 0x5630ea96cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:59.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.802+0000 7f3819bb3640 1 --2- 172.21.15.7:0/2405214389 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5630ea5a7070 0x5630ea96d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:59.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.803+0000 7f3818bb1640 1 -- 172.21.15.7:0/2405214389 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5630ea57e1b0 msgr2=0x5630ea96cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:59.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.803+0000 7f3818bb1640 1 --2- 172.21.15.7:0/2405214389 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5630ea57e1b0 0x5630ea96cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:59.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.803+0000 7f3818bb1640 1 -- 172.21.15.7:0/2405214389 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5630ea5a7070 msgr2=0x5630ea96d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:43:59.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.803+0000 7f3818bb1640 1 --2- 172.21.15.7:0/2405214389 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5630ea5a7070 0x5630ea96d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:59.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.803+0000 7f3818bb1640 1 -- 172.21.15.7:0/2405214389 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630ea9d5370 con 0x5630ea586390 2024-09-21T06:43:59.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.803+0000 7f3818bb1640 1 --2- 172.21.15.7:0/2405214389 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5630ea586390 0x5630ea96d160 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f38040cd990 tx=0x7f380402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dc39980f21824f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:43:59.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.803+0000 7f37fcff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:43:59.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.803+0000 7f37fcff9640 1 -- 172.21.15.7:0/2405214389 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3804049040 con 0x5630ea586390 2024-09-21T06:43:59.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.803+0000 7f37fcff9640 1 -- 172.21.15.7:0/2405214389 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8412+0+0 (secure 0 0 0) 0x7f3804003c50 con 0x5630ea586390 2024-09-21T06:43:59.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.803+0000 7f3821b8a740 1 -- 172.21.15.7:0/2405214389 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f380c004ce0 con 0x5630ea586390 2024-09-21T06:43:59.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.803+0000 7f37fcff9640 1 -- 172.21.15.7:0/2405214389 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f38040c9400 con 0x5630ea586390 2024-09-21T06:43:59.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.803+0000 7f3821b8a740 10 client.17046 fetch_fsmap learned FSMap version 25 2024-09-21T06:43:59.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.803+0000 7f3821b8a740 1 -- 172.21.15.7:0/2405214389 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5630ea9d65f0 con 0x5630ea586390 2024-09-21T06:43:59.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.803+0000 7f37fcff9640 1 -- 172.21.15.7:0/2405214389 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f380c004ce0 con 0x5630ea586390 2024-09-21T06:43:59.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.803+0000 7f37fcff9640 1 -- 172.21.15.7:0/2405214389 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f38040f10b0 con 0x5630ea586390 2024-09-21T06:43:59.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.804+0000 7f3821b8a740 10 client.17046 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:43:59.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.804+0000 7f3821b8a740 10 client.17046 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:43:59.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.804+0000 7f3821b8a740 20 client.17046 populate_metadata read hostname 'smithi007' 2024-09-21T06:43:59.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.804+0000 7f3821b8a740 1 --2- 172.21.15.7:0/2405214389 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x5630ea53ada0 0x5630ea9d8d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:43:59.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.804+0000 7f3821b8a740 4 client.17046 mds_command: new command op to 24688 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:43:59.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.804+0000 7f3821b8a740 1 -- 172.21.15.7:0/2405214389 --> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5630ea8c28a0 con 0x5630ea53ada0 2024-09-21T06:43:59.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.804+0000 7f38193b2640 1 --2- 172.21.15.7:0/2405214389 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x5630ea53ada0 0x5630ea9d8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:43:59.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.805+0000 7f38193b2640 1 --2- 172.21.15.7:0/2405214389 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x5630ea53ada0 0x5630ea9d8d80 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e2413a9b47dbfc05 server_cookie=fc7ec2cb5a564675 in_seq=0 out_seq=0 2024-09-21T06:43:59.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.805+0000 7f37fcff9640 10 client.17046 ms_handle_connect on v2:172.21.15.144:6838/4027821922 2024-09-21T06:43:59.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.805+0000 7f37fcff9640 1 -- 172.21.15.7:0/2405214389 <== mds.1 v2:172.21.15.144:6838/4027821922 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5630ea8c28a0 con 0x5630ea53ada0 2024-09-21T06:43:59.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.805+0000 7f37fcff9640 10 client.17046 handle_command_reply: tid=0 2024-09-21T06:43:59.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.805+0000 7f3821b8a740 1 client.17046 shutdown 2024-09-21T06:43:59.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.805+0000 7f3821b8a740 1 -- 172.21.15.7:0/2405214389 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5630ea586390 msgr2=0x5630ea96d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:59.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.805+0000 7f3821b8a740 1 --2- 172.21.15.7:0/2405214389 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5630ea586390 0x5630ea96d160 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f38040cd990 tx=0x7f380402a410 comp rx=0 tx=0).stop 2024-09-21T06:43:59.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.805+0000 7f3821b8a740 1 -- 172.21.15.7:0/2405214389 shutdown_connections 2024-09-21T06:43:59.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.805+0000 7f3821b8a740 1 --2- 172.21.15.7:0/2405214389 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x5630ea53ada0 0x5630ea9d8d80 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:59.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.805+0000 7f3821b8a740 1 --2- 172.21.15.7:0/2405214389 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5630ea5a7070 0x5630ea96d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:59.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.805+0000 7f3821b8a740 1 --2- 172.21.15.7:0/2405214389 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5630ea586390 0x5630ea96d160 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:59.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.805+0000 7f3821b8a740 1 --2- 172.21.15.7:0/2405214389 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5630ea57e1b0 0x5630ea96cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:59.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.805+0000 7f37fcff9640 0 client.17046 ms_handle_reset on v2:172.21.15.144:6838/4027821922 2024-09-21T06:43:59.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.805+0000 7f3821b8a740 1 -- 172.21.15.7:0/2405214389 >> 172.21.15.7:0/2405214389 conn(0x5630ea59b460 msgr2=0x5630ea9597d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:59.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.806+0000 7f3821b8a740 1 -- 172.21.15.7:0/2405214389 shutdown_connections 2024-09-21T06:43:59.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.806+0000 7f3821b8a740 1 -- 172.21.15.7:0/2405214389 wait complete. 2024-09-21T06:43:59.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.806+0000 7f3821b8a740 20 client.17046 trim_cache size 0 max 16384 2024-09-21T06:43:59.813 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:43:59.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.806+0000 7f381b616640 1 -- 172.21.15.7:0/2999983049 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f38000b6680 msgr2=0x7f38000b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:59.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.806+0000 7f381b616640 1 --2- 172.21.15.7:0/2999983049 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f38000b6680 0x7f38000b8b90 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f3810004650 tx=0x7f381000b390 comp rx=0 tx=0).stop 2024-09-21T06:43:59.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.806+0000 7f381b616640 1 -- 172.21.15.7:0/2999983049 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38141094c0 msgr2=0x7f3814075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:43:59.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.806+0000 7f381b616640 1 --2- 172.21.15.7:0/2999983049 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38141094c0 0x7f3814075c50 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f380402a930 tx=0x7f3804004270 comp rx=0 tx=0).stop 2024-09-21T06:43:59.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.806+0000 7f381b616640 1 -- 172.21.15.7:0/2999983049 shutdown_connections 2024-09-21T06:43:59.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.806+0000 7f381b616640 1 --2- 172.21.15.7:0/2999983049 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f38000b6680 0x7f38000b8b90 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:59.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.806+0000 7f381b616640 1 --2- 172.21.15.7:0/2999983049 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3814109e10 0x7f3814076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:59.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.806+0000 7f381b616640 1 --2- 172.21.15.7:0/2999983049 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f38141094c0 0x7f3814075c50 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:59.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.806+0000 7f381b616640 1 --2- 172.21.15.7:0/2999983049 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3814103b80 0x7f3814075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:43:59.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.806+0000 7f381b616640 1 -- 172.21.15.7:0/2999983049 >> 172.21.15.7:0/2999983049 conn(0x7f38140ff610 msgr2=0x7f3814101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:43:59.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.807+0000 7f381b616640 1 -- 172.21.15.7:0/2999983049 shutdown_connections 2024-09-21T06:43:59.814 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:43:59.807+0000 7f381b616640 1 -- 172.21.15.7:0/2999983049 wait complete. 2024-09-21T06:44:00.489 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:44:00.747 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:44:01.157 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:44:00 smithi007 ceph-mon[30983]: pgmap v555: 97 pgs: 97 active+clean; 3.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 8 op/s 2024-09-21T06:44:01.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.249+0000 7fd5641c9640 1 -- 172.21.15.7:0/3891322469 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd55c10de60 msgr2=0x7fd55c110330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:01.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.249+0000 7fd5641c9640 1 --2- 172.21.15.7:0/3891322469 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd55c10de60 0x7fd55c110330 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fd554009ca0 tx=0x7fd55402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:44:01.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.249+0000 7fd5641c9640 1 -- 172.21.15.7:0/3891322469 shutdown_connections 2024-09-21T06:44:01.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.249+0000 7fd5641c9640 1 --2- 172.21.15.7:0/3891322469 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd55c10de60 0x7fd55c110330 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:01.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.249+0000 7fd5641c9640 1 --2- 172.21.15.7:0/3891322469 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd55c105380 0x7fd55c10d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:01.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.249+0000 7fd5641c9640 1 --2- 172.21.15.7:0/3891322469 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd55c104a30 0x7fd55c104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:01.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.249+0000 7fd5641c9640 1 -- 172.21.15.7:0/3891322469 >> 172.21.15.7:0/3891322469 conn(0x7fd55c079760 msgr2=0x7fd55c079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:01.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.249+0000 7fd5641c9640 1 -- 172.21.15.7:0/3891322469 shutdown_connections 2024-09-21T06:44:01.252 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.249+0000 7fd5641c9640 1 -- 172.21.15.7:0/3891322469 wait complete. 2024-09-21T06:44:01.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.250+0000 7fd5641c9640 1 Processor -- start 2024-09-21T06:44:01.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.250+0000 7fd5641c9640 1 -- start start 2024-09-21T06:44:01.253 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.250+0000 7fd5641c9640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd55c104a30 0x7fd55c19a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:01.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.250+0000 7fd5641c9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd55c105380 0x7fd55c19aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:01.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.250+0000 7fd5641c9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd55c10de60 0x7fd55c19fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:01.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.250+0000 7fd5641c9640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd55c113aa0 con 0x7fd55c10de60 2024-09-21T06:44:01.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.250+0000 7fd5641c9640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd55c113920 con 0x7fd55c105380 2024-09-21T06:44:01.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.250+0000 7fd5641c9640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd55c113c20 con 0x7fd55c104a30 2024-09-21T06:44:01.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.250+0000 7fd562766640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd55c10de60 0x7fd55c19fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:01.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.250+0000 7fd562766640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd55c10de60 0x7fd55c19fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57808/0 (socket says 172.21.15.7:57808) 2024-09-21T06:44:01.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.250+0000 7fd562766640 1 -- 172.21.15.7:0/4146996887 learned_addr learned my addr 172.21.15.7:0/4146996887 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:44:01.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.250+0000 7fd561f65640 1 --2- 172.21.15.7:0/4146996887 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd55c104a30 0x7fd55c19a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:01.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.250+0000 7fd561764640 1 --2- 172.21.15.7:0/4146996887 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd55c105380 0x7fd55c19aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:01.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.251+0000 7fd562766640 1 -- 172.21.15.7:0/4146996887 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd55c104a30 msgr2=0x7fd55c19a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:01.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.251+0000 7fd562766640 1 --2- 172.21.15.7:0/4146996887 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd55c104a30 0x7fd55c19a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:01.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.251+0000 7fd562766640 1 -- 172.21.15.7:0/4146996887 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd55c105380 msgr2=0x7fd55c19aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:01.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.251+0000 7fd562766640 1 --2- 172.21.15.7:0/4146996887 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd55c105380 0x7fd55c19aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:01.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.251+0000 7fd562766640 1 -- 172.21.15.7:0/4146996887 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd55c1a03e0 con 0x7fd55c10de60 2024-09-21T06:44:01.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.251+0000 7fd562766640 1 --2- 172.21.15.7:0/4146996887 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd55c10de60 0x7fd55c19fd70 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fd554005cc0 tx=0x7fd55402f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:01.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.251+0000 7fd54effd640 1 -- 172.21.15.7:0/4146996887 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd554003bf0 con 0x7fd55c10de60 2024-09-21T06:44:01.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.251+0000 7fd54effd640 1 -- 172.21.15.7:0/4146996887 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd554003d90 con 0x7fd55c10de60 2024-09-21T06:44:01.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.251+0000 7fd5641c9640 1 -- 172.21.15.7:0/4146996887 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd55c1a0670 con 0x7fd55c10de60 2024-09-21T06:44:01.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.251+0000 7fd54effd640 1 -- 172.21.15.7:0/4146996887 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd55402fbc0 con 0x7fd55c10de60 2024-09-21T06:44:01.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.251+0000 7fd5641c9640 1 -- 172.21.15.7:0/4146996887 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd55c1a0bb0 con 0x7fd55c10de60 2024-09-21T06:44:01.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.254+0000 7fd56a73d740 1 Processor -- start 2024-09-21T06:44:01.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.254+0000 7fd54effd640 1 -- 172.21.15.7:0/4146996887 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7fd55402fd60 con 0x7fd55c10de60 2024-09-21T06:44:01.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.255+0000 7fd56a73d740 1 -- start start 2024-09-21T06:44:01.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.255+0000 7fd56a73d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555d01c10070 0x555d01fb72c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:01.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.255+0000 7fd56a73d740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555d01be71b0 0x555d01fb7800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:01.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.255+0000 7fd56a73d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555d01bef390 0x555d01fb7d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:01.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.255+0000 7fd56a73d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x555d01f2dea0 con 0x555d01c10070 2024-09-21T06:44:01.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.255+0000 7fd56a73d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x555d01f1d2d0 con 0x555d01bef390 2024-09-21T06:44:01.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.255+0000 7fd56a73d740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x555d01f210e0 con 0x555d01be71b0 2024-09-21T06:44:01.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.255+0000 7fd561764640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555d01c10070 0x555d01fb72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:01.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.255+0000 7fd561764640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555d01c10070 0x555d01fb72c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57820/0 (socket says 172.21.15.7:57820) 2024-09-21T06:44:01.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.255+0000 7fd561764640 1 -- 172.21.15.7:0/441072456 learned_addr learned my addr 172.21.15.7:0/441072456 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:44:01.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.255+0000 7fd561f65640 1 --2- 172.21.15.7:0/441072456 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555d01be71b0 0x555d01fb7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:01.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.256+0000 7fd561764640 1 --2- 172.21.15.7:0/441072456 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555d01bef390 0x555d01fb7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:01.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.256+0000 7fd561764640 1 -- 172.21.15.7:0/441072456 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555d01be71b0 msgr2=0x555d01fb7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:01.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.256+0000 7fd561764640 1 --2- 172.21.15.7:0/441072456 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555d01be71b0 0x555d01fb7800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:01.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.256+0000 7fd561764640 1 -- 172.21.15.7:0/441072456 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555d01bef390 msgr2=0x555d01fb7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:01.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.256+0000 7fd561764640 1 --2- 172.21.15.7:0/441072456 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555d01bef390 0x555d01fb7d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:01.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.256+0000 7fd561764640 1 -- 172.21.15.7:0/441072456 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d01c7b650 con 0x555d01c10070 2024-09-21T06:44:01.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.256+0000 7fd561f65640 1 --2- 172.21.15.7:0/441072456 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555d01be71b0 0x555d01fb7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:44:01.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.256+0000 7fd54effd640 1 --2- 172.21.15.7:0/4146996887 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fd5480b66b0 0x7fd5480b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:01.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.256+0000 7fd561764640 1 --2- 172.21.15.7:0/441072456 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555d01c10070 0x555d01fb72c0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fd5500124c0 tx=0x7fd55000b740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8237c1d82c51e18d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:01.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.256+0000 7fd561f65640 1 --2- 172.21.15.7:0/4146996887 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fd5480b66b0 0x7fd5480b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:01.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.256+0000 7fd54effd640 1 -- 172.21.15.7:0/4146996887 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8412+0+0 (secure 0 0 0) 0x7fd554108b90 con 0x7fd55c10de60 2024-09-21T06:44:01.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.256+0000 7fd547fff640 1 -- 172.21.15.7:0/441072456 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd550004030 con 0x555d01c10070 2024-09-21T06:44:01.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.256+0000 7fd547fff640 1 -- 172.21.15.7:0/441072456 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd5500054d0 con 0x555d01c10070 2024-09-21T06:44:01.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.256+0000 7fd547fff640 1 -- 172.21.15.7:0/441072456 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd550004b20 con 0x555d01c10070 2024-09-21T06:44:01.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.257+0000 7fd56a73d740 1 -- 172.21.15.7:0/441072456 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555d01c10070 msgr2=0x555d01fb72c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:01.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.257+0000 7fd56a73d740 1 --2- 172.21.15.7:0/441072456 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555d01c10070 0x555d01fb72c0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fd5500124c0 tx=0x7fd55000b740 comp rx=0 tx=0).stop 2024-09-21T06:44:01.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.257+0000 7fd561f65640 1 --2- 172.21.15.7:0/4146996887 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fd5480b66b0 0x7fd5480b8bc0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x555d01fb5f40 tx=0x7fd558005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:01.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.257+0000 7fd56a73d740 1 -- 172.21.15.7:0/441072456 shutdown_connections 2024-09-21T06:44:01.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.257+0000 7fd56a73d740 1 --2- 172.21.15.7:0/441072456 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555d01bef390 0x555d01fb7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:01.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.257+0000 7fd56a73d740 1 --2- 172.21.15.7:0/441072456 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555d01be71b0 0x555d01fb7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:01.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.257+0000 7fd56a73d740 1 --2- 172.21.15.7:0/441072456 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555d01c10070 0x555d01fb72c0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:01.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.257+0000 7fd56a73d740 1 -- 172.21.15.7:0/441072456 >> 172.21.15.7:0/441072456 conn(0x555d01c04460 msgr2=0x555d01fb51b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:01.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.257+0000 7fd56a73d740 1 -- 172.21.15.7:0/441072456 shutdown_connections 2024-09-21T06:44:01.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.257+0000 7fd56a73d740 1 -- 172.21.15.7:0/441072456 wait complete. 2024-09-21T06:44:01.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.258+0000 7fd56a73d740 1 -- start start 2024-09-21T06:44:01.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.258+0000 7fd56a73d740 1 Processor -- start 2024-09-21T06:44:01.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.258+0000 7fd56a73d740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555d01be71b0 0x555d01fc6d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:01.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.258+0000 7fd56a73d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555d01bef390 0x555d01fc7260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:01.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.258+0000 7fd56a73d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555d01c10070 0x555d01fc77c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:01.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.258+0000 7fd56a73d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x555d01d7e700 con 0x555d01c10070 2024-09-21T06:44:01.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.258+0000 7fd56a73d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x555d01eb8160 con 0x555d01bef390 2024-09-21T06:44:01.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.258+0000 7fd56a73d740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x555d01fc9e00 con 0x555d01be71b0 2024-09-21T06:44:01.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.258+0000 7fd56a73d740 10 client.0 _ll_register_callbacks cb 0x555d01ed19e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:44:01.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.258+0000 7fd562766640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555d01c10070 0x555d01fc77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:01.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.259+0000 7fd562766640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555d01c10070 0x555d01fc77c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57826/0 (socket says 172.21.15.7:57826) 2024-09-21T06:44:01.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.259+0000 7fd562766640 1 -- 172.21.15.7:0/4199933583 learned_addr learned my addr 172.21.15.7:0/4199933583 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:44:01.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.259+0000 7fd561f65640 1 --2- 172.21.15.7:0/4199933583 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555d01be71b0 0x555d01fc6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:01.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.259+0000 7fd561764640 1 --2- 172.21.15.7:0/4199933583 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555d01bef390 0x555d01fc7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:01.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.259+0000 7fd562766640 1 -- 172.21.15.7:0/4199933583 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555d01be71b0 msgr2=0x555d01fc6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:01.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.259+0000 7fd562766640 1 --2- 172.21.15.7:0/4199933583 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555d01be71b0 0x555d01fc6d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:01.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.259+0000 7fd562766640 1 -- 172.21.15.7:0/4199933583 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555d01bef390 msgr2=0x555d01fc7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:01.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.259+0000 7fd562766640 1 --2- 172.21.15.7:0/4199933583 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555d01bef390 0x555d01fc7260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:01.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.259+0000 7fd562766640 1 -- 172.21.15.7:0/4199933583 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d01ee5c90 con 0x555d01c10070 2024-09-21T06:44:01.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.259+0000 7fd561f65640 1 --2- 172.21.15.7:0/4199933583 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555d01be71b0 0x555d01fc6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:44:01.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.259+0000 7fd562766640 1 --2- 172.21.15.7:0/4199933583 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555d01c10070 0x555d01fc77c0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fd5540ce750 tx=0x7fd5540ce4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ff26f514b0d51ab server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:01.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.259+0000 7fd5457fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:44:01.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.259+0000 7fd5457fa640 1 -- 172.21.15.7:0/4199933583 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5540ce560 con 0x555d01c10070 2024-09-21T06:44:01.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.259+0000 7fd5457fa640 1 -- 172.21.15.7:0/4199933583 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8412+0+0 (secure 0 0 0) 0x7fd5540cacc0 con 0x555d01c10070 2024-09-21T06:44:01.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.259+0000 7fd56a73d740 1 -- 172.21.15.7:0/4199933583 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd5500054d0 con 0x555d01c10070 2024-09-21T06:44:01.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.260+0000 7fd5457fa640 1 -- 172.21.15.7:0/4199933583 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd5540cf150 con 0x555d01c10070 2024-09-21T06:44:01.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.260+0000 7fd56a73d740 10 client.17058 fetch_fsmap learned FSMap version 25 2024-09-21T06:44:01.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.260+0000 7fd56a73d740 1 -- 172.21.15.7:0/4199933583 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x555d01fd5ac0 con 0x555d01c10070 2024-09-21T06:44:01.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.260+0000 7fd5457fa640 1 -- 172.21.15.7:0/4199933583 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd5500054d0 con 0x555d01c10070 2024-09-21T06:44:01.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.260+0000 7fd5457fa640 1 -- 172.21.15.7:0/4199933583 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd554004610 con 0x555d01c10070 2024-09-21T06:44:01.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.260+0000 7fd56a73d740 10 client.17058 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:44:01.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.260+0000 7fd56a73d740 10 client.17058 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:44:01.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.260+0000 7fd56a73d740 20 client.17058 populate_metadata read hostname 'smithi007' 2024-09-21T06:44:01.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.260+0000 7fd56a73d740 1 --2- 172.21.15.7:0/4199933583 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x555d01bce9f0 0x555d01fd8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:01.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.260+0000 7fd56a73d740 4 client.17058 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:44:01.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.260+0000 7fd56a73d740 1 -- 172.21.15.7:0/4199933583 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555d01f2fdf0 con 0x555d01bce9f0 2024-09-21T06:44:01.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.260+0000 7fd561f65640 1 --2- 172.21.15.7:0/4199933583 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x555d01bce9f0 0x555d01fd8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:01.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.261+0000 7fd561f65640 1 --2- 172.21.15.7:0/4199933583 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x555d01bce9f0 0x555d01fd8ef0 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c8ad7360c439902 server_cookie=2ad48ca8256b4fcb in_seq=0 out_seq=0 2024-09-21T06:44:01.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.261+0000 7fd5457fa640 10 client.17058 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:44:01.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.262+0000 7fd5457fa640 1 -- 172.21.15.7:0/4199933583 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555d01f2fdf0 con 0x555d01bce9f0 2024-09-21T06:44:01.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.262+0000 7fd5457fa640 10 client.17058 handle_command_reply: tid=0 2024-09-21T06:44:01.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.262+0000 7fd56a73d740 1 client.17058 shutdown 2024-09-21T06:44:01.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.262+0000 7fd56a73d740 1 -- 172.21.15.7:0/4199933583 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555d01c10070 msgr2=0x555d01fc77c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:01.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.262+0000 7fd56a73d740 1 --2- 172.21.15.7:0/4199933583 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555d01c10070 0x555d01fc77c0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fd5540ce750 tx=0x7fd5540ce4d0 comp rx=0 tx=0).stop 2024-09-21T06:44:01.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.262+0000 7fd56a73d740 1 -- 172.21.15.7:0/4199933583 shutdown_connections 2024-09-21T06:44:01.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.262+0000 7fd56a73d740 1 --2- 172.21.15.7:0/4199933583 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x555d01bce9f0 0x555d01fd8ef0 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:01.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.262+0000 7fd56a73d740 1 --2- 172.21.15.7:0/4199933583 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555d01c10070 0x555d01fc77c0 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:01.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.262+0000 7fd56a73d740 1 --2- 172.21.15.7:0/4199933583 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555d01bef390 0x555d01fc7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:01.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.262+0000 7fd56a73d740 1 --2- 172.21.15.7:0/4199933583 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555d01be71b0 0x555d01fc6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:01.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.262+0000 7fd5457fa640 0 client.17058 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:44:01.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.262+0000 7fd56a73d740 1 -- 172.21.15.7:0/4199933583 >> 172.21.15.7:0/4199933583 conn(0x555d01c04460 msgr2=0x555d01fb3750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:01.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.262+0000 7fd56a73d740 1 -- 172.21.15.7:0/4199933583 shutdown_connections 2024-09-21T06:44:01.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.262+0000 7fd56a73d740 1 -- 172.21.15.7:0/4199933583 wait complete. 2024-09-21T06:44:01.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.262+0000 7fd56a73d740 20 client.17058 trim_cache size 0 max 16384 2024-09-21T06:44:01.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.275+0000 7fd56a73d740 1 Processor -- start 2024-09-21T06:44:01.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.275+0000 7fd56a73d740 1 -- start start 2024-09-21T06:44:01.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.275+0000 7fd56a73d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555d01be71b0 0x555d01fbcc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:01.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.276+0000 7fd56a73d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555d01bef390 0x555d01fc8950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:01.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.276+0000 7fd56a73d740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555d01c10070 0x555d01fc3f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:01.278 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.276+0000 7fd56a73d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd55c1afb80 con 0x555d01bef390 2024-09-21T06:44:01.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.276+0000 7fd56a73d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd55c1ad450 con 0x555d01be71b0 2024-09-21T06:44:01.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.276+0000 7fd56a73d740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd55c1ab2c0 con 0x555d01c10070 2024-09-21T06:44:01.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.276+0000 7fd561764640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555d01bef390 0x555d01fc8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:01.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.276+0000 7fd561764640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555d01bef390 0x555d01fc8950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57830/0 (socket says 172.21.15.7:57830) 2024-09-21T06:44:01.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.276+0000 7fd561764640 1 -- 172.21.15.7:0/2438709811 learned_addr learned my addr 172.21.15.7:0/2438709811 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:44:01.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.276+0000 7fd562766640 1 --2- 172.21.15.7:0/2438709811 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555d01c10070 0x555d01fc3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:01.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.276+0000 7fd561f65640 1 --2- 172.21.15.7:0/2438709811 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555d01be71b0 0x555d01fbcc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:01.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.276+0000 7fd561764640 1 -- 172.21.15.7:0/2438709811 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555d01c10070 msgr2=0x555d01fc3f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:01.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.276+0000 7fd561764640 1 --2- 172.21.15.7:0/2438709811 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555d01c10070 0x555d01fc3f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:01.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.276+0000 7fd561764640 1 -- 172.21.15.7:0/2438709811 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555d01be71b0 msgr2=0x555d01fbcc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:01.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.276+0000 7fd561764640 1 --2- 172.21.15.7:0/2438709811 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555d01be71b0 0x555d01fbcc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:01.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.276+0000 7fd561764640 1 -- 172.21.15.7:0/2438709811 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d01fb95b0 con 0x555d01bef390 2024-09-21T06:44:01.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.276+0000 7fd561764640 1 --2- 172.21.15.7:0/2438709811 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555d01bef390 0x555d01fc8950 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fd550005c60 tx=0x7fd550005900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9fe651a514949ab server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:01.279 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.276+0000 7fd5477fe640 1 -- 172.21.15.7:0/2438709811 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd550005050 con 0x555d01bef390 2024-09-21T06:44:01.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.277+0000 7fd5477fe640 1 -- 172.21.15.7:0/2438709811 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd5500045d0 con 0x555d01bef390 2024-09-21T06:44:01.280 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.277+0000 7fd5477fe640 1 -- 172.21.15.7:0/2438709811 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5500106c0 con 0x555d01bef390 2024-09-21T06:44:01.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.277+0000 7fd56a73d740 1 -- 172.21.15.7:0/2438709811 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555d01bef390 msgr2=0x555d01fc8950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:01.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.277+0000 7fd56a73d740 1 --2- 172.21.15.7:0/2438709811 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555d01bef390 0x555d01fc8950 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fd550005c60 tx=0x7fd550005900 comp rx=0 tx=0).stop 2024-09-21T06:44:01.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.277+0000 7fd56a73d740 1 -- 172.21.15.7:0/2438709811 shutdown_connections 2024-09-21T06:44:01.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.277+0000 7fd56a73d740 1 --2- 172.21.15.7:0/2438709811 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555d01c10070 0x555d01fc3f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:01.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.277+0000 7fd56a73d740 1 --2- 172.21.15.7:0/2438709811 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555d01bef390 0x555d01fc8950 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:01.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.277+0000 7fd56a73d740 1 --2- 172.21.15.7:0/2438709811 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555d01be71b0 0x555d01fbcc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:01.283 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.277+0000 7fd56a73d740 1 -- 172.21.15.7:0/2438709811 >> 172.21.15.7:0/2438709811 conn(0x555d01c04460 msgr2=0x555d01fc8240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:01.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.277+0000 7fd56a73d740 1 -- 172.21.15.7:0/2438709811 shutdown_connections 2024-09-21T06:44:01.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.277+0000 7fd56a73d740 1 -- 172.21.15.7:0/2438709811 wait complete. 2024-09-21T06:44:01.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.278+0000 7fd56a73d740 1 -- start start 2024-09-21T06:44:01.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.278+0000 7fd56a73d740 1 Processor -- start 2024-09-21T06:44:01.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.278+0000 7fd56a73d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555d01be71b0 0x555d01fcdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:01.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.278+0000 7fd56a73d740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555d01bef390 0x555d01fce110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:01.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.278+0000 7fd56a73d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555d01c10070 0x555d0203b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:01.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.278+0000 7fd56a73d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd55c1ab910 con 0x555d01be71b0 2024-09-21T06:44:01.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.278+0000 7fd56a73d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd55c1acd80 con 0x555d01c10070 2024-09-21T06:44:01.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.278+0000 7fd56a73d740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd55c1abfe0 con 0x555d01bef390 2024-09-21T06:44:01.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.278+0000 7fd56a73d740 10 client.0 _ll_register_callbacks cb 0x7fd5540ce8f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:44:01.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.279+0000 7fd561f65640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555d01be71b0 0x555d01fcdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:01.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.279+0000 7fd561f65640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555d01be71b0 0x555d01fcdb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57840/0 (socket says 172.21.15.7:57840) 2024-09-21T06:44:01.284 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.279+0000 7fd561f65640 1 -- 172.21.15.7:0/554311965 learned_addr learned my addr 172.21.15.7:0/554311965 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:44:01.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.279+0000 7fd561764640 1 --2- 172.21.15.7:0/554311965 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555d01bef390 0x555d01fce110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:01.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.279+0000 7fd562766640 1 --2- 172.21.15.7:0/554311965 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555d01c10070 0x555d0203b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:01.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.279+0000 7fd561f65640 1 -- 172.21.15.7:0/554311965 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555d01bef390 msgr2=0x555d01fce110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:01.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.279+0000 7fd561f65640 1 --2- 172.21.15.7:0/554311965 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555d01bef390 0x555d01fce110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:01.285 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.279+0000 7fd561f65640 1 -- 172.21.15.7:0/554311965 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555d01c10070 msgr2=0x555d0203b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:01.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.279+0000 7fd561f65640 1 --2- 172.21.15.7:0/554311965 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555d01c10070 0x555d0203b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:01.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.279+0000 7fd561f65640 1 -- 172.21.15.7:0/554311965 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d01fd3030 con 0x555d01be71b0 2024-09-21T06:44:01.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.279+0000 7fd561f65640 1 --2- 172.21.15.7:0/554311965 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555d01be71b0 0x555d01fcdb30 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fd558012fd0 tx=0x7fd5580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=822ebae90b29936e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:01.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.279+0000 7fd5457fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:44:01.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.279+0000 7fd5457fa640 1 -- 172.21.15.7:0/554311965 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd558004460 con 0x555d01be71b0 2024-09-21T06:44:01.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.279+0000 7fd5457fa640 1 -- 172.21.15.7:0/554311965 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8412+0+0 (secure 0 0 0) 0x7fd5580208d0 con 0x555d01be71b0 2024-09-21T06:44:01.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.279+0000 7fd56a73d740 1 -- 172.21.15.7:0/554311965 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd5500045d0 con 0x555d01be71b0 2024-09-21T06:44:01.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.280+0000 7fd5457fa640 1 -- 172.21.15.7:0/554311965 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd558020ad0 con 0x555d01be71b0 2024-09-21T06:44:01.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.280+0000 7fd56a73d740 10 client.17064 fetch_fsmap learned FSMap version 25 2024-09-21T06:44:01.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.280+0000 7fd56a73d740 1 -- 172.21.15.7:0/554311965 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x555d02044260 con 0x555d01be71b0 2024-09-21T06:44:01.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.280+0000 7fd5457fa640 1 -- 172.21.15.7:0/554311965 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd5500045d0 con 0x555d01be71b0 2024-09-21T06:44:01.286 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.280+0000 7fd5457fa640 1 -- 172.21.15.7:0/554311965 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd558038030 con 0x555d01be71b0 2024-09-21T06:44:01.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.280+0000 7fd56a73d740 10 client.17064 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:44:01.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.280+0000 7fd56a73d740 10 client.17064 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:44:01.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.280+0000 7fd56a73d740 20 client.17064 populate_metadata read hostname 'smithi007' 2024-09-21T06:44:01.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.280+0000 7fd56a73d740 1 --2- 172.21.15.7:0/554311965 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x555d01ba3da0 0x555d02046a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:01.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.280+0000 7fd56a73d740 4 client.17064 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:44:01.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.280+0000 7fd56a73d740 1 -- 172.21.15.7:0/554311965 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555d01f2b8a0 con 0x555d01ba3da0 2024-09-21T06:44:01.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.280+0000 7fd561764640 1 --2- 172.21.15.7:0/554311965 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x555d01ba3da0 0x555d02046a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:01.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.281+0000 7fd5457fa640 10 client.17064 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:44:01.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.281+0000 7fd561764640 1 --2- 172.21.15.7:0/554311965 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x555d01ba3da0 0x555d02046a50 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b4d501954564bc65 server_cookie=a9d8a671f5cf2e5d in_seq=0 out_seq=0 2024-09-21T06:44:01.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.281+0000 7fd5457fa640 1 -- 172.21.15.7:0/554311965 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555d01f2b8a0 con 0x555d01ba3da0 2024-09-21T06:44:01.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.281+0000 7fd5457fa640 10 client.17064 handle_command_reply: tid=0 2024-09-21T06:44:01.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.281+0000 7fd56a73d740 1 client.17064 shutdown 2024-09-21T06:44:01.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.281+0000 7fd56a73d740 1 -- 172.21.15.7:0/554311965 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555d01be71b0 msgr2=0x555d01fcdb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:01.287 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.281+0000 7fd56a73d740 1 --2- 172.21.15.7:0/554311965 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555d01be71b0 0x555d01fcdb30 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fd558012fd0 tx=0x7fd5580046c0 comp rx=0 tx=0).stop 2024-09-21T06:44:01.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.281+0000 7fd56a73d740 1 -- 172.21.15.7:0/554311965 shutdown_connections 2024-09-21T06:44:01.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.281+0000 7fd56a73d740 1 --2- 172.21.15.7:0/554311965 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x555d01ba3da0 0x555d02046a50 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:01.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.281+0000 7fd56a73d740 1 --2- 172.21.15.7:0/554311965 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555d01c10070 0x555d0203b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:01.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.281+0000 7fd56a73d740 1 --2- 172.21.15.7:0/554311965 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555d01bef390 0x555d01fce110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:01.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.281+0000 7fd56a73d740 1 --2- 172.21.15.7:0/554311965 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555d01be71b0 0x555d01fcdb30 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:01.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.281+0000 7fd5457fa640 0 client.17064 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:44:01.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.281+0000 7fd56a73d740 1 -- 172.21.15.7:0/554311965 >> 172.21.15.7:0/554311965 conn(0x555d01c04460 msgr2=0x555d01fc7fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:01.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.281+0000 7fd56a73d740 1 -- 172.21.15.7:0/554311965 shutdown_connections 2024-09-21T06:44:01.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.281+0000 7fd56a73d740 1 -- 172.21.15.7:0/554311965 wait complete. 2024-09-21T06:44:01.288 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.281+0000 7fd56a73d740 20 client.17064 trim_cache size 0 max 16384 2024-09-21T06:44:01.289 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:44:01.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.282+0000 7fd5641c9640 1 -- 172.21.15.7:0/4146996887 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fd5480b66b0 msgr2=0x7fd5480b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:01.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.282+0000 7fd5641c9640 1 --2- 172.21.15.7:0/4146996887 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fd5480b66b0 0x7fd5480b8bc0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x555d01fb5f40 tx=0x7fd558005f90 comp rx=0 tx=0).stop 2024-09-21T06:44:01.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.282+0000 7fd5641c9640 1 -- 172.21.15.7:0/4146996887 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd55c10de60 msgr2=0x7fd55c19fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:01.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.282+0000 7fd5641c9640 1 --2- 172.21.15.7:0/4146996887 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd55c10de60 0x7fd55c19fd70 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fd554005cc0 tx=0x7fd55402f380 comp rx=0 tx=0).stop 2024-09-21T06:44:01.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.282+0000 7fd5641c9640 1 -- 172.21.15.7:0/4146996887 shutdown_connections 2024-09-21T06:44:01.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.282+0000 7fd5641c9640 1 --2- 172.21.15.7:0/4146996887 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fd5480b66b0 0x7fd5480b8bc0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:01.289 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.282+0000 7fd5641c9640 1 --2- 172.21.15.7:0/4146996887 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd55c10de60 0x7fd55c19fd70 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:01.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.282+0000 7fd5641c9640 1 --2- 172.21.15.7:0/4146996887 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd55c105380 0x7fd55c19aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:01.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.282+0000 7fd5641c9640 1 --2- 172.21.15.7:0/4146996887 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd55c104a30 0x7fd55c19a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:01.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.282+0000 7fd5641c9640 1 -- 172.21.15.7:0/4146996887 >> 172.21.15.7:0/4146996887 conn(0x7fd55c079760 msgr2=0x7fd55c106990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:01.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.282+0000 7fd5641c9640 1 -- 172.21.15.7:0/4146996887 shutdown_connections 2024-09-21T06:44:01.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:01.282+0000 7fd5641c9640 1 -- 172.21.15.7:0/4146996887 wait complete. 2024-09-21T06:44:01.290 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:44:00 smithi144 ceph-mon[34653]: pgmap v555: 97 pgs: 97 active+clean; 3.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 8 op/s 2024-09-21T06:44:01.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:44:00 smithi018 ceph-mon[34477]: pgmap v555: 97 pgs: 97 active+clean; 3.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 8 op/s 2024-09-21T06:44:02.968 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:44:02.968 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:44:03.238 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:44:03.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:44:02 smithi144 ceph-mon[34653]: pgmap v556: 97 pgs: 97 active+clean; 3.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-21T06:44:03.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:44:02 smithi007 ceph-mon[30983]: pgmap v556: 97 pgs: 97 active+clean; 3.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-21T06:44:03.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:44:02 smithi018 ceph-mon[34477]: pgmap v556: 97 pgs: 97 active+clean; 3.3 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-21T06:44:03.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.754+0000 7f89c1076640 1 -- 172.21.15.7:0/142553591 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89bc108420 msgr2=0x7f89bc108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:03.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.754+0000 7f89c1076640 1 --2- 172.21.15.7:0/142553591 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89bc108420 0x7f89bc108830 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f89b0009900 tx=0x7f89b002a410 comp rx=0 tx=0).stop 2024-09-21T06:44:03.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.754+0000 7f89c1076640 1 -- 172.21.15.7:0/142553591 shutdown_connections 2024-09-21T06:44:03.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.754+0000 7f89c1076640 1 --2- 172.21.15.7:0/142553591 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f89bc108d70 0x7f89bc10f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:03.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.754+0000 7f89c1076640 1 --2- 172.21.15.7:0/142553591 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89bc108420 0x7f89bc108830 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:03.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.754+0000 7f89c1076640 1 --2- 172.21.15.7:0/142553591 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f89bc102ae0 0x7f89bc102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:03.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.754+0000 7f89c1076640 1 -- 172.21.15.7:0/142553591 >> 172.21.15.7:0/142553591 conn(0x7f89bc079770 msgr2=0x7f89bc079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:03.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.754+0000 7f89c1076640 1 -- 172.21.15.7:0/142553591 shutdown_connections 2024-09-21T06:44:03.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.754+0000 7f89c1076640 1 -- 172.21.15.7:0/142553591 wait complete. 2024-09-21T06:44:03.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.755+0000 7f89c1076640 1 Processor -- start 2024-09-21T06:44:03.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.755+0000 7f89c1076640 1 -- start start 2024-09-21T06:44:03.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.755+0000 7f89c1076640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f89bc102ae0 0x7f89bc19a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:03.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.756+0000 7f89c1076640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f89bc108420 0x7f89bc19aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:03.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.756+0000 7f89c1076640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89bc108d70 0x7f89bc19fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:03.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.756+0000 7f89c1076640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f89bc113b50 con 0x7f89bc108d70 2024-09-21T06:44:03.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.756+0000 7f89c1076640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f89bc1139d0 con 0x7f89bc102ae0 2024-09-21T06:44:03.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.756+0000 7f89c1076640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f89bc113cd0 con 0x7f89bc108420 2024-09-21T06:44:03.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.756+0000 7f89bb59e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89bc108d70 0x7f89bc19fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:03.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.756+0000 7f89bb59e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89bc108d70 0x7f89bc19fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57856/0 (socket says 172.21.15.7:57856) 2024-09-21T06:44:03.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.756+0000 7f89bb59e640 1 -- 172.21.15.7:0/504110629 learned_addr learned my addr 172.21.15.7:0/504110629 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:44:03.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.756+0000 7f89ba59c640 1 --2- 172.21.15.7:0/504110629 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f89bc108420 0x7f89bc19aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:03.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.756+0000 7f89bad9d640 1 --2- 172.21.15.7:0/504110629 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f89bc102ae0 0x7f89bc19a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:03.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.756+0000 7f89bb59e640 1 -- 172.21.15.7:0/504110629 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f89bc108420 msgr2=0x7f89bc19aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:03.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.756+0000 7f89bb59e640 1 --2- 172.21.15.7:0/504110629 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f89bc108420 0x7f89bc19aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:03.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.756+0000 7f89bb59e640 1 -- 172.21.15.7:0/504110629 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f89bc102ae0 msgr2=0x7f89bc19a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:03.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.756+0000 7f89bb59e640 1 --2- 172.21.15.7:0/504110629 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f89bc102ae0 0x7f89bc19a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:03.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.756+0000 7f89bb59e640 1 -- 172.21.15.7:0/504110629 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89bc1a0490 con 0x7f89bc108d70 2024-09-21T06:44:03.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.756+0000 7f89ba59c640 1 --2- 172.21.15.7:0/504110629 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f89bc108420 0x7f89bc19aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:44:03.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.756+0000 7f89bad9d640 1 --2- 172.21.15.7:0/504110629 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f89bc102ae0 0x7f89bc19a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:44:03.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.756+0000 7f89bb59e640 1 --2- 172.21.15.7:0/504110629 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89bc108d70 0x7f89bc19fd60 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f89b400eaa0 tx=0x7f89b400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:03.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.756+0000 7f89a3fff640 1 -- 172.21.15.7:0/504110629 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89b400cdb0 con 0x7f89bc108d70 2024-09-21T06:44:03.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.757+0000 7f89a3fff640 1 -- 172.21.15.7:0/504110629 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f89b4005020 con 0x7f89bc108d70 2024-09-21T06:44:03.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.757+0000 7f89c1076640 1 -- 172.21.15.7:0/504110629 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89bc1a0780 con 0x7f89bc108d70 2024-09-21T06:44:03.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.757+0000 7f89a3fff640 1 -- 172.21.15.7:0/504110629 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89b40116d0 con 0x7f89bc108d70 2024-09-21T06:44:03.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.757+0000 7f89c1076640 1 -- 172.21.15.7:0/504110629 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89bc1a6ee0 con 0x7f89bc108d70 2024-09-21T06:44:03.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.759+0000 7f89c75ea740 1 Processor -- start 2024-09-21T06:44:03.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.760+0000 7f89a3fff640 1 -- 172.21.15.7:0/504110629 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f89b4011870 con 0x7f89bc108d70 2024-09-21T06:44:03.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.760+0000 7f89c75ea740 1 -- start start 2024-09-21T06:44:03.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.760+0000 7f89c75ea740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c615941350 0x55c615ce8430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:03.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.760+0000 7f89c75ea740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c615918490 0x55c615ce8970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:03.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.760+0000 7f89c75ea740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c615920670 0x55c615ce8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:03.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.760+0000 7f89c75ea740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55c615c5ee60 con 0x55c615941350 2024-09-21T06:44:03.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.760+0000 7f89c75ea740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55c615c4e290 con 0x55c615918490 2024-09-21T06:44:03.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.760+0000 7f89c75ea740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55c615c520a0 con 0x55c615920670 2024-09-21T06:44:03.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.760+0000 7f89ba59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c615941350 0x55c615ce8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:03.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.760+0000 7f89ba59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c615941350 0x55c615ce8430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57872/0 (socket says 172.21.15.7:57872) 2024-09-21T06:44:03.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.760+0000 7f89ba59c640 1 -- 172.21.15.7:0/4001521086 learned_addr learned my addr 172.21.15.7:0/4001521086 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:44:03.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.760+0000 7f89bad9d640 1 --2- 172.21.15.7:0/4001521086 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c615918490 0x55c615ce8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:03.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.761+0000 7f89ba59c640 1 --2- 172.21.15.7:0/4001521086 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c615920670 0x55c615ce8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:03.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.761+0000 7f89ba59c640 1 -- 172.21.15.7:0/4001521086 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c615920670 msgr2=0x55c615ce8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:03.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.761+0000 7f89ba59c640 1 --2- 172.21.15.7:0/4001521086 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c615920670 0x55c615ce8eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:03.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.761+0000 7f89ba59c640 1 -- 172.21.15.7:0/4001521086 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c615918490 msgr2=0x55c615ce8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:03.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.761+0000 7f89ba59c640 1 --2- 172.21.15.7:0/4001521086 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c615918490 0x55c615ce8970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:03.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.761+0000 7f89ba59c640 1 -- 172.21.15.7:0/4001521086 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6159ac930 con 0x55c615941350 2024-09-21T06:44:03.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.761+0000 7f89bad9d640 1 --2- 172.21.15.7:0/4001521086 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c615918490 0x55c615ce8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:44:03.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.761+0000 7f89a3fff640 1 --2- 172.21.15.7:0/504110629 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f89a40b6680 0x7f89a40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:03.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.761+0000 7f89ba59c640 1 --2- 172.21.15.7:0/4001521086 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c615941350 0x55c615ce8430 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f89b0005ab0 tx=0x7f89b0009560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52155056224695a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:03.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.761+0000 7f89bad9d640 1 --2- 172.21.15.7:0/504110629 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f89a40b6680 0x7f89a40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:03.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.761+0000 7f89a3fff640 1 -- 172.21.15.7:0/504110629 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8412+0+0 (secure 0 0 0) 0x7f89b40e7900 con 0x7f89bc108d70 2024-09-21T06:44:03.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.761+0000 7f89a17fa640 1 -- 172.21.15.7:0/4001521086 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89b0035050 con 0x55c615941350 2024-09-21T06:44:03.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.761+0000 7f89a17fa640 1 -- 172.21.15.7:0/4001521086 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f89b00316f0 con 0x55c615941350 2024-09-21T06:44:03.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.761+0000 7f89a17fa640 1 -- 172.21.15.7:0/4001521086 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89b00046c0 con 0x55c615941350 2024-09-21T06:44:03.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.762+0000 7f89c75ea740 1 -- 172.21.15.7:0/4001521086 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c615941350 msgr2=0x55c615ce8430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:03.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.762+0000 7f89bad9d640 1 --2- 172.21.15.7:0/504110629 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f89a40b6680 0x7f89a40b8b90 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x55c615ce70b0 tx=0x7f89ac00b5c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:03.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.762+0000 7f89c75ea740 1 --2- 172.21.15.7:0/4001521086 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c615941350 0x55c615ce8430 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f89b0005ab0 tx=0x7f89b0009560 comp rx=0 tx=0).stop 2024-09-21T06:44:03.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.762+0000 7f89c75ea740 1 -- 172.21.15.7:0/4001521086 shutdown_connections 2024-09-21T06:44:03.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.762+0000 7f89c75ea740 1 --2- 172.21.15.7:0/4001521086 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c615920670 0x55c615ce8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:03.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.762+0000 7f89c75ea740 1 --2- 172.21.15.7:0/4001521086 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c615918490 0x55c615ce8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:03.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.762+0000 7f89c75ea740 1 --2- 172.21.15.7:0/4001521086 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c615941350 0x55c615ce8430 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:03.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.762+0000 7f89c75ea740 1 -- 172.21.15.7:0/4001521086 >> 172.21.15.7:0/4001521086 conn(0x55c615935740 msgr2=0x55c615ce6320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:03.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.762+0000 7f89c75ea740 1 -- 172.21.15.7:0/4001521086 shutdown_connections 2024-09-21T06:44:03.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.762+0000 7f89c75ea740 1 -- 172.21.15.7:0/4001521086 wait complete. 2024-09-21T06:44:03.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.763+0000 7f89c75ea740 1 -- start start 2024-09-21T06:44:03.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.763+0000 7f89c75ea740 1 Processor -- start 2024-09-21T06:44:03.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.763+0000 7f89c75ea740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c615918490 0x55c615cf4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:03.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.763+0000 7f89c75ea740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c615920670 0x55c615cf4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:03.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.763+0000 7f89c75ea740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c615941350 0x55c615cffed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:03.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.763+0000 7f89c75ea740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55c615aaf890 con 0x55c615918490 2024-09-21T06:44:03.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.763+0000 7f89c75ea740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55c615be8d40 con 0x55c615920670 2024-09-21T06:44:03.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.763+0000 7f89c75ea740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55c615cf6bb0 con 0x55c615941350 2024-09-21T06:44:03.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.764+0000 7f89bad9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c615918490 0x55c615cf4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:03.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.764+0000 7f89c75ea740 10 client.0 _ll_register_callbacks cb 0x55c615c4cc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:44:03.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.764+0000 7f89bad9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c615918490 0x55c615cf4020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57874/0 (socket says 172.21.15.7:57874) 2024-09-21T06:44:03.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.764+0000 7f89bad9d640 1 -- 172.21.15.7:0/264504343 learned_addr learned my addr 172.21.15.7:0/264504343 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:44:03.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.764+0000 7f89ba59c640 1 --2- 172.21.15.7:0/264504343 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c615920670 0x55c615cf4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:03.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.764+0000 7f89bb59e640 1 --2- 172.21.15.7:0/264504343 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c615941350 0x55c615cffed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:03.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.764+0000 7f89bad9d640 1 -- 172.21.15.7:0/264504343 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c615941350 msgr2=0x55c615cffed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:03.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.764+0000 7f89bad9d640 1 --2- 172.21.15.7:0/264504343 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c615941350 0x55c615cffed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:03.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.764+0000 7f89bad9d640 1 -- 172.21.15.7:0/264504343 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c615920670 msgr2=0x55c615cf4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:03.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.764+0000 7f89bad9d640 1 --2- 172.21.15.7:0/264504343 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c615920670 0x55c615cf4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:03.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.764+0000 7f89bad9d640 1 -- 172.21.15.7:0/264504343 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c615d00460 con 0x55c615918490 2024-09-21T06:44:03.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.764+0000 7f89bad9d640 1 --2- 172.21.15.7:0/264504343 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c615918490 0x55c615cf4020 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f89ac00b590 tx=0x7f89ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25dd5ca0b8639208 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:03.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.764+0000 7f899eff5640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:44:03.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.764+0000 7f899eff5640 1 -- 172.21.15.7:0/264504343 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89ac00fac0 con 0x55c615918490 2024-09-21T06:44:03.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.764+0000 7f899eff5640 1 -- 172.21.15.7:0/264504343 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8412+0+0 (secure 0 0 0) 0x7f89ac00fc60 con 0x55c615918490 2024-09-21T06:44:03.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.764+0000 7f89c75ea740 1 -- 172.21.15.7:0/264504343 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f89b00316f0 con 0x55c615918490 2024-09-21T06:44:03.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.765+0000 7f899eff5640 1 -- 172.21.15.7:0/264504343 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f89ac00fe60 con 0x55c615918490 2024-09-21T06:44:03.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.765+0000 7f89c75ea740 10 client.17076 fetch_fsmap learned FSMap version 25 2024-09-21T06:44:03.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.765+0000 7f89c75ea740 1 -- 172.21.15.7:0/264504343 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c615d02df0 con 0x55c615918490 2024-09-21T06:44:03.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.765+0000 7f899eff5640 1 -- 172.21.15.7:0/264504343 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f89b00316f0 con 0x55c615918490 2024-09-21T06:44:03.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.765+0000 7f899eff5640 1 -- 172.21.15.7:0/264504343 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f89ac02f020 con 0x55c615918490 2024-09-21T06:44:03.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.765+0000 7f89c75ea740 10 client.17076 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:44:03.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.765+0000 7f89c75ea740 10 client.17076 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:44:03.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.765+0000 7f89c75ea740 20 client.17076 populate_metadata read hostname 'smithi007' 2024-09-21T06:44:03.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.765+0000 7f89c75ea740 1 --2- 172.21.15.7:0/264504343 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55c6158ffcd0 0x55c615d062a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:03.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.765+0000 7f89c75ea740 4 client.17076 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:44:03.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.765+0000 7f89c75ea740 1 -- 172.21.15.7:0/264504343 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c615c60db0 con 0x55c6158ffcd0 2024-09-21T06:44:03.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.766+0000 7f89ba59c640 1 --2- 172.21.15.7:0/264504343 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55c6158ffcd0 0x55c615d062a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:03.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.766+0000 7f899eff5640 10 client.17076 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:44:03.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.766+0000 7f89ba59c640 1 --2- 172.21.15.7:0/264504343 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55c6158ffcd0 0x55c615d062a0 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b1ac39d07d7466e server_cookie=472c97f5e4a81eb7 in_seq=0 out_seq=0 2024-09-21T06:44:03.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.767+0000 7f899eff5640 1 -- 172.21.15.7:0/264504343 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c615c60db0 con 0x55c6158ffcd0 2024-09-21T06:44:03.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.767+0000 7f899eff5640 10 client.17076 handle_command_reply: tid=0 2024-09-21T06:44:03.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.767+0000 7f89c75ea740 1 client.17076 shutdown 2024-09-21T06:44:03.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.767+0000 7f89c75ea740 1 -- 172.21.15.7:0/264504343 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c615918490 msgr2=0x55c615cf4020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:03.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.767+0000 7f89c75ea740 1 --2- 172.21.15.7:0/264504343 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c615918490 0x55c615cf4020 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f89ac00b590 tx=0x7f89ac0046c0 comp rx=0 tx=0).stop 2024-09-21T06:44:03.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.767+0000 7f89c75ea740 1 -- 172.21.15.7:0/264504343 shutdown_connections 2024-09-21T06:44:03.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.767+0000 7f89c75ea740 1 --2- 172.21.15.7:0/264504343 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55c6158ffcd0 0x55c615d062a0 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:03.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.767+0000 7f89c75ea740 1 --2- 172.21.15.7:0/264504343 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c615941350 0x55c615cffed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:03.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.767+0000 7f89c75ea740 1 --2- 172.21.15.7:0/264504343 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c615920670 0x55c615cf4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:03.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.767+0000 7f89c75ea740 1 --2- 172.21.15.7:0/264504343 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c615918490 0x55c615cf4020 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:03.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.767+0000 7f89c75ea740 1 -- 172.21.15.7:0/264504343 >> 172.21.15.7:0/264504343 conn(0x55c615935740 msgr2=0x55c615ceb610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:03.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.767+0000 7f899eff5640 0 client.17076 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:44:03.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.767+0000 7f89c75ea740 1 -- 172.21.15.7:0/264504343 shutdown_connections 2024-09-21T06:44:03.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.767+0000 7f89c75ea740 1 -- 172.21.15.7:0/264504343 wait complete. 2024-09-21T06:44:03.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.767+0000 7f89c75ea740 20 client.17076 trim_cache size 0 max 16384 2024-09-21T06:44:03.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.785+0000 7f89c75ea740 1 Processor -- start 2024-09-21T06:44:03.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.785+0000 7f89c75ea740 1 -- start start 2024-09-21T06:44:03.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.785+0000 7f89c75ea740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c615918490 0x55c615ced510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:03.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.785+0000 7f89c75ea740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c615920670 0x55c615ceda50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:03.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.785+0000 7f89c75ea740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c615941350 0x55c615ceb530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:03.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.785+0000 7f89c75ea740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f89bc1b1e30 con 0x55c615941350 2024-09-21T06:44:03.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.785+0000 7f89c75ea740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f89bc1af700 con 0x55c615918490 2024-09-21T06:44:03.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.785+0000 7f89c75ea740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f89bc1ad570 con 0x55c615920670 2024-09-21T06:44:03.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.785+0000 7f89bb59e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c615941350 0x55c615ceb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:03.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.785+0000 7f89bb59e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c615941350 0x55c615ceb530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57878/0 (socket says 172.21.15.7:57878) 2024-09-21T06:44:03.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.785+0000 7f89bb59e640 1 -- 172.21.15.7:0/1676902668 learned_addr learned my addr 172.21.15.7:0/1676902668 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:44:03.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.786+0000 7f89bad9d640 1 --2- 172.21.15.7:0/1676902668 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c615918490 0x55c615ced510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:03.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.786+0000 7f89ba59c640 1 --2- 172.21.15.7:0/1676902668 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c615920670 0x55c615ceda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:03.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.786+0000 7f89bb59e640 1 -- 172.21.15.7:0/1676902668 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c615920670 msgr2=0x55c615ceda50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:03.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.786+0000 7f89bb59e640 1 --2- 172.21.15.7:0/1676902668 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c615920670 0x55c615ceda50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:03.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.786+0000 7f89bb59e640 1 -- 172.21.15.7:0/1676902668 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c615918490 msgr2=0x55c615ced510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:03.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.786+0000 7f89bb59e640 1 --2- 172.21.15.7:0/1676902668 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c615918490 0x55c615ced510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:03.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.786+0000 7f89bb59e640 1 -- 172.21.15.7:0/1676902668 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c615ce6860 con 0x55c615941350 2024-09-21T06:44:03.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.786+0000 7f89bb59e640 1 --2- 172.21.15.7:0/1676902668 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c615941350 0x55c615ceb530 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f89b40aa9d0 tx=0x7f89b40ad270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=856f30e6782c6a8b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:03.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.786+0000 7f89a0ff9640 1 -- 172.21.15.7:0/1676902668 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89b40b2020 con 0x55c615941350 2024-09-21T06:44:03.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.786+0000 7f89a0ff9640 1 -- 172.21.15.7:0/1676902668 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f89b40b7180 con 0x55c615941350 2024-09-21T06:44:03.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.786+0000 7f89a0ff9640 1 -- 172.21.15.7:0/1676902668 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89b401f040 con 0x55c615941350 2024-09-21T06:44:03.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.787+0000 7f89c75ea740 1 -- 172.21.15.7:0/1676902668 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c615941350 msgr2=0x55c615ceb530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:03.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.787+0000 7f89c75ea740 1 --2- 172.21.15.7:0/1676902668 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c615941350 0x55c615ceb530 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f89b40aa9d0 tx=0x7f89b40ad270 comp rx=0 tx=0).stop 2024-09-21T06:44:03.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.787+0000 7f89c75ea740 1 -- 172.21.15.7:0/1676902668 shutdown_connections 2024-09-21T06:44:03.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.787+0000 7f89c75ea740 1 --2- 172.21.15.7:0/1676902668 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c615941350 0x55c615ceb530 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:03.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.787+0000 7f89c75ea740 1 --2- 172.21.15.7:0/1676902668 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c615920670 0x55c615ceda50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:03.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.787+0000 7f89c75ea740 1 --2- 172.21.15.7:0/1676902668 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c615918490 0x55c615ced510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:03.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.787+0000 7f89c75ea740 1 -- 172.21.15.7:0/1676902668 >> 172.21.15.7:0/1676902668 conn(0x55c615935740 msgr2=0x55c615cf26a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:03.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.787+0000 7f89c75ea740 1 -- 172.21.15.7:0/1676902668 shutdown_connections 2024-09-21T06:44:03.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.787+0000 7f89c75ea740 1 -- 172.21.15.7:0/1676902668 wait complete. 2024-09-21T06:44:03.792 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.787+0000 7f89c75ea740 1 -- start start 2024-09-21T06:44:03.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.787+0000 7f89c75ea740 1 Processor -- start 2024-09-21T06:44:03.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.788+0000 7f89c75ea740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c615918490 0x55c615cf80a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:03.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.788+0000 7f89c75ea740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c615920670 0x55c615cf85e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:03.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.788+0000 7f89c75ea740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c615941350 0x55c615d6fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:03.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.788+0000 7f89c75ea740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f89bc1adbc0 con 0x55c615918490 2024-09-21T06:44:03.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.788+0000 7f89c75ea740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f89bc1af030 con 0x55c615920670 2024-09-21T06:44:03.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.788+0000 7f89c75ea740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f89bc1ae290 con 0x55c615941350 2024-09-21T06:44:03.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.788+0000 7f89bad9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c615918490 0x55c615cf80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:03.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.788+0000 7f89c75ea740 10 client.0 _ll_register_callbacks cb 0x7f89ac00bcd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:44:03.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.788+0000 7f89bad9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c615918490 0x55c615cf80a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57890/0 (socket says 172.21.15.7:57890) 2024-09-21T06:44:03.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.788+0000 7f89bad9d640 1 -- 172.21.15.7:0/3968436869 learned_addr learned my addr 172.21.15.7:0/3968436869 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:44:03.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.788+0000 7f89ba59c640 1 --2- 172.21.15.7:0/3968436869 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c615920670 0x55c615cf85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:03.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.788+0000 7f89bb59e640 1 --2- 172.21.15.7:0/3968436869 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c615941350 0x55c615d6fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:03.793 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.788+0000 7f89bad9d640 1 -- 172.21.15.7:0/3968436869 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c615941350 msgr2=0x55c615d6fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:03.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.788+0000 7f89bad9d640 1 --2- 172.21.15.7:0/3968436869 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c615941350 0x55c615d6fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:03.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.788+0000 7f89bad9d640 1 -- 172.21.15.7:0/3968436869 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c615920670 msgr2=0x55c615cf85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:03.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.788+0000 7f89bad9d640 1 --2- 172.21.15.7:0/3968436869 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c615920670 0x55c615cf85e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:03.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.788+0000 7f89bad9d640 1 -- 172.21.15.7:0/3968436869 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c615cf8e00 con 0x55c615918490 2024-09-21T06:44:03.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.788+0000 7f89ba59c640 1 --2- 172.21.15.7:0/3968436869 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c615920670 0x55c615cf85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:44:03.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.789+0000 7f89bad9d640 1 --2- 172.21.15.7:0/3968436869 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c615918490 0x55c615cf80a0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f89ac01f800 tx=0x7f89ac00f9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3e558805c9922f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:03.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.789+0000 7f899eff5640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:44:03.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.789+0000 7f899eff5640 1 -- 172.21.15.7:0/3968436869 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89ac040060 con 0x55c615918490 2024-09-21T06:44:03.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.789+0000 7f89c75ea740 1 -- 172.21.15.7:0/3968436869 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f89b40b7180 con 0x55c615918490 2024-09-21T06:44:03.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.789+0000 7f899eff5640 1 -- 172.21.15.7:0/3968436869 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8412+0+0 (secure 0 0 0) 0x7f89ac027610 con 0x55c615918490 2024-09-21T06:44:03.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.789+0000 7f899eff5640 1 -- 172.21.15.7:0/3968436869 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f89ac010490 con 0x55c615918490 2024-09-21T06:44:03.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.789+0000 7f89c75ea740 10 client.17082 fetch_fsmap learned FSMap version 25 2024-09-21T06:44:03.794 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.789+0000 7f89c75ea740 1 -- 172.21.15.7:0/3968436869 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c615d71280 con 0x55c615918490 2024-09-21T06:44:03.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.789+0000 7f899eff5640 1 -- 172.21.15.7:0/3968436869 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f89b40b7180 con 0x55c615918490 2024-09-21T06:44:03.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.789+0000 7f899eff5640 1 -- 172.21.15.7:0/3968436869 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f89ac043030 con 0x55c615918490 2024-09-21T06:44:03.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.790+0000 7f89c75ea740 10 client.17082 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:44:03.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.790+0000 7f89c75ea740 10 client.17082 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:44:03.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.790+0000 7f89c75ea740 20 client.17082 populate_metadata read hostname 'smithi007' 2024-09-21T06:44:03.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.790+0000 7f89c75ea740 1 --2- 172.21.15.7:0/3968436869 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55c6158d5080 0x55c615d73a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:03.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.790+0000 7f89c75ea740 4 client.17082 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:44:03.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.790+0000 7f89c75ea740 1 -- 172.21.15.7:0/3968436869 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55c615c5c860 con 0x55c6158d5080 2024-09-21T06:44:03.795 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.790+0000 7f89ba59c640 1 --2- 172.21.15.7:0/3968436869 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55c6158d5080 0x55c615d73a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:03.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.790+0000 7f89ba59c640 1 --2- 172.21.15.7:0/3968436869 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55c6158d5080 0x55c615d73a70 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52af5fb7a4b1427 server_cookie=e2f7050902feca8c in_seq=0 out_seq=0 2024-09-21T06:44:03.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.790+0000 7f899eff5640 10 client.17082 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:44:03.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.792+0000 7f899eff5640 1 -- 172.21.15.7:0/3968436869 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55c615c5c860 con 0x55c6158d5080 2024-09-21T06:44:03.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.792+0000 7f899eff5640 10 client.17082 handle_command_reply: tid=0 2024-09-21T06:44:03.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.792+0000 7f89c75ea740 1 client.17082 shutdown 2024-09-21T06:44:03.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.792+0000 7f89c75ea740 1 -- 172.21.15.7:0/3968436869 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c615918490 msgr2=0x55c615cf80a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:03.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.792+0000 7f89c75ea740 1 --2- 172.21.15.7:0/3968436869 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c615918490 0x55c615cf80a0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f89ac01f800 tx=0x7f89ac00f9c0 comp rx=0 tx=0).stop 2024-09-21T06:44:03.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.792+0000 7f89c75ea740 1 -- 172.21.15.7:0/3968436869 shutdown_connections 2024-09-21T06:44:03.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.792+0000 7f89c75ea740 1 --2- 172.21.15.7:0/3968436869 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55c6158d5080 0x55c615d73a70 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:03.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.792+0000 7f89c75ea740 1 --2- 172.21.15.7:0/3968436869 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55c615941350 0x55c615d6fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:03.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.792+0000 7f89c75ea740 1 --2- 172.21.15.7:0/3968436869 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55c615920670 0x55c615cf85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:03.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.792+0000 7f89c75ea740 1 --2- 172.21.15.7:0/3968436869 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55c615918490 0x55c615cf80a0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:03.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.792+0000 7f89c75ea740 1 -- 172.21.15.7:0/3968436869 >> 172.21.15.7:0/3968436869 conn(0x55c615935740 msgr2=0x55c615ceb530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:03.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.792+0000 7f899eff5640 0 client.17082 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:44:03.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.793+0000 7f89c75ea740 1 -- 172.21.15.7:0/3968436869 shutdown_connections 2024-09-21T06:44:03.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.793+0000 7f89c75ea740 1 -- 172.21.15.7:0/3968436869 wait complete. 2024-09-21T06:44:03.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.793+0000 7f89c75ea740 20 client.17082 trim_cache size 0 max 16384 2024-09-21T06:44:03.798 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:44:03.798 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0, 2024-09-21T06:44:03.798 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_tag": "d98b2d47-c2db-4811-8b3e-ec744a20d9d6", 2024-09-21T06:44:03.798 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": "asynchronous" 2024-09-21T06:44:03.798 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:44:03.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.793+0000 7f89c1076640 1 -- 172.21.15.7:0/504110629 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f89a40b6680 msgr2=0x7f89a40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:03.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.793+0000 7f89c1076640 1 --2- 172.21.15.7:0/504110629 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f89a40b6680 0x7f89a40b8b90 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x55c615ce70b0 tx=0x7f89ac00b5c0 comp rx=0 tx=0).stop 2024-09-21T06:44:03.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.793+0000 7f89c1076640 1 -- 172.21.15.7:0/504110629 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89bc108d70 msgr2=0x7f89bc19fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:03.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.793+0000 7f89c1076640 1 --2- 172.21.15.7:0/504110629 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89bc108d70 0x7f89bc19fd60 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f89b400eaa0 tx=0x7f89b400ef60 comp rx=0 tx=0).stop 2024-09-21T06:44:03.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.793+0000 7f89c1076640 1 -- 172.21.15.7:0/504110629 shutdown_connections 2024-09-21T06:44:03.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.793+0000 7f89c1076640 1 --2- 172.21.15.7:0/504110629 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f89a40b6680 0x7f89a40b8b90 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:03.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.793+0000 7f89c1076640 1 --2- 172.21.15.7:0/504110629 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f89bc108d70 0x7f89bc19fd60 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:03.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.793+0000 7f89c1076640 1 --2- 172.21.15.7:0/504110629 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f89bc108420 0x7f89bc19aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:03.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.793+0000 7f89c1076640 1 --2- 172.21.15.7:0/504110629 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f89bc102ae0 0x7f89bc19a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:03.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.793+0000 7f89c1076640 1 -- 172.21.15.7:0/504110629 >> 172.21.15.7:0/504110629 conn(0x7f89bc079770 msgr2=0x7f89bc106510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:03.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.793+0000 7f89c1076640 1 -- 172.21.15.7:0/504110629 shutdown_connections 2024-09-21T06:44:03.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:03.794+0000 7f89c1076640 1 -- 172.21.15.7:0/504110629 wait complete. 2024-09-21T06:44:04.539 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:44:04.799 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:44:05.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:44:04 smithi007 ceph-mon[30983]: pgmap v557: 97 pgs: 97 active+clean; 3.3 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-21T06:44:05.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:44:04 smithi007 ceph-mon[30983]: scrub queued for path: / 2024-09-21T06:44:05.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:44:04 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T06:44:05.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:44:04 smithi007 ceph-mon[30983]: scrub summary: active paths [/] 2024-09-21T06:44:05.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:44:04 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T06:44:05.205 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:44:04 smithi007 ceph-mon[30983]: scrub summary: idle 2024-09-21T06:44:05.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:44:04 smithi144 ceph-mon[34653]: pgmap v557: 97 pgs: 97 active+clean; 3.3 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-21T06:44:05.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:44:04 smithi144 ceph-mon[34653]: scrub queued for path: / 2024-09-21T06:44:05.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:44:04 smithi144 ceph-mon[34653]: scrub summary: idle+waiting paths [/] 2024-09-21T06:44:05.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:44:04 smithi144 ceph-mon[34653]: scrub summary: active paths [/] 2024-09-21T06:44:05.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:44:04 smithi144 ceph-mon[34653]: scrub summary: idle+waiting paths [/] 2024-09-21T06:44:05.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:44:04 smithi144 ceph-mon[34653]: scrub summary: idle 2024-09-21T06:44:05.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.298+0000 7f64a2396640 1 -- 172.21.15.7:0/3750775254 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f649c108d10 msgr2=0x7f649c10f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:05.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.298+0000 7f64a2396640 1 --2- 172.21.15.7:0/3750775254 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f649c108d10 0x7f649c10f540 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f6494009ca0 tx=0x7f649402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:44:05.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.298+0000 7f64a2396640 1 -- 172.21.15.7:0/3750775254 shutdown_connections 2024-09-21T06:44:05.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.298+0000 7f64a2396640 1 --2- 172.21.15.7:0/3750775254 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f649c108d10 0x7f649c10f540 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:05.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.298+0000 7f64a2396640 1 --2- 172.21.15.7:0/3750775254 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f649c1083c0 0x7f649c1087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:05.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.298+0000 7f64a2396640 1 --2- 172.21.15.7:0/3750775254 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f649c102a80 0x7f649c102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:05.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.298+0000 7f64a2396640 1 -- 172.21.15.7:0/3750775254 >> 172.21.15.7:0/3750775254 conn(0x7f649c079740 msgr2=0x7f649c079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:05.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.298+0000 7f64a2396640 1 -- 172.21.15.7:0/3750775254 shutdown_connections 2024-09-21T06:44:05.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.298+0000 7f64a2396640 1 -- 172.21.15.7:0/3750775254 wait complete. 2024-09-21T06:44:05.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.299+0000 7f64a2396640 1 Processor -- start 2024-09-21T06:44:05.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.299+0000 7f64a2396640 1 -- start start 2024-09-21T06:44:05.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.299+0000 7f64a2396640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f649c102a80 0x7f649c10ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:05.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.299+0000 7f64a2396640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f649c1083c0 0x7f649c110510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:05.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.299+0000 7f64a2396640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f649c108d10 0x7f649c110a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:05.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.299+0000 7f64a2396640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f649c113aa0 con 0x7f649c108d10 2024-09-21T06:44:05.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.299+0000 7f64a2396640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f649c113920 con 0x7f649c102a80 2024-09-21T06:44:05.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.299+0000 7f64a2396640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f649c113c20 con 0x7f649c1083c0 2024-09-21T06:44:05.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.299+0000 7f64a0933640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f649c108d10 0x7f649c110a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:05.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.299+0000 7f64a0933640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f649c108d10 0x7f649c110a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57902/0 (socket says 172.21.15.7:57902) 2024-09-21T06:44:05.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.299+0000 7f64a0933640 1 -- 172.21.15.7:0/2354583461 learned_addr learned my addr 172.21.15.7:0/2354583461 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:44:05.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.299+0000 7f649bfff640 1 --2- 172.21.15.7:0/2354583461 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f649c102a80 0x7f649c10ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:05.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.299+0000 7f649b7fe640 1 --2- 172.21.15.7:0/2354583461 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f649c1083c0 0x7f649c110510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:05.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.300+0000 7f64a0933640 1 -- 172.21.15.7:0/2354583461 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f649c1083c0 msgr2=0x7f649c110510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:05.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.300+0000 7f64a0933640 1 --2- 172.21.15.7:0/2354583461 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f649c1083c0 0x7f649c110510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:05.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.300+0000 7f64a0933640 1 -- 172.21.15.7:0/2354583461 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f649c102a80 msgr2=0x7f649c10ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:05.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.300+0000 7f64a0933640 1 --2- 172.21.15.7:0/2354583461 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f649c102a80 0x7f649c10ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:05.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.300+0000 7f64a0933640 1 -- 172.21.15.7:0/2354583461 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f649c1a87d0 con 0x7f649c108d10 2024-09-21T06:44:05.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.300+0000 7f64a0933640 1 --2- 172.21.15.7:0/2354583461 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f649c108d10 0x7f649c110a50 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f64940098d0 tx=0x7f64940317b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:05.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.300+0000 7f64997fa640 1 -- 172.21.15.7:0/2354583461 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6494003b70 con 0x7f649c108d10 2024-09-21T06:44:05.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.300+0000 7f64997fa640 1 -- 172.21.15.7:0/2354583461 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6494003d10 con 0x7f649c108d10 2024-09-21T06:44:05.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.300+0000 7f64a2396640 1 -- 172.21.15.7:0/2354583461 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f649c1a8a60 con 0x7f649c108d10 2024-09-21T06:44:05.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.300+0000 7f64997fa640 1 -- 172.21.15.7:0/2354583461 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f649402fa20 con 0x7f649c108d10 2024-09-21T06:44:05.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.300+0000 7f64a2396640 1 -- 172.21.15.7:0/2354583461 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f649c1a8ff0 con 0x7f649c108d10 2024-09-21T06:44:05.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.303+0000 7f64a890a740 1 Processor -- start 2024-09-21T06:44:05.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.303+0000 7f64997fa640 1 -- 172.21.15.7:0/2354583461 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f649402fc40 con 0x7f649c108d10 2024-09-21T06:44:05.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.303+0000 7f64a890a740 1 -- start start 2024-09-21T06:44:05.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.303+0000 7f64a890a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55838aac8070 0x55838ae6f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:05.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.303+0000 7f64a890a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55838aa9f1b0 0x55838ae6f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:05.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.303+0000 7f64a890a740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55838aaa7390 0x55838ae6fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:05.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.303+0000 7f64a890a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55838ade5e50 con 0x55838aac8070 2024-09-21T06:44:05.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.303+0000 7f64a890a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55838add5280 con 0x55838aa9f1b0 2024-09-21T06:44:05.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.303+0000 7f64a890a740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55838add9090 con 0x55838aaa7390 2024-09-21T06:44:05.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.304+0000 7f649b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55838aac8070 0x55838ae6f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:05.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.304+0000 7f649b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55838aac8070 0x55838ae6f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57906/0 (socket says 172.21.15.7:57906) 2024-09-21T06:44:05.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.304+0000 7f649b7fe640 1 -- 172.21.15.7:0/2968397895 learned_addr learned my addr 172.21.15.7:0/2968397895 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:44:05.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.304+0000 7f649bfff640 1 --2- 172.21.15.7:0/2968397895 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55838aa9f1b0 0x55838ae6f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:05.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.304+0000 7f649b7fe640 1 -- 172.21.15.7:0/2968397895 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55838aaa7390 msgr2=0x55838ae6fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:05.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.304+0000 7f649b7fe640 1 --2- 172.21.15.7:0/2968397895 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55838aaa7390 0x55838ae6fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:05.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.304+0000 7f649b7fe640 1 -- 172.21.15.7:0/2968397895 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55838aa9f1b0 msgr2=0x55838ae6f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:05.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.304+0000 7f649b7fe640 1 --2- 172.21.15.7:0/2968397895 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55838aa9f1b0 0x55838ae6f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:05.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.304+0000 7f649b7fe640 1 -- 172.21.15.7:0/2968397895 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55838ab33650 con 0x55838aac8070 2024-09-21T06:44:05.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.304+0000 7f64997fa640 1 --2- 172.21.15.7:0/2354583461 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f64840b6700 0x7f64840b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:05.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.304+0000 7f64997fa640 1 -- 172.21.15.7:0/2354583461 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8412+0+0 (secure 0 0 0) 0x7f6494108890 con 0x7f649c108d10 2024-09-21T06:44:05.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.304+0000 7f649b7fe640 1 --2- 172.21.15.7:0/2354583461 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f64840b6700 0x7f64840b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:05.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.304+0000 7f649b7fe640 1 --2- 172.21.15.7:0/2968397895 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55838aac8070 0x55838ae6f270 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f6490009c90 tx=0x7f6490013830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55f78e23874c9f8a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:05.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.305+0000 7f64827fc640 1 -- 172.21.15.7:0/2968397895 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6490023070 con 0x55838aac8070 2024-09-21T06:44:05.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.305+0000 7f64827fc640 1 -- 172.21.15.7:0/2968397895 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f64900042f0 con 0x55838aac8070 2024-09-21T06:44:05.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.305+0000 7f64827fc640 1 -- 172.21.15.7:0/2968397895 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6490010430 con 0x55838aac8070 2024-09-21T06:44:05.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.306+0000 7f64a890a740 1 -- 172.21.15.7:0/2968397895 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55838aac8070 msgr2=0x55838ae6f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:05.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.306+0000 7f649b7fe640 1 --2- 172.21.15.7:0/2354583461 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f64840b6700 0x7f64840b8c10 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f6490020000 tx=0x7f649001d000 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:05.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.306+0000 7f64a890a740 1 --2- 172.21.15.7:0/2968397895 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55838aac8070 0x55838ae6f270 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f6490009c90 tx=0x7f6490013830 comp rx=0 tx=0).stop 2024-09-21T06:44:05.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.306+0000 7f64a890a740 1 -- 172.21.15.7:0/2968397895 shutdown_connections 2024-09-21T06:44:05.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.306+0000 7f64a890a740 1 --2- 172.21.15.7:0/2968397895 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55838aaa7390 0x55838ae6fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:05.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.306+0000 7f64a890a740 1 --2- 172.21.15.7:0/2968397895 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55838aa9f1b0 0x55838ae6f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:05.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.306+0000 7f64a890a740 1 --2- 172.21.15.7:0/2968397895 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55838aac8070 0x55838ae6f270 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:05.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.306+0000 7f64a890a740 1 -- 172.21.15.7:0/2968397895 >> 172.21.15.7:0/2968397895 conn(0x55838aabc460 msgr2=0x55838ae6d160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:05.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.306+0000 7f64a890a740 1 -- 172.21.15.7:0/2968397895 shutdown_connections 2024-09-21T06:44:05.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.306+0000 7f64a890a740 1 -- 172.21.15.7:0/2968397895 wait complete. 2024-09-21T06:44:05.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.306+0000 7f64a890a740 1 -- start start 2024-09-21T06:44:05.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.306+0000 7f64a890a740 1 Processor -- start 2024-09-21T06:44:05.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.307+0000 7f64a890a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55838aa9f1b0 0x55838ae7a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:05.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.307+0000 7f64a890a740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55838aaa7390 0x55838ae7ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:05.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.307+0000 7f64a890a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55838aac8070 0x55838ae7b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:05.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.307+0000 7f64a890a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55838ac36700 con 0x55838aac8070 2024-09-21T06:44:05.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.307+0000 7f64a890a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55838ad70110 con 0x55838aa9f1b0 2024-09-21T06:44:05.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.307+0000 7f64a890a740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55838ae7da50 con 0x55838aaa7390 2024-09-21T06:44:05.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.307+0000 7f64a890a740 10 client.0 _ll_register_callbacks cb 0x55838ad89990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:44:05.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.307+0000 7f64a0933640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55838aac8070 0x55838ae7b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:05.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.307+0000 7f64a0933640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55838aac8070 0x55838ae7b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57918/0 (socket says 172.21.15.7:57918) 2024-09-21T06:44:05.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.307+0000 7f64a0933640 1 -- 172.21.15.7:0/3934430834 learned_addr learned my addr 172.21.15.7:0/3934430834 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:44:05.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.307+0000 7f649bfff640 1 --2- 172.21.15.7:0/3934430834 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55838aa9f1b0 0x55838ae7a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:05.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.307+0000 7f649b7fe640 1 --2- 172.21.15.7:0/3934430834 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55838aaa7390 0x55838ae7ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:05.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.307+0000 7f64a0933640 1 -- 172.21.15.7:0/3934430834 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55838aaa7390 msgr2=0x55838ae7ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:05.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.307+0000 7f64a0933640 1 --2- 172.21.15.7:0/3934430834 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55838aaa7390 0x55838ae7ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:05.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.307+0000 7f64a0933640 1 -- 172.21.15.7:0/3934430834 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55838aa9f1b0 msgr2=0x55838ae7a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:05.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.307+0000 7f64a0933640 1 --2- 172.21.15.7:0/3934430834 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55838aa9f1b0 0x55838ae7a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:05.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.307+0000 7f64a0933640 1 -- 172.21.15.7:0/3934430834 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55838ad9dc40 con 0x55838aac8070 2024-09-21T06:44:05.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.307+0000 7f649bfff640 1 --2- 172.21.15.7:0/3934430834 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55838aa9f1b0 0x55838ae7a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:44:05.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.308+0000 7f64a0933640 1 --2- 172.21.15.7:0/3934430834 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55838aac8070 0x55838ae7b380 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f64940ce6e0 tx=0x7f64940ca720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c3bc9bba1859e16 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:05.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.308+0000 7f647b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:44:05.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.308+0000 7f647b7fe640 1 -- 172.21.15.7:0/3934430834 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64940f4020 con 0x55838aac8070 2024-09-21T06:44:05.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.308+0000 7f647b7fe640 1 -- 172.21.15.7:0/3934430834 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8412+0+0 (secure 0 0 0) 0x7f6494004b40 con 0x55838aac8070 2024-09-21T06:44:05.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.308+0000 7f64a890a740 1 -- 172.21.15.7:0/3934430834 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f64900042f0 con 0x55838aac8070 2024-09-21T06:44:05.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.308+0000 7f647b7fe640 1 -- 172.21.15.7:0/3934430834 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f64940ce260 con 0x55838aac8070 2024-09-21T06:44:05.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.308+0000 7f64a890a740 10 client.17094 fetch_fsmap learned FSMap version 25 2024-09-21T06:44:05.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.308+0000 7f64a890a740 1 -- 172.21.15.7:0/3934430834 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55838ae89680 con 0x55838aac8070 2024-09-21T06:44:05.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.308+0000 7f647b7fe640 1 -- 172.21.15.7:0/3934430834 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f64900042f0 con 0x55838aac8070 2024-09-21T06:44:05.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.308+0000 7f647b7fe640 1 -- 172.21.15.7:0/3934430834 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f64940f02f0 con 0x55838aac8070 2024-09-21T06:44:05.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.308+0000 7f64a890a740 10 client.17094 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:44:05.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.308+0000 7f64a890a740 10 client.17094 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:44:05.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.308+0000 7f64a890a740 20 client.17094 populate_metadata read hostname 'smithi007' 2024-09-21T06:44:05.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.308+0000 7f64a890a740 1 --2- 172.21.15.7:0/3934430834 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55838aa869f0 0x55838ae8cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:05.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.309+0000 7f64a890a740 4 client.17094 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:44:05.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.309+0000 7f64a890a740 1 -- 172.21.15.7:0/3934430834 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55838ade7da0 con 0x55838aa869f0 2024-09-21T06:44:05.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.309+0000 7f649bfff640 1 --2- 172.21.15.7:0/3934430834 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55838aa869f0 0x55838ae8cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:05.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.309+0000 7f649bfff640 1 --2- 172.21.15.7:0/3934430834 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55838aa869f0 0x55838ae8cc10 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6b89b6aa8e7247d server_cookie=93a57ab7dba4042e in_seq=0 out_seq=0 2024-09-21T06:44:05.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.309+0000 7f647b7fe640 10 client.17094 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:44:05.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.310+0000 7f647b7fe640 1 -- 172.21.15.7:0/3934430834 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55838ade7da0 con 0x55838aa869f0 2024-09-21T06:44:05.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.310+0000 7f647b7fe640 10 client.17094 handle_command_reply: tid=0 2024-09-21T06:44:05.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.310+0000 7f64a890a740 1 client.17094 shutdown 2024-09-21T06:44:05.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.310+0000 7f64a890a740 1 -- 172.21.15.7:0/3934430834 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55838aac8070 msgr2=0x55838ae7b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:05.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.310+0000 7f64a890a740 1 --2- 172.21.15.7:0/3934430834 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55838aac8070 0x55838ae7b380 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f64940ce6e0 tx=0x7f64940ca720 comp rx=0 tx=0).stop 2024-09-21T06:44:05.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.310+0000 7f64a890a740 1 -- 172.21.15.7:0/3934430834 shutdown_connections 2024-09-21T06:44:05.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.310+0000 7f64a890a740 1 --2- 172.21.15.7:0/3934430834 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55838aa869f0 0x55838ae8cc10 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:05.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.310+0000 7f64a890a740 1 --2- 172.21.15.7:0/3934430834 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55838aac8070 0x55838ae7b380 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:05.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.310+0000 7f64a890a740 1 --2- 172.21.15.7:0/3934430834 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55838aaa7390 0x55838ae7ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:05.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.310+0000 7f64a890a740 1 --2- 172.21.15.7:0/3934430834 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55838aa9f1b0 0x55838ae7a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:05.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.310+0000 7f64a890a740 1 -- 172.21.15.7:0/3934430834 >> 172.21.15.7:0/3934430834 conn(0x55838aabc460 msgr2=0x55838ae72450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:05.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.310+0000 7f647b7fe640 0 client.17094 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:44:05.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.310+0000 7f64a890a740 1 -- 172.21.15.7:0/3934430834 shutdown_connections 2024-09-21T06:44:05.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.311+0000 7f64a890a740 1 -- 172.21.15.7:0/3934430834 wait complete. 2024-09-21T06:44:05.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.311+0000 7f64a890a740 20 client.17094 trim_cache size 0 max 16384 2024-09-21T06:44:05.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.328+0000 7f64a890a740 1 Processor -- start 2024-09-21T06:44:05.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.328+0000 7f64a890a740 1 -- start start 2024-09-21T06:44:05.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.328+0000 7f64a890a740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55838aa9f1b0 0x55838ae7c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:05.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.328+0000 7f64a890a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55838aaa7390 0x55838ae709b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:05.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.328+0000 7f64a890a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55838aac8070 0x55838ae6c710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:05.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.328+0000 7f64a890a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f649c1b4040 con 0x55838aac8070 2024-09-21T06:44:05.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.328+0000 7f64a890a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f649c1b1910 con 0x55838aaa7390 2024-09-21T06:44:05.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.328+0000 7f64a890a740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f649c1af780 con 0x55838aa9f1b0 2024-09-21T06:44:05.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.329+0000 7f64a0933640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55838aac8070 0x55838ae6c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:05.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.329+0000 7f64a0933640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55838aac8070 0x55838ae6c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57932/0 (socket says 172.21.15.7:57932) 2024-09-21T06:44:05.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.329+0000 7f64a0933640 1 -- 172.21.15.7:0/4104656072 learned_addr learned my addr 172.21.15.7:0/4104656072 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:44:05.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.329+0000 7f649bfff640 1 --2- 172.21.15.7:0/4104656072 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55838aa9f1b0 0x55838ae7c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:05.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.329+0000 7f649b7fe640 1 --2- 172.21.15.7:0/4104656072 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55838aaa7390 0x55838ae709b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:05.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.329+0000 7f64a0933640 1 -- 172.21.15.7:0/4104656072 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55838aa9f1b0 msgr2=0x55838ae7c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:05.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.329+0000 7f64a0933640 1 --2- 172.21.15.7:0/4104656072 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55838aa9f1b0 0x55838ae7c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:05.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.329+0000 7f64a0933640 1 -- 172.21.15.7:0/4104656072 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55838aaa7390 msgr2=0x55838ae709b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:05.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.329+0000 7f64a0933640 1 --2- 172.21.15.7:0/4104656072 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55838aaa7390 0x55838ae709b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:05.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.329+0000 7f64a0933640 1 -- 172.21.15.7:0/4104656072 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55838aa86c20 con 0x55838aac8070 2024-09-21T06:44:05.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.329+0000 7f64a0933640 1 --2- 172.21.15.7:0/4104656072 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55838aac8070 0x55838ae6c710 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f6494003fd0 tx=0x7f649402a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12281ce34661188a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:05.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.329+0000 7f6481ffb640 1 -- 172.21.15.7:0/4104656072 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64940f4070 con 0x55838aac8070 2024-09-21T06:44:05.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.329+0000 7f6481ffb640 1 -- 172.21.15.7:0/4104656072 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f64940c8e50 con 0x55838aac8070 2024-09-21T06:44:05.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.329+0000 7f6481ffb640 1 -- 172.21.15.7:0/4104656072 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64940d8170 con 0x55838aac8070 2024-09-21T06:44:05.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.330+0000 7f64a890a740 1 -- 172.21.15.7:0/4104656072 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55838aac8070 msgr2=0x55838ae6c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:05.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.330+0000 7f64a890a740 1 --2- 172.21.15.7:0/4104656072 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55838aac8070 0x55838ae6c710 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f6494003fd0 tx=0x7f649402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:44:05.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.330+0000 7f64a890a740 1 -- 172.21.15.7:0/4104656072 shutdown_connections 2024-09-21T06:44:05.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.330+0000 7f64a890a740 1 --2- 172.21.15.7:0/4104656072 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55838aac8070 0x55838ae6c710 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:05.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.330+0000 7f64a890a740 1 --2- 172.21.15.7:0/4104656072 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55838aaa7390 0x55838ae709b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:05.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.330+0000 7f64a890a740 1 --2- 172.21.15.7:0/4104656072 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55838aa9f1b0 0x55838ae7c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:05.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.330+0000 7f64a890a740 1 -- 172.21.15.7:0/4104656072 >> 172.21.15.7:0/4104656072 conn(0x55838aabc460 msgr2=0x55838ae702a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:05.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.330+0000 7f64a890a740 1 -- 172.21.15.7:0/4104656072 shutdown_connections 2024-09-21T06:44:05.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.330+0000 7f64a890a740 1 -- 172.21.15.7:0/4104656072 wait complete. 2024-09-21T06:44:05.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.331+0000 7f64a890a740 1 -- start start 2024-09-21T06:44:05.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.331+0000 7f64a890a740 1 Processor -- start 2024-09-21T06:44:05.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.331+0000 7f64a890a740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55838aa9f1b0 0x55838ae83520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:05.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.331+0000 7f64a890a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55838aaa7390 0x55838ae7e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:05.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.331+0000 7f64a890a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55838aac8070 0x55838ae7ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:05.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.331+0000 7f64a890a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f649c1afdd0 con 0x55838aac8070 2024-09-21T06:44:05.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.331+0000 7f64a890a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f649c1b1240 con 0x55838aaa7390 2024-09-21T06:44:05.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.331+0000 7f64a890a740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f649c1b04a0 con 0x55838aa9f1b0 2024-09-21T06:44:05.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.331+0000 7f64a890a740 10 client.0 _ll_register_callbacks cb 0x7f6494003ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:44:05.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.332+0000 7f64a0933640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55838aac8070 0x55838ae7ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:05.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.332+0000 7f64a0933640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55838aac8070 0x55838ae7ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57940/0 (socket says 172.21.15.7:57940) 2024-09-21T06:44:05.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.332+0000 7f64a0933640 1 -- 172.21.15.7:0/964820753 learned_addr learned my addr 172.21.15.7:0/964820753 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:44:05.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.332+0000 7f649b7fe640 1 --2- 172.21.15.7:0/964820753 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55838aaa7390 0x55838ae7e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:05.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.332+0000 7f649bfff640 1 --2- 172.21.15.7:0/964820753 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55838aa9f1b0 0x55838ae83520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:05.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.332+0000 7f64a0933640 1 -- 172.21.15.7:0/964820753 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55838aa9f1b0 msgr2=0x55838ae83520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:05.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.332+0000 7f64a0933640 1 --2- 172.21.15.7:0/964820753 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55838aa9f1b0 0x55838ae83520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:05.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.332+0000 7f64a0933640 1 -- 172.21.15.7:0/964820753 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55838aaa7390 msgr2=0x55838ae7e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:05.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.332+0000 7f64a0933640 1 --2- 172.21.15.7:0/964820753 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55838aaa7390 0x55838ae7e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:05.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.332+0000 7f64a0933640 1 -- 172.21.15.7:0/964820753 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55838ae7f700 con 0x55838aac8070 2024-09-21T06:44:05.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.332+0000 7f64a0933640 1 --2- 172.21.15.7:0/964820753 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55838aac8070 0x55838ae7ef70 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f64940ce6e0 tx=0x7f64940d3160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3942795a915121b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:05.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.332+0000 7f647b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:44:05.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.332+0000 7f647b7fe640 1 -- 172.21.15.7:0/964820753 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64940ad060 con 0x55838aac8070 2024-09-21T06:44:05.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.332+0000 7f647b7fe640 1 -- 172.21.15.7:0/964820753 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8412+0+0 (secure 0 0 0) 0x7f6494004b40 con 0x55838aac8070 2024-09-21T06:44:05.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.332+0000 7f64a890a740 1 -- 172.21.15.7:0/964820753 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f64940c8e50 con 0x55838aac8070 2024-09-21T06:44:05.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.332+0000 7f647b7fe640 1 -- 172.21.15.7:0/964820753 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f64940e8070 con 0x55838aac8070 2024-09-21T06:44:05.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.332+0000 7f64a890a740 10 client.17100 fetch_fsmap learned FSMap version 25 2024-09-21T06:44:05.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.332+0000 7f64a890a740 1 -- 172.21.15.7:0/964820753 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55838aef7590 con 0x55838aac8070 2024-09-21T06:44:05.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.333+0000 7f647b7fe640 1 -- 172.21.15.7:0/964820753 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f64940c8e50 con 0x55838aac8070 2024-09-21T06:44:05.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.333+0000 7f647b7fe640 1 -- 172.21.15.7:0/964820753 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f64940b0030 con 0x55838aac8070 2024-09-21T06:44:05.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.333+0000 7f64a890a740 10 client.17100 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:44:05.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.333+0000 7f64a890a740 10 client.17100 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:44:05.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.333+0000 7f64a890a740 20 client.17100 populate_metadata read hostname 'smithi007' 2024-09-21T06:44:05.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.333+0000 7f64a890a740 1 --2- 172.21.15.7:0/964820753 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55838aa5bda0 0x55838aef9960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:05.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.333+0000 7f64a890a740 4 client.17100 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:44:05.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.333+0000 7f64a890a740 1 -- 172.21.15.7:0/964820753 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55838ae764b0 con 0x55838aa5bda0 2024-09-21T06:44:05.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.333+0000 7f649bfff640 1 --2- 172.21.15.7:0/964820753 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55838aa5bda0 0x55838aef9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:05.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.334+0000 7f649bfff640 1 --2- 172.21.15.7:0/964820753 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55838aa5bda0 0x55838aef9960 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9413bcdae75b0bbd server_cookie=91537cee3b12890e in_seq=0 out_seq=0 2024-09-21T06:44:05.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.334+0000 7f647b7fe640 10 client.17100 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:44:05.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.334+0000 7f647b7fe640 1 -- 172.21.15.7:0/964820753 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4066 (crc 0 0 0) 0x55838ae764b0 con 0x55838aa5bda0 2024-09-21T06:44:05.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.334+0000 7f647b7fe640 10 client.17100 handle_command_reply: tid=0 2024-09-21T06:44:05.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.334+0000 7f64a890a740 1 client.17100 shutdown 2024-09-21T06:44:05.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.334+0000 7f64a890a740 1 -- 172.21.15.7:0/964820753 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55838aac8070 msgr2=0x55838ae7ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:05.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.334+0000 7f64a890a740 1 --2- 172.21.15.7:0/964820753 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55838aac8070 0x55838ae7ef70 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f64940ce6e0 tx=0x7f64940d3160 comp rx=0 tx=0).stop 2024-09-21T06:44:05.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.334+0000 7f64a890a740 1 -- 172.21.15.7:0/964820753 shutdown_connections 2024-09-21T06:44:05.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.334+0000 7f64a890a740 1 --2- 172.21.15.7:0/964820753 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55838aa5bda0 0x55838aef9960 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:05.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.334+0000 7f64a890a740 1 --2- 172.21.15.7:0/964820753 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55838aac8070 0x55838ae7ef70 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:05.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.334+0000 7f64a890a740 1 --2- 172.21.15.7:0/964820753 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55838aaa7390 0x55838ae7e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:05.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.334+0000 7f64a890a740 1 --2- 172.21.15.7:0/964820753 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55838aa9f1b0 0x55838ae83520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:05.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.334+0000 7f64a890a740 1 -- 172.21.15.7:0/964820753 >> 172.21.15.7:0/964820753 conn(0x55838aabc460 msgr2=0x55838ae86620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:05.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.334+0000 7f647b7fe640 0 client.17100 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:44:05.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.334+0000 7f64a890a740 1 -- 172.21.15.7:0/964820753 shutdown_connections 2024-09-21T06:44:05.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.334+0000 7f64a890a740 1 -- 172.21.15.7:0/964820753 wait complete. 2024-09-21T06:44:05.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.334+0000 7f64a890a740 20 client.17100 trim_cache size 0 max 16384 2024-09-21T06:44:05.342 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:44:05.342 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "no active scrubs running", 2024-09-21T06:44:05.342 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": {}, 2024-09-21T06:44:05.342 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_stats": { 2024-09-21T06:44:05.342 INFO:teuthology.orchestra.run.smithi007.stdout: "d98b2d47-c2db-4811-8b3e-ec744a20d9d6": { 2024-09-21T06:44:05.342 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:44:03.790680+0000", 2024-09-21T06:44:05.342 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:44:05.342 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:44:05.342 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:44:05.342 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:44:05.342 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:44:05.342 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:44:05.342 INFO:teuthology.orchestra.run.smithi007.stdout: "310a0ec8-44bb-49ed-a534-3bc91cb1ee9d": { 2024-09-21T06:44:05.343 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:40:55.373968+0000", 2024-09-21T06:44:05.343 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:44:05.343 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:44:05.343 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:44:05.343 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:44:05.343 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:44:05.343 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:44:05.343 INFO:teuthology.orchestra.run.smithi007.stdout: "dd792920-08a1-482d-8961-5c6a6f131599": { 2024-09-21T06:44:05.343 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:43:53.390806+0000", 2024-09-21T06:44:05.343 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:44:05.343 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:44:05.343 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:44:05.343 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:44:05.343 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:44:05.343 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:44:05.343 INFO:teuthology.orchestra.run.smithi007.stdout: "13441782-2231-4713-8ebd-068a941de47f": { 2024-09-21T06:44:05.344 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:39:30.219006+0000", 2024-09-21T06:44:05.344 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:44:05.344 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:44:05.344 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:44:05.344 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:44:05.344 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:44:05.344 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:44:05.344 INFO:teuthology.orchestra.run.smithi007.stdout: "b0327167-8c41-4286-8afc-7f0780972fd7": { 2024-09-21T06:44:05.344 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:38:36.828657+0000", 2024-09-21T06:44:05.344 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:44:05.344 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:44:05.344 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:44:05.344 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:44:05.344 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:44:05.344 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:44:05.344 INFO:teuthology.orchestra.run.smithi007.stdout: "d7b6a90c-9ae1-4e02-93ad-335a7e9df1d7": { 2024-09-21T06:44:05.345 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:39:19.226139+0000", 2024-09-21T06:44:05.345 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:44:05.345 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:44:05.345 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:44:05.345 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:44:05.345 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:44:05.345 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:44:05.345 INFO:teuthology.orchestra.run.smithi007.stdout: "6231e9c1-14a2-40b5-be3c-76d87a0d733b": { 2024-09-21T06:44:05.345 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:37:02.484812+0000", 2024-09-21T06:44:05.345 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:44:05.345 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:44:05.345 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:44:05.345 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:44:05.345 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:44:05.345 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:44:05.345 INFO:teuthology.orchestra.run.smithi007.stdout: "a1ae5b3b-f158-44be-8ef4-d70e9ba879cc": { 2024-09-21T06:44:05.346 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:41:37.568453+0000", 2024-09-21T06:44:05.346 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:44:05.346 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:44:05.346 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:44:05.346 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:44:05.346 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:44:05.346 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:44:05.346 INFO:teuthology.orchestra.run.smithi007.stdout: "62fca477-b241-45f5-8185-bc78aeb8b19f": { 2024-09-21T06:44:05.346 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:40:12.744488+0000", 2024-09-21T06:44:05.346 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:44:05.346 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:44:05.346 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:44:05.346 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:44:05.346 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:44:05.346 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:44:05.347 INFO:teuthology.orchestra.run.smithi007.stdout: "5cbaaba2-6ab1-4f83-abd6-8c6eef4b5c42": { 2024-09-21T06:44:05.347 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:37:46.566272+0000", 2024-09-21T06:44:05.347 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:44:05.347 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:44:05.347 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:44:05.347 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:44:05.347 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:44:05.347 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:44:05.347 INFO:teuthology.orchestra.run.smithi007.stdout: "b466f071-ab32-427c-a0ed-73edea33145e": { 2024-09-21T06:44:05.347 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:43:01.151440+0000", 2024-09-21T06:44:05.347 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:44:05.347 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:44:05.347 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:44:05.347 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:44:05.347 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:44:05.347 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:44:05.348 INFO:teuthology.orchestra.run.smithi007.stdout: "ef9eaabd-003a-44fb-8373-c854a9e15a71": { 2024-09-21T06:44:05.348 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:42:19.467946+0000", 2024-09-21T06:44:05.348 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:44:05.348 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:44:05.348 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:44:05.348 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:44:05.348 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:44:05.348 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:44:05.348 INFO:teuthology.orchestra.run.smithi007.stdout: "0b89345c-1f00-4efe-8ee9-4cb17e43584c": { 2024-09-21T06:44:05.348 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:36:19.500334+0000", 2024-09-21T06:44:05.348 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:44:05.348 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:44:05.348 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:44:05.348 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:44:05.348 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:44:05.348 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:44:05.349 INFO:teuthology.orchestra.run.smithi007.stdout: "3c5b7f3f-e9b3-4d48-8154-2d7d4700992e": { 2024-09-21T06:44:05.349 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:43:43.120930+0000", 2024-09-21T06:44:05.349 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:44:05.349 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:44:05.349 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:44:05.349 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:44:05.349 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:44:05.349 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:44:05.349 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:44:05.349 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:44:05.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.335+0000 7f64a2396640 1 -- 172.21.15.7:0/2354583461 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f64840b6700 msgr2=0x7f64840b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:05.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.335+0000 7f64a2396640 1 --2- 172.21.15.7:0/2354583461 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f64840b6700 0x7f64840b8c10 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f6490020000 tx=0x7f649001d000 comp rx=0 tx=0).stop 2024-09-21T06:44:05.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.335+0000 7f64a2396640 1 -- 172.21.15.7:0/2354583461 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f649c108d10 msgr2=0x7f649c110a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:05.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.335+0000 7f64a2396640 1 --2- 172.21.15.7:0/2354583461 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f649c108d10 0x7f649c110a50 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f64940098d0 tx=0x7f64940317b0 comp rx=0 tx=0).stop 2024-09-21T06:44:05.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.335+0000 7f64a2396640 1 -- 172.21.15.7:0/2354583461 shutdown_connections 2024-09-21T06:44:05.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.335+0000 7f64a2396640 1 --2- 172.21.15.7:0/2354583461 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f64840b6700 0x7f64840b8c10 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:05.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.335+0000 7f64a2396640 1 --2- 172.21.15.7:0/2354583461 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f649c108d10 0x7f649c110a50 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:05.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.335+0000 7f64a2396640 1 --2- 172.21.15.7:0/2354583461 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f649c1083c0 0x7f649c110510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:05.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.335+0000 7f64a2396640 1 --2- 172.21.15.7:0/2354583461 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f649c102a80 0x7f649c10ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:05.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.335+0000 7f64a2396640 1 -- 172.21.15.7:0/2354583461 >> 172.21.15.7:0/2354583461 conn(0x7f649c079740 msgr2=0x7f649c104430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:05.350 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.335+0000 7f64a2396640 1 -- 172.21.15.7:0/2354583461 shutdown_connections 2024-09-21T06:44:05.351 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:05.335+0000 7f64a2396640 1 -- 172.21.15.7:0/2354583461 wait complete. 2024-09-21T06:44:05.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:44:04 smithi018 ceph-mon[34477]: pgmap v557: 97 pgs: 97 active+clean; 3.3 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-21T06:44:05.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:44:04 smithi018 ceph-mon[34477]: scrub queued for path: / 2024-09-21T06:44:05.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:44:04 smithi018 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-21T06:44:05.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:44:04 smithi018 ceph-mon[34477]: scrub summary: active paths [/] 2024-09-21T06:44:05.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:44:04 smithi018 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-21T06:44:05.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:44:04 smithi018 ceph-mon[34477]: scrub summary: idle 2024-09-21T06:44:06.074 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:44:06.074 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:44:06.332 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:44:06.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:06.800+0000 7f50c7b1a640 1 -- 172.21.15.7:0/372489048 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f50c0109df0 msgr2=0x7f50c0110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:06.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:06.800+0000 7f50c7b1a640 1 --2- 172.21.15.7:0/372489048 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f50c0109df0 0x7f50c0110620 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f50b8009900 tx=0x7f50b802a410 comp rx=0 tx=0).stop 2024-09-21T06:44:06.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:06.800+0000 7f50c7b1a640 1 -- 172.21.15.7:0/372489048 shutdown_connections 2024-09-21T06:44:06.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:06.800+0000 7f50c7b1a640 1 --2- 172.21.15.7:0/372489048 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f50c0109df0 0x7f50c0110620 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:06.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:06.800+0000 7f50c7b1a640 1 --2- 172.21.15.7:0/372489048 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f50c01094a0 0x7f50c01098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:06.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:06.800+0000 7f50c7b1a640 1 --2- 172.21.15.7:0/372489048 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50c0103b60 0x7f50c0103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:06.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:06.800+0000 7f50c7b1a640 1 -- 172.21.15.7:0/372489048 >> 172.21.15.7:0/372489048 conn(0x7f50c007b850 msgr2=0x7f50c007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:06.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:06.800+0000 7f50c7b1a640 1 -- 172.21.15.7:0/372489048 shutdown_connections 2024-09-21T06:44:06.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:06.800+0000 7f50c7b1a640 1 -- 172.21.15.7:0/372489048 wait complete. 2024-09-21T06:44:06.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:06.801+0000 7f50c7b1a640 1 Processor -- start 2024-09-21T06:44:06.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:06.801+0000 7f50c7b1a640 1 -- start start 2024-09-21T06:44:06.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:06.801+0000 7f50c7b1a640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f50c0103b60 0x7f50c0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:06.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:06.801+0000 7f50c7b1a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50c01094a0 0x7f50c0075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:06.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:06.801+0000 7f50c7b1a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f50c0109df0 0x7f50c0076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:06.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:06.801+0000 7f50c7b1a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f50c0113ab0 con 0x7f50c0109df0 2024-09-21T06:44:06.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:06.801+0000 7f50c7b1a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f50c0113930 con 0x7f50c01094a0 2024-09-21T06:44:06.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:06.801+0000 7f50c7b1a640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f50c0113c30 con 0x7f50c0103b60 2024-09-21T06:44:06.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:06.801+0000 7f50c60b7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f50c0109df0 0x7f50c0076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:06.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:06.801+0000 7f50c60b7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f50c0109df0 0x7f50c0076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57956/0 (socket says 172.21.15.7:57956) 2024-09-21T06:44:06.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:06.801+0000 7f50c60b7640 1 -- 172.21.15.7:0/3299569248 learned_addr learned my addr 172.21.15.7:0/3299569248 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:44:06.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:06.802+0000 7f50c58b6640 1 --2- 172.21.15.7:0/3299569248 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f50c0103b60 0x7f50c0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:06.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:06.802+0000 7f50c50b5640 1 --2- 172.21.15.7:0/3299569248 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50c01094a0 0x7f50c0075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:06.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:06.802+0000 7f50c60b7640 1 -- 172.21.15.7:0/3299569248 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f50c0103b60 msgr2=0x7f50c0075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:06.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:06.802+0000 7f50c60b7640 1 --2- 172.21.15.7:0/3299569248 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f50c0103b60 0x7f50c0075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:06.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:06.802+0000 7f50c60b7640 1 -- 172.21.15.7:0/3299569248 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50c01094a0 msgr2=0x7f50c0075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:06.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:06.802+0000 7f50c60b7640 1 --2- 172.21.15.7:0/3299569248 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50c01094a0 0x7f50c0075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:06.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:06.802+0000 7f50c60b7640 1 -- 172.21.15.7:0/3299569248 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50c01a8610 con 0x7f50c0109df0 2024-09-21T06:44:06.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:06.802+0000 7f50c60b7640 1 --2- 172.21.15.7:0/3299569248 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f50c0109df0 0x7f50c0076190 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f50b8004770 tx=0x7f50b8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:06.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:06.802+0000 7f50beffd640 1 -- 172.21.15.7:0/3299569248 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b803f030 con 0x7f50c0109df0 2024-09-21T06:44:06.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:06.802+0000 7f50beffd640 1 -- 172.21.15.7:0/3299569248 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f50b8003aa0 con 0x7f50c0109df0 2024-09-21T06:44:06.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:06.802+0000 7f50c7b1a640 1 -- 172.21.15.7:0/3299569248 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50c01a88a0 con 0x7f50c0109df0 2024-09-21T06:44:06.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:06.802+0000 7f50beffd640 1 -- 172.21.15.7:0/3299569248 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b8035070 con 0x7f50c0109df0 2024-09-21T06:44:06.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:06.802+0000 7f50c7b1a640 1 -- 172.21.15.7:0/3299569248 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50c01a8d80 con 0x7f50c0109df0 2024-09-21T06:44:06.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:06.803+0000 7f50c7b1a640 1 -- 172.21.15.7:0/3299569248 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50c0103f70 con 0x7f50c0109df0 2024-09-21T06:44:06.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:06.805+0000 7f50beffd640 1 -- 172.21.15.7:0/3299569248 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f50b8042030 con 0x7f50c0109df0 2024-09-21T06:44:06.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:06.806+0000 7f50beffd640 1 --2- 172.21.15.7:0/3299569248 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f50a80b6680 0x7f50a80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:06.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:06.806+0000 7f50c58b6640 1 --2- 172.21.15.7:0/3299569248 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f50a80b6680 0x7f50a80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:06.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:06.806+0000 7f50beffd640 1 -- 172.21.15.7:0/3299569248 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8412+0+0 (secure 0 0 0) 0x7f50b81080e0 con 0x7f50c0109df0 2024-09-21T06:44:06.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:06.806+0000 7f50c58b6640 1 --2- 172.21.15.7:0/3299569248 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f50a80b6680 0x7f50a80b8b90 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f50c0077160 tx=0x7f50b0009760 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:06.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:06.809+0000 7f50beffd640 1 -- 172.21.15.7:0/3299569248 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f50b80ce640 con 0x7f50c0109df0 2024-09-21T06:44:07.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:07.035+0000 7f50c7b1a640 1 -- 172.21.15.7:0/3299569248 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f50c002e640 con 0x7f50c0109df0 2024-09-21T06:44:07.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:07.036+0000 7f50beffd640 1 -- 172.21.15.7:0/3299569248 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11899 (secure 0 0 0) 0x7f50b80d2a20 con 0x7f50c0109df0 2024-09-21T06:44:07.038 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:44:07.038 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-21T06:36:10:753693+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2015971546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2015971546},{"type":"v1","addr":"172.21.15.7:6835","nonce":2015971546}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/2350816224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":2350816224},{"type":"v1","addr":"172.21.15.7:6837","nonce":2350816224}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14823,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/1669980572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":1669980572},{"type":"v1","addr":"172.21.15.7:6839","nonce":1669980572}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14835,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/2528308973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":2528308973},{"type":"v1","addr":"172.21.15.7:6841","nonce":2528308973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24623,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1337382979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1337382979},{"type":"v1","addr":"172.21.15.18:6833","nonce":1337382979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/2751454345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":2751454345},{"type":"v1","addr":"172.21.15.144:6833","nonce":2751454345}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:34:24.627168+0000","modified":"2024-09-21T06:36:10.737288+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24716,"mds_1":24688,"mds_2":24686},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24656":{"gid":24656,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6835/158884796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":158884796},{"type":"v1","addr":"172.21.15.18:6835","nonce":158884796}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6835/3636739922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3636739922},{"type":"v1","addr":"172.21.15.144:6835","nonce":3636739922}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24673":{"gid":24673,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6837/1126341753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":1126341753},{"type":"v1","addr":"172.21.15.144:6837","nonce":1126341753}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.18:6837/1539670694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1539670694},{"type":"v1","addr":"172.21.15.18:6837","nonce":1539670694}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24688":{"gid":24688,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.144:6839/4027821922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":4027821922},{"type":"v1","addr":"172.21.15.144:6839","nonce":4027821922}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24716":{"gid":24716,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.18:6839/3798713532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":3798713532},{"type":"v1","addr":"172.21.15.18:6839","nonce":3798713532}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24716,"qdb_cluster":[24716,24688,24686]},"id":1}]} 2024-09-21T06:44:07.039 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-21T06:44:07.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:07.038+0000 7f50c7b1a640 1 -- 172.21.15.7:0/3299569248 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f50a80b6680 msgr2=0x7f50a80b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:07.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:07.038+0000 7f50c7b1a640 1 --2- 172.21.15.7:0/3299569248 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f50a80b6680 0x7f50a80b8b90 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f50c0077160 tx=0x7f50b0009760 comp rx=0 tx=0).stop 2024-09-21T06:44:07.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:07.038+0000 7f50c7b1a640 1 -- 172.21.15.7:0/3299569248 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f50c0109df0 msgr2=0x7f50c0076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:07.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:07.038+0000 7f50c7b1a640 1 --2- 172.21.15.7:0/3299569248 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f50c0109df0 0x7f50c0076190 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f50b8004770 tx=0x7f50b8004270 comp rx=0 tx=0).stop 2024-09-21T06:44:07.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:07.038+0000 7f50c7b1a640 1 -- 172.21.15.7:0/3299569248 shutdown_connections 2024-09-21T06:44:07.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:07.038+0000 7f50c7b1a640 1 --2- 172.21.15.7:0/3299569248 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f50a80b6680 0x7f50a80b8b90 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:07.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:07.038+0000 7f50c7b1a640 1 --2- 172.21.15.7:0/3299569248 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f50c0109df0 0x7f50c0076190 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:07.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:07.038+0000 7f50c7b1a640 1 --2- 172.21.15.7:0/3299569248 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50c01094a0 0x7f50c0075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:07.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:07.038+0000 7f50c7b1a640 1 --2- 172.21.15.7:0/3299569248 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f50c0103b60 0x7f50c0075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:07.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:07.038+0000 7f50c7b1a640 1 -- 172.21.15.7:0/3299569248 >> 172.21.15.7:0/3299569248 conn(0x7f50c007b850 msgr2=0x7f50c0107490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:07.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:07.039+0000 7f50c7b1a640 1 -- 172.21.15.7:0/3299569248 shutdown_connections 2024-09-21T06:44:07.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:07.039+0000 7f50c7b1a640 1 -- 172.21.15.7:0/3299569248 wait complete. 2024-09-21T06:44:07.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:44:06 smithi144 ceph-mon[34653]: pgmap v558: 97 pgs: 97 active+clean; 3.3 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-21T06:44:07.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:44:06 smithi007 ceph-mon[30983]: pgmap v558: 97 pgs: 97 active+clean; 3.3 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-21T06:44:07.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:44:06 smithi018 ceph-mon[34477]: pgmap v558: 97 pgs: 97 active+clean; 3.3 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-21T06:44:07.769 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:44:08.032 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:44:08.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:44:07 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/3299569248' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:44:08.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:44:07 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/3299569248' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:44:08.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:44:07 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/3299569248' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:44:08.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.561+0000 7fe880165640 1 -- 172.21.15.7:0/1080515839 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe87806b2f0 msgr2=0x7fe878102230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:08.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.561+0000 7fe880165640 1 --2- 172.21.15.7:0/1080515839 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe87806b2f0 0x7fe878102230 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fe874009900 tx=0x7fe87402a410 comp rx=0 tx=0).stop 2024-09-21T06:44:08.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.561+0000 7fe880165640 1 -- 172.21.15.7:0/1080515839 shutdown_connections 2024-09-21T06:44:08.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.561+0000 7fe880165640 1 --2- 172.21.15.7:0/1080515839 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe878102b80 0x7fe8781080b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:08.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.561+0000 7fe880165640 1 --2- 172.21.15.7:0/1080515839 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe878102770 0x7fe878107b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:08.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.561+0000 7fe880165640 1 --2- 172.21.15.7:0/1080515839 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe87806b2f0 0x7fe878102230 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:08.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.561+0000 7fe880165640 1 -- 172.21.15.7:0/1080515839 >> 172.21.15.7:0/1080515839 conn(0x7fe878079e40 msgr2=0x7fe87807a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:08.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.561+0000 7fe880165640 1 -- 172.21.15.7:0/1080515839 shutdown_connections 2024-09-21T06:44:08.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.561+0000 7fe880165640 1 -- 172.21.15.7:0/1080515839 wait complete. 2024-09-21T06:44:08.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.562+0000 7fe880165640 1 Processor -- start 2024-09-21T06:44:08.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.562+0000 7fe880165640 1 -- start start 2024-09-21T06:44:08.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.562+0000 7fe880165640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe87806b2f0 0x7fe8780fee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:08.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.562+0000 7fe880165640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe878102770 0x7fe8780ff3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:08.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.562+0000 7fe880165640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe878102b80 0x7fe8780ff8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:08.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.562+0000 7fe880165640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe878112a40 con 0x7fe878102b80 2024-09-21T06:44:08.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.562+0000 7fe880165640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe8781128c0 con 0x7fe878102770 2024-09-21T06:44:08.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.562+0000 7fe880165640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe878112bc0 con 0x7fe87806b2f0 2024-09-21T06:44:08.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.562+0000 7fe87e702640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe878102b80 0x7fe8780ff8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:08.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.562+0000 7fe87df01640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe87806b2f0 0x7fe8780fee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:08.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.562+0000 7fe87e702640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe878102b80 0x7fe8780ff8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57978/0 (socket says 172.21.15.7:57978) 2024-09-21T06:44:08.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.562+0000 7fe87e702640 1 -- 172.21.15.7:0/4051023981 learned_addr learned my addr 172.21.15.7:0/4051023981 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:44:08.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.562+0000 7fe87d700640 1 --2- 172.21.15.7:0/4051023981 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe878102770 0x7fe8780ff3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:08.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.563+0000 7fe87e702640 1 -- 172.21.15.7:0/4051023981 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe87806b2f0 msgr2=0x7fe8780fee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:08.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.563+0000 7fe87e702640 1 --2- 172.21.15.7:0/4051023981 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe87806b2f0 0x7fe8780fee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:08.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.563+0000 7fe87e702640 1 -- 172.21.15.7:0/4051023981 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe878102770 msgr2=0x7fe8780ff3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:08.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.563+0000 7fe87e702640 1 --2- 172.21.15.7:0/4051023981 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe878102770 0x7fe8780ff3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:08.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.563+0000 7fe87e702640 1 -- 172.21.15.7:0/4051023981 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8781a87c0 con 0x7fe878102b80 2024-09-21T06:44:08.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.563+0000 7fe87e702640 1 --2- 172.21.15.7:0/4051023981 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe878102b80 0x7fe8780ff8f0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fe870009fd0 tx=0x7fe87000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:08.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.563+0000 7fe86effd640 1 -- 172.21.15.7:0/4051023981 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe870017070 con 0x7fe878102b80 2024-09-21T06:44:08.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.563+0000 7fe880165640 1 -- 172.21.15.7:0/4051023981 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8781a8ab0 con 0x7fe878102b80 2024-09-21T06:44:08.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.563+0000 7fe86effd640 1 -- 172.21.15.7:0/4051023981 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe870003e20 con 0x7fe878102b80 2024-09-21T06:44:08.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.563+0000 7fe86effd640 1 -- 172.21.15.7:0/4051023981 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe870010460 con 0x7fe878102b80 2024-09-21T06:44:08.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.563+0000 7fe880165640 1 -- 172.21.15.7:0/4051023981 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8781a8fc0 con 0x7fe878102b80 2024-09-21T06:44:08.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.566+0000 7fe8866d9740 1 Processor -- start 2024-09-21T06:44:08.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.566+0000 7fe86effd640 1 -- 172.21.15.7:0/4051023981 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7fe870003970 con 0x7fe878102b80 2024-09-21T06:44:08.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.566+0000 7fe8866d9740 1 -- start start 2024-09-21T06:44:08.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.567+0000 7fe8866d9740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d32f9f9070 0x55d32fda02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:08.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.567+0000 7fe8866d9740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d32f9d01b0 0x55d32fda0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:08.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.567+0000 7fe8866d9740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d32f9d8390 0x55d32fda0d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:08.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.567+0000 7fe8866d9740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55d32fd16ea0 con 0x55d32f9d8390 2024-09-21T06:44:08.571 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.567+0000 7fe8866d9740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55d32fd062d0 con 0x55d32f9f9070 2024-09-21T06:44:08.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.567+0000 7fe8866d9740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55d32fd0a0e0 con 0x55d32f9d01b0 2024-09-21T06:44:08.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.567+0000 7fe87d700640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d32f9d8390 0x55d32fda0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:08.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.567+0000 7fe87d700640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d32f9d8390 0x55d32fda0d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57988/0 (socket says 172.21.15.7:57988) 2024-09-21T06:44:08.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.567+0000 7fe87d700640 1 -- 172.21.15.7:0/4182793974 learned_addr learned my addr 172.21.15.7:0/4182793974 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:44:08.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.567+0000 7fe87df01640 1 --2- 172.21.15.7:0/4182793974 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d32f9d01b0 0x55d32fda0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:08.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.567+0000 7fe87d700640 1 --2- 172.21.15.7:0/4182793974 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d32f9f9070 0x55d32fda02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:08.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.567+0000 7fe87d700640 1 -- 172.21.15.7:0/4182793974 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d32f9d01b0 msgr2=0x55d32fda0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:08.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.567+0000 7fe87d700640 1 --2- 172.21.15.7:0/4182793974 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d32f9d01b0 0x55d32fda0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:08.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.567+0000 7fe86effd640 1 --2- 172.21.15.7:0/4051023981 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fe8640b6680 0x7fe8640b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:08.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.567+0000 7fe87d700640 1 -- 172.21.15.7:0/4182793974 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d32f9f9070 msgr2=0x55d32fda02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:08.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.567+0000 7fe87d700640 1 --2- 172.21.15.7:0/4182793974 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d32f9f9070 0x55d32fda02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:08.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.567+0000 7fe87d700640 1 -- 172.21.15.7:0/4182793974 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d32fa64650 con 0x55d32f9d8390 2024-09-21T06:44:08.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.567+0000 7fe87e702640 1 --2- 172.21.15.7:0/4051023981 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fe8640b6680 0x7fe8640b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:08.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.568+0000 7fe87d700640 1 --2- 172.21.15.7:0/4182793974 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d32f9d8390 0x55d32fda0d40 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fe8680116b0 tx=0x7fe86800a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcfda5986d12bd39 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:08.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.568+0000 7fe86effd640 1 -- 172.21.15.7:0/4051023981 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 8412+0+0 (secure 0 0 0) 0x7fe8700e7380 con 0x7fe878102b80 2024-09-21T06:44:08.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.568+0000 7fe863fff640 1 -- 172.21.15.7:0/4182793974 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe868004020 con 0x55d32f9d8390 2024-09-21T06:44:08.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.568+0000 7fe863fff640 1 -- 172.21.15.7:0/4182793974 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe8680054d0 con 0x55d32f9d8390 2024-09-21T06:44:08.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.568+0000 7fe863fff640 1 -- 172.21.15.7:0/4182793974 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe868004c60 con 0x55d32f9d8390 2024-09-21T06:44:08.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.569+0000 7fe8866d9740 1 -- 172.21.15.7:0/4182793974 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d32f9d8390 msgr2=0x55d32fda0d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:08.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.569+0000 7fe87e702640 1 --2- 172.21.15.7:0/4051023981 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fe8640b6680 0x7fe8640b8b90 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe8700e5140 tx=0x7fe870079fa0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:08.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.569+0000 7fe8866d9740 1 --2- 172.21.15.7:0/4182793974 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d32f9d8390 0x55d32fda0d40 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fe8680116b0 tx=0x7fe86800a640 comp rx=0 tx=0).stop 2024-09-21T06:44:08.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.569+0000 7fe8866d9740 1 -- 172.21.15.7:0/4182793974 shutdown_connections 2024-09-21T06:44:08.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.569+0000 7fe8866d9740 1 --2- 172.21.15.7:0/4182793974 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d32f9d8390 0x55d32fda0d40 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:08.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.569+0000 7fe8866d9740 1 --2- 172.21.15.7:0/4182793974 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d32f9d01b0 0x55d32fda0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:08.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.569+0000 7fe8866d9740 1 --2- 172.21.15.7:0/4182793974 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d32f9f9070 0x55d32fda02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:08.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.569+0000 7fe8866d9740 1 -- 172.21.15.7:0/4182793974 >> 172.21.15.7:0/4182793974 conn(0x55d32f9ed460 msgr2=0x55d32fd9e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:08.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.569+0000 7fe8866d9740 1 -- 172.21.15.7:0/4182793974 shutdown_connections 2024-09-21T06:44:08.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.569+0000 7fe8866d9740 1 -- 172.21.15.7:0/4182793974 wait complete. 2024-09-21T06:44:08.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.569+0000 7fe8866d9740 1 -- start start 2024-09-21T06:44:08.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.570+0000 7fe8866d9740 1 Processor -- start 2024-09-21T06:44:08.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.570+0000 7fe8866d9740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d32f9d01b0 0x55d32fdab980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:08.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.570+0000 7fe8866d9740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d32f9d8390 0x55d32fdabec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:08.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.570+0000 7fe8866d9740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d32f9f9070 0x55d32fdb7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:08.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.570+0000 7fe8866d9740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55d32fb67700 con 0x55d32f9f9070 2024-09-21T06:44:08.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.570+0000 7fe8866d9740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55d32fca1160 con 0x55d32f9d8390 2024-09-21T06:44:08.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.570+0000 7fe8866d9740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55d32fdaeaa0 con 0x55d32f9d01b0 2024-09-21T06:44:08.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.570+0000 7fe8866d9740 10 client.0 _ll_register_callbacks cb 0x55d32fcba9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:44:08.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.570+0000 7fe87d700640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d32f9f9070 0x55d32fdb7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:08.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.570+0000 7fe87d700640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d32f9f9070 0x55d32fdb7d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57994/0 (socket says 172.21.15.7:57994) 2024-09-21T06:44:08.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.570+0000 7fe87d700640 1 -- 172.21.15.7:0/2288430749 learned_addr learned my addr 172.21.15.7:0/2288430749 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:44:08.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.570+0000 7fe87df01640 1 --2- 172.21.15.7:0/2288430749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d32f9d8390 0x55d32fdabec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:08.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.570+0000 7fe87d700640 1 --2- 172.21.15.7:0/2288430749 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d32f9d01b0 0x55d32fdab980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:08.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.571+0000 7fe87df01640 1 -- 172.21.15.7:0/2288430749 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d32f9d01b0 msgr2=0x55d32fdab980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:08.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.571+0000 7fe87df01640 1 --2- 172.21.15.7:0/2288430749 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d32f9d01b0 0x55d32fdab980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:08.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.571+0000 7fe87df01640 1 -- 172.21.15.7:0/2288430749 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d32f9f9070 msgr2=0x55d32fdb7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:08.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.571+0000 7fe87df01640 1 --2- 172.21.15.7:0/2288430749 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d32f9f9070 0x55d32fdb7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:08.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.571+0000 7fe87df01640 1 -- 172.21.15.7:0/2288430749 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d32fccec90 con 0x55d32f9d8390 2024-09-21T06:44:08.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.571+0000 7fe87d700640 1 --2- 172.21.15.7:0/2288430749 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d32f9f9070 0x55d32fdb7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:44:08.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.571+0000 7fe87df01640 1 --2- 172.21.15.7:0/2288430749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d32f9d8390 0x55d32fdabec0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe87402aa00 tx=0x7fe874005040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48958b6b01935efb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:08.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.571+0000 7fe8617fa640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-21T06:44:08.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.571+0000 7fe8617fa640 1 -- 172.21.15.7:0/2288430749 <== mon.2 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe874035040 con 0x55d32f9d8390 2024-09-21T06:44:08.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.571+0000 7fe8866d9740 1 -- 172.21.15.7:0/2288430749 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe8680054d0 con 0x55d32f9d8390 2024-09-21T06:44:08.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.571+0000 7fe8617fa640 1 -- 172.21.15.7:0/2288430749 <== mon.2 v2:172.21.15.18:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8412+0+0 (secure 0 0 0) 0x7fe874004770 con 0x55d32f9d8390 2024-09-21T06:44:08.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.571+0000 7fe8617fa640 1 -- 172.21.15.7:0/2288430749 <== mon.2 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe874004970 con 0x55d32f9d8390 2024-09-21T06:44:08.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.571+0000 7fe8866d9740 10 client.26717 fetch_fsmap learned FSMap version 25 2024-09-21T06:44:08.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.571+0000 7fe8866d9740 1 -- 172.21.15.7:0/2288430749 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d32fdba800 con 0x55d32f9d8390 2024-09-21T06:44:08.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.572+0000 7fe8617fa640 1 -- 172.21.15.7:0/2288430749 <== mon.2 v2:172.21.15.18:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe8680054d0 con 0x55d32f9d8390 2024-09-21T06:44:08.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.572+0000 7fe8617fa640 1 -- 172.21.15.7:0/2288430749 <== mon.2 v2:172.21.15.18:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fe87404e050 con 0x55d32f9d8390 2024-09-21T06:44:08.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.572+0000 7fe8866d9740 10 client.26717 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:44:08.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.572+0000 7fe8866d9740 10 client.26717 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-21T06:44:08.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.572+0000 7fe8866d9740 20 client.26717 populate_metadata read hostname 'smithi007' 2024-09-21T06:44:08.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.572+0000 7fe8866d9740 1 --2- 172.21.15.7:0/2288430749 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x55d32f9b79f0 0x55d32fdbdc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:08.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.572+0000 7fe8866d9740 4 client.26717 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:44:08.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.572+0000 7fe8866d9740 1 -- 172.21.15.7:0/2288430749 --> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d32fd18df0 con 0x55d32f9b79f0 2024-09-21T06:44:08.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.572+0000 7fe87d700640 1 --2- 172.21.15.7:0/2288430749 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x55d32f9b79f0 0x55d32fdbdc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:08.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.572+0000 7fe8617fa640 10 client.26717 ms_handle_connect on v2:172.21.15.18:6836/1539670694 2024-09-21T06:44:08.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.573+0000 7fe87d700640 1 --2- 172.21.15.7:0/2288430749 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x55d32f9b79f0 0x55d32fdbdc70 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2b89e86827cb1605 server_cookie=e547911865f2f641 in_seq=0 out_seq=0 2024-09-21T06:44:08.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.573+0000 7fe8617fa640 1 -- 172.21.15.7:0/2288430749 <== mds.2 v2:172.21.15.18:6836/1539670694 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d32fd18df0 con 0x55d32f9b79f0 2024-09-21T06:44:08.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.573+0000 7fe8617fa640 10 client.26717 handle_command_reply: tid=0 2024-09-21T06:44:08.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.573+0000 7fe8866d9740 1 client.26717 shutdown 2024-09-21T06:44:08.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.573+0000 7fe8866d9740 1 -- 172.21.15.7:0/2288430749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d32f9d8390 msgr2=0x55d32fdabec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:08.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.573+0000 7fe8866d9740 1 --2- 172.21.15.7:0/2288430749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d32f9d8390 0x55d32fdabec0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe87402aa00 tx=0x7fe874005040 comp rx=0 tx=0).stop 2024-09-21T06:44:08.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.574+0000 7fe8866d9740 1 -- 172.21.15.7:0/2288430749 shutdown_connections 2024-09-21T06:44:08.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.574+0000 7fe8866d9740 1 --2- 172.21.15.7:0/2288430749 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x55d32f9b79f0 0x55d32fdbdc70 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:08.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.574+0000 7fe8866d9740 1 --2- 172.21.15.7:0/2288430749 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d32f9f9070 0x55d32fdb7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:08.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.574+0000 7fe8866d9740 1 --2- 172.21.15.7:0/2288430749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d32f9d8390 0x55d32fdabec0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:08.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.574+0000 7fe8866d9740 1 --2- 172.21.15.7:0/2288430749 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d32f9d01b0 0x55d32fdab980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:08.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.574+0000 7fe8617fa640 0 client.26717 ms_handle_reset on v2:172.21.15.18:6836/1539670694 2024-09-21T06:44:08.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.574+0000 7fe8866d9740 1 -- 172.21.15.7:0/2288430749 >> 172.21.15.7:0/2288430749 conn(0x55d32f9ed460 msgr2=0x55d32fda34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:08.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.574+0000 7fe8866d9740 1 -- 172.21.15.7:0/2288430749 shutdown_connections 2024-09-21T06:44:08.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.574+0000 7fe8866d9740 1 -- 172.21.15.7:0/2288430749 wait complete. 2024-09-21T06:44:08.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.574+0000 7fe8866d9740 20 client.26717 trim_cache size 0 max 16384 2024-09-21T06:44:08.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.587+0000 7fe8866d9740 1 Processor -- start 2024-09-21T06:44:08.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.587+0000 7fe8866d9740 1 -- start start 2024-09-21T06:44:08.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.587+0000 7fe8866d9740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d32f9d01b0 0x55d32fda7130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:08.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.587+0000 7fe8866d9740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d32f9d8390 0x55d32fda1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:08.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.587+0000 7fe8866d9740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d32f9f9070 0x55d32fdb7c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:08.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.587+0000 7fe8866d9740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe8781b3ee0 con 0x55d32f9f9070 2024-09-21T06:44:08.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.587+0000 7fe8866d9740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe8781b17b0 con 0x55d32f9d8390 2024-09-21T06:44:08.590 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.587+0000 7fe8866d9740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe8781af620 con 0x55d32f9d01b0 2024-09-21T06:44:08.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.588+0000 7fe87d700640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d32f9f9070 0x55d32fdb7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:08.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.588+0000 7fe87d700640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d32f9f9070 0x55d32fdb7c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58008/0 (socket says 172.21.15.7:58008) 2024-09-21T06:44:08.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.588+0000 7fe87d700640 1 -- 172.21.15.7:0/3952855343 learned_addr learned my addr 172.21.15.7:0/3952855343 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:44:08.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.588+0000 7fe87df01640 1 --2- 172.21.15.7:0/3952855343 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d32f9d8390 0x55d32fda1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:08.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.588+0000 7fe87d700640 1 --2- 172.21.15.7:0/3952855343 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d32f9d01b0 0x55d32fda7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:08.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.588+0000 7fe87d700640 1 -- 172.21.15.7:0/3952855343 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d32f9d01b0 msgr2=0x55d32fda7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:08.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.588+0000 7fe87d700640 1 --2- 172.21.15.7:0/3952855343 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d32f9d01b0 0x55d32fda7130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:08.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.588+0000 7fe87d700640 1 -- 172.21.15.7:0/3952855343 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d32f9d8390 msgr2=0x55d32fda1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:08.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.588+0000 7fe87d700640 1 --2- 172.21.15.7:0/3952855343 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d32f9d8390 0x55d32fda1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:08.592 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.588+0000 7fe87d700640 1 -- 172.21.15.7:0/3952855343 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d32fd9eaa0 con 0x55d32f9f9070 2024-09-21T06:44:08.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.588+0000 7fe87d700640 1 --2- 172.21.15.7:0/3952855343 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d32f9f9070 0x55d32fdb7c90 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fe86800f3c0 tx=0x7fe868020040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eba57bb9cc2973f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:08.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.588+0000 7fe8637fe640 1 -- 172.21.15.7:0/3952855343 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe868004fd0 con 0x55d32f9f9070 2024-09-21T06:44:08.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.588+0000 7fe8637fe640 1 -- 172.21.15.7:0/3952855343 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe868005620 con 0x55d32f9f9070 2024-09-21T06:44:08.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.588+0000 7fe8637fe640 1 -- 172.21.15.7:0/3952855343 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe86801e470 con 0x55d32f9f9070 2024-09-21T06:44:08.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.589+0000 7fe8866d9740 1 -- 172.21.15.7:0/3952855343 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d32f9f9070 msgr2=0x55d32fdb7c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:08.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.589+0000 7fe8866d9740 1 --2- 172.21.15.7:0/3952855343 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d32f9f9070 0x55d32fdb7c90 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fe86800f3c0 tx=0x7fe868020040 comp rx=0 tx=0).stop 2024-09-21T06:44:08.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.589+0000 7fe8866d9740 1 -- 172.21.15.7:0/3952855343 shutdown_connections 2024-09-21T06:44:08.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.589+0000 7fe8866d9740 1 --2- 172.21.15.7:0/3952855343 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d32f9f9070 0x55d32fdb7c90 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:08.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.589+0000 7fe8866d9740 1 --2- 172.21.15.7:0/3952855343 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d32f9d8390 0x55d32fda1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:08.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.589+0000 7fe8866d9740 1 --2- 172.21.15.7:0/3952855343 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d32f9d01b0 0x55d32fda7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:08.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.589+0000 7fe8866d9740 1 -- 172.21.15.7:0/3952855343 >> 172.21.15.7:0/3952855343 conn(0x55d32f9ed460 msgr2=0x55d32fda12f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:08.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.589+0000 7fe8866d9740 1 -- 172.21.15.7:0/3952855343 shutdown_connections 2024-09-21T06:44:08.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.589+0000 7fe8866d9740 1 -- 172.21.15.7:0/3952855343 wait complete. 2024-09-21T06:44:08.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.590+0000 7fe8866d9740 1 -- start start 2024-09-21T06:44:08.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.590+0000 7fe8866d9740 1 Processor -- start 2024-09-21T06:44:08.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.590+0000 7fe8866d9740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d32f9d01b0 0x55d32fdb4190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:08.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.590+0000 7fe8866d9740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d32f9d8390 0x55d32fdaf690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:08.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.590+0000 7fe8866d9740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d32f9f9070 0x55d32fdafbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:08.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.591+0000 7fe8866d9740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe8781afc70 con 0x55d32f9d8390 2024-09-21T06:44:08.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.591+0000 7fe8866d9740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe8781b10e0 con 0x55d32f9d01b0 2024-09-21T06:44:08.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.591+0000 7fe8866d9740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe8781b0340 con 0x55d32f9f9070 2024-09-21T06:44:08.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.591+0000 7fe8866d9740 10 client.0 _ll_register_callbacks cb 0x7fe874004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:44:08.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.591+0000 7fe87df01640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d32f9d8390 0x55d32fdaf690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:08.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.591+0000 7fe87df01640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d32f9d8390 0x55d32fdaf690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58014/0 (socket says 172.21.15.7:58014) 2024-09-21T06:44:08.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.591+0000 7fe87df01640 1 -- 172.21.15.7:0/3658869217 learned_addr learned my addr 172.21.15.7:0/3658869217 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:44:08.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.591+0000 7fe87d700640 1 --2- 172.21.15.7:0/3658869217 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d32f9d01b0 0x55d32fdb4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:08.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.591+0000 7fe87d700640 1 --2- 172.21.15.7:0/3658869217 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d32f9f9070 0x55d32fdafbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:08.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.591+0000 7fe87df01640 1 -- 172.21.15.7:0/3658869217 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d32f9f9070 msgr2=0x55d32fdafbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:08.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.591+0000 7fe87df01640 1 --2- 172.21.15.7:0/3658869217 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d32f9f9070 0x55d32fdafbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:08.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.591+0000 7fe87df01640 1 -- 172.21.15.7:0/3658869217 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d32f9d01b0 msgr2=0x55d32fdb4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:08.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.591+0000 7fe87df01640 1 --2- 172.21.15.7:0/3658869217 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d32f9d01b0 0x55d32fdb4190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:08.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.591+0000 7fe87df01640 1 -- 172.21.15.7:0/3658869217 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d32fdb0110 con 0x55d32f9d8390 2024-09-21T06:44:08.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.591+0000 7fe87df01640 1 --2- 172.21.15.7:0/3658869217 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d32f9d8390 0x55d32fdaf690 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fe874001eb0 tx=0x7fe874000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b81e0e569a1d74d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:08.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.591+0000 7fe8617fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:44:08.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.591+0000 7fe8617fa640 1 -- 172.21.15.7:0/3658869217 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe874035040 con 0x55d32f9d8390 2024-09-21T06:44:08.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.591+0000 7fe8617fa640 1 -- 172.21.15.7:0/3658869217 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(79..79 src has 1..79) ==== 8412+0+0 (secure 0 0 0) 0x7fe8740314f0 con 0x55d32f9d8390 2024-09-21T06:44:08.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.591+0000 7fe8866d9740 1 -- 172.21.15.7:0/3658869217 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe868005620 con 0x55d32f9d8390 2024-09-21T06:44:08.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.592+0000 7fe8617fa640 1 -- 172.21.15.7:0/3658869217 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe8740035f0 con 0x55d32f9d8390 2024-09-21T06:44:08.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.592+0000 7fe8866d9740 10 client.17124 fetch_fsmap learned FSMap version 25 2024-09-21T06:44:08.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.592+0000 7fe8866d9740 1 -- 172.21.15.7:0/3658869217 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d32fe28240 con 0x55d32f9d8390 2024-09-21T06:44:08.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.592+0000 7fe8617fa640 1 -- 172.21.15.7:0/3658869217 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe868005620 con 0x55d32f9d8390 2024-09-21T06:44:08.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.592+0000 7fe8617fa640 1 -- 172.21.15.7:0/3658869217 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fe874061050 con 0x55d32f9d8390 2024-09-21T06:44:08.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.592+0000 7fe8866d9740 10 client.17124 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:44:08.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.592+0000 7fe8866d9740 10 client.17124 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-21T06:44:08.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.592+0000 7fe8866d9740 20 client.17124 populate_metadata read hostname 'smithi007' 2024-09-21T06:44:08.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.592+0000 7fe8866d9740 1 --2- 172.21.15.7:0/3658869217 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x55d32f98cda0 0x55d32fe2aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:08.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.592+0000 7fe8866d9740 4 client.17124 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:44:08.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.592+0000 7fe8866d9740 1 -- 172.21.15.7:0/3658869217 --> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d32fd148a0 con 0x55d32f98cda0 2024-09-21T06:44:08.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.592+0000 7fe87d700640 1 --2- 172.21.15.7:0/3658869217 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x55d32f98cda0 0x55d32fe2aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:08.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.593+0000 7fe87d700640 1 --2- 172.21.15.7:0/3658869217 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x55d32f98cda0 0x55d32fe2aa30 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8e6756490b08a9b7 server_cookie=687f02c43322cc16 in_seq=0 out_seq=0 2024-09-21T06:44:08.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.593+0000 7fe8617fa640 10 client.17124 ms_handle_connect on v2:172.21.15.18:6836/1539670694 2024-09-21T06:44:08.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.593+0000 7fe8617fa640 1 -- 172.21.15.7:0/3658869217 <== mds.2 v2:172.21.15.18:6836/1539670694 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d32fd148a0 con 0x55d32f98cda0 2024-09-21T06:44:08.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.593+0000 7fe8617fa640 10 client.17124 handle_command_reply: tid=0 2024-09-21T06:44:08.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.593+0000 7fe8866d9740 1 client.17124 shutdown 2024-09-21T06:44:08.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.593+0000 7fe8866d9740 1 -- 172.21.15.7:0/3658869217 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d32f9d8390 msgr2=0x55d32fdaf690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:08.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.593+0000 7fe8866d9740 1 --2- 172.21.15.7:0/3658869217 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d32f9d8390 0x55d32fdaf690 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fe874001eb0 tx=0x7fe874000bc0 comp rx=0 tx=0).stop 2024-09-21T06:44:08.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.593+0000 7fe8866d9740 1 -- 172.21.15.7:0/3658869217 shutdown_connections 2024-09-21T06:44:08.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.593+0000 7fe8866d9740 1 --2- 172.21.15.7:0/3658869217 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x55d32f98cda0 0x55d32fe2aa30 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:08.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.593+0000 7fe8866d9740 1 --2- 172.21.15.7:0/3658869217 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d32f9f9070 0x55d32fdafbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:08.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.593+0000 7fe8866d9740 1 --2- 172.21.15.7:0/3658869217 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d32f9d8390 0x55d32fdaf690 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:08.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.593+0000 7fe8866d9740 1 --2- 172.21.15.7:0/3658869217 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d32f9d01b0 0x55d32fdb4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:08.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.593+0000 7fe8617fa640 0 client.17124 ms_handle_reset on v2:172.21.15.18:6836/1539670694 2024-09-21T06:44:08.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.593+0000 7fe8866d9740 1 -- 172.21.15.7:0/3658869217 >> 172.21.15.7:0/3658869217 conn(0x55d32f9ed460 msgr2=0x55d32fdace30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:08.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.593+0000 7fe8866d9740 1 -- 172.21.15.7:0/3658869217 shutdown_connections 2024-09-21T06:44:08.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.593+0000 7fe8866d9740 1 -- 172.21.15.7:0/3658869217 wait complete. 2024-09-21T06:44:08.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.594+0000 7fe8866d9740 20 client.17124 trim_cache size 0 max 16384 2024-09-21T06:44:08.602 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:44:08.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.594+0000 7fe880165640 1 -- 172.21.15.7:0/4051023981 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fe8640b6680 msgr2=0x7fe8640b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:08.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.594+0000 7fe880165640 1 --2- 172.21.15.7:0/4051023981 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fe8640b6680 0x7fe8640b8b90 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe8700e5140 tx=0x7fe870079fa0 comp rx=0 tx=0).stop 2024-09-21T06:44:08.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.594+0000 7fe880165640 1 -- 172.21.15.7:0/4051023981 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe878102b80 msgr2=0x7fe8780ff8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:08.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.594+0000 7fe880165640 1 --2- 172.21.15.7:0/4051023981 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe878102b80 0x7fe8780ff8f0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fe870009fd0 tx=0x7fe87000b260 comp rx=0 tx=0).stop 2024-09-21T06:44:08.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.594+0000 7fe880165640 1 -- 172.21.15.7:0/4051023981 shutdown_connections 2024-09-21T06:44:08.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.594+0000 7fe880165640 1 --2- 172.21.15.7:0/4051023981 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fe8640b6680 0x7fe8640b8b90 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:08.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.594+0000 7fe880165640 1 --2- 172.21.15.7:0/4051023981 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe878102b80 0x7fe8780ff8f0 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:08.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.594+0000 7fe880165640 1 --2- 172.21.15.7:0/4051023981 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe878102770 0x7fe8780ff3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:08.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.594+0000 7fe880165640 1 --2- 172.21.15.7:0/4051023981 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe87806b2f0 0x7fe8780fee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:08.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.594+0000 7fe880165640 1 -- 172.21.15.7:0/4051023981 >> 172.21.15.7:0/4051023981 conn(0x7fe878079e40 msgr2=0x7fe878108cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:08.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.594+0000 7fe880165640 1 -- 172.21.15.7:0/4051023981 shutdown_connections 2024-09-21T06:44:08.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:08.594+0000 7fe880165640 1 -- 172.21.15.7:0/4051023981 wait complete. 2024-09-21T06:44:09.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:44:08 smithi144 ceph-mon[34653]: pgmap v559: 97 pgs: 97 active+clean; 3.3 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-21T06:44:09.317 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:44:08 smithi007 ceph-mon[30983]: pgmap v559: 97 pgs: 97 active+clean; 3.3 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-21T06:44:09.345 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:44:09.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:44:08 smithi018 ceph-mon[34477]: pgmap v559: 97 pgs: 97 active+clean; 3.3 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-21T06:44:09.602 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:44:10.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.080+0000 7fa9b1a78640 1 -- 172.21.15.7:0/2547565160 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9ac108cf0 msgr2=0x7fa9ac10f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:10.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.080+0000 7fa9b1a78640 1 --2- 172.21.15.7:0/2547565160 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9ac108cf0 0x7fa9ac10f520 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fa9a4009ca0 tx=0x7fa9a402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:44:10.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.080+0000 7fa9b1a78640 1 -- 172.21.15.7:0/2547565160 shutdown_connections 2024-09-21T06:44:10.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.080+0000 7fa9b1a78640 1 --2- 172.21.15.7:0/2547565160 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9ac108cf0 0x7fa9ac10f520 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:10.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.080+0000 7fa9b1a78640 1 --2- 172.21.15.7:0/2547565160 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa9ac1083a0 0x7fa9ac1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:10.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.080+0000 7fa9b1a78640 1 --2- 172.21.15.7:0/2547565160 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9ac102a60 0x7fa9ac102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:10.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.080+0000 7fa9b1a78640 1 -- 172.21.15.7:0/2547565160 >> 172.21.15.7:0/2547565160 conn(0x7fa9ac079730 msgr2=0x7fa9ac079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:10.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.080+0000 7fa9b1a78640 1 -- 172.21.15.7:0/2547565160 shutdown_connections 2024-09-21T06:44:10.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.080+0000 7fa9b1a78640 1 -- 172.21.15.7:0/2547565160 wait complete. 2024-09-21T06:44:10.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.080+0000 7fa9b1a78640 1 Processor -- start 2024-09-21T06:44:10.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.081+0000 7fa9b1a78640 1 -- start start 2024-09-21T06:44:10.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.081+0000 7fa9b1a78640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9ac102a60 0x7fa9ac19b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:10.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.081+0000 7fa9b1a78640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9ac1083a0 0x7fa9ac19b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:10.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.081+0000 7fa9b1a78640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa9ac108cf0 0x7fa9ac19bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:10.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.081+0000 7fa9b1a78640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa9ac112960 con 0x7fa9ac1083a0 2024-09-21T06:44:10.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.081+0000 7fa9b1a78640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa9ac1127e0 con 0x7fa9ac102a60 2024-09-21T06:44:10.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.081+0000 7fa9b1a78640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa9ac112ae0 con 0x7fa9ac108cf0 2024-09-21T06:44:10.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.081+0000 7fa9a2ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9ac1083a0 0x7fa9ac19b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:10.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.081+0000 7fa9ab7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9ac102a60 0x7fa9ac19b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:10.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.081+0000 7fa9a2ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9ac1083a0 0x7fa9ac19b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58034/0 (socket says 172.21.15.7:58034) 2024-09-21T06:44:10.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.081+0000 7fa9a2ffd640 1 -- 172.21.15.7:0/50317123 learned_addr learned my addr 172.21.15.7:0/50317123 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:44:10.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.081+0000 7fa9abfff640 1 --2- 172.21.15.7:0/50317123 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa9ac108cf0 0x7fa9ac19bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:10.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.082+0000 7fa9a2ffd640 1 -- 172.21.15.7:0/50317123 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa9ac108cf0 msgr2=0x7fa9ac19bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:10.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.082+0000 7fa9a2ffd640 1 --2- 172.21.15.7:0/50317123 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa9ac108cf0 0x7fa9ac19bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:10.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.082+0000 7fa9a2ffd640 1 -- 172.21.15.7:0/50317123 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9ac102a60 msgr2=0x7fa9ac19b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:10.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.082+0000 7fa9a2ffd640 1 --2- 172.21.15.7:0/50317123 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9ac102a60 0x7fa9ac19b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:10.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.082+0000 7fa9a2ffd640 1 -- 172.21.15.7:0/50317123 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9ac1a6520 con 0x7fa9ac1083a0 2024-09-21T06:44:10.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.082+0000 7fa9ab7fe640 1 --2- 172.21.15.7:0/50317123 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9ac102a60 0x7fa9ac19b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:44:10.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.082+0000 7fa9a2ffd640 1 --2- 172.21.15.7:0/50317123 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9ac1083a0 0x7fa9ac19b750 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fa99400e9f0 tx=0x7fa99400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:10.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.082+0000 7fa9a97fa640 1 -- 172.21.15.7:0/50317123 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa99400ccc0 con 0x7fa9ac1083a0 2024-09-21T06:44:10.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.082+0000 7fa9b1a78640 1 -- 172.21.15.7:0/50317123 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9ac1a6810 con 0x7fa9ac1083a0 2024-09-21T06:44:10.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.082+0000 7fa9a97fa640 1 -- 172.21.15.7:0/50317123 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa9940054d0 con 0x7fa9ac1083a0 2024-09-21T06:44:10.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.082+0000 7fa9a97fa640 1 -- 172.21.15.7:0/50317123 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa994010430 con 0x7fa9ac1083a0 2024-09-21T06:44:10.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.082+0000 7fa9b1a78640 1 -- 172.21.15.7:0/50317123 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9ac1a6d00 con 0x7fa9ac1083a0 2024-09-21T06:44:10.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.085+0000 7fa9a97fa640 1 -- 172.21.15.7:0/50317123 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7fa9940105d0 con 0x7fa9ac1083a0 2024-09-21T06:44:10.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.085+0000 7fa9b7fec740 1 Processor -- start 2024-09-21T06:44:10.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.085+0000 7fa9b7fec740 1 -- start start 2024-09-21T06:44:10.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.085+0000 7fa9b7fec740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a71962070 0x559a71d096a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:10.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.085+0000 7fa9b7fec740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559a719391b0 0x559a71d09be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:10.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.085+0000 7fa9b7fec740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a71941390 0x559a71d0a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:10.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.085+0000 7fa9b7fec740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x559a71c7fea0 con 0x559a71962070 2024-09-21T06:44:10.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.085+0000 7fa9b7fec740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559a71c6f2d0 con 0x559a719391b0 2024-09-21T06:44:10.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.085+0000 7fa9b7fec740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x559a71c730e0 con 0x559a71941390 2024-09-21T06:44:10.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.086+0000 7fa9abfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a71962070 0x559a71d096a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:10.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.086+0000 7fa9abfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a71962070 0x559a71d096a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58036/0 (socket says 172.21.15.7:58036) 2024-09-21T06:44:10.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.086+0000 7fa9abfff640 1 -- 172.21.15.7:0/3108797700 learned_addr learned my addr 172.21.15.7:0/3108797700 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:44:10.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.086+0000 7fa9ab7fe640 1 --2- 172.21.15.7:0/3108797700 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559a719391b0 0x559a71d09be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:10.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.086+0000 7fa9a2ffd640 1 --2- 172.21.15.7:0/3108797700 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a71941390 0x559a71d0a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:10.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.086+0000 7fa9ab7fe640 1 -- 172.21.15.7:0/3108797700 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a71941390 msgr2=0x559a71d0a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:10.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.086+0000 7fa9ab7fe640 1 --2- 172.21.15.7:0/3108797700 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a71941390 0x559a71d0a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:10.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.086+0000 7fa9ab7fe640 1 -- 172.21.15.7:0/3108797700 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a71962070 msgr2=0x559a71d096a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:10.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.086+0000 7fa9ab7fe640 1 --2- 172.21.15.7:0/3108797700 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a71962070 0x559a71d096a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:10.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.086+0000 7fa9ab7fe640 1 -- 172.21.15.7:0/3108797700 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a719cd650 con 0x559a719391b0 2024-09-21T06:44:10.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.086+0000 7fa9a97fa640 1 --2- 172.21.15.7:0/50317123 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa9980b6680 0x7fa9980b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:10.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.086+0000 7fa9abfff640 1 --2- 172.21.15.7:0/50317123 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa9980b6680 0x7fa9980b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:10.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.086+0000 7fa9ab7fe640 1 --2- 172.21.15.7:0/3108797700 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559a719391b0 0x559a71d09be0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa99c009fa0 tx=0x7fa99c0118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=96378d13594227c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:10.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.086+0000 7fa9a97fa640 1 -- 172.21.15.7:0/50317123 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8456+0+0 (secure 0 0 0) 0x7fa9940e7ac0 con 0x7fa9ac1083a0 2024-09-21T06:44:10.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.087+0000 7fa9a1ffb640 1 -- 172.21.15.7:0/3108797700 <== mon.2 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa99c004030 con 0x559a719391b0 2024-09-21T06:44:10.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.087+0000 7fa9a1ffb640 1 -- 172.21.15.7:0/3108797700 <== mon.2 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa99c0054d0 con 0x559a719391b0 2024-09-21T06:44:10.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.087+0000 7fa9a1ffb640 1 -- 172.21.15.7:0/3108797700 <== mon.2 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa99c004bd0 con 0x559a719391b0 2024-09-21T06:44:10.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.087+0000 7fa9b7fec740 1 -- 172.21.15.7:0/3108797700 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559a719391b0 msgr2=0x559a71d09be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:10.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.087+0000 7fa9abfff640 1 --2- 172.21.15.7:0/50317123 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa9980b6680 0x7fa9980b8b90 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa9a402f500 tx=0x7fa9a402f310 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:10.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.087+0000 7fa9b7fec740 1 --2- 172.21.15.7:0/3108797700 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559a719391b0 0x559a71d09be0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa99c009fa0 tx=0x7fa99c0118d0 comp rx=0 tx=0).stop 2024-09-21T06:44:10.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.088+0000 7fa9b7fec740 1 -- 172.21.15.7:0/3108797700 shutdown_connections 2024-09-21T06:44:10.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.088+0000 7fa9b7fec740 1 --2- 172.21.15.7:0/3108797700 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a71941390 0x559a71d0a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:10.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.088+0000 7fa9b7fec740 1 --2- 172.21.15.7:0/3108797700 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559a719391b0 0x559a71d09be0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:10.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.088+0000 7fa9b7fec740 1 --2- 172.21.15.7:0/3108797700 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a71962070 0x559a71d096a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:10.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.088+0000 7fa9b7fec740 1 -- 172.21.15.7:0/3108797700 >> 172.21.15.7:0/3108797700 conn(0x559a71956460 msgr2=0x559a71d07590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:10.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.088+0000 7fa9b7fec740 1 -- 172.21.15.7:0/3108797700 shutdown_connections 2024-09-21T06:44:10.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.088+0000 7fa9b7fec740 1 -- 172.21.15.7:0/3108797700 wait complete. 2024-09-21T06:44:10.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.088+0000 7fa9b7fec740 1 -- start start 2024-09-21T06:44:10.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.088+0000 7fa9b7fec740 1 Processor -- start 2024-09-21T06:44:10.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.089+0000 7fa9b7fec740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a719391b0 0x559a71d14d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:10.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.089+0000 7fa9b7fec740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a71941390 0x559a71d152a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:10.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.089+0000 7fa9b7fec740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559a71962070 0x559a71d21170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:10.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.089+0000 7fa9b7fec740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x559a71ad0700 con 0x559a71941390 2024-09-21T06:44:10.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.089+0000 7fa9b7fec740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559a71c0a160 con 0x559a71962070 2024-09-21T06:44:10.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.089+0000 7fa9b7fec740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x559a71d17e80 con 0x559a719391b0 2024-09-21T06:44:10.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.089+0000 7fa9b7fec740 10 client.0 _ll_register_callbacks cb 0x559a71c239e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:44:10.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.089+0000 7fa9a2ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a71941390 0x559a71d152a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:10.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.089+0000 7fa9a2ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a71941390 0x559a71d152a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58040/0 (socket says 172.21.15.7:58040) 2024-09-21T06:44:10.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.089+0000 7fa9a2ffd640 1 -- 172.21.15.7:0/3659320552 learned_addr learned my addr 172.21.15.7:0/3659320552 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:44:10.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.089+0000 7fa9ab7fe640 1 --2- 172.21.15.7:0/3659320552 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a719391b0 0x559a71d14d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:10.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.089+0000 7fa9abfff640 1 --2- 172.21.15.7:0/3659320552 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559a71962070 0x559a71d21170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:10.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.089+0000 7fa9a2ffd640 1 -- 172.21.15.7:0/3659320552 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a719391b0 msgr2=0x559a71d14d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:10.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.089+0000 7fa9a2ffd640 1 --2- 172.21.15.7:0/3659320552 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a719391b0 0x559a71d14d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:10.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.089+0000 7fa9a2ffd640 1 -- 172.21.15.7:0/3659320552 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559a71962070 msgr2=0x559a71d21170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:10.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.089+0000 7fa9a2ffd640 1 --2- 172.21.15.7:0/3659320552 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559a71962070 0x559a71d21170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:10.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.089+0000 7fa9a2ffd640 1 -- 172.21.15.7:0/3659320552 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a71c37c90 con 0x559a71941390 2024-09-21T06:44:10.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.089+0000 7fa9a2ffd640 1 --2- 172.21.15.7:0/3659320552 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a71941390 0x559a71d152a0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fa99400c6a0 tx=0x7fa9940eb200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb373912602ecaab server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:10.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.089+0000 7fa98affd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:44:10.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.089+0000 7fa98affd640 1 -- 172.21.15.7:0/3659320552 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9940a97f0 con 0x559a71941390 2024-09-21T06:44:10.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.089+0000 7fa98affd640 1 -- 172.21.15.7:0/3659320552 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8456+0+0 (secure 0 0 0) 0x7fa994005200 con 0x559a71941390 2024-09-21T06:44:10.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.089+0000 7fa9b7fec740 1 -- 172.21.15.7:0/3659320552 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa99c0054d0 con 0x559a71941390 2024-09-21T06:44:10.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.090+0000 7fa98affd640 1 -- 172.21.15.7:0/3659320552 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa9940ad0c0 con 0x559a71941390 2024-09-21T06:44:10.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.090+0000 7fa9b7fec740 10 client.17136 fetch_fsmap learned FSMap version 25 2024-09-21T06:44:10.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.090+0000 7fa9b7fec740 1 -- 172.21.15.7:0/3659320552 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559a71d23b30 con 0x559a71941390 2024-09-21T06:44:10.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.090+0000 7fa98affd640 1 -- 172.21.15.7:0/3659320552 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa99c0054d0 con 0x559a71941390 2024-09-21T06:44:10.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.090+0000 7fa98affd640 1 -- 172.21.15.7:0/3659320552 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa9940a92a0 con 0x559a71941390 2024-09-21T06:44:10.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.090+0000 7fa9b7fec740 10 client.17136 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:44:10.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.090+0000 7fa9b7fec740 10 client.17136 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:44:10.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.090+0000 7fa9b7fec740 20 client.17136 populate_metadata read hostname 'smithi007' 2024-09-21T06:44:10.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.090+0000 7fa9b7fec740 1 --2- 172.21.15.7:0/3659320552 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x559a719209f0 0x559a71d27000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:10.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.090+0000 7fa9b7fec740 4 client.17136 mds_command: new command op to 24688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:44:10.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.090+0000 7fa9b7fec740 1 -- 172.21.15.7:0/3659320552 --> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559a71c81df0 con 0x559a719209f0 2024-09-21T06:44:10.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.090+0000 7fa9ab7fe640 1 --2- 172.21.15.7:0/3659320552 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x559a719209f0 0x559a71d27000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:10.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.091+0000 7fa98affd640 10 client.17136 ms_handle_connect on v2:172.21.15.144:6838/4027821922 2024-09-21T06:44:10.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.091+0000 7fa9ab7fe640 1 --2- 172.21.15.7:0/3659320552 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x559a719209f0 0x559a71d27000 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6d0ded4d2676b75d server_cookie=ea28bf1f0997de49 in_seq=0 out_seq=0 2024-09-21T06:44:10.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.091+0000 7fa98affd640 1 -- 172.21.15.7:0/3659320552 <== mds.1 v2:172.21.15.144:6838/4027821922 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559a71c81df0 con 0x559a719209f0 2024-09-21T06:44:10.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.091+0000 7fa98affd640 10 client.17136 handle_command_reply: tid=0 2024-09-21T06:44:10.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.092+0000 7fa9b7fec740 1 client.17136 shutdown 2024-09-21T06:44:10.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.092+0000 7fa9b7fec740 1 -- 172.21.15.7:0/3659320552 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a71941390 msgr2=0x559a71d152a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:10.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.092+0000 7fa9b7fec740 1 --2- 172.21.15.7:0/3659320552 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a71941390 0x559a71d152a0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fa99400c6a0 tx=0x7fa9940eb200 comp rx=0 tx=0).stop 2024-09-21T06:44:10.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.092+0000 7fa9b7fec740 1 -- 172.21.15.7:0/3659320552 shutdown_connections 2024-09-21T06:44:10.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.092+0000 7fa9b7fec740 1 --2- 172.21.15.7:0/3659320552 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x559a719209f0 0x559a71d27000 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:10.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.092+0000 7fa9b7fec740 1 --2- 172.21.15.7:0/3659320552 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559a71962070 0x559a71d21170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:10.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.092+0000 7fa9b7fec740 1 --2- 172.21.15.7:0/3659320552 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a71941390 0x559a71d152a0 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:10.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.092+0000 7fa98affd640 0 client.17136 ms_handle_reset on v2:172.21.15.144:6838/4027821922 2024-09-21T06:44:10.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.092+0000 7fa9b7fec740 1 --2- 172.21.15.7:0/3659320552 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a719391b0 0x559a71d14d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:10.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.092+0000 7fa9b7fec740 1 -- 172.21.15.7:0/3659320552 >> 172.21.15.7:0/3659320552 conn(0x559a71956460 msgr2=0x559a71d0c880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:10.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.092+0000 7fa9b7fec740 1 -- 172.21.15.7:0/3659320552 shutdown_connections 2024-09-21T06:44:10.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.092+0000 7fa9b7fec740 1 -- 172.21.15.7:0/3659320552 wait complete. 2024-09-21T06:44:10.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.092+0000 7fa9b7fec740 20 client.17136 trim_cache size 0 max 16384 2024-09-21T06:44:10.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.105+0000 7fa9b7fec740 1 Processor -- start 2024-09-21T06:44:10.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.105+0000 7fa9b7fec740 1 -- start start 2024-09-21T06:44:10.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.106+0000 7fa9b7fec740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a719391b0 0x559a71d15220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:10.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.106+0000 7fa9b7fec740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a71941390 0x559a71d21070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:10.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.106+0000 7fa9b7fec740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559a71962070 0x559a71d11f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:10.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.106+0000 7fa9b7fec740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa9ac1b1ea0 con 0x559a719391b0 2024-09-21T06:44:10.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.106+0000 7fa9b7fec740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa9ac1af770 con 0x559a71962070 2024-09-21T06:44:10.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.106+0000 7fa9b7fec740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa9ac1ad5e0 con 0x559a71941390 2024-09-21T06:44:10.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.106+0000 7fa9ab7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a719391b0 0x559a71d15220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:10.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.106+0000 7fa9ab7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a719391b0 0x559a71d15220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58044/0 (socket says 172.21.15.7:58044) 2024-09-21T06:44:10.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.106+0000 7fa9ab7fe640 1 -- 172.21.15.7:0/804848972 learned_addr learned my addr 172.21.15.7:0/804848972 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:44:10.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.106+0000 7fa9abfff640 1 --2- 172.21.15.7:0/804848972 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559a71962070 0x559a71d11f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:10.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.106+0000 7fa9a2ffd640 1 --2- 172.21.15.7:0/804848972 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a71941390 0x559a71d21070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:10.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.106+0000 7fa9ab7fe640 1 -- 172.21.15.7:0/804848972 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a71941390 msgr2=0x559a71d21070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:10.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.106+0000 7fa9ab7fe640 1 --2- 172.21.15.7:0/804848972 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a71941390 0x559a71d21070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:10.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.106+0000 7fa9ab7fe640 1 -- 172.21.15.7:0/804848972 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559a71962070 msgr2=0x559a71d11f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:10.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.106+0000 7fa9ab7fe640 1 --2- 172.21.15.7:0/804848972 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559a71962070 0x559a71d11f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:10.109 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.106+0000 7fa9ab7fe640 1 -- 172.21.15.7:0/804848972 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a71d0b990 con 0x559a719391b0 2024-09-21T06:44:10.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.106+0000 7fa9abfff640 1 --2- 172.21.15.7:0/804848972 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559a71962070 0x559a71d11f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:44:10.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.106+0000 7fa9a2ffd640 1 --2- 172.21.15.7:0/804848972 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a71941390 0x559a71d21070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:44:10.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.106+0000 7fa9ab7fe640 1 --2- 172.21.15.7:0/804848972 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a719391b0 0x559a71d15220 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x559a71d08320 tx=0x7fa99c0041d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=384f3f3f544683ea server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:10.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.107+0000 7fa9a17fa640 1 -- 172.21.15.7:0/804848972 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa99c01d040 con 0x559a719391b0 2024-09-21T06:44:10.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.107+0000 7fa9a17fa640 1 -- 172.21.15.7:0/804848972 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa99c004340 con 0x559a719391b0 2024-09-21T06:44:10.110 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.107+0000 7fa9a17fa640 1 -- 172.21.15.7:0/804848972 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa99c003850 con 0x559a719391b0 2024-09-21T06:44:10.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.107+0000 7fa9b7fec740 1 -- 172.21.15.7:0/804848972 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a719391b0 msgr2=0x559a71d15220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:10.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.107+0000 7fa9b7fec740 1 --2- 172.21.15.7:0/804848972 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a719391b0 0x559a71d15220 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x559a71d08320 tx=0x7fa99c0041d0 comp rx=0 tx=0).stop 2024-09-21T06:44:10.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.107+0000 7fa9b7fec740 1 -- 172.21.15.7:0/804848972 shutdown_connections 2024-09-21T06:44:10.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.107+0000 7fa9b7fec740 1 --2- 172.21.15.7:0/804848972 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559a71962070 0x559a71d11f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:10.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.107+0000 7fa9b7fec740 1 --2- 172.21.15.7:0/804848972 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a71941390 0x559a71d21070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:10.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.107+0000 7fa9b7fec740 1 --2- 172.21.15.7:0/804848972 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a719391b0 0x559a71d15220 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:10.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.107+0000 7fa9b7fec740 1 -- 172.21.15.7:0/804848972 >> 172.21.15.7:0/804848972 conn(0x559a71956460 msgr2=0x559a71d14b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:10.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.107+0000 7fa9b7fec740 1 -- 172.21.15.7:0/804848972 shutdown_connections 2024-09-21T06:44:10.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.107+0000 7fa9b7fec740 1 -- 172.21.15.7:0/804848972 wait complete. 2024-09-21T06:44:10.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.108+0000 7fa9b7fec740 1 -- start start 2024-09-21T06:44:10.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.108+0000 7fa9b7fec740 1 Processor -- start 2024-09-21T06:44:10.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.108+0000 7fa9b7fec740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a719391b0 0x559a71d192b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:10.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.108+0000 7fa9b7fec740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a71941390 0x559a71d197f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:10.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.108+0000 7fa9b7fec740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559a71962070 0x559a71d19d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:10.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.109+0000 7fa9b7fec740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa9ac1adc30 con 0x559a719391b0 2024-09-21T06:44:10.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.109+0000 7fa9b7fec740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa9ac1af0a0 con 0x559a71962070 2024-09-21T06:44:10.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.109+0000 7fa9b7fec740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa9ac1ae300 con 0x559a71941390 2024-09-21T06:44:10.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.109+0000 7fa9b7fec740 10 client.0 _ll_register_callbacks cb 0x7fa99400e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:44:10.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.109+0000 7fa9ab7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a719391b0 0x559a71d192b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:10.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.109+0000 7fa9ab7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a719391b0 0x559a71d192b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:58058/0 (socket says 172.21.15.7:58058) 2024-09-21T06:44:10.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.109+0000 7fa9ab7fe640 1 -- 172.21.15.7:0/2781400708 learned_addr learned my addr 172.21.15.7:0/2781400708 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:44:10.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.109+0000 7fa9a2ffd640 1 --2- 172.21.15.7:0/2781400708 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a71941390 0x559a71d197f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:10.114 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.109+0000 7fa9abfff640 1 --2- 172.21.15.7:0/2781400708 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559a71962070 0x559a71d19d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:10.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.109+0000 7fa9ab7fe640 1 -- 172.21.15.7:0/2781400708 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a71941390 msgr2=0x559a71d197f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:10.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.109+0000 7fa9ab7fe640 1 --2- 172.21.15.7:0/2781400708 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a71941390 0x559a71d197f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:10.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.109+0000 7fa9ab7fe640 1 -- 172.21.15.7:0/2781400708 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559a71962070 msgr2=0x559a71d19d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:10.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.109+0000 7fa9ab7fe640 1 --2- 172.21.15.7:0/2781400708 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559a71962070 0x559a71d19d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:10.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.109+0000 7fa9ab7fe640 1 -- 172.21.15.7:0/2781400708 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a71d90b20 con 0x559a719391b0 2024-09-21T06:44:10.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.109+0000 7fa9abfff640 1 --2- 172.21.15.7:0/2781400708 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559a71962070 0x559a71d19d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:44:10.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.109+0000 7fa9ab7fe640 1 --2- 172.21.15.7:0/2781400708 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a719391b0 0x559a71d192b0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fa99c006010 tx=0x7fa99c011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f9db12bb540d7ee server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:10.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.109+0000 7fa98affd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:44:10.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.109+0000 7fa98affd640 1 -- 172.21.15.7:0/2781400708 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa99c036070 con 0x559a719391b0 2024-09-21T06:44:10.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.109+0000 7fa9b7fec740 1 -- 172.21.15.7:0/2781400708 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa99c004340 con 0x559a719391b0 2024-09-21T06:44:10.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.109+0000 7fa98affd640 1 -- 172.21.15.7:0/2781400708 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8456+0+0 (secure 0 0 0) 0x7fa99c00f720 con 0x559a719391b0 2024-09-21T06:44:10.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.110+0000 7fa98affd640 1 -- 172.21.15.7:0/2781400708 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa99c042050 con 0x559a719391b0 2024-09-21T06:44:10.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.110+0000 7fa9b7fec740 10 client.17142 fetch_fsmap learned FSMap version 25 2024-09-21T06:44:10.115 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.110+0000 7fa9b7fec740 1 -- 172.21.15.7:0/2781400708 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559a71d91c80 con 0x559a719391b0 2024-09-21T06:44:10.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.110+0000 7fa98affd640 1 -- 172.21.15.7:0/2781400708 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa99c004340 con 0x559a719391b0 2024-09-21T06:44:10.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.110+0000 7fa98affd640 1 -- 172.21.15.7:0/2781400708 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa99c019cd0 con 0x559a719391b0 2024-09-21T06:44:10.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.110+0000 7fa9b7fec740 10 client.17142 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:44:10.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.110+0000 7fa9b7fec740 10 client.17142 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:44:10.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.110+0000 7fa9b7fec740 20 client.17142 populate_metadata read hostname 'smithi007' 2024-09-21T06:44:10.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.110+0000 7fa9b7fec740 1 --2- 172.21.15.7:0/2781400708 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x559a718f5da0 0x559a71d94190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:10.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.110+0000 7fa9b7fec740 4 client.17142 mds_command: new command op to 24688 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:44:10.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.110+0000 7fa9b7fec740 1 -- 172.21.15.7:0/2781400708 --> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559a71c7d8a0 con 0x559a718f5da0 2024-09-21T06:44:10.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.111+0000 7fa9a2ffd640 1 --2- 172.21.15.7:0/2781400708 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x559a718f5da0 0x559a71d94190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:10.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.111+0000 7fa9a2ffd640 1 --2- 172.21.15.7:0/2781400708 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x559a718f5da0 0x559a71d94190 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b754933145c7aa0d server_cookie=a0fc9dbd4dc001f4 in_seq=0 out_seq=0 2024-09-21T06:44:10.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.111+0000 7fa98affd640 10 client.17142 ms_handle_connect on v2:172.21.15.144:6838/4027821922 2024-09-21T06:44:10.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.111+0000 7fa98affd640 1 -- 172.21.15.7:0/2781400708 <== mds.1 v2:172.21.15.144:6838/4027821922 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559a71c7d8a0 con 0x559a718f5da0 2024-09-21T06:44:10.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.111+0000 7fa98affd640 10 client.17142 handle_command_reply: tid=0 2024-09-21T06:44:10.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.111+0000 7fa9b7fec740 1 client.17142 shutdown 2024-09-21T06:44:10.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.112+0000 7fa9b7fec740 1 -- 172.21.15.7:0/2781400708 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a719391b0 msgr2=0x559a71d192b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:10.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.112+0000 7fa9b7fec740 1 --2- 172.21.15.7:0/2781400708 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a719391b0 0x559a71d192b0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fa99c006010 tx=0x7fa99c011e60 comp rx=0 tx=0).stop 2024-09-21T06:44:10.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.112+0000 7fa9b7fec740 1 -- 172.21.15.7:0/2781400708 shutdown_connections 2024-09-21T06:44:10.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.112+0000 7fa9b7fec740 1 --2- 172.21.15.7:0/2781400708 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x559a718f5da0 0x559a71d94190 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:10.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.112+0000 7fa9b7fec740 1 --2- 172.21.15.7:0/2781400708 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559a71962070 0x559a71d19d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:10.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.112+0000 7fa9b7fec740 1 --2- 172.21.15.7:0/2781400708 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a71941390 0x559a71d197f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:10.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.112+0000 7fa9b7fec740 1 --2- 172.21.15.7:0/2781400708 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a719391b0 0x559a71d192b0 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:10.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.112+0000 7fa9b7fec740 1 -- 172.21.15.7:0/2781400708 >> 172.21.15.7:0/2781400708 conn(0x559a71956460 msgr2=0x559a71d0a6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:10.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.112+0000 7fa98affd640 0 client.17142 ms_handle_reset on v2:172.21.15.144:6838/4027821922 2024-09-21T06:44:10.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.112+0000 7fa9b7fec740 1 -- 172.21.15.7:0/2781400708 shutdown_connections 2024-09-21T06:44:10.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.112+0000 7fa9b7fec740 1 -- 172.21.15.7:0/2781400708 wait complete. 2024-09-21T06:44:10.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.112+0000 7fa9b7fec740 20 client.17142 trim_cache size 0 max 16384 2024-09-21T06:44:10.119 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:44:10.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.112+0000 7fa9b1a78640 1 -- 172.21.15.7:0/50317123 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa9980b6680 msgr2=0x7fa9980b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:10.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.112+0000 7fa9b1a78640 1 --2- 172.21.15.7:0/50317123 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa9980b6680 0x7fa9980b8b90 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa9a402f500 tx=0x7fa9a402f310 comp rx=0 tx=0).stop 2024-09-21T06:44:10.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.112+0000 7fa9b1a78640 1 -- 172.21.15.7:0/50317123 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9ac1083a0 msgr2=0x7fa9ac19b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:10.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.112+0000 7fa9b1a78640 1 --2- 172.21.15.7:0/50317123 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9ac1083a0 0x7fa9ac19b750 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fa99400e9f0 tx=0x7fa99400eeb0 comp rx=0 tx=0).stop 2024-09-21T06:44:10.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.113+0000 7fa9b1a78640 1 -- 172.21.15.7:0/50317123 shutdown_connections 2024-09-21T06:44:10.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.113+0000 7fa9b1a78640 1 --2- 172.21.15.7:0/50317123 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa9980b6680 0x7fa9980b8b90 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:10.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.113+0000 7fa9b1a78640 1 --2- 172.21.15.7:0/50317123 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa9ac108cf0 0x7fa9ac19bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:10.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.113+0000 7fa9b1a78640 1 --2- 172.21.15.7:0/50317123 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9ac1083a0 0x7fa9ac19b750 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:10.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.113+0000 7fa9b1a78640 1 --2- 172.21.15.7:0/50317123 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9ac102a60 0x7fa9ac19b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:10.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.113+0000 7fa9b1a78640 1 -- 172.21.15.7:0/50317123 >> 172.21.15.7:0/50317123 conn(0x7fa9ac079730 msgr2=0x7fa9ac1043b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:10.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.113+0000 7fa9b1a78640 1 -- 172.21.15.7:0/50317123 shutdown_connections 2024-09-21T06:44:10.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:10.113+0000 7fa9b1a78640 1 -- 172.21.15.7:0/50317123 wait complete. 2024-09-21T06:44:10.980 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:44:11.246 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:44:11.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:44:10 smithi144 ceph-mon[34653]: pgmap v560: 97 pgs: 97 active+clean; 3.3 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-09-21T06:44:11.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:44:10 smithi144 ceph-mon[34653]: osdmap e80: 12 total, 12 up, 12 in 2024-09-21T06:44:11.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:44:10 smithi007 ceph-mon[30983]: pgmap v560: 97 pgs: 97 active+clean; 3.3 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-09-21T06:44:11.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:44:10 smithi007 ceph-mon[30983]: osdmap e80: 12 total, 12 up, 12 in 2024-09-21T06:44:11.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:44:10 smithi018 ceph-mon[34477]: pgmap v560: 97 pgs: 97 active+clean; 3.3 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 44 KiB/s wr, 25 op/s 2024-09-21T06:44:11.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:44:10 smithi018 ceph-mon[34477]: osdmap e80: 12 total, 12 up, 12 in 2024-09-21T06:44:11.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.748+0000 7fdf325c3640 1 -- 172.21.15.7:0/4249552967 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf2c1048c0 msgr2=0x7fdf2c104cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:11.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.748+0000 7fdf325c3640 1 --2- 172.21.15.7:0/4249552967 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf2c1048c0 0x7fdf2c104cd0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c009900 tx=0x7fdf1c02a410 comp rx=0 tx=0).stop 2024-09-21T06:44:11.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.748+0000 7fdf325c3640 1 -- 172.21.15.7:0/4249552967 shutdown_connections 2024-09-21T06:44:11.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.748+0000 7fdf325c3640 1 --2- 172.21.15.7:0/4249552967 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdf2c10de70 0x7fdf2c110340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:11.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.748+0000 7fdf325c3640 1 --2- 172.21.15.7:0/4249552967 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf2c1052a0 0x7fdf2c10d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:11.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.748+0000 7fdf325c3640 1 --2- 172.21.15.7:0/4249552967 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf2c1048c0 0x7fdf2c104cd0 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:11.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.748+0000 7fdf325c3640 1 -- 172.21.15.7:0/4249552967 >> 172.21.15.7:0/4249552967 conn(0x7fdf2c079760 msgr2=0x7fdf2c079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:11.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.748+0000 7fdf325c3640 1 -- 172.21.15.7:0/4249552967 shutdown_connections 2024-09-21T06:44:11.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.748+0000 7fdf325c3640 1 -- 172.21.15.7:0/4249552967 wait complete. 2024-09-21T06:44:11.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.749+0000 7fdf325c3640 1 Processor -- start 2024-09-21T06:44:11.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.749+0000 7fdf325c3640 1 -- start start 2024-09-21T06:44:11.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.749+0000 7fdf325c3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf2c1048c0 0x7fdf2c1027d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:11.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.749+0000 7fdf325c3640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf2c1052a0 0x7fdf2c102d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:11.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.749+0000 7fdf325c3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdf2c10de70 0x7fdf2c103250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:11.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.749+0000 7fdf325c3640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fdf2c113ab0 con 0x7fdf2c1048c0 2024-09-21T06:44:11.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.749+0000 7fdf325c3640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fdf2c113930 con 0x7fdf2c10de70 2024-09-21T06:44:11.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.749+0000 7fdf325c3640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fdf2c113c30 con 0x7fdf2c1052a0 2024-09-21T06:44:11.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.749+0000 7fdf2bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf2c1048c0 0x7fdf2c1027d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:11.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.749+0000 7fdf2bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf2c1048c0 0x7fdf2c1027d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36826/0 (socket says 172.21.15.7:36826) 2024-09-21T06:44:11.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.749+0000 7fdf2bfff640 1 -- 172.21.15.7:0/3753008015 learned_addr learned my addr 172.21.15.7:0/3753008015 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:44:11.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.750+0000 7fdf30b60640 1 --2- 172.21.15.7:0/3753008015 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdf2c10de70 0x7fdf2c103250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:11.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.750+0000 7fdf23fff640 1 --2- 172.21.15.7:0/3753008015 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf2c1052a0 0x7fdf2c102d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:11.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.750+0000 7fdf2bfff640 1 -- 172.21.15.7:0/3753008015 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf2c1052a0 msgr2=0x7fdf2c102d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:11.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.750+0000 7fdf2bfff640 1 --2- 172.21.15.7:0/3753008015 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf2c1052a0 0x7fdf2c102d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:11.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.750+0000 7fdf2bfff640 1 -- 172.21.15.7:0/3753008015 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdf2c10de70 msgr2=0x7fdf2c103250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:11.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.750+0000 7fdf2bfff640 1 --2- 172.21.15.7:0/3753008015 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdf2c10de70 0x7fdf2c103250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:11.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.750+0000 7fdf2bfff640 1 -- 172.21.15.7:0/3753008015 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf2c1a87a0 con 0x7fdf2c1048c0 2024-09-21T06:44:11.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.750+0000 7fdf2bfff640 1 --2- 172.21.15.7:0/3753008015 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf2c1048c0 0x7fdf2c1027d0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c006010 tx=0x7fdf1c004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:11.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.750+0000 7fdf29ffb640 1 -- 172.21.15.7:0/3753008015 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c03f030 con 0x7fdf2c1048c0 2024-09-21T06:44:11.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.750+0000 7fdf29ffb640 1 -- 172.21.15.7:0/3753008015 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdf1c003aa0 con 0x7fdf2c1048c0 2024-09-21T06:44:11.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.750+0000 7fdf325c3640 1 -- 172.21.15.7:0/3753008015 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf2c1a8a30 con 0x7fdf2c1048c0 2024-09-21T06:44:11.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.750+0000 7fdf29ffb640 1 -- 172.21.15.7:0/3753008015 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c035070 con 0x7fdf2c1048c0 2024-09-21T06:44:11.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.750+0000 7fdf325c3640 1 -- 172.21.15.7:0/3753008015 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf2c1a8f10 con 0x7fdf2c1048c0 2024-09-21T06:44:11.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.753+0000 7fdf38b37740 1 Processor -- start 2024-09-21T06:44:11.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.753+0000 7fdf38b37740 1 -- start start 2024-09-21T06:44:11.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.753+0000 7fdf29ffb640 1 -- 172.21.15.7:0/3753008015 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7fdf1c042030 con 0x7fdf2c1048c0 2024-09-21T06:44:11.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.753+0000 7fdf38b37740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55798f912070 0x55798fcb92c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:11.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.753+0000 7fdf38b37740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55798f8e91b0 0x55798fcb9800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:11.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.753+0000 7fdf38b37740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55798f8f1390 0x55798fcb9d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:11.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.753+0000 7fdf38b37740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55798fc2fea0 con 0x55798f8e91b0 2024-09-21T06:44:11.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.753+0000 7fdf38b37740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55798fc1f2d0 con 0x55798f8f1390 2024-09-21T06:44:11.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.753+0000 7fdf38b37740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55798fc230e0 con 0x55798f912070 2024-09-21T06:44:11.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.753+0000 7fdf2bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55798f8e91b0 0x55798fcb9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:11.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.753+0000 7fdf2bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55798f8e91b0 0x55798fcb9800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36838/0 (socket says 172.21.15.7:36838) 2024-09-21T06:44:11.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.753+0000 7fdf2bfff640 1 -- 172.21.15.7:0/3275008749 learned_addr learned my addr 172.21.15.7:0/3275008749 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:44:11.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.753+0000 7fdf23fff640 1 --2- 172.21.15.7:0/3275008749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55798f8f1390 0x55798fcb9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:11.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.754+0000 7fdf30b60640 1 --2- 172.21.15.7:0/3275008749 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55798f912070 0x55798fcb92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:11.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.754+0000 7fdf2bfff640 1 -- 172.21.15.7:0/3275008749 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55798f912070 msgr2=0x55798fcb92c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:11.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.754+0000 7fdf2bfff640 1 --2- 172.21.15.7:0/3275008749 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55798f912070 0x55798fcb92c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:11.761 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.754+0000 7fdf2bfff640 1 -- 172.21.15.7:0/3275008749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55798f8f1390 msgr2=0x55798fcb9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:11.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.754+0000 7fdf2bfff640 1 --2- 172.21.15.7:0/3275008749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55798f8f1390 0x55798fcb9d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:11.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.754+0000 7fdf2bfff640 1 -- 172.21.15.7:0/3275008749 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55798f97d650 con 0x55798f8e91b0 2024-09-21T06:44:11.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.754+0000 7fdf2bfff640 1 --2- 172.21.15.7:0/3275008749 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55798f8e91b0 0x55798fcb9800 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c105250 tx=0x7fdf1c10be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ab4e7852ac65544 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:11.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.754+0000 7fdf227fc640 1 -- 172.21.15.7:0/3275008749 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c117020 con 0x55798f8e91b0 2024-09-21T06:44:11.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.754+0000 7fdf227fc640 1 -- 172.21.15.7:0/3275008749 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdf1c110e00 con 0x55798f8e91b0 2024-09-21T06:44:11.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.754+0000 7fdf227fc640 1 -- 172.21.15.7:0/3275008749 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c1123a0 con 0x55798f8e91b0 2024-09-21T06:44:11.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.754+0000 7fdf29ffb640 1 --2- 172.21.15.7:0/3753008015 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fdf180b6680 0x7fdf180b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:11.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.755+0000 7fdf30b60640 1 --2- 172.21.15.7:0/3753008015 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fdf180b6680 0x7fdf180b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:11.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.755+0000 7fdf29ffb640 1 -- 172.21.15.7:0/3753008015 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8456+0+0 (secure 0 0 0) 0x7fdf1c107b50 con 0x7fdf2c1048c0 2024-09-21T06:44:11.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.755+0000 7fdf38b37740 1 -- 172.21.15.7:0/3275008749 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55798f8e91b0 msgr2=0x55798fcb9800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:11.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.755+0000 7fdf30b60640 1 --2- 172.21.15.7:0/3753008015 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fdf180b6680 0x7fdf180b8b90 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fdf24005fd0 tx=0x7fdf24009500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:11.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.755+0000 7fdf38b37740 1 --2- 172.21.15.7:0/3275008749 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55798f8e91b0 0x55798fcb9800 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c105250 tx=0x7fdf1c10be20 comp rx=0 tx=0).stop 2024-09-21T06:44:11.762 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.755+0000 7fdf38b37740 1 -- 172.21.15.7:0/3275008749 shutdown_connections 2024-09-21T06:44:11.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.755+0000 7fdf38b37740 1 --2- 172.21.15.7:0/3275008749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55798f8f1390 0x55798fcb9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:11.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.755+0000 7fdf38b37740 1 --2- 172.21.15.7:0/3275008749 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55798f8e91b0 0x55798fcb9800 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:11.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.755+0000 7fdf38b37740 1 --2- 172.21.15.7:0/3275008749 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55798f912070 0x55798fcb92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:11.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.755+0000 7fdf38b37740 1 -- 172.21.15.7:0/3275008749 >> 172.21.15.7:0/3275008749 conn(0x55798f906460 msgr2=0x55798fcb71b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:11.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.755+0000 7fdf38b37740 1 -- 172.21.15.7:0/3275008749 shutdown_connections 2024-09-21T06:44:11.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.755+0000 7fdf38b37740 1 -- 172.21.15.7:0/3275008749 wait complete. 2024-09-21T06:44:11.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.756+0000 7fdf38b37740 1 -- start start 2024-09-21T06:44:11.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.756+0000 7fdf38b37740 1 Processor -- start 2024-09-21T06:44:11.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.757+0000 7fdf38b37740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55798f8e91b0 0x55798fcc49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:11.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.757+0000 7fdf38b37740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55798f8f1390 0x55798fcc4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:11.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.757+0000 7fdf38b37740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55798f912070 0x55798fcd0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:11.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.757+0000 7fdf38b37740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55798fa80700 con 0x55798f8f1390 2024-09-21T06:44:11.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.757+0000 7fdf38b37740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55798fbba160 con 0x55798f912070 2024-09-21T06:44:11.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.757+0000 7fdf38b37740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55798fcc7860 con 0x55798f8e91b0 2024-09-21T06:44:11.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.757+0000 7fdf38b37740 10 client.0 _ll_register_callbacks cb 0x55798fbd39e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:44:11.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.757+0000 7fdf23fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55798f8f1390 0x55798fcc4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:11.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.757+0000 7fdf2bfff640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55798f8e91b0 0x55798fcc49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:11.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.757+0000 7fdf2bfff640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55798f8e91b0 0x55798fcc49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.7:57184/0 (socket says 172.21.15.7:57184) 2024-09-21T06:44:11.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.757+0000 7fdf23fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55798f8f1390 0x55798fcc4ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36846/0 (socket says 172.21.15.7:36846) 2024-09-21T06:44:11.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.757+0000 7fdf2bfff640 1 -- 172.21.15.7:0/2677209876 learned_addr learned my addr 172.21.15.7:0/2677209876 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:44:11.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.757+0000 7fdf30b60640 1 --2- 172.21.15.7:0/2677209876 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55798f912070 0x55798fcd0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:11.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.757+0000 7fdf23fff640 1 -- 172.21.15.7:0/2677209876 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55798f8e91b0 msgr2=0x55798fcc49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:11.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.757+0000 7fdf23fff640 1 --2- 172.21.15.7:0/2677209876 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55798f8e91b0 0x55798fcc49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:11.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.757+0000 7fdf23fff640 1 -- 172.21.15.7:0/2677209876 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55798f912070 msgr2=0x55798fcd0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:11.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.757+0000 7fdf23fff640 1 --2- 172.21.15.7:0/2677209876 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55798f912070 0x55798fcd0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:11.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.757+0000 7fdf23fff640 1 -- 172.21.15.7:0/2677209876 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55798fbe7c90 con 0x55798f8f1390 2024-09-21T06:44:11.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.757+0000 7fdf30b60640 1 --2- 172.21.15.7:0/2677209876 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55798f912070 0x55798fcd0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:44:11.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.757+0000 7fdf23fff640 1 --2- 172.21.15.7:0/2677209876 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55798f8f1390 0x55798fcc4ee0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fdf14005fd0 tx=0x7fdf14012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71b451b223ef7054 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:11.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.757+0000 7fdf0b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:44:11.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.758+0000 7fdf0b7fe640 1 -- 172.21.15.7:0/2677209876 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf14005020 con 0x55798f8f1390 2024-09-21T06:44:11.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.758+0000 7fdf38b37740 1 -- 172.21.15.7:0/2677209876 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdf1c110e00 con 0x55798f8f1390 2024-09-21T06:44:11.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.758+0000 7fdf0b7fe640 1 -- 172.21.15.7:0/2677209876 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8456+0+0 (secure 0 0 0) 0x7fdf140051c0 con 0x55798f8f1390 2024-09-21T06:44:11.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.758+0000 7fdf0b7fe640 1 -- 172.21.15.7:0/2677209876 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fdf140053c0 con 0x55798f8f1390 2024-09-21T06:44:11.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.758+0000 7fdf38b37740 10 client.17154 fetch_fsmap learned FSMap version 25 2024-09-21T06:44:11.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.758+0000 7fdf38b37740 1 -- 172.21.15.7:0/2677209876 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55798fcd3500 con 0x55798f8f1390 2024-09-21T06:44:11.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.758+0000 7fdf0b7fe640 1 -- 172.21.15.7:0/2677209876 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdf1c110e00 con 0x55798f8f1390 2024-09-21T06:44:11.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.758+0000 7fdf0b7fe640 1 -- 172.21.15.7:0/2677209876 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fdf14019030 con 0x55798f8f1390 2024-09-21T06:44:11.768 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.758+0000 7fdf38b37740 10 client.17154 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:44:11.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.758+0000 7fdf38b37740 10 client.17154 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:44:11.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.758+0000 7fdf38b37740 20 client.17154 populate_metadata read hostname 'smithi007' 2024-09-21T06:44:11.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.758+0000 7fdf38b37740 1 --2- 172.21.15.7:0/2677209876 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55798f8d09f0 0x55798fcd6a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:11.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.758+0000 7fdf38b37740 4 client.17154 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:44:11.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.758+0000 7fdf38b37740 1 -- 172.21.15.7:0/2677209876 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55798fc31df0 con 0x55798f8d09f0 2024-09-21T06:44:11.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.759+0000 7fdf2bfff640 1 --2- 172.21.15.7:0/2677209876 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55798f8d09f0 0x55798fcd6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:11.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.759+0000 7fdf0b7fe640 10 client.17154 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:44:11.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.759+0000 7fdf2bfff640 1 --2- 172.21.15.7:0/2677209876 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55798f8d09f0 0x55798fcd6a50 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91e5c3f4bfb36505 server_cookie=8684a86f448bd29c in_seq=0 out_seq=0 2024-09-21T06:44:11.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.760+0000 7fdf0b7fe640 1 -- 172.21.15.7:0/2677209876 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55798fc31df0 con 0x55798f8d09f0 2024-09-21T06:44:11.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.760+0000 7fdf0b7fe640 10 client.17154 handle_command_reply: tid=0 2024-09-21T06:44:11.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.760+0000 7fdf38b37740 1 client.17154 shutdown 2024-09-21T06:44:11.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.760+0000 7fdf38b37740 1 -- 172.21.15.7:0/2677209876 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55798f8f1390 msgr2=0x55798fcc4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:11.769 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.760+0000 7fdf38b37740 1 --2- 172.21.15.7:0/2677209876 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55798f8f1390 0x55798fcc4ee0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fdf14005fd0 tx=0x7fdf14012820 comp rx=0 tx=0).stop 2024-09-21T06:44:11.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.760+0000 7fdf38b37740 1 -- 172.21.15.7:0/2677209876 shutdown_connections 2024-09-21T06:44:11.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.760+0000 7fdf38b37740 1 --2- 172.21.15.7:0/2677209876 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55798f8d09f0 0x55798fcd6a50 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:11.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.760+0000 7fdf38b37740 1 --2- 172.21.15.7:0/2677209876 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55798f912070 0x55798fcd0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:11.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.760+0000 7fdf38b37740 1 --2- 172.21.15.7:0/2677209876 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55798f8f1390 0x55798fcc4ee0 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:11.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.760+0000 7fdf38b37740 1 --2- 172.21.15.7:0/2677209876 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55798f8e91b0 0x55798fcc49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:11.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.760+0000 7fdf38b37740 1 -- 172.21.15.7:0/2677209876 >> 172.21.15.7:0/2677209876 conn(0x55798f906460 msgr2=0x55798fcbc450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:11.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.760+0000 7fdf0b7fe640 0 client.17154 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:44:11.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.760+0000 7fdf38b37740 1 -- 172.21.15.7:0/2677209876 shutdown_connections 2024-09-21T06:44:11.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.760+0000 7fdf38b37740 1 -- 172.21.15.7:0/2677209876 wait complete. 2024-09-21T06:44:11.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.760+0000 7fdf38b37740 20 client.17154 trim_cache size 0 max 16384 2024-09-21T06:44:11.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.774+0000 7fdf38b37740 1 Processor -- start 2024-09-21T06:44:11.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.774+0000 7fdf38b37740 1 -- start start 2024-09-21T06:44:11.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.774+0000 7fdf38b37740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55798f8e91b0 0x55798fcd0980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:11.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.774+0000 7fdf38b37740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55798f8f1390 0x55798fcc1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:11.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.774+0000 7fdf38b37740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55798f912070 0x55798fcc20d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:11.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.774+0000 7fdf38b37740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fdf2c1b41a0 con 0x55798f8f1390 2024-09-21T06:44:11.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.774+0000 7fdf38b37740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fdf2c1b1a70 con 0x55798f912070 2024-09-21T06:44:11.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.774+0000 7fdf38b37740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fdf2c1af8e0 con 0x55798f8e91b0 2024-09-21T06:44:11.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.774+0000 7fdf23fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55798f8f1390 0x55798fcc1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:11.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.774+0000 7fdf23fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55798f8f1390 0x55798fcc1b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36862/0 (socket says 172.21.15.7:36862) 2024-09-21T06:44:11.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.774+0000 7fdf23fff640 1 -- 172.21.15.7:0/1346571922 learned_addr learned my addr 172.21.15.7:0/1346571922 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:44:11.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.774+0000 7fdf30b60640 1 --2- 172.21.15.7:0/1346571922 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55798f912070 0x55798fcc20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:11.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.774+0000 7fdf2bfff640 1 --2- 172.21.15.7:0/1346571922 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55798f8e91b0 0x55798fcd0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:11.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.774+0000 7fdf23fff640 1 -- 172.21.15.7:0/1346571922 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55798f8e91b0 msgr2=0x55798fcd0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:11.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.774+0000 7fdf23fff640 1 --2- 172.21.15.7:0/1346571922 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55798f8e91b0 0x55798fcd0980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:11.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.774+0000 7fdf23fff640 1 -- 172.21.15.7:0/1346571922 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55798f912070 msgr2=0x55798fcc20d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:11.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.774+0000 7fdf23fff640 1 --2- 172.21.15.7:0/1346571922 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55798f912070 0x55798fcc20d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:11.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.774+0000 7fdf23fff640 1 -- 172.21.15.7:0/1346571922 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55798fcc70e0 con 0x55798f8f1390 2024-09-21T06:44:11.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.775+0000 7fdf23fff640 1 --2- 172.21.15.7:0/1346571922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55798f8f1390 0x55798fcc1b90 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fdf1400daa0 tx=0x7fdf14003e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e6f85f3fdca4e0e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:11.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.775+0000 7fdf21ffb640 1 -- 172.21.15.7:0/1346571922 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf14027040 con 0x55798f8f1390 2024-09-21T06:44:11.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.775+0000 7fdf21ffb640 1 -- 172.21.15.7:0/1346571922 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdf14004300 con 0x55798f8f1390 2024-09-21T06:44:11.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.775+0000 7fdf21ffb640 1 -- 172.21.15.7:0/1346571922 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf14010c30 con 0x55798f8f1390 2024-09-21T06:44:11.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.776+0000 7fdf38b37740 1 -- 172.21.15.7:0/1346571922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55798f8f1390 msgr2=0x55798fcc1b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:11.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.776+0000 7fdf38b37740 1 --2- 172.21.15.7:0/1346571922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55798f8f1390 0x55798fcc1b90 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fdf1400daa0 tx=0x7fdf14003e20 comp rx=0 tx=0).stop 2024-09-21T06:44:11.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.776+0000 7fdf38b37740 1 -- 172.21.15.7:0/1346571922 shutdown_connections 2024-09-21T06:44:11.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.776+0000 7fdf38b37740 1 --2- 172.21.15.7:0/1346571922 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55798f912070 0x55798fcc20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:11.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.776+0000 7fdf38b37740 1 --2- 172.21.15.7:0/1346571922 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55798f8f1390 0x55798fcc1b90 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:11.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.776+0000 7fdf38b37740 1 --2- 172.21.15.7:0/1346571922 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55798f8e91b0 0x55798fcd0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:11.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.776+0000 7fdf38b37740 1 -- 172.21.15.7:0/1346571922 >> 172.21.15.7:0/1346571922 conn(0x55798f906460 msgr2=0x55798fcc3220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:11.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.776+0000 7fdf38b37740 1 -- 172.21.15.7:0/1346571922 shutdown_connections 2024-09-21T06:44:11.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.776+0000 7fdf38b37740 1 -- 172.21.15.7:0/1346571922 wait complete. 2024-09-21T06:44:11.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.776+0000 7fdf38b37740 1 -- start start 2024-09-21T06:44:11.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.776+0000 7fdf38b37740 1 Processor -- start 2024-09-21T06:44:11.781 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.777+0000 7fdf38b37740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55798f8e91b0 0x55798fcc8d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:11.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.777+0000 7fdf38b37740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55798f8f1390 0x55798fcc92c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:11.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.777+0000 7fdf38b37740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55798f912070 0x55798fd40430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:11.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.777+0000 7fdf38b37740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fdf2c1aff30 con 0x55798f8f1390 2024-09-21T06:44:11.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.777+0000 7fdf38b37740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fdf2c1b13a0 con 0x55798f8e91b0 2024-09-21T06:44:11.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.777+0000 7fdf38b37740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fdf2c1b0600 con 0x55798f912070 2024-09-21T06:44:11.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.777+0000 7fdf38b37740 10 client.0 _ll_register_callbacks cb 0x7fdf1400d8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:44:11.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.777+0000 7fdf23fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55798f8f1390 0x55798fcc92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:11.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.777+0000 7fdf2bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55798f8e91b0 0x55798fcc8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:11.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.777+0000 7fdf23fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55798f8f1390 0x55798fcc92c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36866/0 (socket says 172.21.15.7:36866) 2024-09-21T06:44:11.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.777+0000 7fdf23fff640 1 -- 172.21.15.7:0/3586161568 learned_addr learned my addr 172.21.15.7:0/3586161568 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:44:11.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.777+0000 7fdf30b60640 1 --2- 172.21.15.7:0/3586161568 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55798f912070 0x55798fd40430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:11.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.777+0000 7fdf23fff640 1 -- 172.21.15.7:0/3586161568 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55798f912070 msgr2=0x55798fd40430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:11.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.777+0000 7fdf23fff640 1 --2- 172.21.15.7:0/3586161568 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55798f912070 0x55798fd40430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:11.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.777+0000 7fdf23fff640 1 -- 172.21.15.7:0/3586161568 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55798f8e91b0 msgr2=0x55798fcc8d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:11.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.777+0000 7fdf23fff640 1 --2- 172.21.15.7:0/3586161568 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55798f8e91b0 0x55798fcc8d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:11.783 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.777+0000 7fdf23fff640 1 -- 172.21.15.7:0/3586161568 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55798fd40970 con 0x55798f8f1390 2024-09-21T06:44:11.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.777+0000 7fdf2bfff640 1 --2- 172.21.15.7:0/3586161568 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55798f8e91b0 0x55798fcc8d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:44:11.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.778+0000 7fdf23fff640 1 --2- 172.21.15.7:0/3586161568 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55798f8f1390 0x55798fcc92c0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fdf140039d0 tx=0x7fdf140044b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f129e0d7a42d0e4d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:11.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.778+0000 7fdf0b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:44:11.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.778+0000 7fdf0b7fe640 1 -- 172.21.15.7:0/3586161568 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf14027040 con 0x55798f8f1390 2024-09-21T06:44:11.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.778+0000 7fdf0b7fe640 1 -- 172.21.15.7:0/3586161568 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8456+0+0 (secure 0 0 0) 0x7fdf140108a0 con 0x55798f8f1390 2024-09-21T06:44:11.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.778+0000 7fdf38b37740 1 -- 172.21.15.7:0/3586161568 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdf14004300 con 0x55798f8f1390 2024-09-21T06:44:11.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.778+0000 7fdf0b7fe640 1 -- 172.21.15.7:0/3586161568 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fdf14043050 con 0x55798f8f1390 2024-09-21T06:44:11.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.778+0000 7fdf38b37740 10 client.17160 fetch_fsmap learned FSMap version 25 2024-09-21T06:44:11.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.778+0000 7fdf38b37740 1 -- 172.21.15.7:0/3586161568 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55798fd41a90 con 0x55798f8f1390 2024-09-21T06:44:11.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.778+0000 7fdf0b7fe640 1 -- 172.21.15.7:0/3586161568 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdf14004300 con 0x55798f8f1390 2024-09-21T06:44:11.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.778+0000 7fdf0b7fe640 1 -- 172.21.15.7:0/3586161568 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fdf1402a070 con 0x55798f8f1390 2024-09-21T06:44:11.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.779+0000 7fdf38b37740 10 client.17160 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:44:11.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.779+0000 7fdf38b37740 10 client.17160 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:44:11.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.779+0000 7fdf38b37740 20 client.17160 populate_metadata read hostname 'smithi007' 2024-09-21T06:44:11.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.779+0000 7fdf38b37740 1 --2- 172.21.15.7:0/3586161568 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55798f8a5da0 0x55798fd44150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:11.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.779+0000 7fdf38b37740 4 client.17160 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:44:11.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.779+0000 7fdf38b37740 1 -- 172.21.15.7:0/3586161568 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55798fc2d8a0 con 0x55798f8a5da0 2024-09-21T06:44:11.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.779+0000 7fdf2bfff640 1 --2- 172.21.15.7:0/3586161568 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55798f8a5da0 0x55798fd44150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:11.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.779+0000 7fdf2bfff640 1 --2- 172.21.15.7:0/3586161568 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55798f8a5da0 0x55798fd44150 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=119f9459c10e15f server_cookie=535c9cc27cfe33d4 in_seq=0 out_seq=0 2024-09-21T06:44:11.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.779+0000 7fdf0b7fe640 10 client.17160 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:44:11.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.779+0000 7fdf0b7fe640 1 -- 172.21.15.7:0/3586161568 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55798fc2d8a0 con 0x55798f8a5da0 2024-09-21T06:44:11.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.779+0000 7fdf0b7fe640 10 client.17160 handle_command_reply: tid=0 2024-09-21T06:44:11.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.780+0000 7fdf38b37740 1 client.17160 shutdown 2024-09-21T06:44:11.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.780+0000 7fdf38b37740 1 -- 172.21.15.7:0/3586161568 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55798f8f1390 msgr2=0x55798fcc92c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:11.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.780+0000 7fdf38b37740 1 --2- 172.21.15.7:0/3586161568 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55798f8f1390 0x55798fcc92c0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fdf140039d0 tx=0x7fdf140044b0 comp rx=0 tx=0).stop 2024-09-21T06:44:11.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.780+0000 7fdf38b37740 1 -- 172.21.15.7:0/3586161568 shutdown_connections 2024-09-21T06:44:11.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.780+0000 7fdf38b37740 1 --2- 172.21.15.7:0/3586161568 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55798f8a5da0 0x55798fd44150 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:11.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.780+0000 7fdf38b37740 1 --2- 172.21.15.7:0/3586161568 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55798f912070 0x55798fd40430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:11.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.780+0000 7fdf38b37740 1 --2- 172.21.15.7:0/3586161568 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55798f8f1390 0x55798fcc92c0 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:11.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.780+0000 7fdf38b37740 1 --2- 172.21.15.7:0/3586161568 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55798f8e91b0 0x55798fcc8d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:11.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.780+0000 7fdf38b37740 1 -- 172.21.15.7:0/3586161568 >> 172.21.15.7:0/3586161568 conn(0x55798f906460 msgr2=0x55798fcba2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:11.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.780+0000 7fdf0b7fe640 0 client.17160 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:44:11.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.780+0000 7fdf38b37740 1 -- 172.21.15.7:0/3586161568 shutdown_connections 2024-09-21T06:44:11.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.780+0000 7fdf38b37740 1 -- 172.21.15.7:0/3586161568 wait complete. 2024-09-21T06:44:11.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.780+0000 7fdf38b37740 20 client.17160 trim_cache size 0 max 16384 2024-09-21T06:44:11.789 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:44:11.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.781+0000 7fdf325c3640 1 -- 172.21.15.7:0/3753008015 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fdf180b6680 msgr2=0x7fdf180b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:11.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.781+0000 7fdf325c3640 1 --2- 172.21.15.7:0/3753008015 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fdf180b6680 0x7fdf180b8b90 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fdf24005fd0 tx=0x7fdf24009500 comp rx=0 tx=0).stop 2024-09-21T06:44:11.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.781+0000 7fdf325c3640 1 -- 172.21.15.7:0/3753008015 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf2c1048c0 msgr2=0x7fdf2c1027d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:11.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.781+0000 7fdf325c3640 1 --2- 172.21.15.7:0/3753008015 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf2c1048c0 0x7fdf2c1027d0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c006010 tx=0x7fdf1c004060 comp rx=0 tx=0).stop 2024-09-21T06:44:11.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.781+0000 7fdf325c3640 1 -- 172.21.15.7:0/3753008015 shutdown_connections 2024-09-21T06:44:11.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.781+0000 7fdf325c3640 1 --2- 172.21.15.7:0/3753008015 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fdf180b6680 0x7fdf180b8b90 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:11.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.781+0000 7fdf325c3640 1 --2- 172.21.15.7:0/3753008015 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdf2c10de70 0x7fdf2c103250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:11.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.781+0000 7fdf325c3640 1 --2- 172.21.15.7:0/3753008015 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fdf2c1052a0 0x7fdf2c102d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:11.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.781+0000 7fdf325c3640 1 --2- 172.21.15.7:0/3753008015 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fdf2c1048c0 0x7fdf2c1027d0 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:11.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.781+0000 7fdf325c3640 1 -- 172.21.15.7:0/3753008015 >> 172.21.15.7:0/3753008015 conn(0x7fdf2c079760 msgr2=0x7fdf2c100890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:11.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.781+0000 7fdf325c3640 1 -- 172.21.15.7:0/3753008015 shutdown_connections 2024-09-21T06:44:11.790 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:11.781+0000 7fdf325c3640 1 -- 172.21.15.7:0/3753008015 wait complete. 2024-09-21T06:44:13.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:44:12 smithi144 ceph-mon[34653]: pgmap v562: 97 pgs: 97 active+clean; 3.3 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-09-21T06:44:13.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:44:12 smithi007 ceph-mon[30983]: pgmap v562: 97 pgs: 97 active+clean; 3.3 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-09-21T06:44:13.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:44:12 smithi018 ceph-mon[34477]: pgmap v562: 97 pgs: 97 active+clean; 3.3 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-09-21T06:44:13.605 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:44:13.605 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:44:13.878 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:44:14.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.387+0000 7ff6ddbeb640 1 -- 172.21.15.7:0/585203594 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff6d8108d20 msgr2=0x7ff6d810f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:14.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.387+0000 7ff6ddbeb640 1 --2- 172.21.15.7:0/585203594 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff6d8108d20 0x7ff6d810f550 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7ff6d0009ca0 tx=0x7ff6d002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:44:14.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.387+0000 7ff6ddbeb640 1 -- 172.21.15.7:0/585203594 shutdown_connections 2024-09-21T06:44:14.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.388+0000 7ff6ddbeb640 1 --2- 172.21.15.7:0/585203594 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff6d8108d20 0x7ff6d810f550 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:14.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.388+0000 7ff6ddbeb640 1 --2- 172.21.15.7:0/585203594 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff6d81083d0 0x7ff6d81087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:14.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.388+0000 7ff6ddbeb640 1 --2- 172.21.15.7:0/585203594 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6d8102ae0 0x7ff6d8102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:14.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.388+0000 7ff6ddbeb640 1 -- 172.21.15.7:0/585203594 >> 172.21.15.7:0/585203594 conn(0x7ff6d8079760 msgr2=0x7ff6d8079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:14.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.388+0000 7ff6ddbeb640 1 -- 172.21.15.7:0/585203594 shutdown_connections 2024-09-21T06:44:14.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.388+0000 7ff6ddbeb640 1 -- 172.21.15.7:0/585203594 wait complete. 2024-09-21T06:44:14.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.388+0000 7ff6ddbeb640 1 Processor -- start 2024-09-21T06:44:14.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.388+0000 7ff6ddbeb640 1 -- start start 2024-09-21T06:44:14.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.389+0000 7ff6ddbeb640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6d8102ae0 0x7ff6d8199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:14.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.389+0000 7ff6ddbeb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff6d81083d0 0x7ff6d81998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:14.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.389+0000 7ff6ddbeb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff6d8108d20 0x7ff6d819eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:14.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.389+0000 7ff6ddbeb640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff6d81129e0 con 0x7ff6d8108d20 2024-09-21T06:44:14.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.389+0000 7ff6ddbeb640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff6d8112860 con 0x7ff6d81083d0 2024-09-21T06:44:14.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.389+0000 7ff6ddbeb640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff6d8112b60 con 0x7ff6d8102ae0 2024-09-21T06:44:14.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.389+0000 7ff6d7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff6d8108d20 0x7ff6d819eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:14.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.389+0000 7ff6d7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff6d8108d20 0x7ff6d819eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36876/0 (socket says 172.21.15.7:36876) 2024-09-21T06:44:14.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.389+0000 7ff6d7fff640 1 -- 172.21.15.7:0/1937995045 learned_addr learned my addr 172.21.15.7:0/1937995045 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:44:14.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.389+0000 7ff6d77fe640 1 --2- 172.21.15.7:0/1937995045 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6d8102ae0 0x7ff6d8199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:14.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.389+0000 7ff6ceffd640 1 --2- 172.21.15.7:0/1937995045 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff6d81083d0 0x7ff6d81998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:14.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.389+0000 7ff6d7fff640 1 -- 172.21.15.7:0/1937995045 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6d8102ae0 msgr2=0x7ff6d8199330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:14.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.389+0000 7ff6d7fff640 1 --2- 172.21.15.7:0/1937995045 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6d8102ae0 0x7ff6d8199330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:14.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.389+0000 7ff6d7fff640 1 -- 172.21.15.7:0/1937995045 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff6d81083d0 msgr2=0x7ff6d81998d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:14.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.389+0000 7ff6d7fff640 1 --2- 172.21.15.7:0/1937995045 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff6d81083d0 0x7ff6d81998d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:14.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.389+0000 7ff6d7fff640 1 -- 172.21.15.7:0/1937995045 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6d819f1e0 con 0x7ff6d8108d20 2024-09-21T06:44:14.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.389+0000 7ff6d7fff640 1 --2- 172.21.15.7:0/1937995045 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff6d8108d20 0x7ff6d819eb70 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7ff6d0009430 tx=0x7ff6d00319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:14.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.390+0000 7ff6d57fa640 1 -- 172.21.15.7:0/1937995045 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d004a070 con 0x7ff6d8108d20 2024-09-21T06:44:14.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.390+0000 7ff6d57fa640 1 -- 172.21.15.7:0/1937995045 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff6d0003b80 con 0x7ff6d8108d20 2024-09-21T06:44:14.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.390+0000 7ff6ddbeb640 1 -- 172.21.15.7:0/1937995045 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6d819f470 con 0x7ff6d8108d20 2024-09-21T06:44:14.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.390+0000 7ff6d57fa640 1 -- 172.21.15.7:0/1937995045 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d002f870 con 0x7ff6d8108d20 2024-09-21T06:44:14.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.390+0000 7ff6ddbeb640 1 -- 172.21.15.7:0/1937995045 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6d819f9b0 con 0x7ff6d8108d20 2024-09-21T06:44:14.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.392+0000 7ff6e415f740 1 Processor -- start 2024-09-21T06:44:14.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.392+0000 7ff6d57fa640 1 -- 172.21.15.7:0/1937995045 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7ff6d004d070 con 0x7ff6d8108d20 2024-09-21T06:44:14.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.392+0000 7ff6e415f740 1 -- start start 2024-09-21T06:44:14.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.393+0000 7ff6e415f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c4237d350 0x555c42724430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:14.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.393+0000 7ff6e415f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c42354490 0x555c42724970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:14.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.393+0000 7ff6e415f740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555c4235c670 0x555c42724eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:14.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.393+0000 7ff6e415f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x555c4269ae60 con 0x555c42354490 2024-09-21T06:44:14.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.393+0000 7ff6e415f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x555c4268a290 con 0x555c4237d350 2024-09-21T06:44:14.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.393+0000 7ff6e415f740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x555c4268e0a0 con 0x555c4235c670 2024-09-21T06:44:14.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.393+0000 7ff6d77fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c42354490 0x555c42724970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:14.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.393+0000 7ff6d77fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c42354490 0x555c42724970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36884/0 (socket says 172.21.15.7:36884) 2024-09-21T06:44:14.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.393+0000 7ff6d77fe640 1 -- 172.21.15.7:0/4165595932 learned_addr learned my addr 172.21.15.7:0/4165595932 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:44:14.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.393+0000 7ff6ceffd640 1 --2- 172.21.15.7:0/4165595932 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555c4235c670 0x555c42724eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:14.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.393+0000 7ff6ceffd640 1 --2- 172.21.15.7:0/4165595932 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c4237d350 0x555c42724430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:14.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.393+0000 7ff6d57fa640 1 --2- 172.21.15.7:0/1937995045 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7ff6c40b66b0 0x7ff6c40b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:14.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.393+0000 7ff6d77fe640 1 -- 172.21.15.7:0/4165595932 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555c4235c670 msgr2=0x555c42724eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:14.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.393+0000 7ff6d77fe640 1 --2- 172.21.15.7:0/4165595932 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555c4235c670 0x555c42724eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:14.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.393+0000 7ff6d77fe640 1 -- 172.21.15.7:0/4165595932 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c4237d350 msgr2=0x555c42724430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:14.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.393+0000 7ff6d77fe640 1 --2- 172.21.15.7:0/4165595932 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c4237d350 0x555c42724430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:14.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.393+0000 7ff6d77fe640 1 -- 172.21.15.7:0/4165595932 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c423e8930 con 0x555c42354490 2024-09-21T06:44:14.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.393+0000 7ff6ceffd640 1 --2- 172.21.15.7:0/4165595932 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c4237d350 0x555c42724430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:44:14.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.393+0000 7ff6d7fff640 1 --2- 172.21.15.7:0/1937995045 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7ff6c40b66b0 0x7ff6c40b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:14.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.394+0000 7ff6d57fa640 1 -- 172.21.15.7:0/1937995045 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8456+0+0 (secure 0 0 0) 0x7ff6d0109cc0 con 0x7ff6d8108d20 2024-09-21T06:44:14.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.394+0000 7ff6d77fe640 1 --2- 172.21.15.7:0/4165595932 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c42354490 0x555c42724970 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7ff6c800b760 tx=0x7ff6c800bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d812da551b3009b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:14.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.394+0000 7ff6cdffb640 1 -- 172.21.15.7:0/4165595932 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6c8003dd0 con 0x555c42354490 2024-09-21T06:44:14.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.394+0000 7ff6cdffb640 1 -- 172.21.15.7:0/4165595932 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff6c8015070 con 0x555c42354490 2024-09-21T06:44:14.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.394+0000 7ff6cdffb640 1 -- 172.21.15.7:0/4165595932 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6c8004ce0 con 0x555c42354490 2024-09-21T06:44:14.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.395+0000 7ff6e415f740 1 -- 172.21.15.7:0/4165595932 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c42354490 msgr2=0x555c42724970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:14.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.395+0000 7ff6e415f740 1 --2- 172.21.15.7:0/4165595932 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c42354490 0x555c42724970 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7ff6c800b760 tx=0x7ff6c800bc20 comp rx=0 tx=0).stop 2024-09-21T06:44:14.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.395+0000 7ff6d7fff640 1 --2- 172.21.15.7:0/1937995045 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7ff6c40b66b0 0x7ff6c40b8bc0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ff6d0107500 tx=0x7ff6d00095c0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:14.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.395+0000 7ff6e415f740 1 -- 172.21.15.7:0/4165595932 shutdown_connections 2024-09-21T06:44:14.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.395+0000 7ff6e415f740 1 --2- 172.21.15.7:0/4165595932 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555c4235c670 0x555c42724eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:14.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.395+0000 7ff6e415f740 1 --2- 172.21.15.7:0/4165595932 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c42354490 0x555c42724970 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:14.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.395+0000 7ff6e415f740 1 --2- 172.21.15.7:0/4165595932 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c4237d350 0x555c42724430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:14.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.395+0000 7ff6e415f740 1 -- 172.21.15.7:0/4165595932 >> 172.21.15.7:0/4165595932 conn(0x555c42371740 msgr2=0x555c42722320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:14.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.395+0000 7ff6e415f740 1 -- 172.21.15.7:0/4165595932 shutdown_connections 2024-09-21T06:44:14.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.395+0000 7ff6e415f740 1 -- 172.21.15.7:0/4165595932 wait complete. 2024-09-21T06:44:14.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.395+0000 7ff6e415f740 1 -- start start 2024-09-21T06:44:14.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.395+0000 7ff6e415f740 1 Processor -- start 2024-09-21T06:44:14.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.396+0000 7ff6e415f740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555c42354490 0x555c42730010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:14.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.396+0000 7ff6e415f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c4235c670 0x555c42730550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:14.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.396+0000 7ff6e415f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c4237d350 0x555c4273bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:14.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.396+0000 7ff6e415f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x555c424eb890 con 0x555c4235c670 2024-09-21T06:44:14.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.396+0000 7ff6e415f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x555c42624d40 con 0x555c4237d350 2024-09-21T06:44:14.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.396+0000 7ff6e415f740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x555c42732c10 con 0x555c42354490 2024-09-21T06:44:14.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.396+0000 7ff6e415f740 10 client.0 _ll_register_callbacks cb 0x555c42688c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:44:14.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.396+0000 7ff6d77fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c4235c670 0x555c42730550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:14.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.396+0000 7ff6d77fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c4235c670 0x555c42730550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36900/0 (socket says 172.21.15.7:36900) 2024-09-21T06:44:14.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.396+0000 7ff6d77fe640 1 -- 172.21.15.7:0/2718533604 learned_addr learned my addr 172.21.15.7:0/2718533604 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:44:14.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.396+0000 7ff6ceffd640 1 --2- 172.21.15.7:0/2718533604 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555c42354490 0x555c42730010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:14.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.396+0000 7ff6ceffd640 1 --2- 172.21.15.7:0/2718533604 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c4237d350 0x555c4273bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:14.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.396+0000 7ff6d77fe640 1 -- 172.21.15.7:0/2718533604 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555c42354490 msgr2=0x555c42730010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:14.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.396+0000 7ff6d77fe640 1 --2- 172.21.15.7:0/2718533604 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555c42354490 0x555c42730010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:14.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.396+0000 7ff6d77fe640 1 -- 172.21.15.7:0/2718533604 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c4237d350 msgr2=0x555c4273bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:14.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.396+0000 7ff6d77fe640 1 --2- 172.21.15.7:0/2718533604 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c4237d350 0x555c4273bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:14.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.396+0000 7ff6d77fe640 1 -- 172.21.15.7:0/2718533604 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c4273c490 con 0x555c4235c670 2024-09-21T06:44:14.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.396+0000 7ff6ceffd640 1 --2- 172.21.15.7:0/2718533604 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555c42354490 0x555c42730010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:44:14.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.396+0000 7ff6d77fe640 1 --2- 172.21.15.7:0/2718533604 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c4235c670 0x555c42730550 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7ff6c8003e00 tx=0x7ff6c8003e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8216ec43d58926fe server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:14.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.396+0000 7ff6b6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:44:14.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.397+0000 7ff6b6ffd640 1 -- 172.21.15.7:0/2718533604 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6c8028060 con 0x555c4235c670 2024-09-21T06:44:14.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.397+0000 7ff6b6ffd640 1 -- 172.21.15.7:0/2718533604 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8456+0+0 (secure 0 0 0) 0x7ff6c8011850 con 0x555c4235c670 2024-09-21T06:44:14.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.397+0000 7ff6e415f740 1 -- 172.21.15.7:0/2718533604 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff6c8015070 con 0x555c4235c670 2024-09-21T06:44:14.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.397+0000 7ff6b6ffd640 1 -- 172.21.15.7:0/2718533604 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff6c800be70 con 0x555c4235c670 2024-09-21T06:44:14.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.397+0000 7ff6e415f740 10 client.17172 fetch_fsmap learned FSMap version 25 2024-09-21T06:44:14.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.397+0000 7ff6e415f740 1 -- 172.21.15.7:0/2718533604 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x555c4273edc0 con 0x555c4235c670 2024-09-21T06:44:14.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.397+0000 7ff6b6ffd640 1 -- 172.21.15.7:0/2718533604 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff6c8015070 con 0x555c4235c670 2024-09-21T06:44:14.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.397+0000 7ff6b6ffd640 1 -- 172.21.15.7:0/2718533604 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff6c8022070 con 0x555c4235c670 2024-09-21T06:44:14.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.397+0000 7ff6e415f740 10 client.17172 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:44:14.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.397+0000 7ff6e415f740 10 client.17172 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:44:14.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.397+0000 7ff6e415f740 20 client.17172 populate_metadata read hostname 'smithi007' 2024-09-21T06:44:14.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.397+0000 7ff6e415f740 1 --2- 172.21.15.7:0/2718533604 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x555c4233bcd0 0x555c427421d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:14.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.397+0000 7ff6e415f740 4 client.17172 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:44:14.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.397+0000 7ff6e415f740 1 -- 172.21.15.7:0/2718533604 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555c4269cdb0 con 0x555c4233bcd0 2024-09-21T06:44:14.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.398+0000 7ff6ceffd640 1 --2- 172.21.15.7:0/2718533604 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x555c4233bcd0 0x555c427421d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:14.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.398+0000 7ff6b6ffd640 10 client.17172 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:44:14.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.398+0000 7ff6ceffd640 1 --2- 172.21.15.7:0/2718533604 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x555c4233bcd0 0x555c427421d0 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a88e8b3e2a77b402 server_cookie=62497d1b0444a7de in_seq=0 out_seq=0 2024-09-21T06:44:14.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.399+0000 7ff6b6ffd640 1 -- 172.21.15.7:0/2718533604 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555c4269cdb0 con 0x555c4233bcd0 2024-09-21T06:44:14.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.399+0000 7ff6b6ffd640 10 client.17172 handle_command_reply: tid=0 2024-09-21T06:44:14.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.399+0000 7ff6e415f740 1 client.17172 shutdown 2024-09-21T06:44:14.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.399+0000 7ff6e415f740 1 -- 172.21.15.7:0/2718533604 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c4235c670 msgr2=0x555c42730550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:14.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.399+0000 7ff6e415f740 1 --2- 172.21.15.7:0/2718533604 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c4235c670 0x555c42730550 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7ff6c8003e00 tx=0x7ff6c8003e30 comp rx=0 tx=0).stop 2024-09-21T06:44:14.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.399+0000 7ff6e415f740 1 -- 172.21.15.7:0/2718533604 shutdown_connections 2024-09-21T06:44:14.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.399+0000 7ff6e415f740 1 --2- 172.21.15.7:0/2718533604 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x555c4233bcd0 0x555c427421d0 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:14.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.399+0000 7ff6e415f740 1 --2- 172.21.15.7:0/2718533604 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c4237d350 0x555c4273bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:14.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.399+0000 7ff6e415f740 1 --2- 172.21.15.7:0/2718533604 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c4235c670 0x555c42730550 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:14.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.399+0000 7ff6e415f740 1 --2- 172.21.15.7:0/2718533604 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555c42354490 0x555c42730010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:14.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.399+0000 7ff6e415f740 1 -- 172.21.15.7:0/2718533604 >> 172.21.15.7:0/2718533604 conn(0x555c42371740 msgr2=0x555c42727610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:14.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.399+0000 7ff6b6ffd640 0 client.17172 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:44:14.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.399+0000 7ff6e415f740 1 -- 172.21.15.7:0/2718533604 shutdown_connections 2024-09-21T06:44:14.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.399+0000 7ff6e415f740 1 -- 172.21.15.7:0/2718533604 wait complete. 2024-09-21T06:44:14.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.399+0000 7ff6e415f740 20 client.17172 trim_cache size 0 max 16384 2024-09-21T06:44:14.423 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.417+0000 7ff6e415f740 1 Processor -- start 2024-09-21T06:44:14.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.417+0000 7ff6e415f740 1 -- start start 2024-09-21T06:44:14.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.417+0000 7ff6e415f740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555c42354490 0x555c4273be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:14.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.418+0000 7ff6e415f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c4235c670 0x555c42727c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:14.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.418+0000 7ff6e415f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c4237d350 0x555c42729510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:14.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.418+0000 7ff6e415f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff6d81afb90 con 0x555c4237d350 2024-09-21T06:44:14.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.418+0000 7ff6e415f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff6d81ad460 con 0x555c4235c670 2024-09-21T06:44:14.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.418+0000 7ff6e415f740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff6d81ab2d0 con 0x555c42354490 2024-09-21T06:44:14.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.418+0000 7ff6ceffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c4237d350 0x555c42729510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:14.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.418+0000 7ff6ceffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c4237d350 0x555c42729510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36902/0 (socket says 172.21.15.7:36902) 2024-09-21T06:44:14.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.418+0000 7ff6ceffd640 1 -- 172.21.15.7:0/1683833583 learned_addr learned my addr 172.21.15.7:0/1683833583 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:44:14.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.418+0000 7ff6d77fe640 1 --2- 172.21.15.7:0/1683833583 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c4235c670 0x555c42727c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:14.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.418+0000 7ff6ceffd640 1 --2- 172.21.15.7:0/1683833583 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555c42354490 0x555c4273be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:14.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.418+0000 7ff6ceffd640 1 -- 172.21.15.7:0/1683833583 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555c42354490 msgr2=0x555c4273be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:14.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.418+0000 7ff6ceffd640 1 --2- 172.21.15.7:0/1683833583 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555c42354490 0x555c4273be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:14.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.418+0000 7ff6ceffd640 1 -- 172.21.15.7:0/1683833583 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c4235c670 msgr2=0x555c42727c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:14.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.418+0000 7ff6ceffd640 1 --2- 172.21.15.7:0/1683833583 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c4235c670 0x555c42727c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:14.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.418+0000 7ff6ceffd640 1 -- 172.21.15.7:0/1683833583 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c4233bf00 con 0x555c4237d350 2024-09-21T06:44:14.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.418+0000 7ff6d77fe640 1 --2- 172.21.15.7:0/1683833583 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c4235c670 0x555c42727c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:44:14.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.418+0000 7ff6ceffd640 1 --2- 172.21.15.7:0/1683833583 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c4237d350 0x555c42729510 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x555c427327b0 tx=0x7ff6c0013040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=326734cde1db648c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:14.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.418+0000 7ff6cd7fa640 1 -- 172.21.15.7:0/1683833583 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6c0010c40 con 0x555c4237d350 2024-09-21T06:44:14.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.418+0000 7ff6cd7fa640 1 -- 172.21.15.7:0/1683833583 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff6c0010de0 con 0x555c4237d350 2024-09-21T06:44:14.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.418+0000 7ff6cd7fa640 1 -- 172.21.15.7:0/1683833583 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6c0004e10 con 0x555c4237d350 2024-09-21T06:44:14.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.419+0000 7ff6e415f740 1 -- 172.21.15.7:0/1683833583 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c4237d350 msgr2=0x555c42729510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:14.425 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.419+0000 7ff6e415f740 1 --2- 172.21.15.7:0/1683833583 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c4237d350 0x555c42729510 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x555c427327b0 tx=0x7ff6c0013040 comp rx=0 tx=0).stop 2024-09-21T06:44:14.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.419+0000 7ff6e415f740 1 -- 172.21.15.7:0/1683833583 shutdown_connections 2024-09-21T06:44:14.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.419+0000 7ff6e415f740 1 --2- 172.21.15.7:0/1683833583 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c4237d350 0x555c42729510 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:14.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.419+0000 7ff6e415f740 1 --2- 172.21.15.7:0/1683833583 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c4235c670 0x555c42727c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:14.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.419+0000 7ff6e415f740 1 --2- 172.21.15.7:0/1683833583 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555c42354490 0x555c4273be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:14.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.419+0000 7ff6e415f740 1 -- 172.21.15.7:0/1683833583 >> 172.21.15.7:0/1683833583 conn(0x555c42371740 msgr2=0x555c42727530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:14.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.419+0000 7ff6e415f740 1 -- 172.21.15.7:0/1683833583 shutdown_connections 2024-09-21T06:44:14.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.419+0000 7ff6e415f740 1 -- 172.21.15.7:0/1683833583 wait complete. 2024-09-21T06:44:14.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.420+0000 7ff6e415f740 1 -- start start 2024-09-21T06:44:14.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.420+0000 7ff6e415f740 1 Processor -- start 2024-09-21T06:44:14.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.420+0000 7ff6e415f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c42354490 0x555c42745200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:14.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.420+0000 7ff6e415f740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555c4235c670 0x555c42745740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:14.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.420+0000 7ff6e415f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c4237d350 0x555c427a5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:14.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.420+0000 7ff6e415f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff6d81ab920 con 0x555c4237d350 2024-09-21T06:44:14.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.420+0000 7ff6e415f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff6d81acd90 con 0x555c42354490 2024-09-21T06:44:14.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.420+0000 7ff6e415f740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff6d81abff0 con 0x555c4235c670 2024-09-21T06:44:14.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.420+0000 7ff6e415f740 10 client.0 _ll_register_callbacks cb 0x7ff6c000e9d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:44:14.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.420+0000 7ff6ceffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c4237d350 0x555c427a5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:14.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.420+0000 7ff6ceffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c4237d350 0x555c427a5d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36918/0 (socket says 172.21.15.7:36918) 2024-09-21T06:44:14.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.420+0000 7ff6ceffd640 1 -- 172.21.15.7:0/3064583117 learned_addr learned my addr 172.21.15.7:0/3064583117 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:44:14.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.420+0000 7ff6ceffd640 1 --2- 172.21.15.7:0/3064583117 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c42354490 0x555c42745200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:14.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.421+0000 7ff6d77fe640 1 --2- 172.21.15.7:0/3064583117 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555c4235c670 0x555c42745740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:14.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.421+0000 7ff6ceffd640 1 -- 172.21.15.7:0/3064583117 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555c4235c670 msgr2=0x555c42745740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:14.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.421+0000 7ff6ceffd640 1 --2- 172.21.15.7:0/3064583117 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555c4235c670 0x555c42745740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:14.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.421+0000 7ff6ceffd640 1 -- 172.21.15.7:0/3064583117 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c42354490 msgr2=0x555c42745200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:14.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.421+0000 7ff6ceffd640 1 --2- 172.21.15.7:0/3064583117 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c42354490 0x555c42745200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:14.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.421+0000 7ff6ceffd640 1 -- 172.21.15.7:0/3064583117 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c427a62d0 con 0x555c4237d350 2024-09-21T06:44:14.427 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.421+0000 7ff6ceffd640 1 --2- 172.21.15.7:0/3064583117 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c4237d350 0x555c427a5d90 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x555c427a8590 tx=0x7ff6c0010f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=306eed31437199ca server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:14.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.421+0000 7ff6b6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:44:14.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.421+0000 7ff6b6ffd640 1 -- 172.21.15.7:0/3064583117 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6c0010c10 con 0x555c4237d350 2024-09-21T06:44:14.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.421+0000 7ff6b6ffd640 1 -- 172.21.15.7:0/3064583117 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8456+0+0 (secure 0 0 0) 0x7ff6c0004260 con 0x555c4237d350 2024-09-21T06:44:14.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.421+0000 7ff6e415f740 1 -- 172.21.15.7:0/3064583117 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff6c0010de0 con 0x555c4237d350 2024-09-21T06:44:14.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.421+0000 7ff6b6ffd640 1 -- 172.21.15.7:0/3064583117 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff6c0004460 con 0x555c4237d350 2024-09-21T06:44:14.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.421+0000 7ff6e415f740 10 client.17178 fetch_fsmap learned FSMap version 25 2024-09-21T06:44:14.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.421+0000 7ff6e415f740 1 -- 172.21.15.7:0/3064583117 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x555c427b1450 con 0x555c4237d350 2024-09-21T06:44:14.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.422+0000 7ff6b6ffd640 1 -- 172.21.15.7:0/3064583117 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff6c0010de0 con 0x555c4237d350 2024-09-21T06:44:14.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.422+0000 7ff6b6ffd640 1 -- 172.21.15.7:0/3064583117 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff6c0004de0 con 0x555c4237d350 2024-09-21T06:44:14.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.422+0000 7ff6e415f740 10 client.17178 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:44:14.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.422+0000 7ff6e415f740 10 client.17178 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:44:14.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.422+0000 7ff6e415f740 20 client.17178 populate_metadata read hostname 'smithi007' 2024-09-21T06:44:14.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.422+0000 7ff6e415f740 1 --2- 172.21.15.7:0/3064583117 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x555c42311080 0x555c427b3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:14.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.422+0000 7ff6e415f740 4 client.17178 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:44:14.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.422+0000 7ff6e415f740 1 -- 172.21.15.7:0/3064583117 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x555c42698860 con 0x555c42311080 2024-09-21T06:44:14.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.422+0000 7ff6d77fe640 1 --2- 172.21.15.7:0/3064583117 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x555c42311080 0x555c427b3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:14.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.423+0000 7ff6b6ffd640 10 client.17178 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:44:14.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.423+0000 7ff6d77fe640 1 --2- 172.21.15.7:0/3064583117 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x555c42311080 0x555c427b3bb0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=514308924ac4cbcd server_cookie=fab5879adce1571b in_seq=0 out_seq=0 2024-09-21T06:44:14.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.424+0000 7ff6b6ffd640 1 -- 172.21.15.7:0/3064583117 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x555c42698860 con 0x555c42311080 2024-09-21T06:44:14.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.424+0000 7ff6b6ffd640 10 client.17178 handle_command_reply: tid=0 2024-09-21T06:44:14.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.424+0000 7ff6e415f740 1 client.17178 shutdown 2024-09-21T06:44:14.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.425+0000 7ff6e415f740 1 -- 172.21.15.7:0/3064583117 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c4237d350 msgr2=0x555c427a5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:14.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.425+0000 7ff6e415f740 1 --2- 172.21.15.7:0/3064583117 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c4237d350 0x555c427a5d90 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x555c427a8590 tx=0x7ff6c0010f90 comp rx=0 tx=0).stop 2024-09-21T06:44:14.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.425+0000 7ff6e415f740 1 -- 172.21.15.7:0/3064583117 shutdown_connections 2024-09-21T06:44:14.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.425+0000 7ff6e415f740 1 --2- 172.21.15.7:0/3064583117 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x555c42311080 0x555c427b3bb0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:14.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.425+0000 7ff6e415f740 1 --2- 172.21.15.7:0/3064583117 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x555c4237d350 0x555c427a5d90 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:14.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.425+0000 7ff6e415f740 1 --2- 172.21.15.7:0/3064583117 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x555c4235c670 0x555c42745740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:14.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.425+0000 7ff6e415f740 1 --2- 172.21.15.7:0/3064583117 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x555c42354490 0x555c42745200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:14.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.425+0000 7ff6e415f740 1 -- 172.21.15.7:0/3064583117 >> 172.21.15.7:0/3064583117 conn(0x555c42371740 msgr2=0x555c4272e2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:14.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.425+0000 7ff6b6ffd640 0 client.17178 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:44:14.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.425+0000 7ff6e415f740 1 -- 172.21.15.7:0/3064583117 shutdown_connections 2024-09-21T06:44:14.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.425+0000 7ff6e415f740 1 -- 172.21.15.7:0/3064583117 wait complete. 2024-09-21T06:44:14.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.425+0000 7ff6e415f740 20 client.17178 trim_cache size 0 max 16384 2024-09-21T06:44:14.431 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:44:14.431 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0, 2024-09-21T06:44:14.431 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_tag": "3f7283b7-f175-4023-9191-177660b3a6be", 2024-09-21T06:44:14.432 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": "asynchronous" 2024-09-21T06:44:14.432 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:44:14.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.425+0000 7ff6ddbeb640 1 -- 172.21.15.7:0/1937995045 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7ff6c40b66b0 msgr2=0x7ff6c40b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:14.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.425+0000 7ff6ddbeb640 1 --2- 172.21.15.7:0/1937995045 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7ff6c40b66b0 0x7ff6c40b8bc0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ff6d0107500 tx=0x7ff6d00095c0 comp rx=0 tx=0).stop 2024-09-21T06:44:14.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.426+0000 7ff6ddbeb640 1 -- 172.21.15.7:0/1937995045 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff6d8108d20 msgr2=0x7ff6d819eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:14.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.426+0000 7ff6ddbeb640 1 --2- 172.21.15.7:0/1937995045 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff6d8108d20 0x7ff6d819eb70 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7ff6d0009430 tx=0x7ff6d00319f0 comp rx=0 tx=0).stop 2024-09-21T06:44:14.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.426+0000 7ff6ddbeb640 1 -- 172.21.15.7:0/1937995045 shutdown_connections 2024-09-21T06:44:14.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.426+0000 7ff6ddbeb640 1 --2- 172.21.15.7:0/1937995045 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7ff6c40b66b0 0x7ff6c40b8bc0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:14.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.426+0000 7ff6ddbeb640 1 --2- 172.21.15.7:0/1937995045 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff6d8108d20 0x7ff6d819eb70 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:14.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.426+0000 7ff6ddbeb640 1 --2- 172.21.15.7:0/1937995045 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff6d81083d0 0x7ff6d81998d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:14.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.426+0000 7ff6ddbeb640 1 --2- 172.21.15.7:0/1937995045 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff6d8102ae0 0x7ff6d8199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:14.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.426+0000 7ff6ddbeb640 1 -- 172.21.15.7:0/1937995045 >> 172.21.15.7:0/1937995045 conn(0x7ff6d8079760 msgr2=0x7ff6d81043a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:14.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.426+0000 7ff6ddbeb640 1 -- 172.21.15.7:0/1937995045 shutdown_connections 2024-09-21T06:44:14.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:14.426+0000 7ff6ddbeb640 1 -- 172.21.15.7:0/1937995045 wait complete. 2024-09-21T06:44:15.187 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:44:15.261 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:44:14 smithi007 ceph-mon[30983]: pgmap v563: 97 pgs: 97 active+clean; 3.3 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 204 B/s wr, 7 op/s 2024-09-21T06:44:15.261 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:44:14 smithi007 ceph-mon[30983]: scrub queued for path: / 2024-09-21T06:44:15.261 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:44:14 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T06:44:15.261 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:44:14 smithi007 ceph-mon[30983]: scrub summary: active paths [/] 2024-09-21T06:44:15.261 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:44:14 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T06:44:15.261 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:44:14 smithi007 ceph-mon[30983]: scrub summary: idle 2024-09-21T06:44:15.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:44:14 smithi144 ceph-mon[34653]: pgmap v563: 97 pgs: 97 active+clean; 3.3 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 204 B/s wr, 7 op/s 2024-09-21T06:44:15.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:44:14 smithi144 ceph-mon[34653]: scrub queued for path: / 2024-09-21T06:44:15.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:44:14 smithi144 ceph-mon[34653]: scrub summary: idle+waiting paths [/] 2024-09-21T06:44:15.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:44:14 smithi144 ceph-mon[34653]: scrub summary: active paths [/] 2024-09-21T06:44:15.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:44:14 smithi144 ceph-mon[34653]: scrub summary: idle+waiting paths [/] 2024-09-21T06:44:15.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:44:14 smithi144 ceph-mon[34653]: scrub summary: idle 2024-09-21T06:44:15.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:44:14 smithi018 ceph-mon[34477]: pgmap v563: 97 pgs: 97 active+clean; 3.3 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 204 B/s wr, 7 op/s 2024-09-21T06:44:15.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:44:14 smithi018 ceph-mon[34477]: scrub queued for path: / 2024-09-21T06:44:15.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:44:14 smithi018 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-21T06:44:15.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:44:14 smithi018 ceph-mon[34477]: scrub summary: active paths [/] 2024-09-21T06:44:15.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:44:14 smithi018 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-21T06:44:15.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:44:14 smithi018 ceph-mon[34477]: scrub summary: idle 2024-09-21T06:44:15.452 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:44:15.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.930+0000 7f2d7942b640 1 -- 172.21.15.7:0/1813100524 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d74109df0 msgr2=0x7f2d74110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:15.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.930+0000 7f2d7942b640 1 --2- 172.21.15.7:0/1813100524 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d74109df0 0x7f2d74110620 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c009900 tx=0x7f2d6c02a410 comp rx=0 tx=0).stop 2024-09-21T06:44:15.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.930+0000 7f2d7942b640 1 -- 172.21.15.7:0/1813100524 shutdown_connections 2024-09-21T06:44:15.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.930+0000 7f2d7942b640 1 --2- 172.21.15.7:0/1813100524 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d74109df0 0x7f2d74110620 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:15.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.930+0000 7f2d7942b640 1 --2- 172.21.15.7:0/1813100524 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d741094a0 0x7f2d741098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:15.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.930+0000 7f2d7942b640 1 --2- 172.21.15.7:0/1813100524 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2d74103b60 0x7f2d74103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:15.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.930+0000 7f2d7942b640 1 -- 172.21.15.7:0/1813100524 >> 172.21.15.7:0/1813100524 conn(0x7f2d7407b850 msgr2=0x7f2d7407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:15.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.930+0000 7f2d7942b640 1 -- 172.21.15.7:0/1813100524 shutdown_connections 2024-09-21T06:44:15.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.930+0000 7f2d7942b640 1 -- 172.21.15.7:0/1813100524 wait complete. 2024-09-21T06:44:15.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.931+0000 7f2d7942b640 1 Processor -- start 2024-09-21T06:44:15.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.931+0000 7f2d7942b640 1 -- start start 2024-09-21T06:44:15.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.932+0000 7f2d7942b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d74103b60 0x7f2d7419a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:15.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.932+0000 7f2d7942b640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2d741094a0 0x7f2d7419a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:15.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.932+0000 7f2d7942b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d74109df0 0x7f2d7419fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:15.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.932+0000 7f2d7942b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2d74113ab0 con 0x7f2d74103b60 2024-09-21T06:44:15.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.932+0000 7f2d7942b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2d74113930 con 0x7f2d74109df0 2024-09-21T06:44:15.947 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.932+0000 7f2d7942b640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2d74113c30 con 0x7f2d741094a0 2024-09-21T06:44:15.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.932+0000 7f2d72ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d74103b60 0x7f2d7419a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:15.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.932+0000 7f2d72ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d74103b60 0x7f2d7419a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36940/0 (socket says 172.21.15.7:36940) 2024-09-21T06:44:15.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.932+0000 7f2d72ffd640 1 -- 172.21.15.7:0/4282864185 learned_addr learned my addr 172.21.15.7:0/4282864185 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:44:15.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.932+0000 7f2d727fc640 1 --2- 172.21.15.7:0/4282864185 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2d741094a0 0x7f2d7419a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:15.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.932+0000 7f2d737fe640 1 --2- 172.21.15.7:0/4282864185 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d74109df0 0x7f2d7419fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:15.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.932+0000 7f2d72ffd640 1 -- 172.21.15.7:0/4282864185 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2d741094a0 msgr2=0x7f2d7419a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:15.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.932+0000 7f2d72ffd640 1 --2- 172.21.15.7:0/4282864185 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2d741094a0 0x7f2d7419a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:15.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.932+0000 7f2d72ffd640 1 -- 172.21.15.7:0/4282864185 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d74109df0 msgr2=0x7f2d7419fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:15.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.932+0000 7f2d72ffd640 1 --2- 172.21.15.7:0/4282864185 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d74109df0 0x7f2d7419fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:15.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.932+0000 7f2d72ffd640 1 -- 172.21.15.7:0/4282864185 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d741a0390 con 0x7f2d74103b60 2024-09-21T06:44:15.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.932+0000 7f2d72ffd640 1 --2- 172.21.15.7:0/4282864185 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d74103b60 0x7f2d7419a420 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f2d6400ea80 tx=0x7f2d6400ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:15.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.932+0000 7f2d5bfff640 1 -- 172.21.15.7:0/4282864185 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d6400ce40 con 0x7f2d74103b60 2024-09-21T06:44:15.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.932+0000 7f2d5bfff640 1 -- 172.21.15.7:0/4282864185 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2d64005020 con 0x7f2d74103b60 2024-09-21T06:44:15.948 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.933+0000 7f2d7942b640 1 -- 172.21.15.7:0/4282864185 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d741a0680 con 0x7f2d74103b60 2024-09-21T06:44:15.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.933+0000 7f2d5bfff640 1 -- 172.21.15.7:0/4282864185 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d640116d0 con 0x7f2d74103b60 2024-09-21T06:44:15.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.933+0000 7f2d7942b640 1 -- 172.21.15.7:0/4282864185 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d741a6de0 con 0x7f2d74103b60 2024-09-21T06:44:15.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.936+0000 7f2d7f99f740 1 Processor -- start 2024-09-21T06:44:15.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.936+0000 7f2d7f99f740 1 -- start start 2024-09-21T06:44:15.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.936+0000 7f2d7f99f740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56028908a070 0x560289431650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:15.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.936+0000 7f2d7f99f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5602890611b0 0x560289431b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:15.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.936+0000 7f2d7f99f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560289069390 0x5602894320d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:15.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.936+0000 7f2d7f99f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5602893a7e50 con 0x560289069390 2024-09-21T06:44:15.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.936+0000 7f2d7f99f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x560289397280 con 0x5602890611b0 2024-09-21T06:44:15.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.936+0000 7f2d7f99f740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x56028939b090 con 0x56028908a070 2024-09-21T06:44:15.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.936+0000 7f2d5bfff640 1 -- 172.21.15.7:0/4282864185 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f2d64011870 con 0x7f2d74103b60 2024-09-21T06:44:15.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.936+0000 7f2d727fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560289069390 0x5602894320d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:15.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.936+0000 7f2d727fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560289069390 0x5602894320d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36954/0 (socket says 172.21.15.7:36954) 2024-09-21T06:44:15.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.936+0000 7f2d727fc640 1 -- 172.21.15.7:0/4153253863 learned_addr learned my addr 172.21.15.7:0/4153253863 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:44:15.949 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.936+0000 7f2d737fe640 1 --2- 172.21.15.7:0/4153253863 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56028908a070 0x560289431650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:15.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.937+0000 7f2d72ffd640 1 --2- 172.21.15.7:0/4153253863 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5602890611b0 0x560289431b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:15.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.937+0000 7f2d727fc640 1 -- 172.21.15.7:0/4153253863 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56028908a070 msgr2=0x560289431650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:15.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.937+0000 7f2d727fc640 1 --2- 172.21.15.7:0/4153253863 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56028908a070 0x560289431650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:15.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.937+0000 7f2d727fc640 1 -- 172.21.15.7:0/4153253863 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5602890611b0 msgr2=0x560289431b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:15.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.937+0000 7f2d727fc640 1 --2- 172.21.15.7:0/4153253863 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5602890611b0 0x560289431b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:15.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.937+0000 7f2d727fc640 1 -- 172.21.15.7:0/4153253863 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602890f5650 con 0x560289069390 2024-09-21T06:44:15.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.937+0000 7f2d72ffd640 1 --2- 172.21.15.7:0/4153253863 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5602890611b0 0x560289431b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:44:15.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.937+0000 7f2d727fc640 1 --2- 172.21.15.7:0/4153253863 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560289069390 0x5602894320d0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f2d68009c20 tx=0x7f2d68011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b3e46e51e4a0791 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:15.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.937+0000 7f2d597fa640 1 -- 172.21.15.7:0/4153253863 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d68004230 con 0x560289069390 2024-09-21T06:44:15.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.937+0000 7f2d597fa640 1 -- 172.21.15.7:0/4153253863 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2d680043d0 con 0x560289069390 2024-09-21T06:44:15.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.937+0000 7f2d597fa640 1 -- 172.21.15.7:0/4153253863 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d68004ca0 con 0x560289069390 2024-09-21T06:44:15.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.937+0000 7f2d5bfff640 1 --2- 172.21.15.7:0/4282864185 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f2d5c0b6680 0x7f2d5c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:15.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.937+0000 7f2d737fe640 1 --2- 172.21.15.7:0/4282864185 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f2d5c0b6680 0x7f2d5c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:15.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.937+0000 7f2d5bfff640 1 -- 172.21.15.7:0/4282864185 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8456+0+0 (secure 0 0 0) 0x7f2d640e79a0 con 0x7f2d74103b60 2024-09-21T06:44:15.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.938+0000 7f2d737fe640 1 --2- 172.21.15.7:0/4282864185 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f2d5c0b6680 0x7f2d5c0b8b90 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c005ab0 tx=0x7f2d6c005a40 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:15.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.938+0000 7f2d7f99f740 1 -- 172.21.15.7:0/4153253863 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560289069390 msgr2=0x5602894320d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:15.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.938+0000 7f2d7f99f740 1 --2- 172.21.15.7:0/4153253863 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560289069390 0x5602894320d0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f2d68009c20 tx=0x7f2d68011810 comp rx=0 tx=0).stop 2024-09-21T06:44:15.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.938+0000 7f2d7f99f740 1 -- 172.21.15.7:0/4153253863 shutdown_connections 2024-09-21T06:44:15.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.938+0000 7f2d7f99f740 1 --2- 172.21.15.7:0/4153253863 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560289069390 0x5602894320d0 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:15.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.938+0000 7f2d7f99f740 1 --2- 172.21.15.7:0/4153253863 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5602890611b0 0x560289431b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:15.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.938+0000 7f2d7f99f740 1 --2- 172.21.15.7:0/4153253863 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56028908a070 0x560289431650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:15.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.938+0000 7f2d7f99f740 1 -- 172.21.15.7:0/4153253863 >> 172.21.15.7:0/4153253863 conn(0x56028907e460 msgr2=0x56028942f540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:15.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.938+0000 7f2d7f99f740 1 -- 172.21.15.7:0/4153253863 shutdown_connections 2024-09-21T06:44:15.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.938+0000 7f2d7f99f740 1 -- 172.21.15.7:0/4153253863 wait complete. 2024-09-21T06:44:15.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.939+0000 7f2d7f99f740 1 -- start start 2024-09-21T06:44:15.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.939+0000 7f2d7f99f740 1 Processor -- start 2024-09-21T06:44:15.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.939+0000 7f2d7f99f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5602890611b0 0x56028943ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:15.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.939+0000 7f2d7f99f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560289069390 0x56028943d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:15.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.939+0000 7f2d7f99f740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56028908a070 0x560289449120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:15.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.939+0000 7f2d7f99f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5602891f8700 con 0x560289069390 2024-09-21T06:44:15.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.939+0000 7f2d7f99f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x560289332110 con 0x5602890611b0 2024-09-21T06:44:15.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.939+0000 7f2d7f99f740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x56028943fe30 con 0x56028908a070 2024-09-21T06:44:15.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.939+0000 7f2d7f99f740 10 client.0 _ll_register_callbacks cb 0x56028934b990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:44:15.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.939+0000 7f2d727fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560289069390 0x56028943d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:15.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.939+0000 7f2d727fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560289069390 0x56028943d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36958/0 (socket says 172.21.15.7:36958) 2024-09-21T06:44:15.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.939+0000 7f2d727fc640 1 -- 172.21.15.7:0/2191816595 learned_addr learned my addr 172.21.15.7:0/2191816595 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:44:15.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.939+0000 7f2d72ffd640 1 --2- 172.21.15.7:0/2191816595 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5602890611b0 0x56028943ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:15.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.939+0000 7f2d737fe640 1 --2- 172.21.15.7:0/2191816595 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56028908a070 0x560289449120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:15.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.939+0000 7f2d727fc640 1 -- 172.21.15.7:0/2191816595 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56028908a070 msgr2=0x560289449120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:15.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.940+0000 7f2d727fc640 1 --2- 172.21.15.7:0/2191816595 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56028908a070 0x560289449120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:15.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.940+0000 7f2d727fc640 1 -- 172.21.15.7:0/2191816595 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5602890611b0 msgr2=0x56028943ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:15.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.940+0000 7f2d727fc640 1 --2- 172.21.15.7:0/2191816595 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5602890611b0 0x56028943ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:15.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.940+0000 7f2d727fc640 1 -- 172.21.15.7:0/2191816595 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56028935fc40 con 0x560289069390 2024-09-21T06:44:15.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.940+0000 7f2d737fe640 1 --2- 172.21.15.7:0/2191816595 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56028908a070 0x560289449120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:44:15.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.940+0000 7f2d727fc640 1 --2- 172.21.15.7:0/2191816595 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560289069390 0x56028943d230 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f2d68000c00 tx=0x7f2d68019ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46f9770fac0aa861 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:15.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.940+0000 7f2d56ff5640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:44:15.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.940+0000 7f2d56ff5640 1 -- 172.21.15.7:0/2191816595 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d68028020 con 0x560289069390 2024-09-21T06:44:15.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.940+0000 7f2d56ff5640 1 -- 172.21.15.7:0/2191816595 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8456+0+0 (secure 0 0 0) 0x7f2d68024620 con 0x560289069390 2024-09-21T06:44:15.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.940+0000 7f2d7f99f740 1 -- 172.21.15.7:0/2191816595 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2d680043d0 con 0x560289069390 2024-09-21T06:44:15.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.940+0000 7f2d56ff5640 1 -- 172.21.15.7:0/2191816595 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2d68033050 con 0x560289069390 2024-09-21T06:44:15.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.940+0000 7f2d7f99f740 10 client.17190 fetch_fsmap learned FSMap version 25 2024-09-21T06:44:15.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.940+0000 7f2d7f99f740 1 -- 172.21.15.7:0/2191816595 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56028944ba90 con 0x560289069390 2024-09-21T06:44:15.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.940+0000 7f2d56ff5640 1 -- 172.21.15.7:0/2191816595 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2d680043d0 con 0x560289069390 2024-09-21T06:44:15.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.941+0000 7f2d56ff5640 1 -- 172.21.15.7:0/2191816595 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f2d68018070 con 0x560289069390 2024-09-21T06:44:15.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.941+0000 7f2d7f99f740 10 client.17190 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:44:15.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.941+0000 7f2d7f99f740 10 client.17190 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:44:15.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.941+0000 7f2d7f99f740 20 client.17190 populate_metadata read hostname 'smithi007' 2024-09-21T06:44:15.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.941+0000 7f2d7f99f740 1 --2- 172.21.15.7:0/2191816595 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5602890489f0 0x56028944edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:15.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.941+0000 7f2d7f99f740 4 client.17190 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:44:15.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.941+0000 7f2d7f99f740 1 -- 172.21.15.7:0/2191816595 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5602893a9da0 con 0x5602890489f0 2024-09-21T06:44:15.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.941+0000 7f2d72ffd640 1 --2- 172.21.15.7:0/2191816595 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5602890489f0 0x56028944edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:15.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.942+0000 7f2d72ffd640 1 --2- 172.21.15.7:0/2191816595 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5602890489f0 0x56028944edf0 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b76a981510a57e66 server_cookie=dc2b34d440897541 in_seq=0 out_seq=0 2024-09-21T06:44:15.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.942+0000 7f2d56ff5640 10 client.17190 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:44:15.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.942+0000 7f2d56ff5640 1 -- 172.21.15.7:0/2191816595 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5602893a9da0 con 0x5602890489f0 2024-09-21T06:44:15.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.942+0000 7f2d56ff5640 10 client.17190 handle_command_reply: tid=0 2024-09-21T06:44:15.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.942+0000 7f2d7f99f740 1 client.17190 shutdown 2024-09-21T06:44:15.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.943+0000 7f2d7f99f740 1 -- 172.21.15.7:0/2191816595 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560289069390 msgr2=0x56028943d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:15.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.943+0000 7f2d7f99f740 1 --2- 172.21.15.7:0/2191816595 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560289069390 0x56028943d230 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f2d68000c00 tx=0x7f2d68019ba0 comp rx=0 tx=0).stop 2024-09-21T06:44:15.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.943+0000 7f2d7f99f740 1 -- 172.21.15.7:0/2191816595 shutdown_connections 2024-09-21T06:44:15.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.943+0000 7f2d7f99f740 1 --2- 172.21.15.7:0/2191816595 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5602890489f0 0x56028944edf0 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:15.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.943+0000 7f2d7f99f740 1 --2- 172.21.15.7:0/2191816595 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56028908a070 0x560289449120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:15.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.943+0000 7f2d7f99f740 1 --2- 172.21.15.7:0/2191816595 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560289069390 0x56028943d230 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:15.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.943+0000 7f2d56ff5640 0 client.17190 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:44:15.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.943+0000 7f2d7f99f740 1 --2- 172.21.15.7:0/2191816595 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5602890611b0 0x56028943ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:15.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.943+0000 7f2d7f99f740 1 -- 172.21.15.7:0/2191816595 >> 172.21.15.7:0/2191816595 conn(0x56028907e460 msgr2=0x5602894347e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:15.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.943+0000 7f2d7f99f740 1 -- 172.21.15.7:0/2191816595 shutdown_connections 2024-09-21T06:44:15.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.943+0000 7f2d7f99f740 1 -- 172.21.15.7:0/2191816595 wait complete. 2024-09-21T06:44:15.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.943+0000 7f2d7f99f740 20 client.17190 trim_cache size 0 max 16384 2024-09-21T06:44:15.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.962+0000 7f2d7f99f740 1 Processor -- start 2024-09-21T06:44:15.963 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.962+0000 7f2d7f99f740 1 -- start start 2024-09-21T06:44:15.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.962+0000 7f2d7f99f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5602890611b0 0x56028943e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:15.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.962+0000 7f2d7f99f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560289069390 0x560289449020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:15.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.962+0000 7f2d7f99f740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56028908a070 0x560289439ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:15.964 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.962+0000 7f2d7f99f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2d741b1e80 con 0x560289069390 2024-09-21T06:44:15.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.962+0000 7f2d7f99f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2d741af750 con 0x5602890611b0 2024-09-21T06:44:15.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.962+0000 7f2d7f99f740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2d741ad5c0 con 0x56028908a070 2024-09-21T06:44:15.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.962+0000 7f2d727fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560289069390 0x560289449020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:15.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.962+0000 7f2d727fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560289069390 0x560289449020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36970/0 (socket says 172.21.15.7:36970) 2024-09-21T06:44:15.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.962+0000 7f2d727fc640 1 -- 172.21.15.7:0/1983767498 learned_addr learned my addr 172.21.15.7:0/1983767498 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:44:15.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.962+0000 7f2d72ffd640 1 --2- 172.21.15.7:0/1983767498 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5602890611b0 0x56028943e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:15.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.962+0000 7f2d737fe640 1 --2- 172.21.15.7:0/1983767498 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56028908a070 0x560289439ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:15.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.963+0000 7f2d727fc640 1 -- 172.21.15.7:0/1983767498 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56028908a070 msgr2=0x560289439ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:15.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.963+0000 7f2d727fc640 1 --2- 172.21.15.7:0/1983767498 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56028908a070 0x560289439ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:15.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.963+0000 7f2d727fc640 1 -- 172.21.15.7:0/1983767498 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5602890611b0 msgr2=0x56028943e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:15.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.963+0000 7f2d727fc640 1 --2- 172.21.15.7:0/1983767498 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5602890611b0 0x56028943e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:15.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.963+0000 7f2d727fc640 1 -- 172.21.15.7:0/1983767498 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560289433940 con 0x560289069390 2024-09-21T06:44:15.965 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.963+0000 7f2d727fc640 1 --2- 172.21.15.7:0/1983767498 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560289069390 0x560289449020 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f2d68011850 tx=0x7f2d68009a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=489dcb65bcb34ea server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:15.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.963+0000 7f2d58ff9640 1 -- 172.21.15.7:0/1983767498 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d68028070 con 0x560289069390 2024-09-21T06:44:15.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.963+0000 7f2d58ff9640 1 -- 172.21.15.7:0/1983767498 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2d6801f040 con 0x560289069390 2024-09-21T06:44:15.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.963+0000 7f2d58ff9640 1 -- 172.21.15.7:0/1983767498 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d68018c00 con 0x560289069390 2024-09-21T06:44:15.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.964+0000 7f2d7f99f740 1 -- 172.21.15.7:0/1983767498 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560289069390 msgr2=0x560289449020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:15.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.964+0000 7f2d7f99f740 1 --2- 172.21.15.7:0/1983767498 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560289069390 0x560289449020 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f2d68011850 tx=0x7f2d68009a70 comp rx=0 tx=0).stop 2024-09-21T06:44:15.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.964+0000 7f2d7f99f740 1 -- 172.21.15.7:0/1983767498 shutdown_connections 2024-09-21T06:44:15.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.964+0000 7f2d7f99f740 1 --2- 172.21.15.7:0/1983767498 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56028908a070 0x560289439ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:15.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.964+0000 7f2d7f99f740 1 --2- 172.21.15.7:0/1983767498 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560289069390 0x560289449020 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:15.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.964+0000 7f2d7f99f740 1 --2- 172.21.15.7:0/1983767498 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5602890611b0 0x56028943e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:15.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.964+0000 7f2d7f99f740 1 -- 172.21.15.7:0/1983767498 >> 172.21.15.7:0/1983767498 conn(0x56028907e460 msgr2=0x56028943e210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:15.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.964+0000 7f2d7f99f740 1 -- 172.21.15.7:0/1983767498 shutdown_connections 2024-09-21T06:44:15.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.964+0000 7f2d7f99f740 1 -- 172.21.15.7:0/1983767498 wait complete. 2024-09-21T06:44:15.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.964+0000 7f2d7f99f740 1 -- start start 2024-09-21T06:44:15.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.964+0000 7f2d7f99f740 1 Processor -- start 2024-09-21T06:44:15.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.965+0000 7f2d7f99f740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5602890611b0 0x560289445960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:15.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.965+0000 7f2d7f99f740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560289069390 0x560289440e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:15.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.965+0000 7f2d7f99f740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56028908a070 0x560289441440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:15.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.965+0000 7f2d7f99f740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2d741adc10 con 0x560289069390 2024-09-21T06:44:15.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.965+0000 7f2d7f99f740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2d741af080 con 0x5602890611b0 2024-09-21T06:44:15.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.965+0000 7f2d7f99f740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2d741ae2e0 con 0x56028908a070 2024-09-21T06:44:15.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.965+0000 7f2d7f99f740 10 client.0 _ll_register_callbacks cb 0x7f2d68005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:44:15.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.965+0000 7f2d727fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560289069390 0x560289440e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:15.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.965+0000 7f2d727fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560289069390 0x560289440e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:36976/0 (socket says 172.21.15.7:36976) 2024-09-21T06:44:15.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.965+0000 7f2d727fc640 1 -- 172.21.15.7:0/1949593950 learned_addr learned my addr 172.21.15.7:0/1949593950 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:44:15.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.965+0000 7f2d72ffd640 1 --2- 172.21.15.7:0/1949593950 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5602890611b0 0x560289445960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:15.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.966+0000 7f2d737fe640 1 --2- 172.21.15.7:0/1949593950 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56028908a070 0x560289441440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:15.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.966+0000 7f2d727fc640 1 -- 172.21.15.7:0/1949593950 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56028908a070 msgr2=0x560289441440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:15.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.966+0000 7f2d727fc640 1 --2- 172.21.15.7:0/1949593950 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56028908a070 0x560289441440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:15.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.966+0000 7f2d727fc640 1 -- 172.21.15.7:0/1949593950 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5602890611b0 msgr2=0x560289445960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:15.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.966+0000 7f2d727fc640 1 --2- 172.21.15.7:0/1949593950 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5602890611b0 0x560289445960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:15.970 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.966+0000 7f2d727fc640 1 -- 172.21.15.7:0/1949593950 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560289441bd0 con 0x560289069390 2024-09-21T06:44:15.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.966+0000 7f2d737fe640 1 --2- 172.21.15.7:0/1949593950 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56028908a070 0x560289441440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:44:15.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.966+0000 7f2d727fc640 1 --2- 172.21.15.7:0/1949593950 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560289069390 0x560289440e10 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f2d680186e0 tx=0x7f2d68009e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54ed3e1173584345 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:15.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.966+0000 7f2d56ff5640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:44:15.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.966+0000 7f2d56ff5640 1 -- 172.21.15.7:0/1949593950 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d68028030 con 0x560289069390 2024-09-21T06:44:15.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.966+0000 7f2d56ff5640 1 -- 172.21.15.7:0/1949593950 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(80..80 src has 1..80) ==== 8456+0+0 (secure 0 0 0) 0x7f2d68018e00 con 0x560289069390 2024-09-21T06:44:15.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.966+0000 7f2d7f99f740 1 -- 172.21.15.7:0/1949593950 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2d6801f040 con 0x560289069390 2024-09-21T06:44:15.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.966+0000 7f2d56ff5640 1 -- 172.21.15.7:0/1949593950 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2d680050c0 con 0x560289069390 2024-09-21T06:44:15.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.967+0000 7f2d7f99f740 10 client.17196 fetch_fsmap learned FSMap version 25 2024-09-21T06:44:15.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.967+0000 7f2d7f99f740 1 -- 172.21.15.7:0/1949593950 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5602894b9710 con 0x560289069390 2024-09-21T06:44:15.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.967+0000 7f2d56ff5640 1 -- 172.21.15.7:0/1949593950 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2d6801f040 con 0x560289069390 2024-09-21T06:44:15.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.967+0000 7f2d56ff5640 1 -- 172.21.15.7:0/1949593950 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f2d68018050 con 0x560289069390 2024-09-21T06:44:15.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.967+0000 7f2d7f99f740 10 client.17196 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:44:15.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.967+0000 7f2d7f99f740 10 client.17196 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:44:15.971 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.967+0000 7f2d7f99f740 20 client.17196 populate_metadata read hostname 'smithi007' 2024-09-21T06:44:15.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.967+0000 7f2d7f99f740 1 --2- 172.21.15.7:0/1949593950 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x56028901dda0 0x5602894bbe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:15.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.967+0000 7f2d7f99f740 4 client.17196 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:44:15.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.967+0000 7f2d7f99f740 1 -- 172.21.15.7:0/1949593950 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5602893a5850 con 0x56028901dda0 2024-09-21T06:44:15.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.968+0000 7f2d72ffd640 1 --2- 172.21.15.7:0/1949593950 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x56028901dda0 0x5602894bbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:15.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.968+0000 7f2d56ff5640 10 client.17196 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:44:15.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.968+0000 7f2d72ffd640 1 --2- 172.21.15.7:0/1949593950 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x56028901dda0 0x5602894bbe60 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=807b93a3e047a718 server_cookie=e5f8c50fc6c3a302 in_seq=0 out_seq=0 2024-09-21T06:44:15.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.969+0000 7f2d56ff5640 1 -- 172.21.15.7:0/1949593950 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4350 (crc 0 0 0) 0x5602893a5850 con 0x56028901dda0 2024-09-21T06:44:15.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.969+0000 7f2d56ff5640 10 client.17196 handle_command_reply: tid=0 2024-09-21T06:44:15.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.969+0000 7f2d7f99f740 1 client.17196 shutdown 2024-09-21T06:44:15.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.969+0000 7f2d7f99f740 1 -- 172.21.15.7:0/1949593950 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560289069390 msgr2=0x560289440e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:15.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.969+0000 7f2d7f99f740 1 --2- 172.21.15.7:0/1949593950 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560289069390 0x560289440e10 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f2d680186e0 tx=0x7f2d68009e90 comp rx=0 tx=0).stop 2024-09-21T06:44:15.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.969+0000 7f2d7f99f740 1 -- 172.21.15.7:0/1949593950 shutdown_connections 2024-09-21T06:44:15.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.969+0000 7f2d7f99f740 1 --2- 172.21.15.7:0/1949593950 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x56028901dda0 0x5602894bbe60 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:15.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.969+0000 7f2d7f99f740 1 --2- 172.21.15.7:0/1949593950 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56028908a070 0x560289441440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:15.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.969+0000 7f2d7f99f740 1 --2- 172.21.15.7:0/1949593950 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560289069390 0x560289440e10 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:15.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.969+0000 7f2d7f99f740 1 --2- 172.21.15.7:0/1949593950 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5602890611b0 0x560289445960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:15.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.969+0000 7f2d7f99f740 1 -- 172.21.15.7:0/1949593950 >> 172.21.15.7:0/1949593950 conn(0x56028907e460 msgr2=0x56028943e1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:15.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.969+0000 7f2d56ff5640 0 client.17196 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:44:15.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.969+0000 7f2d7f99f740 1 -- 172.21.15.7:0/1949593950 shutdown_connections 2024-09-21T06:44:15.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.969+0000 7f2d7f99f740 1 -- 172.21.15.7:0/1949593950 wait complete. 2024-09-21T06:44:15.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.969+0000 7f2d7f99f740 20 client.17196 trim_cache size 0 max 16384 2024-09-21T06:44:15.974 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:44:15.974 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "no active scrubs running", 2024-09-21T06:44:15.975 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": {}, 2024-09-21T06:44:15.975 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_stats": { 2024-09-21T06:44:15.975 INFO:teuthology.orchestra.run.smithi007.stdout: "d98b2d47-c2db-4811-8b3e-ec744a20d9d6": { 2024-09-21T06:44:15.975 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:44:03.790680+0000", 2024-09-21T06:44:15.975 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:44:15.975 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:44:15.975 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:44:15.975 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:44:15.975 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:44:15.975 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:44:15.975 INFO:teuthology.orchestra.run.smithi007.stdout: "310a0ec8-44bb-49ed-a534-3bc91cb1ee9d": { 2024-09-21T06:44:15.975 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:40:55.373968+0000", 2024-09-21T06:44:15.975 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:44:15.975 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:44:15.976 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:44:15.976 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:44:15.976 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:44:15.976 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:44:15.976 INFO:teuthology.orchestra.run.smithi007.stdout: "dd792920-08a1-482d-8961-5c6a6f131599": { 2024-09-21T06:44:15.976 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:43:53.390806+0000", 2024-09-21T06:44:15.976 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:44:15.976 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:44:15.976 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:44:15.976 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:44:15.976 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:44:15.976 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:44:15.976 INFO:teuthology.orchestra.run.smithi007.stdout: "13441782-2231-4713-8ebd-068a941de47f": { 2024-09-21T06:44:15.976 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:39:30.219006+0000", 2024-09-21T06:44:15.976 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:44:15.976 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:44:15.976 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:44:15.977 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:44:15.977 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:44:15.977 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:44:15.977 INFO:teuthology.orchestra.run.smithi007.stdout: "b0327167-8c41-4286-8afc-7f0780972fd7": { 2024-09-21T06:44:15.977 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:38:36.828657+0000", 2024-09-21T06:44:15.977 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:44:15.977 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:44:15.977 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:44:15.977 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:44:15.977 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:44:15.977 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:44:15.977 INFO:teuthology.orchestra.run.smithi007.stdout: "d7b6a90c-9ae1-4e02-93ad-335a7e9df1d7": { 2024-09-21T06:44:15.977 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:39:19.226139+0000", 2024-09-21T06:44:15.977 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:44:15.977 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:44:15.977 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:44:15.978 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:44:15.978 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:44:15.978 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:44:15.978 INFO:teuthology.orchestra.run.smithi007.stdout: "3f7283b7-f175-4023-9191-177660b3a6be": { 2024-09-21T06:44:15.978 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:44:14.422552+0000", 2024-09-21T06:44:15.978 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:44:15.978 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:44:15.978 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:44:15.978 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:44:15.978 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:44:15.978 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:44:15.978 INFO:teuthology.orchestra.run.smithi007.stdout: "6231e9c1-14a2-40b5-be3c-76d87a0d733b": { 2024-09-21T06:44:15.978 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:37:02.484812+0000", 2024-09-21T06:44:15.978 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:44:15.978 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:44:15.979 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:44:15.979 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:44:15.979 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:44:15.979 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:44:15.979 INFO:teuthology.orchestra.run.smithi007.stdout: "a1ae5b3b-f158-44be-8ef4-d70e9ba879cc": { 2024-09-21T06:44:15.979 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:41:37.568453+0000", 2024-09-21T06:44:15.979 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:44:15.979 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:44:15.979 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:44:15.979 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:44:15.979 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:44:15.979 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:44:15.979 INFO:teuthology.orchestra.run.smithi007.stdout: "62fca477-b241-45f5-8185-bc78aeb8b19f": { 2024-09-21T06:44:15.979 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:40:12.744488+0000", 2024-09-21T06:44:15.980 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:44:15.980 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:44:15.980 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:44:15.980 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:44:15.980 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:44:15.980 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:44:15.980 INFO:teuthology.orchestra.run.smithi007.stdout: "5cbaaba2-6ab1-4f83-abd6-8c6eef4b5c42": { 2024-09-21T06:44:15.980 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:37:46.566272+0000", 2024-09-21T06:44:15.980 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:44:15.980 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:44:15.980 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:44:15.980 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:44:15.980 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:44:15.980 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:44:15.981 INFO:teuthology.orchestra.run.smithi007.stdout: "b466f071-ab32-427c-a0ed-73edea33145e": { 2024-09-21T06:44:15.981 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:43:01.151440+0000", 2024-09-21T06:44:15.981 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:44:15.981 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:44:15.981 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:44:15.981 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:44:15.981 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:44:15.981 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:44:15.981 INFO:teuthology.orchestra.run.smithi007.stdout: "ef9eaabd-003a-44fb-8373-c854a9e15a71": { 2024-09-21T06:44:15.981 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:42:19.467946+0000", 2024-09-21T06:44:15.981 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:44:15.981 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:44:15.981 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:44:15.981 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:44:15.982 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:44:15.982 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:44:15.982 INFO:teuthology.orchestra.run.smithi007.stdout: "0b89345c-1f00-4efe-8ee9-4cb17e43584c": { 2024-09-21T06:44:15.982 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:36:19.500334+0000", 2024-09-21T06:44:15.982 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:44:15.982 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:44:15.982 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:44:15.982 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:44:15.982 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:44:15.982 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:44:15.982 INFO:teuthology.orchestra.run.smithi007.stdout: "3c5b7f3f-e9b3-4d48-8154-2d7d4700992e": { 2024-09-21T06:44:15.982 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:43:43.120930+0000", 2024-09-21T06:44:15.982 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:44:15.982 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:44:15.983 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:44:15.983 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:44:15.983 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:44:15.983 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:44:15.983 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:44:15.983 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:44:15.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.970+0000 7f2d7942b640 1 -- 172.21.15.7:0/4282864185 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f2d5c0b6680 msgr2=0x7f2d5c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:15.983 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.970+0000 7f2d7942b640 1 --2- 172.21.15.7:0/4282864185 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f2d5c0b6680 0x7f2d5c0b8b90 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c005ab0 tx=0x7f2d6c005a40 comp rx=0 tx=0).stop 2024-09-21T06:44:15.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.970+0000 7f2d7942b640 1 -- 172.21.15.7:0/4282864185 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d74103b60 msgr2=0x7f2d7419a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:15.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.970+0000 7f2d7942b640 1 --2- 172.21.15.7:0/4282864185 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d74103b60 0x7f2d7419a420 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f2d6400ea80 tx=0x7f2d6400ef40 comp rx=0 tx=0).stop 2024-09-21T06:44:15.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.970+0000 7f2d7942b640 1 -- 172.21.15.7:0/4282864185 shutdown_connections 2024-09-21T06:44:15.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.970+0000 7f2d7942b640 1 --2- 172.21.15.7:0/4282864185 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f2d5c0b6680 0x7f2d5c0b8b90 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:15.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.970+0000 7f2d7942b640 1 --2- 172.21.15.7:0/4282864185 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2d74109df0 0x7f2d7419fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:15.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.970+0000 7f2d7942b640 1 --2- 172.21.15.7:0/4282864185 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2d741094a0 0x7f2d7419a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:15.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.970+0000 7f2d7942b640 1 --2- 172.21.15.7:0/4282864185 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2d74103b60 0x7f2d7419a420 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:15.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.970+0000 7f2d7942b640 1 -- 172.21.15.7:0/4282864185 >> 172.21.15.7:0/4282864185 conn(0x7f2d7407b850 msgr2=0x7f2d741074f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:15.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.970+0000 7f2d7942b640 1 -- 172.21.15.7:0/4282864185 shutdown_connections 2024-09-21T06:44:15.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:15.970+0000 7f2d7942b640 1 -- 172.21.15.7:0/4282864185 wait complete. 2024-09-21T06:44:16.768 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:44:16.768 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:44:17.029 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:44:17.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:44:16 smithi144 ceph-mon[34653]: pgmap v564: 97 pgs: 97 active+clean; 3.3 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 204 B/s wr, 7 op/s 2024-09-21T06:44:17.292 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:44:16 smithi007 ceph-mon[30983]: pgmap v564: 97 pgs: 97 active+clean; 3.3 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 204 B/s wr, 7 op/s 2024-09-21T06:44:17.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:44:16 smithi018 ceph-mon[34477]: pgmap v564: 97 pgs: 97 active+clean; 3.3 MiB data, 413 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 204 B/s wr, 7 op/s 2024-09-21T06:44:17.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:17.523+0000 7f1f73831640 1 -- 172.21.15.7:0/1556013155 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f6c105380 msgr2=0x7f1f6c10d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:17.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:17.523+0000 7f1f73831640 1 --2- 172.21.15.7:0/1556013155 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f6c105380 0x7f1f6c10d8d0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c009900 tx=0x7f1f5c02a410 comp rx=0 tx=0).stop 2024-09-21T06:44:17.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:17.523+0000 7f1f73831640 1 -- 172.21.15.7:0/1556013155 shutdown_connections 2024-09-21T06:44:17.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:17.523+0000 7f1f73831640 1 --2- 172.21.15.7:0/1556013155 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1f6c10de60 0x7f1f6c110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:17.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:17.523+0000 7f1f73831640 1 --2- 172.21.15.7:0/1556013155 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f6c105380 0x7f1f6c10d8d0 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:17.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:17.523+0000 7f1f73831640 1 --2- 172.21.15.7:0/1556013155 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f6c104a30 0x7f1f6c104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:17.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:17.523+0000 7f1f73831640 1 -- 172.21.15.7:0/1556013155 >> 172.21.15.7:0/1556013155 conn(0x7f1f6c0797b0 msgr2=0x7f1f6c079bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:17.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:17.523+0000 7f1f73831640 1 -- 172.21.15.7:0/1556013155 shutdown_connections 2024-09-21T06:44:17.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:17.523+0000 7f1f73831640 1 -- 172.21.15.7:0/1556013155 wait complete. 2024-09-21T06:44:17.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:17.524+0000 7f1f73831640 1 Processor -- start 2024-09-21T06:44:17.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:17.524+0000 7f1f73831640 1 -- start start 2024-09-21T06:44:17.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:17.524+0000 7f1f73831640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f6c104a30 0x7f1f6c19a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:17.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:17.524+0000 7f1f73831640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1f6c105380 0x7f1f6c19aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:17.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:17.524+0000 7f1f73831640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f6c10de60 0x7f1f6c19fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:17.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:17.524+0000 7f1f73831640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f1f6c113b00 con 0x7f1f6c104a30 2024-09-21T06:44:17.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:17.524+0000 7f1f73831640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1f6c113980 con 0x7f1f6c10de60 2024-09-21T06:44:17.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:17.524+0000 7f1f73831640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f1f6c113c80 con 0x7f1f6c105380 2024-09-21T06:44:17.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:17.525+0000 7f1f715cd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f6c104a30 0x7f1f6c19a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:17.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:17.525+0000 7f1f715cd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f6c104a30 0x7f1f6c19a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37006/0 (socket says 172.21.15.7:37006) 2024-09-21T06:44:17.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:17.525+0000 7f1f715cd640 1 -- 172.21.15.7:0/1696196936 learned_addr learned my addr 172.21.15.7:0/1696196936 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:44:17.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:17.525+0000 7f1f71dce640 1 --2- 172.21.15.7:0/1696196936 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f6c10de60 0x7f1f6c19fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:17.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:17.525+0000 7f1f70dcc640 1 --2- 172.21.15.7:0/1696196936 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1f6c105380 0x7f1f6c19aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:17.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:17.525+0000 7f1f715cd640 1 -- 172.21.15.7:0/1696196936 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1f6c105380 msgr2=0x7f1f6c19aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:17.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:17.525+0000 7f1f715cd640 1 --2- 172.21.15.7:0/1696196936 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1f6c105380 0x7f1f6c19aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:17.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:17.525+0000 7f1f715cd640 1 -- 172.21.15.7:0/1696196936 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f6c10de60 msgr2=0x7f1f6c19fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:17.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:17.525+0000 7f1f715cd640 1 --2- 172.21.15.7:0/1696196936 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f6c10de60 0x7f1f6c19fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:17.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:17.525+0000 7f1f715cd640 1 -- 172.21.15.7:0/1696196936 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f6c1a04c0 con 0x7f1f6c104a30 2024-09-21T06:44:17.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:17.525+0000 7f1f71dce640 1 --2- 172.21.15.7:0/1696196936 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f6c10de60 0x7f1f6c19fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:44:17.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:17.525+0000 7f1f70dcc640 1 --2- 172.21.15.7:0/1696196936 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1f6c105380 0x7f1f6c19aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:44:17.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:17.525+0000 7f1f715cd640 1 --2- 172.21.15.7:0/1696196936 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f6c104a30 0x7f1f6c19a550 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f1f6800d950 tx=0x7f1f6800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:17.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:17.525+0000 7f1f627fc640 1 -- 172.21.15.7:0/1696196936 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f68017030 con 0x7f1f6c104a30 2024-09-21T06:44:17.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:17.525+0000 7f1f73831640 1 -- 172.21.15.7:0/1696196936 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f6c1a07b0 con 0x7f1f6c104a30 2024-09-21T06:44:17.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:17.525+0000 7f1f627fc640 1 -- 172.21.15.7:0/1696196936 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1f68004020 con 0x7f1f6c104a30 2024-09-21T06:44:17.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:17.525+0000 7f1f627fc640 1 -- 172.21.15.7:0/1696196936 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f680047a0 con 0x7f1f6c104a30 2024-09-21T06:44:17.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:17.525+0000 7f1f73831640 1 -- 172.21.15.7:0/1696196936 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f6c1a6f10 con 0x7f1f6c104a30 2024-09-21T06:44:17.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:17.526+0000 7f1f73831640 1 -- 172.21.15.7:0/1696196936 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f6c104e40 con 0x7f1f6c104a30 2024-09-21T06:44:17.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:17.528+0000 7f1f627fc640 1 -- 172.21.15.7:0/1696196936 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f1f68009a30 con 0x7f1f6c104a30 2024-09-21T06:44:17.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:17.529+0000 7f1f627fc640 1 --2- 172.21.15.7:0/1696196936 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f1f580b6680 0x7f1f580b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:17.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:17.529+0000 7f1f70dcc640 1 --2- 172.21.15.7:0/1696196936 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f1f580b6680 0x7f1f580b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:17.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:17.529+0000 7f1f627fc640 1 -- 172.21.15.7:0/1696196936 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8456+0+0 (secure 0 0 0) 0x7f1f680e7930 con 0x7f1f6c104a30 2024-09-21T06:44:17.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:17.529+0000 7f1f70dcc640 1 --2- 172.21.15.7:0/1696196936 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f1f580b6680 0x7f1f580b8b90 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c000c00 tx=0x7f1f5c031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:17.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:17.532+0000 7f1f627fc640 1 -- 172.21.15.7:0/1696196936 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1f680ade60 con 0x7f1f6c104a30 2024-09-21T06:44:17.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:17.761+0000 7f1f73831640 1 -- 172.21.15.7:0/1696196936 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1f6c19b680 con 0x7f1f6c104a30 2024-09-21T06:44:17.763 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:17.762+0000 7f1f627fc640 1 -- 172.21.15.7:0/1696196936 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11899 (secure 0 0 0) 0x7f1f680b2240 con 0x7f1f6c104a30 2024-09-21T06:44:17.763 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:44:17.764 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-21T06:36:10:753693+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2015971546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2015971546},{"type":"v1","addr":"172.21.15.7:6835","nonce":2015971546}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/2350816224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":2350816224},{"type":"v1","addr":"172.21.15.7:6837","nonce":2350816224}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14823,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/1669980572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":1669980572},{"type":"v1","addr":"172.21.15.7:6839","nonce":1669980572}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14835,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/2528308973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":2528308973},{"type":"v1","addr":"172.21.15.7:6841","nonce":2528308973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24623,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1337382979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1337382979},{"type":"v1","addr":"172.21.15.18:6833","nonce":1337382979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/2751454345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":2751454345},{"type":"v1","addr":"172.21.15.144:6833","nonce":2751454345}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:34:24.627168+0000","modified":"2024-09-21T06:36:10.737288+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24716,"mds_1":24688,"mds_2":24686},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24656":{"gid":24656,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6835/158884796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":158884796},{"type":"v1","addr":"172.21.15.18:6835","nonce":158884796}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6835/3636739922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3636739922},{"type":"v1","addr":"172.21.15.144:6835","nonce":3636739922}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24673":{"gid":24673,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6837/1126341753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":1126341753},{"type":"v1","addr":"172.21.15.144:6837","nonce":1126341753}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.18:6837/1539670694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1539670694},{"type":"v1","addr":"172.21.15.18:6837","nonce":1539670694}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24688":{"gid":24688,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.144:6839/4027821922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":4027821922},{"type":"v1","addr":"172.21.15.144:6839","nonce":4027821922}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24716":{"gid":24716,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.18:6839/3798713532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":3798713532},{"type":"v1","addr":"172.21.15.18:6839","nonce":3798713532}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24716,"qdb_cluster":[24716,24688,24686]},"id":1}]} 2024-09-21T06:44:17.764 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-21T06:44:17.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:17.764+0000 7f1f73831640 1 -- 172.21.15.7:0/1696196936 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f1f580b6680 msgr2=0x7f1f580b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:17.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:17.764+0000 7f1f73831640 1 --2- 172.21.15.7:0/1696196936 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f1f580b6680 0x7f1f580b8b90 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f1f5c000c00 tx=0x7f1f5c031400 comp rx=0 tx=0).stop 2024-09-21T06:44:17.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:17.764+0000 7f1f73831640 1 -- 172.21.15.7:0/1696196936 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f6c104a30 msgr2=0x7f1f6c19a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:17.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:17.764+0000 7f1f73831640 1 --2- 172.21.15.7:0/1696196936 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f6c104a30 0x7f1f6c19a550 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f1f6800d950 tx=0x7f1f6800de10 comp rx=0 tx=0).stop 2024-09-21T06:44:17.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:17.764+0000 7f1f73831640 1 -- 172.21.15.7:0/1696196936 shutdown_connections 2024-09-21T06:44:17.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:17.764+0000 7f1f73831640 1 --2- 172.21.15.7:0/1696196936 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f1f580b6680 0x7f1f580b8b90 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:17.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:17.764+0000 7f1f73831640 1 --2- 172.21.15.7:0/1696196936 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1f6c10de60 0x7f1f6c19fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:17.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:17.764+0000 7f1f73831640 1 --2- 172.21.15.7:0/1696196936 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f1f6c105380 0x7f1f6c19aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:17.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:17.764+0000 7f1f73831640 1 --2- 172.21.15.7:0/1696196936 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f1f6c104a30 0x7f1f6c19a550 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:17.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:17.764+0000 7f1f73831640 1 -- 172.21.15.7:0/1696196936 >> 172.21.15.7:0/1696196936 conn(0x7f1f6c0797b0 msgr2=0x7f1f6c0ff790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:17.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:17.764+0000 7f1f73831640 1 -- 172.21.15.7:0/1696196936 shutdown_connections 2024-09-21T06:44:17.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:17.764+0000 7f1f73831640 1 -- 172.21.15.7:0/1696196936 wait complete. 2024-09-21T06:44:18.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:44:17 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/1696196936' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:44:18.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:44:17 smithi007 ceph-mon[30983]: osdmap e81: 12 total, 12 up, 12 in 2024-09-21T06:44:18.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:44:17 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/1696196936' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:44:18.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:44:17 smithi144 ceph-mon[34653]: osdmap e81: 12 total, 12 up, 12 in 2024-09-21T06:44:18.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:44:17 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/1696196936' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:44:18.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:44:17 smithi018 ceph-mon[34477]: osdmap e81: 12 total, 12 up, 12 in 2024-09-21T06:44:18.419 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:44:18.675 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:44:19.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:44:18 smithi007 ceph-mon[30983]: pgmap v565: 97 pgs: 97 active+clean; 3.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 204 B/s wr, 7 op/s 2024-09-21T06:44:19.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.203+0000 7fbc98ba8640 1 -- 172.21.15.7:0/2089012654 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc941083b0 msgr2=0x7fbc941087c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:19.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.203+0000 7fbc98ba8640 1 --2- 172.21.15.7:0/2089012654 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc941083b0 0x7fbc941087c0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fbc88009900 tx=0x7fbc8802a410 comp rx=0 tx=0).stop 2024-09-21T06:44:19.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.203+0000 7fbc98ba8640 1 -- 172.21.15.7:0/2089012654 shutdown_connections 2024-09-21T06:44:19.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.203+0000 7fbc98ba8640 1 --2- 172.21.15.7:0/2089012654 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc94108d00 0x7fbc9410f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:19.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.203+0000 7fbc98ba8640 1 --2- 172.21.15.7:0/2089012654 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc941083b0 0x7fbc941087c0 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:19.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.203+0000 7fbc98ba8640 1 --2- 172.21.15.7:0/2089012654 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc94102a70 0x7fbc94102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:19.212 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.203+0000 7fbc98ba8640 1 -- 172.21.15.7:0/2089012654 >> 172.21.15.7:0/2089012654 conn(0x7fbc94079710 msgr2=0x7fbc94079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:19.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.203+0000 7fbc98ba8640 1 -- 172.21.15.7:0/2089012654 shutdown_connections 2024-09-21T06:44:19.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.203+0000 7fbc98ba8640 1 -- 172.21.15.7:0/2089012654 wait complete. 2024-09-21T06:44:19.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.204+0000 7fbc98ba8640 1 Processor -- start 2024-09-21T06:44:19.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.204+0000 7fbc98ba8640 1 -- start start 2024-09-21T06:44:19.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.204+0000 7fbc98ba8640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc94102a70 0x7fbc9419a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:19.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.204+0000 7fbc98ba8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc941083b0 0x7fbc9419aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:19.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.204+0000 7fbc98ba8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc94108d00 0x7fbc9419fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:19.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.204+0000 7fbc98ba8640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbc94113ae0 con 0x7fbc941083b0 2024-09-21T06:44:19.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.204+0000 7fbc98ba8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fbc94113960 con 0x7fbc94108d00 2024-09-21T06:44:19.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.204+0000 7fbc98ba8640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fbc94113c60 con 0x7fbc94102a70 2024-09-21T06:44:19.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.205+0000 7fbc91d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc941083b0 0x7fbc9419aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:19.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.205+0000 7fbc91d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc941083b0 0x7fbc9419aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37024/0 (socket says 172.21.15.7:37024) 2024-09-21T06:44:19.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.205+0000 7fbc91d9b640 1 -- 172.21.15.7:0/2016741090 learned_addr learned my addr 172.21.15.7:0/2016741090 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:44:19.213 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.205+0000 7fbc9259c640 1 --2- 172.21.15.7:0/2016741090 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc94102a70 0x7fbc9419a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:19.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.205+0000 7fbc92d9d640 1 --2- 172.21.15.7:0/2016741090 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc94108d00 0x7fbc9419fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:19.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.205+0000 7fbc91d9b640 1 -- 172.21.15.7:0/2016741090 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc94102a70 msgr2=0x7fbc9419a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:19.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.205+0000 7fbc91d9b640 1 --2- 172.21.15.7:0/2016741090 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc94102a70 0x7fbc9419a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:19.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.205+0000 7fbc91d9b640 1 -- 172.21.15.7:0/2016741090 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc94108d00 msgr2=0x7fbc9419fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:19.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.205+0000 7fbc91d9b640 1 --2- 172.21.15.7:0/2016741090 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc94108d00 0x7fbc9419fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:19.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.205+0000 7fbc91d9b640 1 -- 172.21.15.7:0/2016741090 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc941a03a0 con 0x7fbc941083b0 2024-09-21T06:44:19.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.205+0000 7fbc91d9b640 1 --2- 172.21.15.7:0/2016741090 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc941083b0 0x7fbc9419aa90 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fbc88006010 tx=0x7fbc88004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:19.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.205+0000 7fbc837fe640 1 -- 172.21.15.7:0/2016741090 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc8803f030 con 0x7fbc941083b0 2024-09-21T06:44:19.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.205+0000 7fbc837fe640 1 -- 172.21.15.7:0/2016741090 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc88003aa0 con 0x7fbc941083b0 2024-09-21T06:44:19.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.205+0000 7fbc837fe640 1 -- 172.21.15.7:0/2016741090 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc88035070 con 0x7fbc941083b0 2024-09-21T06:44:19.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.205+0000 7fbc98ba8640 1 -- 172.21.15.7:0/2016741090 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc941a0630 con 0x7fbc941083b0 2024-09-21T06:44:19.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.205+0000 7fbc98ba8640 1 -- 172.21.15.7:0/2016741090 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc941a0ac0 con 0x7fbc941083b0 2024-09-21T06:44:19.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.208+0000 7fbc9f11c740 1 Processor -- start 2024-09-21T06:44:19.214 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.209+0000 7fbc9f11c740 1 -- start start 2024-09-21T06:44:19.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.209+0000 7fbc9f11c740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5584ea499070 0x5584ea8406a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:19.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.209+0000 7fbc9f11c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5584ea4701b0 0x5584ea840be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:19.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.209+0000 7fbc837fe640 1 -- 172.21.15.7:0/2016741090 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7fbc88042030 con 0x7fbc941083b0 2024-09-21T06:44:19.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.209+0000 7fbc9f11c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5584ea478390 0x5584ea841120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:19.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.209+0000 7fbc9f11c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5584ea7b6ea0 con 0x5584ea478390 2024-09-21T06:44:19.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.209+0000 7fbc9f11c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5584ea7a62d0 con 0x5584ea4701b0 2024-09-21T06:44:19.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.209+0000 7fbc9f11c740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5584ea7aa0e0 con 0x5584ea499070 2024-09-21T06:44:19.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.209+0000 7fbc91d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5584ea478390 0x5584ea841120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:19.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.209+0000 7fbc92d9d640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5584ea499070 0x5584ea8406a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:19.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.209+0000 7fbc9259c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5584ea4701b0 0x5584ea840be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:19.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.209+0000 7fbc9259c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5584ea4701b0 0x5584ea840be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.7:53628/0 (socket says 172.21.15.7:53628) 2024-09-21T06:44:19.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.209+0000 7fbc92d9d640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5584ea499070 0x5584ea8406a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.7:57340/0 (socket says 172.21.15.7:57340) 2024-09-21T06:44:19.215 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.209+0000 7fbc91d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5584ea478390 0x5584ea841120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37028/0 (socket says 172.21.15.7:37028) 2024-09-21T06:44:19.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.209+0000 7fbc9259c640 1 -- 172.21.15.7:0/1749592184 learned_addr learned my addr 172.21.15.7:0/1749592184 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:44:19.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.210+0000 7fbc9259c640 1 -- 172.21.15.7:0/1749592184 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5584ea499070 msgr2=0x5584ea8406a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:19.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.210+0000 7fbc9259c640 1 --2- 172.21.15.7:0/1749592184 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5584ea499070 0x5584ea8406a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:19.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.210+0000 7fbc9259c640 1 -- 172.21.15.7:0/1749592184 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5584ea478390 msgr2=0x5584ea841120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:19.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.210+0000 7fbc9259c640 1 --2- 172.21.15.7:0/1749592184 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5584ea478390 0x5584ea841120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:19.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.210+0000 7fbc9259c640 1 -- 172.21.15.7:0/1749592184 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584ea504650 con 0x5584ea4701b0 2024-09-21T06:44:19.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.210+0000 7fbc91d9b640 1 --2- 172.21.15.7:0/1749592184 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5584ea478390 0x5584ea841120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:44:19.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.210+0000 7fbc9259c640 1 --2- 172.21.15.7:0/1749592184 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5584ea4701b0 0x5584ea840be0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbc84009cf0 tx=0x7fbc84011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67b848614852909 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:19.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.210+0000 7fbc837fe640 1 --2- 172.21.15.7:0/2016741090 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fbc7c0b66b0 0x7fbc7c0b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:19.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.210+0000 7fbc80ff9640 1 -- 172.21.15.7:0/1749592184 <== mon.2 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc84004230 con 0x5584ea4701b0 2024-09-21T06:44:19.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.210+0000 7fbc80ff9640 1 -- 172.21.15.7:0/1749592184 <== mon.2 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc840043d0 con 0x5584ea4701b0 2024-09-21T06:44:19.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.210+0000 7fbc837fe640 1 -- 172.21.15.7:0/2016741090 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8412+0+0 (secure 0 0 0) 0x7fbc88107bc0 con 0x7fbc941083b0 2024-09-21T06:44:19.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.210+0000 7fbc80ff9640 1 -- 172.21.15.7:0/1749592184 <== mon.2 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc84019880 con 0x5584ea4701b0 2024-09-21T06:44:19.216 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.210+0000 7fbc92d9d640 1 --2- 172.21.15.7:0/2016741090 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fbc7c0b66b0 0x7fbc7c0b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:19.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.211+0000 7fbc9f11c740 1 -- 172.21.15.7:0/1749592184 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5584ea4701b0 msgr2=0x5584ea840be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:19.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.211+0000 7fbc92d9d640 1 --2- 172.21.15.7:0/2016741090 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fbc7c0b66b0 0x7fbc7c0b8bc0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c007ed0 tx=0x7fbc8c007680 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:19.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.211+0000 7fbc9f11c740 1 --2- 172.21.15.7:0/1749592184 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5584ea4701b0 0x5584ea840be0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbc84009cf0 tx=0x7fbc84011810 comp rx=0 tx=0).stop 2024-09-21T06:44:19.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.211+0000 7fbc9f11c740 1 -- 172.21.15.7:0/1749592184 shutdown_connections 2024-09-21T06:44:19.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.211+0000 7fbc9f11c740 1 --2- 172.21.15.7:0/1749592184 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5584ea478390 0x5584ea841120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:19.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.211+0000 7fbc9f11c740 1 --2- 172.21.15.7:0/1749592184 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5584ea4701b0 0x5584ea840be0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:19.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.211+0000 7fbc9f11c740 1 --2- 172.21.15.7:0/1749592184 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5584ea499070 0x5584ea8406a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:19.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.211+0000 7fbc9f11c740 1 -- 172.21.15.7:0/1749592184 >> 172.21.15.7:0/1749592184 conn(0x5584ea48d460 msgr2=0x5584ea83e590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:19.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.211+0000 7fbc9f11c740 1 -- 172.21.15.7:0/1749592184 shutdown_connections 2024-09-21T06:44:19.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.211+0000 7fbc9f11c740 1 -- 172.21.15.7:0/1749592184 wait complete. 2024-09-21T06:44:19.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.212+0000 7fbc9f11c740 1 -- start start 2024-09-21T06:44:19.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.212+0000 7fbc9f11c740 1 Processor -- start 2024-09-21T06:44:19.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.212+0000 7fbc9f11c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5584ea4701b0 0x5584ea8501a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:19.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.212+0000 7fbc9f11c740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5584ea478390 0x5584ea8506e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:19.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.212+0000 7fbc9f11c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5584ea499070 0x5584ea85c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:19.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.212+0000 7fbc9f11c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5584ea607700 con 0x5584ea499070 2024-09-21T06:44:19.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.212+0000 7fbc9f11c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5584ea741160 con 0x5584ea4701b0 2024-09-21T06:44:19.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.212+0000 7fbc9f11c740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5584ea853120 con 0x5584ea478390 2024-09-21T06:44:19.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.212+0000 7fbc9f11c740 10 client.0 _ll_register_callbacks cb 0x5584ea75a9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:44:19.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.212+0000 7fbc92d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5584ea499070 0x5584ea85c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:19.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.212+0000 7fbc92d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5584ea499070 0x5584ea85c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37040/0 (socket says 172.21.15.7:37040) 2024-09-21T06:44:19.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.213+0000 7fbc92d9d640 1 -- 172.21.15.7:0/2936898484 learned_addr learned my addr 172.21.15.7:0/2936898484 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:44:19.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.213+0000 7fbc9259c640 1 --2- 172.21.15.7:0/2936898484 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5584ea4701b0 0x5584ea8501a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:19.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.213+0000 7fbc91d9b640 1 --2- 172.21.15.7:0/2936898484 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5584ea478390 0x5584ea8506e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:19.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.213+0000 7fbc92d9d640 1 -- 172.21.15.7:0/2936898484 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5584ea478390 msgr2=0x5584ea8506e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:19.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.213+0000 7fbc92d9d640 1 --2- 172.21.15.7:0/2936898484 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5584ea478390 0x5584ea8506e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:19.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.213+0000 7fbc92d9d640 1 -- 172.21.15.7:0/2936898484 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5584ea4701b0 msgr2=0x5584ea8501a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:19.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.213+0000 7fbc92d9d640 1 --2- 172.21.15.7:0/2936898484 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5584ea4701b0 0x5584ea8501a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:19.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.213+0000 7fbc92d9d640 1 -- 172.21.15.7:0/2936898484 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584ea76ec90 con 0x5584ea499070 2024-09-21T06:44:19.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.213+0000 7fbc92d9d640 1 --2- 172.21.15.7:0/2936898484 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5584ea499070 0x5584ea85c450 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c00edc0 tx=0x7fbc8c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f2b508fecc3968 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:19.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.213+0000 7fbc79ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:44:19.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.213+0000 7fbc79ffb640 1 -- 172.21.15.7:0/2936898484 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc8c01cd30 con 0x5584ea499070 2024-09-21T06:44:19.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.213+0000 7fbc9f11c740 1 -- 172.21.15.7:0/2936898484 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc840043d0 con 0x5584ea499070 2024-09-21T06:44:19.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.213+0000 7fbc79ffb640 1 -- 172.21.15.7:0/2936898484 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8412+0+0 (secure 0 0 0) 0x7fbc8c01d410 con 0x5584ea499070 2024-09-21T06:44:19.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.213+0000 7fbc79ffb640 1 -- 172.21.15.7:0/2936898484 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fbc8c01d610 con 0x5584ea499070 2024-09-21T06:44:19.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.213+0000 7fbc9f11c740 10 client.17214 fetch_fsmap learned FSMap version 25 2024-09-21T06:44:19.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.213+0000 7fbc9f11c740 1 -- 172.21.15.7:0/2936898484 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5584ea85ef20 con 0x5584ea499070 2024-09-21T06:44:19.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.214+0000 7fbc79ffb640 1 -- 172.21.15.7:0/2936898484 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc840043d0 con 0x5584ea499070 2024-09-21T06:44:19.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.214+0000 7fbc79ffb640 1 -- 172.21.15.7:0/2936898484 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fbc8c030050 con 0x5584ea499070 2024-09-21T06:44:19.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.214+0000 7fbc9f11c740 10 client.17214 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:44:19.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.214+0000 7fbc9f11c740 10 client.17214 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-21T06:44:19.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.214+0000 7fbc9f11c740 20 client.17214 populate_metadata read hostname 'smithi007' 2024-09-21T06:44:19.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.214+0000 7fbc9f11c740 1 --2- 172.21.15.7:0/2936898484 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x5584ea4579f0 0x5584ea8623c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:19.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.214+0000 7fbc9f11c740 4 client.17214 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:44:19.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.214+0000 7fbc9f11c740 1 -- 172.21.15.7:0/2936898484 --> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5584ea7b8df0 con 0x5584ea4579f0 2024-09-21T06:44:19.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.214+0000 7fbc9259c640 1 --2- 172.21.15.7:0/2936898484 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x5584ea4579f0 0x5584ea8623c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:19.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.215+0000 7fbc9259c640 1 --2- 172.21.15.7:0/2936898484 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x5584ea4579f0 0x5584ea8623c0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d1ec6fe9aba03dd0 server_cookie=e4616d02def5869e in_seq=0 out_seq=0 2024-09-21T06:44:19.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.215+0000 7fbc79ffb640 10 client.17214 ms_handle_connect on v2:172.21.15.18:6836/1539670694 2024-09-21T06:44:19.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.215+0000 7fbc79ffb640 1 -- 172.21.15.7:0/2936898484 <== mds.2 v2:172.21.15.18:6836/1539670694 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5584ea7b8df0 con 0x5584ea4579f0 2024-09-21T06:44:19.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.215+0000 7fbc79ffb640 10 client.17214 handle_command_reply: tid=0 2024-09-21T06:44:19.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.215+0000 7fbc9f11c740 1 client.17214 shutdown 2024-09-21T06:44:19.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.216+0000 7fbc9f11c740 1 -- 172.21.15.7:0/2936898484 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5584ea499070 msgr2=0x5584ea85c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:19.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.216+0000 7fbc9f11c740 1 --2- 172.21.15.7:0/2936898484 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5584ea499070 0x5584ea85c450 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c00edc0 tx=0x7fbc8c004a40 comp rx=0 tx=0).stop 2024-09-21T06:44:19.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.216+0000 7fbc9f11c740 1 -- 172.21.15.7:0/2936898484 shutdown_connections 2024-09-21T06:44:19.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.216+0000 7fbc9f11c740 1 --2- 172.21.15.7:0/2936898484 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x5584ea4579f0 0x5584ea8623c0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:19.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.216+0000 7fbc9f11c740 1 --2- 172.21.15.7:0/2936898484 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5584ea499070 0x5584ea85c450 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:19.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.216+0000 7fbc9f11c740 1 --2- 172.21.15.7:0/2936898484 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5584ea478390 0x5584ea8506e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:19.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.216+0000 7fbc9f11c740 1 --2- 172.21.15.7:0/2936898484 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5584ea4701b0 0x5584ea8501a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:19.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.216+0000 7fbc9f11c740 1 -- 172.21.15.7:0/2936898484 >> 172.21.15.7:0/2936898484 conn(0x5584ea48d460 msgr2=0x5584ea842090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:19.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.216+0000 7fbc79ffb640 0 client.17214 ms_handle_reset on v2:172.21.15.18:6836/1539670694 2024-09-21T06:44:19.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.216+0000 7fbc9f11c740 1 -- 172.21.15.7:0/2936898484 shutdown_connections 2024-09-21T06:44:19.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.216+0000 7fbc9f11c740 1 -- 172.21.15.7:0/2936898484 wait complete. 2024-09-21T06:44:19.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.216+0000 7fbc9f11c740 20 client.17214 trim_cache size 0 max 16384 2024-09-21T06:44:19.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.229+0000 7fbc9f11c740 1 Processor -- start 2024-09-21T06:44:19.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.229+0000 7fbc9f11c740 1 -- start start 2024-09-21T06:44:19.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.229+0000 7fbc9f11c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5584ea4701b0 0x5584ea8392d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:19.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.229+0000 7fbc9f11c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5584ea478390 0x5584ea84ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:19.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.229+0000 7fbc9f11c740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5584ea499070 0x5584ea84ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:19.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.229+0000 7fbc9f11c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbc941afc20 con 0x5584ea4701b0 2024-09-21T06:44:19.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.229+0000 7fbc9f11c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fbc941ad4f0 con 0x5584ea478390 2024-09-21T06:44:19.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.229+0000 7fbc9f11c740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fbc941ab380 con 0x5584ea499070 2024-09-21T06:44:19.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.229+0000 7fbc9259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5584ea4701b0 0x5584ea8392d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:19.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.230+0000 7fbc9259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5584ea4701b0 0x5584ea8392d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37056/0 (socket says 172.21.15.7:37056) 2024-09-21T06:44:19.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.230+0000 7fbc9259c640 1 -- 172.21.15.7:0/1505109910 learned_addr learned my addr 172.21.15.7:0/1505109910 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:44:19.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.230+0000 7fbc91d9b640 1 --2- 172.21.15.7:0/1505109910 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5584ea478390 0x5584ea84ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:19.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.230+0000 7fbc92d9d640 1 --2- 172.21.15.7:0/1505109910 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5584ea499070 0x5584ea84ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:19.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.230+0000 7fbc9259c640 1 -- 172.21.15.7:0/1505109910 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5584ea499070 msgr2=0x5584ea84ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:19.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.230+0000 7fbc9259c640 1 --2- 172.21.15.7:0/1505109910 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5584ea499070 0x5584ea84ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:19.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.230+0000 7fbc9259c640 1 -- 172.21.15.7:0/1505109910 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5584ea478390 msgr2=0x5584ea84ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:19.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.230+0000 7fbc9259c640 1 --2- 172.21.15.7:0/1505109910 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5584ea478390 0x5584ea84ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:19.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.230+0000 7fbc9259c640 1 -- 172.21.15.7:0/1505109910 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584ea842df0 con 0x5584ea4701b0 2024-09-21T06:44:19.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.230+0000 7fbc91d9b640 1 --2- 172.21.15.7:0/1505109910 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5584ea478390 0x5584ea84ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:44:19.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.230+0000 7fbc9259c640 1 --2- 172.21.15.7:0/1505109910 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5584ea4701b0 0x5584ea8392d0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7fbc8401b040 tx=0x7fbc84011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b9681b0bde0d72e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:19.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.230+0000 7fbc7bfff640 1 -- 172.21.15.7:0/1505109910 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc840035f0 con 0x5584ea4701b0 2024-09-21T06:44:19.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.230+0000 7fbc7bfff640 1 -- 172.21.15.7:0/1505109910 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc84005040 con 0x5584ea4701b0 2024-09-21T06:44:19.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.230+0000 7fbc7bfff640 1 -- 172.21.15.7:0/1505109910 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc84019770 con 0x5584ea4701b0 2024-09-21T06:44:19.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.231+0000 7fbc9f11c740 1 -- 172.21.15.7:0/1505109910 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5584ea4701b0 msgr2=0x5584ea8392d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:19.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.231+0000 7fbc9f11c740 1 --2- 172.21.15.7:0/1505109910 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5584ea4701b0 0x5584ea8392d0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7fbc8401b040 tx=0x7fbc84011810 comp rx=0 tx=0).stop 2024-09-21T06:44:19.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.231+0000 7fbc9f11c740 1 -- 172.21.15.7:0/1505109910 shutdown_connections 2024-09-21T06:44:19.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.231+0000 7fbc9f11c740 1 --2- 172.21.15.7:0/1505109910 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5584ea499070 0x5584ea84ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:19.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.231+0000 7fbc9f11c740 1 --2- 172.21.15.7:0/1505109910 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5584ea478390 0x5584ea84ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:19.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.231+0000 7fbc9f11c740 1 --2- 172.21.15.7:0/1505109910 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5584ea4701b0 0x5584ea8392d0 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:19.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.231+0000 7fbc9f11c740 1 -- 172.21.15.7:0/1505109910 >> 172.21.15.7:0/1505109910 conn(0x5584ea48d460 msgr2=0x5584ea84b2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:19.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.231+0000 7fbc9f11c740 1 -- 172.21.15.7:0/1505109910 shutdown_connections 2024-09-21T06:44:19.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.231+0000 7fbc9f11c740 1 -- 172.21.15.7:0/1505109910 wait complete. 2024-09-21T06:44:19.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.231+0000 7fbc9f11c740 1 -- start start 2024-09-21T06:44:19.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.232+0000 7fbc9f11c740 1 Processor -- start 2024-09-21T06:44:19.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.232+0000 7fbc9f11c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5584ea4701b0 0x5584ea858b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:19.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.232+0000 7fbc9f11c740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5584ea478390 0x5584ea854040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:19.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.232+0000 7fbc9f11c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5584ea499070 0x5584ea854580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:19.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.232+0000 7fbc9f11c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fbc941ab9d0 con 0x5584ea499070 2024-09-21T06:44:19.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.232+0000 7fbc9f11c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fbc941ace20 con 0x5584ea4701b0 2024-09-21T06:44:19.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.232+0000 7fbc9f11c740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fbc941ac080 con 0x5584ea478390 2024-09-21T06:44:19.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.232+0000 7fbc9f11c740 10 client.0 _ll_register_callbacks cb 0x7fbc8c007b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:44:19.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.232+0000 7fbc92d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5584ea499070 0x5584ea854580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:19.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.232+0000 7fbc92d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5584ea499070 0x5584ea854580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37064/0 (socket says 172.21.15.7:37064) 2024-09-21T06:44:19.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.232+0000 7fbc92d9d640 1 -- 172.21.15.7:0/419296633 learned_addr learned my addr 172.21.15.7:0/419296633 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:44:19.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.232+0000 7fbc91d9b640 1 --2- 172.21.15.7:0/419296633 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5584ea478390 0x5584ea854040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:19.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.232+0000 7fbc9259c640 1 --2- 172.21.15.7:0/419296633 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5584ea4701b0 0x5584ea858b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:19.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.232+0000 7fbc92d9d640 1 -- 172.21.15.7:0/419296633 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5584ea478390 msgr2=0x5584ea854040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:19.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.232+0000 7fbc92d9d640 1 --2- 172.21.15.7:0/419296633 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5584ea478390 0x5584ea854040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:19.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.232+0000 7fbc92d9d640 1 -- 172.21.15.7:0/419296633 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5584ea4701b0 msgr2=0x5584ea858b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:19.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.232+0000 7fbc92d9d640 1 --2- 172.21.15.7:0/419296633 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5584ea4701b0 0x5584ea858b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:19.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.232+0000 7fbc92d9d640 1 -- 172.21.15.7:0/419296633 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584ea854cc0 con 0x5584ea499070 2024-09-21T06:44:19.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.233+0000 7fbc92d9d640 1 --2- 172.21.15.7:0/419296633 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5584ea499070 0x5584ea854580 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c000f80 tx=0x7fbc8c0286b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5311bf6398129911 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:19.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.233+0000 7fbc79ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:44:19.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.233+0000 7fbc79ffb640 1 -- 172.21.15.7:0/419296633 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc8c01c770 con 0x5584ea499070 2024-09-21T06:44:19.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.233+0000 7fbc79ffb640 1 -- 172.21.15.7:0/419296633 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8412+0+0 (secure 0 0 0) 0x7fbc8c01cd40 con 0x5584ea499070 2024-09-21T06:44:19.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.233+0000 7fbc9f11c740 1 -- 172.21.15.7:0/419296633 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc84005040 con 0x5584ea499070 2024-09-21T06:44:19.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.233+0000 7fbc79ffb640 1 -- 172.21.15.7:0/419296633 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fbc8c028720 con 0x5584ea499070 2024-09-21T06:44:19.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.233+0000 7fbc9f11c740 10 client.17220 fetch_fsmap learned FSMap version 25 2024-09-21T06:44:19.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.233+0000 7fbc9f11c740 1 -- 172.21.15.7:0/419296633 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5584ea8ccc70 con 0x5584ea499070 2024-09-21T06:44:19.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.233+0000 7fbc79ffb640 1 -- 172.21.15.7:0/419296633 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc84005040 con 0x5584ea499070 2024-09-21T06:44:19.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.233+0000 7fbc79ffb640 1 -- 172.21.15.7:0/419296633 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fbc8c030040 con 0x5584ea499070 2024-09-21T06:44:19.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.233+0000 7fbc9f11c740 10 client.17220 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:44:19.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.233+0000 7fbc9f11c740 10 client.17220 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-21T06:44:19.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.233+0000 7fbc9f11c740 20 client.17220 populate_metadata read hostname 'smithi007' 2024-09-21T06:44:19.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.234+0000 7fbc9f11c740 1 --2- 172.21.15.7:0/419296633 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x5584ea42cda0 0x5584ea8cf410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:19.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.234+0000 7fbc9f11c740 4 client.17220 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:44:19.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.234+0000 7fbc9f11c740 1 -- 172.21.15.7:0/419296633 --> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5584ea7b48a0 con 0x5584ea42cda0 2024-09-21T06:44:19.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.234+0000 7fbc9259c640 1 --2- 172.21.15.7:0/419296633 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x5584ea42cda0 0x5584ea8cf410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:19.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.234+0000 7fbc9259c640 1 --2- 172.21.15.7:0/419296633 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x5584ea42cda0 0x5584ea8cf410 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=866b447bbf0f539f server_cookie=691f953c0c808b6b in_seq=0 out_seq=0 2024-09-21T06:44:19.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.234+0000 7fbc79ffb640 10 client.17220 ms_handle_connect on v2:172.21.15.18:6836/1539670694 2024-09-21T06:44:19.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.234+0000 7fbc79ffb640 1 -- 172.21.15.7:0/419296633 <== mds.2 v2:172.21.15.18:6836/1539670694 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5584ea7b48a0 con 0x5584ea42cda0 2024-09-21T06:44:19.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.234+0000 7fbc79ffb640 10 client.17220 handle_command_reply: tid=0 2024-09-21T06:44:19.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.234+0000 7fbc9f11c740 1 client.17220 shutdown 2024-09-21T06:44:19.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.235+0000 7fbc9f11c740 1 -- 172.21.15.7:0/419296633 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5584ea499070 msgr2=0x5584ea854580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:19.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.235+0000 7fbc9f11c740 1 --2- 172.21.15.7:0/419296633 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5584ea499070 0x5584ea854580 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c000f80 tx=0x7fbc8c0286b0 comp rx=0 tx=0).stop 2024-09-21T06:44:19.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.235+0000 7fbc9f11c740 1 -- 172.21.15.7:0/419296633 shutdown_connections 2024-09-21T06:44:19.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.235+0000 7fbc9f11c740 1 --2- 172.21.15.7:0/419296633 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x5584ea42cda0 0x5584ea8cf410 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:19.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.235+0000 7fbc9f11c740 1 --2- 172.21.15.7:0/419296633 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5584ea499070 0x5584ea854580 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:19.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.235+0000 7fbc9f11c740 1 --2- 172.21.15.7:0/419296633 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5584ea478390 0x5584ea854040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:19.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.235+0000 7fbc9f11c740 1 --2- 172.21.15.7:0/419296633 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5584ea4701b0 0x5584ea858b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:19.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.235+0000 7fbc9f11c740 1 -- 172.21.15.7:0/419296633 >> 172.21.15.7:0/419296633 conn(0x5584ea48d460 msgr2=0x5584ea84e620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:19.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.235+0000 7fbc79ffb640 0 client.17220 ms_handle_reset on v2:172.21.15.18:6836/1539670694 2024-09-21T06:44:19.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.235+0000 7fbc9f11c740 1 -- 172.21.15.7:0/419296633 shutdown_connections 2024-09-21T06:44:19.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.235+0000 7fbc9f11c740 1 -- 172.21.15.7:0/419296633 wait complete. 2024-09-21T06:44:19.243 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.235+0000 7fbc9f11c740 20 client.17220 trim_cache size 0 max 16384 2024-09-21T06:44:19.243 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:44:19.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.235+0000 7fbc98ba8640 1 -- 172.21.15.7:0/2016741090 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fbc7c0b66b0 msgr2=0x7fbc7c0b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:19.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.235+0000 7fbc98ba8640 1 --2- 172.21.15.7:0/2016741090 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fbc7c0b66b0 0x7fbc7c0b8bc0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c007ed0 tx=0x7fbc8c007680 comp rx=0 tx=0).stop 2024-09-21T06:44:19.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.235+0000 7fbc98ba8640 1 -- 172.21.15.7:0/2016741090 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc941083b0 msgr2=0x7fbc9419aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:19.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.235+0000 7fbc98ba8640 1 --2- 172.21.15.7:0/2016741090 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc941083b0 0x7fbc9419aa90 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fbc88006010 tx=0x7fbc88004060 comp rx=0 tx=0).stop 2024-09-21T06:44:19.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.235+0000 7fbc98ba8640 1 -- 172.21.15.7:0/2016741090 shutdown_connections 2024-09-21T06:44:19.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.235+0000 7fbc98ba8640 1 --2- 172.21.15.7:0/2016741090 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fbc7c0b66b0 0x7fbc7c0b8bc0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:19.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.235+0000 7fbc98ba8640 1 --2- 172.21.15.7:0/2016741090 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc94108d00 0x7fbc9419fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:19.244 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.236+0000 7fbc98ba8640 1 --2- 172.21.15.7:0/2016741090 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fbc941083b0 0x7fbc9419aa90 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:19.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.236+0000 7fbc98ba8640 1 --2- 172.21.15.7:0/2016741090 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fbc94102a70 0x7fbc9419a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:19.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.236+0000 7fbc98ba8640 1 -- 172.21.15.7:0/2016741090 >> 172.21.15.7:0/2016741090 conn(0x7fbc94079710 msgr2=0x7fbc94104430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:19.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.236+0000 7fbc98ba8640 1 -- 172.21.15.7:0/2016741090 shutdown_connections 2024-09-21T06:44:19.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:19.236+0000 7fbc98ba8640 1 -- 172.21.15.7:0/2016741090 wait complete. 2024-09-21T06:44:19.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:44:18 smithi144 ceph-mon[34653]: pgmap v565: 97 pgs: 97 active+clean; 3.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 204 B/s wr, 7 op/s 2024-09-21T06:44:19.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:44:18 smithi018 ceph-mon[34477]: pgmap v565: 97 pgs: 97 active+clean; 3.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 204 B/s wr, 7 op/s 2024-09-21T06:44:20.089 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:44:20.347 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:44:20.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.823+0000 7f60f0469640 1 -- 172.21.15.7:0/3930009797 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60e8105320 msgr2=0x7f60e810d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:20.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.823+0000 7f60f0469640 1 --2- 172.21.15.7:0/3930009797 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60e8105320 0x7f60e810d870 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f60d8009900 tx=0x7f60d802a410 comp rx=0 tx=0).stop 2024-09-21T06:44:20.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.823+0000 7f60f0469640 1 -- 172.21.15.7:0/3930009797 shutdown_connections 2024-09-21T06:44:20.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.823+0000 7f60f0469640 1 --2- 172.21.15.7:0/3930009797 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f60e810de30 0x7f60e8110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:20.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.823+0000 7f60f0469640 1 --2- 172.21.15.7:0/3930009797 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60e8105320 0x7f60e810d870 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:20.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.823+0000 7f60f0469640 1 --2- 172.21.15.7:0/3930009797 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60e81049d0 0x7f60e8104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:20.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.823+0000 7f60f0469640 1 -- 172.21.15.7:0/3930009797 >> 172.21.15.7:0/3930009797 conn(0x7f60e8079740 msgr2=0x7f60e8079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:20.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.823+0000 7f60f0469640 1 -- 172.21.15.7:0/3930009797 shutdown_connections 2024-09-21T06:44:20.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.823+0000 7f60f0469640 1 -- 172.21.15.7:0/3930009797 wait complete. 2024-09-21T06:44:20.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.824+0000 7f60f0469640 1 Processor -- start 2024-09-21T06:44:20.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.824+0000 7f60f0469640 1 -- start start 2024-09-21T06:44:20.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.824+0000 7f60f0469640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f60e81049d0 0x7f60e8102710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:20.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.824+0000 7f60f0469640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60e8105320 0x7f60e8102c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:20.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.824+0000 7f60f0469640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60e810de30 0x7f60e8103190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:20.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.824+0000 7f60f0469640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f60e8113a90 con 0x7f60e810de30 2024-09-21T06:44:20.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.824+0000 7f60f0469640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f60e8113910 con 0x7f60e81049d0 2024-09-21T06:44:20.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.824+0000 7f60f0469640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f60e8113c10 con 0x7f60e8105320 2024-09-21T06:44:20.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.824+0000 7f60eea06640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60e810de30 0x7f60e8103190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:20.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.824+0000 7f60eea06640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60e810de30 0x7f60e8103190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40378/0 (socket says 172.21.15.7:40378) 2024-09-21T06:44:20.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.824+0000 7f60eea06640 1 -- 172.21.15.7:0/1294041160 learned_addr learned my addr 172.21.15.7:0/1294041160 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:44:20.828 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.824+0000 7f60ee205640 1 --2- 172.21.15.7:0/1294041160 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f60e81049d0 0x7f60e8102710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:20.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.825+0000 7f60eda04640 1 --2- 172.21.15.7:0/1294041160 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60e8105320 0x7f60e8102c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:20.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.825+0000 7f60eea06640 1 -- 172.21.15.7:0/1294041160 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60e8105320 msgr2=0x7f60e8102c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:20.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.825+0000 7f60eea06640 1 --2- 172.21.15.7:0/1294041160 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60e8105320 0x7f60e8102c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:20.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.825+0000 7f60eea06640 1 -- 172.21.15.7:0/1294041160 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f60e81049d0 msgr2=0x7f60e8102710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:20.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.825+0000 7f60eea06640 1 --2- 172.21.15.7:0/1294041160 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f60e81049d0 0x7f60e8102710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:20.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.825+0000 7f60eea06640 1 -- 172.21.15.7:0/1294041160 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60e81a87a0 con 0x7f60e810de30 2024-09-21T06:44:20.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.825+0000 7f60eea06640 1 --2- 172.21.15.7:0/1294041160 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60e810de30 0x7f60e8103190 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f60e000eb10 tx=0x7f60e000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:20.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.825+0000 7f60df7fe640 1 -- 172.21.15.7:0/1294041160 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60e0004b20 con 0x7f60e810de30 2024-09-21T06:44:20.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.825+0000 7f60f0469640 1 -- 172.21.15.7:0/1294041160 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60e81a8a90 con 0x7f60e810de30 2024-09-21T06:44:20.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.825+0000 7f60df7fe640 1 -- 172.21.15.7:0/1294041160 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f60e0004cc0 con 0x7f60e810de30 2024-09-21T06:44:20.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.825+0000 7f60df7fe640 1 -- 172.21.15.7:0/1294041160 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60e0010670 con 0x7f60e810de30 2024-09-21T06:44:20.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.825+0000 7f60f0469640 1 -- 172.21.15.7:0/1294041160 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60e81a8f50 con 0x7f60e810de30 2024-09-21T06:44:20.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.828+0000 7f60f69dd740 1 Processor -- start 2024-09-21T06:44:20.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.828+0000 7f60df7fe640 1 -- 172.21.15.7:0/1294041160 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f60e0005020 con 0x7f60e810de30 2024-09-21T06:44:20.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.828+0000 7f60f69dd740 1 -- start start 2024-09-21T06:44:20.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.829+0000 7f60f69dd740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556ba2bf5070 0x556ba2f9c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:20.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.829+0000 7f60f69dd740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ba2bcc1b0 0x556ba2f9cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:20.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.829+0000 7f60f69dd740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ba2bd4390 0x556ba2f9d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:20.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.829+0000 7f60f69dd740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x556ba2f12ea0 con 0x556ba2bcc1b0 2024-09-21T06:44:20.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.829+0000 7f60f69dd740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x556ba2f022d0 con 0x556ba2bf5070 2024-09-21T06:44:20.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.829+0000 7f60f69dd740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x556ba2f060e0 con 0x556ba2bd4390 2024-09-21T06:44:20.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.829+0000 7f60ee205640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ba2bcc1b0 0x556ba2f9cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:20.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.829+0000 7f60ee205640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ba2bcc1b0 0x556ba2f9cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40394/0 (socket says 172.21.15.7:40394) 2024-09-21T06:44:20.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.829+0000 7f60ee205640 1 -- 172.21.15.7:0/2736833863 learned_addr learned my addr 172.21.15.7:0/2736833863 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:44:20.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.829+0000 7f60eda04640 1 --2- 172.21.15.7:0/2736833863 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556ba2bf5070 0x556ba2f9c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:20.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.829+0000 7f60eda04640 1 --2- 172.21.15.7:0/2736833863 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ba2bd4390 0x556ba2f9d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:20.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.829+0000 7f60ee205640 1 -- 172.21.15.7:0/2736833863 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ba2bd4390 msgr2=0x556ba2f9d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:20.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.829+0000 7f60ee205640 1 --2- 172.21.15.7:0/2736833863 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ba2bd4390 0x556ba2f9d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:20.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.829+0000 7f60ee205640 1 -- 172.21.15.7:0/2736833863 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556ba2bf5070 msgr2=0x556ba2f9c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:20.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.829+0000 7f60ee205640 1 --2- 172.21.15.7:0/2736833863 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556ba2bf5070 0x556ba2f9c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:20.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.829+0000 7f60ee205640 1 -- 172.21.15.7:0/2736833863 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ba2c60650 con 0x556ba2bcc1b0 2024-09-21T06:44:20.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.829+0000 7f60eda04640 1 --2- 172.21.15.7:0/2736833863 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556ba2bf5070 0x556ba2f9c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:44:20.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.829+0000 7f60ee205640 1 --2- 172.21.15.7:0/2736833863 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ba2bcc1b0 0x556ba2f9cbe0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f60e4009c60 tx=0x7f60e4011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90d10dd95686ad76 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:20.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.830+0000 7f60df7fe640 1 --2- 172.21.15.7:0/1294041160 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f60d40b6680 0x7f60d40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:20.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.830+0000 7f60eda04640 1 --2- 172.21.15.7:0/1294041160 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f60d40b6680 0x7f60d40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:20.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.830+0000 7f60dcd9a640 1 -- 172.21.15.7:0/2736833863 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60e4004220 con 0x556ba2bcc1b0 2024-09-21T06:44:20.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.830+0000 7f60df7fe640 1 -- 172.21.15.7:0/1294041160 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8412+0+0 (secure 0 0 0) 0x7f60e00e7c80 con 0x7f60e810de30 2024-09-21T06:44:20.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.830+0000 7f60dcd9a640 1 -- 172.21.15.7:0/2736833863 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f60e40043c0 con 0x556ba2bcc1b0 2024-09-21T06:44:20.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.830+0000 7f60dcd9a640 1 -- 172.21.15.7:0/2736833863 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60e40197a0 con 0x556ba2bcc1b0 2024-09-21T06:44:20.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.831+0000 7f60f69dd740 1 -- 172.21.15.7:0/2736833863 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ba2bcc1b0 msgr2=0x556ba2f9cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:20.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.831+0000 7f60eda04640 1 --2- 172.21.15.7:0/1294041160 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f60d40b6680 0x7f60d40b8b90 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f60d8009230 tx=0x7f60d8000bc0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:20.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.831+0000 7f60f69dd740 1 --2- 172.21.15.7:0/2736833863 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ba2bcc1b0 0x556ba2f9cbe0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f60e4009c60 tx=0x7f60e4011810 comp rx=0 tx=0).stop 2024-09-21T06:44:20.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.831+0000 7f60f69dd740 1 -- 172.21.15.7:0/2736833863 shutdown_connections 2024-09-21T06:44:20.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.831+0000 7f60f69dd740 1 --2- 172.21.15.7:0/2736833863 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ba2bd4390 0x556ba2f9d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:20.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.831+0000 7f60f69dd740 1 --2- 172.21.15.7:0/2736833863 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ba2bcc1b0 0x556ba2f9cbe0 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:20.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.831+0000 7f60f69dd740 1 --2- 172.21.15.7:0/2736833863 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556ba2bf5070 0x556ba2f9c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:20.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.831+0000 7f60f69dd740 1 -- 172.21.15.7:0/2736833863 >> 172.21.15.7:0/2736833863 conn(0x556ba2be9460 msgr2=0x556ba2f9a590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:20.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.831+0000 7f60f69dd740 1 -- 172.21.15.7:0/2736833863 shutdown_connections 2024-09-21T06:44:20.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.831+0000 7f60f69dd740 1 -- 172.21.15.7:0/2736833863 wait complete. 2024-09-21T06:44:20.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.831+0000 7f60f69dd740 1 -- start start 2024-09-21T06:44:20.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.832+0000 7f60f69dd740 1 Processor -- start 2024-09-21T06:44:20.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.832+0000 7f60f69dd740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ba2bcc1b0 0x556ba2fa7d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:20.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.832+0000 7f60f69dd740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556ba2bd4390 0x556ba2fa8280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:20.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.832+0000 7f60f69dd740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ba2bf5070 0x556ba2fa8800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:20.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.832+0000 7f60f69dd740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x556ba2d63700 con 0x556ba2bcc1b0 2024-09-21T06:44:20.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.832+0000 7f60f69dd740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x556ba2e9d160 con 0x556ba2bd4390 2024-09-21T06:44:20.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.832+0000 7f60f69dd740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x556ba2faae80 con 0x556ba2bf5070 2024-09-21T06:44:20.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.832+0000 7f60f69dd740 10 client.0 _ll_register_callbacks cb 0x556ba2eb69e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:44:20.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.832+0000 7f60ee205640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ba2bcc1b0 0x556ba2fa7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:20.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.832+0000 7f60ee205640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ba2bcc1b0 0x556ba2fa7d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40408/0 (socket says 172.21.15.7:40408) 2024-09-21T06:44:20.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.832+0000 7f60ee205640 1 -- 172.21.15.7:0/623498696 learned_addr learned my addr 172.21.15.7:0/623498696 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:44:20.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.832+0000 7f60eda04640 1 --2- 172.21.15.7:0/623498696 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556ba2bd4390 0x556ba2fa8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:20.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.832+0000 7f60eea06640 1 --2- 172.21.15.7:0/623498696 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ba2bf5070 0x556ba2fa8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:20.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.832+0000 7f60ee205640 1 -- 172.21.15.7:0/623498696 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ba2bf5070 msgr2=0x556ba2fa8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:20.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.832+0000 7f60ee205640 1 --2- 172.21.15.7:0/623498696 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ba2bf5070 0x556ba2fa8800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:20.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.832+0000 7f60ee205640 1 -- 172.21.15.7:0/623498696 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556ba2bd4390 msgr2=0x556ba2fa8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:20.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.832+0000 7f60ee205640 1 --2- 172.21.15.7:0/623498696 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556ba2bd4390 0x556ba2fa8280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:20.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.832+0000 7f60ee205640 1 -- 172.21.15.7:0/623498696 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ba2ecac90 con 0x556ba2bcc1b0 2024-09-21T06:44:20.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.833+0000 7f60ee205640 1 --2- 172.21.15.7:0/623498696 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ba2bcc1b0 0x556ba2fa7d40 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f60e40096e0 tx=0x7f60e4004230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=880482ff2058b1c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:20.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.833+0000 7f60d1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:44:20.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.833+0000 7f60d1ffb640 1 -- 172.21.15.7:0/623498696 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60e4028070 con 0x556ba2bcc1b0 2024-09-21T06:44:20.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.833+0000 7f60f69dd740 1 -- 172.21.15.7:0/623498696 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f60e40043c0 con 0x556ba2bcc1b0 2024-09-21T06:44:20.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.833+0000 7f60d1ffb640 1 -- 172.21.15.7:0/623498696 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8412+0+0 (secure 0 0 0) 0x7f60e4003880 con 0x556ba2bcc1b0 2024-09-21T06:44:20.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.833+0000 7f60d1ffb640 1 -- 172.21.15.7:0/623498696 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f60e4034050 con 0x556ba2bcc1b0 2024-09-21T06:44:20.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.833+0000 7f60f69dd740 10 client.17232 fetch_fsmap learned FSMap version 25 2024-09-21T06:44:20.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.833+0000 7f60f69dd740 1 -- 172.21.15.7:0/623498696 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x556ba2fb6ac0 con 0x556ba2bcc1b0 2024-09-21T06:44:20.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.833+0000 7f60d1ffb640 1 -- 172.21.15.7:0/623498696 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f60e40043c0 con 0x556ba2bcc1b0 2024-09-21T06:44:20.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.834+0000 7f60d1ffb640 1 -- 172.21.15.7:0/623498696 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f60e4004ad0 con 0x556ba2bcc1b0 2024-09-21T06:44:20.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.834+0000 7f60f69dd740 10 client.17232 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:44:20.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.834+0000 7f60f69dd740 10 client.17232 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:44:20.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.834+0000 7f60f69dd740 20 client.17232 populate_metadata read hostname 'smithi007' 2024-09-21T06:44:20.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.834+0000 7f60f69dd740 1 --2- 172.21.15.7:0/623498696 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x556ba2bb39f0 0x556ba2fb9e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:20.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.834+0000 7f60f69dd740 4 client.17232 mds_command: new command op to 24688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:44:20.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.834+0000 7f60f69dd740 1 -- 172.21.15.7:0/623498696 --> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556ba2f14df0 con 0x556ba2bb39f0 2024-09-21T06:44:20.839 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.834+0000 7f60eda04640 1 --2- 172.21.15.7:0/623498696 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x556ba2bb39f0 0x556ba2fb9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:20.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.834+0000 7f60eda04640 1 --2- 172.21.15.7:0/623498696 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x556ba2bb39f0 0x556ba2fb9e80 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=53a96c66e1736730 server_cookie=4ebadd75e158bd77 in_seq=0 out_seq=0 2024-09-21T06:44:20.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.834+0000 7f60d1ffb640 10 client.17232 ms_handle_connect on v2:172.21.15.144:6838/4027821922 2024-09-21T06:44:20.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.835+0000 7f60d1ffb640 1 -- 172.21.15.7:0/623498696 <== mds.1 v2:172.21.15.144:6838/4027821922 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556ba2f14df0 con 0x556ba2bb39f0 2024-09-21T06:44:20.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.835+0000 7f60d1ffb640 10 client.17232 handle_command_reply: tid=0 2024-09-21T06:44:20.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.835+0000 7f60f69dd740 1 client.17232 shutdown 2024-09-21T06:44:20.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.836+0000 7f60f69dd740 1 -- 172.21.15.7:0/623498696 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ba2bcc1b0 msgr2=0x556ba2fa7d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:20.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.836+0000 7f60f69dd740 1 --2- 172.21.15.7:0/623498696 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ba2bcc1b0 0x556ba2fa7d40 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f60e40096e0 tx=0x7f60e4004230 comp rx=0 tx=0).stop 2024-09-21T06:44:20.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.836+0000 7f60f69dd740 1 -- 172.21.15.7:0/623498696 shutdown_connections 2024-09-21T06:44:20.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.836+0000 7f60f69dd740 1 --2- 172.21.15.7:0/623498696 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x556ba2bb39f0 0x556ba2fb9e80 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:20.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.836+0000 7f60f69dd740 1 --2- 172.21.15.7:0/623498696 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ba2bf5070 0x556ba2fa8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:20.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.836+0000 7f60f69dd740 1 --2- 172.21.15.7:0/623498696 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556ba2bd4390 0x556ba2fa8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:20.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.836+0000 7f60d1ffb640 0 client.17232 ms_handle_reset on v2:172.21.15.144:6838/4027821922 2024-09-21T06:44:20.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.836+0000 7f60f69dd740 1 --2- 172.21.15.7:0/623498696 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ba2bcc1b0 0x556ba2fa7d40 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:20.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.836+0000 7f60f69dd740 1 -- 172.21.15.7:0/623498696 >> 172.21.15.7:0/623498696 conn(0x556ba2be9460 msgr2=0x556ba2f9f830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:20.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.836+0000 7f60f69dd740 1 -- 172.21.15.7:0/623498696 shutdown_connections 2024-09-21T06:44:20.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.836+0000 7f60f69dd740 1 -- 172.21.15.7:0/623498696 wait complete. 2024-09-21T06:44:20.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.836+0000 7f60f69dd740 20 client.17232 trim_cache size 0 max 16384 2024-09-21T06:44:20.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.849+0000 7f60f69dd740 1 Processor -- start 2024-09-21T06:44:20.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.849+0000 7f60f69dd740 1 -- start start 2024-09-21T06:44:20.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.849+0000 7f60f69dd740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ba2bcc1b0 0x556ba2fa7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:20.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.849+0000 7f60f69dd740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ba2bd4390 0x556ba2fa9c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:20.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.849+0000 7f60f69dd740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556ba2bf5070 0x556ba2f9dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:20.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.849+0000 7f60f69dd740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f60e81b40a0 con 0x556ba2bd4390 2024-09-21T06:44:20.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.849+0000 7f60f69dd740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f60e81b1970 con 0x556ba2bf5070 2024-09-21T06:44:20.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.849+0000 7f60f69dd740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f60e81af7e0 con 0x556ba2bcc1b0 2024-09-21T06:44:20.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.850+0000 7f60eda04640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ba2bd4390 0x556ba2fa9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:20.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.850+0000 7f60eda04640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ba2bd4390 0x556ba2fa9c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40420/0 (socket says 172.21.15.7:40420) 2024-09-21T06:44:20.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.850+0000 7f60eda04640 1 -- 172.21.15.7:0/3720462703 learned_addr learned my addr 172.21.15.7:0/3720462703 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:44:20.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.850+0000 7f60ee205640 1 --2- 172.21.15.7:0/3720462703 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ba2bcc1b0 0x556ba2fa7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:20.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.850+0000 7f60eea06640 1 --2- 172.21.15.7:0/3720462703 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556ba2bf5070 0x556ba2f9dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:20.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.850+0000 7f60eda04640 1 -- 172.21.15.7:0/3720462703 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ba2bcc1b0 msgr2=0x556ba2fa7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:20.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.850+0000 7f60eda04640 1 --2- 172.21.15.7:0/3720462703 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ba2bcc1b0 0x556ba2fa7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:20.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.850+0000 7f60eda04640 1 -- 172.21.15.7:0/3720462703 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556ba2bf5070 msgr2=0x556ba2f9dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:20.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.850+0000 7f60eda04640 1 --2- 172.21.15.7:0/3720462703 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556ba2bf5070 0x556ba2f9dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:20.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.850+0000 7f60eda04640 1 -- 172.21.15.7:0/3720462703 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ba2fa9000 con 0x556ba2bd4390 2024-09-21T06:44:20.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.850+0000 7f60eda04640 1 --2- 172.21.15.7:0/3720462703 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ba2bd4390 0x556ba2fa9c20 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f60d8031de0 tx=0x7f60d803f070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb75a6a7e44df8a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:20.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.850+0000 7f60d3fff640 1 -- 172.21.15.7:0/3720462703 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60d8035040 con 0x556ba2bd4390 2024-09-21T06:44:20.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.850+0000 7f60d3fff640 1 -- 172.21.15.7:0/3720462703 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f60d8058070 con 0x556ba2bd4390 2024-09-21T06:44:20.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.850+0000 7f60d3fff640 1 -- 172.21.15.7:0/3720462703 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60d8003b60 con 0x556ba2bd4390 2024-09-21T06:44:20.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.851+0000 7f60f69dd740 1 -- 172.21.15.7:0/3720462703 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ba2bd4390 msgr2=0x556ba2fa9c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:20.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.851+0000 7f60f69dd740 1 --2- 172.21.15.7:0/3720462703 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ba2bd4390 0x556ba2fa9c20 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f60d8031de0 tx=0x7f60d803f070 comp rx=0 tx=0).stop 2024-09-21T06:44:20.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.851+0000 7f60f69dd740 1 -- 172.21.15.7:0/3720462703 shutdown_connections 2024-09-21T06:44:20.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.851+0000 7f60f69dd740 1 --2- 172.21.15.7:0/3720462703 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556ba2bf5070 0x556ba2f9dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:20.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.851+0000 7f60f69dd740 1 --2- 172.21.15.7:0/3720462703 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ba2bd4390 0x556ba2fa9c20 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:20.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.851+0000 7f60f69dd740 1 --2- 172.21.15.7:0/3720462703 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ba2bcc1b0 0x556ba2fa7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:20.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.851+0000 7f60f69dd740 1 -- 172.21.15.7:0/3720462703 >> 172.21.15.7:0/3720462703 conn(0x556ba2be9460 msgr2=0x556ba2f9d6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:20.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.851+0000 7f60f69dd740 1 -- 172.21.15.7:0/3720462703 shutdown_connections 2024-09-21T06:44:20.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.851+0000 7f60f69dd740 1 -- 172.21.15.7:0/3720462703 wait complete. 2024-09-21T06:44:20.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.852+0000 7f60f69dd740 1 -- start start 2024-09-21T06:44:20.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.852+0000 7f60f69dd740 1 Processor -- start 2024-09-21T06:44:20.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.852+0000 7f60f69dd740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556ba2bcc1b0 0x556ba2fac090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:20.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.852+0000 7f60f69dd740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ba2bd4390 0x556ba2fac5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:20.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.852+0000 7f60f69dd740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ba2bf5070 0x556ba2facb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:20.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.852+0000 7f60f69dd740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f60e81afe30 con 0x556ba2bd4390 2024-09-21T06:44:20.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.852+0000 7f60f69dd740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f60e81b12a0 con 0x556ba2bcc1b0 2024-09-21T06:44:20.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.852+0000 7f60f69dd740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f60e81b0500 con 0x556ba2bf5070 2024-09-21T06:44:20.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.852+0000 7f60f69dd740 10 client.0 _ll_register_callbacks cb 0x7f60e4009ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:44:20.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.852+0000 7f60eda04640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ba2bd4390 0x556ba2fac5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:20.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.852+0000 7f60eda04640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ba2bd4390 0x556ba2fac5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40424/0 (socket says 172.21.15.7:40424) 2024-09-21T06:44:20.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.852+0000 7f60ee205640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556ba2bcc1b0 0x556ba2fac090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:20.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.852+0000 7f60eda04640 1 -- 172.21.15.7:0/2942217182 learned_addr learned my addr 172.21.15.7:0/2942217182 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:44:20.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.852+0000 7f60eea06640 1 --2- 172.21.15.7:0/2942217182 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ba2bf5070 0x556ba2facb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:20.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.852+0000 7f60eda04640 1 -- 172.21.15.7:0/2942217182 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ba2bf5070 msgr2=0x556ba2facb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:20.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.852+0000 7f60eda04640 1 --2- 172.21.15.7:0/2942217182 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ba2bf5070 0x556ba2facb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:20.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.852+0000 7f60eda04640 1 -- 172.21.15.7:0/2942217182 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556ba2bcc1b0 msgr2=0x556ba2fac090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:20.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.852+0000 7f60eda04640 1 --2- 172.21.15.7:0/2942217182 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556ba2bcc1b0 0x556ba2fac090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:20.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.852+0000 7f60eda04640 1 -- 172.21.15.7:0/2942217182 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ba3023780 con 0x556ba2bd4390 2024-09-21T06:44:20.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.853+0000 7f60eda04640 1 --2- 172.21.15.7:0/2942217182 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ba2bd4390 0x556ba2fac5d0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f60d80092a0 tx=0x7f60d8031c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cfa2a4fa3f8f391 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:20.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.853+0000 7f60d1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:44:20.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.853+0000 7f60d1ffb640 1 -- 172.21.15.7:0/2942217182 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60d8060020 con 0x556ba2bd4390 2024-09-21T06:44:20.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.853+0000 7f60f69dd740 1 -- 172.21.15.7:0/2942217182 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f60d8058070 con 0x556ba2bd4390 2024-09-21T06:44:20.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.853+0000 7f60d1ffb640 1 -- 172.21.15.7:0/2942217182 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8412+0+0 (secure 0 0 0) 0x7f60d8004250 con 0x556ba2bd4390 2024-09-21T06:44:20.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.853+0000 7f60d1ffb640 1 -- 172.21.15.7:0/2942217182 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f60d8035030 con 0x556ba2bd4390 2024-09-21T06:44:20.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.853+0000 7f60f69dd740 10 client.17238 fetch_fsmap learned FSMap version 25 2024-09-21T06:44:20.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.853+0000 7f60f69dd740 1 -- 172.21.15.7:0/2942217182 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x556ba3024a00 con 0x556ba2bd4390 2024-09-21T06:44:20.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.853+0000 7f60d1ffb640 1 -- 172.21.15.7:0/2942217182 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f60d8058070 con 0x556ba2bd4390 2024-09-21T06:44:20.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.853+0000 7f60d1ffb640 1 -- 172.21.15.7:0/2942217182 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f60d805c5a0 con 0x556ba2bd4390 2024-09-21T06:44:20.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.853+0000 7f60f69dd740 10 client.17238 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:44:20.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.854+0000 7f60f69dd740 10 client.17238 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:44:20.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.854+0000 7f60f69dd740 20 client.17238 populate_metadata read hostname 'smithi007' 2024-09-21T06:44:20.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.854+0000 7f60f69dd740 1 --2- 172.21.15.7:0/2942217182 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x556ba2b88da0 0x556ba30271f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:20.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.854+0000 7f60f69dd740 4 client.17238 mds_command: new command op to 24688 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:44:20.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.854+0000 7f60f69dd740 1 -- 172.21.15.7:0/2942217182 --> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556ba2f108a0 con 0x556ba2b88da0 2024-09-21T06:44:20.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.854+0000 7f60ee205640 1 --2- 172.21.15.7:0/2942217182 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x556ba2b88da0 0x556ba30271f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:20.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.854+0000 7f60d1ffb640 10 client.17238 ms_handle_connect on v2:172.21.15.144:6838/4027821922 2024-09-21T06:44:20.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.854+0000 7f60ee205640 1 --2- 172.21.15.7:0/2942217182 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x556ba2b88da0 0x556ba30271f0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3c00b1f5b34513f5 server_cookie=95777a46d81e1262 in_seq=0 out_seq=0 2024-09-21T06:44:20.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.855+0000 7f60d1ffb640 1 -- 172.21.15.7:0/2942217182 <== mds.1 v2:172.21.15.144:6838/4027821922 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556ba2f108a0 con 0x556ba2b88da0 2024-09-21T06:44:20.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.855+0000 7f60d1ffb640 10 client.17238 handle_command_reply: tid=0 2024-09-21T06:44:20.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.855+0000 7f60f69dd740 1 client.17238 shutdown 2024-09-21T06:44:20.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.855+0000 7f60f69dd740 1 -- 172.21.15.7:0/2942217182 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ba2bd4390 msgr2=0x556ba2fac5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:20.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.855+0000 7f60f69dd740 1 --2- 172.21.15.7:0/2942217182 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ba2bd4390 0x556ba2fac5d0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f60d80092a0 tx=0x7f60d8031c30 comp rx=0 tx=0).stop 2024-09-21T06:44:20.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.855+0000 7f60f69dd740 1 -- 172.21.15.7:0/2942217182 shutdown_connections 2024-09-21T06:44:20.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.855+0000 7f60f69dd740 1 --2- 172.21.15.7:0/2942217182 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x556ba2b88da0 0x556ba30271f0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:20.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.855+0000 7f60f69dd740 1 --2- 172.21.15.7:0/2942217182 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x556ba2bf5070 0x556ba2facb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:20.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.855+0000 7f60d1ffb640 0 client.17238 ms_handle_reset on v2:172.21.15.144:6838/4027821922 2024-09-21T06:44:20.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.855+0000 7f60f69dd740 1 --2- 172.21.15.7:0/2942217182 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x556ba2bd4390 0x556ba2fac5d0 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:20.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.855+0000 7f60f69dd740 1 --2- 172.21.15.7:0/2942217182 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556ba2bcc1b0 0x556ba2fac090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:20.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.855+0000 7f60f69dd740 1 -- 172.21.15.7:0/2942217182 >> 172.21.15.7:0/2942217182 conn(0x556ba2be9460 msgr2=0x556ba2fa9960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:20.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.855+0000 7f60f69dd740 1 -- 172.21.15.7:0/2942217182 shutdown_connections 2024-09-21T06:44:20.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.855+0000 7f60f69dd740 1 -- 172.21.15.7:0/2942217182 wait complete. 2024-09-21T06:44:20.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.855+0000 7f60f69dd740 20 client.17238 trim_cache size 0 max 16384 2024-09-21T06:44:20.862 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:44:20.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.856+0000 7f60f0469640 1 -- 172.21.15.7:0/1294041160 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f60d40b6680 msgr2=0x7f60d40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:20.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.856+0000 7f60f0469640 1 --2- 172.21.15.7:0/1294041160 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f60d40b6680 0x7f60d40b8b90 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f60d8009230 tx=0x7f60d8000bc0 comp rx=0 tx=0).stop 2024-09-21T06:44:20.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.856+0000 7f60f0469640 1 -- 172.21.15.7:0/1294041160 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60e810de30 msgr2=0x7f60e8103190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:20.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.856+0000 7f60f0469640 1 --2- 172.21.15.7:0/1294041160 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60e810de30 0x7f60e8103190 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f60e000eb10 tx=0x7f60e000c2d0 comp rx=0 tx=0).stop 2024-09-21T06:44:20.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.856+0000 7f60f0469640 1 -- 172.21.15.7:0/1294041160 shutdown_connections 2024-09-21T06:44:20.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.856+0000 7f60f0469640 1 --2- 172.21.15.7:0/1294041160 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f60d40b6680 0x7f60d40b8b90 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:20.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.856+0000 7f60f0469640 1 --2- 172.21.15.7:0/1294041160 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f60e810de30 0x7f60e8103190 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:20.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.856+0000 7f60f0469640 1 --2- 172.21.15.7:0/1294041160 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f60e8105320 0x7f60e8102c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:20.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.856+0000 7f60f0469640 1 --2- 172.21.15.7:0/1294041160 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f60e81049d0 0x7f60e8102710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:20.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.856+0000 7f60f0469640 1 -- 172.21.15.7:0/1294041160 >> 172.21.15.7:0/1294041160 conn(0x7f60e8079740 msgr2=0x7f60e8107990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:20.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.856+0000 7f60f0469640 1 -- 172.21.15.7:0/1294041160 shutdown_connections 2024-09-21T06:44:20.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:20.856+0000 7f60f0469640 1 -- 172.21.15.7:0/1294041160 wait complete. 2024-09-21T06:44:21.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:44:21 smithi144 ceph-mon[34653]: pgmap v567: 97 pgs: 97 active+clean; 3.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 219 B/s wr, 8 op/s 2024-09-21T06:44:21.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:44:21 smithi007 ceph-mon[30983]: pgmap v567: 97 pgs: 97 active+clean; 3.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 219 B/s wr, 8 op/s 2024-09-21T06:44:21.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:44:21 smithi018 ceph-mon[34477]: pgmap v567: 97 pgs: 97 active+clean; 3.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 219 B/s wr, 8 op/s 2024-09-21T06:44:21.658 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:44:21.919 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:44:22.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.459+0000 7fccd3325640 1 -- 172.21.15.7:0/102262566 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcccc102a80 msgr2=0x7fcccc102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:22.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.459+0000 7fccd3325640 1 --2- 172.21.15.7:0/102262566 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcccc102a80 0x7fcccc102e90 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fccc8009900 tx=0x7fccc802a410 comp rx=0 tx=0).stop 2024-09-21T06:44:22.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.459+0000 7fccd3325640 1 -- 172.21.15.7:0/102262566 shutdown_connections 2024-09-21T06:44:22.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.459+0000 7fccd3325640 1 --2- 172.21.15.7:0/102262566 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcccc108d10 0x7fcccc10f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:22.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.459+0000 7fccd3325640 1 --2- 172.21.15.7:0/102262566 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcccc1083c0 0x7fcccc1087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:22.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.459+0000 7fccd3325640 1 --2- 172.21.15.7:0/102262566 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcccc102a80 0x7fcccc102e90 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:22.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.459+0000 7fccd3325640 1 -- 172.21.15.7:0/102262566 >> 172.21.15.7:0/102262566 conn(0x7fcccc079740 msgr2=0x7fcccc079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:22.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.459+0000 7fccd3325640 1 -- 172.21.15.7:0/102262566 shutdown_connections 2024-09-21T06:44:22.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.459+0000 7fccd3325640 1 -- 172.21.15.7:0/102262566 wait complete. 2024-09-21T06:44:22.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.460+0000 7fccd3325640 1 Processor -- start 2024-09-21T06:44:22.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.460+0000 7fccd3325640 1 -- start start 2024-09-21T06:44:22.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.460+0000 7fccd3325640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcccc102a80 0x7fcccc104270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:22.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.460+0000 7fccd3325640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcccc1083c0 0x7fcccc1047b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:22.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.460+0000 7fccd3325640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcccc108d10 0x7fcccc104cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:22.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.460+0000 7fccd3325640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fcccc112980 con 0x7fcccc108d10 2024-09-21T06:44:22.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.460+0000 7fccd3325640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcccc112800 con 0x7fcccc102a80 2024-09-21T06:44:22.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.460+0000 7fccd3325640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fcccc112b00 con 0x7fcccc1083c0 2024-09-21T06:44:22.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.461+0000 7fccd18c2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcccc108d10 0x7fcccc104cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:22.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.461+0000 7fccd08c0640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcccc1083c0 0x7fcccc1047b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:22.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.461+0000 7fccd18c2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcccc108d10 0x7fcccc104cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40444/0 (socket says 172.21.15.7:40444) 2024-09-21T06:44:22.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.461+0000 7fccd18c2640 1 -- 172.21.15.7:0/3478301196 learned_addr learned my addr 172.21.15.7:0/3478301196 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:44:22.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.461+0000 7fccd10c1640 1 --2- 172.21.15.7:0/3478301196 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcccc102a80 0x7fcccc104270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:22.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.461+0000 7fccd18c2640 1 -- 172.21.15.7:0/3478301196 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcccc1083c0 msgr2=0x7fcccc1047b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:22.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.461+0000 7fccd18c2640 1 --2- 172.21.15.7:0/3478301196 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcccc1083c0 0x7fcccc1047b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:22.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.461+0000 7fccd18c2640 1 -- 172.21.15.7:0/3478301196 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcccc102a80 msgr2=0x7fcccc104270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:22.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.461+0000 7fccd18c2640 1 --2- 172.21.15.7:0/3478301196 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcccc102a80 0x7fcccc104270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:22.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.461+0000 7fccd18c2640 1 -- 172.21.15.7:0/3478301196 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcccc1a8700 con 0x7fcccc108d10 2024-09-21T06:44:22.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.461+0000 7fccd08c0640 1 --2- 172.21.15.7:0/3478301196 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcccc1083c0 0x7fcccc1047b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:44:22.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.461+0000 7fccd18c2640 1 --2- 172.21.15.7:0/3478301196 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcccc108d10 0x7fcccc104cf0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fccc400eb10 tx=0x7fccc400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:22.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.461+0000 7fccc27fc640 1 -- 172.21.15.7:0/3478301196 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc4004b20 con 0x7fcccc108d10 2024-09-21T06:44:22.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.461+0000 7fccc27fc640 1 -- 172.21.15.7:0/3478301196 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fccc4004cc0 con 0x7fcccc108d10 2024-09-21T06:44:22.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.461+0000 7fccc27fc640 1 -- 172.21.15.7:0/3478301196 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc4010670 con 0x7fcccc108d10 2024-09-21T06:44:22.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.461+0000 7fccd3325640 1 -- 172.21.15.7:0/3478301196 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcccc1a89f0 con 0x7fcccc108d10 2024-09-21T06:44:22.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.462+0000 7fccd3325640 1 -- 172.21.15.7:0/3478301196 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcccc1a8f30 con 0x7fcccc108d10 2024-09-21T06:44:22.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.464+0000 7fccd9899740 1 Processor -- start 2024-09-21T06:44:22.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.464+0000 7fccc27fc640 1 -- 172.21.15.7:0/3478301196 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7fccc4005020 con 0x7fcccc108d10 2024-09-21T06:44:22.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.464+0000 7fccd9899740 1 -- start start 2024-09-21T06:44:22.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.465+0000 7fccd9899740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec8fd21070 0x55ec900c86a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:22.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.465+0000 7fccd9899740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec8fcf81b0 0x55ec900c8be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:22.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.465+0000 7fccd9899740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ec8fd00390 0x55ec900c9120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:22.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.465+0000 7fccd9899740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55ec9003eea0 con 0x55ec8fd21070 2024-09-21T06:44:22.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.465+0000 7fccd9899740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55ec9002e2d0 con 0x55ec8fd00390 2024-09-21T06:44:22.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.465+0000 7fccd9899740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55ec900320e0 con 0x55ec8fcf81b0 2024-09-21T06:44:22.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.465+0000 7fccd08c0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec8fd21070 0x55ec900c86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:22.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.465+0000 7fccd08c0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec8fd21070 0x55ec900c86a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40458/0 (socket says 172.21.15.7:40458) 2024-09-21T06:44:22.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.465+0000 7fccd08c0640 1 -- 172.21.15.7:0/662840330 learned_addr learned my addr 172.21.15.7:0/662840330 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:44:22.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.465+0000 7fccd08c0640 1 --2- 172.21.15.7:0/662840330 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ec8fd00390 0x55ec900c9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:22.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.465+0000 7fccd10c1640 1 --2- 172.21.15.7:0/662840330 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec8fcf81b0 0x55ec900c8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:22.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.465+0000 7fccd08c0640 1 -- 172.21.15.7:0/662840330 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec8fcf81b0 msgr2=0x55ec900c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:22.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.465+0000 7fccd08c0640 1 --2- 172.21.15.7:0/662840330 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec8fcf81b0 0x55ec900c8be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:22.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.465+0000 7fccd08c0640 1 -- 172.21.15.7:0/662840330 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ec8fd00390 msgr2=0x55ec900c9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:22.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.465+0000 7fccd08c0640 1 --2- 172.21.15.7:0/662840330 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ec8fd00390 0x55ec900c9120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:22.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.465+0000 7fccc27fc640 1 --2- 172.21.15.7:0/3478301196 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fccb80b6700 0x7fccb80b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:22.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.465+0000 7fccd08c0640 1 -- 172.21.15.7:0/662840330 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec8fd8c650 con 0x55ec8fd21070 2024-09-21T06:44:22.473 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.466+0000 7fccd18c2640 1 --2- 172.21.15.7:0/3478301196 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fccb80b6700 0x7fccb80b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:22.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.466+0000 7fccd08c0640 1 --2- 172.21.15.7:0/662840330 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec8fd21070 0x55ec900c86a0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fccbc0139e0 tx=0x7fccbc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2475aecec278dbe3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:22.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.466+0000 7fccc27fc640 1 -- 172.21.15.7:0/3478301196 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8412+0+0 (secure 0 0 0) 0x7fccc40e7c00 con 0x7fcccc108d10 2024-09-21T06:44:22.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.466+0000 7fccb77fe640 1 -- 172.21.15.7:0/662840330 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccbc004030 con 0x55ec8fd21070 2024-09-21T06:44:22.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.466+0000 7fccb77fe640 1 -- 172.21.15.7:0/662840330 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fccbc00f980 con 0x55ec8fd21070 2024-09-21T06:44:22.474 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.466+0000 7fccb77fe640 1 -- 172.21.15.7:0/662840330 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccbc003af0 con 0x55ec8fd21070 2024-09-21T06:44:22.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.467+0000 7fccd9899740 1 -- 172.21.15.7:0/662840330 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec8fd21070 msgr2=0x55ec900c86a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:22.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.467+0000 7fccd18c2640 1 --2- 172.21.15.7:0/3478301196 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fccb80b6700 0x7fccb80b8c10 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fccc40aad30 tx=0x7fccc4079670 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:22.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.467+0000 7fccd9899740 1 --2- 172.21.15.7:0/662840330 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec8fd21070 0x55ec900c86a0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fccbc0139e0 tx=0x7fccbc009c00 comp rx=0 tx=0).stop 2024-09-21T06:44:22.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.467+0000 7fccd9899740 1 -- 172.21.15.7:0/662840330 shutdown_connections 2024-09-21T06:44:22.478 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.467+0000 7fccd9899740 1 --2- 172.21.15.7:0/662840330 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ec8fd00390 0x55ec900c9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:22.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.467+0000 7fccd9899740 1 --2- 172.21.15.7:0/662840330 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec8fcf81b0 0x55ec900c8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:22.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.467+0000 7fccd9899740 1 --2- 172.21.15.7:0/662840330 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec8fd21070 0x55ec900c86a0 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:22.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.467+0000 7fccd9899740 1 -- 172.21.15.7:0/662840330 >> 172.21.15.7:0/662840330 conn(0x55ec8fd15460 msgr2=0x55ec900c6590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:22.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.467+0000 7fccd9899740 1 -- 172.21.15.7:0/662840330 shutdown_connections 2024-09-21T06:44:22.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.467+0000 7fccd9899740 1 -- 172.21.15.7:0/662840330 wait complete. 2024-09-21T06:44:22.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.467+0000 7fccd9899740 1 -- start start 2024-09-21T06:44:22.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.468+0000 7fccd9899740 1 Processor -- start 2024-09-21T06:44:22.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.468+0000 7fccd9899740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec8fcf81b0 0x55ec900d3d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:22.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.468+0000 7fccd9899740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ec8fd00390 0x55ec900d4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:22.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.468+0000 7fccd9899740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec8fd21070 0x55ec900e0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:22.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.468+0000 7fccd9899740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55ec8fe8f700 con 0x55ec8fd21070 2024-09-21T06:44:22.479 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.468+0000 7fccd9899740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55ec8ffc9160 con 0x55ec8fd00390 2024-09-21T06:44:22.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.468+0000 7fccd9899740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55ec900d6e80 con 0x55ec8fcf81b0 2024-09-21T06:44:22.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.468+0000 7fccd9899740 10 client.0 _ll_register_callbacks cb 0x55ec8ffe29e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:44:22.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.468+0000 7fccd08c0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec8fd21070 0x55ec900e0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:22.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.468+0000 7fccd08c0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec8fd21070 0x55ec900e0170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40464/0 (socket says 172.21.15.7:40464) 2024-09-21T06:44:22.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.468+0000 7fccd08c0640 1 -- 172.21.15.7:0/1197133932 learned_addr learned my addr 172.21.15.7:0/1197133932 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:44:22.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.468+0000 7fccd10c1640 1 --2- 172.21.15.7:0/1197133932 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ec8fd00390 0x55ec900d4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:22.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.468+0000 7fccd08c0640 1 --2- 172.21.15.7:0/1197133932 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec8fcf81b0 0x55ec900d3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:22.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.469+0000 7fccd08c0640 1 -- 172.21.15.7:0/1197133932 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec8fcf81b0 msgr2=0x55ec900d3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:22.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.469+0000 7fccd08c0640 1 --2- 172.21.15.7:0/1197133932 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec8fcf81b0 0x55ec900d3d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:22.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.469+0000 7fccd08c0640 1 -- 172.21.15.7:0/1197133932 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ec8fd00390 msgr2=0x55ec900d4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:22.480 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.469+0000 7fccd08c0640 1 --2- 172.21.15.7:0/1197133932 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ec8fd00390 0x55ec900d4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:22.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.469+0000 7fccd08c0640 1 -- 172.21.15.7:0/1197133932 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec8fff6c90 con 0x55ec8fd21070 2024-09-21T06:44:22.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.469+0000 7fccd10c1640 1 --2- 172.21.15.7:0/1197133932 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ec8fd00390 0x55ec900d4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:44:22.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.469+0000 7fccd08c0640 1 --2- 172.21.15.7:0/1197133932 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec8fd21070 0x55ec900e0170 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fccbc00f790 tx=0x7fccbc003690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a5f72e8f768663 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:22.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.469+0000 7fccb4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:44:22.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.469+0000 7fccb4ff9640 1 -- 172.21.15.7:0/1197133932 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccbc005020 con 0x55ec8fd21070 2024-09-21T06:44:22.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.469+0000 7fccd9899740 1 -- 172.21.15.7:0/1197133932 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fccbc00f980 con 0x55ec8fd21070 2024-09-21T06:44:22.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.469+0000 7fccb4ff9640 1 -- 172.21.15.7:0/1197133932 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8412+0+0 (secure 0 0 0) 0x7fccbc0051c0 con 0x55ec8fd21070 2024-09-21T06:44:22.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.469+0000 7fccb4ff9640 1 -- 172.21.15.7:0/1197133932 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fccbc0053c0 con 0x55ec8fd21070 2024-09-21T06:44:22.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.469+0000 7fccd9899740 10 client.17250 fetch_fsmap learned FSMap version 25 2024-09-21T06:44:22.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.469+0000 7fccd9899740 1 -- 172.21.15.7:0/1197133932 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ec900e2b50 con 0x55ec8fd21070 2024-09-21T06:44:22.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.470+0000 7fccb4ff9640 1 -- 172.21.15.7:0/1197133932 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fccbc00f980 con 0x55ec8fd21070 2024-09-21T06:44:22.481 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.470+0000 7fccb4ff9640 1 -- 172.21.15.7:0/1197133932 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fccbc01e070 con 0x55ec8fd21070 2024-09-21T06:44:22.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.470+0000 7fccd9899740 10 client.17250 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:44:22.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.470+0000 7fccd9899740 10 client.17250 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:44:22.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.470+0000 7fccd9899740 20 client.17250 populate_metadata read hostname 'smithi007' 2024-09-21T06:44:22.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.470+0000 7fccd9899740 1 --2- 172.21.15.7:0/1197133932 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55ec8fcdf9f0 0x55ec900e5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:22.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.470+0000 7fccd9899740 4 client.17250 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:44:22.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.470+0000 7fccd9899740 1 -- 172.21.15.7:0/1197133932 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ec90040df0 con 0x55ec8fcdf9f0 2024-09-21T06:44:22.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.470+0000 7fccd10c1640 1 --2- 172.21.15.7:0/1197133932 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55ec8fcdf9f0 0x55ec900e5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:22.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.471+0000 7fccd10c1640 1 --2- 172.21.15.7:0/1197133932 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55ec8fcdf9f0 0x55ec900e5f10 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83c5b3f842404065 server_cookie=410bed3be7da975 in_seq=0 out_seq=0 2024-09-21T06:44:22.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.471+0000 7fccb4ff9640 10 client.17250 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:44:22.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.471+0000 7fccb4ff9640 1 -- 172.21.15.7:0/1197133932 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ec90040df0 con 0x55ec8fcdf9f0 2024-09-21T06:44:22.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.471+0000 7fccb4ff9640 10 client.17250 handle_command_reply: tid=0 2024-09-21T06:44:22.482 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.471+0000 7fccd9899740 1 client.17250 shutdown 2024-09-21T06:44:22.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.472+0000 7fccd9899740 1 -- 172.21.15.7:0/1197133932 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec8fd21070 msgr2=0x55ec900e0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:22.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.472+0000 7fccd9899740 1 --2- 172.21.15.7:0/1197133932 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec8fd21070 0x55ec900e0170 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fccbc00f790 tx=0x7fccbc003690 comp rx=0 tx=0).stop 2024-09-21T06:44:22.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.472+0000 7fccd9899740 1 -- 172.21.15.7:0/1197133932 shutdown_connections 2024-09-21T06:44:22.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.472+0000 7fccd9899740 1 --2- 172.21.15.7:0/1197133932 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55ec8fcdf9f0 0x55ec900e5f10 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:22.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.472+0000 7fccd9899740 1 --2- 172.21.15.7:0/1197133932 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec8fd21070 0x55ec900e0170 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:22.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.472+0000 7fccd9899740 1 --2- 172.21.15.7:0/1197133932 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ec8fd00390 0x55ec900d4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:22.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.472+0000 7fccb4ff9640 0 client.17250 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:44:22.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.472+0000 7fccd9899740 1 --2- 172.21.15.7:0/1197133932 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec8fcf81b0 0x55ec900d3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:22.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.472+0000 7fccd9899740 1 -- 172.21.15.7:0/1197133932 >> 172.21.15.7:0/1197133932 conn(0x55ec8fd15460 msgr2=0x55ec900cb880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:22.483 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.472+0000 7fccd9899740 1 -- 172.21.15.7:0/1197133932 shutdown_connections 2024-09-21T06:44:22.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.472+0000 7fccd9899740 1 -- 172.21.15.7:0/1197133932 wait complete. 2024-09-21T06:44:22.484 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.472+0000 7fccd9899740 20 client.17250 trim_cache size 0 max 16384 2024-09-21T06:44:22.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.485+0000 7fccd9899740 1 Processor -- start 2024-09-21T06:44:22.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.485+0000 7fccd9899740 1 -- start start 2024-09-21T06:44:22.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.486+0000 7fccd9899740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec8fcf81b0 0x55ec900d5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:22.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.486+0000 7fccd9899740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec8fd00390 0x55ec900c9de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:22.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.486+0000 7fccd9899740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ec8fd21070 0x55ec900c5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:22.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.486+0000 7fccd9899740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fcccc1b4040 con 0x55ec8fcf81b0 2024-09-21T06:44:22.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.486+0000 7fccd9899740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcccc1b1910 con 0x55ec8fd21070 2024-09-21T06:44:22.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.486+0000 7fccd9899740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fcccc1af780 con 0x55ec8fd00390 2024-09-21T06:44:22.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.486+0000 7fccd08c0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec8fcf81b0 0x55ec900d5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:22.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.486+0000 7fccd08c0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec8fcf81b0 0x55ec900d5bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40476/0 (socket says 172.21.15.7:40476) 2024-09-21T06:44:22.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.486+0000 7fccd08c0640 1 -- 172.21.15.7:0/2432349570 learned_addr learned my addr 172.21.15.7:0/2432349570 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:44:22.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.486+0000 7fccd10c1640 1 --2- 172.21.15.7:0/2432349570 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec8fd00390 0x55ec900c9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:22.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.486+0000 7fccd08c0640 1 -- 172.21.15.7:0/2432349570 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec8fd00390 msgr2=0x55ec900c9de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:22.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.486+0000 7fccd08c0640 1 --2- 172.21.15.7:0/2432349570 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec8fd00390 0x55ec900c9de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:22.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.486+0000 7fccd08c0640 1 -- 172.21.15.7:0/2432349570 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ec8fd21070 msgr2=0x55ec900c5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:22.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.486+0000 7fccd08c0640 1 --2- 172.21.15.7:0/2432349570 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ec8fd21070 0x55ec900c5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:22.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.486+0000 7fccd08c0640 1 -- 172.21.15.7:0/2432349570 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec900d69f0 con 0x55ec8fcf81b0 2024-09-21T06:44:22.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.486+0000 7fccd08c0640 1 --2- 172.21.15.7:0/2432349570 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec8fcf81b0 0x55ec900d5bf0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fccbc003660 tx=0x7fccbc005db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b3c8511d7970acb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:22.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.486+0000 7fccb6ffd640 1 -- 172.21.15.7:0/2432349570 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccbc033030 con 0x55ec8fcf81b0 2024-09-21T06:44:22.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.486+0000 7fccb6ffd640 1 -- 172.21.15.7:0/2432349570 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fccbc00f980 con 0x55ec8fcf81b0 2024-09-21T06:44:22.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.486+0000 7fccb6ffd640 1 -- 172.21.15.7:0/2432349570 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccbc0134c0 con 0x55ec8fcf81b0 2024-09-21T06:44:22.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.487+0000 7fccd9899740 1 -- 172.21.15.7:0/2432349570 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec8fcf81b0 msgr2=0x55ec900d5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:22.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.487+0000 7fccd9899740 1 --2- 172.21.15.7:0/2432349570 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec8fcf81b0 0x55ec900d5bf0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fccbc003660 tx=0x7fccbc005db0 comp rx=0 tx=0).stop 2024-09-21T06:44:22.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.487+0000 7fccd9899740 1 -- 172.21.15.7:0/2432349570 shutdown_connections 2024-09-21T06:44:22.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.487+0000 7fccd9899740 1 --2- 172.21.15.7:0/2432349570 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ec8fd21070 0x55ec900c5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:22.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.487+0000 7fccd9899740 1 --2- 172.21.15.7:0/2432349570 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec8fd00390 0x55ec900c9de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:22.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.487+0000 7fccd9899740 1 --2- 172.21.15.7:0/2432349570 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec8fcf81b0 0x55ec900d5bf0 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:22.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.487+0000 7fccd9899740 1 -- 172.21.15.7:0/2432349570 >> 172.21.15.7:0/2432349570 conn(0x55ec8fd15460 msgr2=0x55ec900c96d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:22.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.487+0000 7fccd9899740 1 -- 172.21.15.7:0/2432349570 shutdown_connections 2024-09-21T06:44:22.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.487+0000 7fccd9899740 1 -- 172.21.15.7:0/2432349570 wait complete. 2024-09-21T06:44:22.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.488+0000 7fccd9899740 1 -- start start 2024-09-21T06:44:22.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.488+0000 7fccd9899740 1 Processor -- start 2024-09-21T06:44:22.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.488+0000 7fccd9899740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec8fcf81b0 0x55ec900dc850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:22.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.488+0000 7fccd9899740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ec8fd00390 0x55ec900d7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:22.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.488+0000 7fccd9899740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec8fd21070 0x55ec900d8240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:22.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.488+0000 7fccd9899740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fcccc1afdd0 con 0x55ec8fcf81b0 2024-09-21T06:44:22.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.488+0000 7fccd9899740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcccc1b1240 con 0x55ec8fd00390 2024-09-21T06:44:22.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.488+0000 7fccd9899740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fcccc1b04a0 con 0x55ec8fd21070 2024-09-21T06:44:22.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.488+0000 7fccd9899740 10 client.0 _ll_register_callbacks cb 0x7fccbc013810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:44:22.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.488+0000 7fccd08c0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec8fcf81b0 0x55ec900dc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:22.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.488+0000 7fccd08c0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec8fcf81b0 0x55ec900dc850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40482/0 (socket says 172.21.15.7:40482) 2024-09-21T06:44:22.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.488+0000 7fccd08c0640 1 -- 172.21.15.7:0/42068961 learned_addr learned my addr 172.21.15.7:0/42068961 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:44:22.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.489+0000 7fccd10c1640 1 --2- 172.21.15.7:0/42068961 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ec8fd00390 0x55ec900d7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:22.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.489+0000 7fccd08c0640 1 --2- 172.21.15.7:0/42068961 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec8fd21070 0x55ec900d8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:22.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.489+0000 7fccd08c0640 1 -- 172.21.15.7:0/42068961 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec8fd21070 msgr2=0x55ec900d8240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:22.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.489+0000 7fccd08c0640 1 --2- 172.21.15.7:0/42068961 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec8fd21070 0x55ec900d8240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:22.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.489+0000 7fccd08c0640 1 -- 172.21.15.7:0/42068961 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ec8fd00390 msgr2=0x55ec900d7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:22.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.489+0000 7fccd08c0640 1 --2- 172.21.15.7:0/42068961 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ec8fd00390 0x55ec900d7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:22.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.489+0000 7fccd08c0640 1 -- 172.21.15.7:0/42068961 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec900d8980 con 0x55ec8fcf81b0 2024-09-21T06:44:22.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.489+0000 7fccd08c0640 1 --2- 172.21.15.7:0/42068961 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec8fcf81b0 0x55ec900dc850 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fccbc010bf0 tx=0x7fccbc010a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3aff69f2410c776a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:22.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.489+0000 7fccb4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:44:22.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.489+0000 7fccb4ff9640 1 -- 172.21.15.7:0/42068961 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccbc03d060 con 0x55ec8fcf81b0 2024-09-21T06:44:22.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.489+0000 7fccb4ff9640 1 -- 172.21.15.7:0/42068961 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8412+0+0 (secure 0 0 0) 0x7fccbc003850 con 0x55ec8fcf81b0 2024-09-21T06:44:22.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.489+0000 7fccd9899740 1 -- 172.21.15.7:0/42068961 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fccbc00f980 con 0x55ec8fcf81b0 2024-09-21T06:44:22.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.489+0000 7fccb4ff9640 1 -- 172.21.15.7:0/42068961 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fccbc033040 con 0x55ec8fcf81b0 2024-09-21T06:44:22.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.489+0000 7fccd9899740 10 client.17256 fetch_fsmap learned FSMap version 25 2024-09-21T06:44:22.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.489+0000 7fccd9899740 1 -- 172.21.15.7:0/42068961 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ec90150680 con 0x55ec8fcf81b0 2024-09-21T06:44:22.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.490+0000 7fccb4ff9640 1 -- 172.21.15.7:0/42068961 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fccbc00f980 con 0x55ec8fcf81b0 2024-09-21T06:44:22.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.490+0000 7fccb4ff9640 1 -- 172.21.15.7:0/42068961 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fccbc040020 con 0x55ec8fcf81b0 2024-09-21T06:44:22.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.490+0000 7fccd9899740 10 client.17256 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:44:22.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.490+0000 7fccd9899740 10 client.17256 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:44:22.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.490+0000 7fccd9899740 20 client.17256 populate_metadata read hostname 'smithi007' 2024-09-21T06:44:22.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.490+0000 7fccd9899740 1 --2- 172.21.15.7:0/42068961 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55ec8fcb4da0 0x55ec90152db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:22.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.490+0000 7fccd9899740 4 client.17256 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:44:22.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.490+0000 7fccd9899740 1 -- 172.21.15.7:0/42068961 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ec9003c8a0 con 0x55ec8fcb4da0 2024-09-21T06:44:22.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.490+0000 7fccd10c1640 1 --2- 172.21.15.7:0/42068961 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55ec8fcb4da0 0x55ec90152db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:22.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.491+0000 7fccb4ff9640 10 client.17256 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:44:22.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.491+0000 7fccd10c1640 1 --2- 172.21.15.7:0/42068961 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55ec8fcb4da0 0x55ec90152db0 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24781558fda35f6f server_cookie=9f06963c56cad1a7 in_seq=0 out_seq=0 2024-09-21T06:44:22.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.491+0000 7fccb4ff9640 1 -- 172.21.15.7:0/42068961 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ec9003c8a0 con 0x55ec8fcb4da0 2024-09-21T06:44:22.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.491+0000 7fccb4ff9640 10 client.17256 handle_command_reply: tid=0 2024-09-21T06:44:22.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.491+0000 7fccd9899740 1 client.17256 shutdown 2024-09-21T06:44:22.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.491+0000 7fccd9899740 1 -- 172.21.15.7:0/42068961 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec8fcf81b0 msgr2=0x55ec900dc850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:22.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.491+0000 7fccd9899740 1 --2- 172.21.15.7:0/42068961 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec8fcf81b0 0x55ec900dc850 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fccbc010bf0 tx=0x7fccbc010a20 comp rx=0 tx=0).stop 2024-09-21T06:44:22.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.491+0000 7fccd9899740 1 -- 172.21.15.7:0/42068961 shutdown_connections 2024-09-21T06:44:22.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.491+0000 7fccd9899740 1 --2- 172.21.15.7:0/42068961 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55ec8fcb4da0 0x55ec90152db0 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:22.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.491+0000 7fccd9899740 1 --2- 172.21.15.7:0/42068961 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ec8fd21070 0x55ec900d8240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:22.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.491+0000 7fccd9899740 1 --2- 172.21.15.7:0/42068961 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ec8fd00390 0x55ec900d7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:22.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.491+0000 7fccd9899740 1 --2- 172.21.15.7:0/42068961 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ec8fcf81b0 0x55ec900dc850 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:22.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.491+0000 7fccd9899740 1 -- 172.21.15.7:0/42068961 >> 172.21.15.7:0/42068961 conn(0x55ec8fd15460 msgr2=0x55ec900d58e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:22.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.491+0000 7fccb4ff9640 0 client.17256 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:44:22.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.491+0000 7fccd9899740 1 -- 172.21.15.7:0/42068961 shutdown_connections 2024-09-21T06:44:22.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.491+0000 7fccd9899740 1 -- 172.21.15.7:0/42068961 wait complete. 2024-09-21T06:44:22.500 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.491+0000 7fccd9899740 20 client.17256 trim_cache size 0 max 16384 2024-09-21T06:44:22.501 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:44:22.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.492+0000 7fccd3325640 1 -- 172.21.15.7:0/3478301196 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fccb80b6700 msgr2=0x7fccb80b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:22.501 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.492+0000 7fccd3325640 1 --2- 172.21.15.7:0/3478301196 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fccb80b6700 0x7fccb80b8c10 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fccc40aad30 tx=0x7fccc4079670 comp rx=0 tx=0).stop 2024-09-21T06:44:22.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.492+0000 7fccd3325640 1 -- 172.21.15.7:0/3478301196 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcccc108d10 msgr2=0x7fcccc104cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:22.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.492+0000 7fccd3325640 1 --2- 172.21.15.7:0/3478301196 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcccc108d10 0x7fcccc104cf0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fccc400eb10 tx=0x7fccc400c2d0 comp rx=0 tx=0).stop 2024-09-21T06:44:22.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.492+0000 7fccd3325640 1 -- 172.21.15.7:0/3478301196 shutdown_connections 2024-09-21T06:44:22.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.492+0000 7fccd3325640 1 --2- 172.21.15.7:0/3478301196 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fccb80b6700 0x7fccb80b8c10 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:22.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.492+0000 7fccd3325640 1 --2- 172.21.15.7:0/3478301196 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcccc108d10 0x7fcccc104cf0 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:22.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.492+0000 7fccd3325640 1 --2- 172.21.15.7:0/3478301196 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcccc1083c0 0x7fcccc1047b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:22.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.492+0000 7fccd3325640 1 --2- 172.21.15.7:0/3478301196 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcccc102a80 0x7fcccc104270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:22.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.492+0000 7fccd3325640 1 -- 172.21.15.7:0/3478301196 >> 172.21.15.7:0/3478301196 conn(0x7fcccc079740 msgr2=0x7fcccc101980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:22.502 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.492+0000 7fccd3325640 1 -- 172.21.15.7:0/3478301196 shutdown_connections 2024-09-21T06:44:22.503 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:22.492+0000 7fccd3325640 1 -- 172.21.15.7:0/3478301196 wait complete. 2024-09-21T06:44:23.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:44:23 smithi007 ceph-mon[30983]: pgmap v568: 97 pgs: 97 active+clean; 3.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T06:44:23.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:44:23 smithi144 ceph-mon[34653]: pgmap v568: 97 pgs: 97 active+clean; 3.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T06:44:23.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:44:23 smithi018 ceph-mon[34477]: pgmap v568: 97 pgs: 97 active+clean; 3.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T06:44:24.287 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:44:24.287 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:44:24.559 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:44:25.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.057+0000 7f9de6851640 1 -- 172.21.15.7:0/1559606045 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9de01094a0 msgr2=0x7f9de01098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:25.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.057+0000 7f9de6851640 1 --2- 172.21.15.7:0/1559606045 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9de01094a0 0x7f9de01098b0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f9dc8009900 tx=0x7f9dc802a410 comp rx=0 tx=0).stop 2024-09-21T06:44:25.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.057+0000 7f9de6851640 1 -- 172.21.15.7:0/1559606045 shutdown_connections 2024-09-21T06:44:25.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.057+0000 7f9de6851640 1 --2- 172.21.15.7:0/1559606045 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9de0109df0 0x7f9de0110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:25.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.057+0000 7f9de6851640 1 --2- 172.21.15.7:0/1559606045 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9de01094a0 0x7f9de01098b0 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:25.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.057+0000 7f9de6851640 1 --2- 172.21.15.7:0/1559606045 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9de0103b60 0x7f9de0103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:25.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.057+0000 7f9de6851640 1 -- 172.21.15.7:0/1559606045 >> 172.21.15.7:0/1559606045 conn(0x7f9de007b850 msgr2=0x7f9de007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:25.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.057+0000 7f9de6851640 1 -- 172.21.15.7:0/1559606045 shutdown_connections 2024-09-21T06:44:25.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.057+0000 7f9de6851640 1 -- 172.21.15.7:0/1559606045 wait complete. 2024-09-21T06:44:25.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.058+0000 7f9de6851640 1 Processor -- start 2024-09-21T06:44:25.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.058+0000 7f9de6851640 1 -- start start 2024-09-21T06:44:25.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.058+0000 7f9de6851640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9de0103b60 0x7f9de019a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:25.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.058+0000 7f9de6851640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9de01094a0 0x7f9de019ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:25.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.058+0000 7f9de6851640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9de0109df0 0x7f9de019fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:25.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.058+0000 7f9de6851640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9de0113ab0 con 0x7f9de0109df0 2024-09-21T06:44:25.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.058+0000 7f9de6851640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9de0113930 con 0x7f9de0103b60 2024-09-21T06:44:25.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.058+0000 7f9de6851640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9de0113c30 con 0x7f9de01094a0 2024-09-21T06:44:25.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.058+0000 7f9de4dee640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9de0109df0 0x7f9de019fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:25.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.058+0000 7f9de4dee640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9de0109df0 0x7f9de019fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40504/0 (socket says 172.21.15.7:40504) 2024-09-21T06:44:25.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.058+0000 7f9de4dee640 1 -- 172.21.15.7:0/1279716772 learned_addr learned my addr 172.21.15.7:0/1279716772 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:44:25.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.058+0000 7f9dd7fff640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9de01094a0 0x7f9de019ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:25.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.058+0000 7f9ddffff640 1 --2- 172.21.15.7:0/1279716772 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9de0103b60 0x7f9de019a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:25.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.059+0000 7f9de4dee640 1 -- 172.21.15.7:0/1279716772 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9de01094a0 msgr2=0x7f9de019ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:25.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.059+0000 7f9de4dee640 1 --2- 172.21.15.7:0/1279716772 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9de01094a0 0x7f9de019ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:25.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.059+0000 7f9de4dee640 1 -- 172.21.15.7:0/1279716772 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9de0103b60 msgr2=0x7f9de019a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:25.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.059+0000 7f9de4dee640 1 --2- 172.21.15.7:0/1279716772 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9de0103b60 0x7f9de019a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:25.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.059+0000 7f9de4dee640 1 -- 172.21.15.7:0/1279716772 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9de01a04d0 con 0x7f9de0109df0 2024-09-21T06:44:25.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.059+0000 7f9de4dee640 1 --2- 172.21.15.7:0/1279716772 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9de0109df0 0x7f9de019fda0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f9dd800eaa0 tx=0x7f9dd800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:25.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.059+0000 7f9dddffb640 1 -- 172.21.15.7:0/1279716772 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd800cdb0 con 0x7f9de0109df0 2024-09-21T06:44:25.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.059+0000 7f9dddffb640 1 -- 172.21.15.7:0/1279716772 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9dd8005020 con 0x7f9de0109df0 2024-09-21T06:44:25.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.059+0000 7f9de6851640 1 -- 172.21.15.7:0/1279716772 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9de01a07c0 con 0x7f9de0109df0 2024-09-21T06:44:25.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.059+0000 7f9dddffb640 1 -- 172.21.15.7:0/1279716772 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd80116d0 con 0x7f9de0109df0 2024-09-21T06:44:25.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.059+0000 7f9de6851640 1 -- 172.21.15.7:0/1279716772 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9de01a6f20 con 0x7f9de0109df0 2024-09-21T06:44:25.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.062+0000 7f9decdc5740 1 Processor -- start 2024-09-21T06:44:25.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.062+0000 7f9dddffb640 1 -- 172.21.15.7:0/1279716772 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f9dd80051d0 con 0x7f9de0109df0 2024-09-21T06:44:25.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.062+0000 7f9decdc5740 1 -- start start 2024-09-21T06:44:25.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.062+0000 7f9decdc5740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5568ffb72350 0x5568fff19430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:25.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.063+0000 7f9decdc5740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5568ffb49490 0x5568fff19970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:25.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.063+0000 7f9decdc5740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5568ffb51670 0x5568fff19eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:25.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.063+0000 7f9decdc5740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5568ffe8fe60 con 0x5568ffb51670 2024-09-21T06:44:25.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.063+0000 7f9decdc5740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5568ffe7f290 con 0x5568ffb49490 2024-09-21T06:44:25.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.063+0000 7f9decdc5740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5568ffe830a0 con 0x5568ffb72350 2024-09-21T06:44:25.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.063+0000 7f9dd7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5568ffb51670 0x5568fff19eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:25.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.063+0000 7f9dd7fff640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5568ffb72350 0x5568fff19430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:25.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.063+0000 7f9dd7fff640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5568ffb72350 0x5568fff19430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.7:50290/0 (socket says 172.21.15.7:50290) 2024-09-21T06:44:25.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.063+0000 7f9dd7fff640 1 -- 172.21.15.7:0/2669999068 learned_addr learned my addr 172.21.15.7:0/2669999068 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:44:25.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.063+0000 7f9ddffff640 1 --2- 172.21.15.7:0/2669999068 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5568ffb49490 0x5568fff19970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:25.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.063+0000 7f9dd7fff640 1 -- 172.21.15.7:0/2669999068 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5568ffb49490 msgr2=0x5568fff19970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:25.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.063+0000 7f9dd7fff640 1 --2- 172.21.15.7:0/2669999068 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5568ffb49490 0x5568fff19970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:25.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.063+0000 7f9dd7fff640 1 -- 172.21.15.7:0/2669999068 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5568ffb51670 msgr2=0x5568fff19eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:25.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.063+0000 7f9dd7fff640 1 --2- 172.21.15.7:0/2669999068 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5568ffb51670 0x5568fff19eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:25.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.063+0000 7f9dddffb640 1 --2- 172.21.15.7:0/1279716772 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f9dcc0b6700 0x7f9dcc0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:25.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.063+0000 7f9dd7fff640 1 -- 172.21.15.7:0/2669999068 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568ffbdd930 con 0x5568ffb72350 2024-09-21T06:44:25.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.063+0000 7f9ddffff640 1 --2- 172.21.15.7:0/1279716772 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f9dcc0b6700 0x7f9dcc0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:25.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.063+0000 7f9dddffb640 1 -- 172.21.15.7:0/1279716772 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8412+0+0 (secure 0 0 0) 0x7f9dd80e7670 con 0x7f9de0109df0 2024-09-21T06:44:25.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.063+0000 7f9dd7fff640 1 --2- 172.21.15.7:0/2669999068 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5568ffb72350 0x5568fff19430 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9dc8032fd0 tx=0x7f9dc8031400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2671cbf5587120b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:25.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.064+0000 7f9dd67fc640 1 -- 172.21.15.7:0/2669999068 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc8035050 con 0x5568ffb72350 2024-09-21T06:44:25.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.064+0000 7f9dd67fc640 1 -- 172.21.15.7:0/2669999068 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9dc8005030 con 0x5568ffb72350 2024-09-21T06:44:25.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.064+0000 7f9dd67fc640 1 -- 172.21.15.7:0/2669999068 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc80044e0 con 0x5568ffb72350 2024-09-21T06:44:25.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.065+0000 7f9decdc5740 1 -- 172.21.15.7:0/2669999068 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5568ffb72350 msgr2=0x5568fff19430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:25.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.065+0000 7f9ddffff640 1 --2- 172.21.15.7:0/1279716772 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f9dcc0b6700 0x7f9dcc0b8c10 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x5568fff180b0 tx=0x7f9dd000b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:25.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.065+0000 7f9decdc5740 1 --2- 172.21.15.7:0/2669999068 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5568ffb72350 0x5568fff19430 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9dc8032fd0 tx=0x7f9dc8031400 comp rx=0 tx=0).stop 2024-09-21T06:44:25.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.065+0000 7f9decdc5740 1 -- 172.21.15.7:0/2669999068 shutdown_connections 2024-09-21T06:44:25.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.065+0000 7f9decdc5740 1 --2- 172.21.15.7:0/2669999068 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5568ffb51670 0x5568fff19eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:25.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.065+0000 7f9decdc5740 1 --2- 172.21.15.7:0/2669999068 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5568ffb49490 0x5568fff19970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:25.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.065+0000 7f9decdc5740 1 --2- 172.21.15.7:0/2669999068 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5568ffb72350 0x5568fff19430 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:25.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.065+0000 7f9decdc5740 1 -- 172.21.15.7:0/2669999068 >> 172.21.15.7:0/2669999068 conn(0x5568ffb66740 msgr2=0x5568fff17320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:25.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.065+0000 7f9decdc5740 1 -- 172.21.15.7:0/2669999068 shutdown_connections 2024-09-21T06:44:25.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.065+0000 7f9decdc5740 1 -- 172.21.15.7:0/2669999068 wait complete. 2024-09-21T06:44:25.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.065+0000 7f9decdc5740 1 -- start start 2024-09-21T06:44:25.069 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.065+0000 7f9decdc5740 1 Processor -- start 2024-09-21T06:44:25.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.066+0000 7f9decdc5740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5568ffb49490 0x5568fff24fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:25.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.066+0000 7f9decdc5740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5568ffb51670 0x5568fff254f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:25.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.066+0000 7f9decdc5740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5568ffb72350 0x5568fff30ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:25.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.066+0000 7f9decdc5740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5568ffce0890 con 0x5568ffb72350 2024-09-21T06:44:25.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.066+0000 7f9decdc5740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5568ffe19d40 con 0x5568ffb49490 2024-09-21T06:44:25.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.066+0000 7f9decdc5740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5568fff27bb0 con 0x5568ffb51670 2024-09-21T06:44:25.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.066+0000 7f9decdc5740 10 client.0 _ll_register_callbacks cb 0x5568ffe7dc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:44:25.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.066+0000 7f9de4dee640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5568ffb72350 0x5568fff30ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:25.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.066+0000 7f9de4dee640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5568ffb72350 0x5568fff30ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40520/0 (socket says 172.21.15.7:40520) 2024-09-21T06:44:25.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.066+0000 7f9de4dee640 1 -- 172.21.15.7:0/1556753609 learned_addr learned my addr 172.21.15.7:0/1556753609 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:44:25.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.066+0000 7f9ddffff640 1 --2- 172.21.15.7:0/1556753609 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5568ffb49490 0x5568fff24fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:25.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.066+0000 7f9dd7fff640 1 --2- 172.21.15.7:0/1556753609 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5568ffb51670 0x5568fff254f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:25.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.066+0000 7f9de4dee640 1 -- 172.21.15.7:0/1556753609 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5568ffb51670 msgr2=0x5568fff254f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:25.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.066+0000 7f9de4dee640 1 --2- 172.21.15.7:0/1556753609 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5568ffb51670 0x5568fff254f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:25.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.066+0000 7f9de4dee640 1 -- 172.21.15.7:0/1556753609 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5568ffb49490 msgr2=0x5568fff24fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:25.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.066+0000 7f9de4dee640 1 --2- 172.21.15.7:0/1556753609 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5568ffb49490 0x5568fff24fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:25.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.066+0000 7f9de4dee640 1 -- 172.21.15.7:0/1556753609 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568fff31460 con 0x5568ffb72350 2024-09-21T06:44:25.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.066+0000 7f9dd7fff640 1 --2- 172.21.15.7:0/1556753609 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5568ffb51670 0x5568fff254f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:44:25.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.066+0000 7f9ddffff640 1 --2- 172.21.15.7:0/1556753609 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5568ffb49490 0x5568fff24fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:44:25.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.067+0000 7f9de4dee640 1 --2- 172.21.15.7:0/1556753609 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5568ffb72350 0x5568fff30ed0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f9dd80ad570 tx=0x7f9dd80ace80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=302eacdc4ff381f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:25.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.067+0000 7f9dbf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:44:25.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.067+0000 7f9dbf7fe640 1 -- 172.21.15.7:0/1556753609 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd801f040 con 0x5568ffb72350 2024-09-21T06:44:25.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.067+0000 7f9dbf7fe640 1 -- 172.21.15.7:0/1556753609 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8412+0+0 (secure 0 0 0) 0x7f9dd80ac2b0 con 0x5568ffb72350 2024-09-21T06:44:25.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.067+0000 7f9decdc5740 1 -- 172.21.15.7:0/1556753609 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9dc8005030 con 0x5568ffb72350 2024-09-21T06:44:25.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.067+0000 7f9dbf7fe640 1 -- 172.21.15.7:0/1556753609 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9dd80b6f50 con 0x5568ffb72350 2024-09-21T06:44:25.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.067+0000 7f9decdc5740 10 client.17268 fetch_fsmap learned FSMap version 25 2024-09-21T06:44:25.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.067+0000 7f9decdc5740 1 -- 172.21.15.7:0/1556753609 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5568fff33d90 con 0x5568ffb72350 2024-09-21T06:44:25.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.067+0000 7f9dbf7fe640 1 -- 172.21.15.7:0/1556753609 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9dc8005030 con 0x5568ffb72350 2024-09-21T06:44:25.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.067+0000 7f9dbf7fe640 1 -- 172.21.15.7:0/1556753609 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9dd80a7ce0 con 0x5568ffb72350 2024-09-21T06:44:25.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.067+0000 7f9decdc5740 10 client.17268 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:44:25.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.067+0000 7f9decdc5740 10 client.17268 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:44:25.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.067+0000 7f9decdc5740 20 client.17268 populate_metadata read hostname 'smithi007' 2024-09-21T06:44:25.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.067+0000 7f9decdc5740 1 --2- 172.21.15.7:0/1556753609 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5568ffb30cd0 0x5568fff37210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:25.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.067+0000 7f9decdc5740 4 client.17268 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:44:25.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.067+0000 7f9decdc5740 1 -- 172.21.15.7:0/1556753609 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5568ffe91db0 con 0x5568ffb30cd0 2024-09-21T06:44:25.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.068+0000 7f9ddffff640 1 --2- 172.21.15.7:0/1556753609 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5568ffb30cd0 0x5568fff37210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:25.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.068+0000 7f9ddffff640 1 --2- 172.21.15.7:0/1556753609 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5568ffb30cd0 0x5568fff37210 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b113f7726767e16d server_cookie=99717f156ed925a7 in_seq=0 out_seq=0 2024-09-21T06:44:25.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.068+0000 7f9dbf7fe640 10 client.17268 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:44:25.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.069+0000 7f9dbf7fe640 1 -- 172.21.15.7:0/1556753609 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5568ffe91db0 con 0x5568ffb30cd0 2024-09-21T06:44:25.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.069+0000 7f9dbf7fe640 10 client.17268 handle_command_reply: tid=0 2024-09-21T06:44:25.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.069+0000 7f9decdc5740 1 client.17268 shutdown 2024-09-21T06:44:25.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.070+0000 7f9decdc5740 1 -- 172.21.15.7:0/1556753609 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5568ffb72350 msgr2=0x5568fff30ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:25.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.070+0000 7f9decdc5740 1 --2- 172.21.15.7:0/1556753609 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5568ffb72350 0x5568fff30ed0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f9dd80ad570 tx=0x7f9dd80ace80 comp rx=0 tx=0).stop 2024-09-21T06:44:25.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.070+0000 7f9decdc5740 1 -- 172.21.15.7:0/1556753609 shutdown_connections 2024-09-21T06:44:25.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.070+0000 7f9decdc5740 1 --2- 172.21.15.7:0/1556753609 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5568ffb30cd0 0x5568fff37210 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:25.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.070+0000 7f9decdc5740 1 --2- 172.21.15.7:0/1556753609 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5568ffb72350 0x5568fff30ed0 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:25.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.070+0000 7f9decdc5740 1 --2- 172.21.15.7:0/1556753609 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5568ffb51670 0x5568fff254f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:25.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.070+0000 7f9decdc5740 1 --2- 172.21.15.7:0/1556753609 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5568ffb49490 0x5568fff24fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:25.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.070+0000 7f9decdc5740 1 -- 172.21.15.7:0/1556753609 >> 172.21.15.7:0/1556753609 conn(0x5568ffb66740 msgr2=0x5568fff1c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:25.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.070+0000 7f9dbf7fe640 0 client.17268 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:44:25.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.070+0000 7f9decdc5740 1 -- 172.21.15.7:0/1556753609 shutdown_connections 2024-09-21T06:44:25.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.070+0000 7f9decdc5740 1 -- 172.21.15.7:0/1556753609 wait complete. 2024-09-21T06:44:25.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.070+0000 7f9decdc5740 20 client.17268 trim_cache size 0 max 16384 2024-09-21T06:44:25.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.087+0000 7f9decdc5740 1 Processor -- start 2024-09-21T06:44:25.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.087+0000 7f9decdc5740 1 -- start start 2024-09-21T06:44:25.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.088+0000 7f9decdc5740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5568ffb49490 0x5568fff1cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:25.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.088+0000 7f9decdc5740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5568ffb51670 0x5568fff30dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:25.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.088+0000 7f9decdc5740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5568ffb72350 0x5568fff1e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:25.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.088+0000 7f9decdc5740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9de01b1ef0 con 0x5568ffb72350 2024-09-21T06:44:25.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.088+0000 7f9decdc5740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9de01af7c0 con 0x5568ffb49490 2024-09-21T06:44:25.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.088+0000 7f9decdc5740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9de01ad630 con 0x5568ffb51670 2024-09-21T06:44:25.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.088+0000 7f9de4dee640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5568ffb72350 0x5568fff1e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:25.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.088+0000 7f9de4dee640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5568ffb72350 0x5568fff1e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40530/0 (socket says 172.21.15.7:40530) 2024-09-21T06:44:25.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.088+0000 7f9de4dee640 1 -- 172.21.15.7:0/2185039967 learned_addr learned my addr 172.21.15.7:0/2185039967 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:44:25.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.088+0000 7f9ddffff640 1 --2- 172.21.15.7:0/2185039967 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5568ffb49490 0x5568fff1cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:25.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.088+0000 7f9dd7fff640 1 --2- 172.21.15.7:0/2185039967 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5568ffb51670 0x5568fff30dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:25.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.088+0000 7f9de4dee640 1 -- 172.21.15.7:0/2185039967 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5568ffb51670 msgr2=0x5568fff30dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:25.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.088+0000 7f9de4dee640 1 --2- 172.21.15.7:0/2185039967 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5568ffb51670 0x5568fff30dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:25.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.088+0000 7f9de4dee640 1 -- 172.21.15.7:0/2185039967 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5568ffb49490 msgr2=0x5568fff1cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:25.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.088+0000 7f9de4dee640 1 --2- 172.21.15.7:0/2185039967 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5568ffb49490 0x5568fff1cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:25.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.088+0000 7f9de4dee640 1 -- 172.21.15.7:0/2185039967 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568fff16a70 con 0x5568ffb72350 2024-09-21T06:44:25.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.088+0000 7f9de4dee640 1 --2- 172.21.15.7:0/2185039967 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5568ffb72350 0x5568fff1e4c0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f9dd80e5430 tx=0x7f9dd8000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5697661e813259a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:25.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.089+0000 7f9dd5ffb640 1 -- 172.21.15.7:0/2185039967 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd801f070 con 0x5568ffb72350 2024-09-21T06:44:25.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.089+0000 7f9dd5ffb640 1 -- 172.21.15.7:0/2185039967 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9dd805c070 con 0x5568ffb72350 2024-09-21T06:44:25.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.089+0000 7f9dd5ffb640 1 -- 172.21.15.7:0/2185039967 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd80b3400 con 0x5568ffb72350 2024-09-21T06:44:25.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.089+0000 7f9decdc5740 1 -- 172.21.15.7:0/2185039967 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5568ffb72350 msgr2=0x5568fff1e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:25.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.089+0000 7f9decdc5740 1 --2- 172.21.15.7:0/2185039967 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5568ffb72350 0x5568fff1e4c0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f9dd80e5430 tx=0x7f9dd8000f40 comp rx=0 tx=0).stop 2024-09-21T06:44:25.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.089+0000 7f9decdc5740 1 -- 172.21.15.7:0/2185039967 shutdown_connections 2024-09-21T06:44:25.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.089+0000 7f9decdc5740 1 --2- 172.21.15.7:0/2185039967 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5568ffb72350 0x5568fff1e4c0 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:25.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.089+0000 7f9decdc5740 1 --2- 172.21.15.7:0/2185039967 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5568ffb51670 0x5568fff30dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:25.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.089+0000 7f9decdc5740 1 --2- 172.21.15.7:0/2185039967 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5568ffb49490 0x5568fff1cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:25.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.089+0000 7f9decdc5740 1 -- 172.21.15.7:0/2185039967 >> 172.21.15.7:0/2185039967 conn(0x5568ffb66740 msgr2=0x5568fff1c530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:25.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.089+0000 7f9decdc5740 1 -- 172.21.15.7:0/2185039967 shutdown_connections 2024-09-21T06:44:25.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.089+0000 7f9decdc5740 1 -- 172.21.15.7:0/2185039967 wait complete. 2024-09-21T06:44:25.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.090+0000 7f9decdc5740 1 -- start start 2024-09-21T06:44:25.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.090+0000 7f9decdc5740 1 Processor -- start 2024-09-21T06:44:25.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.090+0000 7f9decdc5740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5568ffb49490 0x5568fff2ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:25.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.090+0000 7f9decdc5740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5568ffb51670 0x5568fff2d380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:25.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.090+0000 7f9decdc5740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5568ffb72350 0x5568fff27df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:25.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.090+0000 7f9decdc5740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9de01adc80 con 0x5568ffb49490 2024-09-21T06:44:25.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.090+0000 7f9decdc5740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9de01af0f0 con 0x5568ffb51670 2024-09-21T06:44:25.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.090+0000 7f9decdc5740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9de01ae350 con 0x5568ffb72350 2024-09-21T06:44:25.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.090+0000 7f9decdc5740 10 client.0 _ll_register_callbacks cb 0x7f9dd80a9c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:44:25.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.090+0000 7f9ddffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5568ffb49490 0x5568fff2ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:25.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.091+0000 7f9ddffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5568ffb49490 0x5568fff2ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40538/0 (socket says 172.21.15.7:40538) 2024-09-21T06:44:25.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.091+0000 7f9ddffff640 1 -- 172.21.15.7:0/2163039600 learned_addr learned my addr 172.21.15.7:0/2163039600 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:44:25.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.091+0000 7f9dd7fff640 1 --2- 172.21.15.7:0/2163039600 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5568ffb51670 0x5568fff2d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:25.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.091+0000 7f9de4dee640 1 --2- 172.21.15.7:0/2163039600 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5568ffb72350 0x5568fff27df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:25.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.091+0000 7f9ddffff640 1 -- 172.21.15.7:0/2163039600 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5568ffb72350 msgr2=0x5568fff27df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:25.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.091+0000 7f9ddffff640 1 --2- 172.21.15.7:0/2163039600 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5568ffb72350 0x5568fff27df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:25.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.091+0000 7f9ddffff640 1 -- 172.21.15.7:0/2163039600 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5568ffb51670 msgr2=0x5568fff2d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:25.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.091+0000 7f9ddffff640 1 --2- 172.21.15.7:0/2163039600 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5568ffb51670 0x5568fff2d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:25.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.091+0000 7f9ddffff640 1 -- 172.21.15.7:0/2163039600 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568fff28330 con 0x5568ffb49490 2024-09-21T06:44:25.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.091+0000 7f9ddffff640 1 --2- 172.21.15.7:0/2163039600 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5568ffb49490 0x5568fff2ce40 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f9dd00043f0 tx=0x7f9dd00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1e1174a39fef0c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:25.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.091+0000 7f9dbf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:44:25.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.091+0000 7f9dbf7fe640 1 -- 172.21.15.7:0/2163039600 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd001eb50 con 0x5568ffb49490 2024-09-21T06:44:25.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.091+0000 7f9dbf7fe640 1 -- 172.21.15.7:0/2163039600 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8412+0+0 (secure 0 0 0) 0x7f9dd001ecf0 con 0x5568ffb49490 2024-09-21T06:44:25.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.091+0000 7f9decdc5740 1 -- 172.21.15.7:0/2163039600 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9dd805c070 con 0x5568ffb49490 2024-09-21T06:44:25.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.091+0000 7f9dbf7fe640 1 -- 172.21.15.7:0/2163039600 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9dd002a3b0 con 0x5568ffb49490 2024-09-21T06:44:25.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.091+0000 7f9decdc5740 10 client.17274 fetch_fsmap learned FSMap version 25 2024-09-21T06:44:25.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.092+0000 7f9decdc5740 1 -- 172.21.15.7:0/2163039600 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5568fffa22c0 con 0x5568ffb49490 2024-09-21T06:44:25.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.092+0000 7f9dbf7fe640 1 -- 172.21.15.7:0/2163039600 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9dd805c070 con 0x5568ffb49490 2024-09-21T06:44:25.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.092+0000 7f9dbf7fe640 1 -- 172.21.15.7:0/2163039600 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9dd0038030 con 0x5568ffb49490 2024-09-21T06:44:25.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.092+0000 7f9decdc5740 10 client.17274 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:44:25.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.092+0000 7f9decdc5740 10 client.17274 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:44:25.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.092+0000 7f9decdc5740 20 client.17274 populate_metadata read hostname 'smithi007' 2024-09-21T06:44:25.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.092+0000 7f9decdc5740 1 --2- 172.21.15.7:0/2163039600 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5568ffb06080 0x5568fffa4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:25.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.092+0000 7f9decdc5740 4 client.17274 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:44:25.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.092+0000 7f9decdc5740 1 -- 172.21.15.7:0/2163039600 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5568ffe8d860 con 0x5568ffb06080 2024-09-21T06:44:25.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.092+0000 7f9dd7fff640 1 --2- 172.21.15.7:0/2163039600 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5568ffb06080 0x5568fffa4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:25.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.093+0000 7f9dbf7fe640 10 client.17274 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:44:25.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.093+0000 7f9dd7fff640 1 --2- 172.21.15.7:0/2163039600 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5568ffb06080 0x5568fffa4ae0 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a4b20fc5b98d55b7 server_cookie=4169d6fa919b9d9b in_seq=0 out_seq=0 2024-09-21T06:44:25.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.094+0000 7f9dbf7fe640 1 -- 172.21.15.7:0/2163039600 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5568ffe8d860 con 0x5568ffb06080 2024-09-21T06:44:25.106 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.094+0000 7f9dbf7fe640 10 client.17274 handle_command_reply: tid=0 2024-09-21T06:44:25.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.095+0000 7f9decdc5740 1 client.17274 shutdown 2024-09-21T06:44:25.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.095+0000 7f9decdc5740 1 -- 172.21.15.7:0/2163039600 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5568ffb49490 msgr2=0x5568fff2ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:25.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.095+0000 7f9decdc5740 1 --2- 172.21.15.7:0/2163039600 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5568ffb49490 0x5568fff2ce40 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f9dd00043f0 tx=0x7f9dd00046c0 comp rx=0 tx=0).stop 2024-09-21T06:44:25.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.095+0000 7f9decdc5740 1 -- 172.21.15.7:0/2163039600 shutdown_connections 2024-09-21T06:44:25.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.095+0000 7f9decdc5740 1 --2- 172.21.15.7:0/2163039600 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5568ffb06080 0x5568fffa4ae0 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:25.107 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.095+0000 7f9decdc5740 1 --2- 172.21.15.7:0/2163039600 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5568ffb72350 0x5568fff27df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:25.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.095+0000 7f9decdc5740 1 --2- 172.21.15.7:0/2163039600 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5568ffb51670 0x5568fff2d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:25.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.095+0000 7f9decdc5740 1 --2- 172.21.15.7:0/2163039600 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5568ffb49490 0x5568fff2ce40 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:25.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.095+0000 7f9decdc5740 1 -- 172.21.15.7:0/2163039600 >> 172.21.15.7:0/2163039600 conn(0x5568ffb66740 msgr2=0x5568fff16c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:25.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.095+0000 7f9dbf7fe640 0 client.17274 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:44:25.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.095+0000 7f9decdc5740 1 -- 172.21.15.7:0/2163039600 shutdown_connections 2024-09-21T06:44:25.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.095+0000 7f9decdc5740 1 -- 172.21.15.7:0/2163039600 wait complete. 2024-09-21T06:44:25.108 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.095+0000 7f9decdc5740 20 client.17274 trim_cache size 0 max 16384 2024-09-21T06:44:25.109 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:44:25.109 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0, 2024-09-21T06:44:25.109 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_tag": "02016ff7-8cc2-467e-a465-f69400f702cb", 2024-09-21T06:44:25.110 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": "asynchronous" 2024-09-21T06:44:25.110 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:44:25.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.096+0000 7f9de6851640 1 -- 172.21.15.7:0/1279716772 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f9dcc0b6700 msgr2=0x7f9dcc0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:25.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.096+0000 7f9de6851640 1 --2- 172.21.15.7:0/1279716772 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f9dcc0b6700 0x7f9dcc0b8c10 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x5568fff180b0 tx=0x7f9dd000b390 comp rx=0 tx=0).stop 2024-09-21T06:44:25.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.096+0000 7f9de6851640 1 -- 172.21.15.7:0/1279716772 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9de0109df0 msgr2=0x7f9de019fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:25.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.096+0000 7f9de6851640 1 --2- 172.21.15.7:0/1279716772 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9de0109df0 0x7f9de019fda0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f9dd800eaa0 tx=0x7f9dd800ef60 comp rx=0 tx=0).stop 2024-09-21T06:44:25.111 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.096+0000 7f9de6851640 1 -- 172.21.15.7:0/1279716772 shutdown_connections 2024-09-21T06:44:25.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.096+0000 7f9de6851640 1 --2- 172.21.15.7:0/1279716772 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f9dcc0b6700 0x7f9dcc0b8c10 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:25.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.096+0000 7f9de6851640 1 --2- 172.21.15.7:0/1279716772 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9de0109df0 0x7f9de019fda0 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:25.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.096+0000 7f9de6851640 1 --2- 172.21.15.7:0/1279716772 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9de01094a0 0x7f9de019ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:25.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.096+0000 7f9de6851640 1 --2- 172.21.15.7:0/1279716772 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9de0103b60 0x7f9de019a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:25.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.096+0000 7f9de6851640 1 -- 172.21.15.7:0/1279716772 >> 172.21.15.7:0/1279716772 conn(0x7f9de007b850 msgr2=0x7f9de0105560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:25.112 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.096+0000 7f9de6851640 1 -- 172.21.15.7:0/1279716772 shutdown_connections 2024-09-21T06:44:25.113 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:25.096+0000 7f9de6851640 1 -- 172.21.15.7:0/1279716772 wait complete. 2024-09-21T06:44:25.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:44:25 smithi144 ceph-mon[34653]: pgmap v569: 97 pgs: 97 active+clean; 3.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T06:44:25.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:44:25 smithi007 ceph-mon[30983]: pgmap v569: 97 pgs: 97 active+clean; 3.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T06:44:25.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:44:25 smithi018 ceph-mon[34477]: pgmap v569: 97 pgs: 97 active+clean; 3.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T06:44:26.145 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:44:26.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:44:26 smithi144 ceph-mon[34653]: scrub queued for path: / 2024-09-21T06:44:26.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:44:26 smithi144 ceph-mon[34653]: scrub summary: idle+waiting paths [/] 2024-09-21T06:44:26.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:44:26 smithi144 ceph-mon[34653]: scrub summary: active paths [/] 2024-09-21T06:44:26.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:44:26 smithi144 ceph-mon[34653]: scrub summary: idle+waiting paths [/] 2024-09-21T06:44:26.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:44:26 smithi007 ceph-mon[30983]: scrub queued for path: / 2024-09-21T06:44:26.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:44:26 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T06:44:26.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:44:26 smithi007 ceph-mon[30983]: scrub summary: active paths [/] 2024-09-21T06:44:26.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:44:26 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T06:44:26.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:44:26 smithi018 ceph-mon[34477]: scrub queued for path: / 2024-09-21T06:44:26.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:44:26 smithi018 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-21T06:44:26.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:44:26 smithi018 ceph-mon[34477]: scrub summary: active paths [/] 2024-09-21T06:44:26.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:44:26 smithi018 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-21T06:44:26.406 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:44:26.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.933+0000 7fb60f3c7640 1 -- 172.21.15.7:0/1335896274 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb6081026d0 msgr2=0x7fb608102ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:26.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.933+0000 7fb60f3c7640 1 --2- 172.21.15.7:0/1335896274 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb6081026d0 0x7fb608102ae0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7fb604009900 tx=0x7fb60402a510 comp rx=0 tx=0).stop 2024-09-21T06:44:26.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.933+0000 7fb60f3c7640 1 -- 172.21.15.7:0/1335896274 shutdown_connections 2024-09-21T06:44:26.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.933+0000 7fb60f3c7640 1 --2- 172.21.15.7:0/1335896274 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb608110280 0x7fb6081126a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:26.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.933+0000 7fb60f3c7640 1 --2- 172.21.15.7:0/1335896274 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb608103020 0x7fb60810fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:26.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.933+0000 7fb60f3c7640 1 --2- 172.21.15.7:0/1335896274 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb6081026d0 0x7fb608102ae0 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:26.942 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.933+0000 7fb60f3c7640 1 -- 172.21.15.7:0/1335896274 >> 172.21.15.7:0/1335896274 conn(0x7fb608079760 msgr2=0x7fb608079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:26.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.933+0000 7fb60f3c7640 1 -- 172.21.15.7:0/1335896274 shutdown_connections 2024-09-21T06:44:26.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.933+0000 7fb60f3c7640 1 -- 172.21.15.7:0/1335896274 wait complete. 2024-09-21T06:44:26.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.934+0000 7fb60f3c7640 1 Processor -- start 2024-09-21T06:44:26.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.934+0000 7fb60f3c7640 1 -- start start 2024-09-21T06:44:26.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.934+0000 7fb60f3c7640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb6081026d0 0x7fb60819c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:26.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.934+0000 7fb60f3c7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb608103020 0x7fb60819cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:26.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.934+0000 7fb60f3c7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb608110280 0x7fb6081a1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:26.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.934+0000 7fb60f3c7640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb608115c90 con 0x7fb608110280 2024-09-21T06:44:26.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.934+0000 7fb60f3c7640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb608115b10 con 0x7fb608103020 2024-09-21T06:44:26.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.934+0000 7fb60f3c7640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb608115e10 con 0x7fb6081026d0 2024-09-21T06:44:26.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.934+0000 7fb60d964640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb608110280 0x7fb6081a1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:26.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.934+0000 7fb60d964640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb608110280 0x7fb6081a1f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40554/0 (socket says 172.21.15.7:40554) 2024-09-21T06:44:26.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.934+0000 7fb60d964640 1 -- 172.21.15.7:0/4249572009 learned_addr learned my addr 172.21.15.7:0/4249572009 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:44:26.943 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.934+0000 7fb60c962640 1 --2- 172.21.15.7:0/4249572009 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb608103020 0x7fb60819cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:26.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.934+0000 7fb60d163640 1 --2- 172.21.15.7:0/4249572009 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb6081026d0 0x7fb60819c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:26.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.934+0000 7fb60d964640 1 -- 172.21.15.7:0/4249572009 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb6081026d0 msgr2=0x7fb60819c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:26.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.934+0000 7fb60d964640 1 --2- 172.21.15.7:0/4249572009 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb6081026d0 0x7fb60819c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:26.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.934+0000 7fb60d964640 1 -- 172.21.15.7:0/4249572009 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb608103020 msgr2=0x7fb60819cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:26.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.934+0000 7fb60d964640 1 --2- 172.21.15.7:0/4249572009 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb608103020 0x7fb60819cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:26.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.934+0000 7fb60d964640 1 -- 172.21.15.7:0/4249572009 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6081a2630 con 0x7fb608110280 2024-09-21T06:44:26.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.935+0000 7fb60c962640 1 --2- 172.21.15.7:0/4249572009 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb608103020 0x7fb60819cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:44:26.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.935+0000 7fb60d163640 1 --2- 172.21.15.7:0/4249572009 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb6081026d0 0x7fb60819c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:44:26.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.935+0000 7fb60d964640 1 --2- 172.21.15.7:0/4249572009 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb608110280 0x7fb6081a1f00 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7fb600009fd0 tx=0x7fb60000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:26.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.935+0000 7fb5fe7fc640 1 -- 172.21.15.7:0/4249572009 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb600017070 con 0x7fb608110280 2024-09-21T06:44:26.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.935+0000 7fb60f3c7640 1 -- 172.21.15.7:0/4249572009 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6081a2920 con 0x7fb608110280 2024-09-21T06:44:26.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.935+0000 7fb5fe7fc640 1 -- 172.21.15.7:0/4249572009 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb600003e20 con 0x7fb608110280 2024-09-21T06:44:26.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.935+0000 7fb5fe7fc640 1 -- 172.21.15.7:0/4249572009 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb600010460 con 0x7fb608110280 2024-09-21T06:44:26.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.935+0000 7fb60f3c7640 1 -- 172.21.15.7:0/4249572009 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6081a9080 con 0x7fb608110280 2024-09-21T06:44:26.944 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.938+0000 7fb61593b740 1 Processor -- start 2024-09-21T06:44:26.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.938+0000 7fb5fe7fc640 1 -- 172.21.15.7:0/4249572009 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7fb600003970 con 0x7fb608110280 2024-09-21T06:44:26.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.938+0000 7fb61593b740 1 -- start start 2024-09-21T06:44:26.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.939+0000 7fb61593b740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559036bee070 0x559036f95270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:26.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.939+0000 7fb61593b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559036bc51b0 0x559036f957b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:26.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.939+0000 7fb61593b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559036bcd390 0x559036f95cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:26.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.939+0000 7fb61593b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x559036f0be50 con 0x559036bc51b0 2024-09-21T06:44:26.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.939+0000 7fb61593b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559036efb280 con 0x559036bcd390 2024-09-21T06:44:26.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.939+0000 7fb61593b740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x559036eff090 con 0x559036bee070 2024-09-21T06:44:26.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.939+0000 7fb60d163640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559036bc51b0 0x559036f957b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:26.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.939+0000 7fb60d163640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559036bc51b0 0x559036f957b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40560/0 (socket says 172.21.15.7:40560) 2024-09-21T06:44:26.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.939+0000 7fb60d163640 1 -- 172.21.15.7:0/2263421033 learned_addr learned my addr 172.21.15.7:0/2263421033 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:44:26.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.939+0000 7fb60c962640 1 --2- 172.21.15.7:0/2263421033 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559036bcd390 0x559036f95cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:26.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.939+0000 7fb60c962640 1 --2- 172.21.15.7:0/2263421033 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559036bee070 0x559036f95270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:26.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.939+0000 7fb60d163640 1 -- 172.21.15.7:0/2263421033 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559036bee070 msgr2=0x559036f95270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:26.945 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.939+0000 7fb60d163640 1 --2- 172.21.15.7:0/2263421033 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559036bee070 0x559036f95270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:26.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.939+0000 7fb60d163640 1 -- 172.21.15.7:0/2263421033 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559036bcd390 msgr2=0x559036f95cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:26.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.939+0000 7fb60d163640 1 --2- 172.21.15.7:0/2263421033 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559036bcd390 0x559036f95cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:26.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.939+0000 7fb5fe7fc640 1 --2- 172.21.15.7:0/4249572009 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fb5f40b6680 0x7fb5f40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:26.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.939+0000 7fb60d163640 1 -- 172.21.15.7:0/2263421033 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559036c59650 con 0x559036bc51b0 2024-09-21T06:44:26.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.940+0000 7fb60c962640 1 --2- 172.21.15.7:0/4249572009 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fb5f40b6680 0x7fb5f40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:26.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.940+0000 7fb60d163640 1 --2- 172.21.15.7:0/2263421033 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559036bc51b0 0x559036f957b0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7fb60402aa30 tx=0x7fb604032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17c7b49591230dc2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:26.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.940+0000 7fb5fe7fc640 1 -- 172.21.15.7:0/4249572009 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8412+0+0 (secure 0 0 0) 0x7fb6000e7490 con 0x7fb608110280 2024-09-21T06:44:26.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.940+0000 7fb5f37fe640 1 -- 172.21.15.7:0/2263421033 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb60403f070 con 0x559036bc51b0 2024-09-21T06:44:26.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.940+0000 7fb5f37fe640 1 -- 172.21.15.7:0/2263421033 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb6040316a0 con 0x559036bc51b0 2024-09-21T06:44:26.946 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.940+0000 7fb5f37fe640 1 -- 172.21.15.7:0/2263421033 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb604035070 con 0x559036bc51b0 2024-09-21T06:44:26.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.941+0000 7fb61593b740 1 -- 172.21.15.7:0/2263421033 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559036bc51b0 msgr2=0x559036f957b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:26.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.941+0000 7fb60c962640 1 --2- 172.21.15.7:0/4249572009 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fb5f40b6680 0x7fb5f40b8b90 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb608112180 tx=0x7fb5f800b510 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:26.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.941+0000 7fb61593b740 1 --2- 172.21.15.7:0/2263421033 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559036bc51b0 0x559036f957b0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7fb60402aa30 tx=0x7fb604032ce0 comp rx=0 tx=0).stop 2024-09-21T06:44:26.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.941+0000 7fb61593b740 1 -- 172.21.15.7:0/2263421033 shutdown_connections 2024-09-21T06:44:26.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.941+0000 7fb61593b740 1 --2- 172.21.15.7:0/2263421033 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559036bcd390 0x559036f95cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:26.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.941+0000 7fb61593b740 1 --2- 172.21.15.7:0/2263421033 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559036bc51b0 0x559036f957b0 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:26.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.941+0000 7fb61593b740 1 --2- 172.21.15.7:0/2263421033 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559036bee070 0x559036f95270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:26.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.941+0000 7fb61593b740 1 -- 172.21.15.7:0/2263421033 >> 172.21.15.7:0/2263421033 conn(0x559036be2460 msgr2=0x559036f93160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:26.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.941+0000 7fb61593b740 1 -- 172.21.15.7:0/2263421033 shutdown_connections 2024-09-21T06:44:26.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.941+0000 7fb61593b740 1 -- 172.21.15.7:0/2263421033 wait complete. 2024-09-21T06:44:26.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.942+0000 7fb61593b740 1 -- start start 2024-09-21T06:44:26.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.942+0000 7fb61593b740 1 Processor -- start 2024-09-21T06:44:26.950 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.942+0000 7fb61593b740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559036bc51b0 0x559036fa08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:26.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.942+0000 7fb61593b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559036bcd390 0x559036fa0de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:26.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.942+0000 7fb61593b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559036bee070 0x559036fa1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:26.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.942+0000 7fb61593b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x559036d5c700 con 0x559036bcd390 2024-09-21T06:44:26.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.942+0000 7fb61593b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559036e96110 con 0x559036bee070 2024-09-21T06:44:26.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.942+0000 7fb61593b740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x559036fa39f0 con 0x559036bc51b0 2024-09-21T06:44:26.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.942+0000 7fb60c962640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559036bcd390 0x559036fa0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:26.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.942+0000 7fb60c962640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559036bcd390 0x559036fa0de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40574/0 (socket says 172.21.15.7:40574) 2024-09-21T06:44:26.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.942+0000 7fb61593b740 10 client.0 _ll_register_callbacks cb 0x559036eaf990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:44:26.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.942+0000 7fb60c962640 1 -- 172.21.15.7:0/1318002377 learned_addr learned my addr 172.21.15.7:0/1318002377 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:44:26.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.943+0000 7fb60d163640 1 --2- 172.21.15.7:0/1318002377 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559036bc51b0 0x559036fa08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:26.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.943+0000 7fb60d964640 1 --2- 172.21.15.7:0/1318002377 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559036bee070 0x559036fa1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:26.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.943+0000 7fb60c962640 1 -- 172.21.15.7:0/1318002377 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559036bc51b0 msgr2=0x559036fa08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:26.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.943+0000 7fb60c962640 1 --2- 172.21.15.7:0/1318002377 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559036bc51b0 0x559036fa08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:26.951 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.943+0000 7fb60c962640 1 -- 172.21.15.7:0/1318002377 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559036bee070 msgr2=0x559036fa1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:26.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.943+0000 7fb60c962640 1 --2- 172.21.15.7:0/1318002377 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559036bee070 0x559036fa1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:26.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.943+0000 7fb60c962640 1 -- 172.21.15.7:0/1318002377 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559036ec3c40 con 0x559036bcd390 2024-09-21T06:44:26.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.943+0000 7fb60d964640 1 --2- 172.21.15.7:0/1318002377 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559036bee070 0x559036fa1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:44:26.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.943+0000 7fb60d163640 1 --2- 172.21.15.7:0/1318002377 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559036bc51b0 0x559036fa08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:44:26.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.943+0000 7fb60c962640 1 --2- 172.21.15.7:0/1318002377 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559036bcd390 0x559036fa0de0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7fb5f8004530 tx=0x7fb5f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8151c4283940354 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:26.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.943+0000 7fb5f0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:44:26.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.943+0000 7fb5f0ff9640 1 -- 172.21.15.7:0/1318002377 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f8012860 con 0x559036bcd390 2024-09-21T06:44:26.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.943+0000 7fb5f0ff9640 1 -- 172.21.15.7:0/1318002377 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8412+0+0 (secure 0 0 0) 0x7fb5f8012a00 con 0x559036bcd390 2024-09-21T06:44:26.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.943+0000 7fb61593b740 1 -- 172.21.15.7:0/1318002377 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb6040316a0 con 0x559036bcd390 2024-09-21T06:44:26.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.943+0000 7fb5f0ff9640 1 -- 172.21.15.7:0/1318002377 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb5f8012c00 con 0x559036bcd390 2024-09-21T06:44:26.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.943+0000 7fb61593b740 10 client.17286 fetch_fsmap learned FSMap version 25 2024-09-21T06:44:26.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.943+0000 7fb61593b740 1 -- 172.21.15.7:0/1318002377 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559036faf6a0 con 0x559036bcd390 2024-09-21T06:44:26.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.944+0000 7fb5f0ff9640 1 -- 172.21.15.7:0/1318002377 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb6040316a0 con 0x559036bcd390 2024-09-21T06:44:26.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.944+0000 7fb5f0ff9640 1 -- 172.21.15.7:0/1318002377 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb5f8031020 con 0x559036bcd390 2024-09-21T06:44:26.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.944+0000 7fb61593b740 10 client.17286 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:44:26.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.944+0000 7fb61593b740 10 client.17286 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:44:26.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.944+0000 7fb61593b740 20 client.17286 populate_metadata read hostname 'smithi007' 2024-09-21T06:44:26.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.944+0000 7fb61593b740 1 --2- 172.21.15.7:0/1318002377 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x559036bac9f0 0x559036fb2c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:26.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.944+0000 7fb61593b740 4 client.17286 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:44:26.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.944+0000 7fb61593b740 1 -- 172.21.15.7:0/1318002377 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559036f0dda0 con 0x559036bac9f0 2024-09-21T06:44:26.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.944+0000 7fb60d163640 1 --2- 172.21.15.7:0/1318002377 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x559036bac9f0 0x559036fb2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:26.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.945+0000 7fb60d163640 1 --2- 172.21.15.7:0/1318002377 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x559036bac9f0 0x559036fb2c20 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=22b7f75cacc27d26 server_cookie=5f15a0e98d99a9c6 in_seq=0 out_seq=0 2024-09-21T06:44:26.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.945+0000 7fb5f0ff9640 10 client.17286 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:44:26.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.945+0000 7fb5f0ff9640 1 -- 172.21.15.7:0/1318002377 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559036f0dda0 con 0x559036bac9f0 2024-09-21T06:44:26.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.945+0000 7fb5f0ff9640 10 client.17286 handle_command_reply: tid=0 2024-09-21T06:44:26.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.946+0000 7fb61593b740 1 client.17286 shutdown 2024-09-21T06:44:26.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.946+0000 7fb61593b740 1 -- 172.21.15.7:0/1318002377 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559036bcd390 msgr2=0x559036fa0de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:26.953 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.946+0000 7fb61593b740 1 --2- 172.21.15.7:0/1318002377 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559036bcd390 0x559036fa0de0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7fb5f8004530 tx=0x7fb5f80046c0 comp rx=0 tx=0).stop 2024-09-21T06:44:26.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.946+0000 7fb61593b740 1 -- 172.21.15.7:0/1318002377 shutdown_connections 2024-09-21T06:44:26.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.946+0000 7fb61593b740 1 --2- 172.21.15.7:0/1318002377 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x559036bac9f0 0x559036fb2c20 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:26.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.946+0000 7fb61593b740 1 --2- 172.21.15.7:0/1318002377 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559036bee070 0x559036fa1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:26.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.946+0000 7fb61593b740 1 --2- 172.21.15.7:0/1318002377 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559036bcd390 0x559036fa0de0 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:26.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.946+0000 7fb61593b740 1 --2- 172.21.15.7:0/1318002377 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559036bc51b0 0x559036fa08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:26.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.946+0000 7fb5f0ff9640 0 client.17286 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:44:26.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.946+0000 7fb61593b740 1 -- 172.21.15.7:0/1318002377 >> 172.21.15.7:0/1318002377 conn(0x559036be2460 msgr2=0x559036f98400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:26.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.946+0000 7fb61593b740 1 -- 172.21.15.7:0/1318002377 shutdown_connections 2024-09-21T06:44:26.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.946+0000 7fb61593b740 1 -- 172.21.15.7:0/1318002377 wait complete. 2024-09-21T06:44:26.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.946+0000 7fb61593b740 20 client.17286 trim_cache size 0 max 16384 2024-09-21T06:44:26.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.964+0000 7fb61593b740 1 Processor -- start 2024-09-21T06:44:26.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.964+0000 7fb61593b740 1 -- start start 2024-09-21T06:44:26.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.964+0000 7fb61593b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559036bc51b0 0x559036f96c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:26.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.964+0000 7fb61593b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559036bcd390 0x559036fa24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:26.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.964+0000 7fb61593b740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559036bee070 0x559036f92710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:26.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.964+0000 7fb61593b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb6081b3fc0 con 0x559036bcd390 2024-09-21T06:44:26.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.964+0000 7fb61593b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb6081b1890 con 0x559036bc51b0 2024-09-21T06:44:26.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.964+0000 7fb61593b740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb6081af700 con 0x559036bee070 2024-09-21T06:44:26.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.964+0000 7fb60c962640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559036bcd390 0x559036fa24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:26.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.964+0000 7fb60c962640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559036bcd390 0x559036fa24d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40588/0 (socket says 172.21.15.7:40588) 2024-09-21T06:44:26.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.964+0000 7fb60c962640 1 -- 172.21.15.7:0/2514384304 learned_addr learned my addr 172.21.15.7:0/2514384304 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:44:26.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.964+0000 7fb60d163640 1 --2- 172.21.15.7:0/2514384304 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559036bc51b0 0x559036f96c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:26.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.964+0000 7fb60d964640 1 --2- 172.21.15.7:0/2514384304 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559036bee070 0x559036f92710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:26.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.964+0000 7fb60c962640 1 -- 172.21.15.7:0/2514384304 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559036bee070 msgr2=0x559036f92710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:26.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.964+0000 7fb60c962640 1 --2- 172.21.15.7:0/2514384304 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559036bee070 0x559036f92710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:26.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.964+0000 7fb60c962640 1 -- 172.21.15.7:0/2514384304 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559036bc51b0 msgr2=0x559036f96c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:26.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.964+0000 7fb60c962640 1 --2- 172.21.15.7:0/2514384304 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559036bc51b0 0x559036f96c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:26.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.964+0000 7fb60c962640 1 -- 172.21.15.7:0/2514384304 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559036fa1b60 con 0x559036bcd390 2024-09-21T06:44:26.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.964+0000 7fb60d964640 1 --2- 172.21.15.7:0/2514384304 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559036bee070 0x559036f92710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:44:26.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.964+0000 7fb60d163640 1 --2- 172.21.15.7:0/2514384304 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559036bc51b0 0x559036f96c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:44:26.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.965+0000 7fb60c962640 1 --2- 172.21.15.7:0/2514384304 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559036bcd390 0x559036fa24d0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fb5f8033550 tx=0x7fb5f800bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a954f7076d1e1b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:26.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.965+0000 7fb5f2ffd640 1 -- 172.21.15.7:0/2514384304 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f8033a70 con 0x559036bcd390 2024-09-21T06:44:26.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.965+0000 7fb5f2ffd640 1 -- 172.21.15.7:0/2514384304 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb5f8033c10 con 0x559036bcd390 2024-09-21T06:44:26.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.965+0000 7fb5f2ffd640 1 -- 172.21.15.7:0/2514384304 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f800fb30 con 0x559036bcd390 2024-09-21T06:44:26.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.966+0000 7fb61593b740 1 -- 172.21.15.7:0/2514384304 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559036bcd390 msgr2=0x559036fa24d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:26.972 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.966+0000 7fb61593b740 1 --2- 172.21.15.7:0/2514384304 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559036bcd390 0x559036fa24d0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fb5f8033550 tx=0x7fb5f800bda0 comp rx=0 tx=0).stop 2024-09-21T06:44:26.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.966+0000 7fb61593b740 1 -- 172.21.15.7:0/2514384304 shutdown_connections 2024-09-21T06:44:26.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.966+0000 7fb61593b740 1 --2- 172.21.15.7:0/2514384304 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559036bee070 0x559036f92710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:26.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.966+0000 7fb61593b740 1 --2- 172.21.15.7:0/2514384304 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559036bcd390 0x559036fa24d0 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:26.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.966+0000 7fb61593b740 1 --2- 172.21.15.7:0/2514384304 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559036bc51b0 0x559036f96c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:26.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.966+0000 7fb61593b740 1 -- 172.21.15.7:0/2514384304 >> 172.21.15.7:0/2514384304 conn(0x559036be2460 msgr2=0x559036fa1dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:26.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.966+0000 7fb61593b740 1 -- 172.21.15.7:0/2514384304 shutdown_connections 2024-09-21T06:44:26.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.966+0000 7fb61593b740 1 -- 172.21.15.7:0/2514384304 wait complete. 2024-09-21T06:44:26.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.966+0000 7fb61593b740 1 -- start start 2024-09-21T06:44:26.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.966+0000 7fb61593b740 1 Processor -- start 2024-09-21T06:44:26.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.967+0000 7fb61593b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559036bc51b0 0x559036fa4be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:26.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.967+0000 7fb61593b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559036bcd390 0x559036fa5120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:26.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.967+0000 7fb61593b740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559036bee070 0x559036fa5660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:26.973 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.967+0000 7fb61593b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb6081afd50 con 0x559036bcd390 2024-09-21T06:44:26.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.967+0000 7fb61593b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb6081b11c0 con 0x559036bc51b0 2024-09-21T06:44:26.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.967+0000 7fb61593b740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb6081b0420 con 0x559036bee070 2024-09-21T06:44:26.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.967+0000 7fb61593b740 10 client.0 _ll_register_callbacks cb 0x7fb5f800b8d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:44:26.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.967+0000 7fb60c962640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559036bcd390 0x559036fa5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:26.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.967+0000 7fb60c962640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559036bcd390 0x559036fa5120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:40590/0 (socket says 172.21.15.7:40590) 2024-09-21T06:44:26.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.967+0000 7fb60c962640 1 -- 172.21.15.7:0/1840000752 learned_addr learned my addr 172.21.15.7:0/1840000752 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:44:26.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.967+0000 7fb60d163640 1 --2- 172.21.15.7:0/1840000752 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559036bc51b0 0x559036fa4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:26.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.967+0000 7fb60d964640 1 --2- 172.21.15.7:0/1840000752 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559036bee070 0x559036fa5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:26.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.967+0000 7fb60c962640 1 -- 172.21.15.7:0/1840000752 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559036bee070 msgr2=0x559036fa5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:26.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.967+0000 7fb60c962640 1 --2- 172.21.15.7:0/1840000752 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559036bee070 0x559036fa5660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:26.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.967+0000 7fb60c962640 1 -- 172.21.15.7:0/1840000752 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559036bc51b0 msgr2=0x559036fa4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:26.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.967+0000 7fb60c962640 1 --2- 172.21.15.7:0/1840000752 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559036bc51b0 0x559036fa4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:26.974 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.967+0000 7fb60c962640 1 -- 172.21.15.7:0/1840000752 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55903701c620 con 0x559036bcd390 2024-09-21T06:44:26.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.967+0000 7fb60c962640 1 --2- 172.21.15.7:0/1840000752 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559036bcd390 0x559036fa5120 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fb5f8003ed0 tx=0x7fb5f8003f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d55eefd942310cba server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:26.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.967+0000 7fb5f0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:44:26.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.968+0000 7fb5f0ff9640 1 -- 172.21.15.7:0/1840000752 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f8012860 con 0x559036bcd390 2024-09-21T06:44:26.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.968+0000 7fb5f0ff9640 1 -- 172.21.15.7:0/1840000752 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8412+0+0 (secure 0 0 0) 0x7fb5f800f8b0 con 0x559036bcd390 2024-09-21T06:44:26.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.968+0000 7fb61593b740 1 -- 172.21.15.7:0/1840000752 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb5f8033c10 con 0x559036bcd390 2024-09-21T06:44:26.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.968+0000 7fb5f0ff9640 1 -- 172.21.15.7:0/1840000752 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb5f800f690 con 0x559036bcd390 2024-09-21T06:44:26.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.968+0000 7fb61593b740 10 client.17292 fetch_fsmap learned FSMap version 25 2024-09-21T06:44:26.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.968+0000 7fb61593b740 1 -- 172.21.15.7:0/1840000752 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55903701d760 con 0x559036bcd390 2024-09-21T06:44:26.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.968+0000 7fb5f0ff9640 1 -- 172.21.15.7:0/1840000752 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb5f8033c10 con 0x559036bcd390 2024-09-21T06:44:26.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.968+0000 7fb5f0ff9640 1 -- 172.21.15.7:0/1840000752 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb5f804e020 con 0x559036bcd390 2024-09-21T06:44:26.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.968+0000 7fb61593b740 10 client.17292 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:44:26.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.968+0000 7fb61593b740 10 client.17292 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:44:26.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.968+0000 7fb61593b740 20 client.17292 populate_metadata read hostname 'smithi007' 2024-09-21T06:44:26.975 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.968+0000 7fb61593b740 1 --2- 172.21.15.7:0/1840000752 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x559036b81da0 0x55903701fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:26.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.968+0000 7fb61593b740 4 client.17292 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:44:26.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.968+0000 7fb61593b740 1 -- 172.21.15.7:0/1840000752 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559036f09850 con 0x559036b81da0 2024-09-21T06:44:26.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.969+0000 7fb60d163640 1 --2- 172.21.15.7:0/1840000752 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x559036b81da0 0x55903701fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:26.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.969+0000 7fb60d163640 1 --2- 172.21.15.7:0/1840000752 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x559036b81da0 0x55903701fd80 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9629fa1ae3208261 server_cookie=2ed8d7ed812da681 in_seq=0 out_seq=0 2024-09-21T06:44:26.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.969+0000 7fb5f0ff9640 10 client.17292 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:44:26.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.969+0000 7fb5f0ff9640 1 -- 172.21.15.7:0/1840000752 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4830 (crc 0 0 0) 0x559036f09850 con 0x559036b81da0 2024-09-21T06:44:26.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.969+0000 7fb5f0ff9640 10 client.17292 handle_command_reply: tid=0 2024-09-21T06:44:26.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.969+0000 7fb61593b740 1 client.17292 shutdown 2024-09-21T06:44:26.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.969+0000 7fb61593b740 1 -- 172.21.15.7:0/1840000752 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559036bcd390 msgr2=0x559036fa5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:26.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.969+0000 7fb61593b740 1 --2- 172.21.15.7:0/1840000752 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559036bcd390 0x559036fa5120 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fb5f8003ed0 tx=0x7fb5f8003f00 comp rx=0 tx=0).stop 2024-09-21T06:44:26.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.969+0000 7fb61593b740 1 -- 172.21.15.7:0/1840000752 shutdown_connections 2024-09-21T06:44:26.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.969+0000 7fb61593b740 1 --2- 172.21.15.7:0/1840000752 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x559036b81da0 0x55903701fd80 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:26.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.970+0000 7fb61593b740 1 --2- 172.21.15.7:0/1840000752 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559036bee070 0x559036fa5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:26.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.970+0000 7fb61593b740 1 --2- 172.21.15.7:0/1840000752 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559036bcd390 0x559036fa5120 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:26.976 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.970+0000 7fb5f0ff9640 0 client.17292 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:44:26.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.970+0000 7fb61593b740 1 --2- 172.21.15.7:0/1840000752 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559036bc51b0 0x559036fa4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:26.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.970+0000 7fb61593b740 1 -- 172.21.15.7:0/1840000752 >> 172.21.15.7:0/1840000752 conn(0x559036be2460 msgr2=0x559036fa26f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:26.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.970+0000 7fb61593b740 1 -- 172.21.15.7:0/1840000752 shutdown_connections 2024-09-21T06:44:26.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.970+0000 7fb61593b740 1 -- 172.21.15.7:0/1840000752 wait complete. 2024-09-21T06:44:26.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.970+0000 7fb61593b740 20 client.17292 trim_cache size 0 max 16384 2024-09-21T06:44:26.977 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:44:26.977 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T06:44:26.977 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": { 2024-09-21T06:44:26.977 INFO:teuthology.orchestra.run.smithi007.stdout: "02016ff7-8cc2-467e-a465-f69400f702cb": { 2024-09-21T06:44:26.977 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:44:26.978 INFO:teuthology.orchestra.run.smithi007.stdout: "tag": "02016ff7-8cc2-467e-a465-f69400f702cb", 2024-09-21T06:44:26.978 INFO:teuthology.orchestra.run.smithi007.stdout: "options": "recursive,force" 2024-09-21T06:44:26.978 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:44:26.978 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:44:26.978 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_stats": { 2024-09-21T06:44:26.978 INFO:teuthology.orchestra.run.smithi007.stdout: "d98b2d47-c2db-4811-8b3e-ec744a20d9d6": { 2024-09-21T06:44:26.978 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:44:03.790680+0000", 2024-09-21T06:44:26.978 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:44:26.978 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:44:26.978 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:44:26.978 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:44:26.978 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:44:26.978 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:44:26.979 INFO:teuthology.orchestra.run.smithi007.stdout: "310a0ec8-44bb-49ed-a534-3bc91cb1ee9d": { 2024-09-21T06:44:26.979 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:40:55.373968+0000", 2024-09-21T06:44:26.979 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:44:26.979 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:44:26.979 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:44:26.979 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:44:26.979 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:44:26.979 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:44:26.979 INFO:teuthology.orchestra.run.smithi007.stdout: "dd792920-08a1-482d-8961-5c6a6f131599": { 2024-09-21T06:44:26.979 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:43:53.390806+0000", 2024-09-21T06:44:26.979 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:44:26.979 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:44:26.979 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:44:26.979 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:44:26.979 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:44:26.980 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:44:26.980 INFO:teuthology.orchestra.run.smithi007.stdout: "13441782-2231-4713-8ebd-068a941de47f": { 2024-09-21T06:44:26.980 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:39:30.219006+0000", 2024-09-21T06:44:26.980 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:44:26.980 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:44:26.980 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:44:26.980 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:44:26.980 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:44:26.980 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:44:26.980 INFO:teuthology.orchestra.run.smithi007.stdout: "02016ff7-8cc2-467e-a465-f69400f702cb": { 2024-09-21T06:44:26.980 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:44:25.093423+0000", 2024-09-21T06:44:26.980 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:44:26.980 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:44:26.981 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:44:26.981 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:44:26.981 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:44:26.981 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:44:26.981 INFO:teuthology.orchestra.run.smithi007.stdout: "b0327167-8c41-4286-8afc-7f0780972fd7": { 2024-09-21T06:44:26.981 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:38:36.828657+0000", 2024-09-21T06:44:26.981 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:44:26.981 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:44:26.981 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:44:26.981 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:44:26.981 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:44:26.981 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:44:26.981 INFO:teuthology.orchestra.run.smithi007.stdout: "d7b6a90c-9ae1-4e02-93ad-335a7e9df1d7": { 2024-09-21T06:44:26.981 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:39:19.226139+0000", 2024-09-21T06:44:26.981 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:44:26.982 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:44:26.982 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:44:26.982 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:44:26.982 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:44:26.982 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:44:26.982 INFO:teuthology.orchestra.run.smithi007.stdout: "3f7283b7-f175-4023-9191-177660b3a6be": { 2024-09-21T06:44:26.982 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:44:14.422552+0000", 2024-09-21T06:44:26.982 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:44:26.982 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:44:26.982 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:44:26.982 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:44:26.982 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:44:26.982 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:44:26.982 INFO:teuthology.orchestra.run.smithi007.stdout: "6231e9c1-14a2-40b5-be3c-76d87a0d733b": { 2024-09-21T06:44:26.983 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:37:02.484812+0000", 2024-09-21T06:44:26.983 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:44:26.983 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:44:26.983 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:44:26.983 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:44:26.983 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:44:26.983 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:44:26.983 INFO:teuthology.orchestra.run.smithi007.stdout: "a1ae5b3b-f158-44be-8ef4-d70e9ba879cc": { 2024-09-21T06:44:26.983 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:41:37.568453+0000", 2024-09-21T06:44:26.983 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:44:26.983 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:44:26.983 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:44:26.983 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:44:26.983 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:44:26.983 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:44:26.984 INFO:teuthology.orchestra.run.smithi007.stdout: "62fca477-b241-45f5-8185-bc78aeb8b19f": { 2024-09-21T06:44:26.984 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:40:12.744488+0000", 2024-09-21T06:44:26.984 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:44:26.984 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:44:26.984 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:44:26.984 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:44:26.984 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:44:26.984 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:44:26.984 INFO:teuthology.orchestra.run.smithi007.stdout: "5cbaaba2-6ab1-4f83-abd6-8c6eef4b5c42": { 2024-09-21T06:44:26.984 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:37:46.566272+0000", 2024-09-21T06:44:26.984 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:44:26.984 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:44:26.984 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:44:26.984 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:44:26.985 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:44:26.985 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:44:26.985 INFO:teuthology.orchestra.run.smithi007.stdout: "b466f071-ab32-427c-a0ed-73edea33145e": { 2024-09-21T06:44:26.985 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:43:01.151440+0000", 2024-09-21T06:44:26.985 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:44:26.985 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:44:26.985 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:44:26.985 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:44:26.985 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:44:26.985 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:44:26.985 INFO:teuthology.orchestra.run.smithi007.stdout: "ef9eaabd-003a-44fb-8373-c854a9e15a71": { 2024-09-21T06:44:26.985 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:42:19.467946+0000", 2024-09-21T06:44:26.985 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:44:26.985 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:44:26.986 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:44:26.986 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:44:26.986 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:44:26.986 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:44:26.986 INFO:teuthology.orchestra.run.smithi007.stdout: "0b89345c-1f00-4efe-8ee9-4cb17e43584c": { 2024-09-21T06:44:26.986 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:36:19.500334+0000", 2024-09-21T06:44:26.986 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:44:26.986 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:44:26.986 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:44:26.986 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:44:26.986 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:44:26.986 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:44:26.986 INFO:teuthology.orchestra.run.smithi007.stdout: "3c5b7f3f-e9b3-4d48-8154-2d7d4700992e": { 2024-09-21T06:44:26.986 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:43:43.120930+0000", 2024-09-21T06:44:26.987 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:44:26.987 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:44:26.987 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:44:26.987 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:44:26.987 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:44:26.987 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:44:26.987 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:44:26.987 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:44:26.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.970+0000 7fb60f3c7640 1 -- 172.21.15.7:0/4249572009 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fb5f40b6680 msgr2=0x7fb5f40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:26.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.970+0000 7fb60f3c7640 1 --2- 172.21.15.7:0/4249572009 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fb5f40b6680 0x7fb5f40b8b90 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb608112180 tx=0x7fb5f800b510 comp rx=0 tx=0).stop 2024-09-21T06:44:26.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.970+0000 7fb60f3c7640 1 -- 172.21.15.7:0/4249572009 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb608110280 msgr2=0x7fb6081a1f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:26.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.970+0000 7fb60f3c7640 1 --2- 172.21.15.7:0/4249572009 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb608110280 0x7fb6081a1f00 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7fb600009fd0 tx=0x7fb60000b260 comp rx=0 tx=0).stop 2024-09-21T06:44:26.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.970+0000 7fb60f3c7640 1 -- 172.21.15.7:0/4249572009 shutdown_connections 2024-09-21T06:44:26.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.970+0000 7fb60f3c7640 1 --2- 172.21.15.7:0/4249572009 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fb5f40b6680 0x7fb5f40b8b90 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:26.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.970+0000 7fb60f3c7640 1 --2- 172.21.15.7:0/4249572009 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb608110280 0x7fb6081a1f00 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:26.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.970+0000 7fb60f3c7640 1 --2- 172.21.15.7:0/4249572009 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb608103020 0x7fb60819cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:26.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.970+0000 7fb60f3c7640 1 --2- 172.21.15.7:0/4249572009 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb6081026d0 0x7fb60819c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:26.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.970+0000 7fb60f3c7640 1 -- 172.21.15.7:0/4249572009 >> 172.21.15.7:0/4249572009 conn(0x7fb608079760 msgr2=0x7fb608108cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:26.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.971+0000 7fb60f3c7640 1 -- 172.21.15.7:0/4249572009 shutdown_connections 2024-09-21T06:44:26.988 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:26.971+0000 7fb60f3c7640 1 -- 172.21.15.7:0/4249572009 wait complete. 2024-09-21T06:44:27.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:44:27 smithi144 ceph-mon[34653]: pgmap v570: 97 pgs: 97 active+clean; 3.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T06:44:27.328 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:44:27 smithi007 ceph-mon[30983]: pgmap v570: 97 pgs: 97 active+clean; 3.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T06:44:27.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:44:27 smithi018 ceph-mon[34477]: pgmap v570: 97 pgs: 97 active+clean; 3.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T06:44:27.922 INFO:tasks.cephfs.filesystem:scrub status for tag:02016ff7-8cc2-467e-a465-f69400f702cb - {'path': '/', 'tag': '02016ff7-8cc2-467e-a465-f69400f702cb', 'options': 'recursive,force'} 2024-09-21T06:44:29.218 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:44:29 smithi007 ceph-mon[30983]: pgmap v571: 97 pgs: 97 active+clean; 3.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 7 op/s 2024-09-21T06:44:29.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:44:29 smithi144 ceph-mon[34653]: pgmap v571: 97 pgs: 97 active+clean; 3.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 7 op/s 2024-09-21T06:44:29.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:44:29 smithi018 ceph-mon[34477]: pgmap v571: 97 pgs: 97 active+clean; 3.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 7 op/s 2024-09-21T06:44:30.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:44:30 smithi144 ceph-mon[34653]: scrub summary: idle 2024-09-21T06:44:30.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:44:30 smithi007 ceph-mon[30983]: scrub summary: idle 2024-09-21T06:44:30.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:44:30 smithi018 ceph-mon[34477]: scrub summary: idle 2024-09-21T06:44:31.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:44:31 smithi144 ceph-mon[34653]: pgmap v572: 97 pgs: 97 active+clean; 3.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 7 op/s 2024-09-21T06:44:31.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:44:31 smithi007 ceph-mon[30983]: pgmap v572: 97 pgs: 97 active+clean; 3.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 7 op/s 2024-09-21T06:44:31.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:44:31 smithi018 ceph-mon[34477]: pgmap v572: 97 pgs: 97 active+clean; 3.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 7 op/s 2024-09-21T06:44:33.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:44:33 smithi144 ceph-mon[34653]: pgmap v573: 97 pgs: 97 active+clean; 3.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 6 op/s 2024-09-21T06:44:33.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:44:33 smithi007 ceph-mon[30983]: pgmap v573: 97 pgs: 97 active+clean; 3.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 6 op/s 2024-09-21T06:44:33.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:44:33 smithi018 ceph-mon[34477]: pgmap v573: 97 pgs: 97 active+clean; 3.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 6 op/s 2024-09-21T06:44:35.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:44:35 smithi144 ceph-mon[34653]: pgmap v574: 97 pgs: 97 active+clean; 3.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 7 op/s 2024-09-21T06:44:35.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:44:35 smithi007 ceph-mon[30983]: pgmap v574: 97 pgs: 97 active+clean; 3.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 7 op/s 2024-09-21T06:44:35.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:44:35 smithi018 ceph-mon[34477]: pgmap v574: 97 pgs: 97 active+clean; 3.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 7 op/s 2024-09-21T06:44:37.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:44:37 smithi007 ceph-mon[30983]: pgmap v575: 97 pgs: 97 active+clean; 3.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 5 op/s 2024-09-21T06:44:37.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:44:37 smithi018 ceph-mon[34477]: pgmap v575: 97 pgs: 97 active+clean; 3.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 5 op/s 2024-09-21T06:44:37.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:44:37 smithi144 ceph-mon[34653]: pgmap v575: 97 pgs: 97 active+clean; 3.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 5 op/s 2024-09-21T06:44:38.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:44:38 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:44:38.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:44:38 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:44:38.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:44:38 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:44:38.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:44:38 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:44:38.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:44:38 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:44:38.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:44:38 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:44:38.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:44:38 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:44:38.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:44:38 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:44:38.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:44:38 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:44:38.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:44:38 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:44:38.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:44:38 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:44:38.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:44:38 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:44:39.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:44:39 smithi007 ceph-mon[30983]: pgmap v576: 97 pgs: 97 active+clean; 3.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 6 op/s 2024-09-21T06:44:39.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:44:39 smithi018 ceph-mon[34477]: pgmap v576: 97 pgs: 97 active+clean; 3.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 6 op/s 2024-09-21T06:44:39.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:44:39 smithi144 ceph-mon[34653]: pgmap v576: 97 pgs: 97 active+clean; 3.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 6 op/s 2024-09-21T06:44:41.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:44:41 smithi007 ceph-mon[30983]: pgmap v577: 97 pgs: 97 active+clean; 3.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-09-21T06:44:41.368 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:44:41 smithi018 ceph-mon[34477]: pgmap v577: 97 pgs: 97 active+clean; 3.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-09-21T06:44:41.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:44:41 smithi144 ceph-mon[34653]: pgmap v577: 97 pgs: 97 active+clean; 3.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-09-21T06:44:42.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:44:42 smithi018 ceph-mon[34477]: pgmap v578: 97 pgs: 97 active+clean; 3.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-21T06:44:42.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:44:42 smithi144 ceph-mon[34653]: pgmap v578: 97 pgs: 97 active+clean; 3.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-21T06:44:42.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:44:42 smithi007 ceph-mon[30983]: pgmap v578: 97 pgs: 97 active+clean; 3.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-21T06:44:44.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:44:44 smithi144 ceph-mon[34653]: pgmap v579: 97 pgs: 97 active+clean; 3.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:44:44.839 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:44:44 smithi007 ceph-mon[30983]: pgmap v579: 97 pgs: 97 active+clean; 3.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:44:44.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:44:44 smithi018 ceph-mon[34477]: pgmap v579: 97 pgs: 97 active+clean; 3.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:44:46.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:44:46 smithi144 ceph-mon[34653]: pgmap v580: 97 pgs: 97 active+clean; 3.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:44:46.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:44:46 smithi007 ceph-mon[30983]: pgmap v580: 97 pgs: 97 active+clean; 3.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:44:46.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:44:46 smithi018 ceph-mon[34477]: pgmap v580: 97 pgs: 97 active+clean; 3.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:44:48.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:44:48 smithi144 ceph-mon[34653]: pgmap v581: 97 pgs: 97 active+clean; 3.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:44:48.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:44:48 smithi007 ceph-mon[30983]: pgmap v581: 97 pgs: 97 active+clean; 3.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:44:48.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:44:48 smithi018 ceph-mon[34477]: pgmap v581: 97 pgs: 97 active+clean; 3.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:44:50.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:44:50 smithi144 ceph-mon[34653]: pgmap v582: 97 pgs: 97 active+clean; 3.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:44:50.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:44:50 smithi007 ceph-mon[30983]: pgmap v582: 97 pgs: 97 active+clean; 3.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:44:50.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:44:50 smithi018 ceph-mon[34477]: pgmap v582: 97 pgs: 97 active+clean; 3.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:44:52.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:44:52 smithi144 ceph-mon[34653]: pgmap v583: 97 pgs: 97 active+clean; 3.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:44:52.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:44:52 smithi007 ceph-mon[30983]: pgmap v583: 97 pgs: 97 active+clean; 3.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:44:52.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:44:52 smithi018 ceph-mon[34477]: pgmap v583: 97 pgs: 97 active+clean; 3.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:44:54.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:44:54 smithi144 ceph-mon[34653]: pgmap v584: 97 pgs: 97 active+clean; 3.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:44:54.839 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:44:54 smithi007 ceph-mon[30983]: pgmap v584: 97 pgs: 97 active+clean; 3.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:44:54.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:44:54 smithi018 ceph-mon[34477]: pgmap v584: 97 pgs: 97 active+clean; 3.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:44:56.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:44:56 smithi144 ceph-mon[34653]: pgmap v585: 97 pgs: 97 active+clean; 3.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:44:56.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:44:56 smithi007 ceph-mon[30983]: pgmap v585: 97 pgs: 97 active+clean; 3.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:44:56.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:44:56 smithi018 ceph-mon[34477]: pgmap v585: 97 pgs: 97 active+clean; 3.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:44:57.923 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:44:58.196 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:44:58.590 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:44:58 smithi007 ceph-mon[30983]: pgmap v586: 97 pgs: 97 active+clean; 3.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:44:58.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.731+0000 7f9ec605c640 1 -- 172.21.15.7:0/3751819144 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ec01094d0 msgr2=0x7f9ec01098e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:58.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.731+0000 7f9ec605c640 1 --2- 172.21.15.7:0/3751819144 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ec01094d0 0x7f9ec01098e0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f9eb4009900 tx=0x7f9eb402a410 comp rx=0 tx=0).stop 2024-09-21T06:44:58.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.731+0000 7f9ec605c640 1 -- 172.21.15.7:0/3751819144 shutdown_connections 2024-09-21T06:44:58.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.731+0000 7f9ec605c640 1 --2- 172.21.15.7:0/3751819144 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9ec0109e20 0x7f9ec0110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:58.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.731+0000 7f9ec605c640 1 --2- 172.21.15.7:0/3751819144 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ec01094d0 0x7f9ec01098e0 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:58.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.731+0000 7f9ec605c640 1 --2- 172.21.15.7:0/3751819144 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ec0103b90 0x7f9ec0103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:58.748 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.731+0000 7f9ec605c640 1 -- 172.21.15.7:0/3751819144 >> 172.21.15.7:0/3751819144 conn(0x7f9ec00ff600 msgr2=0x7f9ec0101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:58.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.731+0000 7f9ec605c640 1 -- 172.21.15.7:0/3751819144 shutdown_connections 2024-09-21T06:44:58.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.731+0000 7f9ec605c640 1 -- 172.21.15.7:0/3751819144 wait complete. 2024-09-21T06:44:58.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.732+0000 7f9ec605c640 1 Processor -- start 2024-09-21T06:44:58.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.732+0000 7f9ec605c640 1 -- start start 2024-09-21T06:44:58.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.732+0000 7f9ec605c640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ec0103b90 0x7f9ec0075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:58.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.732+0000 7f9ec605c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9ec01094d0 0x7f9ec0075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:58.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.732+0000 7f9ec605c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ec0109e20 0x7f9ec0076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:58.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.732+0000 7f9ec605c640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9ec0113ae0 con 0x7f9ec0109e20 2024-09-21T06:44:58.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.732+0000 7f9ec605c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9ec0113960 con 0x7f9ec01094d0 2024-09-21T06:44:58.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.732+0000 7f9ec605c640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9ec0113c60 con 0x7f9ec0103b90 2024-09-21T06:44:58.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.732+0000 7f9ebffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ec0109e20 0x7f9ec0076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:58.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.732+0000 7f9ebffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ec0109e20 0x7f9ec0076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46528/0 (socket says 172.21.15.7:46528) 2024-09-21T06:44:58.749 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.732+0000 7f9ebffff640 1 -- 172.21.15.7:0/3834404924 learned_addr learned my addr 172.21.15.7:0/3834404924 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:44:58.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.732+0000 7f9ebeffd640 1 --2- 172.21.15.7:0/3834404924 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9ec01094d0 0x7f9ec0075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:58.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.733+0000 7f9ebf7fe640 1 --2- 172.21.15.7:0/3834404924 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ec0103b90 0x7f9ec0075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:58.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.733+0000 7f9ebffff640 1 -- 172.21.15.7:0/3834404924 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ec0103b90 msgr2=0x7f9ec0075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:58.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.733+0000 7f9ebffff640 1 --2- 172.21.15.7:0/3834404924 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ec0103b90 0x7f9ec0075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:58.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.733+0000 7f9ebffff640 1 -- 172.21.15.7:0/3834404924 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9ec01094d0 msgr2=0x7f9ec0075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:58.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.733+0000 7f9ebffff640 1 --2- 172.21.15.7:0/3834404924 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9ec01094d0 0x7f9ec0075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:58.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.733+0000 7f9ebffff640 1 -- 172.21.15.7:0/3834404924 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ec01a86c0 con 0x7f9ec0109e20 2024-09-21T06:44:58.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.733+0000 7f9ebeffd640 1 --2- 172.21.15.7:0/3834404924 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9ec01094d0 0x7f9ec0075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:44:58.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.733+0000 7f9ebffff640 1 --2- 172.21.15.7:0/3834404924 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ec0109e20 0x7f9ec0076190 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f9eb800eaa0 tx=0x7f9eb800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:58.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.733+0000 7f9ebcff9640 1 -- 172.21.15.7:0/3834404924 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb8004d20 con 0x7f9ec0109e20 2024-09-21T06:44:58.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.733+0000 7f9ebcff9640 1 -- 172.21.15.7:0/3834404924 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9eb8005020 con 0x7f9ec0109e20 2024-09-21T06:44:58.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.733+0000 7f9ec605c640 1 -- 172.21.15.7:0/3834404924 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ec01a89b0 con 0x7f9ec0109e20 2024-09-21T06:44:58.750 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.733+0000 7f9ebcff9640 1 -- 172.21.15.7:0/3834404924 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb80116b0 con 0x7f9ec0109e20 2024-09-21T06:44:58.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.734+0000 7f9ec605c640 1 -- 172.21.15.7:0/3834404924 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ec01a8e70 con 0x7f9ec0109e20 2024-09-21T06:44:58.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.736+0000 7f9ebcff9640 1 -- 172.21.15.7:0/3834404924 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f9eb8011850 con 0x7f9ec0109e20 2024-09-21T06:44:58.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.737+0000 7f9ecc5d0740 1 Processor -- start 2024-09-21T06:44:58.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.737+0000 7f9ecc5d0740 1 -- start start 2024-09-21T06:44:58.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.737+0000 7f9ebcff9640 1 --2- 172.21.15.7:0/3834404924 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f9ea80b6680 0x7f9ea80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:58.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.737+0000 7f9ecc5d0740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a49ec29070 0x55a49efd0650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:58.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.737+0000 7f9ecc5d0740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a49ec001b0 0x55a49efd0b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:58.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.737+0000 7f9ecc5d0740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a49ec08390 0x55a49efd10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:58.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.737+0000 7f9ecc5d0740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55a49ef46e50 con 0x55a49ec29070 2024-09-21T06:44:58.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.737+0000 7f9ecc5d0740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a49ef36280 con 0x55a49ec08390 2024-09-21T06:44:58.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.737+0000 7f9ecc5d0740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55a49ef3a090 con 0x55a49ec001b0 2024-09-21T06:44:58.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.737+0000 7f9ebeffd640 1 --2- 172.21.15.7:0/3834404924 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f9ea80b6680 0x7f9ea80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:58.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.737+0000 7f9ebcff9640 1 -- 172.21.15.7:0/3834404924 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8412+0+0 (secure 0 0 0) 0x7f9eb80e78d0 con 0x7f9ec0109e20 2024-09-21T06:44:58.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.737+0000 7f9ebf7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a49ec29070 0x55a49efd0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:58.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.737+0000 7f9ebf7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a49ec29070 0x55a49efd0650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46536/0 (socket says 172.21.15.7:46536) 2024-09-21T06:44:58.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.737+0000 7f9ebf7fe640 1 -- 172.21.15.7:0/889985146 learned_addr learned my addr 172.21.15.7:0/889985146 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:44:58.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.738+0000 7f9ebeffd640 1 --2- 172.21.15.7:0/889985146 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a49ec001b0 0x55a49efd0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:58.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.738+0000 7f9ebffff640 1 --2- 172.21.15.7:0/889985146 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a49ec08390 0x55a49efd10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:58.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.738+0000 7f9ebf7fe640 1 -- 172.21.15.7:0/889985146 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a49ec001b0 msgr2=0x55a49efd0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:58.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.738+0000 7f9ebf7fe640 1 --2- 172.21.15.7:0/889985146 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a49ec001b0 0x55a49efd0b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:58.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.738+0000 7f9ebf7fe640 1 -- 172.21.15.7:0/889985146 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a49ec08390 msgr2=0x55a49efd10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:58.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.738+0000 7f9ebf7fe640 1 --2- 172.21.15.7:0/889985146 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a49ec08390 0x55a49efd10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:58.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.738+0000 7f9ebf7fe640 1 -- 172.21.15.7:0/889985146 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a49ec94650 con 0x55a49ec29070 2024-09-21T06:44:58.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.738+0000 7f9ebeffd640 1 --2- 172.21.15.7:0/3834404924 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f9ea80b6680 0x7f9ea80b8b90 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f9eb4009230 tx=0x7f9eb4031830 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:58.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.738+0000 7f9ebf7fe640 1 --2- 172.21.15.7:0/889985146 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a49ec29070 0x55a49efd0650 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f9eb000ac80 tx=0x7f9eb000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c063dd9cb7487a92 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:58.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.738+0000 7f9ea5ffb640 1 -- 172.21.15.7:0/889985146 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb001d070 con 0x55a49ec29070 2024-09-21T06:44:58.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.738+0000 7f9ea5ffb640 1 -- 172.21.15.7:0/889985146 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9eb0018af0 con 0x55a49ec29070 2024-09-21T06:44:58.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.738+0000 7f9ea5ffb640 1 -- 172.21.15.7:0/889985146 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb0010a90 con 0x55a49ec29070 2024-09-21T06:44:58.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.739+0000 7f9ecc5d0740 1 -- 172.21.15.7:0/889985146 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a49ec29070 msgr2=0x55a49efd0650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:58.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.739+0000 7f9ecc5d0740 1 --2- 172.21.15.7:0/889985146 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a49ec29070 0x55a49efd0650 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f9eb000ac80 tx=0x7f9eb000f790 comp rx=0 tx=0).stop 2024-09-21T06:44:58.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.739+0000 7f9ecc5d0740 1 -- 172.21.15.7:0/889985146 shutdown_connections 2024-09-21T06:44:58.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.739+0000 7f9ecc5d0740 1 --2- 172.21.15.7:0/889985146 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a49ec08390 0x55a49efd10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:58.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.739+0000 7f9ecc5d0740 1 --2- 172.21.15.7:0/889985146 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a49ec001b0 0x55a49efd0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:58.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.739+0000 7f9ecc5d0740 1 --2- 172.21.15.7:0/889985146 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a49ec29070 0x55a49efd0650 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:58.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.739+0000 7f9ecc5d0740 1 -- 172.21.15.7:0/889985146 >> 172.21.15.7:0/889985146 conn(0x55a49ec1d460 msgr2=0x55a49efce540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:58.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.739+0000 7f9ecc5d0740 1 -- 172.21.15.7:0/889985146 shutdown_connections 2024-09-21T06:44:58.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.739+0000 7f9ecc5d0740 1 -- 172.21.15.7:0/889985146 wait complete. 2024-09-21T06:44:58.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.740+0000 7f9ecc5d0740 1 -- start start 2024-09-21T06:44:58.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.740+0000 7f9ecc5d0740 1 Processor -- start 2024-09-21T06:44:58.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.740+0000 7f9ecc5d0740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a49ec001b0 0x55a49efdbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:58.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.740+0000 7f9ecc5d0740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a49ec08390 0x55a49efdc230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:58.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.740+0000 7f9ecc5d0740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a49ec29070 0x55a49efe8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:58.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.740+0000 7f9ecc5d0740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55a49ed97700 con 0x55a49ec08390 2024-09-21T06:44:58.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.740+0000 7f9ecc5d0740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a49eed1110 con 0x55a49ec29070 2024-09-21T06:44:58.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.740+0000 7f9ecc5d0740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55a49efdee30 con 0x55a49ec001b0 2024-09-21T06:44:58.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.741+0000 7f9ecc5d0740 10 client.0 _ll_register_callbacks cb 0x55a49eeea990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:44:58.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.741+0000 7f9ebeffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a49ec08390 0x55a49efdc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:58.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.741+0000 7f9ebeffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a49ec08390 0x55a49efdc230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46540/0 (socket says 172.21.15.7:46540) 2024-09-21T06:44:58.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.741+0000 7f9ebeffd640 1 -- 172.21.15.7:0/888304848 learned_addr learned my addr 172.21.15.7:0/888304848 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:44:58.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.741+0000 7f9ebffff640 1 --2- 172.21.15.7:0/888304848 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a49ec29070 0x55a49efe8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:58.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.741+0000 7f9ebf7fe640 1 --2- 172.21.15.7:0/888304848 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a49ec001b0 0x55a49efdbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:58.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.741+0000 7f9ebeffd640 1 -- 172.21.15.7:0/888304848 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a49ec001b0 msgr2=0x55a49efdbcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:58.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.741+0000 7f9ebeffd640 1 --2- 172.21.15.7:0/888304848 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a49ec001b0 0x55a49efdbcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:58.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.741+0000 7f9ebeffd640 1 -- 172.21.15.7:0/888304848 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a49ec29070 msgr2=0x55a49efe8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:58.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.741+0000 7f9ebeffd640 1 --2- 172.21.15.7:0/888304848 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a49ec29070 0x55a49efe8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:58.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.741+0000 7f9ebeffd640 1 -- 172.21.15.7:0/888304848 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a49eefec40 con 0x55a49ec08390 2024-09-21T06:44:58.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.741+0000 7f9ebeffd640 1 --2- 172.21.15.7:0/888304848 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a49ec08390 0x55a49efdc230 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f9eb4009900 tx=0x7f9eb402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4c91f4f4d2bd42d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:58.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.741+0000 7f9e9effd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:44:58.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.741+0000 7f9e9effd640 1 -- 172.21.15.7:0/888304848 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb404e070 con 0x55a49ec08390 2024-09-21T06:44:58.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.741+0000 7f9e9effd640 1 -- 172.21.15.7:0/888304848 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8412+0+0 (secure 0 0 0) 0x7f9eb4005240 con 0x55a49ec08390 2024-09-21T06:44:58.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.742+0000 7f9ecc5d0740 1 -- 172.21.15.7:0/888304848 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9eb0018af0 con 0x55a49ec08390 2024-09-21T06:44:58.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.742+0000 7f9e9effd640 1 -- 172.21.15.7:0/888304848 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9eb405a050 con 0x55a49ec08390 2024-09-21T06:44:58.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.742+0000 7f9ecc5d0740 10 client.17304 fetch_fsmap learned FSMap version 25 2024-09-21T06:44:58.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.742+0000 7f9ecc5d0740 1 -- 172.21.15.7:0/888304848 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a49efeab20 con 0x55a49ec08390 2024-09-21T06:44:58.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.742+0000 7f9e9effd640 1 -- 172.21.15.7:0/888304848 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9eb0018af0 con 0x55a49ec08390 2024-09-21T06:44:58.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.743+0000 7f9e9effd640 1 -- 172.21.15.7:0/888304848 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9eb40035f0 con 0x55a49ec08390 2024-09-21T06:44:58.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.743+0000 7f9ecc5d0740 10 client.17304 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:44:58.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.743+0000 7f9ecc5d0740 10 client.17304 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:44:58.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.743+0000 7f9ecc5d0740 20 client.17304 populate_metadata read hostname 'smithi007' 2024-09-21T06:44:58.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.743+0000 7f9ecc5d0740 1 --2- 172.21.15.7:0/888304848 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55a49ebe79f0 0x55a49efee0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:58.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.743+0000 7f9ecc5d0740 4 client.17304 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:44:58.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.743+0000 7f9ecc5d0740 1 -- 172.21.15.7:0/888304848 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a49ef48da0 con 0x55a49ebe79f0 2024-09-21T06:44:58.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.743+0000 7f9ebf7fe640 1 --2- 172.21.15.7:0/888304848 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55a49ebe79f0 0x55a49efee0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:58.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.743+0000 7f9ebf7fe640 1 --2- 172.21.15.7:0/888304848 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55a49ebe79f0 0x55a49efee0e0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e8e464a031a8d29 server_cookie=d5c6a25e7084b696 in_seq=0 out_seq=0 2024-09-21T06:44:58.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.743+0000 7f9e9effd640 10 client.17304 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:44:58.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.744+0000 7f9e9effd640 1 -- 172.21.15.7:0/888304848 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a49ef48da0 con 0x55a49ebe79f0 2024-09-21T06:44:58.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.744+0000 7f9e9effd640 10 client.17304 handle_command_reply: tid=0 2024-09-21T06:44:58.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.744+0000 7f9ecc5d0740 1 client.17304 shutdown 2024-09-21T06:44:58.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.745+0000 7f9ecc5d0740 1 -- 172.21.15.7:0/888304848 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a49ec08390 msgr2=0x55a49efdc230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:58.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.745+0000 7f9ecc5d0740 1 --2- 172.21.15.7:0/888304848 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a49ec08390 0x55a49efdc230 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f9eb4009900 tx=0x7f9eb402a410 comp rx=0 tx=0).stop 2024-09-21T06:44:58.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.745+0000 7f9ecc5d0740 1 -- 172.21.15.7:0/888304848 shutdown_connections 2024-09-21T06:44:58.756 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.745+0000 7f9ecc5d0740 1 --2- 172.21.15.7:0/888304848 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55a49ebe79f0 0x55a49efee0e0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:58.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.745+0000 7f9e9effd640 0 client.17304 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:44:58.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.745+0000 7f9ecc5d0740 1 --2- 172.21.15.7:0/888304848 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a49ec29070 0x55a49efe8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:58.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.745+0000 7f9ecc5d0740 1 --2- 172.21.15.7:0/888304848 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a49ec08390 0x55a49efdc230 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:58.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.745+0000 7f9ecc5d0740 1 --2- 172.21.15.7:0/888304848 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a49ec001b0 0x55a49efdbcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:58.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.745+0000 7f9ecc5d0740 1 -- 172.21.15.7:0/888304848 >> 172.21.15.7:0/888304848 conn(0x55a49ec1d460 msgr2=0x55a49efd3800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:58.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.745+0000 7f9ecc5d0740 1 -- 172.21.15.7:0/888304848 shutdown_connections 2024-09-21T06:44:58.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.745+0000 7f9ecc5d0740 1 -- 172.21.15.7:0/888304848 wait complete. 2024-09-21T06:44:58.757 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.745+0000 7f9ecc5d0740 20 client.17304 trim_cache size 0 max 16384 2024-09-21T06:44:58.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.763+0000 7f9ecc5d0740 1 Processor -- start 2024-09-21T06:44:58.764 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.763+0000 7f9ecc5d0740 1 -- start start 2024-09-21T06:44:58.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.763+0000 7f9ecc5d0740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a49ebe79f0 0x55a49efdabe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:58.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.763+0000 7f9ecc5d0740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a49ec001b0 0x55a49efd3e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:58.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.763+0000 7f9ecc5d0740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a49ec08390 0x55a49efd8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:58.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.763+0000 7f9ecc5d0740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9ec01b3fa0 con 0x55a49ec08390 2024-09-21T06:44:58.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.763+0000 7f9ecc5d0740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9ec01b1870 con 0x55a49ebe79f0 2024-09-21T06:44:58.765 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.763+0000 7f9ecc5d0740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9ec01af6e0 con 0x55a49ec001b0 2024-09-21T06:44:58.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.763+0000 7f9ebffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a49ec08390 0x55a49efd8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:58.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.763+0000 7f9ebffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a49ec08390 0x55a49efd8ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46542/0 (socket says 172.21.15.7:46542) 2024-09-21T06:44:58.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.763+0000 7f9ebffff640 1 -- 172.21.15.7:0/744786170 learned_addr learned my addr 172.21.15.7:0/744786170 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:44:58.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.763+0000 7f9ebf7fe640 1 --2- 172.21.15.7:0/744786170 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a49ebe79f0 0x55a49efdabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:58.766 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.763+0000 7f9ebeffd640 1 --2- 172.21.15.7:0/744786170 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a49ec001b0 0x55a49efd3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:58.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.764+0000 7f9ebf7fe640 1 -- 172.21.15.7:0/744786170 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a49ec001b0 msgr2=0x55a49efd3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:58.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.764+0000 7f9ebf7fe640 1 --2- 172.21.15.7:0/744786170 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a49ec001b0 0x55a49efd3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:58.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.764+0000 7f9ebf7fe640 1 -- 172.21.15.7:0/744786170 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a49ec08390 msgr2=0x55a49efd8ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:58.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.764+0000 7f9ebf7fe640 1 --2- 172.21.15.7:0/744786170 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a49ec08390 0x55a49efd8ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:58.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.764+0000 7f9ebf7fe640 1 -- 172.21.15.7:0/744786170 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a49efdcfb0 con 0x55a49ebe79f0 2024-09-21T06:44:58.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.764+0000 7f9ebf7fe640 1 --2- 172.21.15.7:0/744786170 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a49ebe79f0 0x55a49efdabe0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9eb0000c00 tx=0x7f9eb000afd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c60cad3b3c529fb1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:58.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.764+0000 7f9ea57fa640 1 -- 172.21.15.7:0/744786170 <== mon.2 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb001d040 con 0x55a49ebe79f0 2024-09-21T06:44:58.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.764+0000 7f9ea57fa640 1 -- 172.21.15.7:0/744786170 <== mon.2 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9eb000a6f0 con 0x55a49ebe79f0 2024-09-21T06:44:58.767 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.764+0000 7f9ea57fa640 1 -- 172.21.15.7:0/744786170 <== mon.2 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb0004660 con 0x55a49ebe79f0 2024-09-21T06:44:58.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.765+0000 7f9ecc5d0740 1 -- 172.21.15.7:0/744786170 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a49ebe79f0 msgr2=0x55a49efdabe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:58.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.765+0000 7f9ecc5d0740 1 --2- 172.21.15.7:0/744786170 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a49ebe79f0 0x55a49efdabe0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9eb0000c00 tx=0x7f9eb000afd0 comp rx=0 tx=0).stop 2024-09-21T06:44:58.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.765+0000 7f9ecc5d0740 1 -- 172.21.15.7:0/744786170 shutdown_connections 2024-09-21T06:44:58.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.765+0000 7f9ecc5d0740 1 --2- 172.21.15.7:0/744786170 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a49ec08390 0x55a49efd8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:58.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.765+0000 7f9ecc5d0740 1 --2- 172.21.15.7:0/744786170 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a49ec001b0 0x55a49efd3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:58.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.765+0000 7f9ecc5d0740 1 --2- 172.21.15.7:0/744786170 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a49ebe79f0 0x55a49efdabe0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:58.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.765+0000 7f9ecc5d0740 1 -- 172.21.15.7:0/744786170 >> 172.21.15.7:0/744786170 conn(0x55a49ec1d460 msgr2=0x55a49efd3750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:58.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.765+0000 7f9ecc5d0740 1 -- 172.21.15.7:0/744786170 shutdown_connections 2024-09-21T06:44:58.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.765+0000 7f9ecc5d0740 1 -- 172.21.15.7:0/744786170 wait complete. 2024-09-21T06:44:58.770 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.766+0000 7f9ecc5d0740 1 -- start start 2024-09-21T06:44:58.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.766+0000 7f9ecc5d0740 1 Processor -- start 2024-09-21T06:44:58.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.766+0000 7f9ecc5d0740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a49ebe79f0 0x55a49efe07d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:58.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.766+0000 7f9ecc5d0740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a49ec001b0 0x55a49efe0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:58.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.766+0000 7f9ecc5d0740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a49ec08390 0x55a49f057aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:58.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.766+0000 7f9ecc5d0740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9ec01afd30 con 0x55a49ec001b0 2024-09-21T06:44:58.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.766+0000 7f9ecc5d0740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9ec01b11a0 con 0x55a49ec08390 2024-09-21T06:44:58.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.766+0000 7f9ecc5d0740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9ec01b0400 con 0x55a49ebe79f0 2024-09-21T06:44:58.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.766+0000 7f9ecc5d0740 10 client.0 _ll_register_callbacks cb 0x7f9eb40095e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:44:58.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.766+0000 7f9ebeffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a49ec001b0 0x55a49efe0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:58.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.766+0000 7f9ebeffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a49ec001b0 0x55a49efe0d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46544/0 (socket says 172.21.15.7:46544) 2024-09-21T06:44:58.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.766+0000 7f9ebeffd640 1 -- 172.21.15.7:0/122592980 learned_addr learned my addr 172.21.15.7:0/122592980 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:44:58.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.767+0000 7f9ebffff640 1 --2- 172.21.15.7:0/122592980 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a49ec08390 0x55a49f057aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:58.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.767+0000 7f9ebf7fe640 1 --2- 172.21.15.7:0/122592980 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a49ebe79f0 0x55a49efe07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:58.771 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.767+0000 7f9ebeffd640 1 -- 172.21.15.7:0/122592980 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a49ebe79f0 msgr2=0x55a49efe07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:58.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.767+0000 7f9ebeffd640 1 --2- 172.21.15.7:0/122592980 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a49ebe79f0 0x55a49efe07d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:58.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.767+0000 7f9ebeffd640 1 -- 172.21.15.7:0/122592980 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a49ec08390 msgr2=0x55a49f057aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:44:58.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.767+0000 7f9ebeffd640 1 --2- 172.21.15.7:0/122592980 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a49ec08390 0x55a49f057aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:58.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.767+0000 7f9ebeffd640 1 -- 172.21.15.7:0/122592980 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a49f058030 con 0x55a49ec001b0 2024-09-21T06:44:58.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.767+0000 7f9ebeffd640 1 --2- 172.21.15.7:0/122592980 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a49ec001b0 0x55a49efe0d10 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f9eb4006010 tx=0x7f9eb40038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67cc9e80b643455c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:44:58.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.767+0000 7f9e9effd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:44:58.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.767+0000 7f9e9effd640 1 -- 172.21.15.7:0/122592980 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb404e040 con 0x55a49ec001b0 2024-09-21T06:44:58.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.767+0000 7f9e9effd640 1 -- 172.21.15.7:0/122592980 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8412+0+0 (secure 0 0 0) 0x7f9eb4005020 con 0x55a49ec001b0 2024-09-21T06:44:58.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.767+0000 7f9ecc5d0740 1 -- 172.21.15.7:0/122592980 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9eb000a6f0 con 0x55a49ec001b0 2024-09-21T06:44:58.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.768+0000 7f9e9effd640 1 -- 172.21.15.7:0/122592980 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9eb4035040 con 0x55a49ec001b0 2024-09-21T06:44:58.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.768+0000 7f9ecc5d0740 10 client.17310 fetch_fsmap learned FSMap version 25 2024-09-21T06:44:58.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.768+0000 7f9ecc5d0740 1 -- 172.21.15.7:0/122592980 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a49f0592a0 con 0x55a49ec001b0 2024-09-21T06:44:58.772 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.768+0000 7f9e9effd640 1 -- 172.21.15.7:0/122592980 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9eb000a6f0 con 0x55a49ec001b0 2024-09-21T06:44:58.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.768+0000 7f9e9effd640 1 -- 172.21.15.7:0/122592980 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9eb4053440 con 0x55a49ec001b0 2024-09-21T06:44:58.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.768+0000 7f9ecc5d0740 10 client.17310 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:44:58.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.768+0000 7f9ecc5d0740 10 client.17310 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:44:58.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.768+0000 7f9ecc5d0740 20 client.17310 populate_metadata read hostname 'smithi007' 2024-09-21T06:44:58.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.768+0000 7f9ecc5d0740 1 --2- 172.21.15.7:0/122592980 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55a49ec29070 0x55a49f05ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:44:58.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.768+0000 7f9ecc5d0740 4 client.17310 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:44:58.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.768+0000 7f9ecc5d0740 1 -- 172.21.15.7:0/122592980 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a49ef44850 con 0x55a49ec29070 2024-09-21T06:44:58.773 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.768+0000 7f9ebf7fe640 1 --2- 172.21.15.7:0/122592980 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55a49ec29070 0x55a49f05ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:44:58.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.769+0000 7f9e9effd640 10 client.17310 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:44:58.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.769+0000 7f9ebf7fe640 1 --2- 172.21.15.7:0/122592980 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55a49ec29070 0x55a49f05ba80 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=735e0c087959928a server_cookie=7122bcc97aa76b0a in_seq=0 out_seq=0 2024-09-21T06:44:58.774 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.769+0000 7f9e9effd640 1 -- 172.21.15.7:0/122592980 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4634 (crc 0 0 0) 0x55a49ef44850 con 0x55a49ec29070 2024-09-21T06:44:58.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.769+0000 7f9e9effd640 10 client.17310 handle_command_reply: tid=0 2024-09-21T06:44:58.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.769+0000 7f9ecc5d0740 1 client.17310 shutdown 2024-09-21T06:44:58.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.769+0000 7f9ecc5d0740 1 -- 172.21.15.7:0/122592980 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a49ec001b0 msgr2=0x55a49efe0d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:58.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.769+0000 7f9ecc5d0740 1 --2- 172.21.15.7:0/122592980 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a49ec001b0 0x55a49efe0d10 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f9eb4006010 tx=0x7f9eb40038a0 comp rx=0 tx=0).stop 2024-09-21T06:44:58.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.769+0000 7f9ecc5d0740 1 -- 172.21.15.7:0/122592980 shutdown_connections 2024-09-21T06:44:58.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.769+0000 7f9ecc5d0740 1 --2- 172.21.15.7:0/122592980 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55a49ec29070 0x55a49f05ba80 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:58.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.769+0000 7f9ecc5d0740 1 --2- 172.21.15.7:0/122592980 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a49ec08390 0x55a49f057aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:58.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.769+0000 7f9ecc5d0740 1 --2- 172.21.15.7:0/122592980 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a49ec001b0 0x55a49efe0d10 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:58.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.769+0000 7f9e9effd640 0 client.17310 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:44:58.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.769+0000 7f9ecc5d0740 1 --2- 172.21.15.7:0/122592980 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a49ebe79f0 0x55a49efe07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:58.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.770+0000 7f9ecc5d0740 1 -- 172.21.15.7:0/122592980 >> 172.21.15.7:0/122592980 conn(0x55a49ec1d460 msgr2=0x55a49efdd180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:58.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.770+0000 7f9ecc5d0740 1 -- 172.21.15.7:0/122592980 shutdown_connections 2024-09-21T06:44:58.775 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.770+0000 7f9ecc5d0740 1 -- 172.21.15.7:0/122592980 wait complete. 2024-09-21T06:44:58.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.770+0000 7f9ecc5d0740 20 client.17310 trim_cache size 0 max 16384 2024-09-21T06:44:58.776 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:44:58.776 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "no active scrubs running", 2024-09-21T06:44:58.776 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": {}, 2024-09-21T06:44:58.776 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_stats": { 2024-09-21T06:44:58.776 INFO:teuthology.orchestra.run.smithi007.stdout: "d98b2d47-c2db-4811-8b3e-ec744a20d9d6": { 2024-09-21T06:44:58.776 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:44:03.790680+0000", 2024-09-21T06:44:58.776 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:44:58.776 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:44:58.776 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:44:58.776 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:44:58.777 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:44:58.777 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:44:58.777 INFO:teuthology.orchestra.run.smithi007.stdout: "310a0ec8-44bb-49ed-a534-3bc91cb1ee9d": { 2024-09-21T06:44:58.777 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:40:55.373968+0000", 2024-09-21T06:44:58.777 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:44:58.777 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:44:58.777 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:44:58.777 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:44:58.777 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:44:58.777 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:44:58.777 INFO:teuthology.orchestra.run.smithi007.stdout: "dd792920-08a1-482d-8961-5c6a6f131599": { 2024-09-21T06:44:58.777 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:43:53.390806+0000", 2024-09-21T06:44:58.777 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:44:58.777 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:44:58.778 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:44:58.778 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:44:58.778 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:44:58.778 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:44:58.778 INFO:teuthology.orchestra.run.smithi007.stdout: "13441782-2231-4713-8ebd-068a941de47f": { 2024-09-21T06:44:58.778 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:39:30.219006+0000", 2024-09-21T06:44:58.778 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:44:58.778 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:44:58.778 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:44:58.778 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:44:58.778 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:44:58.778 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:44:58.778 INFO:teuthology.orchestra.run.smithi007.stdout: "02016ff7-8cc2-467e-a465-f69400f702cb": { 2024-09-21T06:44:58.778 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:44:25.093423+0000", 2024-09-21T06:44:58.779 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:44:58.779 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:44:58.779 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:44:58.779 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:44:58.779 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:44:58.779 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:44:58.779 INFO:teuthology.orchestra.run.smithi007.stdout: "b0327167-8c41-4286-8afc-7f0780972fd7": { 2024-09-21T06:44:58.779 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:38:36.828657+0000", 2024-09-21T06:44:58.779 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:44:58.779 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:44:58.779 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:44:58.779 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:44:58.779 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:44:58.779 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:44:58.779 INFO:teuthology.orchestra.run.smithi007.stdout: "d7b6a90c-9ae1-4e02-93ad-335a7e9df1d7": { 2024-09-21T06:44:58.780 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:39:19.226139+0000", 2024-09-21T06:44:58.780 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:44:58.780 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:44:58.780 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:44:58.780 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:44:58.780 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:44:58.780 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:44:58.780 INFO:teuthology.orchestra.run.smithi007.stdout: "3f7283b7-f175-4023-9191-177660b3a6be": { 2024-09-21T06:44:58.780 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:44:14.422552+0000", 2024-09-21T06:44:58.780 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:44:58.780 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:44:58.780 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:44:58.780 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:44:58.780 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:44:58.780 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:44:58.781 INFO:teuthology.orchestra.run.smithi007.stdout: "6231e9c1-14a2-40b5-be3c-76d87a0d733b": { 2024-09-21T06:44:58.781 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:37:02.484812+0000", 2024-09-21T06:44:58.781 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:44:58.781 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:44:58.781 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:44:58.781 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:44:58.781 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:44:58.781 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:44:58.781 INFO:teuthology.orchestra.run.smithi007.stdout: "a1ae5b3b-f158-44be-8ef4-d70e9ba879cc": { 2024-09-21T06:44:58.781 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:41:37.568453+0000", 2024-09-21T06:44:58.781 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:44:58.781 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:44:58.782 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:44:58.782 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:44:58.782 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:44:58.782 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:44:58.782 INFO:teuthology.orchestra.run.smithi007.stdout: "62fca477-b241-45f5-8185-bc78aeb8b19f": { 2024-09-21T06:44:58.782 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:40:12.744488+0000", 2024-09-21T06:44:58.782 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:44:58.782 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:44:58.782 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:44:58.782 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:44:58.782 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:44:58.782 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:44:58.782 INFO:teuthology.orchestra.run.smithi007.stdout: "5cbaaba2-6ab1-4f83-abd6-8c6eef4b5c42": { 2024-09-21T06:44:58.782 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:37:46.566272+0000", 2024-09-21T06:44:58.783 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:44:58.783 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:44:58.783 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:44:58.783 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:44:58.783 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:44:58.783 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:44:58.783 INFO:teuthology.orchestra.run.smithi007.stdout: "b466f071-ab32-427c-a0ed-73edea33145e": { 2024-09-21T06:44:58.783 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:43:01.151440+0000", 2024-09-21T06:44:58.783 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:44:58.783 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:44:58.783 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:44:58.783 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:44:58.783 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:44:58.783 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:44:58.784 INFO:teuthology.orchestra.run.smithi007.stdout: "ef9eaabd-003a-44fb-8373-c854a9e15a71": { 2024-09-21T06:44:58.784 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:42:19.467946+0000", 2024-09-21T06:44:58.784 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:44:58.784 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:44:58.784 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:44:58.784 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:44:58.784 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:44:58.784 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:44:58.784 INFO:teuthology.orchestra.run.smithi007.stdout: "0b89345c-1f00-4efe-8ee9-4cb17e43584c": { 2024-09-21T06:44:58.784 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:36:19.500334+0000", 2024-09-21T06:44:58.784 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:44:58.784 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:44:58.785 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:44:58.785 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:44:58.785 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:44:58.785 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:44:58.785 INFO:teuthology.orchestra.run.smithi007.stdout: "3c5b7f3f-e9b3-4d48-8154-2d7d4700992e": { 2024-09-21T06:44:58.785 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:43:43.120930+0000", 2024-09-21T06:44:58.785 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:44:58.785 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:44:58.785 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:44:58.785 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:44:58.785 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:44:58.785 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:44:58.785 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:44:58.785 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:44:58.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.770+0000 7f9ec605c640 1 -- 172.21.15.7:0/3834404924 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f9ea80b6680 msgr2=0x7f9ea80b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:58.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.770+0000 7f9ec605c640 1 --2- 172.21.15.7:0/3834404924 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f9ea80b6680 0x7f9ea80b8b90 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f9eb4009230 tx=0x7f9eb4031830 comp rx=0 tx=0).stop 2024-09-21T06:44:58.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.770+0000 7f9ec605c640 1 -- 172.21.15.7:0/3834404924 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ec0109e20 msgr2=0x7f9ec0076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:44:58.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.770+0000 7f9ec605c640 1 --2- 172.21.15.7:0/3834404924 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ec0109e20 0x7f9ec0076190 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f9eb800eaa0 tx=0x7f9eb800eea0 comp rx=0 tx=0).stop 2024-09-21T06:44:58.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.771+0000 7f9ec605c640 1 -- 172.21.15.7:0/3834404924 shutdown_connections 2024-09-21T06:44:58.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.771+0000 7f9ec605c640 1 --2- 172.21.15.7:0/3834404924 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f9ea80b6680 0x7f9ea80b8b90 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:58.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.771+0000 7f9ec605c640 1 --2- 172.21.15.7:0/3834404924 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9ec0109e20 0x7f9ec0076190 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:58.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.771+0000 7f9ec605c640 1 --2- 172.21.15.7:0/3834404924 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9ec01094d0 0x7f9ec0075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:58.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.771+0000 7f9ec605c640 1 --2- 172.21.15.7:0/3834404924 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9ec0103b90 0x7f9ec0075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:44:58.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.771+0000 7f9ec605c640 1 -- 172.21.15.7:0/3834404924 >> 172.21.15.7:0/3834404924 conn(0x7f9ec00ff600 msgr2=0x7f9ec0101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:44:58.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.771+0000 7f9ec605c640 1 -- 172.21.15.7:0/3834404924 shutdown_connections 2024-09-21T06:44:58.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:44:58.771+0000 7f9ec605c640 1 -- 172.21.15.7:0/3834404924 wait complete. 2024-09-21T06:44:58.788 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:44:58 smithi144 ceph-mon[34653]: pgmap v586: 97 pgs: 97 active+clean; 3.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:44:58.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:44:58 smithi018 ceph-mon[34477]: pgmap v586: 97 pgs: 97 active+clean; 3.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:44:59.663 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:44:59.664 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:44:59.924 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:45:00.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:00.457+0000 7fa4436c4640 1 -- 172.21.15.7:0/3567612916 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa43c109df0 msgr2=0x7fa43c110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:00.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:00.457+0000 7fa4436c4640 1 --2- 172.21.15.7:0/3567612916 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa43c109df0 0x7fa43c110620 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7fa434009ca0 tx=0x7fa43402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:45:00.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:00.457+0000 7fa4436c4640 1 -- 172.21.15.7:0/3567612916 shutdown_connections 2024-09-21T06:45:00.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:00.457+0000 7fa4436c4640 1 --2- 172.21.15.7:0/3567612916 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa43c109df0 0x7fa43c110620 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:00.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:00.457+0000 7fa4436c4640 1 --2- 172.21.15.7:0/3567612916 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa43c1094a0 0x7fa43c1098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:00.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:00.457+0000 7fa4436c4640 1 --2- 172.21.15.7:0/3567612916 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa43c103b60 0x7fa43c103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:00.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:00.457+0000 7fa4436c4640 1 -- 172.21.15.7:0/3567612916 >> 172.21.15.7:0/3567612916 conn(0x7fa43c07b850 msgr2=0x7fa43c07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:00.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:00.457+0000 7fa4436c4640 1 -- 172.21.15.7:0/3567612916 shutdown_connections 2024-09-21T06:45:00.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:00.457+0000 7fa4436c4640 1 -- 172.21.15.7:0/3567612916 wait complete. 2024-09-21T06:45:00.461 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:00.457+0000 7fa4436c4640 1 Processor -- start 2024-09-21T06:45:00.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:00.458+0000 7fa4436c4640 1 -- start start 2024-09-21T06:45:00.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:00.458+0000 7fa4436c4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa43c103b60 0x7fa43c075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:00.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:00.458+0000 7fa4436c4640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa43c1094a0 0x7fa43c075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:00.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:00.458+0000 7fa4436c4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa43c109df0 0x7fa43c076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:00.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:00.458+0000 7fa4436c4640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa43c113ab0 con 0x7fa43c109df0 2024-09-21T06:45:00.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:00.458+0000 7fa4436c4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa43c113930 con 0x7fa43c103b60 2024-09-21T06:45:00.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:00.458+0000 7fa4436c4640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa43c113c30 con 0x7fa43c1094a0 2024-09-21T06:45:00.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:00.458+0000 7fa441c61640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa43c109df0 0x7fa43c076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:00.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:00.458+0000 7fa440c5f640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa43c1094a0 0x7fa43c075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:00.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:00.458+0000 7fa441c61640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa43c109df0 0x7fa43c076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33756/0 (socket says 172.21.15.7:33756) 2024-09-21T06:45:00.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:00.458+0000 7fa441c61640 1 -- 172.21.15.7:0/1228585616 learned_addr learned my addr 172.21.15.7:0/1228585616 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:00.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:00.458+0000 7fa441460640 1 --2- 172.21.15.7:0/1228585616 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa43c103b60 0x7fa43c075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:00.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:00.458+0000 7fa441c61640 1 -- 172.21.15.7:0/1228585616 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa43c1094a0 msgr2=0x7fa43c075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:00.462 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:00.458+0000 7fa441c61640 1 --2- 172.21.15.7:0/1228585616 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa43c1094a0 0x7fa43c075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:00.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:00.458+0000 7fa441c61640 1 -- 172.21.15.7:0/1228585616 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa43c103b60 msgr2=0x7fa43c075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:00.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:00.458+0000 7fa441c61640 1 --2- 172.21.15.7:0/1228585616 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa43c103b60 0x7fa43c075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:00.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:00.458+0000 7fa441c61640 1 -- 172.21.15.7:0/1228585616 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa43c1a86c0 con 0x7fa43c109df0 2024-09-21T06:45:00.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:00.458+0000 7fa440c5f640 1 --2- 172.21.15.7:0/1228585616 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa43c1094a0 0x7fa43c075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:45:00.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:00.459+0000 7fa441c61640 1 --2- 172.21.15.7:0/1228585616 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa43c109df0 0x7fa43c076190 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fa4340098d0 tx=0x7fa4340317b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:00.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:00.459+0000 7fa4327fc640 1 -- 172.21.15.7:0/1228585616 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa434003b70 con 0x7fa43c109df0 2024-09-21T06:45:00.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:00.459+0000 7fa4327fc640 1 -- 172.21.15.7:0/1228585616 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa434003d10 con 0x7fa43c109df0 2024-09-21T06:45:00.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:00.459+0000 7fa4436c4640 1 -- 172.21.15.7:0/1228585616 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa43c1a8950 con 0x7fa43c109df0 2024-09-21T06:45:00.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:00.459+0000 7fa4327fc640 1 -- 172.21.15.7:0/1228585616 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa43402fa20 con 0x7fa43c109df0 2024-09-21T06:45:00.463 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:00.459+0000 7fa4436c4640 1 -- 172.21.15.7:0/1228585616 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa43c1a8ee0 con 0x7fa43c109df0 2024-09-21T06:45:00.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:00.460+0000 7fa4436c4640 1 -- 172.21.15.7:0/1228585616 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa43c103f70 con 0x7fa43c109df0 2024-09-21T06:45:00.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:00.461+0000 7fa4327fc640 1 -- 172.21.15.7:0/1228585616 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7fa43402fbe0 con 0x7fa43c109df0 2024-09-21T06:45:00.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:00.462+0000 7fa4327fc640 1 --2- 172.21.15.7:0/1228585616 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa4280b6700 0x7fa4280b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:00.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:00.462+0000 7fa441460640 1 --2- 172.21.15.7:0/1228585616 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa4280b6700 0x7fa4280b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:00.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:00.462+0000 7fa4327fc640 1 -- 172.21.15.7:0/1228585616 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8412+0+0 (secure 0 0 0) 0x7fa434108a90 con 0x7fa43c109df0 2024-09-21T06:45:00.464 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:00.463+0000 7fa441460640 1 --2- 172.21.15.7:0/1228585616 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa4280b6700 0x7fa4280b8c10 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa43c077160 tx=0x7fa43800b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:00.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:00.465+0000 7fa4327fc640 1 -- 172.21.15.7:0/1228585616 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa4340cf0e0 con 0x7fa43c109df0 2024-09-21T06:45:00.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:00.689+0000 7fa4436c4640 1 -- 172.21.15.7:0/1228585616 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa43c076a10 con 0x7fa43c109df0 2024-09-21T06:45:00.691 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:45:00 smithi007 ceph-mon[30983]: pgmap v587: 97 pgs: 97 active+clean; 3.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:45:00.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:00.690+0000 7fa4327fc640 1 -- 172.21.15.7:0/1228585616 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11899 (secure 0 0 0) 0x7fa43c076a10 con 0x7fa43c109df0 2024-09-21T06:45:00.692 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:45:00.692 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-21T06:36:10:753693+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2015971546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2015971546},{"type":"v1","addr":"172.21.15.7:6835","nonce":2015971546}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/2350816224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":2350816224},{"type":"v1","addr":"172.21.15.7:6837","nonce":2350816224}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14823,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/1669980572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":1669980572},{"type":"v1","addr":"172.21.15.7:6839","nonce":1669980572}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14835,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/2528308973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":2528308973},{"type":"v1","addr":"172.21.15.7:6841","nonce":2528308973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24623,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1337382979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1337382979},{"type":"v1","addr":"172.21.15.18:6833","nonce":1337382979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/2751454345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":2751454345},{"type":"v1","addr":"172.21.15.144:6833","nonce":2751454345}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:34:24.627168+0000","modified":"2024-09-21T06:36:10.737288+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24716,"mds_1":24688,"mds_2":24686},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24656":{"gid":24656,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6835/158884796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":158884796},{"type":"v1","addr":"172.21.15.18:6835","nonce":158884796}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6835/3636739922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3636739922},{"type":"v1","addr":"172.21.15.144:6835","nonce":3636739922}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24673":{"gid":24673,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6837/1126341753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":1126341753},{"type":"v1","addr":"172.21.15.144:6837","nonce":1126341753}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.18:6837/1539670694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1539670694},{"type":"v1","addr":"172.21.15.18:6837","nonce":1539670694}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24688":{"gid":24688,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.144:6839/4027821922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":4027821922},{"type":"v1","addr":"172.21.15.144:6839","nonce":4027821922}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24716":{"gid":24716,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.18:6839/3798713532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":3798713532},{"type":"v1","addr":"172.21.15.18:6839","nonce":3798713532}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24716,"qdb_cluster":[24716,24688,24686]},"id":1}]} 2024-09-21T06:45:00.693 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-21T06:45:00.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:00.693+0000 7fa4436c4640 1 -- 172.21.15.7:0/1228585616 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa4280b6700 msgr2=0x7fa4280b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:00.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:00.693+0000 7fa4436c4640 1 --2- 172.21.15.7:0/1228585616 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa4280b6700 0x7fa4280b8c10 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa43c077160 tx=0x7fa43800b390 comp rx=0 tx=0).stop 2024-09-21T06:45:00.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:00.693+0000 7fa4436c4640 1 -- 172.21.15.7:0/1228585616 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa43c109df0 msgr2=0x7fa43c076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:00.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:00.693+0000 7fa4436c4640 1 --2- 172.21.15.7:0/1228585616 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa43c109df0 0x7fa43c076190 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fa4340098d0 tx=0x7fa4340317b0 comp rx=0 tx=0).stop 2024-09-21T06:45:00.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:00.693+0000 7fa4436c4640 1 -- 172.21.15.7:0/1228585616 shutdown_connections 2024-09-21T06:45:00.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:00.693+0000 7fa4436c4640 1 --2- 172.21.15.7:0/1228585616 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa4280b6700 0x7fa4280b8c10 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:00.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:00.693+0000 7fa4436c4640 1 --2- 172.21.15.7:0/1228585616 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa43c109df0 0x7fa43c076190 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:00.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:00.693+0000 7fa4436c4640 1 --2- 172.21.15.7:0/1228585616 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa43c1094a0 0x7fa43c075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:00.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:00.693+0000 7fa4436c4640 1 --2- 172.21.15.7:0/1228585616 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa43c103b60 0x7fa43c075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:00.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:00.693+0000 7fa4436c4640 1 -- 172.21.15.7:0/1228585616 >> 172.21.15.7:0/1228585616 conn(0x7fa43c07b850 msgr2=0x7fa43c105430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:00.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:00.693+0000 7fa4436c4640 1 -- 172.21.15.7:0/1228585616 shutdown_connections 2024-09-21T06:45:00.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:00.693+0000 7fa4436c4640 1 -- 172.21.15.7:0/1228585616 wait complete. 2024-09-21T06:45:00.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:45:00 smithi144 ceph-mon[34653]: pgmap v587: 97 pgs: 97 active+clean; 3.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:45:00.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:45:00 smithi018 ceph-mon[34477]: pgmap v587: 97 pgs: 97 active+clean; 3.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:45:01.353 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:45:01.589 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:45:01 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/1228585616' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:45:01.616 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:45:01.770 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:45:01 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/1228585616' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:45:01.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:45:01 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/1228585616' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:45:02.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.108+0000 7fa29d881640 1 -- 172.21.15.7:0/2616356972 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa298109e10 msgr2=0x7fa298110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:02.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.108+0000 7fa29d881640 1 --2- 172.21.15.7:0/2616356972 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa298109e10 0x7fa298110640 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7fa290009ca0 tx=0x7fa29002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:45:02.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.108+0000 7fa29d881640 1 -- 172.21.15.7:0/2616356972 shutdown_connections 2024-09-21T06:45:02.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.108+0000 7fa29d881640 1 --2- 172.21.15.7:0/2616356972 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa298109e10 0x7fa298110640 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:02.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.108+0000 7fa29d881640 1 --2- 172.21.15.7:0/2616356972 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2981094c0 0x7fa2981098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:02.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.108+0000 7fa29d881640 1 --2- 172.21.15.7:0/2616356972 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa298103b80 0x7fa298103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:02.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.108+0000 7fa29d881640 1 -- 172.21.15.7:0/2616356972 >> 172.21.15.7:0/2616356972 conn(0x7fa2980ff590 msgr2=0x7fa2981019e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:02.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.108+0000 7fa29d881640 1 -- 172.21.15.7:0/2616356972 shutdown_connections 2024-09-21T06:45:02.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.108+0000 7fa29d881640 1 -- 172.21.15.7:0/2616356972 wait complete. 2024-09-21T06:45:02.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.109+0000 7fa29d881640 1 Processor -- start 2024-09-21T06:45:02.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.109+0000 7fa29d881640 1 -- start start 2024-09-21T06:45:02.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.110+0000 7fa29d881640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa298103b80 0x7fa29819a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:02.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.110+0000 7fa29d881640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2981094c0 0x7fa29819a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:02.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.110+0000 7fa29d881640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa298109e10 0x7fa29819fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:02.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.110+0000 7fa29d881640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa298113ad0 con 0x7fa298103b80 2024-09-21T06:45:02.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.110+0000 7fa29d881640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa298113950 con 0x7fa2981094c0 2024-09-21T06:45:02.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.110+0000 7fa29d881640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa298113c50 con 0x7fa298109e10 2024-09-21T06:45:02.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.110+0000 7fa296ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa298103b80 0x7fa29819a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:02.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.110+0000 7fa296ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa298103b80 0x7fa29819a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33768/0 (socket says 172.21.15.7:33768) 2024-09-21T06:45:02.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.110+0000 7fa296ffd640 1 -- 172.21.15.7:0/3303829646 learned_addr learned my addr 172.21.15.7:0/3303829646 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:02.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.110+0000 7fa2977fe640 1 --2- 172.21.15.7:0/3303829646 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa298109e10 0x7fa29819fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:02.118 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.110+0000 7fa2967fc640 1 --2- 172.21.15.7:0/3303829646 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2981094c0 0x7fa29819a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:02.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.110+0000 7fa296ffd640 1 -- 172.21.15.7:0/3303829646 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa298109e10 msgr2=0x7fa29819fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:02.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.110+0000 7fa296ffd640 1 --2- 172.21.15.7:0/3303829646 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa298109e10 0x7fa29819fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:02.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.110+0000 7fa296ffd640 1 -- 172.21.15.7:0/3303829646 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2981094c0 msgr2=0x7fa29819a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:02.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.110+0000 7fa296ffd640 1 --2- 172.21.15.7:0/3303829646 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2981094c0 0x7fa29819a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:02.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.110+0000 7fa296ffd640 1 -- 172.21.15.7:0/3303829646 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2981a03b0 con 0x7fa298103b80 2024-09-21T06:45:02.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.110+0000 7fa296ffd640 1 --2- 172.21.15.7:0/3303829646 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa298103b80 0x7fa29819a440 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7fa28800d950 tx=0x7fa28800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:02.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.111+0000 7fa29c87f640 1 -- 172.21.15.7:0/3303829646 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa288017070 con 0x7fa298103b80 2024-09-21T06:45:02.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.111+0000 7fa29c87f640 1 -- 172.21.15.7:0/3303829646 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa288009c30 con 0x7fa298103b80 2024-09-21T06:45:02.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.111+0000 7fa29c87f640 1 -- 172.21.15.7:0/3303829646 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa28800f620 con 0x7fa298103b80 2024-09-21T06:45:02.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.111+0000 7fa29d881640 1 -- 172.21.15.7:0/3303829646 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2981a06a0 con 0x7fa298103b80 2024-09-21T06:45:02.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.111+0000 7fa29d881640 1 -- 172.21.15.7:0/3303829646 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2981a6e00 con 0x7fa298103b80 2024-09-21T06:45:02.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.113+0000 7fa2a3df5740 1 Processor -- start 2024-09-21T06:45:02.119 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.113+0000 7fa2a3df5740 1 -- start start 2024-09-21T06:45:02.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.114+0000 7fa2a3df5740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56012bc8e070 0x56012c0352c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:02.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.114+0000 7fa2a3df5740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56012bc651b0 0x56012c035800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:02.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.114+0000 7fa2a3df5740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56012bc6d390 0x56012c035d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:02.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.114+0000 7fa2a3df5740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56012bfabea0 con 0x56012bc6d390 2024-09-21T06:45:02.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.114+0000 7fa2a3df5740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56012bf9b2d0 con 0x56012bc651b0 2024-09-21T06:45:02.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.114+0000 7fa2a3df5740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x56012bf9f0e0 con 0x56012bc8e070 2024-09-21T06:45:02.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.114+0000 7fa29c87f640 1 -- 172.21.15.7:0/3303829646 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7fa28800f7c0 con 0x7fa298103b80 2024-09-21T06:45:02.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.114+0000 7fa2967fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56012bc6d390 0x56012c035d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:02.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.114+0000 7fa2967fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56012bc6d390 0x56012c035d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33772/0 (socket says 172.21.15.7:33772) 2024-09-21T06:45:02.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.114+0000 7fa2967fc640 1 -- 172.21.15.7:0/2241639392 learned_addr learned my addr 172.21.15.7:0/2241639392 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:02.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.114+0000 7fa2977fe640 1 --2- 172.21.15.7:0/2241639392 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56012bc8e070 0x56012c0352c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:02.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.114+0000 7fa296ffd640 1 --2- 172.21.15.7:0/2241639392 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56012bc651b0 0x56012c035800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:02.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.114+0000 7fa2967fc640 1 -- 172.21.15.7:0/2241639392 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56012bc8e070 msgr2=0x56012c0352c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:02.120 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.114+0000 7fa2967fc640 1 --2- 172.21.15.7:0/2241639392 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56012bc8e070 0x56012c0352c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:02.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.114+0000 7fa2967fc640 1 -- 172.21.15.7:0/2241639392 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56012bc651b0 msgr2=0x56012c035800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:02.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.114+0000 7fa2967fc640 1 --2- 172.21.15.7:0/2241639392 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56012bc651b0 0x56012c035800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:02.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.114+0000 7fa2967fc640 1 -- 172.21.15.7:0/2241639392 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56012bcf9650 con 0x56012bc6d390 2024-09-21T06:45:02.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.114+0000 7fa296ffd640 1 --2- 172.21.15.7:0/2241639392 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56012bc651b0 0x56012c035800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:45:02.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.114+0000 7fa2967fc640 1 --2- 172.21.15.7:0/2241639392 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56012bc6d390 0x56012c035d40 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fa28c009c20 tx=0x7fa28c011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=908a229577a2df85 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:02.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.115+0000 7fa27dffb640 1 -- 172.21.15.7:0/2241639392 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa28c004230 con 0x56012bc6d390 2024-09-21T06:45:02.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.115+0000 7fa27dffb640 1 -- 172.21.15.7:0/2241639392 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa28c0043d0 con 0x56012bc6d390 2024-09-21T06:45:02.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.115+0000 7fa27dffb640 1 -- 172.21.15.7:0/2241639392 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa28c004d50 con 0x56012bc6d390 2024-09-21T06:45:02.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.115+0000 7fa29c87f640 1 --2- 172.21.15.7:0/3303829646 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa2800b6700 0x7fa2800b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:02.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.115+0000 7fa2977fe640 1 --2- 172.21.15.7:0/3303829646 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa2800b6700 0x7fa2800b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:02.121 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.115+0000 7fa29c87f640 1 -- 172.21.15.7:0/3303829646 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8412+0+0 (secure 0 0 0) 0x7fa2880e7200 con 0x7fa298103b80 2024-09-21T06:45:02.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.116+0000 7fa2a3df5740 1 -- 172.21.15.7:0/2241639392 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56012bc6d390 msgr2=0x56012c035d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:02.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.116+0000 7fa2977fe640 1 --2- 172.21.15.7:0/3303829646 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa2800b6700 0x7fa2800b8c10 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fa29002f500 tx=0x7fa29002f310 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:02.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.116+0000 7fa2a3df5740 1 --2- 172.21.15.7:0/2241639392 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56012bc6d390 0x56012c035d40 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fa28c009c20 tx=0x7fa28c011810 comp rx=0 tx=0).stop 2024-09-21T06:45:02.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.116+0000 7fa2a3df5740 1 -- 172.21.15.7:0/2241639392 shutdown_connections 2024-09-21T06:45:02.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.116+0000 7fa2a3df5740 1 --2- 172.21.15.7:0/2241639392 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56012bc6d390 0x56012c035d40 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:02.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.116+0000 7fa2a3df5740 1 --2- 172.21.15.7:0/2241639392 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56012bc651b0 0x56012c035800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:02.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.116+0000 7fa2a3df5740 1 --2- 172.21.15.7:0/2241639392 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56012bc8e070 0x56012c0352c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:02.125 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.116+0000 7fa2a3df5740 1 -- 172.21.15.7:0/2241639392 >> 172.21.15.7:0/2241639392 conn(0x56012bc82460 msgr2=0x56012c0331b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:02.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.116+0000 7fa2a3df5740 1 -- 172.21.15.7:0/2241639392 shutdown_connections 2024-09-21T06:45:02.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.116+0000 7fa2a3df5740 1 -- 172.21.15.7:0/2241639392 wait complete. 2024-09-21T06:45:02.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.116+0000 7fa2a3df5740 1 -- start start 2024-09-21T06:45:02.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.117+0000 7fa2a3df5740 1 Processor -- start 2024-09-21T06:45:02.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.117+0000 7fa2a3df5740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56012bc651b0 0x56012c040980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:02.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.117+0000 7fa2a3df5740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56012bc6d390 0x56012c040ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:02.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.117+0000 7fa2a3df5740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56012bc8e070 0x56012c04cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:02.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.117+0000 7fa2a3df5740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56012bdfc700 con 0x56012bc651b0 2024-09-21T06:45:02.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.117+0000 7fa2a3df5740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56012bf36160 con 0x56012bc6d390 2024-09-21T06:45:02.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.117+0000 7fa2a3df5740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x56012c043aa0 con 0x56012bc8e070 2024-09-21T06:45:02.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.117+0000 7fa2a3df5740 10 client.0 _ll_register_callbacks cb 0x56012bf4f9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:02.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.117+0000 7fa2967fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56012bc6d390 0x56012c040ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:02.126 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.117+0000 7fa296ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56012bc651b0 0x56012c040980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:02.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.117+0000 7fa296ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56012bc651b0 0x56012c040980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33780/0 (socket says 172.21.15.7:33780) 2024-09-21T06:45:02.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.117+0000 7fa2967fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56012bc6d390 0x56012c040ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.7:59540/0 (socket says 172.21.15.7:59540) 2024-09-21T06:45:02.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.117+0000 7fa296ffd640 1 -- 172.21.15.7:0/1654469555 learned_addr learned my addr 172.21.15.7:0/1654469555 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:02.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.117+0000 7fa2977fe640 1 --2- 172.21.15.7:0/1654469555 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56012bc8e070 0x56012c04cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:02.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.118+0000 7fa296ffd640 1 -- 172.21.15.7:0/1654469555 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56012bc8e070 msgr2=0x56012c04cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:02.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.118+0000 7fa296ffd640 1 --2- 172.21.15.7:0/1654469555 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56012bc8e070 0x56012c04cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:02.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.118+0000 7fa296ffd640 1 -- 172.21.15.7:0/1654469555 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56012bc6d390 msgr2=0x56012c040ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:02.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.118+0000 7fa296ffd640 1 --2- 172.21.15.7:0/1654469555 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56012bc6d390 0x56012c040ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:02.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.118+0000 7fa296ffd640 1 -- 172.21.15.7:0/1654469555 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56012bf63c90 con 0x56012bc651b0 2024-09-21T06:45:02.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.118+0000 7fa2967fc640 1 --2- 172.21.15.7:0/1654469555 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56012bc6d390 0x56012c040ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:45:02.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.118+0000 7fa296ffd640 1 --2- 172.21.15.7:0/1654469555 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56012bc651b0 0x56012c040980 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fa2880aa3e0 tx=0x7fa2880acf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38fa0dc86d565333 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:02.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.118+0000 7fa276ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:45:02.127 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.118+0000 7fa276ffd640 1 -- 172.21.15.7:0/1654469555 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa288020070 con 0x56012bc651b0 2024-09-21T06:45:02.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.118+0000 7fa276ffd640 1 -- 172.21.15.7:0/1654469555 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8412+0+0 (secure 0 0 0) 0x7fa2880abe40 con 0x56012bc651b0 2024-09-21T06:45:02.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.118+0000 7fa2a3df5740 1 -- 172.21.15.7:0/1654469555 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa28c0043d0 con 0x56012bc651b0 2024-09-21T06:45:02.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.118+0000 7fa276ffd640 1 -- 172.21.15.7:0/1654469555 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa2880ac8e0 con 0x56012bc651b0 2024-09-21T06:45:02.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.118+0000 7fa2a3df5740 10 client.17328 fetch_fsmap learned FSMap version 25 2024-09-21T06:45:02.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.118+0000 7fa2a3df5740 1 -- 172.21.15.7:0/1654469555 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56012c04f720 con 0x56012bc651b0 2024-09-21T06:45:02.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.119+0000 7fa276ffd640 1 -- 172.21.15.7:0/1654469555 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa28c0043d0 con 0x56012bc651b0 2024-09-21T06:45:02.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.119+0000 7fa276ffd640 1 -- 172.21.15.7:0/1654469555 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa2880ac040 con 0x56012bc651b0 2024-09-21T06:45:02.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.119+0000 7fa2a3df5740 10 client.17328 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:45:02.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.119+0000 7fa2a3df5740 10 client.17328 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-21T06:45:02.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.119+0000 7fa2a3df5740 20 client.17328 populate_metadata read hostname 'smithi007' 2024-09-21T06:45:02.128 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.119+0000 7fa2a3df5740 1 --2- 172.21.15.7:0/1654469555 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x56012bc4c9f0 0x56012c052ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:02.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.119+0000 7fa2a3df5740 4 client.17328 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:45:02.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.119+0000 7fa2a3df5740 1 -- 172.21.15.7:0/1654469555 --> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56012bfaddf0 con 0x56012bc4c9f0 2024-09-21T06:45:02.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.119+0000 7fa2967fc640 1 --2- 172.21.15.7:0/1654469555 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x56012bc4c9f0 0x56012c052ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:02.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.120+0000 7fa276ffd640 10 client.17328 ms_handle_connect on v2:172.21.15.18:6836/1539670694 2024-09-21T06:45:02.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.120+0000 7fa2967fc640 1 --2- 172.21.15.7:0/1654469555 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x56012bc4c9f0 0x56012c052ba0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=bf42267222ce85f9 server_cookie=43278903a48bb0fe in_seq=0 out_seq=0 2024-09-21T06:45:02.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.120+0000 7fa276ffd640 1 -- 172.21.15.7:0/1654469555 <== mds.2 v2:172.21.15.18:6836/1539670694 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56012bfaddf0 con 0x56012bc4c9f0 2024-09-21T06:45:02.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.120+0000 7fa276ffd640 10 client.17328 handle_command_reply: tid=0 2024-09-21T06:45:02.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.120+0000 7fa2a3df5740 1 client.17328 shutdown 2024-09-21T06:45:02.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.121+0000 7fa2a3df5740 1 -- 172.21.15.7:0/1654469555 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56012bc651b0 msgr2=0x56012c040980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:02.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.121+0000 7fa2a3df5740 1 --2- 172.21.15.7:0/1654469555 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56012bc651b0 0x56012c040980 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fa2880aa3e0 tx=0x7fa2880acf40 comp rx=0 tx=0).stop 2024-09-21T06:45:02.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.121+0000 7fa2a3df5740 1 -- 172.21.15.7:0/1654469555 shutdown_connections 2024-09-21T06:45:02.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.121+0000 7fa2a3df5740 1 --2- 172.21.15.7:0/1654469555 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x56012bc4c9f0 0x56012c052ba0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:02.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.121+0000 7fa276ffd640 0 client.17328 ms_handle_reset on v2:172.21.15.18:6836/1539670694 2024-09-21T06:45:02.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.121+0000 7fa2a3df5740 1 --2- 172.21.15.7:0/1654469555 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56012bc8e070 0x56012c04cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:02.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.121+0000 7fa2a3df5740 1 --2- 172.21.15.7:0/1654469555 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56012bc6d390 0x56012c040ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:02.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.121+0000 7fa2a3df5740 1 --2- 172.21.15.7:0/1654469555 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56012bc651b0 0x56012c040980 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:02.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.121+0000 7fa2a3df5740 1 -- 172.21.15.7:0/1654469555 >> 172.21.15.7:0/1654469555 conn(0x56012bc82460 msgr2=0x56012c038450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:02.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.121+0000 7fa2a3df5740 1 -- 172.21.15.7:0/1654469555 shutdown_connections 2024-09-21T06:45:02.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.121+0000 7fa2a3df5740 1 -- 172.21.15.7:0/1654469555 wait complete. 2024-09-21T06:45:02.130 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.121+0000 7fa2a3df5740 20 client.17328 trim_cache size 0 max 16384 2024-09-21T06:45:02.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.134+0000 7fa2a3df5740 1 Processor -- start 2024-09-21T06:45:02.136 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.134+0000 7fa2a3df5740 1 -- start start 2024-09-21T06:45:02.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.134+0000 7fa2a3df5740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56012bc4c9f0 0x56012c041ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:02.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.134+0000 7fa2a3df5740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56012bc651b0 0x56012c032760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:02.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.135+0000 7fa2a3df5740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56012bc6d390 0x56012c032ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:02.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.135+0000 7fa2a3df5740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa2981b1dd0 con 0x56012bc6d390 2024-09-21T06:45:02.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.135+0000 7fa2a3df5740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa2981af6a0 con 0x56012bc4c9f0 2024-09-21T06:45:02.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.135+0000 7fa2a3df5740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa2981ad510 con 0x56012bc651b0 2024-09-21T06:45:02.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.135+0000 7fa2977fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56012bc6d390 0x56012c032ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:02.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.135+0000 7fa296ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56012bc4c9f0 0x56012c041ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:02.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.135+0000 7fa2977fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56012bc6d390 0x56012c032ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33794/0 (socket says 172.21.15.7:33794) 2024-09-21T06:45:02.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.135+0000 7fa2977fe640 1 -- 172.21.15.7:0/3557172674 learned_addr learned my addr 172.21.15.7:0/3557172674 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:02.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.135+0000 7fa2967fc640 1 --2- 172.21.15.7:0/3557172674 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56012bc651b0 0x56012c032760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:02.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.135+0000 7fa2977fe640 1 -- 172.21.15.7:0/3557172674 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56012bc651b0 msgr2=0x56012c032760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:02.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.135+0000 7fa2977fe640 1 --2- 172.21.15.7:0/3557172674 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56012bc651b0 0x56012c032760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:02.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.135+0000 7fa2977fe640 1 -- 172.21.15.7:0/3557172674 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56012bc4c9f0 msgr2=0x56012c041ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:02.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.135+0000 7fa2977fe640 1 --2- 172.21.15.7:0/3557172674 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56012bc4c9f0 0x56012c041ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:02.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.135+0000 7fa2977fe640 1 -- 172.21.15.7:0/3557172674 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56012c042d50 con 0x56012bc6d390 2024-09-21T06:45:02.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.135+0000 7fa296ffd640 1 --2- 172.21.15.7:0/3557172674 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56012bc4c9f0 0x56012c041ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:45:02.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.135+0000 7fa2977fe640 1 --2- 172.21.15.7:0/3557172674 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56012bc6d390 0x56012c032ca0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fa290009ca0 tx=0x7fa290044000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d81f480a7b02737 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:02.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.136+0000 7fa27d7fa640 1 -- 172.21.15.7:0/3557172674 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa290003af0 con 0x56012bc6d390 2024-09-21T06:45:02.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.136+0000 7fa27d7fa640 1 -- 172.21.15.7:0/3557172674 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa290036050 con 0x56012bc6d390 2024-09-21T06:45:02.139 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.136+0000 7fa27d7fa640 1 -- 172.21.15.7:0/3557172674 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa29002f8c0 con 0x56012bc6d390 2024-09-21T06:45:02.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.136+0000 7fa2a3df5740 1 -- 172.21.15.7:0/3557172674 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56012bc6d390 msgr2=0x56012c032ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:02.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.136+0000 7fa2a3df5740 1 --2- 172.21.15.7:0/3557172674 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56012bc6d390 0x56012c032ca0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fa290009ca0 tx=0x7fa290044000 comp rx=0 tx=0).stop 2024-09-21T06:45:02.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.137+0000 7fa2a3df5740 1 -- 172.21.15.7:0/3557172674 shutdown_connections 2024-09-21T06:45:02.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.137+0000 7fa2a3df5740 1 --2- 172.21.15.7:0/3557172674 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56012bc6d390 0x56012c032ca0 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:02.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.137+0000 7fa2a3df5740 1 --2- 172.21.15.7:0/3557172674 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56012bc651b0 0x56012c032760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:02.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.137+0000 7fa2a3df5740 1 --2- 172.21.15.7:0/3557172674 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56012bc4c9f0 0x56012c041ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:02.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.137+0000 7fa2a3df5740 1 -- 172.21.15.7:0/3557172674 >> 172.21.15.7:0/3557172674 conn(0x56012bc82460 msgr2=0x56012c036cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:02.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.137+0000 7fa2a3df5740 1 -- 172.21.15.7:0/3557172674 shutdown_connections 2024-09-21T06:45:02.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.137+0000 7fa2a3df5740 1 -- 172.21.15.7:0/3557172674 wait complete. 2024-09-21T06:45:02.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.137+0000 7fa2a3df5740 1 -- start start 2024-09-21T06:45:02.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.137+0000 7fa2a3df5740 1 Processor -- start 2024-09-21T06:45:02.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.138+0000 7fa2a3df5740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56012bc4c9f0 0x56012c045650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:02.143 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.138+0000 7fa2a3df5740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56012bc651b0 0x56012c045c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:02.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.138+0000 7fa2a3df5740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56012bc6d390 0x56012c0b6530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:02.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.138+0000 7fa2a3df5740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa2981adb60 con 0x56012bc4c9f0 2024-09-21T06:45:02.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.138+0000 7fa2a3df5740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa2981aefd0 con 0x56012bc651b0 2024-09-21T06:45:02.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.138+0000 7fa2a3df5740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa2981ae230 con 0x56012bc6d390 2024-09-21T06:45:02.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.138+0000 7fa2a3df5740 10 client.0 _ll_register_callbacks cb 0x7fa28800df40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:02.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.138+0000 7fa296ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56012bc4c9f0 0x56012c045650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:02.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.138+0000 7fa296ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56012bc4c9f0 0x56012c045650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33802/0 (socket says 172.21.15.7:33802) 2024-09-21T06:45:02.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.138+0000 7fa296ffd640 1 -- 172.21.15.7:0/278054788 learned_addr learned my addr 172.21.15.7:0/278054788 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:02.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.138+0000 7fa2967fc640 1 --2- 172.21.15.7:0/278054788 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56012bc651b0 0x56012c045c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:02.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.138+0000 7fa2977fe640 1 --2- 172.21.15.7:0/278054788 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56012bc6d390 0x56012c0b6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:02.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.138+0000 7fa296ffd640 1 -- 172.21.15.7:0/278054788 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56012bc6d390 msgr2=0x56012c0b6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:02.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.138+0000 7fa296ffd640 1 --2- 172.21.15.7:0/278054788 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56012bc6d390 0x56012c0b6530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:02.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.138+0000 7fa296ffd640 1 -- 172.21.15.7:0/278054788 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56012bc651b0 msgr2=0x56012c045c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:02.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.138+0000 7fa296ffd640 1 --2- 172.21.15.7:0/278054788 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56012bc651b0 0x56012c045c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:02.144 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.138+0000 7fa296ffd640 1 -- 172.21.15.7:0/278054788 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56012c0b6ba0 con 0x56012bc4c9f0 2024-09-21T06:45:02.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.138+0000 7fa2967fc640 1 --2- 172.21.15.7:0/278054788 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56012bc651b0 0x56012c045c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:45:02.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.138+0000 7fa296ffd640 1 --2- 172.21.15.7:0/278054788 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56012bc4c9f0 0x56012c045650 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fa2880a9740 tx=0x7fa2880a98f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23529bd0fb9da4f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:02.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.138+0000 7fa276ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:45:02.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.139+0000 7fa276ffd640 1 -- 172.21.15.7:0/278054788 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa288020040 con 0x56012bc4c9f0 2024-09-21T06:45:02.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.139+0000 7fa276ffd640 1 -- 172.21.15.7:0/278054788 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8412+0+0 (secure 0 0 0) 0x7fa2880b2d30 con 0x56012bc4c9f0 2024-09-21T06:45:02.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.139+0000 7fa2a3df5740 1 -- 172.21.15.7:0/278054788 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa290036050 con 0x56012bc4c9f0 2024-09-21T06:45:02.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.139+0000 7fa276ffd640 1 -- 172.21.15.7:0/278054788 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa2880acc80 con 0x56012bc4c9f0 2024-09-21T06:45:02.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.139+0000 7fa2a3df5740 10 client.17334 fetch_fsmap learned FSMap version 25 2024-09-21T06:45:02.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.139+0000 7fa2a3df5740 1 -- 172.21.15.7:0/278054788 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56012c0bdf70 con 0x56012bc4c9f0 2024-09-21T06:45:02.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.139+0000 7fa276ffd640 1 -- 172.21.15.7:0/278054788 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa290036050 con 0x56012bc4c9f0 2024-09-21T06:45:02.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.139+0000 7fa276ffd640 1 -- 172.21.15.7:0/278054788 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa2880d0a40 con 0x56012bc4c9f0 2024-09-21T06:45:02.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.139+0000 7fa2a3df5740 10 client.17334 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:45:02.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.139+0000 7fa2a3df5740 10 client.17334 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-21T06:45:02.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.139+0000 7fa2a3df5740 20 client.17334 populate_metadata read hostname 'smithi007' 2024-09-21T06:45:02.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.139+0000 7fa2a3df5740 1 --2- 172.21.15.7:0/278054788 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x56012bc8e070 0x56012c0c07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:02.145 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.139+0000 7fa2a3df5740 4 client.17334 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:45:02.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.139+0000 7fa2a3df5740 1 -- 172.21.15.7:0/278054788 --> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56012bfa98a0 con 0x56012bc8e070 2024-09-21T06:45:02.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.140+0000 7fa2967fc640 1 --2- 172.21.15.7:0/278054788 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x56012bc8e070 0x56012c0c07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:02.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.140+0000 7fa276ffd640 10 client.17334 ms_handle_connect on v2:172.21.15.18:6836/1539670694 2024-09-21T06:45:02.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.140+0000 7fa2967fc640 1 --2- 172.21.15.7:0/278054788 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x56012bc8e070 0x56012c0c07b0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=46c7228d5c3f72f4 server_cookie=723f5b9f7234d80a in_seq=0 out_seq=0 2024-09-21T06:45:02.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.140+0000 7fa276ffd640 1 -- 172.21.15.7:0/278054788 <== mds.2 v2:172.21.15.18:6836/1539670694 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56012bfa98a0 con 0x56012bc8e070 2024-09-21T06:45:02.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.140+0000 7fa276ffd640 10 client.17334 handle_command_reply: tid=0 2024-09-21T06:45:02.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.140+0000 7fa2a3df5740 1 client.17334 shutdown 2024-09-21T06:45:02.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.140+0000 7fa2a3df5740 1 -- 172.21.15.7:0/278054788 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56012bc4c9f0 msgr2=0x56012c045650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:02.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.141+0000 7fa2a3df5740 1 --2- 172.21.15.7:0/278054788 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56012bc4c9f0 0x56012c045650 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fa2880a9740 tx=0x7fa2880a98f0 comp rx=0 tx=0).stop 2024-09-21T06:45:02.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.141+0000 7fa2a3df5740 1 -- 172.21.15.7:0/278054788 shutdown_connections 2024-09-21T06:45:02.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.141+0000 7fa2a3df5740 1 --2- 172.21.15.7:0/278054788 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x56012bc8e070 0x56012c0c07b0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:02.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.141+0000 7fa2a3df5740 1 --2- 172.21.15.7:0/278054788 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56012bc6d390 0x56012c0b6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:02.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.141+0000 7fa2a3df5740 1 --2- 172.21.15.7:0/278054788 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56012bc651b0 0x56012c045c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:02.146 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.141+0000 7fa2a3df5740 1 --2- 172.21.15.7:0/278054788 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56012bc4c9f0 0x56012c045650 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:02.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.141+0000 7fa2a3df5740 1 -- 172.21.15.7:0/278054788 >> 172.21.15.7:0/278054788 conn(0x56012bc82460 msgr2=0x56012c03a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:02.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.141+0000 7fa276ffd640 0 client.17334 ms_handle_reset on v2:172.21.15.18:6836/1539670694 2024-09-21T06:45:02.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.141+0000 7fa2a3df5740 1 -- 172.21.15.7:0/278054788 shutdown_connections 2024-09-21T06:45:02.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.141+0000 7fa2a3df5740 1 -- 172.21.15.7:0/278054788 wait complete. 2024-09-21T06:45:02.147 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.141+0000 7fa2a3df5740 20 client.17334 trim_cache size 0 max 16384 2024-09-21T06:45:02.147 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:45:02.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.141+0000 7fa29d881640 1 -- 172.21.15.7:0/3303829646 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa2800b6700 msgr2=0x7fa2800b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:02.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.141+0000 7fa29d881640 1 --2- 172.21.15.7:0/3303829646 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa2800b6700 0x7fa2800b8c10 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fa29002f500 tx=0x7fa29002f310 comp rx=0 tx=0).stop 2024-09-21T06:45:02.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.141+0000 7fa29d881640 1 -- 172.21.15.7:0/3303829646 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa298103b80 msgr2=0x7fa29819a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:02.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.141+0000 7fa29d881640 1 --2- 172.21.15.7:0/3303829646 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa298103b80 0x7fa29819a440 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7fa28800d950 tx=0x7fa28800de10 comp rx=0 tx=0).stop 2024-09-21T06:45:02.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.141+0000 7fa29d881640 1 -- 172.21.15.7:0/3303829646 shutdown_connections 2024-09-21T06:45:02.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.141+0000 7fa29d881640 1 --2- 172.21.15.7:0/3303829646 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa2800b6700 0x7fa2800b8c10 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:02.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.141+0000 7fa29d881640 1 --2- 172.21.15.7:0/3303829646 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa298109e10 0x7fa29819fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:02.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.141+0000 7fa29d881640 1 --2- 172.21.15.7:0/3303829646 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2981094c0 0x7fa29819a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:02.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.141+0000 7fa29d881640 1 --2- 172.21.15.7:0/3303829646 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa298103b80 0x7fa29819a440 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:02.148 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.141+0000 7fa29d881640 1 -- 172.21.15.7:0/3303829646 >> 172.21.15.7:0/3303829646 conn(0x7fa2980ff590 msgr2=0x7fa2981029a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:02.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.142+0000 7fa29d881640 1 -- 172.21.15.7:0/3303829646 shutdown_connections 2024-09-21T06:45:02.149 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:02.142+0000 7fa29d881640 1 -- 172.21.15.7:0/3303829646 wait complete. 2024-09-21T06:45:02.758 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:45:02 smithi007 ceph-mon[30983]: pgmap v588: 97 pgs: 97 active+clean; 3.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-21T06:45:02.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:45:02 smithi144 ceph-mon[34653]: pgmap v588: 97 pgs: 97 active+clean; 3.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-21T06:45:02.794 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:45:02.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:45:02 smithi018 ceph-mon[34477]: pgmap v588: 97 pgs: 97 active+clean; 3.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-21T06:45:03.055 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:45:03.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.544+0000 7fee08ed5640 1 -- 172.21.15.7:0/1753287024 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee04103b60 msgr2=0x7fee04103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:03.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.544+0000 7fee08ed5640 1 --2- 172.21.15.7:0/1753287024 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee04103b60 0x7fee04103f70 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fedf4009ca0 tx=0x7fedf402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:45:03.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.544+0000 7fee08ed5640 1 -- 172.21.15.7:0/1753287024 shutdown_connections 2024-09-21T06:45:03.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.544+0000 7fee08ed5640 1 --2- 172.21.15.7:0/1753287024 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee04109df0 0x7fee04110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:03.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.544+0000 7fee08ed5640 1 --2- 172.21.15.7:0/1753287024 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee041094a0 0x7fee041098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:03.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.544+0000 7fee08ed5640 1 --2- 172.21.15.7:0/1753287024 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee04103b60 0x7fee04103f70 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:03.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.544+0000 7fee08ed5640 1 -- 172.21.15.7:0/1753287024 >> 172.21.15.7:0/1753287024 conn(0x7fee0407b850 msgr2=0x7fee0407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:03.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.544+0000 7fee08ed5640 1 -- 172.21.15.7:0/1753287024 shutdown_connections 2024-09-21T06:45:03.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.544+0000 7fee08ed5640 1 -- 172.21.15.7:0/1753287024 wait complete. 2024-09-21T06:45:03.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.545+0000 7fee08ed5640 1 Processor -- start 2024-09-21T06:45:03.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.545+0000 7fee08ed5640 1 -- start start 2024-09-21T06:45:03.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.545+0000 7fee08ed5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee04103b60 0x7fee0419a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:03.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.546+0000 7fee08ed5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee041094a0 0x7fee0419aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:03.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.546+0000 7fee08ed5640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee04109df0 0x7fee0419fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:03.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.546+0000 7fee08ed5640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fee04113ab0 con 0x7fee041094a0 2024-09-21T06:45:03.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.546+0000 7fee08ed5640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fee04113930 con 0x7fee04103b60 2024-09-21T06:45:03.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.546+0000 7fee08ed5640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fee04113c30 con 0x7fee04109df0 2024-09-21T06:45:03.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.546+0000 7fee01d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee041094a0 0x7fee0419aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:03.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.546+0000 7fee01d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee041094a0 0x7fee0419aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33812/0 (socket says 172.21.15.7:33812) 2024-09-21T06:45:03.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.546+0000 7fee01d9b640 1 -- 172.21.15.7:0/2343798972 learned_addr learned my addr 172.21.15.7:0/2343798972 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:03.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.546+0000 7fee0259c640 1 --2- 172.21.15.7:0/2343798972 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee04103b60 0x7fee0419a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:03.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.546+0000 7fee02d9d640 1 --2- 172.21.15.7:0/2343798972 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee04109df0 0x7fee0419fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:03.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.546+0000 7fee01d9b640 1 -- 172.21.15.7:0/2343798972 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee04109df0 msgr2=0x7fee0419fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:03.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.546+0000 7fee01d9b640 1 --2- 172.21.15.7:0/2343798972 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee04109df0 0x7fee0419fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:03.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.546+0000 7fee01d9b640 1 -- 172.21.15.7:0/2343798972 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee04103b60 msgr2=0x7fee0419a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:03.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.546+0000 7fee01d9b640 1 --2- 172.21.15.7:0/2343798972 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee04103b60 0x7fee0419a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:03.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.546+0000 7fee01d9b640 1 -- 172.21.15.7:0/2343798972 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee041a03d0 con 0x7fee041094a0 2024-09-21T06:45:03.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.546+0000 7fee01d9b640 1 --2- 172.21.15.7:0/2343798972 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee041094a0 0x7fee0419aac0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fedf800d750 tx=0x7fedf800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:03.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.546+0000 7fedf37fe640 1 -- 172.21.15.7:0/2343798972 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedf8017070 con 0x7fee041094a0 2024-09-21T06:45:03.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.547+0000 7fedf37fe640 1 -- 172.21.15.7:0/2343798972 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fedf80054d0 con 0x7fee041094a0 2024-09-21T06:45:03.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.547+0000 7fee08ed5640 1 -- 172.21.15.7:0/2343798972 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee041a06c0 con 0x7fee041094a0 2024-09-21T06:45:03.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.547+0000 7fedf37fe640 1 -- 172.21.15.7:0/2343798972 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedf8004c30 con 0x7fee041094a0 2024-09-21T06:45:03.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.547+0000 7fee08ed5640 1 -- 172.21.15.7:0/2343798972 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee041a6ee0 con 0x7fee041094a0 2024-09-21T06:45:03.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.549+0000 7fee0f449740 1 Processor -- start 2024-09-21T06:45:03.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.549+0000 7fee0f449740 1 -- start start 2024-09-21T06:45:03.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.550+0000 7fee0f449740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc0f841070 0x55cc0fbe86a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:03.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.550+0000 7fee0f449740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc0f8181b0 0x55cc0fbe8be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:03.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.550+0000 7fee0f449740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc0f820390 0x55cc0fbe9120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:03.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.550+0000 7fee0f449740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55cc0fb5eea0 con 0x55cc0f8181b0 2024-09-21T06:45:03.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.550+0000 7fee0f449740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55cc0fb4e2d0 con 0x55cc0f841070 2024-09-21T06:45:03.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.550+0000 7fee0f449740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55cc0fb520e0 con 0x55cc0f820390 2024-09-21T06:45:03.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.550+0000 7fedf37fe640 1 -- 172.21.15.7:0/2343798972 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7fedf8010460 con 0x7fee041094a0 2024-09-21T06:45:03.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.550+0000 7fee0259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc0f8181b0 0x55cc0fbe8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:03.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.550+0000 7fee0259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc0f8181b0 0x55cc0fbe8be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33828/0 (socket says 172.21.15.7:33828) 2024-09-21T06:45:03.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.550+0000 7fee0259c640 1 -- 172.21.15.7:0/1244939101 learned_addr learned my addr 172.21.15.7:0/1244939101 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:03.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.550+0000 7fee01d9b640 1 --2- 172.21.15.7:0/1244939101 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc0f820390 0x55cc0fbe9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:03.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.550+0000 7fee02d9d640 1 --2- 172.21.15.7:0/1244939101 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc0f841070 0x55cc0fbe86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:03.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.550+0000 7fee0259c640 1 -- 172.21.15.7:0/1244939101 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc0f820390 msgr2=0x55cc0fbe9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:03.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.550+0000 7fee0259c640 1 --2- 172.21.15.7:0/1244939101 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc0f820390 0x55cc0fbe9120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:03.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.550+0000 7fee0259c640 1 -- 172.21.15.7:0/1244939101 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc0f841070 msgr2=0x55cc0fbe86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:03.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.550+0000 7fee0259c640 1 --2- 172.21.15.7:0/1244939101 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc0f841070 0x55cc0fbe86a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:03.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.550+0000 7fee0259c640 1 -- 172.21.15.7:0/1244939101 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc0f8ac650 con 0x55cc0f8181b0 2024-09-21T06:45:03.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.550+0000 7fee0259c640 1 --2- 172.21.15.7:0/1244939101 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc0f8181b0 0x55cc0fbe8be0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7fedf4035000 tx=0x7fedf4009940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27a24e2882e9fd29 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:03.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.551+0000 7fedf0ff9640 1 -- 172.21.15.7:0/1244939101 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedf4031450 con 0x55cc0f8181b0 2024-09-21T06:45:03.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.551+0000 7fedf0ff9640 1 -- 172.21.15.7:0/1244939101 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fedf4036030 con 0x55cc0f8181b0 2024-09-21T06:45:03.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.551+0000 7fedf0ff9640 1 -- 172.21.15.7:0/1244939101 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedf4004380 con 0x55cc0f8181b0 2024-09-21T06:45:03.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.551+0000 7fedf37fe640 1 --2- 172.21.15.7:0/2343798972 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fedec0b66b0 0x7fedec0b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:03.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.551+0000 7fee02d9d640 1 --2- 172.21.15.7:0/2343798972 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fedec0b66b0 0x7fedec0b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:03.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.551+0000 7fedf37fe640 1 -- 172.21.15.7:0/2343798972 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8412+0+0 (secure 0 0 0) 0x7fedf80e70b0 con 0x7fee041094a0 2024-09-21T06:45:03.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.552+0000 7fee0f449740 1 -- 172.21.15.7:0/1244939101 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc0f8181b0 msgr2=0x55cc0fbe8be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:03.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.552+0000 7fee02d9d640 1 --2- 172.21.15.7:0/2343798972 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fedec0b66b0 0x7fedec0b8bc0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fedfc0045d0 tx=0x7fedfc005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:03.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.552+0000 7fee0f449740 1 --2- 172.21.15.7:0/1244939101 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc0f8181b0 0x55cc0fbe8be0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7fedf4035000 tx=0x7fedf4009940 comp rx=0 tx=0).stop 2024-09-21T06:45:03.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.552+0000 7fee0f449740 1 -- 172.21.15.7:0/1244939101 shutdown_connections 2024-09-21T06:45:03.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.552+0000 7fee0f449740 1 --2- 172.21.15.7:0/1244939101 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc0f820390 0x55cc0fbe9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:03.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.552+0000 7fee0f449740 1 --2- 172.21.15.7:0/1244939101 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc0f8181b0 0x55cc0fbe8be0 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:03.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.552+0000 7fee0f449740 1 --2- 172.21.15.7:0/1244939101 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc0f841070 0x55cc0fbe86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:03.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.552+0000 7fee0f449740 1 -- 172.21.15.7:0/1244939101 >> 172.21.15.7:0/1244939101 conn(0x55cc0f835460 msgr2=0x55cc0fbe6590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:03.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.552+0000 7fee0f449740 1 -- 172.21.15.7:0/1244939101 shutdown_connections 2024-09-21T06:45:03.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.552+0000 7fee0f449740 1 -- 172.21.15.7:0/1244939101 wait complete. 2024-09-21T06:45:03.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.552+0000 7fee0f449740 1 -- start start 2024-09-21T06:45:03.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.553+0000 7fee0f449740 1 Processor -- start 2024-09-21T06:45:03.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.553+0000 7fee0f449740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc0f8181b0 0x55cc0fbf3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:03.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.553+0000 7fee0f449740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc0f820390 0x55cc0fbf4280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:03.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.553+0000 7fee0f449740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc0f841070 0x55cc0fbf4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:03.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.553+0000 7fee0f449740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55cc0f9af700 con 0x55cc0f841070 2024-09-21T06:45:03.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.553+0000 7fee0f449740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55cc0fae9160 con 0x55cc0f820390 2024-09-21T06:45:03.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.553+0000 7fee0f449740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55cc0fbf6ca0 con 0x55cc0f8181b0 2024-09-21T06:45:03.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.553+0000 7fee0f449740 10 client.0 _ll_register_callbacks cb 0x55cc0fb029e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:03.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.553+0000 7fee02d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc0f841070 0x55cc0fbf4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:03.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.553+0000 7fee02d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc0f841070 0x55cc0fbf4800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33834/0 (socket says 172.21.15.7:33834) 2024-09-21T06:45:03.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.553+0000 7fee02d9d640 1 -- 172.21.15.7:0/408494731 learned_addr learned my addr 172.21.15.7:0/408494731 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:03.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.553+0000 7fee01d9b640 1 --2- 172.21.15.7:0/408494731 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc0f820390 0x55cc0fbf4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:03.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.553+0000 7fee0259c640 1 --2- 172.21.15.7:0/408494731 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc0f8181b0 0x55cc0fbf3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:03.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.553+0000 7fee02d9d640 1 -- 172.21.15.7:0/408494731 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc0f8181b0 msgr2=0x55cc0fbf3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:03.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.553+0000 7fee02d9d640 1 --2- 172.21.15.7:0/408494731 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc0f8181b0 0x55cc0fbf3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:03.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.553+0000 7fee02d9d640 1 -- 172.21.15.7:0/408494731 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc0f820390 msgr2=0x55cc0fbf4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:03.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.553+0000 7fee02d9d640 1 --2- 172.21.15.7:0/408494731 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc0f820390 0x55cc0fbf4280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:03.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.553+0000 7fee02d9d640 1 -- 172.21.15.7:0/408494731 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc0fb16c90 con 0x55cc0f841070 2024-09-21T06:45:03.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.554+0000 7fee02d9d640 1 --2- 172.21.15.7:0/408494731 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc0f841070 0x55cc0fbf4800 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fedfc0043b0 tx=0x7fedfc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f08838f33ca9298 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:03.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.554+0000 7fede9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:45:03.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.554+0000 7fede9ffb640 1 -- 172.21.15.7:0/408494731 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedfc029060 con 0x55cc0f841070 2024-09-21T06:45:03.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.554+0000 7fede9ffb640 1 -- 172.21.15.7:0/408494731 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8412+0+0 (secure 0 0 0) 0x7fedfc01c750 con 0x55cc0f841070 2024-09-21T06:45:03.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.554+0000 7fee0f449740 1 -- 172.21.15.7:0/408494731 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fedf4036030 con 0x55cc0f841070 2024-09-21T06:45:03.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.554+0000 7fede9ffb640 1 -- 172.21.15.7:0/408494731 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fedfc01c950 con 0x55cc0f841070 2024-09-21T06:45:03.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.554+0000 7fee0f449740 10 client.17346 fetch_fsmap learned FSMap version 25 2024-09-21T06:45:03.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.554+0000 7fee0f449740 1 -- 172.21.15.7:0/408494731 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55cc0fc029d0 con 0x55cc0f841070 2024-09-21T06:45:03.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.554+0000 7fede9ffb640 1 -- 172.21.15.7:0/408494731 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fedf4036030 con 0x55cc0f841070 2024-09-21T06:45:03.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.555+0000 7fede9ffb640 1 -- 172.21.15.7:0/408494731 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fedfc02c020 con 0x55cc0f841070 2024-09-21T06:45:03.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.555+0000 7fee0f449740 10 client.17346 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:45:03.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.555+0000 7fee0f449740 10 client.17346 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:45:03.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.555+0000 7fee0f449740 20 client.17346 populate_metadata read hostname 'smithi007' 2024-09-21T06:45:03.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.555+0000 7fee0f449740 1 --2- 172.21.15.7:0/408494731 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x55cc0f7ff9f0 0x55cc0fc05f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:03.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.555+0000 7fee0f449740 4 client.17346 mds_command: new command op to 24688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:45:03.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.555+0000 7fee0f449740 1 -- 172.21.15.7:0/408494731 --> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cc0fb60df0 con 0x55cc0f7ff9f0 2024-09-21T06:45:03.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.555+0000 7fee0259c640 1 --2- 172.21.15.7:0/408494731 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x55cc0f7ff9f0 0x55cc0fc05f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:03.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.556+0000 7fee0259c640 1 --2- 172.21.15.7:0/408494731 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x55cc0f7ff9f0 0x55cc0fc05f20 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=32b53d5c66cac98d server_cookie=cc2119087163f7d5 in_seq=0 out_seq=0 2024-09-21T06:45:03.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.556+0000 7fede9ffb640 10 client.17346 ms_handle_connect on v2:172.21.15.144:6838/4027821922 2024-09-21T06:45:03.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.556+0000 7fede9ffb640 1 -- 172.21.15.7:0/408494731 <== mds.1 v2:172.21.15.144:6838/4027821922 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cc0fb60df0 con 0x55cc0f7ff9f0 2024-09-21T06:45:03.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.556+0000 7fede9ffb640 10 client.17346 handle_command_reply: tid=0 2024-09-21T06:45:03.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.556+0000 7fee0f449740 1 client.17346 shutdown 2024-09-21T06:45:03.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.556+0000 7fee0f449740 1 -- 172.21.15.7:0/408494731 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc0f841070 msgr2=0x55cc0fbf4800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:03.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.556+0000 7fee0f449740 1 --2- 172.21.15.7:0/408494731 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc0f841070 0x55cc0fbf4800 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fedfc0043b0 tx=0x7fedfc0046c0 comp rx=0 tx=0).stop 2024-09-21T06:45:03.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.556+0000 7fee0f449740 1 -- 172.21.15.7:0/408494731 shutdown_connections 2024-09-21T06:45:03.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.556+0000 7fee0f449740 1 --2- 172.21.15.7:0/408494731 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x55cc0f7ff9f0 0x55cc0fc05f20 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:03.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.556+0000 7fee0f449740 1 --2- 172.21.15.7:0/408494731 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc0f841070 0x55cc0fbf4800 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:03.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.557+0000 7fee0f449740 1 --2- 172.21.15.7:0/408494731 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc0f820390 0x55cc0fbf4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:03.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.557+0000 7fee0f449740 1 --2- 172.21.15.7:0/408494731 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc0f8181b0 0x55cc0fbf3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:03.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.557+0000 7fede9ffb640 0 client.17346 ms_handle_reset on v2:172.21.15.144:6838/4027821922 2024-09-21T06:45:03.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.557+0000 7fee0f449740 1 -- 172.21.15.7:0/408494731 >> 172.21.15.7:0/408494731 conn(0x55cc0f835460 msgr2=0x55cc0fbeb830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:03.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.557+0000 7fee0f449740 1 -- 172.21.15.7:0/408494731 shutdown_connections 2024-09-21T06:45:03.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.557+0000 7fee0f449740 1 -- 172.21.15.7:0/408494731 wait complete. 2024-09-21T06:45:03.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.557+0000 7fee0f449740 20 client.17346 trim_cache size 0 max 16384 2024-09-21T06:45:03.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.570+0000 7fee0f449740 1 Processor -- start 2024-09-21T06:45:03.572 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.570+0000 7fee0f449740 1 -- start start 2024-09-21T06:45:03.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.570+0000 7fee0f449740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc0f8181b0 0x55cc0fbe9de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:03.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.570+0000 7fee0f449740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc0f820390 0x55cc0fbf0f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:03.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.570+0000 7fee0f449740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc0f841070 0x55cc0fbf1470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:03.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.570+0000 7fee0f449740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fee041b1df0 con 0x55cc0f8181b0 2024-09-21T06:45:03.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.570+0000 7fee0f449740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fee041af6c0 con 0x55cc0f841070 2024-09-21T06:45:03.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.570+0000 7fee0f449740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fee041ad530 con 0x55cc0f820390 2024-09-21T06:45:03.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.571+0000 7fee0259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc0f8181b0 0x55cc0fbe9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:03.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.571+0000 7fee0259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc0f8181b0 0x55cc0fbe9de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33836/0 (socket says 172.21.15.7:33836) 2024-09-21T06:45:03.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.571+0000 7fee0259c640 1 -- 172.21.15.7:0/2788714739 learned_addr learned my addr 172.21.15.7:0/2788714739 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:03.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.571+0000 7fee01d9b640 1 --2- 172.21.15.7:0/2788714739 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc0f820390 0x55cc0fbf0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:03.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.571+0000 7fee02d9d640 1 --2- 172.21.15.7:0/2788714739 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc0f841070 0x55cc0fbf1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:03.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.571+0000 7fee0259c640 1 -- 172.21.15.7:0/2788714739 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc0f820390 msgr2=0x55cc0fbf0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:03.573 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.571+0000 7fee0259c640 1 --2- 172.21.15.7:0/2788714739 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc0f820390 0x55cc0fbf0f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:03.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.571+0000 7fee0259c640 1 -- 172.21.15.7:0/2788714739 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc0f841070 msgr2=0x55cc0fbf1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:03.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.571+0000 7fee0259c640 1 --2- 172.21.15.7:0/2788714739 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc0f841070 0x55cc0fbf1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:03.574 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.571+0000 7fee0259c640 1 -- 172.21.15.7:0/2788714739 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc0fbf6480 con 0x55cc0f8181b0 2024-09-21T06:45:03.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.571+0000 7fee0259c640 1 --2- 172.21.15.7:0/2788714739 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc0f8181b0 0x55cc0fbe9de0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7fedf4009a60 tx=0x7fedf4003ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b44641540fd00df server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:03.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.571+0000 7fedebfff640 1 -- 172.21.15.7:0/2788714739 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedf405e070 con 0x55cc0f8181b0 2024-09-21T06:45:03.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.571+0000 7fedebfff640 1 -- 172.21.15.7:0/2788714739 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fedf4055070 con 0x55cc0f8181b0 2024-09-21T06:45:03.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.571+0000 7fedebfff640 1 -- 172.21.15.7:0/2788714739 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedf40044c0 con 0x55cc0f8181b0 2024-09-21T06:45:03.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.572+0000 7fee0f449740 1 -- 172.21.15.7:0/2788714739 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc0f8181b0 msgr2=0x55cc0fbe9de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:03.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.572+0000 7fee0f449740 1 --2- 172.21.15.7:0/2788714739 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc0f8181b0 0x55cc0fbe9de0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7fedf4009a60 tx=0x7fedf4003ee0 comp rx=0 tx=0).stop 2024-09-21T06:45:03.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.572+0000 7fee0f449740 1 -- 172.21.15.7:0/2788714739 shutdown_connections 2024-09-21T06:45:03.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.572+0000 7fee0f449740 1 --2- 172.21.15.7:0/2788714739 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc0f841070 0x55cc0fbf1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:03.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.572+0000 7fee0f449740 1 --2- 172.21.15.7:0/2788714739 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc0f820390 0x55cc0fbf0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:03.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.572+0000 7fee0f449740 1 --2- 172.21.15.7:0/2788714739 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc0f8181b0 0x55cc0fbe9de0 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:03.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.572+0000 7fee0f449740 1 -- 172.21.15.7:0/2788714739 >> 172.21.15.7:0/2788714739 conn(0x55cc0f835460 msgr2=0x55cc0fbe96d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:03.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.572+0000 7fee0f449740 1 -- 172.21.15.7:0/2788714739 shutdown_connections 2024-09-21T06:45:03.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.572+0000 7fee0f449740 1 -- 172.21.15.7:0/2788714739 wait complete. 2024-09-21T06:45:03.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.573+0000 7fee0f449740 1 -- start start 2024-09-21T06:45:03.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.573+0000 7fee0f449740 1 Processor -- start 2024-09-21T06:45:03.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.573+0000 7fee0f449740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc0f8181b0 0x55cc0fbf7f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:03.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.573+0000 7fee0f449740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc0f820390 0x55cc0fbf8460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:03.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.573+0000 7fee0f449740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc0f841070 0x55cc0fbf89a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:03.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.573+0000 7fee0f449740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fee041adb80 con 0x55cc0f8181b0 2024-09-21T06:45:03.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.573+0000 7fee0f449740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fee041aeff0 con 0x55cc0f841070 2024-09-21T06:45:03.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.573+0000 7fee0f449740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fee041ae250 con 0x55cc0f820390 2024-09-21T06:45:03.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.573+0000 7fee0f449740 10 client.0 _ll_register_callbacks cb 0x7fedfc004220 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:03.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.573+0000 7fee0259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc0f8181b0 0x55cc0fbf7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:03.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.573+0000 7fee0259c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc0f8181b0 0x55cc0fbf7f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33852/0 (socket says 172.21.15.7:33852) 2024-09-21T06:45:03.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.573+0000 7fee0259c640 1 -- 172.21.15.7:0/1299908425 learned_addr learned my addr 172.21.15.7:0/1299908425 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:03.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.573+0000 7fee01d9b640 1 --2- 172.21.15.7:0/1299908425 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc0f820390 0x55cc0fbf8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:03.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.573+0000 7fee02d9d640 1 --2- 172.21.15.7:0/1299908425 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc0f841070 0x55cc0fbf89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:03.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.574+0000 7fee0259c640 1 -- 172.21.15.7:0/1299908425 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc0f820390 msgr2=0x55cc0fbf8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:03.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.574+0000 7fee0259c640 1 --2- 172.21.15.7:0/1299908425 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc0f820390 0x55cc0fbf8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:03.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.574+0000 7fee0259c640 1 -- 172.21.15.7:0/1299908425 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc0f841070 msgr2=0x55cc0fbf89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:03.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.574+0000 7fee0259c640 1 --2- 172.21.15.7:0/1299908425 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc0f841070 0x55cc0fbf89a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:03.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.574+0000 7fee0259c640 1 -- 172.21.15.7:0/1299908425 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc0fc6f910 con 0x55cc0f8181b0 2024-09-21T06:45:03.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.574+0000 7fee0259c640 1 --2- 172.21.15.7:0/1299908425 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc0f8181b0 0x55cc0fbf7f20 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7fedf4009dc0 tx=0x7fedf4003f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb387e1a26df2275 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:03.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.574+0000 7fede9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:45:03.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.574+0000 7fede9ffb640 1 -- 172.21.15.7:0/1299908425 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedf405e020 con 0x55cc0f8181b0 2024-09-21T06:45:03.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.574+0000 7fede9ffb640 1 -- 172.21.15.7:0/1299908425 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8412+0+0 (secure 0 0 0) 0x7fedf4031450 con 0x55cc0f8181b0 2024-09-21T06:45:03.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.574+0000 7fee0f449740 1 -- 172.21.15.7:0/1299908425 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fedf4055070 con 0x55cc0f8181b0 2024-09-21T06:45:03.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.574+0000 7fede9ffb640 1 -- 172.21.15.7:0/1299908425 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fedf4069050 con 0x55cc0f8181b0 2024-09-21T06:45:03.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.574+0000 7fee0f449740 10 client.17352 fetch_fsmap learned FSMap version 25 2024-09-21T06:45:03.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.574+0000 7fee0f449740 1 -- 172.21.15.7:0/1299908425 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55cc0fc70b90 con 0x55cc0f8181b0 2024-09-21T06:45:03.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.575+0000 7fede9ffb640 1 -- 172.21.15.7:0/1299908425 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fedf4036050 con 0x55cc0f8181b0 2024-09-21T06:45:03.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.575+0000 7fede9ffb640 1 -- 172.21.15.7:0/1299908425 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fedf4043070 con 0x55cc0f8181b0 2024-09-21T06:45:03.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.575+0000 7fee0f449740 10 client.17352 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:45:03.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.575+0000 7fee0f449740 10 client.17352 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:45:03.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.575+0000 7fee0f449740 20 client.17352 populate_metadata read hostname 'smithi007' 2024-09-21T06:45:03.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.575+0000 7fee0f449740 1 --2- 172.21.15.7:0/1299908425 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x55cc0f7d4da0 0x55cc0fc72fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:03.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.575+0000 7fee0f449740 4 client.17352 mds_command: new command op to 24688 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:45:03.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.575+0000 7fee0f449740 1 -- 172.21.15.7:0/1299908425 --> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7fedf4055070 con 0x55cc0f7d4da0 2024-09-21T06:45:03.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.575+0000 7fee01d9b640 1 --2- 172.21.15.7:0/1299908425 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x55cc0f7d4da0 0x55cc0fc72fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:03.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.576+0000 7fee01d9b640 1 --2- 172.21.15.7:0/1299908425 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x55cc0f7d4da0 0x55cc0fc72fb0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=12dcf43304d504be server_cookie=57c78c327c6dbebc in_seq=0 out_seq=0 2024-09-21T06:45:03.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.576+0000 7fede9ffb640 10 client.17352 ms_handle_connect on v2:172.21.15.144:6838/4027821922 2024-09-21T06:45:03.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.576+0000 7fede9ffb640 1 -- 172.21.15.7:0/1299908425 <== mds.1 v2:172.21.15.144:6838/4027821922 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7fedf4055070 con 0x55cc0f7d4da0 2024-09-21T06:45:03.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.576+0000 7fede9ffb640 10 client.17352 handle_command_reply: tid=0 2024-09-21T06:45:03.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.576+0000 7fee0f449740 1 client.17352 shutdown 2024-09-21T06:45:03.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.576+0000 7fee0f449740 1 -- 172.21.15.7:0/1299908425 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc0f8181b0 msgr2=0x55cc0fbf7f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:03.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.576+0000 7fee0f449740 1 --2- 172.21.15.7:0/1299908425 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc0f8181b0 0x55cc0fbf7f20 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7fedf4009dc0 tx=0x7fedf4003f50 comp rx=0 tx=0).stop 2024-09-21T06:45:03.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.576+0000 7fee0f449740 1 -- 172.21.15.7:0/1299908425 shutdown_connections 2024-09-21T06:45:03.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.576+0000 7fee0f449740 1 --2- 172.21.15.7:0/1299908425 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x55cc0f7d4da0 0x55cc0fc72fb0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:03.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.576+0000 7fee0f449740 1 --2- 172.21.15.7:0/1299908425 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cc0f841070 0x55cc0fbf89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:03.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.576+0000 7fee0f449740 1 --2- 172.21.15.7:0/1299908425 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55cc0f820390 0x55cc0fbf8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:03.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.576+0000 7fee0f449740 1 --2- 172.21.15.7:0/1299908425 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55cc0f8181b0 0x55cc0fbf7f20 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:03.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.576+0000 7fede9ffb640 0 client.17352 ms_handle_reset on v2:172.21.15.144:6838/4027821922 2024-09-21T06:45:03.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.576+0000 7fee0f449740 1 -- 172.21.15.7:0/1299908425 >> 172.21.15.7:0/1299908425 conn(0x55cc0f835460 msgr2=0x55cc0fbfeeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:03.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.576+0000 7fee0f449740 1 -- 172.21.15.7:0/1299908425 shutdown_connections 2024-09-21T06:45:03.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.576+0000 7fee0f449740 1 -- 172.21.15.7:0/1299908425 wait complete. 2024-09-21T06:45:03.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.577+0000 7fee0f449740 20 client.17352 trim_cache size 0 max 16384 2024-09-21T06:45:03.583 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:45:03.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.577+0000 7fee08ed5640 1 -- 172.21.15.7:0/2343798972 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fedec0b66b0 msgr2=0x7fedec0b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:03.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.577+0000 7fee08ed5640 1 --2- 172.21.15.7:0/2343798972 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fedec0b66b0 0x7fedec0b8bc0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fedfc0045d0 tx=0x7fedfc005f90 comp rx=0 tx=0).stop 2024-09-21T06:45:03.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.577+0000 7fee08ed5640 1 -- 172.21.15.7:0/2343798972 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee041094a0 msgr2=0x7fee0419aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:03.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.577+0000 7fee08ed5640 1 --2- 172.21.15.7:0/2343798972 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee041094a0 0x7fee0419aac0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fedf800d750 tx=0x7fedf800dc10 comp rx=0 tx=0).stop 2024-09-21T06:45:03.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.577+0000 7fee08ed5640 1 -- 172.21.15.7:0/2343798972 shutdown_connections 2024-09-21T06:45:03.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.577+0000 7fee08ed5640 1 --2- 172.21.15.7:0/2343798972 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fedec0b66b0 0x7fedec0b8bc0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:03.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.577+0000 7fee08ed5640 1 --2- 172.21.15.7:0/2343798972 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee04109df0 0x7fee0419fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:03.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.577+0000 7fee08ed5640 1 --2- 172.21.15.7:0/2343798972 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee041094a0 0x7fee0419aac0 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:03.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.577+0000 7fee08ed5640 1 --2- 172.21.15.7:0/2343798972 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee04103b60 0x7fee0419a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:03.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.577+0000 7fee08ed5640 1 -- 172.21.15.7:0/2343798972 >> 172.21.15.7:0/2343798972 conn(0x7fee0407b850 msgr2=0x7fee041075e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:03.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.577+0000 7fee08ed5640 1 -- 172.21.15.7:0/2343798972 shutdown_connections 2024-09-21T06:45:03.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:03.577+0000 7fee08ed5640 1 -- 172.21.15.7:0/2343798972 wait complete. 2024-09-21T06:45:04.435 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:45:04.696 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:45:04.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:45:04 smithi144 ceph-mon[34653]: pgmap v589: 97 pgs: 97 active+clean; 3.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-21T06:45:04.816 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:45:04 smithi007 ceph-mon[30983]: pgmap v589: 97 pgs: 97 active+clean; 3.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-21T06:45:04.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:45:04 smithi018 ceph-mon[34477]: pgmap v589: 97 pgs: 97 active+clean; 3.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-21T06:45:05.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.229+0000 7f0f957cc640 1 -- 172.21.15.7:0/3346940320 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f90105380 msgr2=0x7f0f9010d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:05.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.229+0000 7f0f957cc640 1 --2- 172.21.15.7:0/3346940320 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f90105380 0x7f0f9010d8d0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f0f84009900 tx=0x7f0f8402a410 comp rx=0 tx=0).stop 2024-09-21T06:45:05.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.229+0000 7f0f957cc640 1 -- 172.21.15.7:0/3346940320 shutdown_connections 2024-09-21T06:45:05.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.229+0000 7f0f957cc640 1 --2- 172.21.15.7:0/3346940320 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f9010de60 0x7f0f90110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:05.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.229+0000 7f0f957cc640 1 --2- 172.21.15.7:0/3346940320 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f90105380 0x7f0f9010d8d0 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:05.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.229+0000 7f0f957cc640 1 --2- 172.21.15.7:0/3346940320 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f90104a30 0x7f0f90104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:05.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.229+0000 7f0f957cc640 1 -- 172.21.15.7:0/3346940320 >> 172.21.15.7:0/3346940320 conn(0x7f0f900797b0 msgr2=0x7f0f90079bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:05.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.229+0000 7f0f957cc640 1 -- 172.21.15.7:0/3346940320 shutdown_connections 2024-09-21T06:45:05.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.229+0000 7f0f957cc640 1 -- 172.21.15.7:0/3346940320 wait complete. 2024-09-21T06:45:05.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.230+0000 7f0f957cc640 1 Processor -- start 2024-09-21T06:45:05.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.230+0000 7f0f957cc640 1 -- start start 2024-09-21T06:45:05.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.230+0000 7f0f957cc640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f90104a30 0x7f0f9019a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:05.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.230+0000 7f0f957cc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f90105380 0x7f0f9019aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:05.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.230+0000 7f0f957cc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f9010de60 0x7f0f9019fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:05.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.231+0000 7f0f957cc640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0f90113aa0 con 0x7f0f90105380 2024-09-21T06:45:05.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.231+0000 7f0f957cc640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0f90113920 con 0x7f0f9010de60 2024-09-21T06:45:05.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.231+0000 7f0f957cc640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0f90113c20 con 0x7f0f90104a30 2024-09-21T06:45:05.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.231+0000 7f0f8e7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f90105380 0x7f0f9019aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:05.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.231+0000 7f0f8e7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f90105380 0x7f0f9019aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33858/0 (socket says 172.21.15.7:33858) 2024-09-21T06:45:05.235 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.231+0000 7f0f8e7fc640 1 -- 172.21.15.7:0/1704852368 learned_addr learned my addr 172.21.15.7:0/1704852368 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:05.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.231+0000 7f0f8effd640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f90104a30 0x7f0f9019a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:05.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.231+0000 7f0f8f7fe640 1 --2- 172.21.15.7:0/1704852368 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f9010de60 0x7f0f9019fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:05.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.231+0000 7f0f8e7fc640 1 -- 172.21.15.7:0/1704852368 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f90104a30 msgr2=0x7f0f9019a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:05.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.231+0000 7f0f8e7fc640 1 --2- 172.21.15.7:0/1704852368 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f90104a30 0x7f0f9019a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:05.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.231+0000 7f0f8e7fc640 1 -- 172.21.15.7:0/1704852368 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f9010de60 msgr2=0x7f0f9019fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:05.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.231+0000 7f0f8e7fc640 1 --2- 172.21.15.7:0/1704852368 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f9010de60 0x7f0f9019fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:05.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.231+0000 7f0f8e7fc640 1 -- 172.21.15.7:0/1704852368 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f901a0400 con 0x7f0f90105380 2024-09-21T06:45:05.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.231+0000 7f0f8f7fe640 1 --2- 172.21.15.7:0/1704852368 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f9010de60 0x7f0f9019fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:05.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.231+0000 7f0f8e7fc640 1 --2- 172.21.15.7:0/1704852368 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f90105380 0x7f0f9019aa30 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f0f84006010 tx=0x7f0f84004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:05.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.231+0000 7f0f77fff640 1 -- 172.21.15.7:0/1704852368 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f8403f030 con 0x7f0f90105380 2024-09-21T06:45:05.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.232+0000 7f0f957cc640 1 -- 172.21.15.7:0/1704852368 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f901a0690 con 0x7f0f90105380 2024-09-21T06:45:05.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.232+0000 7f0f77fff640 1 -- 172.21.15.7:0/1704852368 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f84003aa0 con 0x7f0f90105380 2024-09-21T06:45:05.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.232+0000 7f0f77fff640 1 -- 172.21.15.7:0/1704852368 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f84035070 con 0x7f0f90105380 2024-09-21T06:45:05.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.232+0000 7f0f957cc640 1 -- 172.21.15.7:0/1704852368 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f901a6e50 con 0x7f0f90105380 2024-09-21T06:45:05.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.234+0000 7f0f9bd40740 1 Processor -- start 2024-09-21T06:45:05.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.234+0000 7f0f9bd40740 1 -- start start 2024-09-21T06:45:05.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.235+0000 7f0f77fff640 1 -- 172.21.15.7:0/1704852368 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f0f84042030 con 0x7f0f90105380 2024-09-21T06:45:05.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.235+0000 7f0f9bd40740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5653d8b58070 0x5653d8eff2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:05.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.235+0000 7f0f9bd40740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5653d8b2f1b0 0x5653d8eff800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:05.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.235+0000 7f0f9bd40740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5653d8b37390 0x5653d8effd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:05.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.235+0000 7f0f9bd40740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5653d8e75ea0 con 0x5653d8b37390 2024-09-21T06:45:05.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.235+0000 7f0f9bd40740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5653d8e652d0 con 0x5653d8b58070 2024-09-21T06:45:05.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.235+0000 7f0f9bd40740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5653d8e690e0 con 0x5653d8b2f1b0 2024-09-21T06:45:05.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.235+0000 7f0f8e7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5653d8b37390 0x5653d8effd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:05.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.235+0000 7f0f8e7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5653d8b37390 0x5653d8effd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33866/0 (socket says 172.21.15.7:33866) 2024-09-21T06:45:05.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.235+0000 7f0f8e7fc640 1 -- 172.21.15.7:0/1704535770 learned_addr learned my addr 172.21.15.7:0/1704535770 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:05.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.235+0000 7f0f8f7fe640 1 --2- 172.21.15.7:0/1704535770 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5653d8b58070 0x5653d8eff2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:05.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.235+0000 7f0f8effd640 1 --2- 172.21.15.7:0/1704535770 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5653d8b2f1b0 0x5653d8eff800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:05.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.235+0000 7f0f8e7fc640 1 -- 172.21.15.7:0/1704535770 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5653d8b2f1b0 msgr2=0x5653d8eff800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:05.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.235+0000 7f0f8e7fc640 1 --2- 172.21.15.7:0/1704535770 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5653d8b2f1b0 0x5653d8eff800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:05.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.235+0000 7f0f8e7fc640 1 -- 172.21.15.7:0/1704535770 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5653d8b58070 msgr2=0x5653d8eff2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:05.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.235+0000 7f0f8e7fc640 1 --2- 172.21.15.7:0/1704535770 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5653d8b58070 0x5653d8eff2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:05.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.235+0000 7f0f8e7fc640 1 -- 172.21.15.7:0/1704535770 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653d8bc3650 con 0x5653d8b37390 2024-09-21T06:45:05.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.236+0000 7f0f77fff640 1 --2- 172.21.15.7:0/1704852368 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f0f780b6680 0x7f0f780b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:05.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.236+0000 7f0f8e7fc640 1 --2- 172.21.15.7:0/1704535770 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5653d8b37390 0x5653d8effd40 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f0f84104fc0 tx=0x7f0f8410dcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ac2c95309545a27 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:05.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.236+0000 7f0f8f7fe640 1 --2- 172.21.15.7:0/1704852368 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f0f780b6680 0x7f0f780b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:05.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.236+0000 7f0f77fff640 1 -- 172.21.15.7:0/1704852368 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8412+0+0 (secure 0 0 0) 0x7f0f84107890 con 0x7f0f90105380 2024-09-21T06:45:05.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.236+0000 7f0f757fa640 1 -- 172.21.15.7:0/1704535770 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f840c9da0 con 0x5653d8b37390 2024-09-21T06:45:05.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.236+0000 7f0f757fa640 1 -- 172.21.15.7:0/1704535770 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f840c7e50 con 0x5653d8b37390 2024-09-21T06:45:05.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.236+0000 7f0f757fa640 1 -- 172.21.15.7:0/1704535770 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f840ccec0 con 0x5653d8b37390 2024-09-21T06:45:05.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.237+0000 7f0f9bd40740 1 -- 172.21.15.7:0/1704535770 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5653d8b37390 msgr2=0x5653d8effd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:05.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.237+0000 7f0f9bd40740 1 --2- 172.21.15.7:0/1704535770 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5653d8b37390 0x5653d8effd40 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f0f84104fc0 tx=0x7f0f8410dcd0 comp rx=0 tx=0).stop 2024-09-21T06:45:05.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.237+0000 7f0f8f7fe640 1 --2- 172.21.15.7:0/1704852368 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f0f780b6680 0x7f0f780b8b90 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f0f88009d30 tx=0x7f0f88005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:05.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.237+0000 7f0f9bd40740 1 -- 172.21.15.7:0/1704535770 shutdown_connections 2024-09-21T06:45:05.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.237+0000 7f0f9bd40740 1 --2- 172.21.15.7:0/1704535770 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5653d8b37390 0x5653d8effd40 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:05.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.237+0000 7f0f9bd40740 1 --2- 172.21.15.7:0/1704535770 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5653d8b2f1b0 0x5653d8eff800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:05.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.237+0000 7f0f9bd40740 1 --2- 172.21.15.7:0/1704535770 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5653d8b58070 0x5653d8eff2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:05.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.237+0000 7f0f9bd40740 1 -- 172.21.15.7:0/1704535770 >> 172.21.15.7:0/1704535770 conn(0x5653d8b4c460 msgr2=0x5653d8efd1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:05.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.237+0000 7f0f9bd40740 1 -- 172.21.15.7:0/1704535770 shutdown_connections 2024-09-21T06:45:05.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.237+0000 7f0f9bd40740 1 -- 172.21.15.7:0/1704535770 wait complete. 2024-09-21T06:45:05.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.237+0000 7f0f9bd40740 1 -- start start 2024-09-21T06:45:05.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.238+0000 7f0f9bd40740 1 Processor -- start 2024-09-21T06:45:05.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.238+0000 7f0f9bd40740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5653d8b2f1b0 0x5653d8f0a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:05.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.238+0000 7f0f9bd40740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5653d8b37390 0x5653d8f0ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:05.245 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.238+0000 7f0f9bd40740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5653d8b58070 0x5653d8f16ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:05.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.238+0000 7f0f9bd40740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5653d8cc6700 con 0x5653d8b37390 2024-09-21T06:45:05.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.238+0000 7f0f9bd40740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5653d8e00160 con 0x5653d8b2f1b0 2024-09-21T06:45:05.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.238+0000 7f0f9bd40740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5653d8f0d860 con 0x5653d8b58070 2024-09-21T06:45:05.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.238+0000 7f0f9bd40740 10 client.0 _ll_register_callbacks cb 0x5653d8e199e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:05.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.238+0000 7f0f8e7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5653d8b37390 0x5653d8f0ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:05.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.238+0000 7f0f8e7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5653d8b37390 0x5653d8f0ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33870/0 (socket says 172.21.15.7:33870) 2024-09-21T06:45:05.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.238+0000 7f0f8e7fc640 1 -- 172.21.15.7:0/370652260 learned_addr learned my addr 172.21.15.7:0/370652260 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:05.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.238+0000 7f0f8effd640 1 --2- 172.21.15.7:0/370652260 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5653d8b2f1b0 0x5653d8f0a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:05.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.238+0000 7f0f8f7fe640 1 --2- 172.21.15.7:0/370652260 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5653d8b58070 0x5653d8f16ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:05.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.238+0000 7f0f8e7fc640 1 -- 172.21.15.7:0/370652260 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5653d8b58070 msgr2=0x5653d8f16ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:05.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.238+0000 7f0f8e7fc640 1 --2- 172.21.15.7:0/370652260 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5653d8b58070 0x5653d8f16ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:05.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.238+0000 7f0f8e7fc640 1 -- 172.21.15.7:0/370652260 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5653d8b2f1b0 msgr2=0x5653d8f0a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:05.246 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.238+0000 7f0f8e7fc640 1 --2- 172.21.15.7:0/370652260 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5653d8b2f1b0 0x5653d8f0a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:05.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.238+0000 7f0f8e7fc640 1 -- 172.21.15.7:0/370652260 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653d8e2dc90 con 0x5653d8b37390 2024-09-21T06:45:05.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.238+0000 7f0f8f7fe640 1 --2- 172.21.15.7:0/370652260 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5653d8b58070 0x5653d8f16ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:45:05.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.238+0000 7f0f8effd640 1 --2- 172.21.15.7:0/370652260 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5653d8b2f1b0 0x5653d8f0a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:05.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.239+0000 7f0f8e7fc640 1 --2- 172.21.15.7:0/370652260 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5653d8b37390 0x5653d8f0ae80 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f0f840c9030 tx=0x7f0f84000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3383186df96611ef server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:05.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.239+0000 7f0f72ff5640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:45:05.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.239+0000 7f0f72ff5640 1 -- 172.21.15.7:0/370652260 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f84049050 con 0x5653d8b37390 2024-09-21T06:45:05.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.239+0000 7f0f72ff5640 1 -- 172.21.15.7:0/370652260 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8412+0+0 (secure 0 0 0) 0x7f0f840d6ee0 con 0x5653d8b37390 2024-09-21T06:45:05.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.239+0000 7f0f9bd40740 1 -- 172.21.15.7:0/370652260 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f840c7e50 con 0x5653d8b37390 2024-09-21T06:45:05.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.239+0000 7f0f72ff5640 1 -- 172.21.15.7:0/370652260 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0f840cd0a0 con 0x5653d8b37390 2024-09-21T06:45:05.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.239+0000 7f0f9bd40740 10 client.17364 fetch_fsmap learned FSMap version 25 2024-09-21T06:45:05.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.239+0000 7f0f9bd40740 1 -- 172.21.15.7:0/370652260 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5653d8f194a0 con 0x5653d8b37390 2024-09-21T06:45:05.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.239+0000 7f0f72ff5640 1 -- 172.21.15.7:0/370652260 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f840c7e50 con 0x5653d8b37390 2024-09-21T06:45:05.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.239+0000 7f0f72ff5640 1 -- 172.21.15.7:0/370652260 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f0f8404c060 con 0x5653d8b37390 2024-09-21T06:45:05.247 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.239+0000 7f0f9bd40740 10 client.17364 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:45:05.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.239+0000 7f0f9bd40740 10 client.17364 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:45:05.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.240+0000 7f0f9bd40740 20 client.17364 populate_metadata read hostname 'smithi007' 2024-09-21T06:45:05.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.240+0000 7f0f9bd40740 1 --2- 172.21.15.7:0/370652260 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5653d8b169f0 0x5653d8f1c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:05.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.240+0000 7f0f9bd40740 4 client.17364 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:45:05.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.240+0000 7f0f9bd40740 1 -- 172.21.15.7:0/370652260 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5653d8e77df0 con 0x5653d8b169f0 2024-09-21T06:45:05.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.240+0000 7f0f8effd640 1 --2- 172.21.15.7:0/370652260 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5653d8b169f0 0x5653d8f1c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:05.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.240+0000 7f0f8effd640 1 --2- 172.21.15.7:0/370652260 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5653d8b169f0 0x5653d8f1c800 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee8b88c35b5559d6 server_cookie=89b7ef58eea9df2 in_seq=0 out_seq=0 2024-09-21T06:45:05.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.240+0000 7f0f72ff5640 10 client.17364 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:45:05.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.241+0000 7f0f72ff5640 1 -- 172.21.15.7:0/370652260 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5653d8e77df0 con 0x5653d8b169f0 2024-09-21T06:45:05.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.241+0000 7f0f72ff5640 10 client.17364 handle_command_reply: tid=0 2024-09-21T06:45:05.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.241+0000 7f0f9bd40740 1 client.17364 shutdown 2024-09-21T06:45:05.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.241+0000 7f0f9bd40740 1 -- 172.21.15.7:0/370652260 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5653d8b37390 msgr2=0x5653d8f0ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:05.248 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.241+0000 7f0f9bd40740 1 --2- 172.21.15.7:0/370652260 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5653d8b37390 0x5653d8f0ae80 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f0f840c9030 tx=0x7f0f84000bc0 comp rx=0 tx=0).stop 2024-09-21T06:45:05.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.241+0000 7f0f9bd40740 1 -- 172.21.15.7:0/370652260 shutdown_connections 2024-09-21T06:45:05.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.241+0000 7f0f9bd40740 1 --2- 172.21.15.7:0/370652260 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5653d8b169f0 0x5653d8f1c800 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:05.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.241+0000 7f0f9bd40740 1 --2- 172.21.15.7:0/370652260 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5653d8b58070 0x5653d8f16ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:05.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.241+0000 7f0f9bd40740 1 --2- 172.21.15.7:0/370652260 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5653d8b37390 0x5653d8f0ae80 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:05.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.241+0000 7f0f9bd40740 1 --2- 172.21.15.7:0/370652260 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5653d8b2f1b0 0x5653d8f0a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:05.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.241+0000 7f0f72ff5640 0 client.17364 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:45:05.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.241+0000 7f0f9bd40740 1 -- 172.21.15.7:0/370652260 >> 172.21.15.7:0/370652260 conn(0x5653d8b4c460 msgr2=0x5653d8f02450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:05.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.242+0000 7f0f9bd40740 1 -- 172.21.15.7:0/370652260 shutdown_connections 2024-09-21T06:45:05.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.242+0000 7f0f9bd40740 1 -- 172.21.15.7:0/370652260 wait complete. 2024-09-21T06:45:05.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.242+0000 7f0f9bd40740 20 client.17364 trim_cache size 0 max 16384 2024-09-21T06:45:05.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.255+0000 7f0f9bd40740 1 Processor -- start 2024-09-21T06:45:05.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.255+0000 7f0f9bd40740 1 -- start start 2024-09-21T06:45:05.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.255+0000 7f0f9bd40740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5653d8b2f1b0 0x5653d8f09830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:05.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.255+0000 7f0f9bd40740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5653d8b37390 0x5653d8f00a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:05.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.255+0000 7f0f9bd40740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5653d8b58070 0x5653d8f16980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:05.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.255+0000 7f0f9bd40740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0f901b1e60 con 0x5653d8b2f1b0 2024-09-21T06:45:05.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.255+0000 7f0f9bd40740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0f901af730 con 0x5653d8b58070 2024-09-21T06:45:05.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.255+0000 7f0f9bd40740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0f901ad5a0 con 0x5653d8b37390 2024-09-21T06:45:05.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.255+0000 7f0f8effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5653d8b2f1b0 0x5653d8f09830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:05.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.255+0000 7f0f8effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5653d8b2f1b0 0x5653d8f09830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33876/0 (socket says 172.21.15.7:33876) 2024-09-21T06:45:05.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.255+0000 7f0f8effd640 1 -- 172.21.15.7:0/3926473246 learned_addr learned my addr 172.21.15.7:0/3926473246 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:05.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.255+0000 7f0f8e7fc640 1 --2- 172.21.15.7:0/3926473246 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5653d8b37390 0x5653d8f00a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:05.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.255+0000 7f0f8f7fe640 1 --2- 172.21.15.7:0/3926473246 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5653d8b58070 0x5653d8f16980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:05.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.255+0000 7f0f8effd640 1 -- 172.21.15.7:0/3926473246 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5653d8b37390 msgr2=0x5653d8f00a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:05.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.255+0000 7f0f8effd640 1 --2- 172.21.15.7:0/3926473246 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5653d8b37390 0x5653d8f00a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:05.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.255+0000 7f0f8effd640 1 -- 172.21.15.7:0/3926473246 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5653d8b58070 msgr2=0x5653d8f16980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:05.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.255+0000 7f0f8effd640 1 --2- 172.21.15.7:0/3926473246 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5653d8b58070 0x5653d8f16980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:05.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.255+0000 7f0f8effd640 1 -- 172.21.15.7:0/3926473246 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653d8ef7460 con 0x5653d8b2f1b0 2024-09-21T06:45:05.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.255+0000 7f0f8f7fe640 1 --2- 172.21.15.7:0/3926473246 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5653d8b58070 0x5653d8f16980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:45:05.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.256+0000 7f0f8effd640 1 --2- 172.21.15.7:0/3926473246 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5653d8b2f1b0 0x5653d8f09830 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x5653d8f02270 tx=0x7f0f80015b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59fe60952ef5cea0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:05.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.256+0000 7f0f74ff9640 1 -- 172.21.15.7:0/3926473246 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f80013360 con 0x5653d8b2f1b0 2024-09-21T06:45:05.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.256+0000 7f0f74ff9640 1 -- 172.21.15.7:0/3926473246 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f80015580 con 0x5653d8b2f1b0 2024-09-21T06:45:05.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.256+0000 7f0f74ff9640 1 -- 172.21.15.7:0/3926473246 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f800139a0 con 0x5653d8b2f1b0 2024-09-21T06:45:05.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.257+0000 7f0f9bd40740 1 -- 172.21.15.7:0/3926473246 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5653d8b2f1b0 msgr2=0x5653d8f09830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:05.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.257+0000 7f0f9bd40740 1 --2- 172.21.15.7:0/3926473246 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5653d8b2f1b0 0x5653d8f09830 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x5653d8f02270 tx=0x7f0f80015b90 comp rx=0 tx=0).stop 2024-09-21T06:45:05.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.257+0000 7f0f9bd40740 1 -- 172.21.15.7:0/3926473246 shutdown_connections 2024-09-21T06:45:05.263 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.257+0000 7f0f9bd40740 1 --2- 172.21.15.7:0/3926473246 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5653d8b58070 0x5653d8f16980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:05.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.257+0000 7f0f9bd40740 1 --2- 172.21.15.7:0/3926473246 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5653d8b37390 0x5653d8f00a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:05.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.257+0000 7f0f9bd40740 1 --2- 172.21.15.7:0/3926473246 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5653d8b2f1b0 0x5653d8f09830 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:05.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.257+0000 7f0f9bd40740 1 -- 172.21.15.7:0/3926473246 >> 172.21.15.7:0/3926473246 conn(0x5653d8b4c460 msgr2=0x5653d8f002f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:05.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.257+0000 7f0f9bd40740 1 -- 172.21.15.7:0/3926473246 shutdown_connections 2024-09-21T06:45:05.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.257+0000 7f0f9bd40740 1 -- 172.21.15.7:0/3926473246 wait complete. 2024-09-21T06:45:05.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.257+0000 7f0f9bd40740 1 -- start start 2024-09-21T06:45:05.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.257+0000 7f0f9bd40740 1 Processor -- start 2024-09-21T06:45:05.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.257+0000 7f0f9bd40740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5653d8b2f1b0 0x5653d8f0f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:05.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.257+0000 7f0f9bd40740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5653d8b37390 0x5653d8f0f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:05.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.258+0000 7f0f9bd40740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5653d8b58070 0x5653d8f86060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:05.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.258+0000 7f0f9bd40740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0f901adbf0 con 0x5653d8b58070 2024-09-21T06:45:05.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.258+0000 7f0f9bd40740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0f901af060 con 0x5653d8b37390 2024-09-21T06:45:05.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.258+0000 7f0f9bd40740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0f901ae2c0 con 0x5653d8b2f1b0 2024-09-21T06:45:05.264 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.258+0000 7f0f9bd40740 10 client.0 _ll_register_callbacks cb 0x7f0f880095d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:05.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.258+0000 7f0f8f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5653d8b58070 0x5653d8f86060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:05.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.258+0000 7f0f8effd640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5653d8b2f1b0 0x5653d8f0f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:05.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.258+0000 7f0f8f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5653d8b58070 0x5653d8f86060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33892/0 (socket says 172.21.15.7:33892) 2024-09-21T06:45:05.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.258+0000 7f0f8f7fe640 1 -- 172.21.15.7:0/1765981927 learned_addr learned my addr 172.21.15.7:0/1765981927 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:05.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.258+0000 7f0f8e7fc640 1 --2- 172.21.15.7:0/1765981927 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5653d8b37390 0x5653d8f0f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:05.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.258+0000 7f0f8f7fe640 1 -- 172.21.15.7:0/1765981927 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5653d8b2f1b0 msgr2=0x5653d8f0f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:05.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.258+0000 7f0f8f7fe640 1 --2- 172.21.15.7:0/1765981927 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5653d8b2f1b0 0x5653d8f0f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:05.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.258+0000 7f0f8f7fe640 1 -- 172.21.15.7:0/1765981927 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5653d8b37390 msgr2=0x5653d8f0f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:05.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.258+0000 7f0f8f7fe640 1 --2- 172.21.15.7:0/1765981927 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5653d8b37390 0x5653d8f0f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:05.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.258+0000 7f0f8f7fe640 1 -- 172.21.15.7:0/1765981927 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653d8ef85d0 con 0x5653d8b58070 2024-09-21T06:45:05.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.258+0000 7f0f8f7fe640 1 --2- 172.21.15.7:0/1765981927 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5653d8b58070 0x5653d8f86060 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f0f8801d9e0 tx=0x7f0f88004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1cd9068965501df server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:05.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.258+0000 7f0f72ff5640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:45:05.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.258+0000 7f0f72ff5640 1 -- 172.21.15.7:0/1765981927 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f8802d060 con 0x5653d8b58070 2024-09-21T06:45:05.265 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.259+0000 7f0f72ff5640 1 -- 172.21.15.7:0/1765981927 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8412+0+0 (secure 0 0 0) 0x7f0f88011bd0 con 0x5653d8b58070 2024-09-21T06:45:05.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.259+0000 7f0f9bd40740 1 -- 172.21.15.7:0/1765981927 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f80015580 con 0x5653d8b58070 2024-09-21T06:45:05.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.259+0000 7f0f72ff5640 1 -- 172.21.15.7:0/1765981927 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0f88009e20 con 0x5653d8b58070 2024-09-21T06:45:05.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.259+0000 7f0f9bd40740 10 client.17370 fetch_fsmap learned FSMap version 25 2024-09-21T06:45:05.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.259+0000 7f0f9bd40740 1 -- 172.21.15.7:0/1765981927 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5653d8f87760 con 0x5653d8b58070 2024-09-21T06:45:05.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.259+0000 7f0f72ff5640 1 -- 172.21.15.7:0/1765981927 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f80015580 con 0x5653d8b58070 2024-09-21T06:45:05.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.259+0000 7f0f72ff5640 1 -- 172.21.15.7:0/1765981927 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f0f88030020 con 0x5653d8b58070 2024-09-21T06:45:05.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.259+0000 7f0f9bd40740 10 client.17370 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:45:05.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.259+0000 7f0f9bd40740 10 client.17370 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:45:05.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.259+0000 7f0f9bd40740 20 client.17370 populate_metadata read hostname 'smithi007' 2024-09-21T06:45:05.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.259+0000 7f0f9bd40740 1 --2- 172.21.15.7:0/1765981927 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5653d8aebda0 0x5653d8f89f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:05.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.259+0000 7f0f9bd40740 4 client.17370 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:45:05.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.259+0000 7f0f9bd40740 1 -- 172.21.15.7:0/1765981927 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5653d8e738a0 con 0x5653d8aebda0 2024-09-21T06:45:05.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.259+0000 7f0f8effd640 1 --2- 172.21.15.7:0/1765981927 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5653d8aebda0 0x5653d8f89f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:05.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.260+0000 7f0f72ff5640 10 client.17370 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:45:05.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.260+0000 7f0f8effd640 1 --2- 172.21.15.7:0/1765981927 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5653d8aebda0 0x5653d8f89f50 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6cb13a4d9c123aa3 server_cookie=4d76dfab38d27e7c in_seq=0 out_seq=0 2024-09-21T06:45:05.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.260+0000 7f0f72ff5640 1 -- 172.21.15.7:0/1765981927 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5653d8e738a0 con 0x5653d8aebda0 2024-09-21T06:45:05.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.260+0000 7f0f72ff5640 10 client.17370 handle_command_reply: tid=0 2024-09-21T06:45:05.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.260+0000 7f0f9bd40740 1 client.17370 shutdown 2024-09-21T06:45:05.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.260+0000 7f0f9bd40740 1 -- 172.21.15.7:0/1765981927 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5653d8b58070 msgr2=0x5653d8f86060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:05.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.260+0000 7f0f9bd40740 1 --2- 172.21.15.7:0/1765981927 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5653d8b58070 0x5653d8f86060 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f0f8801d9e0 tx=0x7f0f88004730 comp rx=0 tx=0).stop 2024-09-21T06:45:05.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.260+0000 7f0f9bd40740 1 -- 172.21.15.7:0/1765981927 shutdown_connections 2024-09-21T06:45:05.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.260+0000 7f0f9bd40740 1 --2- 172.21.15.7:0/1765981927 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5653d8aebda0 0x5653d8f89f50 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:05.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.260+0000 7f0f9bd40740 1 --2- 172.21.15.7:0/1765981927 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5653d8b58070 0x5653d8f86060 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:05.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.260+0000 7f0f9bd40740 1 --2- 172.21.15.7:0/1765981927 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5653d8b37390 0x5653d8f0f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:05.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.260+0000 7f0f72ff5640 0 client.17370 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:45:05.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.260+0000 7f0f9bd40740 1 --2- 172.21.15.7:0/1765981927 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5653d8b2f1b0 0x5653d8f0f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:05.267 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.260+0000 7f0f9bd40740 1 -- 172.21.15.7:0/1765981927 >> 172.21.15.7:0/1765981927 conn(0x5653d8b4c460 msgr2=0x5653d8f0bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:05.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.260+0000 7f0f9bd40740 1 -- 172.21.15.7:0/1765981927 shutdown_connections 2024-09-21T06:45:05.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.260+0000 7f0f9bd40740 1 -- 172.21.15.7:0/1765981927 wait complete. 2024-09-21T06:45:05.268 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.261+0000 7f0f9bd40740 20 client.17370 trim_cache size 0 max 16384 2024-09-21T06:45:05.268 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:45:05.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.261+0000 7f0f957cc640 1 -- 172.21.15.7:0/1704852368 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f0f780b6680 msgr2=0x7f0f780b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:05.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.261+0000 7f0f957cc640 1 --2- 172.21.15.7:0/1704852368 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f0f780b6680 0x7f0f780b8b90 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f0f88009d30 tx=0x7f0f88005f90 comp rx=0 tx=0).stop 2024-09-21T06:45:05.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.261+0000 7f0f957cc640 1 -- 172.21.15.7:0/1704852368 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f90105380 msgr2=0x7f0f9019aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:05.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.261+0000 7f0f957cc640 1 --2- 172.21.15.7:0/1704852368 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f90105380 0x7f0f9019aa30 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f0f84006010 tx=0x7f0f84004060 comp rx=0 tx=0).stop 2024-09-21T06:45:05.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.261+0000 7f0f957cc640 1 -- 172.21.15.7:0/1704852368 shutdown_connections 2024-09-21T06:45:05.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.261+0000 7f0f957cc640 1 --2- 172.21.15.7:0/1704852368 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f0f780b6680 0x7f0f780b8b90 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:05.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.261+0000 7f0f957cc640 1 --2- 172.21.15.7:0/1704852368 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f9010de60 0x7f0f9019fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:05.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.261+0000 7f0f957cc640 1 --2- 172.21.15.7:0/1704852368 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f90105380 0x7f0f9019aa30 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:05.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.261+0000 7f0f957cc640 1 --2- 172.21.15.7:0/1704852368 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f90104a30 0x7f0f9019a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:05.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.261+0000 7f0f957cc640 1 -- 172.21.15.7:0/1704852368 >> 172.21.15.7:0/1704852368 conn(0x7f0f900797b0 msgr2=0x7f0f901008b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:05.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.261+0000 7f0f957cc640 1 -- 172.21.15.7:0/1704852368 shutdown_connections 2024-09-21T06:45:05.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:05.261+0000 7f0f957cc640 1 -- 172.21.15.7:0/1704852368 wait complete. 2024-09-21T06:45:06.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:45:06 smithi144 ceph-mon[34653]: pgmap v590: 97 pgs: 97 active+clean; 3.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-21T06:45:06.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:45:06 smithi007 ceph-mon[30983]: pgmap v590: 97 pgs: 97 active+clean; 3.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-21T06:45:06.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:45:06 smithi018 ceph-mon[34477]: pgmap v590: 97 pgs: 97 active+clean; 3.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-21T06:45:07.099 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:45:07.099 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:45:07.370 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:45:07.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.885+0000 7f816c85b640 1 -- 172.21.15.7:0/1731090138 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8168103b60 msgr2=0x7f8168103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:07.900 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.885+0000 7f816c85b640 1 --2- 172.21.15.7:0/1731090138 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8168103b60 0x7f8168103f70 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f8158009900 tx=0x7f815802a410 comp rx=0 tx=0).stop 2024-09-21T06:45:07.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.885+0000 7f816c85b640 1 -- 172.21.15.7:0/1731090138 shutdown_connections 2024-09-21T06:45:07.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.885+0000 7f816c85b640 1 --2- 172.21.15.7:0/1731090138 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8168109df0 0x7f8168110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:07.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.885+0000 7f816c85b640 1 --2- 172.21.15.7:0/1731090138 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f81681094a0 0x7f81681098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:07.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.885+0000 7f816c85b640 1 --2- 172.21.15.7:0/1731090138 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8168103b60 0x7f8168103f70 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:07.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.885+0000 7f816c85b640 1 -- 172.21.15.7:0/1731090138 >> 172.21.15.7:0/1731090138 conn(0x7f816807b850 msgr2=0x7f816807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:07.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.886+0000 7f816c85b640 1 -- 172.21.15.7:0/1731090138 shutdown_connections 2024-09-21T06:45:07.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.886+0000 7f816c85b640 1 -- 172.21.15.7:0/1731090138 wait complete. 2024-09-21T06:45:07.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.886+0000 7f816c85b640 1 Processor -- start 2024-09-21T06:45:07.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.886+0000 7f816c85b640 1 -- start start 2024-09-21T06:45:07.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.887+0000 7f816c85b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8168103b60 0x7f816819a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:07.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.887+0000 7f816c85b640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f81681094a0 0x7f816819aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:07.901 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.887+0000 7f816c85b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8168109df0 0x7f816819fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:07.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.887+0000 7f816c85b640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8168113af0 con 0x7f8168109df0 2024-09-21T06:45:07.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.887+0000 7f816c85b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8168113970 con 0x7f8168103b60 2024-09-21T06:45:07.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.887+0000 7f816c85b640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8168113c70 con 0x7f81681094a0 2024-09-21T06:45:07.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.887+0000 7f8166d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8168109df0 0x7f816819fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:07.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.887+0000 7f8166d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8168109df0 0x7f816819fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33904/0 (socket says 172.21.15.7:33904) 2024-09-21T06:45:07.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.887+0000 7f8166d9d640 1 -- 172.21.15.7:0/1442436062 learned_addr learned my addr 172.21.15.7:0/1442436062 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:07.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.887+0000 7f8165d9b640 1 --2- 172.21.15.7:0/1442436062 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f81681094a0 0x7f816819aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:07.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.887+0000 7f816659c640 1 --2- 172.21.15.7:0/1442436062 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8168103b60 0x7f816819a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:07.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.887+0000 7f8166d9d640 1 -- 172.21.15.7:0/1442436062 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f81681094a0 msgr2=0x7f816819aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:07.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.887+0000 7f8166d9d640 1 --2- 172.21.15.7:0/1442436062 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f81681094a0 0x7f816819aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:07.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.887+0000 7f8166d9d640 1 -- 172.21.15.7:0/1442436062 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8168103b60 msgr2=0x7f816819a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:07.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.887+0000 7f8166d9d640 1 --2- 172.21.15.7:0/1442436062 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8168103b60 0x7f816819a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:07.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.887+0000 7f8166d9d640 1 -- 172.21.15.7:0/1442436062 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81681a0470 con 0x7f8168109df0 2024-09-21T06:45:07.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.887+0000 7f8166d9d640 1 --2- 172.21.15.7:0/1442436062 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8168109df0 0x7f816819fd40 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f8160009fd0 tx=0x7f816000def0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:07.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.888+0000 7f81577fe640 1 -- 172.21.15.7:0/1442436062 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8160017070 con 0x7f8168109df0 2024-09-21T06:45:07.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.888+0000 7f816c85b640 1 -- 172.21.15.7:0/1442436062 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81681a0760 con 0x7f8168109df0 2024-09-21T06:45:07.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.888+0000 7f81577fe640 1 -- 172.21.15.7:0/1442436062 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8160003e20 con 0x7f8168109df0 2024-09-21T06:45:07.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.888+0000 7f81577fe640 1 -- 172.21.15.7:0/1442436062 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8160010460 con 0x7f8168109df0 2024-09-21T06:45:07.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.888+0000 7f816c85b640 1 -- 172.21.15.7:0/1442436062 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81681a6ec0 con 0x7f8168109df0 2024-09-21T06:45:07.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.890+0000 7f8172dcf740 1 Processor -- start 2024-09-21T06:45:07.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.891+0000 7f81577fe640 1 -- 172.21.15.7:0/1442436062 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f8160004020 con 0x7f8168109df0 2024-09-21T06:45:07.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.891+0000 7f8172dcf740 1 -- start start 2024-09-21T06:45:07.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.891+0000 7f8172dcf740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56472b5b9350 0x56472b960430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:07.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.891+0000 7f8172dcf740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56472b590490 0x56472b960970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:07.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.891+0000 7f8172dcf740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56472b598670 0x56472b960eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:07.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.891+0000 7f8172dcf740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56472b8d6e60 con 0x56472b598670 2024-09-21T06:45:07.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.891+0000 7f8172dcf740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56472b8c6290 con 0x56472b590490 2024-09-21T06:45:07.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.891+0000 7f8172dcf740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x56472b8ca0a0 con 0x56472b5b9350 2024-09-21T06:45:07.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.891+0000 7f8165d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56472b598670 0x56472b960eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:07.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.891+0000 7f8165d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56472b598670 0x56472b960eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33920/0 (socket says 172.21.15.7:33920) 2024-09-21T06:45:07.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.891+0000 7f816659c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56472b590490 0x56472b960970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:07.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.891+0000 7f8165d9b640 1 -- 172.21.15.7:0/809414624 learned_addr learned my addr 172.21.15.7:0/809414624 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:07.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.891+0000 7f8165d9b640 1 --2- 172.21.15.7:0/809414624 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56472b5b9350 0x56472b960430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:07.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.892+0000 7f81577fe640 1 --2- 172.21.15.7:0/1442436062 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f81500b6680 0x7f81500b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:07.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.892+0000 7f816659c640 1 -- 172.21.15.7:0/809414624 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56472b5b9350 msgr2=0x56472b960430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:07.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.892+0000 7f816659c640 1 --2- 172.21.15.7:0/809414624 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56472b5b9350 0x56472b960430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:07.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.892+0000 7f816659c640 1 -- 172.21.15.7:0/809414624 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56472b598670 msgr2=0x56472b960eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:07.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.892+0000 7f816659c640 1 --2- 172.21.15.7:0/809414624 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56472b598670 0x56472b960eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:07.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.892+0000 7f816659c640 1 -- 172.21.15.7:0/809414624 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56472b624930 con 0x56472b590490 2024-09-21T06:45:07.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.892+0000 7f8166d9d640 1 --2- 172.21.15.7:0/1442436062 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f81500b6680 0x7f81500b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:07.904 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.892+0000 7f81577fe640 1 -- 172.21.15.7:0/1442436062 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8412+0+0 (secure 0 0 0) 0x7f81600e7430 con 0x7f8168109df0 2024-09-21T06:45:07.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.892+0000 7f816659c640 1 --2- 172.21.15.7:0/809414624 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56472b590490 0x56472b960970 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8158009230 tx=0x7f8158032df0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a20485e0a5d347c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:07.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.892+0000 7f8166d9d640 1 --2- 172.21.15.7:0/1442436062 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f81500b6680 0x7f81500b8b90 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f81600aa560 tx=0x7f816007a5d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:07.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.892+0000 7f8154ff9640 1 -- 172.21.15.7:0/809414624 <== mon.2 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8158040070 con 0x56472b590490 2024-09-21T06:45:07.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.892+0000 7f8154ff9640 1 -- 172.21.15.7:0/809414624 <== mon.2 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81580316a0 con 0x56472b590490 2024-09-21T06:45:07.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.892+0000 7f8154ff9640 1 -- 172.21.15.7:0/809414624 <== mon.2 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8158035040 con 0x56472b590490 2024-09-21T06:45:07.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.893+0000 7f8172dcf740 1 -- 172.21.15.7:0/809414624 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56472b590490 msgr2=0x56472b960970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:07.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.893+0000 7f8172dcf740 1 --2- 172.21.15.7:0/809414624 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56472b590490 0x56472b960970 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8158009230 tx=0x7f8158032df0 comp rx=0 tx=0).stop 2024-09-21T06:45:07.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.893+0000 7f8172dcf740 1 -- 172.21.15.7:0/809414624 shutdown_connections 2024-09-21T06:45:07.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.893+0000 7f8172dcf740 1 --2- 172.21.15.7:0/809414624 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56472b598670 0x56472b960eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:07.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.893+0000 7f8172dcf740 1 --2- 172.21.15.7:0/809414624 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56472b590490 0x56472b960970 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:07.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.893+0000 7f8172dcf740 1 --2- 172.21.15.7:0/809414624 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56472b5b9350 0x56472b960430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:07.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.893+0000 7f8172dcf740 1 -- 172.21.15.7:0/809414624 >> 172.21.15.7:0/809414624 conn(0x56472b5ad740 msgr2=0x56472b95e320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:07.905 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.894+0000 7f8172dcf740 1 -- 172.21.15.7:0/809414624 shutdown_connections 2024-09-21T06:45:07.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.894+0000 7f8172dcf740 1 -- 172.21.15.7:0/809414624 wait complete. 2024-09-21T06:45:07.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.894+0000 7f8172dcf740 1 -- start start 2024-09-21T06:45:07.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.894+0000 7f8172dcf740 1 Processor -- start 2024-09-21T06:45:07.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.894+0000 7f8172dcf740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56472b590490 0x56472b9703f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:07.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.894+0000 7f8172dcf740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56472b598670 0x56472b970930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:07.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.894+0000 7f8172dcf740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56472b5b9350 0x56472b97c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:07.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.894+0000 7f8172dcf740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x56472b727890 con 0x56472b5b9350 2024-09-21T06:45:07.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.894+0000 7f8172dcf740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56472b860d40 con 0x56472b590490 2024-09-21T06:45:07.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.894+0000 7f8172dcf740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x56472b972ee0 con 0x56472b598670 2024-09-21T06:45:07.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.894+0000 7f8172dcf740 10 client.0 _ll_register_callbacks cb 0x56472b8c4c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:07.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.895+0000 7f8165d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56472b5b9350 0x56472b97c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:07.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.895+0000 7f8165d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56472b5b9350 0x56472b97c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33928/0 (socket says 172.21.15.7:33928) 2024-09-21T06:45:07.906 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.895+0000 7f8165d9b640 1 -- 172.21.15.7:0/4201431015 learned_addr learned my addr 172.21.15.7:0/4201431015 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:07.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.895+0000 7f8165d9b640 1 --2- 172.21.15.7:0/4201431015 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56472b590490 0x56472b9703f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:07.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.895+0000 7f816659c640 1 --2- 172.21.15.7:0/4201431015 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56472b598670 0x56472b970930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:07.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.895+0000 7f8165d9b640 1 -- 172.21.15.7:0/4201431015 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56472b598670 msgr2=0x56472b970930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:07.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.895+0000 7f8165d9b640 1 --2- 172.21.15.7:0/4201431015 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56472b598670 0x56472b970930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:07.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.895+0000 7f8165d9b640 1 -- 172.21.15.7:0/4201431015 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56472b590490 msgr2=0x56472b9703f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:07.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.895+0000 7f8165d9b640 1 --2- 172.21.15.7:0/4201431015 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56472b590490 0x56472b9703f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:07.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.895+0000 7f8165d9b640 1 -- 172.21.15.7:0/4201431015 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56472b97c7d0 con 0x56472b5b9350 2024-09-21T06:45:07.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.895+0000 7f8165d9b640 1 --2- 172.21.15.7:0/4201431015 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56472b5b9350 0x56472b97c210 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f815c019c50 tx=0x7f815c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fba11b5e2d9a2ce server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:07.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.895+0000 7f814dffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:45:07.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.895+0000 7f814dffb640 1 -- 172.21.15.7:0/4201431015 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f815c019050 con 0x56472b5b9350 2024-09-21T06:45:07.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.895+0000 7f8172dcf740 1 -- 172.21.15.7:0/4201431015 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81580316a0 con 0x56472b5b9350 2024-09-21T06:45:07.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.895+0000 7f814dffb640 1 -- 172.21.15.7:0/4201431015 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8412+0+0 (secure 0 0 0) 0x7f815c00f040 con 0x56472b5b9350 2024-09-21T06:45:07.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.895+0000 7f814dffb640 1 -- 172.21.15.7:0/4201431015 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f815c029050 con 0x56472b5b9350 2024-09-21T06:45:07.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.895+0000 7f8172dcf740 10 client.17382 fetch_fsmap learned FSMap version 25 2024-09-21T06:45:07.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.896+0000 7f8172dcf740 1 -- 172.21.15.7:0/4201431015 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56472b97f160 con 0x56472b5b9350 2024-09-21T06:45:07.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.896+0000 7f814dffb640 1 -- 172.21.15.7:0/4201431015 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81580316a0 con 0x56472b5b9350 2024-09-21T06:45:07.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.896+0000 7f814dffb640 1 -- 172.21.15.7:0/4201431015 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f815c017bf0 con 0x56472b5b9350 2024-09-21T06:45:07.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.896+0000 7f8172dcf740 10 client.17382 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:45:07.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.896+0000 7f8172dcf740 10 client.17382 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:45:07.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.896+0000 7f8172dcf740 20 client.17382 populate_metadata read hostname 'smithi007' 2024-09-21T06:45:07.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.896+0000 7f8172dcf740 1 --2- 172.21.15.7:0/4201431015 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x56472b577cd0 0x56472b9826c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:07.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.896+0000 7f8172dcf740 4 client.17382 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:45:07.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.896+0000 7f8172dcf740 1 -- 172.21.15.7:0/4201431015 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56472b8d8db0 con 0x56472b577cd0 2024-09-21T06:45:07.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.896+0000 7f816659c640 1 --2- 172.21.15.7:0/4201431015 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x56472b577cd0 0x56472b9826c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:07.908 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.897+0000 7f814dffb640 10 client.17382 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:45:07.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.897+0000 7f816659c640 1 --2- 172.21.15.7:0/4201431015 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x56472b577cd0 0x56472b9826c0 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=408e665a878b2e7a server_cookie=c73f25ef68ade299 in_seq=0 out_seq=0 2024-09-21T06:45:07.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.898+0000 7f814dffb640 1 -- 172.21.15.7:0/4201431015 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f815804ff90 con 0x56472b577cd0 2024-09-21T06:45:07.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.898+0000 7f814dffb640 10 client.17382 handle_command_reply: tid=0 2024-09-21T06:45:07.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.898+0000 7f8172dcf740 1 client.17382 shutdown 2024-09-21T06:45:07.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.898+0000 7f8172dcf740 1 -- 172.21.15.7:0/4201431015 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56472b5b9350 msgr2=0x56472b97c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:07.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.898+0000 7f8172dcf740 1 --2- 172.21.15.7:0/4201431015 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56472b5b9350 0x56472b97c210 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f815c019c50 tx=0x7f815c008040 comp rx=0 tx=0).stop 2024-09-21T06:45:07.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.898+0000 7f8172dcf740 1 -- 172.21.15.7:0/4201431015 shutdown_connections 2024-09-21T06:45:07.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.898+0000 7f8172dcf740 1 --2- 172.21.15.7:0/4201431015 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x56472b577cd0 0x56472b9826c0 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:07.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.898+0000 7f8172dcf740 1 --2- 172.21.15.7:0/4201431015 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56472b5b9350 0x56472b97c210 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:07.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.898+0000 7f8172dcf740 1 --2- 172.21.15.7:0/4201431015 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56472b598670 0x56472b970930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:07.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.898+0000 7f8172dcf740 1 --2- 172.21.15.7:0/4201431015 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56472b590490 0x56472b9703f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:07.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.898+0000 7f8172dcf740 1 -- 172.21.15.7:0/4201431015 >> 172.21.15.7:0/4201431015 conn(0x56472b5ad740 msgr2=0x56472b963580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:07.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.898+0000 7f814dffb640 0 client.17382 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:45:07.909 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.898+0000 7f8172dcf740 1 -- 172.21.15.7:0/4201431015 shutdown_connections 2024-09-21T06:45:07.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.898+0000 7f8172dcf740 1 -- 172.21.15.7:0/4201431015 wait complete. 2024-09-21T06:45:07.910 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.898+0000 7f8172dcf740 20 client.17382 trim_cache size 0 max 16384 2024-09-21T06:45:07.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.916+0000 7f8172dcf740 1 Processor -- start 2024-09-21T06:45:07.917 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.916+0000 7f8172dcf740 1 -- start start 2024-09-21T06:45:07.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.916+0000 7f8172dcf740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56472b590490 0x56472b95e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:07.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.916+0000 7f8172dcf740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56472b598670 0x56472b97c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:07.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.916+0000 7f8172dcf740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56472b5b9350 0x56472b96d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:07.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.916+0000 7f8172dcf740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f81681afc40 con 0x56472b590490 2024-09-21T06:45:07.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.916+0000 7f8172dcf740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f81681ad510 con 0x56472b598670 2024-09-21T06:45:07.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.916+0000 7f8172dcf740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f81681ab380 con 0x56472b5b9350 2024-09-21T06:45:07.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.916+0000 7f8165d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56472b590490 0x56472b95e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:07.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.916+0000 7f8165d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56472b590490 0x56472b95e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33934/0 (socket says 172.21.15.7:33934) 2024-09-21T06:45:07.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.916+0000 7f8165d9b640 1 -- 172.21.15.7:0/1079034340 learned_addr learned my addr 172.21.15.7:0/1079034340 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:07.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.916+0000 7f816659c640 1 --2- 172.21.15.7:0/1079034340 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56472b598670 0x56472b97c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:07.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.916+0000 7f8165d9b640 1 --2- 172.21.15.7:0/1079034340 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56472b5b9350 0x56472b96d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:07.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.917+0000 7f8165d9b640 1 -- 172.21.15.7:0/1079034340 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56472b5b9350 msgr2=0x56472b96d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:07.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.917+0000 7f8165d9b640 1 --2- 172.21.15.7:0/1079034340 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56472b5b9350 0x56472b96d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:07.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.917+0000 7f8165d9b640 1 -- 172.21.15.7:0/1079034340 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56472b598670 msgr2=0x56472b97c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:07.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.917+0000 7f8165d9b640 1 --2- 172.21.15.7:0/1079034340 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56472b598670 0x56472b97c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:07.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.917+0000 7f8165d9b640 1 -- 172.21.15.7:0/1079034340 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56472b972930 con 0x56472b590490 2024-09-21T06:45:07.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.917+0000 7f8165d9b640 1 --2- 172.21.15.7:0/1079034340 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56472b590490 0x56472b95e250 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f815c00c010 tx=0x7f815c009a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63aca664290ef364 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:07.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.917+0000 7f814ffff640 1 -- 172.21.15.7:0/1079034340 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f815c033070 con 0x56472b590490 2024-09-21T06:45:07.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.917+0000 7f814ffff640 1 -- 172.21.15.7:0/1079034340 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f815c020070 con 0x56472b590490 2024-09-21T06:45:07.920 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.917+0000 7f814ffff640 1 -- 172.21.15.7:0/1079034340 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f815c0257b0 con 0x56472b590490 2024-09-21T06:45:07.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.918+0000 7f8172dcf740 1 -- 172.21.15.7:0/1079034340 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56472b590490 msgr2=0x56472b95e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:07.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.918+0000 7f8172dcf740 1 --2- 172.21.15.7:0/1079034340 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56472b590490 0x56472b95e250 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f815c00c010 tx=0x7f815c009a40 comp rx=0 tx=0).stop 2024-09-21T06:45:07.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.918+0000 7f8172dcf740 1 -- 172.21.15.7:0/1079034340 shutdown_connections 2024-09-21T06:45:07.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.918+0000 7f8172dcf740 1 --2- 172.21.15.7:0/1079034340 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56472b5b9350 0x56472b96d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:07.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.918+0000 7f8172dcf740 1 --2- 172.21.15.7:0/1079034340 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56472b598670 0x56472b97c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:07.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.918+0000 7f8172dcf740 1 --2- 172.21.15.7:0/1079034340 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56472b590490 0x56472b95e250 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:07.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.918+0000 7f8172dcf740 1 -- 172.21.15.7:0/1079034340 >> 172.21.15.7:0/1079034340 conn(0x56472b5ad740 msgr2=0x56472b96ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:07.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.918+0000 7f8172dcf740 1 -- 172.21.15.7:0/1079034340 shutdown_connections 2024-09-21T06:45:07.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.918+0000 7f8172dcf740 1 -- 172.21.15.7:0/1079034340 wait complete. 2024-09-21T06:45:07.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.918+0000 7f8172dcf740 1 -- start start 2024-09-21T06:45:07.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.918+0000 7f8172dcf740 1 Processor -- start 2024-09-21T06:45:07.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.919+0000 7f8172dcf740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56472b590490 0x56472b974910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:07.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.919+0000 7f8172dcf740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56472b598670 0x56472b974e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:07.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.919+0000 7f8172dcf740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56472b5b9350 0x56472b9ec0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:07.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.919+0000 7f8172dcf740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f81681ab9d0 con 0x56472b5b9350 2024-09-21T06:45:07.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.919+0000 7f8172dcf740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f81681ace40 con 0x56472b590490 2024-09-21T06:45:07.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.919+0000 7f8172dcf740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f81681ac0a0 con 0x56472b598670 2024-09-21T06:45:07.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.919+0000 7f8172dcf740 10 client.0 _ll_register_callbacks cb 0x7f815c009280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:07.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.919+0000 7f8165d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56472b5b9350 0x56472b9ec0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:07.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.919+0000 7f8165d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56472b5b9350 0x56472b9ec0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33946/0 (socket says 172.21.15.7:33946) 2024-09-21T06:45:07.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.919+0000 7f8165d9b640 1 -- 172.21.15.7:0/1720403262 learned_addr learned my addr 172.21.15.7:0/1720403262 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:07.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.919+0000 7f8165d9b640 1 --2- 172.21.15.7:0/1720403262 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56472b590490 0x56472b974910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:07.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.919+0000 7f816659c640 1 --2- 172.21.15.7:0/1720403262 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56472b598670 0x56472b974e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:07.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.919+0000 7f8165d9b640 1 -- 172.21.15.7:0/1720403262 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56472b598670 msgr2=0x56472b974e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:07.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.919+0000 7f8165d9b640 1 --2- 172.21.15.7:0/1720403262 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56472b598670 0x56472b974e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:07.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.919+0000 7f8165d9b640 1 -- 172.21.15.7:0/1720403262 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56472b590490 msgr2=0x56472b974910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:07.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.919+0000 7f8165d9b640 1 --2- 172.21.15.7:0/1720403262 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56472b590490 0x56472b974910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:07.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.919+0000 7f8165d9b640 1 -- 172.21.15.7:0/1720403262 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56472b9ec6b0 con 0x56472b5b9350 2024-09-21T06:45:07.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.919+0000 7f8165d9b640 1 --2- 172.21.15.7:0/1720403262 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56472b5b9350 0x56472b9ec0c0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x56472b982ce0 tx=0x7f815c013c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56cf63ed3816cacc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:07.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.919+0000 7f814dffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:45:07.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.920+0000 7f814dffb640 1 -- 172.21.15.7:0/1720403262 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f815c033040 con 0x56472b5b9350 2024-09-21T06:45:07.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.920+0000 7f814dffb640 1 -- 172.21.15.7:0/1720403262 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8412+0+0 (secure 0 0 0) 0x7f815c025da0 con 0x56472b5b9350 2024-09-21T06:45:07.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.920+0000 7f8172dcf740 1 -- 172.21.15.7:0/1720403262 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f815c020070 con 0x56472b5b9350 2024-09-21T06:45:07.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.920+0000 7f814dffb640 1 -- 172.21.15.7:0/1720403262 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f815c017440 con 0x56472b5b9350 2024-09-21T06:45:07.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.920+0000 7f8172dcf740 10 client.17388 fetch_fsmap learned FSMap version 25 2024-09-21T06:45:07.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.920+0000 7f8172dcf740 1 -- 172.21.15.7:0/1720403262 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56472b9ed950 con 0x56472b5b9350 2024-09-21T06:45:07.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.920+0000 7f814dffb640 1 -- 172.21.15.7:0/1720403262 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f815c020070 con 0x56472b5b9350 2024-09-21T06:45:07.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.920+0000 7f814dffb640 1 -- 172.21.15.7:0/1720403262 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f815c042070 con 0x56472b5b9350 2024-09-21T06:45:07.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.920+0000 7f8172dcf740 10 client.17388 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:45:07.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.920+0000 7f8172dcf740 10 client.17388 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:45:07.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.920+0000 7f8172dcf740 20 client.17388 populate_metadata read hostname 'smithi007' 2024-09-21T06:45:07.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.920+0000 7f8172dcf740 1 --2- 172.21.15.7:0/1720403262 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x56472b54d080 0x56472b9eff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:07.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.920+0000 7f8172dcf740 4 client.17388 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:45:07.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.920+0000 7f8172dcf740 1 -- 172.21.15.7:0/1720403262 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x56472b8d4860 con 0x56472b54d080 2024-09-21T06:45:07.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.921+0000 7f816659c640 1 --2- 172.21.15.7:0/1720403262 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x56472b54d080 0x56472b9eff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:07.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.921+0000 7f816659c640 1 --2- 172.21.15.7:0/1720403262 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x56472b54d080 0x56472b9eff40 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f261d9ea22cf8666 server_cookie=2eed4b70fe335519 in_seq=0 out_seq=0 2024-09-21T06:45:07.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.921+0000 7f814dffb640 10 client.17388 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:45:07.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.923+0000 7f814dffb640 1 -- 172.21.15.7:0/1720403262 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56472b8d4860 con 0x56472b54d080 2024-09-21T06:45:07.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.923+0000 7f814dffb640 10 client.17388 handle_command_reply: tid=0 2024-09-21T06:45:07.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.923+0000 7f8172dcf740 1 client.17388 shutdown 2024-09-21T06:45:07.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.923+0000 7f8172dcf740 1 -- 172.21.15.7:0/1720403262 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56472b5b9350 msgr2=0x56472b9ec0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:07.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.923+0000 7f8172dcf740 1 --2- 172.21.15.7:0/1720403262 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56472b5b9350 0x56472b9ec0c0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x56472b982ce0 tx=0x7f815c013c20 comp rx=0 tx=0).stop 2024-09-21T06:45:07.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.923+0000 7f8172dcf740 1 -- 172.21.15.7:0/1720403262 shutdown_connections 2024-09-21T06:45:07.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.923+0000 7f8172dcf740 1 --2- 172.21.15.7:0/1720403262 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x56472b54d080 0x56472b9eff40 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:07.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.923+0000 7f8172dcf740 1 --2- 172.21.15.7:0/1720403262 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x56472b5b9350 0x56472b9ec0c0 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:07.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.923+0000 7f8172dcf740 1 --2- 172.21.15.7:0/1720403262 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x56472b598670 0x56472b974e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:07.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.923+0000 7f8172dcf740 1 --2- 172.21.15.7:0/1720403262 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x56472b590490 0x56472b974910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:07.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.923+0000 7f8172dcf740 1 -- 172.21.15.7:0/1720403262 >> 172.21.15.7:0/1720403262 conn(0x56472b5ad740 msgr2=0x56472b96e630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:07.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.923+0000 7f814dffb640 0 client.17388 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:45:07.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.923+0000 7f8172dcf740 1 -- 172.21.15.7:0/1720403262 shutdown_connections 2024-09-21T06:45:07.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.923+0000 7f8172dcf740 1 -- 172.21.15.7:0/1720403262 wait complete. 2024-09-21T06:45:07.928 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.923+0000 7f8172dcf740 20 client.17388 trim_cache size 0 max 16384 2024-09-21T06:45:07.929 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:45:07.929 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0, 2024-09-21T06:45:07.929 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_tag": "a53a88e2-8599-4b25-a72c-3377770d50ea", 2024-09-21T06:45:07.929 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": "asynchronous" 2024-09-21T06:45:07.929 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:45:07.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.924+0000 7f816c85b640 1 -- 172.21.15.7:0/1442436062 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f81500b6680 msgr2=0x7f81500b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:07.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.924+0000 7f816c85b640 1 --2- 172.21.15.7:0/1442436062 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f81500b6680 0x7f81500b8b90 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f81600aa560 tx=0x7f816007a5d0 comp rx=0 tx=0).stop 2024-09-21T06:45:07.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.924+0000 7f816c85b640 1 -- 172.21.15.7:0/1442436062 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8168109df0 msgr2=0x7f816819fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:07.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.924+0000 7f816c85b640 1 --2- 172.21.15.7:0/1442436062 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8168109df0 0x7f816819fd40 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f8160009fd0 tx=0x7f816000def0 comp rx=0 tx=0).stop 2024-09-21T06:45:07.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.924+0000 7f816c85b640 1 -- 172.21.15.7:0/1442436062 shutdown_connections 2024-09-21T06:45:07.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.924+0000 7f816c85b640 1 --2- 172.21.15.7:0/1442436062 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f81500b6680 0x7f81500b8b90 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:07.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.924+0000 7f816c85b640 1 --2- 172.21.15.7:0/1442436062 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8168109df0 0x7f816819fd40 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:07.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.924+0000 7f816c85b640 1 --2- 172.21.15.7:0/1442436062 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f81681094a0 0x7f816819aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:07.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.924+0000 7f816c85b640 1 --2- 172.21.15.7:0/1442436062 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8168103b60 0x7f816819a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:07.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.924+0000 7f816c85b640 1 -- 172.21.15.7:0/1442436062 >> 172.21.15.7:0/1442436062 conn(0x7f816807b850 msgr2=0x7f8168107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:07.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.924+0000 7f816c85b640 1 -- 172.21.15.7:0/1442436062 shutdown_connections 2024-09-21T06:45:07.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:07.924+0000 7f816c85b640 1 -- 172.21.15.7:0/1442436062 wait complete. 2024-09-21T06:45:08.589 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:45:08 smithi007 ceph-mon[30983]: pgmap v591: 97 pgs: 97 active+clean; 3.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-21T06:45:08.714 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:45:08.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:45:08 smithi144 ceph-mon[34653]: pgmap v591: 97 pgs: 97 active+clean; 3.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-21T06:45:08.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:45:08 smithi018 ceph-mon[34477]: pgmap v591: 97 pgs: 97 active+clean; 3.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-21T06:45:08.973 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:45:09.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.478+0000 7f63553d8640 1 -- 172.21.15.7:0/2049086080 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f635010de40 msgr2=0x7f6350110330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:09.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.478+0000 7f63553d8640 1 --2- 172.21.15.7:0/2049086080 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f635010de40 0x7f6350110330 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f6348009ca0 tx=0x7f634802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:45:09.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.478+0000 7f63553d8640 1 -- 172.21.15.7:0/2049086080 shutdown_connections 2024-09-21T06:45:09.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.478+0000 7f63553d8640 1 --2- 172.21.15.7:0/2049086080 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f635010de40 0x7f6350110330 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:09.486 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.478+0000 7f63553d8640 1 --2- 172.21.15.7:0/2049086080 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6350105330 0x7f635010d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:09.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.478+0000 7f63553d8640 1 --2- 172.21.15.7:0/2049086080 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f63501049e0 0x7f6350104df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:09.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.478+0000 7f63553d8640 1 -- 172.21.15.7:0/2049086080 >> 172.21.15.7:0/2049086080 conn(0x7f6350079750 msgr2=0x7f6350079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:09.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.478+0000 7f63553d8640 1 -- 172.21.15.7:0/2049086080 shutdown_connections 2024-09-21T06:45:09.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.478+0000 7f63553d8640 1 -- 172.21.15.7:0/2049086080 wait complete. 2024-09-21T06:45:09.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.478+0000 7f63553d8640 1 Processor -- start 2024-09-21T06:45:09.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.479+0000 7f63553d8640 1 -- start start 2024-09-21T06:45:09.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.479+0000 7f63553d8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63501049e0 0x7f6350102720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:09.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.479+0000 7f63553d8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6350105330 0x7f6350102c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:09.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.479+0000 7f63553d8640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f635010de40 0x7f63501031a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:09.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.479+0000 7f63553d8640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6350113b40 con 0x7f63501049e0 2024-09-21T06:45:09.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.479+0000 7f63553d8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f63501139c0 con 0x7f6350105330 2024-09-21T06:45:09.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.479+0000 7f63553d8640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6350113cc0 con 0x7f635010de40 2024-09-21T06:45:09.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.479+0000 7f634effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63501049e0 0x7f6350102720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:09.487 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.479+0000 7f634effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63501049e0 0x7f6350102720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33970/0 (socket says 172.21.15.7:33970) 2024-09-21T06:45:09.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.479+0000 7f634effd640 1 -- 172.21.15.7:0/3042859063 learned_addr learned my addr 172.21.15.7:0/3042859063 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:09.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.479+0000 7f634f7fe640 1 --2- 172.21.15.7:0/3042859063 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f635010de40 0x7f63501031a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:09.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.479+0000 7f634e7fc640 1 --2- 172.21.15.7:0/3042859063 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6350105330 0x7f6350102c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:09.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.479+0000 7f634effd640 1 -- 172.21.15.7:0/3042859063 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f635010de40 msgr2=0x7f63501031a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:09.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.479+0000 7f634effd640 1 --2- 172.21.15.7:0/3042859063 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f635010de40 0x7f63501031a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:09.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.479+0000 7f634effd640 1 -- 172.21.15.7:0/3042859063 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6350105330 msgr2=0x7f6350102c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:09.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.479+0000 7f634effd640 1 --2- 172.21.15.7:0/3042859063 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6350105330 0x7f6350102c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:09.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.479+0000 7f634effd640 1 -- 172.21.15.7:0/3042859063 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63501a8870 con 0x7f63501049e0 2024-09-21T06:45:09.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.480+0000 7f634effd640 1 --2- 172.21.15.7:0/3042859063 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63501049e0 0x7f6350102720 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f634000b450 tx=0x7f634000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:09.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.480+0000 7f6337fff640 1 -- 172.21.15.7:0/3042859063 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6340015020 con 0x7f63501049e0 2024-09-21T06:45:09.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.480+0000 7f63553d8640 1 -- 172.21.15.7:0/3042859063 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63501a8b60 con 0x7f63501049e0 2024-09-21T06:45:09.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.480+0000 7f6337fff640 1 -- 172.21.15.7:0/3042859063 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6340011d40 con 0x7f63501049e0 2024-09-21T06:45:09.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.480+0000 7f6337fff640 1 -- 172.21.15.7:0/3042859063 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f634000f340 con 0x7f63501049e0 2024-09-21T06:45:09.488 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.480+0000 7f63553d8640 1 -- 172.21.15.7:0/3042859063 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63501a90a0 con 0x7f63501049e0 2024-09-21T06:45:09.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.482+0000 7f635b94c740 1 Processor -- start 2024-09-21T06:45:09.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.482+0000 7f635b94c740 1 -- start start 2024-09-21T06:45:09.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.482+0000 7f6337fff640 1 -- 172.21.15.7:0/3042859063 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f6340018020 con 0x7f63501049e0 2024-09-21T06:45:09.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.483+0000 7f635b94c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626f1dc8070 0x5626f216f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:09.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.483+0000 7f635b94c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626f1d9f1b0 0x5626f216fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:09.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.483+0000 7f635b94c740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5626f1da7390 0x5626f21700d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:09.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.483+0000 7f635b94c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5626f20e5e50 con 0x5626f1dc8070 2024-09-21T06:45:09.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.483+0000 7f635b94c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5626f20d5280 con 0x5626f1d9f1b0 2024-09-21T06:45:09.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.483+0000 7f635b94c740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5626f20d9090 con 0x5626f1da7390 2024-09-21T06:45:09.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.483+0000 7f634f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626f1dc8070 0x5626f216f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:09.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.483+0000 7f634f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626f1dc8070 0x5626f216f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33972/0 (socket says 172.21.15.7:33972) 2024-09-21T06:45:09.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.483+0000 7f634f7fe640 1 -- 172.21.15.7:0/3270630578 learned_addr learned my addr 172.21.15.7:0/3270630578 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:09.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.483+0000 7f634e7fc640 1 --2- 172.21.15.7:0/3270630578 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5626f1da7390 0x5626f21700d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:09.489 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.483+0000 7f634effd640 1 --2- 172.21.15.7:0/3270630578 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626f1d9f1b0 0x5626f216fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:09.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.483+0000 7f634f7fe640 1 -- 172.21.15.7:0/3270630578 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5626f1da7390 msgr2=0x5626f21700d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:09.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.483+0000 7f634f7fe640 1 --2- 172.21.15.7:0/3270630578 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5626f1da7390 0x5626f21700d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:09.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.483+0000 7f634f7fe640 1 -- 172.21.15.7:0/3270630578 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626f1d9f1b0 msgr2=0x5626f216fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:09.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.483+0000 7f634f7fe640 1 --2- 172.21.15.7:0/3270630578 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626f1d9f1b0 0x5626f216fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:09.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.483+0000 7f634f7fe640 1 -- 172.21.15.7:0/3270630578 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626f1e33650 con 0x5626f1dc8070 2024-09-21T06:45:09.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.483+0000 7f634effd640 1 --2- 172.21.15.7:0/3270630578 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626f1d9f1b0 0x5626f216fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:09.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.483+0000 7f634f7fe640 1 --2- 172.21.15.7:0/3270630578 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626f1dc8070 0x5626f216f650 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f6348009920 tx=0x7f6348009950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b97c5ee24284206d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:09.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.483+0000 7f6337fff640 1 --2- 172.21.15.7:0/3042859063 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f63380b6680 0x7f63380b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:09.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.484+0000 7f634effd640 1 --2- 172.21.15.7:0/3042859063 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f63380b6680 0x7f63380b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:09.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.484+0000 7f63357fa640 1 -- 172.21.15.7:0/3270630578 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6348031e30 con 0x5626f1dc8070 2024-09-21T06:45:09.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.484+0000 7f6337fff640 1 -- 172.21.15.7:0/3042859063 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8412+0+0 (secure 0 0 0) 0x7f63400e7070 con 0x7f63501049e0 2024-09-21T06:45:09.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.484+0000 7f63357fa640 1 -- 172.21.15.7:0/3270630578 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6348036030 con 0x5626f1dc8070 2024-09-21T06:45:09.490 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.484+0000 7f63357fa640 1 -- 172.21.15.7:0/3270630578 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63480042a0 con 0x5626f1dc8070 2024-09-21T06:45:09.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.485+0000 7f635b94c740 1 -- 172.21.15.7:0/3270630578 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626f1dc8070 msgr2=0x5626f216f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:09.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.485+0000 7f634effd640 1 --2- 172.21.15.7:0/3042859063 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f63380b6680 0x7f63380b8b90 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f63400e48e0 tx=0x7f63400047d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:09.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.485+0000 7f635b94c740 1 --2- 172.21.15.7:0/3270630578 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626f1dc8070 0x5626f216f650 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f6348009920 tx=0x7f6348009950 comp rx=0 tx=0).stop 2024-09-21T06:45:09.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.485+0000 7f635b94c740 1 -- 172.21.15.7:0/3270630578 shutdown_connections 2024-09-21T06:45:09.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.485+0000 7f635b94c740 1 --2- 172.21.15.7:0/3270630578 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5626f1da7390 0x5626f21700d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:09.494 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.485+0000 7f635b94c740 1 --2- 172.21.15.7:0/3270630578 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626f1d9f1b0 0x5626f216fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:09.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.485+0000 7f635b94c740 1 --2- 172.21.15.7:0/3270630578 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626f1dc8070 0x5626f216f650 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:09.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.485+0000 7f635b94c740 1 -- 172.21.15.7:0/3270630578 >> 172.21.15.7:0/3270630578 conn(0x5626f1dbc460 msgr2=0x5626f216d540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:09.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.485+0000 7f635b94c740 1 -- 172.21.15.7:0/3270630578 shutdown_connections 2024-09-21T06:45:09.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.485+0000 7f635b94c740 1 -- 172.21.15.7:0/3270630578 wait complete. 2024-09-21T06:45:09.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.485+0000 7f635b94c740 1 -- start start 2024-09-21T06:45:09.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.485+0000 7f635b94c740 1 Processor -- start 2024-09-21T06:45:09.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.486+0000 7f635b94c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626f1d9f1b0 0x5626f217adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:09.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.486+0000 7f635b94c740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5626f1da7390 0x5626f217b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:09.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.486+0000 7f635b94c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626f1dc8070 0x5626f2186f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:09.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.486+0000 7f635b94c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5626f1f36700 con 0x5626f1d9f1b0 2024-09-21T06:45:09.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.486+0000 7f635b94c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5626f2070110 con 0x5626f1dc8070 2024-09-21T06:45:09.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.486+0000 7f635b94c740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5626f217dc50 con 0x5626f1da7390 2024-09-21T06:45:09.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.486+0000 7f635b94c740 10 client.0 _ll_register_callbacks cb 0x5626f2089990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:09.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.486+0000 7f634f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626f1d9f1b0 0x5626f217adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:09.495 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.486+0000 7f634f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626f1d9f1b0 0x5626f217adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33978/0 (socket says 172.21.15.7:33978) 2024-09-21T06:45:09.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.486+0000 7f634f7fe640 1 -- 172.21.15.7:0/2870193333 learned_addr learned my addr 172.21.15.7:0/2870193333 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:09.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.486+0000 7f634e7fc640 1 --2- 172.21.15.7:0/2870193333 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5626f1da7390 0x5626f217b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:09.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.486+0000 7f634f7fe640 1 --2- 172.21.15.7:0/2870193333 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626f1dc8070 0x5626f2186f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:09.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.486+0000 7f634f7fe640 1 -- 172.21.15.7:0/2870193333 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5626f1da7390 msgr2=0x5626f217b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:09.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.486+0000 7f634f7fe640 1 --2- 172.21.15.7:0/2870193333 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5626f1da7390 0x5626f217b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:09.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.486+0000 7f634f7fe640 1 -- 172.21.15.7:0/2870193333 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626f1dc8070 msgr2=0x5626f2186f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:09.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.486+0000 7f634f7fe640 1 --2- 172.21.15.7:0/2870193333 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626f1dc8070 0x5626f2186f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:09.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.486+0000 7f634f7fe640 1 -- 172.21.15.7:0/2870193333 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626f209dc40 con 0x5626f1d9f1b0 2024-09-21T06:45:09.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.486+0000 7f634f7fe640 1 --2- 172.21.15.7:0/2870193333 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626f1d9f1b0 0x5626f217adb0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f6348005e30 tx=0x7f6348003e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9fe90af67a25ccb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:09.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.486+0000 7f6332ff5640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:45:09.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.487+0000 7f6332ff5640 1 -- 172.21.15.7:0/2870193333 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6348058060 con 0x5626f1d9f1b0 2024-09-21T06:45:09.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.487+0000 7f6332ff5640 1 -- 172.21.15.7:0/2870193333 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8412+0+0 (secure 0 0 0) 0x7f63480042c0 con 0x5626f1d9f1b0 2024-09-21T06:45:09.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.487+0000 7f635b94c740 1 -- 172.21.15.7:0/2870193333 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6348036030 con 0x5626f1d9f1b0 2024-09-21T06:45:09.496 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.487+0000 7f6332ff5640 1 -- 172.21.15.7:0/2870193333 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f63480044c0 con 0x5626f1d9f1b0 2024-09-21T06:45:09.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.487+0000 7f635b94c740 10 client.17400 fetch_fsmap learned FSMap version 25 2024-09-21T06:45:09.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.487+0000 7f635b94c740 1 -- 172.21.15.7:0/2870193333 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5626f21899c0 con 0x5626f1d9f1b0 2024-09-21T06:45:09.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.487+0000 7f6332ff5640 1 -- 172.21.15.7:0/2870193333 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6348036030 con 0x5626f1d9f1b0 2024-09-21T06:45:09.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.487+0000 7f6332ff5640 1 -- 172.21.15.7:0/2870193333 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f634805b070 con 0x5626f1d9f1b0 2024-09-21T06:45:09.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.487+0000 7f635b94c740 10 client.17400 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:45:09.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.487+0000 7f635b94c740 10 client.17400 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:45:09.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.487+0000 7f635b94c740 20 client.17400 populate_metadata read hostname 'smithi007' 2024-09-21T06:45:09.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.487+0000 7f635b94c740 1 --2- 172.21.15.7:0/2870193333 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5626f1d869f0 0x5626f218cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:09.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.487+0000 7f635b94c740 4 client.17400 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:45:09.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.487+0000 7f635b94c740 1 -- 172.21.15.7:0/2870193333 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5626f20e7da0 con 0x5626f1d869f0 2024-09-21T06:45:09.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.488+0000 7f634e7fc640 1 --2- 172.21.15.7:0/2870193333 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5626f1d869f0 0x5626f218cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:09.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.488+0000 7f6332ff5640 10 client.17400 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:45:09.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.488+0000 7f634e7fc640 1 --2- 172.21.15.7:0/2870193333 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5626f1d869f0 0x5626f218cd20 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f11210d56dd9e7a1 server_cookie=c7c8dad1880bd27a in_seq=0 out_seq=0 2024-09-21T06:45:09.497 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.489+0000 7f6332ff5640 1 -- 172.21.15.7:0/2870193333 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5626f20e7da0 con 0x5626f1d869f0 2024-09-21T06:45:09.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.489+0000 7f6332ff5640 10 client.17400 handle_command_reply: tid=0 2024-09-21T06:45:09.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.489+0000 7f635b94c740 1 client.17400 shutdown 2024-09-21T06:45:09.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.489+0000 7f635b94c740 1 -- 172.21.15.7:0/2870193333 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626f1d9f1b0 msgr2=0x5626f217adb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:09.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.489+0000 7f635b94c740 1 --2- 172.21.15.7:0/2870193333 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626f1d9f1b0 0x5626f217adb0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f6348005e30 tx=0x7f6348003e50 comp rx=0 tx=0).stop 2024-09-21T06:45:09.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.489+0000 7f635b94c740 1 -- 172.21.15.7:0/2870193333 shutdown_connections 2024-09-21T06:45:09.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.489+0000 7f635b94c740 1 --2- 172.21.15.7:0/2870193333 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5626f1d869f0 0x5626f218cd20 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:09.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.489+0000 7f635b94c740 1 --2- 172.21.15.7:0/2870193333 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626f1dc8070 0x5626f2186f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:09.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.489+0000 7f6332ff5640 0 client.17400 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:45:09.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.489+0000 7f635b94c740 1 --2- 172.21.15.7:0/2870193333 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5626f1da7390 0x5626f217b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:09.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.489+0000 7f635b94c740 1 --2- 172.21.15.7:0/2870193333 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626f1d9f1b0 0x5626f217adb0 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:09.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.489+0000 7f635b94c740 1 -- 172.21.15.7:0/2870193333 >> 172.21.15.7:0/2870193333 conn(0x5626f1dbc460 msgr2=0x5626f2172830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:09.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.489+0000 7f635b94c740 1 -- 172.21.15.7:0/2870193333 shutdown_connections 2024-09-21T06:45:09.498 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.489+0000 7f635b94c740 1 -- 172.21.15.7:0/2870193333 wait complete. 2024-09-21T06:45:09.499 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.490+0000 7f635b94c740 20 client.17400 trim_cache size 0 max 16384 2024-09-21T06:45:09.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.507+0000 7f635b94c740 1 Processor -- start 2024-09-21T06:45:09.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.507+0000 7f635b94c740 1 -- start start 2024-09-21T06:45:09.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.507+0000 7f635b94c740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5626f1d9f1b0 0x5626f217b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:09.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.507+0000 7f635b94c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626f1da7390 0x5626f217c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:09.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.507+0000 7f635b94c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626f1dc8070 0x5626f2177fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:09.510 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.507+0000 7f635b94c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f63501b40a0 con 0x5626f1da7390 2024-09-21T06:45:09.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.507+0000 7f635b94c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f63501b1970 con 0x5626f1dc8070 2024-09-21T06:45:09.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.507+0000 7f635b94c740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f63501af7e0 con 0x5626f1d9f1b0 2024-09-21T06:45:09.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.508+0000 7f634e7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626f1da7390 0x5626f217c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:09.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.508+0000 7f634e7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626f1da7390 0x5626f217c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33990/0 (socket says 172.21.15.7:33990) 2024-09-21T06:45:09.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.508+0000 7f634e7fc640 1 -- 172.21.15.7:0/283179250 learned_addr learned my addr 172.21.15.7:0/283179250 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:09.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.508+0000 7f634f7fe640 1 --2- 172.21.15.7:0/283179250 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5626f1d9f1b0 0x5626f217b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:09.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.508+0000 7f634f7fe640 1 --2- 172.21.15.7:0/283179250 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626f1dc8070 0x5626f2177fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:09.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.508+0000 7f634e7fc640 1 -- 172.21.15.7:0/283179250 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5626f1d9f1b0 msgr2=0x5626f217b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:09.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.508+0000 7f634e7fc640 1 --2- 172.21.15.7:0/283179250 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5626f1d9f1b0 0x5626f217b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:09.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.508+0000 7f634e7fc640 1 -- 172.21.15.7:0/283179250 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626f1dc8070 msgr2=0x5626f2177fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:09.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.508+0000 7f634e7fc640 1 --2- 172.21.15.7:0/283179250 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626f1dc8070 0x5626f2177fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:09.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.508+0000 7f634e7fc640 1 -- 172.21.15.7:0/283179250 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626f217d960 con 0x5626f1da7390 2024-09-21T06:45:09.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.508+0000 7f634f7fe640 1 --2- 172.21.15.7:0/283179250 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626f1dc8070 0x5626f2177fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:09.511 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.508+0000 7f634e7fc640 1 --2- 172.21.15.7:0/283179250 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626f1da7390 0x5626f217c9e0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x5626f20d5340 tx=0x7f63440118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc12ecbb4c9fd2ee server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:09.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.508+0000 7f6334ff9640 1 -- 172.21.15.7:0/283179250 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63440042f0 con 0x5626f1da7390 2024-09-21T06:45:09.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.508+0000 7f6334ff9640 1 -- 172.21.15.7:0/283179250 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6344004490 con 0x5626f1da7390 2024-09-21T06:45:09.512 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.508+0000 7f6334ff9640 1 -- 172.21.15.7:0/283179250 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f634401c800 con 0x5626f1da7390 2024-09-21T06:45:09.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.509+0000 7f635b94c740 1 -- 172.21.15.7:0/283179250 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626f1da7390 msgr2=0x5626f217c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:09.515 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.509+0000 7f635b94c740 1 --2- 172.21.15.7:0/283179250 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626f1da7390 0x5626f217c9e0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x5626f20d5340 tx=0x7f63440118d0 comp rx=0 tx=0).stop 2024-09-21T06:45:09.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.509+0000 7f635b94c740 1 -- 172.21.15.7:0/283179250 shutdown_connections 2024-09-21T06:45:09.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.509+0000 7f635b94c740 1 --2- 172.21.15.7:0/283179250 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626f1dc8070 0x5626f2177fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:09.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.509+0000 7f635b94c740 1 --2- 172.21.15.7:0/283179250 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626f1da7390 0x5626f217c9e0 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:09.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.509+0000 7f635b94c740 1 --2- 172.21.15.7:0/283179250 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5626f1d9f1b0 0x5626f217b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:09.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.509+0000 7f635b94c740 1 -- 172.21.15.7:0/283179250 >> 172.21.15.7:0/283179250 conn(0x5626f1dbc460 msgr2=0x5626f217c2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:09.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.509+0000 7f635b94c740 1 -- 172.21.15.7:0/283179250 shutdown_connections 2024-09-21T06:45:09.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.509+0000 7f635b94c740 1 -- 172.21.15.7:0/283179250 wait complete. 2024-09-21T06:45:09.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.510+0000 7f635b94c740 1 -- start start 2024-09-21T06:45:09.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.510+0000 7f635b94c740 1 Processor -- start 2024-09-21T06:45:09.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.510+0000 7f635b94c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626f1d9f1b0 0x5626f21efc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:09.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.510+0000 7f635b94c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626f1da7390 0x5626f21f0250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:09.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.510+0000 7f635b94c740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5626f1dc8070 0x5626f218fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:09.516 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.510+0000 7f635b94c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f63501afe30 con 0x5626f1da7390 2024-09-21T06:45:09.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.510+0000 7f635b94c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f63501b12a0 con 0x5626f1d9f1b0 2024-09-21T06:45:09.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.510+0000 7f635b94c740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f63501b0500 con 0x5626f1dc8070 2024-09-21T06:45:09.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.510+0000 7f635b94c740 10 client.0 _ll_register_callbacks cb 0x7f634400b3a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:09.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.510+0000 7f634e7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626f1da7390 0x5626f21f0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:09.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.510+0000 7f634e7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626f1da7390 0x5626f21f0250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:33992/0 (socket says 172.21.15.7:33992) 2024-09-21T06:45:09.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.510+0000 7f634e7fc640 1 -- 172.21.15.7:0/1314965818 learned_addr learned my addr 172.21.15.7:0/1314965818 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:09.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.510+0000 7f634f7fe640 1 --2- 172.21.15.7:0/1314965818 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626f1d9f1b0 0x5626f21efc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:09.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.510+0000 7f634f7fe640 1 --2- 172.21.15.7:0/1314965818 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5626f1dc8070 0x5626f218fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:09.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.510+0000 7f634e7fc640 1 -- 172.21.15.7:0/1314965818 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5626f1dc8070 msgr2=0x5626f218fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:09.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.510+0000 7f634e7fc640 1 --2- 172.21.15.7:0/1314965818 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5626f1dc8070 0x5626f218fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:09.517 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.510+0000 7f634e7fc640 1 -- 172.21.15.7:0/1314965818 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626f1d9f1b0 msgr2=0x5626f21efc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:09.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.510+0000 7f634e7fc640 1 --2- 172.21.15.7:0/1314965818 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626f1d9f1b0 0x5626f21efc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:09.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.510+0000 7f634e7fc640 1 -- 172.21.15.7:0/1314965818 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626f2190210 con 0x5626f1da7390 2024-09-21T06:45:09.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.510+0000 7f634f7fe640 1 --2- 172.21.15.7:0/1314965818 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626f1d9f1b0 0x5626f21efc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:09.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.511+0000 7f634e7fc640 1 --2- 172.21.15.7:0/1314965818 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626f1da7390 0x5626f21f0250 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f6344000c00 tx=0x7f6344004180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d717d032dc6fb4dd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:09.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.511+0000 7f6332ff5640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:45:09.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.511+0000 7f6332ff5640 1 -- 172.21.15.7:0/1314965818 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6344032060 con 0x5626f1da7390 2024-09-21T06:45:09.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.511+0000 7f6332ff5640 1 -- 172.21.15.7:0/1314965818 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8412+0+0 (secure 0 0 0) 0x7f6344003800 con 0x5626f1da7390 2024-09-21T06:45:09.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.511+0000 7f635b94c740 1 -- 172.21.15.7:0/1314965818 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6344004490 con 0x5626f1da7390 2024-09-21T06:45:09.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.511+0000 7f6332ff5640 1 -- 172.21.15.7:0/1314965818 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6344003a00 con 0x5626f1da7390 2024-09-21T06:45:09.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.511+0000 7f635b94c740 10 client.17406 fetch_fsmap learned FSMap version 25 2024-09-21T06:45:09.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.511+0000 7f635b94c740 1 -- 172.21.15.7:0/1314965818 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5626f21f7470 con 0x5626f1da7390 2024-09-21T06:45:09.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.511+0000 7f6332ff5640 1 -- 172.21.15.7:0/1314965818 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6344004490 con 0x5626f1da7390 2024-09-21T06:45:09.518 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.511+0000 7f6332ff5640 1 -- 172.21.15.7:0/1314965818 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f6344035020 con 0x5626f1da7390 2024-09-21T06:45:09.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.512+0000 7f635b94c740 10 client.17406 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:45:09.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.512+0000 7f635b94c740 10 client.17406 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:45:09.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.512+0000 7f635b94c740 20 client.17406 populate_metadata read hostname 'smithi007' 2024-09-21T06:45:09.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.512+0000 7f635b94c740 1 --2- 172.21.15.7:0/1314965818 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5626f1d5bda0 0x5626f21f9b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:09.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.512+0000 7f635b94c740 4 client.17406 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:45:09.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.512+0000 7f635b94c740 1 -- 172.21.15.7:0/1314965818 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5626f20e3850 con 0x5626f1d5bda0 2024-09-21T06:45:09.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.512+0000 7f634f7fe640 1 --2- 172.21.15.7:0/1314965818 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5626f1d5bda0 0x5626f21f9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:09.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.512+0000 7f634f7fe640 1 --2- 172.21.15.7:0/1314965818 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5626f1d5bda0 0x5626f21f9b20 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e36d26249829f36 server_cookie=29470e5b4ae5723 in_seq=0 out_seq=0 2024-09-21T06:45:09.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.512+0000 7f6332ff5640 10 client.17406 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:45:09.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.513+0000 7f6332ff5640 1 -- 172.21.15.7:0/1314965818 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4918 (crc 0 0 0) 0x5626f20e3850 con 0x5626f1d5bda0 2024-09-21T06:45:09.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.513+0000 7f6332ff5640 10 client.17406 handle_command_reply: tid=0 2024-09-21T06:45:09.519 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.513+0000 7f635b94c740 1 client.17406 shutdown 2024-09-21T06:45:09.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.513+0000 7f635b94c740 1 -- 172.21.15.7:0/1314965818 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626f1da7390 msgr2=0x5626f21f0250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:09.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.513+0000 7f635b94c740 1 --2- 172.21.15.7:0/1314965818 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626f1da7390 0x5626f21f0250 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f6344000c00 tx=0x7f6344004180 comp rx=0 tx=0).stop 2024-09-21T06:45:09.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.513+0000 7f635b94c740 1 -- 172.21.15.7:0/1314965818 shutdown_connections 2024-09-21T06:45:09.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.513+0000 7f635b94c740 1 --2- 172.21.15.7:0/1314965818 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5626f1d5bda0 0x5626f21f9b20 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:09.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.513+0000 7f635b94c740 1 --2- 172.21.15.7:0/1314965818 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5626f1dc8070 0x5626f218fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:09.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.513+0000 7f635b94c740 1 --2- 172.21.15.7:0/1314965818 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5626f1da7390 0x5626f21f0250 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:09.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.513+0000 7f635b94c740 1 --2- 172.21.15.7:0/1314965818 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5626f1d9f1b0 0x5626f21efc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:09.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.513+0000 7f635b94c740 1 -- 172.21.15.7:0/1314965818 >> 172.21.15.7:0/1314965818 conn(0x5626f1dbc460 msgr2=0x5626f21705b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:09.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.513+0000 7f6332ff5640 0 client.17406 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:45:09.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.513+0000 7f635b94c740 1 -- 172.21.15.7:0/1314965818 shutdown_connections 2024-09-21T06:45:09.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.513+0000 7f635b94c740 1 -- 172.21.15.7:0/1314965818 wait complete. 2024-09-21T06:45:09.520 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.513+0000 7f635b94c740 20 client.17406 trim_cache size 0 max 16384 2024-09-21T06:45:09.521 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:45:09.521 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "no active scrubs running", 2024-09-21T06:45:09.521 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": {}, 2024-09-21T06:45:09.521 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_stats": { 2024-09-21T06:45:09.521 INFO:teuthology.orchestra.run.smithi007.stdout: "d98b2d47-c2db-4811-8b3e-ec744a20d9d6": { 2024-09-21T06:45:09.521 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:44:03.790680+0000", 2024-09-21T06:45:09.521 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:09.521 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:09.521 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:09.521 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:09.521 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:09.521 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:09.522 INFO:teuthology.orchestra.run.smithi007.stdout: "310a0ec8-44bb-49ed-a534-3bc91cb1ee9d": { 2024-09-21T06:45:09.522 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:40:55.373968+0000", 2024-09-21T06:45:09.522 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:09.522 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:09.522 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:09.522 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:09.522 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:09.522 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:09.522 INFO:teuthology.orchestra.run.smithi007.stdout: "dd792920-08a1-482d-8961-5c6a6f131599": { 2024-09-21T06:45:09.522 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:43:53.390806+0000", 2024-09-21T06:45:09.522 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:09.522 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:09.523 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:09.523 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:09.523 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:09.523 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:09.523 INFO:teuthology.orchestra.run.smithi007.stdout: "13441782-2231-4713-8ebd-068a941de47f": { 2024-09-21T06:45:09.523 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:39:30.219006+0000", 2024-09-21T06:45:09.523 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:09.523 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:09.523 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:09.523 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:09.523 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:09.523 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:09.523 INFO:teuthology.orchestra.run.smithi007.stdout: "02016ff7-8cc2-467e-a465-f69400f702cb": { 2024-09-21T06:45:09.523 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:44:25.093423+0000", 2024-09-21T06:45:09.523 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:09.523 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:09.524 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:09.524 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:09.524 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:09.524 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:09.524 INFO:teuthology.orchestra.run.smithi007.stdout: "b0327167-8c41-4286-8afc-7f0780972fd7": { 2024-09-21T06:45:09.524 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:38:36.828657+0000", 2024-09-21T06:45:09.524 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:09.524 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:09.524 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:09.524 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:09.524 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:09.524 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:09.524 INFO:teuthology.orchestra.run.smithi007.stdout: "d7b6a90c-9ae1-4e02-93ad-335a7e9df1d7": { 2024-09-21T06:45:09.524 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:39:19.226139+0000", 2024-09-21T06:45:09.524 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:09.525 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:09.525 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:09.525 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:09.525 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:09.525 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:09.525 INFO:teuthology.orchestra.run.smithi007.stdout: "3f7283b7-f175-4023-9191-177660b3a6be": { 2024-09-21T06:45:09.525 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:44:14.422552+0000", 2024-09-21T06:45:09.525 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:09.525 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:09.525 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:09.525 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:09.525 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:09.525 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:09.526 INFO:teuthology.orchestra.run.smithi007.stdout: "6231e9c1-14a2-40b5-be3c-76d87a0d733b": { 2024-09-21T06:45:09.526 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:37:02.484812+0000", 2024-09-21T06:45:09.526 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:09.526 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:09.526 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:09.526 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:09.526 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:09.526 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:09.526 INFO:teuthology.orchestra.run.smithi007.stdout: "a1ae5b3b-f158-44be-8ef4-d70e9ba879cc": { 2024-09-21T06:45:09.526 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:41:37.568453+0000", 2024-09-21T06:45:09.526 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:09.526 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:09.526 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:09.526 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:09.527 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:09.527 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:09.527 INFO:teuthology.orchestra.run.smithi007.stdout: "62fca477-b241-45f5-8185-bc78aeb8b19f": { 2024-09-21T06:45:09.527 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:40:12.744488+0000", 2024-09-21T06:45:09.527 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:09.527 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:09.527 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:09.527 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:09.527 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:09.527 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:09.527 INFO:teuthology.orchestra.run.smithi007.stdout: "5cbaaba2-6ab1-4f83-abd6-8c6eef4b5c42": { 2024-09-21T06:45:09.527 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:37:46.566272+0000", 2024-09-21T06:45:09.527 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:09.527 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:09.528 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:09.528 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:09.528 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:09.528 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:09.528 INFO:teuthology.orchestra.run.smithi007.stdout: "b466f071-ab32-427c-a0ed-73edea33145e": { 2024-09-21T06:45:09.528 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:43:01.151440+0000", 2024-09-21T06:45:09.528 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:09.528 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:09.528 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:09.528 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:09.528 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:09.528 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:09.528 INFO:teuthology.orchestra.run.smithi007.stdout: "ef9eaabd-003a-44fb-8373-c854a9e15a71": { 2024-09-21T06:45:09.528 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:42:19.467946+0000", 2024-09-21T06:45:09.528 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:09.528 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:09.529 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:09.529 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:09.529 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:09.529 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:09.529 INFO:teuthology.orchestra.run.smithi007.stdout: "a53a88e2-8599-4b25-a72c-3377770d50ea": { 2024-09-21T06:45:09.529 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:45:07.921907+0000", 2024-09-21T06:45:09.529 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:09.529 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:09.529 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:09.529 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:09.529 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:09.529 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:09.529 INFO:teuthology.orchestra.run.smithi007.stdout: "0b89345c-1f00-4efe-8ee9-4cb17e43584c": { 2024-09-21T06:45:09.529 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:36:19.500334+0000", 2024-09-21T06:45:09.529 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:09.529 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:09.530 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:09.530 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:09.530 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:09.530 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:09.530 INFO:teuthology.orchestra.run.smithi007.stdout: "3c5b7f3f-e9b3-4d48-8154-2d7d4700992e": { 2024-09-21T06:45:09.530 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:43:43.120930+0000", 2024-09-21T06:45:09.530 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:09.530 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:09.530 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:09.530 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:09.530 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:09.530 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:45:09.530 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:45:09.530 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:45:09.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.514+0000 7f63553d8640 1 -- 172.21.15.7:0/3042859063 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f63380b6680 msgr2=0x7f63380b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:09.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.514+0000 7f63553d8640 1 --2- 172.21.15.7:0/3042859063 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f63380b6680 0x7f63380b8b90 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f63400e48e0 tx=0x7f63400047d0 comp rx=0 tx=0).stop 2024-09-21T06:45:09.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.514+0000 7f63553d8640 1 -- 172.21.15.7:0/3042859063 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63501049e0 msgr2=0x7f6350102720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:09.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.514+0000 7f63553d8640 1 --2- 172.21.15.7:0/3042859063 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63501049e0 0x7f6350102720 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f634000b450 tx=0x7f634000b910 comp rx=0 tx=0).stop 2024-09-21T06:45:09.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.514+0000 7f63553d8640 1 -- 172.21.15.7:0/3042859063 shutdown_connections 2024-09-21T06:45:09.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.514+0000 7f63553d8640 1 --2- 172.21.15.7:0/3042859063 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f63380b6680 0x7f63380b8b90 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:09.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.514+0000 7f63553d8640 1 --2- 172.21.15.7:0/3042859063 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f635010de40 0x7f63501031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:09.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.514+0000 7f63553d8640 1 --2- 172.21.15.7:0/3042859063 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6350105330 0x7f6350102c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:09.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.514+0000 7f63553d8640 1 --2- 172.21.15.7:0/3042859063 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f63501049e0 0x7f6350102720 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:09.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.514+0000 7f63553d8640 1 -- 172.21.15.7:0/3042859063 >> 172.21.15.7:0/3042859063 conn(0x7f6350079750 msgr2=0x7f6350107960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:09.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.514+0000 7f63553d8640 1 -- 172.21.15.7:0/3042859063 shutdown_connections 2024-09-21T06:45:09.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:09.514+0000 7f63553d8640 1 -- 172.21.15.7:0/3042859063 wait complete. 2024-09-21T06:45:09.691 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:45:09 smithi007 ceph-mon[30983]: scrub queued for path: / 2024-09-21T06:45:09.691 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:45:09 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T06:45:09.692 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:45:09 smithi007 ceph-mon[30983]: scrub summary: active paths [/] 2024-09-21T06:45:09.692 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:45:09 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T06:45:09.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:45:09 smithi144 ceph-mon[34653]: scrub queued for path: / 2024-09-21T06:45:09.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:45:09 smithi144 ceph-mon[34653]: scrub summary: idle+waiting paths [/] 2024-09-21T06:45:09.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:45:09 smithi144 ceph-mon[34653]: scrub summary: active paths [/] 2024-09-21T06:45:09.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:45:09 smithi144 ceph-mon[34653]: scrub summary: idle+waiting paths [/] 2024-09-21T06:45:09.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:45:09 smithi018 ceph-mon[34477]: scrub queued for path: / 2024-09-21T06:45:09.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:45:09 smithi018 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-21T06:45:09.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:45:09 smithi018 ceph-mon[34477]: scrub summary: active paths [/] 2024-09-21T06:45:09.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:45:09 smithi018 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-21T06:45:10.202 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:45:10.203 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:45:10.463 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:45:10.584 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:45:10 smithi007 ceph-mon[30983]: pgmap v592: 97 pgs: 97 active+clean; 3.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-21T06:45:10.584 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:45:10 smithi007 ceph-mon[30983]: scrub summary: idle 2024-09-21T06:45:10.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:45:10 smithi144 ceph-mon[34653]: pgmap v592: 97 pgs: 97 active+clean; 3.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-21T06:45:10.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:45:10 smithi144 ceph-mon[34653]: scrub summary: idle 2024-09-21T06:45:10.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:45:10 smithi018 ceph-mon[34477]: pgmap v592: 97 pgs: 97 active+clean; 3.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-21T06:45:10.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:45:10 smithi018 ceph-mon[34477]: scrub summary: idle 2024-09-21T06:45:10.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:10.918+0000 7fca3ccf4640 1 -- 172.21.15.7:0/925323980 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca381094a0 msgr2=0x7fca381098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:10.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:10.918+0000 7fca3ccf4640 1 --2- 172.21.15.7:0/925323980 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca381094a0 0x7fca381098b0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fca2c009ca0 tx=0x7fca2c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:45:10.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:10.918+0000 7fca3ccf4640 1 -- 172.21.15.7:0/925323980 shutdown_connections 2024-09-21T06:45:10.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:10.918+0000 7fca3ccf4640 1 --2- 172.21.15.7:0/925323980 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca38109df0 0x7fca38110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:10.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:10.918+0000 7fca3ccf4640 1 --2- 172.21.15.7:0/925323980 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca381094a0 0x7fca381098b0 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:10.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:10.918+0000 7fca3ccf4640 1 --2- 172.21.15.7:0/925323980 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fca38103b60 0x7fca38103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:10.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:10.918+0000 7fca3ccf4640 1 -- 172.21.15.7:0/925323980 >> 172.21.15.7:0/925323980 conn(0x7fca3807b850 msgr2=0x7fca3807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:10.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:10.918+0000 7fca3ccf4640 1 -- 172.21.15.7:0/925323980 shutdown_connections 2024-09-21T06:45:10.921 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:10.918+0000 7fca3ccf4640 1 -- 172.21.15.7:0/925323980 wait complete. 2024-09-21T06:45:10.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:10.919+0000 7fca3ccf4640 1 Processor -- start 2024-09-21T06:45:10.922 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:10.919+0000 7fca3ccf4640 1 -- start start 2024-09-21T06:45:10.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:10.920+0000 7fca3ccf4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca38103b60 0x7fca3819c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:10.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:10.920+0000 7fca3ccf4640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fca381094a0 0x7fca3819cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:10.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:10.920+0000 7fca3ccf4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca38109df0 0x7fca381a1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:10.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:10.920+0000 7fca3ccf4640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fca38113ab0 con 0x7fca38109df0 2024-09-21T06:45:10.923 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:10.920+0000 7fca3ccf4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fca38113930 con 0x7fca38103b60 2024-09-21T06:45:10.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:10.920+0000 7fca3ccf4640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fca38113c30 con 0x7fca381094a0 2024-09-21T06:45:10.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:10.920+0000 7fca36d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca38109df0 0x7fca381a1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:10.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:10.920+0000 7fca36d9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca38109df0 0x7fca381a1f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39230/0 (socket says 172.21.15.7:39230) 2024-09-21T06:45:10.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:10.920+0000 7fca36d9d640 1 -- 172.21.15.7:0/1045045567 learned_addr learned my addr 172.21.15.7:0/1045045567 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:10.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:10.920+0000 7fca35d9b640 1 --2- 172.21.15.7:0/1045045567 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fca381094a0 0x7fca3819cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:10.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:10.920+0000 7fca3659c640 1 --2- 172.21.15.7:0/1045045567 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca38103b60 0x7fca3819c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:10.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:10.920+0000 7fca36d9d640 1 -- 172.21.15.7:0/1045045567 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fca381094a0 msgr2=0x7fca3819cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:10.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:10.920+0000 7fca36d9d640 1 --2- 172.21.15.7:0/1045045567 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fca381094a0 0x7fca3819cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:10.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:10.920+0000 7fca36d9d640 1 -- 172.21.15.7:0/1045045567 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca38103b60 msgr2=0x7fca3819c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:10.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:10.920+0000 7fca36d9d640 1 --2- 172.21.15.7:0/1045045567 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca38103b60 0x7fca3819c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:10.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:10.920+0000 7fca36d9d640 1 -- 172.21.15.7:0/1045045567 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca381a2570 con 0x7fca38109df0 2024-09-21T06:45:10.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:10.920+0000 7fca35d9b640 1 --2- 172.21.15.7:0/1045045567 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fca381094a0 0x7fca3819cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:10.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:10.920+0000 7fca36d9d640 1 --2- 172.21.15.7:0/1045045567 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca38109df0 0x7fca381a1f00 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fca3000c970 tx=0x7fca3000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:10.924 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:10.920+0000 7fca277fe640 1 -- 172.21.15.7:0/1045045567 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca30007bb0 con 0x7fca38109df0 2024-09-21T06:45:10.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:10.921+0000 7fca277fe640 1 -- 172.21.15.7:0/1045045567 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca30007d50 con 0x7fca38109df0 2024-09-21T06:45:10.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:10.921+0000 7fca3ccf4640 1 -- 172.21.15.7:0/1045045567 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca381a2860 con 0x7fca38109df0 2024-09-21T06:45:10.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:10.921+0000 7fca277fe640 1 -- 172.21.15.7:0/1045045567 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca30018770 con 0x7fca38109df0 2024-09-21T06:45:10.925 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:10.921+0000 7fca3ccf4640 1 -- 172.21.15.7:0/1045045567 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca381a2d20 con 0x7fca38109df0 2024-09-21T06:45:10.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:10.922+0000 7fca3ccf4640 1 -- 172.21.15.7:0/1045045567 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca38104de0 con 0x7fca38109df0 2024-09-21T06:45:10.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:10.923+0000 7fca277fe640 1 -- 172.21.15.7:0/1045045567 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7fca3000f990 con 0x7fca38109df0 2024-09-21T06:45:10.926 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:10.924+0000 7fca277fe640 1 --2- 172.21.15.7:0/1045045567 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fca200b66b0 0x7fca200b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:10.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:10.924+0000 7fca3659c640 1 --2- 172.21.15.7:0/1045045567 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fca200b66b0 0x7fca200b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:10.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:10.924+0000 7fca277fe640 1 -- 172.21.15.7:0/1045045567 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8456+0+0 (secure 0 0 0) 0x7fca300e77b0 con 0x7fca38109df0 2024-09-21T06:45:10.927 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:10.925+0000 7fca3659c640 1 --2- 172.21.15.7:0/1045045567 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fca200b66b0 0x7fca200b8bc0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fca28005e10 tx=0x7fca28005da0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:10.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:10.928+0000 7fca277fe640 1 -- 172.21.15.7:0/1045045567 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fca30014030 con 0x7fca38109df0 2024-09-21T06:45:11.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:11.157+0000 7fca3ccf4640 1 -- 172.21.15.7:0/1045045567 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fca381a92a0 con 0x7fca38109df0 2024-09-21T06:45:11.159 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:11.158+0000 7fca277fe640 1 -- 172.21.15.7:0/1045045567 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11899 (secure 0 0 0) 0x7fca300add40 con 0x7fca38109df0 2024-09-21T06:45:11.160 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:45:11.160 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-21T06:36:10:753693+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2015971546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2015971546},{"type":"v1","addr":"172.21.15.7:6835","nonce":2015971546}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/2350816224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":2350816224},{"type":"v1","addr":"172.21.15.7:6837","nonce":2350816224}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14823,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/1669980572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":1669980572},{"type":"v1","addr":"172.21.15.7:6839","nonce":1669980572}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14835,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/2528308973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":2528308973},{"type":"v1","addr":"172.21.15.7:6841","nonce":2528308973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24623,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1337382979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1337382979},{"type":"v1","addr":"172.21.15.18:6833","nonce":1337382979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/2751454345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":2751454345},{"type":"v1","addr":"172.21.15.144:6833","nonce":2751454345}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:34:24.627168+0000","modified":"2024-09-21T06:36:10.737288+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24716,"mds_1":24688,"mds_2":24686},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24656":{"gid":24656,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6835/158884796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":158884796},{"type":"v1","addr":"172.21.15.18:6835","nonce":158884796}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6835/3636739922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3636739922},{"type":"v1","addr":"172.21.15.144:6835","nonce":3636739922}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24673":{"gid":24673,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6837/1126341753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":1126341753},{"type":"v1","addr":"172.21.15.144:6837","nonce":1126341753}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.18:6837/1539670694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1539670694},{"type":"v1","addr":"172.21.15.18:6837","nonce":1539670694}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24688":{"gid":24688,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.144:6839/4027821922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":4027821922},{"type":"v1","addr":"172.21.15.144:6839","nonce":4027821922}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24716":{"gid":24716,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.18:6839/3798713532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":3798713532},{"type":"v1","addr":"172.21.15.18:6839","nonce":3798713532}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24716,"qdb_cluster":[24716,24688,24686]},"id":1}]} 2024-09-21T06:45:11.160 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-21T06:45:11.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:11.160+0000 7fca3ccf4640 1 -- 172.21.15.7:0/1045045567 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fca200b66b0 msgr2=0x7fca200b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:11.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:11.160+0000 7fca3ccf4640 1 --2- 172.21.15.7:0/1045045567 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fca200b66b0 0x7fca200b8bc0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fca28005e10 tx=0x7fca28005da0 comp rx=0 tx=0).stop 2024-09-21T06:45:11.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:11.160+0000 7fca3ccf4640 1 -- 172.21.15.7:0/1045045567 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca38109df0 msgr2=0x7fca381a1f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:11.162 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:11.160+0000 7fca3ccf4640 1 --2- 172.21.15.7:0/1045045567 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca38109df0 0x7fca381a1f00 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fca3000c970 tx=0x7fca3000ce30 comp rx=0 tx=0).stop 2024-09-21T06:45:11.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:11.160+0000 7fca3ccf4640 1 -- 172.21.15.7:0/1045045567 shutdown_connections 2024-09-21T06:45:11.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:11.160+0000 7fca3ccf4640 1 --2- 172.21.15.7:0/1045045567 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fca200b66b0 0x7fca200b8bc0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:11.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:11.160+0000 7fca3ccf4640 1 --2- 172.21.15.7:0/1045045567 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fca38109df0 0x7fca381a1f00 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:11.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:11.160+0000 7fca3ccf4640 1 --2- 172.21.15.7:0/1045045567 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fca381094a0 0x7fca3819cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:11.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:11.160+0000 7fca3ccf4640 1 --2- 172.21.15.7:0/1045045567 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca38103b60 0x7fca3819c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:11.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:11.160+0000 7fca3ccf4640 1 -- 172.21.15.7:0/1045045567 >> 172.21.15.7:0/1045045567 conn(0x7fca3807b850 msgr2=0x7fca381052d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:11.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:11.160+0000 7fca3ccf4640 1 -- 172.21.15.7:0/1045045567 shutdown_connections 2024-09-21T06:45:11.163 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:11.160+0000 7fca3ccf4640 1 -- 172.21.15.7:0/1045045567 wait complete. 2024-09-21T06:45:11.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:45:11 smithi144 ceph-mon[34653]: osdmap e82: 12 total, 12 up, 12 in 2024-09-21T06:45:11.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:45:11 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/1045045567' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:45:11.839 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:45:11 smithi007 ceph-mon[30983]: osdmap e82: 12 total, 12 up, 12 in 2024-09-21T06:45:11.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:45:11 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/1045045567' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:45:11.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:45:11 smithi018 ceph-mon[34477]: osdmap e82: 12 total, 12 up, 12 in 2024-09-21T06:45:11.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:45:11 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/1045045567' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:45:12.075 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:45:12.331 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:45:12.731 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:45:12 smithi007 ceph-mon[30983]: pgmap v594: 97 pgs: 97 active+clean; 3.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-21T06:45:12.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:45:12 smithi144 ceph-mon[34653]: pgmap v594: 97 pgs: 97 active+clean; 3.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-21T06:45:12.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.823+0000 7f13d5cd9640 1 -- 172.21.15.7:0/2706149291 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f13d010de20 msgr2=0x7f13d0110310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:12.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.823+0000 7f13d5cd9640 1 --2- 172.21.15.7:0/2706149291 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f13d010de20 0x7f13d0110310 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f13c8009ca0 tx=0x7f13c802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:45:12.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.824+0000 7f13d5cd9640 1 -- 172.21.15.7:0/2706149291 shutdown_connections 2024-09-21T06:45:12.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.824+0000 7f13d5cd9640 1 --2- 172.21.15.7:0/2706149291 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f13d010de20 0x7f13d0110310 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:12.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.824+0000 7f13d5cd9640 1 --2- 172.21.15.7:0/2706149291 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13d0105310 0x7f13d010d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:12.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.824+0000 7f13d5cd9640 1 --2- 172.21.15.7:0/2706149291 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13d01049c0 0x7f13d0104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:12.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.824+0000 7f13d5cd9640 1 -- 172.21.15.7:0/2706149291 >> 172.21.15.7:0/2706149291 conn(0x7f13d0079710 msgr2=0x7f13d0079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:12.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.824+0000 7f13d5cd9640 1 -- 172.21.15.7:0/2706149291 shutdown_connections 2024-09-21T06:45:12.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.824+0000 7f13d5cd9640 1 -- 172.21.15.7:0/2706149291 wait complete. 2024-09-21T06:45:12.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.824+0000 7f13d5cd9640 1 Processor -- start 2024-09-21T06:45:12.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.825+0000 7f13d5cd9640 1 -- start start 2024-09-21T06:45:12.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.825+0000 7f13d5cd9640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13d01049c0 0x7f13d0102700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:12.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.825+0000 7f13d5cd9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f13d0105310 0x7f13d0102c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:12.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.825+0000 7f13d5cd9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13d010de20 0x7f13d0103180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:12.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.825+0000 7f13d5cd9640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f13d0113a80 con 0x7f13d0105310 2024-09-21T06:45:12.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.825+0000 7f13d5cd9640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f13d0113900 con 0x7f13d010de20 2024-09-21T06:45:12.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.825+0000 7f13d5cd9640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f13d0113c00 con 0x7f13d01049c0 2024-09-21T06:45:12.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.825+0000 7f13ceffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f13d0105310 0x7f13d0102c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:12.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.825+0000 7f13ceffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f13d0105310 0x7f13d0102c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39252/0 (socket says 172.21.15.7:39252) 2024-09-21T06:45:12.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.825+0000 7f13ceffd640 1 -- 172.21.15.7:0/4008604367 learned_addr learned my addr 172.21.15.7:0/4008604367 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:12.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.825+0000 7f13cffff640 1 --2- 172.21.15.7:0/4008604367 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13d010de20 0x7f13d0103180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:12.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.825+0000 7f13cf7fe640 1 --2- 172.21.15.7:0/4008604367 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13d01049c0 0x7f13d0102700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:12.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.825+0000 7f13ceffd640 1 -- 172.21.15.7:0/4008604367 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13d01049c0 msgr2=0x7f13d0102700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:12.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.825+0000 7f13ceffd640 1 --2- 172.21.15.7:0/4008604367 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13d01049c0 0x7f13d0102700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:12.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.825+0000 7f13ceffd640 1 -- 172.21.15.7:0/4008604367 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13d010de20 msgr2=0x7f13d0103180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:12.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.825+0000 7f13ceffd640 1 --2- 172.21.15.7:0/4008604367 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13d010de20 0x7f13d0103180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:12.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.825+0000 7f13ceffd640 1 -- 172.21.15.7:0/4008604367 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13d01a86d0 con 0x7f13d0105310 2024-09-21T06:45:12.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.825+0000 7f13cf7fe640 1 --2- 172.21.15.7:0/4008604367 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13d01049c0 0x7f13d0102700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:45:12.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.826+0000 7f13ceffd640 1 --2- 172.21.15.7:0/4008604367 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f13d0105310 0x7f13d0102c40 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f13c400d740 tx=0x7f13c400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:12.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.826+0000 7f13ccff9640 1 -- 172.21.15.7:0/4008604367 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c4017070 con 0x7f13d0105310 2024-09-21T06:45:12.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.826+0000 7f13ccff9640 1 -- 172.21.15.7:0/4008604367 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f13c400de50 con 0x7f13d0105310 2024-09-21T06:45:12.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.826+0000 7f13d5cd9640 1 -- 172.21.15.7:0/4008604367 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13d01a89c0 con 0x7f13d0105310 2024-09-21T06:45:12.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.826+0000 7f13ccff9640 1 -- 172.21.15.7:0/4008604367 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c400f620 con 0x7f13d0105310 2024-09-21T06:45:12.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.826+0000 7f13d5cd9640 1 -- 172.21.15.7:0/4008604367 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13d01a8f00 con 0x7f13d0105310 2024-09-21T06:45:12.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.828+0000 7f13dc24d740 1 Processor -- start 2024-09-21T06:45:12.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.828+0000 7f13dc24d740 1 -- start start 2024-09-21T06:45:12.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.829+0000 7f13ccff9640 1 -- 172.21.15.7:0/4008604367 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f13c401a070 con 0x7f13d0105310 2024-09-21T06:45:12.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.829+0000 7f13dc24d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ac2d6df070 0x55ac2da866a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:12.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.829+0000 7f13dc24d740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ac2d6b61b0 0x55ac2da86be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:12.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.829+0000 7f13dc24d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ac2d6be390 0x55ac2da87120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:12.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.829+0000 7f13dc24d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55ac2d9fcea0 con 0x55ac2d6df070 2024-09-21T06:45:12.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.829+0000 7f13dc24d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55ac2d9ec2d0 con 0x55ac2d6be390 2024-09-21T06:45:12.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.829+0000 7f13dc24d740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55ac2d9f00e0 con 0x55ac2d6b61b0 2024-09-21T06:45:12.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.829+0000 7f13cffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ac2d6df070 0x55ac2da866a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:12.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.829+0000 7f13cffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ac2d6df070 0x55ac2da866a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39258/0 (socket says 172.21.15.7:39258) 2024-09-21T06:45:12.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.829+0000 7f13cffff640 1 -- 172.21.15.7:0/2081612140 learned_addr learned my addr 172.21.15.7:0/2081612140 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:12.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.829+0000 7f13cf7fe640 1 --2- 172.21.15.7:0/2081612140 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ac2d6b61b0 0x55ac2da86be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:12.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.829+0000 7f13cffff640 1 -- 172.21.15.7:0/2081612140 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ac2d6b61b0 msgr2=0x55ac2da86be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:12.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.829+0000 7f13cffff640 1 --2- 172.21.15.7:0/2081612140 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ac2d6b61b0 0x55ac2da86be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:12.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.829+0000 7f13cffff640 1 -- 172.21.15.7:0/2081612140 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ac2d6be390 msgr2=0x55ac2da87120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:12.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.829+0000 7f13ceffd640 1 --2- 172.21.15.7:0/2081612140 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ac2d6be390 0x55ac2da87120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:12.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.829+0000 7f13cffff640 1 --2- 172.21.15.7:0/2081612140 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ac2d6be390 0x55ac2da87120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:12.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.829+0000 7f13cffff640 1 -- 172.21.15.7:0/2081612140 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac2d74a650 con 0x55ac2d6df070 2024-09-21T06:45:12.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.829+0000 7f13cf7fe640 1 --2- 172.21.15.7:0/2081612140 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ac2d6b61b0 0x55ac2da86be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:12.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.829+0000 7f13ceffd640 1 --2- 172.21.15.7:0/2081612140 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ac2d6be390 0x55ac2da87120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:45:12.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.829+0000 7f13cffff640 1 --2- 172.21.15.7:0/2081612140 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ac2d6df070 0x55ac2da866a0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f13c80098b0 tx=0x7f13c80098e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3aba269ebb934680 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:12.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.830+0000 7f13ccff9640 1 --2- 172.21.15.7:0/4008604367 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f13b80b6680 0x7f13b80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:12.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.830+0000 7f13b5ffb640 1 -- 172.21.15.7:0/2081612140 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c8031cf0 con 0x55ac2d6df070 2024-09-21T06:45:12.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.830+0000 7f13b5ffb640 1 -- 172.21.15.7:0/2081612140 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f13c8036030 con 0x55ac2d6df070 2024-09-21T06:45:12.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.830+0000 7f13b5ffb640 1 -- 172.21.15.7:0/2081612140 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c80042a0 con 0x55ac2d6df070 2024-09-21T06:45:12.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.830+0000 7f13cf7fe640 1 --2- 172.21.15.7:0/4008604367 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f13b80b6680 0x7f13b80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:12.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.830+0000 7f13ccff9640 1 -- 172.21.15.7:0/4008604367 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8456+0+0 (secure 0 0 0) 0x7f13c40e70e0 con 0x7f13d0105310 2024-09-21T06:45:12.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.831+0000 7f13dc24d740 1 -- 172.21.15.7:0/2081612140 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ac2d6df070 msgr2=0x55ac2da866a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:12.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.831+0000 7f13cf7fe640 1 --2- 172.21.15.7:0/4008604367 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f13b80b6680 0x7f13b80b8b90 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x55ac2da85320 tx=0x7f13c00093f0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:12.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.831+0000 7f13dc24d740 1 --2- 172.21.15.7:0/2081612140 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ac2d6df070 0x55ac2da866a0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f13c80098b0 tx=0x7f13c80098e0 comp rx=0 tx=0).stop 2024-09-21T06:45:12.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.831+0000 7f13dc24d740 1 -- 172.21.15.7:0/2081612140 shutdown_connections 2024-09-21T06:45:12.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.831+0000 7f13dc24d740 1 --2- 172.21.15.7:0/2081612140 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ac2d6be390 0x55ac2da87120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:12.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.831+0000 7f13dc24d740 1 --2- 172.21.15.7:0/2081612140 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ac2d6b61b0 0x55ac2da86be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:12.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.831+0000 7f13dc24d740 1 --2- 172.21.15.7:0/2081612140 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ac2d6df070 0x55ac2da866a0 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:12.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.831+0000 7f13dc24d740 1 -- 172.21.15.7:0/2081612140 >> 172.21.15.7:0/2081612140 conn(0x55ac2d6d3460 msgr2=0x55ac2da84590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:12.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.831+0000 7f13dc24d740 1 -- 172.21.15.7:0/2081612140 shutdown_connections 2024-09-21T06:45:12.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.831+0000 7f13dc24d740 1 -- 172.21.15.7:0/2081612140 wait complete. 2024-09-21T06:45:12.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.831+0000 7f13dc24d740 1 -- start start 2024-09-21T06:45:12.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.831+0000 7f13dc24d740 1 Processor -- start 2024-09-21T06:45:12.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.832+0000 7f13dc24d740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ac2d6b61b0 0x55ac2da91d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:12.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.832+0000 7f13dc24d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ac2d6be390 0x55ac2da922c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:12.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.832+0000 7f13dc24d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ac2d6df070 0x55ac2da9dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:12.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.832+0000 7f13dc24d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55ac2d84d700 con 0x55ac2d6be390 2024-09-21T06:45:12.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.832+0000 7f13dc24d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55ac2d987160 con 0x55ac2d6df070 2024-09-21T06:45:12.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.832+0000 7f13dc24d740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55ac2da94ca0 con 0x55ac2d6b61b0 2024-09-21T06:45:12.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.832+0000 7f13dc24d740 10 client.0 _ll_register_callbacks cb 0x55ac2d9a09e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:12.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.832+0000 7f13ceffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ac2d6be390 0x55ac2da922c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:12.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.832+0000 7f13ceffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ac2d6be390 0x55ac2da922c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39260/0 (socket says 172.21.15.7:39260) 2024-09-21T06:45:12.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.832+0000 7f13ceffd640 1 -- 172.21.15.7:0/2520586152 learned_addr learned my addr 172.21.15.7:0/2520586152 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:12.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.832+0000 7f13cffff640 1 --2- 172.21.15.7:0/2520586152 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ac2d6df070 0x55ac2da9dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:12.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.832+0000 7f13cf7fe640 1 --2- 172.21.15.7:0/2520586152 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ac2d6b61b0 0x55ac2da91d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:12.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.832+0000 7f13ceffd640 1 -- 172.21.15.7:0/2520586152 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ac2d6b61b0 msgr2=0x55ac2da91d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:12.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.832+0000 7f13ceffd640 1 --2- 172.21.15.7:0/2520586152 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ac2d6b61b0 0x55ac2da91d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:12.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.832+0000 7f13ceffd640 1 -- 172.21.15.7:0/2520586152 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ac2d6df070 msgr2=0x55ac2da9dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:12.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.832+0000 7f13ceffd640 1 --2- 172.21.15.7:0/2520586152 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ac2d6df070 0x55ac2da9dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:12.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.832+0000 7f13ceffd640 1 -- 172.21.15.7:0/2520586152 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac2d9b4c90 con 0x55ac2d6be390 2024-09-21T06:45:12.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.833+0000 7f13ceffd640 1 --2- 172.21.15.7:0/2520586152 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ac2d6be390 0x55ac2da922c0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f13c4009610 tx=0x7f13c40acd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26b1b3a69e4ccc9e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:12.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.833+0000 7f13aeffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:45:12.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.833+0000 7f13aeffd640 1 -- 172.21.15.7:0/2520586152 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c4021030 con 0x55ac2d6be390 2024-09-21T06:45:12.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.833+0000 7f13aeffd640 1 -- 172.21.15.7:0/2520586152 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8456+0+0 (secure 0 0 0) 0x7f13c40e92d0 con 0x55ac2d6be390 2024-09-21T06:45:12.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.833+0000 7f13dc24d740 1 -- 172.21.15.7:0/2520586152 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f13c8036030 con 0x55ac2d6be390 2024-09-21T06:45:12.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.833+0000 7f13aeffd640 1 -- 172.21.15.7:0/2520586152 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f13c40ac6e0 con 0x55ac2d6be390 2024-09-21T06:45:12.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.833+0000 7f13dc24d740 10 client.17424 fetch_fsmap learned FSMap version 25 2024-09-21T06:45:12.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.833+0000 7f13dc24d740 1 -- 172.21.15.7:0/2520586152 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ac2daa0910 con 0x55ac2d6be390 2024-09-21T06:45:12.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.833+0000 7f13aeffd640 1 -- 172.21.15.7:0/2520586152 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f13c8036030 con 0x55ac2d6be390 2024-09-21T06:45:12.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.833+0000 7f13aeffd640 1 -- 172.21.15.7:0/2520586152 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f13c40a88c0 con 0x55ac2d6be390 2024-09-21T06:45:12.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.833+0000 7f13dc24d740 10 client.17424 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:45:12.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.833+0000 7f13dc24d740 10 client.17424 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-21T06:45:12.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.833+0000 7f13dc24d740 20 client.17424 populate_metadata read hostname 'smithi007' 2024-09-21T06:45:12.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.833+0000 7f13dc24d740 1 --2- 172.21.15.7:0/2520586152 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x55ac2d69d9f0 0x55ac2daa3e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:12.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.833+0000 7f13dc24d740 4 client.17424 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:45:12.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.833+0000 7f13dc24d740 1 -- 172.21.15.7:0/2520586152 --> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ac2d9fedf0 con 0x55ac2d69d9f0 2024-09-21T06:45:12.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.834+0000 7f13cf7fe640 1 --2- 172.21.15.7:0/2520586152 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x55ac2d69d9f0 0x55ac2daa3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:12.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.834+0000 7f13aeffd640 10 client.17424 ms_handle_connect on v2:172.21.15.18:6836/1539670694 2024-09-21T06:45:12.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.834+0000 7f13cf7fe640 1 --2- 172.21.15.7:0/2520586152 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x55ac2d69d9f0 0x55ac2daa3e80 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d454c9ffc3e3ce4a server_cookie=c066f9e1cfa5f587 in_seq=0 out_seq=0 2024-09-21T06:45:12.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.835+0000 7f13aeffd640 1 -- 172.21.15.7:0/2520586152 <== mds.2 v2:172.21.15.18:6836/1539670694 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ac2d9fedf0 con 0x55ac2d69d9f0 2024-09-21T06:45:12.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.835+0000 7f13aeffd640 10 client.17424 handle_command_reply: tid=0 2024-09-21T06:45:12.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.835+0000 7f13dc24d740 1 client.17424 shutdown 2024-09-21T06:45:12.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.835+0000 7f13dc24d740 1 -- 172.21.15.7:0/2520586152 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ac2d6be390 msgr2=0x55ac2da922c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:12.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.835+0000 7f13dc24d740 1 --2- 172.21.15.7:0/2520586152 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ac2d6be390 0x55ac2da922c0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f13c4009610 tx=0x7f13c40acd40 comp rx=0 tx=0).stop 2024-09-21T06:45:12.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.835+0000 7f13dc24d740 1 -- 172.21.15.7:0/2520586152 shutdown_connections 2024-09-21T06:45:12.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.835+0000 7f13dc24d740 1 --2- 172.21.15.7:0/2520586152 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x55ac2d69d9f0 0x55ac2daa3e80 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:12.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.835+0000 7f13dc24d740 1 --2- 172.21.15.7:0/2520586152 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ac2d6df070 0x55ac2da9dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:12.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.835+0000 7f13dc24d740 1 --2- 172.21.15.7:0/2520586152 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ac2d6be390 0x55ac2da922c0 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:12.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.835+0000 7f13aeffd640 0 client.17424 ms_handle_reset on v2:172.21.15.18:6836/1539670694 2024-09-21T06:45:12.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.835+0000 7f13dc24d740 1 --2- 172.21.15.7:0/2520586152 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ac2d6b61b0 0x55ac2da91d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:12.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.835+0000 7f13dc24d740 1 -- 172.21.15.7:0/2520586152 >> 172.21.15.7:0/2520586152 conn(0x55ac2d6d3460 msgr2=0x55ac2da89880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:12.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.835+0000 7f13dc24d740 1 -- 172.21.15.7:0/2520586152 shutdown_connections 2024-09-21T06:45:12.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.835+0000 7f13dc24d740 1 -- 172.21.15.7:0/2520586152 wait complete. 2024-09-21T06:45:12.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.835+0000 7f13dc24d740 20 client.17424 trim_cache size 0 max 16384 2024-09-21T06:45:12.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.849+0000 7f13dc24d740 1 Processor -- start 2024-09-21T06:45:12.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.849+0000 7f13dc24d740 1 -- start start 2024-09-21T06:45:12.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.849+0000 7f13dc24d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ac2d6b61b0 0x55ac2da88090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:12.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.849+0000 7f13dc24d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ac2d6be390 0x55ac2da939b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:12.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.849+0000 7f13dc24d740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ac2d6df070 0x55ac2da9dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:12.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.849+0000 7f13dc24d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f13d01b4070 con 0x55ac2d6be390 2024-09-21T06:45:12.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.849+0000 7f13dc24d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f13d01b1940 con 0x55ac2d6b61b0 2024-09-21T06:45:12.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.849+0000 7f13dc24d740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f13d01af7b0 con 0x55ac2d6df070 2024-09-21T06:45:12.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.849+0000 7f13ceffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ac2d6be390 0x55ac2da939b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:12.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.849+0000 7f13ceffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ac2d6be390 0x55ac2da939b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39276/0 (socket says 172.21.15.7:39276) 2024-09-21T06:45:12.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.849+0000 7f13ceffd640 1 -- 172.21.15.7:0/505695960 learned_addr learned my addr 172.21.15.7:0/505695960 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:12.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.849+0000 7f13cf7fe640 1 --2- 172.21.15.7:0/505695960 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ac2d6b61b0 0x55ac2da88090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:12.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.849+0000 7f13cffff640 1 --2- 172.21.15.7:0/505695960 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ac2d6df070 0x55ac2da9dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:12.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.849+0000 7f13ceffd640 1 -- 172.21.15.7:0/505695960 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ac2d6df070 msgr2=0x55ac2da9dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:12.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.849+0000 7f13ceffd640 1 --2- 172.21.15.7:0/505695960 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ac2d6df070 0x55ac2da9dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:12.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.849+0000 7f13ceffd640 1 -- 172.21.15.7:0/505695960 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ac2d6b61b0 msgr2=0x55ac2da88090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:12.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.849+0000 7f13ceffd640 1 --2- 172.21.15.7:0/505695960 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ac2d6b61b0 0x55ac2da88090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:12.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.849+0000 7f13ceffd640 1 -- 172.21.15.7:0/505695960 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac2da90280 con 0x55ac2d6be390 2024-09-21T06:45:12.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.849+0000 7f13cffff640 1 --2- 172.21.15.7:0/505695960 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ac2d6df070 0x55ac2da9dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:45:12.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.850+0000 7f13ceffd640 1 --2- 172.21.15.7:0/505695960 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ac2d6be390 0x55ac2da939b0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f13c40e7490 tx=0x7f13c40ace70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e36ef9b58804348 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:12.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.850+0000 7f13b57fa640 1 -- 172.21.15.7:0/505695960 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c4021070 con 0x55ac2d6be390 2024-09-21T06:45:12.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.850+0000 7f13b57fa640 1 -- 172.21.15.7:0/505695960 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f13c40ad670 con 0x55ac2d6be390 2024-09-21T06:45:12.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.850+0000 7f13b57fa640 1 -- 172.21.15.7:0/505695960 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c40abef0 con 0x55ac2d6be390 2024-09-21T06:45:12.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.850+0000 7f13dc24d740 1 -- 172.21.15.7:0/505695960 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ac2d6be390 msgr2=0x55ac2da939b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:12.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.850+0000 7f13dc24d740 1 --2- 172.21.15.7:0/505695960 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ac2d6be390 0x55ac2da939b0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f13c40e7490 tx=0x7f13c40ace70 comp rx=0 tx=0).stop 2024-09-21T06:45:12.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.851+0000 7f13dc24d740 1 -- 172.21.15.7:0/505695960 shutdown_connections 2024-09-21T06:45:12.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.851+0000 7f13dc24d740 1 --2- 172.21.15.7:0/505695960 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ac2d6df070 0x55ac2da9dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:12.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.851+0000 7f13dc24d740 1 --2- 172.21.15.7:0/505695960 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ac2d6be390 0x55ac2da939b0 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:12.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.851+0000 7f13dc24d740 1 --2- 172.21.15.7:0/505695960 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ac2d6b61b0 0x55ac2da88090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:12.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.851+0000 7f13dc24d740 1 -- 172.21.15.7:0/505695960 >> 172.21.15.7:0/505695960 conn(0x55ac2d6d3460 msgr2=0x55ac2da932a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:12.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.851+0000 7f13dc24d740 1 -- 172.21.15.7:0/505695960 shutdown_connections 2024-09-21T06:45:12.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.851+0000 7f13dc24d740 1 -- 172.21.15.7:0/505695960 wait complete. 2024-09-21T06:45:12.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.851+0000 7f13dc24d740 1 -- start start 2024-09-21T06:45:12.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.851+0000 7f13dc24d740 1 Processor -- start 2024-09-21T06:45:12.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.852+0000 7f13dc24d740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ac2d6b61b0 0x55ac2da967a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:12.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.852+0000 7f13dc24d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ac2d6be390 0x55ac2da96d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:12.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.852+0000 7f13dc24d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ac2d6df070 0x55ac2db077c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:12.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.852+0000 7f13dc24d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f13d01afe00 con 0x55ac2d6be390 2024-09-21T06:45:12.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.852+0000 7f13dc24d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f13d01b1270 con 0x55ac2d6df070 2024-09-21T06:45:12.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.852+0000 7f13dc24d740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f13d01b04d0 con 0x55ac2d6b61b0 2024-09-21T06:45:12.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.852+0000 7f13dc24d740 10 client.0 _ll_register_callbacks cb 0x7f13c4009f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:12.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.852+0000 7f13ceffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ac2d6be390 0x55ac2da96d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:12.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.852+0000 7f13ceffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ac2d6be390 0x55ac2da96d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39290/0 (socket says 172.21.15.7:39290) 2024-09-21T06:45:12.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.852+0000 7f13ceffd640 1 -- 172.21.15.7:0/2694865857 learned_addr learned my addr 172.21.15.7:0/2694865857 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:12.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.852+0000 7f13cffff640 1 --2- 172.21.15.7:0/2694865857 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ac2d6df070 0x55ac2db077c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:12.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.852+0000 7f13cf7fe640 1 --2- 172.21.15.7:0/2694865857 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ac2d6b61b0 0x55ac2da967a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:12.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.852+0000 7f13ceffd640 1 -- 172.21.15.7:0/2694865857 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ac2d6b61b0 msgr2=0x55ac2da967a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:12.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.852+0000 7f13ceffd640 1 --2- 172.21.15.7:0/2694865857 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ac2d6b61b0 0x55ac2da967a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:12.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.852+0000 7f13ceffd640 1 -- 172.21.15.7:0/2694865857 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ac2d6df070 msgr2=0x55ac2db077c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:12.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.852+0000 7f13ceffd640 1 --2- 172.21.15.7:0/2694865857 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ac2d6df070 0x55ac2db077c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:12.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.852+0000 7f13ceffd640 1 -- 172.21.15.7:0/2694865857 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac2db07e30 con 0x55ac2d6be390 2024-09-21T06:45:12.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.852+0000 7f13ceffd640 1 --2- 172.21.15.7:0/2694865857 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ac2d6be390 0x55ac2da96d80 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f13c40a8cf0 tx=0x7f13c40a8e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7915a5d31456523 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:12.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.852+0000 7f13aeffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:45:12.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.852+0000 7f13aeffd640 1 -- 172.21.15.7:0/2694865857 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13c4021070 con 0x55ac2d6be390 2024-09-21T06:45:12.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.852+0000 7f13aeffd640 1 -- 172.21.15.7:0/2694865857 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8456+0+0 (secure 0 0 0) 0x7f13c405c1b0 con 0x55ac2d6be390 2024-09-21T06:45:12.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.852+0000 7f13dc24d740 1 -- 172.21.15.7:0/2694865857 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f13c40ad670 con 0x55ac2d6be390 2024-09-21T06:45:12.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.853+0000 7f13aeffd640 1 -- 172.21.15.7:0/2694865857 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f13c405c3f0 con 0x55ac2d6be390 2024-09-21T06:45:12.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.853+0000 7f13dc24d740 10 client.17430 fetch_fsmap learned FSMap version 25 2024-09-21T06:45:12.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.853+0000 7f13dc24d740 1 -- 172.21.15.7:0/2694865857 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ac2db0f070 con 0x55ac2d6be390 2024-09-21T06:45:12.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.853+0000 7f13aeffd640 1 -- 172.21.15.7:0/2694865857 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f13c40ad670 con 0x55ac2d6be390 2024-09-21T06:45:12.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.853+0000 7f13aeffd640 1 -- 172.21.15.7:0/2694865857 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f13c40b2be0 con 0x55ac2d6be390 2024-09-21T06:45:12.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.853+0000 7f13dc24d740 10 client.17430 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:45:12.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.853+0000 7f13dc24d740 10 client.17430 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-21T06:45:12.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.853+0000 7f13dc24d740 20 client.17430 populate_metadata read hostname 'smithi007' 2024-09-21T06:45:12.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.853+0000 7f13dc24d740 1 --2- 172.21.15.7:0/2694865857 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x55ac2d672da0 0x55ac2db11570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:12.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.853+0000 7f13dc24d740 4 client.17430 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:45:12.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.853+0000 7f13dc24d740 1 -- 172.21.15.7:0/2694865857 --> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ac2d9fa8a0 con 0x55ac2d672da0 2024-09-21T06:45:12.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.853+0000 7f13cf7fe640 1 --2- 172.21.15.7:0/2694865857 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x55ac2d672da0 0x55ac2db11570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:12.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.854+0000 7f13cf7fe640 1 --2- 172.21.15.7:0/2694865857 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x55ac2d672da0 0x55ac2db11570 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8ce200fa5fd6d3f7 server_cookie=ac5784d51a48228a in_seq=0 out_seq=0 2024-09-21T06:45:12.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.854+0000 7f13aeffd640 10 client.17430 ms_handle_connect on v2:172.21.15.18:6836/1539670694 2024-09-21T06:45:12.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.854+0000 7f13aeffd640 1 -- 172.21.15.7:0/2694865857 <== mds.2 v2:172.21.15.18:6836/1539670694 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ac2d9fa8a0 con 0x55ac2d672da0 2024-09-21T06:45:12.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.854+0000 7f13aeffd640 10 client.17430 handle_command_reply: tid=0 2024-09-21T06:45:12.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.854+0000 7f13dc24d740 1 client.17430 shutdown 2024-09-21T06:45:12.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.854+0000 7f13dc24d740 1 -- 172.21.15.7:0/2694865857 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ac2d6be390 msgr2=0x55ac2da96d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:12.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.854+0000 7f13dc24d740 1 --2- 172.21.15.7:0/2694865857 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ac2d6be390 0x55ac2da96d80 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f13c40a8cf0 tx=0x7f13c40a8e80 comp rx=0 tx=0).stop 2024-09-21T06:45:12.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.854+0000 7f13dc24d740 1 -- 172.21.15.7:0/2694865857 shutdown_connections 2024-09-21T06:45:12.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.854+0000 7f13dc24d740 1 --2- 172.21.15.7:0/2694865857 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x55ac2d672da0 0x55ac2db11570 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:12.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.854+0000 7f13dc24d740 1 --2- 172.21.15.7:0/2694865857 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55ac2d6df070 0x55ac2db077c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:12.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.854+0000 7f13dc24d740 1 --2- 172.21.15.7:0/2694865857 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55ac2d6be390 0x55ac2da96d80 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:12.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.854+0000 7f13dc24d740 1 --2- 172.21.15.7:0/2694865857 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55ac2d6b61b0 0x55ac2da967a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:12.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.854+0000 7f13aeffd640 0 client.17430 ms_handle_reset on v2:172.21.15.18:6836/1539670694 2024-09-21T06:45:12.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.854+0000 7f13dc24d740 1 -- 172.21.15.7:0/2694865857 >> 172.21.15.7:0/2694865857 conn(0x55ac2d6d3460 msgr2=0x55ac2da87e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:12.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.854+0000 7f13dc24d740 1 -- 172.21.15.7:0/2694865857 shutdown_connections 2024-09-21T06:45:12.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.854+0000 7f13dc24d740 1 -- 172.21.15.7:0/2694865857 wait complete. 2024-09-21T06:45:12.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.854+0000 7f13dc24d740 20 client.17430 trim_cache size 0 max 16384 2024-09-21T06:45:12.861 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:45:12.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.855+0000 7f13d5cd9640 1 -- 172.21.15.7:0/4008604367 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f13b80b6680 msgr2=0x7f13b80b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:12.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.855+0000 7f13d5cd9640 1 --2- 172.21.15.7:0/4008604367 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f13b80b6680 0x7f13b80b8b90 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x55ac2da85320 tx=0x7f13c00093f0 comp rx=0 tx=0).stop 2024-09-21T06:45:12.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.855+0000 7f13d5cd9640 1 -- 172.21.15.7:0/4008604367 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f13d0105310 msgr2=0x7f13d0102c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:12.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.855+0000 7f13d5cd9640 1 --2- 172.21.15.7:0/4008604367 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f13d0105310 0x7f13d0102c40 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f13c400d740 tx=0x7f13c400dc00 comp rx=0 tx=0).stop 2024-09-21T06:45:12.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.855+0000 7f13d5cd9640 1 -- 172.21.15.7:0/4008604367 shutdown_connections 2024-09-21T06:45:12.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.855+0000 7f13d5cd9640 1 --2- 172.21.15.7:0/4008604367 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f13b80b6680 0x7f13b80b8b90 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:12.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.855+0000 7f13d5cd9640 1 --2- 172.21.15.7:0/4008604367 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f13d010de20 0x7f13d0103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:12.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.855+0000 7f13d5cd9640 1 --2- 172.21.15.7:0/4008604367 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f13d0105310 0x7f13d0102c40 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:12.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.855+0000 7f13d5cd9640 1 --2- 172.21.15.7:0/4008604367 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f13d01049c0 0x7f13d0102700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:12.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.855+0000 7f13d5cd9640 1 -- 172.21.15.7:0/4008604367 >> 172.21.15.7:0/4008604367 conn(0x7f13d0079710 msgr2=0x7f13d01078b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:12.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.855+0000 7f13d5cd9640 1 -- 172.21.15.7:0/4008604367 shutdown_connections 2024-09-21T06:45:12.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:12.855+0000 7f13d5cd9640 1 -- 172.21.15.7:0/4008604367 wait complete. 2024-09-21T06:45:12.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:45:12 smithi018 ceph-mon[34477]: pgmap v594: 97 pgs: 97 active+clean; 3.3 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-21T06:45:13.651 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:45:13.907 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:45:14.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.426+0000 7ff356668640 1 -- 172.21.15.7:0/1058846220 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff350108d00 msgr2=0x7ff35010f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:14.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.426+0000 7ff356668640 1 --2- 172.21.15.7:0/1058846220 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff350108d00 0x7ff35010f530 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7ff348009ca0 tx=0x7ff34802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:45:14.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.426+0000 7ff356668640 1 -- 172.21.15.7:0/1058846220 shutdown_connections 2024-09-21T06:45:14.444 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.426+0000 7ff356668640 1 --2- 172.21.15.7:0/1058846220 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff350108d00 0x7ff35010f530 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:14.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.426+0000 7ff356668640 1 --2- 172.21.15.7:0/1058846220 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff3501083b0 0x7ff3501087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:14.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.426+0000 7ff356668640 1 --2- 172.21.15.7:0/1058846220 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff350102a70 0x7ff350102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:14.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.426+0000 7ff356668640 1 -- 172.21.15.7:0/1058846220 >> 172.21.15.7:0/1058846220 conn(0x7ff350079710 msgr2=0x7ff350079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:14.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.426+0000 7ff356668640 1 -- 172.21.15.7:0/1058846220 shutdown_connections 2024-09-21T06:45:14.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.426+0000 7ff356668640 1 -- 172.21.15.7:0/1058846220 wait complete. 2024-09-21T06:45:14.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.427+0000 7ff356668640 1 Processor -- start 2024-09-21T06:45:14.445 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.427+0000 7ff356668640 1 -- start start 2024-09-21T06:45:14.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.427+0000 7ff356668640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff350102a70 0x7ff35019b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:14.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.427+0000 7ff356668640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff3501083b0 0x7ff35019b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:14.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.427+0000 7ff356668640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff350108d00 0x7ff35019bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:14.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.427+0000 7ff356668640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff3501129c0 con 0x7ff3501083b0 2024-09-21T06:45:14.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.427+0000 7ff356668640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff350112840 con 0x7ff350108d00 2024-09-21T06:45:14.446 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.427+0000 7ff356668640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff350112b40 con 0x7ff350102a70 2024-09-21T06:45:14.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.427+0000 7ff34f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff3501083b0 0x7ff35019b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:14.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.427+0000 7ff34f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff3501083b0 0x7ff35019b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39312/0 (socket says 172.21.15.7:39312) 2024-09-21T06:45:14.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.427+0000 7ff34f7fe640 1 -- 172.21.15.7:0/3140668459 learned_addr learned my addr 172.21.15.7:0/3140668459 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:14.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.427+0000 7ff354c05640 1 --2- 172.21.15.7:0/3140668459 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff350108d00 0x7ff35019bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:14.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.428+0000 7ff34ffff640 1 --2- 172.21.15.7:0/3140668459 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff350102a70 0x7ff35019b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:14.447 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.428+0000 7ff34f7fe640 1 -- 172.21.15.7:0/3140668459 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff350102a70 msgr2=0x7ff35019b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:14.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.428+0000 7ff34f7fe640 1 --2- 172.21.15.7:0/3140668459 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff350102a70 0x7ff35019b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:14.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.428+0000 7ff34f7fe640 1 -- 172.21.15.7:0/3140668459 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff350108d00 msgr2=0x7ff35019bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:14.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.428+0000 7ff34f7fe640 1 --2- 172.21.15.7:0/3140668459 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff350108d00 0x7ff35019bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:14.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.428+0000 7ff34f7fe640 1 -- 172.21.15.7:0/3140668459 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3501a6550 con 0x7ff3501083b0 2024-09-21T06:45:14.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.428+0000 7ff354c05640 1 --2- 172.21.15.7:0/3140668459 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff350108d00 0x7ff35019bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:45:14.448 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.428+0000 7ff34ffff640 1 --2- 172.21.15.7:0/3140668459 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff350102a70 0x7ff35019b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:14.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.428+0000 7ff34f7fe640 1 --2- 172.21.15.7:0/3140668459 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff3501083b0 0x7ff35019b890 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7ff34400c8c0 tx=0x7ff34400cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:14.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.428+0000 7ff34d7fa640 1 -- 172.21.15.7:0/3140668459 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff344007bb0 con 0x7ff3501083b0 2024-09-21T06:45:14.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.428+0000 7ff356668640 1 -- 172.21.15.7:0/3140668459 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3501a6840 con 0x7ff3501083b0 2024-09-21T06:45:14.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.428+0000 7ff34d7fa640 1 -- 172.21.15.7:0/3140668459 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff344007d50 con 0x7ff3501083b0 2024-09-21T06:45:14.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.428+0000 7ff34d7fa640 1 -- 172.21.15.7:0/3140668459 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3440187c0 con 0x7ff3501083b0 2024-09-21T06:45:14.449 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.428+0000 7ff356668640 1 -- 172.21.15.7:0/3140668459 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3501a6dd0 con 0x7ff3501083b0 2024-09-21T06:45:14.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.431+0000 7ff34d7fa640 1 -- 172.21.15.7:0/3140668459 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7ff34400fa20 con 0x7ff3501083b0 2024-09-21T06:45:14.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.431+0000 7ff35cbdc740 1 Processor -- start 2024-09-21T06:45:14.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.431+0000 7ff35cbdc740 1 -- start start 2024-09-21T06:45:14.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.431+0000 7ff35cbdc740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a41b94070 0x559a41f3b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:14.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.431+0000 7ff35cbdc740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a41b6b1b0 0x559a41f3bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:14.450 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.431+0000 7ff35cbdc740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559a41b73390 0x559a41f3c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:14.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.431+0000 7ff35cbdc740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x559a41eb1ea0 con 0x559a41b94070 2024-09-21T06:45:14.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.431+0000 7ff35cbdc740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559a41ea12d0 con 0x559a41b73390 2024-09-21T06:45:14.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.431+0000 7ff35cbdc740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x559a41ea50e0 con 0x559a41b6b1b0 2024-09-21T06:45:14.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.431+0000 7ff354c05640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a41b94070 0x559a41f3b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:14.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.432+0000 7ff354c05640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a41b94070 0x559a41f3b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39326/0 (socket says 172.21.15.7:39326) 2024-09-21T06:45:14.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.432+0000 7ff354c05640 1 -- 172.21.15.7:0/3393346346 learned_addr learned my addr 172.21.15.7:0/3393346346 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:14.451 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.432+0000 7ff34f7fe640 1 --2- 172.21.15.7:0/3393346346 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559a41b73390 0x559a41f3c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:14.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.432+0000 7ff34ffff640 1 --2- 172.21.15.7:0/3393346346 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a41b6b1b0 0x559a41f3bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:14.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.432+0000 7ff354c05640 1 -- 172.21.15.7:0/3393346346 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a41b6b1b0 msgr2=0x559a41f3bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:14.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.432+0000 7ff354c05640 1 --2- 172.21.15.7:0/3393346346 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a41b6b1b0 0x559a41f3bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:14.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.432+0000 7ff354c05640 1 -- 172.21.15.7:0/3393346346 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559a41b73390 msgr2=0x559a41f3c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:14.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.432+0000 7ff354c05640 1 --2- 172.21.15.7:0/3393346346 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559a41b73390 0x559a41f3c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:14.452 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.432+0000 7ff354c05640 1 -- 172.21.15.7:0/3393346346 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a41bff650 con 0x559a41b94070 2024-09-21T06:45:14.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.432+0000 7ff34d7fa640 1 --2- 172.21.15.7:0/3140668459 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7ff3380b66b0 0x7ff3380b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:14.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.432+0000 7ff354c05640 1 --2- 172.21.15.7:0/3393346346 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a41b94070 0x559a41f3b6a0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7ff348033040 tx=0x7ff34802f450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54516e3e8af536a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:14.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.432+0000 7ff34ffff640 1 --2- 172.21.15.7:0/3140668459 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7ff3380b66b0 0x7ff3380b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:14.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.432+0000 7ff34d7fa640 1 -- 172.21.15.7:0/3140668459 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8456+0+0 (secure 0 0 0) 0x7ff3440e7760 con 0x7ff3501083b0 2024-09-21T06:45:14.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.432+0000 7ff3367fc640 1 -- 172.21.15.7:0/3393346346 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff348031650 con 0x559a41b94070 2024-09-21T06:45:14.453 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.433+0000 7ff3367fc640 1 -- 172.21.15.7:0/3393346346 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff348036040 con 0x559a41b94070 2024-09-21T06:45:14.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.433+0000 7ff3367fc640 1 -- 172.21.15.7:0/3393346346 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3480045d0 con 0x559a41b94070 2024-09-21T06:45:14.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.433+0000 7ff35cbdc740 1 -- 172.21.15.7:0/3393346346 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a41b94070 msgr2=0x559a41f3b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:14.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.433+0000 7ff34ffff640 1 --2- 172.21.15.7:0/3140668459 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7ff3380b66b0 0x7ff3380b8bc0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x559a41f3a320 tx=0x7ff340005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:14.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.433+0000 7ff35cbdc740 1 --2- 172.21.15.7:0/3393346346 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a41b94070 0x559a41f3b6a0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7ff348033040 tx=0x7ff34802f450 comp rx=0 tx=0).stop 2024-09-21T06:45:14.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.433+0000 7ff35cbdc740 1 -- 172.21.15.7:0/3393346346 shutdown_connections 2024-09-21T06:45:14.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.433+0000 7ff35cbdc740 1 --2- 172.21.15.7:0/3393346346 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559a41b73390 0x559a41f3c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:14.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.433+0000 7ff35cbdc740 1 --2- 172.21.15.7:0/3393346346 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a41b6b1b0 0x559a41f3bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:14.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.433+0000 7ff35cbdc740 1 --2- 172.21.15.7:0/3393346346 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a41b94070 0x559a41f3b6a0 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:14.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.433+0000 7ff35cbdc740 1 -- 172.21.15.7:0/3393346346 >> 172.21.15.7:0/3393346346 conn(0x559a41b88460 msgr2=0x559a41f39590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:14.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.434+0000 7ff35cbdc740 1 -- 172.21.15.7:0/3393346346 shutdown_connections 2024-09-21T06:45:14.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.434+0000 7ff35cbdc740 1 -- 172.21.15.7:0/3393346346 wait complete. 2024-09-21T06:45:14.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.434+0000 7ff35cbdc740 1 -- start start 2024-09-21T06:45:14.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.434+0000 7ff35cbdc740 1 Processor -- start 2024-09-21T06:45:14.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.434+0000 7ff35cbdc740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a41b6b1b0 0x559a41f46dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:14.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.434+0000 7ff35cbdc740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a41b73390 0x559a41f47300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:14.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.434+0000 7ff35cbdc740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559a41b94070 0x559a41f52f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:14.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.434+0000 7ff35cbdc740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x559a41d02700 con 0x559a41b6b1b0 2024-09-21T06:45:14.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.434+0000 7ff35cbdc740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559a41e3c160 con 0x559a41b94070 2024-09-21T06:45:14.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.434+0000 7ff35cbdc740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x559a41f49ca0 con 0x559a41b73390 2024-09-21T06:45:14.456 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.435+0000 7ff35cbdc740 10 client.0 _ll_register_callbacks cb 0x559a41e559e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:14.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.435+0000 7ff34ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a41b6b1b0 0x559a41f46dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:14.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.435+0000 7ff34ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a41b6b1b0 0x559a41f46dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39340/0 (socket says 172.21.15.7:39340) 2024-09-21T06:45:14.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.435+0000 7ff34ffff640 1 -- 172.21.15.7:0/2193450186 learned_addr learned my addr 172.21.15.7:0/2193450186 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:14.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.435+0000 7ff34f7fe640 1 --2- 172.21.15.7:0/2193450186 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a41b73390 0x559a41f47300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:14.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.435+0000 7ff354c05640 1 --2- 172.21.15.7:0/2193450186 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559a41b94070 0x559a41f52f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:14.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.435+0000 7ff34ffff640 1 -- 172.21.15.7:0/2193450186 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a41b73390 msgr2=0x559a41f47300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:14.457 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.435+0000 7ff34ffff640 1 --2- 172.21.15.7:0/2193450186 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a41b73390 0x559a41f47300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:14.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.435+0000 7ff34ffff640 1 -- 172.21.15.7:0/2193450186 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559a41b94070 msgr2=0x559a41f52f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:14.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.435+0000 7ff34ffff640 1 --2- 172.21.15.7:0/2193450186 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559a41b94070 0x559a41f52f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:14.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.435+0000 7ff34ffff640 1 -- 172.21.15.7:0/2193450186 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a41e69c90 con 0x559a41b6b1b0 2024-09-21T06:45:14.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.435+0000 7ff34ffff640 1 --2- 172.21.15.7:0/2193450186 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a41b6b1b0 0x559a41f46dc0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7ff3400045e0 tx=0x7ff340004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bc706e1000dd03e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:14.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.435+0000 7ff32f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:45:14.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.435+0000 7ff32f7fe640 1 -- 172.21.15.7:0/2193450186 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff340020610 con 0x559a41b6b1b0 2024-09-21T06:45:14.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.435+0000 7ff32f7fe640 1 -- 172.21.15.7:0/2193450186 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8456+0+0 (secure 0 0 0) 0x7ff3400207b0 con 0x559a41b6b1b0 2024-09-21T06:45:14.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.435+0000 7ff35cbdc740 1 -- 172.21.15.7:0/2193450186 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff348036040 con 0x559a41b6b1b0 2024-09-21T06:45:14.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.436+0000 7ff32f7fe640 1 -- 172.21.15.7:0/2193450186 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff3400209b0 con 0x559a41b6b1b0 2024-09-21T06:45:14.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.436+0000 7ff35cbdc740 10 client.17442 fetch_fsmap learned FSMap version 25 2024-09-21T06:45:14.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.436+0000 7ff35cbdc740 1 -- 172.21.15.7:0/2193450186 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559a41f55a70 con 0x559a41b6b1b0 2024-09-21T06:45:14.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.436+0000 7ff32f7fe640 1 -- 172.21.15.7:0/2193450186 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff348036040 con 0x559a41b6b1b0 2024-09-21T06:45:14.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.436+0000 7ff32f7fe640 1 -- 172.21.15.7:0/2193450186 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff34001c030 con 0x559a41b6b1b0 2024-09-21T06:45:14.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.436+0000 7ff35cbdc740 10 client.17442 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:45:14.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.436+0000 7ff35cbdc740 10 client.17442 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:45:14.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.436+0000 7ff35cbdc740 20 client.17442 populate_metadata read hostname 'smithi007' 2024-09-21T06:45:14.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.436+0000 7ff35cbdc740 1 --2- 172.21.15.7:0/2193450186 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x559a41b529f0 0x559a41f58ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:14.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.436+0000 7ff35cbdc740 4 client.17442 mds_command: new command op to 24688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:45:14.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.436+0000 7ff35cbdc740 1 -- 172.21.15.7:0/2193450186 --> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559a41eb3df0 con 0x559a41b529f0 2024-09-21T06:45:14.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.436+0000 7ff34f7fe640 1 --2- 172.21.15.7:0/2193450186 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x559a41b529f0 0x559a41f58ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:14.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.437+0000 7ff34f7fe640 1 --2- 172.21.15.7:0/2193450186 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x559a41b529f0 0x559a41f58ef0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6b041c8b09cd1732 server_cookie=a6343d76c6901f6d in_seq=0 out_seq=0 2024-09-21T06:45:14.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.437+0000 7ff32f7fe640 10 client.17442 ms_handle_connect on v2:172.21.15.144:6838/4027821922 2024-09-21T06:45:14.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.438+0000 7ff32f7fe640 1 -- 172.21.15.7:0/2193450186 <== mds.1 v2:172.21.15.144:6838/4027821922 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559a41eb3df0 con 0x559a41b529f0 2024-09-21T06:45:14.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.438+0000 7ff32f7fe640 10 client.17442 handle_command_reply: tid=0 2024-09-21T06:45:14.459 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.438+0000 7ff35cbdc740 1 client.17442 shutdown 2024-09-21T06:45:14.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.438+0000 7ff35cbdc740 1 -- 172.21.15.7:0/2193450186 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a41b6b1b0 msgr2=0x559a41f46dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:14.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.438+0000 7ff35cbdc740 1 --2- 172.21.15.7:0/2193450186 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a41b6b1b0 0x559a41f46dc0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7ff3400045e0 tx=0x7ff340004730 comp rx=0 tx=0).stop 2024-09-21T06:45:14.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.438+0000 7ff35cbdc740 1 -- 172.21.15.7:0/2193450186 shutdown_connections 2024-09-21T06:45:14.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.438+0000 7ff35cbdc740 1 --2- 172.21.15.7:0/2193450186 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x559a41b529f0 0x559a41f58ef0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:14.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.438+0000 7ff35cbdc740 1 --2- 172.21.15.7:0/2193450186 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559a41b94070 0x559a41f52f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:14.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.438+0000 7ff35cbdc740 1 --2- 172.21.15.7:0/2193450186 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a41b73390 0x559a41f47300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:14.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.438+0000 7ff35cbdc740 1 --2- 172.21.15.7:0/2193450186 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a41b6b1b0 0x559a41f46dc0 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:14.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.438+0000 7ff35cbdc740 1 -- 172.21.15.7:0/2193450186 >> 172.21.15.7:0/2193450186 conn(0x559a41b88460 msgr2=0x559a41f3e880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:14.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.438+0000 7ff32f7fe640 0 client.17442 ms_handle_reset on v2:172.21.15.144:6838/4027821922 2024-09-21T06:45:14.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.438+0000 7ff35cbdc740 1 -- 172.21.15.7:0/2193450186 shutdown_connections 2024-09-21T06:45:14.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.438+0000 7ff35cbdc740 1 -- 172.21.15.7:0/2193450186 wait complete. 2024-09-21T06:45:14.460 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.438+0000 7ff35cbdc740 20 client.17442 trim_cache size 0 max 16384 2024-09-21T06:45:14.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.452+0000 7ff35cbdc740 1 Processor -- start 2024-09-21T06:45:14.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.452+0000 7ff35cbdc740 1 -- start start 2024-09-21T06:45:14.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.452+0000 7ff35cbdc740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a41b6b1b0 0x559a41f489f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:14.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.452+0000 7ff35cbdc740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a41b73390 0x559a41f38bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:14.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.452+0000 7ff35cbdc740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559a41b94070 0x559a41f39100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:14.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.452+0000 7ff35cbdc740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff3501b1e60 con 0x559a41b6b1b0 2024-09-21T06:45:14.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.452+0000 7ff35cbdc740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff3501af730 con 0x559a41b94070 2024-09-21T06:45:14.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.452+0000 7ff35cbdc740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff3501ad5a0 con 0x559a41b73390 2024-09-21T06:45:14.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.452+0000 7ff34ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a41b6b1b0 0x559a41f489f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:14.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.452+0000 7ff34ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a41b6b1b0 0x559a41f489f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39350/0 (socket says 172.21.15.7:39350) 2024-09-21T06:45:14.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.452+0000 7ff34ffff640 1 -- 172.21.15.7:0/2624328757 learned_addr learned my addr 172.21.15.7:0/2624328757 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:14.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.452+0000 7ff354c05640 1 --2- 172.21.15.7:0/2624328757 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559a41b94070 0x559a41f39100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:14.465 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.452+0000 7ff34f7fe640 1 --2- 172.21.15.7:0/2624328757 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a41b73390 0x559a41f38bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:14.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.453+0000 7ff34ffff640 1 -- 172.21.15.7:0/2624328757 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a41b73390 msgr2=0x559a41f38bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:14.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.453+0000 7ff34ffff640 1 --2- 172.21.15.7:0/2624328757 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a41b73390 0x559a41f38bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:14.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.453+0000 7ff34ffff640 1 -- 172.21.15.7:0/2624328757 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559a41b94070 msgr2=0x559a41f39100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:14.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.453+0000 7ff34ffff640 1 --2- 172.21.15.7:0/2624328757 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559a41b94070 0x559a41f39100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:14.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.453+0000 7ff34ffff640 1 -- 172.21.15.7:0/2624328757 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a41f419d0 con 0x559a41b6b1b0 2024-09-21T06:45:14.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.453+0000 7ff34ffff640 1 --2- 172.21.15.7:0/2624328757 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a41b6b1b0 0x559a41f489f0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7ff340029d80 tx=0x7ff340000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2098d45820d70e2c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:14.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.453+0000 7ff335ffb640 1 -- 172.21.15.7:0/2624328757 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff340020610 con 0x559a41b6b1b0 2024-09-21T06:45:14.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.453+0000 7ff335ffb640 1 -- 172.21.15.7:0/2624328757 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff340024070 con 0x559a41b6b1b0 2024-09-21T06:45:14.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.453+0000 7ff335ffb640 1 -- 172.21.15.7:0/2624328757 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff340032440 con 0x559a41b6b1b0 2024-09-21T06:45:14.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.454+0000 7ff35cbdc740 1 -- 172.21.15.7:0/2624328757 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a41b6b1b0 msgr2=0x559a41f489f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:14.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.454+0000 7ff35cbdc740 1 --2- 172.21.15.7:0/2624328757 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a41b6b1b0 0x559a41f489f0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7ff340029d80 tx=0x7ff340000bc0 comp rx=0 tx=0).stop 2024-09-21T06:45:14.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.454+0000 7ff35cbdc740 1 -- 172.21.15.7:0/2624328757 shutdown_connections 2024-09-21T06:45:14.466 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.454+0000 7ff35cbdc740 1 --2- 172.21.15.7:0/2624328757 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559a41b94070 0x559a41f39100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:14.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.454+0000 7ff35cbdc740 1 --2- 172.21.15.7:0/2624328757 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a41b73390 0x559a41f38bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:14.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.454+0000 7ff35cbdc740 1 --2- 172.21.15.7:0/2624328757 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a41b6b1b0 0x559a41f489f0 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:14.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.454+0000 7ff35cbdc740 1 -- 172.21.15.7:0/2624328757 >> 172.21.15.7:0/2624328757 conn(0x559a41b88460 msgr2=0x559a41f482e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:14.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.454+0000 7ff35cbdc740 1 -- 172.21.15.7:0/2624328757 shutdown_connections 2024-09-21T06:45:14.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.454+0000 7ff35cbdc740 1 -- 172.21.15.7:0/2624328757 wait complete. 2024-09-21T06:45:14.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.454+0000 7ff35cbdc740 1 -- start start 2024-09-21T06:45:14.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.455+0000 7ff35cbdc740 1 Processor -- start 2024-09-21T06:45:14.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.455+0000 7ff35cbdc740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559a41b6b1b0 0x559a41f4f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:14.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.455+0000 7ff35cbdc740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a41b73390 0x559a41f4a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:14.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.455+0000 7ff35cbdc740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a41b94070 0x559a41f4ae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:14.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.455+0000 7ff35cbdc740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff3501adbf0 con 0x559a41b73390 2024-09-21T06:45:14.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.455+0000 7ff35cbdc740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff3501af060 con 0x559a41b6b1b0 2024-09-21T06:45:14.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.455+0000 7ff35cbdc740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff3501ae2c0 con 0x559a41b94070 2024-09-21T06:45:14.467 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.455+0000 7ff35cbdc740 10 client.0 _ll_register_callbacks cb 0x7ff340009740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:14.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.455+0000 7ff34f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a41b73390 0x559a41f4a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:14.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.455+0000 7ff34ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559a41b6b1b0 0x559a41f4f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:14.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.455+0000 7ff34f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a41b73390 0x559a41f4a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39362/0 (socket says 172.21.15.7:39362) 2024-09-21T06:45:14.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.455+0000 7ff34f7fe640 1 -- 172.21.15.7:0/1571095870 learned_addr learned my addr 172.21.15.7:0/1571095870 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:14.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.455+0000 7ff354c05640 1 --2- 172.21.15.7:0/1571095870 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a41b94070 0x559a41f4ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:14.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.455+0000 7ff34f7fe640 1 -- 172.21.15.7:0/1571095870 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a41b94070 msgr2=0x559a41f4ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:14.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.455+0000 7ff34f7fe640 1 --2- 172.21.15.7:0/1571095870 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a41b94070 0x559a41f4ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:14.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.455+0000 7ff34f7fe640 1 -- 172.21.15.7:0/1571095870 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559a41b6b1b0 msgr2=0x559a41f4f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:14.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.455+0000 7ff34f7fe640 1 --2- 172.21.15.7:0/1571095870 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559a41b6b1b0 0x559a41f4f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:14.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.455+0000 7ff34f7fe640 1 -- 172.21.15.7:0/1571095870 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a41f4b380 con 0x559a41b73390 2024-09-21T06:45:14.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.455+0000 7ff34ffff640 1 --2- 172.21.15.7:0/1571095870 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559a41b6b1b0 0x559a41f4f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:45:14.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.456+0000 7ff34f7fe640 1 --2- 172.21.15.7:0/1571095870 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a41b73390 0x559a41f4a900 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7ff344000c00 tx=0x7ff3440e53f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef540802ae675fd9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:14.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.456+0000 7ff32f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:45:14.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.456+0000 7ff32f7fe640 1 -- 172.21.15.7:0/1571095870 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3440acd60 con 0x559a41b73390 2024-09-21T06:45:14.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.456+0000 7ff32f7fe640 1 -- 172.21.15.7:0/1571095870 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8456+0+0 (secure 0 0 0) 0x7ff3440b6240 con 0x559a41b73390 2024-09-21T06:45:14.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.456+0000 7ff35cbdc740 1 -- 172.21.15.7:0/1571095870 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff340024070 con 0x559a41b73390 2024-09-21T06:45:14.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.456+0000 7ff32f7fe640 1 -- 172.21.15.7:0/1571095870 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff3440ad100 con 0x559a41b73390 2024-09-21T06:45:14.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.456+0000 7ff35cbdc740 10 client.17448 fetch_fsmap learned FSMap version 25 2024-09-21T06:45:14.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.456+0000 7ff35cbdc740 1 -- 172.21.15.7:0/1571095870 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559a41fc3510 con 0x559a41b73390 2024-09-21T06:45:14.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.456+0000 7ff32f7fe640 1 -- 172.21.15.7:0/1571095870 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff340024070 con 0x559a41b73390 2024-09-21T06:45:14.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.456+0000 7ff32f7fe640 1 -- 172.21.15.7:0/1571095870 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7ff3440a9140 con 0x559a41b73390 2024-09-21T06:45:14.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.456+0000 7ff35cbdc740 10 client.17448 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:45:14.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.456+0000 7ff35cbdc740 10 client.17448 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:45:14.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.456+0000 7ff35cbdc740 20 client.17448 populate_metadata read hostname 'smithi007' 2024-09-21T06:45:14.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.456+0000 7ff35cbdc740 1 --2- 172.21.15.7:0/1571095870 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x559a41b27da0 0x559a41fc5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:14.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.457+0000 7ff35cbdc740 4 client.17448 mds_command: new command op to 24688 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:45:14.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.457+0000 7ff35cbdc740 1 -- 172.21.15.7:0/1571095870 --> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559a41eaf8a0 con 0x559a41b27da0 2024-09-21T06:45:14.469 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.457+0000 7ff34ffff640 1 --2- 172.21.15.7:0/1571095870 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x559a41b27da0 0x559a41fc5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:14.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.457+0000 7ff34ffff640 1 --2- 172.21.15.7:0/1571095870 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x559a41b27da0 0x559a41fc5c30 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d972dcd5a238c766 server_cookie=dbbd980c899fcb00 in_seq=0 out_seq=0 2024-09-21T06:45:14.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.457+0000 7ff32f7fe640 10 client.17448 ms_handle_connect on v2:172.21.15.144:6838/4027821922 2024-09-21T06:45:14.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.457+0000 7ff32f7fe640 1 -- 172.21.15.7:0/1571095870 <== mds.1 v2:172.21.15.144:6838/4027821922 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559a41eaf8a0 con 0x559a41b27da0 2024-09-21T06:45:14.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.457+0000 7ff32f7fe640 10 client.17448 handle_command_reply: tid=0 2024-09-21T06:45:14.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.457+0000 7ff35cbdc740 1 client.17448 shutdown 2024-09-21T06:45:14.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.458+0000 7ff35cbdc740 1 -- 172.21.15.7:0/1571095870 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a41b73390 msgr2=0x559a41f4a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:14.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.458+0000 7ff35cbdc740 1 --2- 172.21.15.7:0/1571095870 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a41b73390 0x559a41f4a900 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7ff344000c00 tx=0x7ff3440e53f0 comp rx=0 tx=0).stop 2024-09-21T06:45:14.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.458+0000 7ff35cbdc740 1 -- 172.21.15.7:0/1571095870 shutdown_connections 2024-09-21T06:45:14.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.458+0000 7ff35cbdc740 1 --2- 172.21.15.7:0/1571095870 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x559a41b27da0 0x559a41fc5c30 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:14.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.458+0000 7ff35cbdc740 1 --2- 172.21.15.7:0/1571095870 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559a41b94070 0x559a41f4ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:14.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.458+0000 7ff35cbdc740 1 --2- 172.21.15.7:0/1571095870 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559a41b73390 0x559a41f4a900 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:14.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.458+0000 7ff35cbdc740 1 --2- 172.21.15.7:0/1571095870 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559a41b6b1b0 0x559a41f4f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:14.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.458+0000 7ff35cbdc740 1 -- 172.21.15.7:0/1571095870 >> 172.21.15.7:0/1571095870 conn(0x559a41b88460 msgr2=0x559a41f3d090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:14.470 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.458+0000 7ff32f7fe640 0 client.17448 ms_handle_reset on v2:172.21.15.144:6838/4027821922 2024-09-21T06:45:14.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.458+0000 7ff35cbdc740 1 -- 172.21.15.7:0/1571095870 shutdown_connections 2024-09-21T06:45:14.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.458+0000 7ff35cbdc740 1 -- 172.21.15.7:0/1571095870 wait complete. 2024-09-21T06:45:14.471 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.458+0000 7ff35cbdc740 20 client.17448 trim_cache size 0 max 16384 2024-09-21T06:45:14.471 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:45:14.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.458+0000 7ff356668640 1 -- 172.21.15.7:0/3140668459 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7ff3380b66b0 msgr2=0x7ff3380b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:14.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.458+0000 7ff356668640 1 --2- 172.21.15.7:0/3140668459 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7ff3380b66b0 0x7ff3380b8bc0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x559a41f3a320 tx=0x7ff340005f90 comp rx=0 tx=0).stop 2024-09-21T06:45:14.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.458+0000 7ff356668640 1 -- 172.21.15.7:0/3140668459 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff3501083b0 msgr2=0x7ff35019b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:14.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.458+0000 7ff356668640 1 --2- 172.21.15.7:0/3140668459 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff3501083b0 0x7ff35019b890 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7ff34400c8c0 tx=0x7ff34400cd80 comp rx=0 tx=0).stop 2024-09-21T06:45:14.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.459+0000 7ff356668640 1 -- 172.21.15.7:0/3140668459 shutdown_connections 2024-09-21T06:45:14.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.459+0000 7ff356668640 1 --2- 172.21.15.7:0/3140668459 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7ff3380b66b0 0x7ff3380b8bc0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:14.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.459+0000 7ff356668640 1 --2- 172.21.15.7:0/3140668459 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff350108d00 0x7ff35019bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:14.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.459+0000 7ff356668640 1 --2- 172.21.15.7:0/3140668459 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff3501083b0 0x7ff35019b890 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:14.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.459+0000 7ff356668640 1 --2- 172.21.15.7:0/3140668459 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff350102a70 0x7ff35019b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:14.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.459+0000 7ff356668640 1 -- 172.21.15.7:0/3140668459 >> 172.21.15.7:0/3140668459 conn(0x7ff350079710 msgr2=0x7ff350104430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:14.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.459+0000 7ff356668640 1 -- 172.21.15.7:0/3140668459 shutdown_connections 2024-09-21T06:45:14.472 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:14.459+0000 7ff356668640 1 -- 172.21.15.7:0/3140668459 wait complete. 2024-09-21T06:45:14.589 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:45:14 smithi007 ceph-mon[30983]: pgmap v595: 97 pgs: 97 active+clean; 3.3 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 204 B/s wr, 7 op/s 2024-09-21T06:45:14.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:45:14 smithi144 ceph-mon[34653]: pgmap v595: 97 pgs: 97 active+clean; 3.3 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 204 B/s wr, 7 op/s 2024-09-21T06:45:14.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:45:14 smithi018 ceph-mon[34477]: pgmap v595: 97 pgs: 97 active+clean; 3.3 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 204 B/s wr, 7 op/s 2024-09-21T06:45:15.262 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:45:15.518 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:45:16.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.005+0000 7f0e011c7640 1 -- 172.21.15.7:0/1494870158 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0dfc102a60 msgr2=0x7f0dfc102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:16.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.005+0000 7f0e011c7640 1 --2- 172.21.15.7:0/1494870158 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0dfc102a60 0x7f0dfc102e70 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f0dec009900 tx=0x7f0dec02a3f0 comp rx=0 tx=0).stop 2024-09-21T06:45:16.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.005+0000 7f0e011c7640 1 -- 172.21.15.7:0/1494870158 shutdown_connections 2024-09-21T06:45:16.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.005+0000 7f0e011c7640 1 --2- 172.21.15.7:0/1494870158 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0dfc108cf0 0x7f0dfc10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:16.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.005+0000 7f0e011c7640 1 --2- 172.21.15.7:0/1494870158 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0dfc1083a0 0x7f0dfc1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:16.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.005+0000 7f0e011c7640 1 --2- 172.21.15.7:0/1494870158 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0dfc102a60 0x7f0dfc102e70 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:16.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.005+0000 7f0e011c7640 1 -- 172.21.15.7:0/1494870158 >> 172.21.15.7:0/1494870158 conn(0x7f0dfc079730 msgr2=0x7f0dfc079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:16.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.005+0000 7f0e011c7640 1 -- 172.21.15.7:0/1494870158 shutdown_connections 2024-09-21T06:45:16.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.005+0000 7f0e011c7640 1 -- 172.21.15.7:0/1494870158 wait complete. 2024-09-21T06:45:16.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.006+0000 7f0e011c7640 1 Processor -- start 2024-09-21T06:45:16.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.006+0000 7f0e011c7640 1 -- start start 2024-09-21T06:45:16.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.007+0000 7f0e011c7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0dfc102a60 0x7f0dfc19b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:16.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.007+0000 7f0e011c7640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0dfc1083a0 0x7f0dfc19b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:16.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.007+0000 7f0e011c7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0dfc108cf0 0x7f0dfc19bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:16.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.007+0000 7f0e011c7640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0dfc112960 con 0x7f0dfc108cf0 2024-09-21T06:45:16.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.007+0000 7f0e011c7640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0dfc1127e0 con 0x7f0dfc102a60 2024-09-21T06:45:16.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.007+0000 7f0e011c7640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0dfc112ae0 con 0x7f0dfc1083a0 2024-09-21T06:45:16.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.007+0000 7f0dfb59e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0dfc108cf0 0x7f0dfc19bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:16.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.007+0000 7f0dfa59c640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0dfc1083a0 0x7f0dfc19b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:16.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.007+0000 7f0dfb59e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0dfc108cf0 0x7f0dfc19bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39372/0 (socket says 172.21.15.7:39372) 2024-09-21T06:45:16.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.007+0000 7f0dfb59e640 1 -- 172.21.15.7:0/1807533332 learned_addr learned my addr 172.21.15.7:0/1807533332 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:16.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.007+0000 7f0dfad9d640 1 --2- 172.21.15.7:0/1807533332 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0dfc102a60 0x7f0dfc19b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:16.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.007+0000 7f0dfb59e640 1 -- 172.21.15.7:0/1807533332 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0dfc1083a0 msgr2=0x7f0dfc19b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:16.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.007+0000 7f0dfb59e640 1 --2- 172.21.15.7:0/1807533332 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0dfc1083a0 0x7f0dfc19b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:16.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.007+0000 7f0dfb59e640 1 -- 172.21.15.7:0/1807533332 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0dfc102a60 msgr2=0x7f0dfc19b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:16.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.007+0000 7f0dfb59e640 1 --2- 172.21.15.7:0/1807533332 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0dfc102a60 0x7f0dfc19b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:16.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.007+0000 7f0dfb59e640 1 -- 172.21.15.7:0/1807533332 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dfc1a6470 con 0x7f0dfc108cf0 2024-09-21T06:45:16.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.008+0000 7f0dfb59e640 1 --2- 172.21.15.7:0/1807533332 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0dfc108cf0 0x7f0dfc19bcf0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f0df400eaa0 tx=0x7f0df400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:16.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.008+0000 7f0de3fff640 1 -- 172.21.15.7:0/1807533332 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0df4004d20 con 0x7f0dfc108cf0 2024-09-21T06:45:16.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.008+0000 7f0e011c7640 1 -- 172.21.15.7:0/1807533332 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0dfc1a6760 con 0x7f0dfc108cf0 2024-09-21T06:45:16.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.008+0000 7f0de3fff640 1 -- 172.21.15.7:0/1807533332 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0df4005020 con 0x7f0dfc108cf0 2024-09-21T06:45:16.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.008+0000 7f0de3fff640 1 -- 172.21.15.7:0/1807533332 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0df40116b0 con 0x7f0dfc108cf0 2024-09-21T06:45:16.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.008+0000 7f0e011c7640 1 -- 172.21.15.7:0/1807533332 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0dfc1a6c50 con 0x7f0dfc108cf0 2024-09-21T06:45:16.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.010+0000 7f0e0773b740 1 Processor -- start 2024-09-21T06:45:16.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.011+0000 7f0de3fff640 1 -- 172.21.15.7:0/1807533332 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f0df4011850 con 0x7f0dfc108cf0 2024-09-21T06:45:16.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.011+0000 7f0e0773b740 1 -- start start 2024-09-21T06:45:16.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.011+0000 7f0e0773b740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fd59438070 0x55fd597df2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:16.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.011+0000 7f0e0773b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fd5940f1b0 0x55fd597df800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:16.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.011+0000 7f0e0773b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fd59417390 0x55fd597dfd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:16.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.011+0000 7f0e0773b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55fd59755ea0 con 0x55fd59417390 2024-09-21T06:45:16.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.011+0000 7f0e0773b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55fd597452d0 con 0x55fd5940f1b0 2024-09-21T06:45:16.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.011+0000 7f0e0773b740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55fd597490e0 con 0x55fd59438070 2024-09-21T06:45:16.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.011+0000 7f0dfa59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fd59417390 0x55fd597dfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:16.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.011+0000 7f0dfad9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fd5940f1b0 0x55fd597df800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:16.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.011+0000 7f0dfa59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fd59417390 0x55fd597dfd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39384/0 (socket says 172.21.15.7:39384) 2024-09-21T06:45:16.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.011+0000 7f0dfa59c640 1 -- 172.21.15.7:0/577647690 learned_addr learned my addr 172.21.15.7:0/577647690 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:16.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.011+0000 7f0dfad9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fd5940f1b0 0x55fd597df800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.7:42272/0 (socket says 172.21.15.7:42272) 2024-09-21T06:45:16.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.011+0000 7f0dfa59c640 1 --2- 172.21.15.7:0/577647690 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fd59438070 0x55fd597df2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:16.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.011+0000 7f0de3fff640 1 --2- 172.21.15.7:0/1807533332 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f0de40b66b0 0x7f0de40b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:16.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.012+0000 7f0dfad9d640 1 -- 172.21.15.7:0/577647690 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fd59438070 msgr2=0x55fd597df2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:16.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.012+0000 7f0dfad9d640 1 --2- 172.21.15.7:0/577647690 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fd59438070 0x55fd597df2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:16.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.012+0000 7f0dfad9d640 1 -- 172.21.15.7:0/577647690 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fd59417390 msgr2=0x55fd597dfd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:16.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.012+0000 7f0dfad9d640 1 --2- 172.21.15.7:0/577647690 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fd59417390 0x55fd597dfd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:16.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.012+0000 7f0dfad9d640 1 -- 172.21.15.7:0/577647690 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd594a3650 con 0x55fd5940f1b0 2024-09-21T06:45:16.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.012+0000 7f0dfb59e640 1 --2- 172.21.15.7:0/1807533332 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f0de40b66b0 0x7f0de40b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:16.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.012+0000 7f0de3fff640 1 -- 172.21.15.7:0/1807533332 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8456+0+0 (secure 0 0 0) 0x7f0df40e7880 con 0x7f0dfc108cf0 2024-09-21T06:45:16.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.012+0000 7f0dfad9d640 1 --2- 172.21.15.7:0/577647690 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fd5940f1b0 0x55fd597df800 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc06b9c0 tx=0x7f0dec032df0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1456f3fd5ffd964b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:16.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.012+0000 7f0dfb59e640 1 --2- 172.21.15.7:0/1807533332 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f0de40b66b0 0x7f0de40b8bc0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f0df4004970 tx=0x7f0df40a1f70 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:16.021 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.012+0000 7f0de17fa640 1 -- 172.21.15.7:0/577647690 <== mon.2 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dec040070 con 0x55fd5940f1b0 2024-09-21T06:45:16.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.012+0000 7f0de17fa640 1 -- 172.21.15.7:0/577647690 <== mon.2 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0dec005db0 con 0x55fd5940f1b0 2024-09-21T06:45:16.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.012+0000 7f0de17fa640 1 -- 172.21.15.7:0/577647690 <== mon.2 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dec035040 con 0x55fd5940f1b0 2024-09-21T06:45:16.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.013+0000 7f0e0773b740 1 -- 172.21.15.7:0/577647690 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fd5940f1b0 msgr2=0x55fd597df800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:16.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.013+0000 7f0e0773b740 1 --2- 172.21.15.7:0/577647690 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fd5940f1b0 0x55fd597df800 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc06b9c0 tx=0x7f0dec032df0 comp rx=0 tx=0).stop 2024-09-21T06:45:16.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.013+0000 7f0e0773b740 1 -- 172.21.15.7:0/577647690 shutdown_connections 2024-09-21T06:45:16.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.013+0000 7f0e0773b740 1 --2- 172.21.15.7:0/577647690 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fd59417390 0x55fd597dfd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:16.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.013+0000 7f0e0773b740 1 --2- 172.21.15.7:0/577647690 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fd5940f1b0 0x55fd597df800 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:16.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.013+0000 7f0e0773b740 1 --2- 172.21.15.7:0/577647690 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fd59438070 0x55fd597df2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:16.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.013+0000 7f0e0773b740 1 -- 172.21.15.7:0/577647690 >> 172.21.15.7:0/577647690 conn(0x55fd5942c460 msgr2=0x55fd597dd1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:16.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.013+0000 7f0e0773b740 1 -- 172.21.15.7:0/577647690 shutdown_connections 2024-09-21T06:45:16.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.013+0000 7f0e0773b740 1 -- 172.21.15.7:0/577647690 wait complete. 2024-09-21T06:45:16.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.014+0000 7f0e0773b740 1 -- start start 2024-09-21T06:45:16.022 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.014+0000 7f0e0773b740 1 Processor -- start 2024-09-21T06:45:16.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.014+0000 7f0e0773b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fd5940f1b0 0x55fd597ea990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:16.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.014+0000 7f0e0773b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fd59417390 0x55fd597eaed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:16.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.014+0000 7f0e0773b740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fd59438070 0x55fd597f6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:16.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.014+0000 7f0e0773b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55fd595a6700 con 0x55fd59417390 2024-09-21T06:45:16.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.014+0000 7f0e0773b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55fd596e0160 con 0x55fd5940f1b0 2024-09-21T06:45:16.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.014+0000 7f0e0773b740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55fd597eda40 con 0x55fd59438070 2024-09-21T06:45:16.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.014+0000 7f0e0773b740 10 client.0 _ll_register_callbacks cb 0x55fd596f99e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:16.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.014+0000 7f0dfad9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fd59417390 0x55fd597eaed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:16.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.014+0000 7f0dfad9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fd59417390 0x55fd597eaed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39396/0 (socket says 172.21.15.7:39396) 2024-09-21T06:45:16.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.014+0000 7f0dfad9d640 1 -- 172.21.15.7:0/824708329 learned_addr learned my addr 172.21.15.7:0/824708329 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:16.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.015+0000 7f0dfa59c640 1 --2- 172.21.15.7:0/824708329 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fd5940f1b0 0x55fd597ea990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:16.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.015+0000 7f0dfa59c640 1 --2- 172.21.15.7:0/824708329 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fd59438070 0x55fd597f6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:16.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.015+0000 7f0dfad9d640 1 -- 172.21.15.7:0/824708329 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fd59438070 msgr2=0x55fd597f6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:16.023 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.015+0000 7f0dfad9d640 1 --2- 172.21.15.7:0/824708329 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fd59438070 0x55fd597f6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:16.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.015+0000 7f0dfad9d640 1 -- 172.21.15.7:0/824708329 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fd5940f1b0 msgr2=0x55fd597ea990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:16.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.015+0000 7f0dfad9d640 1 --2- 172.21.15.7:0/824708329 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fd5940f1b0 0x55fd597ea990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:16.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.015+0000 7f0dfad9d640 1 -- 172.21.15.7:0/824708329 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd5970dc90 con 0x55fd59417390 2024-09-21T06:45:16.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.015+0000 7f0dfad9d640 1 --2- 172.21.15.7:0/824708329 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fd59417390 0x55fd597eaed0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f0dec0056a0 tx=0x7f0dec0056d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f41d069f6acb5524 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:16.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.015+0000 7f0ddeff5640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:45:16.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.015+0000 7f0ddeff5640 1 -- 172.21.15.7:0/824708329 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dec035070 con 0x55fd59417390 2024-09-21T06:45:16.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.015+0000 7f0ddeff5640 1 -- 172.21.15.7:0/824708329 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8456+0+0 (secure 0 0 0) 0x7f0dec0317b0 con 0x55fd59417390 2024-09-21T06:45:16.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.015+0000 7f0e0773b740 1 -- 172.21.15.7:0/824708329 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0dec005db0 con 0x55fd59417390 2024-09-21T06:45:16.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.015+0000 7f0ddeff5640 1 -- 172.21.15.7:0/824708329 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0dec040040 con 0x55fd59417390 2024-09-21T06:45:16.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.015+0000 7f0e0773b740 10 client.17460 fetch_fsmap learned FSMap version 25 2024-09-21T06:45:16.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.015+0000 7f0e0773b740 1 -- 172.21.15.7:0/824708329 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55fd597f9760 con 0x55fd59417390 2024-09-21T06:45:16.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.016+0000 7f0ddeff5640 1 -- 172.21.15.7:0/824708329 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0dec005db0 con 0x55fd59417390 2024-09-21T06:45:16.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.016+0000 7f0ddeff5640 1 -- 172.21.15.7:0/824708329 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f0dec003850 con 0x55fd59417390 2024-09-21T06:45:16.024 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.016+0000 7f0e0773b740 10 client.17460 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:45:16.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.016+0000 7f0e0773b740 10 client.17460 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:45:16.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.016+0000 7f0e0773b740 20 client.17460 populate_metadata read hostname 'smithi007' 2024-09-21T06:45:16.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.016+0000 7f0e0773b740 1 --2- 172.21.15.7:0/824708329 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55fd593f69f0 0x55fd597fcac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:16.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.016+0000 7f0e0773b740 4 client.17460 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:45:16.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.016+0000 7f0e0773b740 1 -- 172.21.15.7:0/824708329 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fd59757df0 con 0x55fd593f69f0 2024-09-21T06:45:16.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.016+0000 7f0dfa59c640 1 --2- 172.21.15.7:0/824708329 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55fd593f69f0 0x55fd597fcac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:16.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.017+0000 7f0ddeff5640 10 client.17460 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:45:16.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.017+0000 7f0dfa59c640 1 --2- 172.21.15.7:0/824708329 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55fd593f69f0 0x55fd597fcac0 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=79195b6e7b1fbde7 server_cookie=620b43549ab760bd in_seq=0 out_seq=0 2024-09-21T06:45:16.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.017+0000 7f0ddeff5640 1 -- 172.21.15.7:0/824708329 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fd59757df0 con 0x55fd593f69f0 2024-09-21T06:45:16.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.017+0000 7f0ddeff5640 10 client.17460 handle_command_reply: tid=0 2024-09-21T06:45:16.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.018+0000 7f0e0773b740 1 client.17460 shutdown 2024-09-21T06:45:16.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.018+0000 7f0e0773b740 1 -- 172.21.15.7:0/824708329 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fd59417390 msgr2=0x55fd597eaed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:16.025 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.018+0000 7f0e0773b740 1 --2- 172.21.15.7:0/824708329 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fd59417390 0x55fd597eaed0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f0dec0056a0 tx=0x7f0dec0056d0 comp rx=0 tx=0).stop 2024-09-21T06:45:16.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.018+0000 7f0e0773b740 1 -- 172.21.15.7:0/824708329 shutdown_connections 2024-09-21T06:45:16.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.018+0000 7f0e0773b740 1 --2- 172.21.15.7:0/824708329 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55fd593f69f0 0x55fd597fcac0 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:16.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.018+0000 7f0e0773b740 1 --2- 172.21.15.7:0/824708329 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fd59438070 0x55fd597f6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:16.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.018+0000 7f0e0773b740 1 --2- 172.21.15.7:0/824708329 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fd59417390 0x55fd597eaed0 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:16.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.018+0000 7f0e0773b740 1 --2- 172.21.15.7:0/824708329 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fd5940f1b0 0x55fd597ea990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:16.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.018+0000 7f0e0773b740 1 -- 172.21.15.7:0/824708329 >> 172.21.15.7:0/824708329 conn(0x55fd5942c460 msgr2=0x55fd597e2450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:16.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.018+0000 7f0ddeff5640 0 client.17460 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:45:16.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.018+0000 7f0e0773b740 1 -- 172.21.15.7:0/824708329 shutdown_connections 2024-09-21T06:45:16.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.018+0000 7f0e0773b740 1 -- 172.21.15.7:0/824708329 wait complete. 2024-09-21T06:45:16.026 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.018+0000 7f0e0773b740 20 client.17460 trim_cache size 0 max 16384 2024-09-21T06:45:16.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.031+0000 7f0e0773b740 1 Processor -- start 2024-09-21T06:45:16.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.031+0000 7f0e0773b740 1 -- start start 2024-09-21T06:45:16.033 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.031+0000 7f0e0773b740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fd5940f1b0 0x55fd597e0a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:16.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.031+0000 7f0e0773b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fd59417390 0x55fd597ffed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:16.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.031+0000 7f0e0773b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fd59438070 0x55fd59800410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:16.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.031+0000 7f0e0773b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0dfc1b1dc0 con 0x55fd59438070 2024-09-21T06:45:16.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.031+0000 7f0e0773b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0dfc1af690 con 0x55fd59417390 2024-09-21T06:45:16.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.031+0000 7f0e0773b740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0dfc1ad500 con 0x55fd5940f1b0 2024-09-21T06:45:16.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.032+0000 7f0dfa59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fd59438070 0x55fd59800410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:16.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.032+0000 7f0dfa59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fd59438070 0x55fd59800410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39400/0 (socket says 172.21.15.7:39400) 2024-09-21T06:45:16.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.032+0000 7f0dfa59c640 1 -- 172.21.15.7:0/4022120600 learned_addr learned my addr 172.21.15.7:0/4022120600 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:16.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.032+0000 7f0dfa59c640 1 --2- 172.21.15.7:0/4022120600 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fd5940f1b0 0x55fd597e0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:16.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.032+0000 7f0dfad9d640 1 --2- 172.21.15.7:0/4022120600 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fd59417390 0x55fd597ffed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:16.034 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.032+0000 7f0dfa59c640 1 -- 172.21.15.7:0/4022120600 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fd5940f1b0 msgr2=0x55fd597e0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:16.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.032+0000 7f0dfa59c640 1 --2- 172.21.15.7:0/4022120600 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fd5940f1b0 0x55fd597e0a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:16.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.032+0000 7f0dfa59c640 1 -- 172.21.15.7:0/4022120600 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fd59417390 msgr2=0x55fd597ffed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:16.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.032+0000 7f0dfa59c640 1 --2- 172.21.15.7:0/4022120600 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fd59417390 0x55fd597ffed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:16.035 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.032+0000 7f0dfa59c640 1 -- 172.21.15.7:0/4022120600 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd597ddaa0 con 0x55fd59438070 2024-09-21T06:45:16.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.032+0000 7f0dfa59c640 1 --2- 172.21.15.7:0/4022120600 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fd59438070 0x55fd59800410 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f0df000a760 tx=0x7f0df00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ed7b2712aabc5ba server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:16.037 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.032+0000 7f0de0ff9640 1 -- 172.21.15.7:0/4022120600 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0df000f940 con 0x55fd59438070 2024-09-21T06:45:16.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.032+0000 7f0de0ff9640 1 -- 172.21.15.7:0/4022120600 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0df0005020 con 0x55fd59438070 2024-09-21T06:45:16.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.032+0000 7f0de0ff9640 1 -- 172.21.15.7:0/4022120600 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0df0004b00 con 0x55fd59438070 2024-09-21T06:45:16.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.033+0000 7f0e0773b740 1 -- 172.21.15.7:0/4022120600 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fd59438070 msgr2=0x55fd59800410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:16.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.033+0000 7f0e0773b740 1 --2- 172.21.15.7:0/4022120600 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fd59438070 0x55fd59800410 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f0df000a760 tx=0x7f0df00046c0 comp rx=0 tx=0).stop 2024-09-21T06:45:16.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.033+0000 7f0e0773b740 1 -- 172.21.15.7:0/4022120600 shutdown_connections 2024-09-21T06:45:16.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.033+0000 7f0e0773b740 1 --2- 172.21.15.7:0/4022120600 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fd59438070 0x55fd59800410 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:16.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.033+0000 7f0e0773b740 1 --2- 172.21.15.7:0/4022120600 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fd59417390 0x55fd597ffed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:16.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.033+0000 7f0e0773b740 1 --2- 172.21.15.7:0/4022120600 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fd5940f1b0 0x55fd597e0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:16.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.033+0000 7f0e0773b740 1 -- 172.21.15.7:0/4022120600 >> 172.21.15.7:0/4022120600 conn(0x55fd5942c460 msgr2=0x55fd597e02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:16.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.033+0000 7f0e0773b740 1 -- 172.21.15.7:0/4022120600 shutdown_connections 2024-09-21T06:45:16.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.033+0000 7f0e0773b740 1 -- 172.21.15.7:0/4022120600 wait complete. 2024-09-21T06:45:16.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.033+0000 7f0e0773b740 1 -- start start 2024-09-21T06:45:16.038 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.034+0000 7f0e0773b740 1 Processor -- start 2024-09-21T06:45:16.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.034+0000 7f0e0773b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fd5940f1b0 0x55fd5985e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:16.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.034+0000 7f0e0773b740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fd59417390 0x55fd5985ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:16.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.034+0000 7f0e0773b740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fd59438070 0x55fd59863be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:16.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.034+0000 7f0e0773b740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0dfc1adb50 con 0x55fd59438070 2024-09-21T06:45:16.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.034+0000 7f0e0773b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0dfc1aefc0 con 0x55fd5940f1b0 2024-09-21T06:45:16.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.034+0000 7f0e0773b740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0dfc1ae220 con 0x55fd59417390 2024-09-21T06:45:16.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.034+0000 7f0e0773b740 10 client.0 _ll_register_callbacks cb 0x7f0df000a7d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:16.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.034+0000 7f0dfa59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fd59438070 0x55fd59863be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:16.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.034+0000 7f0dfa59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fd59438070 0x55fd59863be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39408/0 (socket says 172.21.15.7:39408) 2024-09-21T06:45:16.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.034+0000 7f0dfa59c640 1 -- 172.21.15.7:0/1247780577 learned_addr learned my addr 172.21.15.7:0/1247780577 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:16.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.034+0000 7f0dfa59c640 1 --2- 172.21.15.7:0/1247780577 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fd5940f1b0 0x55fd5985e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:16.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.034+0000 7f0dfad9d640 1 --2- 172.21.15.7:0/1247780577 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fd59417390 0x55fd5985ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:16.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.034+0000 7f0dfa59c640 1 -- 172.21.15.7:0/1247780577 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fd59417390 msgr2=0x55fd5985ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:16.039 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.034+0000 7f0dfa59c640 1 --2- 172.21.15.7:0/1247780577 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fd59417390 0x55fd5985ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:16.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.034+0000 7f0dfa59c640 1 -- 172.21.15.7:0/1247780577 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fd5940f1b0 msgr2=0x55fd5985e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:16.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.034+0000 7f0dfa59c640 1 --2- 172.21.15.7:0/1247780577 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fd5940f1b0 0x55fd5985e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:16.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.034+0000 7f0dfa59c640 1 -- 172.21.15.7:0/1247780577 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd59864250 con 0x55fd59438070 2024-09-21T06:45:16.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.035+0000 7f0dfa59c640 1 --2- 172.21.15.7:0/1247780577 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fd59438070 0x55fd59863be0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f0df0029040 tx=0x7f0df00047a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=927c754c08022dc5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:16.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.035+0000 7f0ddeff5640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:45:16.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.035+0000 7f0ddeff5640 1 -- 172.21.15.7:0/1247780577 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0df000fcd0 con 0x55fd59438070 2024-09-21T06:45:16.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.035+0000 7f0ddeff5640 1 -- 172.21.15.7:0/1247780577 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8456+0+0 (secure 0 0 0) 0x7f0df001a040 con 0x55fd59438070 2024-09-21T06:45:16.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.035+0000 7f0e0773b740 1 -- 172.21.15.7:0/1247780577 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0df0005020 con 0x55fd59438070 2024-09-21T06:45:16.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.035+0000 7f0ddeff5640 1 -- 172.21.15.7:0/1247780577 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0df0004880 con 0x55fd59438070 2024-09-21T06:45:16.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.035+0000 7f0e0773b740 10 client.17466 fetch_fsmap learned FSMap version 25 2024-09-21T06:45:16.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.035+0000 7f0e0773b740 1 -- 172.21.15.7:0/1247780577 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55fd5986b640 con 0x55fd59438070 2024-09-21T06:45:16.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.035+0000 7f0ddeff5640 1 -- 172.21.15.7:0/1247780577 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0df0005020 con 0x55fd59438070 2024-09-21T06:45:16.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.035+0000 7f0ddeff5640 1 -- 172.21.15.7:0/1247780577 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f0df003d9a0 con 0x55fd59438070 2024-09-21T06:45:16.040 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.036+0000 7f0e0773b740 10 client.17466 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:45:16.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.036+0000 7f0e0773b740 10 client.17466 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:45:16.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.036+0000 7f0e0773b740 20 client.17466 populate_metadata read hostname 'smithi007' 2024-09-21T06:45:16.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.036+0000 7f0e0773b740 1 --2- 172.21.15.7:0/1247780577 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55fd593cbda0 0x55fd5986dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:16.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.036+0000 7f0e0773b740 4 client.17466 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:45:16.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.036+0000 7f0e0773b740 1 -- 172.21.15.7:0/1247780577 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fd597e6540 con 0x55fd593cbda0 2024-09-21T06:45:16.041 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.036+0000 7f0dfad9d640 1 --2- 172.21.15.7:0/1247780577 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55fd593cbda0 0x55fd5986dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:16.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.036+0000 7f0ddeff5640 10 client.17466 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:45:16.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.036+0000 7f0dfad9d640 1 --2- 172.21.15.7:0/1247780577 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55fd593cbda0 0x55fd5986dd20 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=85788dfa45824cb7 server_cookie=ba10abbad0b5211a in_seq=0 out_seq=0 2024-09-21T06:45:16.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.037+0000 7f0ddeff5640 1 -- 172.21.15.7:0/1247780577 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fd597e6540 con 0x55fd593cbda0 2024-09-21T06:45:16.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.037+0000 7f0ddeff5640 10 client.17466 handle_command_reply: tid=0 2024-09-21T06:45:16.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.037+0000 7f0e0773b740 1 client.17466 shutdown 2024-09-21T06:45:16.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.037+0000 7f0e0773b740 1 -- 172.21.15.7:0/1247780577 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fd59438070 msgr2=0x55fd59863be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:16.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.037+0000 7f0e0773b740 1 --2- 172.21.15.7:0/1247780577 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fd59438070 0x55fd59863be0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f0df0029040 tx=0x7f0df00047a0 comp rx=0 tx=0).stop 2024-09-21T06:45:16.042 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.037+0000 7f0e0773b740 1 -- 172.21.15.7:0/1247780577 shutdown_connections 2024-09-21T06:45:16.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.037+0000 7f0e0773b740 1 --2- 172.21.15.7:0/1247780577 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55fd593cbda0 0x55fd5986dd20 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:16.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.037+0000 7f0e0773b740 1 --2- 172.21.15.7:0/1247780577 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55fd59438070 0x55fd59863be0 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:16.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.037+0000 7f0e0773b740 1 --2- 172.21.15.7:0/1247780577 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55fd59417390 0x55fd5985ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:16.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.037+0000 7f0ddeff5640 0 client.17466 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:45:16.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.037+0000 7f0e0773b740 1 --2- 172.21.15.7:0/1247780577 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55fd5940f1b0 0x55fd5985e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:16.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.037+0000 7f0e0773b740 1 -- 172.21.15.7:0/1247780577 >> 172.21.15.7:0/1247780577 conn(0x55fd5942c460 msgr2=0x55fd597ebdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:16.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.037+0000 7f0e0773b740 1 -- 172.21.15.7:0/1247780577 shutdown_connections 2024-09-21T06:45:16.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.037+0000 7f0e0773b740 1 -- 172.21.15.7:0/1247780577 wait complete. 2024-09-21T06:45:16.043 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.037+0000 7f0e0773b740 20 client.17466 trim_cache size 0 max 16384 2024-09-21T06:45:16.043 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:45:16.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.037+0000 7f0e011c7640 1 -- 172.21.15.7:0/1807533332 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f0de40b66b0 msgr2=0x7f0de40b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:16.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.037+0000 7f0e011c7640 1 --2- 172.21.15.7:0/1807533332 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f0de40b66b0 0x7f0de40b8bc0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f0df4004970 tx=0x7f0df40a1f70 comp rx=0 tx=0).stop 2024-09-21T06:45:16.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.037+0000 7f0e011c7640 1 -- 172.21.15.7:0/1807533332 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0dfc108cf0 msgr2=0x7f0dfc19bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:16.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.037+0000 7f0e011c7640 1 --2- 172.21.15.7:0/1807533332 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0dfc108cf0 0x7f0dfc19bcf0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f0df400eaa0 tx=0x7f0df400eea0 comp rx=0 tx=0).stop 2024-09-21T06:45:16.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.037+0000 7f0e011c7640 1 -- 172.21.15.7:0/1807533332 shutdown_connections 2024-09-21T06:45:16.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.038+0000 7f0e011c7640 1 --2- 172.21.15.7:0/1807533332 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f0de40b66b0 0x7f0de40b8bc0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:16.044 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.038+0000 7f0e011c7640 1 --2- 172.21.15.7:0/1807533332 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0dfc108cf0 0x7f0dfc19bcf0 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:16.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.038+0000 7f0e011c7640 1 --2- 172.21.15.7:0/1807533332 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0dfc1083a0 0x7f0dfc19b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:16.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.038+0000 7f0e011c7640 1 --2- 172.21.15.7:0/1807533332 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0dfc102a60 0x7f0dfc19b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:16.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.038+0000 7f0e011c7640 1 -- 172.21.15.7:0/1807533332 >> 172.21.15.7:0/1807533332 conn(0x7f0dfc079730 msgr2=0x7f0dfc1013b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:16.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.038+0000 7f0e011c7640 1 -- 172.21.15.7:0/1807533332 shutdown_connections 2024-09-21T06:45:16.045 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:16.038+0000 7f0e011c7640 1 -- 172.21.15.7:0/1807533332 wait complete. 2024-09-21T06:45:16.719 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:45:16 smithi007 ceph-mon[30983]: pgmap v596: 97 pgs: 97 active+clean; 3.3 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 204 B/s wr, 7 op/s 2024-09-21T06:45:16.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:45:16 smithi144 ceph-mon[34653]: pgmap v596: 97 pgs: 97 active+clean; 3.3 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 204 B/s wr, 7 op/s 2024-09-21T06:45:16.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:45:16 smithi018 ceph-mon[34477]: pgmap v596: 97 pgs: 97 active+clean; 3.3 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 204 B/s wr, 7 op/s 2024-09-21T06:45:17.752 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:45:17.752 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:45:18.027 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:45:18.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.525+0000 7fb4d096a640 1 -- 172.21.15.7:0/3573508663 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb4cc102a70 msgr2=0x7fb4cc102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:18.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.525+0000 7fb4d096a640 1 --2- 172.21.15.7:0/3573508663 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb4cc102a70 0x7fb4cc102e80 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc009ca0 tx=0x7fb4bc02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:45:18.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.525+0000 7fb4d096a640 1 -- 172.21.15.7:0/3573508663 shutdown_connections 2024-09-21T06:45:18.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.525+0000 7fb4d096a640 1 --2- 172.21.15.7:0/3573508663 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4cc108d00 0x7fb4cc10f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:18.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.525+0000 7fb4d096a640 1 --2- 172.21.15.7:0/3573508663 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb4cc1083b0 0x7fb4cc1087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:18.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.525+0000 7fb4d096a640 1 --2- 172.21.15.7:0/3573508663 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb4cc102a70 0x7fb4cc102e80 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:18.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.525+0000 7fb4d096a640 1 -- 172.21.15.7:0/3573508663 >> 172.21.15.7:0/3573508663 conn(0x7fb4cc079710 msgr2=0x7fb4cc079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:18.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.525+0000 7fb4d096a640 1 -- 172.21.15.7:0/3573508663 shutdown_connections 2024-09-21T06:45:18.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.526+0000 7fb4d096a640 1 -- 172.21.15.7:0/3573508663 wait complete. 2024-09-21T06:45:18.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.526+0000 7fb4d096a640 1 Processor -- start 2024-09-21T06:45:18.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.526+0000 7fb4d096a640 1 -- start start 2024-09-21T06:45:18.549 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.527+0000 7fb4d096a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb4cc102a70 0x7fb4cc19a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:18.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.527+0000 7fb4d096a640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4cc1083b0 0x7fb4cc19aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:18.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.527+0000 7fb4d096a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb4cc108d00 0x7fb4cc19fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:18.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.527+0000 7fb4d096a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb4cc1129c0 con 0x7fb4cc102a70 2024-09-21T06:45:18.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.527+0000 7fb4d096a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb4cc112840 con 0x7fb4cc108d00 2024-09-21T06:45:18.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.527+0000 7fb4d096a640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb4cc112b40 con 0x7fb4cc1083b0 2024-09-21T06:45:18.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.527+0000 7fb4ca59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb4cc102a70 0x7fb4cc19a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:18.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.527+0000 7fb4ca59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb4cc102a70 0x7fb4cc19a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39420/0 (socket says 172.21.15.7:39420) 2024-09-21T06:45:18.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.527+0000 7fb4ca59c640 1 -- 172.21.15.7:0/1348651599 learned_addr learned my addr 172.21.15.7:0/1348651599 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:18.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.527+0000 7fb4c9d9b640 1 --2- 172.21.15.7:0/1348651599 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4cc1083b0 0x7fb4cc19aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:18.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.527+0000 7fb4cad9d640 1 --2- 172.21.15.7:0/1348651599 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb4cc108d00 0x7fb4cc19fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:18.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.527+0000 7fb4ca59c640 1 -- 172.21.15.7:0/1348651599 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4cc1083b0 msgr2=0x7fb4cc19aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:18.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.527+0000 7fb4ca59c640 1 --2- 172.21.15.7:0/1348651599 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4cc1083b0 0x7fb4cc19aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:18.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.527+0000 7fb4ca59c640 1 -- 172.21.15.7:0/1348651599 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb4cc108d00 msgr2=0x7fb4cc19fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:18.550 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.527+0000 7fb4ca59c640 1 --2- 172.21.15.7:0/1348651599 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb4cc108d00 0x7fb4cc19fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:18.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.527+0000 7fb4ca59c640 1 -- 172.21.15.7:0/1348651599 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4cc1a0490 con 0x7fb4cc102a70 2024-09-21T06:45:18.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.527+0000 7fb4c9d9b640 1 --2- 172.21.15.7:0/1348651599 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4cc1083b0 0x7fb4cc19aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:18.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.527+0000 7fb4cad9d640 1 --2- 172.21.15.7:0/1348651599 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb4cc108d00 0x7fb4cc19fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:18.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.527+0000 7fb4ca59c640 1 --2- 172.21.15.7:0/1348651599 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb4cc102a70 0x7fb4cc19a520 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc006010 tx=0x7fb4bc0319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:18.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.528+0000 7fb4c37fe640 1 -- 172.21.15.7:0/1348651599 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4bc003bf0 con 0x7fb4cc102a70 2024-09-21T06:45:18.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.528+0000 7fb4c37fe640 1 -- 172.21.15.7:0/1348651599 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb4bc003d90 con 0x7fb4cc102a70 2024-09-21T06:45:18.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.528+0000 7fb4c37fe640 1 -- 172.21.15.7:0/1348651599 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4bc02fc20 con 0x7fb4cc102a70 2024-09-21T06:45:18.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.528+0000 7fb4d096a640 1 -- 172.21.15.7:0/1348651599 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4cc1a0720 con 0x7fb4cc102a70 2024-09-21T06:45:18.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.528+0000 7fb4d096a640 1 -- 172.21.15.7:0/1348651599 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4cc1a6ee0 con 0x7fb4cc102a70 2024-09-21T06:45:18.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.530+0000 7fb4d6ede740 1 Processor -- start 2024-09-21T06:45:18.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.531+0000 7fb4d6ede740 1 -- start start 2024-09-21T06:45:18.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.531+0000 7fb4c37fe640 1 -- 172.21.15.7:0/1348651599 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7fb4bc0046a0 con 0x7fb4cc102a70 2024-09-21T06:45:18.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.531+0000 7fb4d6ede740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560df7fc5350 0x560df836c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:18.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.531+0000 7fb4d6ede740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560df7f9c490 0x560df836c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:18.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.531+0000 7fb4d6ede740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560df7fa4670 0x560df836ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:18.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.531+0000 7fb4d6ede740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x560df82e2e60 con 0x560df7fa4670 2024-09-21T06:45:18.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.531+0000 7fb4d6ede740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x560df82d2290 con 0x560df7fc5350 2024-09-21T06:45:18.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.531+0000 7fb4d6ede740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x560df82d60a0 con 0x560df7f9c490 2024-09-21T06:45:18.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.531+0000 7fb4c9d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560df7fa4670 0x560df836ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:18.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.531+0000 7fb4cad9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560df7fc5350 0x560df836c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:18.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.531+0000 7fb4c9d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560df7fa4670 0x560df836ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39436/0 (socket says 172.21.15.7:39436) 2024-09-21T06:45:18.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.531+0000 7fb4c9d9b640 1 -- 172.21.15.7:0/3240554085 learned_addr learned my addr 172.21.15.7:0/3240554085 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:18.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.531+0000 7fb4ca59c640 1 --2- 172.21.15.7:0/3240554085 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560df7f9c490 0x560df836c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:18.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.532+0000 7fb4c9d9b640 1 -- 172.21.15.7:0/3240554085 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560df7f9c490 msgr2=0x560df836c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:18.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.532+0000 7fb4c9d9b640 1 --2- 172.21.15.7:0/3240554085 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560df7f9c490 0x560df836c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:18.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.532+0000 7fb4c9d9b640 1 -- 172.21.15.7:0/3240554085 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560df7fc5350 msgr2=0x560df836c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:18.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.532+0000 7fb4c9d9b640 1 --2- 172.21.15.7:0/3240554085 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560df7fc5350 0x560df836c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:18.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.532+0000 7fb4c9d9b640 1 -- 172.21.15.7:0/3240554085 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560df8030930 con 0x560df7fa4670 2024-09-21T06:45:18.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.532+0000 7fb4cad9d640 1 --2- 172.21.15.7:0/3240554085 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560df7fc5350 0x560df836c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:45:18.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.532+0000 7fb4c9d9b640 1 --2- 172.21.15.7:0/3240554085 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560df7fa4670 0x560df836ceb0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fb4b400bc30 tx=0x7fb4b400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bf255c5760f6d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:18.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.532+0000 7fb4c37fe640 1 --2- 172.21.15.7:0/1348651599 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fb4b80b6680 0x7fb4b80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:18.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.532+0000 7fb4c0ff9640 1 -- 172.21.15.7:0/3240554085 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4b4004030 con 0x560df7fa4670 2024-09-21T06:45:18.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.532+0000 7fb4cad9d640 1 --2- 172.21.15.7:0/1348651599 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fb4b80b6680 0x7fb4b80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:18.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.532+0000 7fb4c0ff9640 1 -- 172.21.15.7:0/3240554085 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb4b4005020 con 0x560df7fa4670 2024-09-21T06:45:18.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.532+0000 7fb4c0ff9640 1 -- 172.21.15.7:0/3240554085 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4b4004b80 con 0x560df7fa4670 2024-09-21T06:45:18.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.532+0000 7fb4c37fe640 1 -- 172.21.15.7:0/1348651599 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7fb4bc108aa0 con 0x7fb4cc102a70 2024-09-21T06:45:18.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.533+0000 7fb4d6ede740 1 -- 172.21.15.7:0/3240554085 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560df7fa4670 msgr2=0x560df836ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:18.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.533+0000 7fb4d6ede740 1 --2- 172.21.15.7:0/3240554085 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560df7fa4670 0x560df836ceb0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fb4b400bc30 tx=0x7fb4b400f730 comp rx=0 tx=0).stop 2024-09-21T06:45:18.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.533+0000 7fb4cad9d640 1 --2- 172.21.15.7:0/1348651599 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fb4b80b6680 0x7fb4b80b8b90 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fb4c4005fd0 tx=0x7fb4c400c400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:18.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.533+0000 7fb4d6ede740 1 -- 172.21.15.7:0/3240554085 shutdown_connections 2024-09-21T06:45:18.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.533+0000 7fb4d6ede740 1 --2- 172.21.15.7:0/3240554085 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560df7fa4670 0x560df836ceb0 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:18.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.533+0000 7fb4d6ede740 1 --2- 172.21.15.7:0/3240554085 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560df7f9c490 0x560df836c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:18.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.533+0000 7fb4d6ede740 1 --2- 172.21.15.7:0/3240554085 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560df7fc5350 0x560df836c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:18.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.533+0000 7fb4d6ede740 1 -- 172.21.15.7:0/3240554085 >> 172.21.15.7:0/3240554085 conn(0x560df7fb9740 msgr2=0x560df836a320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:18.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.533+0000 7fb4d6ede740 1 -- 172.21.15.7:0/3240554085 shutdown_connections 2024-09-21T06:45:18.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.533+0000 7fb4d6ede740 1 -- 172.21.15.7:0/3240554085 wait complete. 2024-09-21T06:45:18.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.534+0000 7fb4d6ede740 1 -- start start 2024-09-21T06:45:18.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.534+0000 7fb4d6ede740 1 Processor -- start 2024-09-21T06:45:18.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.534+0000 7fb4d6ede740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560df7f9c490 0x560df8378000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:18.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.534+0000 7fb4d6ede740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560df7fa4670 0x560df8378540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:18.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.534+0000 7fb4d6ede740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560df7fc5350 0x560df8383f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:18.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.534+0000 7fb4d6ede740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x560df8133890 con 0x560df7fa4670 2024-09-21T06:45:18.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.534+0000 7fb4d6ede740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x560df826cd40 con 0x560df7fc5350 2024-09-21T06:45:18.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.534+0000 7fb4d6ede740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x560df837ac10 con 0x560df7f9c490 2024-09-21T06:45:18.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.534+0000 7fb4d6ede740 10 client.0 _ll_register_callbacks cb 0x560df82d0c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:18.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.534+0000 7fb4c9d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560df7fa4670 0x560df8378540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:18.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.534+0000 7fb4c9d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560df7fa4670 0x560df8378540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39442/0 (socket says 172.21.15.7:39442) 2024-09-21T06:45:18.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.534+0000 7fb4c9d9b640 1 -- 172.21.15.7:0/376233881 learned_addr learned my addr 172.21.15.7:0/376233881 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:18.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.534+0000 7fb4cad9d640 1 --2- 172.21.15.7:0/376233881 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560df7fc5350 0x560df8383f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:18.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.534+0000 7fb4ca59c640 1 --2- 172.21.15.7:0/376233881 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560df7f9c490 0x560df8378000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:18.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.534+0000 7fb4c9d9b640 1 -- 172.21.15.7:0/376233881 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560df7f9c490 msgr2=0x560df8378000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:18.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.535+0000 7fb4c9d9b640 1 --2- 172.21.15.7:0/376233881 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560df7f9c490 0x560df8378000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:18.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.535+0000 7fb4c9d9b640 1 -- 172.21.15.7:0/376233881 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560df7fc5350 msgr2=0x560df8383f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:18.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.535+0000 7fb4c9d9b640 1 --2- 172.21.15.7:0/376233881 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560df7fc5350 0x560df8383f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:18.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.535+0000 7fb4c9d9b640 1 -- 172.21.15.7:0/376233881 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560df83844f0 con 0x560df7fa4670 2024-09-21T06:45:18.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.535+0000 7fb4c9d9b640 1 --2- 172.21.15.7:0/376233881 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560df7fa4670 0x560df8378540 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fb4b4004880 tx=0x7fb4b400bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fd533afed14b53d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:18.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.535+0000 7fb4b1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:45:18.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.535+0000 7fb4b1ffb640 1 -- 172.21.15.7:0/376233881 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4b402a060 con 0x560df7fa4670 2024-09-21T06:45:18.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.535+0000 7fb4d6ede740 1 -- 172.21.15.7:0/376233881 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb4b4005020 con 0x560df7fa4670 2024-09-21T06:45:18.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.535+0000 7fb4b1ffb640 1 -- 172.21.15.7:0/376233881 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7fb4b4005460 con 0x560df7fa4670 2024-09-21T06:45:18.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.535+0000 7fb4b1ffb640 1 -- 172.21.15.7:0/376233881 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb4b4004040 con 0x560df7fa4670 2024-09-21T06:45:18.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.535+0000 7fb4d6ede740 10 client.17478 fetch_fsmap learned FSMap version 25 2024-09-21T06:45:18.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.535+0000 7fb4d6ede740 1 -- 172.21.15.7:0/376233881 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560df8386e00 con 0x560df7fa4670 2024-09-21T06:45:18.555 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.535+0000 7fb4b1ffb640 1 -- 172.21.15.7:0/376233881 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb4b4005020 con 0x560df7fa4670 2024-09-21T06:45:18.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.536+0000 7fb4b1ffb640 1 -- 172.21.15.7:0/376233881 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb4b402d020 con 0x560df7fa4670 2024-09-21T06:45:18.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.536+0000 7fb4d6ede740 10 client.17478 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:45:18.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.536+0000 7fb4d6ede740 10 client.17478 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:45:18.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.536+0000 7fb4d6ede740 20 client.17478 populate_metadata read hostname 'smithi007' 2024-09-21T06:45:18.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.536+0000 7fb4d6ede740 1 --2- 172.21.15.7:0/376233881 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x560df7f83cd0 0x560df838a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:18.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.536+0000 7fb4d6ede740 4 client.17478 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:45:18.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.536+0000 7fb4d6ede740 1 -- 172.21.15.7:0/376233881 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560df82e4db0 con 0x560df7f83cd0 2024-09-21T06:45:18.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.536+0000 7fb4ca59c640 1 --2- 172.21.15.7:0/376233881 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x560df7f83cd0 0x560df838a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:18.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.536+0000 7fb4b1ffb640 10 client.17478 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:45:18.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.536+0000 7fb4ca59c640 1 --2- 172.21.15.7:0/376233881 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x560df7f83cd0 0x560df838a1c0 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1500617b43feb765 server_cookie=1da668cdb9bc159d in_seq=0 out_seq=0 2024-09-21T06:45:18.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.537+0000 7fb4b1ffb640 1 -- 172.21.15.7:0/376233881 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560df82e4db0 con 0x560df7f83cd0 2024-09-21T06:45:18.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.537+0000 7fb4b1ffb640 10 client.17478 handle_command_reply: tid=0 2024-09-21T06:45:18.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.537+0000 7fb4d6ede740 1 client.17478 shutdown 2024-09-21T06:45:18.556 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.537+0000 7fb4d6ede740 1 -- 172.21.15.7:0/376233881 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560df7fa4670 msgr2=0x560df8378540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:18.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.537+0000 7fb4d6ede740 1 --2- 172.21.15.7:0/376233881 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560df7fa4670 0x560df8378540 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fb4b4004880 tx=0x7fb4b400bf50 comp rx=0 tx=0).stop 2024-09-21T06:45:18.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.537+0000 7fb4d6ede740 1 -- 172.21.15.7:0/376233881 shutdown_connections 2024-09-21T06:45:18.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.537+0000 7fb4d6ede740 1 --2- 172.21.15.7:0/376233881 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x560df7f83cd0 0x560df838a1c0 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:18.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.537+0000 7fb4b1ffb640 0 client.17478 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:45:18.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.537+0000 7fb4d6ede740 1 --2- 172.21.15.7:0/376233881 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560df7fc5350 0x560df8383f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:18.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.537+0000 7fb4d6ede740 1 --2- 172.21.15.7:0/376233881 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560df7fa4670 0x560df8378540 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:18.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.537+0000 7fb4d6ede740 1 --2- 172.21.15.7:0/376233881 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560df7f9c490 0x560df8378000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:18.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.537+0000 7fb4d6ede740 1 -- 172.21.15.7:0/376233881 >> 172.21.15.7:0/376233881 conn(0x560df7fb9740 msgr2=0x560df836f610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:18.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.538+0000 7fb4d6ede740 1 -- 172.21.15.7:0/376233881 shutdown_connections 2024-09-21T06:45:18.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.538+0000 7fb4d6ede740 1 -- 172.21.15.7:0/376233881 wait complete. 2024-09-21T06:45:18.557 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.538+0000 7fb4d6ede740 20 client.17478 trim_cache size 0 max 16384 2024-09-21T06:45:18.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.555+0000 7fb4d6ede740 1 Processor -- start 2024-09-21T06:45:18.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.556+0000 7fb4d6ede740 1 -- start start 2024-09-21T06:45:18.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.556+0000 7fb4d6ede740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560df7f83cd0 0x560df8379a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:18.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.556+0000 7fb4d6ede740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560df7f9c490 0x560df8374ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:18.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.556+0000 7fb4d6ede740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560df7fa4670 0x560df8375530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:18.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.556+0000 7fb4d6ede740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb4cc1b1e90 con 0x560df7f83cd0 2024-09-21T06:45:18.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.556+0000 7fb4d6ede740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb4cc1af760 con 0x560df7fa4670 2024-09-21T06:45:18.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.556+0000 7fb4d6ede740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb4cc1ad5d0 con 0x560df7f9c490 2024-09-21T06:45:18.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.556+0000 7fb4ca59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560df7f83cd0 0x560df8379a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:18.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.556+0000 7fb4ca59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560df7f83cd0 0x560df8379a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39452/0 (socket says 172.21.15.7:39452) 2024-09-21T06:45:18.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.556+0000 7fb4ca59c640 1 -- 172.21.15.7:0/2023976502 learned_addr learned my addr 172.21.15.7:0/2023976502 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:18.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.556+0000 7fb4c9d9b640 1 --2- 172.21.15.7:0/2023976502 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560df7f9c490 0x560df8374ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:18.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.556+0000 7fb4ca59c640 1 -- 172.21.15.7:0/2023976502 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560df7f9c490 msgr2=0x560df8374ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:18.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.556+0000 7fb4ca59c640 1 --2- 172.21.15.7:0/2023976502 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560df7f9c490 0x560df8374ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:18.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.556+0000 7fb4ca59c640 1 -- 172.21.15.7:0/2023976502 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560df7fa4670 msgr2=0x560df8375530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:18.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.556+0000 7fb4ca59c640 1 --2- 172.21.15.7:0/2023976502 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560df7fa4670 0x560df8375530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:18.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.556+0000 7fb4ca59c640 1 -- 172.21.15.7:0/2023976502 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560df836e720 con 0x560df7f83cd0 2024-09-21T06:45:18.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.556+0000 7fb4c9d9b640 1 --2- 172.21.15.7:0/2023976502 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560df7f9c490 0x560df8374ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:18.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.556+0000 7fb4ca59c640 1 --2- 172.21.15.7:0/2023976502 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560df7f83cd0 0x560df8379a30 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc004af0 tx=0x7fb4bc009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58d0f61a9a5814dc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:18.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.557+0000 7fb4b3fff640 1 -- 172.21.15.7:0/2023976502 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4bc10e070 con 0x560df7f83cd0 2024-09-21T06:45:18.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.557+0000 7fb4b3fff640 1 -- 172.21.15.7:0/2023976502 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb4bc036040 con 0x560df7f83cd0 2024-09-21T06:45:18.560 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.557+0000 7fb4b3fff640 1 -- 172.21.15.7:0/2023976502 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4bc0ca0d0 con 0x560df7f83cd0 2024-09-21T06:45:18.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.557+0000 7fb4d6ede740 1 -- 172.21.15.7:0/2023976502 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560df7f83cd0 msgr2=0x560df8379a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:18.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.557+0000 7fb4d6ede740 1 --2- 172.21.15.7:0/2023976502 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560df7f83cd0 0x560df8379a30 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc004af0 tx=0x7fb4bc009a20 comp rx=0 tx=0).stop 2024-09-21T06:45:18.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.557+0000 7fb4d6ede740 1 -- 172.21.15.7:0/2023976502 shutdown_connections 2024-09-21T06:45:18.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.558+0000 7fb4d6ede740 1 --2- 172.21.15.7:0/2023976502 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560df7fa4670 0x560df8375530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:18.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.558+0000 7fb4d6ede740 1 --2- 172.21.15.7:0/2023976502 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560df7f9c490 0x560df8374ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:18.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.558+0000 7fb4d6ede740 1 --2- 172.21.15.7:0/2023976502 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560df7f83cd0 0x560df8379a30 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:18.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.558+0000 7fb4d6ede740 1 -- 172.21.15.7:0/2023976502 >> 172.21.15.7:0/2023976502 conn(0x560df7fb9740 msgr2=0x560df8379320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:18.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.558+0000 7fb4d6ede740 1 -- 172.21.15.7:0/2023976502 shutdown_connections 2024-09-21T06:45:18.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.558+0000 7fb4d6ede740 1 -- 172.21.15.7:0/2023976502 wait complete. 2024-09-21T06:45:18.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.558+0000 7fb4d6ede740 1 -- start start 2024-09-21T06:45:18.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.558+0000 7fb4d6ede740 1 Processor -- start 2024-09-21T06:45:18.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.558+0000 7fb4d6ede740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560df7f83cd0 0x560df838bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:18.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.558+0000 7fb4d6ede740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560df7f9c490 0x560df838c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:18.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.558+0000 7fb4d6ede740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560df7fa4670 0x560df83ed980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:18.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.558+0000 7fb4d6ede740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb4cc1adc20 con 0x560df7f83cd0 2024-09-21T06:45:18.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.558+0000 7fb4d6ede740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb4cc1af090 con 0x560df7fa4670 2024-09-21T06:45:18.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.558+0000 7fb4d6ede740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb4cc1ae2f0 con 0x560df7f9c490 2024-09-21T06:45:18.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.558+0000 7fb4d6ede740 10 client.0 _ll_register_callbacks cb 0x7fb4b4015070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:18.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.559+0000 7fb4ca59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560df7f83cd0 0x560df838bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:18.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.559+0000 7fb4ca59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560df7f83cd0 0x560df838bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39458/0 (socket says 172.21.15.7:39458) 2024-09-21T06:45:18.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.559+0000 7fb4ca59c640 1 -- 172.21.15.7:0/1497324784 learned_addr learned my addr 172.21.15.7:0/1497324784 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:18.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.559+0000 7fb4c9d9b640 1 --2- 172.21.15.7:0/1497324784 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560df7f9c490 0x560df838c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:18.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.559+0000 7fb4cad9d640 1 --2- 172.21.15.7:0/1497324784 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560df7fa4670 0x560df83ed980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:18.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.559+0000 7fb4ca59c640 1 -- 172.21.15.7:0/1497324784 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560df7f9c490 msgr2=0x560df838c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:18.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.559+0000 7fb4ca59c640 1 --2- 172.21.15.7:0/1497324784 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560df7f9c490 0x560df838c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:18.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.559+0000 7fb4ca59c640 1 -- 172.21.15.7:0/1497324784 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560df7fa4670 msgr2=0x560df83ed980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:18.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.559+0000 7fb4ca59c640 1 --2- 172.21.15.7:0/1497324784 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560df7fa4670 0x560df83ed980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:18.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.559+0000 7fb4ca59c640 1 -- 172.21.15.7:0/1497324784 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560df83edff0 con 0x560df7f83cd0 2024-09-21T06:45:18.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.559+0000 7fb4cad9d640 1 --2- 172.21.15.7:0/1497324784 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560df7fa4670 0x560df83ed980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:18.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.559+0000 7fb4ca59c640 1 --2- 172.21.15.7:0/1497324784 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560df7f83cd0 0x560df838bc10 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc0ce660 tx=0x7fb4bc10bfc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4af202b2015730ed server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:18.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.559+0000 7fb4b1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:45:18.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.559+0000 7fb4b1ffb640 1 -- 172.21.15.7:0/1497324784 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4bc10e070 con 0x560df7f83cd0 2024-09-21T06:45:18.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.559+0000 7fb4b1ffb640 1 -- 172.21.15.7:0/1497324784 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7fb4bc0d3050 con 0x560df7f83cd0 2024-09-21T06:45:18.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.559+0000 7fb4d6ede740 1 -- 172.21.15.7:0/1497324784 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb4bc036040 con 0x560df7f83cd0 2024-09-21T06:45:18.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.559+0000 7fb4b1ffb640 1 -- 172.21.15.7:0/1497324784 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb4bc0ce0d0 con 0x560df7f83cd0 2024-09-21T06:45:18.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.560+0000 7fb4d6ede740 10 client.17484 fetch_fsmap learned FSMap version 25 2024-09-21T06:45:18.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.560+0000 7fb4d6ede740 1 -- 172.21.15.7:0/1497324784 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560df83f5420 con 0x560df7f83cd0 2024-09-21T06:45:18.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.560+0000 7fb4b1ffb640 1 -- 172.21.15.7:0/1497324784 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb4bc036040 con 0x560df7f83cd0 2024-09-21T06:45:18.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.560+0000 7fb4b1ffb640 1 -- 172.21.15.7:0/1497324784 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fb4bc0d7ef0 con 0x560df7f83cd0 2024-09-21T06:45:18.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.560+0000 7fb4d6ede740 10 client.17484 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:45:18.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.560+0000 7fb4d6ede740 10 client.17484 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:45:18.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.560+0000 7fb4d6ede740 20 client.17484 populate_metadata read hostname 'smithi007' 2024-09-21T06:45:18.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.560+0000 7fb4d6ede740 1 --2- 172.21.15.7:0/1497324784 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x560df7fc5350 0x560df83f7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:18.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.560+0000 7fb4d6ede740 4 client.17484 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:45:18.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.560+0000 7fb4d6ede740 1 -- 172.21.15.7:0/1497324784 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x560df82e0860 con 0x560df7fc5350 2024-09-21T06:45:18.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.560+0000 7fb4c9d9b640 1 --2- 172.21.15.7:0/1497324784 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x560df7fc5350 0x560df83f7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:18.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.561+0000 7fb4b1ffb640 10 client.17484 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:45:18.566 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.561+0000 7fb4c9d9b640 1 --2- 172.21.15.7:0/1497324784 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x560df7fc5350 0x560df83f7aa0 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=828588300f4e8e3 server_cookie=a27e6f942ba7b0a6 in_seq=0 out_seq=0 2024-09-21T06:45:18.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.562+0000 7fb4b1ffb640 1 -- 172.21.15.7:0/1497324784 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x560df82e0860 con 0x560df7fc5350 2024-09-21T06:45:18.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.562+0000 7fb4b1ffb640 10 client.17484 handle_command_reply: tid=0 2024-09-21T06:45:18.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.562+0000 7fb4d6ede740 1 client.17484 shutdown 2024-09-21T06:45:18.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.563+0000 7fb4d6ede740 1 -- 172.21.15.7:0/1497324784 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560df7f83cd0 msgr2=0x560df838bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:18.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.563+0000 7fb4d6ede740 1 --2- 172.21.15.7:0/1497324784 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560df7f83cd0 0x560df838bc10 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc0ce660 tx=0x7fb4bc10bfc0 comp rx=0 tx=0).stop 2024-09-21T06:45:18.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.563+0000 7fb4d6ede740 1 -- 172.21.15.7:0/1497324784 shutdown_connections 2024-09-21T06:45:18.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.563+0000 7fb4d6ede740 1 --2- 172.21.15.7:0/1497324784 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x560df7fc5350 0x560df83f7aa0 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:18.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.563+0000 7fb4d6ede740 1 --2- 172.21.15.7:0/1497324784 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560df7fa4670 0x560df83ed980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:18.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.563+0000 7fb4d6ede740 1 --2- 172.21.15.7:0/1497324784 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560df7f9c490 0x560df838c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:18.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.563+0000 7fb4d6ede740 1 --2- 172.21.15.7:0/1497324784 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560df7f83cd0 0x560df838bc10 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:18.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.563+0000 7fb4b1ffb640 0 client.17484 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:45:18.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.563+0000 7fb4d6ede740 1 -- 172.21.15.7:0/1497324784 >> 172.21.15.7:0/1497324784 conn(0x560df7fb9740 msgr2=0x560df83792b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:18.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.563+0000 7fb4d6ede740 1 -- 172.21.15.7:0/1497324784 shutdown_connections 2024-09-21T06:45:18.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.563+0000 7fb4d6ede740 1 -- 172.21.15.7:0/1497324784 wait complete. 2024-09-21T06:45:18.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.563+0000 7fb4d6ede740 20 client.17484 trim_cache size 0 max 16384 2024-09-21T06:45:18.568 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:45:18.568 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0, 2024-09-21T06:45:18.569 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_tag": "fe20df33-20a9-4e2f-be35-9778411fd6cd", 2024-09-21T06:45:18.569 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": "asynchronous" 2024-09-21T06:45:18.569 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:45:18.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.564+0000 7fb4d096a640 1 -- 172.21.15.7:0/1348651599 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fb4b80b6680 msgr2=0x7fb4b80b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:18.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.564+0000 7fb4d096a640 1 --2- 172.21.15.7:0/1348651599 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fb4b80b6680 0x7fb4b80b8b90 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fb4c4005fd0 tx=0x7fb4c400c400 comp rx=0 tx=0).stop 2024-09-21T06:45:18.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.564+0000 7fb4d096a640 1 -- 172.21.15.7:0/1348651599 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb4cc102a70 msgr2=0x7fb4cc19a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:18.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.564+0000 7fb4d096a640 1 --2- 172.21.15.7:0/1348651599 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb4cc102a70 0x7fb4cc19a520 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc006010 tx=0x7fb4bc0319f0 comp rx=0 tx=0).stop 2024-09-21T06:45:18.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.565+0000 7fb4d096a640 1 -- 172.21.15.7:0/1348651599 shutdown_connections 2024-09-21T06:45:18.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.565+0000 7fb4d096a640 1 --2- 172.21.15.7:0/1348651599 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fb4b80b6680 0x7fb4b80b8b90 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:18.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.565+0000 7fb4d096a640 1 --2- 172.21.15.7:0/1348651599 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb4cc108d00 0x7fb4cc19fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:18.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.565+0000 7fb4d096a640 1 --2- 172.21.15.7:0/1348651599 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb4cc1083b0 0x7fb4cc19aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:18.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.565+0000 7fb4d096a640 1 --2- 172.21.15.7:0/1348651599 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb4cc102a70 0x7fb4cc19a520 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:18.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.565+0000 7fb4d096a640 1 -- 172.21.15.7:0/1348651599 >> 172.21.15.7:0/1348651599 conn(0x7fb4cc079710 msgr2=0x7fb4cc101b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:18.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.565+0000 7fb4d096a640 1 -- 172.21.15.7:0/1348651599 shutdown_connections 2024-09-21T06:45:18.570 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:18.565+0000 7fb4d096a640 1 -- 172.21.15.7:0/1348651599 wait complete. 2024-09-21T06:45:19.173 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:45:18 smithi007 ceph-mon[30983]: pgmap v597: 97 pgs: 97 active+clean; 3.3 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 204 B/s wr, 7 op/s 2024-09-21T06:45:19.173 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:45:18 smithi007 ceph-mon[30983]: osdmap e83: 12 total, 12 up, 12 in 2024-09-21T06:45:19.279 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:45:19.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:45:18 smithi144 ceph-mon[34653]: pgmap v597: 97 pgs: 97 active+clean; 3.3 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 204 B/s wr, 7 op/s 2024-09-21T06:45:19.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:45:18 smithi144 ceph-mon[34653]: osdmap e83: 12 total, 12 up, 12 in 2024-09-21T06:45:19.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:45:18 smithi018 ceph-mon[34477]: pgmap v597: 97 pgs: 97 active+clean; 3.3 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 204 B/s wr, 7 op/s 2024-09-21T06:45:19.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:45:18 smithi018 ceph-mon[34477]: osdmap e83: 12 total, 12 up, 12 in 2024-09-21T06:45:19.541 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:45:19.967 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:45:19 smithi007 ceph-mon[30983]: scrub queued for path: / 2024-09-21T06:45:19.967 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:45:19 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T06:45:19.967 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:45:19 smithi007 ceph-mon[30983]: scrub summary: active paths [/] 2024-09-21T06:45:19.967 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:45:19 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T06:45:19.967 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:45:19 smithi007 ceph-mon[30983]: scrub summary: idle 2024-09-21T06:45:20.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.062+0000 7feeddcaf640 1 -- 172.21.15.7:0/3436225340 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feed8102a60 msgr2=0x7feed8102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:20.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.062+0000 7feeddcaf640 1 --2- 172.21.15.7:0/3436225340 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feed8102a60 0x7feed8102e70 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7feec8009900 tx=0x7feec802a410 comp rx=0 tx=0).stop 2024-09-21T06:45:20.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.062+0000 7feeddcaf640 1 -- 172.21.15.7:0/3436225340 shutdown_connections 2024-09-21T06:45:20.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.062+0000 7feeddcaf640 1 --2- 172.21.15.7:0/3436225340 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feed8108cf0 0x7feed810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:20.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.062+0000 7feeddcaf640 1 --2- 172.21.15.7:0/3436225340 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feed81083a0 0x7feed81087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:20.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.062+0000 7feeddcaf640 1 --2- 172.21.15.7:0/3436225340 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feed8102a60 0x7feed8102e70 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:20.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.062+0000 7feeddcaf640 1 -- 172.21.15.7:0/3436225340 >> 172.21.15.7:0/3436225340 conn(0x7feed8079730 msgr2=0x7feed8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:20.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.062+0000 7feeddcaf640 1 -- 172.21.15.7:0/3436225340 shutdown_connections 2024-09-21T06:45:20.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.062+0000 7feeddcaf640 1 -- 172.21.15.7:0/3436225340 wait complete. 2024-09-21T06:45:20.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.063+0000 7feeddcaf640 1 Processor -- start 2024-09-21T06:45:20.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.063+0000 7feeddcaf640 1 -- start start 2024-09-21T06:45:20.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.063+0000 7feeddcaf640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feed8102a60 0x7feed819a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:20.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.063+0000 7feeddcaf640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feed81083a0 0x7feed819aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:20.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.063+0000 7feeddcaf640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feed8108cf0 0x7feed819fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:20.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.063+0000 7feeddcaf640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7feed8113a80 con 0x7feed8108cf0 2024-09-21T06:45:20.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.063+0000 7feeddcaf640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7feed8113900 con 0x7feed8102a60 2024-09-21T06:45:20.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.063+0000 7feeddcaf640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7feed8113c00 con 0x7feed81083a0 2024-09-21T06:45:20.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.064+0000 7feed7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feed8108cf0 0x7feed819fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:20.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.064+0000 7feed7fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feed8108cf0 0x7feed819fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39474/0 (socket says 172.21.15.7:39474) 2024-09-21T06:45:20.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.064+0000 7feed7fff640 1 -- 172.21.15.7:0/2358310139 learned_addr learned my addr 172.21.15.7:0/2358310139 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:20.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.064+0000 7feed6ffd640 1 --2- 172.21.15.7:0/2358310139 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feed81083a0 0x7feed819aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:20.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.064+0000 7feed77fe640 1 --2- 172.21.15.7:0/2358310139 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feed8102a60 0x7feed819a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:20.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.064+0000 7feed7fff640 1 -- 172.21.15.7:0/2358310139 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feed81083a0 msgr2=0x7feed819aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:20.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.064+0000 7feed7fff640 1 --2- 172.21.15.7:0/2358310139 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feed81083a0 0x7feed819aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:20.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.064+0000 7feed7fff640 1 -- 172.21.15.7:0/2358310139 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feed8102a60 msgr2=0x7feed819a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:20.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.064+0000 7feed7fff640 1 --2- 172.21.15.7:0/2358310139 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feed8102a60 0x7feed819a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:20.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.064+0000 7feed7fff640 1 -- 172.21.15.7:0/2358310139 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feed81a0480 con 0x7feed8108cf0 2024-09-21T06:45:20.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.064+0000 7feed7fff640 1 --2- 172.21.15.7:0/2358310139 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feed8108cf0 0x7feed819fd50 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7feed000eaa0 tx=0x7feed000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:20.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.064+0000 7feed4ff9640 1 -- 172.21.15.7:0/2358310139 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed000cdb0 con 0x7feed8108cf0 2024-09-21T06:45:20.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.064+0000 7feed4ff9640 1 -- 172.21.15.7:0/2358310139 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feed0005020 con 0x7feed8108cf0 2024-09-21T06:45:20.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.064+0000 7feeddcaf640 1 -- 172.21.15.7:0/2358310139 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feed81a0770 con 0x7feed8108cf0 2024-09-21T06:45:20.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.064+0000 7feed4ff9640 1 -- 172.21.15.7:0/2358310139 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed00116d0 con 0x7feed8108cf0 2024-09-21T06:45:20.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.064+0000 7feeddcaf640 1 -- 172.21.15.7:0/2358310139 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feed81a6ed0 con 0x7feed8108cf0 2024-09-21T06:45:20.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.067+0000 7feed4ff9640 1 -- 172.21.15.7:0/2358310139 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7feed0011870 con 0x7feed8108cf0 2024-09-21T06:45:20.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.067+0000 7feee4223740 1 Processor -- start 2024-09-21T06:45:20.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.067+0000 7feee4223740 1 -- start start 2024-09-21T06:45:20.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.067+0000 7feee4223740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e0cfd69070 0x55e0d0110650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:20.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.067+0000 7feee4223740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e0cfd401b0 0x55e0d0110b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:20.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.067+0000 7feee4223740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e0cfd48390 0x55e0d01110d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:20.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.067+0000 7feee4223740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e0d0086e50 con 0x55e0cfd401b0 2024-09-21T06:45:20.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.067+0000 7feee4223740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55e0d0076280 con 0x55e0cfd48390 2024-09-21T06:45:20.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.067+0000 7feee4223740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55e0d007a090 con 0x55e0cfd69070 2024-09-21T06:45:20.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.068+0000 7feed77fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e0cfd401b0 0x55e0d0110b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:20.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.068+0000 7feed77fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e0cfd401b0 0x55e0d0110b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39486/0 (socket says 172.21.15.7:39486) 2024-09-21T06:45:20.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.068+0000 7feed77fe640 1 -- 172.21.15.7:0/2216227566 learned_addr learned my addr 172.21.15.7:0/2216227566 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:20.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.068+0000 7feed6ffd640 1 --2- 172.21.15.7:0/2216227566 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e0cfd69070 0x55e0d0110650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:20.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.068+0000 7feed4ff9640 1 --2- 172.21.15.7:0/2358310139 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7feec00b6680 0x7feec00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:20.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.068+0000 7feed6ffd640 1 --2- 172.21.15.7:0/2216227566 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e0cfd48390 0x55e0d01110d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:20.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.068+0000 7feed77fe640 1 -- 172.21.15.7:0/2216227566 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e0cfd69070 msgr2=0x55e0d0110650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:20.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.068+0000 7feed77fe640 1 --2- 172.21.15.7:0/2216227566 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e0cfd69070 0x55e0d0110650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:20.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.068+0000 7feed77fe640 1 -- 172.21.15.7:0/2216227566 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e0cfd48390 msgr2=0x55e0d01110d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:20.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.068+0000 7feed77fe640 1 --2- 172.21.15.7:0/2216227566 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e0cfd48390 0x55e0d01110d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:20.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.068+0000 7feed77fe640 1 -- 172.21.15.7:0/2216227566 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0cfdd4650 con 0x55e0cfd401b0 2024-09-21T06:45:20.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.068+0000 7feed6ffd640 1 --2- 172.21.15.7:0/2216227566 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e0cfd48390 0x55e0d01110d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:45:20.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.068+0000 7feed7fff640 1 --2- 172.21.15.7:0/2358310139 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7feec00b6680 0x7feec00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:20.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.068+0000 7feed77fe640 1 --2- 172.21.15.7:0/2216227566 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e0cfd401b0 0x55e0d0110b90 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7feec8009900 tx=0x7feec8032cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f9d001f5a748676 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:20.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.068+0000 7feed4ff9640 1 -- 172.21.15.7:0/2358310139 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7feed00e7770 con 0x7feed8108cf0 2024-09-21T06:45:20.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.068+0000 7feebdffb640 1 -- 172.21.15.7:0/2216227566 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec8040070 con 0x55e0cfd401b0 2024-09-21T06:45:20.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.069+0000 7feebdffb640 1 -- 172.21.15.7:0/2216227566 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feec8032e40 con 0x55e0cfd401b0 2024-09-21T06:45:20.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.069+0000 7feebdffb640 1 -- 172.21.15.7:0/2216227566 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec8035040 con 0x55e0cfd401b0 2024-09-21T06:45:20.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.069+0000 7feee4223740 1 -- 172.21.15.7:0/2216227566 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e0cfd401b0 msgr2=0x55e0d0110b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:20.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.069+0000 7feed7fff640 1 --2- 172.21.15.7:0/2358310139 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7feec00b6680 0x7feec00b8b90 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7feed00e4fe0 tx=0x7feed007b310 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:20.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.069+0000 7feee4223740 1 --2- 172.21.15.7:0/2216227566 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e0cfd401b0 0x55e0d0110b90 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7feec8009900 tx=0x7feec8032cd0 comp rx=0 tx=0).stop 2024-09-21T06:45:20.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.069+0000 7feee4223740 1 -- 172.21.15.7:0/2216227566 shutdown_connections 2024-09-21T06:45:20.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.069+0000 7feee4223740 1 --2- 172.21.15.7:0/2216227566 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e0cfd48390 0x55e0d01110d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:20.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.069+0000 7feee4223740 1 --2- 172.21.15.7:0/2216227566 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e0cfd401b0 0x55e0d0110b90 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:20.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.069+0000 7feee4223740 1 --2- 172.21.15.7:0/2216227566 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e0cfd69070 0x55e0d0110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:20.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.069+0000 7feee4223740 1 -- 172.21.15.7:0/2216227566 >> 172.21.15.7:0/2216227566 conn(0x55e0cfd5d460 msgr2=0x55e0d010e540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:20.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.070+0000 7feee4223740 1 -- 172.21.15.7:0/2216227566 shutdown_connections 2024-09-21T06:45:20.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.070+0000 7feee4223740 1 -- 172.21.15.7:0/2216227566 wait complete. 2024-09-21T06:45:20.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.070+0000 7feee4223740 1 -- start start 2024-09-21T06:45:20.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.070+0000 7feee4223740 1 Processor -- start 2024-09-21T06:45:20.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.070+0000 7feee4223740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e0cfd401b0 0x55e0d011bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:20.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.070+0000 7feee4223740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e0cfd48390 0x55e0d011c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:20.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.070+0000 7feee4223740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e0cfd69070 0x55e0d01280f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:20.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.071+0000 7feee4223740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55e0cfed7700 con 0x55e0cfd401b0 2024-09-21T06:45:20.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.071+0000 7feee4223740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55e0d0011110 con 0x55e0cfd48390 2024-09-21T06:45:20.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.071+0000 7feee4223740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55e0d011edd0 con 0x55e0cfd69070 2024-09-21T06:45:20.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.071+0000 7feee4223740 10 client.0 _ll_register_callbacks cb 0x55e0d002a990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:20.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.071+0000 7feed6ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e0cfd401b0 0x55e0d011bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:20.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.071+0000 7feed6ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e0cfd401b0 0x55e0d011bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39502/0 (socket says 172.21.15.7:39502) 2024-09-21T06:45:20.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.071+0000 7feed6ffd640 1 -- 172.21.15.7:0/1665818123 learned_addr learned my addr 172.21.15.7:0/1665818123 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:20.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.071+0000 7feed77fe640 1 --2- 172.21.15.7:0/1665818123 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e0cfd48390 0x55e0d011c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:20.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.071+0000 7feed6ffd640 1 --2- 172.21.15.7:0/1665818123 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e0cfd69070 0x55e0d01280f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:20.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.071+0000 7feed6ffd640 1 -- 172.21.15.7:0/1665818123 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e0cfd69070 msgr2=0x55e0d01280f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:20.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.071+0000 7feed6ffd640 1 --2- 172.21.15.7:0/1665818123 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e0cfd69070 0x55e0d01280f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:20.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.071+0000 7feed6ffd640 1 -- 172.21.15.7:0/1665818123 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e0cfd48390 msgr2=0x55e0d011c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:20.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.071+0000 7feed6ffd640 1 --2- 172.21.15.7:0/1665818123 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e0cfd48390 0x55e0d011c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:20.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.071+0000 7feed6ffd640 1 -- 172.21.15.7:0/1665818123 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0d003ec40 con 0x55e0cfd401b0 2024-09-21T06:45:20.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.071+0000 7feed6ffd640 1 --2- 172.21.15.7:0/1665818123 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e0cfd401b0 0x55e0d011bd30 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7feecc00be80 tx=0x7feecc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d3e3bf70cadbe2a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:20.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.071+0000 7feeb6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:45:20.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.071+0000 7feeb6ffd640 1 -- 172.21.15.7:0/1665818123 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feecc0117f0 con 0x55e0cfd401b0 2024-09-21T06:45:20.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.071+0000 7feeb6ffd640 1 -- 172.21.15.7:0/1665818123 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7feecc011990 con 0x55e0cfd401b0 2024-09-21T06:45:20.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.071+0000 7feee4223740 1 -- 172.21.15.7:0/1665818123 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e0d0088da0 con 0x55e0cfd401b0 2024-09-21T06:45:20.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.072+0000 7feeb6ffd640 1 -- 172.21.15.7:0/1665818123 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7feecc025050 con 0x55e0cfd401b0 2024-09-21T06:45:20.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.072+0000 7feee4223740 10 client.17496 fetch_fsmap learned FSMap version 25 2024-09-21T06:45:20.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.072+0000 7feee4223740 1 -- 172.21.15.7:0/1665818123 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e0d012aaa0 con 0x55e0cfd401b0 2024-09-21T06:45:20.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.072+0000 7feeb6ffd640 1 -- 172.21.15.7:0/1665818123 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55e0d0088da0 con 0x55e0cfd401b0 2024-09-21T06:45:20.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.072+0000 7feeb6ffd640 1 -- 172.21.15.7:0/1665818123 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7feecc012cd0 con 0x55e0cfd401b0 2024-09-21T06:45:20.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.072+0000 7feee4223740 10 client.17496 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:45:20.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.072+0000 7feee4223740 10 client.17496 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:45:20.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.072+0000 7feee4223740 20 client.17496 populate_metadata read hostname 'smithi007' 2024-09-21T06:45:20.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.072+0000 7feee4223740 1 --2- 172.21.15.7:0/1665818123 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55e0cfd279f0 0x55e0d012e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:20.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.072+0000 7feee4223740 4 client.17496 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:45:20.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.072+0000 7feee4223740 1 -- 172.21.15.7:0/1665818123 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e0d0084850 con 0x55e0cfd279f0 2024-09-21T06:45:20.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.072+0000 7feed77fe640 1 --2- 172.21.15.7:0/1665818123 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55e0cfd279f0 0x55e0d012e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:20.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.073+0000 7feed77fe640 1 --2- 172.21.15.7:0/1665818123 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55e0cfd279f0 0x55e0d012e000 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9db57625f1ec064c server_cookie=7ab59867657cca88 in_seq=0 out_seq=0 2024-09-21T06:45:20.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.073+0000 7feeb6ffd640 10 client.17496 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:45:20.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.074+0000 7feeb6ffd640 1 -- 172.21.15.7:0/1665818123 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e0d0084850 con 0x55e0cfd279f0 2024-09-21T06:45:20.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.074+0000 7feeb6ffd640 10 client.17496 handle_command_reply: tid=0 2024-09-21T06:45:20.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.074+0000 7feee4223740 1 client.17496 shutdown 2024-09-21T06:45:20.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.074+0000 7feee4223740 1 -- 172.21.15.7:0/1665818123 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e0cfd401b0 msgr2=0x55e0d011bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:20.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.074+0000 7feee4223740 1 --2- 172.21.15.7:0/1665818123 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e0cfd401b0 0x55e0d011bd30 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7feecc00be80 tx=0x7feecc0046c0 comp rx=0 tx=0).stop 2024-09-21T06:45:20.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.074+0000 7feee4223740 1 -- 172.21.15.7:0/1665818123 shutdown_connections 2024-09-21T06:45:20.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.074+0000 7feee4223740 1 --2- 172.21.15.7:0/1665818123 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55e0cfd279f0 0x55e0d012e000 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:20.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.074+0000 7feee4223740 1 --2- 172.21.15.7:0/1665818123 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e0cfd69070 0x55e0d01280f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:20.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.074+0000 7feee4223740 1 --2- 172.21.15.7:0/1665818123 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e0cfd48390 0x55e0d011c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:20.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.074+0000 7feee4223740 1 --2- 172.21.15.7:0/1665818123 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e0cfd401b0 0x55e0d011bd30 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:20.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.074+0000 7feee4223740 1 -- 172.21.15.7:0/1665818123 >> 172.21.15.7:0/1665818123 conn(0x55e0cfd5d460 msgr2=0x55e0d01137e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:20.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.074+0000 7feeb6ffd640 0 client.17496 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:45:20.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.074+0000 7feee4223740 1 -- 172.21.15.7:0/1665818123 shutdown_connections 2024-09-21T06:45:20.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.074+0000 7feee4223740 1 -- 172.21.15.7:0/1665818123 wait complete. 2024-09-21T06:45:20.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.074+0000 7feee4223740 20 client.17496 trim_cache size 0 max 16384 2024-09-21T06:45:20.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.092+0000 7feee4223740 1 Processor -- start 2024-09-21T06:45:20.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.092+0000 7feee4223740 1 -- start start 2024-09-21T06:45:20.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.092+0000 7feee4223740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e0cfd401b0 0x55e0d011ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:20.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.092+0000 7feee4223740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e0cfd48390 0x55e0d011d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:20.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.092+0000 7feee4223740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e0cfd69070 0x55e0d010db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:20.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.092+0000 7feee4223740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7feed81b1ee0 con 0x55e0cfd69070 2024-09-21T06:45:20.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.092+0000 7feee4223740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7feed81af7b0 con 0x55e0cfd401b0 2024-09-21T06:45:20.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.092+0000 7feee4223740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7feed81ad620 con 0x55e0cfd48390 2024-09-21T06:45:20.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.092+0000 7feed6ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e0cfd69070 0x55e0d010db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:20.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.092+0000 7feed6ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e0cfd69070 0x55e0d010db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39518/0 (socket says 172.21.15.7:39518) 2024-09-21T06:45:20.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.092+0000 7feed6ffd640 1 -- 172.21.15.7:0/78447260 learned_addr learned my addr 172.21.15.7:0/78447260 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:20.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.092+0000 7feed6ffd640 1 --2- 172.21.15.7:0/78447260 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e0cfd401b0 0x55e0d011ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:20.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.093+0000 7feed77fe640 1 --2- 172.21.15.7:0/78447260 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e0cfd48390 0x55e0d011d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:20.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.093+0000 7feed6ffd640 1 -- 172.21.15.7:0/78447260 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e0cfd48390 msgr2=0x55e0d011d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:20.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.093+0000 7feed6ffd640 1 --2- 172.21.15.7:0/78447260 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e0cfd48390 0x55e0d011d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:20.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.093+0000 7feed6ffd640 1 -- 172.21.15.7:0/78447260 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e0cfd401b0 msgr2=0x55e0d011ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:20.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.093+0000 7feed6ffd640 1 --2- 172.21.15.7:0/78447260 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e0cfd401b0 0x55e0d011ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:20.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.093+0000 7feed6ffd640 1 -- 172.21.15.7:0/78447260 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0d0112b70 con 0x55e0cfd69070 2024-09-21T06:45:20.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.093+0000 7feed77fe640 1 --2- 172.21.15.7:0/78447260 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e0cfd48390 0x55e0d011d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:20.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.093+0000 7feed6ffd640 1 --2- 172.21.15.7:0/78447260 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e0cfd69070 0x55e0d010db70 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7feecc003fd0 tx=0x7feecc00b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff6ad6a000b9c261 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:20.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.093+0000 7feebd7fa640 1 -- 172.21.15.7:0/78447260 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feecc020a70 con 0x55e0cfd69070 2024-09-21T06:45:20.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.093+0000 7feebd7fa640 1 -- 172.21.15.7:0/78447260 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feecc0054d0 con 0x55e0cfd69070 2024-09-21T06:45:20.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.093+0000 7feebd7fa640 1 -- 172.21.15.7:0/78447260 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feecc004aa0 con 0x55e0cfd69070 2024-09-21T06:45:20.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.094+0000 7feee4223740 1 -- 172.21.15.7:0/78447260 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e0cfd69070 msgr2=0x55e0d010db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:20.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.094+0000 7feee4223740 1 --2- 172.21.15.7:0/78447260 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e0cfd69070 0x55e0d010db70 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7feecc003fd0 tx=0x7feecc00b390 comp rx=0 tx=0).stop 2024-09-21T06:45:20.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.094+0000 7feee4223740 1 -- 172.21.15.7:0/78447260 shutdown_connections 2024-09-21T06:45:20.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.094+0000 7feee4223740 1 --2- 172.21.15.7:0/78447260 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e0cfd69070 0x55e0d010db70 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:20.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.094+0000 7feee4223740 1 --2- 172.21.15.7:0/78447260 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e0cfd48390 0x55e0d011d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:20.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.094+0000 7feee4223740 1 --2- 172.21.15.7:0/78447260 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e0cfd401b0 0x55e0d011ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:20.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.094+0000 7feee4223740 1 -- 172.21.15.7:0/78447260 >> 172.21.15.7:0/78447260 conn(0x55e0cfd5d460 msgr2=0x55e0d011d250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:20.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.094+0000 7feee4223740 1 -- 172.21.15.7:0/78447260 shutdown_connections 2024-09-21T06:45:20.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.094+0000 7feee4223740 1 -- 172.21.15.7:0/78447260 wait complete. 2024-09-21T06:45:20.098 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.094+0000 7feee4223740 1 -- start start 2024-09-21T06:45:20.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.095+0000 7feee4223740 1 Processor -- start 2024-09-21T06:45:20.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.095+0000 7feee4223740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e0cfd401b0 0x55e0d011fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:20.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.095+0000 7feee4223740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e0cfd48390 0x55e0d0120000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:20.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.095+0000 7feee4223740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e0cfd69070 0x55e0d0123ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:20.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.095+0000 7feee4223740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7feed81adc70 con 0x55e0cfd48390 2024-09-21T06:45:20.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.095+0000 7feee4223740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7feed81af0e0 con 0x55e0cfd401b0 2024-09-21T06:45:20.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.095+0000 7feee4223740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7feed81ae340 con 0x55e0cfd69070 2024-09-21T06:45:20.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.095+0000 7feee4223740 10 client.0 _ll_register_callbacks cb 0x7feecc004080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:20.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.095+0000 7feed77fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e0cfd48390 0x55e0d0120000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:20.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.095+0000 7feed77fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e0cfd48390 0x55e0d0120000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:39532/0 (socket says 172.21.15.7:39532) 2024-09-21T06:45:20.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.095+0000 7feed77fe640 1 -- 172.21.15.7:0/2887825110 learned_addr learned my addr 172.21.15.7:0/2887825110 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:20.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.095+0000 7feed6ffd640 1 --2- 172.21.15.7:0/2887825110 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e0cfd401b0 0x55e0d011fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:20.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.095+0000 7feed77fe640 1 -- 172.21.15.7:0/2887825110 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e0cfd69070 msgr2=0x55e0d0123ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:20.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.095+0000 7feed77fe640 1 --2- 172.21.15.7:0/2887825110 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e0cfd69070 0x55e0d0123ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:20.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.095+0000 7feed77fe640 1 -- 172.21.15.7:0/2887825110 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e0cfd401b0 msgr2=0x55e0d011fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:20.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.095+0000 7feed77fe640 1 --2- 172.21.15.7:0/2887825110 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e0cfd401b0 0x55e0d011fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:20.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.095+0000 7feed77fe640 1 -- 172.21.15.7:0/2887825110 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0d0124560 con 0x55e0cfd48390 2024-09-21T06:45:20.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.096+0000 7feed77fe640 1 --2- 172.21.15.7:0/2887825110 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e0cfd48390 0x55e0d0120000 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7feec8005230 tx=0x7feec80051c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2de4cb54d82ff7f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:20.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.096+0000 7feeb6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:45:20.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.096+0000 7feeb6ffd640 1 -- 172.21.15.7:0/2887825110 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec8052060 con 0x55e0cfd48390 2024-09-21T06:45:20.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.096+0000 7feeb6ffd640 1 -- 172.21.15.7:0/2887825110 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7feec80316b0 con 0x55e0cfd48390 2024-09-21T06:45:20.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.096+0000 7feee4223740 1 -- 172.21.15.7:0/2887825110 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feecc0054d0 con 0x55e0cfd48390 2024-09-21T06:45:20.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.096+0000 7feeb6ffd640 1 -- 172.21.15.7:0/2887825110 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7feec8035040 con 0x55e0cfd48390 2024-09-21T06:45:20.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.096+0000 7feee4223740 10 client.17502 fetch_fsmap learned FSMap version 25 2024-09-21T06:45:20.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.096+0000 7feee4223740 1 -- 172.21.15.7:0/2887825110 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55e0d0198480 con 0x55e0cfd48390 2024-09-21T06:45:20.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.096+0000 7feeb6ffd640 1 -- 172.21.15.7:0/2887825110 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feecc0054d0 con 0x55e0cfd48390 2024-09-21T06:45:20.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.096+0000 7feeb6ffd640 1 -- 172.21.15.7:0/2887825110 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7feec8055020 con 0x55e0cfd48390 2024-09-21T06:45:20.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.096+0000 7feee4223740 10 client.17502 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:45:20.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.096+0000 7feee4223740 10 client.17502 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:45:20.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.096+0000 7feee4223740 20 client.17502 populate_metadata read hostname 'smithi007' 2024-09-21T06:45:20.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.096+0000 7feee4223740 1 --2- 172.21.15.7:0/2887825110 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55e0cfcfcda0 0x55e0d019a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:20.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.097+0000 7feee4223740 4 client.17502 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:45:20.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.097+0000 7feee4223740 1 -- 172.21.15.7:0/2887825110 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e0d0081c80 con 0x55e0cfcfcda0 2024-09-21T06:45:20.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.097+0000 7feed6ffd640 1 --2- 172.21.15.7:0/2887825110 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55e0cfcfcda0 0x55e0d019a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:20.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.097+0000 7feeb6ffd640 10 client.17502 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:45:20.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.097+0000 7feed6ffd640 1 --2- 172.21.15.7:0/2887825110 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55e0cfcfcda0 0x55e0d019a7d0 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e00eacccc6ae5093 server_cookie=16d3b17d6d04dfd8 in_seq=0 out_seq=0 2024-09-21T06:45:20.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.098+0000 7feeb6ffd640 1 -- 172.21.15.7:0/2887825110 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5202 (crc 0 0 0) 0x55e0d0081c80 con 0x55e0cfcfcda0 2024-09-21T06:45:20.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.098+0000 7feeb6ffd640 10 client.17502 handle_command_reply: tid=0 2024-09-21T06:45:20.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.098+0000 7feee4223740 1 client.17502 shutdown 2024-09-21T06:45:20.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.098+0000 7feee4223740 1 -- 172.21.15.7:0/2887825110 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e0cfd48390 msgr2=0x55e0d0120000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:20.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.098+0000 7feee4223740 1 --2- 172.21.15.7:0/2887825110 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e0cfd48390 0x55e0d0120000 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7feec8005230 tx=0x7feec80051c0 comp rx=0 tx=0).stop 2024-09-21T06:45:20.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.098+0000 7feee4223740 1 -- 172.21.15.7:0/2887825110 shutdown_connections 2024-09-21T06:45:20.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.098+0000 7feee4223740 1 --2- 172.21.15.7:0/2887825110 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55e0cfcfcda0 0x55e0d019a7d0 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:20.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.098+0000 7feee4223740 1 --2- 172.21.15.7:0/2887825110 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55e0cfd69070 0x55e0d0123ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:20.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.098+0000 7feee4223740 1 --2- 172.21.15.7:0/2887825110 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55e0cfd48390 0x55e0d0120000 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:20.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.098+0000 7feee4223740 1 --2- 172.21.15.7:0/2887825110 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55e0cfd401b0 0x55e0d011fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:20.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.098+0000 7feeb6ffd640 0 client.17502 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:45:20.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.098+0000 7feee4223740 1 -- 172.21.15.7:0/2887825110 >> 172.21.15.7:0/2887825110 conn(0x55e0cfd5d460 msgr2=0x55e0d0111f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:20.104 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.098+0000 7feee4223740 1 -- 172.21.15.7:0/2887825110 shutdown_connections 2024-09-21T06:45:20.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.098+0000 7feee4223740 1 -- 172.21.15.7:0/2887825110 wait complete. 2024-09-21T06:45:20.105 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.098+0000 7feee4223740 20 client.17502 trim_cache size 0 max 16384 2024-09-21T06:45:20.105 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:45:20.105 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "no active scrubs running", 2024-09-21T06:45:20.105 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": {}, 2024-09-21T06:45:20.105 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_stats": { 2024-09-21T06:45:20.105 INFO:teuthology.orchestra.run.smithi007.stdout: "fe20df33-20a9-4e2f-be35-9778411fd6cd": { 2024-09-21T06:45:20.105 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:45:18.561779+0000", 2024-09-21T06:45:20.105 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:20.105 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:20.105 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:20.106 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:20.106 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:20.106 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:20.106 INFO:teuthology.orchestra.run.smithi007.stdout: "d98b2d47-c2db-4811-8b3e-ec744a20d9d6": { 2024-09-21T06:45:20.106 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:44:03.790680+0000", 2024-09-21T06:45:20.106 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:20.106 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:20.106 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:20.106 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:20.106 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:20.106 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:20.106 INFO:teuthology.orchestra.run.smithi007.stdout: "310a0ec8-44bb-49ed-a534-3bc91cb1ee9d": { 2024-09-21T06:45:20.106 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:40:55.373968+0000", 2024-09-21T06:45:20.106 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:20.107 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:20.107 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:20.107 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:20.107 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:20.107 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:20.107 INFO:teuthology.orchestra.run.smithi007.stdout: "dd792920-08a1-482d-8961-5c6a6f131599": { 2024-09-21T06:45:20.107 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:43:53.390806+0000", 2024-09-21T06:45:20.107 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:20.107 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:20.107 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:20.107 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:20.107 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:20.107 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:20.107 INFO:teuthology.orchestra.run.smithi007.stdout: "13441782-2231-4713-8ebd-068a941de47f": { 2024-09-21T06:45:20.107 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:39:30.219006+0000", 2024-09-21T06:45:20.108 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:20.108 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:20.108 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:20.108 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:20.108 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:20.108 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:20.108 INFO:teuthology.orchestra.run.smithi007.stdout: "02016ff7-8cc2-467e-a465-f69400f702cb": { 2024-09-21T06:45:20.108 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:44:25.093423+0000", 2024-09-21T06:45:20.108 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:20.108 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:20.108 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:20.108 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:20.108 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:20.108 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:20.109 INFO:teuthology.orchestra.run.smithi007.stdout: "b0327167-8c41-4286-8afc-7f0780972fd7": { 2024-09-21T06:45:20.109 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:38:36.828657+0000", 2024-09-21T06:45:20.109 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:20.109 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:20.109 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:20.109 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:20.109 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:20.109 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:20.109 INFO:teuthology.orchestra.run.smithi007.stdout: "d7b6a90c-9ae1-4e02-93ad-335a7e9df1d7": { 2024-09-21T06:45:20.109 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:39:19.226139+0000", 2024-09-21T06:45:20.109 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:20.109 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:20.109 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:20.109 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:20.109 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:20.110 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:20.110 INFO:teuthology.orchestra.run.smithi007.stdout: "3f7283b7-f175-4023-9191-177660b3a6be": { 2024-09-21T06:45:20.110 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:44:14.422552+0000", 2024-09-21T06:45:20.110 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:20.110 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:20.110 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:20.110 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:20.110 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:20.110 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:20.110 INFO:teuthology.orchestra.run.smithi007.stdout: "6231e9c1-14a2-40b5-be3c-76d87a0d733b": { 2024-09-21T06:45:20.110 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:37:02.484812+0000", 2024-09-21T06:45:20.110 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:20.110 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:20.110 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:20.111 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:20.111 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:20.111 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:20.111 INFO:teuthology.orchestra.run.smithi007.stdout: "a1ae5b3b-f158-44be-8ef4-d70e9ba879cc": { 2024-09-21T06:45:20.111 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:41:37.568453+0000", 2024-09-21T06:45:20.111 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:20.111 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:20.111 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:20.111 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:20.111 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:20.111 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:20.111 INFO:teuthology.orchestra.run.smithi007.stdout: "62fca477-b241-45f5-8185-bc78aeb8b19f": { 2024-09-21T06:45:20.111 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:40:12.744488+0000", 2024-09-21T06:45:20.111 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:20.111 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:20.112 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:20.112 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:20.112 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:20.112 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:20.112 INFO:teuthology.orchestra.run.smithi007.stdout: "5cbaaba2-6ab1-4f83-abd6-8c6eef4b5c42": { 2024-09-21T06:45:20.112 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:37:46.566272+0000", 2024-09-21T06:45:20.112 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:20.112 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:20.112 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:20.112 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:20.112 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:20.112 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:20.112 INFO:teuthology.orchestra.run.smithi007.stdout: "b466f071-ab32-427c-a0ed-73edea33145e": { 2024-09-21T06:45:20.112 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:43:01.151440+0000", 2024-09-21T06:45:20.112 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:20.113 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:20.113 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:20.113 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:20.113 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:20.113 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:20.113 INFO:teuthology.orchestra.run.smithi007.stdout: "ef9eaabd-003a-44fb-8373-c854a9e15a71": { 2024-09-21T06:45:20.113 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:42:19.467946+0000", 2024-09-21T06:45:20.113 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:20.113 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:20.113 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:20.113 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:20.113 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:20.113 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:20.113 INFO:teuthology.orchestra.run.smithi007.stdout: "a53a88e2-8599-4b25-a72c-3377770d50ea": { 2024-09-21T06:45:20.114 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:45:07.921907+0000", 2024-09-21T06:45:20.114 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:20.114 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:20.114 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:20.114 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:20.114 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:20.114 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:20.114 INFO:teuthology.orchestra.run.smithi007.stdout: "0b89345c-1f00-4efe-8ee9-4cb17e43584c": { 2024-09-21T06:45:20.114 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:36:19.500334+0000", 2024-09-21T06:45:20.114 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:20.114 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:20.114 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:20.114 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:20.114 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:20.114 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:20.115 INFO:teuthology.orchestra.run.smithi007.stdout: "3c5b7f3f-e9b3-4d48-8154-2d7d4700992e": { 2024-09-21T06:45:20.115 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:43:43.120930+0000", 2024-09-21T06:45:20.115 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:20.115 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:20.115 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:20.115 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:20.115 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:20.115 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:45:20.115 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:45:20.115 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:45:20.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.099+0000 7feeddcaf640 1 -- 172.21.15.7:0/2358310139 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7feec00b6680 msgr2=0x7feec00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:20.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.099+0000 7feeddcaf640 1 --2- 172.21.15.7:0/2358310139 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7feec00b6680 0x7feec00b8b90 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7feed00e4fe0 tx=0x7feed007b310 comp rx=0 tx=0).stop 2024-09-21T06:45:20.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.099+0000 7feeddcaf640 1 -- 172.21.15.7:0/2358310139 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feed8108cf0 msgr2=0x7feed819fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:20.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.099+0000 7feeddcaf640 1 --2- 172.21.15.7:0/2358310139 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feed8108cf0 0x7feed819fd50 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7feed000eaa0 tx=0x7feed000ef60 comp rx=0 tx=0).stop 2024-09-21T06:45:20.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.099+0000 7feeddcaf640 1 -- 172.21.15.7:0/2358310139 shutdown_connections 2024-09-21T06:45:20.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.099+0000 7feeddcaf640 1 --2- 172.21.15.7:0/2358310139 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7feec00b6680 0x7feec00b8b90 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:20.116 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.099+0000 7feeddcaf640 1 --2- 172.21.15.7:0/2358310139 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feed8108cf0 0x7feed819fd50 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:20.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.099+0000 7feeddcaf640 1 --2- 172.21.15.7:0/2358310139 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feed81083a0 0x7feed819aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:20.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.099+0000 7feeddcaf640 1 --2- 172.21.15.7:0/2358310139 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feed8102a60 0x7feed819a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:20.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.099+0000 7feeddcaf640 1 -- 172.21.15.7:0/2358310139 >> 172.21.15.7:0/2358310139 conn(0x7feed8079730 msgr2=0x7feed81014c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:20.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.099+0000 7feeddcaf640 1 -- 172.21.15.7:0/2358310139 shutdown_connections 2024-09-21T06:45:20.117 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:20.099+0000 7feeddcaf640 1 -- 172.21.15.7:0/2358310139 wait complete. 2024-09-21T06:45:20.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:45:19 smithi144 ceph-mon[34653]: scrub queued for path: / 2024-09-21T06:45:20.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:45:19 smithi144 ceph-mon[34653]: scrub summary: idle+waiting paths [/] 2024-09-21T06:45:20.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:45:19 smithi144 ceph-mon[34653]: scrub summary: active paths [/] 2024-09-21T06:45:20.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:45:19 smithi144 ceph-mon[34653]: scrub summary: idle+waiting paths [/] 2024-09-21T06:45:20.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:45:19 smithi144 ceph-mon[34653]: scrub summary: idle 2024-09-21T06:45:20.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:45:19 smithi018 ceph-mon[34477]: scrub queued for path: / 2024-09-21T06:45:20.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:45:19 smithi018 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-21T06:45:20.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:45:19 smithi018 ceph-mon[34477]: scrub summary: active paths [/] 2024-09-21T06:45:20.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:45:19 smithi018 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-21T06:45:20.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:45:19 smithi018 ceph-mon[34477]: scrub summary: idle 2024-09-21T06:45:20.794 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:45:20.794 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:45:21.054 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:45:21.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:45:20 smithi007 ceph-mon[30983]: pgmap v599: 97 pgs: 97 active+clean; 3.3 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 230 B/s wr, 7 op/s 2024-09-21T06:45:21.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:45:20 smithi144 ceph-mon[34653]: pgmap v599: 97 pgs: 97 active+clean; 3.3 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 230 B/s wr, 7 op/s 2024-09-21T06:45:21.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:45:20 smithi018 ceph-mon[34477]: pgmap v599: 97 pgs: 97 active+clean; 3.3 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 230 B/s wr, 7 op/s 2024-09-21T06:45:21.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:21.569+0000 7f0f34f3d640 1 -- 172.21.15.7:0/3686306437 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f301083a0 msgr2=0x7f0f301087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:21.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:21.569+0000 7f0f34f3d640 1 --2- 172.21.15.7:0/3686306437 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f301083a0 0x7f0f301087b0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f0f24009900 tx=0x7f0f2402a410 comp rx=0 tx=0).stop 2024-09-21T06:45:21.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:21.569+0000 7f0f34f3d640 1 -- 172.21.15.7:0/3686306437 shutdown_connections 2024-09-21T06:45:21.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:21.569+0000 7f0f34f3d640 1 --2- 172.21.15.7:0/3686306437 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f30108cf0 0x7f0f3010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:21.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:21.569+0000 7f0f34f3d640 1 --2- 172.21.15.7:0/3686306437 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f301083a0 0x7f0f301087b0 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:21.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:21.569+0000 7f0f34f3d640 1 --2- 172.21.15.7:0/3686306437 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f30102a60 0x7f0f30102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:21.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:21.569+0000 7f0f34f3d640 1 -- 172.21.15.7:0/3686306437 >> 172.21.15.7:0/3686306437 conn(0x7f0f30079730 msgr2=0x7f0f30079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:21.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:21.569+0000 7f0f34f3d640 1 -- 172.21.15.7:0/3686306437 shutdown_connections 2024-09-21T06:45:21.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:21.569+0000 7f0f34f3d640 1 -- 172.21.15.7:0/3686306437 wait complete. 2024-09-21T06:45:21.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:21.570+0000 7f0f34f3d640 1 Processor -- start 2024-09-21T06:45:21.580 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:21.570+0000 7f0f34f3d640 1 -- start start 2024-09-21T06:45:21.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:21.570+0000 7f0f34f3d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f30102a60 0x7f0f3019b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:21.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:21.571+0000 7f0f34f3d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f301083a0 0x7f0f3019b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:21.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:21.571+0000 7f0f34f3d640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f30108cf0 0x7f0f3019bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:21.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:21.571+0000 7f0f34f3d640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0f30112960 con 0x7f0f301083a0 2024-09-21T06:45:21.581 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:21.571+0000 7f0f34f3d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0f301127e0 con 0x7f0f30102a60 2024-09-21T06:45:21.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:21.571+0000 7f0f34f3d640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0f30112ae0 con 0x7f0f30108cf0 2024-09-21T06:45:21.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:21.571+0000 7f0f2dd9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f301083a0 0x7f0f3019b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:21.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:21.571+0000 7f0f2dd9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f301083a0 0x7f0f3019b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:42996/0 (socket says 172.21.15.7:42996) 2024-09-21T06:45:21.582 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:21.571+0000 7f0f2dd9b640 1 -- 172.21.15.7:0/367028203 learned_addr learned my addr 172.21.15.7:0/367028203 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:21.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:21.571+0000 7f0f2ed9d640 1 --2- 172.21.15.7:0/367028203 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f30108cf0 0x7f0f3019bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:21.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:21.571+0000 7f0f2e59c640 1 --2- 172.21.15.7:0/367028203 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f30102a60 0x7f0f3019b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:21.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:21.571+0000 7f0f2dd9b640 1 -- 172.21.15.7:0/367028203 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f30108cf0 msgr2=0x7f0f3019bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:21.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:21.571+0000 7f0f2dd9b640 1 --2- 172.21.15.7:0/367028203 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f30108cf0 0x7f0f3019bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:21.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:21.571+0000 7f0f2dd9b640 1 -- 172.21.15.7:0/367028203 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f30102a60 msgr2=0x7f0f3019b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:21.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:21.571+0000 7f0f2dd9b640 1 --2- 172.21.15.7:0/367028203 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f30102a60 0x7f0f3019b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:21.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:21.571+0000 7f0f2dd9b640 1 -- 172.21.15.7:0/367028203 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f301a6580 con 0x7f0f301083a0 2024-09-21T06:45:21.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:21.571+0000 7f0f2dd9b640 1 --2- 172.21.15.7:0/367028203 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f301083a0 0x7f0f3019b830 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f0f24006010 tx=0x7f0f24004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:21.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:21.572+0000 7f0f1f7fe640 1 -- 172.21.15.7:0/367028203 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f2403f030 con 0x7f0f301083a0 2024-09-21T06:45:21.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:21.572+0000 7f0f1f7fe640 1 -- 172.21.15.7:0/367028203 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0f24003aa0 con 0x7f0f301083a0 2024-09-21T06:45:21.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:21.572+0000 7f0f1f7fe640 1 -- 172.21.15.7:0/367028203 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f24035070 con 0x7f0f301083a0 2024-09-21T06:45:21.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:21.572+0000 7f0f34f3d640 1 -- 172.21.15.7:0/367028203 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f301a6810 con 0x7f0f301083a0 2024-09-21T06:45:21.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:21.572+0000 7f0f34f3d640 1 -- 172.21.15.7:0/367028203 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f301a6d40 con 0x7f0f301083a0 2024-09-21T06:45:21.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:21.573+0000 7f0f34f3d640 1 -- 172.21.15.7:0/367028203 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f30103ce0 con 0x7f0f301083a0 2024-09-21T06:45:21.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:21.575+0000 7f0f1f7fe640 1 -- 172.21.15.7:0/367028203 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f0f24042030 con 0x7f0f301083a0 2024-09-21T06:45:21.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:21.576+0000 7f0f1f7fe640 1 --2- 172.21.15.7:0/367028203 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f0f180b6730 0x7f0f180b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:21.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:21.576+0000 7f0f2e59c640 1 --2- 172.21.15.7:0/367028203 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f0f180b6730 0x7f0f180b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:21.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:21.576+0000 7f0f1f7fe640 1 -- 172.21.15.7:0/367028203 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7f0f24107de0 con 0x7f0f301083a0 2024-09-21T06:45:21.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:21.577+0000 7f0f2e59c640 1 --2- 172.21.15.7:0/367028203 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f0f180b6730 0x7f0f180b8c40 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f0f3006c720 tx=0x7f0f20005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:21.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:21.580+0000 7f0f1f7fe640 1 -- 172.21.15.7:0/367028203 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0f240d2780 con 0x7f0f301083a0 2024-09-21T06:45:21.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:21.807+0000 7f0f34f3d640 1 -- 172.21.15.7:0/367028203 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0f30102e70 con 0x7f0f301083a0 2024-09-21T06:45:21.810 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:21.808+0000 7f0f1f7fe640 1 -- 172.21.15.7:0/367028203 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11899 (secure 0 0 0) 0x7f0f240d76c0 con 0x7f0f301083a0 2024-09-21T06:45:21.810 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:45:21.810 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-21T06:36:10:753693+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2015971546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2015971546},{"type":"v1","addr":"172.21.15.7:6835","nonce":2015971546}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/2350816224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":2350816224},{"type":"v1","addr":"172.21.15.7:6837","nonce":2350816224}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14823,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/1669980572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":1669980572},{"type":"v1","addr":"172.21.15.7:6839","nonce":1669980572}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14835,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/2528308973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":2528308973},{"type":"v1","addr":"172.21.15.7:6841","nonce":2528308973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24623,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1337382979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1337382979},{"type":"v1","addr":"172.21.15.18:6833","nonce":1337382979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/2751454345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":2751454345},{"type":"v1","addr":"172.21.15.144:6833","nonce":2751454345}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:34:24.627168+0000","modified":"2024-09-21T06:36:10.737288+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24716,"mds_1":24688,"mds_2":24686},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24656":{"gid":24656,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6835/158884796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":158884796},{"type":"v1","addr":"172.21.15.18:6835","nonce":158884796}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6835/3636739922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3636739922},{"type":"v1","addr":"172.21.15.144:6835","nonce":3636739922}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24673":{"gid":24673,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6837/1126341753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":1126341753},{"type":"v1","addr":"172.21.15.144:6837","nonce":1126341753}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.18:6837/1539670694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1539670694},{"type":"v1","addr":"172.21.15.18:6837","nonce":1539670694}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24688":{"gid":24688,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.144:6839/4027821922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":4027821922},{"type":"v1","addr":"172.21.15.144:6839","nonce":4027821922}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24716":{"gid":24716,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.18:6839/3798713532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":3798713532},{"type":"v1","addr":"172.21.15.18:6839","nonce":3798713532}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24716,"qdb_cluster":[24716,24688,24686]},"id":1}]} 2024-09-21T06:45:21.810 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-21T06:45:21.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:21.810+0000 7f0f34f3d640 1 -- 172.21.15.7:0/367028203 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f0f180b6730 msgr2=0x7f0f180b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:21.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:21.810+0000 7f0f34f3d640 1 --2- 172.21.15.7:0/367028203 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f0f180b6730 0x7f0f180b8c40 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f0f3006c720 tx=0x7f0f20005f90 comp rx=0 tx=0).stop 2024-09-21T06:45:21.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:21.810+0000 7f0f34f3d640 1 -- 172.21.15.7:0/367028203 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f301083a0 msgr2=0x7f0f3019b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:21.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:21.810+0000 7f0f34f3d640 1 --2- 172.21.15.7:0/367028203 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f301083a0 0x7f0f3019b830 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f0f24006010 tx=0x7f0f24004060 comp rx=0 tx=0).stop 2024-09-21T06:45:21.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:21.810+0000 7f0f34f3d640 1 -- 172.21.15.7:0/367028203 shutdown_connections 2024-09-21T06:45:21.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:21.810+0000 7f0f34f3d640 1 --2- 172.21.15.7:0/367028203 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f0f180b6730 0x7f0f180b8c40 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:21.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:21.810+0000 7f0f34f3d640 1 --2- 172.21.15.7:0/367028203 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0f30108cf0 0x7f0f3019bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:21.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:21.810+0000 7f0f34f3d640 1 --2- 172.21.15.7:0/367028203 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f0f301083a0 0x7f0f3019b830 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:21.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:21.810+0000 7f0f34f3d640 1 --2- 172.21.15.7:0/367028203 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0f30102a60 0x7f0f3019b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:21.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:21.810+0000 7f0f34f3d640 1 -- 172.21.15.7:0/367028203 >> 172.21.15.7:0/367028203 conn(0x7f0f30079730 msgr2=0x7f0f301044c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:21.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:21.810+0000 7f0f34f3d640 1 -- 172.21.15.7:0/367028203 shutdown_connections 2024-09-21T06:45:21.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:21.810+0000 7f0f34f3d640 1 -- 172.21.15.7:0/367028203 wait complete. 2024-09-21T06:45:22.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:45:21 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/367028203' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:45:22.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:45:21 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/367028203' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:45:22.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:45:21 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/367028203' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:45:22.509 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:45:22.770 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:45:23.173 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:45:22 smithi007 ceph-mon[30983]: pgmap v600: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T06:45:23.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:45:22 smithi144 ceph-mon[34653]: pgmap v600: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T06:45:23.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.264+0000 7f038a15a640 1 -- 172.21.15.7:0/2032720474 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03841048c0 msgr2=0x7f0384104cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:23.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.264+0000 7f038a15a640 1 --2- 172.21.15.7:0/2032720474 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03841048c0 0x7f0384104cd0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f0374009900 tx=0x7f037402a410 comp rx=0 tx=0).stop 2024-09-21T06:45:23.290 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.264+0000 7f038a15a640 1 -- 172.21.15.7:0/2032720474 shutdown_connections 2024-09-21T06:45:23.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.264+0000 7f038a15a640 1 --2- 172.21.15.7:0/2032720474 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f038410de70 0x7f0384110340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:23.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.264+0000 7f038a15a640 1 --2- 172.21.15.7:0/2032720474 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f03841052a0 0x7f038410d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:23.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.264+0000 7f038a15a640 1 --2- 172.21.15.7:0/2032720474 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03841048c0 0x7f0384104cd0 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:23.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.264+0000 7f038a15a640 1 -- 172.21.15.7:0/2032720474 >> 172.21.15.7:0/2032720474 conn(0x7f0384079760 msgr2=0x7f0384079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:23.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.264+0000 7f038a15a640 1 -- 172.21.15.7:0/2032720474 shutdown_connections 2024-09-21T06:45:23.291 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.264+0000 7f038a15a640 1 -- 172.21.15.7:0/2032720474 wait complete. 2024-09-21T06:45:23.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.265+0000 7f038a15a640 1 Processor -- start 2024-09-21T06:45:23.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.265+0000 7f038a15a640 1 -- start start 2024-09-21T06:45:23.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.266+0000 7f038a15a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f03841048c0 0x7f038419a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:23.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.266+0000 7f038a15a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03841052a0 0x7f038419aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:23.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.266+0000 7f038a15a640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f038410de70 0x7f038419fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:23.292 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.266+0000 7f038a15a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f0384113ad0 con 0x7f03841052a0 2024-09-21T06:45:23.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.266+0000 7f038a15a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0384113950 con 0x7f03841048c0 2024-09-21T06:45:23.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.266+0000 7f038a15a640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0384113c50 con 0x7f038410de70 2024-09-21T06:45:23.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.266+0000 7f0382ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03841052a0 0x7f038419aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:23.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.266+0000 7f0382ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03841052a0 0x7f038419aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43010/0 (socket says 172.21.15.7:43010) 2024-09-21T06:45:23.293 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.266+0000 7f0382ffd640 1 -- 172.21.15.7:0/334102785 learned_addr learned my addr 172.21.15.7:0/334102785 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:23.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.266+0000 7f0383fff640 1 --2- 172.21.15.7:0/334102785 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f038410de70 0x7f038419fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:23.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.266+0000 7f03837fe640 1 --2- 172.21.15.7:0/334102785 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f03841048c0 0x7f038419a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:23.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.266+0000 7f0382ffd640 1 -- 172.21.15.7:0/334102785 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f038410de70 msgr2=0x7f038419fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:23.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.266+0000 7f0382ffd640 1 --2- 172.21.15.7:0/334102785 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f038410de70 0x7f038419fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:23.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.266+0000 7f0382ffd640 1 -- 172.21.15.7:0/334102785 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f03841048c0 msgr2=0x7f038419a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:23.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.266+0000 7f0382ffd640 1 --2- 172.21.15.7:0/334102785 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f03841048c0 0x7f038419a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:23.294 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.266+0000 7f0382ffd640 1 -- 172.21.15.7:0/334102785 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03841a0470 con 0x7f03841052a0 2024-09-21T06:45:23.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.266+0000 7f0383fff640 1 --2- 172.21.15.7:0/334102785 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f038410de70 0x7f038419fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:23.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.266+0000 7f0382ffd640 1 --2- 172.21.15.7:0/334102785 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03841052a0 0x7f038419aaa0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f037800d750 tx=0x7f037800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:23.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.266+0000 7f0380ff9640 1 -- 172.21.15.7:0/334102785 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0378017070 con 0x7f03841052a0 2024-09-21T06:45:23.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.267+0000 7f0380ff9640 1 -- 172.21.15.7:0/334102785 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f03780054d0 con 0x7f03841052a0 2024-09-21T06:45:23.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.267+0000 7f0380ff9640 1 -- 172.21.15.7:0/334102785 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0378004c30 con 0x7f03841052a0 2024-09-21T06:45:23.295 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.267+0000 7f038a15a640 1 -- 172.21.15.7:0/334102785 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03841a0760 con 0x7f03841052a0 2024-09-21T06:45:23.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.267+0000 7f038a15a640 1 -- 172.21.15.7:0/334102785 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03841a6ec0 con 0x7f03841052a0 2024-09-21T06:45:23.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.269+0000 7f0380ff9640 1 -- 172.21.15.7:0/334102785 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f0378004dd0 con 0x7f03841052a0 2024-09-21T06:45:23.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.269+0000 7f03906ce740 1 Processor -- start 2024-09-21T06:45:23.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.269+0000 7f03906ce740 1 -- start start 2024-09-21T06:45:23.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.270+0000 7f03906ce740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5557a3300070 0x5557a36a76a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:23.296 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.270+0000 7f03906ce740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5557a32d71b0 0x5557a36a7be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:23.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.270+0000 7f03906ce740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5557a32df390 0x5557a36a8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:23.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.270+0000 7f03906ce740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5557a361dea0 con 0x5557a32d71b0 2024-09-21T06:45:23.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.270+0000 7f03906ce740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5557a360d2d0 con 0x5557a32df390 2024-09-21T06:45:23.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.270+0000 7f03906ce740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5557a36110e0 con 0x5557a3300070 2024-09-21T06:45:23.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.270+0000 7f03837fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5557a32d71b0 0x5557a36a7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:23.297 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.270+0000 7f03837fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5557a32d71b0 0x5557a36a7be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43022/0 (socket says 172.21.15.7:43022) 2024-09-21T06:45:23.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.270+0000 7f03837fe640 1 -- 172.21.15.7:0/3712163597 learned_addr learned my addr 172.21.15.7:0/3712163597 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:23.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.270+0000 7f0383fff640 1 --2- 172.21.15.7:0/3712163597 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5557a3300070 0x5557a36a76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:23.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.270+0000 7f0382ffd640 1 --2- 172.21.15.7:0/3712163597 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5557a32df390 0x5557a36a8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:23.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.270+0000 7f03837fe640 1 -- 172.21.15.7:0/3712163597 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5557a3300070 msgr2=0x5557a36a76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:23.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.270+0000 7f03837fe640 1 --2- 172.21.15.7:0/3712163597 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5557a3300070 0x5557a36a76a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:23.298 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.270+0000 7f03837fe640 1 -- 172.21.15.7:0/3712163597 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5557a32df390 msgr2=0x5557a36a8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:23.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.270+0000 7f03837fe640 1 --2- 172.21.15.7:0/3712163597 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5557a32df390 0x5557a36a8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:23.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.270+0000 7f03837fe640 1 -- 172.21.15.7:0/3712163597 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557a336b650 con 0x5557a32d71b0 2024-09-21T06:45:23.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.270+0000 7f0382ffd640 1 --2- 172.21.15.7:0/3712163597 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5557a32df390 0x5557a36a8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:23.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.270+0000 7f03837fe640 1 --2- 172.21.15.7:0/3712163597 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5557a32d71b0 0x5557a36a7be0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f038406c890 tx=0x7f0374032c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f5276944085accd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:23.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.271+0000 7f0380ff9640 1 --2- 172.21.15.7:0/334102785 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f036c0b6700 0x7f036c0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:23.299 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.271+0000 7f0383fff640 1 --2- 172.21.15.7:0/334102785 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f036c0b6700 0x7f036c0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:23.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.271+0000 7f0369ffb640 1 -- 172.21.15.7:0/3712163597 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f037403f070 con 0x5557a32d71b0 2024-09-21T06:45:23.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.271+0000 7f0369ffb640 1 -- 172.21.15.7:0/3712163597 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0374032e40 con 0x5557a32d71b0 2024-09-21T06:45:23.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.271+0000 7f0369ffb640 1 -- 172.21.15.7:0/3712163597 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0374035070 con 0x5557a32d71b0 2024-09-21T06:45:23.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.271+0000 7f0380ff9640 1 -- 172.21.15.7:0/334102785 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7f03780e7060 con 0x7f03841052a0 2024-09-21T06:45:23.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.272+0000 7f03906ce740 1 -- 172.21.15.7:0/3712163597 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5557a32d71b0 msgr2=0x5557a36a7be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:23.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.272+0000 7f0383fff640 1 --2- 172.21.15.7:0/334102785 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f036c0b6700 0x7f036c0b8c10 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f037c005fd0 tx=0x7f037c009800 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:23.300 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.272+0000 7f03906ce740 1 --2- 172.21.15.7:0/3712163597 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5557a32d71b0 0x5557a36a7be0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f038406c890 tx=0x7f0374032c50 comp rx=0 tx=0).stop 2024-09-21T06:45:23.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.272+0000 7f03906ce740 1 -- 172.21.15.7:0/3712163597 shutdown_connections 2024-09-21T06:45:23.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.272+0000 7f03906ce740 1 --2- 172.21.15.7:0/3712163597 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5557a32df390 0x5557a36a8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:23.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.272+0000 7f03906ce740 1 --2- 172.21.15.7:0/3712163597 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5557a32d71b0 0x5557a36a7be0 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:23.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.272+0000 7f03906ce740 1 --2- 172.21.15.7:0/3712163597 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5557a3300070 0x5557a36a76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:23.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.272+0000 7f03906ce740 1 -- 172.21.15.7:0/3712163597 >> 172.21.15.7:0/3712163597 conn(0x5557a32f4460 msgr2=0x5557a36a5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:23.301 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.272+0000 7f03906ce740 1 -- 172.21.15.7:0/3712163597 shutdown_connections 2024-09-21T06:45:23.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.272+0000 7f03906ce740 1 -- 172.21.15.7:0/3712163597 wait complete. 2024-09-21T06:45:23.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.272+0000 7f03906ce740 1 -- start start 2024-09-21T06:45:23.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.273+0000 7f03906ce740 1 Processor -- start 2024-09-21T06:45:23.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.273+0000 7f03906ce740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5557a32d71b0 0x5557a36b7110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:23.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.273+0000 7f03906ce740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5557a32df390 0x5557a36b7650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:23.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.273+0000 7f03906ce740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5557a3300070 0x5557a36b7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:23.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.273+0000 7f03906ce740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5557a346e700 con 0x5557a3300070 2024-09-21T06:45:23.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.273+0000 7f03906ce740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5557a35a8160 con 0x5557a32d71b0 2024-09-21T06:45:23.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.273+0000 7f03906ce740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5557a36ba180 con 0x5557a32df390 2024-09-21T06:45:23.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.273+0000 7f03906ce740 10 client.0 _ll_register_callbacks cb 0x5557a35c19e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:23.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.273+0000 7f0383fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5557a3300070 0x5557a36b7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:23.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.273+0000 7f0383fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5557a3300070 0x5557a36b7bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43034/0 (socket says 172.21.15.7:43034) 2024-09-21T06:45:23.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.273+0000 7f0383fff640 1 -- 172.21.15.7:0/1470155753 learned_addr learned my addr 172.21.15.7:0/1470155753 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:23.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.273+0000 7f03837fe640 1 --2- 172.21.15.7:0/1470155753 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5557a32d71b0 0x5557a36b7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:23.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.273+0000 7f0382ffd640 1 --2- 172.21.15.7:0/1470155753 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5557a32df390 0x5557a36b7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:23.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.273+0000 7f0383fff640 1 -- 172.21.15.7:0/1470155753 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5557a32df390 msgr2=0x5557a36b7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:23.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.273+0000 7f0383fff640 1 --2- 172.21.15.7:0/1470155753 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5557a32df390 0x5557a36b7650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:23.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.273+0000 7f0383fff640 1 -- 172.21.15.7:0/1470155753 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5557a32d71b0 msgr2=0x5557a36b7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:23.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.273+0000 7f0383fff640 1 --2- 172.21.15.7:0/1470155753 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5557a32d71b0 0x5557a36b7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:23.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.273+0000 7f0383fff640 1 -- 172.21.15.7:0/1470155753 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557a35d5c90 con 0x5557a3300070 2024-09-21T06:45:23.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.273+0000 7f03837fe640 1 --2- 172.21.15.7:0/1470155753 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5557a32d71b0 0x5557a36b7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:45:23.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.274+0000 7f0383fff640 1 --2- 172.21.15.7:0/1470155753 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5557a3300070 0x5557a36b7bd0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f037c011d40 tx=0x7f037c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aca11a0956e72183 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:23.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.274+0000 7f0362ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:45:23.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.274+0000 7f0362ffd640 1 -- 172.21.15.7:0/1470155753 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f037c01ed30 con 0x5557a3300070 2024-09-21T06:45:23.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.274+0000 7f0362ffd640 1 -- 172.21.15.7:0/1470155753 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7f037c02a480 con 0x5557a3300070 2024-09-21T06:45:23.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.274+0000 7f03906ce740 1 -- 172.21.15.7:0/1470155753 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5557a361fdf0 con 0x5557a3300070 2024-09-21T06:45:23.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.274+0000 7f0362ffd640 1 -- 172.21.15.7:0/1470155753 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f037c02a680 con 0x5557a3300070 2024-09-21T06:45:23.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.274+0000 7f03906ce740 10 client.17520 fetch_fsmap learned FSMap version 25 2024-09-21T06:45:23.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.274+0000 7f03906ce740 1 -- 172.21.15.7:0/1470155753 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5557a36c5f40 con 0x5557a3300070 2024-09-21T06:45:23.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.274+0000 7f0362ffd640 1 -- 172.21.15.7:0/1470155753 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5557a361fdf0 con 0x5557a3300070 2024-09-21T06:45:23.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.274+0000 7f0362ffd640 1 -- 172.21.15.7:0/1470155753 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f037c032050 con 0x5557a3300070 2024-09-21T06:45:23.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.274+0000 7f03906ce740 10 client.17520 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:45:23.304 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.274+0000 7f03906ce740 10 client.17520 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-21T06:45:23.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.274+0000 7f03906ce740 20 client.17520 populate_metadata read hostname 'smithi007' 2024-09-21T06:45:23.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.274+0000 7f03906ce740 1 --2- 172.21.15.7:0/1470155753 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x5557a32be9f0 0x5557a36c9480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:23.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.274+0000 7f03906ce740 4 client.17520 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:45:23.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.274+0000 7f03906ce740 1 -- 172.21.15.7:0/1470155753 --> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5557a361b8a0 con 0x5557a32be9f0 2024-09-21T06:45:23.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.275+0000 7f03837fe640 1 --2- 172.21.15.7:0/1470155753 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x5557a32be9f0 0x5557a36c9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:23.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.275+0000 7f0362ffd640 10 client.17520 ms_handle_connect on v2:172.21.15.18:6836/1539670694 2024-09-21T06:45:23.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.275+0000 7f03837fe640 1 --2- 172.21.15.7:0/1470155753 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x5557a32be9f0 0x5557a36c9480 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=322fc52073af53ac server_cookie=3cc9596c9af76229 in_seq=0 out_seq=0 2024-09-21T06:45:23.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.276+0000 7f0362ffd640 1 -- 172.21.15.7:0/1470155753 <== mds.2 v2:172.21.15.18:6836/1539670694 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5557a361b8a0 con 0x5557a32be9f0 2024-09-21T06:45:23.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.276+0000 7f0362ffd640 10 client.17520 handle_command_reply: tid=0 2024-09-21T06:45:23.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.276+0000 7f03906ce740 1 client.17520 shutdown 2024-09-21T06:45:23.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.276+0000 7f03906ce740 1 -- 172.21.15.7:0/1470155753 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5557a3300070 msgr2=0x5557a36b7bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:23.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.276+0000 7f03906ce740 1 --2- 172.21.15.7:0/1470155753 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5557a3300070 0x5557a36b7bd0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f037c011d40 tx=0x7f037c004a40 comp rx=0 tx=0).stop 2024-09-21T06:45:23.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.276+0000 7f03906ce740 1 -- 172.21.15.7:0/1470155753 shutdown_connections 2024-09-21T06:45:23.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.276+0000 7f03906ce740 1 --2- 172.21.15.7:0/1470155753 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x5557a32be9f0 0x5557a36c9480 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:23.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.276+0000 7f03906ce740 1 --2- 172.21.15.7:0/1470155753 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5557a3300070 0x5557a36b7bd0 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:23.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.276+0000 7f0362ffd640 0 client.17520 ms_handle_reset on v2:172.21.15.18:6836/1539670694 2024-09-21T06:45:23.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.276+0000 7f03906ce740 1 --2- 172.21.15.7:0/1470155753 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5557a32df390 0x5557a36b7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:23.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.276+0000 7f03906ce740 1 --2- 172.21.15.7:0/1470155753 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5557a32d71b0 0x5557a36b7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:23.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.276+0000 7f03906ce740 1 -- 172.21.15.7:0/1470155753 >> 172.21.15.7:0/1470155753 conn(0x5557a32f4460 msgr2=0x5557a36a3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:23.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.276+0000 7f03906ce740 1 -- 172.21.15.7:0/1470155753 shutdown_connections 2024-09-21T06:45:23.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.276+0000 7f03906ce740 1 -- 172.21.15.7:0/1470155753 wait complete. 2024-09-21T06:45:23.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.277+0000 7f03906ce740 20 client.17520 trim_cache size 0 max 16384 2024-09-21T06:45:23.310 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.290+0000 7f03906ce740 1 Processor -- start 2024-09-21T06:45:23.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.290+0000 7f03906ce740 1 -- start start 2024-09-21T06:45:23.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.290+0000 7f03906ce740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5557a32be9f0 0x5557a36acf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:23.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.290+0000 7f03906ce740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5557a32d71b0 0x5557a36b4300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:23.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.290+0000 7f03906ce740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5557a32df390 0x5557a36b4840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:23.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.290+0000 7f03906ce740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f03841afb70 con 0x5557a32df390 2024-09-21T06:45:23.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.290+0000 7f03906ce740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f03841ad440 con 0x5557a32be9f0 2024-09-21T06:45:23.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.290+0000 7f03906ce740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f03841ab2b0 con 0x5557a32d71b0 2024-09-21T06:45:23.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.290+0000 7f0383fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5557a32df390 0x5557a36b4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:23.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.290+0000 7f03837fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5557a32be9f0 0x5557a36acf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:23.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.290+0000 7f0383fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5557a32df390 0x5557a36b4840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43048/0 (socket says 172.21.15.7:43048) 2024-09-21T06:45:23.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.290+0000 7f0383fff640 1 -- 172.21.15.7:0/214552624 learned_addr learned my addr 172.21.15.7:0/214552624 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:23.311 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.291+0000 7f0382ffd640 1 --2- 172.21.15.7:0/214552624 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5557a32d71b0 0x5557a36b4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:23.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.291+0000 7f0383fff640 1 -- 172.21.15.7:0/214552624 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5557a32d71b0 msgr2=0x5557a36b4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:23.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.291+0000 7f0383fff640 1 --2- 172.21.15.7:0/214552624 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5557a32d71b0 0x5557a36b4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:23.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.291+0000 7f0383fff640 1 -- 172.21.15.7:0/214552624 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5557a32be9f0 msgr2=0x5557a36acf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:23.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.291+0000 7f0383fff640 1 --2- 172.21.15.7:0/214552624 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5557a32be9f0 0x5557a36acf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:23.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.291+0000 7f0383fff640 1 -- 172.21.15.7:0/214552624 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557a36a9fb0 con 0x5557a32df390 2024-09-21T06:45:23.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.291+0000 7f0383fff640 1 --2- 172.21.15.7:0/214552624 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5557a32df390 0x5557a36b4840 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f037c014fd0 tx=0x7f037c033f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be06f613fdf22de4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:23.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.291+0000 7f03697fa640 1 -- 172.21.15.7:0/214552624 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f037c033ab0 con 0x5557a32df390 2024-09-21T06:45:23.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.291+0000 7f03697fa640 1 -- 172.21.15.7:0/214552624 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f037c033c50 con 0x5557a32df390 2024-09-21T06:45:23.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.291+0000 7f03697fa640 1 -- 172.21.15.7:0/214552624 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f037c02a820 con 0x5557a32df390 2024-09-21T06:45:23.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.292+0000 7f03906ce740 1 -- 172.21.15.7:0/214552624 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5557a32df390 msgr2=0x5557a36b4840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:23.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.292+0000 7f03906ce740 1 --2- 172.21.15.7:0/214552624 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5557a32df390 0x5557a36b4840 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f037c014fd0 tx=0x7f037c033f00 comp rx=0 tx=0).stop 2024-09-21T06:45:23.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.292+0000 7f03906ce740 1 -- 172.21.15.7:0/214552624 shutdown_connections 2024-09-21T06:45:23.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.292+0000 7f03906ce740 1 --2- 172.21.15.7:0/214552624 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5557a32df390 0x5557a36b4840 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:23.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.292+0000 7f03906ce740 1 --2- 172.21.15.7:0/214552624 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5557a32d71b0 0x5557a36b4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:23.312 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.292+0000 7f03906ce740 1 --2- 172.21.15.7:0/214552624 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5557a32be9f0 0x5557a36acf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:23.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.292+0000 7f03906ce740 1 -- 172.21.15.7:0/214552624 >> 172.21.15.7:0/214552624 conn(0x5557a32f4460 msgr2=0x5557a36ac840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:23.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.292+0000 7f03906ce740 1 -- 172.21.15.7:0/214552624 shutdown_connections 2024-09-21T06:45:23.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.292+0000 7f03906ce740 1 -- 172.21.15.7:0/214552624 wait complete. 2024-09-21T06:45:23.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.292+0000 7f03906ce740 1 -- start start 2024-09-21T06:45:23.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.293+0000 7f03906ce740 1 Processor -- start 2024-09-21T06:45:23.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.293+0000 7f03906ce740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5557a32be9f0 0x5557a36bfce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:23.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.293+0000 7f03906ce740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5557a32d71b0 0x5557a36bd200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:23.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.293+0000 7f03906ce740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5557a32df390 0x5557a36bd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:23.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.293+0000 7f03906ce740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f03841ab900 con 0x5557a32be9f0 2024-09-21T06:45:23.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.293+0000 7f03906ce740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f03841acd70 con 0x5557a32df390 2024-09-21T06:45:23.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.293+0000 7f03906ce740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f03841abfd0 con 0x5557a32d71b0 2024-09-21T06:45:23.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.293+0000 7f03906ce740 10 client.0 _ll_register_callbacks cb 0x7f037c009a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:23.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.293+0000 7f03837fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5557a32be9f0 0x5557a36bfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:23.313 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.293+0000 7f03837fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5557a32be9f0 0x5557a36bfce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43052/0 (socket says 172.21.15.7:43052) 2024-09-21T06:45:23.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.293+0000 7f03837fe640 1 -- 172.21.15.7:0/3929260499 learned_addr learned my addr 172.21.15.7:0/3929260499 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:23.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.293+0000 7f0383fff640 1 --2- 172.21.15.7:0/3929260499 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5557a32df390 0x5557a36bd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:23.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.293+0000 7f0382ffd640 1 --2- 172.21.15.7:0/3929260499 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5557a32d71b0 0x5557a36bd200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:23.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.293+0000 7f03837fe640 1 -- 172.21.15.7:0/3929260499 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5557a32d71b0 msgr2=0x5557a36bd200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:23.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.293+0000 7f03837fe640 1 --2- 172.21.15.7:0/3929260499 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5557a32d71b0 0x5557a36bd200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:23.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.293+0000 7f03837fe640 1 -- 172.21.15.7:0/3929260499 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5557a32df390 msgr2=0x5557a36bd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:23.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.293+0000 7f03837fe640 1 --2- 172.21.15.7:0/3929260499 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5557a32df390 0x5557a36bd800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:23.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.293+0000 7f03837fe640 1 -- 172.21.15.7:0/3929260499 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5557a36bdfe0 con 0x5557a32be9f0 2024-09-21T06:45:23.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.293+0000 7f0383fff640 1 --2- 172.21.15.7:0/3929260499 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5557a32df390 0x5557a36bd800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:23.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.294+0000 7f03837fe640 1 --2- 172.21.15.7:0/3929260499 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5557a32be9f0 0x5557a36bfce0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f0374005f70 tx=0x7f037402a9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73dbb6896becdf55 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:23.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.294+0000 7f0362ffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:45:23.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.294+0000 7f0362ffd640 1 -- 172.21.15.7:0/3929260499 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f037405a060 con 0x5557a32be9f0 2024-09-21T06:45:23.314 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.294+0000 7f0362ffd640 1 -- 172.21.15.7:0/3929260499 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7f03740318b0 con 0x5557a32be9f0 2024-09-21T06:45:23.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.294+0000 7f03906ce740 1 -- 172.21.15.7:0/3929260499 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f037c033c50 con 0x5557a32be9f0 2024-09-21T06:45:23.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.294+0000 7f0362ffd640 1 -- 172.21.15.7:0/3929260499 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f037403f040 con 0x5557a32be9f0 2024-09-21T06:45:23.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.294+0000 7f03906ce740 10 client.17526 fetch_fsmap learned FSMap version 25 2024-09-21T06:45:23.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.294+0000 7f03906ce740 1 -- 172.21.15.7:0/3929260499 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5557a3733f10 con 0x5557a32be9f0 2024-09-21T06:45:23.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.294+0000 7f0362ffd640 1 -- 172.21.15.7:0/3929260499 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f037c033c50 con 0x5557a32be9f0 2024-09-21T06:45:23.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.295+0000 7f0362ffd640 1 -- 172.21.15.7:0/3929260499 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f037405d020 con 0x5557a32be9f0 2024-09-21T06:45:23.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.295+0000 7f03906ce740 10 client.17526 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:45:23.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.295+0000 7f03906ce740 10 client.17526 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-21T06:45:23.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.295+0000 7f03906ce740 20 client.17526 populate_metadata read hostname 'smithi007' 2024-09-21T06:45:23.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.295+0000 7f03906ce740 1 --2- 172.21.15.7:0/3929260499 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x5557a3300070 0x5557a3736260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:23.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.295+0000 7f03906ce740 4 client.17526 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:45:23.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.295+0000 7f03906ce740 1 -- 172.21.15.7:0/3929260499 --> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5557a3618cd0 con 0x5557a3300070 2024-09-21T06:45:23.315 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.295+0000 7f0382ffd640 1 --2- 172.21.15.7:0/3929260499 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x5557a3300070 0x5557a3736260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:23.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.295+0000 7f0382ffd640 1 --2- 172.21.15.7:0/3929260499 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x5557a3300070 0x5557a3736260 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fec24f8212de9aae server_cookie=2a52f3432e764914 in_seq=0 out_seq=0 2024-09-21T06:45:23.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.295+0000 7f0362ffd640 10 client.17526 ms_handle_connect on v2:172.21.15.18:6836/1539670694 2024-09-21T06:45:23.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.296+0000 7f0362ffd640 1 -- 172.21.15.7:0/3929260499 <== mds.2 v2:172.21.15.18:6836/1539670694 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5557a3618cd0 con 0x5557a3300070 2024-09-21T06:45:23.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.296+0000 7f0362ffd640 10 client.17526 handle_command_reply: tid=0 2024-09-21T06:45:23.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.296+0000 7f03906ce740 1 client.17526 shutdown 2024-09-21T06:45:23.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.296+0000 7f03906ce740 1 -- 172.21.15.7:0/3929260499 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5557a32be9f0 msgr2=0x5557a36bfce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:23.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.296+0000 7f03906ce740 1 --2- 172.21.15.7:0/3929260499 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5557a32be9f0 0x5557a36bfce0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f0374005f70 tx=0x7f037402a9b0 comp rx=0 tx=0).stop 2024-09-21T06:45:23.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.296+0000 7f03906ce740 1 -- 172.21.15.7:0/3929260499 shutdown_connections 2024-09-21T06:45:23.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.296+0000 7f03906ce740 1 --2- 172.21.15.7:0/3929260499 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x5557a3300070 0x5557a3736260 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:23.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.296+0000 7f03906ce740 1 --2- 172.21.15.7:0/3929260499 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5557a32df390 0x5557a36bd800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:23.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.296+0000 7f03906ce740 1 --2- 172.21.15.7:0/3929260499 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5557a32d71b0 0x5557a36bd200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:23.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.296+0000 7f03906ce740 1 --2- 172.21.15.7:0/3929260499 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5557a32be9f0 0x5557a36bfce0 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:23.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.296+0000 7f03906ce740 1 -- 172.21.15.7:0/3929260499 >> 172.21.15.7:0/3929260499 conn(0x5557a32f4460 msgr2=0x5557a36b85a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:23.316 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.296+0000 7f0362ffd640 0 client.17526 ms_handle_reset on v2:172.21.15.18:6836/1539670694 2024-09-21T06:45:23.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.296+0000 7f03906ce740 1 -- 172.21.15.7:0/3929260499 shutdown_connections 2024-09-21T06:45:23.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.296+0000 7f03906ce740 1 -- 172.21.15.7:0/3929260499 wait complete. 2024-09-21T06:45:23.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.296+0000 7f03906ce740 20 client.17526 trim_cache size 0 max 16384 2024-09-21T06:45:23.317 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:45:23.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.297+0000 7f038a15a640 1 -- 172.21.15.7:0/334102785 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f036c0b6700 msgr2=0x7f036c0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:23.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.297+0000 7f038a15a640 1 --2- 172.21.15.7:0/334102785 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f036c0b6700 0x7f036c0b8c10 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f037c005fd0 tx=0x7f037c009800 comp rx=0 tx=0).stop 2024-09-21T06:45:23.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.297+0000 7f038a15a640 1 -- 172.21.15.7:0/334102785 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03841052a0 msgr2=0x7f038419aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:23.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.297+0000 7f038a15a640 1 --2- 172.21.15.7:0/334102785 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03841052a0 0x7f038419aaa0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f037800d750 tx=0x7f037800dc10 comp rx=0 tx=0).stop 2024-09-21T06:45:23.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.297+0000 7f038a15a640 1 -- 172.21.15.7:0/334102785 shutdown_connections 2024-09-21T06:45:23.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.297+0000 7f038a15a640 1 --2- 172.21.15.7:0/334102785 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f036c0b6700 0x7f036c0b8c10 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:23.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.297+0000 7f038a15a640 1 --2- 172.21.15.7:0/334102785 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f038410de70 0x7f038419fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:23.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.297+0000 7f038a15a640 1 --2- 172.21.15.7:0/334102785 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f03841052a0 0x7f038419aaa0 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:23.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.297+0000 7f038a15a640 1 --2- 172.21.15.7:0/334102785 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f03841048c0 0x7f038419a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:23.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.297+0000 7f038a15a640 1 -- 172.21.15.7:0/334102785 >> 172.21.15.7:0/334102785 conn(0x7f0384079760 msgr2=0x7f0384100890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:23.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.297+0000 7f038a15a640 1 -- 172.21.15.7:0/334102785 shutdown_connections 2024-09-21T06:45:23.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:23.297+0000 7f038a15a640 1 -- 172.21.15.7:0/334102785 wait complete. 2024-09-21T06:45:23.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:45:22 smithi018 ceph-mon[34477]: pgmap v600: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T06:45:23.995 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:45:24.254 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:45:24.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.767+0000 7fcdd27b0640 1 -- 172.21.15.7:0/3088541352 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcdcc1094b0 msgr2=0x7fcdcc1098c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:24.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.767+0000 7fcdd27b0640 1 --2- 172.21.15.7:0/3088541352 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcdcc1094b0 0x7fcdcc1098c0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7fcdb4009900 tx=0x7fcdb402a3f0 comp rx=0 tx=0).stop 2024-09-21T06:45:24.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.767+0000 7fcdd27b0640 1 -- 172.21.15.7:0/3088541352 shutdown_connections 2024-09-21T06:45:24.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.767+0000 7fcdd27b0640 1 --2- 172.21.15.7:0/3088541352 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcdcc109e00 0x7fcdcc110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:24.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.767+0000 7fcdd27b0640 1 --2- 172.21.15.7:0/3088541352 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcdcc1094b0 0x7fcdcc1098c0 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:24.776 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.767+0000 7fcdd27b0640 1 --2- 172.21.15.7:0/3088541352 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcdcc103bc0 0x7fcdcc103fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:24.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.767+0000 7fcdd27b0640 1 -- 172.21.15.7:0/3088541352 >> 172.21.15.7:0/3088541352 conn(0x7fcdcc07b910 msgr2=0x7fcdcc07bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:24.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.767+0000 7fcdd27b0640 1 -- 172.21.15.7:0/3088541352 shutdown_connections 2024-09-21T06:45:24.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.767+0000 7fcdd27b0640 1 -- 172.21.15.7:0/3088541352 wait complete. 2024-09-21T06:45:24.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.768+0000 7fcdd27b0640 1 Processor -- start 2024-09-21T06:45:24.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.768+0000 7fcdd27b0640 1 -- start start 2024-09-21T06:45:24.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.769+0000 7fcdd27b0640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcdcc103bc0 0x7fcdcc19a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:24.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.769+0000 7fcdd27b0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcdcc1094b0 0x7fcdcc19aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:24.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.769+0000 7fcdd27b0640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcdcc109e00 0x7fcdcc19fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:24.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.769+0000 7fcdd27b0640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fcdcc113ac0 con 0x7fcdcc103bc0 2024-09-21T06:45:24.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.769+0000 7fcdd27b0640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcdcc113940 con 0x7fcdcc1094b0 2024-09-21T06:45:24.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.769+0000 7fcdd27b0640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fcdcc113c40 con 0x7fcdcc109e00 2024-09-21T06:45:24.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.769+0000 7fcdcbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcdcc103bc0 0x7fcdcc19a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:24.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.769+0000 7fcdcbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcdcc103bc0 0x7fcdcc19a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43078/0 (socket says 172.21.15.7:43078) 2024-09-21T06:45:24.777 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.769+0000 7fcdcbfff640 1 -- 172.21.15.7:0/2890085547 learned_addr learned my addr 172.21.15.7:0/2890085547 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:24.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.769+0000 7fcdd0d4d640 1 --2- 172.21.15.7:0/2890085547 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcdcc109e00 0x7fcdcc19fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:24.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.769+0000 7fcdc3fff640 1 --2- 172.21.15.7:0/2890085547 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcdcc1094b0 0x7fcdcc19aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:24.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.769+0000 7fcdcbfff640 1 -- 172.21.15.7:0/2890085547 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcdcc109e00 msgr2=0x7fcdcc19fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:24.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.769+0000 7fcdcbfff640 1 --2- 172.21.15.7:0/2890085547 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcdcc109e00 0x7fcdcc19fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:24.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.769+0000 7fcdcbfff640 1 -- 172.21.15.7:0/2890085547 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcdcc1094b0 msgr2=0x7fcdcc19aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:24.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.769+0000 7fcdcbfff640 1 --2- 172.21.15.7:0/2890085547 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcdcc1094b0 0x7fcdcc19aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:24.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.769+0000 7fcdcbfff640 1 -- 172.21.15.7:0/2890085547 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdcc1a0340 con 0x7fcdcc103bc0 2024-09-21T06:45:24.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.769+0000 7fcdcbfff640 1 --2- 172.21.15.7:0/2890085547 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcdcc103bc0 0x7fcdcc19a490 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc00c920 tx=0x7fcdbc00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:24.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.769+0000 7fcdc9ffb640 1 -- 172.21.15.7:0/2890085547 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdbc007c70 con 0x7fcdcc103bc0 2024-09-21T06:45:24.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.769+0000 7fcdc9ffb640 1 -- 172.21.15.7:0/2890085547 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcdbc007e10 con 0x7fcdcc103bc0 2024-09-21T06:45:24.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.769+0000 7fcdd27b0640 1 -- 172.21.15.7:0/2890085547 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdcc1a0630 con 0x7fcdcc103bc0 2024-09-21T06:45:24.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.769+0000 7fcdc9ffb640 1 -- 172.21.15.7:0/2890085547 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdbc018820 con 0x7fcdcc103bc0 2024-09-21T06:45:24.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.770+0000 7fcdd27b0640 1 -- 172.21.15.7:0/2890085547 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdcc1a6e50 con 0x7fcdcc103bc0 2024-09-21T06:45:24.778 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.772+0000 7fcdd8d24740 1 Processor -- start 2024-09-21T06:45:24.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.772+0000 7fcdd8d24740 1 -- start start 2024-09-21T06:45:24.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.772+0000 7fcdd8d24740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b039926070 0x55b039ccd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:24.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.772+0000 7fcdd8d24740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0398fd1b0 0x55b039ccdbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:24.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.772+0000 7fcdd8d24740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b039905390 0x55b039cce120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:24.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.772+0000 7fcdd8d24740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55b039c43ea0 con 0x55b0398fd1b0 2024-09-21T06:45:24.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.772+0000 7fcdd8d24740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55b039c332d0 con 0x55b039926070 2024-09-21T06:45:24.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.772+0000 7fcdd8d24740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55b039c370e0 con 0x55b039905390 2024-09-21T06:45:24.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.773+0000 7fcdc3fff640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b039905390 0x55b039cce120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:24.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.773+0000 7fcdc3fff640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b039905390 0x55b039cce120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.7:47254/0 (socket says 172.21.15.7:47254) 2024-09-21T06:45:24.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.773+0000 7fcdc3fff640 1 -- 172.21.15.7:0/2880949813 learned_addr learned my addr 172.21.15.7:0/2880949813 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:24.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.773+0000 7fcdd0d4d640 1 --2- 172.21.15.7:0/2880949813 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b039926070 0x55b039ccd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:24.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.773+0000 7fcdc9ffb640 1 -- 172.21.15.7:0/2890085547 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7fcdbc0189c0 con 0x7fcdcc103bc0 2024-09-21T06:45:24.779 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.773+0000 7fcdcbfff640 1 --2- 172.21.15.7:0/2880949813 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0398fd1b0 0x55b039ccdbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:24.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.773+0000 7fcdc3fff640 1 -- 172.21.15.7:0/2880949813 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b039926070 msgr2=0x55b039ccd6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:24.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.773+0000 7fcdc3fff640 1 --2- 172.21.15.7:0/2880949813 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b039926070 0x55b039ccd6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:24.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.773+0000 7fcdc3fff640 1 -- 172.21.15.7:0/2880949813 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0398fd1b0 msgr2=0x55b039ccdbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:24.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.773+0000 7fcdc3fff640 1 --2- 172.21.15.7:0/2880949813 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0398fd1b0 0x55b039ccdbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:24.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.773+0000 7fcdc3fff640 1 -- 172.21.15.7:0/2880949813 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b039991650 con 0x55b039905390 2024-09-21T06:45:24.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.773+0000 7fcdd0d4d640 1 --2- 172.21.15.7:0/2880949813 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b039926070 0x55b039ccd6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:45:24.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.773+0000 7fcdc3fff640 1 --2- 172.21.15.7:0/2880949813 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b039905390 0x55b039cce120 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fcdb4000c00 tx=0x7fcdb4032c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d594891bbf1c61aa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:24.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.774+0000 7fcdc27fc640 1 -- 172.21.15.7:0/2880949813 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdb403f070 con 0x55b039905390 2024-09-21T06:45:24.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.774+0000 7fcdc27fc640 1 -- 172.21.15.7:0/2880949813 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcdb40316a0 con 0x55b039905390 2024-09-21T06:45:24.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.774+0000 7fcdc27fc640 1 -- 172.21.15.7:0/2880949813 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdb4035070 con 0x55b039905390 2024-09-21T06:45:24.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.774+0000 7fcdc9ffb640 1 --2- 172.21.15.7:0/2890085547 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fcdb80b6730 0x7fcdb80b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:24.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.774+0000 7fcdd0d4d640 1 --2- 172.21.15.7:0/2890085547 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fcdb80b6730 0x7fcdb80b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:24.780 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.774+0000 7fcdc9ffb640 1 -- 172.21.15.7:0/2890085547 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7fcdbc0e7870 con 0x7fcdcc103bc0 2024-09-21T06:45:24.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.775+0000 7fcdd8d24740 1 -- 172.21.15.7:0/2880949813 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b039905390 msgr2=0x55b039cce120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:24.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.775+0000 7fcdd0d4d640 1 --2- 172.21.15.7:0/2890085547 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fcdb80b6730 0x7fcdb80b8c40 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fcdc4005fd0 tx=0x7fcdc4009500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:24.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.775+0000 7fcdd8d24740 1 --2- 172.21.15.7:0/2880949813 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b039905390 0x55b039cce120 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fcdb4000c00 tx=0x7fcdb4032c30 comp rx=0 tx=0).stop 2024-09-21T06:45:24.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.775+0000 7fcdd8d24740 1 -- 172.21.15.7:0/2880949813 shutdown_connections 2024-09-21T06:45:24.784 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.775+0000 7fcdd8d24740 1 --2- 172.21.15.7:0/2880949813 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b039905390 0x55b039cce120 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:24.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.775+0000 7fcdd8d24740 1 --2- 172.21.15.7:0/2880949813 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0398fd1b0 0x55b039ccdbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:24.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.775+0000 7fcdd8d24740 1 --2- 172.21.15.7:0/2880949813 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b039926070 0x55b039ccd6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:24.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.775+0000 7fcdd8d24740 1 -- 172.21.15.7:0/2880949813 >> 172.21.15.7:0/2880949813 conn(0x55b03991a460 msgr2=0x55b039ccb590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:24.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.775+0000 7fcdd8d24740 1 -- 172.21.15.7:0/2880949813 shutdown_connections 2024-09-21T06:45:24.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.775+0000 7fcdd8d24740 1 -- 172.21.15.7:0/2880949813 wait complete. 2024-09-21T06:45:24.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.775+0000 7fcdd8d24740 1 -- start start 2024-09-21T06:45:24.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.776+0000 7fcdd8d24740 1 Processor -- start 2024-09-21T06:45:24.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.776+0000 7fcdd8d24740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0398fd1b0 0x55b039cd8d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:24.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.776+0000 7fcdd8d24740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b039905390 0x55b039cd92b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:24.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.776+0000 7fcdd8d24740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b039926070 0x55b039ce5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:24.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.776+0000 7fcdd8d24740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55b039a94700 con 0x55b0398fd1b0 2024-09-21T06:45:24.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.776+0000 7fcdd8d24740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55b039bce160 con 0x55b039905390 2024-09-21T06:45:24.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.776+0000 7fcdd8d24740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55b039cdbe20 con 0x55b039926070 2024-09-21T06:45:24.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.776+0000 7fcdd8d24740 10 client.0 _ll_register_callbacks cb 0x55b039be79e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:24.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.776+0000 7fcdcbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0398fd1b0 0x55b039cd8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:24.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.776+0000 7fcdcbfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0398fd1b0 0x55b039cd8d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43092/0 (socket says 172.21.15.7:43092) 2024-09-21T06:45:24.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.776+0000 7fcdcbfff640 1 -- 172.21.15.7:0/1952972408 learned_addr learned my addr 172.21.15.7:0/1952972408 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:24.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.776+0000 7fcdc3fff640 1 --2- 172.21.15.7:0/1952972408 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b039905390 0x55b039cd92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:24.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.776+0000 7fcdd0d4d640 1 --2- 172.21.15.7:0/1952972408 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b039926070 0x55b039ce5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:24.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.776+0000 7fcdcbfff640 1 -- 172.21.15.7:0/1952972408 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b039926070 msgr2=0x55b039ce5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:24.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.776+0000 7fcdcbfff640 1 --2- 172.21.15.7:0/1952972408 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b039926070 0x55b039ce5110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:24.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.777+0000 7fcdcbfff640 1 -- 172.21.15.7:0/1952972408 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b039905390 msgr2=0x55b039cd92b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:24.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.777+0000 7fcdcbfff640 1 --2- 172.21.15.7:0/1952972408 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b039905390 0x55b039cd92b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:24.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.777+0000 7fcdcbfff640 1 -- 172.21.15.7:0/1952972408 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b039bfbc90 con 0x55b0398fd1b0 2024-09-21T06:45:24.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.777+0000 7fcdd0d4d640 1 --2- 172.21.15.7:0/1952972408 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b039926070 0x55b039ce5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:45:24.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.777+0000 7fcdc3fff640 1 --2- 172.21.15.7:0/1952972408 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b039905390 0x55b039cd92b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:45:24.786 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.777+0000 7fcdcbfff640 1 --2- 172.21.15.7:0/1952972408 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0398fd1b0 0x55b039cd8d70 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc007590 tx=0x7fcdbc0ad500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b29f118187f31858 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:24.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.777+0000 7fcdab7fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:45:24.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.777+0000 7fcdab7fe640 1 -- 172.21.15.7:0/1952972408 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdbc0ad240 con 0x55b0398fd1b0 2024-09-21T06:45:24.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.777+0000 7fcdab7fe640 1 -- 172.21.15.7:0/1952972408 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7fcdbc0ac990 con 0x55b0398fd1b0 2024-09-21T06:45:24.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.777+0000 7fcdd8d24740 1 -- 172.21.15.7:0/1952972408 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcdb40316a0 con 0x55b0398fd1b0 2024-09-21T06:45:24.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.777+0000 7fcdab7fe640 1 -- 172.21.15.7:0/1952972408 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fcdbc0ade30 con 0x55b0398fd1b0 2024-09-21T06:45:24.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.777+0000 7fcdd8d24740 10 client.17538 fetch_fsmap learned FSMap version 25 2024-09-21T06:45:24.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.777+0000 7fcdd8d24740 1 -- 172.21.15.7:0/1952972408 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b039ce7b90 con 0x55b0398fd1b0 2024-09-21T06:45:24.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.777+0000 7fcdab7fe640 1 -- 172.21.15.7:0/1952972408 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcdb40316a0 con 0x55b0398fd1b0 2024-09-21T06:45:24.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.778+0000 7fcdab7fe640 1 -- 172.21.15.7:0/1952972408 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fcdbc0ac490 con 0x55b0398fd1b0 2024-09-21T06:45:24.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.778+0000 7fcdd8d24740 10 client.17538 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:45:24.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.778+0000 7fcdd8d24740 10 client.17538 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:45:24.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.778+0000 7fcdd8d24740 20 client.17538 populate_metadata read hostname 'smithi007' 2024-09-21T06:45:24.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.778+0000 7fcdd8d24740 1 --2- 172.21.15.7:0/1952972408 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x55b0398e49f0 0x55b039ceb060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:24.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.778+0000 7fcdd8d24740 4 client.17538 mds_command: new command op to 24688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:45:24.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.778+0000 7fcdd8d24740 1 -- 172.21.15.7:0/1952972408 --> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b039c45df0 con 0x55b0398e49f0 2024-09-21T06:45:24.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.778+0000 7fcdc3fff640 1 --2- 172.21.15.7:0/1952972408 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x55b0398e49f0 0x55b039ceb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:24.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.779+0000 7fcdab7fe640 10 client.17538 ms_handle_connect on v2:172.21.15.144:6838/4027821922 2024-09-21T06:45:24.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.779+0000 7fcdc3fff640 1 --2- 172.21.15.7:0/1952972408 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x55b0398e49f0 0x55b039ceb060 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5a5b29c9c4bdd5ac server_cookie=906daca9df1146d5 in_seq=0 out_seq=0 2024-09-21T06:45:24.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.779+0000 7fcdab7fe640 1 -- 172.21.15.7:0/1952972408 <== mds.1 v2:172.21.15.144:6838/4027821922 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b039c45df0 con 0x55b0398e49f0 2024-09-21T06:45:24.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.779+0000 7fcdab7fe640 10 client.17538 handle_command_reply: tid=0 2024-09-21T06:45:24.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.779+0000 7fcdd8d24740 1 client.17538 shutdown 2024-09-21T06:45:24.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.780+0000 7fcdd8d24740 1 -- 172.21.15.7:0/1952972408 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0398fd1b0 msgr2=0x55b039cd8d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:24.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.780+0000 7fcdd8d24740 1 --2- 172.21.15.7:0/1952972408 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0398fd1b0 0x55b039cd8d70 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc007590 tx=0x7fcdbc0ad500 comp rx=0 tx=0).stop 2024-09-21T06:45:24.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.780+0000 7fcdd8d24740 1 -- 172.21.15.7:0/1952972408 shutdown_connections 2024-09-21T06:45:24.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.780+0000 7fcdd8d24740 1 --2- 172.21.15.7:0/1952972408 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x55b0398e49f0 0x55b039ceb060 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:24.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.780+0000 7fcdd8d24740 1 --2- 172.21.15.7:0/1952972408 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b039926070 0x55b039ce5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:24.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.780+0000 7fcdd8d24740 1 --2- 172.21.15.7:0/1952972408 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b039905390 0x55b039cd92b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:24.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.780+0000 7fcdd8d24740 1 --2- 172.21.15.7:0/1952972408 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b0398fd1b0 0x55b039cd8d70 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:24.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.780+0000 7fcdd8d24740 1 -- 172.21.15.7:0/1952972408 >> 172.21.15.7:0/1952972408 conn(0x55b03991a460 msgr2=0x55b039cd0880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:24.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.780+0000 7fcdab7fe640 0 client.17538 ms_handle_reset on v2:172.21.15.144:6838/4027821922 2024-09-21T06:45:24.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.780+0000 7fcdd8d24740 1 -- 172.21.15.7:0/1952972408 shutdown_connections 2024-09-21T06:45:24.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.780+0000 7fcdd8d24740 1 -- 172.21.15.7:0/1952972408 wait complete. 2024-09-21T06:45:24.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.780+0000 7fcdd8d24740 20 client.17538 trim_cache size 0 max 16384 2024-09-21T06:45:24.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.794+0000 7fcdd8d24740 1 Processor -- start 2024-09-21T06:45:24.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.794+0000 7fcdd8d24740 1 -- start start 2024-09-21T06:45:24.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.794+0000 7fcdd8d24740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b0398fd1b0 0x55b039ccede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:24.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.794+0000 7fcdd8d24740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b039905390 0x55b039ccabc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:24.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.794+0000 7fcdd8d24740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b039926070 0x55b039ccb100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:24.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.794+0000 7fcdd8d24740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fcdcc1b1c80 con 0x55b039926070 2024-09-21T06:45:24.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.794+0000 7fcdd8d24740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcdcc1af550 con 0x55b0398fd1b0 2024-09-21T06:45:24.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.794+0000 7fcdd8d24740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fcdcc1ad3c0 con 0x55b039905390 2024-09-21T06:45:24.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.794+0000 7fcdd0d4d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b039926070 0x55b039ccb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:24.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.794+0000 7fcdd0d4d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b039926070 0x55b039ccb100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43106/0 (socket says 172.21.15.7:43106) 2024-09-21T06:45:24.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.794+0000 7fcdd0d4d640 1 -- 172.21.15.7:0/2782306944 learned_addr learned my addr 172.21.15.7:0/2782306944 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:24.797 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.794+0000 7fcdc3fff640 1 --2- 172.21.15.7:0/2782306944 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b039905390 0x55b039ccabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:24.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.794+0000 7fcdcbfff640 1 --2- 172.21.15.7:0/2782306944 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b0398fd1b0 0x55b039ccede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:24.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.794+0000 7fcdd0d4d640 1 -- 172.21.15.7:0/2782306944 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b039905390 msgr2=0x55b039ccabc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:24.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.794+0000 7fcdd0d4d640 1 --2- 172.21.15.7:0/2782306944 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b039905390 0x55b039ccabc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:24.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.795+0000 7fcdd0d4d640 1 -- 172.21.15.7:0/2782306944 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b0398fd1b0 msgr2=0x55b039ccede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:24.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.795+0000 7fcdd0d4d640 1 --2- 172.21.15.7:0/2782306944 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b0398fd1b0 0x55b039ccede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:24.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.795+0000 7fcdd0d4d640 1 -- 172.21.15.7:0/2782306944 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b0398e4c20 con 0x55b039926070 2024-09-21T06:45:24.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.795+0000 7fcdcbfff640 1 --2- 172.21.15.7:0/2782306944 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b0398fd1b0 0x55b039ccede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:24.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.795+0000 7fcdc3fff640 1 --2- 172.21.15.7:0/2782306944 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b039905390 0x55b039ccabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:24.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.795+0000 7fcdd0d4d640 1 --2- 172.21.15.7:0/2782306944 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b039926070 0x55b039ccb100 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fcdc40108a0 tx=0x7fcdc4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bad4dc76ee5b6c3b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:24.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.795+0000 7fcdc1ffb640 1 -- 172.21.15.7:0/2782306944 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc402c070 con 0x55b039926070 2024-09-21T06:45:24.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.795+0000 7fcdc1ffb640 1 -- 172.21.15.7:0/2782306944 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcdc4010e20 con 0x55b039926070 2024-09-21T06:45:24.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.795+0000 7fcdc1ffb640 1 -- 172.21.15.7:0/2782306944 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc4027800 con 0x55b039926070 2024-09-21T06:45:24.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.796+0000 7fcdd8d24740 1 -- 172.21.15.7:0/2782306944 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b039926070 msgr2=0x55b039ccb100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:24.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.796+0000 7fcdd8d24740 1 --2- 172.21.15.7:0/2782306944 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b039926070 0x55b039ccb100 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fcdc40108a0 tx=0x7fcdc4016000 comp rx=0 tx=0).stop 2024-09-21T06:45:24.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.796+0000 7fcdd8d24740 1 -- 172.21.15.7:0/2782306944 shutdown_connections 2024-09-21T06:45:24.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.796+0000 7fcdd8d24740 1 --2- 172.21.15.7:0/2782306944 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b039926070 0x55b039ccb100 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:24.802 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.796+0000 7fcdd8d24740 1 --2- 172.21.15.7:0/2782306944 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b039905390 0x55b039ccabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:24.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.796+0000 7fcdd8d24740 1 --2- 172.21.15.7:0/2782306944 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b0398fd1b0 0x55b039ccede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:24.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.796+0000 7fcdd8d24740 1 -- 172.21.15.7:0/2782306944 >> 172.21.15.7:0/2782306944 conn(0x55b03991a460 msgr2=0x55b039cce6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:24.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.796+0000 7fcdd8d24740 1 -- 172.21.15.7:0/2782306944 shutdown_connections 2024-09-21T06:45:24.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.796+0000 7fcdd8d24740 1 -- 172.21.15.7:0/2782306944 wait complete. 2024-09-21T06:45:24.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.796+0000 7fcdd8d24740 1 -- start start 2024-09-21T06:45:24.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.796+0000 7fcdd8d24740 1 Processor -- start 2024-09-21T06:45:24.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.797+0000 7fcdd8d24740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b0398fd1b0 0x55b039cdd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:24.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.797+0000 7fcdd8d24740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b039905390 0x55b039cdd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:24.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.797+0000 7fcdd8d24740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b039926070 0x55b039cddb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:24.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.797+0000 7fcdd8d24740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fcdcc1ada10 con 0x55b039905390 2024-09-21T06:45:24.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.797+0000 7fcdd8d24740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcdcc1aee80 con 0x55b039926070 2024-09-21T06:45:24.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.797+0000 7fcdd8d24740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fcdcc1ae0e0 con 0x55b0398fd1b0 2024-09-21T06:45:24.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.797+0000 7fcdc3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b039905390 0x55b039cdd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:24.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.797+0000 7fcdd8d24740 10 client.0 _ll_register_callbacks cb 0x7fcdbc00fd60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:24.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.797+0000 7fcdc3fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b039905390 0x55b039cdd5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43116/0 (socket says 172.21.15.7:43116) 2024-09-21T06:45:24.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.797+0000 7fcdc3fff640 1 -- 172.21.15.7:0/2540905396 learned_addr learned my addr 172.21.15.7:0/2540905396 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:24.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.797+0000 7fcdd0d4d640 1 --2- 172.21.15.7:0/2540905396 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b039926070 0x55b039cddb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:24.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.797+0000 7fcdcbfff640 1 --2- 172.21.15.7:0/2540905396 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b0398fd1b0 0x55b039cdd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:24.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.797+0000 7fcdc3fff640 1 -- 172.21.15.7:0/2540905396 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b0398fd1b0 msgr2=0x55b039cdd0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:24.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.797+0000 7fcdc3fff640 1 --2- 172.21.15.7:0/2540905396 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b0398fd1b0 0x55b039cdd0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:24.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.797+0000 7fcdc3fff640 1 -- 172.21.15.7:0/2540905396 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b039926070 msgr2=0x55b039cddb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:24.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.797+0000 7fcdc3fff640 1 --2- 172.21.15.7:0/2540905396 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b039926070 0x55b039cddb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:24.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.797+0000 7fcdc3fff640 1 -- 172.21.15.7:0/2540905396 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b039d54a30 con 0x55b039905390 2024-09-21T06:45:24.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.797+0000 7fcdcbfff640 1 --2- 172.21.15.7:0/2540905396 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b0398fd1b0 0x55b039cdd0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:24.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.798+0000 7fcdc3fff640 1 --2- 172.21.15.7:0/2540905396 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b039905390 0x55b039cdd5e0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7fcdb402a910 tx=0x7fcdb4032bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3be929d9a20534d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:24.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.798+0000 7fcdab7fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:45:24.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.798+0000 7fcdab7fe640 1 -- 172.21.15.7:0/2540905396 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdb403f040 con 0x55b039905390 2024-09-21T06:45:24.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.798+0000 7fcdab7fe640 1 -- 172.21.15.7:0/2540905396 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7fcdb4004040 con 0x55b039905390 2024-09-21T06:45:24.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.798+0000 7fcdd8d24740 1 -- 172.21.15.7:0/2540905396 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcdc4010e20 con 0x55b039905390 2024-09-21T06:45:24.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.798+0000 7fcdab7fe640 1 -- 172.21.15.7:0/2540905396 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fcdb405d050 con 0x55b039905390 2024-09-21T06:45:24.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.798+0000 7fcdd8d24740 10 client.17544 fetch_fsmap learned FSMap version 25 2024-09-21T06:45:24.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.798+0000 7fcdd8d24740 1 -- 172.21.15.7:0/2540905396 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b039d55cb0 con 0x55b039905390 2024-09-21T06:45:24.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.798+0000 7fcdab7fe640 1 -- 172.21.15.7:0/2540905396 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcdc4010e20 con 0x55b039905390 2024-09-21T06:45:24.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.798+0000 7fcdab7fe640 1 -- 172.21.15.7:0/2540905396 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fcdb403b430 con 0x55b039905390 2024-09-21T06:45:24.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.798+0000 7fcdd8d24740 10 client.17544 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:45:24.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.798+0000 7fcdd8d24740 10 client.17544 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:45:24.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.798+0000 7fcdd8d24740 20 client.17544 populate_metadata read hostname 'smithi007' 2024-09-21T06:45:24.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.798+0000 7fcdd8d24740 1 --2- 172.21.15.7:0/2540905396 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x55b0398b9da0 0x55b039d58050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:24.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.798+0000 7fcdd8d24740 4 client.17544 mds_command: new command op to 24688 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:45:24.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.798+0000 7fcdd8d24740 1 -- 172.21.15.7:0/2540905396 --> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b039c418a0 con 0x55b0398b9da0 2024-09-21T06:45:24.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.799+0000 7fcdcbfff640 1 --2- 172.21.15.7:0/2540905396 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x55b0398b9da0 0x55b039d58050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:24.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.799+0000 7fcdab7fe640 10 client.17544 ms_handle_connect on v2:172.21.15.144:6838/4027821922 2024-09-21T06:45:24.805 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.799+0000 7fcdcbfff640 1 --2- 172.21.15.7:0/2540905396 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x55b0398b9da0 0x55b039d58050 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2601a9ed56700fca server_cookie=4a23f2675370196b in_seq=0 out_seq=0 2024-09-21T06:45:24.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.799+0000 7fcdab7fe640 1 -- 172.21.15.7:0/2540905396 <== mds.1 v2:172.21.15.144:6838/4027821922 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b039c418a0 con 0x55b0398b9da0 2024-09-21T06:45:24.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.799+0000 7fcdab7fe640 10 client.17544 handle_command_reply: tid=0 2024-09-21T06:45:24.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.799+0000 7fcdd8d24740 1 client.17544 shutdown 2024-09-21T06:45:24.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.800+0000 7fcdd8d24740 1 -- 172.21.15.7:0/2540905396 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b039905390 msgr2=0x55b039cdd5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:24.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.800+0000 7fcdd8d24740 1 --2- 172.21.15.7:0/2540905396 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b039905390 0x55b039cdd5e0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7fcdb402a910 tx=0x7fcdb4032bb0 comp rx=0 tx=0).stop 2024-09-21T06:45:24.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.800+0000 7fcdd8d24740 1 -- 172.21.15.7:0/2540905396 shutdown_connections 2024-09-21T06:45:24.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.800+0000 7fcdd8d24740 1 --2- 172.21.15.7:0/2540905396 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x55b0398b9da0 0x55b039d58050 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:24.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.800+0000 7fcdd8d24740 1 --2- 172.21.15.7:0/2540905396 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b039926070 0x55b039cddb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:24.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.800+0000 7fcdd8d24740 1 --2- 172.21.15.7:0/2540905396 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b039905390 0x55b039cdd5e0 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:24.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.800+0000 7fcdd8d24740 1 --2- 172.21.15.7:0/2540905396 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b0398fd1b0 0x55b039cdd0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:24.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.800+0000 7fcdd8d24740 1 -- 172.21.15.7:0/2540905396 >> 172.21.15.7:0/2540905396 conn(0x55b03991a460 msgr2=0x55b039cdaa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:24.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.800+0000 7fcdab7fe640 0 client.17544 ms_handle_reset on v2:172.21.15.144:6838/4027821922 2024-09-21T06:45:24.806 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.800+0000 7fcdd8d24740 1 -- 172.21.15.7:0/2540905396 shutdown_connections 2024-09-21T06:45:24.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.800+0000 7fcdd8d24740 1 -- 172.21.15.7:0/2540905396 wait complete. 2024-09-21T06:45:24.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.800+0000 7fcdd8d24740 20 client.17544 trim_cache size 0 max 16384 2024-09-21T06:45:24.807 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:45:24.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.800+0000 7fcdd27b0640 1 -- 172.21.15.7:0/2890085547 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fcdb80b6730 msgr2=0x7fcdb80b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:24.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.800+0000 7fcdd27b0640 1 --2- 172.21.15.7:0/2890085547 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fcdb80b6730 0x7fcdb80b8c40 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fcdc4005fd0 tx=0x7fcdc4009500 comp rx=0 tx=0).stop 2024-09-21T06:45:24.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.800+0000 7fcdd27b0640 1 -- 172.21.15.7:0/2890085547 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcdcc103bc0 msgr2=0x7fcdcc19a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:24.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.800+0000 7fcdd27b0640 1 --2- 172.21.15.7:0/2890085547 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcdcc103bc0 0x7fcdcc19a490 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc00c920 tx=0x7fcdbc00cde0 comp rx=0 tx=0).stop 2024-09-21T06:45:24.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.801+0000 7fcdd27b0640 1 -- 172.21.15.7:0/2890085547 shutdown_connections 2024-09-21T06:45:24.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.801+0000 7fcdd27b0640 1 --2- 172.21.15.7:0/2890085547 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fcdb80b6730 0x7fcdb80b8c40 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:24.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.801+0000 7fcdd27b0640 1 --2- 172.21.15.7:0/2890085547 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fcdcc109e00 0x7fcdcc19fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:24.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.801+0000 7fcdd27b0640 1 --2- 172.21.15.7:0/2890085547 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcdcc1094b0 0x7fcdcc19aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:24.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.801+0000 7fcdd27b0640 1 --2- 172.21.15.7:0/2890085547 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fcdcc103bc0 0x7fcdcc19a490 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:24.808 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.801+0000 7fcdd27b0640 1 -- 172.21.15.7:0/2890085547 >> 172.21.15.7:0/2890085547 conn(0x7fcdcc07b910 msgr2=0x7fcdcc1075a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:24.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.801+0000 7fcdd27b0640 1 -- 172.21.15.7:0/2890085547 shutdown_connections 2024-09-21T06:45:24.809 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:24.801+0000 7fcdd27b0640 1 -- 172.21.15.7:0/2890085547 wait complete. 2024-09-21T06:45:25.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:45:24 smithi007 ceph-mon[30983]: pgmap v601: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T06:45:25.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:45:24 smithi144 ceph-mon[34653]: pgmap v601: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T06:45:25.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:45:24 smithi018 ceph-mon[34477]: pgmap v601: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T06:45:25.555 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:45:25.815 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:45:26.337 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.329+0000 7f8dc9313640 1 -- 172.21.15.7:0/2151347692 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8dc4102090 msgr2=0x7f8dc41024a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:26.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.329+0000 7f8dc9313640 1 --2- 172.21.15.7:0/2151347692 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8dc4102090 0x7f8dc41024a0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f8db4009900 tx=0x7f8db402a410 comp rx=0 tx=0).stop 2024-09-21T06:45:26.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.329+0000 7f8dc9313640 1 -- 172.21.15.7:0/2151347692 shutdown_connections 2024-09-21T06:45:26.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.329+0000 7f8dc9313640 1 --2- 172.21.15.7:0/2151347692 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8dc4106bd0 0x7f8dc4110660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:26.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.329+0000 7f8dc9313640 1 --2- 172.21.15.7:0/2151347692 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8dc4106280 0x7f8dc4106690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:26.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.329+0000 7f8dc9313640 1 --2- 172.21.15.7:0/2151347692 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8dc4102090 0x7f8dc41024a0 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:26.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.329+0000 7f8dc9313640 1 -- 172.21.15.7:0/2151347692 >> 172.21.15.7:0/2151347692 conn(0x7f8dc4077c90 msgr2=0x7f8dc40780d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:26.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.329+0000 7f8dc9313640 1 -- 172.21.15.7:0/2151347692 shutdown_connections 2024-09-21T06:45:26.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.329+0000 7f8dc9313640 1 -- 172.21.15.7:0/2151347692 wait complete. 2024-09-21T06:45:26.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.329+0000 7f8dc9313640 1 Processor -- start 2024-09-21T06:45:26.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.330+0000 7f8dc9313640 1 -- start start 2024-09-21T06:45:26.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.330+0000 7f8dc9313640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8dc4102090 0x7f8dc419a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:26.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.330+0000 7f8dc9313640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8dc4106280 0x7f8dc419aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:26.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.330+0000 7f8dc9313640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8dc4106bd0 0x7f8dc419fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:26.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.330+0000 7f8dc9313640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8dc4113aa0 con 0x7f8dc4106280 2024-09-21T06:45:26.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.330+0000 7f8dc9313640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8dc4113920 con 0x7f8dc4102090 2024-09-21T06:45:26.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.330+0000 7f8dc9313640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8dc4113c20 con 0x7f8dc4106bd0 2024-09-21T06:45:26.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.330+0000 7f8dc27fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8dc4106280 0x7f8dc419aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:26.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.330+0000 7f8dc27fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8dc4106280 0x7f8dc419aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43140/0 (socket says 172.21.15.7:43140) 2024-09-21T06:45:26.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.330+0000 7f8dc27fc640 1 -- 172.21.15.7:0/1359617585 learned_addr learned my addr 172.21.15.7:0/1359617585 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:26.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.330+0000 7f8dc2ffd640 1 --2- 172.21.15.7:0/1359617585 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8dc4102090 0x7f8dc419a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:26.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.330+0000 7f8dc37fe640 1 --2- 172.21.15.7:0/1359617585 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8dc4106bd0 0x7f8dc419fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:26.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.330+0000 7f8dc27fc640 1 -- 172.21.15.7:0/1359617585 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8dc4106bd0 msgr2=0x7f8dc419fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:26.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.330+0000 7f8dc27fc640 1 --2- 172.21.15.7:0/1359617585 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8dc4106bd0 0x7f8dc419fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:26.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.330+0000 7f8dc27fc640 1 -- 172.21.15.7:0/1359617585 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8dc4102090 msgr2=0x7f8dc419a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:26.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.330+0000 7f8dc27fc640 1 --2- 172.21.15.7:0/1359617585 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8dc4102090 0x7f8dc419a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:26.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.330+0000 7f8dc27fc640 1 -- 172.21.15.7:0/1359617585 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dc41a04c0 con 0x7f8dc4106280 2024-09-21T06:45:26.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.331+0000 7f8dc27fc640 1 --2- 172.21.15.7:0/1359617585 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8dc4106280 0x7f8dc419aaf0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f8db800ea50 tx=0x7f8db800ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:26.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.331+0000 7f8dabfff640 1 -- 172.21.15.7:0/1359617585 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8db800cdc0 con 0x7f8dc4106280 2024-09-21T06:45:26.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.331+0000 7f8dabfff640 1 -- 172.21.15.7:0/1359617585 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8db8011920 con 0x7f8dc4106280 2024-09-21T06:45:26.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.331+0000 7f8dc9313640 1 -- 172.21.15.7:0/1359617585 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8dc41a07b0 con 0x7f8dc4106280 2024-09-21T06:45:26.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.331+0000 7f8dabfff640 1 -- 172.21.15.7:0/1359617585 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8db801aa60 con 0x7f8dc4106280 2024-09-21T06:45:26.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.331+0000 7f8dc9313640 1 -- 172.21.15.7:0/1359617585 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8dc41a6f10 con 0x7f8dc4106280 2024-09-21T06:45:26.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.333+0000 7f8dcf887740 1 Processor -- start 2024-09-21T06:45:26.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.333+0000 7f8dcf887740 1 -- start start 2024-09-21T06:45:26.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.334+0000 7f8dcf887740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df0578a070 0x55df05b316a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:26.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.334+0000 7f8dcf887740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df057611b0 0x55df05b31be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:26.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.334+0000 7f8dcf887740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55df05769390 0x55df05b32120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:26.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.334+0000 7f8dcf887740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55df05aa7ea0 con 0x55df0578a070 2024-09-21T06:45:26.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.334+0000 7f8dcf887740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55df05a972d0 con 0x55df057611b0 2024-09-21T06:45:26.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.334+0000 7f8dcf887740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55df05a9b0e0 con 0x55df05769390 2024-09-21T06:45:26.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.334+0000 7f8dc37fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df0578a070 0x55df05b316a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:26.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.334+0000 7f8dc37fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df0578a070 0x55df05b316a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43142/0 (socket says 172.21.15.7:43142) 2024-09-21T06:45:26.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.334+0000 7f8dc37fe640 1 -- 172.21.15.7:0/1152228887 learned_addr learned my addr 172.21.15.7:0/1152228887 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:26.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.334+0000 7f8dabfff640 1 -- 172.21.15.7:0/1359617585 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f8db801ac00 con 0x7f8dc4106280 2024-09-21T06:45:26.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.334+0000 7f8dc2ffd640 1 --2- 172.21.15.7:0/1152228887 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df057611b0 0x55df05b31be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:26.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.334+0000 7f8dc37fe640 1 -- 172.21.15.7:0/1152228887 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55df05769390 msgr2=0x55df05b32120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:26.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.334+0000 7f8dc37fe640 1 --2- 172.21.15.7:0/1152228887 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55df05769390 0x55df05b32120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:26.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.334+0000 7f8dc37fe640 1 -- 172.21.15.7:0/1152228887 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df057611b0 msgr2=0x55df05b31be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:26.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.334+0000 7f8dc37fe640 1 --2- 172.21.15.7:0/1152228887 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df057611b0 0x55df05b31be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:26.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.334+0000 7f8dc37fe640 1 -- 172.21.15.7:0/1152228887 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df057f5650 con 0x55df0578a070 2024-09-21T06:45:26.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.334+0000 7f8dc2ffd640 1 --2- 172.21.15.7:0/1152228887 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df057611b0 0x55df05b31be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:45:26.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.334+0000 7f8dc37fe640 1 --2- 172.21.15.7:0/1152228887 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df0578a070 0x55df05b316a0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc00bbd0 tx=0x7f8dbc00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f7f917fc255e725 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:26.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.335+0000 7f8da97fa640 1 -- 172.21.15.7:0/1152228887 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dbc015070 con 0x55df0578a070 2024-09-21T06:45:26.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.335+0000 7f8da97fa640 1 -- 172.21.15.7:0/1152228887 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8dbc0054d0 con 0x55df0578a070 2024-09-21T06:45:26.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.335+0000 7f8da97fa640 1 -- 172.21.15.7:0/1152228887 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dbc011440 con 0x55df0578a070 2024-09-21T06:45:26.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.335+0000 7f8dabfff640 1 --2- 172.21.15.7:0/1359617585 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f8dac0b6680 0x7f8dac0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:26.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.335+0000 7f8dc2ffd640 1 --2- 172.21.15.7:0/1359617585 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f8dac0b6680 0x7f8dac0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:26.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.335+0000 7f8dabfff640 1 -- 172.21.15.7:0/1359617585 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7f8db80e7be0 con 0x7f8dc4106280 2024-09-21T06:45:26.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.335+0000 7f8dcf887740 1 -- 172.21.15.7:0/1152228887 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df0578a070 msgr2=0x55df05b316a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:26.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.335+0000 7f8dcf887740 1 --2- 172.21.15.7:0/1152228887 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df0578a070 0x55df05b316a0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc00bbd0 tx=0x7f8dbc00f730 comp rx=0 tx=0).stop 2024-09-21T06:45:26.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.336+0000 7f8dc2ffd640 1 --2- 172.21.15.7:0/1359617585 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f8dac0b6680 0x7f8dac0b8b90 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8db4004770 tx=0x7f8db40058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:26.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.336+0000 7f8dcf887740 1 -- 172.21.15.7:0/1152228887 shutdown_connections 2024-09-21T06:45:26.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.336+0000 7f8dcf887740 1 --2- 172.21.15.7:0/1152228887 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55df05769390 0x55df05b32120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:26.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.336+0000 7f8dcf887740 1 --2- 172.21.15.7:0/1152228887 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df057611b0 0x55df05b31be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:26.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.336+0000 7f8dcf887740 1 --2- 172.21.15.7:0/1152228887 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df0578a070 0x55df05b316a0 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:26.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.336+0000 7f8dcf887740 1 -- 172.21.15.7:0/1152228887 >> 172.21.15.7:0/1152228887 conn(0x55df0577e460 msgr2=0x55df05b2f590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:26.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.336+0000 7f8dcf887740 1 -- 172.21.15.7:0/1152228887 shutdown_connections 2024-09-21T06:45:26.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.336+0000 7f8dcf887740 1 -- 172.21.15.7:0/1152228887 wait complete. 2024-09-21T06:45:26.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.336+0000 7f8dcf887740 1 -- start start 2024-09-21T06:45:26.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.336+0000 7f8dcf887740 1 Processor -- start 2024-09-21T06:45:26.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.336+0000 7f8dcf887740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df057611b0 0x55df05b41190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:26.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.336+0000 7f8dcf887740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df05769390 0x55df05b416d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:26.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.337+0000 7f8dcf887740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55df0578a070 0x55df05b4d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:26.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.337+0000 7f8dcf887740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55df058f8700 con 0x55df05769390 2024-09-21T06:45:26.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.337+0000 7f8dcf887740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55df05a32160 con 0x55df057611b0 2024-09-21T06:45:26.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.337+0000 7f8dcf887740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55df05b441b0 con 0x55df0578a070 2024-09-21T06:45:26.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.337+0000 7f8dcf887740 10 client.0 _ll_register_callbacks cb 0x55df05a4b9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:26.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.337+0000 7f8dc27fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df05769390 0x55df05b416d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:26.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.337+0000 7f8dc27fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df05769390 0x55df05b416d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43152/0 (socket says 172.21.15.7:43152) 2024-09-21T06:45:26.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.337+0000 7f8dc27fc640 1 -- 172.21.15.7:0/1344395476 learned_addr learned my addr 172.21.15.7:0/1344395476 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:26.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.337+0000 7f8dc37fe640 1 --2- 172.21.15.7:0/1344395476 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55df0578a070 0x55df05b4d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:26.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.337+0000 7f8dc2ffd640 1 --2- 172.21.15.7:0/1344395476 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df057611b0 0x55df05b41190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:26.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.337+0000 7f8dc27fc640 1 -- 172.21.15.7:0/1344395476 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55df0578a070 msgr2=0x55df05b4d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:26.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.337+0000 7f8dc27fc640 1 --2- 172.21.15.7:0/1344395476 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55df0578a070 0x55df05b4d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:26.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.337+0000 7f8dc27fc640 1 -- 172.21.15.7:0/1344395476 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df057611b0 msgr2=0x55df05b41190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:26.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.337+0000 7f8dc27fc640 1 --2- 172.21.15.7:0/1344395476 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df057611b0 0x55df05b41190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:26.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.337+0000 7f8dc27fc640 1 -- 172.21.15.7:0/1344395476 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df05a5fc90 con 0x55df05769390 2024-09-21T06:45:26.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.337+0000 7f8dc2ffd640 1 --2- 172.21.15.7:0/1344395476 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df057611b0 0x55df05b41190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:26.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.337+0000 7f8dc27fc640 1 --2- 172.21.15.7:0/1344395476 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df05769390 0x55df05b416d0 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f8db80ad7a0 tx=0x7f8db80ad930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10a6059444d8ed28 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:26.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.337+0000 7f8da6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:45:26.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.337+0000 7f8da6ff5640 1 -- 172.21.15.7:0/1344395476 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8db80a9210 con 0x55df05769390 2024-09-21T06:45:26.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.337+0000 7f8da6ff5640 1 -- 172.21.15.7:0/1344395476 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7f8db80b21d0 con 0x55df05769390 2024-09-21T06:45:26.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.337+0000 7f8dcf887740 1 -- 172.21.15.7:0/1344395476 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8dbc0054d0 con 0x55df05769390 2024-09-21T06:45:26.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.338+0000 7f8da6ff5640 1 -- 172.21.15.7:0/1344395476 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8db80ad5b0 con 0x55df05769390 2024-09-21T06:45:26.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.338+0000 7f8dcf887740 10 client.17556 fetch_fsmap learned FSMap version 25 2024-09-21T06:45:26.347 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.338+0000 7f8dcf887740 1 -- 172.21.15.7:0/1344395476 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55df05b4ff00 con 0x55df05769390 2024-09-21T06:45:26.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.338+0000 7f8da6ff5640 1 -- 172.21.15.7:0/1344395476 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8dbc0054d0 con 0x55df05769390 2024-09-21T06:45:26.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.338+0000 7f8da6ff5640 1 -- 172.21.15.7:0/1344395476 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f8db8022030 con 0x55df05769390 2024-09-21T06:45:26.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.338+0000 7f8dcf887740 10 client.17556 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:45:26.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.338+0000 7f8dcf887740 10 client.17556 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:45:26.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.338+0000 7f8dcf887740 20 client.17556 populate_metadata read hostname 'smithi007' 2024-09-21T06:45:26.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.338+0000 7f8dcf887740 1 --2- 172.21.15.7:0/1344395476 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55df057489f0 0x55df05b53340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:26.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.338+0000 7f8dcf887740 4 client.17556 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:45:26.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.338+0000 7f8dcf887740 1 -- 172.21.15.7:0/1344395476 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55df05aa9df0 con 0x55df057489f0 2024-09-21T06:45:26.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.338+0000 7f8dc2ffd640 1 --2- 172.21.15.7:0/1344395476 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55df057489f0 0x55df05b53340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:26.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.339+0000 7f8da6ff5640 10 client.17556 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:45:26.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.339+0000 7f8dc2ffd640 1 --2- 172.21.15.7:0/1344395476 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55df057489f0 0x55df05b53340 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=63a6051bc29c3ae8 server_cookie=5b9a905d128ef817 in_seq=0 out_seq=0 2024-09-21T06:45:26.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.340+0000 7f8da6ff5640 1 -- 172.21.15.7:0/1344395476 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55df05aa9df0 con 0x55df057489f0 2024-09-21T06:45:26.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.340+0000 7f8da6ff5640 10 client.17556 handle_command_reply: tid=0 2024-09-21T06:45:26.348 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.340+0000 7f8dcf887740 1 client.17556 shutdown 2024-09-21T06:45:26.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.340+0000 7f8dcf887740 1 -- 172.21.15.7:0/1344395476 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df05769390 msgr2=0x55df05b416d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:26.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.340+0000 7f8dcf887740 1 --2- 172.21.15.7:0/1344395476 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df05769390 0x55df05b416d0 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f8db80ad7a0 tx=0x7f8db80ad930 comp rx=0 tx=0).stop 2024-09-21T06:45:26.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.340+0000 7f8dcf887740 1 -- 172.21.15.7:0/1344395476 shutdown_connections 2024-09-21T06:45:26.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.340+0000 7f8dcf887740 1 --2- 172.21.15.7:0/1344395476 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55df057489f0 0x55df05b53340 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:26.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.340+0000 7f8dcf887740 1 --2- 172.21.15.7:0/1344395476 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55df0578a070 0x55df05b4d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:26.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.340+0000 7f8dcf887740 1 --2- 172.21.15.7:0/1344395476 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df05769390 0x55df05b416d0 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:26.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.340+0000 7f8dcf887740 1 --2- 172.21.15.7:0/1344395476 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df057611b0 0x55df05b41190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:26.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.340+0000 7f8dcf887740 1 -- 172.21.15.7:0/1344395476 >> 172.21.15.7:0/1344395476 conn(0x55df0577e460 msgr2=0x55df05b34830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:26.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.340+0000 7f8da6ff5640 0 client.17556 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:45:26.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.340+0000 7f8dcf887740 1 -- 172.21.15.7:0/1344395476 shutdown_connections 2024-09-21T06:45:26.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.340+0000 7f8dcf887740 1 -- 172.21.15.7:0/1344395476 wait complete. 2024-09-21T06:45:26.349 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.340+0000 7f8dcf887740 20 client.17556 trim_cache size 0 max 16384 2024-09-21T06:45:26.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.353+0000 7f8dcf887740 1 Processor -- start 2024-09-21T06:45:26.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.353+0000 7f8dcf887740 1 -- start start 2024-09-21T06:45:26.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.353+0000 7f8dcf887740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55df057611b0 0x55df05b43070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:26.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.353+0000 7f8dcf887740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df05769390 0x55df05b32de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:26.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.353+0000 7f8dcf887740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df0578a070 0x55df05b4d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:26.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.353+0000 7f8dcf887740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8dc41afcc0 con 0x55df0578a070 2024-09-21T06:45:26.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.353+0000 7f8dcf887740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8dc41ad590 con 0x55df05769390 2024-09-21T06:45:26.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.353+0000 7f8dcf887740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8dc41ab420 con 0x55df057611b0 2024-09-21T06:45:26.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.354+0000 7f8dc37fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df0578a070 0x55df05b4d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:26.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.354+0000 7f8dc37fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df0578a070 0x55df05b4d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43164/0 (socket says 172.21.15.7:43164) 2024-09-21T06:45:26.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.354+0000 7f8dc37fe640 1 -- 172.21.15.7:0/1001683500 learned_addr learned my addr 172.21.15.7:0/1001683500 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:26.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.354+0000 7f8dc27fc640 1 --2- 172.21.15.7:0/1001683500 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df05769390 0x55df05b32de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:26.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.354+0000 7f8dc2ffd640 1 --2- 172.21.15.7:0/1001683500 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55df057611b0 0x55df05b43070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:26.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.354+0000 7f8dc37fe640 1 -- 172.21.15.7:0/1001683500 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55df057611b0 msgr2=0x55df05b43070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:26.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.354+0000 7f8dc37fe640 1 --2- 172.21.15.7:0/1001683500 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55df057611b0 0x55df05b43070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:26.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.354+0000 7f8dc37fe640 1 -- 172.21.15.7:0/1001683500 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df05769390 msgr2=0x55df05b32de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:26.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.354+0000 7f8dc37fe640 1 --2- 172.21.15.7:0/1001683500 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df05769390 0x55df05b32de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:26.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.354+0000 7f8dc37fe640 1 -- 172.21.15.7:0/1001683500 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df05748c20 con 0x55df0578a070 2024-09-21T06:45:26.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.354+0000 7f8dc37fe640 1 --2- 172.21.15.7:0/1001683500 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df0578a070 0x55df05b4d440 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc00bac0 tx=0x7f8dbc00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa80b24ac473bdc5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:26.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.354+0000 7f8da8ff9640 1 -- 172.21.15.7:0/1001683500 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dbc015050 con 0x55df0578a070 2024-09-21T06:45:26.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.354+0000 7f8da8ff9640 1 -- 172.21.15.7:0/1001683500 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8dbc029070 con 0x55df0578a070 2024-09-21T06:45:26.358 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.354+0000 7f8da8ff9640 1 -- 172.21.15.7:0/1001683500 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dbc011440 con 0x55df0578a070 2024-09-21T06:45:26.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.355+0000 7f8dcf887740 1 -- 172.21.15.7:0/1001683500 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df0578a070 msgr2=0x55df05b4d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:26.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.355+0000 7f8dcf887740 1 --2- 172.21.15.7:0/1001683500 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df0578a070 0x55df05b4d440 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc00bac0 tx=0x7f8dbc00bd70 comp rx=0 tx=0).stop 2024-09-21T06:45:26.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.355+0000 7f8dcf887740 1 -- 172.21.15.7:0/1001683500 shutdown_connections 2024-09-21T06:45:26.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.355+0000 7f8dcf887740 1 --2- 172.21.15.7:0/1001683500 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df0578a070 0x55df05b4d440 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:26.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.355+0000 7f8dcf887740 1 --2- 172.21.15.7:0/1001683500 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df05769390 0x55df05b32de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:26.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.355+0000 7f8dcf887740 1 --2- 172.21.15.7:0/1001683500 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55df057611b0 0x55df05b43070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:26.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.355+0000 7f8dcf887740 1 -- 172.21.15.7:0/1001683500 >> 172.21.15.7:0/1001683500 conn(0x55df0577e460 msgr2=0x55df05b326d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:26.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.355+0000 7f8dcf887740 1 -- 172.21.15.7:0/1001683500 shutdown_connections 2024-09-21T06:45:26.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.355+0000 7f8dcf887740 1 -- 172.21.15.7:0/1001683500 wait complete. 2024-09-21T06:45:26.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.356+0000 7f8dcf887740 1 -- start start 2024-09-21T06:45:26.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.356+0000 7f8dcf887740 1 Processor -- start 2024-09-21T06:45:26.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.356+0000 7f8dcf887740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55df057611b0 0x55df05b455c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:26.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.356+0000 7f8dcf887740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df05769390 0x55df05b45b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:26.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.356+0000 7f8dcf887740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df0578a070 0x55df05b46040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:26.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.356+0000 7f8dcf887740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8dc41aba70 con 0x55df0578a070 2024-09-21T06:45:26.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.356+0000 7f8dcf887740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8dc41acec0 con 0x55df05769390 2024-09-21T06:45:26.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.356+0000 7f8dcf887740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8dc41ac120 con 0x55df057611b0 2024-09-21T06:45:26.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.356+0000 7f8dcf887740 10 client.0 _ll_register_callbacks cb 0x7f8db80a9940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:26.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.356+0000 7f8dc37fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df0578a070 0x55df05b46040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:26.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.356+0000 7f8dc37fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df0578a070 0x55df05b46040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43174/0 (socket says 172.21.15.7:43174) 2024-09-21T06:45:26.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.356+0000 7f8dc37fe640 1 -- 172.21.15.7:0/523423213 learned_addr learned my addr 172.21.15.7:0/523423213 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:26.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.356+0000 7f8dc27fc640 1 --2- 172.21.15.7:0/523423213 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df05769390 0x55df05b45b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:26.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.356+0000 7f8dc2ffd640 1 --2- 172.21.15.7:0/523423213 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55df057611b0 0x55df05b455c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:26.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.356+0000 7f8dc37fe640 1 -- 172.21.15.7:0/523423213 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55df057611b0 msgr2=0x55df05b455c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:26.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.356+0000 7f8dc37fe640 1 --2- 172.21.15.7:0/523423213 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55df057611b0 0x55df05b455c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:26.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.357+0000 7f8dc37fe640 1 -- 172.21.15.7:0/523423213 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df05769390 msgr2=0x55df05b45b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:26.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.357+0000 7f8dc37fe640 1 --2- 172.21.15.7:0/523423213 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df05769390 0x55df05b45b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:26.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.357+0000 7f8dc37fe640 1 -- 172.21.15.7:0/523423213 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df05bbcdc0 con 0x55df0578a070 2024-09-21T06:45:26.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.357+0000 7f8dc27fc640 1 --2- 172.21.15.7:0/523423213 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df05769390 0x55df05b45b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:45:26.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.357+0000 7f8dc37fe640 1 --2- 172.21.15.7:0/523423213 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df0578a070 0x55df05b46040 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc005770 tx=0x7f8dbc00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c906f5f52be2d683 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:26.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.357+0000 7f8da6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:45:26.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.357+0000 7f8da6ff5640 1 -- 172.21.15.7:0/523423213 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dbc004ca0 con 0x55df0578a070 2024-09-21T06:45:26.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.357+0000 7f8da6ff5640 1 -- 172.21.15.7:0/523423213 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7f8dbc004e40 con 0x55df0578a070 2024-09-21T06:45:26.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.357+0000 7f8dcf887740 1 -- 172.21.15.7:0/523423213 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8dbc029070 con 0x55df0578a070 2024-09-21T06:45:26.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.357+0000 7f8da6ff5640 1 -- 172.21.15.7:0/523423213 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8dbc015020 con 0x55df0578a070 2024-09-21T06:45:26.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.357+0000 7f8dcf887740 10 client.17562 fetch_fsmap learned FSMap version 25 2024-09-21T06:45:26.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.357+0000 7f8dcf887740 1 -- 172.21.15.7:0/523423213 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55df05bbe020 con 0x55df0578a070 2024-09-21T06:45:26.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.357+0000 7f8da6ff5640 1 -- 172.21.15.7:0/523423213 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8dbc029070 con 0x55df0578a070 2024-09-21T06:45:26.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.358+0000 7f8da6ff5640 1 -- 172.21.15.7:0/523423213 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f8dbc03d050 con 0x55df0578a070 2024-09-21T06:45:26.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.358+0000 7f8dcf887740 10 client.17562 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:45:26.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.358+0000 7f8dcf887740 10 client.17562 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:45:26.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.358+0000 7f8dcf887740 20 client.17562 populate_metadata read hostname 'smithi007' 2024-09-21T06:45:26.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.358+0000 7f8dcf887740 1 --2- 172.21.15.7:0/523423213 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55df0571dda0 0x55df05bc04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:26.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.358+0000 7f8dcf887740 4 client.17562 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:45:26.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.358+0000 7f8dcf887740 1 -- 172.21.15.7:0/523423213 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55df05aa58a0 con 0x55df0571dda0 2024-09-21T06:45:26.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.358+0000 7f8dc2ffd640 1 --2- 172.21.15.7:0/523423213 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55df0571dda0 0x55df05bc04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:26.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.358+0000 7f8da6ff5640 10 client.17562 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:45:26.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.358+0000 7f8dc2ffd640 1 --2- 172.21.15.7:0/523423213 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55df0571dda0 0x55df05bc04b0 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=828eb63f44853cac server_cookie=f2c6c629e4e0914e in_seq=0 out_seq=0 2024-09-21T06:45:26.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.359+0000 7f8da6ff5640 1 -- 172.21.15.7:0/523423213 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55df05aa58a0 con 0x55df0571dda0 2024-09-21T06:45:26.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.359+0000 7f8da6ff5640 10 client.17562 handle_command_reply: tid=0 2024-09-21T06:45:26.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.359+0000 7f8dcf887740 1 client.17562 shutdown 2024-09-21T06:45:26.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.359+0000 7f8dcf887740 1 -- 172.21.15.7:0/523423213 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df0578a070 msgr2=0x55df05b46040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:26.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.359+0000 7f8dcf887740 1 --2- 172.21.15.7:0/523423213 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df0578a070 0x55df05b46040 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc005770 tx=0x7f8dbc00bf10 comp rx=0 tx=0).stop 2024-09-21T06:45:26.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.359+0000 7f8dcf887740 1 -- 172.21.15.7:0/523423213 shutdown_connections 2024-09-21T06:45:26.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.359+0000 7f8dcf887740 1 --2- 172.21.15.7:0/523423213 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55df0571dda0 0x55df05bc04b0 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:26.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.359+0000 7f8dcf887740 1 --2- 172.21.15.7:0/523423213 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55df0578a070 0x55df05b46040 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:26.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.359+0000 7f8dcf887740 1 --2- 172.21.15.7:0/523423213 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55df05769390 0x55df05b45b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:26.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.359+0000 7f8dcf887740 1 --2- 172.21.15.7:0/523423213 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55df057611b0 0x55df05b455c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:26.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.359+0000 7f8dcf887740 1 -- 172.21.15.7:0/523423213 >> 172.21.15.7:0/523423213 conn(0x55df0577e460 msgr2=0x55df05b351f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:26.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.359+0000 7f8da6ff5640 0 client.17562 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:45:26.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.359+0000 7f8dcf887740 1 -- 172.21.15.7:0/523423213 shutdown_connections 2024-09-21T06:45:26.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.359+0000 7f8dcf887740 1 -- 172.21.15.7:0/523423213 wait complete. 2024-09-21T06:45:26.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.359+0000 7f8dcf887740 20 client.17562 trim_cache size 0 max 16384 2024-09-21T06:45:26.367 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:45:26.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.360+0000 7f8dc9313640 1 -- 172.21.15.7:0/1359617585 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f8dac0b6680 msgr2=0x7f8dac0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:26.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.360+0000 7f8dc9313640 1 --2- 172.21.15.7:0/1359617585 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f8dac0b6680 0x7f8dac0b8b90 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8db4004770 tx=0x7f8db40058d0 comp rx=0 tx=0).stop 2024-09-21T06:45:26.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.360+0000 7f8dc9313640 1 -- 172.21.15.7:0/1359617585 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8dc4106280 msgr2=0x7f8dc419aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:26.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.360+0000 7f8dc9313640 1 --2- 172.21.15.7:0/1359617585 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8dc4106280 0x7f8dc419aaf0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f8db800ea50 tx=0x7f8db800ef10 comp rx=0 tx=0).stop 2024-09-21T06:45:26.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.360+0000 7f8dc9313640 1 -- 172.21.15.7:0/1359617585 shutdown_connections 2024-09-21T06:45:26.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.360+0000 7f8dc9313640 1 --2- 172.21.15.7:0/1359617585 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f8dac0b6680 0x7f8dac0b8b90 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:26.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.360+0000 7f8dc9313640 1 --2- 172.21.15.7:0/1359617585 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8dc4106bd0 0x7f8dc419fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:26.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.360+0000 7f8dc9313640 1 --2- 172.21.15.7:0/1359617585 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8dc4106280 0x7f8dc419aaf0 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:26.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.360+0000 7f8dc9313640 1 --2- 172.21.15.7:0/1359617585 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8dc4102090 0x7f8dc419a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:26.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.360+0000 7f8dc9313640 1 -- 172.21.15.7:0/1359617585 >> 172.21.15.7:0/1359617585 conn(0x7f8dc4077c90 msgr2=0x7f8dc41075b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:26.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.360+0000 7f8dc9313640 1 -- 172.21.15.7:0/1359617585 shutdown_connections 2024-09-21T06:45:26.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:26.360+0000 7f8dc9313640 1 -- 172.21.15.7:0/1359617585 wait complete. 2024-09-21T06:45:27.050 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:45:26 smithi007 ceph-mon[30983]: pgmap v602: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T06:45:27.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:45:26 smithi144 ceph-mon[34653]: pgmap v602: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T06:45:27.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:45:26 smithi018 ceph-mon[34477]: pgmap v602: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 102 B/s wr, 7 op/s 2024-09-21T06:45:28.080 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:45:28.081 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:45:28.351 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:45:29.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.043+0000 7f6210509640 1 -- 172.21.15.7:0/2906147819 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6208102ad0 msgr2=0x7f6208102ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:29.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.043+0000 7f6210509640 1 --2- 172.21.15.7:0/2906147819 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6208102ad0 0x7f6208102ee0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f61f8009ca0 tx=0x7f61f802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.043+0000 7f6210509640 1 -- 172.21.15.7:0/2906147819 shutdown_connections 2024-09-21T06:45:29.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.043+0000 7f6210509640 1 --2- 172.21.15.7:0/2906147819 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6208108d10 0x7f620810f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.043+0000 7f6210509640 1 --2- 172.21.15.7:0/2906147819 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f62081083c0 0x7f62081087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.043+0000 7f6210509640 1 --2- 172.21.15.7:0/2906147819 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6208102ad0 0x7f6208102ee0 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.043+0000 7f6210509640 1 -- 172.21.15.7:0/2906147819 >> 172.21.15.7:0/2906147819 conn(0x7f62080796d0 msgr2=0x7f6208079ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:29.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.043+0000 7f6210509640 1 -- 172.21.15.7:0/2906147819 shutdown_connections 2024-09-21T06:45:29.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.043+0000 7f6210509640 1 -- 172.21.15.7:0/2906147819 wait complete. 2024-09-21T06:45:29.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.044+0000 7f6210509640 1 Processor -- start 2024-09-21T06:45:29.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.044+0000 7f6210509640 1 -- start start 2024-09-21T06:45:29.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.044+0000 7f6210509640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6208102ad0 0x7f620819b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:29.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.044+0000 7f6210509640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62081083c0 0x7f620819b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:29.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.044+0000 7f6210509640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6208108d10 0x7f620819bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:29.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.044+0000 7f6210509640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f62081129d0 con 0x7f62081083c0 2024-09-21T06:45:29.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.044+0000 7f6210509640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6208112850 con 0x7f6208108d10 2024-09-21T06:45:29.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.044+0000 7f6210509640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6208112b50 con 0x7f6208102ad0 2024-09-21T06:45:29.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.045+0000 7f620daa4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62081083c0 0x7f620819b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:29.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.045+0000 7f620daa4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62081083c0 0x7f620819b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43198/0 (socket says 172.21.15.7:43198) 2024-09-21T06:45:29.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.045+0000 7f620daa4640 1 -- 172.21.15.7:0/3887438388 learned_addr learned my addr 172.21.15.7:0/3887438388 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:29.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.045+0000 7f620e2a5640 1 --2- 172.21.15.7:0/3887438388 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6208102ad0 0x7f620819b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:29.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.045+0000 7f620eaa6640 1 --2- 172.21.15.7:0/3887438388 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6208108d10 0x7f620819bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:29.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.045+0000 7f620daa4640 1 -- 172.21.15.7:0/3887438388 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6208102ad0 msgr2=0x7f620819b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:29.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.045+0000 7f620daa4640 1 --2- 172.21.15.7:0/3887438388 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6208102ad0 0x7f620819b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.045+0000 7f620daa4640 1 -- 172.21.15.7:0/3887438388 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6208108d10 msgr2=0x7f620819bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:29.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.045+0000 7f620daa4640 1 --2- 172.21.15.7:0/3887438388 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6208108d10 0x7f620819bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.045+0000 7f620daa4640 1 -- 172.21.15.7:0/3887438388 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62081a64e0 con 0x7f62081083c0 2024-09-21T06:45:29.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.045+0000 7f620eaa6640 1 --2- 172.21.15.7:0/3887438388 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6208108d10 0x7f620819bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:29.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.045+0000 7f620daa4640 1 --2- 172.21.15.7:0/3887438388 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62081083c0 0x7f620819b820 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f61fc00c8c0 tx=0x7f61fc00cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:29.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.045+0000 7f62077fe640 1 -- 172.21.15.7:0/3887438388 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61fc007bb0 con 0x7f62081083c0 2024-09-21T06:45:29.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.045+0000 7f6210509640 1 -- 172.21.15.7:0/3887438388 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62081a67d0 con 0x7f62081083c0 2024-09-21T06:45:29.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.045+0000 7f62077fe640 1 -- 172.21.15.7:0/3887438388 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f61fc007d50 con 0x7f62081083c0 2024-09-21T06:45:29.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.045+0000 7f62077fe640 1 -- 172.21.15.7:0/3887438388 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61fc0187c0 con 0x7f62081083c0 2024-09-21T06:45:29.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.045+0000 7f6210509640 1 -- 172.21.15.7:0/3887438388 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62081a6d60 con 0x7f62081083c0 2024-09-21T06:45:29.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.048+0000 7f6216a7d740 1 Processor -- start 2024-09-21T06:45:29.053 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:45:28 smithi007 ceph-mon[30983]: pgmap v603: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 7 op/s 2024-09-21T06:45:29.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.048+0000 7f6216a7d740 1 -- start start 2024-09-21T06:45:29.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.049+0000 7f6216a7d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1b83e9350 0x55b1b8790430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:29.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.049+0000 7f6216a7d740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b1b83c0490 0x55b1b8790970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:29.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.049+0000 7f6216a7d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b1b83c8670 0x55b1b8790eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:29.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.049+0000 7f6216a7d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55b1b8706e60 con 0x55b1b83e9350 2024-09-21T06:45:29.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.049+0000 7f6216a7d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55b1b86f6290 con 0x55b1b83c8670 2024-09-21T06:45:29.057 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.049+0000 7f6216a7d740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55b1b86fa0a0 con 0x55b1b83c0490 2024-09-21T06:45:29.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.049+0000 7f62077fe640 1 -- 172.21.15.7:0/3887438388 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f61fc00fa20 con 0x7f62081083c0 2024-09-21T06:45:29.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.049+0000 7f620eaa6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1b83e9350 0x55b1b8790430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:29.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.049+0000 7f620eaa6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1b83e9350 0x55b1b8790430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43212/0 (socket says 172.21.15.7:43212) 2024-09-21T06:45:29.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.049+0000 7f620eaa6640 1 -- 172.21.15.7:0/3088016580 learned_addr learned my addr 172.21.15.7:0/3088016580 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:29.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.049+0000 7f620e2a5640 1 --2- 172.21.15.7:0/3088016580 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b1b83c0490 0x55b1b8790970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:29.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.049+0000 7f620daa4640 1 --2- 172.21.15.7:0/3088016580 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b1b83c8670 0x55b1b8790eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:29.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.049+0000 7f620eaa6640 1 -- 172.21.15.7:0/3088016580 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b1b83c0490 msgr2=0x55b1b8790970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:29.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.049+0000 7f620eaa6640 1 --2- 172.21.15.7:0/3088016580 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b1b83c0490 0x55b1b8790970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.049+0000 7f620eaa6640 1 -- 172.21.15.7:0/3088016580 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b1b83c8670 msgr2=0x55b1b8790eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:29.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.049+0000 7f620eaa6640 1 --2- 172.21.15.7:0/3088016580 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b1b83c8670 0x55b1b8790eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.049+0000 7f620eaa6640 1 -- 172.21.15.7:0/3088016580 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1b8454930 con 0x55b1b83e9350 2024-09-21T06:45:29.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.049+0000 7f620daa4640 1 --2- 172.21.15.7:0/3088016580 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b1b83c8670 0x55b1b8790eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:29.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.050+0000 7f620eaa6640 1 --2- 172.21.15.7:0/3088016580 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1b83e9350 0x55b1b8790430 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f620000bcf0 tx=0x7f620000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac0f30790234aba8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:29.058 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.050+0000 7f6204ff9640 1 -- 172.21.15.7:0/3088016580 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6200015070 con 0x55b1b83e9350 2024-09-21T06:45:29.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.050+0000 7f6204ff9640 1 -- 172.21.15.7:0/3088016580 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f62000118f0 con 0x55b1b83e9350 2024-09-21T06:45:29.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.050+0000 7f6204ff9640 1 -- 172.21.15.7:0/3088016580 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62000107a0 con 0x55b1b83e9350 2024-09-21T06:45:29.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.050+0000 7f62077fe640 1 --2- 172.21.15.7:0/3887438388 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f61f00baac0 0x7f61f00bcfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:29.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.050+0000 7f620e2a5640 1 --2- 172.21.15.7:0/3887438388 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f61f00baac0 0x7f61f00bcfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:29.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.050+0000 7f62077fe640 1 -- 172.21.15.7:0/3887438388 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7f61fc0e77c0 con 0x7f62081083c0 2024-09-21T06:45:29.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.051+0000 7f620e2a5640 1 --2- 172.21.15.7:0/3887438388 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f61f00baac0 0x7f61f00bcfd0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f61f8005e30 tx=0x7f61f802f310 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:29.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.051+0000 7f6216a7d740 1 -- 172.21.15.7:0/3088016580 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1b83e9350 msgr2=0x55b1b8790430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:29.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.051+0000 7f6216a7d740 1 --2- 172.21.15.7:0/3088016580 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1b83e9350 0x55b1b8790430 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f620000bcf0 tx=0x7f620000f730 comp rx=0 tx=0).stop 2024-09-21T06:45:29.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.051+0000 7f6216a7d740 1 -- 172.21.15.7:0/3088016580 shutdown_connections 2024-09-21T06:45:29.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.051+0000 7f6216a7d740 1 --2- 172.21.15.7:0/3088016580 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b1b83c8670 0x55b1b8790eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.051+0000 7f6216a7d740 1 --2- 172.21.15.7:0/3088016580 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b1b83c0490 0x55b1b8790970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.051+0000 7f6216a7d740 1 --2- 172.21.15.7:0/3088016580 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1b83e9350 0x55b1b8790430 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.051+0000 7f6216a7d740 1 -- 172.21.15.7:0/3088016580 >> 172.21.15.7:0/3088016580 conn(0x55b1b83dd740 msgr2=0x55b1b878e320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:29.059 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.051+0000 7f6216a7d740 1 -- 172.21.15.7:0/3088016580 shutdown_connections 2024-09-21T06:45:29.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.051+0000 7f6216a7d740 1 -- 172.21.15.7:0/3088016580 wait complete. 2024-09-21T06:45:29.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.052+0000 7f6216a7d740 1 -- start start 2024-09-21T06:45:29.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.052+0000 7f6216a7d740 1 Processor -- start 2024-09-21T06:45:29.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.052+0000 7f6216a7d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1b83c0490 0x55b1b879c040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:29.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.052+0000 7f6216a7d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b1b83c8670 0x55b1b879c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:29.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.052+0000 7f6216a7d740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b1b83e9350 0x55b1b87a7f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:29.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.052+0000 7f6216a7d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55b1b8557890 con 0x55b1b83c0490 2024-09-21T06:45:29.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.052+0000 7f6216a7d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55b1b8690d40 con 0x55b1b83c8670 2024-09-21T06:45:29.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.052+0000 7f6216a7d740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55b1b879ec10 con 0x55b1b83e9350 2024-09-21T06:45:29.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.052+0000 7f6216a7d740 10 client.0 _ll_register_callbacks cb 0x55b1b86f4c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:29.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.052+0000 7f620e2a5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1b83c0490 0x55b1b879c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:29.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.053+0000 7f620e2a5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1b83c0490 0x55b1b879c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43218/0 (socket says 172.21.15.7:43218) 2024-09-21T06:45:29.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.053+0000 7f620e2a5640 1 -- 172.21.15.7:0/1305001411 learned_addr learned my addr 172.21.15.7:0/1305001411 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:29.060 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.053+0000 7f620eaa6640 1 --2- 172.21.15.7:0/1305001411 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b1b83e9350 0x55b1b87a7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:29.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.053+0000 7f620e2a5640 1 -- 172.21.15.7:0/1305001411 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b1b83e9350 msgr2=0x55b1b87a7f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:29.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.053+0000 7f620e2a5640 1 --2- 172.21.15.7:0/1305001411 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b1b83e9350 0x55b1b87a7f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.053+0000 7f620e2a5640 1 -- 172.21.15.7:0/1305001411 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b1b83c8670 msgr2=0x55b1b879c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:29.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.053+0000 7f620daa4640 1 --2- 172.21.15.7:0/1305001411 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b1b83c8670 0x55b1b879c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:29.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.053+0000 7f620e2a5640 1 --2- 172.21.15.7:0/1305001411 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b1b83c8670 0x55b1b879c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.053+0000 7f620e2a5640 1 -- 172.21.15.7:0/1305001411 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1b87a8510 con 0x55b1b83c0490 2024-09-21T06:45:29.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.053+0000 7f620eaa6640 1 --2- 172.21.15.7:0/1305001411 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b1b83e9350 0x55b1b87a7f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:29.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.053+0000 7f620daa4640 1 --2- 172.21.15.7:0/1305001411 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b1b83c8670 0x55b1b879c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:45:29.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.053+0000 7f620e2a5640 1 --2- 172.21.15.7:0/1305001411 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1b83c0490 0x55b1b879c040 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f61f8035000 tx=0x7f61f802a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=334d3d845acf4db9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:29.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.053+0000 7f61edffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:45:29.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.053+0000 7f61edffb640 1 -- 172.21.15.7:0/1305001411 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61f8004040 con 0x55b1b83c0490 2024-09-21T06:45:29.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.053+0000 7f61edffb640 1 -- 172.21.15.7:0/1305001411 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7f61f80041e0 con 0x55b1b83c0490 2024-09-21T06:45:29.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.053+0000 7f6216a7d740 1 -- 172.21.15.7:0/1305001411 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f62000118f0 con 0x55b1b83c0490 2024-09-21T06:45:29.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.054+0000 7f61edffb640 1 -- 172.21.15.7:0/1305001411 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f61f80043e0 con 0x55b1b83c0490 2024-09-21T06:45:29.061 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.054+0000 7f6216a7d740 10 client.17574 fetch_fsmap learned FSMap version 25 2024-09-21T06:45:29.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.054+0000 7f6216a7d740 1 -- 172.21.15.7:0/1305001411 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b1b87aae40 con 0x55b1b83c0490 2024-09-21T06:45:29.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.054+0000 7f61edffb640 1 -- 172.21.15.7:0/1305001411 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f62000118f0 con 0x55b1b83c0490 2024-09-21T06:45:29.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.054+0000 7f61edffb640 1 -- 172.21.15.7:0/1305001411 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f61f8051070 con 0x55b1b83c0490 2024-09-21T06:45:29.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.054+0000 7f6216a7d740 10 client.17574 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:45:29.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.054+0000 7f6216a7d740 10 client.17574 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:45:29.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.054+0000 7f6216a7d740 20 client.17574 populate_metadata read hostname 'smithi007' 2024-09-21T06:45:29.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.054+0000 7f6216a7d740 1 --2- 172.21.15.7:0/1305001411 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55b1b83a7cd0 0x55b1b87ae310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:29.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.054+0000 7f6216a7d740 4 client.17574 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:45:29.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.054+0000 7f6216a7d740 1 -- 172.21.15.7:0/1305001411 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b1b8708db0 con 0x55b1b83a7cd0 2024-09-21T06:45:29.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.054+0000 7f620daa4640 1 --2- 172.21.15.7:0/1305001411 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55b1b83a7cd0 0x55b1b87ae310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:29.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.055+0000 7f61edffb640 10 client.17574 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:45:29.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.055+0000 7f620daa4640 1 --2- 172.21.15.7:0/1305001411 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55b1b83a7cd0 0x55b1b87ae310 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d9d51df305f798c server_cookie=8b0bdcea437bf3cf in_seq=0 out_seq=0 2024-09-21T06:45:29.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.056+0000 7f61edffb640 1 -- 172.21.15.7:0/1305001411 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b1b8708db0 con 0x55b1b83a7cd0 2024-09-21T06:45:29.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.056+0000 7f61edffb640 10 client.17574 handle_command_reply: tid=0 2024-09-21T06:45:29.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.056+0000 7f6216a7d740 1 client.17574 shutdown 2024-09-21T06:45:29.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.056+0000 7f6216a7d740 1 -- 172.21.15.7:0/1305001411 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1b83c0490 msgr2=0x55b1b879c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:29.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.056+0000 7f6216a7d740 1 --2- 172.21.15.7:0/1305001411 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1b83c0490 0x55b1b879c040 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f61f8035000 tx=0x7f61f802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.056+0000 7f6216a7d740 1 -- 172.21.15.7:0/1305001411 shutdown_connections 2024-09-21T06:45:29.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.056+0000 7f6216a7d740 1 --2- 172.21.15.7:0/1305001411 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55b1b83a7cd0 0x55b1b87ae310 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.056+0000 7f6216a7d740 1 --2- 172.21.15.7:0/1305001411 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b1b83e9350 0x55b1b87a7f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.056+0000 7f6216a7d740 1 --2- 172.21.15.7:0/1305001411 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b1b83c8670 0x55b1b879c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.056+0000 7f6216a7d740 1 --2- 172.21.15.7:0/1305001411 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1b83c0490 0x55b1b879c040 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.056+0000 7f61edffb640 0 client.17574 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:45:29.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.056+0000 7f6216a7d740 1 -- 172.21.15.7:0/1305001411 >> 172.21.15.7:0/1305001411 conn(0x55b1b83dd740 msgr2=0x55b1b8793610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:29.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.056+0000 7f6216a7d740 1 -- 172.21.15.7:0/1305001411 shutdown_connections 2024-09-21T06:45:29.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.056+0000 7f6216a7d740 1 -- 172.21.15.7:0/1305001411 wait complete. 2024-09-21T06:45:29.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.056+0000 7f6216a7d740 20 client.17574 trim_cache size 0 max 16384 2024-09-21T06:45:29.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.074+0000 7f6216a7d740 1 Processor -- start 2024-09-21T06:45:29.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.074+0000 7f6216a7d740 1 -- start start 2024-09-21T06:45:29.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.074+0000 7f6216a7d740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b1b83c0490 0x55b1b8796550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:29.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.074+0000 7f6216a7d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b1b83c8670 0x55b1b879da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:29.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.074+0000 7f6216a7d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1b83e9350 0x55b1b8799030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:29.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.075+0000 7f6216a7d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f62081afbe0 con 0x55b1b83e9350 2024-09-21T06:45:29.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.075+0000 7f6216a7d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f62081ad4b0 con 0x55b1b83c8670 2024-09-21T06:45:29.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.075+0000 7f6216a7d740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f62081ab340 con 0x55b1b83c0490 2024-09-21T06:45:29.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.075+0000 7f620eaa6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1b83e9350 0x55b1b8799030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:29.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.075+0000 7f620eaa6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1b83e9350 0x55b1b8799030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43234/0 (socket says 172.21.15.7:43234) 2024-09-21T06:45:29.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.075+0000 7f620eaa6640 1 -- 172.21.15.7:0/145115687 learned_addr learned my addr 172.21.15.7:0/145115687 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:29.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.075+0000 7f620daa4640 1 --2- 172.21.15.7:0/145115687 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b1b83c8670 0x55b1b879da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:29.077 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.075+0000 7f620e2a5640 1 --2- 172.21.15.7:0/145115687 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b1b83c0490 0x55b1b8796550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:29.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.075+0000 7f620eaa6640 1 -- 172.21.15.7:0/145115687 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b1b83c0490 msgr2=0x55b1b8796550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:29.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.075+0000 7f620eaa6640 1 --2- 172.21.15.7:0/145115687 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b1b83c0490 0x55b1b8796550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.075+0000 7f620eaa6640 1 -- 172.21.15.7:0/145115687 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b1b83c8670 msgr2=0x55b1b879da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:29.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.075+0000 7f620eaa6640 1 --2- 172.21.15.7:0/145115687 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b1b83c8670 0x55b1b879da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.078 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.075+0000 7f620eaa6640 1 -- 172.21.15.7:0/145115687 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1b879ada0 con 0x55b1b83e9350 2024-09-21T06:45:29.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.075+0000 7f620eaa6640 1 --2- 172.21.15.7:0/145115687 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1b83e9350 0x55b1b8799030 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f6200019000 tx=0x7f620000b3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fc2dd0dc5736876 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:29.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.075+0000 7f61effff640 1 -- 172.21.15.7:0/145115687 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6200029070 con 0x55b1b83e9350 2024-09-21T06:45:29.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.075+0000 7f61effff640 1 -- 172.21.15.7:0/145115687 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6200004680 con 0x55b1b83e9350 2024-09-21T06:45:29.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.075+0000 7f61effff640 1 -- 172.21.15.7:0/145115687 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6200015050 con 0x55b1b83e9350 2024-09-21T06:45:29.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.076+0000 7f6216a7d740 1 -- 172.21.15.7:0/145115687 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1b83e9350 msgr2=0x55b1b8799030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:29.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.076+0000 7f6216a7d740 1 --2- 172.21.15.7:0/145115687 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1b83e9350 0x55b1b8799030 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f6200019000 tx=0x7f620000b3e0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.076+0000 7f6216a7d740 1 -- 172.21.15.7:0/145115687 shutdown_connections 2024-09-21T06:45:29.081 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.076+0000 7f6216a7d740 1 --2- 172.21.15.7:0/145115687 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1b83e9350 0x55b1b8799030 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.076+0000 7f6216a7d740 1 --2- 172.21.15.7:0/145115687 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b1b83c8670 0x55b1b879da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.076+0000 7f6216a7d740 1 --2- 172.21.15.7:0/145115687 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b1b83c0490 0x55b1b8796550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.076+0000 7f6216a7d740 1 -- 172.21.15.7:0/145115687 >> 172.21.15.7:0/145115687 conn(0x55b1b83dd740 msgr2=0x55b1b879d360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:29.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.076+0000 7f6216a7d740 1 -- 172.21.15.7:0/145115687 shutdown_connections 2024-09-21T06:45:29.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.076+0000 7f6216a7d740 1 -- 172.21.15.7:0/145115687 wait complete. 2024-09-21T06:45:29.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.077+0000 7f6216a7d740 1 -- start start 2024-09-21T06:45:29.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.077+0000 7f6216a7d740 1 Processor -- start 2024-09-21T06:45:29.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.077+0000 7f6216a7d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1b83c0490 0x55b1b87a0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:29.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.077+0000 7f6216a7d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b1b83c8670 0x55b1b87a0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:29.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.077+0000 7f6216a7d740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b1b83e9350 0x55b1b8811ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:29.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.077+0000 7f6216a7d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f62081ab990 con 0x55b1b83c0490 2024-09-21T06:45:29.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.077+0000 7f6216a7d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f62081acde0 con 0x55b1b83c8670 2024-09-21T06:45:29.082 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.077+0000 7f6216a7d740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f62081ac040 con 0x55b1b83e9350 2024-09-21T06:45:29.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.077+0000 7f6216a7d740 10 client.0 _ll_register_callbacks cb 0x7f61f802f440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:29.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.077+0000 7f620e2a5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1b83c0490 0x55b1b87a0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:29.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.077+0000 7f620e2a5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1b83c0490 0x55b1b87a0750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:43240/0 (socket says 172.21.15.7:43240) 2024-09-21T06:45:29.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.077+0000 7f620e2a5640 1 -- 172.21.15.7:0/1975637618 learned_addr learned my addr 172.21.15.7:0/1975637618 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:29.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.078+0000 7f620daa4640 1 --2- 172.21.15.7:0/1975637618 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b1b83c8670 0x55b1b87a0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:29.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.078+0000 7f620eaa6640 1 --2- 172.21.15.7:0/1975637618 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b1b83e9350 0x55b1b8811ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:29.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.078+0000 7f620e2a5640 1 -- 172.21.15.7:0/1975637618 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b1b83e9350 msgr2=0x55b1b8811ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:29.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.078+0000 7f620e2a5640 1 --2- 172.21.15.7:0/1975637618 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b1b83e9350 0x55b1b8811ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.078+0000 7f620e2a5640 1 -- 172.21.15.7:0/1975637618 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b1b83c8670 msgr2=0x55b1b87a0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:29.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.078+0000 7f620e2a5640 1 --2- 172.21.15.7:0/1975637618 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b1b83c8670 0x55b1b87a0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.078+0000 7f620e2a5640 1 -- 172.21.15.7:0/1975637618 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1b8812310 con 0x55b1b83c0490 2024-09-21T06:45:29.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.078+0000 7f620e2a5640 1 --2- 172.21.15.7:0/1975637618 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1b83c0490 0x55b1b87a0750 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f61f802fe60 tx=0x7f61f8004580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd147954a20460b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:29.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.078+0000 7f61edffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:45:29.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.078+0000 7f61edffb640 1 -- 172.21.15.7:0/1975637618 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61f8060070 con 0x55b1b83c0490 2024-09-21T06:45:29.083 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.078+0000 7f61edffb640 1 -- 172.21.15.7:0/1975637618 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7f61f802f870 con 0x55b1b83c0490 2024-09-21T06:45:29.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.078+0000 7f6216a7d740 1 -- 172.21.15.7:0/1975637618 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6200004680 con 0x55b1b83c0490 2024-09-21T06:45:29.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.078+0000 7f61edffb640 1 -- 172.21.15.7:0/1975637618 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f61f806c050 con 0x55b1b83c0490 2024-09-21T06:45:29.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.078+0000 7f6216a7d740 10 client.17580 fetch_fsmap learned FSMap version 25 2024-09-21T06:45:29.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.078+0000 7f6216a7d740 1 -- 172.21.15.7:0/1975637618 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b1b88196c0 con 0x55b1b83c0490 2024-09-21T06:45:29.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.079+0000 7f61edffb640 1 -- 172.21.15.7:0/1975637618 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6200004680 con 0x55b1b83c0490 2024-09-21T06:45:29.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.079+0000 7f61edffb640 1 -- 172.21.15.7:0/1975637618 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f61f8051040 con 0x55b1b83c0490 2024-09-21T06:45:29.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.079+0000 7f6216a7d740 10 client.17580 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:45:29.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.079+0000 7f6216a7d740 10 client.17580 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:45:29.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.079+0000 7f6216a7d740 20 client.17580 populate_metadata read hostname 'smithi007' 2024-09-21T06:45:29.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.079+0000 7f6216a7d740 1 --2- 172.21.15.7:0/1975637618 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55b1b837d080 0x55b1b881beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:29.084 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.079+0000 7f6216a7d740 4 client.17580 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:45:29.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.079+0000 7f6216a7d740 1 -- 172.21.15.7:0/1975637618 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55b1b8704860 con 0x55b1b837d080 2024-09-21T06:45:29.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.079+0000 7f620daa4640 1 --2- 172.21.15.7:0/1975637618 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55b1b837d080 0x55b1b881beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:29.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.080+0000 7f620daa4640 1 --2- 172.21.15.7:0/1975637618 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55b1b837d080 0x55b1b881beb0 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a8d0ea1eb43402ab server_cookie=fc54c3b650aacb38 in_seq=0 out_seq=0 2024-09-21T06:45:29.085 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.080+0000 7f61edffb640 10 client.17580 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:45:29.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.082+0000 7f61edffb640 1 -- 172.21.15.7:0/1975637618 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55b1b8704860 con 0x55b1b837d080 2024-09-21T06:45:29.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.082+0000 7f61edffb640 10 client.17580 handle_command_reply: tid=0 2024-09-21T06:45:29.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.082+0000 7f6216a7d740 1 client.17580 shutdown 2024-09-21T06:45:29.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.082+0000 7f6216a7d740 1 -- 172.21.15.7:0/1975637618 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1b83c0490 msgr2=0x55b1b87a0750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:29.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.082+0000 7f6216a7d740 1 --2- 172.21.15.7:0/1975637618 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1b83c0490 0x55b1b87a0750 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f61f802fe60 tx=0x7f61f8004580 comp rx=0 tx=0).stop 2024-09-21T06:45:29.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.082+0000 7f6216a7d740 1 -- 172.21.15.7:0/1975637618 shutdown_connections 2024-09-21T06:45:29.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.082+0000 7f6216a7d740 1 --2- 172.21.15.7:0/1975637618 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55b1b837d080 0x55b1b881beb0 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.082+0000 7f6216a7d740 1 --2- 172.21.15.7:0/1975637618 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55b1b83e9350 0x55b1b8811ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.082+0000 7f6216a7d740 1 --2- 172.21.15.7:0/1975637618 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55b1b83c8670 0x55b1b87a0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.082+0000 7f6216a7d740 1 --2- 172.21.15.7:0/1975637618 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55b1b83c0490 0x55b1b87a0750 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.082+0000 7f6216a7d740 1 -- 172.21.15.7:0/1975637618 >> 172.21.15.7:0/1975637618 conn(0x55b1b83dd740 msgr2=0x55b1b879d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:29.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.082+0000 7f61edffb640 0 client.17580 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:45:29.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.082+0000 7f6216a7d740 1 -- 172.21.15.7:0/1975637618 shutdown_connections 2024-09-21T06:45:29.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.082+0000 7f6216a7d740 1 -- 172.21.15.7:0/1975637618 wait complete. 2024-09-21T06:45:29.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.082+0000 7f6216a7d740 20 client.17580 trim_cache size 0 max 16384 2024-09-21T06:45:29.087 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:45:29.087 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0, 2024-09-21T06:45:29.087 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_tag": "2ef7127c-8e1a-4ec7-930c-fdda4f777a52", 2024-09-21T06:45:29.088 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": "asynchronous" 2024-09-21T06:45:29.088 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:45:29.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.083+0000 7f6210509640 1 -- 172.21.15.7:0/3887438388 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f61f00baac0 msgr2=0x7f61f00bcfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:29.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.083+0000 7f6210509640 1 --2- 172.21.15.7:0/3887438388 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f61f00baac0 0x7f61f00bcfd0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f61f8005e30 tx=0x7f61f802f310 comp rx=0 tx=0).stop 2024-09-21T06:45:29.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.083+0000 7f6210509640 1 -- 172.21.15.7:0/3887438388 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62081083c0 msgr2=0x7f620819b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:29.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.083+0000 7f6210509640 1 --2- 172.21.15.7:0/3887438388 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62081083c0 0x7f620819b820 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f61fc00c8c0 tx=0x7f61fc00cd80 comp rx=0 tx=0).stop 2024-09-21T06:45:29.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.083+0000 7f6210509640 1 -- 172.21.15.7:0/3887438388 shutdown_connections 2024-09-21T06:45:29.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.083+0000 7f6210509640 1 --2- 172.21.15.7:0/3887438388 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f61f00baac0 0x7f61f00bcfd0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.083+0000 7f6210509640 1 --2- 172.21.15.7:0/3887438388 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6208108d10 0x7f620819bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.083+0000 7f6210509640 1 --2- 172.21.15.7:0/3887438388 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f62081083c0 0x7f620819b820 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.083+0000 7f6210509640 1 --2- 172.21.15.7:0/3887438388 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6208102ad0 0x7f620819b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:29.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.083+0000 7f6210509640 1 -- 172.21.15.7:0/3887438388 >> 172.21.15.7:0/3887438388 conn(0x7f62080796d0 msgr2=0x7f6208106470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:29.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.083+0000 7f6210509640 1 -- 172.21.15.7:0/3887438388 shutdown_connections 2024-09-21T06:45:29.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:29.083+0000 7f6210509640 1 -- 172.21.15.7:0/3887438388 wait complete. 2024-09-21T06:45:29.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:45:28 smithi144 ceph-mon[34653]: pgmap v603: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 7 op/s 2024-09-21T06:45:29.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:45:28 smithi018 ceph-mon[34477]: pgmap v603: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 7 op/s 2024-09-21T06:45:29.787 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:45:30.048 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:45:30.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:45:29 smithi007 ceph-mon[30983]: scrub queued for path: / 2024-09-21T06:45:30.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:45:29 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T06:45:30.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:45:29 smithi007 ceph-mon[30983]: scrub summary: active paths [/] 2024-09-21T06:45:30.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:45:29 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T06:45:30.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:45:29 smithi007 ceph-mon[30983]: scrub summary: idle 2024-09-21T06:45:30.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:45:29 smithi144 ceph-mon[34653]: scrub queued for path: / 2024-09-21T06:45:30.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:45:29 smithi144 ceph-mon[34653]: scrub summary: idle+waiting paths [/] 2024-09-21T06:45:30.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:45:29 smithi144 ceph-mon[34653]: scrub summary: active paths [/] 2024-09-21T06:45:30.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:45:29 smithi144 ceph-mon[34653]: scrub summary: idle+waiting paths [/] 2024-09-21T06:45:30.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:45:29 smithi144 ceph-mon[34653]: scrub summary: idle 2024-09-21T06:45:30.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:45:29 smithi018 ceph-mon[34477]: scrub queued for path: / 2024-09-21T06:45:30.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:45:29 smithi018 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-21T06:45:30.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:45:29 smithi018 ceph-mon[34477]: scrub summary: active paths [/] 2024-09-21T06:45:30.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:45:29 smithi018 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-21T06:45:30.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:45:29 smithi018 ceph-mon[34477]: scrub summary: idle 2024-09-21T06:45:30.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.568+0000 7fa18599f640 1 -- 172.21.15.7:0/1803521028 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1801092f0 msgr2=0x7fa180109700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:30.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.568+0000 7fa18599f640 1 --2- 172.21.15.7:0/1803521028 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1801092f0 0x7fa180109700 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7fa174009900 tx=0x7fa17402a410 comp rx=0 tx=0).stop 2024-09-21T06:45:30.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.568+0000 7fa18599f640 1 -- 172.21.15.7:0/1803521028 shutdown_connections 2024-09-21T06:45:30.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.568+0000 7fa18599f640 1 --2- 172.21.15.7:0/1803521028 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa180109c40 0x7fa180110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:30.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.568+0000 7fa18599f640 1 --2- 172.21.15.7:0/1803521028 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1801092f0 0x7fa180109700 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:30.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.568+0000 7fa18599f640 1 --2- 172.21.15.7:0/1803521028 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1801039b0 0x7fa180103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:30.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.568+0000 7fa18599f640 1 -- 172.21.15.7:0/1803521028 >> 172.21.15.7:0/1803521028 conn(0x7fa1800ff440 msgr2=0x7fa180101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:30.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.568+0000 7fa18599f640 1 -- 172.21.15.7:0/1803521028 shutdown_connections 2024-09-21T06:45:30.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.568+0000 7fa18599f640 1 -- 172.21.15.7:0/1803521028 wait complete. 2024-09-21T06:45:30.576 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.568+0000 7fa18599f640 1 Processor -- start 2024-09-21T06:45:30.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.569+0000 7fa18599f640 1 -- start start 2024-09-21T06:45:30.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.569+0000 7fa18599f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1801039b0 0x7fa18019a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:30.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.569+0000 7fa18599f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1801092f0 0x7fa18019a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:30.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.569+0000 7fa18599f640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa180109c40 0x7fa18019fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:30.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.569+0000 7fa18599f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa180113920 con 0x7fa1801039b0 2024-09-21T06:45:30.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.569+0000 7fa18599f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa1801137a0 con 0x7fa1801092f0 2024-09-21T06:45:30.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.569+0000 7fa18599f640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa180113aa0 con 0x7fa180109c40 2024-09-21T06:45:30.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.569+0000 7fa18499d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1801039b0 0x7fa18019a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:30.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.569+0000 7fa18499d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1801039b0 0x7fa18019a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44250/0 (socket says 172.21.15.7:44250) 2024-09-21T06:45:30.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.569+0000 7fa18499d640 1 -- 172.21.15.7:0/339775484 learned_addr learned my addr 172.21.15.7:0/339775484 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:30.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.569+0000 7fa17ffff640 1 --2- 172.21.15.7:0/339775484 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1801092f0 0x7fa18019a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:30.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.569+0000 7fa18519e640 1 --2- 172.21.15.7:0/339775484 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa180109c40 0x7fa18019fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:30.577 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.569+0000 7fa18499d640 1 -- 172.21.15.7:0/339775484 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa180109c40 msgr2=0x7fa18019fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:30.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.569+0000 7fa18499d640 1 --2- 172.21.15.7:0/339775484 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa180109c40 0x7fa18019fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:30.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.569+0000 7fa18499d640 1 -- 172.21.15.7:0/339775484 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1801092f0 msgr2=0x7fa18019a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:30.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.569+0000 7fa18499d640 1 --2- 172.21.15.7:0/339775484 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1801092f0 0x7fa18019a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:30.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.569+0000 7fa18499d640 1 -- 172.21.15.7:0/339775484 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1801a02a0 con 0x7fa1801039b0 2024-09-21T06:45:30.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.570+0000 7fa18499d640 1 --2- 172.21.15.7:0/339775484 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1801039b0 0x7fa18019a330 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7fa17000e9f0 tx=0x7fa17000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:30.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.570+0000 7fa17dffb640 1 -- 172.21.15.7:0/339775484 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa17000cd80 con 0x7fa1801039b0 2024-09-21T06:45:30.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.570+0000 7fa18599f640 1 -- 172.21.15.7:0/339775484 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1801a0590 con 0x7fa1801039b0 2024-09-21T06:45:30.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.570+0000 7fa17dffb640 1 -- 172.21.15.7:0/339775484 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa1700108e0 con 0x7fa1801039b0 2024-09-21T06:45:30.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.570+0000 7fa17dffb640 1 -- 172.21.15.7:0/339775484 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa170018980 con 0x7fa1801039b0 2024-09-21T06:45:30.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.570+0000 7fa18599f640 1 -- 172.21.15.7:0/339775484 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1801a6cf0 con 0x7fa1801039b0 2024-09-21T06:45:30.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.573+0000 7fa18d175740 1 Processor -- start 2024-09-21T06:45:30.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.573+0000 7fa18d175740 1 -- start start 2024-09-21T06:45:30.578 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.573+0000 7fa18d175740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564c10f56070 0x564c112fd810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:30.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.573+0000 7fa18d175740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564c10f2d1b0 0x564c112fdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:30.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.573+0000 7fa18d175740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564c10f35390 0x564c112fe290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:30.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.573+0000 7fa18d175740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x564c11273e50 con 0x564c10f2d1b0 2024-09-21T06:45:30.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.573+0000 7fa18d175740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x564c11263280 con 0x564c10f56070 2024-09-21T06:45:30.579 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.573+0000 7fa18d175740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x564c11267090 con 0x564c10f35390 2024-09-21T06:45:30.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.574+0000 7fa17ffff640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564c10f35390 0x564c112fe290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:30.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.574+0000 7fa17ffff640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564c10f35390 0x564c112fe290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.7:46500/0 (socket says 172.21.15.7:46500) 2024-09-21T06:45:30.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.574+0000 7fa17ffff640 1 -- 172.21.15.7:0/1695548277 learned_addr learned my addr 172.21.15.7:0/1695548277 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:30.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.574+0000 7fa17dffb640 1 -- 172.21.15.7:0/339775484 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7fa170010430 con 0x7fa1801039b0 2024-09-21T06:45:30.583 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.574+0000 7fa18519e640 1 --2- 172.21.15.7:0/1695548277 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564c10f56070 0x564c112fd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:30.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.575+0000 7fa18499d640 1 --2- 172.21.15.7:0/1695548277 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564c10f2d1b0 0x564c112fdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:30.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.575+0000 7fa17ffff640 1 -- 172.21.15.7:0/1695548277 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564c10f56070 msgr2=0x564c112fd810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:30.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.575+0000 7fa17ffff640 1 --2- 172.21.15.7:0/1695548277 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564c10f56070 0x564c112fd810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:30.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.575+0000 7fa17ffff640 1 -- 172.21.15.7:0/1695548277 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564c10f2d1b0 msgr2=0x564c112fdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:30.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.575+0000 7fa17ffff640 1 --2- 172.21.15.7:0/1695548277 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564c10f2d1b0 0x564c112fdd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:30.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.575+0000 7fa17ffff640 1 -- 172.21.15.7:0/1695548277 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c10fc1650 con 0x564c10f35390 2024-09-21T06:45:30.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.575+0000 7fa18519e640 1 --2- 172.21.15.7:0/1695548277 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564c10f56070 0x564c112fd810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:30.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.575+0000 7fa17ffff640 1 --2- 172.21.15.7:0/1695548277 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564c10f35390 0x564c112fe290 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa174000c00 tx=0x7fa174032c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca894ee6cf14225e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:30.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.575+0000 7fa17dffb640 1 --2- 172.21.15.7:0/339775484 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa1680b6700 0x7fa1680b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:30.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.576+0000 7fa166ffd640 1 -- 172.21.15.7:0/1695548277 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa17403f070 con 0x564c10f35390 2024-09-21T06:45:30.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.576+0000 7fa18519e640 1 --2- 172.21.15.7:0/339775484 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa1680b6700 0x7fa1680b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:30.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.576+0000 7fa166ffd640 1 -- 172.21.15.7:0/1695548277 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa1740316a0 con 0x564c10f35390 2024-09-21T06:45:30.584 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.576+0000 7fa166ffd640 1 -- 172.21.15.7:0/1695548277 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa174035070 con 0x564c10f35390 2024-09-21T06:45:30.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.576+0000 7fa17dffb640 1 -- 172.21.15.7:0/339775484 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7fa1700e7b50 con 0x7fa1801039b0 2024-09-21T06:45:30.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.577+0000 7fa18d175740 1 -- 172.21.15.7:0/1695548277 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564c10f35390 msgr2=0x564c112fe290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:30.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.577+0000 7fa18d175740 1 --2- 172.21.15.7:0/1695548277 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564c10f35390 0x564c112fe290 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa174000c00 tx=0x7fa174032c30 comp rx=0 tx=0).stop 2024-09-21T06:45:30.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.577+0000 7fa18519e640 1 --2- 172.21.15.7:0/339775484 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa1680b6700 0x7fa1680b8c10 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa178009fd0 tx=0x7fa17800e040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:30.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.577+0000 7fa18d175740 1 -- 172.21.15.7:0/1695548277 shutdown_connections 2024-09-21T06:45:30.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.577+0000 7fa18d175740 1 --2- 172.21.15.7:0/1695548277 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564c10f35390 0x564c112fe290 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:30.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.577+0000 7fa18d175740 1 --2- 172.21.15.7:0/1695548277 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564c10f2d1b0 0x564c112fdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:30.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.577+0000 7fa18d175740 1 --2- 172.21.15.7:0/1695548277 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564c10f56070 0x564c112fd810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:30.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.577+0000 7fa18d175740 1 -- 172.21.15.7:0/1695548277 >> 172.21.15.7:0/1695548277 conn(0x564c10f4a460 msgr2=0x564c112fb700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:30.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.577+0000 7fa18d175740 1 -- 172.21.15.7:0/1695548277 shutdown_connections 2024-09-21T06:45:30.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.577+0000 7fa18d175740 1 -- 172.21.15.7:0/1695548277 wait complete. 2024-09-21T06:45:30.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.577+0000 7fa18d175740 1 -- start start 2024-09-21T06:45:30.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.577+0000 7fa18d175740 1 Processor -- start 2024-09-21T06:45:30.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.578+0000 7fa18d175740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564c10f2d1b0 0x564c11308f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:30.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.578+0000 7fa18d175740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564c10f35390 0x564c11309450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:30.585 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.578+0000 7fa18d175740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564c10f56070 0x564c113152b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:30.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.578+0000 7fa18d175740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x564c110c4700 con 0x564c10f2d1b0 2024-09-21T06:45:30.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.578+0000 7fa18d175740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x564c111fe110 con 0x564c10f35390 2024-09-21T06:45:30.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.578+0000 7fa18d175740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x564c1130bf90 con 0x564c10f56070 2024-09-21T06:45:30.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.578+0000 7fa18d175740 10 client.0 _ll_register_callbacks cb 0x564c11217990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:30.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.578+0000 7fa18499d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564c10f2d1b0 0x564c11308f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:30.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.578+0000 7fa18499d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564c10f2d1b0 0x564c11308f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44274/0 (socket says 172.21.15.7:44274) 2024-09-21T06:45:30.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.578+0000 7fa18499d640 1 -- 172.21.15.7:0/1940221905 learned_addr learned my addr 172.21.15.7:0/1940221905 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:30.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.578+0000 7fa17ffff640 1 --2- 172.21.15.7:0/1940221905 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564c10f35390 0x564c11309450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:30.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.578+0000 7fa18519e640 1 --2- 172.21.15.7:0/1940221905 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564c10f56070 0x564c113152b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:30.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.578+0000 7fa18499d640 1 -- 172.21.15.7:0/1940221905 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564c10f56070 msgr2=0x564c113152b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:30.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.578+0000 7fa18499d640 1 --2- 172.21.15.7:0/1940221905 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564c10f56070 0x564c113152b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:30.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.578+0000 7fa18499d640 1 -- 172.21.15.7:0/1940221905 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564c10f35390 msgr2=0x564c11309450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:30.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.578+0000 7fa18499d640 1 --2- 172.21.15.7:0/1940221905 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564c10f35390 0x564c11309450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:30.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.578+0000 7fa18499d640 1 -- 172.21.15.7:0/1940221905 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c1122bc40 con 0x564c10f2d1b0 2024-09-21T06:45:30.586 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.578+0000 7fa18519e640 1 --2- 172.21.15.7:0/1940221905 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564c10f56070 0x564c113152b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:45:30.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.578+0000 7fa17ffff640 1 --2- 172.21.15.7:0/1940221905 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564c10f35390 0x564c11309450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:30.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.578+0000 7fa18499d640 1 --2- 172.21.15.7:0/1940221905 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564c10f2d1b0 0x564c11308f10 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7fa17000e9c0 tx=0x7fa1700a9a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f0ecb802c6b0d29 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:30.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.578+0000 7fa15ffff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:45:30.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.579+0000 7fa15ffff640 1 -- 172.21.15.7:0/1940221905 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1700a9850 con 0x564c10f2d1b0 2024-09-21T06:45:30.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.579+0000 7fa15ffff640 1 -- 172.21.15.7:0/1940221905 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7fa1700a9300 con 0x564c10f2d1b0 2024-09-21T06:45:30.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.579+0000 7fa18d175740 1 -- 172.21.15.7:0/1940221905 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa1740316a0 con 0x564c10f2d1b0 2024-09-21T06:45:30.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.579+0000 7fa15ffff640 1 -- 172.21.15.7:0/1940221905 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa1700a9120 con 0x564c10f2d1b0 2024-09-21T06:45:30.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.579+0000 7fa18d175740 10 client.17592 fetch_fsmap learned FSMap version 25 2024-09-21T06:45:30.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.579+0000 7fa18d175740 1 -- 172.21.15.7:0/1940221905 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564c11317cb0 con 0x564c10f2d1b0 2024-09-21T06:45:30.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.579+0000 7fa15ffff640 1 -- 172.21.15.7:0/1940221905 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa1740316a0 con 0x564c10f2d1b0 2024-09-21T06:45:30.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.579+0000 7fa15ffff640 1 -- 172.21.15.7:0/1940221905 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa1700aece0 con 0x564c10f2d1b0 2024-09-21T06:45:30.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.579+0000 7fa18d175740 10 client.17592 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:45:30.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.579+0000 7fa18d175740 10 client.17592 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:45:30.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.579+0000 7fa18d175740 20 client.17592 populate_metadata read hostname 'smithi007' 2024-09-21T06:45:30.587 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.579+0000 7fa18d175740 1 --2- 172.21.15.7:0/1940221905 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x564c10f149f0 0x564c1131b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:30.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.579+0000 7fa18d175740 4 client.17592 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:45:30.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.579+0000 7fa18d175740 1 -- 172.21.15.7:0/1940221905 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564c11275da0 con 0x564c10f149f0 2024-09-21T06:45:30.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.580+0000 7fa17ffff640 1 --2- 172.21.15.7:0/1940221905 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x564c10f149f0 0x564c1131b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:30.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.580+0000 7fa17ffff640 1 --2- 172.21.15.7:0/1940221905 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x564c10f149f0 0x564c1131b210 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42cc3c9dd20f6924 server_cookie=169e31797d0ee65 in_seq=0 out_seq=0 2024-09-21T06:45:30.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.580+0000 7fa15ffff640 10 client.17592 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:45:30.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.581+0000 7fa15ffff640 1 -- 172.21.15.7:0/1940221905 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564c11275da0 con 0x564c10f149f0 2024-09-21T06:45:30.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.581+0000 7fa15ffff640 10 client.17592 handle_command_reply: tid=0 2024-09-21T06:45:30.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.581+0000 7fa18d175740 1 client.17592 shutdown 2024-09-21T06:45:30.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.581+0000 7fa18d175740 1 -- 172.21.15.7:0/1940221905 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564c10f2d1b0 msgr2=0x564c11308f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:30.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.581+0000 7fa18d175740 1 --2- 172.21.15.7:0/1940221905 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564c10f2d1b0 0x564c11308f10 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7fa17000e9c0 tx=0x7fa1700a9a10 comp rx=0 tx=0).stop 2024-09-21T06:45:30.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.581+0000 7fa18d175740 1 -- 172.21.15.7:0/1940221905 shutdown_connections 2024-09-21T06:45:30.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.581+0000 7fa18d175740 1 --2- 172.21.15.7:0/1940221905 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x564c10f149f0 0x564c1131b210 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:30.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.581+0000 7fa18d175740 1 --2- 172.21.15.7:0/1940221905 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564c10f56070 0x564c113152b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:30.588 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.581+0000 7fa18d175740 1 --2- 172.21.15.7:0/1940221905 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564c10f35390 0x564c11309450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:30.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.581+0000 7fa15ffff640 0 client.17592 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:45:30.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.581+0000 7fa18d175740 1 --2- 172.21.15.7:0/1940221905 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564c10f2d1b0 0x564c11308f10 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:30.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.581+0000 7fa18d175740 1 -- 172.21.15.7:0/1940221905 >> 172.21.15.7:0/1940221905 conn(0x564c10f4a460 msgr2=0x564c113009a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:30.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.581+0000 7fa18d175740 1 -- 172.21.15.7:0/1940221905 shutdown_connections 2024-09-21T06:45:30.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.581+0000 7fa18d175740 1 -- 172.21.15.7:0/1940221905 wait complete. 2024-09-21T06:45:30.589 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.582+0000 7fa18d175740 20 client.17592 trim_cache size 0 max 16384 2024-09-21T06:45:30.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.599+0000 7fa18d175740 1 Processor -- start 2024-09-21T06:45:30.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.599+0000 7fa18d175740 1 -- start start 2024-09-21T06:45:30.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.599+0000 7fa18d175740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564c10f2d1b0 0x564c113093d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:30.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.599+0000 7fa18d175740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564c10f35390 0x564c11300910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:30.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.599+0000 7fa18d175740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564c10f56070 0x564c11300e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:30.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.599+0000 7fa18d175740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa1801afae0 con 0x564c10f35390 2024-09-21T06:45:30.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.599+0000 7fa18d175740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa1801ad3b0 con 0x564c10f2d1b0 2024-09-21T06:45:30.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.599+0000 7fa18d175740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa1801ab220 con 0x564c10f56070 2024-09-21T06:45:30.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.599+0000 7fa17ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564c10f35390 0x564c11300910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:30.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.600+0000 7fa17ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564c10f35390 0x564c11300910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44290/0 (socket says 172.21.15.7:44290) 2024-09-21T06:45:30.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.600+0000 7fa17ffff640 1 -- 172.21.15.7:0/694295041 learned_addr learned my addr 172.21.15.7:0/694295041 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:30.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.600+0000 7fa18499d640 1 --2- 172.21.15.7:0/694295041 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564c10f2d1b0 0x564c113093d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:30.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.600+0000 7fa18519e640 1 --2- 172.21.15.7:0/694295041 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564c10f56070 0x564c11300e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:30.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.600+0000 7fa17ffff640 1 -- 172.21.15.7:0/694295041 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564c10f56070 msgr2=0x564c11300e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:30.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.600+0000 7fa17ffff640 1 --2- 172.21.15.7:0/694295041 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564c10f56070 0x564c11300e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:30.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.600+0000 7fa17ffff640 1 -- 172.21.15.7:0/694295041 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564c10f2d1b0 msgr2=0x564c113093d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:30.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.600+0000 7fa17ffff640 1 --2- 172.21.15.7:0/694295041 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564c10f2d1b0 0x564c113093d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:30.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.600+0000 7fa17ffff640 1 -- 172.21.15.7:0/694295041 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c11303b20 con 0x564c10f35390 2024-09-21T06:45:30.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.600+0000 7fa18499d640 1 --2- 172.21.15.7:0/694295041 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564c10f2d1b0 0x564c113093d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:30.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.600+0000 7fa17ffff640 1 --2- 172.21.15.7:0/694295041 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564c10f35390 0x564c11300910 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7fa17402a930 tx=0x7fa17402a9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78c709d8c396f6c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:30.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.600+0000 7fa1667fc640 1 -- 172.21.15.7:0/694295041 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa17403f040 con 0x564c10f35390 2024-09-21T06:45:30.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.600+0000 7fa1667fc640 1 -- 172.21.15.7:0/694295041 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa17404f070 con 0x564c10f35390 2024-09-21T06:45:30.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.600+0000 7fa1667fc640 1 -- 172.21.15.7:0/694295041 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa174035040 con 0x564c10f35390 2024-09-21T06:45:30.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.601+0000 7fa18d175740 1 -- 172.21.15.7:0/694295041 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564c10f35390 msgr2=0x564c11300910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:30.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.601+0000 7fa18d175740 1 --2- 172.21.15.7:0/694295041 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564c10f35390 0x564c11300910 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7fa17402a930 tx=0x7fa17402a9b0 comp rx=0 tx=0).stop 2024-09-21T06:45:30.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.601+0000 7fa18d175740 1 -- 172.21.15.7:0/694295041 shutdown_connections 2024-09-21T06:45:30.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.601+0000 7fa18d175740 1 --2- 172.21.15.7:0/694295041 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564c10f56070 0x564c11300e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:30.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.601+0000 7fa18d175740 1 --2- 172.21.15.7:0/694295041 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564c10f35390 0x564c11300910 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:30.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.601+0000 7fa18d175740 1 --2- 172.21.15.7:0/694295041 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564c10f2d1b0 0x564c113093d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:30.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.601+0000 7fa18d175740 1 -- 172.21.15.7:0/694295041 >> 172.21.15.7:0/694295041 conn(0x564c10f4a460 msgr2=0x564c11308cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:30.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.601+0000 7fa18d175740 1 -- 172.21.15.7:0/694295041 shutdown_connections 2024-09-21T06:45:30.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.601+0000 7fa18d175740 1 -- 172.21.15.7:0/694295041 wait complete. 2024-09-21T06:45:30.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.602+0000 7fa18d175740 1 -- start start 2024-09-21T06:45:30.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.602+0000 7fa18d175740 1 Processor -- start 2024-09-21T06:45:30.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.602+0000 7fa18d175740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564c10f2d1b0 0x564c1130d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:30.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.602+0000 7fa18d175740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564c10f35390 0x564c1130db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:30.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.602+0000 7fa18d175740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564c10f56070 0x564c11384bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:30.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.602+0000 7fa18d175740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa1801ab870 con 0x564c10f2d1b0 2024-09-21T06:45:30.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.602+0000 7fa18d175740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa1801acce0 con 0x564c10f56070 2024-09-21T06:45:30.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.602+0000 7fa18d175740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa1801abf40 con 0x564c10f35390 2024-09-21T06:45:30.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.602+0000 7fa18d175740 10 client.0 _ll_register_callbacks cb 0x7fa1700056d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:30.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.602+0000 7fa18499d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564c10f2d1b0 0x564c1130d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:30.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.602+0000 7fa18499d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564c10f2d1b0 0x564c1130d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44302/0 (socket says 172.21.15.7:44302) 2024-09-21T06:45:30.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.602+0000 7fa18499d640 1 -- 172.21.15.7:0/709420407 learned_addr learned my addr 172.21.15.7:0/709420407 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:30.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.603+0000 7fa17ffff640 1 --2- 172.21.15.7:0/709420407 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564c10f35390 0x564c1130db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:30.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.603+0000 7fa18519e640 1 --2- 172.21.15.7:0/709420407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564c10f56070 0x564c11384bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:30.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.603+0000 7fa18499d640 1 -- 172.21.15.7:0/709420407 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564c10f35390 msgr2=0x564c1130db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:30.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.603+0000 7fa18499d640 1 --2- 172.21.15.7:0/709420407 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564c10f35390 0x564c1130db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:30.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.603+0000 7fa18499d640 1 -- 172.21.15.7:0/709420407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564c10f56070 msgr2=0x564c11384bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:30.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.603+0000 7fa18499d640 1 --2- 172.21.15.7:0/709420407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564c10f56070 0x564c11384bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:30.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.603+0000 7fa18499d640 1 -- 172.21.15.7:0/709420407 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c11385110 con 0x564c10f2d1b0 2024-09-21T06:45:30.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.603+0000 7fa18499d640 1 --2- 172.21.15.7:0/709420407 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564c10f2d1b0 0x564c1130d5f0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7fa1700b7590 tx=0x7fa1700a9530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53895021e9b3ec1d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:30.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.603+0000 7fa15ffff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:45:30.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.603+0000 7fa15ffff640 1 -- 172.21.15.7:0/709420407 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1700e7e60 con 0x564c10f2d1b0 2024-09-21T06:45:30.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.603+0000 7fa15ffff640 1 -- 172.21.15.7:0/709420407 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7fa1700ac880 con 0x564c10f2d1b0 2024-09-21T06:45:30.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.603+0000 7fa18d175740 1 -- 172.21.15.7:0/709420407 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa17404f070 con 0x564c10f2d1b0 2024-09-21T06:45:30.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.603+0000 7fa15ffff640 1 -- 172.21.15.7:0/709420407 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa1700ad120 con 0x564c10f2d1b0 2024-09-21T06:45:30.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.603+0000 7fa18d175740 10 client.17598 fetch_fsmap learned FSMap version 25 2024-09-21T06:45:30.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.603+0000 7fa18d175740 1 -- 172.21.15.7:0/709420407 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564c11386270 con 0x564c10f2d1b0 2024-09-21T06:45:30.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.603+0000 7fa15ffff640 1 -- 172.21.15.7:0/709420407 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa17404f070 con 0x564c10f2d1b0 2024-09-21T06:45:30.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.604+0000 7fa15ffff640 1 -- 172.21.15.7:0/709420407 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa1700aece0 con 0x564c10f2d1b0 2024-09-21T06:45:30.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.604+0000 7fa18d175740 10 client.17598 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:45:30.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.604+0000 7fa18d175740 10 client.17598 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:45:30.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.604+0000 7fa18d175740 20 client.17598 populate_metadata read hostname 'smithi007' 2024-09-21T06:45:30.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.604+0000 7fa18d175740 1 --2- 172.21.15.7:0/709420407 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x564c10ee9da0 0x564c113889d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:30.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.604+0000 7fa18d175740 4 client.17598 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:45:30.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.604+0000 7fa18d175740 1 -- 172.21.15.7:0/709420407 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564c11271850 con 0x564c10ee9da0 2024-09-21T06:45:30.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.604+0000 7fa17ffff640 1 --2- 172.21.15.7:0/709420407 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x564c10ee9da0 0x564c113889d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:30.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.605+0000 7fa17ffff640 1 --2- 172.21.15.7:0/709420407 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x564c10ee9da0 0x564c113889d0 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c85bc758618d4717 server_cookie=ee8f10ee2b0875a2 in_seq=0 out_seq=0 2024-09-21T06:45:30.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.605+0000 7fa15ffff640 10 client.17598 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:45:30.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.605+0000 7fa15ffff640 1 -- 172.21.15.7:0/709420407 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5486 (crc 0 0 0) 0x564c11271850 con 0x564c10ee9da0 2024-09-21T06:45:30.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.605+0000 7fa15ffff640 10 client.17598 handle_command_reply: tid=0 2024-09-21T06:45:30.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.605+0000 7fa18d175740 1 client.17598 shutdown 2024-09-21T06:45:30.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.605+0000 7fa18d175740 1 -- 172.21.15.7:0/709420407 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564c10f2d1b0 msgr2=0x564c1130d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:30.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.605+0000 7fa18d175740 1 --2- 172.21.15.7:0/709420407 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564c10f2d1b0 0x564c1130d5f0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7fa1700b7590 tx=0x7fa1700a9530 comp rx=0 tx=0).stop 2024-09-21T06:45:30.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.605+0000 7fa18d175740 1 -- 172.21.15.7:0/709420407 shutdown_connections 2024-09-21T06:45:30.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.605+0000 7fa18d175740 1 --2- 172.21.15.7:0/709420407 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x564c10ee9da0 0x564c113889d0 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:30.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.605+0000 7fa18d175740 1 --2- 172.21.15.7:0/709420407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564c10f56070 0x564c11384bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:30.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.605+0000 7fa18d175740 1 --2- 172.21.15.7:0/709420407 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564c10f35390 0x564c1130db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:30.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.605+0000 7fa18d175740 1 --2- 172.21.15.7:0/709420407 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564c10f2d1b0 0x564c1130d5f0 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:30.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.605+0000 7fa18d175740 1 -- 172.21.15.7:0/709420407 >> 172.21.15.7:0/709420407 conn(0x564c10f4a460 msgr2=0x564c11300910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:30.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.605+0000 7fa15ffff640 0 client.17598 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:45:30.611 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.605+0000 7fa18d175740 1 -- 172.21.15.7:0/709420407 shutdown_connections 2024-09-21T06:45:30.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.605+0000 7fa18d175740 1 -- 172.21.15.7:0/709420407 wait complete. 2024-09-21T06:45:30.612 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.606+0000 7fa18d175740 20 client.17598 trim_cache size 0 max 16384 2024-09-21T06:45:30.612 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:45:30.612 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "no active scrubs running", 2024-09-21T06:45:30.612 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": {}, 2024-09-21T06:45:30.612 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_stats": { 2024-09-21T06:45:30.612 INFO:teuthology.orchestra.run.smithi007.stdout: "2ef7127c-8e1a-4ec7-930c-fdda4f777a52": { 2024-09-21T06:45:30.612 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:45:29.079652+0000", 2024-09-21T06:45:30.612 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:30.613 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:30.613 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:30.613 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:30.613 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:30.613 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:30.613 INFO:teuthology.orchestra.run.smithi007.stdout: "fe20df33-20a9-4e2f-be35-9778411fd6cd": { 2024-09-21T06:45:30.613 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:45:18.561779+0000", 2024-09-21T06:45:30.613 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:30.613 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:30.613 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:30.613 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:30.613 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:30.613 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:30.613 INFO:teuthology.orchestra.run.smithi007.stdout: "d98b2d47-c2db-4811-8b3e-ec744a20d9d6": { 2024-09-21T06:45:30.614 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:44:03.790680+0000", 2024-09-21T06:45:30.614 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:30.614 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:30.614 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:30.614 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:30.614 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:30.614 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:30.614 INFO:teuthology.orchestra.run.smithi007.stdout: "310a0ec8-44bb-49ed-a534-3bc91cb1ee9d": { 2024-09-21T06:45:30.614 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:40:55.373968+0000", 2024-09-21T06:45:30.614 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:30.614 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:30.614 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:30.614 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:30.614 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:30.614 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:30.615 INFO:teuthology.orchestra.run.smithi007.stdout: "dd792920-08a1-482d-8961-5c6a6f131599": { 2024-09-21T06:45:30.615 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:43:53.390806+0000", 2024-09-21T06:45:30.615 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:30.615 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:30.615 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:30.615 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:30.615 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:30.615 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:30.615 INFO:teuthology.orchestra.run.smithi007.stdout: "13441782-2231-4713-8ebd-068a941de47f": { 2024-09-21T06:45:30.615 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:39:30.219006+0000", 2024-09-21T06:45:30.615 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:30.615 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:30.615 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:30.615 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:30.616 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:30.616 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:30.616 INFO:teuthology.orchestra.run.smithi007.stdout: "02016ff7-8cc2-467e-a465-f69400f702cb": { 2024-09-21T06:45:30.616 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:44:25.093423+0000", 2024-09-21T06:45:30.616 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:30.616 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:30.616 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:30.616 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:30.616 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:30.616 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:30.616 INFO:teuthology.orchestra.run.smithi007.stdout: "b0327167-8c41-4286-8afc-7f0780972fd7": { 2024-09-21T06:45:30.616 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:38:36.828657+0000", 2024-09-21T06:45:30.616 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:30.616 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:30.616 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:30.617 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:30.617 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:30.617 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:30.617 INFO:teuthology.orchestra.run.smithi007.stdout: "d7b6a90c-9ae1-4e02-93ad-335a7e9df1d7": { 2024-09-21T06:45:30.617 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:39:19.226139+0000", 2024-09-21T06:45:30.617 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:30.617 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:30.617 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:30.617 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:30.617 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:30.617 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:30.617 INFO:teuthology.orchestra.run.smithi007.stdout: "3f7283b7-f175-4023-9191-177660b3a6be": { 2024-09-21T06:45:30.617 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:44:14.422552+0000", 2024-09-21T06:45:30.617 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:30.617 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:30.617 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:30.618 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:30.618 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:30.618 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:30.618 INFO:teuthology.orchestra.run.smithi007.stdout: "6231e9c1-14a2-40b5-be3c-76d87a0d733b": { 2024-09-21T06:45:30.618 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:37:02.484812+0000", 2024-09-21T06:45:30.618 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:30.618 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:30.618 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:30.618 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:30.618 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:30.618 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:30.618 INFO:teuthology.orchestra.run.smithi007.stdout: "a1ae5b3b-f158-44be-8ef4-d70e9ba879cc": { 2024-09-21T06:45:30.618 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:41:37.568453+0000", 2024-09-21T06:45:30.618 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:30.619 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:30.619 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:30.619 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:30.619 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:30.619 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:30.619 INFO:teuthology.orchestra.run.smithi007.stdout: "62fca477-b241-45f5-8185-bc78aeb8b19f": { 2024-09-21T06:45:30.619 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:40:12.744488+0000", 2024-09-21T06:45:30.619 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:30.619 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:30.619 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:30.619 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:30.619 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:30.619 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:30.619 INFO:teuthology.orchestra.run.smithi007.stdout: "5cbaaba2-6ab1-4f83-abd6-8c6eef4b5c42": { 2024-09-21T06:45:30.619 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:37:46.566272+0000", 2024-09-21T06:45:30.620 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:30.620 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:30.620 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:30.620 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:30.620 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:30.620 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:30.620 INFO:teuthology.orchestra.run.smithi007.stdout: "b466f071-ab32-427c-a0ed-73edea33145e": { 2024-09-21T06:45:30.620 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:43:01.151440+0000", 2024-09-21T06:45:30.620 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:30.620 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:30.620 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:30.620 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:30.620 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:30.620 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:30.620 INFO:teuthology.orchestra.run.smithi007.stdout: "ef9eaabd-003a-44fb-8373-c854a9e15a71": { 2024-09-21T06:45:30.621 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:42:19.467946+0000", 2024-09-21T06:45:30.621 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:30.621 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:30.621 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:30.621 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:30.621 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:30.621 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:30.621 INFO:teuthology.orchestra.run.smithi007.stdout: "a53a88e2-8599-4b25-a72c-3377770d50ea": { 2024-09-21T06:45:30.621 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:45:07.921907+0000", 2024-09-21T06:45:30.621 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:30.621 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:30.621 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:30.621 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:30.621 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:30.621 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:30.621 INFO:teuthology.orchestra.run.smithi007.stdout: "0b89345c-1f00-4efe-8ee9-4cb17e43584c": { 2024-09-21T06:45:30.622 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:36:19.500334+0000", 2024-09-21T06:45:30.622 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:30.622 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:30.622 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:30.622 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:30.622 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:30.622 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:30.622 INFO:teuthology.orchestra.run.smithi007.stdout: "3c5b7f3f-e9b3-4d48-8154-2d7d4700992e": { 2024-09-21T06:45:30.622 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:43:43.120930+0000", 2024-09-21T06:45:30.622 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:30.622 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:30.622 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:30.622 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:30.622 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:30.623 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:45:30.623 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:45:30.623 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:45:30.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.606+0000 7fa18599f640 1 -- 172.21.15.7:0/339775484 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa1680b6700 msgr2=0x7fa1680b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:30.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.606+0000 7fa18599f640 1 --2- 172.21.15.7:0/339775484 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa1680b6700 0x7fa1680b8c10 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa178009fd0 tx=0x7fa17800e040 comp rx=0 tx=0).stop 2024-09-21T06:45:30.623 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.606+0000 7fa18599f640 1 -- 172.21.15.7:0/339775484 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1801039b0 msgr2=0x7fa18019a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:30.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.606+0000 7fa18599f640 1 --2- 172.21.15.7:0/339775484 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1801039b0 0x7fa18019a330 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7fa17000e9f0 tx=0x7fa17000eeb0 comp rx=0 tx=0).stop 2024-09-21T06:45:30.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.606+0000 7fa18599f640 1 -- 172.21.15.7:0/339775484 shutdown_connections 2024-09-21T06:45:30.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.606+0000 7fa18599f640 1 --2- 172.21.15.7:0/339775484 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa1680b6700 0x7fa1680b8c10 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:30.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.606+0000 7fa18599f640 1 --2- 172.21.15.7:0/339775484 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa180109c40 0x7fa18019fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:30.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.606+0000 7fa18599f640 1 --2- 172.21.15.7:0/339775484 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1801092f0 0x7fa18019a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:30.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.606+0000 7fa18599f640 1 --2- 172.21.15.7:0/339775484 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1801039b0 0x7fa18019a330 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:30.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.606+0000 7fa18599f640 1 -- 172.21.15.7:0/339775484 >> 172.21.15.7:0/339775484 conn(0x7fa1800ff440 msgr2=0x7fa180101860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:30.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.606+0000 7fa18599f640 1 -- 172.21.15.7:0/339775484 shutdown_connections 2024-09-21T06:45:30.624 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:30.606+0000 7fa18599f640 1 -- 172.21.15.7:0/339775484 wait complete. 2024-09-21T06:45:31.206 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:45:30 smithi007 ceph-mon[30983]: pgmap v604: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 7 op/s 2024-09-21T06:45:31.270 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:45:30 smithi018 ceph-mon[34477]: pgmap v604: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 7 op/s 2024-09-21T06:45:31.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:45:30 smithi144 ceph-mon[34653]: pgmap v604: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 7 op/s 2024-09-21T06:45:31.378 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:45:31.378 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:45:31.635 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:45:32.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:32.127+0000 7f812faa2640 1 -- 172.21.15.7:0/4096775301 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8128102fa0 msgr2=0x7f812810fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:32.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:32.127+0000 7f812faa2640 1 --2- 172.21.15.7:0/4096775301 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8128102fa0 0x7f812810fcc0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f8118009900 tx=0x7f811802a480 comp rx=0 tx=0).stop 2024-09-21T06:45:32.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:32.127+0000 7f812faa2640 1 -- 172.21.15.7:0/4096775301 shutdown_connections 2024-09-21T06:45:32.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:32.127+0000 7f812faa2640 1 --2- 172.21.15.7:0/4096775301 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8128110200 0x7f8128112620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:32.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:32.127+0000 7f812faa2640 1 --2- 172.21.15.7:0/4096775301 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8128102fa0 0x7f812810fcc0 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:32.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:32.127+0000 7f812faa2640 1 --2- 172.21.15.7:0/4096775301 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8128102650 0x7f8128102a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:32.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:32.127+0000 7f812faa2640 1 -- 172.21.15.7:0/4096775301 >> 172.21.15.7:0/4096775301 conn(0x7f8128079760 msgr2=0x7f8128079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:32.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:32.127+0000 7f812faa2640 1 -- 172.21.15.7:0/4096775301 shutdown_connections 2024-09-21T06:45:32.129 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:32.127+0000 7f812faa2640 1 -- 172.21.15.7:0/4096775301 wait complete. 2024-09-21T06:45:32.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:32.127+0000 7f812faa2640 1 Processor -- start 2024-09-21T06:45:32.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:32.128+0000 7f812faa2640 1 -- start start 2024-09-21T06:45:32.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:32.128+0000 7f812faa2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8128102650 0x7f812819c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:32.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:32.128+0000 7f812faa2640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8128102fa0 0x7f812819cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:32.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:32.128+0000 7f812faa2640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8128110200 0x7f81281a1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:32.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:32.128+0000 7f812faa2640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f8128115ca0 con 0x7f8128102fa0 2024-09-21T06:45:32.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:32.128+0000 7f812faa2640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8128115b20 con 0x7f8128102650 2024-09-21T06:45:32.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:32.128+0000 7f812faa2640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8128115e20 con 0x7f8128110200 2024-09-21T06:45:32.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:32.128+0000 7f812d03d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8128102fa0 0x7f812819cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:32.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:32.128+0000 7f812d03d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8128102fa0 0x7f812819cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44330/0 (socket says 172.21.15.7:44330) 2024-09-21T06:45:32.131 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:32.128+0000 7f812d03d640 1 -- 172.21.15.7:0/2160246715 learned_addr learned my addr 172.21.15.7:0/2160246715 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:32.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:32.128+0000 7f812d83e640 1 --2- 172.21.15.7:0/2160246715 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8128102650 0x7f812819c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:32.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:32.128+0000 7f812e03f640 1 --2- 172.21.15.7:0/2160246715 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8128110200 0x7f81281a1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:32.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:32.128+0000 7f812d03d640 1 -- 172.21.15.7:0/2160246715 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8128110200 msgr2=0x7f81281a1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:32.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:32.128+0000 7f812d03d640 1 --2- 172.21.15.7:0/2160246715 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8128110200 0x7f81281a1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:32.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:32.128+0000 7f812d03d640 1 -- 172.21.15.7:0/2160246715 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8128102650 msgr2=0x7f812819c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:32.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:32.128+0000 7f812d03d640 1 --2- 172.21.15.7:0/2160246715 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8128102650 0x7f812819c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:32.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:32.128+0000 7f812d03d640 1 -- 172.21.15.7:0/2160246715 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81281a2600 con 0x7f8128102fa0 2024-09-21T06:45:32.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:32.128+0000 7f812d83e640 1 --2- 172.21.15.7:0/2160246715 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8128102650 0x7f812819c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:32.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:32.129+0000 7f812d03d640 1 --2- 172.21.15.7:0/2160246715 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8128102fa0 0x7f812819cc30 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f8118005940 tx=0x7f81180040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:32.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:32.129+0000 7f811effd640 1 -- 172.21.15.7:0/2160246715 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f811803f030 con 0x7f8128102fa0 2024-09-21T06:45:32.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:32.129+0000 7f811effd640 1 -- 172.21.15.7:0/2160246715 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81180044c0 con 0x7f8128102fa0 2024-09-21T06:45:32.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:32.129+0000 7f812faa2640 1 -- 172.21.15.7:0/2160246715 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81281a2890 con 0x7f8128102fa0 2024-09-21T06:45:32.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:32.129+0000 7f811effd640 1 -- 172.21.15.7:0/2160246715 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8118035070 con 0x7f8128102fa0 2024-09-21T06:45:32.132 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:32.129+0000 7f812faa2640 1 -- 172.21.15.7:0/2160246715 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81281a9050 con 0x7f8128102fa0 2024-09-21T06:45:32.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:32.130+0000 7f812faa2640 1 -- 172.21.15.7:0/2160246715 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f812806c1f0 con 0x7f8128102fa0 2024-09-21T06:45:32.133 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:32.131+0000 7f811effd640 1 -- 172.21.15.7:0/2160246715 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f8118042030 con 0x7f8128102fa0 2024-09-21T06:45:32.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:32.133+0000 7f811effd640 1 --2- 172.21.15.7:0/2160246715 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f81140b6680 0x7f81140b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:32.134 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:32.133+0000 7f812d83e640 1 --2- 172.21.15.7:0/2160246715 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f81140b6680 0x7f81140b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:32.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:32.133+0000 7f811effd640 1 -- 172.21.15.7:0/2160246715 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7f8118107d40 con 0x7f8128102fa0 2024-09-21T06:45:32.135 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:32.133+0000 7f812d83e640 1 --2- 172.21.15.7:0/2160246715 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f81140b6680 0x7f81140b8b90 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f8124009c20 tx=0x7f8124005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:32.138 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:32.136+0000 7f811effd640 1 -- 172.21.15.7:0/2160246715 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f81180ce300 con 0x7f8128102fa0 2024-09-21T06:45:32.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:32.362+0000 7f812faa2640 1 -- 172.21.15.7:0/2160246715 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8128102a60 con 0x7f8128102fa0 2024-09-21T06:45:32.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:32.363+0000 7f811effd640 1 -- 172.21.15.7:0/2160246715 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11899 (secure 0 0 0) 0x7f81180d26e0 con 0x7f8128102fa0 2024-09-21T06:45:32.365 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:45:32.365 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-21T06:36:10:753693+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2015971546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2015971546},{"type":"v1","addr":"172.21.15.7:6835","nonce":2015971546}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/2350816224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":2350816224},{"type":"v1","addr":"172.21.15.7:6837","nonce":2350816224}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14823,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/1669980572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":1669980572},{"type":"v1","addr":"172.21.15.7:6839","nonce":1669980572}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14835,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/2528308973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":2528308973},{"type":"v1","addr":"172.21.15.7:6841","nonce":2528308973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24623,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1337382979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1337382979},{"type":"v1","addr":"172.21.15.18:6833","nonce":1337382979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/2751454345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":2751454345},{"type":"v1","addr":"172.21.15.144:6833","nonce":2751454345}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:34:24.627168+0000","modified":"2024-09-21T06:36:10.737288+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24716,"mds_1":24688,"mds_2":24686},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24656":{"gid":24656,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6835/158884796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":158884796},{"type":"v1","addr":"172.21.15.18:6835","nonce":158884796}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6835/3636739922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3636739922},{"type":"v1","addr":"172.21.15.144:6835","nonce":3636739922}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24673":{"gid":24673,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6837/1126341753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":1126341753},{"type":"v1","addr":"172.21.15.144:6837","nonce":1126341753}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.18:6837/1539670694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1539670694},{"type":"v1","addr":"172.21.15.18:6837","nonce":1539670694}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24688":{"gid":24688,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.144:6839/4027821922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":4027821922},{"type":"v1","addr":"172.21.15.144:6839","nonce":4027821922}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24716":{"gid":24716,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.18:6839/3798713532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":3798713532},{"type":"v1","addr":"172.21.15.18:6839","nonce":3798713532}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24716,"qdb_cluster":[24716,24688,24686]},"id":1}]} 2024-09-21T06:45:32.365 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-21T06:45:32.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:32.365+0000 7f812faa2640 1 -- 172.21.15.7:0/2160246715 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f81140b6680 msgr2=0x7f81140b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:32.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:32.365+0000 7f812faa2640 1 --2- 172.21.15.7:0/2160246715 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f81140b6680 0x7f81140b8b90 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f8124009c20 tx=0x7f8124005f90 comp rx=0 tx=0).stop 2024-09-21T06:45:32.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:32.365+0000 7f812faa2640 1 -- 172.21.15.7:0/2160246715 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8128102fa0 msgr2=0x7f812819cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:32.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:32.365+0000 7f812faa2640 1 --2- 172.21.15.7:0/2160246715 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8128102fa0 0x7f812819cc30 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f8118005940 tx=0x7f81180040c0 comp rx=0 tx=0).stop 2024-09-21T06:45:32.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:32.365+0000 7f812faa2640 1 -- 172.21.15.7:0/2160246715 shutdown_connections 2024-09-21T06:45:32.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:32.365+0000 7f812faa2640 1 --2- 172.21.15.7:0/2160246715 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f81140b6680 0x7f81140b8b90 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:32.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:32.365+0000 7f812faa2640 1 --2- 172.21.15.7:0/2160246715 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8128110200 0x7f81281a1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:32.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:32.365+0000 7f812faa2640 1 --2- 172.21.15.7:0/2160246715 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8128102fa0 0x7f812819cc30 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:32.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:32.365+0000 7f812faa2640 1 --2- 172.21.15.7:0/2160246715 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8128102650 0x7f812819c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:32.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:32.365+0000 7f812faa2640 1 -- 172.21.15.7:0/2160246715 >> 172.21.15.7:0/2160246715 conn(0x7f8128079760 msgr2=0x7f8128109d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:32.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:32.365+0000 7f812faa2640 1 -- 172.21.15.7:0/2160246715 shutdown_connections 2024-09-21T06:45:32.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:32.365+0000 7f812faa2640 1 -- 172.21.15.7:0/2160246715 wait complete. 2024-09-21T06:45:33.031 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:45:33.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:45:32 smithi144 ceph-mon[34653]: pgmap v605: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 7 op/s 2024-09-21T06:45:33.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:45:32 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/2160246715' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:45:33.288 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:45:33.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:45:32 smithi007 ceph-mon[30983]: pgmap v605: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 7 op/s 2024-09-21T06:45:33.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:45:32 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2160246715' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:45:33.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:45:32 smithi018 ceph-mon[34477]: pgmap v605: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 7 op/s 2024-09-21T06:45:33.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:45:32 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/2160246715' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:45:33.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.804+0000 7f9fd823f640 1 -- 172.21.15.7:0/2918673814 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9fd01083a0 msgr2=0x7f9fd01087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:33.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.804+0000 7f9fd823f640 1 --2- 172.21.15.7:0/2918673814 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9fd01083a0 0x7f9fd01087b0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f9fc0009900 tx=0x7f9fc002a3f0 comp rx=0 tx=0).stop 2024-09-21T06:45:33.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.805+0000 7f9fd823f640 1 -- 172.21.15.7:0/2918673814 shutdown_connections 2024-09-21T06:45:33.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.805+0000 7f9fd823f640 1 --2- 172.21.15.7:0/2918673814 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9fd0108cf0 0x7f9fd010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:33.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.805+0000 7f9fd823f640 1 --2- 172.21.15.7:0/2918673814 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9fd01083a0 0x7f9fd01087b0 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:33.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.805+0000 7f9fd823f640 1 --2- 172.21.15.7:0/2918673814 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9fd0102a60 0x7f9fd0102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:33.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.805+0000 7f9fd823f640 1 -- 172.21.15.7:0/2918673814 >> 172.21.15.7:0/2918673814 conn(0x7f9fd0079730 msgr2=0x7f9fd0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:33.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.805+0000 7f9fd823f640 1 -- 172.21.15.7:0/2918673814 shutdown_connections 2024-09-21T06:45:33.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.805+0000 7f9fd823f640 1 -- 172.21.15.7:0/2918673814 wait complete. 2024-09-21T06:45:33.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.805+0000 7f9fd823f640 1 Processor -- start 2024-09-21T06:45:33.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.805+0000 7f9fd823f640 1 -- start start 2024-09-21T06:45:33.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.806+0000 7f9fd823f640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9fd0102a60 0x7f9fd019b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:33.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.806+0000 7f9fd823f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9fd01083a0 0x7f9fd019b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:33.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.806+0000 7f9fd823f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9fd0108cf0 0x7f9fd019bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:33.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.806+0000 7f9fd823f640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd01129a0 con 0x7f9fd01083a0 2024-09-21T06:45:33.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.806+0000 7f9fd823f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd0112820 con 0x7f9fd0108cf0 2024-09-21T06:45:33.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.806+0000 7f9fd823f640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd0112b20 con 0x7f9fd0102a60 2024-09-21T06:45:33.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.806+0000 7f9fd57da640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9fd01083a0 0x7f9fd019b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:33.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.806+0000 7f9fd57da640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9fd01083a0 0x7f9fd019b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44338/0 (socket says 172.21.15.7:44338) 2024-09-21T06:45:33.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.806+0000 7f9fd57da640 1 -- 172.21.15.7:0/1116672872 learned_addr learned my addr 172.21.15.7:0/1116672872 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:33.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.806+0000 7f9fd5fdb640 1 --2- 172.21.15.7:0/1116672872 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9fd0102a60 0x7f9fd019b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:33.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.806+0000 7f9fd67dc640 1 --2- 172.21.15.7:0/1116672872 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9fd0108cf0 0x7f9fd019bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:33.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.806+0000 7f9fd57da640 1 -- 172.21.15.7:0/1116672872 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9fd0102a60 msgr2=0x7f9fd019b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:33.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.806+0000 7f9fd57da640 1 --2- 172.21.15.7:0/1116672872 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9fd0102a60 0x7f9fd019b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:33.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.806+0000 7f9fd57da640 1 -- 172.21.15.7:0/1116672872 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9fd0108cf0 msgr2=0x7f9fd019bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:33.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.806+0000 7f9fd57da640 1 --2- 172.21.15.7:0/1116672872 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9fd0108cf0 0x7f9fd019bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:33.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.806+0000 7f9fd57da640 1 -- 172.21.15.7:0/1116672872 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fd01a6530 con 0x7f9fd01083a0 2024-09-21T06:45:33.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.806+0000 7f9fd5fdb640 1 --2- 172.21.15.7:0/1116672872 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9fd0102a60 0x7f9fd019b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:33.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.806+0000 7f9fd57da640 1 --2- 172.21.15.7:0/1116672872 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9fd01083a0 0x7f9fd019b870 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f9fc0031a90 tx=0x7f9fc0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:33.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.807+0000 7f9fc6ffd640 1 -- 172.21.15.7:0/1116672872 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fc003f030 con 0x7f9fd01083a0 2024-09-21T06:45:33.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.807+0000 7f9fc6ffd640 1 -- 172.21.15.7:0/1116672872 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9fc0003cb0 con 0x7f9fd01083a0 2024-09-21T06:45:33.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.807+0000 7f9fd823f640 1 -- 172.21.15.7:0/1116672872 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fd01a67c0 con 0x7f9fd01083a0 2024-09-21T06:45:33.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.807+0000 7f9fc6ffd640 1 -- 172.21.15.7:0/1116672872 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fc0035070 con 0x7f9fd01083a0 2024-09-21T06:45:33.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.807+0000 7f9fd823f640 1 -- 172.21.15.7:0/1116672872 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fd01a6d20 con 0x7f9fd01083a0 2024-09-21T06:45:33.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.810+0000 7f9fde7b3740 1 Processor -- start 2024-09-21T06:45:33.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.810+0000 7f9fde7b3740 1 -- start start 2024-09-21T06:45:33.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.810+0000 7f9fde7b3740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbea47d070 0x55dbea8242c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:33.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.811+0000 7f9fde7b3740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dbea4541b0 0x55dbea824800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:33.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.811+0000 7f9fde7b3740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dbea45c390 0x55dbea824d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:33.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.811+0000 7f9fde7b3740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55dbea79aea0 con 0x55dbea45c390 2024-09-21T06:45:33.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.811+0000 7f9fde7b3740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55dbea78a2d0 con 0x55dbea47d070 2024-09-21T06:45:33.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.811+0000 7f9fde7b3740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55dbea78e0e0 con 0x55dbea4541b0 2024-09-21T06:45:33.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.811+0000 7f9fc6ffd640 1 -- 172.21.15.7:0/1116672872 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f9fc0042030 con 0x7f9fd01083a0 2024-09-21T06:45:33.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.811+0000 7f9fd57da640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dbea45c390 0x55dbea824d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:33.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.811+0000 7f9fd57da640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dbea45c390 0x55dbea824d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44342/0 (socket says 172.21.15.7:44342) 2024-09-21T06:45:33.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.811+0000 7f9fd57da640 1 -- 172.21.15.7:0/4137460418 learned_addr learned my addr 172.21.15.7:0/4137460418 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:33.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.811+0000 7f9fd67dc640 1 --2- 172.21.15.7:0/4137460418 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbea47d070 0x55dbea8242c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:33.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.811+0000 7f9fd5fdb640 1 --2- 172.21.15.7:0/4137460418 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dbea4541b0 0x55dbea824800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:33.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.811+0000 7f9fd57da640 1 -- 172.21.15.7:0/4137460418 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dbea4541b0 msgr2=0x55dbea824800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:33.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.811+0000 7f9fd57da640 1 --2- 172.21.15.7:0/4137460418 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dbea4541b0 0x55dbea824800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:33.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.811+0000 7f9fd57da640 1 -- 172.21.15.7:0/4137460418 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbea47d070 msgr2=0x55dbea8242c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:33.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.811+0000 7f9fd57da640 1 --2- 172.21.15.7:0/4137460418 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbea47d070 0x55dbea8242c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:33.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.811+0000 7f9fd57da640 1 -- 172.21.15.7:0/4137460418 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbea4e8650 con 0x55dbea45c390 2024-09-21T06:45:33.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.811+0000 7f9fd57da640 1 --2- 172.21.15.7:0/4137460418 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dbea45c390 0x55dbea824d40 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f9fc0105440 tx=0x7f9fc010bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=717cd0372ca2118d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:33.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.812+0000 7f9fc6ffd640 1 --2- 172.21.15.7:0/1116672872 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f9fbc0b66b0 0x7f9fbc0b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:33.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.812+0000 7f9fbbfff640 1 -- 172.21.15.7:0/4137460418 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fc00cd370 con 0x55dbea45c390 2024-09-21T06:45:33.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.812+0000 7f9fd67dc640 1 --2- 172.21.15.7:0/1116672872 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f9fbc0b66b0 0x7f9fbc0b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:33.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.812+0000 7f9fbbfff640 1 -- 172.21.15.7:0/4137460418 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9fc00ce300 con 0x55dbea45c390 2024-09-21T06:45:33.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.812+0000 7f9fbbfff640 1 -- 172.21.15.7:0/4137460418 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fc00cd550 con 0x55dbea45c390 2024-09-21T06:45:33.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.812+0000 7f9fc6ffd640 1 -- 172.21.15.7:0/1116672872 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7f9fc0107da0 con 0x7f9fd01083a0 2024-09-21T06:45:33.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.813+0000 7f9fde7b3740 1 -- 172.21.15.7:0/4137460418 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dbea45c390 msgr2=0x55dbea824d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:33.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.813+0000 7f9fd67dc640 1 --2- 172.21.15.7:0/1116672872 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f9fbc0b66b0 0x7f9fbc0b8bc0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f9fc800b4d0 tx=0x7f9fc800e040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:33.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.813+0000 7f9fde7b3740 1 --2- 172.21.15.7:0/4137460418 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dbea45c390 0x55dbea824d40 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f9fc0105440 tx=0x7f9fc010bf50 comp rx=0 tx=0).stop 2024-09-21T06:45:33.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.813+0000 7f9fde7b3740 1 -- 172.21.15.7:0/4137460418 shutdown_connections 2024-09-21T06:45:33.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.813+0000 7f9fde7b3740 1 --2- 172.21.15.7:0/4137460418 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dbea45c390 0x55dbea824d40 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:33.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.813+0000 7f9fde7b3740 1 --2- 172.21.15.7:0/4137460418 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dbea4541b0 0x55dbea824800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:33.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.813+0000 7f9fde7b3740 1 --2- 172.21.15.7:0/4137460418 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbea47d070 0x55dbea8242c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:33.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.813+0000 7f9fde7b3740 1 -- 172.21.15.7:0/4137460418 >> 172.21.15.7:0/4137460418 conn(0x55dbea471460 msgr2=0x55dbea8221b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:33.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.813+0000 7f9fde7b3740 1 -- 172.21.15.7:0/4137460418 shutdown_connections 2024-09-21T06:45:33.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.813+0000 7f9fde7b3740 1 -- 172.21.15.7:0/4137460418 wait complete. 2024-09-21T06:45:33.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.813+0000 7f9fde7b3740 1 -- start start 2024-09-21T06:45:33.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.814+0000 7f9fde7b3740 1 Processor -- start 2024-09-21T06:45:33.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.814+0000 7f9fde7b3740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbea4541b0 0x55dbea82f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:33.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.814+0000 7f9fde7b3740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dbea45c390 0x55dbea82fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:33.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.814+0000 7f9fde7b3740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dbea47d070 0x55dbea830330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:33.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.814+0000 7f9fde7b3740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55dbea5eb700 con 0x55dbea45c390 2024-09-21T06:45:33.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.814+0000 7f9fde7b3740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55dbea725160 con 0x55dbea4541b0 2024-09-21T06:45:33.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.814+0000 7f9fde7b3740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55dbea832860 con 0x55dbea47d070 2024-09-21T06:45:33.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.814+0000 7f9fde7b3740 10 client.0 _ll_register_callbacks cb 0x55dbea73e9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:33.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.814+0000 7f9fd57da640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dbea45c390 0x55dbea82fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:33.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.814+0000 7f9fd57da640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dbea45c390 0x55dbea82fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44354/0 (socket says 172.21.15.7:44354) 2024-09-21T06:45:33.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.814+0000 7f9fd57da640 1 -- 172.21.15.7:0/4129288080 learned_addr learned my addr 172.21.15.7:0/4129288080 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:33.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.814+0000 7f9fd5fdb640 1 --2- 172.21.15.7:0/4129288080 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbea4541b0 0x55dbea82f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:33.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.814+0000 7f9fd67dc640 1 --2- 172.21.15.7:0/4129288080 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dbea47d070 0x55dbea830330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:33.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.814+0000 7f9fd57da640 1 -- 172.21.15.7:0/4129288080 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dbea47d070 msgr2=0x55dbea830330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:33.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.814+0000 7f9fd57da640 1 --2- 172.21.15.7:0/4129288080 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dbea47d070 0x55dbea830330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:33.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.814+0000 7f9fd57da640 1 -- 172.21.15.7:0/4129288080 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbea4541b0 msgr2=0x55dbea82f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:33.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.815+0000 7f9fd57da640 1 --2- 172.21.15.7:0/4129288080 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbea4541b0 0x55dbea82f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:33.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.815+0000 7f9fd57da640 1 -- 172.21.15.7:0/4129288080 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dbea752c90 con 0x55dbea45c390 2024-09-21T06:45:33.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.815+0000 7f9fd57da640 1 --2- 172.21.15.7:0/4129288080 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dbea45c390 0x55dbea82fdf0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f9fc00cae70 tx=0x7f9fc0005de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dea30c95ca95da38 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:33.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.815+0000 7f9fb97fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:45:33.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.815+0000 7f9fb97fa640 1 -- 172.21.15.7:0/4129288080 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fc00cd740 con 0x55dbea45c390 2024-09-21T06:45:33.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.815+0000 7f9fb97fa640 1 -- 172.21.15.7:0/4129288080 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7f9fc010ba60 con 0x55dbea45c390 2024-09-21T06:45:33.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.815+0000 7f9fde7b3740 1 -- 172.21.15.7:0/4129288080 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9fc00ce300 con 0x55dbea45c390 2024-09-21T06:45:33.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.815+0000 7f9fb97fa640 1 -- 172.21.15.7:0/4129288080 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9fc0049020 con 0x55dbea45c390 2024-09-21T06:45:33.836 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.815+0000 7f9fde7b3740 10 client.17616 fetch_fsmap learned FSMap version 25 2024-09-21T06:45:33.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.815+0000 7f9fde7b3740 1 -- 172.21.15.7:0/4129288080 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55dbea83e420 con 0x55dbea45c390 2024-09-21T06:45:33.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.815+0000 7f9fb97fa640 1 -- 172.21.15.7:0/4129288080 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9fc00ce300 con 0x55dbea45c390 2024-09-21T06:45:33.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.815+0000 7f9fb97fa640 1 -- 172.21.15.7:0/4129288080 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9fc00c9e70 con 0x55dbea45c390 2024-09-21T06:45:33.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.816+0000 7f9fde7b3740 10 client.17616 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:45:33.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.816+0000 7f9fde7b3740 10 client.17616 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-21T06:45:33.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.816+0000 7f9fde7b3740 20 client.17616 populate_metadata read hostname 'smithi007' 2024-09-21T06:45:33.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.816+0000 7f9fde7b3740 1 --2- 172.21.15.7:0/4129288080 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x55dbea43b9f0 0x55dbea8417a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:33.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.816+0000 7f9fde7b3740 4 client.17616 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:45:33.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.816+0000 7f9fde7b3740 1 -- 172.21.15.7:0/4129288080 --> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dbea79cdf0 con 0x55dbea43b9f0 2024-09-21T06:45:33.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.816+0000 7f9fd5fdb640 1 --2- 172.21.15.7:0/4129288080 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x55dbea43b9f0 0x55dbea8417a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:33.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.816+0000 7f9fb97fa640 10 client.17616 ms_handle_connect on v2:172.21.15.18:6836/1539670694 2024-09-21T06:45:33.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.816+0000 7f9fd5fdb640 1 --2- 172.21.15.7:0/4129288080 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x55dbea43b9f0 0x55dbea8417a0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3748e676c9023f68 server_cookie=2158d6d5199dbe13 in_seq=0 out_seq=0 2024-09-21T06:45:33.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.817+0000 7f9fb97fa640 1 -- 172.21.15.7:0/4129288080 <== mds.2 v2:172.21.15.18:6836/1539670694 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55dbea79cdf0 con 0x55dbea43b9f0 2024-09-21T06:45:33.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.817+0000 7f9fb97fa640 10 client.17616 handle_command_reply: tid=0 2024-09-21T06:45:33.837 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.817+0000 7f9fde7b3740 1 client.17616 shutdown 2024-09-21T06:45:33.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.817+0000 7f9fde7b3740 1 -- 172.21.15.7:0/4129288080 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dbea45c390 msgr2=0x55dbea82fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:33.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.817+0000 7f9fde7b3740 1 --2- 172.21.15.7:0/4129288080 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dbea45c390 0x55dbea82fdf0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f9fc00cae70 tx=0x7f9fc0005de0 comp rx=0 tx=0).stop 2024-09-21T06:45:33.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.817+0000 7f9fde7b3740 1 -- 172.21.15.7:0/4129288080 shutdown_connections 2024-09-21T06:45:33.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.817+0000 7f9fde7b3740 1 --2- 172.21.15.7:0/4129288080 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x55dbea43b9f0 0x55dbea8417a0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:33.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.817+0000 7f9fde7b3740 1 --2- 172.21.15.7:0/4129288080 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dbea47d070 0x55dbea830330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:33.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.817+0000 7f9fb97fa640 0 client.17616 ms_handle_reset on v2:172.21.15.18:6836/1539670694 2024-09-21T06:45:33.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.817+0000 7f9fde7b3740 1 --2- 172.21.15.7:0/4129288080 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dbea45c390 0x55dbea82fdf0 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:33.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.817+0000 7f9fde7b3740 1 --2- 172.21.15.7:0/4129288080 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbea4541b0 0x55dbea82f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:33.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.817+0000 7f9fde7b3740 1 -- 172.21.15.7:0/4129288080 >> 172.21.15.7:0/4129288080 conn(0x55dbea471460 msgr2=0x55dbea827450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:33.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.817+0000 7f9fde7b3740 1 -- 172.21.15.7:0/4129288080 shutdown_connections 2024-09-21T06:45:33.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.818+0000 7f9fde7b3740 1 -- 172.21.15.7:0/4129288080 wait complete. 2024-09-21T06:45:33.838 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.818+0000 7f9fde7b3740 20 client.17616 trim_cache size 0 max 16384 2024-09-21T06:45:33.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.831+0000 7f9fde7b3740 1 Processor -- start 2024-09-21T06:45:33.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.831+0000 7f9fde7b3740 1 -- start start 2024-09-21T06:45:33.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.831+0000 7f9fde7b3740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dbea4541b0 0x55dbea831790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:33.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.831+0000 7f9fde7b3740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbea45c390 0x55dbea83b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:33.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.831+0000 7f9fde7b3740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dbea47d070 0x55dbea83b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:33.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.831+0000 7f9fde7b3740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd01b1e20 con 0x55dbea4541b0 2024-09-21T06:45:33.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.831+0000 7f9fde7b3740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd01af6f0 con 0x55dbea45c390 2024-09-21T06:45:33.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.831+0000 7f9fde7b3740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd01ad560 con 0x55dbea47d070 2024-09-21T06:45:33.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.831+0000 7f9fd5fdb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dbea4541b0 0x55dbea831790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:33.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.831+0000 7f9fd5fdb640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dbea4541b0 0x55dbea831790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44364/0 (socket says 172.21.15.7:44364) 2024-09-21T06:45:33.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.831+0000 7f9fd5fdb640 1 -- 172.21.15.7:0/2270419098 learned_addr learned my addr 172.21.15.7:0/2270419098 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:33.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.831+0000 7f9fd57da640 1 --2- 172.21.15.7:0/2270419098 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbea45c390 0x55dbea83b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:33.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.832+0000 7f9fd67dc640 1 --2- 172.21.15.7:0/2270419098 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dbea47d070 0x55dbea83b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:33.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.832+0000 7f9fd5fdb640 1 -- 172.21.15.7:0/2270419098 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dbea47d070 msgr2=0x55dbea83b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:33.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.832+0000 7f9fd5fdb640 1 --2- 172.21.15.7:0/2270419098 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dbea47d070 0x55dbea83b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:33.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.832+0000 7f9fd5fdb640 1 -- 172.21.15.7:0/2270419098 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbea45c390 msgr2=0x55dbea83b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:33.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.832+0000 7f9fd5fdb640 1 --2- 172.21.15.7:0/2270419098 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbea45c390 0x55dbea83b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:33.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.832+0000 7f9fd5fdb640 1 -- 172.21.15.7:0/2270419098 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dbea8265b0 con 0x55dbea4541b0 2024-09-21T06:45:33.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.832+0000 7f9fd67dc640 1 --2- 172.21.15.7:0/2270419098 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dbea47d070 0x55dbea83b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:45:33.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.832+0000 7f9fd5fdb640 1 --2- 172.21.15.7:0/2270419098 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dbea4541b0 0x55dbea831790 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x55dbea841f50 tx=0x7f9fcc010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6513cf9bdaf8455f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:33.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.832+0000 7f9fbb7fe640 1 -- 172.21.15.7:0/2270419098 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fcc023630 con 0x55dbea4541b0 2024-09-21T06:45:33.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.832+0000 7f9fbb7fe640 1 -- 172.21.15.7:0/2270419098 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9fcc01b860 con 0x55dbea4541b0 2024-09-21T06:45:33.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.832+0000 7f9fbb7fe640 1 -- 172.21.15.7:0/2270419098 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fcc022910 con 0x55dbea4541b0 2024-09-21T06:45:33.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.833+0000 7f9fde7b3740 1 -- 172.21.15.7:0/2270419098 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dbea4541b0 msgr2=0x55dbea831790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:33.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.833+0000 7f9fde7b3740 1 --2- 172.21.15.7:0/2270419098 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dbea4541b0 0x55dbea831790 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x55dbea841f50 tx=0x7f9fcc010800 comp rx=0 tx=0).stop 2024-09-21T06:45:33.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.833+0000 7f9fde7b3740 1 -- 172.21.15.7:0/2270419098 shutdown_connections 2024-09-21T06:45:33.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.833+0000 7f9fde7b3740 1 --2- 172.21.15.7:0/2270419098 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dbea47d070 0x55dbea83b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:33.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.833+0000 7f9fde7b3740 1 --2- 172.21.15.7:0/2270419098 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbea45c390 0x55dbea83b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:33.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.833+0000 7f9fde7b3740 1 --2- 172.21.15.7:0/2270419098 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dbea4541b0 0x55dbea831790 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:33.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.833+0000 7f9fde7b3740 1 -- 172.21.15.7:0/2270419098 >> 172.21.15.7:0/2270419098 conn(0x55dbea471460 msgr2=0x55dbea83a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:33.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.833+0000 7f9fde7b3740 1 -- 172.21.15.7:0/2270419098 shutdown_connections 2024-09-21T06:45:33.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.833+0000 7f9fde7b3740 1 -- 172.21.15.7:0/2270419098 wait complete. 2024-09-21T06:45:33.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.833+0000 7f9fde7b3740 1 -- start start 2024-09-21T06:45:33.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.833+0000 7f9fde7b3740 1 Processor -- start 2024-09-21T06:45:33.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.834+0000 7f9fde7b3740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dbea4541b0 0x55dbea837a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:33.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.834+0000 7f9fde7b3740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dbea45c390 0x55dbea837f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:33.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.834+0000 7f9fde7b3740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbea47d070 0x55dbea8a5540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:33.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.834+0000 7f9fde7b3740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd01adbb0 con 0x55dbea45c390 2024-09-21T06:45:33.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.834+0000 7f9fde7b3740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd01af020 con 0x55dbea47d070 2024-09-21T06:45:33.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.834+0000 7f9fde7b3740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd01ae280 con 0x55dbea4541b0 2024-09-21T06:45:33.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.834+0000 7f9fde7b3740 10 client.0 _ll_register_callbacks cb 0x7f9fc8009650 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:33.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.834+0000 7f9fd57da640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dbea45c390 0x55dbea837f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:33.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.834+0000 7f9fd57da640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dbea45c390 0x55dbea837f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44380/0 (socket says 172.21.15.7:44380) 2024-09-21T06:45:33.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.834+0000 7f9fd57da640 1 -- 172.21.15.7:0/3185947069 learned_addr learned my addr 172.21.15.7:0/3185947069 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:33.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.834+0000 7f9fd67dc640 1 --2- 172.21.15.7:0/3185947069 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbea47d070 0x55dbea8a5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:33.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.834+0000 7f9fd5fdb640 1 --2- 172.21.15.7:0/3185947069 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dbea4541b0 0x55dbea837a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:33.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.834+0000 7f9fd57da640 1 -- 172.21.15.7:0/3185947069 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dbea4541b0 msgr2=0x55dbea837a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:33.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.834+0000 7f9fd57da640 1 --2- 172.21.15.7:0/3185947069 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dbea4541b0 0x55dbea837a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:33.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.834+0000 7f9fd57da640 1 -- 172.21.15.7:0/3185947069 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbea47d070 msgr2=0x55dbea8a5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:33.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.834+0000 7f9fd57da640 1 --2- 172.21.15.7:0/3185947069 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbea47d070 0x55dbea8a5540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:33.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.834+0000 7f9fd57da640 1 -- 172.21.15.7:0/3185947069 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dbea8a5a80 con 0x55dbea45c390 2024-09-21T06:45:33.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.835+0000 7f9fd57da640 1 --2- 172.21.15.7:0/3185947069 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dbea45c390 0x55dbea837f40 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f9fc00cd900 tx=0x7f9fc010b850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=545a49c615db025b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:33.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.835+0000 7f9fb97fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:45:33.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.835+0000 7f9fb97fa640 1 -- 172.21.15.7:0/3185947069 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fc00cd9d0 con 0x55dbea45c390 2024-09-21T06:45:33.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.835+0000 7f9fb97fa640 1 -- 172.21.15.7:0/3185947069 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7f9fc003bc50 con 0x55dbea45c390 2024-09-21T06:45:33.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.835+0000 7f9fde7b3740 1 -- 172.21.15.7:0/3185947069 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9fcc01b860 con 0x55dbea45c390 2024-09-21T06:45:33.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.835+0000 7f9fb97fa640 1 -- 172.21.15.7:0/3185947069 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9fc00c9550 con 0x55dbea45c390 2024-09-21T06:45:33.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.835+0000 7f9fde7b3740 10 client.17622 fetch_fsmap learned FSMap version 25 2024-09-21T06:45:33.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.835+0000 7f9fde7b3740 1 -- 172.21.15.7:0/3185947069 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55dbea8a5a80 con 0x55dbea45c390 2024-09-21T06:45:33.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.835+0000 7f9fb97fa640 1 -- 172.21.15.7:0/3185947069 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9fcc01b860 con 0x55dbea45c390 2024-09-21T06:45:33.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.835+0000 7f9fb97fa640 1 -- 172.21.15.7:0/3185947069 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f9fc0105780 con 0x55dbea45c390 2024-09-21T06:45:33.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.835+0000 7f9fde7b3740 10 client.17622 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:45:33.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.835+0000 7f9fde7b3740 10 client.17622 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-21T06:45:33.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.835+0000 7f9fde7b3740 20 client.17622 populate_metadata read hostname 'smithi007' 2024-09-21T06:45:33.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.835+0000 7f9fde7b3740 1 --2- 172.21.15.7:0/3185947069 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x55dbea410da0 0x55dbea8b2f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:33.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.835+0000 7f9fde7b3740 4 client.17622 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:45:33.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.835+0000 7f9fde7b3740 1 -- 172.21.15.7:0/3185947069 --> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55dbea7988a0 con 0x55dbea410da0 2024-09-21T06:45:33.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.836+0000 7f9fd5fdb640 1 --2- 172.21.15.7:0/3185947069 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x55dbea410da0 0x55dbea8b2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:33.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.836+0000 7f9fb97fa640 10 client.17622 ms_handle_connect on v2:172.21.15.18:6836/1539670694 2024-09-21T06:45:33.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.836+0000 7f9fd5fdb640 1 --2- 172.21.15.7:0/3185947069 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x55dbea410da0 0x55dbea8b2f30 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b39b0b7041aea571 server_cookie=20d25e90a333ec3c in_seq=0 out_seq=0 2024-09-21T06:45:33.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.836+0000 7f9fb97fa640 1 -- 172.21.15.7:0/3185947069 <== mds.2 v2:172.21.15.18:6836/1539670694 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55dbea7988a0 con 0x55dbea410da0 2024-09-21T06:45:33.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.836+0000 7f9fb97fa640 10 client.17622 handle_command_reply: tid=0 2024-09-21T06:45:33.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.836+0000 7f9fde7b3740 1 client.17622 shutdown 2024-09-21T06:45:33.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.836+0000 7f9fde7b3740 1 -- 172.21.15.7:0/3185947069 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dbea45c390 msgr2=0x55dbea837f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:33.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.836+0000 7f9fde7b3740 1 --2- 172.21.15.7:0/3185947069 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dbea45c390 0x55dbea837f40 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f9fc00cd900 tx=0x7f9fc010b850 comp rx=0 tx=0).stop 2024-09-21T06:45:33.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.837+0000 7f9fde7b3740 1 -- 172.21.15.7:0/3185947069 shutdown_connections 2024-09-21T06:45:33.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.837+0000 7f9fde7b3740 1 --2- 172.21.15.7:0/3185947069 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x55dbea410da0 0x55dbea8b2f30 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:33.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.837+0000 7f9fde7b3740 1 --2- 172.21.15.7:0/3185947069 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dbea47d070 0x55dbea8a5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:33.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.837+0000 7f9fde7b3740 1 --2- 172.21.15.7:0/3185947069 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55dbea45c390 0x55dbea837f40 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:33.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.837+0000 7f9fb97fa640 0 client.17622 ms_handle_reset on v2:172.21.15.18:6836/1539670694 2024-09-21T06:45:33.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.837+0000 7f9fde7b3740 1 --2- 172.21.15.7:0/3185947069 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55dbea4541b0 0x55dbea837a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:33.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.837+0000 7f9fde7b3740 1 -- 172.21.15.7:0/3185947069 >> 172.21.15.7:0/3185947069 conn(0x55dbea471460 msgr2=0x55dbea8314f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:33.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.837+0000 7f9fde7b3740 1 -- 172.21.15.7:0/3185947069 shutdown_connections 2024-09-21T06:45:33.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.837+0000 7f9fde7b3740 1 -- 172.21.15.7:0/3185947069 wait complete. 2024-09-21T06:45:33.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.837+0000 7f9fde7b3740 20 client.17622 trim_cache size 0 max 16384 2024-09-21T06:45:33.849 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:45:33.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.837+0000 7f9fd823f640 1 -- 172.21.15.7:0/1116672872 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f9fbc0b66b0 msgr2=0x7f9fbc0b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:33.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.837+0000 7f9fd823f640 1 --2- 172.21.15.7:0/1116672872 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f9fbc0b66b0 0x7f9fbc0b8bc0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f9fc800b4d0 tx=0x7f9fc800e040 comp rx=0 tx=0).stop 2024-09-21T06:45:33.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.837+0000 7f9fd823f640 1 -- 172.21.15.7:0/1116672872 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9fd01083a0 msgr2=0x7f9fd019b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:33.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.837+0000 7f9fd823f640 1 --2- 172.21.15.7:0/1116672872 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9fd01083a0 0x7f9fd019b870 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f9fc0031a90 tx=0x7f9fc0004270 comp rx=0 tx=0).stop 2024-09-21T06:45:33.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.837+0000 7f9fd823f640 1 -- 172.21.15.7:0/1116672872 shutdown_connections 2024-09-21T06:45:33.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.837+0000 7f9fd823f640 1 --2- 172.21.15.7:0/1116672872 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f9fbc0b66b0 0x7f9fbc0b8bc0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:33.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.838+0000 7f9fd823f640 1 --2- 172.21.15.7:0/1116672872 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9fd0108cf0 0x7f9fd019bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:33.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.838+0000 7f9fd823f640 1 --2- 172.21.15.7:0/1116672872 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9fd01083a0 0x7f9fd019b870 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:33.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.838+0000 7f9fd823f640 1 --2- 172.21.15.7:0/1116672872 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9fd0102a60 0x7f9fd019b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:33.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.838+0000 7f9fd823f640 1 -- 172.21.15.7:0/1116672872 >> 172.21.15.7:0/1116672872 conn(0x7f9fd0079730 msgr2=0x7f9fd01052c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:33.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.838+0000 7f9fd823f640 1 -- 172.21.15.7:0/1116672872 shutdown_connections 2024-09-21T06:45:33.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:33.838+0000 7f9fd823f640 1 -- 172.21.15.7:0/1116672872 wait complete. 2024-09-21T06:45:34.582 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:45:34.843 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:45:35.239 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:45:34 smithi007 ceph-mon[30983]: pgmap v606: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 8 op/s 2024-09-21T06:45:35.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:45:34 smithi144 ceph-mon[34653]: pgmap v606: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 8 op/s 2024-09-21T06:45:35.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:45:34 smithi018 ceph-mon[34477]: pgmap v606: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 8 op/s 2024-09-21T06:45:35.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.332+0000 7fddf7b88640 1 -- 172.21.15.7:0/1223119507 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fddf0108d10 msgr2=0x7fddf010f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:35.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.332+0000 7fddf7b88640 1 --2- 172.21.15.7:0/1223119507 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fddf0108d10 0x7fddf010f540 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7fdde8009ca0 tx=0x7fdde802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:45:35.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.332+0000 7fddf7b88640 1 -- 172.21.15.7:0/1223119507 shutdown_connections 2024-09-21T06:45:35.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.332+0000 7fddf7b88640 1 --2- 172.21.15.7:0/1223119507 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fddf0108d10 0x7fddf010f540 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:35.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.332+0000 7fddf7b88640 1 --2- 172.21.15.7:0/1223119507 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddf01083c0 0x7fddf01087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:35.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.332+0000 7fddf7b88640 1 --2- 172.21.15.7:0/1223119507 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fddf0102a80 0x7fddf0102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:35.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.332+0000 7fddf7b88640 1 -- 172.21.15.7:0/1223119507 >> 172.21.15.7:0/1223119507 conn(0x7fddf0079740 msgr2=0x7fddf0079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:35.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.332+0000 7fddf7b88640 1 -- 172.21.15.7:0/1223119507 shutdown_connections 2024-09-21T06:45:35.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.332+0000 7fddf7b88640 1 -- 172.21.15.7:0/1223119507 wait complete. 2024-09-21T06:45:35.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.332+0000 7fddf7b88640 1 Processor -- start 2024-09-21T06:45:35.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.332+0000 7fddf7b88640 1 -- start start 2024-09-21T06:45:35.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.333+0000 7fddf7b88640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddf0102a80 0x7fddf019a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:35.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.333+0000 7fddf7b88640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fddf01083c0 0x7fddf019aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:35.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.333+0000 7fddf7b88640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fddf0108d10 0x7fddf019fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:35.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.333+0000 7fddf7b88640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fddf0113aa0 con 0x7fddf0108d10 2024-09-21T06:45:35.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.333+0000 7fddf7b88640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fddf0113920 con 0x7fddf01083c0 2024-09-21T06:45:35.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.333+0000 7fddf7b88640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fddf0113c20 con 0x7fddf0102a80 2024-09-21T06:45:35.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.333+0000 7fddf6125640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fddf0108d10 0x7fddf019fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:35.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.333+0000 7fddf6125640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fddf0108d10 0x7fddf019fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44392/0 (socket says 172.21.15.7:44392) 2024-09-21T06:45:35.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.333+0000 7fddf6125640 1 -- 172.21.15.7:0/1890919372 learned_addr learned my addr 172.21.15.7:0/1890919372 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:35.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.333+0000 7fddf5123640 1 --2- 172.21.15.7:0/1890919372 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fddf01083c0 0x7fddf019aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:35.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.333+0000 7fddf5924640 1 --2- 172.21.15.7:0/1890919372 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddf0102a80 0x7fddf019a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:35.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.333+0000 7fddf6125640 1 -- 172.21.15.7:0/1890919372 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddf0102a80 msgr2=0x7fddf019a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:35.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.333+0000 7fddf6125640 1 --2- 172.21.15.7:0/1890919372 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddf0102a80 0x7fddf019a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:35.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.333+0000 7fddf6125640 1 -- 172.21.15.7:0/1890919372 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fddf01083c0 msgr2=0x7fddf019aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:35.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.333+0000 7fddf6125640 1 --2- 172.21.15.7:0/1890919372 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fddf01083c0 0x7fddf019aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:35.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.333+0000 7fddf6125640 1 -- 172.21.15.7:0/1890919372 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddf01a0400 con 0x7fddf0108d10 2024-09-21T06:45:35.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.333+0000 7fddf6125640 1 --2- 172.21.15.7:0/1890919372 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fddf0108d10 0x7fddf019fcd0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7fdde8005cc0 tx=0x7fdde802f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:35.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.334+0000 7fdde6ffd640 1 -- 172.21.15.7:0/1890919372 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdde8003bf0 con 0x7fddf0108d10 2024-09-21T06:45:35.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.334+0000 7fddf7b88640 1 -- 172.21.15.7:0/1890919372 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddf01a0690 con 0x7fddf0108d10 2024-09-21T06:45:35.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.334+0000 7fdde6ffd640 1 -- 172.21.15.7:0/1890919372 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdde8003d90 con 0x7fddf0108d10 2024-09-21T06:45:35.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.334+0000 7fdde6ffd640 1 -- 172.21.15.7:0/1890919372 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdde802fbc0 con 0x7fddf0108d10 2024-09-21T06:45:35.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.334+0000 7fddf7b88640 1 -- 172.21.15.7:0/1890919372 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddf01a6e50 con 0x7fddf0108d10 2024-09-21T06:45:35.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.337+0000 7fddfe0fc740 1 Processor -- start 2024-09-21T06:45:35.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.337+0000 7fdde6ffd640 1 -- 172.21.15.7:0/1890919372 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7fdde802fd60 con 0x7fddf0108d10 2024-09-21T06:45:35.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.337+0000 7fddfe0fc740 1 -- start start 2024-09-21T06:45:35.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.337+0000 7fddfe0fc740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5623b3aa7070 0x5623b3e4e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:35.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.337+0000 7fddfe0fc740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5623b3a7e1b0 0x5623b3e4e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:35.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.337+0000 7fddfe0fc740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5623b3a86390 0x5623b3e4ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:35.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.337+0000 7fddfe0fc740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5623b3dc4ea0 con 0x5623b3a86390 2024-09-21T06:45:35.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.337+0000 7fddfe0fc740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5623b3db42d0 con 0x5623b3a7e1b0 2024-09-21T06:45:35.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.337+0000 7fddfe0fc740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5623b3db80e0 con 0x5623b3aa7070 2024-09-21T06:45:35.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.338+0000 7fddf5123640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5623b3a86390 0x5623b3e4ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:35.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.338+0000 7fddf5123640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5623b3a86390 0x5623b3e4ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44406/0 (socket says 172.21.15.7:44406) 2024-09-21T06:45:35.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.338+0000 7fddf5123640 1 -- 172.21.15.7:0/2727866232 learned_addr learned my addr 172.21.15.7:0/2727866232 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:35.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.338+0000 7fddf5924640 1 --2- 172.21.15.7:0/2727866232 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5623b3a7e1b0 0x5623b3e4e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:35.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.338+0000 7fddf5123640 1 --2- 172.21.15.7:0/2727866232 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5623b3aa7070 0x5623b3e4e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:35.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.338+0000 7fdde6ffd640 1 --2- 172.21.15.7:0/1890919372 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fdddc0b6680 0x7fdddc0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:35.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.338+0000 7fddf5924640 1 -- 172.21.15.7:0/2727866232 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5623b3aa7070 msgr2=0x5623b3e4e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:35.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.338+0000 7fddf5924640 1 --2- 172.21.15.7:0/2727866232 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5623b3aa7070 0x5623b3e4e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:35.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.338+0000 7fddf5924640 1 -- 172.21.15.7:0/2727866232 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5623b3a86390 msgr2=0x5623b3e4ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:35.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.338+0000 7fddf5924640 1 --2- 172.21.15.7:0/2727866232 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5623b3a86390 0x5623b3e4ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:35.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.338+0000 7fddf6125640 1 --2- 172.21.15.7:0/1890919372 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fdddc0b6680 0x7fdddc0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:35.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.338+0000 7fddf5924640 1 -- 172.21.15.7:0/2727866232 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623b3b12650 con 0x5623b3a7e1b0 2024-09-21T06:45:35.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.338+0000 7fddf5123640 1 --2- 172.21.15.7:0/2727866232 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5623b3a86390 0x5623b3e4ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:45:35.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.338+0000 7fdde6ffd640 1 -- 172.21.15.7:0/1890919372 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7fdde8108b80 con 0x7fddf0108d10 2024-09-21T06:45:35.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.338+0000 7fddf5924640 1 --2- 172.21.15.7:0/2727866232 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5623b3a7e1b0 0x5623b3e4e800 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fddec00bbf0 tx=0x7fddec0107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46e7b91a92b5607d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:35.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.338+0000 7fdddbfff640 1 -- 172.21.15.7:0/2727866232 <== mon.2 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddec004030 con 0x5623b3a7e1b0 2024-09-21T06:45:35.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.339+0000 7fdddbfff640 1 -- 172.21.15.7:0/2727866232 <== mon.2 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fddec0035f0 con 0x5623b3a7e1b0 2024-09-21T06:45:35.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.339+0000 7fddf6125640 1 --2- 172.21.15.7:0/1890919372 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fdddc0b6680 0x7fdddc0b8b90 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fdde81063f0 tx=0x7fdde80c32a0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:35.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.339+0000 7fdddbfff640 1 -- 172.21.15.7:0/2727866232 <== mon.2 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddec011680 con 0x5623b3a7e1b0 2024-09-21T06:45:35.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.339+0000 7fddfe0fc740 1 -- 172.21.15.7:0/2727866232 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5623b3a7e1b0 msgr2=0x5623b3e4e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:35.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.339+0000 7fddfe0fc740 1 --2- 172.21.15.7:0/2727866232 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5623b3a7e1b0 0x5623b3e4e800 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fddec00bbf0 tx=0x7fddec0107a0 comp rx=0 tx=0).stop 2024-09-21T06:45:35.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.339+0000 7fddfe0fc740 1 -- 172.21.15.7:0/2727866232 shutdown_connections 2024-09-21T06:45:35.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.339+0000 7fddfe0fc740 1 --2- 172.21.15.7:0/2727866232 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5623b3a86390 0x5623b3e4ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:35.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.339+0000 7fddfe0fc740 1 --2- 172.21.15.7:0/2727866232 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5623b3a7e1b0 0x5623b3e4e800 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:35.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.339+0000 7fddfe0fc740 1 --2- 172.21.15.7:0/2727866232 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5623b3aa7070 0x5623b3e4e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:35.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.339+0000 7fddfe0fc740 1 -- 172.21.15.7:0/2727866232 >> 172.21.15.7:0/2727866232 conn(0x5623b3a9b460 msgr2=0x5623b3e4c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:35.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.340+0000 7fddfe0fc740 1 -- 172.21.15.7:0/2727866232 shutdown_connections 2024-09-21T06:45:35.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.340+0000 7fddfe0fc740 1 -- 172.21.15.7:0/2727866232 wait complete. 2024-09-21T06:45:35.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.340+0000 7fddfe0fc740 1 -- start start 2024-09-21T06:45:35.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.340+0000 7fddfe0fc740 1 Processor -- start 2024-09-21T06:45:35.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.340+0000 7fddfe0fc740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5623b3a7e1b0 0x5623b3e59930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:35.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.341+0000 7fddfe0fc740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5623b3a86390 0x5623b3e59e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:35.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.341+0000 7fddfe0fc740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5623b3aa7070 0x5623b3e65dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:35.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.341+0000 7fddfe0fc740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5623b3c15700 con 0x5623b3aa7070 2024-09-21T06:45:35.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.341+0000 7fddfe0fc740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5623b3d4f160 con 0x5623b3a86390 2024-09-21T06:45:35.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.341+0000 7fddfe0fc740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5623b3e5caa0 con 0x5623b3a7e1b0 2024-09-21T06:45:35.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.341+0000 7fddfe0fc740 10 client.0 _ll_register_callbacks cb 0x5623b3d689e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:35.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.341+0000 7fddf5123640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5623b3aa7070 0x5623b3e65dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:35.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.341+0000 7fddf5123640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5623b3aa7070 0x5623b3e65dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44422/0 (socket says 172.21.15.7:44422) 2024-09-21T06:45:35.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.341+0000 7fddf5123640 1 -- 172.21.15.7:0/3964413737 learned_addr learned my addr 172.21.15.7:0/3964413737 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:35.396 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.341+0000 7fddf5123640 1 --2- 172.21.15.7:0/3964413737 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5623b3a7e1b0 0x5623b3e59930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:35.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.341+0000 7fddf5924640 1 --2- 172.21.15.7:0/3964413737 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5623b3a86390 0x5623b3e59e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:35.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.341+0000 7fddf5123640 1 -- 172.21.15.7:0/3964413737 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5623b3a7e1b0 msgr2=0x5623b3e59930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:35.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.341+0000 7fddf5123640 1 --2- 172.21.15.7:0/3964413737 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5623b3a7e1b0 0x5623b3e59930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:35.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.341+0000 7fddf5123640 1 -- 172.21.15.7:0/3964413737 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5623b3a86390 msgr2=0x5623b3e59e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:35.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.341+0000 7fddf5123640 1 --2- 172.21.15.7:0/3964413737 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5623b3a86390 0x5623b3e59e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:35.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.341+0000 7fddf5123640 1 -- 172.21.15.7:0/3964413737 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623b3d7cc90 con 0x5623b3aa7070 2024-09-21T06:45:35.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.341+0000 7fddf5123640 1 --2- 172.21.15.7:0/3964413737 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5623b3aa7070 0x5623b3e65dc0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7fdde0005900 tx=0x7fdde0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1ba306b469c1722 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:35.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.341+0000 7fddd97fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:45:35.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.341+0000 7fddd97fa640 1 -- 172.21.15.7:0/3964413737 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdde0004020 con 0x5623b3aa7070 2024-09-21T06:45:35.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.341+0000 7fddd97fa640 1 -- 172.21.15.7:0/3964413737 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7fdde0019070 con 0x5623b3aa7070 2024-09-21T06:45:35.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.341+0000 7fddfe0fc740 1 -- 172.21.15.7:0/3964413737 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fddec0035f0 con 0x5623b3aa7070 2024-09-21T06:45:35.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.342+0000 7fddd97fa640 1 -- 172.21.15.7:0/3964413737 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fdde002b050 con 0x5623b3aa7070 2024-09-21T06:45:35.397 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.342+0000 7fddfe0fc740 10 client.17634 fetch_fsmap learned FSMap version 25 2024-09-21T06:45:35.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.342+0000 7fddfe0fc740 1 -- 172.21.15.7:0/3964413737 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5623b3e68800 con 0x5623b3aa7070 2024-09-21T06:45:35.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.342+0000 7fddd97fa640 1 -- 172.21.15.7:0/3964413737 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fddec0035f0 con 0x5623b3aa7070 2024-09-21T06:45:35.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.342+0000 7fddd97fa640 1 -- 172.21.15.7:0/3964413737 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fdde00035f0 con 0x5623b3aa7070 2024-09-21T06:45:35.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.342+0000 7fddfe0fc740 10 client.17634 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:45:35.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.342+0000 7fddfe0fc740 10 client.17634 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:45:35.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.342+0000 7fddfe0fc740 20 client.17634 populate_metadata read hostname 'smithi007' 2024-09-21T06:45:35.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.342+0000 7fddfe0fc740 1 --2- 172.21.15.7:0/3964413737 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x5623b3a659f0 0x5623b3e6bd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:35.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.342+0000 7fddfe0fc740 4 client.17634 mds_command: new command op to 24688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:45:35.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.342+0000 7fddfe0fc740 1 -- 172.21.15.7:0/3964413737 --> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5623b3dc6df0 con 0x5623b3a659f0 2024-09-21T06:45:35.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.342+0000 7fddf5924640 1 --2- 172.21.15.7:0/3964413737 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x5623b3a659f0 0x5623b3e6bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:35.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.343+0000 7fddf5924640 1 --2- 172.21.15.7:0/3964413737 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x5623b3a659f0 0x5623b3e6bd10 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=43be19065bc299d1 server_cookie=e06b604bd15430a8 in_seq=0 out_seq=0 2024-09-21T06:45:35.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.343+0000 7fddd97fa640 10 client.17634 ms_handle_connect on v2:172.21.15.144:6838/4027821922 2024-09-21T06:45:35.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.344+0000 7fddd97fa640 1 -- 172.21.15.7:0/3964413737 <== mds.1 v2:172.21.15.144:6838/4027821922 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5623b3dc6df0 con 0x5623b3a659f0 2024-09-21T06:45:35.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.344+0000 7fddd97fa640 10 client.17634 handle_command_reply: tid=0 2024-09-21T06:45:35.398 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.344+0000 7fddfe0fc740 1 client.17634 shutdown 2024-09-21T06:45:35.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.344+0000 7fddfe0fc740 1 -- 172.21.15.7:0/3964413737 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5623b3aa7070 msgr2=0x5623b3e65dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:35.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.344+0000 7fddfe0fc740 1 --2- 172.21.15.7:0/3964413737 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5623b3aa7070 0x5623b3e65dc0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7fdde0005900 tx=0x7fdde0004730 comp rx=0 tx=0).stop 2024-09-21T06:45:35.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.344+0000 7fddfe0fc740 1 -- 172.21.15.7:0/3964413737 shutdown_connections 2024-09-21T06:45:35.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.344+0000 7fddfe0fc740 1 --2- 172.21.15.7:0/3964413737 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x5623b3a659f0 0x5623b3e6bd10 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:35.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.344+0000 7fddfe0fc740 1 --2- 172.21.15.7:0/3964413737 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5623b3aa7070 0x5623b3e65dc0 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:35.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.344+0000 7fddfe0fc740 1 --2- 172.21.15.7:0/3964413737 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5623b3a86390 0x5623b3e59e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:35.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.344+0000 7fddd97fa640 0 client.17634 ms_handle_reset on v2:172.21.15.144:6838/4027821922 2024-09-21T06:45:35.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.344+0000 7fddfe0fc740 1 --2- 172.21.15.7:0/3964413737 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5623b3a7e1b0 0x5623b3e59930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:35.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.344+0000 7fddfe0fc740 1 -- 172.21.15.7:0/3964413737 >> 172.21.15.7:0/3964413737 conn(0x5623b3a9b460 msgr2=0x5623b3e51450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:35.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.344+0000 7fddfe0fc740 1 -- 172.21.15.7:0/3964413737 shutdown_connections 2024-09-21T06:45:35.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.344+0000 7fddfe0fc740 1 -- 172.21.15.7:0/3964413737 wait complete. 2024-09-21T06:45:35.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.344+0000 7fddfe0fc740 20 client.17634 trim_cache size 0 max 16384 2024-09-21T06:45:35.399 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.358+0000 7fddfe0fc740 1 Processor -- start 2024-09-21T06:45:35.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.358+0000 7fddfe0fc740 1 -- start start 2024-09-21T06:45:35.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.358+0000 7fddfe0fc740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5623b3a659f0 0x5623b3e4fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:35.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.358+0000 7fddfe0fc740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5623b3a7e1b0 0x5623b3e5b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:35.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.358+0000 7fddfe0fc740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5623b3a86390 0x5623b3e65cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:35.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.358+0000 7fddfe0fc740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fddf01b1e60 con 0x5623b3a86390 2024-09-21T06:45:35.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.358+0000 7fddfe0fc740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fddf01af730 con 0x5623b3a659f0 2024-09-21T06:45:35.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.358+0000 7fddfe0fc740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fddf01ad5a0 con 0x5623b3a7e1b0 2024-09-21T06:45:35.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.358+0000 7fddf5123640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5623b3a86390 0x5623b3e65cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:35.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.358+0000 7fddf5123640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5623b3a86390 0x5623b3e65cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44430/0 (socket says 172.21.15.7:44430) 2024-09-21T06:45:35.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.358+0000 7fddf5123640 1 -- 172.21.15.7:0/81345459 learned_addr learned my addr 172.21.15.7:0/81345459 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:35.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.358+0000 7fddf5123640 1 --2- 172.21.15.7:0/81345459 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5623b3a659f0 0x5623b3e4fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:35.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.358+0000 7fddf5924640 1 --2- 172.21.15.7:0/81345459 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5623b3a7e1b0 0x5623b3e5b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:35.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.358+0000 7fddf5123640 1 -- 172.21.15.7:0/81345459 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5623b3a7e1b0 msgr2=0x5623b3e5b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:35.400 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.358+0000 7fddf5123640 1 --2- 172.21.15.7:0/81345459 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5623b3a7e1b0 0x5623b3e5b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:35.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.358+0000 7fddf5123640 1 -- 172.21.15.7:0/81345459 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5623b3a659f0 msgr2=0x5623b3e4fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:35.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.358+0000 7fddf5123640 1 --2- 172.21.15.7:0/81345459 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5623b3a659f0 0x5623b3e4fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:35.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.358+0000 7fddf5123640 1 -- 172.21.15.7:0/81345459 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623b3e51120 con 0x5623b3a86390 2024-09-21T06:45:35.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.359+0000 7fddf5123640 1 --2- 172.21.15.7:0/81345459 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5623b3a86390 0x5623b3e65cc0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7fdde0003bb0 tx=0x7fdde00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2e56aaffbeca1c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:35.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.359+0000 7fdddb7fe640 1 -- 172.21.15.7:0/81345459 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdde00036b0 con 0x5623b3a86390 2024-09-21T06:45:35.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.359+0000 7fdddb7fe640 1 -- 172.21.15.7:0/81345459 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdde000db80 con 0x5623b3a86390 2024-09-21T06:45:35.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.359+0000 7fdddb7fe640 1 -- 172.21.15.7:0/81345459 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdde00041c0 con 0x5623b3a86390 2024-09-21T06:45:35.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.360+0000 7fddfe0fc740 1 -- 172.21.15.7:0/81345459 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5623b3a86390 msgr2=0x5623b3e65cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:35.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.360+0000 7fddfe0fc740 1 --2- 172.21.15.7:0/81345459 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5623b3a86390 0x5623b3e65cc0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7fdde0003bb0 tx=0x7fdde00046c0 comp rx=0 tx=0).stop 2024-09-21T06:45:35.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.360+0000 7fddfe0fc740 1 -- 172.21.15.7:0/81345459 shutdown_connections 2024-09-21T06:45:35.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.360+0000 7fddfe0fc740 1 --2- 172.21.15.7:0/81345459 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5623b3a86390 0x5623b3e65cc0 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:35.401 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.360+0000 7fddfe0fc740 1 --2- 172.21.15.7:0/81345459 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5623b3a7e1b0 0x5623b3e5b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:35.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.360+0000 7fddfe0fc740 1 --2- 172.21.15.7:0/81345459 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5623b3a659f0 0x5623b3e4fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:35.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.360+0000 7fddfe0fc740 1 -- 172.21.15.7:0/81345459 >> 172.21.15.7:0/81345459 conn(0x5623b3a9b460 msgr2=0x5623b3e5ae50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:35.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.360+0000 7fddfe0fc740 1 -- 172.21.15.7:0/81345459 shutdown_connections 2024-09-21T06:45:35.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.360+0000 7fddfe0fc740 1 -- 172.21.15.7:0/81345459 wait complete. 2024-09-21T06:45:35.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.360+0000 7fddfe0fc740 1 -- start start 2024-09-21T06:45:35.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.360+0000 7fddfe0fc740 1 Processor -- start 2024-09-21T06:45:35.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.361+0000 7fddfe0fc740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5623b3a659f0 0x5623b3e62320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:35.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.361+0000 7fddfe0fc740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5623b3a7e1b0 0x5623b3e5e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:35.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.361+0000 7fddfe0fc740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5623b3a86390 0x5623b3e5ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:35.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.361+0000 7fddfe0fc740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fddf01adbf0 con 0x5623b3a659f0 2024-09-21T06:45:35.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.361+0000 7fddfe0fc740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fddf01af060 con 0x5623b3a7e1b0 2024-09-21T06:45:35.402 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.361+0000 7fddfe0fc740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fddf01ae2c0 con 0x5623b3a86390 2024-09-21T06:45:35.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.361+0000 7fddfe0fc740 10 client.0 _ll_register_callbacks cb 0x7fdde00114a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:35.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.361+0000 7fddf5123640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5623b3a659f0 0x5623b3e62320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:35.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.361+0000 7fddf5123640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5623b3a659f0 0x5623b3e62320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44444/0 (socket says 172.21.15.7:44444) 2024-09-21T06:45:35.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.361+0000 7fddf5123640 1 -- 172.21.15.7:0/527394543 learned_addr learned my addr 172.21.15.7:0/527394543 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:35.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.361+0000 7fddf5924640 1 --2- 172.21.15.7:0/527394543 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5623b3a7e1b0 0x5623b3e5e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:35.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.361+0000 7fddf5123640 1 -- 172.21.15.7:0/527394543 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5623b3a86390 msgr2=0x5623b3e5ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:35.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.361+0000 7fddf5123640 1 --2- 172.21.15.7:0/527394543 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5623b3a86390 0x5623b3e5ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:35.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.361+0000 7fddf5123640 1 -- 172.21.15.7:0/527394543 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5623b3a7e1b0 msgr2=0x5623b3e5e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:35.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.361+0000 7fddf5123640 1 --2- 172.21.15.7:0/527394543 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5623b3a7e1b0 0x5623b3e5e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:35.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.361+0000 7fddf5123640 1 -- 172.21.15.7:0/527394543 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623b3e5f2e0 con 0x5623b3a659f0 2024-09-21T06:45:35.403 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.361+0000 7fddf5123640 1 --2- 172.21.15.7:0/527394543 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5623b3a659f0 0x5623b3e62320 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7fdde000b010 tx=0x7fdde0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a385f55951482ba6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:35.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.361+0000 7fddd97fa640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:45:35.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.361+0000 7fddd97fa640 1 -- 172.21.15.7:0/527394543 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdde0021040 con 0x5623b3a659f0 2024-09-21T06:45:35.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.362+0000 7fddd97fa640 1 -- 172.21.15.7:0/527394543 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7fdde0011240 con 0x5623b3a659f0 2024-09-21T06:45:35.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.362+0000 7fddfe0fc740 1 -- 172.21.15.7:0/527394543 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdde000db80 con 0x5623b3a659f0 2024-09-21T06:45:35.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.362+0000 7fddd97fa640 1 -- 172.21.15.7:0/527394543 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fdde003d050 con 0x5623b3a659f0 2024-09-21T06:45:35.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.362+0000 7fddfe0fc740 10 client.17640 fetch_fsmap learned FSMap version 25 2024-09-21T06:45:35.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.362+0000 7fddfe0fc740 1 -- 172.21.15.7:0/527394543 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5623b3ed7430 con 0x5623b3a659f0 2024-09-21T06:45:35.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.362+0000 7fddd97fa640 1 -- 172.21.15.7:0/527394543 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdde000db80 con 0x5623b3a659f0 2024-09-21T06:45:35.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.362+0000 7fddd97fa640 1 -- 172.21.15.7:0/527394543 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fdde0004730 con 0x5623b3a659f0 2024-09-21T06:45:35.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.362+0000 7fddfe0fc740 10 client.17640 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:45:35.404 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.362+0000 7fddfe0fc740 10 client.17640 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:45:35.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.362+0000 7fddfe0fc740 20 client.17640 populate_metadata read hostname 'smithi007' 2024-09-21T06:45:35.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.362+0000 7fddfe0fc740 1 --2- 172.21.15.7:0/527394543 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x5623b3aa7070 0x5623b3ed9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:35.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.362+0000 7fddfe0fc740 4 client.17640 mds_command: new command op to 24688 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:45:35.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.362+0000 7fddfe0fc740 1 -- 172.21.15.7:0/527394543 --> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5623b3dc28a0 con 0x5623b3aa7070 2024-09-21T06:45:35.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.363+0000 7fddf5924640 1 --2- 172.21.15.7:0/527394543 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x5623b3aa7070 0x5623b3ed9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:35.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.363+0000 7fddd97fa640 10 client.17640 ms_handle_connect on v2:172.21.15.144:6838/4027821922 2024-09-21T06:45:35.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.363+0000 7fddf5924640 1 --2- 172.21.15.7:0/527394543 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x5623b3aa7070 0x5623b3ed9b60 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=52d99469c9d88039 server_cookie=334a1775bd6d656 in_seq=0 out_seq=0 2024-09-21T06:45:35.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.364+0000 7fddd97fa640 1 -- 172.21.15.7:0/527394543 <== mds.1 v2:172.21.15.144:6838/4027821922 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5623b3dc28a0 con 0x5623b3aa7070 2024-09-21T06:45:35.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.364+0000 7fddd97fa640 10 client.17640 handle_command_reply: tid=0 2024-09-21T06:45:35.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.364+0000 7fddfe0fc740 1 client.17640 shutdown 2024-09-21T06:45:35.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.364+0000 7fddfe0fc740 1 -- 172.21.15.7:0/527394543 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5623b3a659f0 msgr2=0x5623b3e62320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:35.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.364+0000 7fddfe0fc740 1 --2- 172.21.15.7:0/527394543 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5623b3a659f0 0x5623b3e62320 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7fdde000b010 tx=0x7fdde0000bc0 comp rx=0 tx=0).stop 2024-09-21T06:45:35.405 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.364+0000 7fddfe0fc740 1 -- 172.21.15.7:0/527394543 shutdown_connections 2024-09-21T06:45:35.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.364+0000 7fddfe0fc740 1 --2- 172.21.15.7:0/527394543 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x5623b3aa7070 0x5623b3ed9b60 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:35.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.364+0000 7fddfe0fc740 1 --2- 172.21.15.7:0/527394543 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5623b3a86390 0x5623b3e5ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:35.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.364+0000 7fddfe0fc740 1 --2- 172.21.15.7:0/527394543 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5623b3a7e1b0 0x5623b3e5e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:35.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.364+0000 7fddd97fa640 0 client.17640 ms_handle_reset on v2:172.21.15.144:6838/4027821922 2024-09-21T06:45:35.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.364+0000 7fddfe0fc740 1 --2- 172.21.15.7:0/527394543 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5623b3a659f0 0x5623b3e62320 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:35.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.364+0000 7fddfe0fc740 1 -- 172.21.15.7:0/527394543 >> 172.21.15.7:0/527394543 conn(0x5623b3a9b460 msgr2=0x5623b3e5b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:35.406 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:45:35.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.364+0000 7fddfe0fc740 1 -- 172.21.15.7:0/527394543 shutdown_connections 2024-09-21T06:45:35.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.364+0000 7fddfe0fc740 1 -- 172.21.15.7:0/527394543 wait complete. 2024-09-21T06:45:35.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.364+0000 7fddfe0fc740 20 client.17640 trim_cache size 0 max 16384 2024-09-21T06:45:35.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.364+0000 7fddf7b88640 1 -- 172.21.15.7:0/1890919372 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fdddc0b6680 msgr2=0x7fdddc0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:35.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.364+0000 7fddf7b88640 1 --2- 172.21.15.7:0/1890919372 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fdddc0b6680 0x7fdddc0b8b90 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fdde81063f0 tx=0x7fdde80c32a0 comp rx=0 tx=0).stop 2024-09-21T06:45:35.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.364+0000 7fddf7b88640 1 -- 172.21.15.7:0/1890919372 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fddf0108d10 msgr2=0x7fddf019fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:35.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.364+0000 7fddf7b88640 1 --2- 172.21.15.7:0/1890919372 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fddf0108d10 0x7fddf019fcd0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7fdde8005cc0 tx=0x7fdde802f380 comp rx=0 tx=0).stop 2024-09-21T06:45:35.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.365+0000 7fddf7b88640 1 -- 172.21.15.7:0/1890919372 shutdown_connections 2024-09-21T06:45:35.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.365+0000 7fddf7b88640 1 --2- 172.21.15.7:0/1890919372 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fdddc0b6680 0x7fdddc0b8b90 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:35.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.365+0000 7fddf7b88640 1 --2- 172.21.15.7:0/1890919372 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fddf0108d10 0x7fddf019fcd0 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:35.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.365+0000 7fddf7b88640 1 --2- 172.21.15.7:0/1890919372 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fddf01083c0 0x7fddf019aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:35.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.365+0000 7fddf7b88640 1 --2- 172.21.15.7:0/1890919372 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fddf0102a80 0x7fddf019a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:35.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.365+0000 7fddf7b88640 1 -- 172.21.15.7:0/1890919372 >> 172.21.15.7:0/1890919372 conn(0x7fddf0079740 msgr2=0x7fddf0104430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:35.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.365+0000 7fddf7b88640 1 -- 172.21.15.7:0/1890919372 shutdown_connections 2024-09-21T06:45:35.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:35.365+0000 7fddf7b88640 1 -- 172.21.15.7:0/1890919372 wait complete. 2024-09-21T06:45:36.083 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:45:36.339 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:45:36.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.833+0000 7fd4b096e640 1 -- 172.21.15.7:0/1384642137 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd4ac10de10 msgr2=0x7fd4ac110300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:36.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.833+0000 7fd4b096e640 1 --2- 172.21.15.7:0/1384642137 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd4ac10de10 0x7fd4ac110300 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7fd4a4009900 tx=0x7fd4a402a410 comp rx=0 tx=0).stop 2024-09-21T06:45:36.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.833+0000 7fd4b096e640 1 -- 172.21.15.7:0/1384642137 shutdown_connections 2024-09-21T06:45:36.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.833+0000 7fd4b096e640 1 --2- 172.21.15.7:0/1384642137 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd4ac10de10 0x7fd4ac110300 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:36.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.833+0000 7fd4b096e640 1 --2- 172.21.15.7:0/1384642137 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd4ac105300 0x7fd4ac10d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:36.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.833+0000 7fd4b096e640 1 --2- 172.21.15.7:0/1384642137 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd4ac1049b0 0x7fd4ac104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:36.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.833+0000 7fd4b096e640 1 -- 172.21.15.7:0/1384642137 >> 172.21.15.7:0/1384642137 conn(0x7fd4ac079730 msgr2=0x7fd4ac079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:36.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.833+0000 7fd4b096e640 1 -- 172.21.15.7:0/1384642137 shutdown_connections 2024-09-21T06:45:36.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.833+0000 7fd4b096e640 1 -- 172.21.15.7:0/1384642137 wait complete. 2024-09-21T06:45:36.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.834+0000 7fd4b096e640 1 Processor -- start 2024-09-21T06:45:36.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.834+0000 7fd4b096e640 1 -- start start 2024-09-21T06:45:36.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.834+0000 7fd4b096e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd4ac1049b0 0x7fd4ac19a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:36.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.834+0000 7fd4b096e640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd4ac105300 0x7fd4ac19ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:36.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.834+0000 7fd4b096e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd4ac10de10 0x7fd4ac19fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:36.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.834+0000 7fd4b096e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd4ac113a70 con 0x7fd4ac1049b0 2024-09-21T06:45:36.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.834+0000 7fd4b096e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd4ac1138f0 con 0x7fd4ac10de10 2024-09-21T06:45:36.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.834+0000 7fd4b096e640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd4ac113bf0 con 0x7fd4ac105300 2024-09-21T06:45:36.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.834+0000 7fd4aa59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd4ac1049b0 0x7fd4ac19a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:36.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.834+0000 7fd4aa59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd4ac1049b0 0x7fd4ac19a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44462/0 (socket says 172.21.15.7:44462) 2024-09-21T06:45:36.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.834+0000 7fd4aa59c640 1 -- 172.21.15.7:0/3690718036 learned_addr learned my addr 172.21.15.7:0/3690718036 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:36.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.834+0000 7fd4aad9d640 1 --2- 172.21.15.7:0/3690718036 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd4ac10de10 0x7fd4ac19fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:36.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.834+0000 7fd4a9d9b640 1 --2- 172.21.15.7:0/3690718036 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd4ac105300 0x7fd4ac19ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:36.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.835+0000 7fd4aa59c640 1 -- 172.21.15.7:0/3690718036 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd4ac105300 msgr2=0x7fd4ac19ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:36.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.835+0000 7fd4aa59c640 1 --2- 172.21.15.7:0/3690718036 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd4ac105300 0x7fd4ac19ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:36.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.835+0000 7fd4aa59c640 1 -- 172.21.15.7:0/3690718036 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd4ac10de10 msgr2=0x7fd4ac19fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:36.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.835+0000 7fd4aa59c640 1 --2- 172.21.15.7:0/3690718036 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd4ac10de10 0x7fd4ac19fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:36.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.835+0000 7fd4aa59c640 1 -- 172.21.15.7:0/3690718036 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4ac1a04f0 con 0x7fd4ac1049b0 2024-09-21T06:45:36.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.835+0000 7fd4aa59c640 1 --2- 172.21.15.7:0/3690718036 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd4ac1049b0 0x7fd4ac19a580 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7fd49c00d950 tx=0x7fd49c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:36.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.835+0000 7fd49b7fe640 1 -- 172.21.15.7:0/3690718036 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd49c017020 con 0x7fd4ac1049b0 2024-09-21T06:45:36.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.835+0000 7fd4b096e640 1 -- 172.21.15.7:0/3690718036 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4ac1a07e0 con 0x7fd4ac1049b0 2024-09-21T06:45:36.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.835+0000 7fd49b7fe640 1 -- 172.21.15.7:0/3690718036 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd49c009c30 con 0x7fd4ac1049b0 2024-09-21T06:45:36.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.835+0000 7fd49b7fe640 1 -- 172.21.15.7:0/3690718036 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd49c00f6b0 con 0x7fd4ac1049b0 2024-09-21T06:45:36.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.835+0000 7fd4b096e640 1 -- 172.21.15.7:0/3690718036 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4ac1a6f40 con 0x7fd4ac1049b0 2024-09-21T06:45:36.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.838+0000 7fd49b7fe640 1 -- 172.21.15.7:0/3690718036 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7fd49c01a020 con 0x7fd4ac1049b0 2024-09-21T06:45:36.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.838+0000 7fd4b6ee2740 1 Processor -- start 2024-09-21T06:45:36.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.838+0000 7fd4b6ee2740 1 -- start start 2024-09-21T06:45:36.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.838+0000 7fd4b6ee2740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a91f072070 0x55a91f4196a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:36.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.838+0000 7fd4b6ee2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a91f0491b0 0x55a91f419be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:36.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.838+0000 7fd4b6ee2740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a91f051390 0x55a91f41a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:36.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.838+0000 7fd4b6ee2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55a91f38fea0 con 0x55a91f0491b0 2024-09-21T06:45:36.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.838+0000 7fd4b6ee2740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a91f37f2d0 con 0x55a91f072070 2024-09-21T06:45:36.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.838+0000 7fd4b6ee2740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55a91f3830e0 con 0x55a91f051390 2024-09-21T06:45:36.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.839+0000 7fd4aa59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a91f0491b0 0x55a91f419be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:36.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.839+0000 7fd4aa59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a91f0491b0 0x55a91f419be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44466/0 (socket says 172.21.15.7:44466) 2024-09-21T06:45:36.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.839+0000 7fd4aa59c640 1 -- 172.21.15.7:0/843212871 learned_addr learned my addr 172.21.15.7:0/843212871 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:36.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.839+0000 7fd4a9d9b640 1 --2- 172.21.15.7:0/843212871 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a91f051390 0x55a91f41a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:36.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.839+0000 7fd4aad9d640 1 --2- 172.21.15.7:0/843212871 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a91f072070 0x55a91f4196a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:36.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.839+0000 7fd4a9d9b640 1 -- 172.21.15.7:0/843212871 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a91f072070 msgr2=0x55a91f4196a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:36.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.839+0000 7fd4a9d9b640 1 --2- 172.21.15.7:0/843212871 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a91f072070 0x55a91f4196a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:36.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.839+0000 7fd4a9d9b640 1 -- 172.21.15.7:0/843212871 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a91f0491b0 msgr2=0x55a91f419be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:36.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.839+0000 7fd4a9d9b640 1 --2- 172.21.15.7:0/843212871 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a91f0491b0 0x55a91f419be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:36.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.839+0000 7fd4a9d9b640 1 -- 172.21.15.7:0/843212871 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a91f0dd650 con 0x55a91f051390 2024-09-21T06:45:36.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.839+0000 7fd49b7fe640 1 --2- 172.21.15.7:0/3690718036 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fd4940b6680 0x7fd4940b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:36.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.839+0000 7fd4aad9d640 1 --2- 172.21.15.7:0/3690718036 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fd4940b6680 0x7fd4940b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:36.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.839+0000 7fd4a9d9b640 1 --2- 172.21.15.7:0/843212871 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a91f051390 0x55a91f41a120 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac06aaa0 tx=0x7fd4a0010740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ba40273caab2412 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:36.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.839+0000 7fd49b7fe640 1 -- 172.21.15.7:0/3690718036 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7fd49c0e7220 con 0x7fd4ac1049b0 2024-09-21T06:45:36.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.840+0000 7fd498ff9640 1 -- 172.21.15.7:0/843212871 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4a0016070 con 0x55a91f051390 2024-09-21T06:45:36.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.840+0000 7fd498ff9640 1 -- 172.21.15.7:0/843212871 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4a0004d20 con 0x55a91f051390 2024-09-21T06:45:36.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.840+0000 7fd498ff9640 1 -- 172.21.15.7:0/843212871 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4a0012740 con 0x55a91f051390 2024-09-21T06:45:36.849 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.841+0000 7fd4b6ee2740 1 -- 172.21.15.7:0/843212871 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a91f051390 msgr2=0x55a91f41a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:36.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.841+0000 7fd4b6ee2740 1 --2- 172.21.15.7:0/843212871 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a91f051390 0x55a91f41a120 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac06aaa0 tx=0x7fd4a0010740 comp rx=0 tx=0).stop 2024-09-21T06:45:36.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.841+0000 7fd4aad9d640 1 --2- 172.21.15.7:0/3690718036 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fd4940b6680 0x7fd4940b8b90 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fd4a4006010 tx=0x7fd4a40058d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:36.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.841+0000 7fd4b6ee2740 1 -- 172.21.15.7:0/843212871 shutdown_connections 2024-09-21T06:45:36.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.841+0000 7fd4b6ee2740 1 --2- 172.21.15.7:0/843212871 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a91f051390 0x55a91f41a120 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:36.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.841+0000 7fd4b6ee2740 1 --2- 172.21.15.7:0/843212871 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a91f0491b0 0x55a91f419be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:36.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.841+0000 7fd4b6ee2740 1 --2- 172.21.15.7:0/843212871 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a91f072070 0x55a91f4196a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:36.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.841+0000 7fd4b6ee2740 1 -- 172.21.15.7:0/843212871 >> 172.21.15.7:0/843212871 conn(0x55a91f066460 msgr2=0x55a91f417590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:36.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.841+0000 7fd4b6ee2740 1 -- 172.21.15.7:0/843212871 shutdown_connections 2024-09-21T06:45:36.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.841+0000 7fd4b6ee2740 1 -- 172.21.15.7:0/843212871 wait complete. 2024-09-21T06:45:36.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.841+0000 7fd4b6ee2740 1 -- start start 2024-09-21T06:45:36.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.841+0000 7fd4b6ee2740 1 Processor -- start 2024-09-21T06:45:36.850 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.842+0000 7fd4b6ee2740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a91f0491b0 0x55a91f424dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:36.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.842+0000 7fd4b6ee2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a91f051390 0x55a91f425310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:36.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.842+0000 7fd4b6ee2740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a91f072070 0x55a91f4355b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:36.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.842+0000 7fd4b6ee2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55a91f1e0700 con 0x55a91f051390 2024-09-21T06:45:36.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.842+0000 7fd4b6ee2740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a91f31a160 con 0x55a91f072070 2024-09-21T06:45:36.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.842+0000 7fd4b6ee2740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55a91f42c290 con 0x55a91f0491b0 2024-09-21T06:45:36.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.842+0000 7fd4b6ee2740 10 client.0 _ll_register_callbacks cb 0x55a91f3339e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:36.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.842+0000 7fd4a9d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a91f051390 0x55a91f425310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:36.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.842+0000 7fd4a9d9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a91f051390 0x55a91f425310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44474/0 (socket says 172.21.15.7:44474) 2024-09-21T06:45:36.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.842+0000 7fd4a9d9b640 1 -- 172.21.15.7:0/1105740988 learned_addr learned my addr 172.21.15.7:0/1105740988 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:36.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.842+0000 7fd4aa59c640 1 --2- 172.21.15.7:0/1105740988 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a91f0491b0 0x55a91f424dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:36.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.842+0000 7fd4aad9d640 1 --2- 172.21.15.7:0/1105740988 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a91f072070 0x55a91f4355b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:36.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.842+0000 7fd4a9d9b640 1 -- 172.21.15.7:0/1105740988 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a91f0491b0 msgr2=0x55a91f424dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:36.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.842+0000 7fd4a9d9b640 1 --2- 172.21.15.7:0/1105740988 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a91f0491b0 0x55a91f424dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:36.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.842+0000 7fd4a9d9b640 1 -- 172.21.15.7:0/1105740988 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a91f072070 msgr2=0x55a91f4355b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:36.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.842+0000 7fd4a9d9b640 1 --2- 172.21.15.7:0/1105740988 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a91f072070 0x55a91f4355b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:36.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.842+0000 7fd4a9d9b640 1 -- 172.21.15.7:0/1105740988 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a91f347c90 con 0x55a91f051390 2024-09-21T06:45:36.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.842+0000 7fd4a9d9b640 1 --2- 172.21.15.7:0/1105740988 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a91f051390 0x55a91f425310 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fd4a0004ce0 tx=0x7fd4a00124c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0459d0b137ec82e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:36.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.842+0000 7fd491ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:45:36.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.843+0000 7fd491ffb640 1 -- 172.21.15.7:0/1105740988 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4a0016070 con 0x55a91f051390 2024-09-21T06:45:36.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.843+0000 7fd491ffb640 1 -- 172.21.15.7:0/1105740988 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7fd4a0003970 con 0x55a91f051390 2024-09-21T06:45:36.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.843+0000 7fd4b6ee2740 1 -- 172.21.15.7:0/1105740988 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd4a0004d20 con 0x55a91f051390 2024-09-21T06:45:36.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.843+0000 7fd491ffb640 1 -- 172.21.15.7:0/1105740988 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd4a0003b70 con 0x55a91f051390 2024-09-21T06:45:36.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.843+0000 7fd4b6ee2740 10 client.17652 fetch_fsmap learned FSMap version 25 2024-09-21T06:45:36.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.843+0000 7fd4b6ee2740 1 -- 172.21.15.7:0/1105740988 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a91f437fe0 con 0x55a91f051390 2024-09-21T06:45:36.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.843+0000 7fd491ffb640 1 -- 172.21.15.7:0/1105740988 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4a0004d20 con 0x55a91f051390 2024-09-21T06:45:36.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.843+0000 7fd491ffb640 1 -- 172.21.15.7:0/1105740988 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd4a002d020 con 0x55a91f051390 2024-09-21T06:45:36.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.843+0000 7fd4b6ee2740 10 client.17652 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:45:36.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.843+0000 7fd4b6ee2740 10 client.17652 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:45:36.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.843+0000 7fd4b6ee2740 20 client.17652 populate_metadata read hostname 'smithi007' 2024-09-21T06:45:36.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.843+0000 7fd4b6ee2740 1 --2- 172.21.15.7:0/1105740988 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55a91f0309f0 0x55a91f43b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:36.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.843+0000 7fd4b6ee2740 4 client.17652 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:45:36.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.843+0000 7fd4b6ee2740 1 -- 172.21.15.7:0/1105740988 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a91f391df0 con 0x55a91f0309f0 2024-09-21T06:45:36.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.844+0000 7fd4aa59c640 1 --2- 172.21.15.7:0/1105740988 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55a91f0309f0 0x55a91f43b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:36.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.844+0000 7fd4aa59c640 1 --2- 172.21.15.7:0/1105740988 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55a91f0309f0 0x55a91f43b340 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8193d15298da09ce server_cookie=38fb17ccf5c38601 in_seq=0 out_seq=0 2024-09-21T06:45:36.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.844+0000 7fd491ffb640 10 client.17652 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:45:36.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.845+0000 7fd491ffb640 1 -- 172.21.15.7:0/1105740988 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a91f391df0 con 0x55a91f0309f0 2024-09-21T06:45:36.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.845+0000 7fd491ffb640 10 client.17652 handle_command_reply: tid=0 2024-09-21T06:45:36.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.845+0000 7fd4b6ee2740 1 client.17652 shutdown 2024-09-21T06:45:36.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.846+0000 7fd4b6ee2740 1 -- 172.21.15.7:0/1105740988 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a91f051390 msgr2=0x55a91f425310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:36.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.846+0000 7fd4b6ee2740 1 --2- 172.21.15.7:0/1105740988 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a91f051390 0x55a91f425310 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fd4a0004ce0 tx=0x7fd4a00124c0 comp rx=0 tx=0).stop 2024-09-21T06:45:36.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.846+0000 7fd4b6ee2740 1 -- 172.21.15.7:0/1105740988 shutdown_connections 2024-09-21T06:45:36.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.846+0000 7fd4b6ee2740 1 --2- 172.21.15.7:0/1105740988 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55a91f0309f0 0x55a91f43b340 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:36.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.846+0000 7fd4b6ee2740 1 --2- 172.21.15.7:0/1105740988 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a91f072070 0x55a91f4355b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:36.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.846+0000 7fd491ffb640 0 client.17652 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:45:36.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.846+0000 7fd4b6ee2740 1 --2- 172.21.15.7:0/1105740988 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a91f051390 0x55a91f425310 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:36.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.846+0000 7fd4b6ee2740 1 --2- 172.21.15.7:0/1105740988 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a91f0491b0 0x55a91f424dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:36.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.846+0000 7fd4b6ee2740 1 -- 172.21.15.7:0/1105740988 >> 172.21.15.7:0/1105740988 conn(0x55a91f066460 msgr2=0x55a91f41c830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:36.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.846+0000 7fd4b6ee2740 1 -- 172.21.15.7:0/1105740988 shutdown_connections 2024-09-21T06:45:36.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.846+0000 7fd4b6ee2740 1 -- 172.21.15.7:0/1105740988 wait complete. 2024-09-21T06:45:36.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.846+0000 7fd4b6ee2740 20 client.17652 trim_cache size 0 max 16384 2024-09-21T06:45:36.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.859+0000 7fd4b6ee2740 1 Processor -- start 2024-09-21T06:45:36.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.859+0000 7fd4b6ee2740 1 -- start start 2024-09-21T06:45:36.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.859+0000 7fd4b6ee2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a91f0309f0 0x55a91f425350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:36.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.859+0000 7fd4b6ee2740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a91f0491b0 0x55a91f41b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:36.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.859+0000 7fd4b6ee2740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a91f051390 0x55a91f426a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:36.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.859+0000 7fd4b6ee2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd4ac1afd80 con 0x55a91f0309f0 2024-09-21T06:45:36.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.859+0000 7fd4b6ee2740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd4ac1ad650 con 0x55a91f0491b0 2024-09-21T06:45:36.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.859+0000 7fd4b6ee2740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd4ac1ab4c0 con 0x55a91f051390 2024-09-21T06:45:36.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.860+0000 7fd4aa59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a91f0309f0 0x55a91f425350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:36.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.860+0000 7fd4aa59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a91f0309f0 0x55a91f425350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44486/0 (socket says 172.21.15.7:44486) 2024-09-21T06:45:36.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.860+0000 7fd4aa59c640 1 -- 172.21.15.7:0/2031393160 learned_addr learned my addr 172.21.15.7:0/2031393160 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:36.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.860+0000 7fd4a9d9b640 1 --2- 172.21.15.7:0/2031393160 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a91f0491b0 0x55a91f41b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:36.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.860+0000 7fd4aad9d640 1 --2- 172.21.15.7:0/2031393160 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a91f051390 0x55a91f426a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:36.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.860+0000 7fd4aa59c640 1 -- 172.21.15.7:0/2031393160 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a91f051390 msgr2=0x55a91f426a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:36.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.860+0000 7fd4aa59c640 1 --2- 172.21.15.7:0/2031393160 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a91f051390 0x55a91f426a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:36.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.860+0000 7fd4aa59c640 1 -- 172.21.15.7:0/2031393160 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a91f0491b0 msgr2=0x55a91f41b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:36.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.860+0000 7fd4aa59c640 1 --2- 172.21.15.7:0/2031393160 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a91f0491b0 0x55a91f41b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:36.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.860+0000 7fd4aa59c640 1 -- 172.21.15.7:0/2031393160 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a91f426090 con 0x55a91f0309f0 2024-09-21T06:45:36.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.860+0000 7fd4aa59c640 1 --2- 172.21.15.7:0/2031393160 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a91f0309f0 0x55a91f425350 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fd49c009610 tx=0x7fd49c0ead70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88220d5ec6b18fff server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:36.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.860+0000 7fd493fff640 1 -- 172.21.15.7:0/2031393160 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd49c0a8f80 con 0x55a91f0309f0 2024-09-21T06:45:36.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.860+0000 7fd493fff640 1 -- 172.21.15.7:0/2031393160 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd49c0acbf0 con 0x55a91f0309f0 2024-09-21T06:45:36.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.860+0000 7fd493fff640 1 -- 172.21.15.7:0/2031393160 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd49c0ac850 con 0x55a91f0309f0 2024-09-21T06:45:36.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.861+0000 7fd4b6ee2740 1 -- 172.21.15.7:0/2031393160 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a91f0309f0 msgr2=0x55a91f425350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:36.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.861+0000 7fd4b6ee2740 1 --2- 172.21.15.7:0/2031393160 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a91f0309f0 0x55a91f425350 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fd49c009610 tx=0x7fd49c0ead70 comp rx=0 tx=0).stop 2024-09-21T06:45:36.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.861+0000 7fd4b6ee2740 1 -- 172.21.15.7:0/2031393160 shutdown_connections 2024-09-21T06:45:36.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.861+0000 7fd4b6ee2740 1 --2- 172.21.15.7:0/2031393160 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a91f051390 0x55a91f426a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:36.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.861+0000 7fd4b6ee2740 1 --2- 172.21.15.7:0/2031393160 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a91f0491b0 0x55a91f41b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:36.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.861+0000 7fd4b6ee2740 1 --2- 172.21.15.7:0/2031393160 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a91f0309f0 0x55a91f425350 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:36.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.861+0000 7fd4b6ee2740 1 -- 172.21.15.7:0/2031393160 >> 172.21.15.7:0/2031393160 conn(0x55a91f066460 msgr2=0x55a91f4262f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:36.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.861+0000 7fd4b6ee2740 1 -- 172.21.15.7:0/2031393160 shutdown_connections 2024-09-21T06:45:36.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.861+0000 7fd4b6ee2740 1 -- 172.21.15.7:0/2031393160 wait complete. 2024-09-21T06:45:36.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.862+0000 7fd4b6ee2740 1 -- start start 2024-09-21T06:45:36.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.862+0000 7fd4b6ee2740 1 Processor -- start 2024-09-21T06:45:36.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.862+0000 7fd4b6ee2740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a91f0309f0 0x55a91f43ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:36.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.862+0000 7fd4b6ee2740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a91f0491b0 0x55a91f43c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:36.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.862+0000 7fd4b6ee2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a91f051390 0x55a91f43c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:36.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.862+0000 7fd4b6ee2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd4ac1abb10 con 0x55a91f051390 2024-09-21T06:45:36.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.862+0000 7fd4b6ee2740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd4ac1acf80 con 0x55a91f0491b0 2024-09-21T06:45:36.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.862+0000 7fd4b6ee2740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd4ac1ac1e0 con 0x55a91f0309f0 2024-09-21T06:45:36.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.862+0000 7fd4b6ee2740 10 client.0 _ll_register_callbacks cb 0x7fd49c0eac40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:36.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.862+0000 7fd4aad9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a91f051390 0x55a91f43c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:36.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.862+0000 7fd4aad9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a91f051390 0x55a91f43c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44496/0 (socket says 172.21.15.7:44496) 2024-09-21T06:45:36.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.862+0000 7fd4aad9d640 1 -- 172.21.15.7:0/3935278507 learned_addr learned my addr 172.21.15.7:0/3935278507 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:36.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.862+0000 7fd4a9d9b640 1 --2- 172.21.15.7:0/3935278507 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a91f0491b0 0x55a91f43c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:36.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.862+0000 7fd4aa59c640 1 --2- 172.21.15.7:0/3935278507 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a91f0309f0 0x55a91f43ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:36.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.863+0000 7fd4aad9d640 1 -- 172.21.15.7:0/3935278507 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a91f0309f0 msgr2=0x55a91f43ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:36.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.863+0000 7fd4aad9d640 1 --2- 172.21.15.7:0/3935278507 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a91f0309f0 0x55a91f43ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:36.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.863+0000 7fd4aad9d640 1 -- 172.21.15.7:0/3935278507 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a91f0491b0 msgr2=0x55a91f43c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:36.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.863+0000 7fd4aad9d640 1 --2- 172.21.15.7:0/3935278507 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a91f0491b0 0x55a91f43c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:36.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.863+0000 7fd4aad9d640 1 -- 172.21.15.7:0/3935278507 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a91f43cf70 con 0x55a91f051390 2024-09-21T06:45:36.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.863+0000 7fd4aa59c640 1 --2- 172.21.15.7:0/3935278507 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a91f0309f0 0x55a91f43ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:36.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.863+0000 7fd4aad9d640 1 --2- 172.21.15.7:0/3935278507 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a91f051390 0x55a91f43c800 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fd4a4005f70 tx=0x7fd4a4009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e45f870ee5cfa8d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:36.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.863+0000 7fd491ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:45:36.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.863+0000 7fd491ffb640 1 -- 172.21.15.7:0/3935278507 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4a4035040 con 0x55a91f051390 2024-09-21T06:45:36.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.863+0000 7fd491ffb640 1 -- 172.21.15.7:0/3935278507 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7fd4a4005230 con 0x55a91f051390 2024-09-21T06:45:36.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.863+0000 7fd4b6ee2740 1 -- 172.21.15.7:0/3935278507 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd49c0acbf0 con 0x55a91f051390 2024-09-21T06:45:36.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.863+0000 7fd491ffb640 1 -- 172.21.15.7:0/3935278507 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd4a405c050 con 0x55a91f051390 2024-09-21T06:45:36.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.863+0000 7fd4b6ee2740 10 client.17658 fetch_fsmap learned FSMap version 25 2024-09-21T06:45:36.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.863+0000 7fd4b6ee2740 1 -- 172.21.15.7:0/3935278507 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a91f4a5b40 con 0x55a91f051390 2024-09-21T06:45:36.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.863+0000 7fd491ffb640 1 -- 172.21.15.7:0/3935278507 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd49c0acbf0 con 0x55a91f051390 2024-09-21T06:45:36.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.864+0000 7fd491ffb640 1 -- 172.21.15.7:0/3935278507 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd4a40035f0 con 0x55a91f051390 2024-09-21T06:45:36.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.864+0000 7fd4b6ee2740 10 client.17658 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:45:36.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.864+0000 7fd4b6ee2740 10 client.17658 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:45:36.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.864+0000 7fd4b6ee2740 20 client.17658 populate_metadata read hostname 'smithi007' 2024-09-21T06:45:36.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.864+0000 7fd4b6ee2740 1 --2- 172.21.15.7:0/3935278507 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55a91f072070 0x55a91f4a8380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:36.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.864+0000 7fd4b6ee2740 4 client.17658 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:45:36.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.864+0000 7fd4b6ee2740 1 -- 172.21.15.7:0/3935278507 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a91f38d8a0 con 0x55a91f072070 2024-09-21T06:45:36.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.864+0000 7fd4aa59c640 1 --2- 172.21.15.7:0/3935278507 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55a91f072070 0x55a91f4a8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:36.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.864+0000 7fd491ffb640 10 client.17658 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:45:36.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.864+0000 7fd4aa59c640 1 --2- 172.21.15.7:0/3935278507 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55a91f072070 0x55a91f4a8380 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3dc6129e36c93ffb server_cookie=7025ab63b199308a in_seq=0 out_seq=0 2024-09-21T06:45:36.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.865+0000 7fd491ffb640 1 -- 172.21.15.7:0/3935278507 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a91f38d8a0 con 0x55a91f072070 2024-09-21T06:45:36.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.865+0000 7fd491ffb640 10 client.17658 handle_command_reply: tid=0 2024-09-21T06:45:36.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.865+0000 7fd4b6ee2740 1 client.17658 shutdown 2024-09-21T06:45:36.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.865+0000 7fd4b6ee2740 1 -- 172.21.15.7:0/3935278507 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a91f051390 msgr2=0x55a91f43c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:36.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.865+0000 7fd4b6ee2740 1 --2- 172.21.15.7:0/3935278507 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a91f051390 0x55a91f43c800 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fd4a4005f70 tx=0x7fd4a4009260 comp rx=0 tx=0).stop 2024-09-21T06:45:36.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.865+0000 7fd4b6ee2740 1 -- 172.21.15.7:0/3935278507 shutdown_connections 2024-09-21T06:45:36.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.865+0000 7fd4b6ee2740 1 --2- 172.21.15.7:0/3935278507 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55a91f072070 0x55a91f4a8380 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:36.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.865+0000 7fd4b6ee2740 1 --2- 172.21.15.7:0/3935278507 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a91f051390 0x55a91f43c800 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:36.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.865+0000 7fd4b6ee2740 1 --2- 172.21.15.7:0/3935278507 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a91f0491b0 0x55a91f43c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:36.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.865+0000 7fd491ffb640 0 client.17658 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:45:36.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.865+0000 7fd4b6ee2740 1 --2- 172.21.15.7:0/3935278507 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a91f0309f0 0x55a91f43ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:36.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.865+0000 7fd4b6ee2740 1 -- 172.21.15.7:0/3935278507 >> 172.21.15.7:0/3935278507 conn(0x55a91f066460 msgr2=0x55a91f41ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:36.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.865+0000 7fd4b6ee2740 1 -- 172.21.15.7:0/3935278507 shutdown_connections 2024-09-21T06:45:36.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.865+0000 7fd4b6ee2740 1 -- 172.21.15.7:0/3935278507 wait complete. 2024-09-21T06:45:36.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.865+0000 7fd4b6ee2740 20 client.17658 trim_cache size 0 max 16384 2024-09-21T06:45:36.871 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:45:36.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.866+0000 7fd4b096e640 1 -- 172.21.15.7:0/3690718036 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fd4940b6680 msgr2=0x7fd4940b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:36.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.866+0000 7fd4b096e640 1 --2- 172.21.15.7:0/3690718036 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fd4940b6680 0x7fd4940b8b90 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fd4a4006010 tx=0x7fd4a40058d0 comp rx=0 tx=0).stop 2024-09-21T06:45:36.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.866+0000 7fd4b096e640 1 -- 172.21.15.7:0/3690718036 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd4ac1049b0 msgr2=0x7fd4ac19a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:36.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.866+0000 7fd4b096e640 1 --2- 172.21.15.7:0/3690718036 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd4ac1049b0 0x7fd4ac19a580 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7fd49c00d950 tx=0x7fd49c00de10 comp rx=0 tx=0).stop 2024-09-21T06:45:36.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.866+0000 7fd4b096e640 1 -- 172.21.15.7:0/3690718036 shutdown_connections 2024-09-21T06:45:36.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.866+0000 7fd4b096e640 1 --2- 172.21.15.7:0/3690718036 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fd4940b6680 0x7fd4940b8b90 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:36.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.866+0000 7fd4b096e640 1 --2- 172.21.15.7:0/3690718036 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd4ac10de10 0x7fd4ac19fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:36.872 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.866+0000 7fd4b096e640 1 --2- 172.21.15.7:0/3690718036 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd4ac105300 0x7fd4ac19ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:36.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.866+0000 7fd4b096e640 1 --2- 172.21.15.7:0/3690718036 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd4ac1049b0 0x7fd4ac19a580 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:36.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.866+0000 7fd4b096e640 1 -- 172.21.15.7:0/3690718036 >> 172.21.15.7:0/3690718036 conn(0x7fd4ac079730 msgr2=0x7fd4ac0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:36.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.866+0000 7fd4b096e640 1 -- 172.21.15.7:0/3690718036 shutdown_connections 2024-09-21T06:45:36.873 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:36.866+0000 7fd4b096e640 1 -- 172.21.15.7:0/3690718036 wait complete. 2024-09-21T06:45:37.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:45:36 smithi007 ceph-mon[30983]: pgmap v607: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-09-21T06:45:37.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:45:36 smithi144 ceph-mon[34653]: pgmap v607: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-09-21T06:45:37.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:45:36 smithi018 ceph-mon[34477]: pgmap v607: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-09-21T06:45:38.597 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:45:38.597 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:45:38.852 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:45:39.251 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:45:38 smithi007 ceph-mon[30983]: pgmap v608: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6 op/s 2024-09-21T06:45:39.251 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:45:38 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:45:39.251 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:45:38 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:45:39.251 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:45:38 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:45:39.251 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:45:38 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:45:39.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:45:38 smithi144 ceph-mon[34653]: pgmap v608: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6 op/s 2024-09-21T06:45:39.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:45:38 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:45:39.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:45:38 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:45:39.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:45:38 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:45:39.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:45:38 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:45:39.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.347+0000 7f6b3692c640 1 -- 172.21.15.7:0/3029643875 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b301083a0 msgr2=0x7f6b301087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:39.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.347+0000 7f6b3692c640 1 --2- 172.21.15.7:0/3029643875 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b301083a0 0x7f6b301087b0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f6b18009900 tx=0x7f6b1802a410 comp rx=0 tx=0).stop 2024-09-21T06:45:39.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.347+0000 7f6b3692c640 1 -- 172.21.15.7:0/3029643875 shutdown_connections 2024-09-21T06:45:39.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.347+0000 7f6b3692c640 1 --2- 172.21.15.7:0/3029643875 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6b30108cf0 0x7f6b3010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:39.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.347+0000 7f6b3692c640 1 --2- 172.21.15.7:0/3029643875 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b301083a0 0x7f6b301087b0 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:39.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.347+0000 7f6b3692c640 1 --2- 172.21.15.7:0/3029643875 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b30102a60 0x7f6b30102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:39.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.347+0000 7f6b3692c640 1 -- 172.21.15.7:0/3029643875 >> 172.21.15.7:0/3029643875 conn(0x7f6b30079730 msgr2=0x7f6b30079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:39.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.347+0000 7f6b3692c640 1 -- 172.21.15.7:0/3029643875 shutdown_connections 2024-09-21T06:45:39.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.347+0000 7f6b3692c640 1 -- 172.21.15.7:0/3029643875 wait complete. 2024-09-21T06:45:39.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.348+0000 7f6b3692c640 1 Processor -- start 2024-09-21T06:45:39.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.348+0000 7f6b3692c640 1 -- start start 2024-09-21T06:45:39.352 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.348+0000 7f6b3692c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b30102a60 0x7f6b300ff670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:39.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.348+0000 7f6b3692c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6b301083a0 0x7f6b300ffbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:39.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.348+0000 7f6b3692c640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b30108cf0 0x7f6b301000f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:39.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.348+0000 7f6b3692c640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6b30112960 con 0x7f6b30102a60 2024-09-21T06:45:39.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.348+0000 7f6b3692c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6b301127e0 con 0x7f6b301083a0 2024-09-21T06:45:39.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.348+0000 7f6b3692c640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6b30112ae0 con 0x7f6b30108cf0 2024-09-21T06:45:39.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.348+0000 7f6b2ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b30102a60 0x7f6b300ff670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:39.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.349+0000 7f6b2ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b30102a60 0x7f6b300ff670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44522/0 (socket says 172.21.15.7:44522) 2024-09-21T06:45:39.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.349+0000 7f6b2ffff640 1 -- 172.21.15.7:0/83253668 learned_addr learned my addr 172.21.15.7:0/83253668 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:39.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.349+0000 7f6b27fff640 1 --2- 172.21.15.7:0/83253668 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6b301083a0 0x7f6b300ffbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:39.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.349+0000 7f6b2ffff640 1 -- 172.21.15.7:0/83253668 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b30108cf0 msgr2=0x7f6b301000f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:39.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.349+0000 7f6b2ffff640 1 --2- 172.21.15.7:0/83253668 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b30108cf0 0x7f6b301000f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:39.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.349+0000 7f6b2ffff640 1 -- 172.21.15.7:0/83253668 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6b301083a0 msgr2=0x7f6b300ffbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:39.353 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.349+0000 7f6b2ffff640 1 --2- 172.21.15.7:0/83253668 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6b301083a0 0x7f6b300ffbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:39.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.349+0000 7f6b2ffff640 1 -- 172.21.15.7:0/83253668 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b301a8720 con 0x7f6b30102a60 2024-09-21T06:45:39.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.349+0000 7f6b2ffff640 1 --2- 172.21.15.7:0/83253668 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b30102a60 0x7f6b300ff670 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f6b2000d950 tx=0x7f6b2000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:39.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.349+0000 7f6b2dffb640 1 -- 172.21.15.7:0/83253668 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b20017030 con 0x7f6b30102a60 2024-09-21T06:45:39.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.349+0000 7f6b2dffb640 1 -- 172.21.15.7:0/83253668 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b20004020 con 0x7f6b30102a60 2024-09-21T06:45:39.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.349+0000 7f6b2dffb640 1 -- 172.21.15.7:0/83253668 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b200047a0 con 0x7f6b30102a60 2024-09-21T06:45:39.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.349+0000 7f6b3692c640 1 -- 172.21.15.7:0/83253668 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b301a8a10 con 0x7f6b30102a60 2024-09-21T06:45:39.354 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.349+0000 7f6b3692c640 1 -- 172.21.15.7:0/83253668 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b301a8f70 con 0x7f6b30102a60 2024-09-21T06:45:39.355 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.353+0000 7f6b3cea0740 1 Processor -- start 2024-09-21T06:45:39.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.353+0000 7f6b3cea0740 1 -- start start 2024-09-21T06:45:39.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.353+0000 7f6b3cea0740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557644820350 0x557644bc7430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:39.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.353+0000 7f6b3cea0740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5576447f7490 0x557644bc7970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:39.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.353+0000 7f6b3cea0740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5576447ff670 0x557644bc7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:39.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.353+0000 7f6b3cea0740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x557644b3de60 con 0x5576447ff670 2024-09-21T06:45:39.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.353+0000 7f6b3cea0740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x557644b2d290 con 0x557644820350 2024-09-21T06:45:39.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.353+0000 7f6b3cea0740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x557644b310a0 con 0x5576447f7490 2024-09-21T06:45:39.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.353+0000 7f6b2dffb640 1 -- 172.21.15.7:0/83253668 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f6b20009a30 con 0x7f6b30102a60 2024-09-21T06:45:39.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.353+0000 7f6b27fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5576447ff670 0x557644bc7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:39.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.353+0000 7f6b34ec9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557644820350 0x557644bc7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:39.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.353+0000 7f6b34ec9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557644820350 0x557644bc7430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.7:37644/0 (socket says 172.21.15.7:37644) 2024-09-21T06:45:39.356 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.353+0000 7f6b34ec9640 1 -- 172.21.15.7:0/597647797 learned_addr learned my addr 172.21.15.7:0/597647797 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:39.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.354+0000 7f6b2ffff640 1 --2- 172.21.15.7:0/597647797 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5576447f7490 0x557644bc7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:39.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.354+0000 7f6b34ec9640 1 -- 172.21.15.7:0/597647797 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5576447f7490 msgr2=0x557644bc7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:39.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.354+0000 7f6b34ec9640 1 --2- 172.21.15.7:0/597647797 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5576447f7490 0x557644bc7970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:39.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.354+0000 7f6b34ec9640 1 -- 172.21.15.7:0/597647797 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5576447ff670 msgr2=0x557644bc7eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:39.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.354+0000 7f6b34ec9640 1 --2- 172.21.15.7:0/597647797 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5576447ff670 0x557644bc7eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:39.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.354+0000 7f6b34ec9640 1 -- 172.21.15.7:0/597647797 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55764488b930 con 0x557644820350 2024-09-21T06:45:39.357 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.354+0000 7f6b34ec9640 1 --2- 172.21.15.7:0/597647797 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557644820350 0x557644bc7430 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6b28009e20 tx=0x7f6b2800e720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f054d721e2a05e7c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:39.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.354+0000 7f6b267fc640 1 -- 172.21.15.7:0/597647797 <== mon.2 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b28004d20 con 0x557644820350 2024-09-21T06:45:39.360 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.354+0000 7f6b267fc640 1 -- 172.21.15.7:0/597647797 <== mon.2 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b2800ee70 con 0x557644820350 2024-09-21T06:45:39.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.354+0000 7f6b267fc640 1 -- 172.21.15.7:0/597647797 <== mon.2 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b28018890 con 0x557644820350 2024-09-21T06:45:39.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.355+0000 7f6b2dffb640 1 --2- 172.21.15.7:0/83253668 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f6b1c0b6700 0x7f6b1c0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:39.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.355+0000 7f6b2ffff640 1 --2- 172.21.15.7:0/83253668 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f6b1c0b6700 0x7f6b1c0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:39.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.355+0000 7f6b2dffb640 1 -- 172.21.15.7:0/83253668 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7f6b200e70a0 con 0x7f6b30102a60 2024-09-21T06:45:39.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.355+0000 7f6b3cea0740 1 -- 172.21.15.7:0/597647797 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557644820350 msgr2=0x557644bc7430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:39.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.355+0000 7f6b2ffff640 1 --2- 172.21.15.7:0/83253668 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f6b1c0b6700 0x7f6b1c0b8c10 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f6b200e49b0 tx=0x7f6b200a96a0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:39.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.355+0000 7f6b3cea0740 1 --2- 172.21.15.7:0/597647797 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557644820350 0x557644bc7430 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6b28009e20 tx=0x7f6b2800e720 comp rx=0 tx=0).stop 2024-09-21T06:45:39.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.355+0000 7f6b3cea0740 1 -- 172.21.15.7:0/597647797 shutdown_connections 2024-09-21T06:45:39.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.355+0000 7f6b3cea0740 1 --2- 172.21.15.7:0/597647797 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5576447ff670 0x557644bc7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:39.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.355+0000 7f6b3cea0740 1 --2- 172.21.15.7:0/597647797 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5576447f7490 0x557644bc7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:39.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.355+0000 7f6b3cea0740 1 --2- 172.21.15.7:0/597647797 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557644820350 0x557644bc7430 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:39.361 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.355+0000 7f6b3cea0740 1 -- 172.21.15.7:0/597647797 >> 172.21.15.7:0/597647797 conn(0x557644814740 msgr2=0x557644bc5320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:39.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.356+0000 7f6b3cea0740 1 -- 172.21.15.7:0/597647797 shutdown_connections 2024-09-21T06:45:39.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.356+0000 7f6b3cea0740 1 -- 172.21.15.7:0/597647797 wait complete. 2024-09-21T06:45:39.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.356+0000 7f6b3cea0740 1 -- start start 2024-09-21T06:45:39.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.356+0000 7f6b3cea0740 1 Processor -- start 2024-09-21T06:45:39.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.357+0000 7f6b3cea0740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5576447f7490 0x557644bd3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:39.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.357+0000 7f6b3cea0740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5576447ff670 0x557644bd35b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:39.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.357+0000 7f6b3cea0740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557644820350 0x557644bdef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:39.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.357+0000 7f6b3cea0740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55764498e890 con 0x5576447f7490 2024-09-21T06:45:39.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.357+0000 7f6b3cea0740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x557644ac7d40 con 0x557644820350 2024-09-21T06:45:39.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.357+0000 7f6b3cea0740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x557644bd5c10 con 0x5576447ff670 2024-09-21T06:45:39.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.357+0000 7f6b34ec9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5576447f7490 0x557644bd3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:39.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.357+0000 7f6b3cea0740 10 client.0 _ll_register_callbacks cb 0x557644b2bc80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:39.362 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.357+0000 7f6b34ec9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5576447f7490 0x557644bd3030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44540/0 (socket says 172.21.15.7:44540) 2024-09-21T06:45:39.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.357+0000 7f6b34ec9640 1 -- 172.21.15.7:0/913725392 learned_addr learned my addr 172.21.15.7:0/913725392 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:39.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.357+0000 7f6b27fff640 1 --2- 172.21.15.7:0/913725392 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5576447ff670 0x557644bd35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:39.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.357+0000 7f6b34ec9640 1 --2- 172.21.15.7:0/913725392 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557644820350 0x557644bdef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:39.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.357+0000 7f6b34ec9640 1 -- 172.21.15.7:0/913725392 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5576447ff670 msgr2=0x557644bd35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:39.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.357+0000 7f6b34ec9640 1 --2- 172.21.15.7:0/913725392 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5576447ff670 0x557644bd35b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:39.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.357+0000 7f6b34ec9640 1 -- 172.21.15.7:0/913725392 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557644820350 msgr2=0x557644bdef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:39.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.357+0000 7f6b34ec9640 1 --2- 172.21.15.7:0/913725392 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557644820350 0x557644bdef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:39.363 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.357+0000 7f6b34ec9640 1 -- 172.21.15.7:0/913725392 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557644bdf510 con 0x5576447f7490 2024-09-21T06:45:39.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.357+0000 7f6b27fff640 1 --2- 172.21.15.7:0/913725392 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5576447ff670 0x557644bd35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:39.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.358+0000 7f6b34ec9640 1 --2- 172.21.15.7:0/913725392 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5576447f7490 0x557644bd3030 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f6b28005b10 tx=0x7f6b28018510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=930c27aa39d2192a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:39.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.358+0000 7f6b0f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:45:39.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.358+0000 7f6b0f7fe640 1 -- 172.21.15.7:0/913725392 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b28005550 con 0x5576447f7490 2024-09-21T06:45:39.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.358+0000 7f6b0f7fe640 1 -- 172.21.15.7:0/913725392 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7f6b280056f0 con 0x5576447f7490 2024-09-21T06:45:39.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.358+0000 7f6b3cea0740 1 -- 172.21.15.7:0/913725392 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b2800ee70 con 0x5576447f7490 2024-09-21T06:45:39.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.358+0000 7f6b0f7fe640 1 -- 172.21.15.7:0/913725392 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6b28030050 con 0x5576447f7490 2024-09-21T06:45:39.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.358+0000 7f6b3cea0740 10 client.17670 fetch_fsmap learned FSMap version 25 2024-09-21T06:45:39.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.358+0000 7f6b3cea0740 1 -- 172.21.15.7:0/913725392 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557644be1e40 con 0x5576447f7490 2024-09-21T06:45:39.364 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.358+0000 7f6b0f7fe640 1 -- 172.21.15.7:0/913725392 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b2800ee70 con 0x5576447f7490 2024-09-21T06:45:39.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.359+0000 7f6b0f7fe640 1 -- 172.21.15.7:0/913725392 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f6b28004680 con 0x5576447f7490 2024-09-21T06:45:39.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.359+0000 7f6b3cea0740 10 client.17670 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:45:39.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.359+0000 7f6b3cea0740 10 client.17670 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:45:39.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.359+0000 7f6b3cea0740 20 client.17670 populate_metadata read hostname 'smithi007' 2024-09-21T06:45:39.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.359+0000 7f6b3cea0740 1 --2- 172.21.15.7:0/913725392 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5576447decd0 0x557644be51a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:39.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.359+0000 7f6b3cea0740 4 client.17670 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:45:39.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.359+0000 7f6b3cea0740 1 -- 172.21.15.7:0/913725392 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557644b3fdb0 con 0x5576447decd0 2024-09-21T06:45:39.365 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.359+0000 7f6b27fff640 1 --2- 172.21.15.7:0/913725392 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5576447decd0 0x557644be51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:39.366 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.359+0000 7f6b27fff640 1 --2- 172.21.15.7:0/913725392 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5576447decd0 0x557644be51a0 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e19a16eb10692be server_cookie=79bdff4b6a913372 in_seq=0 out_seq=0 2024-09-21T06:45:39.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.359+0000 7f6b0f7fe640 10 client.17670 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:45:39.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.360+0000 7f6b0f7fe640 1 -- 172.21.15.7:0/913725392 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557644b3fdb0 con 0x5576447decd0 2024-09-21T06:45:39.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.360+0000 7f6b0f7fe640 10 client.17670 handle_command_reply: tid=0 2024-09-21T06:45:39.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.360+0000 7f6b3cea0740 1 client.17670 shutdown 2024-09-21T06:45:39.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.360+0000 7f6b3cea0740 1 -- 172.21.15.7:0/913725392 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5576447f7490 msgr2=0x557644bd3030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:39.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.360+0000 7f6b3cea0740 1 --2- 172.21.15.7:0/913725392 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5576447f7490 0x557644bd3030 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f6b28005b10 tx=0x7f6b28018510 comp rx=0 tx=0).stop 2024-09-21T06:45:39.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.360+0000 7f6b3cea0740 1 -- 172.21.15.7:0/913725392 shutdown_connections 2024-09-21T06:45:39.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.360+0000 7f6b3cea0740 1 --2- 172.21.15.7:0/913725392 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5576447decd0 0x557644be51a0 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:39.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.360+0000 7f6b0f7fe640 0 client.17670 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:45:39.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.360+0000 7f6b3cea0740 1 --2- 172.21.15.7:0/913725392 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557644820350 0x557644bdef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:39.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.360+0000 7f6b3cea0740 1 --2- 172.21.15.7:0/913725392 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5576447ff670 0x557644bd35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:39.367 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.360+0000 7f6b3cea0740 1 --2- 172.21.15.7:0/913725392 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5576447f7490 0x557644bd3030 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:39.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.360+0000 7f6b3cea0740 1 -- 172.21.15.7:0/913725392 >> 172.21.15.7:0/913725392 conn(0x557644814740 msgr2=0x557644bca610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:39.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.361+0000 7f6b3cea0740 1 -- 172.21.15.7:0/913725392 shutdown_connections 2024-09-21T06:45:39.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.361+0000 7f6b3cea0740 1 -- 172.21.15.7:0/913725392 wait complete. 2024-09-21T06:45:39.368 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.361+0000 7f6b3cea0740 20 client.17670 trim_cache size 0 max 16384 2024-09-21T06:45:39.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:45:38 smithi018 ceph-mon[34477]: pgmap v608: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6 op/s 2024-09-21T06:45:39.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:45:38 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:45:39.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:45:38 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:45:39.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:45:38 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:45:39.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:45:38 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:45:39.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.378+0000 7f6b3cea0740 1 Processor -- start 2024-09-21T06:45:39.381 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.379+0000 7f6b3cea0740 1 -- start start 2024-09-21T06:45:39.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.379+0000 7f6b3cea0740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5576447decd0 0x557644bccbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:39.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.379+0000 7f6b3cea0740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5576447f7490 0x557644bd4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:39.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.379+0000 7f6b3cea0740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5576447ff670 0x557644bd26c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:39.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.379+0000 7f6b3cea0740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6b301b4110 con 0x5576447f7490 2024-09-21T06:45:39.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.379+0000 7f6b3cea0740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6b301b19e0 con 0x5576447ff670 2024-09-21T06:45:39.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.379+0000 7f6b3cea0740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6b301af850 con 0x5576447decd0 2024-09-21T06:45:39.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.379+0000 7f6b27fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5576447f7490 0x557644bd4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:39.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.379+0000 7f6b27fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5576447f7490 0x557644bd4d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44546/0 (socket says 172.21.15.7:44546) 2024-09-21T06:45:39.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.379+0000 7f6b27fff640 1 -- 172.21.15.7:0/3669474875 learned_addr learned my addr 172.21.15.7:0/3669474875 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:39.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.379+0000 7f6b34ec9640 1 --2- 172.21.15.7:0/3669474875 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5576447decd0 0x557644bccbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:39.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.379+0000 7f6b34ec9640 1 --2- 172.21.15.7:0/3669474875 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5576447ff670 0x557644bd26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:39.382 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.379+0000 7f6b27fff640 1 -- 172.21.15.7:0/3669474875 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5576447decd0 msgr2=0x557644bccbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:39.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.379+0000 7f6b27fff640 1 --2- 172.21.15.7:0/3669474875 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5576447decd0 0x557644bccbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:39.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.379+0000 7f6b27fff640 1 -- 172.21.15.7:0/3669474875 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5576447ff670 msgr2=0x557644bd26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:39.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.379+0000 7f6b27fff640 1 --2- 172.21.15.7:0/3669474875 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5576447ff670 0x557644bd26c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:39.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.379+0000 7f6b27fff640 1 -- 172.21.15.7:0/3669474875 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557644bd56b0 con 0x5576447f7490 2024-09-21T06:45:39.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.379+0000 7f6b34ec9640 1 --2- 172.21.15.7:0/3669474875 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5576447decd0 0x557644bccbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:39.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.380+0000 7f6b27fff640 1 --2- 172.21.15.7:0/3669474875 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5576447f7490 0x557644bd4d10 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f6b3006aaa0 tx=0x7f6b18031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48beb3681cef6547 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:39.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.380+0000 7f6b25ffb640 1 -- 172.21.15.7:0/3669474875 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b18035040 con 0x5576447f7490 2024-09-21T06:45:39.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.380+0000 7f6b25ffb640 1 -- 172.21.15.7:0/3669474875 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b180054f0 con 0x5576447f7490 2024-09-21T06:45:39.383 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.380+0000 7f6b25ffb640 1 -- 172.21.15.7:0/3669474875 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b180035f0 con 0x5576447f7490 2024-09-21T06:45:39.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.381+0000 7f6b3cea0740 1 -- 172.21.15.7:0/3669474875 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5576447f7490 msgr2=0x557644bd4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:39.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.381+0000 7f6b3cea0740 1 --2- 172.21.15.7:0/3669474875 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5576447f7490 0x557644bd4d10 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f6b3006aaa0 tx=0x7f6b18031400 comp rx=0 tx=0).stop 2024-09-21T06:45:39.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.381+0000 7f6b3cea0740 1 -- 172.21.15.7:0/3669474875 shutdown_connections 2024-09-21T06:45:39.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.381+0000 7f6b3cea0740 1 --2- 172.21.15.7:0/3669474875 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5576447ff670 0x557644bd26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:39.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.381+0000 7f6b3cea0740 1 --2- 172.21.15.7:0/3669474875 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5576447f7490 0x557644bd4d10 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:39.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.381+0000 7f6b3cea0740 1 --2- 172.21.15.7:0/3669474875 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5576447decd0 0x557644bccbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:39.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.381+0000 7f6b3cea0740 1 -- 172.21.15.7:0/3669474875 >> 172.21.15.7:0/3669474875 conn(0x557644814740 msgr2=0x557644bdde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:39.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.381+0000 7f6b3cea0740 1 -- 172.21.15.7:0/3669474875 shutdown_connections 2024-09-21T06:45:39.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.381+0000 7f6b3cea0740 1 -- 172.21.15.7:0/3669474875 wait complete. 2024-09-21T06:45:39.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.381+0000 7f6b3cea0740 1 -- start start 2024-09-21T06:45:39.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.381+0000 7f6b3cea0740 1 Processor -- start 2024-09-21T06:45:39.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.382+0000 7f6b3cea0740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5576447decd0 0x557644be6540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:39.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.382+0000 7f6b3cea0740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5576447f7490 0x557644be6a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:39.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.382+0000 7f6b3cea0740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5576447ff670 0x557644c4e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:39.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.382+0000 7f6b3cea0740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f6b301afea0 con 0x5576447decd0 2024-09-21T06:45:39.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.382+0000 7f6b3cea0740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6b301b1310 con 0x5576447f7490 2024-09-21T06:45:39.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.382+0000 7f6b3cea0740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f6b301b0570 con 0x5576447ff670 2024-09-21T06:45:39.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.382+0000 7f6b3cea0740 10 client.0 _ll_register_callbacks cb 0x7f6b18009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:39.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.382+0000 7f6b34ec9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5576447decd0 0x557644be6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:39.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.382+0000 7f6b34ec9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5576447decd0 0x557644be6540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:44556/0 (socket says 172.21.15.7:44556) 2024-09-21T06:45:39.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.382+0000 7f6b34ec9640 1 -- 172.21.15.7:0/1979372234 learned_addr learned my addr 172.21.15.7:0/1979372234 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:39.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.382+0000 7f6b27fff640 1 --2- 172.21.15.7:0/1979372234 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5576447f7490 0x557644be6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:39.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.382+0000 7f6b34ec9640 1 --2- 172.21.15.7:0/1979372234 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5576447ff670 0x557644c4e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:39.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.382+0000 7f6b34ec9640 1 -- 172.21.15.7:0/1979372234 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5576447ff670 msgr2=0x557644c4e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:39.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.382+0000 7f6b34ec9640 1 --2- 172.21.15.7:0/1979372234 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5576447ff670 0x557644c4e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:39.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.382+0000 7f6b34ec9640 1 -- 172.21.15.7:0/1979372234 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5576447f7490 msgr2=0x557644be6a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:39.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.382+0000 7f6b34ec9640 1 --2- 172.21.15.7:0/1979372234 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5576447f7490 0x557644be6a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:39.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.382+0000 7f6b34ec9640 1 -- 172.21.15.7:0/1979372234 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557644c4ee60 con 0x5576447decd0 2024-09-21T06:45:39.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.382+0000 7f6b34ec9640 1 --2- 172.21.15.7:0/1979372234 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5576447decd0 0x557644be6540 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f6b28002230 tx=0x7f6b28018510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9edc6804b52a316 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:39.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.382+0000 7f6b0f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:45:39.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.382+0000 7f6b0f7fe640 1 -- 172.21.15.7:0/1979372234 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b2801c070 con 0x5576447decd0 2024-09-21T06:45:39.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.382+0000 7f6b0f7fe640 1 -- 172.21.15.7:0/1979372234 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7f6b28005230 con 0x5576447decd0 2024-09-21T06:45:39.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.383+0000 7f6b3cea0740 1 -- 172.21.15.7:0/1979372234 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b180054f0 con 0x5576447decd0 2024-09-21T06:45:39.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.383+0000 7f6b0f7fe640 1 -- 172.21.15.7:0/1979372234 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6b2800ee70 con 0x5576447decd0 2024-09-21T06:45:39.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.383+0000 7f6b3cea0740 10 client.17676 fetch_fsmap learned FSMap version 25 2024-09-21T06:45:39.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.383+0000 7f6b3cea0740 1 -- 172.21.15.7:0/1979372234 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x557644c4ff60 con 0x5576447decd0 2024-09-21T06:45:39.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.383+0000 7f6b0f7fe640 1 -- 172.21.15.7:0/1979372234 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b180054f0 con 0x5576447decd0 2024-09-21T06:45:39.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.383+0000 7f6b0f7fe640 1 -- 172.21.15.7:0/1979372234 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f6b28010a60 con 0x5576447decd0 2024-09-21T06:45:39.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.383+0000 7f6b3cea0740 10 client.17676 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:45:39.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.383+0000 7f6b3cea0740 10 client.17676 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:45:39.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.383+0000 7f6b3cea0740 20 client.17676 populate_metadata read hostname 'smithi007' 2024-09-21T06:45:39.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.383+0000 7f6b3cea0740 1 --2- 172.21.15.7:0/1979372234 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x557644820350 0x557644c526f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:39.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.383+0000 7f6b3cea0740 4 client.17676 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:45:39.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.383+0000 7f6b3cea0740 1 -- 172.21.15.7:0/1979372234 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x557644b3b860 con 0x557644820350 2024-09-21T06:45:39.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.383+0000 7f6b27fff640 1 --2- 172.21.15.7:0/1979372234 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x557644820350 0x557644c526f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:39.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.384+0000 7f6b27fff640 1 --2- 172.21.15.7:0/1979372234 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x557644820350 0x557644c526f0 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d62e0b4f791c5faa server_cookie=365502a034eb9eed in_seq=0 out_seq=0 2024-09-21T06:45:39.390 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.384+0000 7f6b0f7fe640 10 client.17676 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:45:39.391 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.386+0000 7f6b0f7fe640 1 -- 172.21.15.7:0/1979372234 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x557644b3b860 con 0x557644820350 2024-09-21T06:45:39.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.386+0000 7f6b0f7fe640 10 client.17676 handle_command_reply: tid=0 2024-09-21T06:45:39.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.386+0000 7f6b3cea0740 1 client.17676 shutdown 2024-09-21T06:45:39.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.386+0000 7f6b3cea0740 1 -- 172.21.15.7:0/1979372234 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5576447decd0 msgr2=0x557644be6540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:39.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.386+0000 7f6b3cea0740 1 --2- 172.21.15.7:0/1979372234 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5576447decd0 0x557644be6540 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f6b28002230 tx=0x7f6b28018510 comp rx=0 tx=0).stop 2024-09-21T06:45:39.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.386+0000 7f6b3cea0740 1 -- 172.21.15.7:0/1979372234 shutdown_connections 2024-09-21T06:45:39.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.386+0000 7f6b3cea0740 1 --2- 172.21.15.7:0/1979372234 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x557644820350 0x557644c526f0 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:39.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.386+0000 7f6b3cea0740 1 --2- 172.21.15.7:0/1979372234 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5576447ff670 0x557644c4e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:39.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.386+0000 7f6b3cea0740 1 --2- 172.21.15.7:0/1979372234 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5576447f7490 0x557644be6a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:39.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.386+0000 7f6b0f7fe640 0 client.17676 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:45:39.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.386+0000 7f6b3cea0740 1 --2- 172.21.15.7:0/1979372234 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5576447decd0 0x557644be6540 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:39.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.386+0000 7f6b3cea0740 1 -- 172.21.15.7:0/1979372234 >> 172.21.15.7:0/1979372234 conn(0x557644814740 msgr2=0x557644bd4990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:39.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.386+0000 7f6b3cea0740 1 -- 172.21.15.7:0/1979372234 shutdown_connections 2024-09-21T06:45:39.392 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.386+0000 7f6b3cea0740 1 -- 172.21.15.7:0/1979372234 wait complete. 2024-09-21T06:45:39.393 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.386+0000 7f6b3cea0740 20 client.17676 trim_cache size 0 max 16384 2024-09-21T06:45:39.393 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:45:39.393 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0, 2024-09-21T06:45:39.393 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_tag": "2f69ea29-0ec5-4945-9474-294a8c12e0f0", 2024-09-21T06:45:39.393 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": "asynchronous" 2024-09-21T06:45:39.393 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:45:39.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.387+0000 7f6b3692c640 1 -- 172.21.15.7:0/83253668 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f6b1c0b6700 msgr2=0x7f6b1c0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:39.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.387+0000 7f6b3692c640 1 --2- 172.21.15.7:0/83253668 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f6b1c0b6700 0x7f6b1c0b8c10 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f6b200e49b0 tx=0x7f6b200a96a0 comp rx=0 tx=0).stop 2024-09-21T06:45:39.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.387+0000 7f6b3692c640 1 -- 172.21.15.7:0/83253668 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b30102a60 msgr2=0x7f6b300ff670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:39.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.387+0000 7f6b3692c640 1 --2- 172.21.15.7:0/83253668 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b30102a60 0x7f6b300ff670 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f6b2000d950 tx=0x7f6b2000de10 comp rx=0 tx=0).stop 2024-09-21T06:45:39.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.387+0000 7f6b3692c640 1 -- 172.21.15.7:0/83253668 shutdown_connections 2024-09-21T06:45:39.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.387+0000 7f6b3692c640 1 --2- 172.21.15.7:0/83253668 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f6b1c0b6700 0x7f6b1c0b8c10 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:39.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.387+0000 7f6b3692c640 1 --2- 172.21.15.7:0/83253668 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f6b30108cf0 0x7f6b301000f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:39.394 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.387+0000 7f6b3692c640 1 --2- 172.21.15.7:0/83253668 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6b301083a0 0x7f6b300ffbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:39.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.387+0000 7f6b3692c640 1 --2- 172.21.15.7:0/83253668 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f6b30102a60 0x7f6b300ff670 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:39.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.387+0000 7f6b3692c640 1 -- 172.21.15.7:0/83253668 >> 172.21.15.7:0/83253668 conn(0x7f6b30079730 msgr2=0x7f6b3006b250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:39.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.387+0000 7f6b3692c640 1 -- 172.21.15.7:0/83253668 shutdown_connections 2024-09-21T06:45:39.395 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:39.387+0000 7f6b3692c640 1 -- 172.21.15.7:0/83253668 wait complete. 2024-09-21T06:45:40.072 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:45:40.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:45:39 smithi144 ceph-mon[34653]: scrub queued for path: / 2024-09-21T06:45:40.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:45:39 smithi144 ceph-mon[34653]: scrub summary: idle+waiting paths [/] 2024-09-21T06:45:40.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:45:39 smithi144 ceph-mon[34653]: scrub summary: active paths [/] 2024-09-21T06:45:40.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:45:39 smithi144 ceph-mon[34653]: scrub summary: idle+waiting paths [/] 2024-09-21T06:45:40.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:45:39 smithi144 ceph-mon[34653]: scrub summary: idle 2024-09-21T06:45:40.334 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:45:40.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:45:39 smithi007 ceph-mon[30983]: scrub queued for path: / 2024-09-21T06:45:40.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:45:39 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T06:45:40.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:45:39 smithi007 ceph-mon[30983]: scrub summary: active paths [/] 2024-09-21T06:45:40.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:45:39 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T06:45:40.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:45:39 smithi007 ceph-mon[30983]: scrub summary: idle 2024-09-21T06:45:40.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:45:39 smithi018 ceph-mon[34477]: scrub queued for path: / 2024-09-21T06:45:40.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:45:39 smithi018 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-21T06:45:40.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:45:39 smithi018 ceph-mon[34477]: scrub summary: active paths [/] 2024-09-21T06:45:40.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:45:39 smithi018 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-21T06:45:40.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:45:39 smithi018 ceph-mon[34477]: scrub summary: idle 2024-09-21T06:45:40.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.836+0000 7fc674bb6640 1 -- 172.21.15.7:0/41004632 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc670102a80 msgr2=0x7fc670102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:40.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.836+0000 7fc674bb6640 1 --2- 172.21.15.7:0/41004632 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc670102a80 0x7fc670102e90 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7fc660009900 tx=0x7fc66002e850 comp rx=0 tx=0).stop 2024-09-21T06:45:40.841 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.836+0000 7fc674bb6640 1 -- 172.21.15.7:0/41004632 shutdown_connections 2024-09-21T06:45:40.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.836+0000 7fc674bb6640 1 --2- 172.21.15.7:0/41004632 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc670108d10 0x7fc67010f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:40.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.836+0000 7fc674bb6640 1 --2- 172.21.15.7:0/41004632 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6701083c0 0x7fc6701087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:40.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.836+0000 7fc674bb6640 1 --2- 172.21.15.7:0/41004632 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc670102a80 0x7fc670102e90 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:40.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.836+0000 7fc674bb6640 1 -- 172.21.15.7:0/41004632 >> 172.21.15.7:0/41004632 conn(0x7fc670079740 msgr2=0x7fc670079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:40.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.836+0000 7fc674bb6640 1 -- 172.21.15.7:0/41004632 shutdown_connections 2024-09-21T06:45:40.842 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.836+0000 7fc674bb6640 1 -- 172.21.15.7:0/41004632 wait complete. 2024-09-21T06:45:40.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.837+0000 7fc674bb6640 1 Processor -- start 2024-09-21T06:45:40.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.837+0000 7fc674bb6640 1 -- start start 2024-09-21T06:45:40.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.837+0000 7fc674bb6640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc670102a80 0x7fc6701983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:40.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.837+0000 7fc674bb6640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6701083c0 0x7fc670198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:40.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.837+0000 7fc674bb6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc670108d10 0x7fc67019dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:40.843 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.837+0000 7fc674bb6640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc670111970 con 0x7fc670102a80 2024-09-21T06:45:40.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.837+0000 7fc674bb6640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc6701117f0 con 0x7fc670108d10 2024-09-21T06:45:40.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.837+0000 7fc674bb6640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc670111af0 con 0x7fc6701083c0 2024-09-21T06:45:40.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.837+0000 7fc66e59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc670102a80 0x7fc6701983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:40.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.838+0000 7fc66e59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc670102a80 0x7fc6701983e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51430/0 (socket says 172.21.15.7:51430) 2024-09-21T06:45:40.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.838+0000 7fc66e59c640 1 -- 172.21.15.7:0/395287881 learned_addr learned my addr 172.21.15.7:0/395287881 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:40.844 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.838+0000 7fc66ed9d640 1 --2- 172.21.15.7:0/395287881 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc670108d10 0x7fc67019dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:40.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.838+0000 7fc66dd9b640 1 --2- 172.21.15.7:0/395287881 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6701083c0 0x7fc670198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:40.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.838+0000 7fc66e59c640 1 -- 172.21.15.7:0/395287881 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6701083c0 msgr2=0x7fc670198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:40.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.838+0000 7fc66e59c640 1 --2- 172.21.15.7:0/395287881 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6701083c0 0x7fc670198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:40.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.838+0000 7fc66e59c640 1 -- 172.21.15.7:0/395287881 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc670108d10 msgr2=0x7fc67019dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:40.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.838+0000 7fc66e59c640 1 --2- 172.21.15.7:0/395287881 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc670108d10 0x7fc67019dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:40.845 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.838+0000 7fc66e59c640 1 -- 172.21.15.7:0/395287881 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc67019e350 con 0x7fc670102a80 2024-09-21T06:45:40.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.838+0000 7fc66e59c640 1 --2- 172.21.15.7:0/395287881 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc670102a80 0x7fc6701983e0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7fc66002ed70 tx=0x7fc660037d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:40.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.838+0000 7fc65f7fe640 1 -- 172.21.15.7:0/395287881 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc660044030 con 0x7fc670102a80 2024-09-21T06:45:40.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.838+0000 7fc674bb6640 1 -- 172.21.15.7:0/395287881 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc67019e5e0 con 0x7fc670102a80 2024-09-21T06:45:40.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.838+0000 7fc65f7fe640 1 -- 172.21.15.7:0/395287881 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc660004e70 con 0x7fc670102a80 2024-09-21T06:45:40.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.838+0000 7fc65f7fe640 1 -- 172.21.15.7:0/395287881 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc66003a070 con 0x7fc670102a80 2024-09-21T06:45:40.846 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.839+0000 7fc674bb6640 1 -- 172.21.15.7:0/395287881 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6701a4da0 con 0x7fc670102a80 2024-09-21T06:45:40.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.841+0000 7fc67b12a740 1 Processor -- start 2024-09-21T06:45:40.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.842+0000 7fc67b12a740 1 -- start start 2024-09-21T06:45:40.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.842+0000 7fc65f7fe640 1 -- 172.21.15.7:0/395287881 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7fc660047030 con 0x7fc670102a80 2024-09-21T06:45:40.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.842+0000 7fc67b12a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564bf7315070 0x564bf76bc650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:40.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.842+0000 7fc67b12a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564bf72ec1b0 0x564bf76bcb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:40.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.842+0000 7fc67b12a740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564bf72f4390 0x564bf76bd0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:40.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.842+0000 7fc67b12a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x564bf7632e50 con 0x564bf7315070 2024-09-21T06:45:40.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.842+0000 7fc67b12a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x564bf7622280 con 0x564bf72ec1b0 2024-09-21T06:45:40.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.842+0000 7fc67b12a740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x564bf7626090 con 0x564bf72f4390 2024-09-21T06:45:40.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.842+0000 7fc66ed9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564bf7315070 0x564bf76bc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:40.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.842+0000 7fc66ed9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564bf7315070 0x564bf76bc650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51438/0 (socket says 172.21.15.7:51438) 2024-09-21T06:45:40.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.842+0000 7fc66ed9d640 1 -- 172.21.15.7:0/761912135 learned_addr learned my addr 172.21.15.7:0/761912135 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:40.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.842+0000 7fc66e59c640 1 --2- 172.21.15.7:0/761912135 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564bf72ec1b0 0x564bf76bcb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:40.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.842+0000 7fc66dd9b640 1 --2- 172.21.15.7:0/761912135 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564bf72f4390 0x564bf76bd0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:40.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.842+0000 7fc66ed9d640 1 -- 172.21.15.7:0/761912135 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564bf72f4390 msgr2=0x564bf76bd0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:40.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.842+0000 7fc66ed9d640 1 --2- 172.21.15.7:0/761912135 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564bf72f4390 0x564bf76bd0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:40.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.842+0000 7fc66ed9d640 1 -- 172.21.15.7:0/761912135 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564bf72ec1b0 msgr2=0x564bf76bcb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:40.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.842+0000 7fc66ed9d640 1 --2- 172.21.15.7:0/761912135 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564bf72ec1b0 0x564bf76bcb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:40.859 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.842+0000 7fc66ed9d640 1 -- 172.21.15.7:0/761912135 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564bf7380650 con 0x564bf7315070 2024-09-21T06:45:40.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.843+0000 7fc66ed9d640 1 --2- 172.21.15.7:0/761912135 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564bf7315070 0x564bf76bc650 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7fc6680099c0 tx=0x7fc668009e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d9c7e02a3b95c7d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:40.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.843+0000 7fc65cff9640 1 -- 172.21.15.7:0/761912135 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc668017070 con 0x564bf7315070 2024-09-21T06:45:40.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.843+0000 7fc65cff9640 1 -- 172.21.15.7:0/761912135 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc668013470 con 0x564bf7315070 2024-09-21T06:45:40.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.843+0000 7fc65cff9640 1 -- 172.21.15.7:0/761912135 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6680125d0 con 0x564bf7315070 2024-09-21T06:45:40.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.843+0000 7fc65f7fe640 1 --2- 172.21.15.7:0/395287881 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fc6580b6680 0x7fc6580b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:40.860 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.843+0000 7fc66e59c640 1 --2- 172.21.15.7:0/395287881 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fc6580b6680 0x7fc6580b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:40.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.843+0000 7fc65f7fe640 1 -- 172.21.15.7:0/395287881 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7fc66010bc40 con 0x7fc670102a80 2024-09-21T06:45:40.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.844+0000 7fc67b12a740 1 -- 172.21.15.7:0/761912135 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564bf7315070 msgr2=0x564bf76bc650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:40.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.844+0000 7fc67b12a740 1 --2- 172.21.15.7:0/761912135 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564bf7315070 0x564bf76bc650 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7fc6680099c0 tx=0x7fc668009e80 comp rx=0 tx=0).stop 2024-09-21T06:45:40.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.844+0000 7fc66e59c640 1 --2- 172.21.15.7:0/395287881 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fc6580b6680 0x7fc6580b8b90 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fc6601094b0 tx=0x7fc66010f790 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:40.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.844+0000 7fc67b12a740 1 -- 172.21.15.7:0/761912135 shutdown_connections 2024-09-21T06:45:40.861 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.844+0000 7fc67b12a740 1 --2- 172.21.15.7:0/761912135 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564bf72f4390 0x564bf76bd0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:40.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.844+0000 7fc67b12a740 1 --2- 172.21.15.7:0/761912135 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564bf72ec1b0 0x564bf76bcb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:40.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.844+0000 7fc67b12a740 1 --2- 172.21.15.7:0/761912135 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564bf7315070 0x564bf76bc650 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:40.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.844+0000 7fc67b12a740 1 -- 172.21.15.7:0/761912135 >> 172.21.15.7:0/761912135 conn(0x564bf7309460 msgr2=0x564bf76ba540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:40.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.844+0000 7fc67b12a740 1 -- 172.21.15.7:0/761912135 shutdown_connections 2024-09-21T06:45:40.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.844+0000 7fc67b12a740 1 -- 172.21.15.7:0/761912135 wait complete. 2024-09-21T06:45:40.862 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.844+0000 7fc67b12a740 1 -- start start 2024-09-21T06:45:40.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.845+0000 7fc67b12a740 1 Processor -- start 2024-09-21T06:45:40.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.845+0000 7fc67b12a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564bf72ec1b0 0x564bf76c7d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:40.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.845+0000 7fc67b12a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564bf72f4390 0x564bf76c8270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:40.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.845+0000 7fc67b12a740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564bf7315070 0x564bf76d4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:40.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.845+0000 7fc67b12a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x564bf7483700 con 0x564bf72f4390 2024-09-21T06:45:40.863 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.845+0000 7fc67b12a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x564bf75bd110 con 0x564bf72ec1b0 2024-09-21T06:45:40.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.845+0000 7fc67b12a740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x564bf76cae30 con 0x564bf7315070 2024-09-21T06:45:40.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.845+0000 7fc67b12a740 10 client.0 _ll_register_callbacks cb 0x564bf75d6990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:40.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.845+0000 7fc66dd9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564bf72f4390 0x564bf76c8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:40.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.845+0000 7fc66dd9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564bf72f4390 0x564bf76c8270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51450/0 (socket says 172.21.15.7:51450) 2024-09-21T06:45:40.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.845+0000 7fc66dd9b640 1 -- 172.21.15.7:0/3639828947 learned_addr learned my addr 172.21.15.7:0/3639828947 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:40.864 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.845+0000 7fc66ed9d640 1 --2- 172.21.15.7:0/3639828947 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564bf7315070 0x564bf76d4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:40.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.845+0000 7fc66ed9d640 1 --2- 172.21.15.7:0/3639828947 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564bf72ec1b0 0x564bf76c7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:40.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.845+0000 7fc66dd9b640 1 -- 172.21.15.7:0/3639828947 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564bf7315070 msgr2=0x564bf76d4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:40.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.845+0000 7fc66dd9b640 1 --2- 172.21.15.7:0/3639828947 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564bf7315070 0x564bf76d4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:40.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.845+0000 7fc66dd9b640 1 -- 172.21.15.7:0/3639828947 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564bf72ec1b0 msgr2=0x564bf76c7d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:40.865 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.845+0000 7fc66dd9b640 1 --2- 172.21.15.7:0/3639828947 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564bf72ec1b0 0x564bf76c7d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:40.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.845+0000 7fc66dd9b640 1 -- 172.21.15.7:0/3639828947 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564bf75eac40 con 0x564bf72f4390 2024-09-21T06:45:40.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.846+0000 7fc66dd9b640 1 --2- 172.21.15.7:0/3639828947 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564bf72f4390 0x564bf76c8270 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7fc66400ae70 tx=0x7fc664007680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30da5fa05e0f7b4e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:40.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.846+0000 7fc655ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:45:40.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.846+0000 7fc655ffb640 1 -- 172.21.15.7:0/3639828947 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc664016410 con 0x564bf72f4390 2024-09-21T06:45:40.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.846+0000 7fc655ffb640 1 -- 172.21.15.7:0/3639828947 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7fc6640165b0 con 0x564bf72f4390 2024-09-21T06:45:40.866 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.846+0000 7fc67b12a740 1 -- 172.21.15.7:0/3639828947 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc668013470 con 0x564bf72f4390 2024-09-21T06:45:40.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.846+0000 7fc655ffb640 1 -- 172.21.15.7:0/3639828947 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc6640167b0 con 0x564bf72f4390 2024-09-21T06:45:40.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.846+0000 7fc67b12a740 10 client.17688 fetch_fsmap learned FSMap version 25 2024-09-21T06:45:40.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.846+0000 7fc67b12a740 1 -- 172.21.15.7:0/3639828947 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564bf76d6b60 con 0x564bf72f4390 2024-09-21T06:45:40.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.846+0000 7fc655ffb640 1 -- 172.21.15.7:0/3639828947 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc668013470 con 0x564bf72f4390 2024-09-21T06:45:40.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.846+0000 7fc655ffb640 1 -- 172.21.15.7:0/3639828947 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fc66401fca0 con 0x564bf72f4390 2024-09-21T06:45:40.867 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.847+0000 7fc67b12a740 10 client.17688 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:45:40.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.847+0000 7fc67b12a740 10 client.17688 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:45:40.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.847+0000 7fc67b12a740 20 client.17688 populate_metadata read hostname 'smithi007' 2024-09-21T06:45:40.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.847+0000 7fc67b12a740 1 --2- 172.21.15.7:0/3639828947 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x564bf72d39f0 0x564bf76da0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:40.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.847+0000 7fc67b12a740 4 client.17688 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:45:40.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.847+0000 7fc67b12a740 1 -- 172.21.15.7:0/3639828947 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564bf7634da0 con 0x564bf72d39f0 2024-09-21T06:45:40.868 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.847+0000 7fc66ed9d640 1 --2- 172.21.15.7:0/3639828947 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x564bf72d39f0 0x564bf76da0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:40.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.847+0000 7fc655ffb640 10 client.17688 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:45:40.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.847+0000 7fc66ed9d640 1 --2- 172.21.15.7:0/3639828947 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x564bf72d39f0 0x564bf76da0e0 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=76de4a261c34619 server_cookie=dfe88c51b909fbde in_seq=0 out_seq=0 2024-09-21T06:45:40.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.848+0000 7fc655ffb640 1 -- 172.21.15.7:0/3639828947 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564bf7634da0 con 0x564bf72d39f0 2024-09-21T06:45:40.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.848+0000 7fc655ffb640 10 client.17688 handle_command_reply: tid=0 2024-09-21T06:45:40.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.848+0000 7fc67b12a740 1 client.17688 shutdown 2024-09-21T06:45:40.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.848+0000 7fc67b12a740 1 -- 172.21.15.7:0/3639828947 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564bf72f4390 msgr2=0x564bf76c8270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:40.869 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.848+0000 7fc67b12a740 1 --2- 172.21.15.7:0/3639828947 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564bf72f4390 0x564bf76c8270 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7fc66400ae70 tx=0x7fc664007680 comp rx=0 tx=0).stop 2024-09-21T06:45:40.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.848+0000 7fc67b12a740 1 -- 172.21.15.7:0/3639828947 shutdown_connections 2024-09-21T06:45:40.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.848+0000 7fc67b12a740 1 --2- 172.21.15.7:0/3639828947 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x564bf72d39f0 0x564bf76da0e0 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:40.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.848+0000 7fc67b12a740 1 --2- 172.21.15.7:0/3639828947 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564bf7315070 0x564bf76d4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:40.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.848+0000 7fc67b12a740 1 --2- 172.21.15.7:0/3639828947 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564bf72f4390 0x564bf76c8270 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:40.870 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.848+0000 7fc67b12a740 1 --2- 172.21.15.7:0/3639828947 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564bf72ec1b0 0x564bf76c7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:40.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.848+0000 7fc67b12a740 1 -- 172.21.15.7:0/3639828947 >> 172.21.15.7:0/3639828947 conn(0x564bf7309460 msgr2=0x564bf76bf800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:40.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.848+0000 7fc655ffb640 0 client.17688 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:45:40.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.849+0000 7fc67b12a740 1 -- 172.21.15.7:0/3639828947 shutdown_connections 2024-09-21T06:45:40.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.849+0000 7fc67b12a740 1 -- 172.21.15.7:0/3639828947 wait complete. 2024-09-21T06:45:40.871 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.849+0000 7fc67b12a740 20 client.17688 trim_cache size 0 max 16384 2024-09-21T06:45:40.880 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.866+0000 7fc67b12a740 1 Processor -- start 2024-09-21T06:45:40.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.866+0000 7fc67b12a740 1 -- start start 2024-09-21T06:45:40.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.866+0000 7fc67b12a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564bf72ec1b0 0x564bf76be040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:40.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.866+0000 7fc67b12a740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564bf72f4390 0x564bf76c9960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:40.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.866+0000 7fc67b12a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564bf7315070 0x564bf76b9b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:40.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.866+0000 7fc67b12a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc6701afc90 con 0x564bf7315070 2024-09-21T06:45:40.881 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.866+0000 7fc67b12a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc6701ad560 con 0x564bf72ec1b0 2024-09-21T06:45:40.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.866+0000 7fc67b12a740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc6701ab3d0 con 0x564bf72f4390 2024-09-21T06:45:40.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.867+0000 7fc66ed9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564bf7315070 0x564bf76b9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:40.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.867+0000 7fc66ed9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564bf7315070 0x564bf76b9b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51456/0 (socket says 172.21.15.7:51456) 2024-09-21T06:45:40.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.867+0000 7fc66ed9d640 1 -- 172.21.15.7:0/4173647936 learned_addr learned my addr 172.21.15.7:0/4173647936 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:40.882 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.867+0000 7fc66ed9d640 1 --2- 172.21.15.7:0/4173647936 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564bf72ec1b0 0x564bf76be040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:40.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.867+0000 7fc66dd9b640 1 --2- 172.21.15.7:0/4173647936 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564bf72f4390 0x564bf76c9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:40.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.867+0000 7fc66ed9d640 1 -- 172.21.15.7:0/4173647936 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564bf72f4390 msgr2=0x564bf76c9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:40.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.867+0000 7fc66ed9d640 1 --2- 172.21.15.7:0/4173647936 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564bf72f4390 0x564bf76c9960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:40.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.867+0000 7fc66ed9d640 1 -- 172.21.15.7:0/4173647936 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564bf72ec1b0 msgr2=0x564bf76be040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:40.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.867+0000 7fc66ed9d640 1 --2- 172.21.15.7:0/4173647936 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564bf72ec1b0 0x564bf76be040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:40.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.867+0000 7fc66ed9d640 1 -- 172.21.15.7:0/4173647936 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564bf76c8dd0 con 0x564bf7315070 2024-09-21T06:45:40.883 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.867+0000 7fc66ed9d640 1 --2- 172.21.15.7:0/4173647936 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564bf7315070 0x564bf76b9b70 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7fc668009ec0 tx=0x7fc668000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81081efef43780f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:40.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.867+0000 7fc657fff640 1 -- 172.21.15.7:0/4173647936 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc668017070 con 0x564bf7315070 2024-09-21T06:45:40.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.867+0000 7fc657fff640 1 -- 172.21.15.7:0/4173647936 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc6680044d0 con 0x564bf7315070 2024-09-21T06:45:40.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.867+0000 7fc657fff640 1 -- 172.21.15.7:0/4173647936 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc668003980 con 0x564bf7315070 2024-09-21T06:45:40.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.868+0000 7fc67b12a740 1 -- 172.21.15.7:0/4173647936 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564bf7315070 msgr2=0x564bf76b9b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:40.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.868+0000 7fc67b12a740 1 --2- 172.21.15.7:0/4173647936 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564bf7315070 0x564bf76b9b70 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7fc668009ec0 tx=0x7fc668000bc0 comp rx=0 tx=0).stop 2024-09-21T06:45:40.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.868+0000 7fc67b12a740 1 -- 172.21.15.7:0/4173647936 shutdown_connections 2024-09-21T06:45:40.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.868+0000 7fc67b12a740 1 --2- 172.21.15.7:0/4173647936 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564bf7315070 0x564bf76b9b70 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:40.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.868+0000 7fc67b12a740 1 --2- 172.21.15.7:0/4173647936 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564bf72f4390 0x564bf76c9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:40.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.868+0000 7fc67b12a740 1 --2- 172.21.15.7:0/4173647936 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564bf72ec1b0 0x564bf76be040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:40.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.868+0000 7fc67b12a740 1 -- 172.21.15.7:0/4173647936 >> 172.21.15.7:0/4173647936 conn(0x564bf7309460 msgr2=0x564bf76c9250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:40.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.868+0000 7fc67b12a740 1 -- 172.21.15.7:0/4173647936 shutdown_connections 2024-09-21T06:45:40.884 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.868+0000 7fc67b12a740 1 -- 172.21.15.7:0/4173647936 wait complete. 2024-09-21T06:45:40.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.868+0000 7fc67b12a740 1 -- start start 2024-09-21T06:45:40.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.869+0000 7fc67b12a740 1 Processor -- start 2024-09-21T06:45:40.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.869+0000 7fc67b12a740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564bf72ec1b0 0x564bf773cc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:40.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.869+0000 7fc67b12a740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564bf72f4390 0x564bf773d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:40.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.869+0000 7fc67b12a740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564bf7315070 0x564bf76cfea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:40.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.869+0000 7fc67b12a740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc6701aba20 con 0x564bf72f4390 2024-09-21T06:45:40.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.869+0000 7fc67b12a740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc6701ace90 con 0x564bf7315070 2024-09-21T06:45:40.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.869+0000 7fc67b12a740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc6701ac0f0 con 0x564bf72ec1b0 2024-09-21T06:45:40.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.869+0000 7fc67b12a740 10 client.0 _ll_register_callbacks cb 0x7fc664009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:40.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.869+0000 7fc66dd9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564bf72f4390 0x564bf773d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:40.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.869+0000 7fc66dd9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564bf72f4390 0x564bf773d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51458/0 (socket says 172.21.15.7:51458) 2024-09-21T06:45:40.885 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.869+0000 7fc66dd9b640 1 -- 172.21.15.7:0/3560169077 learned_addr learned my addr 172.21.15.7:0/3560169077 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:40.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.869+0000 7fc66ed9d640 1 --2- 172.21.15.7:0/3560169077 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564bf7315070 0x564bf76cfea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:40.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.869+0000 7fc66dd9b640 1 -- 172.21.15.7:0/3560169077 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564bf72ec1b0 msgr2=0x564bf773cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:40.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.869+0000 7fc66dd9b640 1 --2- 172.21.15.7:0/3560169077 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564bf72ec1b0 0x564bf773cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:40.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.869+0000 7fc66dd9b640 1 -- 172.21.15.7:0/3560169077 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564bf7315070 msgr2=0x564bf76cfea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:40.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.869+0000 7fc66dd9b640 1 --2- 172.21.15.7:0/3560169077 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564bf7315070 0x564bf76cfea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:40.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.869+0000 7fc66dd9b640 1 -- 172.21.15.7:0/3560169077 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564bf76d0510 con 0x564bf72f4390 2024-09-21T06:45:40.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.870+0000 7fc66dd9b640 1 --2- 172.21.15.7:0/3560169077 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564bf72f4390 0x564bf773d220 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7fc664001220 tx=0x7fc664007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e8de440f0d3abf8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:40.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.870+0000 7fc655ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:45:40.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.870+0000 7fc655ffb640 1 -- 172.21.15.7:0/3560169077 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc664016040 con 0x564bf72f4390 2024-09-21T06:45:40.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.870+0000 7fc655ffb640 1 -- 172.21.15.7:0/3560169077 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7fc6640161e0 con 0x564bf72f4390 2024-09-21T06:45:40.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.870+0000 7fc67b12a740 1 -- 172.21.15.7:0/3560169077 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc6680044d0 con 0x564bf72f4390 2024-09-21T06:45:40.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.870+0000 7fc655ffb640 1 -- 172.21.15.7:0/3560169077 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc6640163e0 con 0x564bf72f4390 2024-09-21T06:45:40.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.870+0000 7fc67b12a740 10 client.17694 fetch_fsmap learned FSMap version 25 2024-09-21T06:45:40.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.870+0000 7fc67b12a740 1 -- 172.21.15.7:0/3560169077 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564bf77444b0 con 0x564bf72f4390 2024-09-21T06:45:40.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.870+0000 7fc655ffb640 1 -- 172.21.15.7:0/3560169077 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc6680044d0 con 0x564bf72f4390 2024-09-21T06:45:40.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.870+0000 7fc655ffb640 1 -- 172.21.15.7:0/3560169077 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fc66403b050 con 0x564bf72f4390 2024-09-21T06:45:40.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.871+0000 7fc67b12a740 10 client.17694 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:45:40.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.871+0000 7fc67b12a740 10 client.17694 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:45:40.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.871+0000 7fc67b12a740 20 client.17694 populate_metadata read hostname 'smithi007' 2024-09-21T06:45:40.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.871+0000 7fc67b12a740 1 --2- 172.21.15.7:0/3560169077 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x564bf72a8da0 0x564bf7746bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:40.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.871+0000 7fc67b12a740 4 client.17694 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:45:40.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.871+0000 7fc67b12a740 1 -- 172.21.15.7:0/3560169077 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564bf7630850 con 0x564bf72a8da0 2024-09-21T06:45:40.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.871+0000 7fc66ed9d640 1 --2- 172.21.15.7:0/3560169077 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x564bf72a8da0 0x564bf7746bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:40.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.871+0000 7fc66ed9d640 1 --2- 172.21.15.7:0/3560169077 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x564bf72a8da0 0x564bf7746bf0 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e0a4dfc74e2f3d16 server_cookie=65ca1fd35ab7dca5 in_seq=0 out_seq=0 2024-09-21T06:45:40.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.871+0000 7fc655ffb640 10 client.17694 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:45:40.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.872+0000 7fc655ffb640 1 -- 172.21.15.7:0/3560169077 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+5770 (crc 0 0 0) 0x564bf7630850 con 0x564bf72a8da0 2024-09-21T06:45:40.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.872+0000 7fc655ffb640 10 client.17694 handle_command_reply: tid=0 2024-09-21T06:45:40.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.872+0000 7fc67b12a740 1 client.17694 shutdown 2024-09-21T06:45:40.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.872+0000 7fc67b12a740 1 -- 172.21.15.7:0/3560169077 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564bf72f4390 msgr2=0x564bf773d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:40.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.872+0000 7fc67b12a740 1 --2- 172.21.15.7:0/3560169077 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564bf72f4390 0x564bf773d220 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7fc664001220 tx=0x7fc664007f40 comp rx=0 tx=0).stop 2024-09-21T06:45:40.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.872+0000 7fc67b12a740 1 -- 172.21.15.7:0/3560169077 shutdown_connections 2024-09-21T06:45:40.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.872+0000 7fc67b12a740 1 --2- 172.21.15.7:0/3560169077 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x564bf72a8da0 0x564bf7746bf0 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:40.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.872+0000 7fc67b12a740 1 --2- 172.21.15.7:0/3560169077 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x564bf7315070 0x564bf76cfea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:40.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.872+0000 7fc67b12a740 1 --2- 172.21.15.7:0/3560169077 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x564bf72f4390 0x564bf773d220 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:40.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.872+0000 7fc67b12a740 1 --2- 172.21.15.7:0/3560169077 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x564bf72ec1b0 0x564bf773cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:40.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.872+0000 7fc67b12a740 1 -- 172.21.15.7:0/3560169077 >> 172.21.15.7:0/3560169077 conn(0x564bf7309460 msgr2=0x564bf76bde10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:40.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.872+0000 7fc655ffb640 0 client.17694 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:45:40.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.872+0000 7fc67b12a740 1 -- 172.21.15.7:0/3560169077 shutdown_connections 2024-09-21T06:45:40.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.872+0000 7fc67b12a740 1 -- 172.21.15.7:0/3560169077 wait complete. 2024-09-21T06:45:40.888 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.872+0000 7fc67b12a740 20 client.17694 trim_cache size 0 max 16384 2024-09-21T06:45:40.889 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:45:40.889 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "no active scrubs running", 2024-09-21T06:45:40.889 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": {}, 2024-09-21T06:45:40.889 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_stats": { 2024-09-21T06:45:40.889 INFO:teuthology.orchestra.run.smithi007.stdout: "2f69ea29-0ec5-4945-9474-294a8c12e0f0": { 2024-09-21T06:45:40.889 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:45:39.384528+0000", 2024-09-21T06:45:40.889 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:40.889 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:40.889 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:40.890 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:40.890 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:40.890 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:40.890 INFO:teuthology.orchestra.run.smithi007.stdout: "2ef7127c-8e1a-4ec7-930c-fdda4f777a52": { 2024-09-21T06:45:40.890 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:45:29.079652+0000", 2024-09-21T06:45:40.890 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:40.890 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:40.890 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:40.890 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:40.890 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:40.890 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:40.890 INFO:teuthology.orchestra.run.smithi007.stdout: "fe20df33-20a9-4e2f-be35-9778411fd6cd": { 2024-09-21T06:45:40.891 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:45:18.561779+0000", 2024-09-21T06:45:40.891 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:40.891 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:40.891 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:40.891 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:40.891 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:40.891 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:40.891 INFO:teuthology.orchestra.run.smithi007.stdout: "d98b2d47-c2db-4811-8b3e-ec744a20d9d6": { 2024-09-21T06:45:40.891 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:44:03.790680+0000", 2024-09-21T06:45:40.891 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:40.891 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:40.891 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:40.891 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:40.892 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:40.892 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:40.892 INFO:teuthology.orchestra.run.smithi007.stdout: "310a0ec8-44bb-49ed-a534-3bc91cb1ee9d": { 2024-09-21T06:45:40.892 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:40:55.373968+0000", 2024-09-21T06:45:40.892 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:40.892 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:40.892 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:40.892 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:40.892 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:40.892 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:40.892 INFO:teuthology.orchestra.run.smithi007.stdout: "dd792920-08a1-482d-8961-5c6a6f131599": { 2024-09-21T06:45:40.892 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:43:53.390806+0000", 2024-09-21T06:45:40.892 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:40.893 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:40.893 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:40.893 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:40.893 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:40.893 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:40.893 INFO:teuthology.orchestra.run.smithi007.stdout: "13441782-2231-4713-8ebd-068a941de47f": { 2024-09-21T06:45:40.893 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:39:30.219006+0000", 2024-09-21T06:45:40.893 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:40.893 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:40.893 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:40.893 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:40.893 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:40.893 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:40.893 INFO:teuthology.orchestra.run.smithi007.stdout: "02016ff7-8cc2-467e-a465-f69400f702cb": { 2024-09-21T06:45:40.893 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:44:25.093423+0000", 2024-09-21T06:45:40.894 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:40.894 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:40.894 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:40.894 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:40.894 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:40.894 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:40.894 INFO:teuthology.orchestra.run.smithi007.stdout: "b0327167-8c41-4286-8afc-7f0780972fd7": { 2024-09-21T06:45:40.894 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:38:36.828657+0000", 2024-09-21T06:45:40.894 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:40.894 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:40.894 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:40.894 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:40.895 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:40.895 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:40.895 INFO:teuthology.orchestra.run.smithi007.stdout: "d7b6a90c-9ae1-4e02-93ad-335a7e9df1d7": { 2024-09-21T06:45:40.895 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:39:19.226139+0000", 2024-09-21T06:45:40.895 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:40.895 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:40.895 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:40.895 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:40.895 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:40.895 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:40.895 INFO:teuthology.orchestra.run.smithi007.stdout: "3f7283b7-f175-4023-9191-177660b3a6be": { 2024-09-21T06:45:40.895 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:44:14.422552+0000", 2024-09-21T06:45:40.895 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:40.896 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:40.896 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:40.896 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:40.896 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:40.896 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:40.896 INFO:teuthology.orchestra.run.smithi007.stdout: "6231e9c1-14a2-40b5-be3c-76d87a0d733b": { 2024-09-21T06:45:40.896 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:37:02.484812+0000", 2024-09-21T06:45:40.896 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:40.896 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:40.896 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:40.896 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:40.896 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:40.896 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:40.897 INFO:teuthology.orchestra.run.smithi007.stdout: "a1ae5b3b-f158-44be-8ef4-d70e9ba879cc": { 2024-09-21T06:45:40.897 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:41:37.568453+0000", 2024-09-21T06:45:40.897 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:40.897 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:40.897 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:40.897 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:40.897 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:40.897 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:40.897 INFO:teuthology.orchestra.run.smithi007.stdout: "62fca477-b241-45f5-8185-bc78aeb8b19f": { 2024-09-21T06:45:40.897 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:40:12.744488+0000", 2024-09-21T06:45:40.897 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:40.897 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:40.897 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:40.898 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:40.898 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:40.898 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:40.898 INFO:teuthology.orchestra.run.smithi007.stdout: "5cbaaba2-6ab1-4f83-abd6-8c6eef4b5c42": { 2024-09-21T06:45:40.898 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:37:46.566272+0000", 2024-09-21T06:45:40.898 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:40.898 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:40.898 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:40.898 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:40.898 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:40.898 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:40.898 INFO:teuthology.orchestra.run.smithi007.stdout: "b466f071-ab32-427c-a0ed-73edea33145e": { 2024-09-21T06:45:40.898 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:43:01.151440+0000", 2024-09-21T06:45:40.899 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:40.899 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:40.899 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:40.899 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:40.899 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:40.899 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:40.899 INFO:teuthology.orchestra.run.smithi007.stdout: "ef9eaabd-003a-44fb-8373-c854a9e15a71": { 2024-09-21T06:45:40.899 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:42:19.467946+0000", 2024-09-21T06:45:40.899 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:40.899 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:40.899 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:40.899 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:40.900 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:40.900 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:40.900 INFO:teuthology.orchestra.run.smithi007.stdout: "a53a88e2-8599-4b25-a72c-3377770d50ea": { 2024-09-21T06:45:40.900 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:45:07.921907+0000", 2024-09-21T06:45:40.900 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:40.900 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:40.900 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:40.900 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:40.900 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:40.900 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:40.900 INFO:teuthology.orchestra.run.smithi007.stdout: "0b89345c-1f00-4efe-8ee9-4cb17e43584c": { 2024-09-21T06:45:40.900 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:36:19.500334+0000", 2024-09-21T06:45:40.900 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:40.900 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:40.901 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:40.901 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:40.901 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:40.901 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:40.901 INFO:teuthology.orchestra.run.smithi007.stdout: "3c5b7f3f-e9b3-4d48-8154-2d7d4700992e": { 2024-09-21T06:45:40.901 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:43:43.120930+0000", 2024-09-21T06:45:40.901 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:40.901 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:40.901 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:40.901 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:40.901 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:40.901 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:45:40.901 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:45:40.901 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:45:40.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.873+0000 7fc674bb6640 1 -- 172.21.15.7:0/395287881 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fc6580b6680 msgr2=0x7fc6580b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:40.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.873+0000 7fc674bb6640 1 --2- 172.21.15.7:0/395287881 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fc6580b6680 0x7fc6580b8b90 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fc6601094b0 tx=0x7fc66010f790 comp rx=0 tx=0).stop 2024-09-21T06:45:40.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.873+0000 7fc674bb6640 1 -- 172.21.15.7:0/395287881 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc670102a80 msgr2=0x7fc6701983e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:40.902 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.873+0000 7fc674bb6640 1 --2- 172.21.15.7:0/395287881 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc670102a80 0x7fc6701983e0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7fc66002ed70 tx=0x7fc660037d30 comp rx=0 tx=0).stop 2024-09-21T06:45:40.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.873+0000 7fc674bb6640 1 -- 172.21.15.7:0/395287881 shutdown_connections 2024-09-21T06:45:40.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.873+0000 7fc674bb6640 1 --2- 172.21.15.7:0/395287881 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fc6580b6680 0x7fc6580b8b90 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:40.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.873+0000 7fc674bb6640 1 --2- 172.21.15.7:0/395287881 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc670108d10 0x7fc67019dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:40.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.873+0000 7fc674bb6640 1 --2- 172.21.15.7:0/395287881 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc6701083c0 0x7fc670198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:40.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.873+0000 7fc674bb6640 1 --2- 172.21.15.7:0/395287881 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc670102a80 0x7fc6701983e0 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:40.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.873+0000 7fc674bb6640 1 -- 172.21.15.7:0/395287881 >> 172.21.15.7:0/395287881 conn(0x7fc670079740 msgr2=0x7fc670101550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:40.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.873+0000 7fc674bb6640 1 -- 172.21.15.7:0/395287881 shutdown_connections 2024-09-21T06:45:40.903 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:40.873+0000 7fc674bb6640 1 -- 172.21.15.7:0/395287881 wait complete. 2024-09-21T06:45:41.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:45:40 smithi007 ceph-mon[30983]: pgmap v609: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:45:41.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:45:40 smithi144 ceph-mon[34653]: pgmap v609: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:45:41.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:45:40 smithi018 ceph-mon[34477]: pgmap v609: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:45:41.587 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:45:41.587 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:45:41.846 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:45:42.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:42.367+0000 7fee0b7d7640 1 -- 172.21.15.7:0/3661997294 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee0410de40 msgr2=0x7fee04110330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:42.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:42.367+0000 7fee0b7d7640 1 --2- 172.21.15.7:0/3661997294 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee0410de40 0x7fee04110330 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7fedfc009ca0 tx=0x7fedfc02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:45:42.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:42.367+0000 7fee0b7d7640 1 -- 172.21.15.7:0/3661997294 shutdown_connections 2024-09-21T06:45:42.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:42.367+0000 7fee0b7d7640 1 --2- 172.21.15.7:0/3661997294 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee0410de40 0x7fee04110330 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:42.386 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:42.368+0000 7fee0b7d7640 1 --2- 172.21.15.7:0/3661997294 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee04105330 0x7fee0410d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:42.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:42.368+0000 7fee0b7d7640 1 --2- 172.21.15.7:0/3661997294 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee041049e0 0x7fee04104df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:42.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:42.368+0000 7fee0b7d7640 1 -- 172.21.15.7:0/3661997294 >> 172.21.15.7:0/3661997294 conn(0x7fee04079750 msgr2=0x7fee04079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:42.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:42.368+0000 7fee0b7d7640 1 -- 172.21.15.7:0/3661997294 shutdown_connections 2024-09-21T06:45:42.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:42.368+0000 7fee0b7d7640 1 -- 172.21.15.7:0/3661997294 wait complete. 2024-09-21T06:45:42.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:42.368+0000 7fee0b7d7640 1 Processor -- start 2024-09-21T06:45:42.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:42.368+0000 7fee0b7d7640 1 -- start start 2024-09-21T06:45:42.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:42.369+0000 7fee0b7d7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee041049e0 0x7fee04102720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:42.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:42.369+0000 7fee0b7d7640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee04105330 0x7fee04102c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:42.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:42.369+0000 7fee0b7d7640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee0410de40 0x7fee041031a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:42.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:42.369+0000 7fee0b7d7640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fee04113aa0 con 0x7fee04105330 2024-09-21T06:45:42.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:42.369+0000 7fee0b7d7640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fee04113920 con 0x7fee041049e0 2024-09-21T06:45:42.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:42.369+0000 7fee0b7d7640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fee04113c20 con 0x7fee0410de40 2024-09-21T06:45:42.387 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:42.369+0000 7fee08d72640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee04105330 0x7fee04102c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:42.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:42.369+0000 7fee08d72640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee04105330 0x7fee04102c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51472/0 (socket says 172.21.15.7:51472) 2024-09-21T06:45:42.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:42.369+0000 7fee08d72640 1 -- 172.21.15.7:0/4077107826 learned_addr learned my addr 172.21.15.7:0/4077107826 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:42.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:42.369+0000 7fee09d74640 1 --2- 172.21.15.7:0/4077107826 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee0410de40 0x7fee041031a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:42.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:42.369+0000 7fee09573640 1 --2- 172.21.15.7:0/4077107826 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee041049e0 0x7fee04102720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:42.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:42.369+0000 7fee08d72640 1 -- 172.21.15.7:0/4077107826 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee0410de40 msgr2=0x7fee041031a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:42.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:42.369+0000 7fee08d72640 1 --2- 172.21.15.7:0/4077107826 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee0410de40 0x7fee041031a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:42.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:42.369+0000 7fee08d72640 1 -- 172.21.15.7:0/4077107826 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee041049e0 msgr2=0x7fee04102720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:42.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:42.369+0000 7fee08d72640 1 --2- 172.21.15.7:0/4077107826 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee041049e0 0x7fee04102720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:42.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:42.369+0000 7fee08d72640 1 -- 172.21.15.7:0/4077107826 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee041a8730 con 0x7fee04105330 2024-09-21T06:45:42.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:42.369+0000 7fee09573640 1 --2- 172.21.15.7:0/4077107826 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee041049e0 0x7fee04102720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:42.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:42.369+0000 7fee08d72640 1 --2- 172.21.15.7:0/4077107826 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee04105330 0x7fee04102c60 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7fedf400d740 tx=0x7fedf400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:42.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:42.369+0000 7fedfa7fc640 1 -- 172.21.15.7:0/4077107826 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedf4017070 con 0x7fee04105330 2024-09-21T06:45:42.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:42.370+0000 7fedfa7fc640 1 -- 172.21.15.7:0/4077107826 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fedf400de50 con 0x7fee04105330 2024-09-21T06:45:42.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:42.370+0000 7fedfa7fc640 1 -- 172.21.15.7:0/4077107826 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedf400f620 con 0x7fee04105330 2024-09-21T06:45:42.388 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:42.370+0000 7fee0b7d7640 1 -- 172.21.15.7:0/4077107826 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee041a8a20 con 0x7fee04105330 2024-09-21T06:45:42.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:42.370+0000 7fee0b7d7640 1 -- 172.21.15.7:0/4077107826 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee041a8fb0 con 0x7fee04105330 2024-09-21T06:45:42.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:42.371+0000 7fee0b7d7640 1 -- 172.21.15.7:0/4077107826 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee0406c280 con 0x7fee04105330 2024-09-21T06:45:42.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:42.372+0000 7fedfa7fc640 1 -- 172.21.15.7:0/4077107826 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7fedf401a070 con 0x7fee04105330 2024-09-21T06:45:42.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:42.373+0000 7fedfa7fc640 1 --2- 172.21.15.7:0/4077107826 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fedf00b6700 0x7fedf00b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:42.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:42.373+0000 7fee09573640 1 --2- 172.21.15.7:0/4077107826 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fedf00b6700 0x7fedf00b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:42.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:42.373+0000 7fedfa7fc640 1 -- 172.21.15.7:0/4077107826 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7fedf40e7040 con 0x7fee04105330 2024-09-21T06:45:42.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:42.373+0000 7fee09573640 1 --2- 172.21.15.7:0/4077107826 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fedf00b6700 0x7fedf00b8c10 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fee04104170 tx=0x7fee00005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:42.389 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:42.376+0000 7fedfa7fc640 1 -- 172.21.15.7:0/4077107826 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fedf40ad680 con 0x7fee04105330 2024-09-21T06:45:42.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:42.602+0000 7fee0b7d7640 1 -- 172.21.15.7:0/4077107826 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fee04103a20 con 0x7fee04105330 2024-09-21T06:45:42.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:42.602+0000 7fedfa7fc640 1 -- 172.21.15.7:0/4077107826 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11899 (secure 0 0 0) 0x7fedf40b1a60 con 0x7fee04105330 2024-09-21T06:45:42.604 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:45:42.604 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-21T06:36:10:753693+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2015971546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2015971546},{"type":"v1","addr":"172.21.15.7:6835","nonce":2015971546}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/2350816224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":2350816224},{"type":"v1","addr":"172.21.15.7:6837","nonce":2350816224}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14823,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/1669980572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":1669980572},{"type":"v1","addr":"172.21.15.7:6839","nonce":1669980572}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14835,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/2528308973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":2528308973},{"type":"v1","addr":"172.21.15.7:6841","nonce":2528308973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24623,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1337382979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1337382979},{"type":"v1","addr":"172.21.15.18:6833","nonce":1337382979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/2751454345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":2751454345},{"type":"v1","addr":"172.21.15.144:6833","nonce":2751454345}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:34:24.627168+0000","modified":"2024-09-21T06:36:10.737288+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24716,"mds_1":24688,"mds_2":24686},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24656":{"gid":24656,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6835/158884796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":158884796},{"type":"v1","addr":"172.21.15.18:6835","nonce":158884796}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6835/3636739922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3636739922},{"type":"v1","addr":"172.21.15.144:6835","nonce":3636739922}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24673":{"gid":24673,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6837/1126341753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":1126341753},{"type":"v1","addr":"172.21.15.144:6837","nonce":1126341753}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.18:6837/1539670694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1539670694},{"type":"v1","addr":"172.21.15.18:6837","nonce":1539670694}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24688":{"gid":24688,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.144:6839/4027821922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":4027821922},{"type":"v1","addr":"172.21.15.144:6839","nonce":4027821922}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24716":{"gid":24716,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.18:6839/3798713532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":3798713532},{"type":"v1","addr":"172.21.15.18:6839","nonce":3798713532}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24716,"qdb_cluster":[24716,24688,24686]},"id":1}]} 2024-09-21T06:45:42.605 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-21T06:45:42.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:42.605+0000 7fee0b7d7640 1 -- 172.21.15.7:0/4077107826 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fedf00b6700 msgr2=0x7fedf00b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:42.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:42.605+0000 7fee0b7d7640 1 --2- 172.21.15.7:0/4077107826 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fedf00b6700 0x7fedf00b8c10 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fee04104170 tx=0x7fee00005f90 comp rx=0 tx=0).stop 2024-09-21T06:45:42.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:42.605+0000 7fee0b7d7640 1 -- 172.21.15.7:0/4077107826 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee04105330 msgr2=0x7fee04102c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:42.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:42.605+0000 7fee0b7d7640 1 --2- 172.21.15.7:0/4077107826 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee04105330 0x7fee04102c60 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7fedf400d740 tx=0x7fedf400dc00 comp rx=0 tx=0).stop 2024-09-21T06:45:42.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:42.605+0000 7fee0b7d7640 1 -- 172.21.15.7:0/4077107826 shutdown_connections 2024-09-21T06:45:42.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:42.605+0000 7fee0b7d7640 1 --2- 172.21.15.7:0/4077107826 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fedf00b6700 0x7fedf00b8c10 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:42.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:42.605+0000 7fee0b7d7640 1 --2- 172.21.15.7:0/4077107826 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fee0410de40 0x7fee041031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:42.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:42.605+0000 7fee0b7d7640 1 --2- 172.21.15.7:0/4077107826 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fee04105330 0x7fee04102c60 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:42.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:42.605+0000 7fee0b7d7640 1 --2- 172.21.15.7:0/4077107826 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee041049e0 0x7fee04102720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:42.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:42.605+0000 7fee0b7d7640 1 -- 172.21.15.7:0/4077107826 >> 172.21.15.7:0/4077107826 conn(0x7fee04079750 msgr2=0x7fee04107960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:42.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:42.605+0000 7fee0b7d7640 1 -- 172.21.15.7:0/4077107826 shutdown_connections 2024-09-21T06:45:42.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:42.605+0000 7fee0b7d7640 1 -- 172.21.15.7:0/4077107826 wait complete. 2024-09-21T06:45:43.266 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:45:42 smithi007 ceph-mon[30983]: pgmap v610: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 7 op/s 2024-09-21T06:45:43.267 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:45:42 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/4077107826' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:45:43.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:45:42 smithi144 ceph-mon[34653]: pgmap v610: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 7 op/s 2024-09-21T06:45:43.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:45:42 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/4077107826' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:45:43.298 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:45:43.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:45:42 smithi018 ceph-mon[34477]: pgmap v610: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 7 op/s 2024-09-21T06:45:43.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:45:42 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/4077107826' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:45:43.557 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:45:44.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.057+0000 7f0516ad8640 1 -- 172.21.15.7:0/3481098440 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05101083a0 msgr2=0x7f05101087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:44.062 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.057+0000 7f0516ad8640 1 --2- 172.21.15.7:0/3481098440 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05101083a0 0x7f05101087b0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f04f8009900 tx=0x7f04f802a410 comp rx=0 tx=0).stop 2024-09-21T06:45:44.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.057+0000 7f0516ad8640 1 -- 172.21.15.7:0/3481098440 shutdown_connections 2024-09-21T06:45:44.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.057+0000 7f0516ad8640 1 --2- 172.21.15.7:0/3481098440 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0510108cf0 0x7f051010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:44.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.057+0000 7f0516ad8640 1 --2- 172.21.15.7:0/3481098440 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05101083a0 0x7f05101087b0 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:44.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.057+0000 7f0516ad8640 1 --2- 172.21.15.7:0/3481098440 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0510102a60 0x7f0510102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:44.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.057+0000 7f0516ad8640 1 -- 172.21.15.7:0/3481098440 >> 172.21.15.7:0/3481098440 conn(0x7f0510079730 msgr2=0x7f0510079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:44.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.057+0000 7f0516ad8640 1 -- 172.21.15.7:0/3481098440 shutdown_connections 2024-09-21T06:45:44.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.057+0000 7f0516ad8640 1 -- 172.21.15.7:0/3481098440 wait complete. 2024-09-21T06:45:44.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.058+0000 7f0516ad8640 1 Processor -- start 2024-09-21T06:45:44.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.058+0000 7f0516ad8640 1 -- start start 2024-09-21T06:45:44.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.058+0000 7f0516ad8640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0510102a60 0x7f051019a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:44.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.058+0000 7f0516ad8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05101083a0 0x7f051019ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:44.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.058+0000 7f0516ad8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0510108cf0 0x7f051019fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:44.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.058+0000 7f0516ad8640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f05101129a0 con 0x7f05101083a0 2024-09-21T06:45:44.063 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.058+0000 7f0516ad8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0510112820 con 0x7f0510108cf0 2024-09-21T06:45:44.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.058+0000 7f0516ad8640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f0510112b20 con 0x7f0510102a60 2024-09-21T06:45:44.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.058+0000 7f050ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05101083a0 0x7f051019ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:44.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.058+0000 7f050ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05101083a0 0x7f051019ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51504/0 (socket says 172.21.15.7:51504) 2024-09-21T06:45:44.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.058+0000 7f050ffff640 1 -- 172.21.15.7:0/1798768606 learned_addr learned my addr 172.21.15.7:0/1798768606 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:44.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.058+0000 7f0515075640 1 --2- 172.21.15.7:0/1798768606 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0510108cf0 0x7f051019fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:44.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.059+0000 7f0514874640 1 --2- 172.21.15.7:0/1798768606 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0510102a60 0x7f051019a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:44.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.059+0000 7f050ffff640 1 -- 172.21.15.7:0/1798768606 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0510102a60 msgr2=0x7f051019a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:44.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.059+0000 7f050ffff640 1 --2- 172.21.15.7:0/1798768606 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0510102a60 0x7f051019a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:44.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.059+0000 7f050ffff640 1 -- 172.21.15.7:0/1798768606 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0510108cf0 msgr2=0x7f051019fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:44.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.059+0000 7f050ffff640 1 --2- 172.21.15.7:0/1798768606 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0510108cf0 0x7f051019fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:44.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.059+0000 7f050ffff640 1 -- 172.21.15.7:0/1798768606 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05101a04d0 con 0x7f05101083a0 2024-09-21T06:45:44.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.059+0000 7f050ffff640 1 --2- 172.21.15.7:0/1798768606 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05101083a0 0x7f051019ab00 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f04f8032fd0 tx=0x7f04f8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:44.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.059+0000 7f050dffb640 1 -- 172.21.15.7:0/1798768606 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f803f030 con 0x7f05101083a0 2024-09-21T06:45:44.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.059+0000 7f050dffb640 1 -- 172.21.15.7:0/1798768606 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f04f8004490 con 0x7f05101083a0 2024-09-21T06:45:44.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.059+0000 7f0516ad8640 1 -- 172.21.15.7:0/1798768606 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05101a0760 con 0x7f05101083a0 2024-09-21T06:45:44.064 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.059+0000 7f050dffb640 1 -- 172.21.15.7:0/1798768606 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f8035070 con 0x7f05101083a0 2024-09-21T06:45:44.065 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.060+0000 7f0516ad8640 1 -- 172.21.15.7:0/1798768606 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05101a6f20 con 0x7f05101083a0 2024-09-21T06:45:44.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.063+0000 7f051d04c740 1 Processor -- start 2024-09-21T06:45:44.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.063+0000 7f051d04c740 1 -- start start 2024-09-21T06:45:44.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.063+0000 7f051d04c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601eca3f070 0x5601ecde62c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:44.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.063+0000 7f051d04c740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5601eca161b0 0x5601ecde6800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:44.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.063+0000 7f051d04c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5601eca1e390 0x5601ecde6d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:44.066 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.063+0000 7f051d04c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5601ecd5cea0 con 0x5601eca1e390 2024-09-21T06:45:44.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.063+0000 7f051d04c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5601ecd4c2d0 con 0x5601eca3f070 2024-09-21T06:45:44.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.063+0000 7f051d04c740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5601ecd500e0 con 0x5601eca161b0 2024-09-21T06:45:44.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.063+0000 7f050dffb640 1 -- 172.21.15.7:0/1798768606 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f04f8042030 con 0x7f05101083a0 2024-09-21T06:45:44.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.063+0000 7f0515075640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601eca3f070 0x5601ecde62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:44.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.063+0000 7f0515075640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601eca3f070 0x5601ecde62c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.7:56076/0 (socket says 172.21.15.7:56076) 2024-09-21T06:45:44.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.063+0000 7f0515075640 1 -- 172.21.15.7:0/3082524531 learned_addr learned my addr 172.21.15.7:0/3082524531 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:44.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.063+0000 7f0514874640 1 --2- 172.21.15.7:0/3082524531 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5601eca161b0 0x5601ecde6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:44.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.063+0000 7f050ffff640 1 --2- 172.21.15.7:0/3082524531 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5601eca1e390 0x5601ecde6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:44.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.064+0000 7f0515075640 1 -- 172.21.15.7:0/3082524531 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5601eca161b0 msgr2=0x5601ecde6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:44.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.064+0000 7f0515075640 1 --2- 172.21.15.7:0/3082524531 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5601eca161b0 0x5601ecde6800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:44.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.064+0000 7f0515075640 1 -- 172.21.15.7:0/3082524531 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5601eca1e390 msgr2=0x5601ecde6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:44.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.064+0000 7f0515075640 1 --2- 172.21.15.7:0/3082524531 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5601eca1e390 0x5601ecde6d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:44.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.064+0000 7f0515075640 1 -- 172.21.15.7:0/3082524531 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601ecaaa650 con 0x5601eca3f070 2024-09-21T06:45:44.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.064+0000 7f0515075640 1 --2- 172.21.15.7:0/3082524531 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601eca3f070 0x5601ecde62c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0508010370 tx=0x7f0508010830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59ae697aac65d125 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:44.067 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.064+0000 7f0506ffd640 1 -- 172.21.15.7:0/3082524531 <== mon.2 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0508016070 con 0x5601eca3f070 2024-09-21T06:45:44.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.064+0000 7f050dffb640 1 --2- 172.21.15.7:0/1798768606 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f04fc0b6680 0x7f04fc0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:44.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.064+0000 7f0506ffd640 1 -- 172.21.15.7:0/3082524531 <== mon.2 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0508012bc0 con 0x5601eca3f070 2024-09-21T06:45:44.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.064+0000 7f0506ffd640 1 -- 172.21.15.7:0/3082524531 <== mon.2 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f050801bc20 con 0x5601eca3f070 2024-09-21T06:45:44.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.064+0000 7f0514874640 1 --2- 172.21.15.7:0/1798768606 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f04fc0b6680 0x7f04fc0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:44.068 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.064+0000 7f050dffb640 1 -- 172.21.15.7:0/1798768606 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7f04f8107af0 con 0x7f05101083a0 2024-09-21T06:45:44.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.065+0000 7f051d04c740 1 -- 172.21.15.7:0/3082524531 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601eca3f070 msgr2=0x5601ecde62c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:44.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.065+0000 7f0514874640 1 --2- 172.21.15.7:0/1798768606 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f04fc0b6680 0x7f04fc0b8b90 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x5601ecde4f40 tx=0x7f0500009110 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:44.070 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.065+0000 7f051d04c740 1 --2- 172.21.15.7:0/3082524531 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601eca3f070 0x5601ecde62c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0508010370 tx=0x7f0508010830 comp rx=0 tx=0).stop 2024-09-21T06:45:44.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.065+0000 7f051d04c740 1 -- 172.21.15.7:0/3082524531 shutdown_connections 2024-09-21T06:45:44.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.065+0000 7f051d04c740 1 --2- 172.21.15.7:0/3082524531 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5601eca1e390 0x5601ecde6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:44.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.065+0000 7f051d04c740 1 --2- 172.21.15.7:0/3082524531 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5601eca161b0 0x5601ecde6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:44.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.065+0000 7f051d04c740 1 --2- 172.21.15.7:0/3082524531 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601eca3f070 0x5601ecde62c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:44.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.065+0000 7f051d04c740 1 -- 172.21.15.7:0/3082524531 >> 172.21.15.7:0/3082524531 conn(0x5601eca33460 msgr2=0x5601ecde41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:44.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.065+0000 7f051d04c740 1 -- 172.21.15.7:0/3082524531 shutdown_connections 2024-09-21T06:45:44.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.065+0000 7f051d04c740 1 -- 172.21.15.7:0/3082524531 wait complete. 2024-09-21T06:45:44.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.066+0000 7f051d04c740 1 -- start start 2024-09-21T06:45:44.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.066+0000 7f051d04c740 1 Processor -- start 2024-09-21T06:45:44.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.066+0000 7f051d04c740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5601eca161b0 0x5601ecdf19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:44.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.066+0000 7f051d04c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601eca1e390 0x5601ecdf1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:44.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.066+0000 7f051d04c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5601eca3f070 0x5601ecdfddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:44.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.066+0000 7f051d04c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5601ecbad700 con 0x5601eca3f070 2024-09-21T06:45:44.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.066+0000 7f051d04c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5601ecce7160 con 0x5601eca1e390 2024-09-21T06:45:44.071 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.066+0000 7f051d04c740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5601ecdf4aa0 con 0x5601eca161b0 2024-09-21T06:45:44.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.067+0000 7f051d04c740 10 client.0 _ll_register_callbacks cb 0x5601ecd009e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:44.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.067+0000 7f0515075640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5601eca3f070 0x5601ecdfddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:44.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.067+0000 7f0514874640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5601eca161b0 0x5601ecdf19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:44.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.067+0000 7f0515075640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5601eca3f070 0x5601ecdfddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51516/0 (socket says 172.21.15.7:51516) 2024-09-21T06:45:44.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.067+0000 7f0515075640 1 -- 172.21.15.7:0/281559670 learned_addr learned my addr 172.21.15.7:0/281559670 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:44.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.067+0000 7f050ffff640 1 --2- 172.21.15.7:0/281559670 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601eca1e390 0x5601ecdf1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:44.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.067+0000 7f0514874640 1 -- 172.21.15.7:0/281559670 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601eca1e390 msgr2=0x5601ecdf1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:44.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.067+0000 7f0514874640 1 --2- 172.21.15.7:0/281559670 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601eca1e390 0x5601ecdf1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:44.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.067+0000 7f0514874640 1 -- 172.21.15.7:0/281559670 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5601eca3f070 msgr2=0x5601ecdfddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:44.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.067+0000 7f0514874640 1 --2- 172.21.15.7:0/281559670 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5601eca3f070 0x5601ecdfddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:44.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.067+0000 7f0514874640 1 -- 172.21.15.7:0/281559670 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601ecd14c90 con 0x5601eca161b0 2024-09-21T06:45:44.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.067+0000 7f0515075640 1 --2- 172.21.15.7:0/281559670 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5601eca3f070 0x5601ecdfddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:45:44.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.067+0000 7f050ffff640 1 --2- 172.21.15.7:0/281559670 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601eca1e390 0x5601ecdf1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:45:44.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.067+0000 7f0514874640 1 --2- 172.21.15.7:0/281559670 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5601eca161b0 0x5601ecdf19b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0500011690 tx=0x7f05000047d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=464cbf0a97f2e73e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:44.072 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.067+0000 7f04effff640 10 client.0 ms_handle_connect on v2:172.21.15.144:3300/0 2024-09-21T06:45:44.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.068+0000 7f04effff640 1 -- 172.21.15.7:0/281559670 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0500025070 con 0x5601eca161b0 2024-09-21T06:45:44.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.068+0000 7f051d04c740 1 -- 172.21.15.7:0/281559670 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0508012bc0 con 0x5601eca161b0 2024-09-21T06:45:44.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.068+0000 7f04effff640 1 -- 172.21.15.7:0/281559670 <== mon.1 v2:172.21.15.144:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7f0500021600 con 0x5601eca161b0 2024-09-21T06:45:44.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.068+0000 7f04effff640 1 -- 172.21.15.7:0/281559670 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0500021800 con 0x5601eca161b0 2024-09-21T06:45:44.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.068+0000 7f051d04c740 10 client.26932 fetch_fsmap learned FSMap version 25 2024-09-21T06:45:44.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.068+0000 7f051d04c740 1 -- 172.21.15.7:0/281559670 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5601ece008c0 con 0x5601eca161b0 2024-09-21T06:45:44.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.068+0000 7f04effff640 1 -- 172.21.15.7:0/281559670 <== mon.1 v2:172.21.15.144:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0508012bc0 con 0x5601eca161b0 2024-09-21T06:45:44.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.068+0000 7f04effff640 1 -- 172.21.15.7:0/281559670 <== mon.1 v2:172.21.15.144:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f0500020070 con 0x5601eca161b0 2024-09-21T06:45:44.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.068+0000 7f051d04c740 10 client.26932 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:45:44.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.068+0000 7f051d04c740 10 client.26932 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-21T06:45:44.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.068+0000 7f051d04c740 20 client.26932 populate_metadata read hostname 'smithi007' 2024-09-21T06:45:44.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.068+0000 7f051d04c740 1 --2- 172.21.15.7:0/281559670 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x5601ec9fd9f0 0x5601ece03d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:44.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.068+0000 7f051d04c740 4 client.26932 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:45:44.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.068+0000 7f051d04c740 1 -- 172.21.15.7:0/281559670 --> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5601ecd5edf0 con 0x5601ec9fd9f0 2024-09-21T06:45:44.073 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.069+0000 7f050ffff640 1 --2- 172.21.15.7:0/281559670 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x5601ec9fd9f0 0x5601ece03d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:44.074 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.069+0000 7f050ffff640 1 --2- 172.21.15.7:0/281559670 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x5601ec9fd9f0 0x5601ece03d40 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4dd192ee3cc59937 server_cookie=9dc40a31ebe4f5d3 in_seq=0 out_seq=0 2024-09-21T06:45:44.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.069+0000 7f04effff640 10 client.26932 ms_handle_connect on v2:172.21.15.18:6836/1539670694 2024-09-21T06:45:44.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.070+0000 7f04effff640 1 -- 172.21.15.7:0/281559670 <== mds.2 v2:172.21.15.18:6836/1539670694 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5601ecd5edf0 con 0x5601ec9fd9f0 2024-09-21T06:45:44.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.070+0000 7f04effff640 10 client.26932 handle_command_reply: tid=0 2024-09-21T06:45:44.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.070+0000 7f051d04c740 1 client.26932 shutdown 2024-09-21T06:45:44.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.070+0000 7f051d04c740 1 -- 172.21.15.7:0/281559670 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5601eca161b0 msgr2=0x5601ecdf19b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:44.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.070+0000 7f051d04c740 1 --2- 172.21.15.7:0/281559670 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5601eca161b0 0x5601ecdf19b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0500011690 tx=0x7f05000047d0 comp rx=0 tx=0).stop 2024-09-21T06:45:44.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.070+0000 7f051d04c740 1 -- 172.21.15.7:0/281559670 shutdown_connections 2024-09-21T06:45:44.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.070+0000 7f051d04c740 1 --2- 172.21.15.7:0/281559670 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x5601ec9fd9f0 0x5601ece03d40 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:44.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.070+0000 7f051d04c740 1 --2- 172.21.15.7:0/281559670 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5601eca3f070 0x5601ecdfddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:44.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.070+0000 7f051d04c740 1 --2- 172.21.15.7:0/281559670 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601eca1e390 0x5601ecdf1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:44.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.070+0000 7f051d04c740 1 --2- 172.21.15.7:0/281559670 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5601eca161b0 0x5601ecdf19b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:44.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.070+0000 7f04effff640 0 client.26932 ms_handle_reset on v2:172.21.15.18:6836/1539670694 2024-09-21T06:45:44.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.070+0000 7f051d04c740 1 -- 172.21.15.7:0/281559670 >> 172.21.15.7:0/281559670 conn(0x5601eca33460 msgr2=0x5601ecde9450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:44.075 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.070+0000 7f051d04c740 1 -- 172.21.15.7:0/281559670 shutdown_connections 2024-09-21T06:45:44.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.070+0000 7f051d04c740 1 -- 172.21.15.7:0/281559670 wait complete. 2024-09-21T06:45:44.076 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.070+0000 7f051d04c740 20 client.26932 trim_cache size 0 max 16384 2024-09-21T06:45:44.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.084+0000 7f051d04c740 1 Processor -- start 2024-09-21T06:45:44.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.084+0000 7f051d04c740 1 -- start start 2024-09-21T06:45:44.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.084+0000 7f051d04c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5601eca161b0 0x5601ecdfdcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:44.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.084+0000 7f051d04c740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5601eca1e390 0x5601ecdf1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:44.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.084+0000 7f051d04c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601eca3f070 0x5601ecdf1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:44.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.084+0000 7f051d04c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f05101b1e50 con 0x5601eca161b0 2024-09-21T06:45:44.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.084+0000 7f051d04c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f05101af720 con 0x5601eca3f070 2024-09-21T06:45:44.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.084+0000 7f051d04c740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f05101ad590 con 0x5601eca1e390 2024-09-21T06:45:44.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.084+0000 7f0514874640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5601eca161b0 0x5601ecdfdcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:44.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.084+0000 7f0514874640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5601eca161b0 0x5601ecdfdcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51530/0 (socket says 172.21.15.7:51530) 2024-09-21T06:45:44.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.084+0000 7f0514874640 1 -- 172.21.15.7:0/2630473440 learned_addr learned my addr 172.21.15.7:0/2630473440 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:44.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.084+0000 7f0515075640 1 --2- 172.21.15.7:0/2630473440 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601eca3f070 0x5601ecdf1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:44.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.084+0000 7f0514874640 1 -- 172.21.15.7:0/2630473440 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5601eca1e390 msgr2=0x5601ecdf1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:44.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.084+0000 7f0514874640 1 --2- 172.21.15.7:0/2630473440 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5601eca1e390 0x5601ecdf1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:44.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.084+0000 7f0514874640 1 -- 172.21.15.7:0/2630473440 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601eca3f070 msgr2=0x5601ecdf1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:44.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.084+0000 7f0514874640 1 --2- 172.21.15.7:0/2630473440 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601eca3f070 0x5601ecdf1ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:44.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.084+0000 7f0514874640 1 -- 172.21.15.7:0/2630473440 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5601ecde85b0 con 0x5601eca161b0 2024-09-21T06:45:44.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.085+0000 7f0514874640 1 --2- 172.21.15.7:0/2630473440 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5601eca161b0 0x5601ecdfdcc0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f05000091f0 tx=0x7f0500011710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e55744d1f38bead server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:44.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.085+0000 7f05067fc640 1 -- 172.21.15.7:0/2630473440 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0500039020 con 0x5601eca161b0 2024-09-21T06:45:44.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.085+0000 7f05067fc640 1 -- 172.21.15.7:0/2630473440 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f050001b070 con 0x5601eca161b0 2024-09-21T06:45:44.088 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.085+0000 7f05067fc640 1 -- 172.21.15.7:0/2630473440 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0500025040 con 0x5601eca161b0 2024-09-21T06:45:44.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.086+0000 7f051d04c740 1 -- 172.21.15.7:0/2630473440 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5601eca161b0 msgr2=0x5601ecdfdcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:44.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.086+0000 7f051d04c740 1 --2- 172.21.15.7:0/2630473440 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5601eca161b0 0x5601ecdfdcc0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f05000091f0 tx=0x7f0500011710 comp rx=0 tx=0).stop 2024-09-21T06:45:44.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.086+0000 7f051d04c740 1 -- 172.21.15.7:0/2630473440 shutdown_connections 2024-09-21T06:45:44.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.086+0000 7f051d04c740 1 --2- 172.21.15.7:0/2630473440 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601eca3f070 0x5601ecdf1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:44.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.086+0000 7f051d04c740 1 --2- 172.21.15.7:0/2630473440 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5601eca1e390 0x5601ecdf1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:44.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.086+0000 7f051d04c740 1 --2- 172.21.15.7:0/2630473440 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5601eca161b0 0x5601ecdfdcc0 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:44.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.086+0000 7f051d04c740 1 -- 172.21.15.7:0/2630473440 >> 172.21.15.7:0/2630473440 conn(0x5601eca33460 msgr2=0x5601ecdf0230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:44.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.086+0000 7f051d04c740 1 -- 172.21.15.7:0/2630473440 shutdown_connections 2024-09-21T06:45:44.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.086+0000 7f051d04c740 1 -- 172.21.15.7:0/2630473440 wait complete. 2024-09-21T06:45:44.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.086+0000 7f051d04c740 1 -- start start 2024-09-21T06:45:44.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.086+0000 7f051d04c740 1 Processor -- start 2024-09-21T06:45:44.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.087+0000 7f051d04c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5601eca161b0 0x5601ecdfa4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:44.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.087+0000 7f051d04c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601eca1e390 0x5601ecdf5980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:44.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.087+0000 7f051d04c740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5601eca3f070 0x5601ecdf5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:44.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.087+0000 7f051d04c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f05101adbe0 con 0x5601eca161b0 2024-09-21T06:45:44.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.087+0000 7f051d04c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f05101af050 con 0x5601eca1e390 2024-09-21T06:45:44.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.087+0000 7f051d04c740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f05101ae2b0 con 0x5601eca3f070 2024-09-21T06:45:44.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.087+0000 7f051d04c740 10 client.0 _ll_register_callbacks cb 0x7f0500009810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:44.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.087+0000 7f0514874640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5601eca161b0 0x5601ecdfa4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:44.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.087+0000 7f0514874640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5601eca161b0 0x5601ecdfa4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51544/0 (socket says 172.21.15.7:51544) 2024-09-21T06:45:44.091 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.087+0000 7f0514874640 1 -- 172.21.15.7:0/4010297192 learned_addr learned my addr 172.21.15.7:0/4010297192 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:44.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.087+0000 7f050ffff640 1 --2- 172.21.15.7:0/4010297192 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601eca1e390 0x5601ecdf5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:44.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.087+0000 7f0514874640 1 -- 172.21.15.7:0/4010297192 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5601eca3f070 msgr2=0x5601ecdf5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:44.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.087+0000 7f0514874640 1 --2- 172.21.15.7:0/4010297192 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5601eca3f070 0x5601ecdf5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:44.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.087+0000 7f0514874640 1 -- 172.21.15.7:0/4010297192 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601eca1e390 msgr2=0x5601ecdf5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:44.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.087+0000 7f0514874640 1 --2- 172.21.15.7:0/4010297192 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601eca1e390 0x5601ecdf5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:44.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.087+0000 7f0514874640 1 -- 172.21.15.7:0/4010297192 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5601ecdf6630 con 0x5601eca161b0 2024-09-21T06:45:44.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.087+0000 7f0514874640 1 --2- 172.21.15.7:0/4010297192 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5601eca161b0 0x5601ecdfa4d0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f0500006b50 tx=0x7f05000297e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84e48a01dcb0fcca server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:44.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.087+0000 7f04effff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:45:44.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.087+0000 7f04effff640 1 -- 172.21.15.7:0/4010297192 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0500039030 con 0x5601eca161b0 2024-09-21T06:45:44.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.088+0000 7f04effff640 1 -- 172.21.15.7:0/4010297192 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7f0500021bb0 con 0x5601eca161b0 2024-09-21T06:45:44.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.088+0000 7f051d04c740 1 -- 172.21.15.7:0/4010297192 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f050001b070 con 0x5601eca161b0 2024-09-21T06:45:44.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.088+0000 7f04effff640 1 -- 172.21.15.7:0/4010297192 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0500050050 con 0x5601eca161b0 2024-09-21T06:45:44.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.088+0000 7f051d04c740 10 client.17718 fetch_fsmap learned FSMap version 25 2024-09-21T06:45:44.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.088+0000 7f051d04c740 1 -- 172.21.15.7:0/4010297192 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5601ece72a50 con 0x5601eca161b0 2024-09-21T06:45:44.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.088+0000 7f04effff640 1 -- 172.21.15.7:0/4010297192 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f050001b070 con 0x5601eca161b0 2024-09-21T06:45:44.092 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.088+0000 7f04effff640 1 -- 172.21.15.7:0/4010297192 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f0500020040 con 0x5601eca161b0 2024-09-21T06:45:44.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.088+0000 7f051d04c740 10 client.17718 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:45:44.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.088+0000 7f051d04c740 10 client.17718 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-21T06:45:44.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.088+0000 7f051d04c740 20 client.17718 populate_metadata read hostname 'smithi007' 2024-09-21T06:45:44.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.088+0000 7f051d04c740 1 --2- 172.21.15.7:0/4010297192 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x5601ec9d2da0 0x5601ece750f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:44.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.088+0000 7f051d04c740 4 client.17718 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:45:44.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.088+0000 7f051d04c740 1 -- 172.21.15.7:0/4010297192 --> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5601ecd5a8a0 con 0x5601ec9d2da0 2024-09-21T06:45:44.093 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.088+0000 7f050ffff640 1 --2- 172.21.15.7:0/4010297192 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x5601ec9d2da0 0x5601ece750f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:44.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.089+0000 7f04effff640 10 client.17718 ms_handle_connect on v2:172.21.15.18:6836/1539670694 2024-09-21T06:45:44.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.089+0000 7f050ffff640 1 --2- 172.21.15.7:0/4010297192 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x5601ec9d2da0 0x5601ece750f0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=85852e75bf47e2f7 server_cookie=857c844fcdb541f2 in_seq=0 out_seq=0 2024-09-21T06:45:44.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.089+0000 7f04effff640 1 -- 172.21.15.7:0/4010297192 <== mds.2 v2:172.21.15.18:6836/1539670694 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5601ecd5a8a0 con 0x5601ec9d2da0 2024-09-21T06:45:44.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.089+0000 7f04effff640 10 client.17718 handle_command_reply: tid=0 2024-09-21T06:45:44.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.089+0000 7f051d04c740 1 client.17718 shutdown 2024-09-21T06:45:44.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.089+0000 7f051d04c740 1 -- 172.21.15.7:0/4010297192 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5601eca161b0 msgr2=0x5601ecdfa4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:44.094 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.089+0000 7f051d04c740 1 --2- 172.21.15.7:0/4010297192 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5601eca161b0 0x5601ecdfa4d0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f0500006b50 tx=0x7f05000297e0 comp rx=0 tx=0).stop 2024-09-21T06:45:44.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.089+0000 7f051d04c740 1 -- 172.21.15.7:0/4010297192 shutdown_connections 2024-09-21T06:45:44.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.089+0000 7f051d04c740 1 --2- 172.21.15.7:0/4010297192 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x5601ec9d2da0 0x5601ece750f0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:44.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.089+0000 7f051d04c740 1 --2- 172.21.15.7:0/4010297192 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5601eca3f070 0x5601ecdf5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:44.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.089+0000 7f051d04c740 1 --2- 172.21.15.7:0/4010297192 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601eca1e390 0x5601ecdf5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:44.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.089+0000 7f04effff640 0 client.17718 ms_handle_reset on v2:172.21.15.18:6836/1539670694 2024-09-21T06:45:44.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.089+0000 7f051d04c740 1 --2- 172.21.15.7:0/4010297192 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5601eca161b0 0x5601ecdfa4d0 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:44.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.089+0000 7f051d04c740 1 -- 172.21.15.7:0/4010297192 >> 172.21.15.7:0/4010297192 conn(0x5601eca33460 msgr2=0x5601ecdf1760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:44.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.090+0000 7f051d04c740 1 -- 172.21.15.7:0/4010297192 shutdown_connections 2024-09-21T06:45:44.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.090+0000 7f051d04c740 1 -- 172.21.15.7:0/4010297192 wait complete. 2024-09-21T06:45:44.095 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.090+0000 7f051d04c740 20 client.17718 trim_cache size 0 max 16384 2024-09-21T06:45:44.095 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:45:44.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.090+0000 7f0516ad8640 1 -- 172.21.15.7:0/1798768606 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f04fc0b6680 msgr2=0x7f04fc0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:44.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.090+0000 7f0516ad8640 1 --2- 172.21.15.7:0/1798768606 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f04fc0b6680 0x7f04fc0b8b90 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x5601ecde4f40 tx=0x7f0500009110 comp rx=0 tx=0).stop 2024-09-21T06:45:44.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.090+0000 7f0516ad8640 1 -- 172.21.15.7:0/1798768606 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05101083a0 msgr2=0x7f051019ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:44.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.090+0000 7f0516ad8640 1 --2- 172.21.15.7:0/1798768606 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05101083a0 0x7f051019ab00 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f04f8032fd0 tx=0x7f04f8004270 comp rx=0 tx=0).stop 2024-09-21T06:45:44.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.090+0000 7f0516ad8640 1 -- 172.21.15.7:0/1798768606 shutdown_connections 2024-09-21T06:45:44.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.090+0000 7f0516ad8640 1 --2- 172.21.15.7:0/1798768606 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f04fc0b6680 0x7f04fc0b8b90 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:44.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.090+0000 7f0516ad8640 1 --2- 172.21.15.7:0/1798768606 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0510108cf0 0x7f051019fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:44.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.090+0000 7f0516ad8640 1 --2- 172.21.15.7:0/1798768606 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f05101083a0 0x7f051019ab00 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:44.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.090+0000 7f0516ad8640 1 --2- 172.21.15.7:0/1798768606 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f0510102a60 0x7f051019a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:44.096 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.090+0000 7f0516ad8640 1 -- 172.21.15.7:0/1798768606 >> 172.21.15.7:0/1798768606 conn(0x7f0510079730 msgr2=0x7f05100ffd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:44.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.090+0000 7f0516ad8640 1 -- 172.21.15.7:0/1798768606 shutdown_connections 2024-09-21T06:45:44.097 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:44.090+0000 7f0516ad8640 1 -- 172.21.15.7:0/1798768606 wait complete. 2024-09-21T06:45:44.797 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:45:45.063 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:45:45.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:45:44 smithi144 ceph-mon[34653]: pgmap v611: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 8 op/s 2024-09-21T06:45:45.320 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:45:44 smithi007 ceph-mon[30983]: pgmap v611: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 8 op/s 2024-09-21T06:45:45.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:45:44 smithi018 ceph-mon[34477]: pgmap v611: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 8 op/s 2024-09-21T06:45:45.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.548+0000 7fd0607d8640 1 -- 172.21.15.7:0/3198162373 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd058109df0 msgr2=0x7fd058110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:45.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.548+0000 7fd0607d8640 1 --2- 172.21.15.7:0/3198162373 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd058109df0 0x7fd058110620 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7fd050009ca0 tx=0x7fd05002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:45:45.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.548+0000 7fd0607d8640 1 -- 172.21.15.7:0/3198162373 shutdown_connections 2024-09-21T06:45:45.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.548+0000 7fd0607d8640 1 --2- 172.21.15.7:0/3198162373 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd058109df0 0x7fd058110620 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:45.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.548+0000 7fd0607d8640 1 --2- 172.21.15.7:0/3198162373 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd0581094a0 0x7fd0581098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:45.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.548+0000 7fd0607d8640 1 --2- 172.21.15.7:0/3198162373 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd058103b60 0x7fd058103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:45.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.548+0000 7fd0607d8640 1 -- 172.21.15.7:0/3198162373 >> 172.21.15.7:0/3198162373 conn(0x7fd05807b850 msgr2=0x7fd05807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:45.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.548+0000 7fd0607d8640 1 -- 172.21.15.7:0/3198162373 shutdown_connections 2024-09-21T06:45:45.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.548+0000 7fd0607d8640 1 -- 172.21.15.7:0/3198162373 wait complete. 2024-09-21T06:45:45.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.549+0000 7fd0607d8640 1 Processor -- start 2024-09-21T06:45:45.593 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.549+0000 7fd0607d8640 1 -- start start 2024-09-21T06:45:45.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.549+0000 7fd0607d8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd058103b60 0x7fd05819a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:45.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.549+0000 7fd0607d8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd0581094a0 0x7fd05819aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:45.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.549+0000 7fd0607d8640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd058109df0 0x7fd05819fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:45.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.549+0000 7fd0607d8640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd058113ab0 con 0x7fd058103b60 2024-09-21T06:45:45.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.550+0000 7fd0607d8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd058113930 con 0x7fd0581094a0 2024-09-21T06:45:45.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.550+0000 7fd0607d8640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd058113c30 con 0x7fd058109df0 2024-09-21T06:45:45.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.550+0000 7fd05e574640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd058103b60 0x7fd05819a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:45.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.550+0000 7fd05e574640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd058103b60 0x7fd05819a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51548/0 (socket says 172.21.15.7:51548) 2024-09-21T06:45:45.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.550+0000 7fd05e574640 1 -- 172.21.15.7:0/4280922292 learned_addr learned my addr 172.21.15.7:0/4280922292 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:45.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.550+0000 7fd05ed75640 1 --2- 172.21.15.7:0/4280922292 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd058109df0 0x7fd05819fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:45.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.550+0000 7fd05dd73640 1 --2- 172.21.15.7:0/4280922292 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd0581094a0 0x7fd05819aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:45.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.550+0000 7fd05e574640 1 -- 172.21.15.7:0/4280922292 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd058109df0 msgr2=0x7fd05819fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:45.594 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.550+0000 7fd05e574640 1 --2- 172.21.15.7:0/4280922292 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd058109df0 0x7fd05819fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:45.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.550+0000 7fd05e574640 1 -- 172.21.15.7:0/4280922292 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd0581094a0 msgr2=0x7fd05819aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:45.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.550+0000 7fd05e574640 1 --2- 172.21.15.7:0/4280922292 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd0581094a0 0x7fd05819aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:45.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.550+0000 7fd05e574640 1 -- 172.21.15.7:0/4280922292 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0581a03d0 con 0x7fd058103b60 2024-09-21T06:45:45.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.550+0000 7fd05dd73640 1 --2- 172.21.15.7:0/4280922292 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd0581094a0 0x7fd05819aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:45.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.550+0000 7fd05e574640 1 --2- 172.21.15.7:0/4280922292 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd058103b60 0x7fd05819a460 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fd05400d950 tx=0x7fd05400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:45.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.550+0000 7fd04f7fe640 1 -- 172.21.15.7:0/4280922292 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd054017030 con 0x7fd058103b60 2024-09-21T06:45:45.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.550+0000 7fd04f7fe640 1 -- 172.21.15.7:0/4280922292 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd054004020 con 0x7fd058103b60 2024-09-21T06:45:45.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.550+0000 7fd0607d8640 1 -- 172.21.15.7:0/4280922292 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0581a06c0 con 0x7fd058103b60 2024-09-21T06:45:45.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.550+0000 7fd04f7fe640 1 -- 172.21.15.7:0/4280922292 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0540047a0 con 0x7fd058103b60 2024-09-21T06:45:45.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.550+0000 7fd0607d8640 1 -- 172.21.15.7:0/4280922292 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0581a6e20 con 0x7fd058103b60 2024-09-21T06:45:45.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.553+0000 7fd066d4c740 1 Processor -- start 2024-09-21T06:45:45.595 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.553+0000 7fd066d4c740 1 -- start start 2024-09-21T06:45:45.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.554+0000 7fd066d4c740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f62434070 0x559f627db2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:45.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.554+0000 7fd066d4c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f6240b1b0 0x559f627db800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:45.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.554+0000 7fd066d4c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f62413390 0x559f627dbd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:45.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.554+0000 7fd04f7fe640 1 -- 172.21.15.7:0/4280922292 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7fd054009a30 con 0x7fd058103b60 2024-09-21T06:45:45.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.554+0000 7fd066d4c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x559f62751ea0 con 0x559f6240b1b0 2024-09-21T06:45:45.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.554+0000 7fd066d4c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559f627412d0 con 0x559f62413390 2024-09-21T06:45:45.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.554+0000 7fd066d4c740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x559f627450e0 con 0x559f62434070 2024-09-21T06:45:45.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.554+0000 7fd05e574640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f6240b1b0 0x559f627db800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:45.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.554+0000 7fd05e574640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f6240b1b0 0x559f627db800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51556/0 (socket says 172.21.15.7:51556) 2024-09-21T06:45:45.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.554+0000 7fd05e574640 1 -- 172.21.15.7:0/1371968917 learned_addr learned my addr 172.21.15.7:0/1371968917 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:45.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.554+0000 7fd05ed75640 1 --2- 172.21.15.7:0/1371968917 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f62434070 0x559f627db2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:45.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.554+0000 7fd05dd73640 1 --2- 172.21.15.7:0/1371968917 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f62413390 0x559f627dbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:45.596 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.554+0000 7fd05e574640 1 -- 172.21.15.7:0/1371968917 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f62434070 msgr2=0x559f627db2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:45.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.554+0000 7fd05e574640 1 --2- 172.21.15.7:0/1371968917 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f62434070 0x559f627db2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:45.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.554+0000 7fd05e574640 1 -- 172.21.15.7:0/1371968917 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f62413390 msgr2=0x559f627dbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:45.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.554+0000 7fd05e574640 1 --2- 172.21.15.7:0/1371968917 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f62413390 0x559f627dbd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:45.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.554+0000 7fd05e574640 1 -- 172.21.15.7:0/1371968917 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f6249f650 con 0x559f6240b1b0 2024-09-21T06:45:45.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.554+0000 7fd05e574640 1 --2- 172.21.15.7:0/1371968917 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f6240b1b0 0x559f627db800 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7fd0540e49b0 tx=0x7fd0540ef7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=392973a0bc278d79 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:45.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.555+0000 7fd04cff9640 1 -- 172.21.15.7:0/1371968917 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0540e9520 con 0x559f6240b1b0 2024-09-21T06:45:45.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.555+0000 7fd04cff9640 1 -- 172.21.15.7:0/1371968917 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd0540e7be0 con 0x559f6240b1b0 2024-09-21T06:45:45.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.555+0000 7fd04cff9640 1 -- 172.21.15.7:0/1371968917 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0540f6c80 con 0x559f6240b1b0 2024-09-21T06:45:45.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.555+0000 7fd04f7fe640 1 --2- 172.21.15.7:0/4280922292 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fd0440b6680 0x7fd0440b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:45.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.555+0000 7fd05ed75640 1 --2- 172.21.15.7:0/4280922292 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fd0440b6680 0x7fd0440b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:45.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.555+0000 7fd04f7fe640 1 -- 172.21.15.7:0/4280922292 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7fd0540e7280 con 0x7fd058103b60 2024-09-21T06:45:45.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.556+0000 7fd066d4c740 1 -- 172.21.15.7:0/1371968917 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f6240b1b0 msgr2=0x559f627db800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:45.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.556+0000 7fd05ed75640 1 --2- 172.21.15.7:0/4280922292 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fd0440b6680 0x7fd0440b8b90 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fd050005e30 tx=0x7fd050005c30 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:45.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.556+0000 7fd066d4c740 1 --2- 172.21.15.7:0/1371968917 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f6240b1b0 0x559f627db800 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7fd0540e49b0 tx=0x7fd0540ef7e0 comp rx=0 tx=0).stop 2024-09-21T06:45:45.597 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.556+0000 7fd066d4c740 1 -- 172.21.15.7:0/1371968917 shutdown_connections 2024-09-21T06:45:45.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.556+0000 7fd066d4c740 1 --2- 172.21.15.7:0/1371968917 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f62413390 0x559f627dbd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:45.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.556+0000 7fd066d4c740 1 --2- 172.21.15.7:0/1371968917 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f6240b1b0 0x559f627db800 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:45.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.556+0000 7fd066d4c740 1 --2- 172.21.15.7:0/1371968917 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f62434070 0x559f627db2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:45.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.556+0000 7fd066d4c740 1 -- 172.21.15.7:0/1371968917 >> 172.21.15.7:0/1371968917 conn(0x559f62428460 msgr2=0x559f627d91b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:45.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.556+0000 7fd066d4c740 1 -- 172.21.15.7:0/1371968917 shutdown_connections 2024-09-21T06:45:45.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.556+0000 7fd066d4c740 1 -- 172.21.15.7:0/1371968917 wait complete. 2024-09-21T06:45:45.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.556+0000 7fd066d4c740 1 -- start start 2024-09-21T06:45:45.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.557+0000 7fd066d4c740 1 Processor -- start 2024-09-21T06:45:45.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.557+0000 7fd066d4c740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f6240b1b0 0x559f627eac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:45.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.557+0000 7fd066d4c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f62413390 0x559f627eb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:45.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.557+0000 7fd066d4c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f62434070 0x559f627eb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:45.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.557+0000 7fd066d4c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x559f625a2700 con 0x559f62413390 2024-09-21T06:45:45.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.557+0000 7fd066d4c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559f626dc160 con 0x559f62434070 2024-09-21T06:45:45.598 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.557+0000 7fd066d4c740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x559f627eddd0 con 0x559f6240b1b0 2024-09-21T06:45:45.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.557+0000 7fd066d4c740 10 client.0 _ll_register_callbacks cb 0x559f626f59e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:45.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.557+0000 7fd05dd73640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f62413390 0x559f627eb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:45.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.557+0000 7fd05dd73640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f62413390 0x559f627eb1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51570/0 (socket says 172.21.15.7:51570) 2024-09-21T06:45:45.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.557+0000 7fd05dd73640 1 -- 172.21.15.7:0/2753328622 learned_addr learned my addr 172.21.15.7:0/2753328622 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:45.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.557+0000 7fd05ed75640 1 --2- 172.21.15.7:0/2753328622 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f62434070 0x559f627eb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:45.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.557+0000 7fd05e574640 1 --2- 172.21.15.7:0/2753328622 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f6240b1b0 0x559f627eac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:45.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.557+0000 7fd05dd73640 1 -- 172.21.15.7:0/2753328622 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f6240b1b0 msgr2=0x559f627eac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:45.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.557+0000 7fd05dd73640 1 --2- 172.21.15.7:0/2753328622 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f6240b1b0 0x559f627eac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:45.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.557+0000 7fd05dd73640 1 -- 172.21.15.7:0/2753328622 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f62434070 msgr2=0x559f627eb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:45.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.557+0000 7fd05dd73640 1 --2- 172.21.15.7:0/2753328622 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f62434070 0x559f627eb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:45.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.557+0000 7fd05dd73640 1 -- 172.21.15.7:0/2753328622 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f62709c90 con 0x559f62413390 2024-09-21T06:45:45.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.557+0000 7fd05e574640 1 --2- 172.21.15.7:0/2753328622 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f6240b1b0 0x559f627eac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:45:45.599 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.558+0000 7fd05dd73640 1 --2- 172.21.15.7:0/2753328622 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f62413390 0x559f627eb1b0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fd04800bf00 tx=0x7fd048012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e64b84c336c7a62 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:45.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.558+0000 7fd041ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:45:45.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.558+0000 7fd041ffb640 1 -- 172.21.15.7:0/2753328622 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd04801f060 con 0x559f62413390 2024-09-21T06:45:45.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.558+0000 7fd066d4c740 1 -- 172.21.15.7:0/2753328622 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd0540e7be0 con 0x559f62413390 2024-09-21T06:45:45.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.558+0000 7fd041ffb640 1 -- 172.21.15.7:0/2753328622 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7fd048010960 con 0x559f62413390 2024-09-21T06:45:45.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.558+0000 7fd041ffb640 1 -- 172.21.15.7:0/2753328622 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd048010b60 con 0x559f62413390 2024-09-21T06:45:45.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.558+0000 7fd066d4c740 10 client.17730 fetch_fsmap learned FSMap version 25 2024-09-21T06:45:45.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.558+0000 7fd066d4c740 1 -- 172.21.15.7:0/2753328622 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559f627f9af0 con 0x559f62413390 2024-09-21T06:45:45.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.558+0000 7fd041ffb640 1 -- 172.21.15.7:0/2753328622 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd0540e7be0 con 0x559f62413390 2024-09-21T06:45:45.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.558+0000 7fd041ffb640 1 -- 172.21.15.7:0/2753328622 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd048022020 con 0x559f62413390 2024-09-21T06:45:45.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.558+0000 7fd066d4c740 10 client.17730 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:45:45.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.558+0000 7fd066d4c740 10 client.17730 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:45:45.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.558+0000 7fd066d4c740 20 client.17730 populate_metadata read hostname 'smithi007' 2024-09-21T06:45:45.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.559+0000 7fd066d4c740 1 --2- 172.21.15.7:0/2753328622 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x559f623f29f0 0x559f627fcfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:45.600 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.559+0000 7fd066d4c740 4 client.17730 mds_command: new command op to 24688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:45:45.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.559+0000 7fd066d4c740 1 -- 172.21.15.7:0/2753328622 --> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559f62753df0 con 0x559f623f29f0 2024-09-21T06:45:45.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.559+0000 7fd05e574640 1 --2- 172.21.15.7:0/2753328622 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x559f623f29f0 0x559f627fcfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:45.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.559+0000 7fd041ffb640 10 client.17730 ms_handle_connect on v2:172.21.15.144:6838/4027821922 2024-09-21T06:45:45.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.559+0000 7fd05e574640 1 --2- 172.21.15.7:0/2753328622 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x559f623f29f0 0x559f627fcfc0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=21d2f97ebca8800f server_cookie=92f1baf3ac8d0728 in_seq=0 out_seq=0 2024-09-21T06:45:45.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.560+0000 7fd041ffb640 1 -- 172.21.15.7:0/2753328622 <== mds.1 v2:172.21.15.144:6838/4027821922 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559f62753df0 con 0x559f623f29f0 2024-09-21T06:45:45.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.560+0000 7fd041ffb640 10 client.17730 handle_command_reply: tid=0 2024-09-21T06:45:45.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.560+0000 7fd066d4c740 1 client.17730 shutdown 2024-09-21T06:45:45.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.560+0000 7fd066d4c740 1 -- 172.21.15.7:0/2753328622 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f62413390 msgr2=0x559f627eb1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:45.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.560+0000 7fd066d4c740 1 --2- 172.21.15.7:0/2753328622 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f62413390 0x559f627eb1b0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fd04800bf00 tx=0x7fd048012820 comp rx=0 tx=0).stop 2024-09-21T06:45:45.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.560+0000 7fd066d4c740 1 -- 172.21.15.7:0/2753328622 shutdown_connections 2024-09-21T06:45:45.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.560+0000 7fd066d4c740 1 --2- 172.21.15.7:0/2753328622 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x559f623f29f0 0x559f627fcfc0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:45.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.560+0000 7fd066d4c740 1 --2- 172.21.15.7:0/2753328622 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f62434070 0x559f627eb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:45.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.560+0000 7fd066d4c740 1 --2- 172.21.15.7:0/2753328622 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f62413390 0x559f627eb1b0 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:45.601 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.560+0000 7fd066d4c740 1 --2- 172.21.15.7:0/2753328622 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f6240b1b0 0x559f627eac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:45.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.560+0000 7fd041ffb640 0 client.17730 ms_handle_reset on v2:172.21.15.144:6838/4027821922 2024-09-21T06:45:45.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.560+0000 7fd066d4c740 1 -- 172.21.15.7:0/2753328622 >> 172.21.15.7:0/2753328622 conn(0x559f62428460 msgr2=0x559f627d7750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:45.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.560+0000 7fd066d4c740 1 -- 172.21.15.7:0/2753328622 shutdown_connections 2024-09-21T06:45:45.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.560+0000 7fd066d4c740 1 -- 172.21.15.7:0/2753328622 wait complete. 2024-09-21T06:45:45.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.560+0000 7fd066d4c740 20 client.17730 trim_cache size 0 max 16384 2024-09-21T06:45:45.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.574+0000 7fd066d4c740 1 Processor -- start 2024-09-21T06:45:45.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.574+0000 7fd066d4c740 1 -- start start 2024-09-21T06:45:45.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.574+0000 7fd066d4c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f6240b1b0 0x559f627dca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:45.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.574+0000 7fd066d4c740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f62413390 0x559f627e7e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:45.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.574+0000 7fd066d4c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f62434070 0x559f627e83a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:45.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.574+0000 7fd066d4c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd0581afd00 con 0x559f6240b1b0 2024-09-21T06:45:45.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.574+0000 7fd066d4c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd0581ad5d0 con 0x559f62434070 2024-09-21T06:45:45.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.574+0000 7fd066d4c740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd0581ab440 con 0x559f62413390 2024-09-21T06:45:45.602 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.574+0000 7fd05e574640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f6240b1b0 0x559f627dca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:45.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.574+0000 7fd05e574640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f6240b1b0 0x559f627dca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51578/0 (socket says 172.21.15.7:51578) 2024-09-21T06:45:45.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.574+0000 7fd05e574640 1 -- 172.21.15.7:0/1372856596 learned_addr learned my addr 172.21.15.7:0/1372856596 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:45.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.574+0000 7fd05dd73640 1 --2- 172.21.15.7:0/1372856596 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f62413390 0x559f627e7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:45.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.574+0000 7fd05e574640 1 -- 172.21.15.7:0/1372856596 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f62413390 msgr2=0x559f627e7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:45.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.574+0000 7fd05e574640 1 --2- 172.21.15.7:0/1372856596 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f62413390 0x559f627e7e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:45.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.574+0000 7fd05e574640 1 -- 172.21.15.7:0/1372856596 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f62434070 msgr2=0x559f627e83a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:45.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.574+0000 7fd05ed75640 1 --2- 172.21.15.7:0/1372856596 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f62434070 0x559f627e83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:45.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.574+0000 7fd05e574640 1 --2- 172.21.15.7:0/1372856596 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f62434070 0x559f627e83a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:45.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.574+0000 7fd05e574640 1 -- 172.21.15.7:0/1372856596 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f627dda10 con 0x559f6240b1b0 2024-09-21T06:45:45.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.574+0000 7fd05dd73640 1 --2- 172.21.15.7:0/1372856596 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f62413390 0x559f627e7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:45:45.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.575+0000 7fd05e574640 1 --2- 172.21.15.7:0/1372856596 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f6240b1b0 0x559f627dca00 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fd0540045f0 tx=0x7fd054000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7ae74dcbe3e5d05 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:45.603 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.575+0000 7fd043fff640 1 -- 172.21.15.7:0/1372856596 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0540a9790 con 0x559f6240b1b0 2024-09-21T06:45:45.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.575+0000 7fd043fff640 1 -- 172.21.15.7:0/1372856596 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd0540eaba0 con 0x559f6240b1b0 2024-09-21T06:45:45.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.575+0000 7fd043fff640 1 -- 172.21.15.7:0/1372856596 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0540ac8b0 con 0x559f6240b1b0 2024-09-21T06:45:45.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.575+0000 7fd066d4c740 1 -- 172.21.15.7:0/1372856596 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f6240b1b0 msgr2=0x559f627dca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:45.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.575+0000 7fd066d4c740 1 --2- 172.21.15.7:0/1372856596 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f6240b1b0 0x559f627dca00 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fd0540045f0 tx=0x7fd054000bc0 comp rx=0 tx=0).stop 2024-09-21T06:45:45.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.575+0000 7fd066d4c740 1 -- 172.21.15.7:0/1372856596 shutdown_connections 2024-09-21T06:45:45.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.575+0000 7fd066d4c740 1 --2- 172.21.15.7:0/1372856596 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f62434070 0x559f627e83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:45.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.576+0000 7fd066d4c740 1 --2- 172.21.15.7:0/1372856596 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f62413390 0x559f627e7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:45.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.576+0000 7fd066d4c740 1 --2- 172.21.15.7:0/1372856596 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f6240b1b0 0x559f627dca00 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:45.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.576+0000 7fd066d4c740 1 -- 172.21.15.7:0/1372856596 >> 172.21.15.7:0/1372856596 conn(0x559f62428460 msgr2=0x559f627dc2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:45.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.576+0000 7fd066d4c740 1 -- 172.21.15.7:0/1372856596 shutdown_connections 2024-09-21T06:45:45.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.576+0000 7fd066d4c740 1 -- 172.21.15.7:0/1372856596 wait complete. 2024-09-21T06:45:45.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.576+0000 7fd066d4c740 1 -- start start 2024-09-21T06:45:45.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.576+0000 7fd066d4c740 1 Processor -- start 2024-09-21T06:45:45.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.576+0000 7fd066d4c740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f6240b1b0 0x559f627ef4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:45.604 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.576+0000 7fd066d4c740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f62413390 0x559f627ef9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:45.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.576+0000 7fd066d4c740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f62434070 0x559f628669c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:45.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.576+0000 7fd066d4c740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fd0581aba90 con 0x559f62413390 2024-09-21T06:45:45.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.577+0000 7fd066d4c740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd0581acf00 con 0x559f62434070 2024-09-21T06:45:45.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.577+0000 7fd066d4c740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fd0581ac160 con 0x559f6240b1b0 2024-09-21T06:45:45.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.577+0000 7fd066d4c740 10 client.0 _ll_register_callbacks cb 0x7fd04800b890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:45.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.577+0000 7fd05dd73640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f62413390 0x559f627ef9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:45.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.577+0000 7fd05dd73640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f62413390 0x559f627ef9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51582/0 (socket says 172.21.15.7:51582) 2024-09-21T06:45:45.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.577+0000 7fd05dd73640 1 -- 172.21.15.7:0/507875645 learned_addr learned my addr 172.21.15.7:0/507875645 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:45.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.577+0000 7fd05e574640 1 --2- 172.21.15.7:0/507875645 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f6240b1b0 0x559f627ef4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:45.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.577+0000 7fd05ed75640 1 --2- 172.21.15.7:0/507875645 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f62434070 0x559f628669c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:45.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.577+0000 7fd05dd73640 1 -- 172.21.15.7:0/507875645 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f6240b1b0 msgr2=0x559f627ef4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:45.605 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.577+0000 7fd05dd73640 1 --2- 172.21.15.7:0/507875645 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f6240b1b0 0x559f627ef4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:45.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.577+0000 7fd05dd73640 1 -- 172.21.15.7:0/507875645 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f62434070 msgr2=0x559f628669c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:45.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.577+0000 7fd05dd73640 1 --2- 172.21.15.7:0/507875645 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f62434070 0x559f628669c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:45.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.577+0000 7fd05dd73640 1 -- 172.21.15.7:0/507875645 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f62866f00 con 0x559f62413390 2024-09-21T06:45:45.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.577+0000 7fd05e574640 1 --2- 172.21.15.7:0/507875645 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f6240b1b0 0x559f627ef4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:45.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.577+0000 7fd05ed75640 1 --2- 172.21.15.7:0/507875645 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f62434070 0x559f628669c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:45:45.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.577+0000 7fd05dd73640 1 --2- 172.21.15.7:0/507875645 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f62413390 0x559f627ef9e0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fd048011010 tx=0x7fd04800d6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a82b06c420e8fa58 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:45.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.577+0000 7fd041ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:45:45.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.577+0000 7fd041ffb640 1 -- 172.21.15.7:0/507875645 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd048005450 con 0x559f62413390 2024-09-21T06:45:45.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.577+0000 7fd041ffb640 1 -- 172.21.15.7:0/507875645 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7fd0480055f0 con 0x559f62413390 2024-09-21T06:45:45.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.577+0000 7fd066d4c740 1 -- 172.21.15.7:0/507875645 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd0540eaba0 con 0x559f62413390 2024-09-21T06:45:45.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.578+0000 7fd041ffb640 1 -- 172.21.15.7:0/507875645 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd04801f020 con 0x559f62413390 2024-09-21T06:45:45.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.578+0000 7fd066d4c740 10 client.17736 fetch_fsmap learned FSMap version 25 2024-09-21T06:45:45.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.578+0000 7fd066d4c740 1 -- 172.21.15.7:0/507875645 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559f62867fa0 con 0x559f62413390 2024-09-21T06:45:45.606 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.578+0000 7fd041ffb640 1 -- 172.21.15.7:0/507875645 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd0540eaba0 con 0x559f62413390 2024-09-21T06:45:45.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.578+0000 7fd041ffb640 1 -- 172.21.15.7:0/507875645 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fd048035050 con 0x559f62413390 2024-09-21T06:45:45.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.578+0000 7fd066d4c740 10 client.17736 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:45:45.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.578+0000 7fd066d4c740 10 client.17736 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:45:45.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.578+0000 7fd066d4c740 20 client.17736 populate_metadata read hostname 'smithi007' 2024-09-21T06:45:45.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.578+0000 7fd066d4c740 1 --2- 172.21.15.7:0/507875645 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x559f623c7da0 0x559f6286a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:45.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.578+0000 7fd066d4c740 4 client.17736 mds_command: new command op to 24688 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:45:45.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.578+0000 7fd066d4c740 1 -- 172.21.15.7:0/507875645 --> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559f6274f8a0 con 0x559f623c7da0 2024-09-21T06:45:45.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.578+0000 7fd05e574640 1 --2- 172.21.15.7:0/507875645 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x559f623c7da0 0x559f6286a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:45.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.579+0000 7fd05e574640 1 --2- 172.21.15.7:0/507875645 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x559f623c7da0 0x559f6286a740 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=560637808c342b7b server_cookie=ee1e9798fc6ee39d in_seq=0 out_seq=0 2024-09-21T06:45:45.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.579+0000 7fd041ffb640 10 client.17736 ms_handle_connect on v2:172.21.15.144:6838/4027821922 2024-09-21T06:45:45.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.579+0000 7fd041ffb640 1 -- 172.21.15.7:0/507875645 <== mds.1 v2:172.21.15.144:6838/4027821922 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559f6274f8a0 con 0x559f623c7da0 2024-09-21T06:45:45.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.579+0000 7fd041ffb640 10 client.17736 handle_command_reply: tid=0 2024-09-21T06:45:45.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.579+0000 7fd066d4c740 1 client.17736 shutdown 2024-09-21T06:45:45.607 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.579+0000 7fd066d4c740 1 -- 172.21.15.7:0/507875645 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f62413390 msgr2=0x559f627ef9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:45.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.579+0000 7fd066d4c740 1 --2- 172.21.15.7:0/507875645 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f62413390 0x559f627ef9e0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fd048011010 tx=0x7fd04800d6a0 comp rx=0 tx=0).stop 2024-09-21T06:45:45.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.579+0000 7fd066d4c740 1 -- 172.21.15.7:0/507875645 shutdown_connections 2024-09-21T06:45:45.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.579+0000 7fd066d4c740 1 --2- 172.21.15.7:0/507875645 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x559f623c7da0 0x559f6286a740 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:45.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.579+0000 7fd066d4c740 1 --2- 172.21.15.7:0/507875645 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559f62434070 0x559f628669c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:45.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.579+0000 7fd041ffb640 0 client.17736 ms_handle_reset on v2:172.21.15.144:6838/4027821922 2024-09-21T06:45:45.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.579+0000 7fd066d4c740 1 --2- 172.21.15.7:0/507875645 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559f62413390 0x559f627ef9e0 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:45.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.579+0000 7fd066d4c740 1 --2- 172.21.15.7:0/507875645 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559f6240b1b0 0x559f627ef4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:45.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.579+0000 7fd066d4c740 1 -- 172.21.15.7:0/507875645 >> 172.21.15.7:0/507875645 conn(0x559f62428460 msgr2=0x559f627f6020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:45.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.579+0000 7fd066d4c740 1 -- 172.21.15.7:0/507875645 shutdown_connections 2024-09-21T06:45:45.608 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.579+0000 7fd066d4c740 1 -- 172.21.15.7:0/507875645 wait complete. 2024-09-21T06:45:45.608 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:45:45.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.579+0000 7fd066d4c740 20 client.17736 trim_cache size 0 max 16384 2024-09-21T06:45:45.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.580+0000 7fd0607d8640 1 -- 172.21.15.7:0/4280922292 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fd0440b6680 msgr2=0x7fd0440b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:45.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.580+0000 7fd0607d8640 1 --2- 172.21.15.7:0/4280922292 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fd0440b6680 0x7fd0440b8b90 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fd050005e30 tx=0x7fd050005c30 comp rx=0 tx=0).stop 2024-09-21T06:45:45.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.580+0000 7fd0607d8640 1 -- 172.21.15.7:0/4280922292 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd058103b60 msgr2=0x7fd05819a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:45.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.580+0000 7fd0607d8640 1 --2- 172.21.15.7:0/4280922292 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd058103b60 0x7fd05819a460 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fd05400d950 tx=0x7fd05400de10 comp rx=0 tx=0).stop 2024-09-21T06:45:45.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.580+0000 7fd0607d8640 1 -- 172.21.15.7:0/4280922292 shutdown_connections 2024-09-21T06:45:45.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.580+0000 7fd0607d8640 1 --2- 172.21.15.7:0/4280922292 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fd0440b6680 0x7fd0440b8b90 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:45.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.580+0000 7fd0607d8640 1 --2- 172.21.15.7:0/4280922292 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fd058109df0 0x7fd05819fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:45.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.580+0000 7fd0607d8640 1 --2- 172.21.15.7:0/4280922292 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd0581094a0 0x7fd05819aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:45.609 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.580+0000 7fd0607d8640 1 --2- 172.21.15.7:0/4280922292 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fd058103b60 0x7fd05819a460 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:45.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.580+0000 7fd0607d8640 1 -- 172.21.15.7:0/4280922292 >> 172.21.15.7:0/4280922292 conn(0x7fd05807b850 msgr2=0x7fd0581074f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:45.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.580+0000 7fd0607d8640 1 -- 172.21.15.7:0/4280922292 shutdown_connections 2024-09-21T06:45:45.610 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:45.580+0000 7fd0607d8640 1 -- 172.21.15.7:0/4280922292 wait complete. 2024-09-21T06:45:46.532 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:45:46.796 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:45:47.208 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:45:46 smithi007 ceph-mon[30983]: pgmap v612: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-09-21T06:45:47.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:45:46 smithi144 ceph-mon[34653]: pgmap v612: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-09-21T06:45:47.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.300+0000 7fa2015c9640 1 -- 172.21.15.7:0/2995123625 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1fc102ae0 msgr2=0x7fa1fc102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:47.302 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.300+0000 7fa2015c9640 1 --2- 172.21.15.7:0/2995123625 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1fc102ae0 0x7fa1fc102ef0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec009900 tx=0x7fa1ec02a410 comp rx=0 tx=0).stop 2024-09-21T06:45:47.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.300+0000 7fa2015c9640 1 -- 172.21.15.7:0/2995123625 shutdown_connections 2024-09-21T06:45:47.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.300+0000 7fa2015c9640 1 --2- 172.21.15.7:0/2995123625 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1fc108d20 0x7fa1fc10f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:47.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.300+0000 7fa2015c9640 1 --2- 172.21.15.7:0/2995123625 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1fc1083d0 0x7fa1fc1087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:47.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.300+0000 7fa2015c9640 1 --2- 172.21.15.7:0/2995123625 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1fc102ae0 0x7fa1fc102ef0 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:47.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.300+0000 7fa2015c9640 1 -- 172.21.15.7:0/2995123625 >> 172.21.15.7:0/2995123625 conn(0x7fa1fc079760 msgr2=0x7fa1fc079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:47.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.300+0000 7fa2015c9640 1 -- 172.21.15.7:0/2995123625 shutdown_connections 2024-09-21T06:45:47.303 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.300+0000 7fa2015c9640 1 -- 172.21.15.7:0/2995123625 wait complete. 2024-09-21T06:45:47.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.301+0000 7fa2015c9640 1 Processor -- start 2024-09-21T06:45:47.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.301+0000 7fa2015c9640 1 -- start start 2024-09-21T06:45:47.305 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.301+0000 7fa2015c9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1fc102ae0 0x7fa1fc19a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:47.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.301+0000 7fa2015c9640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1fc1083d0 0x7fa1fc19aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:47.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.301+0000 7fa2015c9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1fc108d20 0x7fa1fc19fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:47.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.302+0000 7fa2015c9640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa1fc113ab0 con 0x7fa1fc102ae0 2024-09-21T06:45:47.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.302+0000 7fa2015c9640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa1fc113930 con 0x7fa1fc108d20 2024-09-21T06:45:47.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.302+0000 7fa2015c9640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa1fc113c30 con 0x7fa1fc1083d0 2024-09-21T06:45:47.306 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.302+0000 7fa1faffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1fc102ae0 0x7fa1fc19a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:47.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.302+0000 7fa1faffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1fc102ae0 0x7fa1fc19a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51592/0 (socket says 172.21.15.7:51592) 2024-09-21T06:45:47.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.302+0000 7fa1faffd640 1 -- 172.21.15.7:0/2418125988 learned_addr learned my addr 172.21.15.7:0/2418125988 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:47.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.302+0000 7fa1fa7fc640 1 --2- 172.21.15.7:0/2418125988 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1fc1083d0 0x7fa1fc19aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:47.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.302+0000 7fa1fb7fe640 1 --2- 172.21.15.7:0/2418125988 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1fc108d20 0x7fa1fc19fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:47.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.302+0000 7fa1faffd640 1 -- 172.21.15.7:0/2418125988 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1fc1083d0 msgr2=0x7fa1fc19aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:47.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.302+0000 7fa1faffd640 1 --2- 172.21.15.7:0/2418125988 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1fc1083d0 0x7fa1fc19aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:47.307 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.302+0000 7fa1faffd640 1 -- 172.21.15.7:0/2418125988 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1fc108d20 msgr2=0x7fa1fc19fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:47.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.302+0000 7fa1faffd640 1 --2- 172.21.15.7:0/2418125988 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1fc108d20 0x7fa1fc19fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:47.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.302+0000 7fa1faffd640 1 -- 172.21.15.7:0/2418125988 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1fc1a0390 con 0x7fa1fc102ae0 2024-09-21T06:45:47.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.302+0000 7fa1fa7fc640 1 --2- 172.21.15.7:0/2418125988 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1fc1083d0 0x7fa1fc19aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:47.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.302+0000 7fa1faffd640 1 --2- 172.21.15.7:0/2418125988 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1fc102ae0 0x7fa1fc19a4e0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec005940 tx=0x7fa1ec004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:47.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.302+0000 7fa1e3fff640 1 -- 172.21.15.7:0/2418125988 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1ec03f030 con 0x7fa1fc102ae0 2024-09-21T06:45:47.308 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.302+0000 7fa1e3fff640 1 -- 172.21.15.7:0/2418125988 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa1ec003aa0 con 0x7fa1fc102ae0 2024-09-21T06:45:47.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.302+0000 7fa2015c9640 1 -- 172.21.15.7:0/2418125988 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1fc1a0620 con 0x7fa1fc102ae0 2024-09-21T06:45:47.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.302+0000 7fa1e3fff640 1 -- 172.21.15.7:0/2418125988 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1ec035070 con 0x7fa1fc102ae0 2024-09-21T06:45:47.309 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.303+0000 7fa2015c9640 1 -- 172.21.15.7:0/2418125988 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1fc1a0b50 con 0x7fa1fc102ae0 2024-09-21T06:45:47.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.305+0000 7fa207b3d740 1 Processor -- start 2024-09-21T06:45:47.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.305+0000 7fa207b3d740 1 -- start start 2024-09-21T06:45:47.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.305+0000 7fa207b3d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560d93651070 0x560d939f86a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:47.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.305+0000 7fa207b3d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d936281b0 0x560d939f8be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:47.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.305+0000 7fa207b3d740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560d93630390 0x560d939f9120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:47.317 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.305+0000 7fa207b3d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x560d9396eea0 con 0x560d936281b0 2024-09-21T06:45:47.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.305+0000 7fa207b3d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x560d9395e2d0 con 0x560d93651070 2024-09-21T06:45:47.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.305+0000 7fa207b3d740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x560d939620e0 con 0x560d93630390 2024-09-21T06:45:47.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.306+0000 7fa1fb7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560d93651070 0x560d939f86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:47.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.306+0000 7fa1fb7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560d93651070 0x560d939f86a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.7:56150/0 (socket says 172.21.15.7:56150) 2024-09-21T06:45:47.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.306+0000 7fa1fa7fc640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560d93630390 0x560d939f9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:47.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.306+0000 7fa1fb7fe640 1 -- 172.21.15.7:0/3817925143 learned_addr learned my addr 172.21.15.7:0/3817925143 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:47.318 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.306+0000 7fa1e3fff640 1 -- 172.21.15.7:0/2418125988 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7fa1ec042030 con 0x7fa1fc102ae0 2024-09-21T06:45:47.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.306+0000 7fa1faffd640 1 --2- 172.21.15.7:0/3817925143 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d936281b0 0x560d939f8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:47.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.306+0000 7fa1fa7fc640 1 -- 172.21.15.7:0/3817925143 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560d93651070 msgr2=0x560d939f86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:47.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.306+0000 7fa1fa7fc640 1 --2- 172.21.15.7:0/3817925143 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560d93651070 0x560d939f86a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:47.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.306+0000 7fa1fa7fc640 1 -- 172.21.15.7:0/3817925143 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d936281b0 msgr2=0x560d939f8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:47.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.306+0000 7fa1fa7fc640 1 --2- 172.21.15.7:0/3817925143 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d936281b0 0x560d939f8be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:47.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.306+0000 7fa1fa7fc640 1 -- 172.21.15.7:0/3817925143 --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d936bc650 con 0x560d93630390 2024-09-21T06:45:47.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.306+0000 7fa1faffd640 1 --2- 172.21.15.7:0/3817925143 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d936281b0 0x560d939f8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:47.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.306+0000 7fa1fa7fc640 1 --2- 172.21.15.7:0/3817925143 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560d93630390 0x560d939f9120 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc100c50 tx=0x7fa1f000e720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12bae0578ad1f4a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:47.319 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.307+0000 7fa1e17fa640 1 -- 172.21.15.7:0/3817925143 <== mon.1 v2:172.21.15.144:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f0014070 con 0x560d93630390 2024-09-21T06:45:47.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.307+0000 7fa1e17fa640 1 -- 172.21.15.7:0/3817925143 <== mon.1 v2:172.21.15.144:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa1f0008e50 con 0x560d93630390 2024-09-21T06:45:47.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.307+0000 7fa1e17fa640 1 -- 172.21.15.7:0/3817925143 <== mon.1 v2:172.21.15.144:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f0010690 con 0x560d93630390 2024-09-21T06:45:47.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.307+0000 7fa1e3fff640 1 --2- 172.21.15.7:0/2418125988 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa1e40b6730 0x7fa1e40b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:47.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.307+0000 7fa1fb7fe640 1 --2- 172.21.15.7:0/2418125988 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa1e40b6730 0x7fa1e40b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:47.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.307+0000 7fa1e3fff640 1 -- 172.21.15.7:0/2418125988 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7fa1ec107890 con 0x7fa1fc102ae0 2024-09-21T06:45:47.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.308+0000 7fa207b3d740 1 -- 172.21.15.7:0/3817925143 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560d93630390 msgr2=0x560d939f9120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:47.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.308+0000 7fa1fb7fe640 1 --2- 172.21.15.7:0/2418125988 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa1e40b6730 0x7fa1e40b8c40 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa1f4009fd0 tx=0x7fa1f4009500 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:47.320 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.308+0000 7fa207b3d740 1 --2- 172.21.15.7:0/3817925143 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560d93630390 0x560d939f9120 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc100c50 tx=0x7fa1f000e720 comp rx=0 tx=0).stop 2024-09-21T06:45:47.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.308+0000 7fa207b3d740 1 -- 172.21.15.7:0/3817925143 shutdown_connections 2024-09-21T06:45:47.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.308+0000 7fa207b3d740 1 --2- 172.21.15.7:0/3817925143 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560d93630390 0x560d939f9120 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:47.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.308+0000 7fa207b3d740 1 --2- 172.21.15.7:0/3817925143 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d936281b0 0x560d939f8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:47.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.308+0000 7fa207b3d740 1 --2- 172.21.15.7:0/3817925143 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560d93651070 0x560d939f86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:47.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.308+0000 7fa207b3d740 1 -- 172.21.15.7:0/3817925143 >> 172.21.15.7:0/3817925143 conn(0x560d93645460 msgr2=0x560d939f6590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:47.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.308+0000 7fa207b3d740 1 -- 172.21.15.7:0/3817925143 shutdown_connections 2024-09-21T06:45:47.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.308+0000 7fa207b3d740 1 -- 172.21.15.7:0/3817925143 wait complete. 2024-09-21T06:45:47.321 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.308+0000 7fa207b3d740 1 -- start start 2024-09-21T06:45:47.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.308+0000 7fa207b3d740 1 Processor -- start 2024-09-21T06:45:47.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.308+0000 7fa207b3d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560d936281b0 0x560d93a03dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:47.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.309+0000 7fa207b3d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d93630390 0x560d93a04310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:47.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.309+0000 7fa207b3d740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560d93651070 0x560d93a10170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:47.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.309+0000 7fa207b3d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x560d937bf700 con 0x560d93630390 2024-09-21T06:45:47.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.309+0000 7fa207b3d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x560d938f9160 con 0x560d936281b0 2024-09-21T06:45:47.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.309+0000 7fa207b3d740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x560d93a06e80 con 0x560d93651070 2024-09-21T06:45:47.322 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.309+0000 7fa207b3d740 10 client.0 _ll_register_callbacks cb 0x560d939129e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:47.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.309+0000 7fa1fa7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d93630390 0x560d93a04310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:47.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.309+0000 7fa1fa7fc640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d93630390 0x560d93a04310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51606/0 (socket says 172.21.15.7:51606) 2024-09-21T06:45:47.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.309+0000 7fa1fa7fc640 1 -- 172.21.15.7:0/3706061669 learned_addr learned my addr 172.21.15.7:0/3706061669 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:47.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.309+0000 7fa1faffd640 1 --2- 172.21.15.7:0/3706061669 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560d936281b0 0x560d93a03dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:47.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.309+0000 7fa1fb7fe640 1 --2- 172.21.15.7:0/3706061669 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560d93651070 0x560d93a10170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:47.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.309+0000 7fa1fa7fc640 1 -- 172.21.15.7:0/3706061669 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560d93651070 msgr2=0x560d93a10170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:47.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.309+0000 7fa1fa7fc640 1 --2- 172.21.15.7:0/3706061669 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560d93651070 0x560d93a10170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:47.323 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.309+0000 7fa1fa7fc640 1 -- 172.21.15.7:0/3706061669 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560d936281b0 msgr2=0x560d93a03dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:47.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.309+0000 7fa1fa7fc640 1 --2- 172.21.15.7:0/3706061669 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560d936281b0 0x560d93a03dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:47.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.309+0000 7fa1fa7fc640 1 -- 172.21.15.7:0/3706061669 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d93926c90 con 0x560d93630390 2024-09-21T06:45:47.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.309+0000 7fa1fa7fc640 1 --2- 172.21.15.7:0/3706061669 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d93630390 0x560d93a04310 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fa1f0000c00 tx=0x7fa1f0005120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2bcc1cf41c0ff9b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:47.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.309+0000 7fa1deff5640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:45:47.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.309+0000 7fa1deff5640 1 -- 172.21.15.7:0/3706061669 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f0014070 con 0x560d93630390 2024-09-21T06:45:47.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.309+0000 7fa1deff5640 1 -- 172.21.15.7:0/3706061669 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7fa1f0005550 con 0x560d93630390 2024-09-21T06:45:47.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.309+0000 7fa207b3d740 1 -- 172.21.15.7:0/3706061669 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa1f0008e50 con 0x560d93630390 2024-09-21T06:45:47.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.310+0000 7fa1deff5640 1 -- 172.21.15.7:0/3706061669 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa1f0004030 con 0x560d93630390 2024-09-21T06:45:47.324 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.310+0000 7fa207b3d740 10 client.17748 fetch_fsmap learned FSMap version 25 2024-09-21T06:45:47.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.310+0000 7fa207b3d740 1 -- 172.21.15.7:0/3706061669 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560d93a12ba0 con 0x560d93630390 2024-09-21T06:45:47.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.310+0000 7fa1deff5640 1 -- 172.21.15.7:0/3706061669 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa1f0008e50 con 0x560d93630390 2024-09-21T06:45:47.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.310+0000 7fa1deff5640 1 -- 172.21.15.7:0/3706061669 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa1f002a030 con 0x560d93630390 2024-09-21T06:45:47.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.310+0000 7fa207b3d740 10 client.17748 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:45:47.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.310+0000 7fa207b3d740 10 client.17748 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:45:47.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.310+0000 7fa207b3d740 20 client.17748 populate_metadata read hostname 'smithi007' 2024-09-21T06:45:47.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.310+0000 7fa207b3d740 1 --2- 172.21.15.7:0/3706061669 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x560d9360f9f0 0x560d93a15fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:47.325 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.310+0000 7fa207b3d740 4 client.17748 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:45:47.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.310+0000 7fa207b3d740 1 -- 172.21.15.7:0/3706061669 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560d93970df0 con 0x560d9360f9f0 2024-09-21T06:45:47.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.311+0000 7fa1faffd640 1 --2- 172.21.15.7:0/3706061669 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x560d9360f9f0 0x560d93a15fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:47.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.311+0000 7fa1faffd640 1 --2- 172.21.15.7:0/3706061669 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x560d9360f9f0 0x560d93a15fb0 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59fce74aed779f95 server_cookie=b4409642a7923cce in_seq=0 out_seq=0 2024-09-21T06:45:47.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.311+0000 7fa1deff5640 10 client.17748 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:45:47.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.312+0000 7fa1deff5640 1 -- 172.21.15.7:0/3706061669 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560d93970df0 con 0x560d9360f9f0 2024-09-21T06:45:47.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.312+0000 7fa1deff5640 10 client.17748 handle_command_reply: tid=0 2024-09-21T06:45:47.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.312+0000 7fa207b3d740 1 client.17748 shutdown 2024-09-21T06:45:47.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.312+0000 7fa207b3d740 1 -- 172.21.15.7:0/3706061669 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d93630390 msgr2=0x560d93a04310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:47.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.312+0000 7fa207b3d740 1 --2- 172.21.15.7:0/3706061669 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d93630390 0x560d93a04310 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fa1f0000c00 tx=0x7fa1f0005120 comp rx=0 tx=0).stop 2024-09-21T06:45:47.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.312+0000 7fa207b3d740 1 -- 172.21.15.7:0/3706061669 shutdown_connections 2024-09-21T06:45:47.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.312+0000 7fa207b3d740 1 --2- 172.21.15.7:0/3706061669 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x560d9360f9f0 0x560d93a15fb0 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:47.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.312+0000 7fa207b3d740 1 --2- 172.21.15.7:0/3706061669 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560d93651070 0x560d93a10170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:47.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.312+0000 7fa207b3d740 1 --2- 172.21.15.7:0/3706061669 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d93630390 0x560d93a04310 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:47.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.312+0000 7fa1deff5640 0 client.17748 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:45:47.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.312+0000 7fa207b3d740 1 --2- 172.21.15.7:0/3706061669 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560d936281b0 0x560d93a03dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:47.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.312+0000 7fa207b3d740 1 -- 172.21.15.7:0/3706061669 >> 172.21.15.7:0/3706061669 conn(0x560d93645460 msgr2=0x560d939fb880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:47.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.312+0000 7fa207b3d740 1 -- 172.21.15.7:0/3706061669 shutdown_connections 2024-09-21T06:45:47.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.312+0000 7fa207b3d740 1 -- 172.21.15.7:0/3706061669 wait complete. 2024-09-21T06:45:47.328 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.312+0000 7fa207b3d740 20 client.17748 trim_cache size 0 max 16384 2024-09-21T06:45:47.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.325+0000 7fa207b3d740 1 Processor -- start 2024-09-21T06:45:47.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.325+0000 7fa207b3d740 1 -- start start 2024-09-21T06:45:47.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.326+0000 7fa207b3d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d936281b0 0x560d939f9de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:47.338 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.326+0000 7fa207b3d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560d93651070 0x560d939f5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:47.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.326+0000 7fa207b3d740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560d935e4da0 0x560d939f6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:47.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.326+0000 7fa207b3d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa1fc1b1e80 con 0x560d936281b0 2024-09-21T06:45:47.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.326+0000 7fa207b3d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa1fc1af750 con 0x560d93651070 2024-09-21T06:45:47.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.326+0000 7fa207b3d740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa1fc1ad5c0 con 0x560d935e4da0 2024-09-21T06:45:47.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.326+0000 7fa1faffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d936281b0 0x560d939f9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:47.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.326+0000 7fa1faffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d936281b0 0x560d939f9de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51612/0 (socket says 172.21.15.7:51612) 2024-09-21T06:45:47.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.326+0000 7fa1faffd640 1 -- 172.21.15.7:0/2459572630 learned_addr learned my addr 172.21.15.7:0/2459572630 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:47.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.326+0000 7fa1fa7fc640 1 --2- 172.21.15.7:0/2459572630 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560d93651070 0x560d939f5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:47.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.326+0000 7fa1fb7fe640 1 --2- 172.21.15.7:0/2459572630 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560d935e4da0 0x560d939f6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:47.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.326+0000 7fa1faffd640 1 -- 172.21.15.7:0/2459572630 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560d935e4da0 msgr2=0x560d939f6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:47.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.326+0000 7fa1faffd640 1 --2- 172.21.15.7:0/2459572630 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560d935e4da0 0x560d939f6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:47.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.326+0000 7fa1faffd640 1 -- 172.21.15.7:0/2459572630 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560d93651070 msgr2=0x560d939f5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:47.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.326+0000 7fa1faffd640 1 --2- 172.21.15.7:0/2459572630 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560d93651070 0x560d939f5bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:47.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.326+0000 7fa1faffd640 1 -- 172.21.15.7:0/2459572630 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d939fb500 con 0x560d936281b0 2024-09-21T06:45:47.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.327+0000 7fa1faffd640 1 --2- 172.21.15.7:0/2459572630 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d936281b0 0x560d939f9de0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec031a70 tx=0x7fa1ec003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3007244909a28caa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:47.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.327+0000 7fa1e0ff9640 1 -- 172.21.15.7:0/2459572630 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1ec10d020 con 0x560d936281b0 2024-09-21T06:45:47.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.327+0000 7fa1e0ff9640 1 -- 172.21.15.7:0/2459572630 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa1ec0c7e50 con 0x560d936281b0 2024-09-21T06:45:47.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.327+0000 7fa1e0ff9640 1 -- 172.21.15.7:0/2459572630 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1ec049040 con 0x560d936281b0 2024-09-21T06:45:47.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.327+0000 7fa207b3d740 1 -- 172.21.15.7:0/2459572630 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d936281b0 msgr2=0x560d939f9de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:47.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.327+0000 7fa207b3d740 1 --2- 172.21.15.7:0/2459572630 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d936281b0 0x560d939f9de0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec031a70 tx=0x7fa1ec003f10 comp rx=0 tx=0).stop 2024-09-21T06:45:47.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.327+0000 7fa207b3d740 1 -- 172.21.15.7:0/2459572630 shutdown_connections 2024-09-21T06:45:47.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.327+0000 7fa207b3d740 1 --2- 172.21.15.7:0/2459572630 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560d935e4da0 0x560d939f6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:47.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.327+0000 7fa207b3d740 1 --2- 172.21.15.7:0/2459572630 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560d93651070 0x560d939f5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:47.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.327+0000 7fa207b3d740 1 --2- 172.21.15.7:0/2459572630 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d936281b0 0x560d939f9de0 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:47.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.327+0000 7fa207b3d740 1 -- 172.21.15.7:0/2459572630 >> 172.21.15.7:0/2459572630 conn(0x560d93645460 msgr2=0x560d939f96d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:47.340 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.328+0000 7fa207b3d740 1 -- 172.21.15.7:0/2459572630 shutdown_connections 2024-09-21T06:45:47.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.328+0000 7fa207b3d740 1 -- 172.21.15.7:0/2459572630 wait complete. 2024-09-21T06:45:47.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.328+0000 7fa207b3d740 1 -- start start 2024-09-21T06:45:47.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.328+0000 7fa207b3d740 1 Processor -- start 2024-09-21T06:45:47.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.328+0000 7fa207b3d740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d935e4da0 0x560d93a17770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:47.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.328+0000 7fa207b3d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560d936281b0 0x560d93a17cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:47.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.328+0000 7fa207b3d740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560d93651070 0x560d93a7f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:47.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.328+0000 7fa207b3d740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa1fc1adc10 con 0x560d935e4da0 2024-09-21T06:45:47.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.328+0000 7fa207b3d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa1fc1af080 con 0x560d936281b0 2024-09-21T06:45:47.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.328+0000 7fa207b3d740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa1fc1ae2e0 con 0x560d93651070 2024-09-21T06:45:47.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.328+0000 7fa207b3d740 10 client.0 _ll_register_callbacks cb 0x7fa1f40099e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:47.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.328+0000 7fa1faffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d935e4da0 0x560d93a17770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:47.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.328+0000 7fa1faffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d935e4da0 0x560d93a17770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51622/0 (socket says 172.21.15.7:51622) 2024-09-21T06:45:47.341 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.328+0000 7fa1faffd640 1 -- 172.21.15.7:0/518782034 learned_addr learned my addr 172.21.15.7:0/518782034 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:47.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.329+0000 7fa1fb7fe640 1 --2- 172.21.15.7:0/518782034 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560d93651070 0x560d93a7f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:47.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.329+0000 7fa1fa7fc640 1 --2- 172.21.15.7:0/518782034 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560d936281b0 0x560d93a17cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:47.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.329+0000 7fa1faffd640 1 -- 172.21.15.7:0/518782034 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560d93651070 msgr2=0x560d93a7f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:47.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.329+0000 7fa1faffd640 1 --2- 172.21.15.7:0/518782034 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560d93651070 0x560d93a7f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:47.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.329+0000 7fa1faffd640 1 -- 172.21.15.7:0/518782034 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560d936281b0 msgr2=0x560d93a17cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:47.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.329+0000 7fa1faffd640 1 --2- 172.21.15.7:0/518782034 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560d936281b0 0x560d93a17cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:47.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.329+0000 7fa1faffd640 1 -- 172.21.15.7:0/518782034 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d93a7fcc0 con 0x560d935e4da0 2024-09-21T06:45:47.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.329+0000 7fa1fb7fe640 1 --2- 172.21.15.7:0/518782034 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560d93651070 0x560d93a7f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:47.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.329+0000 7fa1faffd640 1 --2- 172.21.15.7:0/518782034 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d935e4da0 0x560d93a17770 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec0cd450 tx=0x7fa1ec0cde50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6bb802684ca2b61 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:47.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.329+0000 7fa1deff5640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:45:47.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.329+0000 7fa1deff5640 1 -- 172.21.15.7:0/518782034 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1ec049070 con 0x560d935e4da0 2024-09-21T06:45:47.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.329+0000 7fa1deff5640 1 -- 172.21.15.7:0/518782034 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7fa1ec0d6ce0 con 0x560d935e4da0 2024-09-21T06:45:47.342 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.329+0000 7fa207b3d740 1 -- 172.21.15.7:0/518782034 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa1ec0c7e50 con 0x560d935e4da0 2024-09-21T06:45:47.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.329+0000 7fa1deff5640 1 -- 172.21.15.7:0/518782034 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa1ec10d050 con 0x560d935e4da0 2024-09-21T06:45:47.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.329+0000 7fa207b3d740 10 client.17754 fetch_fsmap learned FSMap version 25 2024-09-21T06:45:47.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.329+0000 7fa207b3d740 1 -- 172.21.15.7:0/518782034 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560d93a80f40 con 0x560d935e4da0 2024-09-21T06:45:47.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.330+0000 7fa1deff5640 1 -- 172.21.15.7:0/518782034 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa1ec0c7e50 con 0x560d935e4da0 2024-09-21T06:45:47.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.330+0000 7fa1deff5640 1 -- 172.21.15.7:0/518782034 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa1ec04c060 con 0x560d935e4da0 2024-09-21T06:45:47.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.330+0000 7fa207b3d740 10 client.17754 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:45:47.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.330+0000 7fa207b3d740 10 client.17754 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:45:47.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.330+0000 7fa207b3d740 20 client.17754 populate_metadata read hostname 'smithi007' 2024-09-21T06:45:47.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.330+0000 7fa207b3d740 1 --2- 172.21.15.7:0/518782034 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x560d93a81760 0x560d93a83b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:47.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.330+0000 7fa207b3d740 4 client.17754 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:45:47.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.330+0000 7fa207b3d740 1 -- 172.21.15.7:0/518782034 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560d9396c8a0 con 0x560d93a81760 2024-09-21T06:45:47.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.330+0000 7fa1fa7fc640 1 --2- 172.21.15.7:0/518782034 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x560d93a81760 0x560d93a83b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:47.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.331+0000 7fa1deff5640 10 client.17754 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:45:47.343 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.331+0000 7fa1fa7fc640 1 --2- 172.21.15.7:0/518782034 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x560d93a81760 0x560d93a83b80 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=506af9357c73c30d server_cookie=d44f5830f913fb6e in_seq=0 out_seq=0 2024-09-21T06:45:47.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.331+0000 7fa1deff5640 1 -- 172.21.15.7:0/518782034 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560d9396c8a0 con 0x560d93a81760 2024-09-21T06:45:47.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.331+0000 7fa1deff5640 10 client.17754 handle_command_reply: tid=0 2024-09-21T06:45:47.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.331+0000 7fa207b3d740 1 client.17754 shutdown 2024-09-21T06:45:47.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.331+0000 7fa207b3d740 1 -- 172.21.15.7:0/518782034 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d935e4da0 msgr2=0x560d93a17770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:47.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.331+0000 7fa207b3d740 1 --2- 172.21.15.7:0/518782034 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d935e4da0 0x560d93a17770 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec0cd450 tx=0x7fa1ec0cde50 comp rx=0 tx=0).stop 2024-09-21T06:45:47.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.331+0000 7fa207b3d740 1 -- 172.21.15.7:0/518782034 shutdown_connections 2024-09-21T06:45:47.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.331+0000 7fa207b3d740 1 --2- 172.21.15.7:0/518782034 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x560d93a81760 0x560d93a83b80 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:47.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.331+0000 7fa207b3d740 1 --2- 172.21.15.7:0/518782034 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x560d93651070 0x560d93a7f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:47.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.331+0000 7fa207b3d740 1 --2- 172.21.15.7:0/518782034 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560d936281b0 0x560d93a17cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:47.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.331+0000 7fa207b3d740 1 --2- 172.21.15.7:0/518782034 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x560d935e4da0 0x560d93a17770 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:47.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.331+0000 7fa207b3d740 1 -- 172.21.15.7:0/518782034 >> 172.21.15.7:0/518782034 conn(0x560d93645460 msgr2=0x560d93a05090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:47.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.331+0000 7fa1deff5640 0 client.17754 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:45:47.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.331+0000 7fa207b3d740 1 -- 172.21.15.7:0/518782034 shutdown_connections 2024-09-21T06:45:47.344 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.331+0000 7fa207b3d740 1 -- 172.21.15.7:0/518782034 wait complete. 2024-09-21T06:45:47.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.331+0000 7fa207b3d740 20 client.17754 trim_cache size 0 max 16384 2024-09-21T06:45:47.345 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:45:47.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.332+0000 7fa2015c9640 1 -- 172.21.15.7:0/2418125988 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa1e40b6730 msgr2=0x7fa1e40b8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:47.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.332+0000 7fa2015c9640 1 --2- 172.21.15.7:0/2418125988 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa1e40b6730 0x7fa1e40b8c40 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa1f4009fd0 tx=0x7fa1f4009500 comp rx=0 tx=0).stop 2024-09-21T06:45:47.345 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.332+0000 7fa2015c9640 1 -- 172.21.15.7:0/2418125988 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1fc102ae0 msgr2=0x7fa1fc19a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:47.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.332+0000 7fa2015c9640 1 --2- 172.21.15.7:0/2418125988 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1fc102ae0 0x7fa1fc19a4e0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec005940 tx=0x7fa1ec004270 comp rx=0 tx=0).stop 2024-09-21T06:45:47.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.332+0000 7fa2015c9640 1 -- 172.21.15.7:0/2418125988 shutdown_connections 2024-09-21T06:45:47.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.332+0000 7fa2015c9640 1 --2- 172.21.15.7:0/2418125988 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa1e40b6730 0x7fa1e40b8c40 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:47.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.332+0000 7fa2015c9640 1 --2- 172.21.15.7:0/2418125988 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1fc108d20 0x7fa1fc19fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:47.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.332+0000 7fa2015c9640 1 --2- 172.21.15.7:0/2418125988 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa1fc1083d0 0x7fa1fc19aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:47.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.332+0000 7fa2015c9640 1 --2- 172.21.15.7:0/2418125988 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa1fc102ae0 0x7fa1fc19a4e0 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:47.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.332+0000 7fa2015c9640 1 -- 172.21.15.7:0/2418125988 >> 172.21.15.7:0/2418125988 conn(0x7fa1fc079760 msgr2=0x7fa1fc101450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:47.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.332+0000 7fa2015c9640 1 -- 172.21.15.7:0/2418125988 shutdown_connections 2024-09-21T06:45:47.346 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:47.332+0000 7fa2015c9640 1 -- 172.21.15.7:0/2418125988 wait complete. 2024-09-21T06:45:47.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:45:46 smithi018 ceph-mon[34477]: pgmap v612: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-09-21T06:45:49.175 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-21T06:45:49.175 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-21T06:45:49.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:45:48 smithi144 ceph-mon[34653]: pgmap v613: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6 op/s 2024-09-21T06:45:49.341 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:45:48 smithi007 ceph-mon[30983]: pgmap v613: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6 op/s 2024-09-21T06:45:49.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:45:48 smithi018 ceph-mon[34477]: pgmap v613: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6 op/s 2024-09-21T06:45:49.448 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:45:49.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.974+0000 7fad231a5640 1 -- 172.21.15.7:0/1173976824 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad1c1094b0 msgr2=0x7fad1c1098c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:49.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.974+0000 7fad231a5640 1 --2- 172.21.15.7:0/1173976824 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad1c1094b0 0x7fad1c1098c0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7fad08009900 tx=0x7fad0802a410 comp rx=0 tx=0).stop 2024-09-21T06:45:49.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.974+0000 7fad231a5640 1 -- 172.21.15.7:0/1173976824 shutdown_connections 2024-09-21T06:45:49.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.974+0000 7fad231a5640 1 --2- 172.21.15.7:0/1173976824 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad1c109e00 0x7fad1c110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:49.977 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.974+0000 7fad231a5640 1 --2- 172.21.15.7:0/1173976824 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad1c1094b0 0x7fad1c1098c0 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:49.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.974+0000 7fad231a5640 1 --2- 172.21.15.7:0/1173976824 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad1c103bc0 0x7fad1c103fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:49.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.974+0000 7fad231a5640 1 -- 172.21.15.7:0/1173976824 >> 172.21.15.7:0/1173976824 conn(0x7fad1c07b910 msgr2=0x7fad1c07bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:49.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.974+0000 7fad231a5640 1 -- 172.21.15.7:0/1173976824 shutdown_connections 2024-09-21T06:45:49.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.974+0000 7fad231a5640 1 -- 172.21.15.7:0/1173976824 wait complete. 2024-09-21T06:45:49.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.975+0000 7fad231a5640 1 Processor -- start 2024-09-21T06:45:49.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.975+0000 7fad231a5640 1 -- start start 2024-09-21T06:45:49.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.975+0000 7fad231a5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad1c103bc0 0x7fad1c19a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:49.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.975+0000 7fad231a5640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad1c1094b0 0x7fad1c19a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:49.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.975+0000 7fad231a5640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad1c109e00 0x7fad1c19fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:49.978 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.975+0000 7fad231a5640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fad1c113ac0 con 0x7fad1c1094b0 2024-09-21T06:45:49.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.975+0000 7fad231a5640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fad1c113940 con 0x7fad1c103bc0 2024-09-21T06:45:49.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.975+0000 7fad231a5640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fad1c113c40 con 0x7fad1c109e00 2024-09-21T06:45:49.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.975+0000 7fad1bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad1c1094b0 0x7fad1c19a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:49.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.975+0000 7fad20f41640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad1c103bc0 0x7fad1c19a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:49.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.975+0000 7fad1bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad1c1094b0 0x7fad1c19a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51636/0 (socket says 172.21.15.7:51636) 2024-09-21T06:45:49.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.975+0000 7fad1bfff640 1 -- 172.21.15.7:0/3419688397 learned_addr learned my addr 172.21.15.7:0/3419688397 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:49.979 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.975+0000 7fad21742640 1 --2- 172.21.15.7:0/3419688397 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad1c109e00 0x7fad1c19fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:49.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.976+0000 7fad20f41640 1 -- 172.21.15.7:0/3419688397 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad1c109e00 msgr2=0x7fad1c19fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:49.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.976+0000 7fad20f41640 1 --2- 172.21.15.7:0/3419688397 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad1c109e00 0x7fad1c19fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:49.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.976+0000 7fad20f41640 1 -- 172.21.15.7:0/3419688397 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad1c1094b0 msgr2=0x7fad1c19a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:49.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.976+0000 7fad20f41640 1 --2- 172.21.15.7:0/3419688397 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad1c1094b0 0x7fad1c19a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:49.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.976+0000 7fad20f41640 1 -- 172.21.15.7:0/3419688397 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad1c1a03c0 con 0x7fad1c103bc0 2024-09-21T06:45:49.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.976+0000 7fad1bfff640 1 --2- 172.21.15.7:0/3419688397 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad1c1094b0 0x7fad1c19a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:45:49.980 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.976+0000 7fad21742640 1 --2- 172.21.15.7:0/3419688397 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad1c109e00 0x7fad1c19fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:45:49.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.976+0000 7fad20f41640 1 --2- 172.21.15.7:0/3419688397 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad1c103bc0 0x7fad1c19a450 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fad1000e9f0 tx=0x7fad1000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:49.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.976+0000 7fad19ffb640 1 -- 172.21.15.7:0/3419688397 <== mon.2 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad1000ccc0 con 0x7fad1c103bc0 2024-09-21T06:45:49.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.976+0000 7fad231a5640 1 -- 172.21.15.7:0/3419688397 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad1c1a06b0 con 0x7fad1c103bc0 2024-09-21T06:45:49.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.976+0000 7fad19ffb640 1 -- 172.21.15.7:0/3419688397 <== mon.2 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fad100108e0 con 0x7fad1c103bc0 2024-09-21T06:45:49.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.976+0000 7fad19ffb640 1 -- 172.21.15.7:0/3419688397 <== mon.2 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad10018880 con 0x7fad1c103bc0 2024-09-21T06:45:49.981 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.977+0000 7fad231a5640 1 -- 172.21.15.7:0/3419688397 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad1c1a6e10 con 0x7fad1c103bc0 2024-09-21T06:45:49.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.979+0000 7fad29719740 1 Processor -- start 2024-09-21T06:45:49.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.979+0000 7fad29719740 1 -- start start 2024-09-21T06:45:49.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.979+0000 7fad19ffb640 1 -- 172.21.15.7:0/3419688397 <== mon.2 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7fad10010430 con 0x7fad1c103bc0 2024-09-21T06:45:49.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.979+0000 7fad29719740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575d562c350 0x5575d59d3430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:49.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.979+0000 7fad29719740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575d5603490 0x5575d59d3970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:49.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.979+0000 7fad29719740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575d560b670 0x5575d59d3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:49.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.979+0000 7fad29719740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5575d5949e60 con 0x5575d5603490 2024-09-21T06:45:49.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.980+0000 7fad29719740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5575d5939290 con 0x5575d562c350 2024-09-21T06:45:49.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.980+0000 7fad29719740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5575d593d0a0 con 0x5575d560b670 2024-09-21T06:45:49.984 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.980+0000 7fad20f41640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575d5603490 0x5575d59d3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:49.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.980+0000 7fad21742640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575d562c350 0x5575d59d3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:49.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.980+0000 7fad20f41640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575d5603490 0x5575d59d3970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51640/0 (socket says 172.21.15.7:51640) 2024-09-21T06:45:49.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.980+0000 7fad20f41640 1 -- 172.21.15.7:0/2141817001 learned_addr learned my addr 172.21.15.7:0/2141817001 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:49.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.980+0000 7fad1bfff640 1 --2- 172.21.15.7:0/2141817001 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575d560b670 0x5575d59d3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:49.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.980+0000 7fad20f41640 1 -- 172.21.15.7:0/2141817001 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575d560b670 msgr2=0x5575d59d3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:49.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.980+0000 7fad20f41640 1 --2- 172.21.15.7:0/2141817001 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575d560b670 0x5575d59d3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:49.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.980+0000 7fad20f41640 1 -- 172.21.15.7:0/2141817001 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575d562c350 msgr2=0x5575d59d3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:49.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.980+0000 7fad20f41640 1 --2- 172.21.15.7:0/2141817001 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575d562c350 0x5575d59d3430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:49.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.980+0000 7fad20f41640 1 -- 172.21.15.7:0/2141817001 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575d5697930 con 0x5575d5603490 2024-09-21T06:45:49.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.980+0000 7fad20f41640 1 --2- 172.21.15.7:0/2141817001 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575d5603490 0x5575d59d3970 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7fad100e5110 tx=0x7fad100f0520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c78297437f3fea0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:49.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.981+0000 7fad19ffb640 1 --2- 172.21.15.7:0/3419688397 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fad0c0b6680 0x7fad0c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:49.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.981+0000 7fad06ffd640 1 -- 172.21.15.7:0/2141817001 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad100fb070 con 0x5575d5603490 2024-09-21T06:45:49.985 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.981+0000 7fad21742640 1 --2- 172.21.15.7:0/3419688397 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fad0c0b6680 0x7fad0c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:49.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.981+0000 7fad06ffd640 1 -- 172.21.15.7:0/2141817001 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fad100ad460 con 0x5575d5603490 2024-09-21T06:45:49.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.981+0000 7fad06ffd640 1 -- 172.21.15.7:0/2141817001 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad10096aa0 con 0x5575d5603490 2024-09-21T06:45:49.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.981+0000 7fad19ffb640 1 -- 172.21.15.7:0/3419688397 <== mon.2 v2:172.21.15.18:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7fad100e79e0 con 0x7fad1c103bc0 2024-09-21T06:45:49.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.982+0000 7fad29719740 1 -- 172.21.15.7:0/2141817001 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575d5603490 msgr2=0x5575d59d3970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:49.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.982+0000 7fad21742640 1 --2- 172.21.15.7:0/3419688397 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fad0c0b6680 0x7fad0c0b8b90 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fad14009fd0 tx=0x7fad14015040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:49.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.982+0000 7fad29719740 1 --2- 172.21.15.7:0/2141817001 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575d5603490 0x5575d59d3970 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7fad100e5110 tx=0x7fad100f0520 comp rx=0 tx=0).stop 2024-09-21T06:45:49.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.982+0000 7fad29719740 1 -- 172.21.15.7:0/2141817001 shutdown_connections 2024-09-21T06:45:49.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.982+0000 7fad29719740 1 --2- 172.21.15.7:0/2141817001 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575d560b670 0x5575d59d3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:49.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.982+0000 7fad29719740 1 --2- 172.21.15.7:0/2141817001 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575d5603490 0x5575d59d3970 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:49.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.982+0000 7fad29719740 1 --2- 172.21.15.7:0/2141817001 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575d562c350 0x5575d59d3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:49.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.982+0000 7fad29719740 1 -- 172.21.15.7:0/2141817001 >> 172.21.15.7:0/2141817001 conn(0x5575d5620740 msgr2=0x5575d59d1320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:49.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.982+0000 7fad29719740 1 -- 172.21.15.7:0/2141817001 shutdown_connections 2024-09-21T06:45:49.986 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.982+0000 7fad29719740 1 -- 172.21.15.7:0/2141817001 wait complete. 2024-09-21T06:45:49.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.982+0000 7fad29719740 1 -- start start 2024-09-21T06:45:49.987 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.982+0000 7fad29719740 1 Processor -- start 2024-09-21T06:45:49.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.983+0000 7fad29719740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575d5603490 0x5575d59df010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:49.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.983+0000 7fad29719740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575d560b670 0x5575d59df550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:49.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.983+0000 7fad29719740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575d562c350 0x5575d59eaf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:49.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.983+0000 7fad29719740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5575d579a890 con 0x5575d560b670 2024-09-21T06:45:49.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.983+0000 7fad29719740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5575d58d3d40 con 0x5575d562c350 2024-09-21T06:45:49.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.983+0000 7fad29719740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5575d59e1c10 con 0x5575d5603490 2024-09-21T06:45:49.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.983+0000 7fad29719740 10 client.0 _ll_register_callbacks cb 0x5575d5937c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:49.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.983+0000 7fad1bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575d560b670 0x5575d59df550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:49.990 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.983+0000 7fad1bfff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575d560b670 0x5575d59df550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51644/0 (socket says 172.21.15.7:51644) 2024-09-21T06:45:49.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.983+0000 7fad1bfff640 1 -- 172.21.15.7:0/3986994174 learned_addr learned my addr 172.21.15.7:0/3986994174 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:49.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.983+0000 7fad20f41640 1 --2- 172.21.15.7:0/3986994174 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575d5603490 0x5575d59df010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:49.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.983+0000 7fad21742640 1 --2- 172.21.15.7:0/3986994174 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575d562c350 0x5575d59eaf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:49.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.983+0000 7fad1bfff640 1 -- 172.21.15.7:0/3986994174 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575d5603490 msgr2=0x5575d59df010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:49.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.983+0000 7fad1bfff640 1 --2- 172.21.15.7:0/3986994174 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575d5603490 0x5575d59df010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:49.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.983+0000 7fad1bfff640 1 -- 172.21.15.7:0/3986994174 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575d562c350 msgr2=0x5575d59eaf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:49.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.983+0000 7fad1bfff640 1 --2- 172.21.15.7:0/3986994174 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575d562c350 0x5575d59eaf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:49.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.983+0000 7fad1bfff640 1 -- 172.21.15.7:0/3986994174 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575d59eb490 con 0x5575d560b670 2024-09-21T06:45:49.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.983+0000 7fad21742640 1 --2- 172.21.15.7:0/3986994174 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575d562c350 0x5575d59eaf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:45:49.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.983+0000 7fad1bfff640 1 --2- 172.21.15.7:0/3986994174 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575d560b670 0x5575d59df550 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7fad08006010 tx=0x7fad08031720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4900033e9bab3d0b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:49.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.983+0000 7facfbfff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:45:49.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.984+0000 7facfbfff640 1 -- 172.21.15.7:0/3986994174 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad08035040 con 0x5575d560b670 2024-09-21T06:45:49.991 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.984+0000 7facfbfff640 1 -- 172.21.15.7:0/3986994174 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7fad08004450 con 0x5575d560b670 2024-09-21T06:45:49.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.984+0000 7fad29719740 1 -- 172.21.15.7:0/3986994174 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fad100ad460 con 0x5575d560b670 2024-09-21T06:45:49.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.984+0000 7facfbfff640 1 -- 172.21.15.7:0/3986994174 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fad08005020 con 0x5575d560b670 2024-09-21T06:45:49.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.984+0000 7fad29719740 10 client.17766 fetch_fsmap learned FSMap version 25 2024-09-21T06:45:49.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.984+0000 7fad29719740 1 -- 172.21.15.7:0/3986994174 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5575d59eddc0 con 0x5575d560b670 2024-09-21T06:45:49.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.984+0000 7facfbfff640 1 -- 172.21.15.7:0/3986994174 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fad100ad460 con 0x5575d560b670 2024-09-21T06:45:49.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.984+0000 7facfbfff640 1 -- 172.21.15.7:0/3986994174 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fad0804f020 con 0x5575d560b670 2024-09-21T06:45:49.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.984+0000 7fad29719740 10 client.17766 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:45:49.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.984+0000 7fad29719740 10 client.17766 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:45:49.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.984+0000 7fad29719740 20 client.17766 populate_metadata read hostname 'smithi007' 2024-09-21T06:45:49.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.984+0000 7fad29719740 1 --2- 172.21.15.7:0/3986994174 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5575d55eacd0 0x5575d59f12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:49.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.984+0000 7fad29719740 4 client.17766 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:45:49.992 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.984+0000 7fad29719740 1 -- 172.21.15.7:0/3986994174 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5575d594bdb0 con 0x5575d55eacd0 2024-09-21T06:45:49.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.985+0000 7fad20f41640 1 --2- 172.21.15.7:0/3986994174 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5575d55eacd0 0x5575d59f12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:49.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.985+0000 7facfbfff640 10 client.17766 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:45:49.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.985+0000 7fad20f41640 1 --2- 172.21.15.7:0/3986994174 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5575d55eacd0 0x5575d59f12d0 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d75002062e30ac3 server_cookie=758c380ebb39a228 in_seq=0 out_seq=0 2024-09-21T06:45:49.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.986+0000 7facfbfff640 1 -- 172.21.15.7:0/3986994174 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5575d594bdb0 con 0x5575d55eacd0 2024-09-21T06:45:49.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.986+0000 7facfbfff640 10 client.17766 handle_command_reply: tid=0 2024-09-21T06:45:49.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.986+0000 7fad29719740 1 client.17766 shutdown 2024-09-21T06:45:49.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.986+0000 7fad29719740 1 -- 172.21.15.7:0/3986994174 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575d560b670 msgr2=0x5575d59df550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:49.993 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.986+0000 7fad29719740 1 --2- 172.21.15.7:0/3986994174 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575d560b670 0x5575d59df550 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7fad08006010 tx=0x7fad08031720 comp rx=0 tx=0).stop 2024-09-21T06:45:49.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.986+0000 7fad29719740 1 -- 172.21.15.7:0/3986994174 shutdown_connections 2024-09-21T06:45:49.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.986+0000 7fad29719740 1 --2- 172.21.15.7:0/3986994174 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5575d55eacd0 0x5575d59f12d0 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:49.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.986+0000 7fad29719740 1 --2- 172.21.15.7:0/3986994174 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575d562c350 0x5575d59eaf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:49.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.986+0000 7fad29719740 1 --2- 172.21.15.7:0/3986994174 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575d560b670 0x5575d59df550 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:49.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.986+0000 7fad29719740 1 --2- 172.21.15.7:0/3986994174 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575d5603490 0x5575d59df010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:49.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.986+0000 7fad29719740 1 -- 172.21.15.7:0/3986994174 >> 172.21.15.7:0/3986994174 conn(0x5575d5620740 msgr2=0x5575d59d6610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:49.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.986+0000 7facfbfff640 0 client.17766 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:45:49.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.987+0000 7fad29719740 1 -- 172.21.15.7:0/3986994174 shutdown_connections 2024-09-21T06:45:49.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.987+0000 7fad29719740 1 -- 172.21.15.7:0/3986994174 wait complete. 2024-09-21T06:45:49.994 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:49.987+0000 7fad29719740 20 client.17766 trim_cache size 0 max 16384 2024-09-21T06:45:50.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.004+0000 7fad29719740 1 Processor -- start 2024-09-21T06:45:50.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.004+0000 7fad29719740 1 -- start start 2024-09-21T06:45:50.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.004+0000 7fad29719740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575d5603490 0x5575d59eae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:50.007 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.004+0000 7fad29719740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575d560b670 0x5575d59d8510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:50.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.004+0000 7fad29719740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575d562c350 0x5575d59d8a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:50.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.004+0000 7fad29719740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fad1c1afbe0 con 0x5575d5603490 2024-09-21T06:45:50.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.004+0000 7fad29719740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fad1c1ad4b0 con 0x5575d560b670 2024-09-21T06:45:50.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.004+0000 7fad29719740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fad1c1ab320 con 0x5575d562c350 2024-09-21T06:45:50.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.005+0000 7fad20f41640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575d5603490 0x5575d59eae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:50.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.005+0000 7fad20f41640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575d5603490 0x5575d59eae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51648/0 (socket says 172.21.15.7:51648) 2024-09-21T06:45:50.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.005+0000 7fad20f41640 1 -- 172.21.15.7:0/313002428 learned_addr learned my addr 172.21.15.7:0/313002428 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:50.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.005+0000 7fad21742640 1 --2- 172.21.15.7:0/313002428 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575d562c350 0x5575d59d8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:50.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.005+0000 7fad1bfff640 1 --2- 172.21.15.7:0/313002428 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575d560b670 0x5575d59d8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:50.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.005+0000 7fad20f41640 1 -- 172.21.15.7:0/313002428 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575d562c350 msgr2=0x5575d59d8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:50.008 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.005+0000 7fad20f41640 1 --2- 172.21.15.7:0/313002428 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575d562c350 0x5575d59d8a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:50.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.005+0000 7fad20f41640 1 -- 172.21.15.7:0/313002428 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575d560b670 msgr2=0x5575d59d8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:50.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.005+0000 7fad20f41640 1 --2- 172.21.15.7:0/313002428 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575d560b670 0x5575d59d8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:50.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.005+0000 7fad20f41640 1 -- 172.21.15.7:0/313002428 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575d59da6a0 con 0x5575d5603490 2024-09-21T06:45:50.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.005+0000 7fad1bfff640 1 --2- 172.21.15.7:0/313002428 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575d560b670 0x5575d59d8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:45:50.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.005+0000 7fad20f41640 1 --2- 172.21.15.7:0/313002428 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575d5603490 0x5575d59eae00 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7fad100aabc0 tx=0x7fad10009700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8bd5f9deeaedc12 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:50.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.005+0000 7fad067fc640 1 -- 172.21.15.7:0/313002428 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad10097b30 con 0x5575d5603490 2024-09-21T06:45:50.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.005+0000 7fad067fc640 1 -- 172.21.15.7:0/313002428 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fad10010720 con 0x5575d5603490 2024-09-21T06:45:50.009 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.005+0000 7fad067fc640 1 -- 172.21.15.7:0/313002428 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad10097d20 con 0x5575d5603490 2024-09-21T06:45:50.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.006+0000 7fad29719740 1 -- 172.21.15.7:0/313002428 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575d5603490 msgr2=0x5575d59eae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:50.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.006+0000 7fad29719740 1 --2- 172.21.15.7:0/313002428 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575d5603490 0x5575d59eae00 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7fad100aabc0 tx=0x7fad10009700 comp rx=0 tx=0).stop 2024-09-21T06:45:50.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.006+0000 7fad29719740 1 -- 172.21.15.7:0/313002428 shutdown_connections 2024-09-21T06:45:50.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.006+0000 7fad29719740 1 --2- 172.21.15.7:0/313002428 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575d562c350 0x5575d59d8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:50.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.006+0000 7fad29719740 1 --2- 172.21.15.7:0/313002428 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575d560b670 0x5575d59d8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:50.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.006+0000 7fad29719740 1 --2- 172.21.15.7:0/313002428 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575d5603490 0x5575d59eae00 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:50.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.006+0000 7fad29719740 1 -- 172.21.15.7:0/313002428 >> 172.21.15.7:0/313002428 conn(0x5575d5620740 msgr2=0x5575d59dd690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:50.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.006+0000 7fad29719740 1 -- 172.21.15.7:0/313002428 shutdown_connections 2024-09-21T06:45:50.012 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.006+0000 7fad29719740 1 -- 172.21.15.7:0/313002428 wait complete. 2024-09-21T06:45:50.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.006+0000 7fad29719740 1 -- start start 2024-09-21T06:45:50.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.007+0000 7fad29719740 1 Processor -- start 2024-09-21T06:45:50.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.007+0000 7fad29719740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575d5603490 0x5575d59f69a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:50.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.007+0000 7fad29719740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575d560b670 0x5575d59f6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:50.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.007+0000 7fad29719740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575d562c350 0x5575d59f7420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:50.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.007+0000 7fad29719740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fad1c1ab970 con 0x5575d5603490 2024-09-21T06:45:50.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.007+0000 7fad29719740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fad1c1acde0 con 0x5575d560b670 2024-09-21T06:45:50.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.007+0000 7fad29719740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fad1c1ac040 con 0x5575d562c350 2024-09-21T06:45:50.013 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.007+0000 7fad29719740 10 client.0 _ll_register_callbacks cb 0x7fad08009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:50.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.007+0000 7fad20f41640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575d5603490 0x5575d59f69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:50.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.007+0000 7fad20f41640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575d5603490 0x5575d59f69a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:51658/0 (socket says 172.21.15.7:51658) 2024-09-21T06:45:50.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.007+0000 7fad20f41640 1 -- 172.21.15.7:0/1505734724 learned_addr learned my addr 172.21.15.7:0/1505734724 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:50.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.007+0000 7fad1bfff640 1 --2- 172.21.15.7:0/1505734724 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575d560b670 0x5575d59f6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:50.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.007+0000 7fad21742640 1 --2- 172.21.15.7:0/1505734724 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575d562c350 0x5575d59f7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:50.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.008+0000 7fad20f41640 1 -- 172.21.15.7:0/1505734724 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575d562c350 msgr2=0x5575d59f7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:50.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.008+0000 7fad20f41640 1 --2- 172.21.15.7:0/1505734724 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575d562c350 0x5575d59f7420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:50.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.008+0000 7fad20f41640 1 -- 172.21.15.7:0/1505734724 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575d560b670 msgr2=0x5575d59f6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:50.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.008+0000 7fad20f41640 1 --2- 172.21.15.7:0/1505734724 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575d560b670 0x5575d59f6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:50.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.008+0000 7fad20f41640 1 -- 172.21.15.7:0/1505734724 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575d59e6560 con 0x5575d5603490 2024-09-21T06:45:50.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.008+0000 7fad21742640 1 --2- 172.21.15.7:0/1505734724 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575d562c350 0x5575d59f7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:50.014 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.008+0000 7fad20f41640 1 --2- 172.21.15.7:0/1505734724 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575d5603490 0x5575d59f69a0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7fad10000c00 tx=0x7fad1000cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5529b23df4449de0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:50.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.008+0000 7facfbfff640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:45:50.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.008+0000 7facfbfff640 1 -- 172.21.15.7:0/1505734724 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad10095090 con 0x5575d5603490 2024-09-21T06:45:50.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.008+0000 7facfbfff640 1 -- 172.21.15.7:0/1505734724 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7fad100eb6a0 con 0x5575d5603490 2024-09-21T06:45:50.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.008+0000 7fad29719740 1 -- 172.21.15.7:0/1505734724 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5575d5947860 con 0x5575d5603490 2024-09-21T06:45:50.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.008+0000 7facfbfff640 1 -- 172.21.15.7:0/1505734724 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fad10096250 con 0x5575d5603490 2024-09-21T06:45:50.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.008+0000 7fad29719740 10 client.17772 fetch_fsmap learned FSMap version 25 2024-09-21T06:45:50.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.008+0000 7fad29719740 1 -- 172.21.15.7:0/1505734724 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5575d5a5be70 con 0x5575d5603490 2024-09-21T06:45:50.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.008+0000 7facfbfff640 1 -- 172.21.15.7:0/1505734724 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5575d5947860 con 0x5575d5603490 2024-09-21T06:45:50.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.009+0000 7facfbfff640 1 -- 172.21.15.7:0/1505734724 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fad100e5420 con 0x5575d5603490 2024-09-21T06:45:50.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.009+0000 7fad29719740 10 client.17772 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:45:50.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.009+0000 7fad29719740 10 client.17772 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:45:50.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.009+0000 7fad29719740 20 client.17772 populate_metadata read hostname 'smithi007' 2024-09-21T06:45:50.015 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.009+0000 7fad29719740 1 --2- 172.21.15.7:0/1505734724 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5575d55c0080 0x5575d5a5e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:50.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.009+0000 7fad29719740 4 client.17772 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-21T06:45:50.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.009+0000 7fad29719740 1 -- 172.21.15.7:0/1505734724 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5575d5944c90 con 0x5575d55c0080 2024-09-21T06:45:50.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.009+0000 7fad1bfff640 1 --2- 172.21.15.7:0/1505734724 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5575d55c0080 0x5575d5a5e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:50.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.010+0000 7fad1bfff640 1 --2- 172.21.15.7:0/1505734724 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5575d55c0080 0x5575d5a5e170 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f361a05fcf4d4789 server_cookie=cd42a1596dd6d368 in_seq=0 out_seq=0 2024-09-21T06:45:50.016 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.010+0000 7facfbfff640 10 client.17772 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:45:50.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.011+0000 7facfbfff640 1 -- 172.21.15.7:0/1505734724 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5575d5944c90 con 0x5575d55c0080 2024-09-21T06:45:50.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.011+0000 7facfbfff640 10 client.17772 handle_command_reply: tid=0 2024-09-21T06:45:50.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.011+0000 7fad29719740 1 client.17772 shutdown 2024-09-21T06:45:50.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.011+0000 7fad29719740 1 -- 172.21.15.7:0/1505734724 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575d5603490 msgr2=0x5575d59f69a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:50.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.011+0000 7fad29719740 1 --2- 172.21.15.7:0/1505734724 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575d5603490 0x5575d59f69a0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7fad10000c00 tx=0x7fad1000cef0 comp rx=0 tx=0).stop 2024-09-21T06:45:50.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.012+0000 7fad29719740 1 -- 172.21.15.7:0/1505734724 shutdown_connections 2024-09-21T06:45:50.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.012+0000 7fad29719740 1 --2- 172.21.15.7:0/1505734724 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x5575d55c0080 0x5575d5a5e170 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:50.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.012+0000 7fad29719740 1 --2- 172.21.15.7:0/1505734724 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5575d562c350 0x5575d59f7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:50.017 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.012+0000 7fad29719740 1 --2- 172.21.15.7:0/1505734724 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5575d560b670 0x5575d59f6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:50.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.012+0000 7fad29719740 1 --2- 172.21.15.7:0/1505734724 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5575d5603490 0x5575d59f69a0 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:50.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.012+0000 7fad29719740 1 -- 172.21.15.7:0/1505734724 >> 172.21.15.7:0/1505734724 conn(0x5575d5620740 msgr2=0x5575d59d6530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:50.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.012+0000 7facfbfff640 0 client.17772 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:45:50.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.012+0000 7fad29719740 1 -- 172.21.15.7:0/1505734724 shutdown_connections 2024-09-21T06:45:50.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.012+0000 7fad29719740 1 -- 172.21.15.7:0/1505734724 wait complete. 2024-09-21T06:45:50.018 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.012+0000 7fad29719740 20 client.17772 trim_cache size 0 max 16384 2024-09-21T06:45:50.018 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:45:50.019 INFO:teuthology.orchestra.run.smithi007.stdout: "return_code": 0, 2024-09-21T06:45:50.019 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_tag": "1995e484-9812-41e2-bf5b-4904415f8598", 2024-09-21T06:45:50.019 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": "asynchronous" 2024-09-21T06:45:50.019 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:45:50.019 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.013+0000 7fad231a5640 1 -- 172.21.15.7:0/3419688397 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fad0c0b6680 msgr2=0x7fad0c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:50.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.013+0000 7fad231a5640 1 --2- 172.21.15.7:0/3419688397 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fad0c0b6680 0x7fad0c0b8b90 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fad14009fd0 tx=0x7fad14015040 comp rx=0 tx=0).stop 2024-09-21T06:45:50.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.013+0000 7fad231a5640 1 -- 172.21.15.7:0/3419688397 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad1c103bc0 msgr2=0x7fad1c19a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:50.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.013+0000 7fad231a5640 1 --2- 172.21.15.7:0/3419688397 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad1c103bc0 0x7fad1c19a450 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fad1000e9f0 tx=0x7fad1000eeb0 comp rx=0 tx=0).stop 2024-09-21T06:45:50.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.013+0000 7fad231a5640 1 -- 172.21.15.7:0/3419688397 shutdown_connections 2024-09-21T06:45:50.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.013+0000 7fad231a5640 1 --2- 172.21.15.7:0/3419688397 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fad0c0b6680 0x7fad0c0b8b90 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:50.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.013+0000 7fad231a5640 1 --2- 172.21.15.7:0/3419688397 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fad1c109e00 0x7fad1c19fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:50.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.013+0000 7fad231a5640 1 --2- 172.21.15.7:0/3419688397 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fad1c1094b0 0x7fad1c19a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:50.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.013+0000 7fad231a5640 1 --2- 172.21.15.7:0/3419688397 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad1c103bc0 0x7fad1c19a450 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:50.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.013+0000 7fad231a5640 1 -- 172.21.15.7:0/3419688397 >> 172.21.15.7:0/3419688397 conn(0x7fad1c07b910 msgr2=0x7fad1c105520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:50.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.013+0000 7fad231a5640 1 -- 172.21.15.7:0/3419688397 shutdown_connections 2024-09-21T06:45:50.020 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:50.013+0000 7fad231a5640 1 -- 172.21.15.7:0/3419688397 wait complete. 2024-09-21T06:45:50.899 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:45:51.161 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:45:51.282 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:45:50 smithi007 ceph-mon[30983]: pgmap v614: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:45:51.282 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:45:50 smithi007 ceph-mon[30983]: scrub queued for path: / 2024-09-21T06:45:51.282 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:45:50 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T06:45:51.282 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:45:50 smithi007 ceph-mon[30983]: scrub summary: active paths [/] 2024-09-21T06:45:51.283 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:45:50 smithi007 ceph-mon[30983]: scrub summary: idle+waiting paths [/] 2024-09-21T06:45:51.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:45:50 smithi144 ceph-mon[34653]: pgmap v614: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:45:51.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:45:50 smithi144 ceph-mon[34653]: scrub queued for path: / 2024-09-21T06:45:51.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:45:50 smithi144 ceph-mon[34653]: scrub summary: idle+waiting paths [/] 2024-09-21T06:45:51.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:45:50 smithi144 ceph-mon[34653]: scrub summary: active paths [/] 2024-09-21T06:45:51.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:45:50 smithi144 ceph-mon[34653]: scrub summary: idle+waiting paths [/] 2024-09-21T06:45:51.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:45:50 smithi018 ceph-mon[34477]: pgmap v614: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:45:51.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:45:50 smithi018 ceph-mon[34477]: scrub queued for path: / 2024-09-21T06:45:51.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:45:50 smithi018 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-21T06:45:51.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:45:50 smithi018 ceph-mon[34477]: scrub summary: active paths [/] 2024-09-21T06:45:51.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:45:50 smithi018 ceph-mon[34477]: scrub summary: idle+waiting paths [/] 2024-09-21T06:45:51.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.638+0000 7fc015c35640 1 -- 172.21.15.7:0/3228442552 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0101083d0 msgr2=0x7fc0101087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:51.654 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.638+0000 7fc015c35640 1 --2- 172.21.15.7:0/3228442552 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0101083d0 0x7fc0101087e0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7fbff8009900 tx=0x7fbff802a410 comp rx=0 tx=0).stop 2024-09-21T06:45:51.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.638+0000 7fc015c35640 1 -- 172.21.15.7:0/3228442552 shutdown_connections 2024-09-21T06:45:51.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.638+0000 7fc015c35640 1 --2- 172.21.15.7:0/3228442552 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc010108d20 0x7fc01010f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:51.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.638+0000 7fc015c35640 1 --2- 172.21.15.7:0/3228442552 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0101083d0 0x7fc0101087e0 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:51.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.638+0000 7fc015c35640 1 --2- 172.21.15.7:0/3228442552 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc010102ae0 0x7fc010102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:51.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.638+0000 7fc015c35640 1 -- 172.21.15.7:0/3228442552 >> 172.21.15.7:0/3228442552 conn(0x7fc010079760 msgr2=0x7fc010079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:51.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.638+0000 7fc015c35640 1 -- 172.21.15.7:0/3228442552 shutdown_connections 2024-09-21T06:45:51.655 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.638+0000 7fc015c35640 1 -- 172.21.15.7:0/3228442552 wait complete. 2024-09-21T06:45:51.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.639+0000 7fc015c35640 1 Processor -- start 2024-09-21T06:45:51.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.639+0000 7fc015c35640 1 -- start start 2024-09-21T06:45:51.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.639+0000 7fc015c35640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc010102ae0 0x7fc01019a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:51.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.639+0000 7fc015c35640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0101083d0 0x7fc01019aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:51.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.639+0000 7fc015c35640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc010108d20 0x7fc01019fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:51.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.639+0000 7fc015c35640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc010112990 con 0x7fc0101083d0 2024-09-21T06:45:51.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.639+0000 7fc015c35640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc010112810 con 0x7fc010102ae0 2024-09-21T06:45:51.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.639+0000 7fc015c35640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc010112b10 con 0x7fc010108d20 2024-09-21T06:45:51.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.639+0000 7fc00effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0101083d0 0x7fc01019aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:51.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.639+0000 7fc00effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0101083d0 0x7fc01019aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46246/0 (socket says 172.21.15.7:46246) 2024-09-21T06:45:51.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.639+0000 7fc00effd640 1 -- 172.21.15.7:0/244041768 learned_addr learned my addr 172.21.15.7:0/244041768 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:51.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.639+0000 7fc00f7fe640 1 --2- 172.21.15.7:0/244041768 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc010102ae0 0x7fc01019a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:51.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.640+0000 7fc00ffff640 1 --2- 172.21.15.7:0/244041768 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc010108d20 0x7fc01019fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:51.656 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.640+0000 7fc00effd640 1 -- 172.21.15.7:0/244041768 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc010108d20 msgr2=0x7fc01019fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:51.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.640+0000 7fc00effd640 1 --2- 172.21.15.7:0/244041768 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc010108d20 0x7fc01019fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:51.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.640+0000 7fc00effd640 1 -- 172.21.15.7:0/244041768 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc010102ae0 msgr2=0x7fc01019a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:51.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.640+0000 7fc00effd640 1 --2- 172.21.15.7:0/244041768 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc010102ae0 0x7fc01019a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:51.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.640+0000 7fc00effd640 1 -- 172.21.15.7:0/244041768 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0101a0380 con 0x7fc0101083d0 2024-09-21T06:45:51.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.640+0000 7fc00effd640 1 --2- 172.21.15.7:0/244041768 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0101083d0 0x7fc01019aa70 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7fbff8032fd0 tx=0x7fbff8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:51.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.640+0000 7fc00cff9640 1 -- 172.21.15.7:0/244041768 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff803f030 con 0x7fc0101083d0 2024-09-21T06:45:51.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.640+0000 7fc00cff9640 1 -- 172.21.15.7:0/244041768 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbff8004490 con 0x7fc0101083d0 2024-09-21T06:45:51.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.640+0000 7fc015c35640 1 -- 172.21.15.7:0/244041768 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0101a0610 con 0x7fc0101083d0 2024-09-21T06:45:51.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.640+0000 7fc00cff9640 1 -- 172.21.15.7:0/244041768 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff8035070 con 0x7fc0101083d0 2024-09-21T06:45:51.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.640+0000 7fc015c35640 1 -- 172.21.15.7:0/244041768 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0101a0af0 con 0x7fc0101083d0 2024-09-21T06:45:51.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.643+0000 7fc01c1a9740 1 Processor -- start 2024-09-21T06:45:51.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.643+0000 7fc01c1a9740 1 -- start start 2024-09-21T06:45:51.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.643+0000 7fc01c1a9740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da65824070 0x55da65bcb270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:51.657 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.643+0000 7fc01c1a9740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da657fb1b0 0x55da65bcb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:51.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.643+0000 7fc00cff9640 1 -- 172.21.15.7:0/244041768 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7fbff8042030 con 0x7fc0101083d0 2024-09-21T06:45:51.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.643+0000 7fc01c1a9740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55da65803390 0x55da65bcbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:51.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.643+0000 7fc01c1a9740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55da65b41e50 con 0x55da65824070 2024-09-21T06:45:51.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.643+0000 7fc01c1a9740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55da65b31280 con 0x55da65803390 2024-09-21T06:45:51.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.643+0000 7fc01c1a9740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55da65b35090 con 0x55da657fb1b0 2024-09-21T06:45:51.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.644+0000 7fc00ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da65824070 0x55da65bcb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:51.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.644+0000 7fc00ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da65824070 0x55da65bcb270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46250/0 (socket says 172.21.15.7:46250) 2024-09-21T06:45:51.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.644+0000 7fc00ffff640 1 -- 172.21.15.7:0/3734496702 learned_addr learned my addr 172.21.15.7:0/3734496702 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:51.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.644+0000 7fc00f7fe640 1 --2- 172.21.15.7:0/3734496702 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da657fb1b0 0x55da65bcb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:51.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.644+0000 7fc00effd640 1 --2- 172.21.15.7:0/3734496702 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55da65803390 0x55da65bcbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:51.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.644+0000 7fc00ffff640 1 -- 172.21.15.7:0/3734496702 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da657fb1b0 msgr2=0x55da65bcb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:51.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.644+0000 7fc00ffff640 1 --2- 172.21.15.7:0/3734496702 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da657fb1b0 0x55da65bcb7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:51.658 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.644+0000 7fc00ffff640 1 -- 172.21.15.7:0/3734496702 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55da65803390 msgr2=0x55da65bcbcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:51.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.644+0000 7fc00ffff640 1 --2- 172.21.15.7:0/3734496702 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55da65803390 0x55da65bcbcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:51.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.644+0000 7fc00ffff640 1 -- 172.21.15.7:0/3734496702 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da6588f650 con 0x55da65824070 2024-09-21T06:45:51.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.644+0000 7fc00ffff640 1 --2- 172.21.15.7:0/3734496702 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da65824070 0x55da65bcb270 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fc008007dd0 tx=0x7fc00800e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db4096816db33752 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:51.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.644+0000 7fc005ffb640 1 -- 172.21.15.7:0/3734496702 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc008014070 con 0x55da65824070 2024-09-21T06:45:51.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.644+0000 7fc005ffb640 1 -- 172.21.15.7:0/3734496702 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc008004d20 con 0x55da65824070 2024-09-21T06:45:51.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.644+0000 7fc005ffb640 1 -- 172.21.15.7:0/3734496702 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0080107b0 con 0x55da65824070 2024-09-21T06:45:51.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.644+0000 7fc00cff9640 1 --2- 172.21.15.7:0/244041768 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fbffc0b66b0 0x7fbffc0b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:51.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.645+0000 7fc00f7fe640 1 --2- 172.21.15.7:0/244041768 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fbffc0b66b0 0x7fbffc0b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:51.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.645+0000 7fc00cff9640 1 -- 172.21.15.7:0/244041768 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7fbff8107bb0 con 0x7fc0101083d0 2024-09-21T06:45:51.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.645+0000 7fc01c1a9740 1 -- 172.21.15.7:0/3734496702 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da65824070 msgr2=0x55da65bcb270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:51.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.645+0000 7fc00f7fe640 1 --2- 172.21.15.7:0/244041768 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fbffc0b66b0 0x7fbffc0b8bc0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x55da65bc9ef0 tx=0x7fc00000b410 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:51.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.645+0000 7fc01c1a9740 1 --2- 172.21.15.7:0/3734496702 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da65824070 0x55da65bcb270 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fc008007dd0 tx=0x7fc00800e720 comp rx=0 tx=0).stop 2024-09-21T06:45:51.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.645+0000 7fc01c1a9740 1 -- 172.21.15.7:0/3734496702 shutdown_connections 2024-09-21T06:45:51.659 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.645+0000 7fc01c1a9740 1 --2- 172.21.15.7:0/3734496702 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55da65803390 0x55da65bcbcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:51.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.645+0000 7fc01c1a9740 1 --2- 172.21.15.7:0/3734496702 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da657fb1b0 0x55da65bcb7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:51.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.645+0000 7fc01c1a9740 1 --2- 172.21.15.7:0/3734496702 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da65824070 0x55da65bcb270 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:51.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.645+0000 7fc01c1a9740 1 -- 172.21.15.7:0/3734496702 >> 172.21.15.7:0/3734496702 conn(0x55da65818460 msgr2=0x55da65bc9160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:51.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.645+0000 7fc01c1a9740 1 -- 172.21.15.7:0/3734496702 shutdown_connections 2024-09-21T06:45:51.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.645+0000 7fc01c1a9740 1 -- 172.21.15.7:0/3734496702 wait complete. 2024-09-21T06:45:51.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.646+0000 7fc01c1a9740 1 -- start start 2024-09-21T06:45:51.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.646+0000 7fc01c1a9740 1 Processor -- start 2024-09-21T06:45:51.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.646+0000 7fc01c1a9740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da657fb1b0 0x55da65bd68d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:51.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.646+0000 7fc01c1a9740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55da65803390 0x55da65bd6e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:51.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.646+0000 7fc01c1a9740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da65824070 0x55da65bd7350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:51.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.646+0000 7fc01c1a9740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55da65992700 con 0x55da65824070 2024-09-21T06:45:51.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.646+0000 7fc01c1a9740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55da65acc110 con 0x55da65803390 2024-09-21T06:45:51.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.646+0000 7fc01c1a9740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55da65bd9a50 con 0x55da657fb1b0 2024-09-21T06:45:51.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.646+0000 7fc01c1a9740 10 client.0 _ll_register_callbacks cb 0x55da65ae5990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:51.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.646+0000 7fc00ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da65824070 0x55da65bd7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:51.660 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.646+0000 7fc00ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da65824070 0x55da65bd7350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46262/0 (socket says 172.21.15.7:46262) 2024-09-21T06:45:51.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.646+0000 7fc00ffff640 1 -- 172.21.15.7:0/991625775 learned_addr learned my addr 172.21.15.7:0/991625775 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:51.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.647+0000 7fc00f7fe640 1 --2- 172.21.15.7:0/991625775 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da657fb1b0 0x55da65bd68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:51.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.647+0000 7fc00effd640 1 --2- 172.21.15.7:0/991625775 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55da65803390 0x55da65bd6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:51.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.647+0000 7fc00ffff640 1 -- 172.21.15.7:0/991625775 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da657fb1b0 msgr2=0x55da65bd68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:51.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.647+0000 7fc00ffff640 1 --2- 172.21.15.7:0/991625775 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da657fb1b0 0x55da65bd68d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:51.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.647+0000 7fc00ffff640 1 -- 172.21.15.7:0/991625775 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55da65803390 msgr2=0x55da65bd6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:51.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.647+0000 7fc00ffff640 1 --2- 172.21.15.7:0/991625775 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55da65803390 0x55da65bd6e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:51.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.647+0000 7fc00ffff640 1 -- 172.21.15.7:0/991625775 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da65af9c40 con 0x55da65824070 2024-09-21T06:45:51.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.647+0000 7fc00effd640 1 --2- 172.21.15.7:0/991625775 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55da65803390 0x55da65bd6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:45:51.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.647+0000 7fc00ffff640 1 --2- 172.21.15.7:0/991625775 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da65824070 0x55da65bd7350 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7fc008005650 tx=0x7fc008005680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37cd00c808a94e59 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:51.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.647+0000 7fbfeeffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:45:51.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.647+0000 7fbfeeffd640 1 -- 172.21.15.7:0/991625775 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc008027060 con 0x55da65824070 2024-09-21T06:45:51.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.647+0000 7fbfeeffd640 1 -- 172.21.15.7:0/991625775 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7fc008004a40 con 0x55da65824070 2024-09-21T06:45:51.661 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.647+0000 7fc01c1a9740 1 -- 172.21.15.7:0/991625775 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc008004d20 con 0x55da65824070 2024-09-21T06:45:51.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.647+0000 7fbfeeffd640 1 -- 172.21.15.7:0/991625775 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc008014070 con 0x55da65824070 2024-09-21T06:45:51.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.647+0000 7fc01c1a9740 10 client.17784 fetch_fsmap learned FSMap version 25 2024-09-21T06:45:51.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.647+0000 7fc01c1a9740 1 -- 172.21.15.7:0/991625775 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55da65be5700 con 0x55da65824070 2024-09-21T06:45:51.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.648+0000 7fbfeeffd640 1 -- 172.21.15.7:0/991625775 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc008004d20 con 0x55da65824070 2024-09-21T06:45:51.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.648+0000 7fbfeeffd640 1 -- 172.21.15.7:0/991625775 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fc00802a020 con 0x55da65824070 2024-09-21T06:45:51.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.648+0000 7fc01c1a9740 10 client.17784 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:45:51.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.648+0000 7fc01c1a9740 10 client.17784 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:45:51.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.648+0000 7fc01c1a9740 20 client.17784 populate_metadata read hostname 'smithi007' 2024-09-21T06:45:51.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.648+0000 7fc01c1a9740 1 --2- 172.21.15.7:0/991625775 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55da657e29f0 0x55da65be8b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:51.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.648+0000 7fc01c1a9740 4 client.17784 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:45:51.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.648+0000 7fc01c1a9740 1 -- 172.21.15.7:0/991625775 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55da65b43da0 con 0x55da657e29f0 2024-09-21T06:45:51.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.648+0000 7fc00f7fe640 1 --2- 172.21.15.7:0/991625775 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55da657e29f0 0x55da65be8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:51.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.649+0000 7fbfeeffd640 10 client.17784 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:45:51.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.649+0000 7fc00f7fe640 1 --2- 172.21.15.7:0/991625775 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55da657e29f0 0x55da65be8b10 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=93af75e8fa10b362 server_cookie=c7a21ef92ab9bc3d in_seq=0 out_seq=0 2024-09-21T06:45:51.662 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.649+0000 7fbfeeffd640 1 -- 172.21.15.7:0/991625775 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55da65b43da0 con 0x55da657e29f0 2024-09-21T06:45:51.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.649+0000 7fbfeeffd640 10 client.17784 handle_command_reply: tid=0 2024-09-21T06:45:51.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.649+0000 7fc01c1a9740 1 client.17784 shutdown 2024-09-21T06:45:51.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.650+0000 7fc01c1a9740 1 -- 172.21.15.7:0/991625775 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da65824070 msgr2=0x55da65bd7350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:51.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.650+0000 7fc01c1a9740 1 --2- 172.21.15.7:0/991625775 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da65824070 0x55da65bd7350 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7fc008005650 tx=0x7fc008005680 comp rx=0 tx=0).stop 2024-09-21T06:45:51.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.650+0000 7fc01c1a9740 1 -- 172.21.15.7:0/991625775 shutdown_connections 2024-09-21T06:45:51.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.650+0000 7fc01c1a9740 1 --2- 172.21.15.7:0/991625775 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55da657e29f0 0x55da65be8b10 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:51.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.650+0000 7fc01c1a9740 1 --2- 172.21.15.7:0/991625775 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da65824070 0x55da65bd7350 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:51.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.650+0000 7fc01c1a9740 1 --2- 172.21.15.7:0/991625775 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55da65803390 0x55da65bd6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:51.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.650+0000 7fc01c1a9740 1 --2- 172.21.15.7:0/991625775 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da657fb1b0 0x55da65bd68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:51.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.650+0000 7fbfeeffd640 0 client.17784 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:45:51.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.650+0000 7fc01c1a9740 1 -- 172.21.15.7:0/991625775 >> 172.21.15.7:0/991625775 conn(0x55da65818460 msgr2=0x55da65bce450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:51.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.650+0000 7fc01c1a9740 1 -- 172.21.15.7:0/991625775 shutdown_connections 2024-09-21T06:45:51.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.650+0000 7fc01c1a9740 1 -- 172.21.15.7:0/991625775 wait complete. 2024-09-21T06:45:51.663 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.650+0000 7fc01c1a9740 20 client.17784 trim_cache size 0 max 16384 2024-09-21T06:45:51.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.668+0000 7fc01c1a9740 1 Processor -- start 2024-09-21T06:45:51.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.668+0000 7fc01c1a9740 1 -- start start 2024-09-21T06:45:51.670 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.668+0000 7fc01c1a9740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55da657fb1b0 0x55da65bcc9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:51.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.668+0000 7fc01c1a9740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da65803390 0x55da65bd3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:51.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.668+0000 7fc01c1a9740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da65824070 0x55da65bd4000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:51.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.669+0000 7fc01c1a9740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc0101b1db0 con 0x55da65824070 2024-09-21T06:45:51.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.669+0000 7fc01c1a9740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc0101af680 con 0x55da657fb1b0 2024-09-21T06:45:51.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.669+0000 7fc01c1a9740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc0101ad4f0 con 0x55da65803390 2024-09-21T06:45:51.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.669+0000 7fc00ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da65824070 0x55da65bd4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:51.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.669+0000 7fc00ffff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da65824070 0x55da65bd4000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46278/0 (socket says 172.21.15.7:46278) 2024-09-21T06:45:51.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.669+0000 7fc00ffff640 1 -- 172.21.15.7:0/1464890071 learned_addr learned my addr 172.21.15.7:0/1464890071 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:51.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.669+0000 7fc00effd640 1 --2- 172.21.15.7:0/1464890071 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da65803390 0x55da65bd3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:51.671 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.669+0000 7fc00f7fe640 1 --2- 172.21.15.7:0/1464890071 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55da657fb1b0 0x55da65bcc9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:51.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.669+0000 7fc00ffff640 1 -- 172.21.15.7:0/1464890071 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da65803390 msgr2=0x55da65bd3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:51.672 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.669+0000 7fc00ffff640 1 --2- 172.21.15.7:0/1464890071 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da65803390 0x55da65bd3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:51.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.669+0000 7fc00ffff640 1 -- 172.21.15.7:0/1464890071 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55da657fb1b0 msgr2=0x55da65bcc9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:51.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.669+0000 7fc00ffff640 1 --2- 172.21.15.7:0/1464890071 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55da657fb1b0 0x55da65bcc9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:51.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.669+0000 7fc00ffff640 1 -- 172.21.15.7:0/1464890071 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da65bd5830 con 0x55da65824070 2024-09-21T06:45:51.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.669+0000 7fc00ffff640 1 --2- 172.21.15.7:0/1464890071 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da65824070 0x55da65bd4000 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7fc0080053e0 tx=0x7fc00800ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d608147600f6224 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:51.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.669+0000 7fc0057fa640 1 -- 172.21.15.7:0/1464890071 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc008027040 con 0x55da65824070 2024-09-21T06:45:51.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.669+0000 7fc0057fa640 1 -- 172.21.15.7:0/1464890071 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc00802cbc0 con 0x55da65824070 2024-09-21T06:45:51.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.669+0000 7fc0057fa640 1 -- 172.21.15.7:0/1464890071 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc008023480 con 0x55da65824070 2024-09-21T06:45:51.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.670+0000 7fc01c1a9740 1 -- 172.21.15.7:0/1464890071 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da65824070 msgr2=0x55da65bd4000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:51.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.670+0000 7fc01c1a9740 1 --2- 172.21.15.7:0/1464890071 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da65824070 0x55da65bd4000 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7fc0080053e0 tx=0x7fc00800ed50 comp rx=0 tx=0).stop 2024-09-21T06:45:51.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.670+0000 7fc01c1a9740 1 -- 172.21.15.7:0/1464890071 shutdown_connections 2024-09-21T06:45:51.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.670+0000 7fc01c1a9740 1 --2- 172.21.15.7:0/1464890071 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da65824070 0x55da65bd4000 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:51.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.670+0000 7fc01c1a9740 1 --2- 172.21.15.7:0/1464890071 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da65803390 0x55da65bd3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:51.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.670+0000 7fc01c1a9740 1 --2- 172.21.15.7:0/1464890071 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55da657fb1b0 0x55da65bcc9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:51.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.670+0000 7fc01c1a9740 1 -- 172.21.15.7:0/1464890071 >> 172.21.15.7:0/1464890071 conn(0x55da65818460 msgr2=0x55da65bcc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:51.673 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.670+0000 7fc01c1a9740 1 -- 172.21.15.7:0/1464890071 shutdown_connections 2024-09-21T06:45:51.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.670+0000 7fc01c1a9740 1 -- 172.21.15.7:0/1464890071 wait complete. 2024-09-21T06:45:51.674 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.671+0000 7fc01c1a9740 1 -- start start 2024-09-21T06:45:51.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.671+0000 7fc01c1a9740 1 Processor -- start 2024-09-21T06:45:51.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.671+0000 7fc01c1a9740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55da657fb1b0 0x55da65be9d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:51.676 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.672+0000 7fc01c1a9740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da65803390 0x55da65bea2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:51.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.672+0000 7fc01c1a9740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da65824070 0x55da65bea800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:51.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.672+0000 7fc01c1a9740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fc0101adb40 con 0x55da65803390 2024-09-21T06:45:51.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.672+0000 7fc01c1a9740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc0101aefb0 con 0x55da657fb1b0 2024-09-21T06:45:51.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.672+0000 7fc01c1a9740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fc0101ae210 con 0x55da65824070 2024-09-21T06:45:51.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.672+0000 7fc01c1a9740 10 client.0 _ll_register_callbacks cb 0x7fc00000b810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:45:51.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.672+0000 7fc00effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da65803390 0x55da65bea2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:51.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.672+0000 7fc00effd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da65803390 0x55da65bea2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46292/0 (socket says 172.21.15.7:46292) 2024-09-21T06:45:51.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.672+0000 7fc00effd640 1 -- 172.21.15.7:0/1957461523 learned_addr learned my addr 172.21.15.7:0/1957461523 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:45:51.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.672+0000 7fc00f7fe640 1 --2- 172.21.15.7:0/1957461523 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55da657fb1b0 0x55da65be9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:51.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.672+0000 7fc00ffff640 1 --2- 172.21.15.7:0/1957461523 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da65824070 0x55da65bea800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:51.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.672+0000 7fc00effd640 1 -- 172.21.15.7:0/1957461523 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da65824070 msgr2=0x55da65bea800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:51.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.672+0000 7fc00effd640 1 --2- 172.21.15.7:0/1957461523 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da65824070 0x55da65bea800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:51.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.672+0000 7fc00effd640 1 -- 172.21.15.7:0/1957461523 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55da657fb1b0 msgr2=0x55da65be9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:45:51.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.672+0000 7fc00effd640 1 --2- 172.21.15.7:0/1957461523 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55da657fb1b0 0x55da65be9d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:51.677 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.672+0000 7fc00effd640 1 -- 172.21.15.7:0/1957461523 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da65c524c0 con 0x55da65803390 2024-09-21T06:45:51.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.672+0000 7fc00effd640 1 --2- 172.21.15.7:0/1957461523 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da65803390 0x55da65bea2a0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7fbff80ca040 tx=0x7fbff803b690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fabaed28216e422 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:45:51.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.672+0000 7fbfeeffd640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:45:51.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.672+0000 7fbfeeffd640 1 -- 172.21.15.7:0/1957461523 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff8049040 con 0x55da65803390 2024-09-21T06:45:51.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.673+0000 7fbfeeffd640 1 -- 172.21.15.7:0/1957461523 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8412+0+0 (secure 0 0 0) 0x7fbff80d21b0 con 0x55da65803390 2024-09-21T06:45:51.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.673+0000 7fc01c1a9740 1 -- 172.21.15.7:0/1957461523 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc00802cbc0 con 0x55da65803390 2024-09-21T06:45:51.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.673+0000 7fbfeeffd640 1 -- 172.21.15.7:0/1957461523 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fbff80c9040 con 0x55da65803390 2024-09-21T06:45:51.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.673+0000 7fc01c1a9740 10 client.17790 fetch_fsmap learned FSMap version 25 2024-09-21T06:45:51.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.673+0000 7fc01c1a9740 1 -- 172.21.15.7:0/1957461523 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55da65c53750 con 0x55da65803390 2024-09-21T06:45:51.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.673+0000 7fbfeeffd640 1 -- 172.21.15.7:0/1957461523 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc00802cbc0 con 0x55da65803390 2024-09-21T06:45:51.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.673+0000 7fbfeeffd640 1 -- 172.21.15.7:0/1957461523 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fbff803bc20 con 0x55da65803390 2024-09-21T06:45:51.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.673+0000 7fc01c1a9740 10 client.17790 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:45:51.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.673+0000 7fc01c1a9740 10 client.17790 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:45:51.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.673+0000 7fc01c1a9740 20 client.17790 populate_metadata read hostname 'smithi007' 2024-09-21T06:45:51.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.673+0000 7fc01c1a9740 1 --2- 172.21.15.7:0/1957461523 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55da657b7da0 0x55da65c55f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:45:51.678 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.673+0000 7fc01c1a9740 4 client.17790 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:45:51.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.673+0000 7fc01c1a9740 1 -- 172.21.15.7:0/1957461523 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55da65b3f850 con 0x55da657b7da0 2024-09-21T06:45:51.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.673+0000 7fc00f7fe640 1 --2- 172.21.15.7:0/1957461523 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55da657b7da0 0x55da65c55f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:45:51.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.674+0000 7fc00f7fe640 1 --2- 172.21.15.7:0/1957461523 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55da657b7da0 0x55da65c55f60 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fda8adc123b014c3 server_cookie=63a8fbe747c1b43e in_seq=0 out_seq=0 2024-09-21T06:45:51.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.674+0000 7fbfeeffd640 10 client.17790 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:45:51.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.674+0000 7fbfeeffd640 1 -- 172.21.15.7:0/1957461523 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+6250 (crc 0 0 0) 0x55da65b3f850 con 0x55da657b7da0 2024-09-21T06:45:51.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.674+0000 7fbfeeffd640 10 client.17790 handle_command_reply: tid=0 2024-09-21T06:45:51.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.674+0000 7fc01c1a9740 1 client.17790 shutdown 2024-09-21T06:45:51.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.674+0000 7fc01c1a9740 1 -- 172.21.15.7:0/1957461523 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da65803390 msgr2=0x55da65bea2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:51.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.674+0000 7fc01c1a9740 1 --2- 172.21.15.7:0/1957461523 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da65803390 0x55da65bea2a0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7fbff80ca040 tx=0x7fbff803b690 comp rx=0 tx=0).stop 2024-09-21T06:45:51.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.674+0000 7fc01c1a9740 1 -- 172.21.15.7:0/1957461523 shutdown_connections 2024-09-21T06:45:51.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.674+0000 7fc01c1a9740 1 --2- 172.21.15.7:0/1957461523 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55da657b7da0 0x55da65c55f60 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:51.679 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.675+0000 7fbfeeffd640 0 client.17790 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:45:51.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.674+0000 7fc01c1a9740 1 --2- 172.21.15.7:0/1957461523 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55da65824070 0x55da65bea800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:51.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.675+0000 7fc01c1a9740 1 --2- 172.21.15.7:0/1957461523 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55da65803390 0x55da65bea2a0 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:51.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.675+0000 7fc01c1a9740 1 --2- 172.21.15.7:0/1957461523 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55da657fb1b0 0x55da65be9d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:51.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.675+0000 7fc01c1a9740 1 -- 172.21.15.7:0/1957461523 >> 172.21.15.7:0/1957461523 conn(0x55da65818460 msgr2=0x55da65bcc160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:51.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.675+0000 7fc01c1a9740 1 -- 172.21.15.7:0/1957461523 shutdown_connections 2024-09-21T06:45:51.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.675+0000 7fc01c1a9740 1 -- 172.21.15.7:0/1957461523 wait complete. 2024-09-21T06:45:51.680 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.675+0000 7fc01c1a9740 20 client.17790 trim_cache size 0 max 16384 2024-09-21T06:45:51.680 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:45:51.680 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-21T06:45:51.680 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": { 2024-09-21T06:45:51.681 INFO:teuthology.orchestra.run.smithi007.stdout: "1995e484-9812-41e2-bf5b-4904415f8598": { 2024-09-21T06:45:51.681 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:51.681 INFO:teuthology.orchestra.run.smithi007.stdout: "tag": "1995e484-9812-41e2-bf5b-4904415f8598", 2024-09-21T06:45:51.681 INFO:teuthology.orchestra.run.smithi007.stdout: "options": "recursive,force" 2024-09-21T06:45:51.681 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:45:51.681 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:51.681 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_stats": { 2024-09-21T06:45:51.681 INFO:teuthology.orchestra.run.smithi007.stdout: "2f69ea29-0ec5-4945-9474-294a8c12e0f0": { 2024-09-21T06:45:51.681 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:45:39.384528+0000", 2024-09-21T06:45:51.681 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:51.681 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:51.681 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:51.681 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:51.681 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:51.681 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:51.682 INFO:teuthology.orchestra.run.smithi007.stdout: "2ef7127c-8e1a-4ec7-930c-fdda4f777a52": { 2024-09-21T06:45:51.682 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:45:29.079652+0000", 2024-09-21T06:45:51.682 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:51.682 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:51.682 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:51.682 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:51.682 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:51.682 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:51.682 INFO:teuthology.orchestra.run.smithi007.stdout: "fe20df33-20a9-4e2f-be35-9778411fd6cd": { 2024-09-21T06:45:51.682 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:45:18.561779+0000", 2024-09-21T06:45:51.682 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:51.682 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:51.682 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:51.682 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:51.682 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:51.683 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:51.683 INFO:teuthology.orchestra.run.smithi007.stdout: "d98b2d47-c2db-4811-8b3e-ec744a20d9d6": { 2024-09-21T06:45:51.683 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:44:03.790680+0000", 2024-09-21T06:45:51.683 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:51.683 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:51.683 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:51.683 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:51.683 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:51.683 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:51.683 INFO:teuthology.orchestra.run.smithi007.stdout: "310a0ec8-44bb-49ed-a534-3bc91cb1ee9d": { 2024-09-21T06:45:51.683 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:40:55.373968+0000", 2024-09-21T06:45:51.683 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:51.683 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:51.683 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:51.683 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:51.684 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:51.684 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:51.684 INFO:teuthology.orchestra.run.smithi007.stdout: "dd792920-08a1-482d-8961-5c6a6f131599": { 2024-09-21T06:45:51.684 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:43:53.390806+0000", 2024-09-21T06:45:51.684 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:51.684 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:51.684 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:51.684 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:51.684 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:51.684 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:51.684 INFO:teuthology.orchestra.run.smithi007.stdout: "13441782-2231-4713-8ebd-068a941de47f": { 2024-09-21T06:45:51.684 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:39:30.219006+0000", 2024-09-21T06:45:51.684 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:51.684 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:51.684 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:51.685 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:51.685 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:51.685 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:51.685 INFO:teuthology.orchestra.run.smithi007.stdout: "02016ff7-8cc2-467e-a465-f69400f702cb": { 2024-09-21T06:45:51.685 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:44:25.093423+0000", 2024-09-21T06:45:51.685 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:51.685 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:51.685 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:51.685 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:51.685 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:51.685 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:51.685 INFO:teuthology.orchestra.run.smithi007.stdout: "b0327167-8c41-4286-8afc-7f0780972fd7": { 2024-09-21T06:45:51.685 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:38:36.828657+0000", 2024-09-21T06:45:51.685 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:51.685 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:51.685 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:51.686 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:51.686 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:51.686 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:51.686 INFO:teuthology.orchestra.run.smithi007.stdout: "d7b6a90c-9ae1-4e02-93ad-335a7e9df1d7": { 2024-09-21T06:45:51.686 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:39:19.226139+0000", 2024-09-21T06:45:51.686 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:51.686 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:51.686 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:51.686 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:51.686 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:51.686 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:51.686 INFO:teuthology.orchestra.run.smithi007.stdout: "1995e484-9812-41e2-bf5b-4904415f8598": { 2024-09-21T06:45:51.686 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:45:50.009400+0000", 2024-09-21T06:45:51.686 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:51.686 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:51.687 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:51.687 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:51.687 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:51.687 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:51.687 INFO:teuthology.orchestra.run.smithi007.stdout: "3f7283b7-f175-4023-9191-177660b3a6be": { 2024-09-21T06:45:51.687 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:44:14.422552+0000", 2024-09-21T06:45:51.687 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:51.687 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:51.687 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:51.687 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:51.687 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:51.687 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:51.687 INFO:teuthology.orchestra.run.smithi007.stdout: "6231e9c1-14a2-40b5-be3c-76d87a0d733b": { 2024-09-21T06:45:51.687 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:37:02.484812+0000", 2024-09-21T06:45:51.687 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:51.687 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:51.688 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:51.688 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:51.688 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:51.688 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:51.688 INFO:teuthology.orchestra.run.smithi007.stdout: "a1ae5b3b-f158-44be-8ef4-d70e9ba879cc": { 2024-09-21T06:45:51.688 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:41:37.568453+0000", 2024-09-21T06:45:51.688 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:51.688 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:51.688 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:51.688 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:51.688 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:51.688 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:51.688 INFO:teuthology.orchestra.run.smithi007.stdout: "62fca477-b241-45f5-8185-bc78aeb8b19f": { 2024-09-21T06:45:51.688 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:40:12.744488+0000", 2024-09-21T06:45:51.688 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:51.688 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:51.689 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:51.689 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:51.689 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:51.689 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:51.689 INFO:teuthology.orchestra.run.smithi007.stdout: "5cbaaba2-6ab1-4f83-abd6-8c6eef4b5c42": { 2024-09-21T06:45:51.689 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:37:46.566272+0000", 2024-09-21T06:45:51.689 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:51.689 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:51.689 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:51.689 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:51.689 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:51.689 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:51.689 INFO:teuthology.orchestra.run.smithi007.stdout: "b466f071-ab32-427c-a0ed-73edea33145e": { 2024-09-21T06:45:51.689 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:43:01.151440+0000", 2024-09-21T06:45:51.689 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:51.689 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:51.689 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:51.690 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:51.690 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:51.690 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:51.690 INFO:teuthology.orchestra.run.smithi007.stdout: "ef9eaabd-003a-44fb-8373-c854a9e15a71": { 2024-09-21T06:45:51.690 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:42:19.467946+0000", 2024-09-21T06:45:51.690 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:51.690 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:51.690 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:51.690 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:51.690 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:51.690 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:51.690 INFO:teuthology.orchestra.run.smithi007.stdout: "a53a88e2-8599-4b25-a72c-3377770d50ea": { 2024-09-21T06:45:51.690 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:45:07.921907+0000", 2024-09-21T06:45:51.690 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:51.690 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:51.691 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:51.691 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:51.691 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:51.691 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:51.691 INFO:teuthology.orchestra.run.smithi007.stdout: "0b89345c-1f00-4efe-8ee9-4cb17e43584c": { 2024-09-21T06:45:51.691 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:36:19.500334+0000", 2024-09-21T06:45:51.691 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:51.691 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:51.691 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:51.691 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:51.691 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:51.691 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:45:51.691 INFO:teuthology.orchestra.run.smithi007.stdout: "3c5b7f3f-e9b3-4d48-8154-2d7d4700992e": { 2024-09-21T06:45:51.691 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:43:43.120930+0000", 2024-09-21T06:45:51.691 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:45:51.692 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:45:51.692 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:45:51.692 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:45:51.692 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:45:51.692 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:45:51.692 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:45:51.692 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:45:51.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.675+0000 7fc015c35640 1 -- 172.21.15.7:0/244041768 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fbffc0b66b0 msgr2=0x7fbffc0b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:51.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.675+0000 7fc015c35640 1 --2- 172.21.15.7:0/244041768 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fbffc0b66b0 0x7fbffc0b8bc0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x55da65bc9ef0 tx=0x7fc00000b410 comp rx=0 tx=0).stop 2024-09-21T06:45:51.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.675+0000 7fc015c35640 1 -- 172.21.15.7:0/244041768 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0101083d0 msgr2=0x7fc01019aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:45:51.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.675+0000 7fc015c35640 1 --2- 172.21.15.7:0/244041768 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0101083d0 0x7fc01019aa70 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7fbff8032fd0 tx=0x7fbff8004270 comp rx=0 tx=0).stop 2024-09-21T06:45:51.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.675+0000 7fc015c35640 1 -- 172.21.15.7:0/244041768 shutdown_connections 2024-09-21T06:45:51.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.675+0000 7fc015c35640 1 --2- 172.21.15.7:0/244041768 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fbffc0b66b0 0x7fbffc0b8bc0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:51.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.675+0000 7fc015c35640 1 --2- 172.21.15.7:0/244041768 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fc010108d20 0x7fc01019fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:51.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.675+0000 7fc015c35640 1 --2- 172.21.15.7:0/244041768 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fc0101083d0 0x7fc01019aa70 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:51.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.675+0000 7fc015c35640 1 --2- 172.21.15.7:0/244041768 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc010102ae0 0x7fc01019a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:45:51.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.675+0000 7fc015c35640 1 -- 172.21.15.7:0/244041768 >> 172.21.15.7:0/244041768 conn(0x7fc010079760 msgr2=0x7fc010101b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:45:51.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.675+0000 7fc015c35640 1 -- 172.21.15.7:0/244041768 shutdown_connections 2024-09-21T06:45:51.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:45:51.675+0000 7fc015c35640 1 -- 172.21.15.7:0/244041768 wait complete. 2024-09-21T06:45:52.475 INFO:tasks.cephfs.filesystem:scrub status for tag:1995e484-9812-41e2-bf5b-4904415f8598 - {'path': '/', 'tag': '1995e484-9812-41e2-bf5b-4904415f8598', 'options': 'recursive,force'} 2024-09-21T06:45:53.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:45:52 smithi144 ceph-mon[34653]: pgmap v615: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 7 op/s 2024-09-21T06:45:53.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:45:52 smithi007 ceph-mon[30983]: pgmap v615: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 7 op/s 2024-09-21T06:45:53.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:45:52 smithi018 ceph-mon[34477]: pgmap v615: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 7 op/s 2024-09-21T06:45:55.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:45:54 smithi144 ceph-mon[34653]: pgmap v616: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 8 op/s 2024-09-21T06:45:55.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:45:54 smithi144 ceph-mon[34653]: scrub summary: idle 2024-09-21T06:45:55.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:45:54 smithi007 ceph-mon[30983]: pgmap v616: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 8 op/s 2024-09-21T06:45:55.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:45:54 smithi007 ceph-mon[30983]: scrub summary: idle 2024-09-21T06:45:55.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:45:54 smithi018 ceph-mon[34477]: pgmap v616: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 8 op/s 2024-09-21T06:45:55.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:45:54 smithi018 ceph-mon[34477]: scrub summary: idle 2024-09-21T06:45:57.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:45:56 smithi144 ceph-mon[34653]: pgmap v617: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-09-21T06:45:57.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:45:56 smithi007 ceph-mon[30983]: pgmap v617: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-09-21T06:45:57.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:45:56 smithi018 ceph-mon[34477]: pgmap v617: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 5 op/s 2024-09-21T06:45:59.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:45:58 smithi144 ceph-mon[34653]: pgmap v618: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6 op/s 2024-09-21T06:45:59.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:45:58 smithi007 ceph-mon[30983]: pgmap v618: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6 op/s 2024-09-21T06:45:59.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:45:58 smithi018 ceph-mon[34477]: pgmap v618: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 6 op/s 2024-09-21T06:46:01.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:46:00 smithi144 ceph-mon[34653]: pgmap v619: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:46:01.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:46:00 smithi007 ceph-mon[30983]: pgmap v619: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:46:01.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:46:00 smithi018 ceph-mon[34477]: pgmap v619: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 7 op/s 2024-09-21T06:46:03.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:46:02 smithi144 ceph-mon[34653]: pgmap v620: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 511 B/s wr, 7 op/s 2024-09-21T06:46:03.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:46:02 smithi007 ceph-mon[30983]: pgmap v620: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 511 B/s wr, 7 op/s 2024-09-21T06:46:03.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:46:02 smithi018 ceph-mon[34477]: pgmap v620: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 511 B/s wr, 7 op/s 2024-09-21T06:46:05.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:46:04 smithi144 ceph-mon[34653]: pgmap v621: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-21T06:46:05.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:46:04 smithi007 ceph-mon[30983]: pgmap v621: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-21T06:46:05.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:46:04 smithi018 ceph-mon[34477]: pgmap v621: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-21T06:46:07.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:46:06 smithi144 ceph-mon[34653]: pgmap v622: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-21T06:46:07.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:46:06 smithi007 ceph-mon[30983]: pgmap v622: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-21T06:46:07.368 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:46:06 smithi018 ceph-mon[34477]: pgmap v622: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-21T06:46:09.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:46:09 smithi144 ceph-mon[34653]: pgmap v623: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-21T06:46:09.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:46:08 smithi007 ceph-mon[30983]: pgmap v623: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-21T06:46:09.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:46:09 smithi018 ceph-mon[34477]: pgmap v623: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-21T06:46:11.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:46:11 smithi144 ceph-mon[34653]: pgmap v624: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-21T06:46:11.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:46:11 smithi144 ceph-mon[34653]: osdmap e84: 12 total, 12 up, 12 in 2024-09-21T06:46:11.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:46:11 smithi007 ceph-mon[30983]: pgmap v624: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-21T06:46:11.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:46:11 smithi007 ceph-mon[30983]: osdmap e84: 12 total, 12 up, 12 in 2024-09-21T06:46:11.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:46:11 smithi018 ceph-mon[34477]: pgmap v624: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 23 op/s 2024-09-21T06:46:11.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:46:11 smithi018 ceph-mon[34477]: osdmap e84: 12 total, 12 up, 12 in 2024-09-21T06:46:13.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:46:13 smithi144 ceph-mon[34653]: pgmap v626: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-21T06:46:13.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:46:13 smithi007 ceph-mon[30983]: pgmap v626: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-21T06:46:13.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:46:13 smithi018 ceph-mon[34477]: pgmap v626: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-21T06:46:15.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:46:15 smithi144 ceph-mon[34653]: pgmap v627: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-21T06:46:15.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:46:15 smithi007 ceph-mon[30983]: pgmap v627: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-21T06:46:15.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:46:15 smithi018 ceph-mon[34477]: pgmap v627: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-21T06:46:17.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:46:17 smithi144 ceph-mon[34653]: pgmap v628: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-21T06:46:17.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:46:17 smithi007 ceph-mon[30983]: pgmap v628: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-21T06:46:17.368 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:46:17 smithi018 ceph-mon[34477]: pgmap v628: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-21T06:46:19.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:46:19 smithi144 ceph-mon[34653]: pgmap v629: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-21T06:46:19.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:46:19 smithi007 ceph-mon[30983]: pgmap v629: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-21T06:46:19.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:46:19 smithi018 ceph-mon[34477]: pgmap v629: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-21T06:46:20.558 DEBUG:teuthology.orchestra.run.smithi007:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-21T06:46:20.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:20.686+0000 7ff542439640 1 -- 172.21.15.7:0/102438370 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff53c108400 msgr2=0x7ff53c10ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:20.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:20.686+0000 7ff542439640 1 --2- 172.21.15.7:0/102438370 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff53c108400 0x7ff53c10ec30 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7ff534009ca0 tx=0x7ff53402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:46:20.688 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:20.686+0000 7ff542439640 1 -- 172.21.15.7:0/102438370 shutdown_connections 2024-09-21T06:46:20.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:20.686+0000 7ff542439640 1 --2- 172.21.15.7:0/102438370 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff53c108400 0x7ff53c10ec30 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:20.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:20.686+0000 7ff542439640 1 --2- 172.21.15.7:0/102438370 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff53c107ab0 0x7ff53c107ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:20.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:20.686+0000 7ff542439640 1 --2- 172.21.15.7:0/102438370 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff53c102180 0x7ff53c102590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:20.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:20.686+0000 7ff542439640 1 -- 172.21.15.7:0/102438370 >> 172.21.15.7:0/102438370 conn(0x7ff53c079e50 msgr2=0x7ff53c07a260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:20.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:20.686+0000 7ff542439640 1 -- 172.21.15.7:0/102438370 shutdown_connections 2024-09-21T06:46:20.689 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:20.686+0000 7ff542439640 1 -- 172.21.15.7:0/102438370 wait complete. 2024-09-21T06:46:20.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:20.687+0000 7ff542439640 1 Processor -- start 2024-09-21T06:46:20.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:20.687+0000 7ff542439640 1 -- start start 2024-09-21T06:46:20.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:20.688+0000 7ff542439640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff53c102180 0x7ff53c199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:20.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:20.688+0000 7ff542439640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff53c107ab0 0x7ff53c1998c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:20.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:20.688+0000 7ff542439640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff53c108400 0x7ff53c19eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:20.691 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:20.688+0000 7ff542439640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7ff53c112940 con 0x7ff53c107ab0 2024-09-21T06:46:20.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:20.688+0000 7ff542439640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff53c1127c0 con 0x7ff53c108400 2024-09-21T06:46:20.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:20.688+0000 7ff542439640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7ff53c112ac0 con 0x7ff53c102180 2024-09-21T06:46:20.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:20.688+0000 7ff53b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff53c107ab0 0x7ff53c1998c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:20.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:20.688+0000 7ff53b7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff53c107ab0 0x7ff53c1998c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38154/0 (socket says 172.21.15.7:38154) 2024-09-21T06:46:20.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:20.688+0000 7ff53b7fe640 1 -- 172.21.15.7:0/648900980 learned_addr learned my addr 172.21.15.7:0/648900980 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:46:20.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:20.688+0000 7ff53bfff640 1 --2- 172.21.15.7:0/648900980 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff53c102180 0x7ff53c199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:20.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:20.688+0000 7ff5409d6640 1 --2- 172.21.15.7:0/648900980 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff53c108400 0x7ff53c19eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:20.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:20.688+0000 7ff53b7fe640 1 -- 172.21.15.7:0/648900980 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff53c102180 msgr2=0x7ff53c199320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:20.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:20.688+0000 7ff53b7fe640 1 --2- 172.21.15.7:0/648900980 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff53c102180 0x7ff53c199320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:20.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:20.688+0000 7ff53b7fe640 1 -- 172.21.15.7:0/648900980 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff53c108400 msgr2=0x7ff53c19eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:20.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:20.688+0000 7ff53b7fe640 1 --2- 172.21.15.7:0/648900980 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff53c108400 0x7ff53c19eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:20.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:20.688+0000 7ff53b7fe640 1 -- 172.21.15.7:0/648900980 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff53c19f250 con 0x7ff53c107ab0 2024-09-21T06:46:20.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:20.688+0000 7ff53b7fe640 1 --2- 172.21.15.7:0/648900980 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff53c107ab0 0x7ff53c1998c0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7ff53000d740 tx=0x7ff53000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:20.692 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:20.688+0000 7ff5397fa640 1 -- 172.21.15.7:0/648900980 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff530017070 con 0x7ff53c107ab0 2024-09-21T06:46:20.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:20.688+0000 7ff5397fa640 1 -- 172.21.15.7:0/648900980 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff53000de50 con 0x7ff53c107ab0 2024-09-21T06:46:20.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:20.688+0000 7ff542439640 1 -- 172.21.15.7:0/648900980 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff53c19f540 con 0x7ff53c107ab0 2024-09-21T06:46:20.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:20.689+0000 7ff5397fa640 1 -- 172.21.15.7:0/648900980 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff53000f620 con 0x7ff53c107ab0 2024-09-21T06:46:20.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:20.689+0000 7ff542439640 1 -- 172.21.15.7:0/648900980 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff53c1a5cd0 con 0x7ff53c107ab0 2024-09-21T06:46:20.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:20.690+0000 7ff542439640 1 -- 172.21.15.7:0/648900980 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff53c102590 con 0x7ff53c107ab0 2024-09-21T06:46:20.693 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:20.691+0000 7ff5397fa640 1 -- 172.21.15.7:0/648900980 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7ff53001a070 con 0x7ff53c107ab0 2024-09-21T06:46:20.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:20.692+0000 7ff5397fa640 1 --2- 172.21.15.7:0/648900980 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7ff5240b6700 0x7ff5240b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:20.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:20.692+0000 7ff5397fa640 1 -- 172.21.15.7:0/648900980 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8456+0+0 (secure 0 0 0) 0x7ff5300e6fc0 con 0x7ff53c107ab0 2024-09-21T06:46:20.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:20.692+0000 7ff53bfff640 1 --2- 172.21.15.7:0/648900980 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7ff5240b6700 0x7ff5240b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:20.694 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:20.693+0000 7ff53bfff640 1 --2- 172.21.15.7:0/648900980 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7ff5240b6700 0x7ff5240b8c10 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7ff52c005fd0 tx=0x7ff52c00b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:20.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:20.695+0000 7ff5397fa640 1 -- 172.21.15.7:0/648900980 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff5300b19b0 con 0x7ff53c107ab0 2024-09-21T06:46:20.907 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:20.906+0000 7ff542439640 1 -- 172.21.15.7:0/648900980 --> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7ff53c063800 con 0x7ff5240b6700 2024-09-21T06:46:20.915 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:20.914+0000 7ff5397fa640 1 -- 172.21.15.7:0/648900980 <== mgr.14223 v2:172.21.15.7:6800/3442812985 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+350 (secure 0 0 0) 0x7ff53c063800 con 0x7ff5240b6700 2024-09-21T06:46:20.916 INFO:teuthology.orchestra.run.smithi007.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-21T00:00:00", "created": "2024-09-21T06:36:19", "first": "2024-09-21T06:37:00", "last": "2024-09-21T06:46:00", "last_pruned": "2024-09-21T06:46:00", "created_count": 10, "pruned_count": 4, "active": true} 2024-09-21T06:46:20.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:20.916+0000 7ff542439640 1 -- 172.21.15.7:0/648900980 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7ff5240b6700 msgr2=0x7ff5240b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:20.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:20.916+0000 7ff542439640 1 --2- 172.21.15.7:0/648900980 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7ff5240b6700 0x7ff5240b8c10 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7ff52c005fd0 tx=0x7ff52c00b390 comp rx=0 tx=0).stop 2024-09-21T06:46:20.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:20.916+0000 7ff542439640 1 -- 172.21.15.7:0/648900980 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff53c107ab0 msgr2=0x7ff53c1998c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:20.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:20.916+0000 7ff542439640 1 --2- 172.21.15.7:0/648900980 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff53c107ab0 0x7ff53c1998c0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7ff53000d740 tx=0x7ff53000dc00 comp rx=0 tx=0).stop 2024-09-21T06:46:20.918 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:20.916+0000 7ff542439640 1 -- 172.21.15.7:0/648900980 shutdown_connections 2024-09-21T06:46:20.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:20.916+0000 7ff542439640 1 --2- 172.21.15.7:0/648900980 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7ff5240b6700 0x7ff5240b8c10 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:20.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:20.916+0000 7ff542439640 1 --2- 172.21.15.7:0/648900980 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff53c108400 0x7ff53c19eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:20.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:20.916+0000 7ff542439640 1 --2- 172.21.15.7:0/648900980 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7ff53c107ab0 0x7ff53c1998c0 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:20.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:20.916+0000 7ff542439640 1 --2- 172.21.15.7:0/648900980 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7ff53c102180 0x7ff53c199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:20.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:20.916+0000 7ff542439640 1 -- 172.21.15.7:0/648900980 >> 172.21.15.7:0/648900980 conn(0x7ff53c079e50 msgr2=0x7ff53c103a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:20.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:20.916+0000 7ff542439640 1 -- 172.21.15.7:0/648900980 shutdown_connections 2024-09-21T06:46:20.919 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:20.916+0000 7ff542439640 1 -- 172.21.15.7:0/648900980 wait complete. 2024-09-21T06:46:20.929 DEBUG:teuthology.orchestra.run.smithi007:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-21T06:46:21.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:21.045+0000 7f3c2c638640 1 -- 172.21.15.7:0/1533575897 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c241082e0 msgr2=0x7f3c241086f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:21.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:21.045+0000 7f3c2c638640 1 --2- 172.21.15.7:0/1533575897 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c241082e0 0x7f3c241086f0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f3c14009900 tx=0x7f3c1402a410 comp rx=0 tx=0).stop 2024-09-21T06:46:21.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:21.045+0000 7f3c2c638640 1 -- 172.21.15.7:0/1533575897 shutdown_connections 2024-09-21T06:46:21.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:21.045+0000 7f3c2c638640 1 --2- 172.21.15.7:0/1533575897 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c24108c30 0x7f3c2410f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:21.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:21.045+0000 7f3c2c638640 1 --2- 172.21.15.7:0/1533575897 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c241082e0 0x7f3c241086f0 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:21.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:21.045+0000 7f3c2c638640 1 --2- 172.21.15.7:0/1533575897 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3c241029b0 0x7f3c24102dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:21.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:21.045+0000 7f3c2c638640 1 -- 172.21.15.7:0/1533575897 >> 172.21.15.7:0/1533575897 conn(0x7f3c240fe390 msgr2=0x7f3c241007e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:21.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:21.045+0000 7f3c2c638640 1 -- 172.21.15.7:0/1533575897 shutdown_connections 2024-09-21T06:46:21.047 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:21.045+0000 7f3c2c638640 1 -- 172.21.15.7:0/1533575897 wait complete. 2024-09-21T06:46:21.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:21.045+0000 7f3c2c638640 1 Processor -- start 2024-09-21T06:46:21.049 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:21.045+0000 7f3c2c638640 1 -- start start 2024-09-21T06:46:21.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:21.046+0000 7f3c2c638640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c241029b0 0x7f3c2419b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:21.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:21.046+0000 7f3c2c638640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3c241082e0 0x7f3c2419b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:21.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:21.046+0000 7f3c2c638640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c24108c30 0x7f3c2419bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:21.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:21.046+0000 7f3c2c638640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f3c241128f0 con 0x7f3c241029b0 2024-09-21T06:46:21.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:21.046+0000 7f3c2c638640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3c24112770 con 0x7f3c241082e0 2024-09-21T06:46:21.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:21.046+0000 7f3c2c638640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3c24112a70 con 0x7f3c24108c30 2024-09-21T06:46:21.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:21.046+0000 7f3c2a3d4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c241029b0 0x7f3c2419b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:21.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:21.046+0000 7f3c2a3d4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c241029b0 0x7f3c2419b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38170/0 (socket says 172.21.15.7:38170) 2024-09-21T06:46:21.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:21.046+0000 7f3c2a3d4640 1 -- 172.21.15.7:0/4168362180 learned_addr learned my addr 172.21.15.7:0/4168362180 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:46:21.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:21.046+0000 7f3c29bd3640 1 --2- 172.21.15.7:0/4168362180 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3c241082e0 0x7f3c2419b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:21.050 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:21.046+0000 7f3c2abd5640 1 --2- 172.21.15.7:0/4168362180 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c24108c30 0x7f3c2419bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:21.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:21.046+0000 7f3c2a3d4640 1 -- 172.21.15.7:0/4168362180 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c24108c30 msgr2=0x7f3c2419bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:21.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:21.046+0000 7f3c2a3d4640 1 --2- 172.21.15.7:0/4168362180 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c24108c30 0x7f3c2419bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:21.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:21.046+0000 7f3c2a3d4640 1 -- 172.21.15.7:0/4168362180 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3c241082e0 msgr2=0x7f3c2419b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:21.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:21.046+0000 7f3c2a3d4640 1 --2- 172.21.15.7:0/4168362180 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3c241082e0 0x7f3c2419b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:21.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:21.046+0000 7f3c2a3d4640 1 -- 172.21.15.7:0/4168362180 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c241a64e0 con 0x7f3c241029b0 2024-09-21T06:46:21.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:21.046+0000 7f3c2abd5640 1 --2- 172.21.15.7:0/4168362180 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c24108c30 0x7f3c2419bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:46:21.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:21.046+0000 7f3c2a3d4640 1 --2- 172.21.15.7:0/4168362180 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c241029b0 0x7f3c2419b220 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f3c2000e9f0 tx=0x7f3c2000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:21.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:21.046+0000 7f3c1b7fe640 1 -- 172.21.15.7:0/4168362180 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c2000cd80 con 0x7f3c241029b0 2024-09-21T06:46:21.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:21.047+0000 7f3c1b7fe640 1 -- 172.21.15.7:0/4168362180 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3c200108e0 con 0x7f3c241029b0 2024-09-21T06:46:21.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:21.047+0000 7f3c1b7fe640 1 -- 172.21.15.7:0/4168362180 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c20018980 con 0x7f3c241029b0 2024-09-21T06:46:21.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:21.047+0000 7f3c2c638640 1 -- 172.21.15.7:0/4168362180 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c241a67d0 con 0x7f3c241029b0 2024-09-21T06:46:21.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:21.047+0000 7f3c2c638640 1 -- 172.21.15.7:0/4168362180 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c241a6ca0 con 0x7f3c241029b0 2024-09-21T06:46:21.051 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:21.048+0000 7f3c2c638640 1 -- 172.21.15.7:0/4168362180 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c24103c20 con 0x7f3c241029b0 2024-09-21T06:46:21.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:21.049+0000 7f3c1b7fe640 1 -- 172.21.15.7:0/4168362180 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f3c20010430 con 0x7f3c241029b0 2024-09-21T06:46:21.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:21.050+0000 7f3c1b7fe640 1 --2- 172.21.15.7:0/4168362180 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f3c100b6680 0x7f3c100b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:21.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:21.050+0000 7f3c29bd3640 1 --2- 172.21.15.7:0/4168362180 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f3c100b6680 0x7f3c100b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:21.052 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:21.050+0000 7f3c1b7fe640 1 -- 172.21.15.7:0/4168362180 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8456+0+0 (secure 0 0 0) 0x7f3c200e7fe0 con 0x7f3c241029b0 2024-09-21T06:46:21.053 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:21.051+0000 7f3c29bd3640 1 --2- 172.21.15.7:0/4168362180 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f3c100b6680 0x7f3c100b8b90 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f3c14009230 tx=0x7f3c14031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:21.055 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:21.053+0000 7f3c1b7fe640 1 -- 172.21.15.7:0/4168362180 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3c200ae530 con 0x7f3c241029b0 2024-09-21T06:46:21.266 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:21.264+0000 7f3c2c638640 1 -- 172.21.15.7:0/4168362180 --> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f3c241071c0 con 0x7f3c100b6680 2024-09-21T06:46:21.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:21.272+0000 7f3c1b7fe640 1 -- 172.21.15.7:0/4168362180 <== mgr.14223 v2:172.21.15.7:6800/3442812985 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f3c241071c0 con 0x7f3c100b6680 2024-09-21T06:46:21.273 INFO:teuthology.orchestra.run.smithi007.stdout:/ 1m 6m3h 2024-09-21T06:46:21.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:21.274+0000 7f3c2c638640 1 -- 172.21.15.7:0/4168362180 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f3c100b6680 msgr2=0x7f3c100b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:21.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:21.274+0000 7f3c2c638640 1 --2- 172.21.15.7:0/4168362180 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f3c100b6680 0x7f3c100b8b90 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f3c14009230 tx=0x7f3c14031400 comp rx=0 tx=0).stop 2024-09-21T06:46:21.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:21.274+0000 7f3c2c638640 1 -- 172.21.15.7:0/4168362180 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c241029b0 msgr2=0x7f3c2419b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:21.276 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:21.274+0000 7f3c2c638640 1 --2- 172.21.15.7:0/4168362180 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c241029b0 0x7f3c2419b220 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f3c2000e9f0 tx=0x7f3c2000eeb0 comp rx=0 tx=0).stop 2024-09-21T06:46:21.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:21.274+0000 7f3c2c638640 1 -- 172.21.15.7:0/4168362180 shutdown_connections 2024-09-21T06:46:21.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:21.274+0000 7f3c2c638640 1 --2- 172.21.15.7:0/4168362180 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f3c100b6680 0x7f3c100b8b90 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:21.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:21.274+0000 7f3c2c638640 1 --2- 172.21.15.7:0/4168362180 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3c24108c30 0x7f3c2419bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:21.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:21.274+0000 7f3c2c638640 1 --2- 172.21.15.7:0/4168362180 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3c241082e0 0x7f3c2419b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:21.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:21.274+0000 7f3c2c638640 1 --2- 172.21.15.7:0/4168362180 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3c241029b0 0x7f3c2419b220 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:21.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:21.274+0000 7f3c2c638640 1 -- 172.21.15.7:0/4168362180 >> 172.21.15.7:0/4168362180 conn(0x7f3c240fe390 msgr2=0x7f3c24106ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:21.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:21.274+0000 7f3c2c638640 1 -- 172.21.15.7:0/4168362180 shutdown_connections 2024-09-21T06:46:21.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:21.274+0000 7f3c2c638640 1 -- 172.21.15.7:0/4168362180 wait complete. 2024-09-21T06:46:21.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:46:21 smithi144 ceph-mon[34653]: pgmap v630: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-21T06:46:21.286 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:46:21 smithi007 ceph-mon[30983]: pgmap v630: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-21T06:46:21.287 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-09-21T06:46:21.297 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-09-21T06:46:21.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:46:21 smithi018 ceph-mon[34477]: pgmap v630: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-21T06:46:22.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:46:22 smithi144 ceph-mon[34653]: from='client.17796 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:46:22.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:46:22 smithi007 ceph-mon[30983]: from='client.17796 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:46:22.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:46:22 smithi018 ceph-mon[34477]: from='client.17796 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:46:22.476 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 scrub status 2024-09-21T06:46:22.747 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:46:23.124 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:46:23 smithi007 ceph-mon[30983]: from='client.17802 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:46:23.124 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:46:23 smithi007 ceph-mon[30983]: pgmap v631: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 180 B/s wr, 6 op/s 2024-09-21T06:46:23.124 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:46:23 smithi007 ceph-mon[30983]: osdmap e85: 12 total, 12 up, 12 in 2024-09-21T06:46:23.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:46:23 smithi144 ceph-mon[34653]: from='client.17802 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:46:23.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:46:23 smithi144 ceph-mon[34653]: pgmap v631: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 180 B/s wr, 6 op/s 2024-09-21T06:46:23.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:46:23 smithi144 ceph-mon[34653]: osdmap e85: 12 total, 12 up, 12 in 2024-09-21T06:46:23.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:46:23 smithi018 ceph-mon[34477]: from='client.17802 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T06:46:23.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:46:23 smithi018 ceph-mon[34477]: pgmap v631: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 180 B/s wr, 6 op/s 2024-09-21T06:46:23.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:46:23 smithi018 ceph-mon[34477]: osdmap e85: 12 total, 12 up, 12 in 2024-09-21T06:46:23.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.398+0000 7f86d443e640 1 -- 172.21.15.7:0/1578985927 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86cc10de60 msgr2=0x7f86cc110330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:23.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.398+0000 7f86d443e640 1 --2- 172.21.15.7:0/1578985927 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86cc10de60 0x7f86cc110330 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f86c4009ca0 tx=0x7f86c402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:46:23.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.398+0000 7f86d443e640 1 -- 172.21.15.7:0/1578985927 shutdown_connections 2024-09-21T06:46:23.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.398+0000 7f86d443e640 1 --2- 172.21.15.7:0/1578985927 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86cc10de60 0x7f86cc110330 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:23.406 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.398+0000 7f86d443e640 1 --2- 172.21.15.7:0/1578985927 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86cc105380 0x7f86cc10d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:23.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.398+0000 7f86d443e640 1 --2- 172.21.15.7:0/1578985927 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86cc104a30 0x7f86cc104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:23.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.398+0000 7f86d443e640 1 -- 172.21.15.7:0/1578985927 >> 172.21.15.7:0/1578985927 conn(0x7f86cc079760 msgr2=0x7f86cc079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:23.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.398+0000 7f86d443e640 1 -- 172.21.15.7:0/1578985927 shutdown_connections 2024-09-21T06:46:23.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.398+0000 7f86d443e640 1 -- 172.21.15.7:0/1578985927 wait complete. 2024-09-21T06:46:23.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.399+0000 7f86d443e640 1 Processor -- start 2024-09-21T06:46:23.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.399+0000 7f86d443e640 1 -- start start 2024-09-21T06:46:23.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.399+0000 7f86d443e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86cc104a30 0x7f86cc19a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:23.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.399+0000 7f86d443e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86cc105380 0x7f86cc19a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:23.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.399+0000 7f86d443e640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86cc10de60 0x7f86cc19fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:23.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.399+0000 7f86d443e640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f86cc113ac0 con 0x7f86cc105380 2024-09-21T06:46:23.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.399+0000 7f86d443e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f86cc113940 con 0x7f86cc104a30 2024-09-21T06:46:23.407 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.399+0000 7f86d443e640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f86cc113c40 con 0x7f86cc10de60 2024-09-21T06:46:23.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.399+0000 7f86d19d9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86cc105380 0x7f86cc19a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:23.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.399+0000 7f86d19d9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86cc105380 0x7f86cc19a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38190/0 (socket says 172.21.15.7:38190) 2024-09-21T06:46:23.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.399+0000 7f86d19d9640 1 -- 172.21.15.7:0/3390074136 learned_addr learned my addr 172.21.15.7:0/3390074136 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:46:23.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.399+0000 7f86d21da640 1 --2- 172.21.15.7:0/3390074136 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86cc104a30 0x7f86cc19a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:23.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.399+0000 7f86d29db640 1 --2- 172.21.15.7:0/3390074136 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86cc10de60 0x7f86cc19fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:23.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.399+0000 7f86d19d9640 1 -- 172.21.15.7:0/3390074136 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86cc10de60 msgr2=0x7f86cc19fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:23.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.399+0000 7f86d19d9640 1 --2- 172.21.15.7:0/3390074136 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86cc10de60 0x7f86cc19fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:23.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.399+0000 7f86d19d9640 1 -- 172.21.15.7:0/3390074136 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86cc104a30 msgr2=0x7f86cc19a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:23.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.399+0000 7f86d19d9640 1 --2- 172.21.15.7:0/3390074136 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86cc104a30 0x7f86cc19a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:23.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.399+0000 7f86d19d9640 1 -- 172.21.15.7:0/3390074136 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86cc1a03a0 con 0x7f86cc105380 2024-09-21T06:46:23.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.400+0000 7f86d19d9640 1 --2- 172.21.15.7:0/3390074136 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86cc105380 0x7f86cc19a9d0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f86c800d740 tx=0x7f86c800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:23.408 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.400+0000 7f86bf7fe640 1 -- 172.21.15.7:0/3390074136 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86c8017070 con 0x7f86cc105380 2024-09-21T06:46:23.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.400+0000 7f86d443e640 1 -- 172.21.15.7:0/3390074136 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86cc1a0690 con 0x7f86cc105380 2024-09-21T06:46:23.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.400+0000 7f86bf7fe640 1 -- 172.21.15.7:0/3390074136 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f86c800de50 con 0x7f86cc105380 2024-09-21T06:46:23.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.400+0000 7f86bf7fe640 1 -- 172.21.15.7:0/3390074136 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86c800f620 con 0x7f86cc105380 2024-09-21T06:46:23.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.400+0000 7f86d443e640 1 -- 172.21.15.7:0/3390074136 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86cc1a6df0 con 0x7f86cc105380 2024-09-21T06:46:23.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.403+0000 7f86da9b2740 1 Processor -- start 2024-09-21T06:46:23.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.403+0000 7f86bf7fe640 1 -- 172.21.15.7:0/3390074136 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f86c801a070 con 0x7f86cc105380 2024-09-21T06:46:23.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.403+0000 7f86da9b2740 1 -- start start 2024-09-21T06:46:23.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.403+0000 7f86da9b2740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a7301b2070 0x55a730559650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:23.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.403+0000 7f86da9b2740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a7301891b0 0x55a730559b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:23.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.403+0000 7f86da9b2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a730191390 0x55a73055a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:23.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.403+0000 7f86da9b2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55a7304cfe50 con 0x55a730191390 2024-09-21T06:46:23.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.403+0000 7f86da9b2740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a7304bf280 con 0x55a7301891b0 2024-09-21T06:46:23.409 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.403+0000 7f86da9b2740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55a7304c3090 con 0x55a7301b2070 2024-09-21T06:46:23.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.403+0000 7f86d19d9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a730191390 0x55a73055a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:23.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.403+0000 7f86d19d9640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a730191390 0x55a73055a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38204/0 (socket says 172.21.15.7:38204) 2024-09-21T06:46:23.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.403+0000 7f86d19d9640 1 -- 172.21.15.7:0/3240814533 learned_addr learned my addr 172.21.15.7:0/3240814533 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:46:23.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.403+0000 7f86d21da640 1 --2- 172.21.15.7:0/3240814533 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a7301891b0 0x55a730559b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:23.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.404+0000 7f86d29db640 1 --2- 172.21.15.7:0/3240814533 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a7301b2070 0x55a730559650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:23.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.404+0000 7f86d21da640 1 -- 172.21.15.7:0/3240814533 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a7301b2070 msgr2=0x55a730559650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:23.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.404+0000 7f86d21da640 1 --2- 172.21.15.7:0/3240814533 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a7301b2070 0x55a730559650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:23.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.404+0000 7f86d21da640 1 -- 172.21.15.7:0/3240814533 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a730191390 msgr2=0x55a73055a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:23.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.404+0000 7f86d21da640 1 --2- 172.21.15.7:0/3240814533 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a730191390 0x55a73055a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:23.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.404+0000 7f86d21da640 1 -- 172.21.15.7:0/3240814533 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a73021d650 con 0x55a7301891b0 2024-09-21T06:46:23.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.404+0000 7f86d19d9640 1 --2- 172.21.15.7:0/3240814533 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a730191390 0x55a73055a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:46:23.410 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.404+0000 7f86bf7fe640 1 --2- 172.21.15.7:0/3390074136 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f86b80b6680 0x7f86b80b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:23.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.404+0000 7f86d21da640 1 --2- 172.21.15.7:0/3240814533 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a7301891b0 0x55a730559b90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f86cc06c8f0 tx=0x7f86c00107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d022f1260b838cf8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:23.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.404+0000 7f86d29db640 1 --2- 172.21.15.7:0/3390074136 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f86b80b6680 0x7f86b80b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:23.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.404+0000 7f86bf7fe640 1 -- 172.21.15.7:0/3390074136 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8412+0+0 (secure 0 0 0) 0x7f86c80e7030 con 0x7f86cc105380 2024-09-21T06:46:23.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.404+0000 7f86bcd9a640 1 -- 172.21.15.7:0/3240814533 <== mon.2 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86c001c480 con 0x55a7301891b0 2024-09-21T06:46:23.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.404+0000 7f86bcd9a640 1 -- 172.21.15.7:0/3240814533 <== mon.2 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f86c00118f0 con 0x55a7301891b0 2024-09-21T06:46:23.411 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.404+0000 7f86bcd9a640 1 -- 172.21.15.7:0/3240814533 <== mon.2 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86c001a7c0 con 0x55a7301891b0 2024-09-21T06:46:23.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.405+0000 7f86da9b2740 1 -- 172.21.15.7:0/3240814533 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a7301891b0 msgr2=0x55a730559b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:23.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.405+0000 7f86d29db640 1 --2- 172.21.15.7:0/3390074136 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f86b80b6680 0x7f86b80b8b90 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f86c402f500 tx=0x7f86c402f370 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:23.414 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.405+0000 7f86da9b2740 1 --2- 172.21.15.7:0/3240814533 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a7301891b0 0x55a730559b90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f86cc06c8f0 tx=0x7f86c00107a0 comp rx=0 tx=0).stop 2024-09-21T06:46:23.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.405+0000 7f86da9b2740 1 -- 172.21.15.7:0/3240814533 shutdown_connections 2024-09-21T06:46:23.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.405+0000 7f86da9b2740 1 --2- 172.21.15.7:0/3240814533 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a730191390 0x55a73055a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:23.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.405+0000 7f86da9b2740 1 --2- 172.21.15.7:0/3240814533 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a7301891b0 0x55a730559b90 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:23.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.405+0000 7f86da9b2740 1 --2- 172.21.15.7:0/3240814533 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a7301b2070 0x55a730559650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:23.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.405+0000 7f86da9b2740 1 -- 172.21.15.7:0/3240814533 >> 172.21.15.7:0/3240814533 conn(0x55a7301a6460 msgr2=0x55a730557540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:23.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.405+0000 7f86da9b2740 1 -- 172.21.15.7:0/3240814533 shutdown_connections 2024-09-21T06:46:23.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.406+0000 7f86da9b2740 1 -- 172.21.15.7:0/3240814533 wait complete. 2024-09-21T06:46:23.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.406+0000 7f86da9b2740 1 -- start start 2024-09-21T06:46:23.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.406+0000 7f86da9b2740 1 Processor -- start 2024-09-21T06:46:23.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.406+0000 7f86da9b2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7301891b0 0x55a730564cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:23.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.406+0000 7f86da9b2740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a730191390 0x55a730565200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:23.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.406+0000 7f86da9b2740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a7301b2070 0x55a730571150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:23.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.406+0000 7f86da9b2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55a730320700 con 0x55a7301891b0 2024-09-21T06:46:23.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.406+0000 7f86da9b2740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a73045a110 con 0x55a730191390 2024-09-21T06:46:23.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.406+0000 7f86da9b2740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55a730567e30 con 0x55a7301b2070 2024-09-21T06:46:23.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.407+0000 7f86da9b2740 10 client.0 _ll_register_callbacks cb 0x55a730473990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:46:23.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.407+0000 7f86d21da640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7301891b0 0x55a730564cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:23.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.407+0000 7f86d21da640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7301891b0 0x55a730564cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38212/0 (socket says 172.21.15.7:38212) 2024-09-21T06:46:23.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.407+0000 7f86d21da640 1 -- 172.21.15.7:0/102502218 learned_addr learned my addr 172.21.15.7:0/102502218 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:46:23.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.407+0000 7f86d29db640 1 --2- 172.21.15.7:0/102502218 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a7301b2070 0x55a730571150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:23.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.407+0000 7f86d19d9640 1 --2- 172.21.15.7:0/102502218 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a730191390 0x55a730565200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:23.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.407+0000 7f86d21da640 1 -- 172.21.15.7:0/102502218 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a7301b2070 msgr2=0x55a730571150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:23.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.407+0000 7f86d21da640 1 --2- 172.21.15.7:0/102502218 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a7301b2070 0x55a730571150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:23.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.407+0000 7f86d21da640 1 -- 172.21.15.7:0/102502218 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a730191390 msgr2=0x55a730565200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:23.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.407+0000 7f86d21da640 1 --2- 172.21.15.7:0/102502218 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a730191390 0x55a730565200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:23.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.407+0000 7f86d21da640 1 -- 172.21.15.7:0/102502218 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a730487c40 con 0x55a7301891b0 2024-09-21T06:46:23.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.407+0000 7f86d21da640 1 --2- 172.21.15.7:0/102502218 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7301891b0 0x55a730564cc0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f86c0011010 tx=0x7f86c0011670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e53fd1b66cc6bf8b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:23.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.407+0000 7f86b5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:46:23.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.407+0000 7f86b5ffb640 1 -- 172.21.15.7:0/102502218 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86c002b060 con 0x55a7301891b0 2024-09-21T06:46:23.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.407+0000 7f86b5ffb640 1 -- 172.21.15.7:0/102502218 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8412+0+0 (secure 0 0 0) 0x7f86c000bd80 con 0x55a7301891b0 2024-09-21T06:46:23.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.407+0000 7f86da9b2740 1 -- 172.21.15.7:0/102502218 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86c00118f0 con 0x55a7301891b0 2024-09-21T06:46:23.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.408+0000 7f86b5ffb640 1 -- 172.21.15.7:0/102502218 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f86c0011cb0 con 0x55a7301891b0 2024-09-21T06:46:23.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.408+0000 7f86da9b2740 10 client.17814 fetch_fsmap learned FSMap version 25 2024-09-21T06:46:23.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.408+0000 7f86da9b2740 1 -- 172.21.15.7:0/102502218 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a730573b30 con 0x55a7301891b0 2024-09-21T06:46:23.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.408+0000 7f86b5ffb640 1 -- 172.21.15.7:0/102502218 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f86c00118f0 con 0x55a7301891b0 2024-09-21T06:46:23.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.408+0000 7f86b5ffb640 1 -- 172.21.15.7:0/102502218 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f86c002e020 con 0x55a7301891b0 2024-09-21T06:46:23.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.408+0000 7f86da9b2740 10 client.17814 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:46:23.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.408+0000 7f86da9b2740 10 client.17814 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:46:23.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.408+0000 7f86da9b2740 20 client.17814 populate_metadata read hostname 'smithi007' 2024-09-21T06:46:23.417 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.408+0000 7f86da9b2740 1 --2- 172.21.15.7:0/102502218 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55a7301709f0 0x55a730576f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:23.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.408+0000 7f86da9b2740 4 client.17814 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:46:23.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.408+0000 7f86da9b2740 1 -- 172.21.15.7:0/102502218 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a7304d1da0 con 0x55a7301709f0 2024-09-21T06:46:23.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.408+0000 7f86d19d9640 1 --2- 172.21.15.7:0/102502218 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55a7301709f0 0x55a730576f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:23.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.409+0000 7f86d19d9640 1 --2- 172.21.15.7:0/102502218 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55a7301709f0 0x55a730576f40 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6ed616f597e0827 server_cookie=72b6aa0621cff5a5 in_seq=0 out_seq=0 2024-09-21T06:46:23.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.409+0000 7f86b5ffb640 10 client.17814 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:46:23.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.410+0000 7f86b5ffb640 1 -- 172.21.15.7:0/102502218 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a7304d1da0 con 0x55a7301709f0 2024-09-21T06:46:23.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.410+0000 7f86b5ffb640 10 client.17814 handle_command_reply: tid=0 2024-09-21T06:46:23.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.410+0000 7f86da9b2740 1 client.17814 shutdown 2024-09-21T06:46:23.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.410+0000 7f86da9b2740 1 -- 172.21.15.7:0/102502218 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7301891b0 msgr2=0x55a730564cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:23.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.410+0000 7f86da9b2740 1 --2- 172.21.15.7:0/102502218 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7301891b0 0x55a730564cc0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f86c0011010 tx=0x7f86c0011670 comp rx=0 tx=0).stop 2024-09-21T06:46:23.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.410+0000 7f86da9b2740 1 -- 172.21.15.7:0/102502218 shutdown_connections 2024-09-21T06:46:23.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.410+0000 7f86da9b2740 1 --2- 172.21.15.7:0/102502218 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55a7301709f0 0x55a730576f40 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:23.418 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.410+0000 7f86da9b2740 1 --2- 172.21.15.7:0/102502218 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a7301b2070 0x55a730571150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:23.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.410+0000 7f86da9b2740 1 --2- 172.21.15.7:0/102502218 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a730191390 0x55a730565200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:23.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.410+0000 7f86da9b2740 1 --2- 172.21.15.7:0/102502218 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7301891b0 0x55a730564cc0 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:23.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.410+0000 7f86da9b2740 1 -- 172.21.15.7:0/102502218 >> 172.21.15.7:0/102502218 conn(0x55a7301a6460 msgr2=0x55a73055c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:23.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.410+0000 7f86b5ffb640 0 client.17814 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:46:23.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.410+0000 7f86da9b2740 1 -- 172.21.15.7:0/102502218 shutdown_connections 2024-09-21T06:46:23.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.410+0000 7f86da9b2740 1 -- 172.21.15.7:0/102502218 wait complete. 2024-09-21T06:46:23.419 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.410+0000 7f86da9b2740 20 client.17814 trim_cache size 0 max 16384 2024-09-21T06:46:23.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.428+0000 7f86da9b2740 1 Processor -- start 2024-09-21T06:46:23.430 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.428+0000 7f86da9b2740 1 -- start start 2024-09-21T06:46:23.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.428+0000 7f86da9b2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7301891b0 0x55a730563bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:23.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.428+0000 7f86da9b2740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a730191390 0x55a73055ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:23.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.428+0000 7f86da9b2740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a7301b2070 0x55a730556b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:23.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.428+0000 7f86da9b2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f86cc1b1e00 con 0x55a7301891b0 2024-09-21T06:46:23.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.428+0000 7f86da9b2740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f86cc1af6d0 con 0x55a730191390 2024-09-21T06:46:23.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.428+0000 7f86da9b2740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f86cc1ad540 con 0x55a7301b2070 2024-09-21T06:46:23.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.428+0000 7f86d21da640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7301891b0 0x55a730563bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:23.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.428+0000 7f86d21da640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7301891b0 0x55a730563bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38214/0 (socket says 172.21.15.7:38214) 2024-09-21T06:46:23.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.428+0000 7f86d21da640 1 -- 172.21.15.7:0/1936047379 learned_addr learned my addr 172.21.15.7:0/1936047379 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:46:23.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.428+0000 7f86d19d9640 1 --2- 172.21.15.7:0/1936047379 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a730191390 0x55a73055ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:23.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.428+0000 7f86d29db640 1 --2- 172.21.15.7:0/1936047379 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a7301b2070 0x55a730556b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:23.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.428+0000 7f86d21da640 1 -- 172.21.15.7:0/1936047379 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a7301b2070 msgr2=0x55a730556b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:23.431 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.428+0000 7f86d21da640 1 --2- 172.21.15.7:0/1936047379 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a7301b2070 0x55a730556b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:23.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.428+0000 7f86d21da640 1 -- 172.21.15.7:0/1936047379 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a730191390 msgr2=0x55a73055ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:23.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.428+0000 7f86d21da640 1 --2- 172.21.15.7:0/1936047379 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a730191390 0x55a73055ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:23.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.428+0000 7f86d21da640 1 -- 172.21.15.7:0/1936047379 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a730565f80 con 0x55a7301891b0 2024-09-21T06:46:23.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.429+0000 7f86d21da640 1 --2- 172.21.15.7:0/1936047379 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7301891b0 0x55a730563bb0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f86c000b3f0 tx=0x7f86c0005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=947ecb814ecc7bcc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:23.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.429+0000 7f86b7fff640 1 -- 172.21.15.7:0/1936047379 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86c002b030 con 0x55a7301891b0 2024-09-21T06:46:23.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.429+0000 7f86b7fff640 1 -- 172.21.15.7:0/1936047379 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f86c000b770 con 0x55a7301891b0 2024-09-21T06:46:23.432 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.429+0000 7f86b7fff640 1 -- 172.21.15.7:0/1936047379 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86c001aa80 con 0x55a7301891b0 2024-09-21T06:46:23.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.429+0000 7f86da9b2740 1 -- 172.21.15.7:0/1936047379 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7301891b0 msgr2=0x55a730563bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:23.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.429+0000 7f86da9b2740 1 --2- 172.21.15.7:0/1936047379 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7301891b0 0x55a730563bb0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f86c000b3f0 tx=0x7f86c0005850 comp rx=0 tx=0).stop 2024-09-21T06:46:23.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.430+0000 7f86da9b2740 1 -- 172.21.15.7:0/1936047379 shutdown_connections 2024-09-21T06:46:23.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.430+0000 7f86da9b2740 1 --2- 172.21.15.7:0/1936047379 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a7301b2070 0x55a730556b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:23.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.430+0000 7f86da9b2740 1 --2- 172.21.15.7:0/1936047379 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a730191390 0x55a73055ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:23.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.430+0000 7f86da9b2740 1 --2- 172.21.15.7:0/1936047379 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7301891b0 0x55a730563bb0 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:23.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.430+0000 7f86da9b2740 1 -- 172.21.15.7:0/1936047379 >> 172.21.15.7:0/1936047379 conn(0x55a7301a6460 msgr2=0x55a73055a680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:23.436 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.430+0000 7f86da9b2740 1 -- 172.21.15.7:0/1936047379 shutdown_connections 2024-09-21T06:46:23.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.430+0000 7f86da9b2740 1 -- 172.21.15.7:0/1936047379 wait complete. 2024-09-21T06:46:23.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.430+0000 7f86da9b2740 1 -- start start 2024-09-21T06:46:23.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.430+0000 7f86da9b2740 1 Processor -- start 2024-09-21T06:46:23.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.430+0000 7f86da9b2740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a7301891b0 0x55a730577790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:23.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.430+0000 7f86da9b2740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a730191390 0x55a730577d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:23.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.430+0000 7f86da9b2740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7301b2070 0x55a7305df6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:23.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.430+0000 7f86da9b2740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f86cc1adb90 con 0x55a7301b2070 2024-09-21T06:46:23.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.430+0000 7f86da9b2740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f86cc1af000 con 0x55a7301891b0 2024-09-21T06:46:23.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.430+0000 7f86da9b2740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f86cc1ae260 con 0x55a730191390 2024-09-21T06:46:23.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.430+0000 7f86da9b2740 10 client.0 _ll_register_callbacks cb 0x7f86c80eaa50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:46:23.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.430+0000 7f86d29db640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7301b2070 0x55a7305df6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:23.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.430+0000 7f86d29db640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7301b2070 0x55a7305df6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38216/0 (socket says 172.21.15.7:38216) 2024-09-21T06:46:23.437 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.430+0000 7f86d29db640 1 -- 172.21.15.7:0/885402231 learned_addr learned my addr 172.21.15.7:0/885402231 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:46:23.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.431+0000 7f86d19d9640 1 --2- 172.21.15.7:0/885402231 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a730191390 0x55a730577d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:23.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.431+0000 7f86d21da640 1 --2- 172.21.15.7:0/885402231 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a7301891b0 0x55a730577790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:23.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.431+0000 7f86d29db640 1 -- 172.21.15.7:0/885402231 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a730191390 msgr2=0x55a730577d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:23.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.431+0000 7f86d29db640 1 --2- 172.21.15.7:0/885402231 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a730191390 0x55a730577d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:23.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.431+0000 7f86d29db640 1 -- 172.21.15.7:0/885402231 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a7301891b0 msgr2=0x55a730577790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:23.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.431+0000 7f86d29db640 1 --2- 172.21.15.7:0/885402231 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a7301891b0 0x55a730577790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:23.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.431+0000 7f86d29db640 1 -- 172.21.15.7:0/885402231 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7305dfcf0 con 0x55a7301b2070 2024-09-21T06:46:23.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.431+0000 7f86d29db640 1 --2- 172.21.15.7:0/885402231 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7301b2070 0x55a7305df6b0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f86c4035000 tx=0x7f86c40095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6bf4b72d6eac2f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:23.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.431+0000 7f86b5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:46:23.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.431+0000 7f86b5ffb640 1 -- 172.21.15.7:0/885402231 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86c4003c70 con 0x55a7301b2070 2024-09-21T06:46:23.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.431+0000 7f86b5ffb640 1 -- 172.21.15.7:0/885402231 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8412+0+0 (secure 0 0 0) 0x7f86c4004030 con 0x55a7301b2070 2024-09-21T06:46:23.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.431+0000 7f86da9b2740 1 -- 172.21.15.7:0/885402231 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86c000b770 con 0x55a7301b2070 2024-09-21T06:46:23.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.431+0000 7f86b5ffb640 1 -- 172.21.15.7:0/885402231 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f86c4003e10 con 0x55a7301b2070 2024-09-21T06:46:23.438 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.431+0000 7f86da9b2740 10 client.17820 fetch_fsmap learned FSMap version 25 2024-09-21T06:46:23.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.431+0000 7f86da9b2740 1 -- 172.21.15.7:0/885402231 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55a7305e0fb0 con 0x55a7301b2070 2024-09-21T06:46:23.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.432+0000 7f86b5ffb640 1 -- 172.21.15.7:0/885402231 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f86c000b770 con 0x55a7301b2070 2024-09-21T06:46:23.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.432+0000 7f86b5ffb640 1 -- 172.21.15.7:0/885402231 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f86c402fd10 con 0x55a7301b2070 2024-09-21T06:46:23.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.432+0000 7f86da9b2740 10 client.17820 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:46:23.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.432+0000 7f86da9b2740 10 client.17820 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:46:23.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.432+0000 7f86da9b2740 20 client.17820 populate_metadata read hostname 'smithi007' 2024-09-21T06:46:23.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.432+0000 7f86da9b2740 1 --2- 172.21.15.7:0/885402231 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55a730145da0 0x55a7305e37d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:23.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.432+0000 7f86da9b2740 4 client.17820 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-21T06:46:23.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.432+0000 7f86da9b2740 1 -- 172.21.15.7:0/885402231 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a7304cd850 con 0x55a730145da0 2024-09-21T06:46:23.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.432+0000 7f86d21da640 1 --2- 172.21.15.7:0/885402231 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55a730145da0 0x55a7305e37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:23.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.433+0000 7f86d21da640 1 --2- 172.21.15.7:0/885402231 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55a730145da0 0x55a7305e37d0 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=adfff229c4e9fc2a server_cookie=89d4f2c64fcbd828 in_seq=0 out_seq=0 2024-09-21T06:46:23.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.433+0000 7f86b5ffb640 10 client.17820 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:46:23.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.433+0000 7f86b5ffb640 1 -- 172.21.15.7:0/885402231 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+6054 (crc 0 0 0) 0x55a7304cd850 con 0x55a730145da0 2024-09-21T06:46:23.439 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.433+0000 7f86b5ffb640 10 client.17820 handle_command_reply: tid=0 2024-09-21T06:46:23.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.433+0000 7f86da9b2740 1 client.17820 shutdown 2024-09-21T06:46:23.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.433+0000 7f86da9b2740 1 -- 172.21.15.7:0/885402231 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7301b2070 msgr2=0x55a7305df6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:23.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.433+0000 7f86da9b2740 1 --2- 172.21.15.7:0/885402231 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7301b2070 0x55a7305df6b0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f86c4035000 tx=0x7f86c40095c0 comp rx=0 tx=0).stop 2024-09-21T06:46:23.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.433+0000 7f86da9b2740 1 -- 172.21.15.7:0/885402231 shutdown_connections 2024-09-21T06:46:23.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.433+0000 7f86da9b2740 1 --2- 172.21.15.7:0/885402231 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55a730145da0 0x55a7305e37d0 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:23.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.433+0000 7f86da9b2740 1 --2- 172.21.15.7:0/885402231 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55a7301b2070 0x55a7305df6b0 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:23.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.433+0000 7f86da9b2740 1 --2- 172.21.15.7:0/885402231 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55a730191390 0x55a730577d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:23.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.433+0000 7f86da9b2740 1 --2- 172.21.15.7:0/885402231 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a7301891b0 0x55a730577790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:23.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.433+0000 7f86da9b2740 1 -- 172.21.15.7:0/885402231 >> 172.21.15.7:0/885402231 conn(0x55a7301a6460 msgr2=0x55a730566150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:23.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.433+0000 7f86b5ffb640 0 client.17820 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:46:23.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.433+0000 7f86da9b2740 1 -- 172.21.15.7:0/885402231 shutdown_connections 2024-09-21T06:46:23.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.433+0000 7f86da9b2740 1 -- 172.21.15.7:0/885402231 wait complete. 2024-09-21T06:46:23.440 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.433+0000 7f86da9b2740 20 client.17820 trim_cache size 0 max 16384 2024-09-21T06:46:23.441 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:46:23.441 INFO:teuthology.orchestra.run.smithi007.stdout: "status": "no active scrubs running", 2024-09-21T06:46:23.441 INFO:teuthology.orchestra.run.smithi007.stdout: "scrubs": {}, 2024-09-21T06:46:23.441 INFO:teuthology.orchestra.run.smithi007.stdout: "scrub_stats": { 2024-09-21T06:46:23.441 INFO:teuthology.orchestra.run.smithi007.stdout: "2f69ea29-0ec5-4945-9474-294a8c12e0f0": { 2024-09-21T06:46:23.441 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:45:39.384528+0000", 2024-09-21T06:46:23.441 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:46:23.441 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:46:23.441 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:46:23.441 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:46:23.442 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:46:23.442 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:23.442 INFO:teuthology.orchestra.run.smithi007.stdout: "2ef7127c-8e1a-4ec7-930c-fdda4f777a52": { 2024-09-21T06:46:23.442 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:45:29.079652+0000", 2024-09-21T06:46:23.442 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:46:23.442 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:46:23.442 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:46:23.442 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:46:23.442 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:46:23.442 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:23.442 INFO:teuthology.orchestra.run.smithi007.stdout: "fe20df33-20a9-4e2f-be35-9778411fd6cd": { 2024-09-21T06:46:23.442 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:45:18.561779+0000", 2024-09-21T06:46:23.442 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:46:23.443 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:46:23.443 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:46:23.443 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:46:23.443 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:46:23.443 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:23.443 INFO:teuthology.orchestra.run.smithi007.stdout: "d98b2d47-c2db-4811-8b3e-ec744a20d9d6": { 2024-09-21T06:46:23.443 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:44:03.790680+0000", 2024-09-21T06:46:23.443 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:46:23.443 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:46:23.443 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:46:23.443 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:46:23.443 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:46:23.443 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:23.443 INFO:teuthology.orchestra.run.smithi007.stdout: "310a0ec8-44bb-49ed-a534-3bc91cb1ee9d": { 2024-09-21T06:46:23.444 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:40:55.373968+0000", 2024-09-21T06:46:23.444 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:46:23.444 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:46:23.444 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:46:23.444 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:46:23.444 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:46:23.444 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:23.444 INFO:teuthology.orchestra.run.smithi007.stdout: "dd792920-08a1-482d-8961-5c6a6f131599": { 2024-09-21T06:46:23.444 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:43:53.390806+0000", 2024-09-21T06:46:23.444 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:46:23.444 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:46:23.444 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:46:23.444 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:46:23.444 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:46:23.445 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:23.445 INFO:teuthology.orchestra.run.smithi007.stdout: "13441782-2231-4713-8ebd-068a941de47f": { 2024-09-21T06:46:23.445 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:39:30.219006+0000", 2024-09-21T06:46:23.445 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:46:23.445 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:46:23.445 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:46:23.445 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:46:23.445 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:46:23.445 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:23.445 INFO:teuthology.orchestra.run.smithi007.stdout: "02016ff7-8cc2-467e-a465-f69400f702cb": { 2024-09-21T06:46:23.445 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:44:25.093423+0000", 2024-09-21T06:46:23.445 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:46:23.445 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:46:23.445 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:46:23.446 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:46:23.446 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:46:23.446 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:23.446 INFO:teuthology.orchestra.run.smithi007.stdout: "b0327167-8c41-4286-8afc-7f0780972fd7": { 2024-09-21T06:46:23.446 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:38:36.828657+0000", 2024-09-21T06:46:23.446 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:46:23.446 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:46:23.446 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:46:23.446 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:46:23.446 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:46:23.446 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:23.446 INFO:teuthology.orchestra.run.smithi007.stdout: "d7b6a90c-9ae1-4e02-93ad-335a7e9df1d7": { 2024-09-21T06:46:23.447 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:39:19.226139+0000", 2024-09-21T06:46:23.447 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:46:23.447 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:46:23.447 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:46:23.447 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:46:23.447 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:46:23.447 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:23.447 INFO:teuthology.orchestra.run.smithi007.stdout: "1995e484-9812-41e2-bf5b-4904415f8598": { 2024-09-21T06:46:23.447 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:45:50.009400+0000", 2024-09-21T06:46:23.447 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:46:23.447 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:46:23.447 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:46:23.447 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:46:23.447 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:46:23.448 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:23.448 INFO:teuthology.orchestra.run.smithi007.stdout: "3f7283b7-f175-4023-9191-177660b3a6be": { 2024-09-21T06:46:23.448 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:44:14.422552+0000", 2024-09-21T06:46:23.448 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:46:23.448 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:46:23.448 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:46:23.448 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:46:23.448 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:46:23.448 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:23.448 INFO:teuthology.orchestra.run.smithi007.stdout: "6231e9c1-14a2-40b5-be3c-76d87a0d733b": { 2024-09-21T06:46:23.448 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:37:02.484812+0000", 2024-09-21T06:46:23.448 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:46:23.448 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:46:23.449 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:46:23.449 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:46:23.449 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:46:23.449 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:23.449 INFO:teuthology.orchestra.run.smithi007.stdout: "a1ae5b3b-f158-44be-8ef4-d70e9ba879cc": { 2024-09-21T06:46:23.449 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:41:37.568453+0000", 2024-09-21T06:46:23.449 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:46:23.449 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:46:23.449 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:46:23.449 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:46:23.449 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:46:23.449 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:23.449 INFO:teuthology.orchestra.run.smithi007.stdout: "62fca477-b241-45f5-8185-bc78aeb8b19f": { 2024-09-21T06:46:23.449 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:40:12.744488+0000", 2024-09-21T06:46:23.449 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:46:23.450 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:46:23.450 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:46:23.450 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:46:23.450 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:46:23.450 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:23.450 INFO:teuthology.orchestra.run.smithi007.stdout: "5cbaaba2-6ab1-4f83-abd6-8c6eef4b5c42": { 2024-09-21T06:46:23.450 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:37:46.566272+0000", 2024-09-21T06:46:23.450 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:46:23.450 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:46:23.450 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:46:23.450 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:46:23.450 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:46:23.450 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:23.451 INFO:teuthology.orchestra.run.smithi007.stdout: "b466f071-ab32-427c-a0ed-73edea33145e": { 2024-09-21T06:46:23.451 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:43:01.151440+0000", 2024-09-21T06:46:23.451 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:46:23.451 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:46:23.451 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:46:23.451 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:46:23.451 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:46:23.451 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:23.451 INFO:teuthology.orchestra.run.smithi007.stdout: "ef9eaabd-003a-44fb-8373-c854a9e15a71": { 2024-09-21T06:46:23.451 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:42:19.467946+0000", 2024-09-21T06:46:23.451 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:46:23.451 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:46:23.451 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:46:23.452 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:46:23.452 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:46:23.452 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:23.452 INFO:teuthology.orchestra.run.smithi007.stdout: "a53a88e2-8599-4b25-a72c-3377770d50ea": { 2024-09-21T06:46:23.452 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:45:07.921907+0000", 2024-09-21T06:46:23.452 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:46:23.452 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:46:23.452 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:46:23.452 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:46:23.452 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:46:23.452 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:23.452 INFO:teuthology.orchestra.run.smithi007.stdout: "0b89345c-1f00-4efe-8ee9-4cb17e43584c": { 2024-09-21T06:46:23.453 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:36:19.500334+0000", 2024-09-21T06:46:23.453 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:46:23.453 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:46:23.453 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:46:23.453 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:46:23.453 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:46:23.453 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:23.453 INFO:teuthology.orchestra.run.smithi007.stdout: "3c5b7f3f-e9b3-4d48-8154-2d7d4700992e": { 2024-09-21T06:46:23.453 INFO:teuthology.orchestra.run.smithi007.stdout: "start_time": "2024-09-21T06:43:43.120930+0000", 2024-09-21T06:46:23.453 INFO:teuthology.orchestra.run.smithi007.stdout: "path": "/", 2024-09-21T06:46:23.453 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_started": 0, 2024-09-21T06:46:23.453 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_passed": 0, 2024-09-21T06:46:23.453 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_failed": 0, 2024-09-21T06:46:23.453 INFO:teuthology.orchestra.run.smithi007.stdout: "uninline_skipped": 0 2024-09-21T06:46:23.453 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:23.454 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:23.454 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:46:23.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.434+0000 7f86d443e640 1 -- 172.21.15.7:0/3390074136 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f86b80b6680 msgr2=0x7f86b80b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:23.454 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.434+0000 7f86d443e640 1 --2- 172.21.15.7:0/3390074136 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f86b80b6680 0x7f86b80b8b90 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f86c402f500 tx=0x7f86c402f370 comp rx=0 tx=0).stop 2024-09-21T06:46:23.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.434+0000 7f86d443e640 1 -- 172.21.15.7:0/3390074136 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86cc105380 msgr2=0x7f86cc19a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:23.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.434+0000 7f86d443e640 1 --2- 172.21.15.7:0/3390074136 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86cc105380 0x7f86cc19a9d0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f86c800d740 tx=0x7f86c800dc00 comp rx=0 tx=0).stop 2024-09-21T06:46:23.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.434+0000 7f86d443e640 1 -- 172.21.15.7:0/3390074136 shutdown_connections 2024-09-21T06:46:23.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.434+0000 7f86d443e640 1 --2- 172.21.15.7:0/3390074136 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f86b80b6680 0x7f86b80b8b90 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:23.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.434+0000 7f86d443e640 1 --2- 172.21.15.7:0/3390074136 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f86cc10de60 0x7f86cc19fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:23.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.434+0000 7f86d443e640 1 --2- 172.21.15.7:0/3390074136 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f86cc105380 0x7f86cc19a9d0 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:23.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.434+0000 7f86d443e640 1 --2- 172.21.15.7:0/3390074136 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f86cc104a30 0x7f86cc19a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:23.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.434+0000 7f86d443e640 1 -- 172.21.15.7:0/3390074136 >> 172.21.15.7:0/3390074136 conn(0x7f86cc079760 msgr2=0x7f86cc105850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:23.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.434+0000 7f86d443e640 1 -- 172.21.15.7:0/3390074136 shutdown_connections 2024-09-21T06:46:23.455 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:23.434+0000 7f86d443e640 1 -- 172.21.15.7:0/3390074136 wait complete. 2024-09-21T06:46:24.334 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-21T06:46:24.334 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:46:24.592 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:46:25.099 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:25.090+0000 7f58a4b75640 1 -- 172.21.15.7:0/3203267713 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f58a0102fa0 msgr2=0x7f58a010fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:25.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:25.090+0000 7f58a4b75640 1 --2- 172.21.15.7:0/3203267713 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f58a0102fa0 0x7f58a010fcc0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f5894009900 tx=0x7f589402a480 comp rx=0 tx=0).stop 2024-09-21T06:46:25.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:25.090+0000 7f58a4b75640 1 -- 172.21.15.7:0/3203267713 shutdown_connections 2024-09-21T06:46:25.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:25.090+0000 7f58a4b75640 1 --2- 172.21.15.7:0/3203267713 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f58a0110200 0x7f58a0112620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:25.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:25.090+0000 7f58a4b75640 1 --2- 172.21.15.7:0/3203267713 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f58a0102fa0 0x7f58a010fcc0 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:25.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:25.090+0000 7f58a4b75640 1 --2- 172.21.15.7:0/3203267713 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58a0102650 0x7f58a0102a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:25.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:25.090+0000 7f58a4b75640 1 -- 172.21.15.7:0/3203267713 >> 172.21.15.7:0/3203267713 conn(0x7f58a0079770 msgr2=0x7f58a0079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:25.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:25.090+0000 7f58a4b75640 1 -- 172.21.15.7:0/3203267713 shutdown_connections 2024-09-21T06:46:25.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:25.090+0000 7f58a4b75640 1 -- 172.21.15.7:0/3203267713 wait complete. 2024-09-21T06:46:25.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:25.091+0000 7f58a4b75640 1 Processor -- start 2024-09-21T06:46:25.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:25.091+0000 7f58a4b75640 1 -- start start 2024-09-21T06:46:25.100 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:25.091+0000 7f58a4b75640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f58a0102650 0x7f58a019c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:25.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:25.091+0000 7f58a4b75640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f58a0102fa0 0x7f58a019cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:25.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:25.091+0000 7f58a4b75640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58a0110200 0x7f58a01a1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:25.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:25.091+0000 7f58a4b75640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f58a0115cf0 con 0x7f58a0102650 2024-09-21T06:46:25.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:25.091+0000 7f58a4b75640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f58a0115b70 con 0x7f58a0110200 2024-09-21T06:46:25.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:25.091+0000 7f58a4b75640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f58a0115e70 con 0x7f58a0102fa0 2024-09-21T06:46:25.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:25.091+0000 7f589e59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f58a0102650 0x7f58a019c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:25.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:25.091+0000 7f589e59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f58a0102650 0x7f58a019c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38236/0 (socket says 172.21.15.7:38236) 2024-09-21T06:46:25.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:25.091+0000 7f589e59c640 1 -- 172.21.15.7:0/3918471104 learned_addr learned my addr 172.21.15.7:0/3918471104 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:46:25.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:25.091+0000 7f589ed9d640 1 --2- 172.21.15.7:0/3918471104 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58a0110200 0x7f58a01a1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:25.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:25.091+0000 7f589dd9b640 1 --2- 172.21.15.7:0/3918471104 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f58a0102fa0 0x7f58a019cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:25.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:25.092+0000 7f589e59c640 1 -- 172.21.15.7:0/3918471104 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f58a0102fa0 msgr2=0x7f58a019cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:25.101 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:25.092+0000 7f589e59c640 1 --2- 172.21.15.7:0/3918471104 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f58a0102fa0 0x7f58a019cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:25.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:25.092+0000 7f589e59c640 1 -- 172.21.15.7:0/3918471104 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58a0110200 msgr2=0x7f58a01a1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:25.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:25.092+0000 7f589e59c640 1 --2- 172.21.15.7:0/3918471104 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58a0110200 0x7f58a01a1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:25.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:25.092+0000 7f589e59c640 1 -- 172.21.15.7:0/3918471104 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58a01a2570 con 0x7f58a0102650 2024-09-21T06:46:25.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:25.092+0000 7f589dd9b640 1 --2- 172.21.15.7:0/3918471104 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f58a0102fa0 0x7f58a019cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:46:25.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:25.092+0000 7f589e59c640 1 --2- 172.21.15.7:0/3918471104 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f58a0102650 0x7f58a019c6c0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f589000d950 tx=0x7f589000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:25.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:25.092+0000 7f588f7fe640 1 -- 172.21.15.7:0/3918471104 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5890017070 con 0x7f58a0102650 2024-09-21T06:46:25.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:25.092+0000 7f588f7fe640 1 -- 172.21.15.7:0/3918471104 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5890009c30 con 0x7f58a0102650 2024-09-21T06:46:25.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:25.092+0000 7f58a4b75640 1 -- 172.21.15.7:0/3918471104 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58a01a2860 con 0x7f58a0102650 2024-09-21T06:46:25.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:25.092+0000 7f588f7fe640 1 -- 172.21.15.7:0/3918471104 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f589000f620 con 0x7f58a0102650 2024-09-21T06:46:25.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:25.092+0000 7f58a4b75640 1 -- 172.21.15.7:0/3918471104 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58a01a9080 con 0x7f58a0102650 2024-09-21T06:46:25.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:25.093+0000 7f58a4b75640 1 -- 172.21.15.7:0/3918471104 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58a006c260 con 0x7f58a0102650 2024-09-21T06:46:25.102 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:25.096+0000 7f588f7fe640 1 -- 172.21.15.7:0/3918471104 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f5890010460 con 0x7f58a0102650 2024-09-21T06:46:25.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:25.096+0000 7f588f7fe640 1 --2- 172.21.15.7:0/3918471104 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f58880b66b0 0x7f58880b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:25.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:25.097+0000 7f589dd9b640 1 --2- 172.21.15.7:0/3918471104 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f58880b66b0 0x7f58880b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:25.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:25.097+0000 7f588f7fe640 1 -- 172.21.15.7:0/3918471104 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8412+0+0 (secure 0 0 0) 0x7f58900e7280 con 0x7f58a0102650 2024-09-21T06:46:25.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:25.097+0000 7f589dd9b640 1 --2- 172.21.15.7:0/3918471104 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f58880b66b0 0x7f58880b8bc0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f5894031440 tx=0x7f5894009680 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:25.103 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:25.100+0000 7f588f7fe640 1 -- 172.21.15.7:0/3918471104 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f58900ad840 con 0x7f58a0102650 2024-09-21T06:46:25.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:46:25 smithi144 ceph-mon[34653]: pgmap v633: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 9 op/s 2024-09-21T06:46:25.326 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:25.324+0000 7f58a4b75640 1 -- 172.21.15.7:0/3918471104 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f58a0102a60 con 0x7f58a0102650 2024-09-21T06:46:25.327 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:46:25 smithi007 ceph-mon[30983]: pgmap v633: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 9 op/s 2024-09-21T06:46:25.327 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:25.325+0000 7f588f7fe640 1 -- 172.21.15.7:0/3918471104 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11899 (secure 0 0 0) 0x7f58a0102a60 con 0x7f58a0102650 2024-09-21T06:46:25.327 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:46:25.328 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-21T06:36:10:753693+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2015971546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2015971546},{"type":"v1","addr":"172.21.15.7:6835","nonce":2015971546}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/2350816224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":2350816224},{"type":"v1","addr":"172.21.15.7:6837","nonce":2350816224}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14823,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/1669980572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":1669980572},{"type":"v1","addr":"172.21.15.7:6839","nonce":1669980572}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14835,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/2528308973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":2528308973},{"type":"v1","addr":"172.21.15.7:6841","nonce":2528308973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24623,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1337382979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1337382979},{"type":"v1","addr":"172.21.15.18:6833","nonce":1337382979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/2751454345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":2751454345},{"type":"v1","addr":"172.21.15.144:6833","nonce":2751454345}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:34:24.627168+0000","modified":"2024-09-21T06:36:10.737288+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24716,"mds_1":24688,"mds_2":24686},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24656":{"gid":24656,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6835/158884796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":158884796},{"type":"v1","addr":"172.21.15.18:6835","nonce":158884796}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6835/3636739922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3636739922},{"type":"v1","addr":"172.21.15.144:6835","nonce":3636739922}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24673":{"gid":24673,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6837/1126341753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":1126341753},{"type":"v1","addr":"172.21.15.144:6837","nonce":1126341753}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.18:6837/1539670694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1539670694},{"type":"v1","addr":"172.21.15.18:6837","nonce":1539670694}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24688":{"gid":24688,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.144:6839/4027821922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":4027821922},{"type":"v1","addr":"172.21.15.144:6839","nonce":4027821922}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24716":{"gid":24716,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.18:6839/3798713532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":3798713532},{"type":"v1","addr":"172.21.15.18:6839","nonce":3798713532}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24716,"qdb_cluster":[24716,24688,24686]},"id":1}]} 2024-09-21T06:46:25.328 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-21T06:46:25.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:25.327+0000 7f58a4b75640 1 -- 172.21.15.7:0/3918471104 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f58880b66b0 msgr2=0x7f58880b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:25.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:25.327+0000 7f58a4b75640 1 --2- 172.21.15.7:0/3918471104 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f58880b66b0 0x7f58880b8bc0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f5894031440 tx=0x7f5894009680 comp rx=0 tx=0).stop 2024-09-21T06:46:25.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:25.327+0000 7f58a4b75640 1 -- 172.21.15.7:0/3918471104 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f58a0102650 msgr2=0x7f58a019c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:25.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:25.327+0000 7f58a4b75640 1 --2- 172.21.15.7:0/3918471104 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f58a0102650 0x7f58a019c6c0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f589000d950 tx=0x7f589000de10 comp rx=0 tx=0).stop 2024-09-21T06:46:25.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:25.328+0000 7f58a4b75640 1 -- 172.21.15.7:0/3918471104 shutdown_connections 2024-09-21T06:46:25.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:25.328+0000 7f58a4b75640 1 --2- 172.21.15.7:0/3918471104 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f58880b66b0 0x7f58880b8bc0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:25.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:25.328+0000 7f58a4b75640 1 --2- 172.21.15.7:0/3918471104 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58a0110200 0x7f58a01a1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:25.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:25.328+0000 7f58a4b75640 1 --2- 172.21.15.7:0/3918471104 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f58a0102fa0 0x7f58a019cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:25.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:25.328+0000 7f58a4b75640 1 --2- 172.21.15.7:0/3918471104 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f58a0102650 0x7f58a019c6c0 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:25.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:25.328+0000 7f58a4b75640 1 -- 172.21.15.7:0/3918471104 >> 172.21.15.7:0/3918471104 conn(0x7f58a0079770 msgr2=0x7f58a0109d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:25.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:25.328+0000 7f58a4b75640 1 -- 172.21.15.7:0/3918471104 shutdown_connections 2024-09-21T06:46:25.331 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:25.328+0000 7f58a4b75640 1 -- 172.21.15.7:0/3918471104 wait complete. 2024-09-21T06:46:25.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:46:25 smithi018 ceph-mon[34477]: pgmap v633: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 9 op/s 2024-09-21T06:46:26.047 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:2 damage ls 2024-09-21T06:46:26.308 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:46:26.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:46:26 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/3918471104' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:46:26.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:46:26 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/3918471104' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:46:26.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:46:26 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/3918471104' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:46:26.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.817+0000 7fe664843640 1 -- 172.21.15.7:0/1128778351 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe660103b80 msgr2=0x7fe660103f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:26.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.817+0000 7fe664843640 1 --2- 172.21.15.7:0/1128778351 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe660103b80 0x7fe660103f90 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7fe658009900 tx=0x7fe65802a410 comp rx=0 tx=0).stop 2024-09-21T06:46:26.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.817+0000 7fe664843640 1 -- 172.21.15.7:0/1128778351 shutdown_connections 2024-09-21T06:46:26.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.817+0000 7fe664843640 1 --2- 172.21.15.7:0/1128778351 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe660109e10 0x7fe660110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:26.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.817+0000 7fe664843640 1 --2- 172.21.15.7:0/1128778351 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6601094c0 0x7fe6601098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:26.819 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.817+0000 7fe664843640 1 --2- 172.21.15.7:0/1128778351 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe660103b80 0x7fe660103f90 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:26.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.817+0000 7fe664843640 1 -- 172.21.15.7:0/1128778351 >> 172.21.15.7:0/1128778351 conn(0x7fe6600ff5b0 msgr2=0x7fe660101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:26.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.817+0000 7fe664843640 1 -- 172.21.15.7:0/1128778351 shutdown_connections 2024-09-21T06:46:26.820 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.817+0000 7fe664843640 1 -- 172.21.15.7:0/1128778351 wait complete. 2024-09-21T06:46:26.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.818+0000 7fe664843640 1 Processor -- start 2024-09-21T06:46:26.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.818+0000 7fe664843640 1 -- start start 2024-09-21T06:46:26.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.818+0000 7fe664843640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe660103b80 0x7fe660075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:26.821 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.818+0000 7fe664843640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6601094c0 0x7fe660075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:26.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.818+0000 7fe664843640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe660109e10 0x7fe660076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:26.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.818+0000 7fe664843640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe660113ad0 con 0x7fe6601094c0 2024-09-21T06:46:26.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.818+0000 7fe664843640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe660113950 con 0x7fe660109e10 2024-09-21T06:46:26.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.818+0000 7fe664843640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe660113c50 con 0x7fe660103b80 2024-09-21T06:46:26.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.818+0000 7fe65dd9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6601094c0 0x7fe660075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:26.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.818+0000 7fe65dd9b640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6601094c0 0x7fe660075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38268/0 (socket says 172.21.15.7:38268) 2024-09-21T06:46:26.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.818+0000 7fe65dd9b640 1 -- 172.21.15.7:0/3537763297 learned_addr learned my addr 172.21.15.7:0/3537763297 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:46:26.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.818+0000 7fe65e59c640 1 --2- 172.21.15.7:0/3537763297 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe660103b80 0x7fe660075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:26.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.819+0000 7fe65ed9d640 1 --2- 172.21.15.7:0/3537763297 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe660109e10 0x7fe660076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:26.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.819+0000 7fe65dd9b640 1 -- 172.21.15.7:0/3537763297 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe660103b80 msgr2=0x7fe660075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:26.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.819+0000 7fe65dd9b640 1 --2- 172.21.15.7:0/3537763297 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe660103b80 0x7fe660075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:26.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.819+0000 7fe65dd9b640 1 -- 172.21.15.7:0/3537763297 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe660109e10 msgr2=0x7fe660076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:26.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.819+0000 7fe65dd9b640 1 --2- 172.21.15.7:0/3537763297 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe660109e10 0x7fe660076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:26.822 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.819+0000 7fe65dd9b640 1 -- 172.21.15.7:0/3537763297 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6601a87c0 con 0x7fe6601094c0 2024-09-21T06:46:26.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.819+0000 7fe65dd9b640 1 --2- 172.21.15.7:0/3537763297 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6601094c0 0x7fe660075c50 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7fe64800d740 tx=0x7fe64800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:26.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.819+0000 7fe6577fe640 1 -- 172.21.15.7:0/3537763297 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe648017070 con 0x7fe6601094c0 2024-09-21T06:46:26.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.819+0000 7fe664843640 1 -- 172.21.15.7:0/3537763297 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6601a8ab0 con 0x7fe6601094c0 2024-09-21T06:46:26.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.819+0000 7fe6577fe640 1 -- 172.21.15.7:0/3537763297 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe64800de50 con 0x7fe6601094c0 2024-09-21T06:46:26.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.819+0000 7fe6577fe640 1 -- 172.21.15.7:0/3537763297 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe64800f620 con 0x7fe6601094c0 2024-09-21T06:46:26.823 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.819+0000 7fe664843640 1 -- 172.21.15.7:0/3537763297 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6601a9040 con 0x7fe6601094c0 2024-09-21T06:46:26.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.822+0000 7fe66adb7740 1 Processor -- start 2024-09-21T06:46:26.824 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.822+0000 7fe66adb7740 1 -- start start 2024-09-21T06:46:26.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.822+0000 7fe6577fe640 1 -- 172.21.15.7:0/3537763297 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7fe64801a070 con 0x7fe6601094c0 2024-09-21T06:46:26.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.823+0000 7fe66adb7740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559b34d23070 0x559b350ca2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:26.825 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.823+0000 7fe66adb7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b34cfa1b0 0x559b350ca800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:26.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.823+0000 7fe66adb7740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559b34d02390 0x559b350cad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:26.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.823+0000 7fe66adb7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x559b35040ea0 con 0x559b34cfa1b0 2024-09-21T06:46:26.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.823+0000 7fe66adb7740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559b350302d0 con 0x559b34d23070 2024-09-21T06:46:26.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.823+0000 7fe66adb7740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x559b350340e0 con 0x559b34d02390 2024-09-21T06:46:26.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.823+0000 7fe65e59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b34cfa1b0 0x559b350ca800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:26.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.823+0000 7fe65e59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b34cfa1b0 0x559b350ca800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38280/0 (socket says 172.21.15.7:38280) 2024-09-21T06:46:26.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.823+0000 7fe65e59c640 1 -- 172.21.15.7:0/685328068 learned_addr learned my addr 172.21.15.7:0/685328068 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:46:26.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.823+0000 7fe65ed9d640 1 --2- 172.21.15.7:0/685328068 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559b34d23070 0x559b350ca2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:26.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.823+0000 7fe65dd9b640 1 --2- 172.21.15.7:0/685328068 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559b34d02390 0x559b350cad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:26.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.823+0000 7fe65e59c640 1 -- 172.21.15.7:0/685328068 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559b34d02390 msgr2=0x559b350cad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:26.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.823+0000 7fe65e59c640 1 --2- 172.21.15.7:0/685328068 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559b34d02390 0x559b350cad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:26.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.823+0000 7fe65e59c640 1 -- 172.21.15.7:0/685328068 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559b34d23070 msgr2=0x559b350ca2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:26.826 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.823+0000 7fe65e59c640 1 --2- 172.21.15.7:0/685328068 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559b34d23070 0x559b350ca2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:26.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.823+0000 7fe65e59c640 1 -- 172.21.15.7:0/685328068 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b34d8e650 con 0x559b34cfa1b0 2024-09-21T06:46:26.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.823+0000 7fe65e59c640 1 --2- 172.21.15.7:0/685328068 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b34cfa1b0 0x559b350ca800 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7fe658009900 tx=0x7fe658032c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f97f156226b16808 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:26.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.823+0000 7fe6577fe640 1 --2- 172.21.15.7:0/3537763297 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fe64c0b6680 0x7fe64c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:26.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.824+0000 7fe65ed9d640 1 --2- 172.21.15.7:0/3537763297 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fe64c0b6680 0x7fe64c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:26.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.824+0000 7fe654ff9640 1 -- 172.21.15.7:0/685328068 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe658040070 con 0x559b34cfa1b0 2024-09-21T06:46:26.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.824+0000 7fe6577fe640 1 -- 172.21.15.7:0/3537763297 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8412+0+0 (secure 0 0 0) 0x7fe6480e7030 con 0x7fe6601094c0 2024-09-21T06:46:26.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.824+0000 7fe654ff9640 1 -- 172.21.15.7:0/685328068 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe658032e50 con 0x559b34cfa1b0 2024-09-21T06:46:26.827 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.824+0000 7fe654ff9640 1 -- 172.21.15.7:0/685328068 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe658035040 con 0x559b34cfa1b0 2024-09-21T06:46:26.829 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.825+0000 7fe66adb7740 1 -- 172.21.15.7:0/685328068 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b34cfa1b0 msgr2=0x559b350ca800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:26.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.825+0000 7fe66adb7740 1 --2- 172.21.15.7:0/685328068 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b34cfa1b0 0x559b350ca800 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7fe658009900 tx=0x7fe658032c60 comp rx=0 tx=0).stop 2024-09-21T06:46:26.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.825+0000 7fe65ed9d640 1 --2- 172.21.15.7:0/3537763297 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fe64c0b6680 0x7fe64c0b8b90 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fe650005fd0 tx=0x7fe650009600 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:26.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.825+0000 7fe66adb7740 1 -- 172.21.15.7:0/685328068 shutdown_connections 2024-09-21T06:46:26.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.825+0000 7fe66adb7740 1 --2- 172.21.15.7:0/685328068 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559b34d02390 0x559b350cad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:26.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.825+0000 7fe66adb7740 1 --2- 172.21.15.7:0/685328068 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b34cfa1b0 0x559b350ca800 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:26.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.825+0000 7fe66adb7740 1 --2- 172.21.15.7:0/685328068 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559b34d23070 0x559b350ca2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:26.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.825+0000 7fe66adb7740 1 -- 172.21.15.7:0/685328068 >> 172.21.15.7:0/685328068 conn(0x559b34d17460 msgr2=0x559b350c81b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:26.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.825+0000 7fe66adb7740 1 -- 172.21.15.7:0/685328068 shutdown_connections 2024-09-21T06:46:26.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.825+0000 7fe66adb7740 1 -- 172.21.15.7:0/685328068 wait complete. 2024-09-21T06:46:26.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.825+0000 7fe66adb7740 1 -- start start 2024-09-21T06:46:26.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.825+0000 7fe66adb7740 1 Processor -- start 2024-09-21T06:46:26.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.826+0000 7fe66adb7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b34cfa1b0 0x559b350d5980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:26.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.826+0000 7fe66adb7740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559b34d02390 0x559b350d5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:26.830 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.826+0000 7fe66adb7740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559b34d23070 0x559b350e1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:26.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.826+0000 7fe66adb7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x559b34e91700 con 0x559b34cfa1b0 2024-09-21T06:46:26.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.826+0000 7fe66adb7740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x559b34fcb160 con 0x559b34d23070 2024-09-21T06:46:26.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.826+0000 7fe66adb7740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x559b350d8a40 con 0x559b34d02390 2024-09-21T06:46:26.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.826+0000 7fe66adb7740 10 client.0 _ll_register_callbacks cb 0x559b34fe49e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:46:26.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.826+0000 7fe65e59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b34cfa1b0 0x559b350d5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:26.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.826+0000 7fe65e59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b34cfa1b0 0x559b350d5980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38288/0 (socket says 172.21.15.7:38288) 2024-09-21T06:46:26.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.826+0000 7fe65e59c640 1 -- 172.21.15.7:0/3100633059 learned_addr learned my addr 172.21.15.7:0/3100633059 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:46:26.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.826+0000 7fe65ed9d640 1 --2- 172.21.15.7:0/3100633059 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559b34d23070 0x559b350e1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:26.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.826+0000 7fe65dd9b640 1 --2- 172.21.15.7:0/3100633059 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559b34d02390 0x559b350d5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:26.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.826+0000 7fe65e59c640 1 -- 172.21.15.7:0/3100633059 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559b34d02390 msgr2=0x559b350d5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:26.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.826+0000 7fe65e59c640 1 --2- 172.21.15.7:0/3100633059 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559b34d02390 0x559b350d5ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:26.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.826+0000 7fe65e59c640 1 -- 172.21.15.7:0/3100633059 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559b34d23070 msgr2=0x559b350e1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:26.831 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.826+0000 7fe65e59c640 1 --2- 172.21.15.7:0/3100633059 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559b34d23070 0x559b350e1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:26.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.826+0000 7fe65e59c640 1 -- 172.21.15.7:0/3100633059 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b34ff8c90 con 0x559b34cfa1b0 2024-09-21T06:46:26.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.826+0000 7fe65ed9d640 1 --2- 172.21.15.7:0/3100633059 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559b34d23070 0x559b350e1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:46:26.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.827+0000 7fe65e59c640 1 --2- 172.21.15.7:0/3100633059 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b34cfa1b0 0x559b350d5980 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7fe658005530 tx=0x7fe6580050e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a947254e56b4af5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:26.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.827+0000 7fe645ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:46:26.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.827+0000 7fe645ffb640 1 -- 172.21.15.7:0/3100633059 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe658035040 con 0x559b34cfa1b0 2024-09-21T06:46:26.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.827+0000 7fe645ffb640 1 -- 172.21.15.7:0/3100633059 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8412+0+0 (secure 0 0 0) 0x7fe658004040 con 0x559b34cfa1b0 2024-09-21T06:46:26.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.827+0000 7fe66adb7740 1 -- 172.21.15.7:0/3100633059 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe658032e50 con 0x559b34cfa1b0 2024-09-21T06:46:26.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.827+0000 7fe645ffb640 1 -- 172.21.15.7:0/3100633059 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe658040040 con 0x559b34cfa1b0 2024-09-21T06:46:26.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.827+0000 7fe66adb7740 10 client.17838 fetch_fsmap learned FSMap version 25 2024-09-21T06:46:26.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.827+0000 7fe66adb7740 1 -- 172.21.15.7:0/3100633059 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559b350e4720 con 0x559b34cfa1b0 2024-09-21T06:46:26.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.827+0000 7fe645ffb640 1 -- 172.21.15.7:0/3100633059 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe658032e50 con 0x559b34cfa1b0 2024-09-21T06:46:26.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.827+0000 7fe645ffb640 1 -- 172.21.15.7:0/3100633059 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fe658054030 con 0x559b34cfa1b0 2024-09-21T06:46:26.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.827+0000 7fe66adb7740 10 client.17838 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:46:26.832 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.828+0000 7fe66adb7740 10 client.17838 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-21T06:46:26.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.828+0000 7fe66adb7740 20 client.17838 populate_metadata read hostname 'smithi007' 2024-09-21T06:46:26.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.828+0000 7fe66adb7740 1 --2- 172.21.15.7:0/3100633059 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x559b34ce19f0 0x559b350e7a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:26.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.828+0000 7fe66adb7740 4 client.17838 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:46:26.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.828+0000 7fe66adb7740 1 -- 172.21.15.7:0/3100633059 --> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559b35042df0 con 0x559b34ce19f0 2024-09-21T06:46:26.833 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.828+0000 7fe65dd9b640 1 --2- 172.21.15.7:0/3100633059 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x559b34ce19f0 0x559b350e7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:26.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.828+0000 7fe65dd9b640 1 --2- 172.21.15.7:0/3100633059 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x559b34ce19f0 0x559b350e7a80 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=58da1858c981f677 server_cookie=72d386796ef6c9a6 in_seq=0 out_seq=0 2024-09-21T06:46:26.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.828+0000 7fe645ffb640 10 client.17838 ms_handle_connect on v2:172.21.15.18:6836/1539670694 2024-09-21T06:46:26.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.829+0000 7fe645ffb640 1 -- 172.21.15.7:0/3100633059 <== mds.2 v2:172.21.15.18:6836/1539670694 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559b35042df0 con 0x559b34ce19f0 2024-09-21T06:46:26.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.829+0000 7fe645ffb640 10 client.17838 handle_command_reply: tid=0 2024-09-21T06:46:26.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.829+0000 7fe66adb7740 1 client.17838 shutdown 2024-09-21T06:46:26.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.829+0000 7fe66adb7740 1 -- 172.21.15.7:0/3100633059 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b34cfa1b0 msgr2=0x559b350d5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:26.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.829+0000 7fe66adb7740 1 --2- 172.21.15.7:0/3100633059 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b34cfa1b0 0x559b350d5980 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7fe658005530 tx=0x7fe6580050e0 comp rx=0 tx=0).stop 2024-09-21T06:46:26.834 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.829+0000 7fe66adb7740 1 -- 172.21.15.7:0/3100633059 shutdown_connections 2024-09-21T06:46:26.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.829+0000 7fe66adb7740 1 --2- 172.21.15.7:0/3100633059 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x559b34ce19f0 0x559b350e7a80 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:26.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.829+0000 7fe66adb7740 1 --2- 172.21.15.7:0/3100633059 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559b34d23070 0x559b350e1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:26.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.829+0000 7fe66adb7740 1 --2- 172.21.15.7:0/3100633059 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559b34d02390 0x559b350d5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:26.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.829+0000 7fe66adb7740 1 --2- 172.21.15.7:0/3100633059 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b34cfa1b0 0x559b350d5980 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:26.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.829+0000 7fe66adb7740 1 -- 172.21.15.7:0/3100633059 >> 172.21.15.7:0/3100633059 conn(0x559b34d17460 msgr2=0x559b350cd450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:26.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.829+0000 7fe645ffb640 0 client.17838 ms_handle_reset on v2:172.21.15.18:6836/1539670694 2024-09-21T06:46:26.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.829+0000 7fe66adb7740 1 -- 172.21.15.7:0/3100633059 shutdown_connections 2024-09-21T06:46:26.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.829+0000 7fe66adb7740 1 -- 172.21.15.7:0/3100633059 wait complete. 2024-09-21T06:46:26.835 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.830+0000 7fe66adb7740 20 client.17838 trim_cache size 0 max 16384 2024-09-21T06:46:26.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.844+0000 7fe66adb7740 1 Processor -- start 2024-09-21T06:46:26.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.845+0000 7fe66adb7740 1 -- start start 2024-09-21T06:46:26.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.845+0000 7fe66adb7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b34cfa1b0 0x559b350d5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:26.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.845+0000 7fe66adb7740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559b34d02390 0x559b350e1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:26.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.845+0000 7fe66adb7740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559b34d23070 0x559b350d2b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:26.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.845+0000 7fe66adb7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe6601b4080 con 0x559b34cfa1b0 2024-09-21T06:46:26.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.845+0000 7fe66adb7740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe6601b1950 con 0x559b34d23070 2024-09-21T06:46:26.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.845+0000 7fe66adb7740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe6601af7c0 con 0x559b34d02390 2024-09-21T06:46:26.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.845+0000 7fe65e59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b34cfa1b0 0x559b350d5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:26.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.845+0000 7fe65e59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b34cfa1b0 0x559b350d5e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38296/0 (socket says 172.21.15.7:38296) 2024-09-21T06:46:26.847 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.845+0000 7fe65e59c640 1 -- 172.21.15.7:0/3193313776 learned_addr learned my addr 172.21.15.7:0/3193313776 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:46:26.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.845+0000 7fe65ed9d640 1 --2- 172.21.15.7:0/3193313776 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559b34d23070 0x559b350d2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:26.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.845+0000 7fe65e59c640 1 -- 172.21.15.7:0/3193313776 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559b34d02390 msgr2=0x559b350e1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:26.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.845+0000 7fe65e59c640 1 --2- 172.21.15.7:0/3193313776 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559b34d02390 0x559b350e1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:26.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.845+0000 7fe65e59c640 1 -- 172.21.15.7:0/3193313776 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559b34d23070 msgr2=0x559b350d2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:26.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.845+0000 7fe65e59c640 1 --2- 172.21.15.7:0/3193313776 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559b34d23070 0x559b350d2b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:26.848 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.845+0000 7fe65e59c640 1 -- 172.21.15.7:0/3193313776 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559b34ce1c20 con 0x559b34cfa1b0 2024-09-21T06:46:26.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.845+0000 7fe65e59c640 1 --2- 172.21.15.7:0/3193313776 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b34cfa1b0 0x559b350d5e40 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7fe658004d30 tx=0x7fe658031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a01064c2a85645a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:26.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.846+0000 7fe647fff640 1 -- 172.21.15.7:0/3193313776 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6580048c0 con 0x559b34cfa1b0 2024-09-21T06:46:26.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.846+0000 7fe647fff640 1 -- 172.21.15.7:0/3193313776 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe658009520 con 0x559b34cfa1b0 2024-09-21T06:46:26.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.846+0000 7fe647fff640 1 -- 172.21.15.7:0/3193313776 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe658031910 con 0x559b34cfa1b0 2024-09-21T06:46:26.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.846+0000 7fe66adb7740 1 -- 172.21.15.7:0/3193313776 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b34cfa1b0 msgr2=0x559b350d5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:26.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.846+0000 7fe66adb7740 1 --2- 172.21.15.7:0/3193313776 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b34cfa1b0 0x559b350d5e40 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7fe658004d30 tx=0x7fe658031400 comp rx=0 tx=0).stop 2024-09-21T06:46:26.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.846+0000 7fe66adb7740 1 -- 172.21.15.7:0/3193313776 shutdown_connections 2024-09-21T06:46:26.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.846+0000 7fe66adb7740 1 --2- 172.21.15.7:0/3193313776 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559b34d23070 0x559b350d2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:26.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.846+0000 7fe66adb7740 1 --2- 172.21.15.7:0/3193313776 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559b34d02390 0x559b350e1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:26.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.846+0000 7fe66adb7740 1 --2- 172.21.15.7:0/3193313776 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b34cfa1b0 0x559b350d5e40 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:26.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.846+0000 7fe66adb7740 1 -- 172.21.15.7:0/3193313776 >> 172.21.15.7:0/3193313776 conn(0x559b34d17460 msgr2=0x559b350d5730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:26.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.846+0000 7fe66adb7740 1 -- 172.21.15.7:0/3193313776 shutdown_connections 2024-09-21T06:46:26.851 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.846+0000 7fe66adb7740 1 -- 172.21.15.7:0/3193313776 wait complete. 2024-09-21T06:46:26.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.847+0000 7fe66adb7740 1 -- start start 2024-09-21T06:46:26.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.847+0000 7fe66adb7740 1 Processor -- start 2024-09-21T06:46:26.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.847+0000 7fe66adb7740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559b34cfa1b0 0x559b350e8620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:26.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.847+0000 7fe66adb7740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559b34d02390 0x559b350e8c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:26.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.847+0000 7fe66adb7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b34d23070 0x559b3514a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:26.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.847+0000 7fe66adb7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fe6601afe10 con 0x559b34d23070 2024-09-21T06:46:26.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.847+0000 7fe66adb7740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe6601b1280 con 0x559b34cfa1b0 2024-09-21T06:46:26.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.847+0000 7fe66adb7740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fe6601b04e0 con 0x559b34d02390 2024-09-21T06:46:26.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.847+0000 7fe66adb7740 10 client.0 _ll_register_callbacks cb 0x7fe650009a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:46:26.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.847+0000 7fe65ed9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b34d23070 0x559b3514a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:26.852 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.847+0000 7fe65ed9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b34d23070 0x559b3514a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38308/0 (socket says 172.21.15.7:38308) 2024-09-21T06:46:26.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.847+0000 7fe65ed9d640 1 -- 172.21.15.7:0/2304480859 learned_addr learned my addr 172.21.15.7:0/2304480859 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:46:26.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.847+0000 7fe65e59c640 1 --2- 172.21.15.7:0/2304480859 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559b34cfa1b0 0x559b350e8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:26.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.848+0000 7fe65dd9b640 1 --2- 172.21.15.7:0/2304480859 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559b34d02390 0x559b350e8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:26.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.848+0000 7fe65ed9d640 1 -- 172.21.15.7:0/2304480859 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559b34d02390 msgr2=0x559b350e8c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:26.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.848+0000 7fe65ed9d640 1 --2- 172.21.15.7:0/2304480859 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559b34d02390 0x559b350e8c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:26.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.848+0000 7fe65ed9d640 1 -- 172.21.15.7:0/2304480859 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559b34cfa1b0 msgr2=0x559b350e8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:26.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.848+0000 7fe65ed9d640 1 --2- 172.21.15.7:0/2304480859 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559b34cfa1b0 0x559b350e8620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:26.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.848+0000 7fe65ed9d640 1 -- 172.21.15.7:0/2304480859 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559b3514aa00 con 0x559b34d23070 2024-09-21T06:46:26.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.848+0000 7fe65e59c640 1 --2- 172.21.15.7:0/2304480859 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559b34cfa1b0 0x559b350e8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:46:26.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.848+0000 7fe65ed9d640 1 --2- 172.21.15.7:0/2304480859 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b34d23070 0x559b3514a390 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7fe650011eb0 tx=0x7fe650004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49b1c93047590a10 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:26.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.848+0000 7fe645ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:46:26.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.848+0000 7fe645ffb640 1 -- 172.21.15.7:0/2304480859 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe65001f810 con 0x559b34d23070 2024-09-21T06:46:26.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.848+0000 7fe645ffb640 1 -- 172.21.15.7:0/2304480859 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8412+0+0 (secure 0 0 0) 0x7fe65001f9b0 con 0x559b34d23070 2024-09-21T06:46:26.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.848+0000 7fe66adb7740 1 -- 172.21.15.7:0/2304480859 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe658009520 con 0x559b34d23070 2024-09-21T06:46:26.853 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.848+0000 7fe645ffb640 1 -- 172.21.15.7:0/2304480859 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe65001fbf0 con 0x559b34d23070 2024-09-21T06:46:26.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.848+0000 7fe66adb7740 10 client.17844 fetch_fsmap learned FSMap version 25 2024-09-21T06:46:26.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.848+0000 7fe66adb7740 1 -- 172.21.15.7:0/2304480859 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x559b35151e80 con 0x559b34d23070 2024-09-21T06:46:26.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.849+0000 7fe645ffb640 1 -- 172.21.15.7:0/2304480859 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe658009520 con 0x559b34d23070 2024-09-21T06:46:26.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.849+0000 7fe645ffb640 1 -- 172.21.15.7:0/2304480859 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fe650029070 con 0x559b34d23070 2024-09-21T06:46:26.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.849+0000 7fe66adb7740 10 client.17844 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:46:26.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.849+0000 7fe66adb7740 10 client.17844 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2024-09-21T06:46:26.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.849+0000 7fe66adb7740 20 client.17844 populate_metadata read hostname 'smithi007' 2024-09-21T06:46:26.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.849+0000 7fe66adb7740 1 --2- 172.21.15.7:0/2304480859 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x559b34cb6da0 0x559b351546f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:26.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.849+0000 7fe66adb7740 4 client.17844 mds_command: new command op to 24686 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:46:26.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.849+0000 7fe66adb7740 1 -- 172.21.15.7:0/2304480859 --> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559b3503e8a0 con 0x559b34cb6da0 2024-09-21T06:46:26.854 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.849+0000 7fe65e59c640 1 --2- 172.21.15.7:0/2304480859 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x559b34cb6da0 0x559b351546f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:26.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.850+0000 7fe645ffb640 10 client.17844 ms_handle_connect on v2:172.21.15.18:6836/1539670694 2024-09-21T06:46:26.855 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.850+0000 7fe65e59c640 1 --2- 172.21.15.7:0/2304480859 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x559b34cb6da0 0x559b351546f0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4b2af75e3701eedf server_cookie=2d0fb971927160d4 in_seq=0 out_seq=0 2024-09-21T06:46:26.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.850+0000 7fe645ffb640 1 -- 172.21.15.7:0/2304480859 <== mds.2 v2:172.21.15.18:6836/1539670694 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559b3503e8a0 con 0x559b34cb6da0 2024-09-21T06:46:26.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.850+0000 7fe645ffb640 10 client.17844 handle_command_reply: tid=0 2024-09-21T06:46:26.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.850+0000 7fe66adb7740 1 client.17844 shutdown 2024-09-21T06:46:26.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.850+0000 7fe66adb7740 1 -- 172.21.15.7:0/2304480859 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b34d23070 msgr2=0x559b3514a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:26.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.850+0000 7fe66adb7740 1 --2- 172.21.15.7:0/2304480859 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b34d23070 0x559b3514a390 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7fe650011eb0 tx=0x7fe650004a40 comp rx=0 tx=0).stop 2024-09-21T06:46:26.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.850+0000 7fe66adb7740 1 -- 172.21.15.7:0/2304480859 shutdown_connections 2024-09-21T06:46:26.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.850+0000 7fe66adb7740 1 --2- 172.21.15.7:0/2304480859 >> [v2:172.21.15.18:6836/1539670694,v1:172.21.15.18:6837/1539670694] conn(0x559b34cb6da0 0x559b351546f0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:26.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.850+0000 7fe66adb7740 1 --2- 172.21.15.7:0/2304480859 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x559b34d23070 0x559b3514a390 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:26.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.850+0000 7fe66adb7740 1 --2- 172.21.15.7:0/2304480859 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x559b34d02390 0x559b350e8c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:26.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.850+0000 7fe645ffb640 0 client.17844 ms_handle_reset on v2:172.21.15.18:6836/1539670694 2024-09-21T06:46:26.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.850+0000 7fe66adb7740 1 --2- 172.21.15.7:0/2304480859 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x559b34cfa1b0 0x559b350e8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:26.856 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.850+0000 7fe66adb7740 1 -- 172.21.15.7:0/2304480859 >> 172.21.15.7:0/2304480859 conn(0x559b34d17460 msgr2=0x559b350cb2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:26.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.850+0000 7fe66adb7740 1 -- 172.21.15.7:0/2304480859 shutdown_connections 2024-09-21T06:46:26.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.850+0000 7fe66adb7740 1 -- 172.21.15.7:0/2304480859 wait complete. 2024-09-21T06:46:26.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.850+0000 7fe66adb7740 20 client.17844 trim_cache size 0 max 16384 2024-09-21T06:46:26.857 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:46:26.857 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.851+0000 7fe664843640 1 -- 172.21.15.7:0/3537763297 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fe64c0b6680 msgr2=0x7fe64c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:26.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.851+0000 7fe664843640 1 --2- 172.21.15.7:0/3537763297 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fe64c0b6680 0x7fe64c0b8b90 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fe650005fd0 tx=0x7fe650009600 comp rx=0 tx=0).stop 2024-09-21T06:46:26.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.851+0000 7fe664843640 1 -- 172.21.15.7:0/3537763297 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6601094c0 msgr2=0x7fe660075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:26.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.851+0000 7fe664843640 1 --2- 172.21.15.7:0/3537763297 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6601094c0 0x7fe660075c50 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7fe64800d740 tx=0x7fe64800dc00 comp rx=0 tx=0).stop 2024-09-21T06:46:26.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.851+0000 7fe664843640 1 -- 172.21.15.7:0/3537763297 shutdown_connections 2024-09-21T06:46:26.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.851+0000 7fe664843640 1 --2- 172.21.15.7:0/3537763297 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fe64c0b6680 0x7fe64c0b8b90 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:26.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.851+0000 7fe664843640 1 --2- 172.21.15.7:0/3537763297 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe660109e10 0x7fe660076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:26.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.851+0000 7fe664843640 1 --2- 172.21.15.7:0/3537763297 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fe6601094c0 0x7fe660075c50 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:26.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.851+0000 7fe664843640 1 --2- 172.21.15.7:0/3537763297 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fe660103b80 0x7fe660075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:26.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.851+0000 7fe664843640 1 -- 172.21.15.7:0/3537763297 >> 172.21.15.7:0/3537763297 conn(0x7fe6600ff5b0 msgr2=0x7fe660108b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:26.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.851+0000 7fe664843640 1 -- 172.21.15.7:0/3537763297 shutdown_connections 2024-09-21T06:46:26.858 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:26.851+0000 7fe664843640 1 -- 172.21.15.7:0/3537763297 wait complete. 2024-09-21T06:46:27.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:46:27 smithi007 ceph-mon[30983]: pgmap v634: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 9 op/s 2024-09-21T06:46:27.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:46:27 smithi018 ceph-mon[34477]: pgmap v634: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 9 op/s 2024-09-21T06:46:27.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:46:27 smithi144 ceph-mon[34653]: pgmap v634: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 102 B/s wr, 9 op/s 2024-09-21T06:46:27.690 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:1 damage ls 2024-09-21T06:46:27.953 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:46:28.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.471+0000 7fa9e8583640 1 -- 172.21.15.7:0/1988359643 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9e010de60 msgr2=0x7fa9e0110330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:28.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.471+0000 7fa9e8583640 1 --2- 172.21.15.7:0/1988359643 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9e010de60 0x7fa9e0110330 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7fa9d8009ca0 tx=0x7fa9d802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:46:28.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.471+0000 7fa9e8583640 1 -- 172.21.15.7:0/1988359643 shutdown_connections 2024-09-21T06:46:28.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.471+0000 7fa9e8583640 1 --2- 172.21.15.7:0/1988359643 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9e010de60 0x7fa9e0110330 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:28.527 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.471+0000 7fa9e8583640 1 --2- 172.21.15.7:0/1988359643 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa9e0105380 0x7fa9e010d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:28.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.471+0000 7fa9e8583640 1 --2- 172.21.15.7:0/1988359643 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9e0104a30 0x7fa9e0104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:28.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.471+0000 7fa9e8583640 1 -- 172.21.15.7:0/1988359643 >> 172.21.15.7:0/1988359643 conn(0x7fa9e0079760 msgr2=0x7fa9e0079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:28.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.471+0000 7fa9e8583640 1 -- 172.21.15.7:0/1988359643 shutdown_connections 2024-09-21T06:46:28.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.471+0000 7fa9e8583640 1 -- 172.21.15.7:0/1988359643 wait complete. 2024-09-21T06:46:28.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.472+0000 7fa9e8583640 1 Processor -- start 2024-09-21T06:46:28.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.472+0000 7fa9e8583640 1 -- start start 2024-09-21T06:46:28.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.472+0000 7fa9e8583640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9e0104a30 0x7fa9e0102770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:28.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.472+0000 7fa9e8583640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9e0105380 0x7fa9e0102cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:28.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.472+0000 7fa9e8583640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa9e010de60 0x7fa9e01031f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:28.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.472+0000 7fa9e8583640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa9e0113aa0 con 0x7fa9e0104a30 2024-09-21T06:46:28.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.472+0000 7fa9e8583640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa9e0113920 con 0x7fa9e0105380 2024-09-21T06:46:28.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.472+0000 7fa9e8583640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa9e0113c20 con 0x7fa9e010de60 2024-09-21T06:46:28.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.472+0000 7fa9e631f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9e0104a30 0x7fa9e0102770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:28.528 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.472+0000 7fa9e631f640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9e0104a30 0x7fa9e0102770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38326/0 (socket says 172.21.15.7:38326) 2024-09-21T06:46:28.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.472+0000 7fa9e631f640 1 -- 172.21.15.7:0/761361155 learned_addr learned my addr 172.21.15.7:0/761361155 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:46:28.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.472+0000 7fa9e5b1e640 1 --2- 172.21.15.7:0/761361155 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9e0105380 0x7fa9e0102cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:28.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.472+0000 7fa9e6b20640 1 --2- 172.21.15.7:0/761361155 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa9e010de60 0x7fa9e01031f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:28.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.472+0000 7fa9e631f640 1 -- 172.21.15.7:0/761361155 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa9e010de60 msgr2=0x7fa9e01031f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:28.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.472+0000 7fa9e631f640 1 --2- 172.21.15.7:0/761361155 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa9e010de60 0x7fa9e01031f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:28.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.472+0000 7fa9e631f640 1 -- 172.21.15.7:0/761361155 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9e0105380 msgr2=0x7fa9e0102cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:28.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.472+0000 7fa9e631f640 1 --2- 172.21.15.7:0/761361155 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9e0105380 0x7fa9e0102cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:28.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.472+0000 7fa9e631f640 1 -- 172.21.15.7:0/761361155 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9e01a8710 con 0x7fa9e0104a30 2024-09-21T06:46:28.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.472+0000 7fa9e5b1e640 1 --2- 172.21.15.7:0/761361155 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9e0105380 0x7fa9e0102cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:46:28.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.473+0000 7fa9e631f640 1 --2- 172.21.15.7:0/761361155 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9e0104a30 0x7fa9e0102770 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc00d770 tx=0x7fa9dc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:28.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.473+0000 7fa9d77fe640 1 -- 172.21.15.7:0/761361155 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9dc017070 con 0x7fa9e0104a30 2024-09-21T06:46:28.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.473+0000 7fa9e8583640 1 -- 172.21.15.7:0/761361155 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9e01a8a00 con 0x7fa9e0104a30 2024-09-21T06:46:28.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.473+0000 7fa9d77fe640 1 -- 172.21.15.7:0/761361155 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa9dc009c30 con 0x7fa9e0104a30 2024-09-21T06:46:28.529 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.473+0000 7fa9d77fe640 1 -- 172.21.15.7:0/761361155 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9dc003cc0 con 0x7fa9e0104a30 2024-09-21T06:46:28.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.473+0000 7fa9e8583640 1 -- 172.21.15.7:0/761361155 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9e01a8f40 con 0x7fa9e0104a30 2024-09-21T06:46:28.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.475+0000 7fa9eeaf7740 1 Processor -- start 2024-09-21T06:46:28.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.476+0000 7fa9eeaf7740 1 -- start start 2024-09-21T06:46:28.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.476+0000 7fa9eeaf7740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5618fa2aa070 0x5618fa6516a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:28.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.476+0000 7fa9eeaf7740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5618fa2811b0 0x5618fa651be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:28.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.476+0000 7fa9eeaf7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618fa289390 0x5618fa652120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:28.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.476+0000 7fa9eeaf7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5618fa5c7ea0 con 0x5618fa289390 2024-09-21T06:46:28.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.476+0000 7fa9eeaf7740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5618fa5b72d0 con 0x5618fa2811b0 2024-09-21T06:46:28.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.476+0000 7fa9eeaf7740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5618fa5bb0e0 con 0x5618fa2aa070 2024-09-21T06:46:28.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.476+0000 7fa9d77fe640 1 -- 172.21.15.7:0/761361155 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7fa9dc003e60 con 0x7fa9e0104a30 2024-09-21T06:46:28.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.476+0000 7fa9e5b1e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618fa289390 0x5618fa652120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:28.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.476+0000 7fa9e5b1e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618fa289390 0x5618fa652120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38328/0 (socket says 172.21.15.7:38328) 2024-09-21T06:46:28.530 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.476+0000 7fa9e5b1e640 1 -- 172.21.15.7:0/3413800884 learned_addr learned my addr 172.21.15.7:0/3413800884 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:46:28.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.476+0000 7fa9e631f640 1 --2- 172.21.15.7:0/3413800884 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5618fa2811b0 0x5618fa651be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:28.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.476+0000 7fa9e6b20640 1 --2- 172.21.15.7:0/3413800884 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5618fa2aa070 0x5618fa6516a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:28.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.476+0000 7fa9e5b1e640 1 -- 172.21.15.7:0/3413800884 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5618fa2aa070 msgr2=0x5618fa6516a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:28.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.476+0000 7fa9e5b1e640 1 --2- 172.21.15.7:0/3413800884 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5618fa2aa070 0x5618fa6516a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:28.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.476+0000 7fa9e5b1e640 1 -- 172.21.15.7:0/3413800884 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5618fa2811b0 msgr2=0x5618fa651be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:28.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.476+0000 7fa9e5b1e640 1 --2- 172.21.15.7:0/3413800884 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5618fa2811b0 0x5618fa651be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:28.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.476+0000 7fa9e5b1e640 1 -- 172.21.15.7:0/3413800884 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618fa315650 con 0x5618fa289390 2024-09-21T06:46:28.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.476+0000 7fa9e631f640 1 --2- 172.21.15.7:0/3413800884 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5618fa2811b0 0x5618fa651be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:46:28.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.477+0000 7fa9e5b1e640 1 --2- 172.21.15.7:0/3413800884 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618fa289390 0x5618fa652120 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7fa9d000bcd0 tx=0x7fa9d000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c758c6170d0a649e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:28.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.477+0000 7fa9d4ff9640 1 -- 172.21.15.7:0/3413800884 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9d0015070 con 0x5618fa289390 2024-09-21T06:46:28.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.477+0000 7fa9d4ff9640 1 -- 172.21.15.7:0/3413800884 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa9d001a910 con 0x5618fa289390 2024-09-21T06:46:28.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.477+0000 7fa9d4ff9640 1 -- 172.21.15.7:0/3413800884 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9d0011960 con 0x5618fa289390 2024-09-21T06:46:28.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.477+0000 7fa9d77fe640 1 --2- 172.21.15.7:0/761361155 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa9cc0b6680 0x7fa9cc0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:28.531 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.477+0000 7fa9e6b20640 1 --2- 172.21.15.7:0/761361155 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa9cc0b6680 0x7fa9cc0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:28.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.477+0000 7fa9d77fe640 1 -- 172.21.15.7:0/761361155 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8412+0+0 (secure 0 0 0) 0x7fa9dc0e70b0 con 0x7fa9e0104a30 2024-09-21T06:46:28.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.478+0000 7fa9eeaf7740 1 -- 172.21.15.7:0/3413800884 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618fa289390 msgr2=0x5618fa652120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:28.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.478+0000 7fa9e6b20640 1 --2- 172.21.15.7:0/761361155 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa9cc0b6680 0x7fa9cc0b8b90 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fa9d8006010 tx=0x7fa9d80093f0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:28.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.478+0000 7fa9eeaf7740 1 --2- 172.21.15.7:0/3413800884 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618fa289390 0x5618fa652120 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7fa9d000bcd0 tx=0x7fa9d000f730 comp rx=0 tx=0).stop 2024-09-21T06:46:28.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.478+0000 7fa9eeaf7740 1 -- 172.21.15.7:0/3413800884 shutdown_connections 2024-09-21T06:46:28.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.478+0000 7fa9eeaf7740 1 --2- 172.21.15.7:0/3413800884 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618fa289390 0x5618fa652120 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:28.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.478+0000 7fa9eeaf7740 1 --2- 172.21.15.7:0/3413800884 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5618fa2811b0 0x5618fa651be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:28.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.478+0000 7fa9eeaf7740 1 --2- 172.21.15.7:0/3413800884 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5618fa2aa070 0x5618fa6516a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:28.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.478+0000 7fa9eeaf7740 1 -- 172.21.15.7:0/3413800884 >> 172.21.15.7:0/3413800884 conn(0x5618fa29e460 msgr2=0x5618fa64f590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:28.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.478+0000 7fa9eeaf7740 1 -- 172.21.15.7:0/3413800884 shutdown_connections 2024-09-21T06:46:28.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.478+0000 7fa9eeaf7740 1 -- 172.21.15.7:0/3413800884 wait complete. 2024-09-21T06:46:28.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.478+0000 7fa9eeaf7740 1 -- start start 2024-09-21T06:46:28.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.478+0000 7fa9eeaf7740 1 Processor -- start 2024-09-21T06:46:28.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.479+0000 7fa9eeaf7740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5618fa2811b0 0x5618fa65cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:28.532 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.479+0000 7fa9eeaf7740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5618fa289390 0x5618fa65d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:28.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.479+0000 7fa9eeaf7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618fa2aa070 0x5618fa669170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:28.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.479+0000 7fa9eeaf7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x5618fa418700 con 0x5618fa2aa070 2024-09-21T06:46:28.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.479+0000 7fa9eeaf7740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5618fa552160 con 0x5618fa289390 2024-09-21T06:46:28.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.479+0000 7fa9eeaf7740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x5618fa65fe80 con 0x5618fa2811b0 2024-09-21T06:46:28.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.479+0000 7fa9eeaf7740 10 client.0 _ll_register_callbacks cb 0x5618fa56b9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:46:28.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.479+0000 7fa9e6b20640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618fa2aa070 0x5618fa669170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:28.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.479+0000 7fa9e6b20640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618fa2aa070 0x5618fa669170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38344/0 (socket says 172.21.15.7:38344) 2024-09-21T06:46:28.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.479+0000 7fa9e6b20640 1 -- 172.21.15.7:0/4107775901 learned_addr learned my addr 172.21.15.7:0/4107775901 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:46:28.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.479+0000 7fa9e5b1e640 1 --2- 172.21.15.7:0/4107775901 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5618fa289390 0x5618fa65d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:28.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.479+0000 7fa9e631f640 1 --2- 172.21.15.7:0/4107775901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5618fa2811b0 0x5618fa65cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:28.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.479+0000 7fa9e6b20640 1 -- 172.21.15.7:0/4107775901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5618fa2811b0 msgr2=0x5618fa65cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:28.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.479+0000 7fa9e6b20640 1 --2- 172.21.15.7:0/4107775901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5618fa2811b0 0x5618fa65cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:28.533 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.479+0000 7fa9e6b20640 1 -- 172.21.15.7:0/4107775901 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5618fa289390 msgr2=0x5618fa65d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:28.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.479+0000 7fa9e6b20640 1 --2- 172.21.15.7:0/4107775901 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5618fa289390 0x5618fa65d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:28.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.479+0000 7fa9e6b20640 1 -- 172.21.15.7:0/4107775901 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618fa57fc90 con 0x5618fa2aa070 2024-09-21T06:46:28.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.480+0000 7fa9e6b20640 1 --2- 172.21.15.7:0/4107775901 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618fa2aa070 0x5618fa669170 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7fa9d80316d0 tx=0x7fa9d80095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6028a20696e5d60 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:28.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.480+0000 7fa9c9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:46:28.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.480+0000 7fa9c9ffb640 1 -- 172.21.15.7:0/4107775901 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9d804f070 con 0x5618fa2aa070 2024-09-21T06:46:28.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.480+0000 7fa9c9ffb640 1 -- 172.21.15.7:0/4107775901 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8412+0+0 (secure 0 0 0) 0x7fa9d8004240 con 0x5618fa2aa070 2024-09-21T06:46:28.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.480+0000 7fa9eeaf7740 1 -- 172.21.15.7:0/4107775901 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa9d001a910 con 0x5618fa2aa070 2024-09-21T06:46:28.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.480+0000 7fa9c9ffb640 1 -- 172.21.15.7:0/4107775901 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa9d805b050 con 0x5618fa2aa070 2024-09-21T06:46:28.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.480+0000 7fa9eeaf7740 10 client.17856 fetch_fsmap learned FSMap version 25 2024-09-21T06:46:28.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.480+0000 7fa9eeaf7740 1 -- 172.21.15.7:0/4107775901 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5618fa66bbf0 con 0x5618fa2aa070 2024-09-21T06:46:28.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.480+0000 7fa9c9ffb640 1 -- 172.21.15.7:0/4107775901 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa9d001a910 con 0x5618fa2aa070 2024-09-21T06:46:28.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.480+0000 7fa9c9ffb640 1 -- 172.21.15.7:0/4107775901 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa9d8044040 con 0x5618fa2aa070 2024-09-21T06:46:28.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.481+0000 7fa9eeaf7740 10 client.17856 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:46:28.534 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.481+0000 7fa9eeaf7740 10 client.17856 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:46:28.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.481+0000 7fa9eeaf7740 20 client.17856 populate_metadata read hostname 'smithi007' 2024-09-21T06:46:28.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.481+0000 7fa9eeaf7740 1 --2- 172.21.15.7:0/4107775901 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x5618fa2689f0 0x5618fa66f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:28.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.481+0000 7fa9eeaf7740 4 client.17856 mds_command: new command op to 24688 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:46:28.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.481+0000 7fa9eeaf7740 1 -- 172.21.15.7:0/4107775901 --> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5618fa5c9df0 con 0x5618fa2689f0 2024-09-21T06:46:28.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.481+0000 7fa9e631f640 1 --2- 172.21.15.7:0/4107775901 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x5618fa2689f0 0x5618fa66f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:28.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.481+0000 7fa9c9ffb640 10 client.17856 ms_handle_connect on v2:172.21.15.144:6838/4027821922 2024-09-21T06:46:28.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.481+0000 7fa9e631f640 1 --2- 172.21.15.7:0/4107775901 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x5618fa2689f0 0x5618fa66f100 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ed19955020d0de77 server_cookie=ac072656e2b257cc in_seq=0 out_seq=0 2024-09-21T06:46:28.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.482+0000 7fa9c9ffb640 1 -- 172.21.15.7:0/4107775901 <== mds.1 v2:172.21.15.144:6838/4027821922 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5618fa5c9df0 con 0x5618fa2689f0 2024-09-21T06:46:28.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.482+0000 7fa9c9ffb640 10 client.17856 handle_command_reply: tid=0 2024-09-21T06:46:28.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.482+0000 7fa9eeaf7740 1 client.17856 shutdown 2024-09-21T06:46:28.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.482+0000 7fa9eeaf7740 1 -- 172.21.15.7:0/4107775901 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618fa2aa070 msgr2=0x5618fa669170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:28.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.482+0000 7fa9eeaf7740 1 --2- 172.21.15.7:0/4107775901 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618fa2aa070 0x5618fa669170 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7fa9d80316d0 tx=0x7fa9d80095c0 comp rx=0 tx=0).stop 2024-09-21T06:46:28.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.482+0000 7fa9eeaf7740 1 -- 172.21.15.7:0/4107775901 shutdown_connections 2024-09-21T06:46:28.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.482+0000 7fa9eeaf7740 1 --2- 172.21.15.7:0/4107775901 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x5618fa2689f0 0x5618fa66f100 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:28.535 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.482+0000 7fa9eeaf7740 1 --2- 172.21.15.7:0/4107775901 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618fa2aa070 0x5618fa669170 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:28.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.482+0000 7fa9eeaf7740 1 --2- 172.21.15.7:0/4107775901 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5618fa289390 0x5618fa65d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:28.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.482+0000 7fa9c9ffb640 0 client.17856 ms_handle_reset on v2:172.21.15.144:6838/4027821922 2024-09-21T06:46:28.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.482+0000 7fa9eeaf7740 1 --2- 172.21.15.7:0/4107775901 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5618fa2811b0 0x5618fa65cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:28.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.482+0000 7fa9eeaf7740 1 -- 172.21.15.7:0/4107775901 >> 172.21.15.7:0/4107775901 conn(0x5618fa29e460 msgr2=0x5618fa654830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:28.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.482+0000 7fa9eeaf7740 1 -- 172.21.15.7:0/4107775901 shutdown_connections 2024-09-21T06:46:28.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.482+0000 7fa9eeaf7740 1 -- 172.21.15.7:0/4107775901 wait complete. 2024-09-21T06:46:28.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.483+0000 7fa9eeaf7740 20 client.17856 trim_cache size 0 max 16384 2024-09-21T06:46:28.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.496+0000 7fa9eeaf7740 1 Processor -- start 2024-09-21T06:46:28.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.496+0000 7fa9eeaf7740 1 -- start start 2024-09-21T06:46:28.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.496+0000 7fa9eeaf7740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5618fa2811b0 0x5618fa65d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:28.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.496+0000 7fa9eeaf7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618fa289390 0x5618fa65ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:28.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.496+0000 7fa9eeaf7740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5618fa2aa070 0x5618fa669070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:28.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.496+0000 7fa9eeaf7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa9e01b4000 con 0x5618fa289390 2024-09-21T06:46:28.536 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.496+0000 7fa9eeaf7740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa9e01b18d0 con 0x5618fa2aa070 2024-09-21T06:46:28.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.496+0000 7fa9eeaf7740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa9e01af740 con 0x5618fa2811b0 2024-09-21T06:46:28.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.496+0000 7fa9e5b1e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618fa289390 0x5618fa65ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:28.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.496+0000 7fa9e5b1e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618fa289390 0x5618fa65ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38346/0 (socket says 172.21.15.7:38346) 2024-09-21T06:46:28.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.496+0000 7fa9e5b1e640 1 -- 172.21.15.7:0/1816810006 learned_addr learned my addr 172.21.15.7:0/1816810006 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:46:28.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.496+0000 7fa9e631f640 1 --2- 172.21.15.7:0/1816810006 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5618fa2811b0 0x5618fa65d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:28.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.496+0000 7fa9e6b20640 1 --2- 172.21.15.7:0/1816810006 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5618fa2aa070 0x5618fa669070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:28.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.496+0000 7fa9e5b1e640 1 -- 172.21.15.7:0/1816810006 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5618fa2811b0 msgr2=0x5618fa65d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:28.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.496+0000 7fa9e5b1e640 1 --2- 172.21.15.7:0/1816810006 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5618fa2811b0 0x5618fa65d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:28.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.496+0000 7fa9e5b1e640 1 -- 172.21.15.7:0/1816810006 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5618fa2aa070 msgr2=0x5618fa669070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:28.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.496+0000 7fa9e5b1e640 1 --2- 172.21.15.7:0/1816810006 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5618fa2aa070 0x5618fa669070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:28.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.496+0000 7fa9e5b1e640 1 -- 172.21.15.7:0/1816810006 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5618fa65f930 con 0x5618fa289390 2024-09-21T06:46:28.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.496+0000 7fa9e6b20640 1 --2- 172.21.15.7:0/1816810006 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5618fa2aa070 0x5618fa669070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:46:28.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.497+0000 7fa9e5b1e640 1 --2- 172.21.15.7:0/1816810006 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618fa289390 0x5618fa65ec80 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7fa9d0011570 tx=0x7fa9d00115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1316d5f23417d56 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:28.537 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.497+0000 7fa9cbfff640 1 -- 172.21.15.7:0/1816810006 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9d0029070 con 0x5618fa289390 2024-09-21T06:46:28.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.497+0000 7fa9cbfff640 1 -- 172.21.15.7:0/1816810006 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa9d0005040 con 0x5618fa289390 2024-09-21T06:46:28.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.497+0000 7fa9cbfff640 1 -- 172.21.15.7:0/1816810006 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9d0015050 con 0x5618fa289390 2024-09-21T06:46:28.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.497+0000 7fa9eeaf7740 1 -- 172.21.15.7:0/1816810006 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618fa289390 msgr2=0x5618fa65ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:28.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.497+0000 7fa9eeaf7740 1 --2- 172.21.15.7:0/1816810006 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618fa289390 0x5618fa65ec80 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7fa9d0011570 tx=0x7fa9d00115a0 comp rx=0 tx=0).stop 2024-09-21T06:46:28.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.497+0000 7fa9eeaf7740 1 -- 172.21.15.7:0/1816810006 shutdown_connections 2024-09-21T06:46:28.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.497+0000 7fa9eeaf7740 1 --2- 172.21.15.7:0/1816810006 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5618fa2aa070 0x5618fa669070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:28.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.497+0000 7fa9eeaf7740 1 --2- 172.21.15.7:0/1816810006 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618fa289390 0x5618fa65ec80 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:28.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.497+0000 7fa9eeaf7740 1 --2- 172.21.15.7:0/1816810006 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5618fa2811b0 0x5618fa65d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:28.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.497+0000 7fa9eeaf7740 1 -- 172.21.15.7:0/1816810006 >> 172.21.15.7:0/1816810006 conn(0x5618fa29e460 msgr2=0x5618fa6525a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:28.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.498+0000 7fa9eeaf7740 1 -- 172.21.15.7:0/1816810006 shutdown_connections 2024-09-21T06:46:28.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.498+0000 7fa9eeaf7740 1 -- 172.21.15.7:0/1816810006 wait complete. 2024-09-21T06:46:28.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.498+0000 7fa9eeaf7740 1 -- start start 2024-09-21T06:46:28.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.498+0000 7fa9eeaf7740 1 Processor -- start 2024-09-21T06:46:28.538 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.498+0000 7fa9eeaf7740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5618fa2811b0 0x5618fa6612d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:28.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.498+0000 7fa9eeaf7740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5618fa289390 0x5618fa661810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:28.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.498+0000 7fa9eeaf7740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618fa2aa070 0x5618fa661d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:28.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.498+0000 7fa9eeaf7740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa9e01afd90 con 0x5618fa2aa070 2024-09-21T06:46:28.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.498+0000 7fa9eeaf7740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa9e01b1200 con 0x5618fa289390 2024-09-21T06:46:28.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.498+0000 7fa9eeaf7740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa9e01b0460 con 0x5618fa2811b0 2024-09-21T06:46:28.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.498+0000 7fa9eeaf7740 10 client.0 _ll_register_callbacks cb 0x7fa9d8009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:46:28.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.498+0000 7fa9e6b20640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618fa2aa070 0x5618fa661d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:28.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.498+0000 7fa9e6b20640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618fa2aa070 0x5618fa661d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38360/0 (socket says 172.21.15.7:38360) 2024-09-21T06:46:28.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.498+0000 7fa9e6b20640 1 -- 172.21.15.7:0/1324375542 learned_addr learned my addr 172.21.15.7:0/1324375542 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:46:28.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.498+0000 7fa9e631f640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5618fa2811b0 0x5618fa6612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:28.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.499+0000 7fa9e5b1e640 1 --2- 172.21.15.7:0/1324375542 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5618fa289390 0x5618fa661810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:28.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.499+0000 7fa9e6b20640 1 -- 172.21.15.7:0/1324375542 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5618fa2811b0 msgr2=0x5618fa6612d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:28.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.499+0000 7fa9e6b20640 1 --2- 172.21.15.7:0/1324375542 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5618fa2811b0 0x5618fa6612d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:28.539 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.499+0000 7fa9e6b20640 1 -- 172.21.15.7:0/1324375542 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5618fa289390 msgr2=0x5618fa661810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:28.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.499+0000 7fa9e6b20640 1 --2- 172.21.15.7:0/1324375542 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5618fa289390 0x5618fa661810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:28.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.499+0000 7fa9e6b20640 1 -- 172.21.15.7:0/1324375542 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618fa6d8d00 con 0x5618fa2aa070 2024-09-21T06:46:28.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.499+0000 7fa9e6b20640 1 --2- 172.21.15.7:0/1324375542 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618fa2aa070 0x5618fa661d50 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7fa9d802a900 tx=0x7fa9d8004df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3662048260a4d04e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:28.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.499+0000 7fa9c9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:46:28.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.499+0000 7fa9c9ffb640 1 -- 172.21.15.7:0/1324375542 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9d804f070 con 0x5618fa2aa070 2024-09-21T06:46:28.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.499+0000 7fa9c9ffb640 1 -- 172.21.15.7:0/1324375542 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8412+0+0 (secure 0 0 0) 0x7fa9d80305c0 con 0x5618fa2aa070 2024-09-21T06:46:28.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.499+0000 7fa9eeaf7740 1 -- 172.21.15.7:0/1324375542 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa9d0005040 con 0x5618fa2aa070 2024-09-21T06:46:28.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.499+0000 7fa9c9ffb640 1 -- 172.21.15.7:0/1324375542 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa9d8031e90 con 0x5618fa2aa070 2024-09-21T06:46:28.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.499+0000 7fa9eeaf7740 10 client.17862 fetch_fsmap learned FSMap version 25 2024-09-21T06:46:28.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.499+0000 7fa9eeaf7740 1 -- 172.21.15.7:0/1324375542 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5618fa6d9ed0 con 0x5618fa2aa070 2024-09-21T06:46:28.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.500+0000 7fa9c9ffb640 1 -- 172.21.15.7:0/1324375542 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa9d0005040 con 0x5618fa2aa070 2024-09-21T06:46:28.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.500+0000 7fa9c9ffb640 1 -- 172.21.15.7:0/1324375542 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7fa9d8044070 con 0x5618fa2aa070 2024-09-21T06:46:28.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.500+0000 7fa9eeaf7740 10 client.17862 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:46:28.540 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.500+0000 7fa9eeaf7740 10 client.17862 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-21T06:46:28.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.500+0000 7fa9eeaf7740 20 client.17862 populate_metadata read hostname 'smithi007' 2024-09-21T06:46:28.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.500+0000 7fa9eeaf7740 1 --2- 172.21.15.7:0/1324375542 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x5618fa23dda0 0x5618fa6dc630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:28.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.500+0000 7fa9eeaf7740 4 client.17862 mds_command: new command op to 24688 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:46:28.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.500+0000 7fa9eeaf7740 1 -- 172.21.15.7:0/1324375542 --> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5618fa5c58a0 con 0x5618fa23dda0 2024-09-21T06:46:28.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.500+0000 7fa9e631f640 1 --2- 172.21.15.7:0/1324375542 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x5618fa23dda0 0x5618fa6dc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:28.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.501+0000 7fa9c9ffb640 10 client.17862 ms_handle_connect on v2:172.21.15.144:6838/4027821922 2024-09-21T06:46:28.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.501+0000 7fa9e631f640 1 --2- 172.21.15.7:0/1324375542 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x5618fa23dda0 0x5618fa6dc630 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6292c45c98e9c598 server_cookie=ecddde6700f4c3e0 in_seq=0 out_seq=0 2024-09-21T06:46:28.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.501+0000 7fa9c9ffb640 1 -- 172.21.15.7:0/1324375542 <== mds.1 v2:172.21.15.144:6838/4027821922 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5618fa5c58a0 con 0x5618fa23dda0 2024-09-21T06:46:28.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.501+0000 7fa9c9ffb640 10 client.17862 handle_command_reply: tid=0 2024-09-21T06:46:28.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.501+0000 7fa9eeaf7740 1 client.17862 shutdown 2024-09-21T06:46:28.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.501+0000 7fa9eeaf7740 1 -- 172.21.15.7:0/1324375542 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618fa2aa070 msgr2=0x5618fa661d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:28.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.501+0000 7fa9eeaf7740 1 --2- 172.21.15.7:0/1324375542 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618fa2aa070 0x5618fa661d50 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7fa9d802a900 tx=0x7fa9d8004df0 comp rx=0 tx=0).stop 2024-09-21T06:46:28.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.501+0000 7fa9eeaf7740 1 -- 172.21.15.7:0/1324375542 shutdown_connections 2024-09-21T06:46:28.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.501+0000 7fa9eeaf7740 1 --2- 172.21.15.7:0/1324375542 >> [v2:172.21.15.144:6838/4027821922,v1:172.21.15.144:6839/4027821922] conn(0x5618fa23dda0 0x5618fa6dc630 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:28.541 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.501+0000 7fa9eeaf7740 1 --2- 172.21.15.7:0/1324375542 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x5618fa2aa070 0x5618fa661d50 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:28.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.501+0000 7fa9eeaf7740 1 --2- 172.21.15.7:0/1324375542 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5618fa289390 0x5618fa661810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:28.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.501+0000 7fa9c9ffb640 0 client.17862 ms_handle_reset on v2:172.21.15.144:6838/4027821922 2024-09-21T06:46:28.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.501+0000 7fa9eeaf7740 1 --2- 172.21.15.7:0/1324375542 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x5618fa2811b0 0x5618fa6612d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:28.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.501+0000 7fa9eeaf7740 1 -- 172.21.15.7:0/1324375542 >> 172.21.15.7:0/1324375542 conn(0x5618fa29e460 msgr2=0x5618fa652f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:28.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.501+0000 7fa9eeaf7740 1 -- 172.21.15.7:0/1324375542 shutdown_connections 2024-09-21T06:46:28.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.501+0000 7fa9eeaf7740 1 -- 172.21.15.7:0/1324375542 wait complete. 2024-09-21T06:46:28.542 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:46:28.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.501+0000 7fa9eeaf7740 20 client.17862 trim_cache size 0 max 16384 2024-09-21T06:46:28.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.502+0000 7fa9e8583640 1 -- 172.21.15.7:0/761361155 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa9cc0b6680 msgr2=0x7fa9cc0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:28.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.502+0000 7fa9e8583640 1 --2- 172.21.15.7:0/761361155 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa9cc0b6680 0x7fa9cc0b8b90 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fa9d8006010 tx=0x7fa9d80093f0 comp rx=0 tx=0).stop 2024-09-21T06:46:28.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.502+0000 7fa9e8583640 1 -- 172.21.15.7:0/761361155 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9e0104a30 msgr2=0x7fa9e0102770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:28.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.502+0000 7fa9e8583640 1 --2- 172.21.15.7:0/761361155 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9e0104a30 0x7fa9e0102770 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc00d770 tx=0x7fa9dc00dc30 comp rx=0 tx=0).stop 2024-09-21T06:46:28.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.502+0000 7fa9e8583640 1 -- 172.21.15.7:0/761361155 shutdown_connections 2024-09-21T06:46:28.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.502+0000 7fa9e8583640 1 --2- 172.21.15.7:0/761361155 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa9cc0b6680 0x7fa9cc0b8b90 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:28.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.502+0000 7fa9e8583640 1 --2- 172.21.15.7:0/761361155 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa9e010de60 0x7fa9e01031f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:28.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.502+0000 7fa9e8583640 1 --2- 172.21.15.7:0/761361155 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9e0105380 0x7fa9e0102cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:28.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.502+0000 7fa9e8583640 1 --2- 172.21.15.7:0/761361155 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa9e0104a30 0x7fa9e0102770 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:28.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.502+0000 7fa9e8583640 1 -- 172.21.15.7:0/761361155 >> 172.21.15.7:0/761361155 conn(0x7fa9e0079760 msgr2=0x7fa9e01007e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:28.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.502+0000 7fa9e8583640 1 -- 172.21.15.7:0/761361155 shutdown_connections 2024-09-21T06:46:28.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:28.502+0000 7fa9e8583640 1 -- 172.21.15.7:0/761361155 wait complete. 2024-09-21T06:46:29.333 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:46:29 smithi007 ceph-mon[30983]: pgmap v635: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T06:46:29.369 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph tell mds.1:0 damage ls 2024-09-21T06:46:29.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:46:29 smithi018 ceph-mon[34477]: pgmap v635: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T06:46:29.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:46:29 smithi144 ceph-mon[34653]: pgmap v635: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T06:46:29.634 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:46:30.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.222+0000 7f49c50e3640 1 -- 172.21.15.7:0/1367007033 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49c0108d00 msgr2=0x7f49c010f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:30.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.222+0000 7f49c50e3640 1 --2- 172.21.15.7:0/1367007033 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49c0108d00 0x7f49c010f530 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f49b8009ca0 tx=0x7f49b802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:46:30.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.222+0000 7f49c50e3640 1 -- 172.21.15.7:0/1367007033 shutdown_connections 2024-09-21T06:46:30.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.222+0000 7f49c50e3640 1 --2- 172.21.15.7:0/1367007033 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49c0108d00 0x7f49c010f530 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:30.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.222+0000 7f49c50e3640 1 --2- 172.21.15.7:0/1367007033 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49c01083b0 0x7f49c01087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:30.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.222+0000 7f49c50e3640 1 --2- 172.21.15.7:0/1367007033 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f49c0102a70 0x7f49c0102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:30.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.222+0000 7f49c50e3640 1 -- 172.21.15.7:0/1367007033 >> 172.21.15.7:0/1367007033 conn(0x7f49c0079710 msgr2=0x7f49c0079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:30.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.222+0000 7f49c50e3640 1 -- 172.21.15.7:0/1367007033 shutdown_connections 2024-09-21T06:46:30.225 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.222+0000 7f49c50e3640 1 -- 172.21.15.7:0/1367007033 wait complete. 2024-09-21T06:46:30.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.223+0000 7f49c50e3640 1 Processor -- start 2024-09-21T06:46:30.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.223+0000 7f49c50e3640 1 -- start start 2024-09-21T06:46:30.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.223+0000 7f49c50e3640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49c0102a70 0x7f49c019a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:30.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.223+0000 7f49c50e3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f49c01083b0 0x7f49c019aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:30.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.223+0000 7f49c50e3640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49c0108d00 0x7f49c019fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:30.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.224+0000 7f49c50e3640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f49c01129c0 con 0x7f49c0108d00 2024-09-21T06:46:30.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.224+0000 7f49c50e3640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f49c0112840 con 0x7f49c01083b0 2024-09-21T06:46:30.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.224+0000 7f49c50e3640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f49c0112b40 con 0x7f49c0102a70 2024-09-21T06:46:30.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.224+0000 7f49bf59e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49c0108d00 0x7f49c019fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:30.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.224+0000 7f49bed9d640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49c0102a70 0x7f49c019a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:30.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.224+0000 7f49bed9d640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49c0102a70 0x7f49c019a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.144:3300/0 says I am v2:172.21.15.7:57964/0 (socket says 172.21.15.7:57964) 2024-09-21T06:46:30.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.224+0000 7f49bed9d640 1 -- 172.21.15.7:0/1840900507 learned_addr learned my addr 172.21.15.7:0/1840900507 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:46:30.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.224+0000 7f49be59c640 1 --2- 172.21.15.7:0/1840900507 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f49c01083b0 0x7f49c019aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:30.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.224+0000 7f49bf59e640 1 -- 172.21.15.7:0/1840900507 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49c0102a70 msgr2=0x7f49c019a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:30.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.224+0000 7f49bf59e640 1 --2- 172.21.15.7:0/1840900507 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49c0102a70 0x7f49c019a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:30.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.224+0000 7f49bf59e640 1 -- 172.21.15.7:0/1840900507 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f49c01083b0 msgr2=0x7f49c019aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:30.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.224+0000 7f49bf59e640 1 --2- 172.21.15.7:0/1840900507 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f49c01083b0 0x7f49c019aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:30.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.224+0000 7f49bf59e640 1 -- 172.21.15.7:0/1840900507 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49c01a0330 con 0x7f49c0108d00 2024-09-21T06:46:30.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.224+0000 7f49bf59e640 1 --2- 172.21.15.7:0/1840900507 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49c0108d00 0x7f49c019fcc0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f49b8009ca0 tx=0x7f49b80319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:30.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.225+0000 7f49a7fff640 1 -- 172.21.15.7:0/1840900507 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49b8003cf0 con 0x7f49c0108d00 2024-09-21T06:46:30.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.225+0000 7f49c50e3640 1 -- 172.21.15.7:0/1840900507 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49c01a05c0 con 0x7f49c0108d00 2024-09-21T06:46:30.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.225+0000 7f49a7fff640 1 -- 172.21.15.7:0/1840900507 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f49b80044f0 con 0x7f49c0108d00 2024-09-21T06:46:30.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.225+0000 7f49a7fff640 1 -- 172.21.15.7:0/1840900507 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49b802fce0 con 0x7f49c0108d00 2024-09-21T06:46:30.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.225+0000 7f49c50e3640 1 -- 172.21.15.7:0/1840900507 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49c01a6e40 con 0x7f49c0108d00 2024-09-21T06:46:30.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.227+0000 7f49cb657740 1 Processor -- start 2024-09-21T06:46:30.230 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.227+0000 7f49a7fff640 1 -- 172.21.15.7:0/1840900507 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f49b80305c0 con 0x7f49c0108d00 2024-09-21T06:46:30.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.227+0000 7f49cb657740 1 -- start start 2024-09-21T06:46:30.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.228+0000 7f49cb657740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1cf3bd070 0x55d1cf7646a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:30.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.228+0000 7f49cb657740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d1cf3941b0 0x55d1cf764be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:30.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.228+0000 7f49cb657740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d1cf39c390 0x55d1cf765120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:30.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.228+0000 7f49cb657740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55d1cf6daea0 con 0x55d1cf3bd070 2024-09-21T06:46:30.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.228+0000 7f49cb657740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55d1cf6ca2d0 con 0x55d1cf39c390 2024-09-21T06:46:30.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.228+0000 7f49cb657740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55d1cf6ce0e0 con 0x55d1cf3941b0 2024-09-21T06:46:30.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.228+0000 7f49be59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1cf3bd070 0x55d1cf7646a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:30.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.228+0000 7f49be59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1cf3bd070 0x55d1cf7646a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38386/0 (socket says 172.21.15.7:38386) 2024-09-21T06:46:30.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.228+0000 7f49be59c640 1 -- 172.21.15.7:0/1710660142 learned_addr learned my addr 172.21.15.7:0/1710660142 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:46:30.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.228+0000 7f49bed9d640 1 --2- 172.21.15.7:0/1710660142 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d1cf3941b0 0x55d1cf764be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:30.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.228+0000 7f49be59c640 1 --2- 172.21.15.7:0/1710660142 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d1cf39c390 0x55d1cf765120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:30.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.228+0000 7f49be59c640 1 -- 172.21.15.7:0/1710660142 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d1cf3941b0 msgr2=0x55d1cf764be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:30.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.228+0000 7f49be59c640 1 --2- 172.21.15.7:0/1710660142 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d1cf3941b0 0x55d1cf764be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:30.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.228+0000 7f49be59c640 1 -- 172.21.15.7:0/1710660142 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d1cf39c390 msgr2=0x55d1cf765120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:30.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.228+0000 7f49be59c640 1 --2- 172.21.15.7:0/1710660142 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d1cf39c390 0x55d1cf765120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:30.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.228+0000 7f49be59c640 1 -- 172.21.15.7:0/1710660142 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1cf428650 con 0x55d1cf3bd070 2024-09-21T06:46:30.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.228+0000 7f49a7fff640 1 --2- 172.21.15.7:0/1840900507 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f49a80b66b0 0x7f49a80b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:30.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.228+0000 7f49bed9d640 1 --2- 172.21.15.7:0/1710660142 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d1cf3941b0 0x55d1cf764be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T06:46:30.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.229+0000 7f49be59c640 1 --2- 172.21.15.7:0/1710660142 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1cf3bd070 0x55d1cf7646a0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f49b4013510 tx=0x7f49b400a6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4248cf4f6b22a46c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:30.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.229+0000 7f49bed9d640 1 --2- 172.21.15.7:0/1840900507 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f49a80b66b0 0x7f49a80b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:30.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.229+0000 7f49a7fff640 1 -- 172.21.15.7:0/1840900507 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8412+0+0 (secure 0 0 0) 0x7f49b81089e0 con 0x7f49c0108d00 2024-09-21T06:46:30.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.229+0000 7f49a57fa640 1 -- 172.21.15.7:0/1710660142 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49b4019030 con 0x55d1cf3bd070 2024-09-21T06:46:30.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.229+0000 7f49a57fa640 1 -- 172.21.15.7:0/1710660142 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f49b40110d0 con 0x55d1cf3bd070 2024-09-21T06:46:30.232 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.229+0000 7f49a57fa640 1 -- 172.21.15.7:0/1710660142 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49b4004cc0 con 0x55d1cf3bd070 2024-09-21T06:46:30.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.230+0000 7f49cb657740 1 -- 172.21.15.7:0/1710660142 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1cf3bd070 msgr2=0x55d1cf7646a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:30.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.230+0000 7f49bed9d640 1 --2- 172.21.15.7:0/1840900507 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f49a80b66b0 0x7f49a80b8bc0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x55d1cf763320 tx=0x7f49b000a380 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:30.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.230+0000 7f49cb657740 1 --2- 172.21.15.7:0/1710660142 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1cf3bd070 0x55d1cf7646a0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f49b4013510 tx=0x7f49b400a6e0 comp rx=0 tx=0).stop 2024-09-21T06:46:30.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.230+0000 7f49cb657740 1 -- 172.21.15.7:0/1710660142 shutdown_connections 2024-09-21T06:46:30.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.230+0000 7f49cb657740 1 --2- 172.21.15.7:0/1710660142 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d1cf39c390 0x55d1cf765120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:30.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.230+0000 7f49cb657740 1 --2- 172.21.15.7:0/1710660142 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d1cf3941b0 0x55d1cf764be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:30.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.230+0000 7f49cb657740 1 --2- 172.21.15.7:0/1710660142 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1cf3bd070 0x55d1cf7646a0 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:30.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.230+0000 7f49cb657740 1 -- 172.21.15.7:0/1710660142 >> 172.21.15.7:0/1710660142 conn(0x55d1cf3b1460 msgr2=0x55d1cf762590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:30.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.230+0000 7f49cb657740 1 -- 172.21.15.7:0/1710660142 shutdown_connections 2024-09-21T06:46:30.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.230+0000 7f49cb657740 1 -- 172.21.15.7:0/1710660142 wait complete. 2024-09-21T06:46:30.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.230+0000 7f49cb657740 1 -- start start 2024-09-21T06:46:30.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.230+0000 7f49cb657740 1 Processor -- start 2024-09-21T06:46:30.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.231+0000 7f49cb657740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d1cf3941b0 0x55d1cf7740c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:30.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.231+0000 7f49cb657740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1cf39c390 0x55d1cf774600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:30.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.231+0000 7f49cb657740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d1cf3bd070 0x55d1cf774b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:30.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.231+0000 7f49cb657740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x55d1cf52b700 con 0x55d1cf39c390 2024-09-21T06:46:30.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.231+0000 7f49cb657740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55d1cf665160 con 0x55d1cf3941b0 2024-09-21T06:46:30.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.231+0000 7f49cb657740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x55d1cf7771b0 con 0x55d1cf3bd070 2024-09-21T06:46:30.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.231+0000 7f49cb657740 10 client.0 _ll_register_callbacks cb 0x55d1cf67e9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:46:30.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.231+0000 7f49be59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1cf39c390 0x55d1cf774600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:30.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.231+0000 7f49be59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1cf39c390 0x55d1cf774600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38398/0 (socket says 172.21.15.7:38398) 2024-09-21T06:46:30.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.231+0000 7f49be59c640 1 -- 172.21.15.7:0/2113305763 learned_addr learned my addr 172.21.15.7:0/2113305763 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:46:30.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.231+0000 7f49bf59e640 1 --2- 172.21.15.7:0/2113305763 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d1cf3bd070 0x55d1cf774b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:30.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.231+0000 7f49bed9d640 1 --2- 172.21.15.7:0/2113305763 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d1cf3941b0 0x55d1cf7740c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:30.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.231+0000 7f49be59c640 1 -- 172.21.15.7:0/2113305763 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d1cf3bd070 msgr2=0x55d1cf774b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:30.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.231+0000 7f49be59c640 1 --2- 172.21.15.7:0/2113305763 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d1cf3bd070 0x55d1cf774b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:30.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.231+0000 7f49be59c640 1 -- 172.21.15.7:0/2113305763 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d1cf3941b0 msgr2=0x55d1cf7740c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:30.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.231+0000 7f49be59c640 1 --2- 172.21.15.7:0/2113305763 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d1cf3941b0 0x55d1cf7740c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:30.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.231+0000 7f49be59c640 1 -- 172.21.15.7:0/2113305763 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1cf692c90 con 0x55d1cf39c390 2024-09-21T06:46:30.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.231+0000 7f49be59c640 1 --2- 172.21.15.7:0/2113305763 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1cf39c390 0x55d1cf774600 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f49b400ad70 tx=0x7f49b400ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd66b564ce89c67 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:30.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.231+0000 7f49a2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:46:30.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.231+0000 7f49a2ff5640 1 -- 172.21.15.7:0/2113305763 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49b4019040 con 0x55d1cf39c390 2024-09-21T06:46:30.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.232+0000 7f49a2ff5640 1 -- 172.21.15.7:0/2113305763 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8412+0+0 (secure 0 0 0) 0x7f49b4004bc0 con 0x55d1cf39c390 2024-09-21T06:46:30.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.232+0000 7f49cb657740 1 -- 172.21.15.7:0/2113305763 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f49b40110d0 con 0x55d1cf39c390 2024-09-21T06:46:30.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.232+0000 7f49a2ff5640 1 -- 172.21.15.7:0/2113305763 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f49b4004dc0 con 0x55d1cf39c390 2024-09-21T06:46:30.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.232+0000 7f49cb657740 10 client.17874 fetch_fsmap learned FSMap version 25 2024-09-21T06:46:30.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.232+0000 7f49cb657740 1 -- 172.21.15.7:0/2113305763 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d1cf782ea0 con 0x55d1cf39c390 2024-09-21T06:46:30.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.232+0000 7f49a2ff5640 1 -- 172.21.15.7:0/2113305763 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f49b40110d0 con 0x55d1cf39c390 2024-09-21T06:46:30.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.232+0000 7f49a2ff5640 1 -- 172.21.15.7:0/2113305763 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f49b4025070 con 0x55d1cf39c390 2024-09-21T06:46:30.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.232+0000 7f49cb657740 10 client.17874 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:46:30.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.232+0000 7f49cb657740 10 client.17874 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:46:30.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.232+0000 7f49cb657740 20 client.17874 populate_metadata read hostname 'smithi007' 2024-09-21T06:46:30.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.232+0000 7f49cb657740 1 --2- 172.21.15.7:0/2113305763 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55d1cf37b9f0 0x55d1cf786200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:30.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.232+0000 7f49cb657740 4 client.17874 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T06:46:30.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.232+0000 7f49cb657740 1 -- 172.21.15.7:0/2113305763 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d1cf6dcdf0 con 0x55d1cf37b9f0 2024-09-21T06:46:30.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.232+0000 7f49bed9d640 1 --2- 172.21.15.7:0/2113305763 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55d1cf37b9f0 0x55d1cf786200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:30.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.233+0000 7f49bed9d640 1 --2- 172.21.15.7:0/2113305763 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55d1cf37b9f0 0x55d1cf786200 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6198a3db51fa1aa8 server_cookie=aed12d7312bbbcc0 in_seq=0 out_seq=0 2024-09-21T06:46:30.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.233+0000 7f49a2ff5640 10 client.17874 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:46:30.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.234+0000 7f49a2ff5640 1 -- 172.21.15.7:0/2113305763 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d1cf6dcdf0 con 0x55d1cf37b9f0 2024-09-21T06:46:30.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.234+0000 7f49a2ff5640 10 client.17874 handle_command_reply: tid=0 2024-09-21T06:46:30.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.234+0000 7f49cb657740 1 client.17874 shutdown 2024-09-21T06:46:30.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.234+0000 7f49cb657740 1 -- 172.21.15.7:0/2113305763 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1cf39c390 msgr2=0x55d1cf774600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:30.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.234+0000 7f49cb657740 1 --2- 172.21.15.7:0/2113305763 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1cf39c390 0x55d1cf774600 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f49b400ad70 tx=0x7f49b400ada0 comp rx=0 tx=0).stop 2024-09-21T06:46:30.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.234+0000 7f49cb657740 1 -- 172.21.15.7:0/2113305763 shutdown_connections 2024-09-21T06:46:30.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.234+0000 7f49cb657740 1 --2- 172.21.15.7:0/2113305763 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55d1cf37b9f0 0x55d1cf786200 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:30.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.234+0000 7f49cb657740 1 --2- 172.21.15.7:0/2113305763 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d1cf3bd070 0x55d1cf774b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:30.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.234+0000 7f49cb657740 1 --2- 172.21.15.7:0/2113305763 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1cf39c390 0x55d1cf774600 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:30.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.234+0000 7f49cb657740 1 --2- 172.21.15.7:0/2113305763 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d1cf3941b0 0x55d1cf7740c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:30.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.234+0000 7f49cb657740 1 -- 172.21.15.7:0/2113305763 >> 172.21.15.7:0/2113305763 conn(0x55d1cf3b1460 msgr2=0x55d1cf760bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:30.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.234+0000 7f49a2ff5640 0 client.17874 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:46:30.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.234+0000 7f49cb657740 1 -- 172.21.15.7:0/2113305763 shutdown_connections 2024-09-21T06:46:30.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.234+0000 7f49cb657740 1 -- 172.21.15.7:0/2113305763 wait complete. 2024-09-21T06:46:30.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.234+0000 7f49cb657740 20 client.17874 trim_cache size 0 max 16384 2024-09-21T06:46:30.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.247+0000 7f49cb657740 1 Processor -- start 2024-09-21T06:46:30.249 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.247+0000 7f49cb657740 1 -- start start 2024-09-21T06:46:30.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.247+0000 7f49cb657740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d1cf3941b0 0x55d1cf766090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:30.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.247+0000 7f49cb657740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1cf39c390 0x55d1cf77fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:30.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.247+0000 7f49cb657740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d1cf3bd070 0x55d1cf780050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:30.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.247+0000 7f49cb657740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f49c01afbc0 con 0x55d1cf39c390 2024-09-21T06:46:30.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.247+0000 7f49cb657740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f49c01ad490 con 0x55d1cf3bd070 2024-09-21T06:46:30.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.247+0000 7f49cb657740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f49c01ab300 con 0x55d1cf3941b0 2024-09-21T06:46:30.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.248+0000 7f49be59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1cf39c390 0x55d1cf77fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:30.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.248+0000 7f49be59c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1cf39c390 0x55d1cf77fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38408/0 (socket says 172.21.15.7:38408) 2024-09-21T06:46:30.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.248+0000 7f49be59c640 1 -- 172.21.15.7:0/3355281526 learned_addr learned my addr 172.21.15.7:0/3355281526 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:46:30.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.248+0000 7f49bed9d640 1 --2- 172.21.15.7:0/3355281526 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d1cf3941b0 0x55d1cf766090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:30.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.248+0000 7f49bf59e640 1 --2- 172.21.15.7:0/3355281526 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d1cf3bd070 0x55d1cf780050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:30.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.248+0000 7f49be59c640 1 -- 172.21.15.7:0/3355281526 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d1cf3941b0 msgr2=0x55d1cf766090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:30.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.248+0000 7f49be59c640 1 --2- 172.21.15.7:0/3355281526 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d1cf3941b0 0x55d1cf766090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:30.250 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.248+0000 7f49be59c640 1 -- 172.21.15.7:0/3355281526 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d1cf3bd070 msgr2=0x55d1cf780050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:30.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.248+0000 7f49be59c640 1 --2- 172.21.15.7:0/3355281526 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d1cf3bd070 0x55d1cf780050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:30.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.248+0000 7f49be59c640 1 -- 172.21.15.7:0/3355281526 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d1cf786660 con 0x55d1cf39c390 2024-09-21T06:46:30.251 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.248+0000 7f49bf59e640 1 --2- 172.21.15.7:0/3355281526 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d1cf3bd070 0x55d1cf780050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:46:30.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.248+0000 7f49be59c640 1 --2- 172.21.15.7:0/3355281526 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1cf39c390 0x55d1cf77fb10 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f49b400a690 tx=0x7f49b4005330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26db291d61656b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:30.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.248+0000 7f49a4ff9640 1 -- 172.21.15.7:0/3355281526 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49b4034070 con 0x55d1cf39c390 2024-09-21T06:46:30.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.248+0000 7f49a4ff9640 1 -- 172.21.15.7:0/3355281526 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f49b401e460 con 0x55d1cf39c390 2024-09-21T06:46:30.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.248+0000 7f49a4ff9640 1 -- 172.21.15.7:0/3355281526 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49b4011b60 con 0x55d1cf39c390 2024-09-21T06:46:30.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.249+0000 7f49cb657740 1 -- 172.21.15.7:0/3355281526 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1cf39c390 msgr2=0x55d1cf77fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:30.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.249+0000 7f49cb657740 1 --2- 172.21.15.7:0/3355281526 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1cf39c390 0x55d1cf77fb10 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f49b400a690 tx=0x7f49b4005330 comp rx=0 tx=0).stop 2024-09-21T06:46:30.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.249+0000 7f49cb657740 1 -- 172.21.15.7:0/3355281526 shutdown_connections 2024-09-21T06:46:30.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.249+0000 7f49cb657740 1 --2- 172.21.15.7:0/3355281526 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d1cf3bd070 0x55d1cf780050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:30.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.249+0000 7f49cb657740 1 --2- 172.21.15.7:0/3355281526 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1cf39c390 0x55d1cf77fb10 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:30.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.249+0000 7f49cb657740 1 --2- 172.21.15.7:0/3355281526 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d1cf3941b0 0x55d1cf766090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:30.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.249+0000 7f49cb657740 1 -- 172.21.15.7:0/3355281526 >> 172.21.15.7:0/3355281526 conn(0x55d1cf3b1460 msgr2=0x55d1cf77f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:30.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.249+0000 7f49cb657740 1 -- 172.21.15.7:0/3355281526 shutdown_connections 2024-09-21T06:46:30.254 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.249+0000 7f49cb657740 1 -- 172.21.15.7:0/3355281526 wait complete. 2024-09-21T06:46:30.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.249+0000 7f49cb657740 1 -- start start 2024-09-21T06:46:30.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.250+0000 7f49cb657740 1 Processor -- start 2024-09-21T06:46:30.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.250+0000 7f49cb657740 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d1cf3941b0 0x55d1cf77cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:30.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.250+0000 7f49cb657740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d1cf39c390 0x55d1cf778150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:30.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.250+0000 7f49cb657740 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1cf3bd070 0x55d1cf7786d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:30.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.250+0000 7f49cb657740 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f49c01ab950 con 0x55d1cf3bd070 2024-09-21T06:46:30.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.250+0000 7f49cb657740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f49c01acdc0 con 0x55d1cf39c390 2024-09-21T06:46:30.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.250+0000 7f49cb657740 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f49c01ac020 con 0x55d1cf3941b0 2024-09-21T06:46:30.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.250+0000 7f49cb657740 10 client.0 _ll_register_callbacks cb 0x7f49b000a6e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T06:46:30.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.250+0000 7f49bf59e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1cf3bd070 0x55d1cf7786d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:30.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.250+0000 7f49be59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d1cf39c390 0x55d1cf778150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:30.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.250+0000 7f49bf59e640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1cf3bd070 0x55d1cf7786d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:38416/0 (socket says 172.21.15.7:38416) 2024-09-21T06:46:30.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.250+0000 7f49bf59e640 1 -- 172.21.15.7:0/898910043 learned_addr learned my addr 172.21.15.7:0/898910043 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:46:30.255 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.250+0000 7f49bed9d640 1 --2- 172.21.15.7:0/898910043 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d1cf3941b0 0x55d1cf77cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:30.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.250+0000 7f49bf59e640 1 -- 172.21.15.7:0/898910043 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d1cf3941b0 msgr2=0x55d1cf77cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:30.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.250+0000 7f49bf59e640 1 --2- 172.21.15.7:0/898910043 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d1cf3941b0 0x55d1cf77cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:30.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.250+0000 7f49bf59e640 1 -- 172.21.15.7:0/898910043 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d1cf39c390 msgr2=0x55d1cf778150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T06:46:30.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.250+0000 7f49bf59e640 1 --2- 172.21.15.7:0/898910043 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d1cf39c390 0x55d1cf778150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:30.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.250+0000 7f49bf59e640 1 -- 172.21.15.7:0/898910043 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1cf778e60 con 0x55d1cf3bd070 2024-09-21T06:46:30.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.251+0000 7f49bf59e640 1 --2- 172.21.15.7:0/898910043 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1cf3bd070 0x55d1cf7786d0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f49b802ade0 tx=0x7f49b80ca870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c892a78f0625fa90 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:30.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.251+0000 7f49a2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.7:3300/0 2024-09-21T06:46:30.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.251+0000 7f49a2ff5640 1 -- 172.21.15.7:0/898910043 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49b802f660 con 0x55d1cf3bd070 2024-09-21T06:46:30.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.251+0000 7f49a2ff5640 1 -- 172.21.15.7:0/898910043 <== mon.0 v2:172.21.15.7:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8412+0+0 (secure 0 0 0) 0x7f49b80cfbd0 con 0x55d1cf3bd070 2024-09-21T06:46:30.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.251+0000 7f49cb657740 1 -- 172.21.15.7:0/898910043 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d1cf6d88a0 con 0x55d1cf3bd070 2024-09-21T06:46:30.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.251+0000 7f49a2ff5640 1 -- 172.21.15.7:0/898910043 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f49b80098d0 con 0x55d1cf3bd070 2024-09-21T06:46:30.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.251+0000 7f49cb657740 10 client.17880 fetch_fsmap learned FSMap version 25 2024-09-21T06:46:30.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.251+0000 7f49cb657740 1 -- 172.21.15.7:0/898910043 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d1cf7f0ad0 con 0x55d1cf3bd070 2024-09-21T06:46:30.256 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.251+0000 7f49a2ff5640 1 -- 172.21.15.7:0/898910043 <== mon.0 v2:172.21.15.7:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55d1cf6d88a0 con 0x55d1cf3bd070 2024-09-21T06:46:30.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.251+0000 7f49a2ff5640 1 -- 172.21.15.7:0/898910043 <== mon.0 v2:172.21.15.7:3300/0 5 ==== fsmap(e 25) ==== 8346+0+0 (secure 0 0 0) 0x7f49b80d7e30 con 0x55d1cf3bd070 2024-09-21T06:46:30.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.251+0000 7f49cb657740 10 client.17880 fetch_fsmap finished waiting for FSMap version 25 2024-09-21T06:46:30.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.251+0000 7f49cb657740 10 client.17880 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-21T06:46:30.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.251+0000 7f49cb657740 20 client.17880 populate_metadata read hostname 'smithi007' 2024-09-21T06:46:30.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.251+0000 7f49cb657740 1 --2- 172.21.15.7:0/898910043 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55d1cf350da0 0x55d1cf7f32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:30.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.251+0000 7f49cb657740 4 client.17880 mds_command: new command op to 24716 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-21T06:46:30.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.251+0000 7f49cb657740 1 -- 172.21.15.7:0/898910043 --> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d1cf6d5cd0 con 0x55d1cf350da0 2024-09-21T06:46:30.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.252+0000 7f49bed9d640 1 --2- 172.21.15.7:0/898910043 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55d1cf350da0 0x55d1cf7f32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:30.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.252+0000 7f49a2ff5640 10 client.17880 ms_handle_connect on v2:172.21.15.18:6838/3798713532 2024-09-21T06:46:30.257 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.252+0000 7f49bed9d640 1 --2- 172.21.15.7:0/898910043 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55d1cf350da0 0x55d1cf7f32c0 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=33e378d2e6959e84 server_cookie=faa32e4273db39f3 in_seq=0 out_seq=0 2024-09-21T06:46:30.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.252+0000 7f49a2ff5640 1 -- 172.21.15.7:0/898910043 <== mds.0 v2:172.21.15.18:6838/3798713532 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d1cf6d5cd0 con 0x55d1cf350da0 2024-09-21T06:46:30.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.252+0000 7f49a2ff5640 10 client.17880 handle_command_reply: tid=0 2024-09-21T06:46:30.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.252+0000 7f49cb657740 1 client.17880 shutdown 2024-09-21T06:46:30.258 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.253+0000 7f49cb657740 1 -- 172.21.15.7:0/898910043 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1cf3bd070 msgr2=0x55d1cf7786d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:30.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.253+0000 7f49cb657740 1 --2- 172.21.15.7:0/898910043 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1cf3bd070 0x55d1cf7786d0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f49b802ade0 tx=0x7f49b80ca870 comp rx=0 tx=0).stop 2024-09-21T06:46:30.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.253+0000 7f49cb657740 1 -- 172.21.15.7:0/898910043 shutdown_connections 2024-09-21T06:46:30.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.253+0000 7f49cb657740 1 --2- 172.21.15.7:0/898910043 >> [v2:172.21.15.18:6838/3798713532,v1:172.21.15.18:6839/3798713532] conn(0x55d1cf350da0 0x55d1cf7f32c0 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:30.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.253+0000 7f49cb657740 1 --2- 172.21.15.7:0/898910043 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x55d1cf3bd070 0x55d1cf7786d0 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:30.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.253+0000 7f49cb657740 1 --2- 172.21.15.7:0/898910043 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d1cf39c390 0x55d1cf778150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:30.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.253+0000 7f49cb657740 1 --2- 172.21.15.7:0/898910043 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x55d1cf3941b0 0x55d1cf77cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:30.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.253+0000 7f49cb657740 1 -- 172.21.15.7:0/898910043 >> 172.21.15.7:0/898910043 conn(0x55d1cf3b1460 msgr2=0x55d1cf765e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:30.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.253+0000 7f49a2ff5640 0 client.17880 ms_handle_reset on v2:172.21.15.18:6838/3798713532 2024-09-21T06:46:30.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.253+0000 7f49cb657740 1 -- 172.21.15.7:0/898910043 shutdown_connections 2024-09-21T06:46:30.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.253+0000 7f49cb657740 1 -- 172.21.15.7:0/898910043 wait complete. 2024-09-21T06:46:30.259 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.253+0000 7f49cb657740 20 client.17880 trim_cache size 0 max 16384 2024-09-21T06:46:30.260 INFO:teuthology.orchestra.run.smithi007.stdout:[] 2024-09-21T06:46:30.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.253+0000 7f49c50e3640 1 -- 172.21.15.7:0/1840900507 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f49a80b66b0 msgr2=0x7f49a80b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:30.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.253+0000 7f49c50e3640 1 --2- 172.21.15.7:0/1840900507 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f49a80b66b0 0x7f49a80b8bc0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x55d1cf763320 tx=0x7f49b000a380 comp rx=0 tx=0).stop 2024-09-21T06:46:30.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.253+0000 7f49c50e3640 1 -- 172.21.15.7:0/1840900507 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49c0108d00 msgr2=0x7f49c019fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:30.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.253+0000 7f49c50e3640 1 --2- 172.21.15.7:0/1840900507 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49c0108d00 0x7f49c019fcc0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f49b8009ca0 tx=0x7f49b80319f0 comp rx=0 tx=0).stop 2024-09-21T06:46:30.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.253+0000 7f49c50e3640 1 -- 172.21.15.7:0/1840900507 shutdown_connections 2024-09-21T06:46:30.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.253+0000 7f49c50e3640 1 --2- 172.21.15.7:0/1840900507 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f49a80b66b0 0x7f49a80b8bc0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:30.260 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.253+0000 7f49c50e3640 1 --2- 172.21.15.7:0/1840900507 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f49c0108d00 0x7f49c019fcc0 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:30.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.253+0000 7f49c50e3640 1 --2- 172.21.15.7:0/1840900507 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f49c01083b0 0x7f49c019aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:30.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.253+0000 7f49c50e3640 1 --2- 172.21.15.7:0/1840900507 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f49c0102a70 0x7f49c019a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:30.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.253+0000 7f49c50e3640 1 -- 172.21.15.7:0/1840900507 >> 172.21.15.7:0/1840900507 conn(0x7f49c0079710 msgr2=0x7f49c0101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:30.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.254+0000 7f49c50e3640 1 -- 172.21.15.7:0/1840900507 shutdown_connections 2024-09-21T06:46:30.261 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:30.254+0000 7f49c50e3640 1 -- 172.21.15.7:0/1840900507 wait complete. 2024-09-21T06:46:31.082 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:46:31 smithi007 ceph-mon[30983]: pgmap v636: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T06:46:31.084 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks/fwd_scrub.py", line 49, in do_scrub self.sleep_unless_stopped(self.sleep_between_iterations) File "/home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks/thrasher.py", line 50, in sleep_unless_stopped raise self.Stopped() tasks.thrasher.ThrasherGreenlet.Stopped 2024-09-21T06:46:31.084 INFO:tasks.fwd_scrub:done joining 2024-09-21T06:46:31.084 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-21T06:46:31.102 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T06:46:31.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.221+0000 7fb609f8a640 1 -- 172.21.15.7:0/4250165765 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb604109410 msgr2=0x7fb604109820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:31.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.221+0000 7fb609f8a640 1 --2- 172.21.15.7:0/4250165765 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb604109410 0x7fb604109820 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7fb5f8009900 tx=0x7fb5f802a410 comp rx=0 tx=0).stop 2024-09-21T06:46:31.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.221+0000 7fb609f8a640 1 -- 172.21.15.7:0/4250165765 shutdown_connections 2024-09-21T06:46:31.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.221+0000 7fb609f8a640 1 --2- 172.21.15.7:0/4250165765 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb604109d60 0x7fb604110590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:31.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.221+0000 7fb609f8a640 1 --2- 172.21.15.7:0/4250165765 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb604109410 0x7fb604109820 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:31.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.221+0000 7fb609f8a640 1 --2- 172.21.15.7:0/4250165765 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb604103ae0 0x7fb604103ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:31.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.221+0000 7fb609f8a640 1 -- 172.21.15.7:0/4250165765 >> 172.21.15.7:0/4250165765 conn(0x7fb60407a990 msgr2=0x7fb60407ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:31.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.221+0000 7fb609f8a640 1 -- 172.21.15.7:0/4250165765 shutdown_connections 2024-09-21T06:46:31.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.221+0000 7fb609f8a640 1 -- 172.21.15.7:0/4250165765 wait complete. 2024-09-21T06:46:31.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.222+0000 7fb609f8a640 1 Processor -- start 2024-09-21T06:46:31.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.222+0000 7fb609f8a640 1 -- start start 2024-09-21T06:46:31.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.222+0000 7fb609f8a640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb604103ae0 0x7fb604075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:31.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.222+0000 7fb609f8a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb604109410 0x7fb604075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:31.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.222+0000 7fb609f8a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb604109d60 0x7fb604076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:31.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.222+0000 7fb609f8a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb604113a20 con 0x7fb604109410 2024-09-21T06:46:31.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.222+0000 7fb609f8a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb6041138a0 con 0x7fb604109d60 2024-09-21T06:46:31.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.222+0000 7fb609f8a640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb604113ba0 con 0x7fb604103ae0 2024-09-21T06:46:31.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.222+0000 7fb602ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb604109410 0x7fb604075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:31.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.222+0000 7fb602ffd640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb604109410 0x7fb604075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57260/0 (socket says 172.21.15.7:57260) 2024-09-21T06:46:31.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.222+0000 7fb602ffd640 1 -- 172.21.15.7:0/4200236682 learned_addr learned my addr 172.21.15.7:0/4200236682 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:46:31.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.222+0000 7fb603fff640 1 --2- 172.21.15.7:0/4200236682 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb604109d60 0x7fb604076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:31.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.222+0000 7fb6037fe640 1 --2- 172.21.15.7:0/4200236682 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb604103ae0 0x7fb604075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:31.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.223+0000 7fb602ffd640 1 -- 172.21.15.7:0/4200236682 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb604103ae0 msgr2=0x7fb604075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:31.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.223+0000 7fb602ffd640 1 --2- 172.21.15.7:0/4200236682 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb604103ae0 0x7fb604075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:31.227 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.223+0000 7fb602ffd640 1 -- 172.21.15.7:0/4200236682 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb604109d60 msgr2=0x7fb604076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:31.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.223+0000 7fb602ffd640 1 --2- 172.21.15.7:0/4200236682 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb604109d60 0x7fb604076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:31.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.223+0000 7fb602ffd640 1 -- 172.21.15.7:0/4200236682 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6041a86f0 con 0x7fb604109410 2024-09-21T06:46:31.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.223+0000 7fb602ffd640 1 --2- 172.21.15.7:0/4200236682 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb604109410 0x7fb604075c50 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7fb5f802a930 tx=0x7fb5f8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:31.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.223+0000 7fb600ff9640 1 -- 172.21.15.7:0/4200236682 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f803f030 con 0x7fb604109410 2024-09-21T06:46:31.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.223+0000 7fb609f8a640 1 -- 172.21.15.7:0/4200236682 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6041a8980 con 0x7fb604109410 2024-09-21T06:46:31.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.223+0000 7fb600ff9640 1 -- 172.21.15.7:0/4200236682 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb5f8003aa0 con 0x7fb604109410 2024-09-21T06:46:31.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.223+0000 7fb600ff9640 1 -- 172.21.15.7:0/4200236682 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f8035070 con 0x7fb604109410 2024-09-21T06:46:31.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.223+0000 7fb609f8a640 1 -- 172.21.15.7:0/4200236682 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6041a8e70 con 0x7fb604109410 2024-09-21T06:46:31.228 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.224+0000 7fb609f8a640 1 -- 172.21.15.7:0/4200236682 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb604103ef0 con 0x7fb604109410 2024-09-21T06:46:31.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.226+0000 7fb600ff9640 1 -- 172.21.15.7:0/4200236682 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7fb5f8042030 con 0x7fb604109410 2024-09-21T06:46:31.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.227+0000 7fb600ff9640 1 --2- 172.21.15.7:0/4200236682 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fb5ec0b66b0 0x7fb5ec0b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:31.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.227+0000 7fb6037fe640 1 --2- 172.21.15.7:0/4200236682 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fb5ec0b66b0 0x7fb5ec0b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:31.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.227+0000 7fb600ff9640 1 -- 172.21.15.7:0/4200236682 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8412+0+0 (secure 0 0 0) 0x7fb5f8108060 con 0x7fb604109410 2024-09-21T06:46:31.229 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.227+0000 7fb6037fe640 1 --2- 172.21.15.7:0/4200236682 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fb5ec0b66b0 0x7fb5ec0b8bc0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fb604077160 tx=0x7fb5f400b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:31.231 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.230+0000 7fb600ff9640 1 -- 172.21.15.7:0/4200236682 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb5f80d2aa0 con 0x7fb604109410 2024-09-21T06:46:31.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:46:31 smithi018 ceph-mon[34477]: pgmap v636: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T06:46:31.424 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.423+0000 7fb609f8a640 1 -- 172.21.15.7:0/4200236682 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb60402e640 con 0x7fb604109410 2024-09-21T06:46:31.426 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.424+0000 7fb600ff9640 1 -- 172.21.15.7:0/4200236682 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+22881 (secure 0 0 0) 0x7fb5f80d5e20 con 0x7fb604109410 2024-09-21T06:46:31.426 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:46:31.427 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":85,"fsid":"347cb918-77e2-11ef-baf5-efdc52797490","created":"2024-09-21T06:25:51.925032+0000","modified":"2024-09-21T06:46:22.919218+0000","last_up_change":"2024-09-21T06:33:32.888843+0000","last_in_change":"2024-09-21T06:33:09.926778+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:29:41.514179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:34:20.531755+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T06:34:22.552541+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":84,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1be5c4a4-3931-4d8b-95c7-c05f5b73fcfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":942632794},{"type":"v1","addr":"172.21.15.7:6803","nonce":942632794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":942632794},{"type":"v1","addr":"172.21.15.7:6805","nonce":942632794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":942632794},{"type":"v1","addr":"172.21.15.7:6809","nonce":942632794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":942632794},{"type":"v1","addr":"172.21.15.7:6807","nonce":942632794}]},"public_addr":"172.21.15.7:6803/942632794","cluster_addr":"172.21.15.7:6805/942632794","heartbeat_back_addr":"172.21.15.7:6809/942632794","heartbeat_front_addr":"172.21.15.7:6807/942632794","state":["exists","up"]},{"osd":1,"uuid":"7ae136a8-c614-47e5-b265-c6cfa857a7fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1839342931},{"type":"v1","addr":"172.21.15.18:6801","nonce":1839342931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1839342931},{"type":"v1","addr":"172.21.15.18:6803","nonce":1839342931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1839342931},{"type":"v1","addr":"172.21.15.18:6807","nonce":1839342931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1839342931},{"type":"v1","addr":"172.21.15.18:6805","nonce":1839342931}]},"public_addr":"172.21.15.18:6801/1839342931","cluster_addr":"172.21.15.18:6803/1839342931","heartbeat_back_addr":"172.21.15.18:6807/1839342931","heartbeat_front_addr":"172.21.15.18:6805/1839342931","state":["exists","up"]},{"osd":2,"uuid":"97b13994-4680-4573-9c2e-ac65ea740e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":1699582162},{"type":"v1","addr":"172.21.15.144:6801","nonce":1699582162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":1699582162},{"type":"v1","addr":"172.21.15.144:6803","nonce":1699582162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":1699582162},{"type":"v1","addr":"172.21.15.144:6807","nonce":1699582162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":1699582162},{"type":"v1","addr":"172.21.15.144:6805","nonce":1699582162}]},"public_addr":"172.21.15.144:6801/1699582162","cluster_addr":"172.21.15.144:6803/1699582162","heartbeat_back_addr":"172.21.15.144:6807/1699582162","heartbeat_front_addr":"172.21.15.144:6805/1699582162","state":["exists","up"]},{"osd":3,"uuid":"ddf70d51-404d-491d-a6a8-15fca4ef01db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":3202935163},{"type":"v1","addr":"172.21.15.7:6811","nonce":3202935163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":3202935163},{"type":"v1","addr":"172.21.15.7:6813","nonce":3202935163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":3202935163},{"type":"v1","addr":"172.21.15.7:6817","nonce":3202935163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":3202935163},{"type":"v1","addr":"172.21.15.7:6815","nonce":3202935163}]},"public_addr":"172.21.15.7:6811/3202935163","cluster_addr":"172.21.15.7:6813/3202935163","heartbeat_back_addr":"172.21.15.7:6817/3202935163","heartbeat_front_addr":"172.21.15.7:6815/3202935163","state":["exists","up"]},{"osd":4,"uuid":"f2ae4340-accf-4ac0-a4d3-c08302712ce1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1058105724},{"type":"v1","addr":"172.21.15.18:6809","nonce":1058105724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":1058105724},{"type":"v1","addr":"172.21.15.18:6811","nonce":1058105724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":1058105724},{"type":"v1","addr":"172.21.15.18:6815","nonce":1058105724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":1058105724},{"type":"v1","addr":"172.21.15.18:6813","nonce":1058105724}]},"public_addr":"172.21.15.18:6809/1058105724","cluster_addr":"172.21.15.18:6811/1058105724","heartbeat_back_addr":"172.21.15.18:6815/1058105724","heartbeat_front_addr":"172.21.15.18:6813/1058105724","state":["exists","up"]},{"osd":5,"uuid":"d56abc37-de6f-47a4-9f5e-67224da78f4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":2814586621},{"type":"v1","addr":"172.21.15.144:6809","nonce":2814586621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":2814586621},{"type":"v1","addr":"172.21.15.144:6811","nonce":2814586621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":2814586621},{"type":"v1","addr":"172.21.15.144:6815","nonce":2814586621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":2814586621},{"type":"v1","addr":"172.21.15.144:6813","nonce":2814586621}]},"public_addr":"172.21.15.144:6809/2814586621","cluster_addr":"172.21.15.144:6811/2814586621","heartbeat_back_addr":"172.21.15.144:6815/2814586621","heartbeat_front_addr":"172.21.15.144:6813/2814586621","state":["exists","up"]},{"osd":6,"uuid":"9145650c-e9b1-4e5a-ae6f-17c8960146e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":3770978305},{"type":"v1","addr":"172.21.15.7:6819","nonce":3770978305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":3770978305},{"type":"v1","addr":"172.21.15.7:6821","nonce":3770978305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3770978305},{"type":"v1","addr":"172.21.15.7:6825","nonce":3770978305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":3770978305},{"type":"v1","addr":"172.21.15.7:6823","nonce":3770978305}]},"public_addr":"172.21.15.7:6819/3770978305","cluster_addr":"172.21.15.7:6821/3770978305","heartbeat_back_addr":"172.21.15.7:6825/3770978305","heartbeat_front_addr":"172.21.15.7:6823/3770978305","state":["exists","up"]},{"osd":7,"uuid":"ca658683-38f7-47ca-b32e-512fe4738ef1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":1322408496},{"type":"v1","addr":"172.21.15.18:6817","nonce":1322408496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1322408496},{"type":"v1","addr":"172.21.15.18:6819","nonce":1322408496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1322408496},{"type":"v1","addr":"172.21.15.18:6823","nonce":1322408496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1322408496},{"type":"v1","addr":"172.21.15.18:6821","nonce":1322408496}]},"public_addr":"172.21.15.18:6817/1322408496","cluster_addr":"172.21.15.18:6819/1322408496","heartbeat_back_addr":"172.21.15.18:6823/1322408496","heartbeat_front_addr":"172.21.15.18:6821/1322408496","state":["exists","up"]},{"osd":8,"uuid":"40d1f37e-6fac-40b9-9319-78f4fc3a6f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1011657022},{"type":"v1","addr":"172.21.15.144:6817","nonce":1011657022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1011657022},{"type":"v1","addr":"172.21.15.144:6819","nonce":1011657022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1011657022},{"type":"v1","addr":"172.21.15.144:6823","nonce":1011657022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":1011657022},{"type":"v1","addr":"172.21.15.144:6821","nonce":1011657022}]},"public_addr":"172.21.15.144:6817/1011657022","cluster_addr":"172.21.15.144:6819/1011657022","heartbeat_back_addr":"172.21.15.144:6823/1011657022","heartbeat_front_addr":"172.21.15.144:6821/1011657022","state":["exists","up"]},{"osd":9,"uuid":"ad12d6f7-fd21-49bd-a343-744f3cff4bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":256146339},{"type":"v1","addr":"172.21.15.7:6827","nonce":256146339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":256146339},{"type":"v1","addr":"172.21.15.7:6829","nonce":256146339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":256146339},{"type":"v1","addr":"172.21.15.7:6833","nonce":256146339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":256146339},{"type":"v1","addr":"172.21.15.7:6831","nonce":256146339}]},"public_addr":"172.21.15.7:6827/256146339","cluster_addr":"172.21.15.7:6829/256146339","heartbeat_back_addr":"172.21.15.7:6833/256146339","heartbeat_front_addr":"172.21.15.7:6831/256146339","state":["exists","up"]},{"osd":10,"uuid":"1317a2ad-ec15-4096-b2da-689475b7cacc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":2038885362},{"type":"v1","addr":"172.21.15.18:6825","nonce":2038885362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2038885362},{"type":"v1","addr":"172.21.15.18:6827","nonce":2038885362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2038885362},{"type":"v1","addr":"172.21.15.18:6831","nonce":2038885362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2038885362},{"type":"v1","addr":"172.21.15.18:6829","nonce":2038885362}]},"public_addr":"172.21.15.18:6825/2038885362","cluster_addr":"172.21.15.18:6827/2038885362","heartbeat_back_addr":"172.21.15.18:6831/2038885362","heartbeat_front_addr":"172.21.15.18:6829/2038885362","state":["exists","up"]},{"osd":11,"uuid":"f9252acb-7290-4923-89f3-844c868d4b39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":1047060848},{"type":"v1","addr":"172.21.15.144:6825","nonce":1047060848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":1047060848},{"type":"v1","addr":"172.21.15.144:6827","nonce":1047060848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":1047060848},{"type":"v1","addr":"172.21.15.144:6831","nonce":1047060848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":1047060848},{"type":"v1","addr":"172.21.15.144:6829","nonce":1047060848}]},"public_addr":"172.21.15.144:6825/1047060848","cluster_addr":"172.21.15.144:6827/1047060848","heartbeat_back_addr":"172.21.15.144:6831/1047060848","heartbeat_front_addr":"172.21.15.144:6829/1047060848","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:28:48.842729+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:29:13.946624+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:29:38.589666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:30:05.116339+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:30:30.562090+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:30:55.586210+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:31:22.138457+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:31:49.178090+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:32:13.687830+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:32:40.408193+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:33:06.044578+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:33:30.988851+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/1296137341":"2024-09-22T06:27:43.044484+0000","172.21.15.7:6801/3879502931":"2024-09-22T06:27:43.044484+0000","172.21.15.7:0/1926706877":"2024-09-22T06:26:40.520265+0000","172.21.15.7:0/2034370456":"2024-09-22T06:26:14.181426+0000","172.21.15.7:6801/3339522713":"2024-09-22T06:26:14.181426+0000","172.21.15.7:6800/3339522713":"2024-09-22T06:26:14.181426+0000","172.21.15.7:0/3586807770":"2024-09-22T06:26:14.181426+0000","172.21.15.7:0/1814223919":"2024-09-22T06:27:43.044484+0000","172.21.15.7:0/601150037":"2024-09-22T06:26:40.520265+0000","172.21.15.7:6800/3876787626":"2024-09-22T06:26:40.520265+0000","172.21.15.7:0/186444636":"2024-09-22T06:26:14.181426+0000","172.21.15.7:0/2180184348":"2024-09-22T06:26:40.520265+0000","172.21.15.7:6801/3876787626":"2024-09-22T06:26:40.520265+0000","172.21.15.7:0/2931793461":"2024-09-22T06:27:43.044484+0000","172.21.15.7:6800/3879502931":"2024-09-22T06:27:43.044484+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:46:31.428 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.426+0000 7fb609f8a640 1 -- 172.21.15.7:0/4200236682 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fb5ec0b66b0 msgr2=0x7fb5ec0b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:31.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.426+0000 7fb609f8a640 1 --2- 172.21.15.7:0/4200236682 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fb5ec0b66b0 0x7fb5ec0b8bc0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fb604077160 tx=0x7fb5f400b390 comp rx=0 tx=0).stop 2024-09-21T06:46:31.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.426+0000 7fb609f8a640 1 -- 172.21.15.7:0/4200236682 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb604109410 msgr2=0x7fb604075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:31.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.426+0000 7fb609f8a640 1 --2- 172.21.15.7:0/4200236682 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb604109410 0x7fb604075c50 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7fb5f802a930 tx=0x7fb5f8004270 comp rx=0 tx=0).stop 2024-09-21T06:46:31.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.426+0000 7fb609f8a640 1 -- 172.21.15.7:0/4200236682 shutdown_connections 2024-09-21T06:46:31.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.426+0000 7fb609f8a640 1 --2- 172.21.15.7:0/4200236682 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fb5ec0b66b0 0x7fb5ec0b8bc0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:31.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.426+0000 7fb609f8a640 1 --2- 172.21.15.7:0/4200236682 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb604109d60 0x7fb604076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:31.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.426+0000 7fb609f8a640 1 --2- 172.21.15.7:0/4200236682 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb604109410 0x7fb604075c50 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:31.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.427+0000 7fb609f8a640 1 --2- 172.21.15.7:0/4200236682 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb604103ae0 0x7fb604075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:31.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.427+0000 7fb609f8a640 1 -- 172.21.15.7:0/4200236682 >> 172.21.15.7:0/4200236682 conn(0x7fb60407a990 msgr2=0x7fb604107500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:31.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.427+0000 7fb609f8a640 1 -- 172.21.15.7:0/4200236682 shutdown_connections 2024-09-21T06:46:31.429 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.427+0000 7fb609f8a640 1 -- 172.21.15.7:0/4200236682 wait complete. 2024-09-21T06:46:31.440 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T06:29:41.514179+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-21T06:34:20.531755+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-21T06:34:22.552541+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 15, 'snap_epoch': 84, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T06:46:31.441 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T06:46:31.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:46:31 smithi144 ceph-mon[34653]: pgmap v636: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T06:46:31.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.556+0000 7f967684d640 1 -- 172.21.15.7:0/462604667 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9670106b50 msgr2=0x7f96701105c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:31.558 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.556+0000 7f967684d640 1 --2- 172.21.15.7:0/462604667 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9670106b50 0x7f96701105c0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f9668009ca0 tx=0x7f966802a8c0 comp rx=0 tx=0).stop 2024-09-21T06:46:31.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.556+0000 7f967684d640 1 -- 172.21.15.7:0/462604667 shutdown_connections 2024-09-21T06:46:31.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.556+0000 7f967684d640 1 --2- 172.21.15.7:0/462604667 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9670106b50 0x7f96701105c0 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:31.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.556+0000 7f967684d640 1 --2- 172.21.15.7:0/462604667 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9670106200 0x7f9670106610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:31.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.556+0000 7f967684d640 1 --2- 172.21.15.7:0/462604667 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9670101fc0 0x7f96701023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:31.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.556+0000 7f967684d640 1 -- 172.21.15.7:0/462604667 >> 172.21.15.7:0/462604667 conn(0x7f9670077bb0 msgr2=0x7f9670077ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:31.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.556+0000 7f967684d640 1 -- 172.21.15.7:0/462604667 shutdown_connections 2024-09-21T06:46:31.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.556+0000 7f967684d640 1 -- 172.21.15.7:0/462604667 wait complete. 2024-09-21T06:46:31.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.557+0000 7f967684d640 1 Processor -- start 2024-09-21T06:46:31.559 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.557+0000 7f967684d640 1 -- start start 2024-09-21T06:46:31.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.557+0000 7f967684d640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9670101fc0 0x7f967019a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:31.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.557+0000 7f967684d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9670106200 0x7f967019a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:31.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.557+0000 7f967684d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9670106b50 0x7f967019fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:31.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.557+0000 7f967684d640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f9670113a20 con 0x7f9670106200 2024-09-21T06:46:31.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.557+0000 7f967684d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f96701138a0 con 0x7f9670106b50 2024-09-21T06:46:31.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.557+0000 7f967684d640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f9670113ba0 con 0x7f9670101fc0 2024-09-21T06:46:31.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.557+0000 7f966f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9670106200 0x7f967019a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:31.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.558+0000 7f966f7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9670106200 0x7f967019a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57292/0 (socket says 172.21.15.7:57292) 2024-09-21T06:46:31.561 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.558+0000 7f966f7fe640 1 -- 172.21.15.7:0/361257872 learned_addr learned my addr 172.21.15.7:0/361257872 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:46:31.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.558+0000 7f966ffff640 1 --2- 172.21.15.7:0/361257872 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9670101fc0 0x7f967019a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:31.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.558+0000 7f9674dea640 1 --2- 172.21.15.7:0/361257872 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9670106b50 0x7f967019fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:31.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.558+0000 7f966f7fe640 1 -- 172.21.15.7:0/361257872 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9670101fc0 msgr2=0x7f967019a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:31.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.558+0000 7f966f7fe640 1 --2- 172.21.15.7:0/361257872 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9670101fc0 0x7f967019a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:31.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.558+0000 7f966f7fe640 1 -- 172.21.15.7:0/361257872 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9670106b50 msgr2=0x7f967019fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:31.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.558+0000 7f966f7fe640 1 --2- 172.21.15.7:0/361257872 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9670106b50 0x7f967019fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:31.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.558+0000 7f966f7fe640 1 -- 172.21.15.7:0/361257872 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96701a02b0 con 0x7f9670106200 2024-09-21T06:46:31.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.558+0000 7f9674dea640 1 --2- 172.21.15.7:0/361257872 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9670106b50 0x7f967019fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:46:31.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.558+0000 7f966f7fe640 1 --2- 172.21.15.7:0/361257872 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9670106200 0x7f967019a920 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f966400d750 tx=0x7f966400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:31.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.558+0000 7f966d7fa640 1 -- 172.21.15.7:0/361257872 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9664017070 con 0x7f9670106200 2024-09-21T06:46:31.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.558+0000 7f966d7fa640 1 -- 172.21.15.7:0/361257872 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f96640054d0 con 0x7f9670106200 2024-09-21T06:46:31.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.558+0000 7f967684d640 1 -- 172.21.15.7:0/361257872 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96701a05a0 con 0x7f9670106200 2024-09-21T06:46:31.562 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.558+0000 7f966d7fa640 1 -- 172.21.15.7:0/361257872 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9664004c30 con 0x7f9670106200 2024-09-21T06:46:31.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.558+0000 7f967684d640 1 -- 172.21.15.7:0/361257872 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96701a6d30 con 0x7f9670106200 2024-09-21T06:46:31.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.559+0000 7f967684d640 1 -- 172.21.15.7:0/361257872 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96701023d0 con 0x7f9670106200 2024-09-21T06:46:31.563 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.562+0000 7f966d7fa640 1 -- 172.21.15.7:0/361257872 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f9664004dd0 con 0x7f9670106200 2024-09-21T06:46:31.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.563+0000 7f966d7fa640 1 --2- 172.21.15.7:0/361257872 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f96580b6680 0x7f96580b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:31.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.563+0000 7f966ffff640 1 --2- 172.21.15.7:0/361257872 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f96580b6680 0x7f96580b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:31.564 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.563+0000 7f966d7fa640 1 -- 172.21.15.7:0/361257872 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8412+0+0 (secure 0 0 0) 0x7f96640e74d0 con 0x7f9670106200 2024-09-21T06:46:31.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.563+0000 7f966ffff640 1 --2- 172.21.15.7:0/361257872 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f96580b6680 0x7f96580b8b90 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f967006ba00 tx=0x7f966000b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:31.567 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.566+0000 7f966d7fa640 1 -- 172.21.15.7:0/361257872 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f96640ada30 con 0x7f9670106200 2024-09-21T06:46:31.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.753+0000 7f967684d640 1 -- 172.21.15.7:0/361257872 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f96701a6f90 con 0x7f9670106200 2024-09-21T06:46:31.755 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.753+0000 7f966d7fa640 1 -- 172.21.15.7:0/361257872 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) ==== 93+0+10 (secure 0 0 0) 0x7f96640b1e10 con 0x7f9670106200 2024-09-21T06:46:31.755 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2024-09-21T06:46:31.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.756+0000 7f967684d640 1 -- 172.21.15.7:0/361257872 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f96580b6680 msgr2=0x7f96580b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:31.758 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.756+0000 7f967684d640 1 --2- 172.21.15.7:0/361257872 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f96580b6680 0x7f96580b8b90 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f967006ba00 tx=0x7f966000b390 comp rx=0 tx=0).stop 2024-09-21T06:46:31.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.756+0000 7f967684d640 1 -- 172.21.15.7:0/361257872 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9670106200 msgr2=0x7f967019a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:31.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.756+0000 7f967684d640 1 --2- 172.21.15.7:0/361257872 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9670106200 0x7f967019a920 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f966400d750 tx=0x7f966400dc10 comp rx=0 tx=0).stop 2024-09-21T06:46:31.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.756+0000 7f967684d640 1 -- 172.21.15.7:0/361257872 shutdown_connections 2024-09-21T06:46:31.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.756+0000 7f967684d640 1 --2- 172.21.15.7:0/361257872 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f96580b6680 0x7f96580b8b90 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:31.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.756+0000 7f967684d640 1 --2- 172.21.15.7:0/361257872 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9670106b50 0x7f967019fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:31.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.756+0000 7f967684d640 1 --2- 172.21.15.7:0/361257872 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f9670106200 0x7f967019a920 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:31.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.756+0000 7f967684d640 1 --2- 172.21.15.7:0/361257872 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f9670101fc0 0x7f967019a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:31.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.756+0000 7f967684d640 1 -- 172.21.15.7:0/361257872 >> 172.21.15.7:0/361257872 conn(0x7f9670077bb0 msgr2=0x7f9670109440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:31.759 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.756+0000 7f967684d640 1 -- 172.21.15.7:0/361257872 shutdown_connections 2024-09-21T06:46:31.760 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.756+0000 7f967684d640 1 -- 172.21.15.7:0/361257872 wait complete. 2024-09-21T06:46:31.769 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-21T06:46:31.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.884+0000 7fa3b23ba640 1 -- 172.21.15.7:0/2883132224 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3ac108c20 msgr2=0x7fa3ac10f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:31.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.884+0000 7fa3b23ba640 1 --2- 172.21.15.7:0/2883132224 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3ac108c20 0x7fa3ac10f450 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7fa3a4009ca0 tx=0x7fa3a402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:46:31.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.884+0000 7fa3b23ba640 1 -- 172.21.15.7:0/2883132224 shutdown_connections 2024-09-21T06:46:31.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.884+0000 7fa3b23ba640 1 --2- 172.21.15.7:0/2883132224 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3ac108c20 0x7fa3ac10f450 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:31.886 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.884+0000 7fa3b23ba640 1 --2- 172.21.15.7:0/2883132224 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa3ac1082d0 0x7fa3ac1086e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:31.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.884+0000 7fa3b23ba640 1 --2- 172.21.15.7:0/2883132224 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3ac1029a0 0x7fa3ac102db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:31.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.884+0000 7fa3b23ba640 1 -- 172.21.15.7:0/2883132224 >> 172.21.15.7:0/2883132224 conn(0x7fa3ac0fe3e0 msgr2=0x7fa3ac100830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:31.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.884+0000 7fa3b23ba640 1 -- 172.21.15.7:0/2883132224 shutdown_connections 2024-09-21T06:46:31.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.884+0000 7fa3b23ba640 1 -- 172.21.15.7:0/2883132224 wait complete. 2024-09-21T06:46:31.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.885+0000 7fa3b23ba640 1 Processor -- start 2024-09-21T06:46:31.887 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.885+0000 7fa3b23ba640 1 -- start start 2024-09-21T06:46:31.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.885+0000 7fa3b23ba640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3ac1029a0 0x7fa3ac199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:31.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.885+0000 7fa3b23ba640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3ac1082d0 0x7fa3ac199820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:31.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.885+0000 7fa3b23ba640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa3ac108c20 0x7fa3ac19eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:31.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.885+0000 7fa3b23ba640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa3ac1128e0 con 0x7fa3ac1082d0 2024-09-21T06:46:31.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.885+0000 7fa3b23ba640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa3ac112760 con 0x7fa3ac1029a0 2024-09-21T06:46:31.889 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.885+0000 7fa3b23ba640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa3ac112a60 con 0x7fa3ac108c20 2024-09-21T06:46:31.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.885+0000 7fa3ab7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3ac1082d0 0x7fa3ac199820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:31.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.885+0000 7fa3ab7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3ac1082d0 0x7fa3ac199820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57318/0 (socket says 172.21.15.7:57318) 2024-09-21T06:46:31.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.885+0000 7fa3abfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3ac1029a0 0x7fa3ac199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:31.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.885+0000 7fa3ab7fe640 1 -- 172.21.15.7:0/3821633438 learned_addr learned my addr 172.21.15.7:0/3821633438 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:46:31.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.886+0000 7fa3ab7fe640 1 -- 172.21.15.7:0/3821633438 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa3ac108c20 msgr2=0x7fa3ac19eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:31.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.886+0000 7fa3b0957640 1 --2- 172.21.15.7:0/3821633438 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa3ac108c20 0x7fa3ac19eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:31.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.886+0000 7fa3ab7fe640 1 --2- 172.21.15.7:0/3821633438 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa3ac108c20 0x7fa3ac19eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:31.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.886+0000 7fa3ab7fe640 1 -- 172.21.15.7:0/3821633438 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3ac1029a0 msgr2=0x7fa3ac199280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:31.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.886+0000 7fa3ab7fe640 1 --2- 172.21.15.7:0/3821633438 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3ac1029a0 0x7fa3ac199280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:31.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.886+0000 7fa3ab7fe640 1 -- 172.21.15.7:0/3821633438 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3ac19f120 con 0x7fa3ac1082d0 2024-09-21T06:46:31.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.886+0000 7fa3b0957640 1 --2- 172.21.15.7:0/3821633438 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa3ac108c20 0x7fa3ac19eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T06:46:31.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.886+0000 7fa3ab7fe640 1 --2- 172.21.15.7:0/3821633438 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3ac1082d0 0x7fa3ac199820 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7fa3a0007860 tx=0x7fa3a0007d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:31.890 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.886+0000 7fa3a97fa640 1 -- 172.21.15.7:0/3821633438 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3a0019070 con 0x7fa3ac1082d0 2024-09-21T06:46:31.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.886+0000 7fa3b23ba640 1 -- 172.21.15.7:0/3821633438 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3ac19f410 con 0x7fa3ac1082d0 2024-09-21T06:46:31.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.886+0000 7fa3a97fa640 1 -- 172.21.15.7:0/3821633438 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3a000c280 con 0x7fa3ac1082d0 2024-09-21T06:46:31.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.886+0000 7fa3a97fa640 1 -- 172.21.15.7:0/3821633438 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3a0014a80 con 0x7fa3ac1082d0 2024-09-21T06:46:31.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.886+0000 7fa3b23ba640 1 -- 172.21.15.7:0/3821633438 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3ac06a890 con 0x7fa3ac1082d0 2024-09-21T06:46:31.891 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.887+0000 7fa3b23ba640 1 -- 172.21.15.7:0/3821633438 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3ac103c10 con 0x7fa3ac1082d0 2024-09-21T06:46:31.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.889+0000 7fa3a97fa640 1 -- 172.21.15.7:0/3821633438 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7fa3a001c070 con 0x7fa3ac1082d0 2024-09-21T06:46:31.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.890+0000 7fa3a97fa640 1 --2- 172.21.15.7:0/3821633438 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa3940b6680 0x7fa3940b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:31.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.890+0000 7fa3abfff640 1 --2- 172.21.15.7:0/3821633438 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa3940b6680 0x7fa3940b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:31.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.890+0000 7fa3a97fa640 1 -- 172.21.15.7:0/3821633438 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8412+0+0 (secure 0 0 0) 0x7fa3a00e6ce0 con 0x7fa3ac1082d0 2024-09-21T06:46:31.892 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.890+0000 7fa3abfff640 1 --2- 172.21.15.7:0/3821633438 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa3940b6680 0x7fa3940b8b90 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fa39c005d00 tx=0x7fa39c00f820 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:31.894 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:31.893+0000 7fa3a97fa640 1 -- 172.21.15.7:0/3821633438 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa3a00b1620 con 0x7fa3ac1082d0 2024-09-21T06:46:32.086 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.084+0000 7fa3b23ba640 1 -- 172.21.15.7:0/3821633438 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fa3ac06b310 con 0x7fa3ac1082d0 2024-09-21T06:46:32.087 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.085+0000 7fa3a97fa640 1 -- 172.21.15.7:0/3821633438 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v85) ==== 104+0+11 (secure 0 0 0) 0x7fa3a00b6560 con 0x7fa3ac1082d0 2024-09-21T06:46:32.087 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2024-09-21T06:46:32.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.087+0000 7fa3b23ba640 1 -- 172.21.15.7:0/3821633438 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa3940b6680 msgr2=0x7fa3940b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:32.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.087+0000 7fa3b23ba640 1 --2- 172.21.15.7:0/3821633438 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa3940b6680 0x7fa3940b8b90 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fa39c005d00 tx=0x7fa39c00f820 comp rx=0 tx=0).stop 2024-09-21T06:46:32.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.087+0000 7fa3b23ba640 1 -- 172.21.15.7:0/3821633438 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3ac1082d0 msgr2=0x7fa3ac199820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:32.089 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.087+0000 7fa3b23ba640 1 --2- 172.21.15.7:0/3821633438 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3ac1082d0 0x7fa3ac199820 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7fa3a0007860 tx=0x7fa3a0007d20 comp rx=0 tx=0).stop 2024-09-21T06:46:32.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.087+0000 7fa3b23ba640 1 -- 172.21.15.7:0/3821633438 shutdown_connections 2024-09-21T06:46:32.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.087+0000 7fa3b23ba640 1 --2- 172.21.15.7:0/3821633438 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa3940b6680 0x7fa3940b8b90 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:32.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.087+0000 7fa3b23ba640 1 --2- 172.21.15.7:0/3821633438 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa3ac108c20 0x7fa3ac19eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:32.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.087+0000 7fa3b23ba640 1 --2- 172.21.15.7:0/3821633438 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa3ac1082d0 0x7fa3ac199820 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:32.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.087+0000 7fa3b23ba640 1 --2- 172.21.15.7:0/3821633438 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3ac1029a0 0x7fa3ac199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:32.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.087+0000 7fa3b23ba640 1 -- 172.21.15.7:0/3821633438 >> 172.21.15.7:0/3821633438 conn(0x7fa3ac0fe3e0 msgr2=0x7fa3ac1058a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:32.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.087+0000 7fa3b23ba640 1 -- 172.21.15.7:0/3821633438 shutdown_connections 2024-09-21T06:46:32.090 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.087+0000 7fa3b23ba640 1 -- 172.21.15.7:0/3821633438 wait complete. 2024-09-21T06:46:32.101 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-21T06:46:32.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.215+0000 7f5d49d32640 1 -- 172.21.15.7:0/2074121100 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d4410dd50 msgr2=0x7f5d44110240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:32.217 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.215+0000 7f5d49d32640 1 --2- 172.21.15.7:0/2074121100 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d4410dd50 0x7f5d44110240 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c009ca0 tx=0x7f5d3c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:46:32.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.215+0000 7f5d49d32640 1 -- 172.21.15.7:0/2074121100 shutdown_connections 2024-09-21T06:46:32.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.215+0000 7f5d49d32640 1 --2- 172.21.15.7:0/2074121100 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d4410dd50 0x7f5d44110240 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:32.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.215+0000 7f5d49d32640 1 --2- 172.21.15.7:0/2074121100 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d44105240 0x7f5d4410d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:32.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.215+0000 7f5d49d32640 1 --2- 172.21.15.7:0/2074121100 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d441048f0 0x7f5d44104d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:32.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.215+0000 7f5d49d32640 1 -- 172.21.15.7:0/2074121100 >> 172.21.15.7:0/2074121100 conn(0x7f5d440fe3e0 msgr2=0x7f5d44100830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:32.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.215+0000 7f5d49d32640 1 -- 172.21.15.7:0/2074121100 shutdown_connections 2024-09-21T06:46:32.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.215+0000 7f5d49d32640 1 -- 172.21.15.7:0/2074121100 wait complete. 2024-09-21T06:46:32.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.216+0000 7f5d49d32640 1 Processor -- start 2024-09-21T06:46:32.218 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.216+0000 7f5d49d32640 1 -- start start 2024-09-21T06:46:32.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.216+0000 7f5d49d32640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d441048f0 0x7f5d4419a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:32.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.216+0000 7f5d49d32640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d44105240 0x7f5d4419a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:32.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.216+0000 7f5d49d32640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d4410dd50 0x7f5d4419fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:32.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.216+0000 7f5d49d32640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f5d441139d0 con 0x7f5d4410dd50 2024-09-21T06:46:32.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.216+0000 7f5d49d32640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5d44113850 con 0x7f5d441048f0 2024-09-21T06:46:32.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.216+0000 7f5d49d32640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f5d44113b50 con 0x7f5d44105240 2024-09-21T06:46:32.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.216+0000 7f5d43fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d4410dd50 0x7f5d4419fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:32.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.216+0000 7f5d43fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d4410dd50 0x7f5d4419fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57336/0 (socket says 172.21.15.7:57336) 2024-09-21T06:46:32.220 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.216+0000 7f5d43fff640 1 -- 172.21.15.7:0/3657029145 learned_addr learned my addr 172.21.15.7:0/3657029145 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:46:32.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.216+0000 7f5d437fe640 1 --2- 172.21.15.7:0/3657029145 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d441048f0 0x7f5d4419a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:32.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.217+0000 7f5d3affd640 1 --2- 172.21.15.7:0/3657029145 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d44105240 0x7f5d4419a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:32.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.217+0000 7f5d43fff640 1 -- 172.21.15.7:0/3657029145 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d44105240 msgr2=0x7f5d4419a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:32.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.217+0000 7f5d43fff640 1 --2- 172.21.15.7:0/3657029145 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d44105240 0x7f5d4419a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:32.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.217+0000 7f5d43fff640 1 -- 172.21.15.7:0/3657029145 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d441048f0 msgr2=0x7f5d4419a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:32.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.217+0000 7f5d43fff640 1 --2- 172.21.15.7:0/3657029145 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d441048f0 0x7f5d4419a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:32.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.217+0000 7f5d43fff640 1 -- 172.21.15.7:0/3657029145 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d441a0320 con 0x7f5d4410dd50 2024-09-21T06:46:32.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.217+0000 7f5d43fff640 1 --2- 172.21.15.7:0/3657029145 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d4410dd50 0x7f5d4419fc20 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c0098d0 tx=0x7f5d3c0317b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:32.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.217+0000 7f5d417fa640 1 -- 172.21.15.7:0/3657029145 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d3c003b70 con 0x7f5d4410dd50 2024-09-21T06:46:32.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.217+0000 7f5d417fa640 1 -- 172.21.15.7:0/3657029145 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5d3c003d10 con 0x7f5d4410dd50 2024-09-21T06:46:32.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.217+0000 7f5d49d32640 1 -- 172.21.15.7:0/3657029145 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d441a05b0 con 0x7f5d4410dd50 2024-09-21T06:46:32.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.217+0000 7f5d417fa640 1 -- 172.21.15.7:0/3657029145 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d3c02fa20 con 0x7f5d4410dd50 2024-09-21T06:46:32.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.217+0000 7f5d49d32640 1 -- 172.21.15.7:0/3657029145 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d441a6da0 con 0x7f5d4410dd50 2024-09-21T06:46:32.221 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.218+0000 7f5d49d32640 1 -- 172.21.15.7:0/3657029145 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d4406af90 con 0x7f5d4410dd50 2024-09-21T06:46:32.222 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.220+0000 7f5d417fa640 1 -- 172.21.15.7:0/3657029145 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f5d3c02fbe0 con 0x7f5d4410dd50 2024-09-21T06:46:32.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.222+0000 7f5d417fa640 1 --2- 172.21.15.7:0/3657029145 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f5d300b6700 0x7f5d300b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:32.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.222+0000 7f5d437fe640 1 --2- 172.21.15.7:0/3657029145 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f5d300b6700 0x7f5d300b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:32.223 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.222+0000 7f5d417fa640 1 -- 172.21.15.7:0/3657029145 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8412+0+0 (secure 0 0 0) 0x7f5d3c108b00 con 0x7f5d4410dd50 2024-09-21T06:46:32.224 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.222+0000 7f5d437fe640 1 --2- 172.21.15.7:0/3657029145 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f5d300b6700 0x7f5d300b8c10 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f5d34009bd0 tx=0x7f5d34005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:32.226 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.225+0000 7f5d417fa640 1 -- 172.21.15.7:0/3657029145 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5d3c0cf0c0 con 0x7f5d4410dd50 2024-09-21T06:46:32.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:46:32 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/4200236682' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:46:32.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:46:32 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/361257872' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T06:46:32.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:46:32 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/4200236682' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:46:32.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:46:32 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/361257872' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T06:46:32.412 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.411+0000 7f5d49d32640 1 -- 172.21.15.7:0/3657029145 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f5d4419b510 con 0x7f5d4410dd50 2024-09-21T06:46:32.413 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.411+0000 7f5d417fa640 1 -- 172.21.15.7:0/3657029145 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v85) ==== 100+0+11 (secure 0 0 0) 0x7f5d3c0d34a0 con 0x7f5d4410dd50 2024-09-21T06:46:32.413 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2024-09-21T06:46:32.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.413+0000 7f5d49d32640 1 -- 172.21.15.7:0/3657029145 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f5d300b6700 msgr2=0x7f5d300b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:32.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.413+0000 7f5d49d32640 1 --2- 172.21.15.7:0/3657029145 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f5d300b6700 0x7f5d300b8c10 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f5d34009bd0 tx=0x7f5d34005f90 comp rx=0 tx=0).stop 2024-09-21T06:46:32.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.413+0000 7f5d49d32640 1 -- 172.21.15.7:0/3657029145 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d4410dd50 msgr2=0x7f5d4419fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:32.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.413+0000 7f5d49d32640 1 --2- 172.21.15.7:0/3657029145 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d4410dd50 0x7f5d4419fc20 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c0098d0 tx=0x7f5d3c0317b0 comp rx=0 tx=0).stop 2024-09-21T06:46:32.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.413+0000 7f5d49d32640 1 -- 172.21.15.7:0/3657029145 shutdown_connections 2024-09-21T06:46:32.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.413+0000 7f5d49d32640 1 --2- 172.21.15.7:0/3657029145 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f5d300b6700 0x7f5d300b8c10 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:32.415 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.413+0000 7f5d49d32640 1 --2- 172.21.15.7:0/3657029145 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f5d4410dd50 0x7f5d4419fc20 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:32.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.413+0000 7f5d49d32640 1 --2- 172.21.15.7:0/3657029145 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f5d44105240 0x7f5d4419a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:32.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.413+0000 7f5d49d32640 1 --2- 172.21.15.7:0/3657029145 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d441048f0 0x7f5d4419a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:32.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.413+0000 7f5d49d32640 1 -- 172.21.15.7:0/3657029145 >> 172.21.15.7:0/3657029145 conn(0x7f5d440fe3e0 msgr2=0x7f5d441077d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:32.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.413+0000 7f5d49d32640 1 -- 172.21.15.7:0/3657029145 shutdown_connections 2024-09-21T06:46:32.416 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.413+0000 7f5d49d32640 1 -- 172.21.15.7:0/3657029145 wait complete. 2024-09-21T06:46:32.427 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-21T06:46:32.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:46:32 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/4200236682' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:46:32.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:46:32 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/361257872' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T06:46:32.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.538+0000 7f2a77158640 1 -- 172.21.15.7:0/2377754972 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a70108300 msgr2=0x7f2a70108710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:32.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.538+0000 7f2a77158640 1 --2- 172.21.15.7:0/2377754972 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a70108300 0x7f2a70108710 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f2a60009900 tx=0x7f2a6002a410 comp rx=0 tx=0).stop 2024-09-21T06:46:32.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.538+0000 7f2a77158640 1 -- 172.21.15.7:0/2377754972 shutdown_connections 2024-09-21T06:46:32.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.538+0000 7f2a77158640 1 --2- 172.21.15.7:0/2377754972 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2a70108c50 0x7f2a7010f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:32.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.538+0000 7f2a77158640 1 --2- 172.21.15.7:0/2377754972 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a70108300 0x7f2a70108710 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:32.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.538+0000 7f2a77158640 1 --2- 172.21.15.7:0/2377754972 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a701029d0 0x7f2a70102de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:32.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.538+0000 7f2a77158640 1 -- 172.21.15.7:0/2377754972 >> 172.21.15.7:0/2377754972 conn(0x7f2a700fe3b0 msgr2=0x7f2a70100800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:32.542 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.538+0000 7f2a77158640 1 -- 172.21.15.7:0/2377754972 shutdown_connections 2024-09-21T06:46:32.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.538+0000 7f2a77158640 1 -- 172.21.15.7:0/2377754972 wait complete. 2024-09-21T06:46:32.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.539+0000 7f2a77158640 1 Processor -- start 2024-09-21T06:46:32.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.539+0000 7f2a77158640 1 -- start start 2024-09-21T06:46:32.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.539+0000 7f2a77158640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a701029d0 0x7f2a7019a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:32.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.539+0000 7f2a77158640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2a70108300 0x7f2a7019a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:32.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.539+0000 7f2a77158640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a70108c50 0x7f2a7019fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:32.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.539+0000 7f2a77158640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f2a70112910 con 0x7f2a701029d0 2024-09-21T06:46:32.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.539+0000 7f2a77158640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2a70112790 con 0x7f2a70108300 2024-09-21T06:46:32.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.539+0000 7f2a77158640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f2a70112a90 con 0x7f2a70108c50 2024-09-21T06:46:32.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.539+0000 7f2a74ef4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a701029d0 0x7f2a7019a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:32.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.540+0000 7f2a74ef4640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a701029d0 0x7f2a7019a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:57362/0 (socket says 172.21.15.7:57362) 2024-09-21T06:46:32.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.540+0000 7f2a74ef4640 1 -- 172.21.15.7:0/2593497890 learned_addr learned my addr 172.21.15.7:0/2593497890 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:46:32.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.540+0000 7f2a6ffff640 1 --2- 172.21.15.7:0/2593497890 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2a70108300 0x7f2a7019a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:32.543 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.540+0000 7f2a756f5640 1 --2- 172.21.15.7:0/2593497890 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a70108c50 0x7f2a7019fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:32.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.540+0000 7f2a74ef4640 1 -- 172.21.15.7:0/2593497890 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a70108c50 msgr2=0x7f2a7019fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:32.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.540+0000 7f2a74ef4640 1 --2- 172.21.15.7:0/2593497890 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a70108c50 0x7f2a7019fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:32.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.540+0000 7f2a74ef4640 1 -- 172.21.15.7:0/2593497890 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2a70108300 msgr2=0x7f2a7019a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:32.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.540+0000 7f2a74ef4640 1 --2- 172.21.15.7:0/2593497890 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2a70108300 0x7f2a7019a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:32.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.540+0000 7f2a74ef4640 1 -- 172.21.15.7:0/2593497890 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a701a0330 con 0x7f2a701029d0 2024-09-21T06:46:32.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.540+0000 7f2a74ef4640 1 --2- 172.21.15.7:0/2593497890 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a701029d0 0x7f2a7019a400 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f2a5800d770 tx=0x7f2a5800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:32.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.540+0000 7f2a6dffb640 1 -- 172.21.15.7:0/2593497890 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a58017070 con 0x7f2a701029d0 2024-09-21T06:46:32.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.540+0000 7f2a77158640 1 -- 172.21.15.7:0/2593497890 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a701a0620 con 0x7f2a701029d0 2024-09-21T06:46:32.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.540+0000 7f2a6dffb640 1 -- 172.21.15.7:0/2593497890 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2a580054d0 con 0x7f2a701029d0 2024-09-21T06:46:32.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.540+0000 7f2a6dffb640 1 -- 172.21.15.7:0/2593497890 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a58004c30 con 0x7f2a701029d0 2024-09-21T06:46:32.544 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.540+0000 7f2a77158640 1 -- 172.21.15.7:0/2593497890 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a701a6db0 con 0x7f2a701029d0 2024-09-21T06:46:32.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.541+0000 7f2a77158640 1 -- 172.21.15.7:0/2593497890 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a70102de0 con 0x7f2a701029d0 2024-09-21T06:46:32.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.543+0000 7f2a6dffb640 1 -- 172.21.15.7:0/2593497890 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f2a58004dd0 con 0x7f2a701029d0 2024-09-21T06:46:32.545 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.544+0000 7f2a6dffb640 1 --2- 172.21.15.7:0/2593497890 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f2a5c0b6680 0x7f2a5c0b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:32.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.544+0000 7f2a6ffff640 1 --2- 172.21.15.7:0/2593497890 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f2a5c0b6680 0x7f2a5c0b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:32.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.544+0000 7f2a6dffb640 1 -- 172.21.15.7:0/2593497890 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8412+0+0 (secure 0 0 0) 0x7f2a580e7610 con 0x7f2a701029d0 2024-09-21T06:46:32.546 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.544+0000 7f2a6ffff640 1 --2- 172.21.15.7:0/2593497890 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f2a5c0b6680 0x7f2a5c0b8b90 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f2a60009230 tx=0x7f2a60031400 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:32.548 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.547+0000 7f2a6dffb640 1 -- 172.21.15.7:0/2593497890 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2a580adb70 con 0x7f2a701029d0 2024-09-21T06:46:32.787 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.786+0000 7f2a77158640 1 -- 172.21.15.7:0/2593497890 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f2a701a6f80 con 0x7f2a701029d0 2024-09-21T06:46:32.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.794+0000 7f2a6dffb640 1 -- 172.21.15.7:0/2593497890 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v25) ==== 81+0+834043 (secure 0 0 0) 0x7f2a580b1f50 con 0x7f2a701029d0 2024-09-21T06:46:32.806 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:46:32.806 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:46:32.806 INFO:teuthology.orchestra.run.smithi007.stdout: "epoch": 25, 2024-09-21T06:46:32.806 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.806 INFO:teuthology.orchestra.run.smithi007.stdout: "active_gid": 14223, 2024-09-21T06:46:32.806 INFO:teuthology.orchestra.run.smithi007.stdout: "active_name": "x", 2024-09-21T06:46:32.806 INFO:teuthology.orchestra.run.smithi007.stdout: "active_addrs": { 2024-09-21T06:46:32.806 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2024-09-21T06:46:32.807 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:32.807 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2024-09-21T06:46:32.807 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6800", 2024-09-21T06:46:32.807 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 3442812985 2024-09-21T06:46:32.807 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.807 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:32.807 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2024-09-21T06:46:32.807 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6801", 2024-09-21T06:46:32.807 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 3442812985 2024-09-21T06:46:32.807 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:32.807 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T06:46:32.807 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.807 INFO:teuthology.orchestra.run.smithi007.stdout: "active_addr": "172.21.15.7:6801/3442812985", 2024-09-21T06:46:32.807 INFO:teuthology.orchestra.run.smithi007.stdout: "active_change": "2024-09-21T06:27:43.044611+0000", 2024-09-21T06:46:32.808 INFO:teuthology.orchestra.run.smithi007.stdout: "active_mgr_features": 4540719139924082687, 2024-09-21T06:46:32.808 INFO:teuthology.orchestra.run.smithi007.stdout: "available": true, 2024-09-21T06:46:32.808 INFO:teuthology.orchestra.run.smithi007.stdout: "standbys": [ 2024-09-21T06:46:32.808 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:32.808 INFO:teuthology.orchestra.run.smithi007.stdout: "gid": 24142, 2024-09-21T06:46:32.808 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "z", 2024-09-21T06:46:32.808 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_features": 4540719139924082687, 2024-09-21T06:46:32.808 INFO:teuthology.orchestra.run.smithi007.stdout: "available_modules": [ 2024-09-21T06:46:32.808 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:32.808 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "alerts", 2024-09-21T06:46:32.808 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:32.808 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:32.808 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:32.808 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-09-21T06:46:32.809 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-09-21T06:46:32.809 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:46:32.809 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.809 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:32.809 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-09-21T06:46:32.809 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.809 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.809 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.809 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "How frequently to reexamine health status", 2024-09-21T06:46:32.809 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.809 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.809 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.809 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.809 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:32.809 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:32.810 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:32.810 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.810 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:32.810 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:32.810 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.810 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.810 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:32.810 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:32.810 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:32.810 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:32.810 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:32.810 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:32.810 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:32.810 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:32.811 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.811 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.811 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.811 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.811 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.811 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:32.811 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:32.811 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:32.811 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.811 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:32.811 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:32.811 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.811 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.811 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.812 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.812 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.812 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.812 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.812 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.812 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:32.812 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:32.812 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:32.812 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.812 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:32.812 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:32.812 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.812 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.812 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:32.812 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:32.813 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:32.813 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:32.813 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:32.813 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:32.813 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:32.813 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:32.813 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.813 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.813 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.813 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.813 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.813 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:32.813 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:32.813 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:32.814 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.814 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:32.814 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:32.814 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.814 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.814 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.814 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.814 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.814 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.814 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.814 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.814 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_destination": { 2024-09-21T06:46:32.814 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_destination", 2024-09-21T06:46:32.814 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:32.814 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.815 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:32.815 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:32.815 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.815 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.815 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.815 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-21T06:46:32.815 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.815 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.815 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.815 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.815 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_from_name": { 2024-09-21T06:46:32.815 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_from_name", 2024-09-21T06:46:32.816 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:32.816 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.816 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:32.816 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "Ceph", 2024-09-21T06:46:32.816 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.816 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.816 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.816 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Email From: name", 2024-09-21T06:46:32.816 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.816 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.816 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.816 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.816 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_host": { 2024-09-21T06:46:32.816 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_host", 2024-09-21T06:46:32.817 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:32.817 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.817 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:32.817 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:32.817 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.817 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.817 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.817 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "SMTP server", 2024-09-21T06:46:32.817 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.817 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.817 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.817 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.817 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_password": { 2024-09-21T06:46:32.817 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_password", 2024-09-21T06:46:32.818 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:32.818 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.818 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:32.818 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:32.818 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.818 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.818 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.818 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Password to authenticate with", 2024-09-21T06:46:32.818 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.818 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.818 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.818 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.818 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_port": { 2024-09-21T06:46:32.818 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_port", 2024-09-21T06:46:32.818 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:32.818 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.819 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:32.819 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "465", 2024-09-21T06:46:32.819 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.819 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.819 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.819 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "SMTP port", 2024-09-21T06:46:32.819 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.819 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.819 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.819 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.819 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_sender": { 2024-09-21T06:46:32.819 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_sender", 2024-09-21T06:46:32.819 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:32.819 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.819 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:32.820 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:32.820 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.820 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.820 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.820 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "SMTP envelope sender", 2024-09-21T06:46:32.820 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.820 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.820 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.820 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.820 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_ssl": { 2024-09-21T06:46:32.820 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_ssl", 2024-09-21T06:46:32.820 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:32.820 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.820 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:32.821 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:32.821 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.821 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.821 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.821 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-21T06:46:32.821 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.821 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.821 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.821 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.821 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_user": { 2024-09-21T06:46:32.821 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_user", 2024-09-21T06:46:32.821 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:32.821 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.821 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:32.822 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:32.822 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.822 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.822 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.822 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "User to authenticate as", 2024-09-21T06:46:32.822 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.822 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.822 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.822 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.822 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:32.822 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:32.822 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:32.822 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:32.822 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:32.822 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:32.823 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.823 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.823 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.823 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.823 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.823 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.823 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.823 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:32.823 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:32.823 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.823 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:32.823 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "balancer", 2024-09-21T06:46:32.823 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:32.823 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:32.824 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:32.824 INFO:teuthology.orchestra.run.smithi007.stdout: "active": { 2024-09-21T06:46:32.824 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "active", 2024-09-21T06:46:32.824 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:32.824 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.824 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:32.824 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:32.824 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.824 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.824 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.824 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "automatically balance PGs across cluster", 2024-09-21T06:46:32.824 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.824 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.824 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.824 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.825 INFO:teuthology.orchestra.run.smithi007.stdout: "begin_time": { 2024-09-21T06:46:32.825 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "begin_time", 2024-09-21T06:46:32.825 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:32.825 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.825 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:32.825 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0000", 2024-09-21T06:46:32.825 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.825 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.825 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.825 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "beginning time of day to automatically balance", 2024-09-21T06:46:32.825 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T06:46:32.825 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.825 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.825 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.825 INFO:teuthology.orchestra.run.smithi007.stdout: "begin_weekday": { 2024-09-21T06:46:32.826 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "begin_weekday", 2024-09-21T06:46:32.826 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-09-21T06:46:32.826 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.826 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:32.826 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:32.826 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "0", 2024-09-21T06:46:32.826 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "6", 2024-09-21T06:46:32.826 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.826 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-21T06:46:32.826 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T06:46:32.826 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.826 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.826 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.826 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_compat_max_iterations": { 2024-09-21T06:46:32.827 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crush_compat_max_iterations", 2024-09-21T06:46:32.827 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-09-21T06:46:32.827 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.827 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:32.827 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "25", 2024-09-21T06:46:32.827 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1", 2024-09-21T06:46:32.827 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "250", 2024-09-21T06:46:32.827 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.827 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-21T06:46:32.827 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.827 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.827 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.827 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.827 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_compat_metrics": { 2024-09-21T06:46:32.827 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crush_compat_metrics", 2024-09-21T06:46:32.828 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:32.828 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.828 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:32.828 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "pgs,objects,bytes", 2024-09-21T06:46:32.828 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.828 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.828 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.828 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-21T06:46:32.828 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-21T06:46:32.828 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.828 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.828 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.828 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_compat_step": { 2024-09-21T06:46:32.828 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crush_compat_step", 2024-09-21T06:46:32.828 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-21T06:46:32.829 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.829 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:32.829 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0.5", 2024-09-21T06:46:32.829 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "0.001", 2024-09-21T06:46:32.829 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "0.999", 2024-09-21T06:46:32.829 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.829 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "aggressiveness of optimization", 2024-09-21T06:46:32.829 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-21T06:46:32.829 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.829 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.829 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.829 INFO:teuthology.orchestra.run.smithi007.stdout: "end_time": { 2024-09-21T06:46:32.829 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "end_time", 2024-09-21T06:46:32.829 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:32.830 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.830 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:32.830 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "2359", 2024-09-21T06:46:32.830 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.830 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.830 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.830 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "ending time of day to automatically balance", 2024-09-21T06:46:32.830 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T06:46:32.830 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.830 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.830 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.830 INFO:teuthology.orchestra.run.smithi007.stdout: "end_weekday": { 2024-09-21T06:46:32.830 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "end_weekday", 2024-09-21T06:46:32.830 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-09-21T06:46:32.831 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.831 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:32.831 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:32.831 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "0", 2024-09-21T06:46:32.831 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "6", 2024-09-21T06:46:32.831 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.831 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-21T06:46:32.831 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T06:46:32.831 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.831 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.831 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.831 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:32.831 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:32.831 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:32.831 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.832 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:32.832 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:32.832 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.832 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.832 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:32.832 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:32.832 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:32.832 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:32.832 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:32.832 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:32.832 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:32.832 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:32.832 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.832 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.833 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.833 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.833 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.833 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:32.833 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:32.833 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:32.833 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.833 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:32.833 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:32.833 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.833 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.833 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.833 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.833 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.834 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.834 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.834 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.834 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:32.834 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:32.834 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:32.834 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.834 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:32.834 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:32.834 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.834 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.834 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:32.834 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:32.834 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:32.834 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:32.835 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:32.835 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:32.835 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:32.835 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:32.835 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.835 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.835 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.835 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.835 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.835 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:32.835 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:32.835 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:32.835 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.835 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:32.835 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:32.836 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.836 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.836 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.836 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.836 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.836 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.836 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.836 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.836 INFO:teuthology.orchestra.run.smithi007.stdout: "min_score": { 2024-09-21T06:46:32.836 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "min_score", 2024-09-21T06:46:32.836 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-21T06:46:32.836 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.836 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:32.836 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:32.837 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.837 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.837 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.837 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-21T06:46:32.837 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.837 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.837 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.837 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.837 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": { 2024-09-21T06:46:32.837 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mode", 2024-09-21T06:46:32.837 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:32.837 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.837 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:32.837 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "upmap", 2024-09-21T06:46:32.838 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.838 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.838 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:32.838 INFO:teuthology.orchestra.run.smithi007.stdout: "crush-compat", 2024-09-21T06:46:32.838 INFO:teuthology.orchestra.run.smithi007.stdout: "none", 2024-09-21T06:46:32.838 INFO:teuthology.orchestra.run.smithi007.stdout: "read", 2024-09-21T06:46:32.838 INFO:teuthology.orchestra.run.smithi007.stdout: "upmap", 2024-09-21T06:46:32.838 INFO:teuthology.orchestra.run.smithi007.stdout: "upmap-read" 2024-09-21T06:46:32.838 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:32.838 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Balancer mode", 2024-09-21T06:46:32.838 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.838 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.838 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.838 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.838 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_ids": { 2024-09-21T06:46:32.839 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "pool_ids", 2024-09-21T06:46:32.839 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:32.839 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.839 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:32.839 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:32.839 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.839 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.839 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.839 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-21T06:46:32.839 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.839 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.839 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.839 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.839 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-09-21T06:46:32.839 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-09-21T06:46:32.840 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:46:32.840 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.840 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:32.840 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-09-21T06:46:32.840 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.840 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.840 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.840 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-21T06:46:32.840 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.840 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.840 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.840 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.840 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:32.840 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:32.841 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:32.841 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:32.841 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:32.841 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:32.841 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.841 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.841 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.841 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.841 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.841 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.841 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.841 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.841 INFO:teuthology.orchestra.run.smithi007.stdout: "upmap_max_deviation": { 2024-09-21T06:46:32.841 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "upmap_max_deviation", 2024-09-21T06:46:32.842 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:32.842 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.842 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:32.842 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5", 2024-09-21T06:46:32.842 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1", 2024-09-21T06:46:32.842 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.842 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.842 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-21T06:46:32.842 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-21T06:46:32.842 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.842 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.842 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.842 INFO:teuthology.orchestra.run.smithi007.stdout: "upmap_max_optimizations": { 2024-09-21T06:46:32.842 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "upmap_max_optimizations", 2024-09-21T06:46:32.843 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-09-21T06:46:32.843 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.843 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:32.843 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-21T06:46:32.843 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.843 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.843 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.843 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-21T06:46:32.843 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.843 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.843 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.843 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:32.843 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:32.843 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.844 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:32.844 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cephadm", 2024-09-21T06:46:32.844 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:32.844 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:32.844 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:32.844 INFO:teuthology.orchestra.run.smithi007.stdout: "agent_down_multiplier": { 2024-09-21T06:46:32.844 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "agent_down_multiplier", 2024-09-21T06:46:32.844 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-21T06:46:32.844 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.844 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.844 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "3.0", 2024-09-21T06:46:32.844 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.844 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.845 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.845 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-21T06:46:32.845 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.845 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.845 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.845 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.845 INFO:teuthology.orchestra.run.smithi007.stdout: "agent_refresh_rate": { 2024-09-21T06:46:32.845 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "agent_refresh_rate", 2024-09-21T06:46:32.845 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:46:32.845 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.845 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.845 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "20", 2024-09-21T06:46:32.845 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.846 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.846 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.846 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-21T06:46:32.846 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.846 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.846 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.846 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.846 INFO:teuthology.orchestra.run.smithi007.stdout: "agent_starting_port": { 2024-09-21T06:46:32.846 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "agent_starting_port", 2024-09-21T06:46:32.846 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:32.846 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.846 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.846 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "4721", 2024-09-21T06:46:32.847 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.847 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.847 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.847 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-21T06:46:32.847 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.847 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.847 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.847 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.847 INFO:teuthology.orchestra.run.smithi007.stdout: "allow_ptrace": { 2024-09-21T06:46:32.847 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "allow_ptrace", 2024-09-21T06:46:32.847 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:32.847 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.847 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.847 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:32.848 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.848 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.848 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.848 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-21T06:46:32.848 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-21T06:46:32.848 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.848 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.848 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.848 INFO:teuthology.orchestra.run.smithi007.stdout: "autotune_interval": { 2024-09-21T06:46:32.848 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "autotune_interval", 2024-09-21T06:46:32.848 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:46:32.848 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.848 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.848 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-09-21T06:46:32.849 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.849 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.849 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.849 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-21T06:46:32.849 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.849 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.849 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.849 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.849 INFO:teuthology.orchestra.run.smithi007.stdout: "autotune_memory_target_ratio": { 2024-09-21T06:46:32.849 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "autotune_memory_target_ratio", 2024-09-21T06:46:32.849 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-21T06:46:32.849 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.849 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.849 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0.7", 2024-09-21T06:46:32.849 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.850 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.850 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.850 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-21T06:46:32.850 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.850 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.850 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.850 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.850 INFO:teuthology.orchestra.run.smithi007.stdout: "cephadm_log_destination": { 2024-09-21T06:46:32.850 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cephadm_log_destination", 2024-09-21T06:46:32.850 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:32.850 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.850 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.850 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:32.850 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.851 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.851 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:32.851 INFO:teuthology.orchestra.run.smithi007.stdout: "file", 2024-09-21T06:46:32.851 INFO:teuthology.orchestra.run.smithi007.stdout: "file,syslog", 2024-09-21T06:46:32.851 INFO:teuthology.orchestra.run.smithi007.stdout: "syslog" 2024-09-21T06:46:32.851 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:32.851 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-21T06:46:32.851 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.851 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.851 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.851 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.851 INFO:teuthology.orchestra.run.smithi007.stdout: "cgroups_split": { 2024-09-21T06:46:32.851 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cgroups_split", 2024-09-21T06:46:32.851 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:32.851 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.852 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.852 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:32.852 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.852 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.852 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.852 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-21T06:46:32.852 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.852 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.852 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.852 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.852 INFO:teuthology.orchestra.run.smithi007.stdout: "config_checks_enabled": { 2024-09-21T06:46:32.852 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "config_checks_enabled", 2024-09-21T06:46:32.852 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:32.852 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.852 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.852 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:32.853 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.853 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.853 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.853 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-21T06:46:32.853 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.853 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.853 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.853 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.853 INFO:teuthology.orchestra.run.smithi007.stdout: "config_dashboard": { 2024-09-21T06:46:32.853 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "config_dashboard", 2024-09-21T06:46:32.853 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:32.853 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.853 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.853 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:32.853 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.854 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.854 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.854 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-21T06:46:32.854 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.854 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.854 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.854 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.854 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_alertmanager": { 2024-09-21T06:46:32.854 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_alertmanager", 2024-09-21T06:46:32.854 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:32.854 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.854 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.854 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-21T06:46:32.855 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.855 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.855 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.855 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Prometheus container image", 2024-09-21T06:46:32.855 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.855 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.855 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.855 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.855 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_base": { 2024-09-21T06:46:32.855 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_base", 2024-09-21T06:46:32.855 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:32.855 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.855 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:32.855 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-21T06:46:32.856 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.856 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.856 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.856 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Container image name, without the tag", 2024-09-21T06:46:32.856 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.856 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.856 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.856 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.856 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_elasticsearch": { 2024-09-21T06:46:32.856 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_elasticsearch", 2024-09-21T06:46:32.856 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:32.856 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.856 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.856 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-21T06:46:32.856 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.857 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.857 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.857 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "elasticsearch container image", 2024-09-21T06:46:32.857 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.857 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.857 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.857 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.857 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_grafana": { 2024-09-21T06:46:32.857 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_grafana", 2024-09-21T06:46:32.857 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:32.857 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.857 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.857 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/grafana:10.4.8", 2024-09-21T06:46:32.857 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.857 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.858 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.858 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Prometheus container image", 2024-09-21T06:46:32.858 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.858 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.858 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.858 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.858 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_haproxy": { 2024-09-21T06:46:32.858 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_haproxy", 2024-09-21T06:46:32.858 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:32.858 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.858 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.858 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-21T06:46:32.858 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.858 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.859 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.859 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "HAproxy container image", 2024-09-21T06:46:32.859 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.859 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.859 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.859 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.859 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_jaeger_agent": { 2024-09-21T06:46:32.859 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_jaeger_agent", 2024-09-21T06:46:32.859 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:32.859 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.859 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.859 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-21T06:46:32.859 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.859 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.859 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.860 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Jaeger agent container image", 2024-09-21T06:46:32.860 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.860 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.860 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.860 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.860 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_jaeger_collector": { 2024-09-21T06:46:32.860 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_jaeger_collector", 2024-09-21T06:46:32.860 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:32.860 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.860 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.860 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-21T06:46:32.860 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.860 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.860 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.860 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Jaeger collector container image", 2024-09-21T06:46:32.860 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.861 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.861 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.861 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.861 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_jaeger_query": { 2024-09-21T06:46:32.861 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_jaeger_query", 2024-09-21T06:46:32.861 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:32.861 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.861 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.861 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-21T06:46:32.861 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.861 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.861 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.861 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Jaeger query container image", 2024-09-21T06:46:32.861 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.861 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.861 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.862 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.862 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_keepalived": { 2024-09-21T06:46:32.862 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_keepalived", 2024-09-21T06:46:32.862 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:32.862 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.862 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.862 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-21T06:46:32.862 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.862 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.862 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.862 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Keepalived container image", 2024-09-21T06:46:32.862 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.862 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.863 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.863 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.863 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_loki": { 2024-09-21T06:46:32.863 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_loki", 2024-09-21T06:46:32.863 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:32.863 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.863 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.863 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-21T06:46:32.863 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.863 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.863 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.863 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Loki container image", 2024-09-21T06:46:32.863 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.863 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.864 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.864 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.864 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_nginx": { 2024-09-21T06:46:32.864 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_nginx", 2024-09-21T06:46:32.864 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:32.864 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.864 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.864 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-21T06:46:32.864 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.864 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.864 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.864 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Nginx container image", 2024-09-21T06:46:32.864 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.864 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.864 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.865 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.865 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_node_exporter": { 2024-09-21T06:46:32.865 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_node_exporter", 2024-09-21T06:46:32.865 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:32.865 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.865 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.865 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-21T06:46:32.865 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.865 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.865 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.865 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Prometheus container image", 2024-09-21T06:46:32.865 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.865 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.865 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.865 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.865 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_nvmeof": { 2024-09-21T06:46:32.866 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_nvmeof", 2024-09-21T06:46:32.866 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:32.866 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.866 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.866 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-21T06:46:32.866 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.866 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.866 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.866 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Nvme-of container image", 2024-09-21T06:46:32.866 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.866 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.866 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.866 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.866 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_oauth2_proxy": { 2024-09-21T06:46:32.867 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_oauth2_proxy", 2024-09-21T06:46:32.867 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:32.867 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.867 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.867 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-21T06:46:32.867 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.867 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.867 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.867 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "oauth2-proxy container image", 2024-09-21T06:46:32.867 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.867 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.867 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.867 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.868 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_prometheus": { 2024-09-21T06:46:32.868 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_prometheus", 2024-09-21T06:46:32.868 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:32.868 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.868 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.868 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-21T06:46:32.868 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.868 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.868 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.868 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Prometheus container image", 2024-09-21T06:46:32.868 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.868 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.868 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.868 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.869 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_promtail": { 2024-09-21T06:46:32.869 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_promtail", 2024-09-21T06:46:32.869 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:32.869 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.869 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.869 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-21T06:46:32.869 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.869 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.869 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.869 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Promtail container image", 2024-09-21T06:46:32.869 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.869 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.869 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.870 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.870 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_samba": { 2024-09-21T06:46:32.870 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_samba", 2024-09-21T06:46:32.870 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:32.870 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.870 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.870 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-21T06:46:32.870 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.870 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.870 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.870 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Samba/SMB container image", 2024-09-21T06:46:32.870 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.870 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.870 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.871 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.871 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_samba_metrics": { 2024-09-21T06:46:32.871 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_samba_metrics", 2024-09-21T06:46:32.871 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:32.871 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.871 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.871 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-21T06:46:32.871 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.871 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.871 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.871 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-21T06:46:32.871 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.871 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.871 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.872 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.872 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_snmp_gateway": { 2024-09-21T06:46:32.872 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_snmp_gateway", 2024-09-21T06:46:32.872 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:32.872 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.872 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.872 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-21T06:46:32.872 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.872 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.872 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.872 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "SNMP Gateway container image", 2024-09-21T06:46:32.872 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.872 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.872 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.873 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.873 INFO:teuthology.orchestra.run.smithi007.stdout: "container_init": { 2024-09-21T06:46:32.873 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_init", 2024-09-21T06:46:32.873 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:32.873 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.873 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.873 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:32.873 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.873 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.873 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.873 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Run podman/docker with `--init`", 2024-09-21T06:46:32.873 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.873 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.873 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.873 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.874 INFO:teuthology.orchestra.run.smithi007.stdout: "daemon_cache_timeout": { 2024-09-21T06:46:32.874 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "daemon_cache_timeout", 2024-09-21T06:46:32.874 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:46:32.874 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.874 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.874 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-09-21T06:46:32.874 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.874 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.874 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.874 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-21T06:46:32.874 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.874 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.875 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.875 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.875 INFO:teuthology.orchestra.run.smithi007.stdout: "default_cephadm_command_timeout": { 2024-09-21T06:46:32.875 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "default_cephadm_command_timeout", 2024-09-21T06:46:32.875 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:32.875 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.875 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.875 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "900", 2024-09-21T06:46:32.875 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.875 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.875 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.875 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-21T06:46:32.875 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.876 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.876 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.876 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.876 INFO:teuthology.orchestra.run.smithi007.stdout: "default_registry": { 2024-09-21T06:46:32.876 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "default_registry", 2024-09-21T06:46:32.876 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:32.876 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.876 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.876 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "docker.io", 2024-09-21T06:46:32.876 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.876 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.876 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.876 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-21T06:46:32.876 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.876 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.877 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.877 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.877 INFO:teuthology.orchestra.run.smithi007.stdout: "device_cache_timeout": { 2024-09-21T06:46:32.877 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "device_cache_timeout", 2024-09-21T06:46:32.877 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:46:32.877 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.877 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.877 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "1800", 2024-09-21T06:46:32.877 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.877 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.877 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.877 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "seconds to cache device inventory", 2024-09-21T06:46:32.877 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.878 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.878 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.878 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.878 INFO:teuthology.orchestra.run.smithi007.stdout: "device_enhanced_scan": { 2024-09-21T06:46:32.878 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "device_enhanced_scan", 2024-09-21T06:46:32.878 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:32.878 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.878 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.878 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:32.878 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.878 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.878 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.878 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-21T06:46:32.878 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.878 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.879 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.879 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.879 INFO:teuthology.orchestra.run.smithi007.stdout: "facts_cache_timeout": { 2024-09-21T06:46:32.879 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "facts_cache_timeout", 2024-09-21T06:46:32.879 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:46:32.879 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.879 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.879 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-09-21T06:46:32.879 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.879 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.879 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.879 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "seconds to cache host facts data", 2024-09-21T06:46:32.879 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.879 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.880 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.880 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.880 INFO:teuthology.orchestra.run.smithi007.stdout: "grafana_dashboards_path": { 2024-09-21T06:46:32.880 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "grafana_dashboards_path", 2024-09-21T06:46:32.880 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:32.880 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.880 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.880 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-21T06:46:32.880 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.880 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.880 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.880 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-21T06:46:32.880 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.880 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.881 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.881 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.881 INFO:teuthology.orchestra.run.smithi007.stdout: "host_check_interval": { 2024-09-21T06:46:32.881 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "host_check_interval", 2024-09-21T06:46:32.881 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:46:32.881 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.881 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.881 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-09-21T06:46:32.881 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.881 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.881 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.881 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to perform a host check", 2024-09-21T06:46:32.881 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.882 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.882 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.882 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.882 INFO:teuthology.orchestra.run.smithi007.stdout: "hw_monitoring": { 2024-09-21T06:46:32.882 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "hw_monitoring", 2024-09-21T06:46:32.882 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:32.882 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.882 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.882 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:32.882 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.882 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.882 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.882 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-21T06:46:32.882 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.883 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.883 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.883 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.883 INFO:teuthology.orchestra.run.smithi007.stdout: "inventory_list_all": { 2024-09-21T06:46:32.883 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "inventory_list_all", 2024-09-21T06:46:32.883 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:32.883 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.883 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.883 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:32.883 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.883 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.883 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.883 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-21T06:46:32.883 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.884 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.884 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.884 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.884 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:32.884 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:32.884 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:32.884 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.884 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:32.884 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:32.884 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.884 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.884 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:32.884 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:32.884 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:32.885 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:32.885 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:32.885 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:32.885 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:32.885 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:32.885 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.885 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.885 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.885 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.885 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.885 INFO:teuthology.orchestra.run.smithi007.stdout: "log_refresh_metadata": { 2024-09-21T06:46:32.885 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_refresh_metadata", 2024-09-21T06:46:32.885 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:32.885 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.885 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.885 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:32.886 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.886 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.886 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.886 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-21T06:46:32.886 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.886 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.886 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.886 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.886 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:32.886 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:32.886 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:32.886 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.886 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.887 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:32.887 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.887 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.887 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.887 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-21T06:46:32.887 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.887 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.887 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.887 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.887 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:32.887 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:32.887 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:32.887 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.887 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:32.888 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:32.888 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.888 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.888 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:32.888 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:32.888 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:32.888 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:32.888 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:32.888 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:32.888 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:32.888 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:32.888 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.888 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.888 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.888 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.889 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.889 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:32.889 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:32.889 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:32.889 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.889 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:32.889 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:32.889 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.889 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.889 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.889 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.889 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.889 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.889 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.890 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.890 INFO:teuthology.orchestra.run.smithi007.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-21T06:46:32.890 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-21T06:46:32.890 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:32.890 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.890 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.890 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:32.890 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.890 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.890 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.890 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-21T06:46:32.890 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.890 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.890 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.891 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.891 INFO:teuthology.orchestra.run.smithi007.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-21T06:46:32.891 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-21T06:46:32.891 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:32.891 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.891 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.891 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "*", 2024-09-21T06:46:32.891 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.891 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.891 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.891 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-21T06:46:32.891 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.891 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.891 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.892 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.892 INFO:teuthology.orchestra.run.smithi007.stdout: "max_count_per_host": { 2024-09-21T06:46:32.892 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_count_per_host", 2024-09-21T06:46:32.892 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:32.892 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.892 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.892 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-21T06:46:32.892 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.892 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.892 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.892 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "max number of daemons per service per host", 2024-09-21T06:46:32.892 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.892 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.893 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.893 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.893 INFO:teuthology.orchestra.run.smithi007.stdout: "max_osd_draining_count": { 2024-09-21T06:46:32.893 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_osd_draining_count", 2024-09-21T06:46:32.893 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:32.893 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.893 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.893 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-21T06:46:32.893 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.893 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.893 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.893 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-21T06:46:32.893 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.893 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.894 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.894 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.894 INFO:teuthology.orchestra.run.smithi007.stdout: "migration_current": { 2024-09-21T06:46:32.894 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "migration_current", 2024-09-21T06:46:32.894 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:32.894 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.894 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.894 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:32.894 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.894 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.894 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.894 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "internal - do not modify", 2024-09-21T06:46:32.894 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.894 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.894 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.895 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.895 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": { 2024-09-21T06:46:32.895 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mode", 2024-09-21T06:46:32.895 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:32.895 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.895 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.895 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "root", 2024-09-21T06:46:32.895 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.895 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.895 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:32.895 INFO:teuthology.orchestra.run.smithi007.stdout: "cephadm-package", 2024-09-21T06:46:32.895 INFO:teuthology.orchestra.run.smithi007.stdout: "root" 2024-09-21T06:46:32.895 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:32.895 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "mode for remote execution of cephadm", 2024-09-21T06:46:32.896 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.896 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.896 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.896 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.896 INFO:teuthology.orchestra.run.smithi007.stdout: "oob_default_addr": { 2024-09-21T06:46:32.896 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "oob_default_addr", 2024-09-21T06:46:32.896 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:32.896 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.896 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.896 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "169.254.1.1", 2024-09-21T06:46:32.896 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.896 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.896 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.896 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-21T06:46:32.897 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.897 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.897 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.897 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.897 INFO:teuthology.orchestra.run.smithi007.stdout: "prometheus_alerts_path": { 2024-09-21T06:46:32.897 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "prometheus_alerts_path", 2024-09-21T06:46:32.897 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:32.897 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.897 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.897 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-21T06:46:32.897 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.897 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.897 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.897 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-21T06:46:32.898 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.898 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.898 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.898 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.898 INFO:teuthology.orchestra.run.smithi007.stdout: "registry_insecure": { 2024-09-21T06:46:32.898 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "registry_insecure", 2024-09-21T06:46:32.898 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:32.898 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.898 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.898 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:32.898 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.898 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.898 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.898 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-21T06:46:32.899 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.899 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.899 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.899 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.899 INFO:teuthology.orchestra.run.smithi007.stdout: "registry_password": { 2024-09-21T06:46:32.899 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "registry_password", 2024-09-21T06:46:32.899 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:32.899 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.899 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.899 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:32.899 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.899 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.899 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.899 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-21T06:46:32.899 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.899 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.900 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.900 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.900 INFO:teuthology.orchestra.run.smithi007.stdout: "registry_url": { 2024-09-21T06:46:32.900 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "registry_url", 2024-09-21T06:46:32.900 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:32.900 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.900 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.900 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:32.900 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.900 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.900 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.900 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-21T06:46:32.900 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.900 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.900 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.901 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.901 INFO:teuthology.orchestra.run.smithi007.stdout: "registry_username": { 2024-09-21T06:46:32.901 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "registry_username", 2024-09-21T06:46:32.901 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:32.901 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.901 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.901 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:32.901 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.901 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.901 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.901 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-21T06:46:32.901 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.901 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.901 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.901 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.901 INFO:teuthology.orchestra.run.smithi007.stdout: "secure_monitoring_stack": { 2024-09-21T06:46:32.902 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "secure_monitoring_stack", 2024-09-21T06:46:32.902 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:32.902 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.902 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.902 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:32.902 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.902 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.902 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.902 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-21T06:46:32.902 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.902 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.902 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.902 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.902 INFO:teuthology.orchestra.run.smithi007.stdout: "service_discovery_port": { 2024-09-21T06:46:32.902 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "service_discovery_port", 2024-09-21T06:46:32.902 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:32.903 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.903 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.903 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8765", 2024-09-21T06:46:32.903 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.903 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.903 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.903 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "cephadm service discovery port", 2024-09-21T06:46:32.903 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.903 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.903 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.903 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.903 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:32.903 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:32.903 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:32.904 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:32.904 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:32.904 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:32.904 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.904 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.904 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.904 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.904 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.904 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.904 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.904 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.904 INFO:teuthology.orchestra.run.smithi007.stdout: "ssh_config_file": { 2024-09-21T06:46:32.904 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ssh_config_file", 2024-09-21T06:46:32.904 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:32.904 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.905 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.905 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:32.905 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.905 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.905 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.905 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-21T06:46:32.905 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.905 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.905 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.905 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.905 INFO:teuthology.orchestra.run.smithi007.stdout: "ssh_keepalive_count_max": { 2024-09-21T06:46:32.905 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ssh_keepalive_count_max", 2024-09-21T06:46:32.905 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:32.906 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.906 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.906 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "3", 2024-09-21T06:46:32.906 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.906 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.906 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.906 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-21T06:46:32.906 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.906 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.906 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.906 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.906 INFO:teuthology.orchestra.run.smithi007.stdout: "ssh_keepalive_interval": { 2024-09-21T06:46:32.907 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ssh_keepalive_interval", 2024-09-21T06:46:32.907 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:32.907 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.907 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.907 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "7", 2024-09-21T06:46:32.907 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.907 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.907 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.907 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-21T06:46:32.907 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.907 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.907 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.907 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.907 INFO:teuthology.orchestra.run.smithi007.stdout: "use_agent": { 2024-09-21T06:46:32.907 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "use_agent", 2024-09-21T06:46:32.908 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:32.908 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.908 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.908 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:32.908 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.908 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.908 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.908 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-21T06:46:32.908 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.908 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.908 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.908 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.908 INFO:teuthology.orchestra.run.smithi007.stdout: "use_repo_digest": { 2024-09-21T06:46:32.908 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "use_repo_digest", 2024-09-21T06:46:32.908 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:32.909 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.909 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.909 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:32.909 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.909 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.909 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.909 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-21T06:46:32.909 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.909 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.909 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.909 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.909 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_on_failed_host_check": { 2024-09-21T06:46:32.909 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_on_failed_host_check", 2024-09-21T06:46:32.909 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:32.910 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.910 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.910 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:32.910 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.910 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.910 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.910 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "raise a health warning if the host check fails", 2024-09-21T06:46:32.910 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.910 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.910 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.910 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.910 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_on_stray_daemons": { 2024-09-21T06:46:32.910 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_on_stray_daemons", 2024-09-21T06:46:32.910 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:32.910 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.911 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.911 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:32.911 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.911 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.911 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.911 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-21T06:46:32.911 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.911 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.911 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.911 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.911 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_on_stray_hosts": { 2024-09-21T06:46:32.911 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_on_stray_hosts", 2024-09-21T06:46:32.911 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:32.911 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.911 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.911 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:32.912 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.912 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.912 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.912 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-21T06:46:32.912 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.912 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.912 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.912 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:32.912 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:32.912 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.912 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:32.912 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crash", 2024-09-21T06:46:32.912 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:32.912 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:32.913 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:32.913 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:32.913 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:32.913 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:32.913 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.913 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:32.913 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:32.913 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.913 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.913 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:32.913 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:32.913 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:32.913 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:32.913 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:32.913 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:32.913 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:32.914 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:32.914 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.914 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.914 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.914 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.914 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.914 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:32.914 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:32.914 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:32.914 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.914 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:32.914 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:32.914 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.914 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.915 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.915 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.915 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.915 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.915 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.915 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.915 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:32.915 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:32.915 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:32.915 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.915 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:32.915 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:32.915 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.916 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.916 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:32.916 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:32.916 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:32.916 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:32.916 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:32.916 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:32.916 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:32.916 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:32.916 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.916 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.916 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.916 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.916 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.917 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:32.917 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:32.917 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:32.917 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.917 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:32.917 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:32.917 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.917 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.917 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.917 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.917 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.917 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.918 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.918 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.918 INFO:teuthology.orchestra.run.smithi007.stdout: "retain_interval": { 2024-09-21T06:46:32.918 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "retain_interval", 2024-09-21T06:46:32.918 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:46:32.918 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.918 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:32.918 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "31536000", 2024-09-21T06:46:32.918 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.918 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.918 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.918 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-21T06:46:32.918 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.918 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.919 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.919 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.919 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:32.919 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:32.919 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:32.919 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:32.919 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:32.919 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:32.919 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.919 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.919 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.919 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.919 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.920 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.920 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.920 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.920 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_recent_interval": { 2024-09-21T06:46:32.920 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_recent_interval", 2024-09-21T06:46:32.920 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:46:32.920 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.920 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:32.920 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "1209600", 2024-09-21T06:46:32.920 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.920 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.920 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.921 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-21T06:46:32.921 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.921 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.921 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.921 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:32.921 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:32.921 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.921 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:32.921 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "dashboard", 2024-09-21T06:46:32.921 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:32.921 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:32.921 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:32.922 INFO:teuthology.orchestra.run.smithi007.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-21T06:46:32.922 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-21T06:46:32.922 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:32.922 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.922 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.922 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-21T06:46:32.922 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.922 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.922 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.922 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.922 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.922 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.922 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.923 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.923 INFO:teuthology.orchestra.run.smithi007.stdout: "ALERTMANAGER_API_HOST": { 2024-09-21T06:46:32.923 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-21T06:46:32.923 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:32.923 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.923 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.923 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:32.923 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.923 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.923 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.923 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.923 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.923 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.924 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.924 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.924 INFO:teuthology.orchestra.run.smithi007.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-21T06:46:32.924 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-21T06:46:32.924 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:32.924 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.924 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.924 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:32.924 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.924 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.924 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.924 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.924 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.924 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.925 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.925 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.925 INFO:teuthology.orchestra.run.smithi007.stdout: "AUDIT_API_ENABLED": { 2024-09-21T06:46:32.925 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "AUDIT_API_ENABLED", 2024-09-21T06:46:32.925 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:32.925 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.925 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.925 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:32.925 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.925 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.925 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.925 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.925 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.925 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.925 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.926 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.926 INFO:teuthology.orchestra.run.smithi007.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-21T06:46:32.926 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-21T06:46:32.926 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:32.926 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.926 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.926 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:32.926 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.926 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.926 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.926 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.926 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.926 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.927 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.927 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.927 INFO:teuthology.orchestra.run.smithi007.stdout: "ENABLE_BROWSABLE_API": { 2024-09-21T06:46:32.927 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-21T06:46:32.927 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:32.927 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.927 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.927 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:32.927 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.927 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.927 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.927 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.927 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.927 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.928 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.928 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.928 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-21T06:46:32.928 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-21T06:46:32.928 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:32.928 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.928 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.928 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:32.928 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.928 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.928 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.928 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.928 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.929 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.929 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.929 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.929 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-21T06:46:32.929 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-21T06:46:32.929 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:32.929 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.929 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.929 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:32.929 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.929 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.929 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.929 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.929 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.930 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.930 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.930 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.930 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-21T06:46:32.930 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-21T06:46:32.930 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:32.930 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.930 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.930 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:32.930 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.930 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.930 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.930 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.930 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.930 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.931 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.931 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.931 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-21T06:46:32.931 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-21T06:46:32.931 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:32.931 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.931 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.931 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:32.931 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.931 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.931 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.931 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.931 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.931 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.932 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.932 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.932 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-21T06:46:32.932 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-21T06:46:32.932 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:32.932 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.932 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.932 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:32.932 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.932 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.932 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.932 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.932 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.932 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.933 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.933 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.933 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-21T06:46:32.933 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-21T06:46:32.933 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:32.933 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.933 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.933 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:32.933 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.933 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.933 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.933 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.933 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.933 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.933 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.934 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.934 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-21T06:46:32.934 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-21T06:46:32.934 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:32.934 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.934 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.934 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:32.934 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.934 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.934 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.934 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.934 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.934 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.934 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.935 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.935 INFO:teuthology.orchestra.run.smithi007.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-21T06:46:32.935 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-21T06:46:32.935 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:32.935 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.935 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.935 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:32.935 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.935 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.935 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.935 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.935 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.935 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.935 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.935 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.935 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_API_PASSWORD": { 2024-09-21T06:46:32.936 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-21T06:46:32.936 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:32.936 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.936 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.936 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "admin", 2024-09-21T06:46:32.936 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.936 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.936 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.936 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.936 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.936 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.936 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.936 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.936 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-21T06:46:32.936 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-21T06:46:32.937 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:32.937 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.937 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.937 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:32.937 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.937 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.937 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.937 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.937 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.937 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.937 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.937 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.937 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_API_URL": { 2024-09-21T06:46:32.937 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_API_URL", 2024-09-21T06:46:32.938 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:32.938 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.938 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.938 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:32.938 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.938 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.938 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.938 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.938 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.938 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.938 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.938 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.938 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_API_USERNAME": { 2024-09-21T06:46:32.939 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-21T06:46:32.939 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:32.939 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.939 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.939 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "admin", 2024-09-21T06:46:32.939 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.939 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.939 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.939 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.939 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.939 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.939 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.939 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.940 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-21T06:46:32.940 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-21T06:46:32.940 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:32.940 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.940 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.940 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:32.940 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.940 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.940 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.940 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.940 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.940 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.940 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.940 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.940 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-21T06:46:32.940 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-21T06:46:32.941 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:32.941 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.941 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.941 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:32.941 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.941 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.941 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.941 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.941 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.941 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.941 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.941 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.941 INFO:teuthology.orchestra.run.smithi007.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-21T06:46:32.941 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-21T06:46:32.942 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:32.942 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.942 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.942 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:32.942 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.942 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.942 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.942 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.942 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.942 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.942 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.942 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.942 INFO:teuthology.orchestra.run.smithi007.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-21T06:46:32.943 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-21T06:46:32.943 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:32.943 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.943 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.943 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:32.943 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.943 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.943 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.943 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.943 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.943 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.943 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.943 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.943 INFO:teuthology.orchestra.run.smithi007.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-21T06:46:32.944 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-21T06:46:32.944 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:32.944 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.944 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.944 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "[]", 2024-09-21T06:46:32.944 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.944 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.944 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.944 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.944 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.944 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.944 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.944 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.944 INFO:teuthology.orchestra.run.smithi007.stdout: "MULTICLUSTER_CONFIG": { 2024-09-21T06:46:32.945 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-21T06:46:32.945 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:32.945 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.945 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.945 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "{}", 2024-09-21T06:46:32.945 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.945 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.945 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.945 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.945 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.945 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.945 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.945 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.945 INFO:teuthology.orchestra.run.smithi007.stdout: "PROMETHEUS_API_HOST": { 2024-09-21T06:46:32.946 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-21T06:46:32.946 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:32.946 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.946 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.946 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:32.946 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.946 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.946 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.946 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.946 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.946 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.946 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.946 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.946 INFO:teuthology.orchestra.run.smithi007.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-21T06:46:32.947 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-21T06:46:32.947 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:32.947 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.947 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.947 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:32.947 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.947 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.947 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.947 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.947 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.947 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.947 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.947 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.947 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-21T06:46:32.948 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-21T06:46:32.948 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:32.948 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.948 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.948 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:32.948 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.948 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.948 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.948 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.948 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.948 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.948 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.948 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.948 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-21T06:46:32.949 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-21T06:46:32.949 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:32.949 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.949 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.949 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:32.949 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.949 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.949 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.949 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.949 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.949 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.949 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.949 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.949 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-21T06:46:32.950 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-21T06:46:32.950 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:32.950 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.950 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.950 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:32.950 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.950 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.950 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.950 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.950 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.950 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.950 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.950 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.951 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-21T06:46:32.951 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-21T06:46:32.951 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:32.951 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.951 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.951 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:32.951 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.951 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.951 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.951 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.951 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.951 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.951 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.951 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.952 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-21T06:46:32.952 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-21T06:46:32.952 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:32.952 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.952 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.952 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:32.952 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.952 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.952 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.952 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.952 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.952 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.952 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.952 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.953 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-21T06:46:32.953 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-21T06:46:32.953 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:32.953 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.953 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.953 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:32.953 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.953 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.953 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.953 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.953 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.953 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.953 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.953 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.953 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-21T06:46:32.954 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-21T06:46:32.954 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:32.954 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.954 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.954 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:32.954 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.954 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.954 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.954 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.954 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.954 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.954 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.954 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.954 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_ENABLED": { 2024-09-21T06:46:32.955 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-21T06:46:32.955 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:32.955 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.955 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.955 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:32.955 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.955 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.955 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.955 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.955 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.955 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.955 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.955 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.956 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-21T06:46:32.956 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-21T06:46:32.956 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:32.956 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.956 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.956 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-21T06:46:32.956 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.956 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.956 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.956 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.956 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.956 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.956 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.956 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.957 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-21T06:46:32.957 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-21T06:46:32.957 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:32.957 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.957 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.957 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-21T06:46:32.957 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.957 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.957 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.957 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.957 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.957 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.957 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.957 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.958 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-21T06:46:32.958 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-21T06:46:32.958 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:32.958 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.958 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.958 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8", 2024-09-21T06:46:32.958 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.958 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.958 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.958 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.958 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.958 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.958 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.958 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.959 INFO:teuthology.orchestra.run.smithi007.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-21T06:46:32.959 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-21T06:46:32.959 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:32.959 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.959 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.959 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "45", 2024-09-21T06:46:32.959 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.959 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.959 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.959 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.959 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.959 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.959 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.960 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.960 INFO:teuthology.orchestra.run.smithi007.stdout: "RGW_API_ACCESS_KEY": { 2024-09-21T06:46:32.960 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-21T06:46:32.960 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:32.960 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.960 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.960 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:32.960 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.960 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.960 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.960 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.960 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.960 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.960 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.961 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.961 INFO:teuthology.orchestra.run.smithi007.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-21T06:46:32.961 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-21T06:46:32.961 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:32.961 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.961 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.961 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "admin", 2024-09-21T06:46:32.961 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.961 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.961 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.961 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.961 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.961 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.961 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.961 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.962 INFO:teuthology.orchestra.run.smithi007.stdout: "RGW_API_SECRET_KEY": { 2024-09-21T06:46:32.962 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-21T06:46:32.962 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:32.962 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.962 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.962 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:32.962 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.962 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.962 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.962 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.962 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.962 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.962 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.962 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.963 INFO:teuthology.orchestra.run.smithi007.stdout: "RGW_API_SSL_VERIFY": { 2024-09-21T06:46:32.963 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-21T06:46:32.963 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:32.963 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.963 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.963 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:32.963 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.963 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.963 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.963 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.963 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.963 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.963 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.963 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.964 INFO:teuthology.orchestra.run.smithi007.stdout: "UNSAFE_TLS_v1_2": { 2024-09-21T06:46:32.964 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-21T06:46:32.964 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:32.964 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.964 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.964 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:32.964 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.964 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.964 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.964 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.964 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.964 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.964 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.964 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.965 INFO:teuthology.orchestra.run.smithi007.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-21T06:46:32.965 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-21T06:46:32.965 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:32.965 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.965 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.965 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:32.965 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.965 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.965 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.965 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.965 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.965 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.965 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.965 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.966 INFO:teuthology.orchestra.run.smithi007.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-21T06:46:32.966 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-21T06:46:32.966 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:32.966 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.966 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.966 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-21T06:46:32.966 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.966 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.966 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.966 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.966 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.966 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.966 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.967 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.967 INFO:teuthology.orchestra.run.smithi007.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-21T06:46:32.967 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-21T06:46:32.967 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:32.967 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.967 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.967 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5", 2024-09-21T06:46:32.967 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.967 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.967 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.967 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.967 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.967 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.967 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.968 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.968 INFO:teuthology.orchestra.run.smithi007.stdout: "cross_origin_url": { 2024-09-21T06:46:32.968 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cross_origin_url", 2024-09-21T06:46:32.968 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:32.968 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.968 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.968 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:32.968 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.968 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.968 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.968 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.968 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.968 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.968 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.969 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.969 INFO:teuthology.orchestra.run.smithi007.stdout: "crt_file": { 2024-09-21T06:46:32.969 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crt_file", 2024-09-21T06:46:32.969 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:32.969 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.969 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.969 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:32.969 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.969 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.969 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.969 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.969 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.969 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.969 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.969 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.970 INFO:teuthology.orchestra.run.smithi007.stdout: "debug": { 2024-09-21T06:46:32.970 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "debug", 2024-09-21T06:46:32.970 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:32.970 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.970 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.970 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:32.970 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.970 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.970 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.970 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Enable/disable debug options", 2024-09-21T06:46:32.970 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.970 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.971 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.971 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.971 INFO:teuthology.orchestra.run.smithi007.stdout: "jwt_token_ttl": { 2024-09-21T06:46:32.971 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "jwt_token_ttl", 2024-09-21T06:46:32.971 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:32.971 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.971 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.971 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "28800", 2024-09-21T06:46:32.971 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.971 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.971 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.971 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.971 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.972 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.972 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.972 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.972 INFO:teuthology.orchestra.run.smithi007.stdout: "key_file": { 2024-09-21T06:46:32.972 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "key_file", 2024-09-21T06:46:32.972 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:32.972 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.972 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.972 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:32.972 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.972 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.972 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.972 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.972 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.973 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.973 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.973 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.973 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:32.973 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:32.973 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:32.973 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.973 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:32.973 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:32.973 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.973 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.973 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:32.973 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:32.973 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:32.974 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:32.974 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:32.974 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:32.974 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:32.974 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:32.974 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.974 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.974 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.974 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.974 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.974 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:32.974 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:32.974 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:32.974 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.975 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:32.975 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:32.975 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.975 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.975 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.975 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.975 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.975 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.975 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.975 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.975 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:32.975 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:32.975 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:32.975 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.975 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:32.976 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:32.976 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.976 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.976 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:32.976 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:32.976 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:32.976 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:32.976 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:32.976 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:32.976 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:32.976 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:32.976 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.976 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.976 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.977 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.977 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.977 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:32.977 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:32.977 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:32.977 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.977 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:32.977 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:32.977 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.977 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.977 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.977 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.977 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.977 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.977 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.978 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.978 INFO:teuthology.orchestra.run.smithi007.stdout: "motd": { 2024-09-21T06:46:32.978 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "motd", 2024-09-21T06:46:32.978 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:32.978 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.978 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.978 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:32.978 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.978 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.978 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.978 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "The message of the day", 2024-09-21T06:46:32.978 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.978 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.978 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.979 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.979 INFO:teuthology.orchestra.run.smithi007.stdout: "redirect_resolve_ip_addr": { 2024-09-21T06:46:32.979 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "redirect_resolve_ip_addr", 2024-09-21T06:46:32.979 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:32.979 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.979 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.979 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:32.979 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.979 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.979 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.979 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.979 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.979 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.979 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.979 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.980 INFO:teuthology.orchestra.run.smithi007.stdout: "server_addr": { 2024-09-21T06:46:32.980 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_addr", 2024-09-21T06:46:32.980 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:32.980 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.980 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.980 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "::", 2024-09-21T06:46:32.980 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.980 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.980 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.980 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.980 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.980 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.980 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.980 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.980 INFO:teuthology.orchestra.run.smithi007.stdout: "server_port": { 2024-09-21T06:46:32.981 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_port", 2024-09-21T06:46:32.981 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:32.981 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.981 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.981 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8080", 2024-09-21T06:46:32.981 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.981 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.981 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.981 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.981 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.981 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.981 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.981 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.981 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:32.982 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:32.982 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:32.982 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:32.982 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:32.982 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:32.982 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.982 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.982 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.982 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.982 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.982 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.982 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.982 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.982 INFO:teuthology.orchestra.run.smithi007.stdout: "ssl": { 2024-09-21T06:46:32.982 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ssl", 2024-09-21T06:46:32.983 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:32.983 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.983 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.983 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:32.983 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.983 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.983 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.983 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.983 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.983 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.983 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.983 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.983 INFO:teuthology.orchestra.run.smithi007.stdout: "ssl_server_port": { 2024-09-21T06:46:32.983 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ssl_server_port", 2024-09-21T06:46:32.983 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:32.984 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.984 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.984 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8443", 2024-09-21T06:46:32.984 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.984 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.984 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.984 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.984 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.984 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.984 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.984 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.984 INFO:teuthology.orchestra.run.smithi007.stdout: "sso_oauth2": { 2024-09-21T06:46:32.985 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sso_oauth2", 2024-09-21T06:46:32.985 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:32.985 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.985 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.985 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:32.985 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.985 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.985 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.985 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.985 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.985 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.985 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.986 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.986 INFO:teuthology.orchestra.run.smithi007.stdout: "standby_behaviour": { 2024-09-21T06:46:32.986 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "standby_behaviour", 2024-09-21T06:46:32.986 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:32.986 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.986 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.986 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "redirect", 2024-09-21T06:46:32.986 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.986 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.986 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:32.986 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:32.986 INFO:teuthology.orchestra.run.smithi007.stdout: "redirect" 2024-09-21T06:46:32.987 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:32.987 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.987 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.987 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.987 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.987 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.987 INFO:teuthology.orchestra.run.smithi007.stdout: "standby_error_status_code": { 2024-09-21T06:46:32.987 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "standby_error_status_code", 2024-09-21T06:46:32.987 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:32.987 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.987 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.987 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "500", 2024-09-21T06:46:32.987 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "400", 2024-09-21T06:46:32.987 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "599", 2024-09-21T06:46:32.988 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.988 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.988 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.988 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.988 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.988 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.988 INFO:teuthology.orchestra.run.smithi007.stdout: "url_prefix": { 2024-09-21T06:46:32.988 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "url_prefix", 2024-09-21T06:46:32.988 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:32.988 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.988 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:32.988 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:32.988 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.988 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.988 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.989 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.989 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.989 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.989 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.989 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:32.989 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:32.989 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.989 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:32.989 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "devicehealth", 2024-09-21T06:46:32.989 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:32.989 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:32.989 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:32.989 INFO:teuthology.orchestra.run.smithi007.stdout: "enable_monitoring": { 2024-09-21T06:46:32.989 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "enable_monitoring", 2024-09-21T06:46:32.989 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:32.990 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.990 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:32.990 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:32.990 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.990 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.990 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.990 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "monitor device health metrics", 2024-09-21T06:46:32.990 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.990 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.990 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.990 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.990 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:32.990 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:32.991 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:32.991 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.991 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:32.991 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:32.991 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.991 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.991 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:32.991 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:32.991 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:32.991 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:32.991 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:32.991 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:32.991 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:32.991 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:32.992 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.992 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.992 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.992 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.992 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.992 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:32.992 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:32.992 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:32.992 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.992 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:32.992 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:32.992 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.992 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.992 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.992 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.993 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.993 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.993 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.993 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.993 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:32.993 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:32.993 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:32.993 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.993 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:32.993 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:32.993 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.993 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.993 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:32.993 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:32.993 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:32.994 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:32.994 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:32.994 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:32.994 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:32.994 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:32.994 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.994 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.994 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.994 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.994 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.994 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:32.994 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:32.994 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:32.994 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.995 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:32.995 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:32.995 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.995 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.995 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.995 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:32.995 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.995 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.995 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.995 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.995 INFO:teuthology.orchestra.run.smithi007.stdout: "mark_out_threshold": { 2024-09-21T06:46:32.995 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mark_out_threshold", 2024-09-21T06:46:32.995 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:46:32.995 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.995 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:32.996 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "2419200", 2024-09-21T06:46:32.996 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.996 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.996 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.996 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-21T06:46:32.996 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.996 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.996 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.996 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.996 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_name": { 2024-09-21T06:46:32.996 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "pool_name", 2024-09-21T06:46:32.996 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:32.996 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.996 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:32.996 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "device_health_metrics", 2024-09-21T06:46:32.997 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.997 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.997 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.997 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-21T06:46:32.997 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.997 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.997 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.997 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.997 INFO:teuthology.orchestra.run.smithi007.stdout: "retention_period": { 2024-09-21T06:46:32.997 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "retention_period", 2024-09-21T06:46:32.997 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:46:32.997 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.997 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:32.997 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "15552000", 2024-09-21T06:46:32.998 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.998 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.998 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.998 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how long to retain device health metrics", 2024-09-21T06:46:32.998 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.998 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.998 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.998 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.998 INFO:teuthology.orchestra.run.smithi007.stdout: "scrape_frequency": { 2024-09-21T06:46:32.998 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "scrape_frequency", 2024-09-21T06:46:32.998 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:46:32.998 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.998 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:32.998 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "86400", 2024-09-21T06:46:32.999 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:32.999 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:32.999 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:32.999 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-21T06:46:32.999 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:32.999 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:32.999 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:32.999 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:32.999 INFO:teuthology.orchestra.run.smithi007.stdout: "self_heal": { 2024-09-21T06:46:32.999 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "self_heal", 2024-09-21T06:46:32.999 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:32.999 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:32.999 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:32.999 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:32.999 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.000 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.000 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.000 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-21T06:46:33.000 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.000 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.000 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.000 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.000 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-09-21T06:46:33.000 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-09-21T06:46:33.000 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:46:33.000 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.000 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.000 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-09-21T06:46:33.000 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.001 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.001 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.001 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to wake up and check device health", 2024-09-21T06:46:33.001 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.001 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.001 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.001 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.001 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:33.001 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:33.001 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.001 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:33.001 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.001 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.001 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.001 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.002 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.002 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.002 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.002 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.002 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.002 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.002 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_threshold": { 2024-09-21T06:46:33.002 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_threshold", 2024-09-21T06:46:33.002 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:46:33.002 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.002 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.002 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "7257600", 2024-09-21T06:46:33.002 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.002 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.002 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.003 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-21T06:46:33.003 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.003 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.003 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.003 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.003 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.003 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.003 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:33.003 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "diskprediction_local", 2024-09-21T06:46:33.003 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:33.003 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:33.003 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:33.003 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:33.003 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:33.003 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.004 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.004 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.004 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.004 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.004 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.004 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.004 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.004 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.004 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.004 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.004 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.004 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.004 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.004 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.005 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.005 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.005 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.005 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.005 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:33.005 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:33.005 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.005 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.005 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.005 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.005 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.005 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.005 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.005 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.005 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.006 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.006 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.006 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.006 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:33.006 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:33.006 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.006 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.006 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.006 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:33.006 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.006 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.006 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.006 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.006 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.007 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.007 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.007 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.007 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.007 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.007 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.007 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.007 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.007 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.007 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.007 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:33.007 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:33.007 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.007 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.007 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.008 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.008 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.008 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.008 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.008 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.008 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.008 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.008 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.008 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.008 INFO:teuthology.orchestra.run.smithi007.stdout: "predict_interval": { 2024-09-21T06:46:33.008 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "predict_interval", 2024-09-21T06:46:33.008 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.008 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.008 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.008 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "86400", 2024-09-21T06:46:33.009 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.009 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.009 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.009 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.009 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.009 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.009 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.009 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.009 INFO:teuthology.orchestra.run.smithi007.stdout: "predictor_model": { 2024-09-21T06:46:33.009 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "predictor_model", 2024-09-21T06:46:33.009 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.009 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.009 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.009 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "prophetstor", 2024-09-21T06:46:33.009 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.010 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.010 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.010 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.010 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.010 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.010 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.010 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.010 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-09-21T06:46:33.010 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-09-21T06:46:33.010 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.010 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.010 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.010 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-09-21T06:46:33.011 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.011 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.011 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.011 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.011 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.011 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.011 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.011 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.011 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:33.011 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:33.011 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.011 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:33.011 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.011 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.011 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.012 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.012 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.012 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.012 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.012 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.012 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.012 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.012 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.012 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.012 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:33.012 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "influx", 2024-09-21T06:46:33.012 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": false, 2024-09-21T06:46:33.012 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "influxdb python module not found", 2024-09-21T06:46:33.012 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:33.012 INFO:teuthology.orchestra.run.smithi007.stdout: "batch_size": { 2024-09-21T06:46:33.013 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "batch_size", 2024-09-21T06:46:33.013 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.013 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.013 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.013 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5000", 2024-09-21T06:46:33.013 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.013 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.013 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.013 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-21T06:46:33.013 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.013 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.013 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.013 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.013 INFO:teuthology.orchestra.run.smithi007.stdout: "database": { 2024-09-21T06:46:33.013 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "database", 2024-09-21T06:46:33.014 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.014 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.014 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.014 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "ceph", 2024-09-21T06:46:33.014 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.014 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.014 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.014 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-21T06:46:33.014 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.014 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.014 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.014 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.014 INFO:teuthology.orchestra.run.smithi007.stdout: "hostname": { 2024-09-21T06:46:33.014 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "hostname", 2024-09-21T06:46:33.015 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.015 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.015 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.015 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.015 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.015 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.015 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.015 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "InfluxDB server hostname", 2024-09-21T06:46:33.015 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.015 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.015 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.015 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.015 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-09-21T06:46:33.015 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-09-21T06:46:33.015 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:46:33.016 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.016 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.016 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "30", 2024-09-21T06:46:33.016 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "5", 2024-09-21T06:46:33.016 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.016 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.016 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-21T06:46:33.016 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.016 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.016 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.016 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.016 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:33.016 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:33.016 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.017 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.017 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.017 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.017 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.017 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.017 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.017 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.017 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.017 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.017 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.017 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.017 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.017 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.017 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.018 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.018 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.018 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.018 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.018 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:33.018 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:33.018 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.018 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.018 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.018 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.018 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.018 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.018 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.018 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.018 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.019 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.019 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.019 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.019 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:33.019 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:33.019 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.019 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.019 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.019 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:33.019 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.019 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.019 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.019 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.019 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.020 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.020 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.020 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.020 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.020 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.020 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.020 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.020 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.020 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.020 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.020 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:33.020 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:33.020 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.020 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.021 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.021 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.021 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.021 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.021 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.021 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.021 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.021 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.021 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.021 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.021 INFO:teuthology.orchestra.run.smithi007.stdout: "password": { 2024-09-21T06:46:33.021 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "password", 2024-09-21T06:46:33.021 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.021 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.022 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.022 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.022 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.022 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.022 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.022 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "password of InfluxDB server user", 2024-09-21T06:46:33.022 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.022 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.022 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.022 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.022 INFO:teuthology.orchestra.run.smithi007.stdout: "port": { 2024-09-21T06:46:33.022 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "port", 2024-09-21T06:46:33.022 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.023 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.023 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.023 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8086", 2024-09-21T06:46:33.023 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.023 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.023 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.023 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "InfluxDB server port", 2024-09-21T06:46:33.023 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.023 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.023 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.023 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.023 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:33.023 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:33.024 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.024 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:33.024 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.024 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.024 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.024 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.024 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.024 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.024 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.024 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.024 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.024 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.024 INFO:teuthology.orchestra.run.smithi007.stdout: "ssl": { 2024-09-21T06:46:33.024 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ssl", 2024-09-21T06:46:33.025 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.025 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.025 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.025 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "false", 2024-09-21T06:46:33.025 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.025 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.025 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.025 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T06:46:33.025 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.025 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.025 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.025 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.025 INFO:teuthology.orchestra.run.smithi007.stdout: "threads": { 2024-09-21T06:46:33.025 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "threads", 2024-09-21T06:46:33.026 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.026 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.026 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.026 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5", 2024-09-21T06:46:33.026 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1", 2024-09-21T06:46:33.026 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "32", 2024-09-21T06:46:33.026 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.026 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-21T06:46:33.026 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.026 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.026 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.026 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.026 INFO:teuthology.orchestra.run.smithi007.stdout: "username": { 2024-09-21T06:46:33.027 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "username", 2024-09-21T06:46:33.027 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.027 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.027 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.027 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.027 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.027 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.027 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.027 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "username of InfluxDB server user", 2024-09-21T06:46:33.027 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.027 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.027 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.027 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.027 INFO:teuthology.orchestra.run.smithi007.stdout: "verify_ssl": { 2024-09-21T06:46:33.028 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "verify_ssl", 2024-09-21T06:46:33.028 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.028 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.028 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.028 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "true", 2024-09-21T06:46:33.028 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.028 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.028 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.028 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T06:46:33.028 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.028 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.028 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.028 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.028 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.029 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.029 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:33.029 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "insights", 2024-09-21T06:46:33.029 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:33.029 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:33.029 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:33.029 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:33.029 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:33.029 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.029 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.029 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.029 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.029 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.029 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.030 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.030 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.030 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.030 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.030 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.030 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.030 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.030 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.030 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.030 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.030 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.030 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.030 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.030 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:33.031 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:33.031 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.031 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.031 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.031 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.031 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.031 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.031 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.031 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.031 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.031 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.031 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.031 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.031 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:33.032 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:33.032 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.032 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.032 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.032 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:33.032 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.032 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.032 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.032 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.032 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.032 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.032 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.032 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.032 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.033 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.033 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.033 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.033 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.033 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.033 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.033 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:33.033 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:33.033 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.033 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.033 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.033 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.033 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.033 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.034 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.034 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.034 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.034 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.034 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.034 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.034 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:33.034 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:33.034 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.034 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:33.034 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.034 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.034 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.034 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.035 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.035 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.035 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.035 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.035 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.035 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.035 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.035 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.035 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:33.035 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "iostat", 2024-09-21T06:46:33.035 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:33.035 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:33.035 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:33.035 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:33.036 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:33.036 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.036 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.036 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.036 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.036 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.036 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.036 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.036 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.036 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.036 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.036 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.036 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.036 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.036 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.037 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.037 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.037 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.037 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.037 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.037 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:33.037 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:33.037 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.037 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.037 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.037 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.037 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.037 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.038 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.038 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.038 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.038 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.038 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.038 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.038 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:33.038 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:33.038 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.038 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.038 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.038 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:33.038 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.038 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.039 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.039 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.039 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.039 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.039 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.039 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.039 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.039 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.039 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.039 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.039 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.039 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.039 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.039 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:33.040 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:33.040 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.040 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.040 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.040 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.040 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.040 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.040 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.040 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.040 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.040 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.040 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.040 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.041 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:33.041 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:33.041 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.041 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:33.041 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.041 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.041 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.041 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.041 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.041 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.041 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.041 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.041 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.042 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.042 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.042 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.042 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:33.042 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "k8sevents", 2024-09-21T06:46:33.042 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:33.042 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:33.042 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:33.042 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_event_retention_days": { 2024-09-21T06:46:33.042 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ceph_event_retention_days", 2024-09-21T06:46:33.042 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.042 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.042 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.042 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "7", 2024-09-21T06:46:33.043 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.043 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.043 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.043 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-21T06:46:33.043 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.043 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.043 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.043 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.043 INFO:teuthology.orchestra.run.smithi007.stdout: "config_check_secs": { 2024-09-21T06:46:33.043 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "config_check_secs", 2024-09-21T06:46:33.043 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.043 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.043 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.044 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-21T06:46:33.044 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "10", 2024-09-21T06:46:33.044 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.044 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.044 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-21T06:46:33.044 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.044 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.044 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.044 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.044 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:33.044 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:33.044 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.044 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.044 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.045 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.045 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.045 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.045 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.045 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.045 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.045 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.045 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.045 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.045 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.045 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.045 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.045 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.045 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.045 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.046 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.046 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:33.046 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:33.046 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.046 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.046 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.046 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.046 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.046 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.046 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.046 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.046 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.046 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.047 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.047 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.047 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:33.047 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:33.047 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.047 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.047 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.047 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:33.047 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.047 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.047 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.047 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.047 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.048 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.048 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.048 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.048 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.048 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.048 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.048 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.048 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.048 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.048 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.048 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:33.048 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:33.048 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.048 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.049 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.049 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.049 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.049 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.049 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.049 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.049 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.049 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.049 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.049 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.049 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:33.049 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:33.049 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.049 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:33.049 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.050 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.050 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.050 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.050 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.050 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.050 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.050 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.050 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.050 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.050 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.050 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.050 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:33.050 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "localpool", 2024-09-21T06:46:33.050 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:33.050 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:33.051 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:33.051 INFO:teuthology.orchestra.run.smithi007.stdout: "failure_domain": { 2024-09-21T06:46:33.051 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "failure_domain", 2024-09-21T06:46:33.051 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.051 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.051 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.051 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "host", 2024-09-21T06:46:33.051 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.051 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.051 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.051 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "failure domain for any created local pool", 2024-09-21T06:46:33.051 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-21T06:46:33.051 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.051 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.052 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.052 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:33.052 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:33.052 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.052 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.052 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.052 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.052 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.052 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.052 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.052 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.052 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.052 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.052 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.052 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.052 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.052 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.053 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.053 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.053 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.053 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.053 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.053 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:33.053 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:33.053 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.053 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.053 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.053 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.053 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.053 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.053 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.053 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.053 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.054 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.054 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.054 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.054 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:33.054 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:33.054 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.054 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.054 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.054 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:33.054 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.054 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.054 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.054 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.054 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.054 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.055 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.055 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.055 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.055 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.055 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.055 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.055 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.055 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.055 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.055 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:33.055 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:33.055 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.055 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.055 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.055 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.056 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.056 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.056 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.056 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.056 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.056 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.056 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.056 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.056 INFO:teuthology.orchestra.run.smithi007.stdout: "min_size": { 2024-09-21T06:46:33.056 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "min_size", 2024-09-21T06:46:33.056 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.056 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.056 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.056 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.056 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.057 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.057 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.057 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "default min_size for any created local pool", 2024-09-21T06:46:33.057 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-21T06:46:33.057 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.057 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.057 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.057 INFO:teuthology.orchestra.run.smithi007.stdout: "num_rep": { 2024-09-21T06:46:33.057 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "num_rep", 2024-09-21T06:46:33.057 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.057 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.057 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.057 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "3", 2024-09-21T06:46:33.057 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.057 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.058 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.058 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "default replica count for any created local pool", 2024-09-21T06:46:33.058 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.058 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.058 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.058 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.058 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num": { 2024-09-21T06:46:33.058 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "pg_num", 2024-09-21T06:46:33.058 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.058 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.058 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.058 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "128", 2024-09-21T06:46:33.058 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.058 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.059 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.059 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "default pg_num for any created local pool", 2024-09-21T06:46:33.059 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.059 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.059 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.059 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.059 INFO:teuthology.orchestra.run.smithi007.stdout: "prefix": { 2024-09-21T06:46:33.059 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "prefix", 2024-09-21T06:46:33.059 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.059 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.059 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.059 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.059 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.059 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.060 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.060 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "name prefix for any created local pool", 2024-09-21T06:46:33.060 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.060 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.060 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.060 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.060 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:33.060 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:33.060 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.060 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:33.060 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.060 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.060 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.060 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.060 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.061 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.061 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.061 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.061 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.061 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.061 INFO:teuthology.orchestra.run.smithi007.stdout: "subtree": { 2024-09-21T06:46:33.061 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "subtree", 2024-09-21T06:46:33.061 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.061 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.061 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.061 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "rack", 2024-09-21T06:46:33.061 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.061 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.061 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.061 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-21T06:46:33.062 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-21T06:46:33.062 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.062 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.062 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.062 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.062 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.062 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:33.062 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mds_autoscaler", 2024-09-21T06:46:33.062 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:33.062 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:33.062 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:33.062 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:33.062 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:33.062 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.063 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.063 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.063 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.063 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.063 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.063 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.063 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.063 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.063 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.063 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.063 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.063 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.063 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.063 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.063 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.064 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.064 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.064 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.064 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:33.064 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:33.064 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.064 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.064 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.064 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.064 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.064 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.064 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.065 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.065 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.065 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.065 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.065 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.065 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:33.065 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:33.065 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.065 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.065 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.065 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:33.065 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.065 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.065 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.066 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.066 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.066 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.066 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.066 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.066 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.066 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.066 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.066 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.066 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.066 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.066 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.066 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:33.067 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:33.067 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.067 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.067 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.067 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.067 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.067 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.067 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.067 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.067 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.067 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.067 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.067 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.067 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:33.068 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:33.068 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.068 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:33.068 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.068 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.068 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.068 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.068 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.068 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.068 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.068 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.068 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.068 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.068 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.069 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.069 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:33.069 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mirroring", 2024-09-21T06:46:33.069 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:33.069 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:33.069 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:33.069 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:33.069 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:33.069 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.069 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.069 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.069 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.069 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.069 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.070 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.070 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.070 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.070 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.070 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.070 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.070 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.070 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.070 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.070 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.070 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.070 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.070 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.071 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:33.071 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:33.071 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.071 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.071 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.071 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.071 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.071 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.071 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.071 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.071 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.071 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.071 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.072 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.072 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:33.072 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:33.072 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.072 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.072 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.072 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:33.072 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.072 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.072 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.072 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.072 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.072 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.072 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.073 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.073 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.073 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.073 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.073 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.073 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.073 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.073 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.073 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:33.073 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:33.073 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.073 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.073 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.074 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.074 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.074 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.074 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.074 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.074 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.074 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.074 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.074 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.074 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:33.074 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:33.074 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.074 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:33.074 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.074 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.075 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.075 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.075 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.075 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.075 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.075 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.075 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.075 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.075 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.075 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.075 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:33.075 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "nfs", 2024-09-21T06:46:33.075 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:33.075 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:33.076 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:33.076 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:33.076 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:33.076 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.076 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.076 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.076 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.076 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.076 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.076 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.076 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.076 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.076 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.076 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.077 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.077 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.077 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.077 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.077 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.077 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.077 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.077 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.077 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:33.077 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:33.077 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.077 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.077 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.077 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.077 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.078 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.078 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.078 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.078 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.078 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.078 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.078 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.078 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:33.078 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:33.078 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.078 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.078 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.079 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:33.079 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.079 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.079 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.079 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.079 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.079 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.079 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.079 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.079 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.079 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.079 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.079 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.079 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.080 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.080 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.080 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:33.080 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:33.080 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.080 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.080 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.080 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.080 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.080 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.080 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.080 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.080 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.080 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.081 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.081 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.081 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:33.081 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:33.081 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.081 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:33.081 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.081 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.081 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.081 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.081 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.081 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.081 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.081 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.082 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.082 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.082 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.082 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.082 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:33.082 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "orchestrator", 2024-09-21T06:46:33.082 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:33.082 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:33.082 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:33.082 INFO:teuthology.orchestra.run.smithi007.stdout: "fail_fs": { 2024-09-21T06:46:33.082 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "fail_fs", 2024-09-21T06:46:33.082 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.082 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.083 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.083 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.083 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.083 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.083 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.083 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-21T06:46:33.083 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.083 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.083 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.083 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.083 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:33.083 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:33.083 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.083 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.084 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.084 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.084 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.084 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.084 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.084 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.084 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.084 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.084 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.084 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.084 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.084 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.084 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.085 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.085 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.085 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.085 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.085 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:33.085 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:33.085 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.085 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.085 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.085 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.085 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.085 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.085 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.085 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.085 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.086 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.086 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.086 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.086 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:33.086 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:33.086 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.086 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.086 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.086 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:33.086 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.086 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.086 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.086 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.086 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.087 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.087 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.087 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.087 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.087 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.087 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.087 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.087 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.087 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.087 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.087 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:33.087 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:33.088 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.088 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.088 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.088 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.088 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.088 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.088 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.088 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.088 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.088 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.088 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.088 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.088 INFO:teuthology.orchestra.run.smithi007.stdout: "orchestrator": { 2024-09-21T06:46:33.088 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "orchestrator", 2024-09-21T06:46:33.089 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.089 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.089 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.089 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.089 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.089 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.089 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.089 INFO:teuthology.orchestra.run.smithi007.stdout: "cephadm", 2024-09-21T06:46:33.089 INFO:teuthology.orchestra.run.smithi007.stdout: "rook", 2024-09-21T06:46:33.089 INFO:teuthology.orchestra.run.smithi007.stdout: "test_orchestrator" 2024-09-21T06:46:33.089 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.089 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Orchestrator backend", 2024-09-21T06:46:33.089 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.090 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.090 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.090 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.090 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:33.090 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:33.090 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.090 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:33.090 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.090 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.090 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.090 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.090 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.090 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.091 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.091 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.091 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.091 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.091 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.091 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.091 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:33.091 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "osd_perf_query", 2024-09-21T06:46:33.091 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:33.091 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:33.091 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:33.091 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:33.091 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:33.091 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.092 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.092 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.092 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.092 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.092 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.092 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.092 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.092 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.092 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.092 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.092 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.092 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.092 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.093 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.093 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.093 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.093 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.093 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.093 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:33.093 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:33.093 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.093 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.093 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.093 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.093 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.093 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.093 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.094 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.094 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.094 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.094 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.094 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.094 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:33.094 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:33.094 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.094 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.094 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.094 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:33.094 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.094 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.095 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.095 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.095 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.095 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.095 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.095 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.095 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.095 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.095 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.095 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.095 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.095 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.095 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.095 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:33.096 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:33.096 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.096 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.096 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.096 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.096 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.096 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.096 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.096 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.096 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.096 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.096 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.096 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.096 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:33.097 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:33.097 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.097 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:33.097 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.097 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.097 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.097 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.097 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.097 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.097 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.097 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.097 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.097 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.098 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.098 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.098 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:33.098 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "osd_support", 2024-09-21T06:46:33.098 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:33.098 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:33.098 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:33.098 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:33.098 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:33.098 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.098 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.098 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.098 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.098 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.099 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.099 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.099 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.099 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.099 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.099 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.099 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.099 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.099 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.099 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.099 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.099 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.099 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.099 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.100 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:33.100 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:33.100 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.100 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.100 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.100 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.100 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.100 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.100 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.100 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.100 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.100 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.100 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.100 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.101 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:33.101 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:33.101 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.101 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.101 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.101 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:33.101 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.101 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.101 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.101 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.101 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.101 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.101 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.101 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.101 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.102 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.102 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.102 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.102 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.102 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.102 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.102 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:33.102 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:33.102 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.102 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.102 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.102 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.102 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.102 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.103 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.103 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.103 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.103 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.103 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.103 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.103 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:33.103 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:33.103 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.103 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:33.103 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.103 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.103 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.103 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.103 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.103 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.104 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.104 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.104 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.104 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.104 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.104 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.104 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:33.104 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "pg_autoscaler", 2024-09-21T06:46:33.104 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:33.104 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:33.104 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:33.104 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:33.104 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:33.104 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.104 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.104 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.105 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.105 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.105 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.105 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.105 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.105 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.105 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.105 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.105 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.105 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.105 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.105 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.105 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.106 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.106 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.106 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.106 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:33.106 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:33.106 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.106 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.106 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.106 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.106 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.106 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.106 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.106 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.106 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.107 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.107 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.107 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.107 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:33.107 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:33.107 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.107 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.107 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.107 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:33.107 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.107 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.107 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.107 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.108 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.108 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.108 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.108 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.108 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.108 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.108 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.108 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.108 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.108 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.108 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.108 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:33.108 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:33.108 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.108 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.109 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.109 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.109 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.109 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.109 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.109 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.109 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.109 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.109 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.109 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.109 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-09-21T06:46:33.109 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-09-21T06:46:33.109 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:46:33.109 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.110 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.110 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-09-21T06:46:33.110 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.110 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.110 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.110 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.110 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.110 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.110 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.110 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.110 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:33.110 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:33.110 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.111 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:33.111 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.111 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.111 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.111 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.111 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.111 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.111 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.111 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.111 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.111 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.111 INFO:teuthology.orchestra.run.smithi007.stdout: "threshold": { 2024-09-21T06:46:33.111 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "threshold", 2024-09-21T06:46:33.111 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-21T06:46:33.111 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.112 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.112 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "3.0", 2024-09-21T06:46:33.112 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1.0", 2024-09-21T06:46:33.112 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.112 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.112 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "scaling threshold", 2024-09-21T06:46:33.112 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-21T06:46:33.112 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.112 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.112 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.112 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.112 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.112 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:33.112 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "progress", 2024-09-21T06:46:33.113 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:33.113 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:33.113 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:33.113 INFO:teuthology.orchestra.run.smithi007.stdout: "allow_pg_recovery_event": { 2024-09-21T06:46:33.113 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "allow_pg_recovery_event", 2024-09-21T06:46:33.113 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.113 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.113 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.113 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.113 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.113 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.113 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.113 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-21T06:46:33.114 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.114 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.114 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.114 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.114 INFO:teuthology.orchestra.run.smithi007.stdout: "enabled": { 2024-09-21T06:46:33.114 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "enabled", 2024-09-21T06:46:33.114 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.114 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.114 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.114 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:33.114 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.114 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.114 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.115 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.115 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.115 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.115 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.115 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.115 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:33.115 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:33.115 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.115 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.115 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.115 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.115 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.115 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.115 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.116 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.116 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.116 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.116 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.116 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.116 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.116 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.116 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.116 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.116 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.116 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.116 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.116 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:33.116 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:33.116 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.117 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.117 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.117 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.117 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.117 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.117 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.117 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.117 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.117 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.117 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.117 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.117 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:33.117 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:33.117 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.117 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.118 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.118 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:33.118 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.118 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.118 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.118 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.118 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.118 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.118 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.118 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.118 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.118 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.118 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.118 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.119 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.119 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.119 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.119 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:33.119 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:33.119 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.119 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.119 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.119 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.119 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.119 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.119 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.119 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.120 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.120 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.120 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.120 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.120 INFO:teuthology.orchestra.run.smithi007.stdout: "max_completed_events": { 2024-09-21T06:46:33.120 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_completed_events", 2024-09-21T06:46:33.120 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.120 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.120 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.120 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "50", 2024-09-21T06:46:33.120 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.121 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.121 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.121 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "number of past completed events to remember", 2024-09-21T06:46:33.121 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.121 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.121 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.121 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.121 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-09-21T06:46:33.121 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-09-21T06:46:33.121 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:46:33.121 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.121 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.121 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5", 2024-09-21T06:46:33.121 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.122 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.122 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.122 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how long the module is going to sleep", 2024-09-21T06:46:33.122 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.122 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.122 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.122 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.122 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:33.122 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:33.122 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.122 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:33.122 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.122 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.122 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.123 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.123 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.123 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.123 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.123 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.123 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.123 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.123 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.123 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.123 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:33.123 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "prometheus", 2024-09-21T06:46:33.123 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:33.123 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:33.124 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:33.124 INFO:teuthology.orchestra.run.smithi007.stdout: "cache": { 2024-09-21T06:46:33.124 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cache", 2024-09-21T06:46:33.124 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.124 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.124 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.124 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:33.124 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.124 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.124 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.124 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.124 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.124 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.124 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.124 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.125 INFO:teuthology.orchestra.run.smithi007.stdout: "exclude_perf_counters": { 2024-09-21T06:46:33.125 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "exclude_perf_counters", 2024-09-21T06:46:33.125 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.125 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.125 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.125 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:33.125 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.125 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.125 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.125 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-21T06:46:33.125 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-21T06:46:33.125 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.125 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.125 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.125 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:33.126 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:33.126 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.126 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.126 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.126 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.126 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.126 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.126 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.126 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.126 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.126 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.126 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.126 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.126 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.127 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.127 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.127 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.127 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.127 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.127 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.127 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:33.127 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:33.127 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.127 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.127 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.127 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.127 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.127 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.128 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.128 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.128 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.128 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.128 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.128 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.128 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:33.128 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:33.128 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.128 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.128 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.128 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:33.128 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.128 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.128 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.128 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.129 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.129 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.129 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.129 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.129 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.129 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.129 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.129 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.129 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.129 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.129 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.129 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:33.129 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:33.129 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.129 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.129 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.129 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.130 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.130 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.130 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.130 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.130 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.130 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.130 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.130 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.130 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_stats_pools": { 2024-09-21T06:46:33.130 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rbd_stats_pools", 2024-09-21T06:46:33.130 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.130 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.130 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.130 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.130 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.131 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.131 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.131 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.131 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.131 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.131 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.131 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.131 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-21T06:46:33.131 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-21T06:46:33.131 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.131 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.131 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.131 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "300", 2024-09-21T06:46:33.131 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.131 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.131 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.132 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.132 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.132 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.132 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.132 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.132 INFO:teuthology.orchestra.run.smithi007.stdout: "scrape_interval": { 2024-09-21T06:46:33.132 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "scrape_interval", 2024-09-21T06:46:33.132 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-21T06:46:33.132 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.132 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.132 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "15.0", 2024-09-21T06:46:33.132 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.132 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.132 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.132 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.132 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.133 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.133 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.133 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.133 INFO:teuthology.orchestra.run.smithi007.stdout: "server_addr": { 2024-09-21T06:46:33.133 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_addr", 2024-09-21T06:46:33.133 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.133 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.133 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.133 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "::", 2024-09-21T06:46:33.133 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.133 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.133 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.133 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-21T06:46:33.133 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.133 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.134 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.134 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.134 INFO:teuthology.orchestra.run.smithi007.stdout: "server_port": { 2024-09-21T06:46:33.134 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_port", 2024-09-21T06:46:33.134 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.134 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.134 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.134 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "9283", 2024-09-21T06:46:33.134 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.134 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.134 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.134 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-21T06:46:33.134 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.134 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.134 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.135 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.135 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:33.135 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:33.135 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.135 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:33.135 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.135 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.135 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.135 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.135 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.135 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.135 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.135 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.135 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.136 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.136 INFO:teuthology.orchestra.run.smithi007.stdout: "stale_cache_strategy": { 2024-09-21T06:46:33.136 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "stale_cache_strategy", 2024-09-21T06:46:33.136 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.136 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.136 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.136 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "log", 2024-09-21T06:46:33.136 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.136 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.136 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.136 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.136 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.136 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.136 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.137 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.137 INFO:teuthology.orchestra.run.smithi007.stdout: "standby_behaviour": { 2024-09-21T06:46:33.137 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "standby_behaviour", 2024-09-21T06:46:33.137 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.137 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.137 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.137 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "default", 2024-09-21T06:46:33.137 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.137 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.137 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.137 INFO:teuthology.orchestra.run.smithi007.stdout: "default", 2024-09-21T06:46:33.137 INFO:teuthology.orchestra.run.smithi007.stdout: "error" 2024-09-21T06:46:33.137 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.137 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.137 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.138 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.138 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.138 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.138 INFO:teuthology.orchestra.run.smithi007.stdout: "standby_error_status_code": { 2024-09-21T06:46:33.138 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "standby_error_status_code", 2024-09-21T06:46:33.138 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.138 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.138 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.138 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "500", 2024-09-21T06:46:33.138 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "400", 2024-09-21T06:46:33.138 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "599", 2024-09-21T06:46:33.138 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.138 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.138 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.138 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.139 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.139 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.139 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.139 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.139 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:33.139 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rbd_support", 2024-09-21T06:46:33.139 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:33.139 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:33.139 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:33.139 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:33.139 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:33.139 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.139 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.139 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.139 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.139 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.139 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.140 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.140 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.140 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.140 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.140 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.140 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.140 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.140 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.140 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.140 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.140 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.140 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.140 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.140 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:33.141 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:33.141 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.141 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.141 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.141 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.141 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.141 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.141 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.141 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.141 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.141 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.141 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.141 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.141 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:33.141 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:33.142 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.142 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.142 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.142 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:33.142 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.142 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.142 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.142 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.142 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.142 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.142 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.142 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.142 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.142 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.143 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.143 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.143 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.143 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.143 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.143 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:33.143 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:33.143 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.143 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.143 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.143 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.143 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.143 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.143 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.143 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.143 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.144 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.144 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.144 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.144 INFO:teuthology.orchestra.run.smithi007.stdout: "max_concurrent_snap_create": { 2024-09-21T06:46:33.144 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_concurrent_snap_create", 2024-09-21T06:46:33.144 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.144 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.144 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.144 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-21T06:46:33.144 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.144 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.144 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.144 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.144 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.144 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.145 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.145 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.145 INFO:teuthology.orchestra.run.smithi007.stdout: "mirror_snapshot_schedule": { 2024-09-21T06:46:33.145 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mirror_snapshot_schedule", 2024-09-21T06:46:33.145 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.145 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.145 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.145 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.145 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.145 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.145 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.145 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.145 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.145 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.146 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.146 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.146 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:33.146 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:33.146 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.146 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:33.146 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.146 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.146 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.146 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.146 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.146 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.146 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.146 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.147 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.147 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.147 INFO:teuthology.orchestra.run.smithi007.stdout: "trash_purge_schedule": { 2024-09-21T06:46:33.147 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "trash_purge_schedule", 2024-09-21T06:46:33.147 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.147 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.147 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.147 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.147 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.147 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.147 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.147 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.147 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.147 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.148 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.148 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.148 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.148 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.148 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:33.148 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "restful", 2024-09-21T06:46:33.148 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:33.148 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:33.148 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:33.148 INFO:teuthology.orchestra.run.smithi007.stdout: "enable_auth": { 2024-09-21T06:46:33.148 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "enable_auth", 2024-09-21T06:46:33.148 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.148 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.148 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.149 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:33.149 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.149 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.149 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.149 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.149 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.149 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.149 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.149 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.149 INFO:teuthology.orchestra.run.smithi007.stdout: "key_file": { 2024-09-21T06:46:33.149 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "key_file", 2024-09-21T06:46:33.149 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.149 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.149 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.150 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.150 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.150 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.150 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.150 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.150 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.150 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.150 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.150 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.150 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:33.150 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:33.150 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.150 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.150 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.151 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.151 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.151 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.151 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.151 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.151 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.151 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.151 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.151 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.151 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.151 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.151 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.151 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.151 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.151 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.152 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.152 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:33.152 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:33.152 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.152 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.152 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.152 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.152 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.152 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.152 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.152 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.152 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.152 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.152 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.152 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.153 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:33.153 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:33.153 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.153 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.153 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.153 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:33.153 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.153 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.153 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.153 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.153 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.153 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.153 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.153 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.153 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.154 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.154 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.154 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.154 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.154 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.154 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.154 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:33.154 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:33.154 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.154 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.154 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.154 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.154 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.154 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.155 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.155 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.155 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.155 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.155 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.155 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.155 INFO:teuthology.orchestra.run.smithi007.stdout: "max_requests": { 2024-09-21T06:46:33.155 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_requests", 2024-09-21T06:46:33.155 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.155 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.155 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.155 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "500", 2024-09-21T06:46:33.155 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.155 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.156 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.156 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-21T06:46:33.156 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.156 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.156 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.156 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.156 INFO:teuthology.orchestra.run.smithi007.stdout: "server_addr": { 2024-09-21T06:46:33.156 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_addr", 2024-09-21T06:46:33.156 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.156 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.156 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.156 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.156 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.156 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.157 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.157 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.157 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.157 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.157 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.157 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.157 INFO:teuthology.orchestra.run.smithi007.stdout: "server_port": { 2024-09-21T06:46:33.157 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_port", 2024-09-21T06:46:33.157 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.157 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.157 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.157 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.157 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.157 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.157 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.158 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.158 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.158 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.158 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.158 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.158 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:33.158 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:33.158 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.158 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:33.158 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.158 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.158 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.158 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.159 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.159 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.159 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.159 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.159 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.159 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.159 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.159 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.159 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:33.159 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rgw", 2024-09-21T06:46:33.159 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:33.159 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:33.159 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:33.159 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:33.160 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:33.160 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.160 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.160 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.160 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.160 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.160 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.160 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.160 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.160 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.160 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.160 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.160 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.161 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.161 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.161 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.161 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.161 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.161 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.161 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.161 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:33.161 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:33.161 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.161 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.161 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.161 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.161 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.161 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.162 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.162 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.162 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.162 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.162 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.162 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.162 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:33.162 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:33.162 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.162 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.162 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.162 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:33.162 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.162 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.163 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.163 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.163 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.163 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.163 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.163 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.163 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.163 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.163 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.163 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.163 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.163 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.163 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.163 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:33.164 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:33.164 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.164 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.164 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.164 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.164 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.164 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.164 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.164 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.164 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.164 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.164 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.164 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.164 INFO:teuthology.orchestra.run.smithi007.stdout: "secondary_zone_period_retry_limit": { 2024-09-21T06:46:33.164 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-21T06:46:33.165 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.165 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.165 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.165 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5", 2024-09-21T06:46:33.165 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.165 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.165 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.165 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-21T06:46:33.165 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.165 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.165 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.165 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.165 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:33.165 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:33.165 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.166 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:33.166 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.166 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.166 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.166 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.166 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.166 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.166 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.166 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.166 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.166 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.166 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.166 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.166 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:33.166 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rook", 2024-09-21T06:46:33.167 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:33.167 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:33.167 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:33.167 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:33.167 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:33.167 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.167 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.167 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.167 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.167 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.167 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.167 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.167 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.167 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.168 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.168 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.168 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.168 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.168 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.168 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.168 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.168 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.168 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.168 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.168 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:33.168 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:33.168 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.168 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.169 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.169 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.169 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.169 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.169 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.169 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.169 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.169 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.169 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.169 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.169 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:33.169 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:33.169 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.169 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.169 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.169 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:33.170 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.170 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.170 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.170 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.170 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.170 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.170 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.170 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.170 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.170 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.170 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.170 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.170 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.170 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.170 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.171 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:33.171 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:33.171 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.171 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.171 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.171 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.171 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.171 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.171 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.171 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.171 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.171 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.171 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.171 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.171 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:33.172 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:33.172 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.172 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:33.172 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.172 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.172 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.172 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.172 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.172 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.172 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.172 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.172 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.172 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.173 INFO:teuthology.orchestra.run.smithi007.stdout: "storage_class": { 2024-09-21T06:46:33.173 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "storage_class", 2024-09-21T06:46:33.173 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.173 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.173 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.173 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "local", 2024-09-21T06:46:33.173 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.173 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.173 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.173 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-21T06:46:33.173 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.173 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.173 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.173 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.174 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.174 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.174 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:33.174 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "selftest", 2024-09-21T06:46:33.174 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:33.174 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:33.174 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:33.174 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:33.174 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:33.174 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.174 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.174 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.174 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.174 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.175 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.175 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.175 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.175 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.175 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.175 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.175 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.175 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.175 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.175 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.175 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.175 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.175 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.176 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.176 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:33.176 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:33.176 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.176 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.176 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.176 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.176 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.176 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.176 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.176 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.176 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.176 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.176 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.177 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.177 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:33.177 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:33.177 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.177 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.177 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.177 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:33.177 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.177 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.177 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.177 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.177 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.177 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.177 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.178 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.178 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.178 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.178 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.178 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.178 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.178 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.178 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.178 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:33.178 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:33.178 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.178 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.178 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.179 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.179 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.179 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.179 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.179 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.179 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.179 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.179 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.179 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.179 INFO:teuthology.orchestra.run.smithi007.stdout: "roption1": { 2024-09-21T06:46:33.179 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "roption1", 2024-09-21T06:46:33.179 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.179 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.179 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.179 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.180 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.180 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.180 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.180 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.180 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.180 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.180 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.180 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.180 INFO:teuthology.orchestra.run.smithi007.stdout: "roption2": { 2024-09-21T06:46:33.180 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "roption2", 2024-09-21T06:46:33.180 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.180 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.180 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.180 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "xyz", 2024-09-21T06:46:33.180 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.181 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.181 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.181 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.181 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.181 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.181 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.181 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.181 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption1": { 2024-09-21T06:46:33.181 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption1", 2024-09-21T06:46:33.181 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.181 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.181 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.181 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.181 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.181 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.182 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.182 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.182 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.182 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.182 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.182 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.182 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption2": { 2024-09-21T06:46:33.182 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption2", 2024-09-21T06:46:33.182 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.182 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.182 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.182 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.182 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.182 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.182 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.183 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.183 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.183 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.183 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.183 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.183 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption3": { 2024-09-21T06:46:33.183 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption3", 2024-09-21T06:46:33.183 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-21T06:46:33.183 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.183 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.183 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.183 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.183 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.183 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.184 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.184 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.184 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.184 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.184 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.184 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption4": { 2024-09-21T06:46:33.184 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption4", 2024-09-21T06:46:33.184 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.184 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.184 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.184 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.184 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.184 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.184 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.184 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.185 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.185 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.185 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.185 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.185 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption5": { 2024-09-21T06:46:33.185 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption5", 2024-09-21T06:46:33.185 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.185 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.185 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.185 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.185 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.185 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.185 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.185 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.185 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.186 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.186 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.186 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.186 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption6": { 2024-09-21T06:46:33.186 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption6", 2024-09-21T06:46:33.186 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.186 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.186 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.186 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:33.186 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.186 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.186 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.186 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.187 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.187 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.187 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.187 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.187 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption7": { 2024-09-21T06:46:33.187 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption7", 2024-09-21T06:46:33.187 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.187 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.187 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.187 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.187 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1", 2024-09-21T06:46:33.187 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "42", 2024-09-21T06:46:33.187 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.187 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.188 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.188 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.188 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.188 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.188 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:33.188 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:33.188 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.188 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:33.188 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.188 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.188 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.188 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.188 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.188 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.188 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.189 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.189 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.189 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.189 INFO:teuthology.orchestra.run.smithi007.stdout: "testkey": { 2024-09-21T06:46:33.189 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "testkey", 2024-09-21T06:46:33.189 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.189 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.189 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.189 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.189 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.189 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.189 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.189 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.189 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.189 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.189 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.189 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.190 INFO:teuthology.orchestra.run.smithi007.stdout: "testlkey": { 2024-09-21T06:46:33.190 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "testlkey", 2024-09-21T06:46:33.190 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.190 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.190 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.190 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.190 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.190 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.190 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.190 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.190 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.190 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.190 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.190 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.191 INFO:teuthology.orchestra.run.smithi007.stdout: "testnewline": { 2024-09-21T06:46:33.191 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "testnewline", 2024-09-21T06:46:33.191 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.191 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.191 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.191 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.191 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.191 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.191 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.191 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.191 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.191 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.191 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.191 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.192 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.192 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.192 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:33.192 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smb", 2024-09-21T06:46:33.192 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:33.193 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:33.193 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:33.193 INFO:teuthology.orchestra.run.smithi007.stdout: "internal_store_backend": { 2024-09-21T06:46:33.194 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "internal_store_backend", 2024-09-21T06:46:33.194 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.194 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:33.194 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.194 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.194 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.194 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.194 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.194 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-21T06:46:33.194 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.194 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.194 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.194 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.194 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:33.195 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:33.195 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.195 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.195 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.195 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.195 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.195 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.195 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.195 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.195 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.195 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.195 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.195 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.195 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.196 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.196 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.196 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.196 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.196 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.196 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.196 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:33.196 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:33.196 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.196 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.196 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.196 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.196 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.196 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.197 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.197 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.197 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.197 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.197 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.197 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.197 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:33.197 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:33.197 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.197 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.197 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.197 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:33.197 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.198 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.198 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.198 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.198 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.198 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.198 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.198 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.198 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.198 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.198 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.198 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.198 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.198 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.198 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.199 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:33.199 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:33.199 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.199 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.199 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.199 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.199 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.199 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.199 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.199 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.199 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.199 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.199 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.199 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.200 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:33.200 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:33.200 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.200 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:33.200 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.200 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.200 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.200 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.200 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.200 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.200 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.200 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.200 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.200 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.200 INFO:teuthology.orchestra.run.smithi007.stdout: "update_orchestration": { 2024-09-21T06:46:33.200 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "update_orchestration", 2024-09-21T06:46:33.201 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.201 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.201 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.201 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:33.201 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.201 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.201 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.201 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-21T06:46:33.201 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.201 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.201 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.201 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.202 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.202 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.202 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:33.202 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "snap_schedule", 2024-09-21T06:46:33.202 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:33.202 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:33.202 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:33.202 INFO:teuthology.orchestra.run.smithi007.stdout: "allow_m_granularity": { 2024-09-21T06:46:33.202 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "allow_m_granularity", 2024-09-21T06:46:33.202 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.202 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.202 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.202 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.202 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.203 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.203 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.203 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "allow minute scheduled snapshots", 2024-09-21T06:46:33.203 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.203 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.203 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.203 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.203 INFO:teuthology.orchestra.run.smithi007.stdout: "dump_on_update": { 2024-09-21T06:46:33.203 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "dump_on_update", 2024-09-21T06:46:33.203 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.203 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.203 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.203 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.203 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.203 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.204 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.204 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "dump database to debug log on update", 2024-09-21T06:46:33.204 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.204 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.204 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.204 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.204 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:33.204 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:33.204 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.204 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.204 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.204 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.204 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.205 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.205 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.205 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.205 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.205 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.205 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.205 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.205 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.205 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.205 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.205 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.205 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.205 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.205 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.206 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:33.206 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:33.206 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.206 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.206 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.206 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.206 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.206 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.206 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.206 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.206 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.206 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.206 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.206 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.207 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:33.207 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:33.207 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.207 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.207 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.207 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:33.207 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.207 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.207 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.207 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.207 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.207 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.207 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.207 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.207 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.208 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.208 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.208 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.208 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.208 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.208 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.208 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:33.208 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:33.208 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.208 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.208 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.208 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.208 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.208 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.209 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.209 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.209 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.209 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.209 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.209 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.209 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:33.209 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:33.209 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.209 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:33.209 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.209 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.209 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.209 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.209 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.210 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.210 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.210 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.210 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.210 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.210 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.210 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.210 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:33.210 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "stats", 2024-09-21T06:46:33.210 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:33.210 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:33.210 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:33.210 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:33.210 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:33.210 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.211 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.211 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.211 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.211 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.211 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.211 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.211 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.211 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.211 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.211 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.211 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.211 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.211 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.211 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.211 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.212 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.212 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.212 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.212 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:33.212 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:33.212 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.212 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.212 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.212 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.212 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.212 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.212 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.212 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.212 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.212 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.213 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.213 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.213 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:33.213 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:33.213 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.213 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.213 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.213 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:33.213 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.213 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.213 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.213 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.213 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.213 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.213 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.214 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.214 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.214 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.214 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.214 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.214 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.214 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.214 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.214 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:33.214 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:33.214 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.214 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.214 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.214 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.215 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.215 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.215 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.215 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.215 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.215 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.215 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.215 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.215 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:33.215 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:33.215 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.215 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:33.215 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.215 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.215 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.216 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.216 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.216 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.216 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.216 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.216 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.216 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.216 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.216 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.216 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:33.216 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "status", 2024-09-21T06:46:33.216 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:33.216 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:33.216 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:33.217 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:33.217 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:33.217 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.217 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.217 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.217 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.217 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.217 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.217 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.217 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.217 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.217 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.217 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.217 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.218 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.218 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.218 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.218 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.218 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.218 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.218 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.218 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:33.218 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:33.218 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.218 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.218 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.218 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.219 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.219 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.219 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.219 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.219 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.219 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.219 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.219 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.219 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:33.219 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:33.219 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.219 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.219 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.219 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:33.219 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.220 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.220 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.220 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.220 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.220 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.220 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.220 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.220 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.220 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.220 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.220 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.220 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.220 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.220 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.221 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:33.221 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:33.221 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.221 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.221 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.221 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.221 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.221 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.221 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.221 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.221 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.221 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.221 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.221 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.221 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:33.222 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:33.222 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.222 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:33.222 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.222 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.222 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.222 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.222 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.222 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.222 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.222 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.222 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.222 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.222 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.223 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.223 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:33.223 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "telegraf", 2024-09-21T06:46:33.223 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:33.223 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:33.223 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:33.223 INFO:teuthology.orchestra.run.smithi007.stdout: "address": { 2024-09-21T06:46:33.223 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "address", 2024-09-21T06:46:33.223 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.223 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.223 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.223 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-21T06:46:33.223 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.223 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.223 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.223 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.224 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.224 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.224 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.224 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.224 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-09-21T06:46:33.224 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-09-21T06:46:33.224 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:46:33.224 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.224 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.224 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "15", 2024-09-21T06:46:33.224 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.224 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.224 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.224 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.225 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.225 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.225 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.225 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.225 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:33.225 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:33.225 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.225 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.225 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.225 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.225 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.225 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.225 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.225 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.225 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.225 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.226 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.226 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.226 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.226 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.226 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.226 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.226 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.226 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.226 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.226 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:33.226 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:33.226 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.226 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.226 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.227 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.227 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.227 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.227 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.227 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.227 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.227 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.227 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.227 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.227 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:33.227 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:33.227 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.227 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.227 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.227 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:33.227 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.228 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.228 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.228 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.228 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.228 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.228 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.228 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.228 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.228 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.228 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.228 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.228 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.228 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.229 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.229 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:33.229 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:33.229 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.229 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.229 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.229 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.229 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.229 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.229 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.229 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.229 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.229 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.229 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.229 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.230 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:33.230 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:33.230 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.230 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:33.230 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.230 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.230 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.230 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.230 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.230 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.230 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.230 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.230 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.230 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.231 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.231 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.231 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:33.231 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "telemetry", 2024-09-21T06:46:33.231 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:33.231 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:33.231 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:33.231 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_basic": { 2024-09-21T06:46:33.231 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_basic", 2024-09-21T06:46:33.231 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.231 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.231 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.231 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:33.231 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.231 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.232 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.232 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-21T06:46:33.232 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.232 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.232 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.232 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.232 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_crash": { 2024-09-21T06:46:33.232 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_crash", 2024-09-21T06:46:33.232 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.232 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.232 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.232 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:33.232 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.232 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.232 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.233 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-21T06:46:33.233 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.233 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.233 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.233 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.233 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_device": { 2024-09-21T06:46:33.233 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_device", 2024-09-21T06:46:33.233 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.233 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.233 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.233 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:33.233 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.233 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.233 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.234 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-21T06:46:33.234 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.234 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.234 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.234 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.234 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_ident": { 2024-09-21T06:46:33.234 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_ident", 2024-09-21T06:46:33.234 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.234 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.234 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.234 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.234 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.234 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.234 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.235 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-21T06:46:33.235 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.235 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.235 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.235 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.235 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_perf": { 2024-09-21T06:46:33.235 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_perf", 2024-09-21T06:46:33.235 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.235 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.235 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.235 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.235 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.235 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.235 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.235 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-21T06:46:33.236 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.236 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.236 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.236 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.236 INFO:teuthology.orchestra.run.smithi007.stdout: "contact": { 2024-09-21T06:46:33.236 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "contact", 2024-09-21T06:46:33.236 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.236 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.236 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.236 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.236 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.236 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.236 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.236 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.236 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.237 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.237 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.237 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.237 INFO:teuthology.orchestra.run.smithi007.stdout: "description": { 2024-09-21T06:46:33.237 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "description", 2024-09-21T06:46:33.237 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.237 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.237 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.237 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.237 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.237 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.237 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.237 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.237 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.238 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.238 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.238 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.238 INFO:teuthology.orchestra.run.smithi007.stdout: "device_url": { 2024-09-21T06:46:33.238 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "device_url", 2024-09-21T06:46:33.238 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.238 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.238 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.238 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-21T06:46:33.238 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.238 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.238 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.238 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.238 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.238 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.239 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.239 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.239 INFO:teuthology.orchestra.run.smithi007.stdout: "enabled": { 2024-09-21T06:46:33.239 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "enabled", 2024-09-21T06:46:33.239 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.239 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.239 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.239 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.239 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.239 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.239 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.239 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.239 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.239 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.239 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.240 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.240 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-09-21T06:46:33.240 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-09-21T06:46:33.240 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.240 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.240 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.240 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "24", 2024-09-21T06:46:33.240 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "8", 2024-09-21T06:46:33.240 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.240 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.240 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.240 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.240 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.240 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.241 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.241 INFO:teuthology.orchestra.run.smithi007.stdout: "last_opt_revision": { 2024-09-21T06:46:33.241 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "last_opt_revision", 2024-09-21T06:46:33.241 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.241 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.241 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.241 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "1", 2024-09-21T06:46:33.241 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.241 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.241 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.241 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.241 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.241 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.241 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.242 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.242 INFO:teuthology.orchestra.run.smithi007.stdout: "leaderboard": { 2024-09-21T06:46:33.242 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "leaderboard", 2024-09-21T06:46:33.242 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.242 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.242 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.242 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.242 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.242 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.242 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.242 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.242 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.242 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.242 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.243 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.243 INFO:teuthology.orchestra.run.smithi007.stdout: "leaderboard_description": { 2024-09-21T06:46:33.243 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "leaderboard_description", 2024-09-21T06:46:33.243 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.243 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.243 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.243 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.243 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.243 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.243 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.243 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.243 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.243 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.243 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.243 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.244 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:33.244 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:33.244 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.244 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.244 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.244 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.244 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.244 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.244 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.244 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.244 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.244 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.244 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.244 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.245 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.245 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.245 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.245 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.245 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.245 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.245 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.245 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:33.245 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:33.245 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.245 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.245 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.245 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.245 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.246 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.246 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.246 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.246 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.246 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.246 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.246 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.246 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:33.246 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:33.246 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.246 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.246 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.246 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:33.246 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.247 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.247 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.247 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.247 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.247 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.247 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.247 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.247 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.247 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.247 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.247 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.247 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.247 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.247 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.248 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:33.248 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:33.248 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.248 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.248 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.248 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.248 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.248 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.248 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.248 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.248 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.248 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.248 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.248 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.248 INFO:teuthology.orchestra.run.smithi007.stdout: "organization": { 2024-09-21T06:46:33.249 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "organization", 2024-09-21T06:46:33.249 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.249 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.249 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.249 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.249 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.249 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.249 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.249 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.249 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.249 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.249 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.249 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.249 INFO:teuthology.orchestra.run.smithi007.stdout: "proxy": { 2024-09-21T06:46:33.250 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "proxy", 2024-09-21T06:46:33.250 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.250 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.250 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.250 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.250 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.250 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.250 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.250 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.250 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.250 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.250 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.250 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.250 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:33.251 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:33.251 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.251 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:33.251 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.251 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.251 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.251 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.251 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.251 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.251 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.251 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.251 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.251 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.251 INFO:teuthology.orchestra.run.smithi007.stdout: "url": { 2024-09-21T06:46:33.251 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "url", 2024-09-21T06:46:33.252 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.252 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.252 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.252 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-21T06:46:33.252 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.252 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.252 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.252 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.252 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.252 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.252 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.252 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.252 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.252 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.252 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:33.253 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "test_orchestrator", 2024-09-21T06:46:33.253 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:33.253 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:33.253 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:33.253 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:33.253 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:33.253 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.253 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.253 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.253 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.253 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.253 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.253 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.254 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.254 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.254 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.254 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.254 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.254 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.254 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.254 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.254 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.254 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.254 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.254 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.254 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:33.255 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:33.255 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.255 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.255 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.255 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.255 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.255 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.255 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.255 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.255 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.255 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.255 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.255 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.255 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:33.255 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:33.256 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.256 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.256 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.256 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:33.256 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.256 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.256 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.256 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.256 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.256 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.256 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.256 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.256 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.256 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.257 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.257 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.257 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.257 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.257 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.257 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:33.257 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:33.257 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.257 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.257 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.257 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.257 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.257 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.257 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.257 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.258 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.258 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.258 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.258 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.258 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:33.258 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:33.258 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.258 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:33.258 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.258 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.258 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.258 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.258 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.258 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.258 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.259 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.259 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.259 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.259 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.259 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.259 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:33.259 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "volumes", 2024-09-21T06:46:33.259 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:33.259 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:33.259 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:33.259 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:33.259 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:33.259 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.259 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.260 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.260 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.260 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.260 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.260 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.260 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.260 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.260 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.260 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.260 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.260 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.260 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.260 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.260 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.261 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.261 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.261 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.261 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:33.261 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:33.261 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.261 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.261 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.261 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.261 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.261 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.261 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.261 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.261 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.261 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.262 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.262 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.262 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:33.262 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:33.262 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.262 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.262 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.262 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:33.262 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.262 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.262 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.262 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.262 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.262 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.263 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.263 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.263 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.263 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.263 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.263 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.263 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.263 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.263 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.263 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:33.263 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:33.263 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.263 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.264 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.264 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.264 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.264 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.264 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.264 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.264 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.264 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.264 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.264 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.264 INFO:teuthology.orchestra.run.smithi007.stdout: "max_concurrent_clones": { 2024-09-21T06:46:33.264 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_concurrent_clones", 2024-09-21T06:46:33.264 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.264 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.265 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.265 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "4", 2024-09-21T06:46:33.265 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.265 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.265 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.265 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-21T06:46:33.265 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.265 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.265 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.265 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.265 INFO:teuthology.orchestra.run.smithi007.stdout: "periodic_async_work": { 2024-09-21T06:46:33.265 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "periodic_async_work", 2024-09-21T06:46:33.265 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.266 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.266 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.266 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.266 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.266 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.266 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.266 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Periodically check for async work", 2024-09-21T06:46:33.266 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.266 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.266 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.266 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.266 INFO:teuthology.orchestra.run.smithi007.stdout: "snapshot_clone_delay": { 2024-09-21T06:46:33.266 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "snapshot_clone_delay", 2024-09-21T06:46:33.267 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.267 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.267 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.267 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.267 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.267 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.267 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.267 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-21T06:46:33.267 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.267 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.267 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.267 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.267 INFO:teuthology.orchestra.run.smithi007.stdout: "snapshot_clone_no_wait": { 2024-09-21T06:46:33.267 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "snapshot_clone_no_wait", 2024-09-21T06:46:33.267 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.268 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.268 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.268 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:33.268 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.268 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.268 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.268 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-21T06:46:33.268 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.268 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.268 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.268 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.268 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:33.268 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:33.268 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.269 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:33.269 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.269 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.269 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.269 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.269 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.269 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.269 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.269 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.269 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.269 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.269 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.269 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.269 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:33.269 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "zabbix", 2024-09-21T06:46:33.270 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:33.270 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:33.270 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:33.270 INFO:teuthology.orchestra.run.smithi007.stdout: "discovery_interval": { 2024-09-21T06:46:33.270 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "discovery_interval", 2024-09-21T06:46:33.270 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-09-21T06:46:33.270 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.270 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.270 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "100", 2024-09-21T06:46:33.270 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.270 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.270 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.270 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.270 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.270 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.270 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.271 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.271 INFO:teuthology.orchestra.run.smithi007.stdout: "identifier": { 2024-09-21T06:46:33.271 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "identifier", 2024-09-21T06:46:33.271 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.271 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.271 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.271 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.271 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.271 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.271 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.271 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.271 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.271 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.271 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.271 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.272 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-09-21T06:46:33.272 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-09-21T06:46:33.272 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:46:33.272 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.272 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.272 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-09-21T06:46:33.272 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.272 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.272 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.272 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.272 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.272 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.272 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.272 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.272 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:33.273 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:33.273 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.273 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.273 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.273 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.273 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.273 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.273 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.273 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.273 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.273 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.273 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.273 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.273 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.273 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.274 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.274 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.274 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.274 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.274 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.274 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:33.274 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:33.274 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.274 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.274 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.274 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.274 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.274 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.274 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.274 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.275 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.275 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.275 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.275 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.275 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:33.275 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:33.275 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.275 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.275 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.275 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:33.275 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.275 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.275 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.275 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.276 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.276 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.276 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.276 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.276 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.276 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.276 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.276 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.276 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.276 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.276 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.276 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:33.276 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:33.276 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.276 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.277 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.277 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.277 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.277 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.277 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.277 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.277 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.277 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.277 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.277 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.277 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:33.277 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:33.277 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.277 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:33.278 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.278 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.278 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.278 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.278 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.278 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.278 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.278 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.278 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.278 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.278 INFO:teuthology.orchestra.run.smithi007.stdout: "zabbix_host": { 2024-09-21T06:46:33.278 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "zabbix_host", 2024-09-21T06:46:33.278 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.278 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.279 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.279 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.279 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.279 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.279 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.279 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.279 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.279 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.279 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.279 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.279 INFO:teuthology.orchestra.run.smithi007.stdout: "zabbix_port": { 2024-09-21T06:46:33.279 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "zabbix_port", 2024-09-21T06:46:33.279 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.279 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.279 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.280 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10051", 2024-09-21T06:46:33.280 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.280 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.280 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.280 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.280 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.280 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.280 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.280 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.280 INFO:teuthology.orchestra.run.smithi007.stdout: "zabbix_sender": { 2024-09-21T06:46:33.280 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "zabbix_sender", 2024-09-21T06:46:33.280 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.280 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.280 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.280 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-21T06:46:33.281 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.281 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.281 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.281 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.281 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.281 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.281 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.281 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.281 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.281 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.281 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T06:46:33.281 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.281 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:33.281 INFO:teuthology.orchestra.run.smithi007.stdout: "gid": 24155, 2024-09-21T06:46:33.282 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "y", 2024-09-21T06:46:33.282 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_features": 4540719139924082687, 2024-09-21T06:46:33.282 INFO:teuthology.orchestra.run.smithi007.stdout: "available_modules": [ 2024-09-21T06:46:33.282 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:33.282 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "alerts", 2024-09-21T06:46:33.282 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:33.282 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:33.282 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:33.282 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-09-21T06:46:33.282 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-09-21T06:46:33.282 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:46:33.282 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.282 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.282 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-09-21T06:46:33.283 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.283 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.283 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.283 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "How frequently to reexamine health status", 2024-09-21T06:46:33.283 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.283 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.283 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.283 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.283 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:33.283 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:33.283 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.283 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.283 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.283 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.283 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.284 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.284 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.284 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.284 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.284 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.284 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.284 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.284 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.284 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.284 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.284 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.284 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.284 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.284 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.285 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:33.285 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:33.285 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.285 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.285 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.285 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.285 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.285 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.285 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.285 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.285 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.285 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.285 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.285 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.285 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:33.285 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:33.286 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.286 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.286 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.286 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:33.286 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.286 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.286 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.286 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.286 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.286 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.286 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.286 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.286 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.286 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.287 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.287 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.287 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.287 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.287 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.287 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:33.287 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:33.287 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.287 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.287 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.287 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.287 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.287 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.287 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.288 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.288 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.288 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.288 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.288 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.288 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_destination": { 2024-09-21T06:46:33.288 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_destination", 2024-09-21T06:46:33.288 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.288 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.288 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.288 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.288 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.288 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.288 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.288 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-21T06:46:33.288 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.289 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.289 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.289 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.289 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_from_name": { 2024-09-21T06:46:33.289 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_from_name", 2024-09-21T06:46:33.289 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.289 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.289 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.289 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "Ceph", 2024-09-21T06:46:33.289 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.289 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.289 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.289 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Email From: name", 2024-09-21T06:46:33.289 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.289 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.289 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.289 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.290 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_host": { 2024-09-21T06:46:33.290 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_host", 2024-09-21T06:46:33.290 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.290 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.290 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.290 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.290 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.290 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.290 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.290 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "SMTP server", 2024-09-21T06:46:33.290 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.290 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.290 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.290 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.290 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_password": { 2024-09-21T06:46:33.291 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_password", 2024-09-21T06:46:33.291 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.291 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.291 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.291 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.291 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.291 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.291 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.291 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Password to authenticate with", 2024-09-21T06:46:33.291 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.291 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.291 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.291 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.292 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_port": { 2024-09-21T06:46:33.292 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_port", 2024-09-21T06:46:33.292 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.292 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.292 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.292 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "465", 2024-09-21T06:46:33.292 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.292 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.292 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.292 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "SMTP port", 2024-09-21T06:46:33.292 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.292 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.292 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.292 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.292 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_sender": { 2024-09-21T06:46:33.292 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_sender", 2024-09-21T06:46:33.293 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.293 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.293 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.293 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.293 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.293 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.293 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.293 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "SMTP envelope sender", 2024-09-21T06:46:33.293 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.293 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.293 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.293 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.293 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_ssl": { 2024-09-21T06:46:33.293 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_ssl", 2024-09-21T06:46:33.294 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.294 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.294 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.294 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:33.294 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.294 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.294 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.294 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-21T06:46:33.294 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.294 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.294 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.294 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.294 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_user": { 2024-09-21T06:46:33.295 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_user", 2024-09-21T06:46:33.295 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.295 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.295 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.295 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.295 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.295 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.295 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.295 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "User to authenticate as", 2024-09-21T06:46:33.295 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.295 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.295 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.295 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.295 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:33.295 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:33.296 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.296 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:33.296 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.296 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.296 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.296 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.296 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.296 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.296 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.296 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.296 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.296 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.296 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.296 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.297 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:33.297 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "balancer", 2024-09-21T06:46:33.297 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:33.297 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:33.297 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:33.297 INFO:teuthology.orchestra.run.smithi007.stdout: "active": { 2024-09-21T06:46:33.297 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "active", 2024-09-21T06:46:33.297 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.297 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.297 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.297 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:33.297 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.297 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.297 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.297 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "automatically balance PGs across cluster", 2024-09-21T06:46:33.298 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.298 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.298 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.298 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.298 INFO:teuthology.orchestra.run.smithi007.stdout: "begin_time": { 2024-09-21T06:46:33.298 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "begin_time", 2024-09-21T06:46:33.298 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.298 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.298 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.298 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0000", 2024-09-21T06:46:33.298 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.298 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.298 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.298 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "beginning time of day to automatically balance", 2024-09-21T06:46:33.298 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T06:46:33.299 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.299 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.299 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.299 INFO:teuthology.orchestra.run.smithi007.stdout: "begin_weekday": { 2024-09-21T06:46:33.299 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "begin_weekday", 2024-09-21T06:46:33.299 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-09-21T06:46:33.299 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.299 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.299 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.299 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "0", 2024-09-21T06:46:33.299 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "6", 2024-09-21T06:46:33.299 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.299 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-21T06:46:33.299 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T06:46:33.300 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.300 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.300 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.300 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_compat_max_iterations": { 2024-09-21T06:46:33.300 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crush_compat_max_iterations", 2024-09-21T06:46:33.300 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-09-21T06:46:33.300 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.300 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.300 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "25", 2024-09-21T06:46:33.300 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1", 2024-09-21T06:46:33.300 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "250", 2024-09-21T06:46:33.300 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.300 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-21T06:46:33.300 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.300 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.300 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.300 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.301 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_compat_metrics": { 2024-09-21T06:46:33.301 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crush_compat_metrics", 2024-09-21T06:46:33.301 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.301 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.301 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.301 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "pgs,objects,bytes", 2024-09-21T06:46:33.301 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.301 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.301 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.301 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-21T06:46:33.301 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-21T06:46:33.301 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.301 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.301 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.301 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_compat_step": { 2024-09-21T06:46:33.301 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crush_compat_step", 2024-09-21T06:46:33.302 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-21T06:46:33.302 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.302 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.302 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0.5", 2024-09-21T06:46:33.302 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "0.001", 2024-09-21T06:46:33.302 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "0.999", 2024-09-21T06:46:33.302 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.302 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "aggressiveness of optimization", 2024-09-21T06:46:33.302 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-21T06:46:33.302 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.302 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.302 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.302 INFO:teuthology.orchestra.run.smithi007.stdout: "end_time": { 2024-09-21T06:46:33.302 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "end_time", 2024-09-21T06:46:33.302 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.303 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.303 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.303 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "2359", 2024-09-21T06:46:33.303 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.303 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.303 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.303 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "ending time of day to automatically balance", 2024-09-21T06:46:33.303 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T06:46:33.303 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.303 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.303 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.303 INFO:teuthology.orchestra.run.smithi007.stdout: "end_weekday": { 2024-09-21T06:46:33.303 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "end_weekday", 2024-09-21T06:46:33.303 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-09-21T06:46:33.303 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.303 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.304 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.304 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "0", 2024-09-21T06:46:33.304 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "6", 2024-09-21T06:46:33.304 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.304 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-21T06:46:33.304 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T06:46:33.304 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.304 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.304 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.304 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:33.304 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:33.304 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.304 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.304 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.304 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.305 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.305 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.305 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.305 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.305 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.305 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.305 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.305 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.305 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.305 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.305 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.305 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.305 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.305 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.305 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.306 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:33.306 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:33.306 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.306 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.306 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.306 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.306 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.306 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.306 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.306 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.306 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.306 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.306 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.306 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.307 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:33.307 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:33.307 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.307 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.307 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.307 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:33.307 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.307 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.307 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.307 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.307 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.307 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.307 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.307 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.307 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.307 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.308 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.308 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.308 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.308 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.308 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.308 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:33.308 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:33.308 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.308 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.308 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.308 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.308 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.308 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.308 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.309 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.309 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.309 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.309 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.309 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.309 INFO:teuthology.orchestra.run.smithi007.stdout: "min_score": { 2024-09-21T06:46:33.309 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "min_score", 2024-09-21T06:46:33.309 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-21T06:46:33.309 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.309 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.309 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.309 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.309 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.309 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.309 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-21T06:46:33.310 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.310 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.310 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.310 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.310 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": { 2024-09-21T06:46:33.310 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mode", 2024-09-21T06:46:33.310 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.310 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.310 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.310 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "upmap", 2024-09-21T06:46:33.310 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.310 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.310 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.310 INFO:teuthology.orchestra.run.smithi007.stdout: "crush-compat", 2024-09-21T06:46:33.310 INFO:teuthology.orchestra.run.smithi007.stdout: "none", 2024-09-21T06:46:33.311 INFO:teuthology.orchestra.run.smithi007.stdout: "read", 2024-09-21T06:46:33.311 INFO:teuthology.orchestra.run.smithi007.stdout: "upmap", 2024-09-21T06:46:33.311 INFO:teuthology.orchestra.run.smithi007.stdout: "upmap-read" 2024-09-21T06:46:33.311 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.311 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Balancer mode", 2024-09-21T06:46:33.311 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.311 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.311 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.311 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.311 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_ids": { 2024-09-21T06:46:33.311 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "pool_ids", 2024-09-21T06:46:33.311 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.311 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.311 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.312 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.312 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.312 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.312 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.312 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-21T06:46:33.312 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.312 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.312 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.312 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.312 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-09-21T06:46:33.312 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-09-21T06:46:33.312 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:46:33.312 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.312 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.312 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-09-21T06:46:33.313 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.313 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.313 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.313 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-21T06:46:33.313 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.313 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.313 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.313 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.313 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:33.313 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:33.313 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.313 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:33.313 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.313 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.313 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.313 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.313 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.314 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.314 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.314 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.314 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.314 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.314 INFO:teuthology.orchestra.run.smithi007.stdout: "upmap_max_deviation": { 2024-09-21T06:46:33.314 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "upmap_max_deviation", 2024-09-21T06:46:33.314 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.314 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.314 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.314 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5", 2024-09-21T06:46:33.314 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1", 2024-09-21T06:46:33.314 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.314 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.314 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-21T06:46:33.315 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-21T06:46:33.315 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.315 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.315 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.315 INFO:teuthology.orchestra.run.smithi007.stdout: "upmap_max_optimizations": { 2024-09-21T06:46:33.315 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "upmap_max_optimizations", 2024-09-21T06:46:33.315 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-09-21T06:46:33.315 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.315 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.315 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-21T06:46:33.315 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.315 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.315 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.316 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-21T06:46:33.316 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.316 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.316 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.316 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.316 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.316 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.316 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:33.316 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cephadm", 2024-09-21T06:46:33.316 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:33.316 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:33.316 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:33.316 INFO:teuthology.orchestra.run.smithi007.stdout: "agent_down_multiplier": { 2024-09-21T06:46:33.316 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "agent_down_multiplier", 2024-09-21T06:46:33.317 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-21T06:46:33.317 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.317 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.317 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "3.0", 2024-09-21T06:46:33.317 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.317 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.317 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.317 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-21T06:46:33.317 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.317 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.317 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.317 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.317 INFO:teuthology.orchestra.run.smithi007.stdout: "agent_refresh_rate": { 2024-09-21T06:46:33.317 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "agent_refresh_rate", 2024-09-21T06:46:33.317 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:46:33.317 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.318 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.318 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "20", 2024-09-21T06:46:33.318 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.318 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.318 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.318 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-21T06:46:33.318 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.318 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.318 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.318 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.318 INFO:teuthology.orchestra.run.smithi007.stdout: "agent_starting_port": { 2024-09-21T06:46:33.318 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "agent_starting_port", 2024-09-21T06:46:33.318 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.318 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.319 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.319 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "4721", 2024-09-21T06:46:33.319 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.319 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.319 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.319 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-21T06:46:33.319 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.319 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.319 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.319 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.319 INFO:teuthology.orchestra.run.smithi007.stdout: "allow_ptrace": { 2024-09-21T06:46:33.319 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "allow_ptrace", 2024-09-21T06:46:33.319 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.319 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.319 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.319 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.320 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.320 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.320 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.320 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-21T06:46:33.320 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-21T06:46:33.320 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.320 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.320 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.320 INFO:teuthology.orchestra.run.smithi007.stdout: "autotune_interval": { 2024-09-21T06:46:33.320 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "autotune_interval", 2024-09-21T06:46:33.320 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:46:33.320 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.320 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.321 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-09-21T06:46:33.321 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.321 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.321 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.321 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-21T06:46:33.321 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.321 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.321 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.321 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.321 INFO:teuthology.orchestra.run.smithi007.stdout: "autotune_memory_target_ratio": { 2024-09-21T06:46:33.321 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "autotune_memory_target_ratio", 2024-09-21T06:46:33.321 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-21T06:46:33.321 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.321 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.321 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0.7", 2024-09-21T06:46:33.321 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.322 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.322 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.322 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-21T06:46:33.322 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.322 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.322 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.322 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.322 INFO:teuthology.orchestra.run.smithi007.stdout: "cephadm_log_destination": { 2024-09-21T06:46:33.322 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cephadm_log_destination", 2024-09-21T06:46:33.322 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.322 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.322 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.322 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.322 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.323 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.323 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.323 INFO:teuthology.orchestra.run.smithi007.stdout: "file", 2024-09-21T06:46:33.323 INFO:teuthology.orchestra.run.smithi007.stdout: "file,syslog", 2024-09-21T06:46:33.323 INFO:teuthology.orchestra.run.smithi007.stdout: "syslog" 2024-09-21T06:46:33.323 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.323 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-21T06:46:33.323 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.323 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.323 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.323 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.323 INFO:teuthology.orchestra.run.smithi007.stdout: "cgroups_split": { 2024-09-21T06:46:33.323 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cgroups_split", 2024-09-21T06:46:33.323 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.323 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.324 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.324 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:33.324 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.324 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.324 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.324 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-21T06:46:33.324 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.324 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.324 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.324 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.324 INFO:teuthology.orchestra.run.smithi007.stdout: "config_checks_enabled": { 2024-09-21T06:46:33.324 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "config_checks_enabled", 2024-09-21T06:46:33.324 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.324 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.325 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.325 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.325 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.325 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.325 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.325 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-21T06:46:33.325 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.325 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.325 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.325 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.325 INFO:teuthology.orchestra.run.smithi007.stdout: "config_dashboard": { 2024-09-21T06:46:33.325 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "config_dashboard", 2024-09-21T06:46:33.325 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.325 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.325 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.326 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:33.326 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.326 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.326 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.326 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-21T06:46:33.326 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.326 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.326 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.326 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.326 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_alertmanager": { 2024-09-21T06:46:33.326 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_alertmanager", 2024-09-21T06:46:33.326 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.326 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.326 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.327 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-21T06:46:33.327 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.327 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.327 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.327 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Prometheus container image", 2024-09-21T06:46:33.327 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.327 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.327 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.327 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.327 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_base": { 2024-09-21T06:46:33.327 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_base", 2024-09-21T06:46:33.327 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.327 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.327 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.328 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-21T06:46:33.328 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.328 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.328 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.328 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Container image name, without the tag", 2024-09-21T06:46:33.328 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.328 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.328 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.328 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.328 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_elasticsearch": { 2024-09-21T06:46:33.328 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_elasticsearch", 2024-09-21T06:46:33.328 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.328 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.328 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.328 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-21T06:46:33.329 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.329 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.329 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.329 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "elasticsearch container image", 2024-09-21T06:46:33.329 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.329 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.329 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.329 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.329 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_grafana": { 2024-09-21T06:46:33.329 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_grafana", 2024-09-21T06:46:33.329 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.329 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.329 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.329 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/grafana:10.4.8", 2024-09-21T06:46:33.329 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.330 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.330 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.330 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Prometheus container image", 2024-09-21T06:46:33.330 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.330 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.330 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.330 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.330 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_haproxy": { 2024-09-21T06:46:33.330 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_haproxy", 2024-09-21T06:46:33.330 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.330 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.330 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.330 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-21T06:46:33.330 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.331 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.331 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.331 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "HAproxy container image", 2024-09-21T06:46:33.331 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.331 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.331 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.331 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.331 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_jaeger_agent": { 2024-09-21T06:46:33.331 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_jaeger_agent", 2024-09-21T06:46:33.331 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.331 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.331 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.331 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-21T06:46:33.331 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.331 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.332 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.332 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Jaeger agent container image", 2024-09-21T06:46:33.332 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.332 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.332 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.332 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.332 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_jaeger_collector": { 2024-09-21T06:46:33.332 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_jaeger_collector", 2024-09-21T06:46:33.332 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.332 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.332 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.332 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-21T06:46:33.332 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.332 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.332 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.333 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Jaeger collector container image", 2024-09-21T06:46:33.333 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.333 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.333 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.333 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.333 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_jaeger_query": { 2024-09-21T06:46:33.333 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_jaeger_query", 2024-09-21T06:46:33.333 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.333 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.333 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.333 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-21T06:46:33.333 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.333 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.333 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.333 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Jaeger query container image", 2024-09-21T06:46:33.334 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.334 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.334 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.334 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.334 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_keepalived": { 2024-09-21T06:46:33.334 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_keepalived", 2024-09-21T06:46:33.334 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.334 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.334 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.334 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-21T06:46:33.334 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.334 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.334 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.334 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Keepalived container image", 2024-09-21T06:46:33.335 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.335 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.335 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.335 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.335 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_loki": { 2024-09-21T06:46:33.335 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_loki", 2024-09-21T06:46:33.335 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.335 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.335 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.335 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-21T06:46:33.335 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.335 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.335 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.335 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Loki container image", 2024-09-21T06:46:33.335 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.336 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.336 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.336 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.336 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_nginx": { 2024-09-21T06:46:33.336 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_nginx", 2024-09-21T06:46:33.336 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.336 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.336 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.336 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-21T06:46:33.336 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.336 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.336 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.336 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Nginx container image", 2024-09-21T06:46:33.336 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.337 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.337 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.337 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.337 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_node_exporter": { 2024-09-21T06:46:33.337 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_node_exporter", 2024-09-21T06:46:33.337 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.337 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.337 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.337 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-21T06:46:33.337 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.337 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.337 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.337 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Prometheus container image", 2024-09-21T06:46:33.337 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.338 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.338 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.338 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.338 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_nvmeof": { 2024-09-21T06:46:33.338 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_nvmeof", 2024-09-21T06:46:33.338 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.338 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.338 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.338 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-21T06:46:33.338 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.338 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.338 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.338 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Nvme-of container image", 2024-09-21T06:46:33.338 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.339 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.339 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.339 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.339 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_oauth2_proxy": { 2024-09-21T06:46:33.339 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_oauth2_proxy", 2024-09-21T06:46:33.339 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.339 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.339 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.339 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-21T06:46:33.339 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.339 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.339 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.339 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "oauth2-proxy container image", 2024-09-21T06:46:33.339 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.339 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.340 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.340 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.340 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_prometheus": { 2024-09-21T06:46:33.340 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_prometheus", 2024-09-21T06:46:33.340 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.340 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.340 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.340 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-21T06:46:33.340 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.340 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.340 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.340 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Prometheus container image", 2024-09-21T06:46:33.340 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.340 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.340 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.341 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.341 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_promtail": { 2024-09-21T06:46:33.341 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_promtail", 2024-09-21T06:46:33.341 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.341 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.341 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.341 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-21T06:46:33.341 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.341 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.341 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.341 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Promtail container image", 2024-09-21T06:46:33.341 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.341 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.342 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.342 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.342 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_samba": { 2024-09-21T06:46:33.342 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_samba", 2024-09-21T06:46:33.342 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.342 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.342 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.342 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-21T06:46:33.342 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.342 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.342 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.342 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Samba/SMB container image", 2024-09-21T06:46:33.342 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.342 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.343 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.343 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.343 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_samba_metrics": { 2024-09-21T06:46:33.343 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_samba_metrics", 2024-09-21T06:46:33.343 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.343 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.343 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.343 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-21T06:46:33.343 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.343 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.343 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.343 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-21T06:46:33.343 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.343 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.343 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.344 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.344 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_snmp_gateway": { 2024-09-21T06:46:33.344 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_snmp_gateway", 2024-09-21T06:46:33.344 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.344 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.344 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.344 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-21T06:46:33.344 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.344 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.344 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.344 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "SNMP Gateway container image", 2024-09-21T06:46:33.344 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.344 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.344 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.344 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.345 INFO:teuthology.orchestra.run.smithi007.stdout: "container_init": { 2024-09-21T06:46:33.345 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_init", 2024-09-21T06:46:33.345 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.345 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.345 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.345 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:33.345 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.345 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.345 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.345 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Run podman/docker with `--init`", 2024-09-21T06:46:33.345 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.345 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.345 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.345 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.346 INFO:teuthology.orchestra.run.smithi007.stdout: "daemon_cache_timeout": { 2024-09-21T06:46:33.346 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "daemon_cache_timeout", 2024-09-21T06:46:33.346 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:46:33.346 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.346 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.346 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-09-21T06:46:33.346 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.346 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.346 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.346 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-21T06:46:33.346 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.346 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.346 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.347 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.347 INFO:teuthology.orchestra.run.smithi007.stdout: "default_cephadm_command_timeout": { 2024-09-21T06:46:33.347 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "default_cephadm_command_timeout", 2024-09-21T06:46:33.347 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.347 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.347 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.347 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "900", 2024-09-21T06:46:33.347 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.347 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.347 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.347 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-21T06:46:33.347 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.347 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.347 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.348 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.348 INFO:teuthology.orchestra.run.smithi007.stdout: "default_registry": { 2024-09-21T06:46:33.348 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "default_registry", 2024-09-21T06:46:33.348 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.348 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.348 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.348 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "docker.io", 2024-09-21T06:46:33.348 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.348 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.348 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.348 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-21T06:46:33.348 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.348 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.348 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.348 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.349 INFO:teuthology.orchestra.run.smithi007.stdout: "device_cache_timeout": { 2024-09-21T06:46:33.349 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "device_cache_timeout", 2024-09-21T06:46:33.349 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:46:33.349 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.349 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.349 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "1800", 2024-09-21T06:46:33.349 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.349 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.349 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.349 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "seconds to cache device inventory", 2024-09-21T06:46:33.349 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.349 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.349 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.349 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.349 INFO:teuthology.orchestra.run.smithi007.stdout: "device_enhanced_scan": { 2024-09-21T06:46:33.350 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "device_enhanced_scan", 2024-09-21T06:46:33.350 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.350 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.350 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.350 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.350 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.350 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.350 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.350 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-21T06:46:33.350 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.350 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.350 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.350 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.350 INFO:teuthology.orchestra.run.smithi007.stdout: "facts_cache_timeout": { 2024-09-21T06:46:33.351 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "facts_cache_timeout", 2024-09-21T06:46:33.351 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:46:33.351 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.351 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.351 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-09-21T06:46:33.351 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.351 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.351 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.351 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "seconds to cache host facts data", 2024-09-21T06:46:33.351 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.351 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.351 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.351 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.351 INFO:teuthology.orchestra.run.smithi007.stdout: "grafana_dashboards_path": { 2024-09-21T06:46:33.352 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "grafana_dashboards_path", 2024-09-21T06:46:33.352 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.352 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.352 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.352 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-21T06:46:33.352 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.352 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.352 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.352 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-21T06:46:33.352 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.352 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.352 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.352 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.352 INFO:teuthology.orchestra.run.smithi007.stdout: "host_check_interval": { 2024-09-21T06:46:33.352 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "host_check_interval", 2024-09-21T06:46:33.353 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:46:33.353 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.353 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.353 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-09-21T06:46:33.353 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.353 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.353 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.353 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to perform a host check", 2024-09-21T06:46:33.353 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.353 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.353 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.353 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.353 INFO:teuthology.orchestra.run.smithi007.stdout: "hw_monitoring": { 2024-09-21T06:46:33.353 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "hw_monitoring", 2024-09-21T06:46:33.353 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.354 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.354 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.354 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.354 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.354 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.354 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.354 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-21T06:46:33.354 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.354 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.354 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.354 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.354 INFO:teuthology.orchestra.run.smithi007.stdout: "inventory_list_all": { 2024-09-21T06:46:33.354 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "inventory_list_all", 2024-09-21T06:46:33.354 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.355 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.355 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.355 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.355 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.355 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.355 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.355 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-21T06:46:33.355 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.355 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.355 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.355 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.355 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:33.355 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:33.355 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.356 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.356 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.356 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.356 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.356 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.356 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.356 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.356 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.356 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.356 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.356 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.356 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.356 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.356 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.356 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.357 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.357 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.357 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.357 INFO:teuthology.orchestra.run.smithi007.stdout: "log_refresh_metadata": { 2024-09-21T06:46:33.357 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_refresh_metadata", 2024-09-21T06:46:33.357 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.357 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.357 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.357 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.357 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.357 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.357 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.357 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-21T06:46:33.357 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.357 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.358 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.358 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.358 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:33.358 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:33.358 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.358 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.358 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.358 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:33.358 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.358 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.358 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.358 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-21T06:46:33.358 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.358 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.359 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.359 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.359 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:33.359 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:33.359 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.359 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.359 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.359 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:33.359 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.359 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.359 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.359 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.359 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.359 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.359 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.359 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.360 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.360 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.360 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.360 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.360 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.360 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.360 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.360 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:33.360 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:33.360 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.360 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.360 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.360 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.360 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.360 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.360 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.361 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.361 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.361 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.361 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.361 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.361 INFO:teuthology.orchestra.run.smithi007.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-21T06:46:33.361 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-21T06:46:33.361 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.361 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.361 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.361 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.361 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.361 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.361 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.361 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-21T06:46:33.361 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.362 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.362 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.362 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.362 INFO:teuthology.orchestra.run.smithi007.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-21T06:46:33.362 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-21T06:46:33.362 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.362 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.362 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.362 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "*", 2024-09-21T06:46:33.362 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.362 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.362 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.362 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-21T06:46:33.362 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.362 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.363 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.363 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.363 INFO:teuthology.orchestra.run.smithi007.stdout: "max_count_per_host": { 2024-09-21T06:46:33.363 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_count_per_host", 2024-09-21T06:46:33.363 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.363 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.363 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.363 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-21T06:46:33.363 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.363 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.363 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.363 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "max number of daemons per service per host", 2024-09-21T06:46:33.363 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.363 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.364 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.364 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.364 INFO:teuthology.orchestra.run.smithi007.stdout: "max_osd_draining_count": { 2024-09-21T06:46:33.364 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_osd_draining_count", 2024-09-21T06:46:33.364 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.364 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.364 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.364 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-21T06:46:33.364 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.364 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.364 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.364 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-21T06:46:33.364 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.364 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.364 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.365 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.365 INFO:teuthology.orchestra.run.smithi007.stdout: "migration_current": { 2024-09-21T06:46:33.365 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "migration_current", 2024-09-21T06:46:33.365 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.365 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.365 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.365 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.365 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.365 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.365 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.365 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "internal - do not modify", 2024-09-21T06:46:33.365 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.365 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.365 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.366 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.366 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": { 2024-09-21T06:46:33.366 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mode", 2024-09-21T06:46:33.366 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.366 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.366 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.366 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "root", 2024-09-21T06:46:33.366 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.366 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.366 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.366 INFO:teuthology.orchestra.run.smithi007.stdout: "cephadm-package", 2024-09-21T06:46:33.366 INFO:teuthology.orchestra.run.smithi007.stdout: "root" 2024-09-21T06:46:33.366 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.366 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "mode for remote execution of cephadm", 2024-09-21T06:46:33.367 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.367 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.367 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.367 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.367 INFO:teuthology.orchestra.run.smithi007.stdout: "oob_default_addr": { 2024-09-21T06:46:33.367 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "oob_default_addr", 2024-09-21T06:46:33.367 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.367 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.367 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.367 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "169.254.1.1", 2024-09-21T06:46:33.367 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.367 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.367 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.367 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-21T06:46:33.367 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.368 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.368 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.368 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.368 INFO:teuthology.orchestra.run.smithi007.stdout: "prometheus_alerts_path": { 2024-09-21T06:46:33.368 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "prometheus_alerts_path", 2024-09-21T06:46:33.368 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.368 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.368 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.368 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-21T06:46:33.368 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.368 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.368 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.368 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-21T06:46:33.368 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.369 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.369 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.369 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.369 INFO:teuthology.orchestra.run.smithi007.stdout: "registry_insecure": { 2024-09-21T06:46:33.369 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "registry_insecure", 2024-09-21T06:46:33.369 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.369 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.369 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.369 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.369 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.369 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.369 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.369 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-21T06:46:33.370 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.370 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.370 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.370 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.370 INFO:teuthology.orchestra.run.smithi007.stdout: "registry_password": { 2024-09-21T06:46:33.370 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "registry_password", 2024-09-21T06:46:33.370 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.370 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.370 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.370 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.370 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.370 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.370 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.370 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-21T06:46:33.371 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.371 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.371 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.371 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.371 INFO:teuthology.orchestra.run.smithi007.stdout: "registry_url": { 2024-09-21T06:46:33.371 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "registry_url", 2024-09-21T06:46:33.371 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.371 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.371 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.371 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.371 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.371 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.371 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.371 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-21T06:46:33.372 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.372 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.372 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.372 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.372 INFO:teuthology.orchestra.run.smithi007.stdout: "registry_username": { 2024-09-21T06:46:33.372 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "registry_username", 2024-09-21T06:46:33.372 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.372 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.372 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.372 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.372 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.372 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.372 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.372 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-21T06:46:33.372 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.373 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.373 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.373 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.373 INFO:teuthology.orchestra.run.smithi007.stdout: "secure_monitoring_stack": { 2024-09-21T06:46:33.373 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "secure_monitoring_stack", 2024-09-21T06:46:33.373 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.373 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.373 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.373 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.373 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.373 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.373 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.373 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-21T06:46:33.373 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.374 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.374 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.374 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.374 INFO:teuthology.orchestra.run.smithi007.stdout: "service_discovery_port": { 2024-09-21T06:46:33.374 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "service_discovery_port", 2024-09-21T06:46:33.374 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.374 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.374 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.374 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8765", 2024-09-21T06:46:33.374 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.374 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.374 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.374 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "cephadm service discovery port", 2024-09-21T06:46:33.374 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.375 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.375 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.375 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.375 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:33.375 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:33.375 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.375 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:33.375 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.375 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.375 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.375 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.375 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.375 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.375 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.375 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.376 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.376 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.376 INFO:teuthology.orchestra.run.smithi007.stdout: "ssh_config_file": { 2024-09-21T06:46:33.376 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ssh_config_file", 2024-09-21T06:46:33.376 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.376 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.376 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.376 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.376 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.376 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.376 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.376 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-21T06:46:33.376 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.376 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.377 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.377 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.377 INFO:teuthology.orchestra.run.smithi007.stdout: "ssh_keepalive_count_max": { 2024-09-21T06:46:33.377 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ssh_keepalive_count_max", 2024-09-21T06:46:33.377 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.377 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.377 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.377 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "3", 2024-09-21T06:46:33.377 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.377 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.377 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.377 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-21T06:46:33.377 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.377 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.378 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.378 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.378 INFO:teuthology.orchestra.run.smithi007.stdout: "ssh_keepalive_interval": { 2024-09-21T06:46:33.378 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ssh_keepalive_interval", 2024-09-21T06:46:33.378 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.378 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.378 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.378 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "7", 2024-09-21T06:46:33.378 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.378 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.378 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.378 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-21T06:46:33.378 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.379 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.379 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.379 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.379 INFO:teuthology.orchestra.run.smithi007.stdout: "use_agent": { 2024-09-21T06:46:33.379 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "use_agent", 2024-09-21T06:46:33.379 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.379 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.379 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.379 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.379 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.379 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.379 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.379 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-21T06:46:33.379 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.380 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.380 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.380 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.380 INFO:teuthology.orchestra.run.smithi007.stdout: "use_repo_digest": { 2024-09-21T06:46:33.380 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "use_repo_digest", 2024-09-21T06:46:33.380 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.380 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.380 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.380 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:33.380 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.380 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.380 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.380 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-21T06:46:33.381 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.381 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.381 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.381 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.381 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_on_failed_host_check": { 2024-09-21T06:46:33.381 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_on_failed_host_check", 2024-09-21T06:46:33.381 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.381 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.381 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.381 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:33.381 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.381 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.381 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.381 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "raise a health warning if the host check fails", 2024-09-21T06:46:33.382 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.382 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.382 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.382 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.382 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_on_stray_daemons": { 2024-09-21T06:46:33.382 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_on_stray_daemons", 2024-09-21T06:46:33.382 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.382 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.382 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.382 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:33.382 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.382 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.382 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.382 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-21T06:46:33.383 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.383 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.383 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.383 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.383 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_on_stray_hosts": { 2024-09-21T06:46:33.383 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_on_stray_hosts", 2024-09-21T06:46:33.383 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.383 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.383 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.383 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:33.383 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.383 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.383 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.383 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-21T06:46:33.383 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.384 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.384 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.384 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.384 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.384 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.384 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:33.384 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crash", 2024-09-21T06:46:33.384 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:33.384 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:33.384 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:33.384 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:33.384 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:33.384 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.385 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.385 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.385 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.385 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.385 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.385 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.385 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.385 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.385 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.385 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.385 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.385 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.385 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.385 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.385 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.386 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.386 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.386 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.386 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:33.386 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:33.386 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.386 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.386 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.386 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.386 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.386 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.386 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.386 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.386 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.387 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.387 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.387 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.387 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:33.387 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:33.387 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.387 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.387 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.387 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:33.387 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.387 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.387 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.387 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.387 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.388 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.388 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.388 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.388 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.388 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.388 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.388 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.388 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.388 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.388 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.388 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:33.388 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:33.388 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.388 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.389 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.389 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.389 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.389 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.389 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.389 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.389 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.389 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.389 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.389 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.389 INFO:teuthology.orchestra.run.smithi007.stdout: "retain_interval": { 2024-09-21T06:46:33.389 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "retain_interval", 2024-09-21T06:46:33.389 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:46:33.389 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.390 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.390 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "31536000", 2024-09-21T06:46:33.390 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.390 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.390 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.390 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-21T06:46:33.390 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.390 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.390 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.390 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.390 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:33.390 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:33.390 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.391 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:33.391 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.391 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.391 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.391 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.391 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.391 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.391 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.391 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.391 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.391 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.391 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_recent_interval": { 2024-09-21T06:46:33.391 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_recent_interval", 2024-09-21T06:46:33.391 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:46:33.391 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.392 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.392 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "1209600", 2024-09-21T06:46:33.392 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.392 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.392 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.392 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-21T06:46:33.392 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.392 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.392 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.392 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.392 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.392 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.392 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:33.393 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "dashboard", 2024-09-21T06:46:33.393 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:33.393 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:33.393 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:33.393 INFO:teuthology.orchestra.run.smithi007.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-21T06:46:33.393 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-21T06:46:33.393 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.393 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.393 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.393 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-21T06:46:33.393 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.393 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.393 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.393 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.394 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.394 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.394 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.394 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.394 INFO:teuthology.orchestra.run.smithi007.stdout: "ALERTMANAGER_API_HOST": { 2024-09-21T06:46:33.394 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-21T06:46:33.394 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.394 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.394 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.394 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.394 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.394 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.394 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.394 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.395 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.395 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.395 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.395 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.395 INFO:teuthology.orchestra.run.smithi007.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-21T06:46:33.395 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-21T06:46:33.395 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.395 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.395 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.395 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:33.395 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.395 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.395 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.395 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.396 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.396 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.396 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.397 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.397 INFO:teuthology.orchestra.run.smithi007.stdout: "AUDIT_API_ENABLED": { 2024-09-21T06:46:33.397 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "AUDIT_API_ENABLED", 2024-09-21T06:46:33.397 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.397 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.397 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.398 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.398 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.398 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.398 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.398 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.398 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.398 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.398 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.398 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.398 INFO:teuthology.orchestra.run.smithi007.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-21T06:46:33.398 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-21T06:46:33.398 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.398 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.399 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.399 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:33.399 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.399 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.399 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.399 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.399 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.399 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.399 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.399 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.399 INFO:teuthology.orchestra.run.smithi007.stdout: "ENABLE_BROWSABLE_API": { 2024-09-21T06:46:33.399 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-21T06:46:33.399 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.399 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.400 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.400 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:33.400 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.400 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.400 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.400 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.400 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.400 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.400 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.400 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.400 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-21T06:46:33.400 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-21T06:46:33.400 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.400 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.400 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.401 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:33.401 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.401 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.401 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.401 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.401 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.401 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.401 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.401 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.401 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-21T06:46:33.401 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-21T06:46:33.401 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.401 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.401 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.401 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:33.402 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.402 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.402 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.402 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.402 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.402 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.402 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.402 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.402 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-21T06:46:33.402 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-21T06:46:33.402 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.402 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.402 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.402 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:33.403 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.403 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.403 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.403 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.403 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.403 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.403 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.403 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.403 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-21T06:46:33.403 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-21T06:46:33.403 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.403 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.403 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.403 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:33.404 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.404 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.404 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.404 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.404 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.404 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.404 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.404 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.404 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-21T06:46:33.404 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-21T06:46:33.404 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.404 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.404 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.404 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:33.404 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.405 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.405 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.405 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.405 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.405 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.405 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.405 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.405 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-21T06:46:33.405 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-21T06:46:33.405 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.405 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.405 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.405 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:33.405 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.405 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.406 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.406 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.406 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.406 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.406 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.406 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.406 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-21T06:46:33.406 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-21T06:46:33.406 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.406 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.406 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.406 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:33.406 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.406 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.407 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.407 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.407 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.407 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.407 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.407 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.407 INFO:teuthology.orchestra.run.smithi007.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-21T06:46:33.407 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-21T06:46:33.407 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.407 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.407 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.407 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.407 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.407 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.407 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.408 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.408 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.408 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.408 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.408 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.408 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_API_PASSWORD": { 2024-09-21T06:46:33.408 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-21T06:46:33.408 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.408 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.408 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.408 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "admin", 2024-09-21T06:46:33.408 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.408 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.409 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.409 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.409 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.409 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.409 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.409 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.409 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-21T06:46:33.409 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-21T06:46:33.409 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.409 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.409 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.409 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:33.409 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.409 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.410 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.410 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.410 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.410 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.410 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.410 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.410 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_API_URL": { 2024-09-21T06:46:33.410 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_API_URL", 2024-09-21T06:46:33.410 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.410 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.410 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.410 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.410 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.410 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.411 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.411 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.411 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.411 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.411 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.411 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.411 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_API_USERNAME": { 2024-09-21T06:46:33.411 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-21T06:46:33.411 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.411 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.411 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.411 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "admin", 2024-09-21T06:46:33.411 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.411 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.412 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.412 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.412 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.412 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.412 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.412 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.412 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-21T06:46:33.412 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-21T06:46:33.412 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.412 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.412 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.412 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.412 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.412 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.412 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.413 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.413 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.413 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.413 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.413 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.413 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-21T06:46:33.413 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-21T06:46:33.413 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.413 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.413 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.413 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.413 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.413 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.413 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.413 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.414 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.414 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.414 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.414 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.414 INFO:teuthology.orchestra.run.smithi007.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-21T06:46:33.414 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-21T06:46:33.414 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.414 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.414 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.414 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:33.414 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.414 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.414 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.414 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.414 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.415 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.415 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.415 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.415 INFO:teuthology.orchestra.run.smithi007.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-21T06:46:33.415 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-21T06:46:33.415 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.415 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.415 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.415 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.415 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.415 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.415 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.415 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.416 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.416 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.416 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.416 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.416 INFO:teuthology.orchestra.run.smithi007.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-21T06:46:33.416 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-21T06:46:33.416 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.416 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.416 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.416 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "[]", 2024-09-21T06:46:33.416 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.416 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.416 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.416 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.417 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.417 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.417 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.417 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.417 INFO:teuthology.orchestra.run.smithi007.stdout: "MULTICLUSTER_CONFIG": { 2024-09-21T06:46:33.417 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-21T06:46:33.417 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.417 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.417 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.417 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "{}", 2024-09-21T06:46:33.417 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.417 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.417 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.417 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.418 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.418 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.418 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.418 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.418 INFO:teuthology.orchestra.run.smithi007.stdout: "PROMETHEUS_API_HOST": { 2024-09-21T06:46:33.418 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-21T06:46:33.418 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.418 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.418 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.418 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.418 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.418 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.418 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.418 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.418 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.419 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.419 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.419 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.419 INFO:teuthology.orchestra.run.smithi007.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-21T06:46:33.419 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-21T06:46:33.419 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.419 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.419 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.419 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:33.419 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.419 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.419 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.419 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.419 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.419 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.420 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.420 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.420 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-21T06:46:33.420 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-21T06:46:33.420 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.420 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.420 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.420 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.420 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.420 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.420 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.420 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.420 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.420 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.420 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.420 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.421 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-21T06:46:33.421 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-21T06:46:33.421 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.421 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.421 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.421 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.421 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.421 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.421 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.421 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.421 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.421 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.421 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.421 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.421 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-21T06:46:33.421 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-21T06:46:33.422 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.422 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.422 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.422 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:33.422 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.422 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.422 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.422 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.422 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.422 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.422 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.422 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.422 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-21T06:46:33.422 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-21T06:46:33.422 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.423 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.423 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.423 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:33.423 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.423 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.423 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.423 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.423 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.423 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.423 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.423 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.423 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-21T06:46:33.423 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-21T06:46:33.424 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.424 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.424 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.424 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.424 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.424 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.424 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.424 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.424 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.424 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.424 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.424 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.424 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-21T06:46:33.424 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-21T06:46:33.424 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.425 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.425 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.425 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.425 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.425 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.425 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.425 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.425 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.425 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.425 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.425 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.425 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-21T06:46:33.425 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-21T06:46:33.426 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.426 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.426 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.426 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.426 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.426 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.426 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.426 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.426 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.426 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.426 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.426 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.426 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_ENABLED": { 2024-09-21T06:46:33.426 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-21T06:46:33.427 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.427 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.427 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.427 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:33.427 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.427 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.427 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.427 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.427 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.427 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.427 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.427 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.427 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-21T06:46:33.427 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-21T06:46:33.428 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.428 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.428 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.428 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-21T06:46:33.428 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.428 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.428 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.428 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.428 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.428 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.428 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.428 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.428 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-21T06:46:33.428 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-21T06:46:33.429 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.429 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.429 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.429 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-21T06:46:33.429 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.429 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.429 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.429 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.429 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.429 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.429 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.429 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.429 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-21T06:46:33.429 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-21T06:46:33.430 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.430 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.430 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.430 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8", 2024-09-21T06:46:33.430 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.430 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.430 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.430 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.430 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.430 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.430 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.430 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.430 INFO:teuthology.orchestra.run.smithi007.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-21T06:46:33.430 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-21T06:46:33.431 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.431 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.431 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.431 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "45", 2024-09-21T06:46:33.431 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.431 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.431 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.431 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.431 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.431 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.431 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.431 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.431 INFO:teuthology.orchestra.run.smithi007.stdout: "RGW_API_ACCESS_KEY": { 2024-09-21T06:46:33.431 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-21T06:46:33.432 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.432 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.432 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.432 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.432 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.432 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.432 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.432 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.432 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.432 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.432 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.432 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.432 INFO:teuthology.orchestra.run.smithi007.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-21T06:46:33.432 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-21T06:46:33.432 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.433 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.433 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.433 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "admin", 2024-09-21T06:46:33.433 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.433 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.433 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.433 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.433 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.433 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.433 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.433 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.433 INFO:teuthology.orchestra.run.smithi007.stdout: "RGW_API_SECRET_KEY": { 2024-09-21T06:46:33.433 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-21T06:46:33.433 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.433 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.434 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.434 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.434 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.434 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.434 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.434 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.434 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.434 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.434 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.434 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.434 INFO:teuthology.orchestra.run.smithi007.stdout: "RGW_API_SSL_VERIFY": { 2024-09-21T06:46:33.434 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-21T06:46:33.434 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.434 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.435 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.435 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:33.435 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.435 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.435 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.435 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.435 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.435 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.435 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.435 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.435 INFO:teuthology.orchestra.run.smithi007.stdout: "UNSAFE_TLS_v1_2": { 2024-09-21T06:46:33.435 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-21T06:46:33.435 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.435 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.435 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.436 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.436 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.436 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.436 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.436 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.436 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.436 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.436 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.436 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.436 INFO:teuthology.orchestra.run.smithi007.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-21T06:46:33.436 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-21T06:46:33.436 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.436 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.436 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.437 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.437 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.437 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.437 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.437 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.437 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.437 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.437 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.437 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.437 INFO:teuthology.orchestra.run.smithi007.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-21T06:46:33.437 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-21T06:46:33.437 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.437 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.437 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.438 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-21T06:46:33.438 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.438 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.438 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.438 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.438 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.438 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.438 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.438 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.438 INFO:teuthology.orchestra.run.smithi007.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-21T06:46:33.438 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-21T06:46:33.438 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.438 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.438 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.439 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5", 2024-09-21T06:46:33.439 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.439 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.439 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.439 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.439 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.439 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.439 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.439 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.439 INFO:teuthology.orchestra.run.smithi007.stdout: "cross_origin_url": { 2024-09-21T06:46:33.439 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cross_origin_url", 2024-09-21T06:46:33.439 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.439 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.439 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.439 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.440 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.440 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.440 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.440 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.440 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.440 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.440 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.440 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.440 INFO:teuthology.orchestra.run.smithi007.stdout: "crt_file": { 2024-09-21T06:46:33.440 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crt_file", 2024-09-21T06:46:33.440 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.440 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.440 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.440 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.441 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.441 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.441 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.441 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.441 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.441 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.441 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.441 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.441 INFO:teuthology.orchestra.run.smithi007.stdout: "debug": { 2024-09-21T06:46:33.441 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "debug", 2024-09-21T06:46:33.441 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.441 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.441 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.441 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.442 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.442 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.442 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.442 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Enable/disable debug options", 2024-09-21T06:46:33.442 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.442 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.442 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.442 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.442 INFO:teuthology.orchestra.run.smithi007.stdout: "jwt_token_ttl": { 2024-09-21T06:46:33.442 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "jwt_token_ttl", 2024-09-21T06:46:33.442 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.442 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.442 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.443 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "28800", 2024-09-21T06:46:33.443 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.443 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.443 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.443 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.443 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.443 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.443 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.443 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.443 INFO:teuthology.orchestra.run.smithi007.stdout: "key_file": { 2024-09-21T06:46:33.443 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "key_file", 2024-09-21T06:46:33.443 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.443 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.444 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.444 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.444 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.444 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.444 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.444 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.444 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.444 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.444 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.444 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.444 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:33.444 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:33.444 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.445 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.445 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.445 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.445 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.445 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.445 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.445 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.445 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.445 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.445 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.445 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.445 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.445 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.445 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.446 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.446 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.446 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.446 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.446 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:33.446 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:33.446 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.446 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.446 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.446 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.446 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.446 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.446 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.446 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.447 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.447 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.447 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.447 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.447 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:33.447 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:33.447 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.447 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.447 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.447 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:33.447 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.447 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.447 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.447 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.448 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.448 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.448 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.448 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.448 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.448 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.448 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.448 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.448 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.448 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.448 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.448 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:33.448 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:33.448 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.448 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.449 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.449 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.449 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.449 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.449 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.449 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.449 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.449 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.449 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.449 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.449 INFO:teuthology.orchestra.run.smithi007.stdout: "motd": { 2024-09-21T06:46:33.449 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "motd", 2024-09-21T06:46:33.449 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.449 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.450 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.450 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.450 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.450 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.450 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.450 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "The message of the day", 2024-09-21T06:46:33.450 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.450 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.450 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.450 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.450 INFO:teuthology.orchestra.run.smithi007.stdout: "redirect_resolve_ip_addr": { 2024-09-21T06:46:33.450 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "redirect_resolve_ip_addr", 2024-09-21T06:46:33.450 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.451 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.451 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.451 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.451 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.451 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.451 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.451 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.451 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.451 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.451 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.451 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.451 INFO:teuthology.orchestra.run.smithi007.stdout: "server_addr": { 2024-09-21T06:46:33.451 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_addr", 2024-09-21T06:46:33.451 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.452 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.452 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.452 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "::", 2024-09-21T06:46:33.452 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.452 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.452 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.452 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.452 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.452 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.452 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.452 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.452 INFO:teuthology.orchestra.run.smithi007.stdout: "server_port": { 2024-09-21T06:46:33.452 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_port", 2024-09-21T06:46:33.452 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.453 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.453 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.453 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8080", 2024-09-21T06:46:33.453 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.453 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.453 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.453 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.453 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.453 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.453 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.453 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.453 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:33.453 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:33.453 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.454 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:33.454 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.454 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.454 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.454 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.454 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.454 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.454 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.454 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.454 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.454 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.454 INFO:teuthology.orchestra.run.smithi007.stdout: "ssl": { 2024-09-21T06:46:33.454 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ssl", 2024-09-21T06:46:33.454 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.455 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.455 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.455 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:33.455 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.455 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.455 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.455 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.455 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.455 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.455 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.455 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.455 INFO:teuthology.orchestra.run.smithi007.stdout: "ssl_server_port": { 2024-09-21T06:46:33.455 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ssl_server_port", 2024-09-21T06:46:33.455 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.456 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.456 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.456 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8443", 2024-09-21T06:46:33.456 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.456 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.456 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.456 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.456 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.456 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.456 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.456 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.456 INFO:teuthology.orchestra.run.smithi007.stdout: "sso_oauth2": { 2024-09-21T06:46:33.457 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sso_oauth2", 2024-09-21T06:46:33.457 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.457 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.457 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.457 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.457 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.457 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.457 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.457 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.457 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.457 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.457 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.458 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.458 INFO:teuthology.orchestra.run.smithi007.stdout: "standby_behaviour": { 2024-09-21T06:46:33.458 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "standby_behaviour", 2024-09-21T06:46:33.458 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.458 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.458 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.458 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "redirect", 2024-09-21T06:46:33.458 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.458 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.458 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.458 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.458 INFO:teuthology.orchestra.run.smithi007.stdout: "redirect" 2024-09-21T06:46:33.458 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.458 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.458 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.459 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.459 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.459 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.459 INFO:teuthology.orchestra.run.smithi007.stdout: "standby_error_status_code": { 2024-09-21T06:46:33.459 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "standby_error_status_code", 2024-09-21T06:46:33.459 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.459 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.459 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.460 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "500", 2024-09-21T06:46:33.460 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "400", 2024-09-21T06:46:33.460 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "599", 2024-09-21T06:46:33.460 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.460 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.460 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.460 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.460 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.460 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.460 INFO:teuthology.orchestra.run.smithi007.stdout: "url_prefix": { 2024-09-21T06:46:33.460 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "url_prefix", 2024-09-21T06:46:33.460 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.460 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.461 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.461 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.461 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.461 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.461 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.461 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.461 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.461 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.461 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.461 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.461 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.461 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.461 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:33.461 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "devicehealth", 2024-09-21T06:46:33.461 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:33.462 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:33.462 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:33.462 INFO:teuthology.orchestra.run.smithi007.stdout: "enable_monitoring": { 2024-09-21T06:46:33.462 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "enable_monitoring", 2024-09-21T06:46:33.462 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.462 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.462 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.462 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:33.462 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.462 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.462 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.462 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "monitor device health metrics", 2024-09-21T06:46:33.462 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.462 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.463 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.463 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.463 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:33.463 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:33.463 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.463 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.463 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.463 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.463 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.463 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.463 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.463 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.463 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.464 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.464 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.464 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.464 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.464 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.464 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.464 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.464 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.464 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.464 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.464 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:33.464 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:33.464 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.464 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.465 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.465 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.465 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.465 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.465 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.465 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.465 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.465 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.465 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.465 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.465 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:33.465 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:33.465 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.465 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.465 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.466 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:33.466 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.466 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.466 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.466 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.466 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.466 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.466 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.466 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.466 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.466 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.466 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.466 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.466 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.467 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.467 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.467 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:33.467 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:33.467 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.467 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.467 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.467 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.467 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.467 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.467 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.467 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.467 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.467 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.467 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.468 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.468 INFO:teuthology.orchestra.run.smithi007.stdout: "mark_out_threshold": { 2024-09-21T06:46:33.468 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mark_out_threshold", 2024-09-21T06:46:33.468 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:46:33.468 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.468 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.468 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "2419200", 2024-09-21T06:46:33.468 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.468 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.468 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.468 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-21T06:46:33.468 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.468 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.468 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.468 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.469 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_name": { 2024-09-21T06:46:33.469 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "pool_name", 2024-09-21T06:46:33.469 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.469 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.469 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.469 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "device_health_metrics", 2024-09-21T06:46:33.469 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.469 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.469 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.469 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-21T06:46:33.469 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.469 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.469 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.469 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.469 INFO:teuthology.orchestra.run.smithi007.stdout: "retention_period": { 2024-09-21T06:46:33.469 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "retention_period", 2024-09-21T06:46:33.470 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:46:33.470 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.470 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.470 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "15552000", 2024-09-21T06:46:33.470 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.470 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.470 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.470 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how long to retain device health metrics", 2024-09-21T06:46:33.470 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.470 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.470 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.470 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.470 INFO:teuthology.orchestra.run.smithi007.stdout: "scrape_frequency": { 2024-09-21T06:46:33.471 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "scrape_frequency", 2024-09-21T06:46:33.471 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:46:33.471 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.471 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.471 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "86400", 2024-09-21T06:46:33.471 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.471 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.471 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.471 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-21T06:46:33.471 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.471 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.471 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.471 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.471 INFO:teuthology.orchestra.run.smithi007.stdout: "self_heal": { 2024-09-21T06:46:33.471 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "self_heal", 2024-09-21T06:46:33.472 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.472 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.472 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.472 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:33.472 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.472 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.472 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.472 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-21T06:46:33.472 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.472 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.472 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.472 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.472 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-09-21T06:46:33.472 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-09-21T06:46:33.473 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:46:33.473 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.473 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.473 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-09-21T06:46:33.473 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.473 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.473 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.473 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to wake up and check device health", 2024-09-21T06:46:33.473 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.473 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.473 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.473 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.473 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:33.473 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:33.473 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.474 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:33.474 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.474 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.474 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.474 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.474 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.474 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.474 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.474 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.474 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.474 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.474 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_threshold": { 2024-09-21T06:46:33.474 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_threshold", 2024-09-21T06:46:33.474 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:46:33.474 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.475 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.475 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "7257600", 2024-09-21T06:46:33.475 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.475 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.475 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.475 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-21T06:46:33.475 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.475 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.475 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.475 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.475 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.475 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.475 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:33.475 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "diskprediction_local", 2024-09-21T06:46:33.476 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:33.476 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:33.476 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:33.476 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:33.476 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:33.476 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.476 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.476 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.476 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.476 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.476 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.476 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.476 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.476 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.476 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.477 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.477 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.477 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.477 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.477 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.477 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.477 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.477 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.477 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.477 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:33.477 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:33.477 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.477 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.477 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.478 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.478 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.478 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.478 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.478 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.478 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.478 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.478 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.478 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.478 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:33.478 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:33.478 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.478 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.478 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.478 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:33.479 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.479 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.479 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.479 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.479 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.479 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.479 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.479 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.479 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.479 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.479 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.479 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.479 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.479 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.479 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.480 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:33.480 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:33.480 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.480 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.480 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.480 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.480 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.480 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.480 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.480 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.480 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.480 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.480 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.480 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.480 INFO:teuthology.orchestra.run.smithi007.stdout: "predict_interval": { 2024-09-21T06:46:33.481 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "predict_interval", 2024-09-21T06:46:33.481 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.481 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.481 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.481 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "86400", 2024-09-21T06:46:33.481 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.481 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.481 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.481 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.481 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.481 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.481 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.481 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.481 INFO:teuthology.orchestra.run.smithi007.stdout: "predictor_model": { 2024-09-21T06:46:33.481 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "predictor_model", 2024-09-21T06:46:33.482 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.482 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.482 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.482 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "prophetstor", 2024-09-21T06:46:33.482 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.482 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.482 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.482 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.482 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.482 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.482 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.482 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.482 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-09-21T06:46:33.482 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-09-21T06:46:33.483 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.483 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.483 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.483 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-09-21T06:46:33.483 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.483 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.483 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.483 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.483 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.483 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.483 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.483 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.483 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:33.483 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:33.484 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.484 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:33.484 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.484 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.484 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.484 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.484 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.484 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.484 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.484 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.484 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.484 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.484 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.484 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.485 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:33.485 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "influx", 2024-09-21T06:46:33.485 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": false, 2024-09-21T06:46:33.485 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "influxdb python module not found", 2024-09-21T06:46:33.485 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:33.485 INFO:teuthology.orchestra.run.smithi007.stdout: "batch_size": { 2024-09-21T06:46:33.485 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "batch_size", 2024-09-21T06:46:33.485 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.485 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.485 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.485 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5000", 2024-09-21T06:46:33.485 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.485 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.485 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.485 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-21T06:46:33.486 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.486 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.486 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.486 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.486 INFO:teuthology.orchestra.run.smithi007.stdout: "database": { 2024-09-21T06:46:33.486 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "database", 2024-09-21T06:46:33.486 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.486 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.486 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.486 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "ceph", 2024-09-21T06:46:33.486 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.486 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.486 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.486 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-21T06:46:33.487 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.487 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.487 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.487 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.487 INFO:teuthology.orchestra.run.smithi007.stdout: "hostname": { 2024-09-21T06:46:33.487 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "hostname", 2024-09-21T06:46:33.487 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.487 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.487 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.487 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.487 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.487 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.487 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.488 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "InfluxDB server hostname", 2024-09-21T06:46:33.488 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.488 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.488 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.488 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.488 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-09-21T06:46:33.488 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-09-21T06:46:33.488 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:46:33.488 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.488 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.488 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "30", 2024-09-21T06:46:33.488 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "5", 2024-09-21T06:46:33.488 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.489 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.489 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-21T06:46:33.489 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.489 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.489 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.489 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.489 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:33.489 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:33.489 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.489 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.489 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.489 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.489 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.490 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.490 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.490 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.490 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.490 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.490 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.490 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.490 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.490 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.490 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.490 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.490 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.490 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.490 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.490 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:33.491 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:33.491 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.491 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.491 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.491 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.491 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.491 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.491 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.491 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.491 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.491 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.491 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.491 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.492 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:33.492 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:33.492 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.492 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.492 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.492 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:33.492 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.492 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.492 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.492 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.492 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.492 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.492 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.492 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.492 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.493 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.493 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.493 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.493 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.493 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.493 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.493 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:33.493 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:33.493 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.493 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.493 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.493 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.493 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.493 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.493 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.493 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.493 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.494 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.494 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.494 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.494 INFO:teuthology.orchestra.run.smithi007.stdout: "password": { 2024-09-21T06:46:33.494 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "password", 2024-09-21T06:46:33.494 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.494 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.494 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.494 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.494 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.494 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.494 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.494 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "password of InfluxDB server user", 2024-09-21T06:46:33.494 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.495 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.495 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.495 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.495 INFO:teuthology.orchestra.run.smithi007.stdout: "port": { 2024-09-21T06:46:33.495 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "port", 2024-09-21T06:46:33.495 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.495 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.495 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.495 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8086", 2024-09-21T06:46:33.495 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.495 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.495 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.495 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "InfluxDB server port", 2024-09-21T06:46:33.495 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.495 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.496 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.496 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.496 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:33.496 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:33.496 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.496 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:33.496 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.496 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.496 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.496 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.496 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.496 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.496 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.497 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.497 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.497 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.497 INFO:teuthology.orchestra.run.smithi007.stdout: "ssl": { 2024-09-21T06:46:33.497 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ssl", 2024-09-21T06:46:33.497 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.497 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.497 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.497 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "false", 2024-09-21T06:46:33.497 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.497 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.497 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.497 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T06:46:33.497 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.497 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.498 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.498 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.498 INFO:teuthology.orchestra.run.smithi007.stdout: "threads": { 2024-09-21T06:46:33.498 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "threads", 2024-09-21T06:46:33.498 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.498 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.498 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.498 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5", 2024-09-21T06:46:33.498 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1", 2024-09-21T06:46:33.498 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "32", 2024-09-21T06:46:33.498 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.498 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-21T06:46:33.498 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.498 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.499 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.499 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.499 INFO:teuthology.orchestra.run.smithi007.stdout: "username": { 2024-09-21T06:46:33.499 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "username", 2024-09-21T06:46:33.499 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.499 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.499 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.499 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.499 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.499 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.499 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.499 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "username of InfluxDB server user", 2024-09-21T06:46:33.499 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.499 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.499 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.500 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.500 INFO:teuthology.orchestra.run.smithi007.stdout: "verify_ssl": { 2024-09-21T06:46:33.500 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "verify_ssl", 2024-09-21T06:46:33.500 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.500 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.500 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.500 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "true", 2024-09-21T06:46:33.500 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.500 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.500 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.500 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T06:46:33.500 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.500 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.500 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.501 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.501 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.501 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.501 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:33.501 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "insights", 2024-09-21T06:46:33.501 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:33.501 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:33.501 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:33.501 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:33.501 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:33.501 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.501 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.501 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.501 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.501 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.502 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.502 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.502 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.502 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.502 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.502 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.502 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.502 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.502 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.502 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.502 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.502 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.502 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.502 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.502 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:33.503 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:33.503 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.503 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.503 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.503 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.503 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.503 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.503 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.503 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.503 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.503 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.503 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.503 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.503 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:33.504 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:33.504 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.504 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.504 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.504 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:33.504 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.504 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.504 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.504 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.504 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.504 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.504 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.504 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.504 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.505 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.505 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.505 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.505 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.505 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.505 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.505 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:33.505 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:33.505 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.505 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.505 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.505 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.505 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.505 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.505 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.506 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.506 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.506 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.506 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.506 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.506 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:33.506 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:33.506 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.506 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:33.506 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.506 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.506 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.506 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.506 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.507 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.507 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.507 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.507 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.507 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.507 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.507 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.507 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:33.507 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "iostat", 2024-09-21T06:46:33.507 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:33.507 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:33.507 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:33.507 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:33.507 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:33.508 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.508 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.508 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.508 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.508 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.508 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.508 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.508 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.508 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.508 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.508 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.508 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.508 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.508 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.509 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.509 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.509 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.509 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.509 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.509 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:33.509 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:33.509 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.509 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.509 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.509 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.509 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.509 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.509 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.510 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.510 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.510 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.510 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.510 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.510 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:33.510 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:33.510 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.510 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.510 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.510 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:33.510 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.510 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.510 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.511 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.511 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.511 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.511 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.511 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.511 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.511 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.511 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.511 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.511 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.511 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.511 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.511 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:33.511 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:33.512 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.512 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.512 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.512 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.512 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.512 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.512 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.512 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.512 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.512 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.512 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.512 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.512 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:33.512 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:33.513 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.513 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:33.513 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.513 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.513 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.513 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.513 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.513 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.513 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.513 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.513 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.513 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.513 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.513 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.513 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:33.514 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "k8sevents", 2024-09-21T06:46:33.514 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:33.514 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:33.514 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:33.514 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_event_retention_days": { 2024-09-21T06:46:33.514 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ceph_event_retention_days", 2024-09-21T06:46:33.514 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.514 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.514 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.514 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "7", 2024-09-21T06:46:33.514 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.514 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.514 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.514 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-21T06:46:33.515 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.515 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.515 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.515 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.515 INFO:teuthology.orchestra.run.smithi007.stdout: "config_check_secs": { 2024-09-21T06:46:33.515 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "config_check_secs", 2024-09-21T06:46:33.515 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.515 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.515 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.515 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-21T06:46:33.515 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "10", 2024-09-21T06:46:33.515 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.516 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.516 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-21T06:46:33.516 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.516 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.516 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.516 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.516 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:33.516 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:33.516 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.516 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.516 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.516 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.516 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.516 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.516 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.517 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.517 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.517 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.517 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.517 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.517 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.517 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.517 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.517 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.517 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.517 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.517 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.517 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:33.517 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:33.518 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.518 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.518 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.518 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.518 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.518 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.518 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.518 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.518 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.518 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.518 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.518 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.518 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:33.518 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:33.519 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.519 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.519 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.519 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:33.519 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.519 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.519 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.519 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.519 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.519 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.519 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.519 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.519 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.519 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.520 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.520 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.520 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.520 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.520 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.520 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:33.520 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:33.520 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.520 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.520 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.520 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.520 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.520 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.520 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.521 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.521 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.521 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.521 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.521 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.521 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:33.521 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:33.521 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.521 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:33.521 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.521 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.521 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.521 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.521 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.521 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.522 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.522 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.522 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.522 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.522 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.522 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.522 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:33.522 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "localpool", 2024-09-21T06:46:33.522 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:33.522 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:33.522 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:33.522 INFO:teuthology.orchestra.run.smithi007.stdout: "failure_domain": { 2024-09-21T06:46:33.522 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "failure_domain", 2024-09-21T06:46:33.523 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.523 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.523 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.523 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "host", 2024-09-21T06:46:33.523 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.523 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.523 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.523 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "failure domain for any created local pool", 2024-09-21T06:46:33.523 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-21T06:46:33.523 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.523 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.523 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.523 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:33.523 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:33.524 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.524 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.524 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.524 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.524 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.524 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.524 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.524 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.524 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.524 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.524 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.524 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.524 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.524 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.525 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.525 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.525 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.525 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.525 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.525 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:33.525 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:33.525 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.525 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.525 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.525 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.525 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.525 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.526 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.526 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.526 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.526 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.526 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.526 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.526 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:33.526 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:33.526 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.526 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.526 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.526 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:33.526 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.526 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.527 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.527 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.527 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.527 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.527 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.527 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.527 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.527 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.527 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.527 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.527 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.527 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.527 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.528 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:33.528 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:33.528 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.528 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.528 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.528 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.528 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.528 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.528 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.528 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.528 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.528 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.528 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.528 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.529 INFO:teuthology.orchestra.run.smithi007.stdout: "min_size": { 2024-09-21T06:46:33.529 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "min_size", 2024-09-21T06:46:33.529 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.529 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.529 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.529 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.529 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.529 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.529 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.529 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "default min_size for any created local pool", 2024-09-21T06:46:33.529 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-21T06:46:33.529 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.529 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.529 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.529 INFO:teuthology.orchestra.run.smithi007.stdout: "num_rep": { 2024-09-21T06:46:33.530 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "num_rep", 2024-09-21T06:46:33.530 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.530 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.530 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.530 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "3", 2024-09-21T06:46:33.530 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.530 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.530 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.530 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "default replica count for any created local pool", 2024-09-21T06:46:33.530 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.530 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.530 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.530 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.530 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num": { 2024-09-21T06:46:33.530 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "pg_num", 2024-09-21T06:46:33.531 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.531 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.531 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.531 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "128", 2024-09-21T06:46:33.531 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.531 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.531 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.531 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "default pg_num for any created local pool", 2024-09-21T06:46:33.531 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.531 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.531 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.531 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.531 INFO:teuthology.orchestra.run.smithi007.stdout: "prefix": { 2024-09-21T06:46:33.531 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "prefix", 2024-09-21T06:46:33.532 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.532 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.532 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.532 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.532 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.532 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.532 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.532 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "name prefix for any created local pool", 2024-09-21T06:46:33.532 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.532 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.532 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.532 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.532 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:33.532 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:33.533 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.533 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:33.533 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.533 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.533 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.533 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.533 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.533 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.533 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.533 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.533 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.533 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.533 INFO:teuthology.orchestra.run.smithi007.stdout: "subtree": { 2024-09-21T06:46:33.533 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "subtree", 2024-09-21T06:46:33.533 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.533 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.534 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.534 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "rack", 2024-09-21T06:46:33.534 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.534 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.534 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.534 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-21T06:46:33.534 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-21T06:46:33.534 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.534 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.534 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.534 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.534 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.534 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:33.534 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mds_autoscaler", 2024-09-21T06:46:33.535 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:33.535 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:33.535 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:33.535 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:33.535 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:33.535 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.535 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.535 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.535 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.535 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.535 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.535 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.535 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.535 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.536 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.536 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.536 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.536 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.536 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.536 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.536 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.536 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.536 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.536 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.536 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:33.536 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:33.536 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.537 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.537 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.537 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.537 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.537 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.537 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.537 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.537 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.537 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.537 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.537 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.537 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:33.537 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:33.537 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.538 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.538 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.538 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:33.538 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.538 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.538 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.538 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.538 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.538 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.538 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.538 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.538 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.538 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.539 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.539 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.539 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.539 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.539 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.539 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:33.539 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:33.539 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.539 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.539 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.539 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.539 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.539 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.540 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.540 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.540 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.540 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.540 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.540 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.540 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:33.540 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:33.540 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.540 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:33.540 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.540 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.540 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.540 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.540 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.541 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.541 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.541 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.541 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.541 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.541 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.541 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.541 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:33.541 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mirroring", 2024-09-21T06:46:33.541 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:33.541 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:33.541 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:33.541 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:33.541 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:33.541 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.542 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.542 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.542 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.542 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.542 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.542 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.542 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.542 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.542 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.542 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.542 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.542 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.542 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.542 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.543 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.543 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.543 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.543 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.543 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:33.543 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:33.543 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.543 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.543 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.543 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.543 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.543 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.543 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.543 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.543 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.544 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.544 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.544 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.544 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:33.544 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:33.544 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.544 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.544 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.544 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:33.544 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.544 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.544 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.544 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.544 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.545 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.545 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.545 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.545 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.545 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.545 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.545 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.545 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.545 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.545 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.545 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:33.545 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:33.545 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.545 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.545 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.546 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.546 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.546 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.546 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.546 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.546 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.546 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.546 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.546 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.546 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:33.546 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:33.546 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.546 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:33.546 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.547 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.547 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.547 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.547 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.547 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.547 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.547 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.547 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.547 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.547 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.547 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.547 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:33.547 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "nfs", 2024-09-21T06:46:33.547 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:33.548 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:33.548 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:33.548 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:33.548 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:33.548 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.548 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.548 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.548 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.548 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.548 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.548 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.548 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.548 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.548 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.548 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.548 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.549 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.549 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.549 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.549 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.549 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.549 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.549 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.549 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:33.549 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:33.549 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.549 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.549 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.549 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.549 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.550 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.550 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.550 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.550 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.550 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.550 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.550 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.550 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:33.550 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:33.550 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.550 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.550 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.550 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:33.550 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.550 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.551 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.551 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.551 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.551 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.551 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.551 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.551 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.551 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.551 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.551 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.551 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.551 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.551 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.551 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:33.552 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:33.552 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.552 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.552 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.552 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.552 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.552 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.552 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.552 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.552 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.552 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.552 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.552 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.552 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:33.553 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:33.553 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.553 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:33.553 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.553 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.553 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.553 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.553 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.553 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.553 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.553 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.553 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.553 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.553 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.554 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.554 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:33.554 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "orchestrator", 2024-09-21T06:46:33.554 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:33.554 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:33.554 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:33.554 INFO:teuthology.orchestra.run.smithi007.stdout: "fail_fs": { 2024-09-21T06:46:33.554 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "fail_fs", 2024-09-21T06:46:33.554 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.554 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.554 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.554 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.554 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.555 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.555 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.555 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-21T06:46:33.555 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.555 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.555 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.555 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.555 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:33.555 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:33.555 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.555 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.555 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.555 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.555 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.556 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.556 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.556 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.556 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.556 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.556 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.556 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.556 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.556 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.556 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.556 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.556 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.556 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.556 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.557 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:33.557 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:33.557 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.557 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.557 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.557 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.557 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.557 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.557 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.557 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.557 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.557 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.557 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.557 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.558 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:33.558 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:33.558 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.558 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.558 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.558 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:33.558 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.558 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.558 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.558 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.558 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.558 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.558 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.558 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.559 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.559 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.559 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.559 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.559 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.559 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.559 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.559 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:33.559 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:33.559 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.559 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.559 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.559 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.559 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.560 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.560 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.560 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.560 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.560 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.560 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.560 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.560 INFO:teuthology.orchestra.run.smithi007.stdout: "orchestrator": { 2024-09-21T06:46:33.560 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "orchestrator", 2024-09-21T06:46:33.560 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.560 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.560 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.560 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.560 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.560 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.561 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.561 INFO:teuthology.orchestra.run.smithi007.stdout: "cephadm", 2024-09-21T06:46:33.561 INFO:teuthology.orchestra.run.smithi007.stdout: "rook", 2024-09-21T06:46:33.561 INFO:teuthology.orchestra.run.smithi007.stdout: "test_orchestrator" 2024-09-21T06:46:33.561 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.561 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Orchestrator backend", 2024-09-21T06:46:33.561 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.561 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.561 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.561 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.561 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:33.561 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:33.561 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.561 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:33.562 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.562 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.562 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.562 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.562 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.562 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.562 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.562 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.562 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.562 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.562 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.562 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.562 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:33.562 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "osd_perf_query", 2024-09-21T06:46:33.562 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:33.563 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:33.563 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:33.563 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:33.563 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:33.563 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.563 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.563 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.563 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.563 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.563 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.563 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.563 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.563 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.563 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.563 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.563 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.564 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.564 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.564 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.564 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.564 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.564 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.564 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.564 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:33.564 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:33.564 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.564 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.564 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.564 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.564 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.564 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.565 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.565 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.565 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.565 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.565 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.565 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.565 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:33.565 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:33.565 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.565 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.565 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.565 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:33.565 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.565 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.566 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.566 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.566 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.566 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.566 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.566 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.566 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.566 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.566 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.566 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.566 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.566 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.566 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.566 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:33.567 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:33.567 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.567 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.567 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.567 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.567 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.567 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.567 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.567 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.567 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.567 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.567 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.567 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.567 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:33.568 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:33.568 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.568 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:33.568 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.568 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.568 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.568 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.568 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.568 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.568 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.568 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.568 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.568 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.568 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.568 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.569 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:33.569 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "osd_support", 2024-09-21T06:46:33.569 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:33.569 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:33.569 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:33.569 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:33.569 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:33.569 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.569 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.569 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.569 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.569 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.569 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.570 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.570 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.570 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.570 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.570 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.570 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.570 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.570 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.570 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.570 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.570 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.570 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.570 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.571 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:33.571 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:33.571 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.571 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.571 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.571 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.571 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.571 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.571 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.571 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.571 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.571 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.572 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.572 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.572 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:33.572 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:33.572 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.572 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.572 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.572 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:33.572 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.572 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.572 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.572 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.572 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.572 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.573 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.573 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.573 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.573 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.573 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.573 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.573 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.573 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.573 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.573 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:33.573 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:33.573 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.573 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.573 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.574 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.574 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.574 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.574 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.574 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.574 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.574 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.574 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.574 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.574 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:33.574 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:33.574 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.574 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:33.574 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.575 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.575 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.575 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.575 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.575 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.575 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.575 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.575 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.575 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.575 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.575 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.575 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:33.575 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "pg_autoscaler", 2024-09-21T06:46:33.575 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:33.575 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:33.576 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:33.576 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:33.576 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:33.576 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.576 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.576 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.576 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.576 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.576 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.576 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.576 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.576 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.576 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.576 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.577 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.577 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.577 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.577 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.577 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.577 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.577 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.577 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.577 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:33.577 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:33.577 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.577 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.577 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.577 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.578 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.578 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.578 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.578 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.578 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.578 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.578 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.578 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.578 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:33.578 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:33.578 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.578 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.578 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.579 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:33.579 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.579 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.579 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.579 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.579 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.579 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.579 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.579 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.579 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.579 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.579 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.579 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.579 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.580 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.580 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.580 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:33.580 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:33.580 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.580 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.580 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.580 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.580 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.580 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.580 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.580 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.580 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.580 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.581 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.581 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.581 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-09-21T06:46:33.581 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-09-21T06:46:33.581 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:46:33.581 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.581 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.581 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-09-21T06:46:33.581 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.581 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.581 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.581 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.581 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.581 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.581 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.582 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.582 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:33.582 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:33.582 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.582 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:33.582 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.582 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.582 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.582 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.582 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.582 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.582 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.582 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.583 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.583 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.583 INFO:teuthology.orchestra.run.smithi007.stdout: "threshold": { 2024-09-21T06:46:33.583 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "threshold", 2024-09-21T06:46:33.583 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-21T06:46:33.583 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.583 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.583 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "3.0", 2024-09-21T06:46:33.583 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1.0", 2024-09-21T06:46:33.583 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.583 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.583 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "scaling threshold", 2024-09-21T06:46:33.583 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-21T06:46:33.584 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.584 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.584 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.584 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.584 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.584 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:33.584 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "progress", 2024-09-21T06:46:33.584 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:33.584 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:33.584 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:33.584 INFO:teuthology.orchestra.run.smithi007.stdout: "allow_pg_recovery_event": { 2024-09-21T06:46:33.584 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "allow_pg_recovery_event", 2024-09-21T06:46:33.584 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.584 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.585 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.585 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.585 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.585 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.585 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.585 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-21T06:46:33.585 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.585 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.585 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.585 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.585 INFO:teuthology.orchestra.run.smithi007.stdout: "enabled": { 2024-09-21T06:46:33.585 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "enabled", 2024-09-21T06:46:33.585 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.585 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.585 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.586 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:33.586 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.586 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.586 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.586 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.586 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.586 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.586 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.586 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.586 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:33.586 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:33.586 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.586 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.586 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.586 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.587 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.587 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.587 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.587 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.587 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.587 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.587 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.587 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.587 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.587 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.587 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.587 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.587 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.587 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.588 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.588 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:33.588 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:33.588 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.588 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.588 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.588 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.588 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.588 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.588 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.588 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.588 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.588 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.588 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.589 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.589 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:33.589 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:33.589 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.589 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.589 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.589 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:33.589 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.589 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.589 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.589 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.589 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.589 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.589 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.589 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.590 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.590 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.590 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.590 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.590 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.590 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.590 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.590 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:33.590 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:33.590 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.590 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.590 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.590 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.590 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.590 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.591 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.591 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.591 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.591 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.591 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.591 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.591 INFO:teuthology.orchestra.run.smithi007.stdout: "max_completed_events": { 2024-09-21T06:46:33.591 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_completed_events", 2024-09-21T06:46:33.591 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.591 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.591 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.591 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "50", 2024-09-21T06:46:33.591 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.591 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.591 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.592 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "number of past completed events to remember", 2024-09-21T06:46:33.592 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.592 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.592 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.592 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.592 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-09-21T06:46:33.592 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-09-21T06:46:33.592 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:46:33.592 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.592 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.592 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5", 2024-09-21T06:46:33.592 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.592 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.592 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.592 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how long the module is going to sleep", 2024-09-21T06:46:33.593 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.593 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.593 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.593 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.593 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:33.593 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:33.593 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.593 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:33.593 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.593 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.593 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.593 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.593 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.593 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.594 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.594 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.594 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.594 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.594 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.594 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.594 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:33.594 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "prometheus", 2024-09-21T06:46:33.594 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:33.594 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:33.594 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:33.594 INFO:teuthology.orchestra.run.smithi007.stdout: "cache": { 2024-09-21T06:46:33.594 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cache", 2024-09-21T06:46:33.594 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.594 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.595 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.595 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:33.595 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.595 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.595 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.595 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.595 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.595 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.595 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.595 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.595 INFO:teuthology.orchestra.run.smithi007.stdout: "exclude_perf_counters": { 2024-09-21T06:46:33.595 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "exclude_perf_counters", 2024-09-21T06:46:33.595 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.595 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.596 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.596 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:33.596 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.596 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.596 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.596 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-21T06:46:33.596 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-21T06:46:33.596 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.596 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.596 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.596 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:33.596 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:33.596 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.596 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.597 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.597 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.597 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.597 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.597 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.597 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.597 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.597 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.597 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.597 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.597 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.597 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.597 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.597 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.598 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.598 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.598 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.598 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:33.598 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:33.598 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.598 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.598 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.598 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.598 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.598 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.598 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.598 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.598 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.599 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.599 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.599 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.599 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:33.599 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:33.599 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.599 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.599 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.599 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:33.599 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.599 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.601 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.601 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.601 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.601 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.601 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.602 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.602 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.602 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.602 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.602 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.602 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.602 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.602 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.602 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:33.602 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:33.602 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.602 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.602 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.603 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.603 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.603 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.603 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.603 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.603 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.603 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.603 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.603 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.603 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_stats_pools": { 2024-09-21T06:46:33.603 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rbd_stats_pools", 2024-09-21T06:46:33.603 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.603 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.603 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.604 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.604 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.604 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.604 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.604 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.604 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.604 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.604 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.604 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.604 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-21T06:46:33.604 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-21T06:46:33.604 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.604 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.604 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.604 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "300", 2024-09-21T06:46:33.605 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.605 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.605 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.605 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.605 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.605 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.605 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.605 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.605 INFO:teuthology.orchestra.run.smithi007.stdout: "scrape_interval": { 2024-09-21T06:46:33.605 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "scrape_interval", 2024-09-21T06:46:33.605 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-21T06:46:33.605 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.605 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.605 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "15.0", 2024-09-21T06:46:33.606 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.606 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.606 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.606 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.606 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.606 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.606 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.606 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.606 INFO:teuthology.orchestra.run.smithi007.stdout: "server_addr": { 2024-09-21T06:46:33.606 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_addr", 2024-09-21T06:46:33.606 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.606 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.606 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.606 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "::", 2024-09-21T06:46:33.607 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.607 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.607 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.607 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-21T06:46:33.607 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.607 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.607 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.607 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.607 INFO:teuthology.orchestra.run.smithi007.stdout: "server_port": { 2024-09-21T06:46:33.607 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_port", 2024-09-21T06:46:33.607 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.607 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.607 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.608 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "9283", 2024-09-21T06:46:33.608 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.608 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.608 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.608 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-21T06:46:33.608 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.608 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.608 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.608 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.608 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:33.608 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:33.608 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.608 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:33.608 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.609 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.609 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.609 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.609 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.609 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.609 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.609 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.609 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.609 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.609 INFO:teuthology.orchestra.run.smithi007.stdout: "stale_cache_strategy": { 2024-09-21T06:46:33.609 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "stale_cache_strategy", 2024-09-21T06:46:33.609 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.609 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.609 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.609 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "log", 2024-09-21T06:46:33.610 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.610 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.610 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.610 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.610 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.610 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.610 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.610 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.610 INFO:teuthology.orchestra.run.smithi007.stdout: "standby_behaviour": { 2024-09-21T06:46:33.610 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "standby_behaviour", 2024-09-21T06:46:33.610 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.610 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.610 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.610 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "default", 2024-09-21T06:46:33.610 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.611 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.611 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.611 INFO:teuthology.orchestra.run.smithi007.stdout: "default", 2024-09-21T06:46:33.611 INFO:teuthology.orchestra.run.smithi007.stdout: "error" 2024-09-21T06:46:33.611 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.611 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.611 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.611 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.611 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.611 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.611 INFO:teuthology.orchestra.run.smithi007.stdout: "standby_error_status_code": { 2024-09-21T06:46:33.611 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "standby_error_status_code", 2024-09-21T06:46:33.611 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.611 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.611 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.612 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "500", 2024-09-21T06:46:33.612 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "400", 2024-09-21T06:46:33.612 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "599", 2024-09-21T06:46:33.612 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.612 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.612 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.612 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.612 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.612 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.612 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.612 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.612 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:33.612 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rbd_support", 2024-09-21T06:46:33.612 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:33.612 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:33.612 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:33.613 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:33.613 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:33.613 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.613 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.613 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.613 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.613 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.613 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.613 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.613 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.613 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.613 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.613 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.614 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.614 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.614 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.614 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.614 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.614 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.614 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.614 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.614 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:33.614 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:33.614 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.614 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.614 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.614 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.615 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.615 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.615 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.615 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.615 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.615 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.615 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.615 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.615 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:33.615 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:33.615 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.615 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.615 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.616 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:33.616 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.616 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.616 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.616 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.616 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.616 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.616 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.616 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.616 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.616 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.616 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.616 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.616 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.617 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.617 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.617 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:33.617 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:33.617 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.617 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.617 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.617 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.617 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.617 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.617 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.617 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.617 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.617 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.617 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.618 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.618 INFO:teuthology.orchestra.run.smithi007.stdout: "max_concurrent_snap_create": { 2024-09-21T06:46:33.618 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_concurrent_snap_create", 2024-09-21T06:46:33.618 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.618 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.618 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.618 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-21T06:46:33.618 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.618 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.618 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.618 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.618 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.618 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.619 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.619 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.619 INFO:teuthology.orchestra.run.smithi007.stdout: "mirror_snapshot_schedule": { 2024-09-21T06:46:33.619 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mirror_snapshot_schedule", 2024-09-21T06:46:33.619 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.619 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.619 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.619 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.619 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.619 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.619 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.619 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.619 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.619 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.619 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.620 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.620 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:33.620 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:33.620 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.620 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:33.620 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.620 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.620 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.620 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.620 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.620 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.620 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.620 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.621 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.621 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.621 INFO:teuthology.orchestra.run.smithi007.stdout: "trash_purge_schedule": { 2024-09-21T06:46:33.621 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "trash_purge_schedule", 2024-09-21T06:46:33.621 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.621 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.621 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.621 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.621 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.621 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.621 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.621 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.621 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.621 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.622 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.622 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.622 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.622 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.622 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:33.622 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "restful", 2024-09-21T06:46:33.622 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:33.622 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:33.622 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:33.622 INFO:teuthology.orchestra.run.smithi007.stdout: "enable_auth": { 2024-09-21T06:46:33.622 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "enable_auth", 2024-09-21T06:46:33.622 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.622 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.623 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.623 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:33.623 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.623 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.623 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.623 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.623 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.623 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.623 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.623 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.623 INFO:teuthology.orchestra.run.smithi007.stdout: "key_file": { 2024-09-21T06:46:33.623 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "key_file", 2024-09-21T06:46:33.623 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.624 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.624 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.624 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.624 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.624 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.624 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.624 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.624 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.624 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.624 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.624 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.624 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:33.624 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:33.624 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.625 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.625 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.625 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.625 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.625 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.625 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.625 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.625 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.625 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.625 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.625 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.625 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.625 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.625 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.626 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.626 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.626 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.626 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.626 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:33.626 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:33.626 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.626 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.626 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.626 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.626 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.626 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.626 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.627 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.627 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.627 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.627 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.627 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.627 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:33.627 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:33.627 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.627 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.627 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.627 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:33.627 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.627 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.627 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.628 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.628 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.628 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.628 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.628 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.628 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.628 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.628 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.628 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.628 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.628 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.628 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.628 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:33.629 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:33.629 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.629 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.629 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.629 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.629 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.629 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.629 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.629 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.629 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.629 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.629 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.629 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.630 INFO:teuthology.orchestra.run.smithi007.stdout: "max_requests": { 2024-09-21T06:46:33.630 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_requests", 2024-09-21T06:46:33.630 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.630 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.630 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.630 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "500", 2024-09-21T06:46:33.630 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.630 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.630 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.630 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-21T06:46:33.630 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.630 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.630 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.631 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.631 INFO:teuthology.orchestra.run.smithi007.stdout: "server_addr": { 2024-09-21T06:46:33.631 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_addr", 2024-09-21T06:46:33.631 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.631 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.631 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.631 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.631 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.631 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.631 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.631 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.631 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.631 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.631 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.632 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.632 INFO:teuthology.orchestra.run.smithi007.stdout: "server_port": { 2024-09-21T06:46:33.632 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_port", 2024-09-21T06:46:33.632 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.632 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.632 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.632 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.632 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.632 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.632 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.632 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.632 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.632 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.632 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.632 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.633 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:33.633 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:33.633 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.633 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:33.633 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.633 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.633 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.633 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.633 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.633 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.633 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.633 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.633 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.633 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.633 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.634 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.634 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:33.634 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rgw", 2024-09-21T06:46:33.634 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:33.634 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:33.634 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:33.634 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:33.634 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:33.634 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.634 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.634 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.634 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.634 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.634 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.635 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.635 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.635 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.635 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.635 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.635 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.635 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.635 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.635 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.635 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.635 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.635 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.635 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.635 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:33.635 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:33.636 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.636 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.636 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.636 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.636 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.636 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.636 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.636 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.636 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.636 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.636 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.636 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.636 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:33.636 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:33.637 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.637 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.637 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.637 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:33.637 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.637 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.637 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.637 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.637 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.637 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.637 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.637 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.637 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.637 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.638 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.638 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.638 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.638 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.638 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.638 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:33.638 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:33.638 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.638 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.638 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.638 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.638 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.638 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.638 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.638 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.639 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.639 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.639 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.639 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.639 INFO:teuthology.orchestra.run.smithi007.stdout: "secondary_zone_period_retry_limit": { 2024-09-21T06:46:33.639 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-21T06:46:33.639 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.639 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.639 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.639 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5", 2024-09-21T06:46:33.639 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.639 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.639 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.639 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-21T06:46:33.639 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.640 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.640 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.640 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.640 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:33.640 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:33.640 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.640 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:33.640 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.640 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.640 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.640 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.640 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.640 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.640 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.641 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.641 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.641 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.641 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.641 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.641 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:33.641 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rook", 2024-09-21T06:46:33.641 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:33.641 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:33.641 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:33.641 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:33.641 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:33.641 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.641 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.641 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.641 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.642 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.642 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.642 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.642 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.642 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.642 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.642 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.642 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.642 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.642 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.642 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.642 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.642 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.642 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.642 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.643 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:33.643 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:33.643 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.643 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.643 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.643 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.643 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.643 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.643 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.643 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.643 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.643 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.643 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.643 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.643 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:33.644 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:33.644 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.644 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.644 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.644 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:33.644 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.644 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.644 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.644 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.644 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.644 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.644 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.644 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.644 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.644 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.645 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.645 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.645 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.645 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.645 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.645 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:33.645 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:33.645 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.645 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.645 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.645 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.645 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.645 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.645 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.646 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.646 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.646 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.646 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.646 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.646 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:33.646 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:33.646 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.646 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:33.646 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.646 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.646 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.646 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.646 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.647 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.647 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.647 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.647 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.647 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.647 INFO:teuthology.orchestra.run.smithi007.stdout: "storage_class": { 2024-09-21T06:46:33.647 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "storage_class", 2024-09-21T06:46:33.647 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.647 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.647 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.647 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "local", 2024-09-21T06:46:33.647 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.647 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.647 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.647 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-21T06:46:33.648 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.648 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.648 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.648 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.648 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.648 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.648 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:33.648 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "selftest", 2024-09-21T06:46:33.648 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:33.648 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:33.648 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:33.648 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:33.648 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:33.649 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.649 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.649 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.649 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.649 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.649 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.649 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.649 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.649 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.649 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.649 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.649 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.649 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.649 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.650 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.650 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.650 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.650 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.650 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.650 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:33.650 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:33.650 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.650 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.650 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.650 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.650 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.650 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.650 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.651 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.651 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.651 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.651 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.651 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.651 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:33.651 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:33.651 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.651 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.651 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.651 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:33.651 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.651 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.651 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.652 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.652 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.652 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.652 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.652 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.652 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.652 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.652 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.652 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.652 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.652 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.652 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.652 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:33.652 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:33.652 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.653 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.653 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.653 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.653 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.653 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.653 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.653 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.653 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.653 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.653 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.653 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.653 INFO:teuthology.orchestra.run.smithi007.stdout: "roption1": { 2024-09-21T06:46:33.653 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "roption1", 2024-09-21T06:46:33.653 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.654 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.654 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.654 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.654 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.654 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.654 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.654 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.654 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.654 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.654 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.654 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.654 INFO:teuthology.orchestra.run.smithi007.stdout: "roption2": { 2024-09-21T06:46:33.654 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "roption2", 2024-09-21T06:46:33.654 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.654 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.655 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.655 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "xyz", 2024-09-21T06:46:33.655 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.655 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.655 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.655 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.655 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.655 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.655 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.655 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.655 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption1": { 2024-09-21T06:46:33.655 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption1", 2024-09-21T06:46:33.655 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.655 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.656 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.656 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.656 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.656 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.656 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.656 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.656 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.656 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.656 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.656 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.656 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption2": { 2024-09-21T06:46:33.656 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption2", 2024-09-21T06:46:33.656 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.656 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.656 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.657 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.657 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.657 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.657 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.657 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.657 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.657 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.657 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.657 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.657 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption3": { 2024-09-21T06:46:33.657 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption3", 2024-09-21T06:46:33.657 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-21T06:46:33.657 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.657 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.657 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.658 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.658 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.658 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.658 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.658 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.658 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.658 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.658 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.658 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption4": { 2024-09-21T06:46:33.658 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption4", 2024-09-21T06:46:33.658 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.658 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.658 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.658 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.658 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.659 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.659 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.659 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.659 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.659 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.659 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.659 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.659 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption5": { 2024-09-21T06:46:33.659 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption5", 2024-09-21T06:46:33.659 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.659 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.659 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.659 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.659 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.659 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.660 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.660 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.660 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.660 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.660 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.660 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.660 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption6": { 2024-09-21T06:46:33.660 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption6", 2024-09-21T06:46:33.660 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.660 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.660 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.660 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:33.660 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.660 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.660 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.661 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.661 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.661 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.661 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.661 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.661 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption7": { 2024-09-21T06:46:33.661 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption7", 2024-09-21T06:46:33.661 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.661 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.661 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.661 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.661 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1", 2024-09-21T06:46:33.661 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "42", 2024-09-21T06:46:33.662 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.662 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.662 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.662 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.662 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.662 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.662 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:33.662 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:33.662 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.662 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:33.662 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.662 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.662 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.662 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.662 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.663 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.663 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.663 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.663 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.663 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.663 INFO:teuthology.orchestra.run.smithi007.stdout: "testkey": { 2024-09-21T06:46:33.663 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "testkey", 2024-09-21T06:46:33.663 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.663 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.663 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.663 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.663 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.663 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.663 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.663 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.664 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.664 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.664 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.664 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.664 INFO:teuthology.orchestra.run.smithi007.stdout: "testlkey": { 2024-09-21T06:46:33.664 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "testlkey", 2024-09-21T06:46:33.664 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.664 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.664 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.664 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.664 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.664 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.664 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.664 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.664 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.665 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.665 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.665 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.665 INFO:teuthology.orchestra.run.smithi007.stdout: "testnewline": { 2024-09-21T06:46:33.665 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "testnewline", 2024-09-21T06:46:33.665 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.665 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.665 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.665 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.665 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.665 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.665 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.665 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.665 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.666 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.666 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.666 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.666 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.666 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.666 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:33.666 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smb", 2024-09-21T06:46:33.666 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:33.666 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:33.666 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:33.666 INFO:teuthology.orchestra.run.smithi007.stdout: "internal_store_backend": { 2024-09-21T06:46:33.666 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "internal_store_backend", 2024-09-21T06:46:33.666 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.666 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:33.667 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.667 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.667 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.667 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.667 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.667 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-21T06:46:33.667 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.667 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.667 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.667 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.667 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:33.667 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:33.667 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.667 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.668 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.668 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.668 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.668 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.668 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.668 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.668 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.668 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.668 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.668 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.668 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.668 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.668 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.669 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.669 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.669 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.669 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.669 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:33.669 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:33.669 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.669 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.669 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.669 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.669 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.669 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.669 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.669 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.669 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.670 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.670 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.670 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.670 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:33.670 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:33.670 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.670 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.670 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.670 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:33.670 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.670 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.670 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.670 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.670 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.670 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.671 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.671 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.671 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.671 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.671 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.671 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.671 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.671 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.671 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.671 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:33.671 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:33.671 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.671 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.671 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.672 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.672 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.672 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.672 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.672 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.672 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.672 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.672 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.672 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.672 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:33.672 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:33.672 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.672 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:33.672 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.672 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.673 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.673 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.673 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.673 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.673 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.673 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.673 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.673 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.673 INFO:teuthology.orchestra.run.smithi007.stdout: "update_orchestration": { 2024-09-21T06:46:33.673 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "update_orchestration", 2024-09-21T06:46:33.673 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.673 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.673 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.673 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:33.673 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.673 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.674 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.674 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-21T06:46:33.674 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.674 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.674 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.674 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.674 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.674 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.674 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:33.674 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "snap_schedule", 2024-09-21T06:46:33.674 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:33.674 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:33.674 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:33.675 INFO:teuthology.orchestra.run.smithi007.stdout: "allow_m_granularity": { 2024-09-21T06:46:33.675 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "allow_m_granularity", 2024-09-21T06:46:33.675 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.675 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.675 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.675 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.675 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.675 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.675 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.675 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "allow minute scheduled snapshots", 2024-09-21T06:46:33.675 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.675 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.675 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.675 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.676 INFO:teuthology.orchestra.run.smithi007.stdout: "dump_on_update": { 2024-09-21T06:46:33.676 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "dump_on_update", 2024-09-21T06:46:33.676 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.676 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.676 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.676 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.676 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.676 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.676 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.676 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "dump database to debug log on update", 2024-09-21T06:46:33.676 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.676 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.676 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.676 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.676 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:33.677 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:33.677 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.677 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.677 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.677 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.677 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.677 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.677 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.677 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.677 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.677 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.677 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.677 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.677 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.678 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.678 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.678 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.678 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.678 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.678 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.678 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:33.678 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:33.678 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.678 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.678 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.678 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.678 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.678 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.679 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.679 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.679 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.679 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.679 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.679 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.679 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:33.679 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:33.679 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.679 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.679 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.679 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:33.679 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.679 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.680 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.680 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.680 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.680 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.680 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.680 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.680 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.680 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.680 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.680 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.680 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.680 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.680 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.680 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:33.680 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:33.681 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.681 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.681 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.681 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.681 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.681 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.681 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.681 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.681 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.681 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.681 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.681 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.681 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:33.681 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:33.682 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.682 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:33.682 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.682 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.682 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.682 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.682 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.682 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.682 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.682 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.682 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.682 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.682 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.682 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.682 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:33.683 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "stats", 2024-09-21T06:46:33.683 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:33.683 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:33.683 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:33.683 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:33.683 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:33.683 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.683 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.683 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.683 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.683 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.683 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.683 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.683 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.684 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.684 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.684 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.684 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.684 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.684 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.684 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.684 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.684 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.684 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.684 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.684 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:33.684 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:33.684 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.684 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.684 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.685 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.685 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.685 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.685 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.685 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.685 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.685 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.685 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.685 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.685 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:33.685 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:33.685 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.685 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.685 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.686 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:33.686 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.686 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.686 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.686 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.686 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.686 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.686 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.686 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.686 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.686 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.686 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.686 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.686 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.686 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.687 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.687 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:33.687 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:33.687 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.687 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.687 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.687 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.687 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.687 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.687 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.687 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.687 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.687 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.687 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.688 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.688 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:33.688 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:33.688 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.688 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:33.688 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.688 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.688 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.688 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.688 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.688 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.688 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.688 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.688 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.689 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.689 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.689 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.689 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:33.689 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "status", 2024-09-21T06:46:33.689 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:33.689 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:33.689 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:33.689 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:33.689 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:33.689 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.689 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.689 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.689 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.689 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.690 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.690 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.690 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.690 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.690 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.690 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.690 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.690 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.690 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.690 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.690 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.690 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.690 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.690 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.690 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:33.691 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:33.691 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.691 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.691 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.691 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.691 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.691 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.691 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.691 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.691 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.691 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.691 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.691 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.691 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:33.691 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:33.692 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.692 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.692 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.692 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:33.692 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.692 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.692 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.692 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.692 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.692 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.692 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.692 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.692 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.693 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.693 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.693 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.693 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.693 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.693 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.693 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:33.693 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:33.693 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.693 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.693 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.693 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.693 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.693 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.694 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.694 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.694 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.694 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.694 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.694 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.694 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:33.694 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:33.694 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.694 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:33.694 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.694 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.694 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.694 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.694 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.695 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.695 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.695 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.695 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.695 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.695 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.695 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.695 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:33.695 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "telegraf", 2024-09-21T06:46:33.695 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:33.695 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:33.695 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:33.695 INFO:teuthology.orchestra.run.smithi007.stdout: "address": { 2024-09-21T06:46:33.695 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "address", 2024-09-21T06:46:33.695 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.696 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.696 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.696 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-21T06:46:33.696 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.696 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.696 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.696 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.696 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.696 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.696 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.696 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.696 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-09-21T06:46:33.696 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-09-21T06:46:33.696 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:46:33.696 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.697 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.697 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "15", 2024-09-21T06:46:33.697 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.697 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.697 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.697 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.697 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.697 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.697 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.697 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.697 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:33.697 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:33.697 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.697 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.697 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.698 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.698 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.698 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.698 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.698 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.698 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.698 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.698 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.698 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.698 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.698 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.698 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.698 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.698 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.699 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.699 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.699 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:33.699 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:33.699 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.699 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.699 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.699 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.699 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.699 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.699 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.699 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.699 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.699 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.699 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.700 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.700 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:33.700 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:33.700 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.700 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.700 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.700 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:33.700 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.700 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.700 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.700 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.700 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.700 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.700 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.700 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.701 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.701 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.701 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.701 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.701 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.701 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.701 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.701 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:33.701 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:33.701 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.701 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.701 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.701 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.701 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.701 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.702 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.702 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.702 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.702 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.702 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.702 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.702 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:33.702 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:33.702 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.702 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:33.702 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.702 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.702 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.702 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.703 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.703 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.703 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.703 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.703 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.703 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.703 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.703 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.703 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:33.703 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "telemetry", 2024-09-21T06:46:33.703 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:33.703 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:33.703 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:33.703 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_basic": { 2024-09-21T06:46:33.704 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_basic", 2024-09-21T06:46:33.704 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.704 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.704 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.704 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:33.704 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.704 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.704 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.704 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-21T06:46:33.704 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.704 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.704 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.704 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.704 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_crash": { 2024-09-21T06:46:33.704 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_crash", 2024-09-21T06:46:33.705 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.705 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.705 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.705 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:33.705 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.705 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.705 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.705 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-21T06:46:33.705 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.705 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.705 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.705 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.705 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_device": { 2024-09-21T06:46:33.705 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_device", 2024-09-21T06:46:33.706 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.706 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.706 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.706 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:33.706 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.706 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.706 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.706 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-21T06:46:33.706 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.706 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.706 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.706 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.706 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_ident": { 2024-09-21T06:46:33.706 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_ident", 2024-09-21T06:46:33.706 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.707 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.707 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.707 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.707 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.707 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.707 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.707 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-21T06:46:33.707 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.707 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.707 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.707 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.707 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_perf": { 2024-09-21T06:46:33.707 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_perf", 2024-09-21T06:46:33.707 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.708 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.708 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.708 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.708 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.708 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.708 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.708 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-21T06:46:33.708 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.708 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.708 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.708 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.708 INFO:teuthology.orchestra.run.smithi007.stdout: "contact": { 2024-09-21T06:46:33.708 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "contact", 2024-09-21T06:46:33.708 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.709 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.709 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.709 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.709 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.709 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.709 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.709 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.709 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.709 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.709 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.709 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.709 INFO:teuthology.orchestra.run.smithi007.stdout: "description": { 2024-09-21T06:46:33.709 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "description", 2024-09-21T06:46:33.709 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.709 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.710 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.710 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.710 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.710 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.710 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.710 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.710 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.710 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.710 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.710 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.710 INFO:teuthology.orchestra.run.smithi007.stdout: "device_url": { 2024-09-21T06:46:33.710 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "device_url", 2024-09-21T06:46:33.710 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.710 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.711 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.711 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-21T06:46:33.711 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.711 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.711 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.711 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.711 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.711 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.711 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.711 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.711 INFO:teuthology.orchestra.run.smithi007.stdout: "enabled": { 2024-09-21T06:46:33.711 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "enabled", 2024-09-21T06:46:33.711 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.712 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.712 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.712 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.712 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.712 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.712 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.712 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.712 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.712 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.712 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.712 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.712 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-09-21T06:46:33.712 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-09-21T06:46:33.712 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.712 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.712 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.713 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "24", 2024-09-21T06:46:33.713 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "8", 2024-09-21T06:46:33.713 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.713 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.713 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.713 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.713 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.713 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.713 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.713 INFO:teuthology.orchestra.run.smithi007.stdout: "last_opt_revision": { 2024-09-21T06:46:33.713 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "last_opt_revision", 2024-09-21T06:46:33.713 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.713 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.713 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.714 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "1", 2024-09-21T06:46:33.714 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.714 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.714 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.714 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.714 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.714 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.714 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.714 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.714 INFO:teuthology.orchestra.run.smithi007.stdout: "leaderboard": { 2024-09-21T06:46:33.714 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "leaderboard", 2024-09-21T06:46:33.714 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.714 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.714 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.715 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.715 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.715 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.715 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.715 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.715 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.715 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.715 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.715 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.715 INFO:teuthology.orchestra.run.smithi007.stdout: "leaderboard_description": { 2024-09-21T06:46:33.715 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "leaderboard_description", 2024-09-21T06:46:33.715 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.715 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.716 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.716 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.716 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.716 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.716 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.716 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.716 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.716 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.716 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.716 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.716 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:33.716 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:33.716 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.716 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.716 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.717 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.717 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.717 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.717 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.717 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.717 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.717 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.717 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.717 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.717 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.717 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.717 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.717 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.717 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.717 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.718 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.718 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:33.718 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:33.718 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.718 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.718 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.718 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.718 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.718 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.718 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.718 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.718 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.718 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.719 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.719 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.719 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:33.719 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:33.719 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.719 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.719 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.719 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:33.719 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.719 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.719 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.719 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.719 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.719 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.719 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.719 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.720 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.720 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.720 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.720 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.720 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.720 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.720 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.720 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:33.720 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:33.720 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.720 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.720 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.720 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.720 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.720 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.720 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.721 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.721 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.721 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.721 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.721 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.721 INFO:teuthology.orchestra.run.smithi007.stdout: "organization": { 2024-09-21T06:46:33.721 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "organization", 2024-09-21T06:46:33.721 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.721 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.721 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.721 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.721 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.721 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.721 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.721 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.721 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.722 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.722 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.722 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.722 INFO:teuthology.orchestra.run.smithi007.stdout: "proxy": { 2024-09-21T06:46:33.722 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "proxy", 2024-09-21T06:46:33.722 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.722 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.722 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.722 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.722 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.722 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.722 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.722 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.722 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.722 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.723 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.723 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.723 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:33.723 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:33.723 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.723 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:33.723 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.723 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.723 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.723 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.723 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.723 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.723 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.723 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.724 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.724 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.724 INFO:teuthology.orchestra.run.smithi007.stdout: "url": { 2024-09-21T06:46:33.724 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "url", 2024-09-21T06:46:33.724 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.724 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.724 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.724 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-21T06:46:33.724 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.724 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.724 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.724 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.724 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.724 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.724 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.724 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.725 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.725 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.725 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:33.725 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "test_orchestrator", 2024-09-21T06:46:33.725 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:33.725 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:33.725 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:33.725 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:33.725 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:33.725 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.725 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.725 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.725 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.725 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.725 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.725 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.726 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.726 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.726 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.726 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.726 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.726 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.726 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.726 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.726 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.726 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.726 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.726 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.726 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:33.726 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:33.727 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.727 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.727 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.727 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.727 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.727 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.727 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.727 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.727 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.727 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.727 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.727 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.727 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:33.727 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:33.727 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.728 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.728 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.728 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:33.728 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.728 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.728 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.728 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.728 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.728 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.728 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.728 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.728 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.728 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.728 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.728 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.729 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.729 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.729 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.729 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:33.729 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:33.729 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.729 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.729 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.729 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.729 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.729 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.729 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.729 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.729 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.729 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.730 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.730 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.730 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:33.730 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:33.730 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.730 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:33.730 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.730 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.730 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.730 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.730 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.730 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.730 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.730 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.731 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.731 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.731 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.731 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.731 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:33.731 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "volumes", 2024-09-21T06:46:33.731 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:33.731 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:33.731 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:33.731 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:33.731 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:33.731 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.731 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.731 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.731 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.731 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.732 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.732 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.732 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.732 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.732 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.732 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.732 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.732 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.732 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.732 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.732 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.732 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.732 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.732 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.732 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:33.733 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:33.733 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.733 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.733 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.733 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.733 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.733 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.733 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.733 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.733 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.733 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.733 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.733 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.733 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:33.733 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:33.733 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.734 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.734 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.734 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:33.734 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.734 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.734 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.734 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.734 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.734 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.734 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.734 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.734 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.734 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.734 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.734 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.734 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.735 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.735 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.735 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:33.735 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:33.735 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.735 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.735 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.735 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.735 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.735 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.735 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.735 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.735 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.735 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.736 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.736 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.736 INFO:teuthology.orchestra.run.smithi007.stdout: "max_concurrent_clones": { 2024-09-21T06:46:33.736 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_concurrent_clones", 2024-09-21T06:46:33.736 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.736 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.736 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.736 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "4", 2024-09-21T06:46:33.736 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.736 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.736 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.736 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-21T06:46:33.736 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.736 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.736 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.737 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.737 INFO:teuthology.orchestra.run.smithi007.stdout: "periodic_async_work": { 2024-09-21T06:46:33.737 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "periodic_async_work", 2024-09-21T06:46:33.737 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.737 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.737 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.737 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.737 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.737 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.737 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.737 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Periodically check for async work", 2024-09-21T06:46:33.737 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.737 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.738 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.738 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.738 INFO:teuthology.orchestra.run.smithi007.stdout: "snapshot_clone_delay": { 2024-09-21T06:46:33.738 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "snapshot_clone_delay", 2024-09-21T06:46:33.738 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.738 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.738 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.738 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.738 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.738 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.738 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.738 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-21T06:46:33.738 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.738 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.738 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.739 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.739 INFO:teuthology.orchestra.run.smithi007.stdout: "snapshot_clone_no_wait": { 2024-09-21T06:46:33.739 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "snapshot_clone_no_wait", 2024-09-21T06:46:33.739 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.739 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.739 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.739 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:33.739 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.739 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.739 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.739 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-21T06:46:33.739 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.739 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.740 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.740 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.740 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:33.740 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:33.740 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.740 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:33.740 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.740 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.740 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.740 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.740 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.740 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.740 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.740 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.741 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.741 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.741 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.741 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.741 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:33.741 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "zabbix", 2024-09-21T06:46:33.741 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:33.741 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:33.741 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:33.741 INFO:teuthology.orchestra.run.smithi007.stdout: "discovery_interval": { 2024-09-21T06:46:33.741 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "discovery_interval", 2024-09-21T06:46:33.741 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-09-21T06:46:33.741 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.741 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.742 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "100", 2024-09-21T06:46:33.742 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.742 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.742 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.742 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.742 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.742 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.742 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.742 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.742 INFO:teuthology.orchestra.run.smithi007.stdout: "identifier": { 2024-09-21T06:46:33.742 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "identifier", 2024-09-21T06:46:33.742 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.742 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.742 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.743 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.743 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.743 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.743 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.743 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.743 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.743 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.743 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.743 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.743 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-09-21T06:46:33.743 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-09-21T06:46:33.743 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:46:33.743 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.743 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.743 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-09-21T06:46:33.744 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.744 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.744 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.744 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.744 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.744 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.744 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.744 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.744 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:33.744 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:33.744 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.744 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.744 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.744 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.745 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.745 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.745 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.745 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.745 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.745 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.745 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.745 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.745 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.745 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.745 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.745 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.745 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.745 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.746 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.746 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:33.746 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:33.746 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.746 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.746 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.746 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.746 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.746 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.746 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.746 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.746 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.746 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.746 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.746 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.747 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:33.747 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:33.747 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.747 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.747 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.747 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:33.747 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.747 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.747 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.747 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.747 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.747 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.747 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.748 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.748 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.748 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.748 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.748 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.748 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.748 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.748 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.748 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:33.748 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:33.748 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.748 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.748 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.748 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.748 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.749 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.749 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.749 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.749 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.749 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.749 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.749 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.749 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:33.749 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:33.749 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.749 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:33.749 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.749 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.749 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.750 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.750 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.750 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.750 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.750 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.750 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.750 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.750 INFO:teuthology.orchestra.run.smithi007.stdout: "zabbix_host": { 2024-09-21T06:46:33.750 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "zabbix_host", 2024-09-21T06:46:33.750 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.750 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.750 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.750 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.750 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.751 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.751 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.751 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.751 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.751 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.751 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.751 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.751 INFO:teuthology.orchestra.run.smithi007.stdout: "zabbix_port": { 2024-09-21T06:46:33.751 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "zabbix_port", 2024-09-21T06:46:33.751 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.751 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.751 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.751 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10051", 2024-09-21T06:46:33.751 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.752 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.752 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.752 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.752 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.752 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.752 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.752 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.752 INFO:teuthology.orchestra.run.smithi007.stdout: "zabbix_sender": { 2024-09-21T06:46:33.752 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "zabbix_sender", 2024-09-21T06:46:33.752 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.752 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.752 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.752 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-21T06:46:33.752 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.753 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.753 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.753 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.753 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.753 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.753 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.753 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.753 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.753 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.753 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T06:46:33.753 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.753 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.753 INFO:teuthology.orchestra.run.smithi007.stdout: "modules": [ 2024-09-21T06:46:33.753 INFO:teuthology.orchestra.run.smithi007.stdout: "cephadm", 2024-09-21T06:46:33.754 INFO:teuthology.orchestra.run.smithi007.stdout: "dashboard", 2024-09-21T06:46:33.754 INFO:teuthology.orchestra.run.smithi007.stdout: "iostat", 2024-09-21T06:46:33.754 INFO:teuthology.orchestra.run.smithi007.stdout: "nfs", 2024-09-21T06:46:33.754 INFO:teuthology.orchestra.run.smithi007.stdout: "restful", 2024-09-21T06:46:33.754 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_schedule" 2024-09-21T06:46:33.754 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.754 INFO:teuthology.orchestra.run.smithi007.stdout: "available_modules": [ 2024-09-21T06:46:33.754 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:33.754 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "alerts", 2024-09-21T06:46:33.754 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:33.754 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:33.754 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:33.754 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-09-21T06:46:33.754 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-09-21T06:46:33.754 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:46:33.755 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.755 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.755 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-09-21T06:46:33.755 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.755 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.755 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.755 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "How frequently to reexamine health status", 2024-09-21T06:46:33.755 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.755 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.755 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.755 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.755 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:33.755 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:33.756 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.756 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.756 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.756 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.756 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.756 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.756 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.756 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.756 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.756 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.756 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.756 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.756 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.757 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.757 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.757 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.757 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.757 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.757 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.757 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:33.757 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:33.757 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.757 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.757 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.757 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.757 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.757 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.757 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.758 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.758 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.758 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.758 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.758 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.758 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:33.758 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:33.758 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.758 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.758 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.758 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:33.758 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.758 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.758 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.758 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.759 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.759 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.759 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.759 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.759 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.759 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.759 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.759 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.759 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.759 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.759 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.759 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:33.759 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:33.760 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.760 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.760 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.760 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.760 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.760 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.760 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.760 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.760 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.760 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.760 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.760 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.760 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_destination": { 2024-09-21T06:46:33.760 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_destination", 2024-09-21T06:46:33.760 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.761 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.761 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.761 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.761 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.761 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.761 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.761 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-21T06:46:33.761 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.761 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.761 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.761 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.761 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_from_name": { 2024-09-21T06:46:33.761 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_from_name", 2024-09-21T06:46:33.761 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.761 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.762 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.762 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "Ceph", 2024-09-21T06:46:33.762 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.762 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.762 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.762 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Email From: name", 2024-09-21T06:46:33.762 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.762 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.762 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.762 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.762 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_host": { 2024-09-21T06:46:33.762 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_host", 2024-09-21T06:46:33.762 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.762 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.763 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.763 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.763 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.763 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.763 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.763 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "SMTP server", 2024-09-21T06:46:33.763 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.763 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.763 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.763 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.763 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_password": { 2024-09-21T06:46:33.763 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_password", 2024-09-21T06:46:33.763 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.763 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.764 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.764 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.764 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.764 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.764 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.764 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Password to authenticate with", 2024-09-21T06:46:33.764 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.764 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.764 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.764 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.764 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_port": { 2024-09-21T06:46:33.764 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_port", 2024-09-21T06:46:33.764 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.764 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.764 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.765 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "465", 2024-09-21T06:46:33.765 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.765 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.765 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.765 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "SMTP port", 2024-09-21T06:46:33.765 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.765 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.765 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.765 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.765 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_sender": { 2024-09-21T06:46:33.765 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_sender", 2024-09-21T06:46:33.765 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.765 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.765 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.765 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.766 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.766 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.766 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.766 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "SMTP envelope sender", 2024-09-21T06:46:33.766 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.766 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.766 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.766 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.766 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_ssl": { 2024-09-21T06:46:33.766 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_ssl", 2024-09-21T06:46:33.766 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.766 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.766 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.767 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:33.767 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.767 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.767 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.767 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-21T06:46:33.767 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.767 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.767 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.767 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.767 INFO:teuthology.orchestra.run.smithi007.stdout: "smtp_user": { 2024-09-21T06:46:33.767 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smtp_user", 2024-09-21T06:46:33.767 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.767 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.768 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.768 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.768 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.768 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.768 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.768 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "User to authenticate as", 2024-09-21T06:46:33.768 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.768 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.768 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.768 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.768 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:33.768 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:33.768 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.768 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:33.768 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.769 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.769 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.769 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.769 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.769 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.769 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.769 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.769 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.769 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.769 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.769 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.769 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:33.769 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "balancer", 2024-09-21T06:46:33.769 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:33.770 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:33.770 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:33.770 INFO:teuthology.orchestra.run.smithi007.stdout: "active": { 2024-09-21T06:46:33.770 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "active", 2024-09-21T06:46:33.770 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.770 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.770 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.770 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:33.770 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.770 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.770 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.770 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "automatically balance PGs across cluster", 2024-09-21T06:46:33.770 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.771 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.771 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.771 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.771 INFO:teuthology.orchestra.run.smithi007.stdout: "begin_time": { 2024-09-21T06:46:33.771 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "begin_time", 2024-09-21T06:46:33.771 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.771 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.771 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.771 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0000", 2024-09-21T06:46:33.771 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.771 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.771 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.771 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "beginning time of day to automatically balance", 2024-09-21T06:46:33.771 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T06:46:33.772 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.772 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.772 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.772 INFO:teuthology.orchestra.run.smithi007.stdout: "begin_weekday": { 2024-09-21T06:46:33.772 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "begin_weekday", 2024-09-21T06:46:33.772 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-09-21T06:46:33.772 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.772 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.772 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.772 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "0", 2024-09-21T06:46:33.772 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "6", 2024-09-21T06:46:33.772 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.772 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-21T06:46:33.772 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T06:46:33.773 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.773 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.773 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.773 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_compat_max_iterations": { 2024-09-21T06:46:33.773 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crush_compat_max_iterations", 2024-09-21T06:46:33.773 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-09-21T06:46:33.773 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.773 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.773 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "25", 2024-09-21T06:46:33.773 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1", 2024-09-21T06:46:33.773 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "250", 2024-09-21T06:46:33.773 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.773 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-21T06:46:33.773 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.774 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.774 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.774 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.774 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_compat_metrics": { 2024-09-21T06:46:33.774 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crush_compat_metrics", 2024-09-21T06:46:33.774 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.774 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.774 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.774 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "pgs,objects,bytes", 2024-09-21T06:46:33.774 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.774 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.774 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.774 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-21T06:46:33.775 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-21T06:46:33.775 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.775 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.775 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.775 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_compat_step": { 2024-09-21T06:46:33.775 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crush_compat_step", 2024-09-21T06:46:33.775 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-21T06:46:33.775 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.775 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.775 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0.5", 2024-09-21T06:46:33.775 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "0.001", 2024-09-21T06:46:33.775 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "0.999", 2024-09-21T06:46:33.775 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.776 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "aggressiveness of optimization", 2024-09-21T06:46:33.776 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-21T06:46:33.776 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.776 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.776 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.776 INFO:teuthology.orchestra.run.smithi007.stdout: "end_time": { 2024-09-21T06:46:33.776 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "end_time", 2024-09-21T06:46:33.776 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.776 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.776 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.776 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "2359", 2024-09-21T06:46:33.776 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.776 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.776 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.776 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "ending time of day to automatically balance", 2024-09-21T06:46:33.777 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T06:46:33.777 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.777 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.777 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.777 INFO:teuthology.orchestra.run.smithi007.stdout: "end_weekday": { 2024-09-21T06:46:33.777 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "end_weekday", 2024-09-21T06:46:33.777 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-09-21T06:46:33.777 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.777 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.777 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.777 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "0", 2024-09-21T06:46:33.777 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "6", 2024-09-21T06:46:33.777 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.777 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-21T06:46:33.778 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T06:46:33.778 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.778 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.778 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.778 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:33.778 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:33.778 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.778 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.778 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.778 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.778 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.778 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.778 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.778 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.779 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.779 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.779 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.779 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.779 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.779 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.779 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.779 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.779 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.779 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.779 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.779 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:33.779 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:33.779 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.780 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.780 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.780 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.780 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.780 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.780 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.780 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.780 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.780 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.780 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.780 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.780 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:33.780 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:33.780 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.781 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.781 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.781 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:33.781 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.781 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.781 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.781 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.781 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.781 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.781 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.781 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.781 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.781 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.781 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.781 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.782 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.782 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.782 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.782 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:33.782 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:33.782 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.782 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.782 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.782 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.782 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.782 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.782 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.782 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.782 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.782 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.783 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.783 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.783 INFO:teuthology.orchestra.run.smithi007.stdout: "min_score": { 2024-09-21T06:46:33.783 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "min_score", 2024-09-21T06:46:33.783 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-21T06:46:33.783 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.783 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.783 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.783 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.783 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.783 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.783 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-21T06:46:33.783 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.783 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.784 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.784 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.784 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": { 2024-09-21T06:46:33.784 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mode", 2024-09-21T06:46:33.784 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.784 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.784 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.784 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "upmap", 2024-09-21T06:46:33.784 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.784 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.784 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.784 INFO:teuthology.orchestra.run.smithi007.stdout: "crush-compat", 2024-09-21T06:46:33.784 INFO:teuthology.orchestra.run.smithi007.stdout: "none", 2024-09-21T06:46:33.784 INFO:teuthology.orchestra.run.smithi007.stdout: "read", 2024-09-21T06:46:33.784 INFO:teuthology.orchestra.run.smithi007.stdout: "upmap", 2024-09-21T06:46:33.785 INFO:teuthology.orchestra.run.smithi007.stdout: "upmap-read" 2024-09-21T06:46:33.785 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.785 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Balancer mode", 2024-09-21T06:46:33.785 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.785 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.785 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.785 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.785 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_ids": { 2024-09-21T06:46:33.785 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "pool_ids", 2024-09-21T06:46:33.785 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.785 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.785 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.785 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.785 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.786 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.786 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.786 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-21T06:46:33.786 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.786 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.786 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.786 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.786 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-09-21T06:46:33.786 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-09-21T06:46:33.786 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:46:33.786 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.786 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.786 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-09-21T06:46:33.786 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.786 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.787 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.787 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-21T06:46:33.787 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.787 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.787 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.787 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.787 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:33.787 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:33.787 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.787 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:33.787 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.787 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.787 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.787 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.787 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.788 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.788 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.788 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.788 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.788 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.788 INFO:teuthology.orchestra.run.smithi007.stdout: "upmap_max_deviation": { 2024-09-21T06:46:33.788 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "upmap_max_deviation", 2024-09-21T06:46:33.788 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.788 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.788 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.788 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5", 2024-09-21T06:46:33.788 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1", 2024-09-21T06:46:33.788 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.789 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.789 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-21T06:46:33.789 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-21T06:46:33.789 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.789 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.789 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.789 INFO:teuthology.orchestra.run.smithi007.stdout: "upmap_max_optimizations": { 2024-09-21T06:46:33.789 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "upmap_max_optimizations", 2024-09-21T06:46:33.789 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-09-21T06:46:33.789 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.789 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.789 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-21T06:46:33.789 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.789 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.790 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.790 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-21T06:46:33.790 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.790 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.790 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.790 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.790 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.790 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.790 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:33.790 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cephadm", 2024-09-21T06:46:33.790 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:33.790 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:33.790 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:33.791 INFO:teuthology.orchestra.run.smithi007.stdout: "agent_down_multiplier": { 2024-09-21T06:46:33.791 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "agent_down_multiplier", 2024-09-21T06:46:33.791 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-21T06:46:33.791 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.791 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.791 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "3.0", 2024-09-21T06:46:33.791 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.791 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.791 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.791 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-21T06:46:33.791 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.791 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.791 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.791 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.792 INFO:teuthology.orchestra.run.smithi007.stdout: "agent_refresh_rate": { 2024-09-21T06:46:33.792 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "agent_refresh_rate", 2024-09-21T06:46:33.792 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:46:33.792 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.792 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.792 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "20", 2024-09-21T06:46:33.792 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.792 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.792 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.792 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-21T06:46:33.792 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.792 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.792 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.792 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.792 INFO:teuthology.orchestra.run.smithi007.stdout: "agent_starting_port": { 2024-09-21T06:46:33.793 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "agent_starting_port", 2024-09-21T06:46:33.793 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.793 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.793 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.793 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "4721", 2024-09-21T06:46:33.793 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.793 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.793 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.793 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-21T06:46:33.793 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.793 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.793 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.793 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.793 INFO:teuthology.orchestra.run.smithi007.stdout: "allow_ptrace": { 2024-09-21T06:46:33.793 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "allow_ptrace", 2024-09-21T06:46:33.794 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.794 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.794 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.794 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.794 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.794 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.794 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.794 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-21T06:46:33.794 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-21T06:46:33.794 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.794 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.794 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.794 INFO:teuthology.orchestra.run.smithi007.stdout: "autotune_interval": { 2024-09-21T06:46:33.795 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "autotune_interval", 2024-09-21T06:46:33.795 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:46:33.795 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.795 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.795 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-09-21T06:46:33.795 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.795 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.795 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.795 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-21T06:46:33.795 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.795 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.795 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.795 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.795 INFO:teuthology.orchestra.run.smithi007.stdout: "autotune_memory_target_ratio": { 2024-09-21T06:46:33.795 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "autotune_memory_target_ratio", 2024-09-21T06:46:33.796 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-21T06:46:33.796 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.796 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.796 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0.7", 2024-09-21T06:46:33.796 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.796 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.796 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.796 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-21T06:46:33.796 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.796 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.796 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.796 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.796 INFO:teuthology.orchestra.run.smithi007.stdout: "cephadm_log_destination": { 2024-09-21T06:46:33.796 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cephadm_log_destination", 2024-09-21T06:46:33.797 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.797 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.797 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.797 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.797 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.797 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.797 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.797 INFO:teuthology.orchestra.run.smithi007.stdout: "file", 2024-09-21T06:46:33.797 INFO:teuthology.orchestra.run.smithi007.stdout: "file,syslog", 2024-09-21T06:46:33.797 INFO:teuthology.orchestra.run.smithi007.stdout: "syslog" 2024-09-21T06:46:33.797 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.797 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-21T06:46:33.797 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.797 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.798 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.798 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.798 INFO:teuthology.orchestra.run.smithi007.stdout: "cgroups_split": { 2024-09-21T06:46:33.798 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cgroups_split", 2024-09-21T06:46:33.798 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.798 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.798 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.798 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:33.798 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.798 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.798 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.798 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-21T06:46:33.798 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.799 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.799 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.799 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.799 INFO:teuthology.orchestra.run.smithi007.stdout: "config_checks_enabled": { 2024-09-21T06:46:33.799 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "config_checks_enabled", 2024-09-21T06:46:33.799 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.799 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.799 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.799 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.799 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.799 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.799 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.799 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-21T06:46:33.800 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.800 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.800 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.800 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.800 INFO:teuthology.orchestra.run.smithi007.stdout: "config_dashboard": { 2024-09-21T06:46:33.800 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "config_dashboard", 2024-09-21T06:46:33.800 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.800 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.800 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.800 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:33.800 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.800 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.800 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.801 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-21T06:46:33.801 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.801 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.801 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.801 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.801 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_alertmanager": { 2024-09-21T06:46:33.801 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_alertmanager", 2024-09-21T06:46:33.801 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.801 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.801 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.801 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-21T06:46:33.801 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.801 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.802 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.802 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Prometheus container image", 2024-09-21T06:46:33.802 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.802 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.802 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.802 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.802 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_base": { 2024-09-21T06:46:33.802 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_base", 2024-09-21T06:46:33.802 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.802 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.802 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.802 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-21T06:46:33.802 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.802 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.803 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.803 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Container image name, without the tag", 2024-09-21T06:46:33.803 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.803 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.803 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.803 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.803 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_elasticsearch": { 2024-09-21T06:46:33.803 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_elasticsearch", 2024-09-21T06:46:33.803 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.803 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.803 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.803 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-21T06:46:33.803 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.803 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.804 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.804 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "elasticsearch container image", 2024-09-21T06:46:33.804 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.804 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.804 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.804 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.804 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_grafana": { 2024-09-21T06:46:33.804 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_grafana", 2024-09-21T06:46:33.804 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.804 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.804 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.804 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/grafana:10.4.8", 2024-09-21T06:46:33.804 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.804 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.805 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.805 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Prometheus container image", 2024-09-21T06:46:33.805 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.805 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.805 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.805 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.805 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_haproxy": { 2024-09-21T06:46:33.805 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_haproxy", 2024-09-21T06:46:33.805 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.805 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.805 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.805 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-21T06:46:33.805 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.805 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.806 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.806 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "HAproxy container image", 2024-09-21T06:46:33.806 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.806 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.806 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.806 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.806 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_jaeger_agent": { 2024-09-21T06:46:33.806 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_jaeger_agent", 2024-09-21T06:46:33.806 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.806 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.806 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.806 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-21T06:46:33.806 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.807 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.807 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.807 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Jaeger agent container image", 2024-09-21T06:46:33.807 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.807 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.807 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.807 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.807 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_jaeger_collector": { 2024-09-21T06:46:33.807 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_jaeger_collector", 2024-09-21T06:46:33.807 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.807 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.807 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.807 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-21T06:46:33.807 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.807 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.807 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.808 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Jaeger collector container image", 2024-09-21T06:46:33.808 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.808 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.808 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.809 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.809 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_jaeger_query": { 2024-09-21T06:46:33.809 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_jaeger_query", 2024-09-21T06:46:33.809 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.809 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.810 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.810 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-21T06:46:33.810 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.810 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.810 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.810 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Jaeger query container image", 2024-09-21T06:46:33.810 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.810 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.810 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.810 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.810 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_keepalived": { 2024-09-21T06:46:33.810 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_keepalived", 2024-09-21T06:46:33.810 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.811 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.811 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.811 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-21T06:46:33.811 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.811 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.811 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.811 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Keepalived container image", 2024-09-21T06:46:33.811 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.811 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.811 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.811 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.811 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_loki": { 2024-09-21T06:46:33.811 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_loki", 2024-09-21T06:46:33.811 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.812 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.812 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.812 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-21T06:46:33.812 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.812 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.812 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.812 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Loki container image", 2024-09-21T06:46:33.812 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.812 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.812 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.812 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.812 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_nginx": { 2024-09-21T06:46:33.812 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_nginx", 2024-09-21T06:46:33.812 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.813 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.813 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.813 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-21T06:46:33.813 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.813 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.813 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.813 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Nginx container image", 2024-09-21T06:46:33.813 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.813 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.813 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.813 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.813 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_node_exporter": { 2024-09-21T06:46:33.813 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_node_exporter", 2024-09-21T06:46:33.813 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.814 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.814 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.814 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-21T06:46:33.814 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.814 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.814 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.814 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Prometheus container image", 2024-09-21T06:46:33.814 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.814 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.814 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.814 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.814 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_nvmeof": { 2024-09-21T06:46:33.814 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_nvmeof", 2024-09-21T06:46:33.814 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.815 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.815 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.815 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-21T06:46:33.815 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.815 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.815 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.815 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Nvme-of container image", 2024-09-21T06:46:33.815 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.815 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.815 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.815 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.815 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_oauth2_proxy": { 2024-09-21T06:46:33.815 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_oauth2_proxy", 2024-09-21T06:46:33.816 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.816 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.816 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.816 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-21T06:46:33.816 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.816 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.816 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.816 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "oauth2-proxy container image", 2024-09-21T06:46:33.816 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.816 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.817 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.817 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.817 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_prometheus": { 2024-09-21T06:46:33.817 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_prometheus", 2024-09-21T06:46:33.817 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.817 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.817 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.817 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-21T06:46:33.817 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.817 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.817 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.817 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Prometheus container image", 2024-09-21T06:46:33.817 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.817 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.818 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.818 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.818 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_promtail": { 2024-09-21T06:46:33.818 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_promtail", 2024-09-21T06:46:33.818 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.818 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.818 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.818 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-21T06:46:33.818 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.818 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.818 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.819 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Promtail container image", 2024-09-21T06:46:33.819 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.819 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.819 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.819 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.819 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_samba": { 2024-09-21T06:46:33.819 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_samba", 2024-09-21T06:46:33.819 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.819 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.819 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.819 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-21T06:46:33.819 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.819 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.819 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.820 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Samba/SMB container image", 2024-09-21T06:46:33.820 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.820 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.820 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.820 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.820 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_samba_metrics": { 2024-09-21T06:46:33.820 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_samba_metrics", 2024-09-21T06:46:33.820 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.820 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.820 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.820 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-21T06:46:33.820 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.820 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.820 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.821 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-21T06:46:33.821 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.821 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.821 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.821 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.821 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image_snmp_gateway": { 2024-09-21T06:46:33.821 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_image_snmp_gateway", 2024-09-21T06:46:33.821 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.821 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.821 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.821 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-21T06:46:33.821 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.821 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.821 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.821 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "SNMP Gateway container image", 2024-09-21T06:46:33.822 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.822 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.822 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.822 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.822 INFO:teuthology.orchestra.run.smithi007.stdout: "container_init": { 2024-09-21T06:46:33.822 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "container_init", 2024-09-21T06:46:33.822 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.822 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.822 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.822 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:33.822 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.822 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.822 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.823 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Run podman/docker with `--init`", 2024-09-21T06:46:33.823 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.823 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.823 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.823 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.823 INFO:teuthology.orchestra.run.smithi007.stdout: "daemon_cache_timeout": { 2024-09-21T06:46:33.823 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "daemon_cache_timeout", 2024-09-21T06:46:33.823 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:46:33.823 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.823 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.823 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-09-21T06:46:33.823 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.823 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.823 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.823 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-21T06:46:33.824 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.824 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.824 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.824 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.824 INFO:teuthology.orchestra.run.smithi007.stdout: "default_cephadm_command_timeout": { 2024-09-21T06:46:33.824 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "default_cephadm_command_timeout", 2024-09-21T06:46:33.824 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.824 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.824 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.824 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "900", 2024-09-21T06:46:33.824 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.824 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.824 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.824 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-21T06:46:33.824 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.825 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.825 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.825 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.825 INFO:teuthology.orchestra.run.smithi007.stdout: "default_registry": { 2024-09-21T06:46:33.825 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "default_registry", 2024-09-21T06:46:33.825 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.825 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.825 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.825 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "docker.io", 2024-09-21T06:46:33.825 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.825 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.825 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.825 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-21T06:46:33.825 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.826 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.826 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.826 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.826 INFO:teuthology.orchestra.run.smithi007.stdout: "device_cache_timeout": { 2024-09-21T06:46:33.826 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "device_cache_timeout", 2024-09-21T06:46:33.826 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:46:33.826 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.826 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.826 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "1800", 2024-09-21T06:46:33.826 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.826 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.826 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.826 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "seconds to cache device inventory", 2024-09-21T06:46:33.826 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.827 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.827 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.827 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.827 INFO:teuthology.orchestra.run.smithi007.stdout: "device_enhanced_scan": { 2024-09-21T06:46:33.827 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "device_enhanced_scan", 2024-09-21T06:46:33.827 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.827 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.827 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.827 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.827 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.827 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.827 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.828 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-21T06:46:33.828 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.828 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.828 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.828 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.828 INFO:teuthology.orchestra.run.smithi007.stdout: "facts_cache_timeout": { 2024-09-21T06:46:33.828 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "facts_cache_timeout", 2024-09-21T06:46:33.828 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:46:33.828 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.828 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.828 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-09-21T06:46:33.828 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.828 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.828 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.829 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "seconds to cache host facts data", 2024-09-21T06:46:33.829 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.829 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.829 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.829 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.829 INFO:teuthology.orchestra.run.smithi007.stdout: "grafana_dashboards_path": { 2024-09-21T06:46:33.829 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "grafana_dashboards_path", 2024-09-21T06:46:33.829 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.829 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.829 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.829 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-21T06:46:33.829 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.829 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.829 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.830 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-21T06:46:33.830 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.830 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.830 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.830 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.830 INFO:teuthology.orchestra.run.smithi007.stdout: "host_check_interval": { 2024-09-21T06:46:33.830 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "host_check_interval", 2024-09-21T06:46:33.830 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:46:33.830 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.830 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.830 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-09-21T06:46:33.830 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.830 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.830 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.831 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to perform a host check", 2024-09-21T06:46:33.831 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.831 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.831 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.831 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.831 INFO:teuthology.orchestra.run.smithi007.stdout: "hw_monitoring": { 2024-09-21T06:46:33.831 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "hw_monitoring", 2024-09-21T06:46:33.831 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.831 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.831 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.831 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.831 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.831 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.832 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.832 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-21T06:46:33.832 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.832 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.832 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.832 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.832 INFO:teuthology.orchestra.run.smithi007.stdout: "inventory_list_all": { 2024-09-21T06:46:33.832 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "inventory_list_all", 2024-09-21T06:46:33.832 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.832 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.832 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.832 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.832 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.832 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.832 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.832 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-21T06:46:33.833 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.833 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.833 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.833 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.833 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:33.833 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:33.833 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.833 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.833 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.833 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.833 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.833 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.833 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.833 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.833 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.834 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.834 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.834 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.834 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.834 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.834 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.834 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.834 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.834 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.834 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.834 INFO:teuthology.orchestra.run.smithi007.stdout: "log_refresh_metadata": { 2024-09-21T06:46:33.834 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_refresh_metadata", 2024-09-21T06:46:33.834 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.835 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.835 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.835 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.835 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.835 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.835 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.835 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-21T06:46:33.835 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.835 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.835 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.835 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.835 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:33.835 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:33.835 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.836 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.836 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.836 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:33.836 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.836 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.836 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.836 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-21T06:46:33.836 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.836 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.836 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.836 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.836 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:33.836 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:33.836 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.837 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.837 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.837 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:33.837 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.837 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.837 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.837 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.837 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.837 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.837 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.837 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.837 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.837 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.837 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.838 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.838 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.838 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.838 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.838 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:33.838 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:33.838 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.838 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.838 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.838 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.838 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.838 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.838 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.838 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.838 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.839 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.839 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.839 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.839 INFO:teuthology.orchestra.run.smithi007.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-21T06:46:33.839 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-21T06:46:33.839 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.839 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.839 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.839 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.839 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.839 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.839 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.839 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-21T06:46:33.840 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.840 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.840 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.840 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.840 INFO:teuthology.orchestra.run.smithi007.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-21T06:46:33.840 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-21T06:46:33.840 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.840 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.840 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.840 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "*", 2024-09-21T06:46:33.840 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.840 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.840 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.841 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-21T06:46:33.841 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.841 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.841 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.841 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.841 INFO:teuthology.orchestra.run.smithi007.stdout: "max_count_per_host": { 2024-09-21T06:46:33.841 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_count_per_host", 2024-09-21T06:46:33.841 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.841 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.841 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.841 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-21T06:46:33.841 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.841 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.841 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.842 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "max number of daemons per service per host", 2024-09-21T06:46:33.842 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.842 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.842 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.842 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.842 INFO:teuthology.orchestra.run.smithi007.stdout: "max_osd_draining_count": { 2024-09-21T06:46:33.842 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_osd_draining_count", 2024-09-21T06:46:33.842 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.842 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.842 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.842 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-21T06:46:33.842 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.842 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.843 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.843 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-21T06:46:33.843 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.843 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.843 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.843 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.843 INFO:teuthology.orchestra.run.smithi007.stdout: "migration_current": { 2024-09-21T06:46:33.843 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "migration_current", 2024-09-21T06:46:33.843 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.843 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.843 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.843 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.843 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.844 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.844 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.844 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "internal - do not modify", 2024-09-21T06:46:33.844 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.844 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.844 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.844 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.844 INFO:teuthology.orchestra.run.smithi007.stdout: "mode": { 2024-09-21T06:46:33.844 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mode", 2024-09-21T06:46:33.844 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.844 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.844 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.844 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "root", 2024-09-21T06:46:33.844 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.844 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.845 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.845 INFO:teuthology.orchestra.run.smithi007.stdout: "cephadm-package", 2024-09-21T06:46:33.845 INFO:teuthology.orchestra.run.smithi007.stdout: "root" 2024-09-21T06:46:33.845 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.845 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "mode for remote execution of cephadm", 2024-09-21T06:46:33.845 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.845 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.845 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.845 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.845 INFO:teuthology.orchestra.run.smithi007.stdout: "oob_default_addr": { 2024-09-21T06:46:33.845 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "oob_default_addr", 2024-09-21T06:46:33.845 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.845 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.846 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.846 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "169.254.1.1", 2024-09-21T06:46:33.846 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.846 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.846 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.846 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-21T06:46:33.846 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.846 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.846 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.846 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.846 INFO:teuthology.orchestra.run.smithi007.stdout: "prometheus_alerts_path": { 2024-09-21T06:46:33.846 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "prometheus_alerts_path", 2024-09-21T06:46:33.846 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.846 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.847 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.847 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-21T06:46:33.847 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.847 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.847 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.847 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-21T06:46:33.847 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.847 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.847 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.847 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.847 INFO:teuthology.orchestra.run.smithi007.stdout: "registry_insecure": { 2024-09-21T06:46:33.847 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "registry_insecure", 2024-09-21T06:46:33.847 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.847 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.848 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.848 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.848 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.848 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.848 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.848 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-21T06:46:33.848 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.848 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.848 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.848 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.848 INFO:teuthology.orchestra.run.smithi007.stdout: "registry_password": { 2024-09-21T06:46:33.848 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "registry_password", 2024-09-21T06:46:33.848 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.848 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.849 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.849 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.849 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.849 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.849 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.849 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-21T06:46:33.849 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.849 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.849 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.849 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.849 INFO:teuthology.orchestra.run.smithi007.stdout: "registry_url": { 2024-09-21T06:46:33.849 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "registry_url", 2024-09-21T06:46:33.849 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.849 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.849 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.849 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.850 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.850 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.850 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.850 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-21T06:46:33.850 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.850 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.850 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.850 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.850 INFO:teuthology.orchestra.run.smithi007.stdout: "registry_username": { 2024-09-21T06:46:33.850 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "registry_username", 2024-09-21T06:46:33.850 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.850 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.850 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.850 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.851 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.851 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.851 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.851 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-21T06:46:33.851 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.851 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.851 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.851 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.851 INFO:teuthology.orchestra.run.smithi007.stdout: "secure_monitoring_stack": { 2024-09-21T06:46:33.851 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "secure_monitoring_stack", 2024-09-21T06:46:33.851 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.851 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.851 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.851 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.852 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.852 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.852 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.852 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-21T06:46:33.852 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.852 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.852 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.852 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.852 INFO:teuthology.orchestra.run.smithi007.stdout: "service_discovery_port": { 2024-09-21T06:46:33.852 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "service_discovery_port", 2024-09-21T06:46:33.852 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.852 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.852 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.852 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8765", 2024-09-21T06:46:33.852 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.853 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.853 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.853 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "cephadm service discovery port", 2024-09-21T06:46:33.853 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.853 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.853 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.853 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.853 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:33.853 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:33.853 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.853 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:33.853 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.853 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.853 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.853 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.853 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.854 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.854 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.854 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.854 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.854 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.854 INFO:teuthology.orchestra.run.smithi007.stdout: "ssh_config_file": { 2024-09-21T06:46:33.854 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ssh_config_file", 2024-09-21T06:46:33.854 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.854 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.854 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.854 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.854 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.854 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.854 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.855 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-21T06:46:33.855 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.855 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.855 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.855 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.855 INFO:teuthology.orchestra.run.smithi007.stdout: "ssh_keepalive_count_max": { 2024-09-21T06:46:33.855 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ssh_keepalive_count_max", 2024-09-21T06:46:33.855 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.855 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.855 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.855 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "3", 2024-09-21T06:46:33.855 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.855 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.855 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.855 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-21T06:46:33.856 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.856 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.856 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.856 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.856 INFO:teuthology.orchestra.run.smithi007.stdout: "ssh_keepalive_interval": { 2024-09-21T06:46:33.856 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ssh_keepalive_interval", 2024-09-21T06:46:33.856 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.856 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.856 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.856 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "7", 2024-09-21T06:46:33.856 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.856 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.856 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.856 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-21T06:46:33.857 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.857 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.857 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.857 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.857 INFO:teuthology.orchestra.run.smithi007.stdout: "use_agent": { 2024-09-21T06:46:33.857 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "use_agent", 2024-09-21T06:46:33.857 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.857 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.857 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.857 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.857 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.857 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.857 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.857 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-21T06:46:33.857 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.858 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.858 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.858 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.858 INFO:teuthology.orchestra.run.smithi007.stdout: "use_repo_digest": { 2024-09-21T06:46:33.858 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "use_repo_digest", 2024-09-21T06:46:33.858 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.858 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.858 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.858 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:33.858 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.858 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.858 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.858 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-21T06:46:33.858 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.859 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.859 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.859 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.859 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_on_failed_host_check": { 2024-09-21T06:46:33.859 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_on_failed_host_check", 2024-09-21T06:46:33.859 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.859 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.859 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.859 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:33.859 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.859 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.859 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.859 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "raise a health warning if the host check fails", 2024-09-21T06:46:33.859 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.860 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.860 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.860 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.860 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_on_stray_daemons": { 2024-09-21T06:46:33.860 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_on_stray_daemons", 2024-09-21T06:46:33.860 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.860 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.860 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.860 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:33.860 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.860 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.860 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.860 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-21T06:46:33.860 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.860 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.861 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.861 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.861 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_on_stray_hosts": { 2024-09-21T06:46:33.861 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_on_stray_hosts", 2024-09-21T06:46:33.861 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.861 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.861 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.861 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:33.861 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.861 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.861 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.861 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-21T06:46:33.861 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.861 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.861 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.862 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.862 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.862 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.862 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:33.862 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crash", 2024-09-21T06:46:33.862 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:33.862 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:33.862 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:33.862 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:33.862 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:33.862 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.862 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.862 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.862 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.863 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.863 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.863 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.863 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.863 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.863 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.863 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.863 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.863 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.863 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.863 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.863 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.863 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.864 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.864 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.864 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:33.864 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:33.864 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.864 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.864 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.864 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.864 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.864 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.864 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.864 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.864 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.864 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.864 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.865 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.865 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:33.865 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:33.865 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.865 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.865 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.865 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:33.865 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.865 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.865 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.865 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.865 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.865 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.866 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.866 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.866 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.866 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.866 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.866 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.866 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.866 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.866 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.866 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:33.866 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:33.866 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.867 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.867 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.867 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.867 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.867 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.867 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.867 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.867 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.867 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.867 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.867 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.867 INFO:teuthology.orchestra.run.smithi007.stdout: "retain_interval": { 2024-09-21T06:46:33.867 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "retain_interval", 2024-09-21T06:46:33.867 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:46:33.867 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.868 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.868 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "31536000", 2024-09-21T06:46:33.868 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.868 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.868 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.868 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-21T06:46:33.868 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.868 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.868 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.868 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.868 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:33.868 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:33.868 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.868 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:33.868 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.868 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.869 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.869 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.869 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.869 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.869 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.869 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.869 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.869 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.869 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_recent_interval": { 2024-09-21T06:46:33.869 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_recent_interval", 2024-09-21T06:46:33.869 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:46:33.869 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.869 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.869 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "1209600", 2024-09-21T06:46:33.869 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.869 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.870 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.870 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-21T06:46:33.870 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.870 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.870 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.870 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.870 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.870 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.870 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:33.870 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "dashboard", 2024-09-21T06:46:33.870 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:33.870 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:33.870 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:33.870 INFO:teuthology.orchestra.run.smithi007.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-21T06:46:33.870 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-21T06:46:33.871 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.871 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.871 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.871 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-21T06:46:33.871 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.871 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.871 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.871 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.871 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.871 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.871 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.871 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.871 INFO:teuthology.orchestra.run.smithi007.stdout: "ALERTMANAGER_API_HOST": { 2024-09-21T06:46:33.871 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-21T06:46:33.871 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.872 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.872 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.872 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.872 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.872 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.872 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.872 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.872 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.872 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.872 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.872 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.872 INFO:teuthology.orchestra.run.smithi007.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-21T06:46:33.872 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-21T06:46:33.872 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.872 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.873 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.873 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:33.873 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.873 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.873 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.873 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.873 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.873 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.873 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.873 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.873 INFO:teuthology.orchestra.run.smithi007.stdout: "AUDIT_API_ENABLED": { 2024-09-21T06:46:33.873 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "AUDIT_API_ENABLED", 2024-09-21T06:46:33.873 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.873 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.873 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.873 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.874 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.874 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.874 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.874 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.874 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.874 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.874 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.874 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.874 INFO:teuthology.orchestra.run.smithi007.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-21T06:46:33.874 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-21T06:46:33.874 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.874 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.874 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.874 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:33.875 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.875 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.875 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.875 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.875 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.875 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.875 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.875 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.875 INFO:teuthology.orchestra.run.smithi007.stdout: "ENABLE_BROWSABLE_API": { 2024-09-21T06:46:33.875 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-21T06:46:33.875 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.875 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.875 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.875 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:33.875 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.876 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.876 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.876 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.876 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.876 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.876 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.876 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.876 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-21T06:46:33.876 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-21T06:46:33.876 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.876 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.876 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.876 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:33.876 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.877 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.877 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.877 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.877 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.877 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.877 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.877 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.877 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-21T06:46:33.877 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-21T06:46:33.877 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.877 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.877 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.877 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:33.878 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.878 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.878 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.878 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.878 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.878 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.878 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.878 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.878 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-21T06:46:33.878 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-21T06:46:33.878 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.878 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.878 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.878 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:33.879 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.879 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.879 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.879 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.879 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.879 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.879 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.879 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.879 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-21T06:46:33.879 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-21T06:46:33.879 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.879 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.879 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.879 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:33.879 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.880 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.880 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.880 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.880 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.880 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.880 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.880 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.880 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-21T06:46:33.880 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-21T06:46:33.880 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.880 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.880 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.880 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:33.880 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.881 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.881 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.881 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.881 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.881 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.881 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.881 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.881 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-21T06:46:33.881 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-21T06:46:33.881 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.881 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.881 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.881 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:33.881 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.881 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.882 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.882 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.882 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.882 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.882 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.882 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.882 INFO:teuthology.orchestra.run.smithi007.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-21T06:46:33.882 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-21T06:46:33.882 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.882 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.882 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.882 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:33.882 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.882 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.883 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.883 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.883 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.883 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.883 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.883 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.883 INFO:teuthology.orchestra.run.smithi007.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-21T06:46:33.883 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-21T06:46:33.883 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.883 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.883 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.883 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.883 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.883 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.884 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.884 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.884 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.884 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.884 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.884 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.884 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_API_PASSWORD": { 2024-09-21T06:46:33.884 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-21T06:46:33.884 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.884 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.884 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.884 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "admin", 2024-09-21T06:46:33.884 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.884 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.885 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.885 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.885 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.885 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.885 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.885 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.885 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-21T06:46:33.885 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-21T06:46:33.885 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.885 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.885 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.885 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:33.885 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.885 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.885 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.886 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.886 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.886 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.886 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.886 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.886 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_API_URL": { 2024-09-21T06:46:33.886 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_API_URL", 2024-09-21T06:46:33.886 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.886 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.886 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.886 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.886 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.886 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.886 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.887 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.887 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.887 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.887 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.887 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.887 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_API_USERNAME": { 2024-09-21T06:46:33.887 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-21T06:46:33.887 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.887 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.887 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.887 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "admin", 2024-09-21T06:46:33.887 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.887 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.887 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.887 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.888 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.888 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.888 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.888 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.888 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-21T06:46:33.888 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-21T06:46:33.888 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.888 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.888 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.888 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.888 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.888 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.888 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.888 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.888 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.889 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.889 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.889 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.889 INFO:teuthology.orchestra.run.smithi007.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-21T06:46:33.889 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-21T06:46:33.889 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.889 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.889 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.889 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.889 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.889 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.889 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.889 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.889 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.889 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.890 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.890 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.890 INFO:teuthology.orchestra.run.smithi007.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-21T06:46:33.890 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-21T06:46:33.890 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.890 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.890 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.890 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:33.890 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.890 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.890 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.890 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.890 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.891 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.891 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.891 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.891 INFO:teuthology.orchestra.run.smithi007.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-21T06:46:33.891 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-21T06:46:33.891 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.891 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.891 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.891 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.891 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.891 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.891 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.891 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.891 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.891 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.892 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.892 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.892 INFO:teuthology.orchestra.run.smithi007.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-21T06:46:33.892 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-21T06:46:33.892 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.892 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.892 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.892 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "[]", 2024-09-21T06:46:33.892 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.892 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.892 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.892 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.893 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.893 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.893 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.893 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.893 INFO:teuthology.orchestra.run.smithi007.stdout: "MULTICLUSTER_CONFIG": { 2024-09-21T06:46:33.893 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-21T06:46:33.893 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.893 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.893 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.893 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "{}", 2024-09-21T06:46:33.893 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.893 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.893 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.893 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.894 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.894 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.894 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.894 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.894 INFO:teuthology.orchestra.run.smithi007.stdout: "PROMETHEUS_API_HOST": { 2024-09-21T06:46:33.894 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-21T06:46:33.894 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.894 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.894 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.894 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.894 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.894 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.894 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.894 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.895 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.895 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.895 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.895 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.895 INFO:teuthology.orchestra.run.smithi007.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-21T06:46:33.895 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-21T06:46:33.895 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.895 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.895 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.895 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:33.895 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.895 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.895 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.896 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.896 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.896 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.896 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.896 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.896 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-21T06:46:33.896 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-21T06:46:33.896 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.896 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.896 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.896 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.896 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.896 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.897 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.897 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.897 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.897 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.897 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.897 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.897 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-21T06:46:33.897 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-21T06:46:33.897 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.897 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.897 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.897 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.898 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.898 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.898 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.898 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.898 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.898 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.898 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.898 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.898 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-21T06:46:33.898 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-21T06:46:33.898 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.899 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.899 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.899 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:33.899 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.899 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.899 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.899 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.899 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.899 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.899 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.899 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.899 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-21T06:46:33.899 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-21T06:46:33.899 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.900 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.900 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.900 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:33.900 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.900 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.900 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.900 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.900 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.900 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.900 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.900 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.900 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-21T06:46:33.900 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-21T06:46:33.900 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.900 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.901 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.901 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.901 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.901 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.901 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.901 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.901 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.901 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.901 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.901 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.901 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-21T06:46:33.901 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-21T06:46:33.901 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.902 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.902 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.902 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.902 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.902 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.902 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.902 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.902 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.902 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.902 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.902 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.902 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-21T06:46:33.902 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-21T06:46:33.902 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.902 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.903 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.903 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.903 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.903 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.903 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.903 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.903 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.903 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.903 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.903 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.903 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_ENABLED": { 2024-09-21T06:46:33.903 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-21T06:46:33.903 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.904 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.904 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.904 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:33.904 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.904 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.904 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.904 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.904 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.904 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.904 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.904 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.904 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-21T06:46:33.904 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-21T06:46:33.904 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.905 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.905 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.905 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-21T06:46:33.905 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.905 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.905 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.905 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.905 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.905 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.905 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.905 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.905 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-21T06:46:33.905 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-21T06:46:33.905 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.906 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.906 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.906 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-21T06:46:33.906 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.906 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.906 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.906 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.906 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.906 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.906 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.906 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.906 INFO:teuthology.orchestra.run.smithi007.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-21T06:46:33.906 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-21T06:46:33.906 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.907 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.907 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.907 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8", 2024-09-21T06:46:33.907 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.907 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.907 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.907 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.907 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.907 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.907 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.907 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.907 INFO:teuthology.orchestra.run.smithi007.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-21T06:46:33.907 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-21T06:46:33.907 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.907 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.908 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.908 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "45", 2024-09-21T06:46:33.908 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.908 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.908 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.908 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.908 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.908 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.908 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.908 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.908 INFO:teuthology.orchestra.run.smithi007.stdout: "RGW_API_ACCESS_KEY": { 2024-09-21T06:46:33.908 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-21T06:46:33.908 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.908 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.909 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.909 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.909 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.909 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.909 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.909 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.909 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.909 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.909 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.909 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.909 INFO:teuthology.orchestra.run.smithi007.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-21T06:46:33.909 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-21T06:46:33.909 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.909 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.909 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.910 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "admin", 2024-09-21T06:46:33.910 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.910 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.910 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.910 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.910 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.910 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.910 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.910 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.910 INFO:teuthology.orchestra.run.smithi007.stdout: "RGW_API_SECRET_KEY": { 2024-09-21T06:46:33.910 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-21T06:46:33.910 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.910 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.910 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.910 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.911 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.911 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.911 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.911 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.911 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.911 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.911 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.911 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.911 INFO:teuthology.orchestra.run.smithi007.stdout: "RGW_API_SSL_VERIFY": { 2024-09-21T06:46:33.911 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-21T06:46:33.911 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.911 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.911 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.911 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:33.911 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.911 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.912 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.912 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.912 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.912 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.912 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.912 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.912 INFO:teuthology.orchestra.run.smithi007.stdout: "UNSAFE_TLS_v1_2": { 2024-09-21T06:46:33.912 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-21T06:46:33.912 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.912 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.912 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.912 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.912 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.912 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.912 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.912 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.913 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.913 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.913 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.913 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.913 INFO:teuthology.orchestra.run.smithi007.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-21T06:46:33.913 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-21T06:46:33.913 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.913 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.913 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.913 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.913 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.913 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.913 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.913 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.913 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.914 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.914 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.914 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.914 INFO:teuthology.orchestra.run.smithi007.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-21T06:46:33.914 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-21T06:46:33.914 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.914 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.914 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.914 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-21T06:46:33.914 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.914 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.914 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.914 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.914 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.915 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.915 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.915 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.915 INFO:teuthology.orchestra.run.smithi007.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-21T06:46:33.915 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-21T06:46:33.915 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.915 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.915 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.915 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5", 2024-09-21T06:46:33.915 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.915 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.915 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.915 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.915 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.915 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.916 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.916 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.916 INFO:teuthology.orchestra.run.smithi007.stdout: "cross_origin_url": { 2024-09-21T06:46:33.916 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cross_origin_url", 2024-09-21T06:46:33.916 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.916 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.916 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.916 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.916 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.916 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.916 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.916 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.916 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.916 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.916 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.916 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.917 INFO:teuthology.orchestra.run.smithi007.stdout: "crt_file": { 2024-09-21T06:46:33.917 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "crt_file", 2024-09-21T06:46:33.917 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.917 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.917 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.917 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.917 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.917 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.917 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.917 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.917 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.917 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.917 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.917 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.918 INFO:teuthology.orchestra.run.smithi007.stdout: "debug": { 2024-09-21T06:46:33.918 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "debug", 2024-09-21T06:46:33.918 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.918 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.918 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.918 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.918 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.918 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.918 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.918 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Enable/disable debug options", 2024-09-21T06:46:33.918 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.918 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.918 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.918 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.918 INFO:teuthology.orchestra.run.smithi007.stdout: "jwt_token_ttl": { 2024-09-21T06:46:33.919 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "jwt_token_ttl", 2024-09-21T06:46:33.919 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.919 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.919 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.919 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "28800", 2024-09-21T06:46:33.919 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.919 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.919 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.919 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.919 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.919 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.919 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.919 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.919 INFO:teuthology.orchestra.run.smithi007.stdout: "key_file": { 2024-09-21T06:46:33.920 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "key_file", 2024-09-21T06:46:33.920 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.920 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.920 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.920 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.920 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.920 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.920 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.920 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.920 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.920 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.920 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.920 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.920 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:33.920 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:33.920 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.921 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.921 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.921 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.921 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.921 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.921 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.921 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.921 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.921 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.921 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.921 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.921 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.921 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.921 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.921 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.922 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.922 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.922 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.922 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:33.922 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:33.922 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.922 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.922 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.922 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.922 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.922 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.922 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.922 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.922 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.923 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.923 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.923 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.923 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:33.923 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:33.923 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.923 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.923 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.923 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:33.923 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.923 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.923 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.923 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.923 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.923 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.924 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.924 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.924 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.924 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.924 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.924 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.924 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.924 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.924 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.924 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:33.924 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:33.924 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.924 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.924 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.924 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.925 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.925 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.925 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.925 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.925 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.925 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.925 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.925 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.925 INFO:teuthology.orchestra.run.smithi007.stdout: "motd": { 2024-09-21T06:46:33.925 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "motd", 2024-09-21T06:46:33.925 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.925 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.925 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.926 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.926 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.926 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.926 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.926 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "The message of the day", 2024-09-21T06:46:33.926 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.926 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.926 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.926 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.926 INFO:teuthology.orchestra.run.smithi007.stdout: "redirect_resolve_ip_addr": { 2024-09-21T06:46:33.926 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "redirect_resolve_ip_addr", 2024-09-21T06:46:33.926 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.926 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.926 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.926 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.927 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.927 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.927 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.927 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.927 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.927 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.927 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.927 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.927 INFO:teuthology.orchestra.run.smithi007.stdout: "server_addr": { 2024-09-21T06:46:33.927 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_addr", 2024-09-21T06:46:33.927 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.927 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.927 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.927 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "::", 2024-09-21T06:46:33.928 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.928 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.928 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.928 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.928 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.928 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.928 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.928 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.928 INFO:teuthology.orchestra.run.smithi007.stdout: "server_port": { 2024-09-21T06:46:33.928 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_port", 2024-09-21T06:46:33.928 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.928 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.928 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.928 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8080", 2024-09-21T06:46:33.929 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.929 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.929 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.929 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.929 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.929 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.929 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.929 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.929 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:33.929 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:33.929 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.929 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:33.929 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.929 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.930 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.930 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.930 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.930 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.930 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.930 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.930 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.930 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.930 INFO:teuthology.orchestra.run.smithi007.stdout: "ssl": { 2024-09-21T06:46:33.930 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ssl", 2024-09-21T06:46:33.930 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.930 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.930 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.930 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:33.931 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.931 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.931 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.931 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.931 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.931 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.931 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.931 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.931 INFO:teuthology.orchestra.run.smithi007.stdout: "ssl_server_port": { 2024-09-21T06:46:33.931 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ssl_server_port", 2024-09-21T06:46:33.931 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.931 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.931 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.931 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8443", 2024-09-21T06:46:33.931 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.932 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.932 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.932 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.932 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.932 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.932 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.932 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.932 INFO:teuthology.orchestra.run.smithi007.stdout: "sso_oauth2": { 2024-09-21T06:46:33.932 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sso_oauth2", 2024-09-21T06:46:33.932 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.932 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.932 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.932 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.932 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.932 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.933 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.933 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.933 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.933 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.933 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.933 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.933 INFO:teuthology.orchestra.run.smithi007.stdout: "standby_behaviour": { 2024-09-21T06:46:33.933 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "standby_behaviour", 2024-09-21T06:46:33.933 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.933 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.933 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.933 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "redirect", 2024-09-21T06:46:33.933 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.934 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.934 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.934 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.934 INFO:teuthology.orchestra.run.smithi007.stdout: "redirect" 2024-09-21T06:46:33.934 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.934 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.934 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.934 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.934 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.934 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.934 INFO:teuthology.orchestra.run.smithi007.stdout: "standby_error_status_code": { 2024-09-21T06:46:33.934 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "standby_error_status_code", 2024-09-21T06:46:33.934 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.934 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.934 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.935 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "500", 2024-09-21T06:46:33.935 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "400", 2024-09-21T06:46:33.935 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "599", 2024-09-21T06:46:33.935 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.935 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.935 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.935 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.935 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.935 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.935 INFO:teuthology.orchestra.run.smithi007.stdout: "url_prefix": { 2024-09-21T06:46:33.935 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "url_prefix", 2024-09-21T06:46:33.935 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.935 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.936 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.936 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.936 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.936 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.936 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.936 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.936 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.936 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.936 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.936 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.936 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.936 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.936 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:33.936 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "devicehealth", 2024-09-21T06:46:33.937 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:33.937 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:33.937 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:33.937 INFO:teuthology.orchestra.run.smithi007.stdout: "enable_monitoring": { 2024-09-21T06:46:33.937 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "enable_monitoring", 2024-09-21T06:46:33.937 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.937 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.937 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.937 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:33.937 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.937 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.937 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.937 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "monitor device health metrics", 2024-09-21T06:46:33.937 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.937 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.938 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.938 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.938 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:33.938 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:33.938 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.938 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.938 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.938 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.938 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.938 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.938 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.938 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.938 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.938 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.938 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.939 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.939 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.939 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.939 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.939 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.939 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.939 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.939 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.939 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:33.939 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:33.939 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.939 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.939 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.939 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.939 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.940 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.940 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.940 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.940 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.940 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.940 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.940 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.940 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:33.940 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:33.940 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.940 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.940 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.940 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:33.940 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.940 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.941 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.941 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.941 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.941 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.941 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.941 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.941 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.941 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.941 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.941 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.941 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.941 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.941 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.941 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:33.941 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:33.942 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.942 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.942 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.942 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.942 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.942 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.942 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.942 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.942 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.942 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.942 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.942 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.942 INFO:teuthology.orchestra.run.smithi007.stdout: "mark_out_threshold": { 2024-09-21T06:46:33.942 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mark_out_threshold", 2024-09-21T06:46:33.943 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:46:33.943 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.943 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.943 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "2419200", 2024-09-21T06:46:33.943 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.943 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.943 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.943 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-21T06:46:33.943 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.943 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.943 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.943 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.943 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_name": { 2024-09-21T06:46:33.943 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "pool_name", 2024-09-21T06:46:33.944 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.944 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.944 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.944 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "device_health_metrics", 2024-09-21T06:46:33.944 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.944 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.944 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.944 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-21T06:46:33.944 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.944 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.944 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.944 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.944 INFO:teuthology.orchestra.run.smithi007.stdout: "retention_period": { 2024-09-21T06:46:33.945 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "retention_period", 2024-09-21T06:46:33.945 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:46:33.945 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.945 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.945 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "15552000", 2024-09-21T06:46:33.945 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.945 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.945 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.945 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how long to retain device health metrics", 2024-09-21T06:46:33.945 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.945 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.945 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.945 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.945 INFO:teuthology.orchestra.run.smithi007.stdout: "scrape_frequency": { 2024-09-21T06:46:33.945 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "scrape_frequency", 2024-09-21T06:46:33.946 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:46:33.946 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.946 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.946 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "86400", 2024-09-21T06:46:33.946 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.946 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.946 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.946 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-21T06:46:33.946 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.946 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.946 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.946 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.946 INFO:teuthology.orchestra.run.smithi007.stdout: "self_heal": { 2024-09-21T06:46:33.946 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "self_heal", 2024-09-21T06:46:33.947 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.947 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.947 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.947 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:33.947 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.947 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.947 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.947 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-21T06:46:33.947 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.947 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.947 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.947 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.947 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-09-21T06:46:33.947 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-09-21T06:46:33.947 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:46:33.948 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.948 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.948 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-09-21T06:46:33.948 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.948 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.948 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.948 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how frequently to wake up and check device health", 2024-09-21T06:46:33.948 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.948 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.948 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.948 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.948 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:33.948 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:33.948 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.949 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:33.949 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.949 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.949 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.949 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.949 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.949 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.949 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.949 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.949 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.949 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.949 INFO:teuthology.orchestra.run.smithi007.stdout: "warn_threshold": { 2024-09-21T06:46:33.949 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "warn_threshold", 2024-09-21T06:46:33.949 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:46:33.949 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.950 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.950 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "7257600", 2024-09-21T06:46:33.950 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.950 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.950 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.950 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-21T06:46:33.950 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.950 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.950 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.950 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.950 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.950 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.950 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:33.950 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "diskprediction_local", 2024-09-21T06:46:33.950 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:33.951 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:33.951 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:33.951 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:33.951 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:33.951 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.951 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.951 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.951 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.951 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.951 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.951 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.951 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.951 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.951 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.951 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.952 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.952 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.952 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.952 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.952 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.952 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.952 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.952 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.952 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:33.952 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:33.952 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.952 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.952 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.952 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.952 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.953 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.953 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.953 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.953 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.953 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.953 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.953 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.953 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:33.953 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:33.953 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.953 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.953 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.953 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:33.953 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.953 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.954 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.954 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.954 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.954 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.954 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.954 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.954 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.954 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.954 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.954 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.954 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.954 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.954 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.954 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:33.954 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:33.955 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.955 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.955 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.955 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.955 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.955 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.955 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.955 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.955 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.955 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.955 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.955 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.955 INFO:teuthology.orchestra.run.smithi007.stdout: "predict_interval": { 2024-09-21T06:46:33.955 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "predict_interval", 2024-09-21T06:46:33.956 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.956 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.956 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.956 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "86400", 2024-09-21T06:46:33.956 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.956 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.956 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.956 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.956 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.956 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.956 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.956 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.956 INFO:teuthology.orchestra.run.smithi007.stdout: "predictor_model": { 2024-09-21T06:46:33.956 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "predictor_model", 2024-09-21T06:46:33.956 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.957 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.957 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.957 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "prophetstor", 2024-09-21T06:46:33.957 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.957 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.957 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.957 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.957 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.957 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.957 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.957 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.957 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-09-21T06:46:33.957 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-09-21T06:46:33.957 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.958 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.958 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.958 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "600", 2024-09-21T06:46:33.958 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.958 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.958 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.958 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.958 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.958 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.958 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.958 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.958 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:33.958 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:33.958 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.959 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:33.959 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.959 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.959 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.959 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.959 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.959 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.959 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.959 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.959 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.959 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.959 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.959 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.959 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:33.959 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "influx", 2024-09-21T06:46:33.960 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": false, 2024-09-21T06:46:33.960 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "influxdb python module not found", 2024-09-21T06:46:33.960 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:33.960 INFO:teuthology.orchestra.run.smithi007.stdout: "batch_size": { 2024-09-21T06:46:33.960 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "batch_size", 2024-09-21T06:46:33.960 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.960 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.960 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.960 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5000", 2024-09-21T06:46:33.960 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.960 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.960 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.960 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-21T06:46:33.960 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.960 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.961 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.961 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.961 INFO:teuthology.orchestra.run.smithi007.stdout: "database": { 2024-09-21T06:46:33.961 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "database", 2024-09-21T06:46:33.961 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.961 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.961 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.961 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "ceph", 2024-09-21T06:46:33.961 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.961 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.961 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.961 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-21T06:46:33.961 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.961 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.962 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.962 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.962 INFO:teuthology.orchestra.run.smithi007.stdout: "hostname": { 2024-09-21T06:46:33.962 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "hostname", 2024-09-21T06:46:33.962 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.962 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.962 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.962 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.962 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.962 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.962 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.962 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "InfluxDB server hostname", 2024-09-21T06:46:33.962 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.962 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.963 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.963 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.963 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-09-21T06:46:33.963 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-09-21T06:46:33.963 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:46:33.963 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.963 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.963 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "30", 2024-09-21T06:46:33.963 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "5", 2024-09-21T06:46:33.963 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.963 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.963 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-21T06:46:33.963 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.963 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.963 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.964 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.964 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:33.964 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:33.964 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.964 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.964 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.964 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.964 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.964 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.964 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.964 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.964 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.964 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.964 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.964 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.965 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.965 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.965 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.965 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.965 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.965 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.965 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.965 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:33.965 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:33.965 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.965 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.965 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.965 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.965 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.965 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.966 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.966 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.966 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.966 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.966 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.966 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.966 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:33.966 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:33.966 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.966 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.966 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.966 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:33.966 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.966 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.967 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.967 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.967 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.967 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.967 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.967 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.967 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.967 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.967 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.967 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.967 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.967 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.967 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.967 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:33.968 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:33.968 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.968 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.968 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.968 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.968 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.968 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.968 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.968 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.968 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.968 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.968 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.968 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.968 INFO:teuthology.orchestra.run.smithi007.stdout: "password": { 2024-09-21T06:46:33.968 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "password", 2024-09-21T06:46:33.968 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.969 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.969 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.969 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.969 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.969 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.969 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.969 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "password of InfluxDB server user", 2024-09-21T06:46:33.969 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.969 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.969 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.969 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.969 INFO:teuthology.orchestra.run.smithi007.stdout: "port": { 2024-09-21T06:46:33.969 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "port", 2024-09-21T06:46:33.969 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.970 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.970 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.970 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "8086", 2024-09-21T06:46:33.970 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.970 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.970 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.970 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "InfluxDB server port", 2024-09-21T06:46:33.970 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.970 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.970 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.970 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.970 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:33.970 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:33.970 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.970 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:33.971 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.971 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.971 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.971 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.971 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.971 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.971 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.971 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.971 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.971 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.971 INFO:teuthology.orchestra.run.smithi007.stdout: "ssl": { 2024-09-21T06:46:33.971 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ssl", 2024-09-21T06:46:33.971 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.971 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.972 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.972 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "false", 2024-09-21T06:46:33.972 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.972 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.972 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.972 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T06:46:33.972 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.972 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.972 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.972 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.972 INFO:teuthology.orchestra.run.smithi007.stdout: "threads": { 2024-09-21T06:46:33.972 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "threads", 2024-09-21T06:46:33.972 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.972 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.973 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.973 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5", 2024-09-21T06:46:33.973 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1", 2024-09-21T06:46:33.973 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "32", 2024-09-21T06:46:33.973 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.973 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-21T06:46:33.973 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.973 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.973 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.973 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.973 INFO:teuthology.orchestra.run.smithi007.stdout: "username": { 2024-09-21T06:46:33.973 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "username", 2024-09-21T06:46:33.973 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.973 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.973 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.974 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.974 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.974 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.974 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.974 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "username of InfluxDB server user", 2024-09-21T06:46:33.974 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.974 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.974 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.974 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.974 INFO:teuthology.orchestra.run.smithi007.stdout: "verify_ssl": { 2024-09-21T06:46:33.974 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "verify_ssl", 2024-09-21T06:46:33.974 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.974 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.975 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.975 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "true", 2024-09-21T06:46:33.975 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.975 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.975 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.975 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T06:46:33.975 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.975 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.975 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.975 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.975 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.975 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.975 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:33.975 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "insights", 2024-09-21T06:46:33.976 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:33.976 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:33.976 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:33.976 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:33.976 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:33.976 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.976 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.976 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.976 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.976 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.976 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.976 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.976 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.976 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.977 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.977 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.977 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.977 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.977 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.977 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.977 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.977 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.977 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.977 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.977 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:33.977 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:33.977 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.977 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.977 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.978 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.978 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.978 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.978 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.978 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.978 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.978 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.978 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.978 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.978 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:33.978 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:33.978 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.978 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.978 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.979 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:33.979 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.979 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.979 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.979 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.979 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.979 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.979 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.979 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.979 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.979 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.979 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.979 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.980 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.980 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.980 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.980 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:33.980 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:33.980 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.980 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.980 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.980 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.980 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.980 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.980 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.980 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.980 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.980 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.981 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.981 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.981 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:33.981 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:33.981 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.981 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:33.981 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.981 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.981 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.981 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.981 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.981 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.981 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.981 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.982 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.982 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.982 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.982 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.982 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:33.982 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "iostat", 2024-09-21T06:46:33.982 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:33.982 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:33.982 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:33.982 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:33.982 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:33.982 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.982 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.982 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.982 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.983 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.983 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.983 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.983 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.983 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.983 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.983 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.983 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.983 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.983 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.983 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.983 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.983 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.983 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.984 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.984 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:33.984 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:33.984 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.984 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.984 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.984 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.984 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.984 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.984 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.984 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.984 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.984 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.984 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.985 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.985 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:33.985 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:33.985 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.985 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.985 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.985 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:33.985 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.985 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.985 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.985 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.985 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.985 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.985 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.986 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.986 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.986 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.986 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.986 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.986 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.986 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.986 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.986 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:33.986 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:33.986 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.986 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.986 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.986 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.987 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.987 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.987 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.987 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.987 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.987 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.987 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.987 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.987 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:33.987 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:33.987 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.987 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:33.987 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.987 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.987 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.988 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.988 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.988 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.988 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.988 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.988 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.988 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.988 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.988 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.988 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:33.988 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "k8sevents", 2024-09-21T06:46:33.988 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:33.988 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:33.988 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:33.989 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_event_retention_days": { 2024-09-21T06:46:33.989 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "ceph_event_retention_days", 2024-09-21T06:46:33.989 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.989 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.989 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.989 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "7", 2024-09-21T06:46:33.989 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.989 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.989 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.989 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-21T06:46:33.989 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.989 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.989 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.989 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.989 INFO:teuthology.orchestra.run.smithi007.stdout: "config_check_secs": { 2024-09-21T06:46:33.990 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "config_check_secs", 2024-09-21T06:46:33.990 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.990 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.990 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:33.990 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-21T06:46:33.990 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "10", 2024-09-21T06:46:33.990 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.990 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.990 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-21T06:46:33.990 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.990 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.990 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.990 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.991 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:33.991 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:33.991 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.991 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.991 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.991 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.991 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.991 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.991 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.991 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.991 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.991 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.991 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.991 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.991 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.992 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.992 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.992 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.992 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.992 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.992 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.992 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:33.992 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:33.992 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.992 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.992 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.992 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.992 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.992 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.992 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.993 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.993 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.993 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.993 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.993 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.993 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:33.993 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:33.993 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.993 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.993 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.993 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:33.993 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.993 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.993 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.994 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.994 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.994 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.994 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.994 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.994 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.994 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.994 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.994 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.994 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.994 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.994 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.994 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:33.994 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:33.995 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.995 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.995 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.995 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:33.995 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.995 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.995 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.995 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.995 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.995 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.995 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.995 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.995 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:33.995 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:33.996 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:33.996 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:33.996 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.996 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:33.996 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.996 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.996 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.996 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.996 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.996 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.996 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.996 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.996 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:33.996 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.997 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:33.997 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "localpool", 2024-09-21T06:46:33.997 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:33.997 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:33.997 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:33.997 INFO:teuthology.orchestra.run.smithi007.stdout: "failure_domain": { 2024-09-21T06:46:33.997 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "failure_domain", 2024-09-21T06:46:33.997 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.997 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.997 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.997 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "host", 2024-09-21T06:46:33.997 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.997 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.997 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:33.997 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "failure domain for any created local pool", 2024-09-21T06:46:33.998 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-21T06:46:33.998 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.998 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.998 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.998 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:33.998 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:33.998 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:33.998 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:33.998 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:33.998 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:33.998 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:33.998 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:33.998 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:33.998 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:33.999 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:33.999 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:33.999 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:33.999 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:33.999 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:33.999 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:33.999 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:33.999 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:33.999 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:33.999 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:33.999 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:33.999 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:33.999 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:33.999 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:33.999 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.000 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.000 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:34.000 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.000 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.000 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.000 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.000 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.000 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.000 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.000 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.000 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:34.000 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:34.000 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:34.000 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.001 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.001 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:34.001 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.001 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.001 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:34.001 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:34.001 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:34.001 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:34.001 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:34.001 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:34.001 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:34.001 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:34.001 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.001 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.001 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.002 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.002 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.002 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:34.002 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:34.002 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:34.002 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.002 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.002 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:34.002 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.002 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.002 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.002 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.002 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.003 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.003 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.003 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.003 INFO:teuthology.orchestra.run.smithi007.stdout: "min_size": { 2024-09-21T06:46:34.003 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "min_size", 2024-09-21T06:46:34.003 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:34.003 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.003 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.003 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:34.003 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.003 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.003 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.003 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "default min_size for any created local pool", 2024-09-21T06:46:34.004 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-21T06:46:34.004 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.004 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.004 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.004 INFO:teuthology.orchestra.run.smithi007.stdout: "num_rep": { 2024-09-21T06:46:34.004 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "num_rep", 2024-09-21T06:46:34.004 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:34.004 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.004 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.004 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "3", 2024-09-21T06:46:34.004 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.004 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.004 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.004 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "default replica count for any created local pool", 2024-09-21T06:46:34.005 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.005 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.005 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.005 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.005 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num": { 2024-09-21T06:46:34.005 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "pg_num", 2024-09-21T06:46:34.005 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:34.005 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.005 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.005 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "128", 2024-09-21T06:46:34.005 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.005 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.005 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.005 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "default pg_num for any created local pool", 2024-09-21T06:46:34.005 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.006 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.006 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.006 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.006 INFO:teuthology.orchestra.run.smithi007.stdout: "prefix": { 2024-09-21T06:46:34.006 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "prefix", 2024-09-21T06:46:34.006 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:34.006 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.006 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.006 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:34.006 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.006 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.006 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.006 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "name prefix for any created local pool", 2024-09-21T06:46:34.006 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.007 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.007 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.007 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.007 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:34.007 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:34.007 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:34.007 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:34.007 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.007 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:34.007 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.007 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.007 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.007 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.007 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.008 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.008 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.008 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.008 INFO:teuthology.orchestra.run.smithi007.stdout: "subtree": { 2024-09-21T06:46:34.008 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "subtree", 2024-09-21T06:46:34.008 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:34.008 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.008 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.008 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "rack", 2024-09-21T06:46:34.008 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.008 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.008 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.008 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-21T06:46:34.009 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-21T06:46:34.009 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.009 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.009 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:34.009 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:34.009 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.009 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:34.009 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mds_autoscaler", 2024-09-21T06:46:34.009 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:34.009 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:34.009 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:34.009 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:34.009 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:34.010 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:34.010 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.010 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.010 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:34.010 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.010 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.010 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:34.010 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:34.010 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:34.010 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:34.010 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:34.010 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:34.010 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:34.010 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:34.011 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.011 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.011 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.011 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.011 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.011 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:34.011 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:34.011 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:34.011 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.011 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.011 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:34.011 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.011 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.011 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.012 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.012 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.012 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.012 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.012 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.012 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:34.012 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:34.012 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:34.012 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.012 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.012 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:34.012 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.012 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.012 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:34.012 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:34.013 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:34.013 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:34.013 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:34.013 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:34.013 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:34.013 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:34.013 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.013 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.013 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.013 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.013 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.013 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:34.013 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:34.013 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:34.014 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.014 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.014 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:34.014 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.014 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.014 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.014 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.014 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.014 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.014 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.014 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.014 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:34.014 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:34.015 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:34.015 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:34.015 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.015 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:34.015 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.015 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.015 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.015 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.015 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.015 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.015 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.015 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:34.015 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:34.015 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.015 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:34.016 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mirroring", 2024-09-21T06:46:34.016 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:34.016 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:34.016 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:34.016 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:34.016 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:34.016 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:34.016 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.016 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.016 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:34.016 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.016 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.016 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:34.017 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:34.017 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:34.017 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:34.017 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:34.017 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:34.017 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:34.017 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:34.017 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.017 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.017 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.017 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.017 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.017 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:34.017 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:34.017 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:34.018 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.018 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.018 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:34.018 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.018 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.018 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.018 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.018 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.018 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.018 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.018 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.018 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:34.018 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:34.018 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:34.018 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.019 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.019 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:34.019 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.019 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.019 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:34.019 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:34.019 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:34.019 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:34.019 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:34.019 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:34.019 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:34.019 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:34.019 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.019 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.020 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.020 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.020 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.020 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:34.020 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:34.020 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:34.020 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.020 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.020 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:34.020 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.020 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.020 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.020 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.020 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.020 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.020 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.021 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.021 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:34.021 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:34.021 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:34.021 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:34.021 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.021 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:34.021 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.021 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.021 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.021 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.021 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.021 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.021 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.021 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:34.021 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:34.022 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.022 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:34.022 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "nfs", 2024-09-21T06:46:34.022 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:34.022 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:34.022 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:34.022 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:34.022 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:34.022 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:34.022 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.022 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.022 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:34.022 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.022 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.022 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:34.023 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:34.023 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:34.023 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:34.023 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:34.023 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:34.023 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:34.023 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:34.023 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.023 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.023 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.023 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.023 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.023 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:34.023 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:34.023 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:34.024 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.024 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.024 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:34.024 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.024 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.024 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.024 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.024 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.024 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.024 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.024 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.024 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:34.024 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:34.024 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:34.024 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.025 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.025 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:34.025 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.025 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.025 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:34.025 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:34.025 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:34.025 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:34.025 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:34.025 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:34.025 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:34.025 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:34.025 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.026 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.026 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.026 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.026 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.026 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:34.026 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:34.026 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:34.026 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.026 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.026 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:34.026 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.026 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.026 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.026 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.026 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.027 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.027 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.027 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.027 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:34.027 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:34.027 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:34.027 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:34.027 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.027 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:34.027 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.027 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.027 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.027 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.028 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.028 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.028 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.028 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:34.028 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:34.028 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.028 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:34.028 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "orchestrator", 2024-09-21T06:46:34.028 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:34.028 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:34.028 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:34.028 INFO:teuthology.orchestra.run.smithi007.stdout: "fail_fs": { 2024-09-21T06:46:34.028 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "fail_fs", 2024-09-21T06:46:34.028 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:34.029 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.029 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:34.029 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:34.029 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.029 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.029 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.029 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-21T06:46:34.029 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.029 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.029 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.029 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.029 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:34.029 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:34.029 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:34.030 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.030 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.030 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:34.030 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.030 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.030 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:34.030 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:34.030 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:34.030 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:34.030 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:34.030 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:34.030 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:34.030 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:34.030 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.031 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.031 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.031 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.031 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.031 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:34.031 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:34.031 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:34.031 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.031 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.031 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:34.031 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.031 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.031 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.031 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.032 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.032 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.032 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.032 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.032 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:34.032 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:34.032 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:34.032 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.032 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.032 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:34.032 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.032 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.032 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:34.032 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:34.032 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:34.033 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:34.033 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:34.033 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:34.033 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:34.033 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:34.033 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.033 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.033 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.033 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.033 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.033 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:34.033 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:34.033 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:34.033 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.033 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.034 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:34.034 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.034 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.034 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.034 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.034 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.034 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.034 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.034 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.034 INFO:teuthology.orchestra.run.smithi007.stdout: "orchestrator": { 2024-09-21T06:46:34.034 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "orchestrator", 2024-09-21T06:46:34.034 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:34.034 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.034 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.034 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:34.035 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.035 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.035 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:34.035 INFO:teuthology.orchestra.run.smithi007.stdout: "cephadm", 2024-09-21T06:46:34.035 INFO:teuthology.orchestra.run.smithi007.stdout: "rook", 2024-09-21T06:46:34.035 INFO:teuthology.orchestra.run.smithi007.stdout: "test_orchestrator" 2024-09-21T06:46:34.035 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:34.035 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Orchestrator backend", 2024-09-21T06:46:34.035 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.035 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.035 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.035 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.035 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:34.035 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:34.035 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:34.036 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:34.036 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.036 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:34.036 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.036 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.036 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.036 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.036 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.036 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.036 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.036 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:34.036 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:34.036 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.037 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:34.037 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "osd_perf_query", 2024-09-21T06:46:34.037 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:34.037 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:34.037 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:34.037 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:34.037 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:34.037 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:34.037 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.037 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.037 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:34.037 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.037 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.037 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:34.038 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:34.038 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:34.038 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:34.038 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:34.038 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:34.038 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:34.038 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:34.038 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.038 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.038 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.038 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.038 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.038 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:34.038 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:34.039 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:34.039 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.039 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.039 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:34.039 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.039 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.039 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.039 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.039 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.039 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.039 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.039 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.039 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:34.039 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:34.040 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:34.040 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.040 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.040 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:34.040 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.040 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.040 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:34.040 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:34.040 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:34.040 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:34.040 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:34.040 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:34.040 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:34.041 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:34.041 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.041 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.041 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.041 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.041 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.041 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:34.041 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:34.041 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:34.041 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.041 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.041 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:34.041 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.041 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.042 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.042 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.042 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.042 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.042 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.042 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.042 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:34.042 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:34.042 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:34.042 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:34.042 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.042 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:34.042 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.042 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.043 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.043 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.043 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.043 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.043 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.043 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:34.043 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:34.043 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.043 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:34.043 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "osd_support", 2024-09-21T06:46:34.043 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:34.043 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:34.043 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:34.043 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:34.043 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:34.044 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:34.044 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.044 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.044 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:34.044 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.044 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.044 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:34.044 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:34.044 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:34.044 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:34.044 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:34.044 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:34.044 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:34.044 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:34.045 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.045 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.045 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.045 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.045 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.045 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:34.045 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:34.045 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:34.045 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.045 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.045 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:34.045 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.045 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.045 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.045 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.046 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.046 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.046 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.046 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.046 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:34.046 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:34.046 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:34.046 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.046 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.046 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:34.046 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.046 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.046 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:34.046 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:34.047 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:34.047 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:34.047 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:34.047 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:34.047 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:34.047 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:34.047 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.047 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.047 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.047 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.047 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.047 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:34.047 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:34.048 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:34.048 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.048 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.048 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:34.048 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.048 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.048 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.048 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.048 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.048 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.048 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.048 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.048 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:34.048 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:34.048 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:34.049 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:34.049 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.049 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:34.049 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.049 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.049 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.049 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.049 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.049 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.049 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.049 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:34.049 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:34.050 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.050 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:34.050 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "pg_autoscaler", 2024-09-21T06:46:34.050 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:34.050 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:34.050 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:34.050 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:34.050 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:34.050 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:34.050 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.050 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.050 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:34.050 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.051 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.051 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:34.051 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:34.051 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:34.051 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:34.051 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:34.051 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:34.051 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:34.051 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:34.051 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.051 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.051 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.051 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.051 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.051 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:34.052 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:34.052 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:34.052 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.052 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.052 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:34.052 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.052 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.052 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.052 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.052 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.052 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.052 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.052 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.052 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:34.053 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:34.053 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:34.053 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.053 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.053 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:34.053 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.053 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.053 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:34.053 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:34.053 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:34.053 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:34.053 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:34.053 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:34.053 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:34.053 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:34.054 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.054 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.054 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.054 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.054 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.054 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:34.054 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:34.054 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:34.054 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.054 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.054 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:34.054 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.054 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.054 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.055 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.055 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.055 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.055 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.055 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.055 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-09-21T06:46:34.055 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-09-21T06:46:34.055 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:46:34.055 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.055 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:34.055 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-09-21T06:46:34.055 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.055 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.055 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.056 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.056 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.056 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.056 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.056 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.056 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:34.056 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:34.056 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:34.056 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:34.056 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.056 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:34.056 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.056 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.056 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.057 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.057 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.057 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.057 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.057 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.057 INFO:teuthology.orchestra.run.smithi007.stdout: "threshold": { 2024-09-21T06:46:34.057 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "threshold", 2024-09-21T06:46:34.057 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-21T06:46:34.057 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.057 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:34.057 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "3.0", 2024-09-21T06:46:34.057 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1.0", 2024-09-21T06:46:34.057 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.057 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.058 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "scaling threshold", 2024-09-21T06:46:34.058 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-21T06:46:34.058 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.058 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.058 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:34.058 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:34.058 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.058 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:34.058 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "progress", 2024-09-21T06:46:34.058 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:34.058 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:34.058 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:34.059 INFO:teuthology.orchestra.run.smithi007.stdout: "allow_pg_recovery_event": { 2024-09-21T06:46:34.059 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "allow_pg_recovery_event", 2024-09-21T06:46:34.059 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:34.059 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.059 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.059 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:34.059 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.059 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.059 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.059 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-21T06:46:34.059 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.059 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.060 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.060 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.060 INFO:teuthology.orchestra.run.smithi007.stdout: "enabled": { 2024-09-21T06:46:34.060 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "enabled", 2024-09-21T06:46:34.060 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:34.060 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.060 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:34.060 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:34.060 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.060 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.060 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.060 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.060 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.061 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.061 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.061 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.061 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:34.061 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:34.061 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:34.061 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.061 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.061 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:34.061 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.061 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.061 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:34.061 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:34.062 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:34.062 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:34.062 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:34.062 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:34.062 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:34.062 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:34.062 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.062 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.062 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.062 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.062 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.062 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:34.062 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:34.062 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:34.063 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.063 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.063 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:34.063 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.063 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.063 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.063 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.063 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.063 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.063 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.063 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.063 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:34.063 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:34.064 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:34.064 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.064 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.064 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:34.064 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.064 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.064 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:34.064 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:34.064 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:34.064 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:34.064 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:34.064 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:34.064 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:34.064 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:34.064 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.065 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.065 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.065 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.065 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.065 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:34.065 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:34.065 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:34.065 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.065 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.065 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:34.065 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.065 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.065 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.065 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.066 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.066 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.066 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.066 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.066 INFO:teuthology.orchestra.run.smithi007.stdout: "max_completed_events": { 2024-09-21T06:46:34.066 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_completed_events", 2024-09-21T06:46:34.066 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:34.066 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.066 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.066 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "50", 2024-09-21T06:46:34.066 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.066 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.066 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.066 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "number of past completed events to remember", 2024-09-21T06:46:34.067 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.067 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.067 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.067 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.067 INFO:teuthology.orchestra.run.smithi007.stdout: "sleep_interval": { 2024-09-21T06:46:34.067 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sleep_interval", 2024-09-21T06:46:34.067 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:46:34.067 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.067 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.067 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5", 2024-09-21T06:46:34.067 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.067 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.067 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.067 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "how long the module is going to sleep", 2024-09-21T06:46:34.068 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.068 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.068 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.068 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.068 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:34.068 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:34.068 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:34.068 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:34.068 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.068 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:34.068 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.068 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.068 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.068 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.069 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.069 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.069 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.069 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:34.069 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:34.069 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.069 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:34.069 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "prometheus", 2024-09-21T06:46:34.069 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:34.069 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:34.069 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:34.069 INFO:teuthology.orchestra.run.smithi007.stdout: "cache": { 2024-09-21T06:46:34.069 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "cache", 2024-09-21T06:46:34.069 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:34.069 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.070 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:34.070 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:34.070 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.070 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.070 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.070 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.070 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.070 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.070 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.070 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.070 INFO:teuthology.orchestra.run.smithi007.stdout: "exclude_perf_counters": { 2024-09-21T06:46:34.070 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "exclude_perf_counters", 2024-09-21T06:46:34.070 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:34.071 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.071 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.071 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:34.071 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.071 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.071 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.071 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-21T06:46:34.071 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-21T06:46:34.071 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.071 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.071 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.071 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:34.071 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:34.071 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:34.072 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.072 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.072 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:34.072 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.072 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.072 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:34.072 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:34.072 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:34.072 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:34.072 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:34.072 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:34.072 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:34.072 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:34.073 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.073 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.073 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.073 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.073 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.073 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:34.073 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:34.073 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:34.073 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.073 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.073 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:34.073 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.073 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.073 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.073 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.074 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.074 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.074 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.074 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.074 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:34.074 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:34.074 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:34.074 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.074 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.074 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:34.074 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.074 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.074 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:34.074 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:34.075 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:34.075 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:34.075 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:34.075 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:34.075 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:34.075 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:34.075 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.075 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.075 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.075 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.075 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.075 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:34.075 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:34.076 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:34.076 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.076 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.076 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:34.076 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.076 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.076 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.076 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.076 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.076 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.076 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.077 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.077 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_stats_pools": { 2024-09-21T06:46:34.077 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rbd_stats_pools", 2024-09-21T06:46:34.077 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:34.077 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.077 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:34.077 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:34.077 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.077 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.077 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.077 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.077 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.077 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.078 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.078 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.078 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-21T06:46:34.078 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-21T06:46:34.078 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:34.078 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.078 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:34.078 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "300", 2024-09-21T06:46:34.078 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.078 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.078 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.078 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.078 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.079 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.079 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.079 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.079 INFO:teuthology.orchestra.run.smithi007.stdout: "scrape_interval": { 2024-09-21T06:46:34.079 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "scrape_interval", 2024-09-21T06:46:34.079 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-21T06:46:34.079 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.079 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:34.079 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "15.0", 2024-09-21T06:46:34.079 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.079 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.079 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.079 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.080 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.080 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.080 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.080 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.080 INFO:teuthology.orchestra.run.smithi007.stdout: "server_addr": { 2024-09-21T06:46:34.080 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_addr", 2024-09-21T06:46:34.080 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:34.080 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.080 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:34.080 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "::", 2024-09-21T06:46:34.080 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.080 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.080 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.080 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-21T06:46:34.081 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.081 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.081 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.081 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.081 INFO:teuthology.orchestra.run.smithi007.stdout: "server_port": { 2024-09-21T06:46:34.081 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_port", 2024-09-21T06:46:34.081 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:34.081 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.081 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.081 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "9283", 2024-09-21T06:46:34.081 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.081 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.081 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.081 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-21T06:46:34.082 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.082 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.082 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.082 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.082 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:34.082 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:34.082 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:34.082 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:34.082 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.082 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:34.082 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.082 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.083 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.083 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.083 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.083 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.083 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.083 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.083 INFO:teuthology.orchestra.run.smithi007.stdout: "stale_cache_strategy": { 2024-09-21T06:46:34.083 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "stale_cache_strategy", 2024-09-21T06:46:34.083 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:34.083 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.083 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:34.083 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "log", 2024-09-21T06:46:34.083 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.084 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.084 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.084 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.084 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.084 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.084 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.084 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.084 INFO:teuthology.orchestra.run.smithi007.stdout: "standby_behaviour": { 2024-09-21T06:46:34.084 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "standby_behaviour", 2024-09-21T06:46:34.084 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:34.084 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.084 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.084 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "default", 2024-09-21T06:46:34.084 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.084 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.085 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:34.085 INFO:teuthology.orchestra.run.smithi007.stdout: "default", 2024-09-21T06:46:34.085 INFO:teuthology.orchestra.run.smithi007.stdout: "error" 2024-09-21T06:46:34.085 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:34.085 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.085 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.085 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.085 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.085 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.085 INFO:teuthology.orchestra.run.smithi007.stdout: "standby_error_status_code": { 2024-09-21T06:46:34.085 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "standby_error_status_code", 2024-09-21T06:46:34.085 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:34.085 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.085 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.086 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "500", 2024-09-21T06:46:34.086 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "400", 2024-09-21T06:46:34.086 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "599", 2024-09-21T06:46:34.086 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.086 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.086 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.086 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.086 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.086 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:34.086 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:34.086 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.086 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:34.086 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rbd_support", 2024-09-21T06:46:34.086 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:34.087 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:34.087 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:34.087 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:34.087 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:34.087 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:34.087 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.087 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.087 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:34.087 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.087 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.087 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:34.087 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:34.087 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:34.087 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:34.088 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:34.088 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:34.088 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:34.088 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:34.088 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.088 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.088 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.088 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.088 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.088 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:34.088 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:34.088 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:34.088 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.088 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.088 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:34.089 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.089 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.089 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.089 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.089 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.089 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.089 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.089 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.089 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:34.089 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:34.089 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:34.089 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.089 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.089 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:34.090 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.090 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.090 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:34.090 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:34.090 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:34.090 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:34.090 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:34.090 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:34.090 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:34.090 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:34.090 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.090 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.090 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.090 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.091 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.091 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:34.091 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:34.091 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:34.091 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.091 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.091 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:34.091 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.091 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.091 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.091 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.091 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.091 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.091 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.091 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.092 INFO:teuthology.orchestra.run.smithi007.stdout: "max_concurrent_snap_create": { 2024-09-21T06:46:34.092 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_concurrent_snap_create", 2024-09-21T06:46:34.092 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:34.092 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.092 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:34.092 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10", 2024-09-21T06:46:34.092 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.092 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.092 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.092 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.092 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.092 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.092 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.092 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.093 INFO:teuthology.orchestra.run.smithi007.stdout: "mirror_snapshot_schedule": { 2024-09-21T06:46:34.093 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mirror_snapshot_schedule", 2024-09-21T06:46:34.093 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:34.093 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.093 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:34.093 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:34.093 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.093 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.093 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.093 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.093 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.093 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.093 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.093 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.093 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:34.094 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:34.094 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:34.094 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:34.094 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.094 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:34.094 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.094 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.094 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.094 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.094 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.094 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.094 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.094 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.094 INFO:teuthology.orchestra.run.smithi007.stdout: "trash_purge_schedule": { 2024-09-21T06:46:34.095 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "trash_purge_schedule", 2024-09-21T06:46:34.095 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:34.095 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.095 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:34.095 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:34.095 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.095 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.095 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.095 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.095 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.095 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.095 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.095 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:34.095 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:34.096 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.096 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:34.096 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "restful", 2024-09-21T06:46:34.096 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:34.096 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:34.096 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:34.096 INFO:teuthology.orchestra.run.smithi007.stdout: "enable_auth": { 2024-09-21T06:46:34.096 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "enable_auth", 2024-09-21T06:46:34.096 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:34.096 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.096 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:34.096 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:34.096 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.097 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.097 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.097 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.097 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.097 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.097 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.097 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.097 INFO:teuthology.orchestra.run.smithi007.stdout: "key_file": { 2024-09-21T06:46:34.097 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "key_file", 2024-09-21T06:46:34.097 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:34.097 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.097 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:34.097 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:34.097 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.098 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.098 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.098 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.098 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.098 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.098 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.098 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.098 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:34.098 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:34.098 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:34.098 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.098 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.098 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:34.098 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.099 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.099 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:34.099 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:34.099 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:34.099 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:34.099 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:34.099 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:34.099 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:34.099 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:34.099 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.099 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.099 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.099 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.099 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.099 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:34.100 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:34.100 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:34.100 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.100 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.100 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:34.100 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.100 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.100 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.100 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.100 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.100 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.100 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.100 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.100 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:34.100 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:34.101 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:34.101 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.101 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.101 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:34.101 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.101 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.101 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:34.101 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:34.101 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:34.101 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:34.101 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:34.101 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:34.101 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:34.101 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:34.101 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.102 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.102 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.102 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.102 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.102 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:34.102 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:34.102 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:34.102 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.102 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.102 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:34.102 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.102 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.102 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.103 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.103 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.103 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.103 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.103 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.103 INFO:teuthology.orchestra.run.smithi007.stdout: "max_requests": { 2024-09-21T06:46:34.103 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_requests", 2024-09-21T06:46:34.103 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:34.103 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.103 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:34.103 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "500", 2024-09-21T06:46:34.103 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.103 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.103 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.103 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-21T06:46:34.104 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.104 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.104 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.104 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.104 INFO:teuthology.orchestra.run.smithi007.stdout: "server_addr": { 2024-09-21T06:46:34.104 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_addr", 2024-09-21T06:46:34.104 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:34.104 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.104 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:34.104 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:34.104 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.104 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.104 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.104 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.104 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.104 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.105 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.105 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.105 INFO:teuthology.orchestra.run.smithi007.stdout: "server_port": { 2024-09-21T06:46:34.105 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "server_port", 2024-09-21T06:46:34.105 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:34.105 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.105 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:34.105 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:34.105 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.105 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.105 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.105 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.105 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.105 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.105 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.106 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.106 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:34.106 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:34.106 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:34.106 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:34.106 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.106 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:34.106 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.106 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.106 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.106 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.106 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.106 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.107 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.107 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:34.107 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:34.107 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.107 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:34.107 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rgw", 2024-09-21T06:46:34.107 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:34.107 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:34.107 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:34.107 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:34.107 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:34.107 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:34.107 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.107 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.108 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:34.108 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.108 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.108 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:34.108 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:34.108 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:34.108 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:34.108 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:34.108 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:34.108 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:34.108 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:34.108 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.108 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.108 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.109 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.109 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.109 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:34.109 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:34.109 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:34.109 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.109 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.109 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:34.109 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.109 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.109 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.109 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.109 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.109 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.110 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.110 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.110 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:34.110 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:34.110 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:34.110 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.110 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.110 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:34.110 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.110 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.110 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:34.110 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:34.110 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:34.111 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:34.111 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:34.111 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:34.111 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:34.111 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:34.111 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.111 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.111 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.111 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.111 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.111 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:34.111 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:34.111 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:34.111 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.112 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.112 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:34.112 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.112 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.112 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.112 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.112 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.112 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.112 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.112 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.112 INFO:teuthology.orchestra.run.smithi007.stdout: "secondary_zone_period_retry_limit": { 2024-09-21T06:46:34.112 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-21T06:46:34.112 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:34.112 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.112 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:34.113 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "5", 2024-09-21T06:46:34.113 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.113 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.113 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.113 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-21T06:46:34.113 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.113 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.113 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.113 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.113 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:34.113 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:34.113 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:34.113 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:34.113 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.114 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:34.114 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.114 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.114 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.114 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.114 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.114 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.114 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.114 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:34.114 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:34.114 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.114 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:34.114 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rook", 2024-09-21T06:46:34.114 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:34.115 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:34.115 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:34.115 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:34.115 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:34.115 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:34.115 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.115 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.115 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:34.115 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.115 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.115 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:34.115 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:34.115 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:34.115 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:34.116 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:34.116 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:34.116 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:34.116 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:34.116 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.116 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.116 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.116 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.116 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.116 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:34.116 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:34.116 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:34.116 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.116 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.117 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:34.117 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.117 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.117 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.117 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.117 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.117 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.117 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.117 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.117 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:34.117 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:34.117 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:34.117 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.117 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.117 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:34.118 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.118 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.118 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:34.118 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:34.118 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:34.118 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:34.118 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:34.118 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:34.118 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:34.118 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:34.118 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.118 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.118 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.118 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.119 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.119 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:34.119 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:34.119 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:34.119 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.119 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.119 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:34.119 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.119 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.119 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.119 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.119 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.119 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.119 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.119 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.120 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:34.120 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:34.120 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:34.120 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:34.120 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.120 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:34.120 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.120 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.120 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.120 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.120 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.120 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.120 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.120 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.120 INFO:teuthology.orchestra.run.smithi007.stdout: "storage_class": { 2024-09-21T06:46:34.121 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "storage_class", 2024-09-21T06:46:34.121 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:34.121 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.121 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:34.121 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "local", 2024-09-21T06:46:34.121 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.121 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.121 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.121 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-21T06:46:34.121 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.121 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.121 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.121 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:34.122 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:34.122 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.122 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:34.122 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "selftest", 2024-09-21T06:46:34.122 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:34.122 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:34.122 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:34.122 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:34.122 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:34.122 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:34.122 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.122 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.122 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:34.123 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.123 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.123 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:34.123 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:34.123 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:34.123 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:34.123 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:34.123 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:34.123 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:34.123 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:34.123 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.123 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.123 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.124 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.124 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.124 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:34.124 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:34.124 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:34.124 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.124 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.124 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:34.124 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.124 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.124 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.124 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.124 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.124 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.125 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.125 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.125 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:34.125 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:34.125 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:34.125 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.125 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.125 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:34.125 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.125 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.125 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:34.125 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:34.125 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:34.126 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:34.126 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:34.126 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:34.126 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:34.126 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:34.126 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.126 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.126 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.126 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.126 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.126 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:34.126 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:34.126 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:34.126 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.127 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.127 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:34.127 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.127 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.127 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.127 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.127 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.127 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.127 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.127 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.127 INFO:teuthology.orchestra.run.smithi007.stdout: "roption1": { 2024-09-21T06:46:34.127 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "roption1", 2024-09-21T06:46:34.127 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:34.128 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.128 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:34.128 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:34.128 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.128 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.128 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.128 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.128 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.128 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.128 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.128 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.128 INFO:teuthology.orchestra.run.smithi007.stdout: "roption2": { 2024-09-21T06:46:34.128 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "roption2", 2024-09-21T06:46:34.128 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:34.129 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.129 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:34.129 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "xyz", 2024-09-21T06:46:34.129 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.129 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.129 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.129 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.129 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.129 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.129 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.129 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.129 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption1": { 2024-09-21T06:46:34.129 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption1", 2024-09-21T06:46:34.130 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:34.130 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.130 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:34.130 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:34.130 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.130 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.130 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.130 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.130 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.130 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.130 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.130 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.130 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption2": { 2024-09-21T06:46:34.130 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption2", 2024-09-21T06:46:34.131 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:34.131 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.131 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:34.131 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:34.131 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.131 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.131 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.131 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.131 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.131 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.131 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.131 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.131 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption3": { 2024-09-21T06:46:34.131 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption3", 2024-09-21T06:46:34.131 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "float", 2024-09-21T06:46:34.132 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.132 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:34.132 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:34.132 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.132 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.132 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.132 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.132 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.132 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.132 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.132 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.132 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption4": { 2024-09-21T06:46:34.132 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption4", 2024-09-21T06:46:34.132 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:34.132 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.133 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:34.133 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:34.133 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.133 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.133 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.133 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.133 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.133 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.133 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.133 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.133 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption5": { 2024-09-21T06:46:34.133 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption5", 2024-09-21T06:46:34.133 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:34.133 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.133 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:34.134 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:34.134 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.134 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.134 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.134 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.134 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.134 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.134 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.134 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.134 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption6": { 2024-09-21T06:46:34.134 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption6", 2024-09-21T06:46:34.134 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:34.134 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.134 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:34.135 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:34.135 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.135 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.135 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.135 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.135 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.135 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.135 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.135 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.135 INFO:teuthology.orchestra.run.smithi007.stdout: "rwoption7": { 2024-09-21T06:46:34.135 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rwoption7", 2024-09-21T06:46:34.135 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:34.135 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.135 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:34.136 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:34.136 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "1", 2024-09-21T06:46:34.136 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "42", 2024-09-21T06:46:34.136 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.136 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.136 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.136 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.136 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.136 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.136 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:34.136 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:34.136 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:34.136 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:34.136 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.137 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:34.137 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.137 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.137 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.137 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.137 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.137 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.137 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.137 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.137 INFO:teuthology.orchestra.run.smithi007.stdout: "testkey": { 2024-09-21T06:46:34.137 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "testkey", 2024-09-21T06:46:34.137 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:34.137 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.137 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:34.138 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:34.138 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.138 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.138 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.138 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.138 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.138 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.138 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.138 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.138 INFO:teuthology.orchestra.run.smithi007.stdout: "testlkey": { 2024-09-21T06:46:34.138 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "testlkey", 2024-09-21T06:46:34.138 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:34.138 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.138 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:34.139 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:34.139 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.139 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.139 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.139 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.139 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.139 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.139 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.139 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.139 INFO:teuthology.orchestra.run.smithi007.stdout: "testnewline": { 2024-09-21T06:46:34.139 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "testnewline", 2024-09-21T06:46:34.139 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:34.139 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.140 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:34.140 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:34.140 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.140 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.140 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.140 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.140 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.140 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.140 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.140 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:34.140 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:34.140 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.140 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:34.141 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "smb", 2024-09-21T06:46:34.141 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:34.141 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:34.141 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:34.141 INFO:teuthology.orchestra.run.smithi007.stdout: "internal_store_backend": { 2024-09-21T06:46:34.141 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "internal_store_backend", 2024-09-21T06:46:34.141 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:34.141 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:34.141 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:34.141 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:34.141 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.141 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.141 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.141 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-21T06:46:34.141 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.142 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.142 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.142 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.142 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:34.142 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:34.142 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:34.142 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.142 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.142 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:34.142 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.142 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.142 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:34.142 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:34.142 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:34.143 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:34.143 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:34.143 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:34.143 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:34.143 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:34.143 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.143 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.143 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.143 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.143 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.143 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:34.143 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:34.143 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:34.143 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.143 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.144 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:34.144 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.144 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.144 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.144 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.144 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.144 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.144 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.144 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.144 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:34.144 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:34.144 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:34.144 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.144 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.145 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:34.145 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.145 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.145 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:34.145 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:34.145 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:34.145 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:34.145 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:34.145 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:34.145 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:34.145 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:34.145 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.145 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.145 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.146 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.146 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.146 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:34.146 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:34.146 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:34.146 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.146 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.146 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:34.146 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.146 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.146 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.146 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.146 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.146 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.147 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.147 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.147 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:34.147 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:34.147 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:34.147 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:34.147 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.147 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:34.147 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.147 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.147 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.147 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.147 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.147 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.147 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.148 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.148 INFO:teuthology.orchestra.run.smithi007.stdout: "update_orchestration": { 2024-09-21T06:46:34.148 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "update_orchestration", 2024-09-21T06:46:34.148 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:34.148 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.148 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:34.148 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:34.148 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.148 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.148 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.148 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-21T06:46:34.148 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.148 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.148 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.148 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:34.149 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:34.149 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.149 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:34.149 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "snap_schedule", 2024-09-21T06:46:34.149 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:34.149 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:34.149 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:34.149 INFO:teuthology.orchestra.run.smithi007.stdout: "allow_m_granularity": { 2024-09-21T06:46:34.149 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "allow_m_granularity", 2024-09-21T06:46:34.149 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:34.149 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.149 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.149 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:34.149 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.149 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.149 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.150 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "allow minute scheduled snapshots", 2024-09-21T06:46:34.150 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.150 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.150 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.150 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.150 INFO:teuthology.orchestra.run.smithi007.stdout: "dump_on_update": { 2024-09-21T06:46:34.150 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "dump_on_update", 2024-09-21T06:46:34.150 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:34.150 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.150 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.150 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:34.150 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.150 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.150 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.150 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "dump database to debug log on update", 2024-09-21T06:46:34.150 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.151 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.151 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.151 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.151 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:34.151 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:34.151 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:34.151 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.151 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.151 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:34.151 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.151 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.151 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:34.151 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:34.151 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:34.152 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:34.152 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:34.152 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:34.152 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:34.152 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:34.152 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.152 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.152 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.152 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.152 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.152 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:34.152 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:34.152 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:34.152 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.152 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.153 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:34.153 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.153 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.153 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.153 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.153 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.153 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.153 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.153 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.153 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:34.153 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:34.153 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:34.153 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.153 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.153 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:34.154 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.154 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.154 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:34.154 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:34.154 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:34.154 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:34.154 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:34.154 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:34.154 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:34.154 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:34.154 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.154 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.154 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.154 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.155 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.155 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:34.155 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:34.155 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:34.155 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.155 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.155 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:34.155 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.155 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.155 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.155 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.155 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.155 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.155 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.155 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.156 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:34.156 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:34.156 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:34.156 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:34.156 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.156 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:34.156 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.156 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.156 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.156 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.156 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.156 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.156 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.156 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:34.157 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:34.157 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.157 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:34.157 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "stats", 2024-09-21T06:46:34.157 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:34.157 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:34.157 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:34.157 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:34.157 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:34.157 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:34.157 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.157 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.157 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:34.157 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.158 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.158 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:34.158 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:34.158 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:34.158 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:34.158 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:34.158 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:34.158 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:34.158 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:34.158 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.158 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.158 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.158 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.158 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.159 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:34.159 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:34.159 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:34.159 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.159 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.159 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:34.159 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.159 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.159 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.159 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.159 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.159 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.159 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.159 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.160 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:34.160 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:34.160 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:34.160 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.160 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.160 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:34.160 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.160 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.160 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:34.160 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:34.160 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:34.160 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:34.160 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:34.160 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:34.160 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:34.161 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:34.161 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.161 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.161 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.161 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.161 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.161 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:34.161 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:34.161 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:34.161 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.161 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.161 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:34.161 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.161 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.162 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.162 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.162 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.162 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.162 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.162 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.162 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:34.162 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:34.162 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:34.162 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:34.162 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.162 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:34.162 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.162 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.163 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.163 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.163 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.163 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.163 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.163 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:34.163 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:34.163 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.163 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:34.163 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "status", 2024-09-21T06:46:34.163 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:34.163 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:34.163 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:34.163 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:34.164 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:34.164 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:34.164 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.164 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.164 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:34.164 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.164 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.164 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:34.164 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:34.164 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:34.164 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:34.164 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:34.164 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:34.164 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:34.165 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:34.165 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.165 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.165 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.165 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.165 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.165 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:34.165 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:34.165 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:34.165 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.165 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.165 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:34.165 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.165 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.166 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.166 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.166 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.166 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.166 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.166 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.166 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:34.166 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:34.166 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:34.166 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.166 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.166 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:34.166 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.166 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.166 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:34.167 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:34.167 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:34.167 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:34.167 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:34.167 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:34.167 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:34.167 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:34.167 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.167 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.167 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.167 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.167 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.167 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:34.167 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:34.168 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:34.168 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.168 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.168 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:34.168 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.168 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.168 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.168 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.168 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.168 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.168 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.168 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.168 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:34.169 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:34.169 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:34.169 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:34.169 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.169 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:34.169 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.169 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.169 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.169 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.169 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.169 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.169 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.169 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:34.169 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:34.169 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.169 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:34.170 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "telegraf", 2024-09-21T06:46:34.170 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:34.170 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:34.170 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:34.170 INFO:teuthology.orchestra.run.smithi007.stdout: "address": { 2024-09-21T06:46:34.170 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "address", 2024-09-21T06:46:34.170 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:34.170 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.170 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:34.170 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-21T06:46:34.170 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.170 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.170 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.170 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.171 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.171 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.171 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.171 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.171 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-09-21T06:46:34.171 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-09-21T06:46:34.171 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:46:34.171 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.171 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:34.171 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "15", 2024-09-21T06:46:34.171 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.171 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.171 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.171 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.172 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.172 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.172 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.172 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.172 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:34.172 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:34.172 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:34.172 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.172 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.172 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:34.172 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.172 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.172 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:34.172 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:34.173 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:34.173 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:34.173 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:34.173 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:34.173 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:34.173 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:34.173 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.173 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.173 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.173 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.173 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.173 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:34.173 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:34.173 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:34.173 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.174 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.174 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:34.174 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.174 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.174 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.174 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.174 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.174 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.174 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.174 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.174 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:34.174 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:34.174 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:34.174 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.175 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.175 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:34.175 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.175 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.175 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:34.175 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:34.175 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:34.175 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:34.175 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:34.175 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:34.175 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:34.175 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:34.175 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.175 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.175 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.176 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.176 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.176 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:34.176 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:34.176 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:34.176 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.176 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.176 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:34.176 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.176 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.176 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.176 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.176 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.176 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.176 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.177 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.177 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:34.177 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:34.177 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:34.177 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:34.177 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.177 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:34.177 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.177 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.177 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.177 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.177 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.177 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.177 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.178 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:34.178 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:34.178 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.178 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:34.178 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "telemetry", 2024-09-21T06:46:34.178 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:34.178 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:34.178 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:34.178 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_basic": { 2024-09-21T06:46:34.178 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_basic", 2024-09-21T06:46:34.178 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:34.178 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.178 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:34.178 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:34.179 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.179 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.179 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.179 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-21T06:46:34.179 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.179 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.179 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.179 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.179 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_crash": { 2024-09-21T06:46:34.179 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_crash", 2024-09-21T06:46:34.179 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:34.179 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.179 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:34.179 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:34.180 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.180 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.180 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.180 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-21T06:46:34.180 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.180 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.180 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.180 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.180 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_device": { 2024-09-21T06:46:34.180 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_device", 2024-09-21T06:46:34.180 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:34.180 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.180 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:34.181 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:34.181 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.181 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.181 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.181 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-21T06:46:34.181 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.181 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.181 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.181 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.181 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_ident": { 2024-09-21T06:46:34.181 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_ident", 2024-09-21T06:46:34.181 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:34.181 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.181 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:34.182 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:34.182 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.182 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.182 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.182 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-21T06:46:34.182 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.182 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.182 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.182 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.182 INFO:teuthology.orchestra.run.smithi007.stdout: "channel_perf": { 2024-09-21T06:46:34.182 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "channel_perf", 2024-09-21T06:46:34.182 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:34.182 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.182 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:34.183 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:34.183 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.183 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.183 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.183 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-21T06:46:34.183 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.183 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.183 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.183 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.183 INFO:teuthology.orchestra.run.smithi007.stdout: "contact": { 2024-09-21T06:46:34.183 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "contact", 2024-09-21T06:46:34.183 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:34.183 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.183 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:34.184 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:34.184 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.184 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.184 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.184 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.184 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.184 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.184 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.184 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.184 INFO:teuthology.orchestra.run.smithi007.stdout: "description": { 2024-09-21T06:46:34.184 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "description", 2024-09-21T06:46:34.184 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:34.184 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.184 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:34.185 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:34.185 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.185 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.185 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.185 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.185 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.185 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.185 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.185 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.185 INFO:teuthology.orchestra.run.smithi007.stdout: "device_url": { 2024-09-21T06:46:34.185 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "device_url", 2024-09-21T06:46:34.185 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:34.185 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.185 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:34.186 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-21T06:46:34.186 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.186 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.186 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.186 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.186 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.186 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.186 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.186 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.186 INFO:teuthology.orchestra.run.smithi007.stdout: "enabled": { 2024-09-21T06:46:34.186 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "enabled", 2024-09-21T06:46:34.186 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:34.186 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.186 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:34.186 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:34.187 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.187 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.187 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.187 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.187 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.187 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.187 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.187 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.187 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-09-21T06:46:34.187 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-09-21T06:46:34.187 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:34.187 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.187 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:34.188 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "24", 2024-09-21T06:46:34.188 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "8", 2024-09-21T06:46:34.188 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.188 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.188 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.188 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.188 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.188 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.188 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.188 INFO:teuthology.orchestra.run.smithi007.stdout: "last_opt_revision": { 2024-09-21T06:46:34.188 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "last_opt_revision", 2024-09-21T06:46:34.188 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:34.188 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.188 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:34.189 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "1", 2024-09-21T06:46:34.189 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.189 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.189 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.189 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.189 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.189 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.189 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.189 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.189 INFO:teuthology.orchestra.run.smithi007.stdout: "leaderboard": { 2024-09-21T06:46:34.189 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "leaderboard", 2024-09-21T06:46:34.189 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:34.189 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.189 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:34.190 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:34.190 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.190 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.190 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.190 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.190 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.190 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.190 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.190 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.190 INFO:teuthology.orchestra.run.smithi007.stdout: "leaderboard_description": { 2024-09-21T06:46:34.190 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "leaderboard_description", 2024-09-21T06:46:34.190 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:34.190 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.190 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:34.191 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:34.191 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.191 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.191 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.191 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.191 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.191 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.191 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.191 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.191 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:34.191 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:34.191 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:34.191 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.191 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.192 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:34.192 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.192 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.192 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:34.192 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:34.192 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:34.192 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:34.192 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:34.192 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:34.192 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:34.192 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:34.192 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.192 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.192 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.193 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.193 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.193 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:34.193 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:34.193 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:34.193 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.193 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.193 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:34.193 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.193 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.193 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.193 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.193 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.193 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.193 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.194 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.194 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:34.194 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:34.194 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:34.194 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.194 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.194 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:34.194 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.194 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.194 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:34.194 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:34.194 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:34.194 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:34.195 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:34.195 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:34.195 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:34.195 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:34.195 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.195 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.195 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.195 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.195 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.195 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:34.195 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:34.195 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:34.195 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.195 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.196 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:34.196 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.196 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.196 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.196 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.196 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.196 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.196 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.196 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.196 INFO:teuthology.orchestra.run.smithi007.stdout: "organization": { 2024-09-21T06:46:34.196 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "organization", 2024-09-21T06:46:34.196 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:34.196 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.197 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:34.197 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:34.197 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.197 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.197 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.197 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.197 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.197 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.197 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.197 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.197 INFO:teuthology.orchestra.run.smithi007.stdout: "proxy": { 2024-09-21T06:46:34.197 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "proxy", 2024-09-21T06:46:34.197 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:34.197 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.197 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:34.198 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:34.198 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.198 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.198 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.198 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.198 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.198 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.198 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.198 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.198 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:34.198 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:34.198 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:34.198 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:34.199 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.199 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:34.199 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.199 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.199 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.199 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.199 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.199 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.199 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.199 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.199 INFO:teuthology.orchestra.run.smithi007.stdout: "url": { 2024-09-21T06:46:34.199 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "url", 2024-09-21T06:46:34.199 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:34.199 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.199 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:34.200 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-21T06:46:34.200 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.200 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.200 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.200 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.200 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.200 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.200 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.200 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:34.200 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:34.200 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.200 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:34.200 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "test_orchestrator", 2024-09-21T06:46:34.200 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:34.201 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:34.201 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:34.201 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:34.201 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:34.201 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:34.201 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.201 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.201 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:34.201 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.201 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.201 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:34.201 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:34.201 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:34.201 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:34.201 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:34.202 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:34.202 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:34.202 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:34.202 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.202 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.202 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.202 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.202 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.202 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:34.202 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:34.202 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:34.202 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.202 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.202 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:34.203 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.203 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.203 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.203 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.203 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.203 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.203 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.203 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.203 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:34.203 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:34.203 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:34.203 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.203 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.203 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:34.204 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.204 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.204 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:34.204 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:34.204 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:34.204 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:34.204 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:34.204 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:34.204 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:34.204 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:34.204 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.204 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.204 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.204 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.204 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.205 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:34.205 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:34.205 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:34.205 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.205 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.205 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:34.205 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.205 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.205 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.205 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.205 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.205 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.205 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.205 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.205 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:34.206 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:34.206 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:34.206 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:34.206 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.206 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:34.206 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.206 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.206 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.206 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.206 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.206 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.206 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.206 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:34.206 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:34.207 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.207 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:34.207 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "volumes", 2024-09-21T06:46:34.207 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:34.207 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:34.207 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:34.207 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:34.207 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:34.207 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:34.207 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.207 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.207 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:34.207 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.207 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.208 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:34.208 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:34.208 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:34.208 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:34.208 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:34.208 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:34.208 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:34.208 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:34.208 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.208 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.208 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.208 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.208 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.208 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:34.208 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:34.209 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:34.209 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.209 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.209 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:34.209 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.209 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.209 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.209 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.209 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.209 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.209 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.209 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.209 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:34.209 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:34.210 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:34.210 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.210 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.210 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:34.210 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.210 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.210 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:34.210 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:34.210 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:34.210 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:34.210 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:34.210 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:34.210 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:34.211 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:34.211 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.211 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.211 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.211 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.211 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.211 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:34.211 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:34.211 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:34.211 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.211 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.211 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:34.211 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.211 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.211 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.212 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.212 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.212 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.212 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.212 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.212 INFO:teuthology.orchestra.run.smithi007.stdout: "max_concurrent_clones": { 2024-09-21T06:46:34.212 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "max_concurrent_clones", 2024-09-21T06:46:34.212 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:34.212 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.212 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:34.212 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "4", 2024-09-21T06:46:34.212 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.212 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.212 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.213 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-21T06:46:34.213 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.213 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.213 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.213 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.213 INFO:teuthology.orchestra.run.smithi007.stdout: "periodic_async_work": { 2024-09-21T06:46:34.213 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "periodic_async_work", 2024-09-21T06:46:34.213 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:34.213 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.213 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:34.213 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:34.213 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.213 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.213 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.214 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Periodically check for async work", 2024-09-21T06:46:34.214 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.214 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.214 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.214 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.214 INFO:teuthology.orchestra.run.smithi007.stdout: "snapshot_clone_delay": { 2024-09-21T06:46:34.214 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "snapshot_clone_delay", 2024-09-21T06:46:34.214 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:34.214 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.214 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:34.214 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:34.214 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.214 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.214 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.215 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-21T06:46:34.215 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.215 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.215 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.215 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.215 INFO:teuthology.orchestra.run.smithi007.stdout: "snapshot_clone_no_wait": { 2024-09-21T06:46:34.215 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "snapshot_clone_no_wait", 2024-09-21T06:46:34.215 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:34.215 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.215 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:34.215 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "True", 2024-09-21T06:46:34.215 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.215 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.215 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.215 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-21T06:46:34.216 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.216 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.216 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.216 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.216 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:34.216 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:34.216 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:34.216 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:34.216 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.216 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:34.216 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.216 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.216 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.216 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.217 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.217 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.217 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.217 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:34.217 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:34.217 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.217 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:34.217 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "zabbix", 2024-09-21T06:46:34.217 INFO:teuthology.orchestra.run.smithi007.stdout: "can_run": true, 2024-09-21T06:46:34.217 INFO:teuthology.orchestra.run.smithi007.stdout: "error_string": "", 2024-09-21T06:46:34.217 INFO:teuthology.orchestra.run.smithi007.stdout: "module_options": { 2024-09-21T06:46:34.217 INFO:teuthology.orchestra.run.smithi007.stdout: "discovery_interval": { 2024-09-21T06:46:34.217 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "discovery_interval", 2024-09-21T06:46:34.217 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "uint", 2024-09-21T06:46:34.218 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.218 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:34.218 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "100", 2024-09-21T06:46:34.218 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.218 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.218 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.218 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.218 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.218 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.218 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.218 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.218 INFO:teuthology.orchestra.run.smithi007.stdout: "identifier": { 2024-09-21T06:46:34.218 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "identifier", 2024-09-21T06:46:34.219 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:34.219 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.219 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:34.219 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:34.219 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.219 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.219 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.219 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.219 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.219 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.219 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.219 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.219 INFO:teuthology.orchestra.run.smithi007.stdout: "interval": { 2024-09-21T06:46:34.219 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "interval", 2024-09-21T06:46:34.220 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "secs", 2024-09-21T06:46:34.220 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.220 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:34.220 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "60", 2024-09-21T06:46:34.220 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.220 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.220 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.220 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.220 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.220 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.220 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.220 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.220 INFO:teuthology.orchestra.run.smithi007.stdout: "log_level": { 2024-09-21T06:46:34.220 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_level", 2024-09-21T06:46:34.221 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:34.221 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.221 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.221 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:34.221 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.221 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.221 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:34.221 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:34.221 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:34.221 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:34.221 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:34.221 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:34.221 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:34.221 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:34.222 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.222 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.222 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.222 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.222 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.222 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster": { 2024-09-21T06:46:34.222 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster", 2024-09-21T06:46:34.222 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:34.222 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.222 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.222 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:34.222 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.222 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.222 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.223 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.223 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.223 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.223 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.223 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.223 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_cluster_level": { 2024-09-21T06:46:34.223 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_cluster_level", 2024-09-21T06:46:34.223 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:34.223 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.223 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.223 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "info", 2024-09-21T06:46:34.223 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.223 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.224 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [ 2024-09-21T06:46:34.224 INFO:teuthology.orchestra.run.smithi007.stdout: "", 2024-09-21T06:46:34.224 INFO:teuthology.orchestra.run.smithi007.stdout: "critical", 2024-09-21T06:46:34.224 INFO:teuthology.orchestra.run.smithi007.stdout: "debug", 2024-09-21T06:46:34.224 INFO:teuthology.orchestra.run.smithi007.stdout: "error", 2024-09-21T06:46:34.224 INFO:teuthology.orchestra.run.smithi007.stdout: "info", 2024-09-21T06:46:34.224 INFO:teuthology.orchestra.run.smithi007.stdout: "warning" 2024-09-21T06:46:34.224 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:34.224 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.224 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.224 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.224 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.224 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.224 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": { 2024-09-21T06:46:34.225 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "log_to_file", 2024-09-21T06:46:34.225 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "bool", 2024-09-21T06:46:34.225 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.225 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.225 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "False", 2024-09-21T06:46:34.225 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.225 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.225 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.225 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.225 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.225 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.225 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.225 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.226 INFO:teuthology.orchestra.run.smithi007.stdout: "sqlite3_killpoint": { 2024-09-21T06:46:34.226 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "sqlite3_killpoint", 2024-09-21T06:46:34.226 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:34.226 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "dev", 2024-09-21T06:46:34.226 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2024-09-21T06:46:34.226 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "0", 2024-09-21T06:46:34.226 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.226 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.226 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.226 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.226 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.226 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.226 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.226 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.227 INFO:teuthology.orchestra.run.smithi007.stdout: "zabbix_host": { 2024-09-21T06:46:34.227 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "zabbix_host", 2024-09-21T06:46:34.227 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:34.227 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.227 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:34.227 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "", 2024-09-21T06:46:34.227 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.227 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.227 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.227 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.227 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.227 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.227 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.227 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.228 INFO:teuthology.orchestra.run.smithi007.stdout: "zabbix_port": { 2024-09-21T06:46:34.228 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "zabbix_port", 2024-09-21T06:46:34.228 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "int", 2024-09-21T06:46:34.228 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.228 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:34.228 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "10051", 2024-09-21T06:46:34.228 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.228 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.228 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.228 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.228 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.228 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.228 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.228 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.229 INFO:teuthology.orchestra.run.smithi007.stdout: "zabbix_sender": { 2024-09-21T06:46:34.229 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "zabbix_sender", 2024-09-21T06:46:34.229 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "str", 2024-09-21T06:46:34.229 INFO:teuthology.orchestra.run.smithi007.stdout: "level": "advanced", 2024-09-21T06:46:34.229 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 0, 2024-09-21T06:46:34.229 INFO:teuthology.orchestra.run.smithi007.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-21T06:46:34.229 INFO:teuthology.orchestra.run.smithi007.stdout: "min": "", 2024-09-21T06:46:34.229 INFO:teuthology.orchestra.run.smithi007.stdout: "max": "", 2024-09-21T06:46:34.229 INFO:teuthology.orchestra.run.smithi007.stdout: "enum_allowed": [], 2024-09-21T06:46:34.229 INFO:teuthology.orchestra.run.smithi007.stdout: "desc": "", 2024-09-21T06:46:34.229 INFO:teuthology.orchestra.run.smithi007.stdout: "long_desc": "", 2024-09-21T06:46:34.229 INFO:teuthology.orchestra.run.smithi007.stdout: "tags": [], 2024-09-21T06:46:34.229 INFO:teuthology.orchestra.run.smithi007.stdout: "see_also": [] 2024-09-21T06:46:34.229 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:34.230 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:34.230 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:34.230 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:34.230 INFO:teuthology.orchestra.run.smithi007.stdout: "services": { 2024-09-21T06:46:34.230 INFO:teuthology.orchestra.run.smithi007.stdout: "dashboard": "https://172.21.15.7:8443/" 2024-09-21T06:46:34.230 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.230 INFO:teuthology.orchestra.run.smithi007.stdout: "always_on_modules": { 2024-09-21T06:46:34.230 INFO:teuthology.orchestra.run.smithi007.stdout: "octopus": [ 2024-09-21T06:46:34.230 INFO:teuthology.orchestra.run.smithi007.stdout: "balancer", 2024-09-21T06:46:34.230 INFO:teuthology.orchestra.run.smithi007.stdout: "crash", 2024-09-21T06:46:34.230 INFO:teuthology.orchestra.run.smithi007.stdout: "devicehealth", 2024-09-21T06:46:34.230 INFO:teuthology.orchestra.run.smithi007.stdout: "orchestrator", 2024-09-21T06:46:34.230 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscaler", 2024-09-21T06:46:34.230 INFO:teuthology.orchestra.run.smithi007.stdout: "progress", 2024-09-21T06:46:34.230 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_support", 2024-09-21T06:46:34.231 INFO:teuthology.orchestra.run.smithi007.stdout: "status", 2024-09-21T06:46:34.231 INFO:teuthology.orchestra.run.smithi007.stdout: "telemetry", 2024-09-21T06:46:34.231 INFO:teuthology.orchestra.run.smithi007.stdout: "volumes" 2024-09-21T06:46:34.231 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:34.231 INFO:teuthology.orchestra.run.smithi007.stdout: "pacific": [ 2024-09-21T06:46:34.231 INFO:teuthology.orchestra.run.smithi007.stdout: "balancer", 2024-09-21T06:46:34.231 INFO:teuthology.orchestra.run.smithi007.stdout: "crash", 2024-09-21T06:46:34.231 INFO:teuthology.orchestra.run.smithi007.stdout: "devicehealth", 2024-09-21T06:46:34.231 INFO:teuthology.orchestra.run.smithi007.stdout: "orchestrator", 2024-09-21T06:46:34.231 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscaler", 2024-09-21T06:46:34.231 INFO:teuthology.orchestra.run.smithi007.stdout: "progress", 2024-09-21T06:46:34.231 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_support", 2024-09-21T06:46:34.231 INFO:teuthology.orchestra.run.smithi007.stdout: "status", 2024-09-21T06:46:34.231 INFO:teuthology.orchestra.run.smithi007.stdout: "telemetry", 2024-09-21T06:46:34.232 INFO:teuthology.orchestra.run.smithi007.stdout: "volumes" 2024-09-21T06:46:34.232 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:34.232 INFO:teuthology.orchestra.run.smithi007.stdout: "quincy": [ 2024-09-21T06:46:34.232 INFO:teuthology.orchestra.run.smithi007.stdout: "balancer", 2024-09-21T06:46:34.232 INFO:teuthology.orchestra.run.smithi007.stdout: "crash", 2024-09-21T06:46:34.232 INFO:teuthology.orchestra.run.smithi007.stdout: "devicehealth", 2024-09-21T06:46:34.232 INFO:teuthology.orchestra.run.smithi007.stdout: "orchestrator", 2024-09-21T06:46:34.232 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscaler", 2024-09-21T06:46:34.232 INFO:teuthology.orchestra.run.smithi007.stdout: "progress", 2024-09-21T06:46:34.232 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_support", 2024-09-21T06:46:34.232 INFO:teuthology.orchestra.run.smithi007.stdout: "status", 2024-09-21T06:46:34.232 INFO:teuthology.orchestra.run.smithi007.stdout: "telemetry", 2024-09-21T06:46:34.232 INFO:teuthology.orchestra.run.smithi007.stdout: "volumes" 2024-09-21T06:46:34.232 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:34.232 INFO:teuthology.orchestra.run.smithi007.stdout: "reef": [ 2024-09-21T06:46:34.233 INFO:teuthology.orchestra.run.smithi007.stdout: "balancer", 2024-09-21T06:46:34.233 INFO:teuthology.orchestra.run.smithi007.stdout: "crash", 2024-09-21T06:46:34.233 INFO:teuthology.orchestra.run.smithi007.stdout: "devicehealth", 2024-09-21T06:46:34.233 INFO:teuthology.orchestra.run.smithi007.stdout: "orchestrator", 2024-09-21T06:46:34.233 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscaler", 2024-09-21T06:46:34.233 INFO:teuthology.orchestra.run.smithi007.stdout: "progress", 2024-09-21T06:46:34.233 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_support", 2024-09-21T06:46:34.233 INFO:teuthology.orchestra.run.smithi007.stdout: "status", 2024-09-21T06:46:34.233 INFO:teuthology.orchestra.run.smithi007.stdout: "telemetry", 2024-09-21T06:46:34.233 INFO:teuthology.orchestra.run.smithi007.stdout: "volumes" 2024-09-21T06:46:34.233 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2024-09-21T06:46:34.233 INFO:teuthology.orchestra.run.smithi007.stdout: "squid": [ 2024-09-21T06:46:34.233 INFO:teuthology.orchestra.run.smithi007.stdout: "balancer", 2024-09-21T06:46:34.233 INFO:teuthology.orchestra.run.smithi007.stdout: "crash", 2024-09-21T06:46:34.234 INFO:teuthology.orchestra.run.smithi007.stdout: "devicehealth", 2024-09-21T06:46:34.234 INFO:teuthology.orchestra.run.smithi007.stdout: "orchestrator", 2024-09-21T06:46:34.234 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscaler", 2024-09-21T06:46:34.234 INFO:teuthology.orchestra.run.smithi007.stdout: "progress", 2024-09-21T06:46:34.234 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_support", 2024-09-21T06:46:34.234 INFO:teuthology.orchestra.run.smithi007.stdout: "status", 2024-09-21T06:46:34.234 INFO:teuthology.orchestra.run.smithi007.stdout: "telemetry", 2024-09-21T06:46:34.234 INFO:teuthology.orchestra.run.smithi007.stdout: "volumes" 2024-09-21T06:46:34.234 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T06:46:34.234 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.234 INFO:teuthology.orchestra.run.smithi007.stdout: "last_failure_osd_epoch": 5, 2024-09-21T06:46:34.234 INFO:teuthology.orchestra.run.smithi007.stdout: "active_clients": [ 2024-09-21T06:46:34.234 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:34.234 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "devicehealth", 2024-09-21T06:46:34.235 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2024-09-21T06:46:34.235 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:34.235 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2024-09-21T06:46:34.235 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:0", 2024-09-21T06:46:34.235 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 4110781505 2024-09-21T06:46:34.235 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:34.235 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T06:46:34.235 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.235 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:34.235 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "libcephsqlite", 2024-09-21T06:46:34.235 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2024-09-21T06:46:34.235 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:34.235 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2024-09-21T06:46:34.235 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:0", 2024-09-21T06:46:34.236 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 3308293059 2024-09-21T06:46:34.236 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:34.236 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T06:46:34.236 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.236 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:34.236 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "rbd_support", 2024-09-21T06:46:34.236 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2024-09-21T06:46:34.236 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:34.236 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2024-09-21T06:46:34.236 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:0", 2024-09-21T06:46:34.236 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 136165045 2024-09-21T06:46:34.236 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:34.236 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T06:46:34.236 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.237 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:34.237 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "snap_schedule", 2024-09-21T06:46:34.237 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2024-09-21T06:46:34.237 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:34.237 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2024-09-21T06:46:34.237 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:0", 2024-09-21T06:46:34.237 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 2170303760 2024-09-21T06:46:34.237 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:34.237 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T06:46:34.237 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.237 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:34.237 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "snap_schedule", 2024-09-21T06:46:34.237 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2024-09-21T06:46:34.237 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:34.237 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2024-09-21T06:46:34.238 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:0", 2024-09-21T06:46:34.238 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 2620872174 2024-09-21T06:46:34.238 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:34.238 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T06:46:34.238 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:34.238 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:34.238 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "volumes", 2024-09-21T06:46:34.238 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2024-09-21T06:46:34.238 INFO:teuthology.orchestra.run.smithi007.stdout: { 2024-09-21T06:46:34.238 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2024-09-21T06:46:34.238 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:0", 2024-09-21T06:46:34.238 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 2256955414 2024-09-21T06:46:34.238 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:34.238 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T06:46:34.238 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:34.239 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2024-09-21T06:46:34.239 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:46:34.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.800+0000 7f2a77158640 1 -- 172.21.15.7:0/2593497890 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f2a5c0b6680 msgr2=0x7f2a5c0b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:34.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.800+0000 7f2a77158640 1 --2- 172.21.15.7:0/2593497890 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f2a5c0b6680 0x7f2a5c0b8b90 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f2a60009230 tx=0x7f2a60031400 comp rx=0 tx=0).stop 2024-09-21T06:46:34.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.800+0000 7f2a77158640 1 -- 172.21.15.7:0/2593497890 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a701029d0 msgr2=0x7f2a7019a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:34.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.800+0000 7f2a77158640 1 --2- 172.21.15.7:0/2593497890 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a701029d0 0x7f2a7019a400 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f2a5800d770 tx=0x7f2a5800dc30 comp rx=0 tx=0).stop 2024-09-21T06:46:34.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.800+0000 7f2a77158640 1 -- 172.21.15.7:0/2593497890 shutdown_connections 2024-09-21T06:46:34.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.800+0000 7f2a77158640 1 --2- 172.21.15.7:0/2593497890 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f2a5c0b6680 0x7f2a5c0b8b90 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:34.240 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.800+0000 7f2a77158640 1 --2- 172.21.15.7:0/2593497890 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f2a70108c50 0x7f2a7019fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:34.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.800+0000 7f2a77158640 1 --2- 172.21.15.7:0/2593497890 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2a70108300 0x7f2a7019a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:34.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.800+0000 7f2a77158640 1 --2- 172.21.15.7:0/2593497890 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f2a701029d0 0x7f2a7019a400 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:34.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.800+0000 7f2a77158640 1 -- 172.21.15.7:0/2593497890 >> 172.21.15.7:0/2593497890 conn(0x7f2a700fe3b0 msgr2=0x7f2a7006a940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:34.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.800+0000 7f2a77158640 1 -- 172.21.15.7:0/2593497890 shutdown_connections 2024-09-21T06:46:34.241 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:32.800+0000 7f2a77158640 1 -- 172.21.15.7:0/2593497890 wait complete. 2024-09-21T06:46:34.284 DEBUG:tasks.check_counter:Getting stats from a 2024-09-21T06:46:34.284 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph daemon mds.a perf dump 2024-09-21T06:46:34.285 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:46:33 smithi007 ceph-mon[30983]: pgmap v637: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T06:46:34.285 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:46:33 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/3821633438' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T06:46:34.285 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:46:33 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/3657029145' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T06:46:34.285 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:46:33 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2593497890' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-21T06:46:34.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:46:33 smithi144 ceph-mon[34653]: pgmap v637: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T06:46:34.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:46:33 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/3821633438' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T06:46:34.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:46:33 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/3657029145' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T06:46:34.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:46:33 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/2593497890' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-21T06:46:34.286 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:46:33 smithi018 ceph-mon[34477]: pgmap v637: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-21T06:46:34.286 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:46:33 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/3821633438' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T06:46:34.287 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:46:33 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/3657029145' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T06:46:34.287 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:46:33 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/2593497890' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-21T06:46:34.554 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:46:35.130 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:46:35.131 INFO:teuthology.orchestra.run.smithi007.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T06:46:35.131 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_messages": 0, 2024-09-21T06:46:35.131 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages": 2, 2024-09-21T06:46:35.131 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_bytes": 0, 2024-09-21T06:46:35.131 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_bytes": 0, 2024-09-21T06:46:35.131 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_created_connections": 4, 2024-09-21T06:46:35.131 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_active_connections": 0, 2024-09-21T06:46:35.131 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_total_time": 0.001266591, 2024-09-21T06:46:35.131 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T06:46:35.131 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_recv_time": 0.000173700, 2024-09-21T06:46:35.131 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:46:35.132 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:46:35.132 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-21T06:46:35.132 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-21T06:46:35.132 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-21T06:46:35.132 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:35.132 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:46:35.132 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-21T06:46:35.132 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-21T06:46:35.132 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-21T06:46:35.132 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:35.132 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T06:46:35.132 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T06:46:35.133 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:35.133 INFO:teuthology.orchestra.run.smithi007.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T06:46:35.133 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_messages": 5, 2024-09-21T06:46:35.133 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages": 154, 2024-09-21T06:46:35.133 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_bytes": 3152, 2024-09-21T06:46:35.133 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_bytes": 107440, 2024-09-21T06:46:35.133 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_created_connections": 3, 2024-09-21T06:46:35.133 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_active_connections": 2, 2024-09-21T06:46:35.133 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_total_time": 0.017853155, 2024-09-21T06:46:35.133 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_send_time": 0.012895661, 2024-09-21T06:46:35.133 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_recv_time": 0.003357940, 2024-09-21T06:46:35.133 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:46:35.133 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:46:35.134 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 153, 2024-09-21T06:46:35.134 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.011888821, 2024-09-21T06:46:35.134 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000077704 2024-09-21T06:46:35.134 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:35.134 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:46:35.134 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-21T06:46:35.134 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-21T06:46:35.134 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-21T06:46:35.134 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:35.134 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-21T06:46:35.134 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_encrypted_bytes": 107440 2024-09-21T06:46:35.134 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:35.135 INFO:teuthology.orchestra.run.smithi007.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T06:46:35.135 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_messages": 205, 2024-09-21T06:46:35.135 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages": 200, 2024-09-21T06:46:35.135 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_bytes": 833408, 2024-09-21T06:46:35.135 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_bytes": 122784, 2024-09-21T06:46:35.135 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_created_connections": 2, 2024-09-21T06:46:35.135 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_active_connections": 1, 2024-09-21T06:46:35.135 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_total_time": 0.037687464, 2024-09-21T06:46:35.135 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_send_time": 0.018687441, 2024-09-21T06:46:35.135 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_recv_time": 0.026011105, 2024-09-21T06:46:35.135 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:46:35.135 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:46:35.136 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 199, 2024-09-21T06:46:35.136 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.011340411, 2024-09-21T06:46:35.136 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000056986 2024-09-21T06:46:35.136 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:35.136 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:46:35.136 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-21T06:46:35.136 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-21T06:46:35.136 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-21T06:46:35.136 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:35.136 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_encrypted_bytes": 833408, 2024-09-21T06:46:35.136 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_encrypted_bytes": 122784 2024-09-21T06:46:35.136 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:35.137 INFO:teuthology.orchestra.run.smithi007.stdout: "cct": { 2024-09-21T06:46:35.137 INFO:teuthology.orchestra.run.smithi007.stdout: "total_workers": 0, 2024-09-21T06:46:35.137 INFO:teuthology.orchestra.run.smithi007.stdout: "unhealthy_workers": 0 2024-09-21T06:46:35.137 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:35.137 INFO:teuthology.orchestra.run.smithi007.stdout: "mempool": { 2024-09-21T06:46:35.137 INFO:teuthology.orchestra.run.smithi007.stdout: "bloom_filter_bytes": 0, 2024-09-21T06:46:35.137 INFO:teuthology.orchestra.run.smithi007.stdout: "bloom_filter_items": 0, 2024-09-21T06:46:35.137 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T06:46:35.137 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_alloc_items": 0, 2024-09-21T06:46:35.137 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T06:46:35.137 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_data_items": 0, 2024-09-21T06:46:35.137 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T06:46:35.137 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T06:46:35.138 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T06:46:35.138 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T06:46:35.138 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T06:46:35.138 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_other_items": 0, 2024-09-21T06:46:35.138 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T06:46:35.138 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T06:46:35.138 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_extent_bytes": 0, 2024-09-21T06:46:35.138 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_extent_items": 0, 2024-09-21T06:46:35.138 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_blob_bytes": 0, 2024-09-21T06:46:35.138 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_blob_items": 0, 2024-09-21T06:46:35.138 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T06:46:35.138 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T06:46:35.139 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T06:46:35.139 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T06:46:35.139 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T06:46:35.139 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_items": 0, 2024-09-21T06:46:35.139 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_txc_bytes": 0, 2024-09-21T06:46:35.139 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_txc_items": 0, 2024-09-21T06:46:35.139 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T06:46:35.139 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T06:46:35.139 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_bytes": 0, 2024-09-21T06:46:35.139 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_items": 0, 2024-09-21T06:46:35.139 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_bytes": 0, 2024-09-21T06:46:35.139 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_items": 0, 2024-09-21T06:46:35.139 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T06:46:35.140 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_reader_items": 0, 2024-09-21T06:46:35.140 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T06:46:35.140 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_writer_items": 0, 2024-09-21T06:46:35.140 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_anon_bytes": 148967, 2024-09-21T06:46:35.140 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_anon_items": 29, 2024-09-21T06:46:35.140 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_meta_bytes": 0, 2024-09-21T06:46:35.140 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_meta_items": 0, 2024-09-21T06:46:35.140 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_bytes": 0, 2024-09-21T06:46:35.140 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_items": 0, 2024-09-21T06:46:35.140 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mapbl_bytes": 0, 2024-09-21T06:46:35.140 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mapbl_items": 0, 2024-09-21T06:46:35.140 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pglog_bytes": 0, 2024-09-21T06:46:35.140 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pglog_items": 0, 2024-09-21T06:46:35.141 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_bytes": 0, 2024-09-21T06:46:35.141 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_items": 0, 2024-09-21T06:46:35.141 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T06:46:35.141 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_mapping_items": 0, 2024-09-21T06:46:35.141 INFO:teuthology.orchestra.run.smithi007.stdout: "pgmap_bytes": 0, 2024-09-21T06:46:35.141 INFO:teuthology.orchestra.run.smithi007.stdout: "pgmap_items": 0, 2024-09-21T06:46:35.141 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_co_bytes": 968, 2024-09-21T06:46:35.141 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_co_items": 2, 2024-09-21T06:46:35.141 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_1_bytes": 0, 2024-09-21T06:46:35.141 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_1_items": 0, 2024-09-21T06:46:35.141 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_2_bytes": 0, 2024-09-21T06:46:35.141 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_2_items": 0 2024-09-21T06:46:35.142 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:35.142 INFO:teuthology.orchestra.run.smithi007.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T06:46:35.142 INFO:teuthology.orchestra.run.smithi007.stdout: "val": 0, 2024-09-21T06:46:35.142 INFO:teuthology.orchestra.run.smithi007.stdout: "max": 104857600, 2024-09-21T06:46:35.142 INFO:teuthology.orchestra.run.smithi007.stdout: "get_started": 0, 2024-09-21T06:46:35.142 INFO:teuthology.orchestra.run.smithi007.stdout: "get": 206, 2024-09-21T06:46:35.142 INFO:teuthology.orchestra.run.smithi007.stdout: "get_sum": 804460, 2024-09-21T06:46:35.142 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_fail": 0, 2024-09-21T06:46:35.142 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_success": 206, 2024-09-21T06:46:35.142 INFO:teuthology.orchestra.run.smithi007.stdout: "take": 0, 2024-09-21T06:46:35.142 INFO:teuthology.orchestra.run.smithi007.stdout: "take_sum": 0, 2024-09-21T06:46:35.142 INFO:teuthology.orchestra.run.smithi007.stdout: "put": 206, 2024-09-21T06:46:35.142 INFO:teuthology.orchestra.run.smithi007.stdout: "put_sum": 804460, 2024-09-21T06:46:35.143 INFO:teuthology.orchestra.run.smithi007.stdout: "wait": { 2024-09-21T06:46:35.143 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-21T06:46:35.143 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-21T06:46:35.143 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-21T06:46:35.143 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:35.143 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:35.143 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:46:35.337 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:46:35 smithi144 ceph-mon[34653]: pgmap v638: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:46:35.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:46:35 smithi007 ceph-mon[30983]: pgmap v638: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:46:35.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:46:35 smithi018 ceph-mon[34477]: pgmap v638: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:46:35.878 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.a 2024-09-21T06:46:35.878 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.a 2024-09-21T06:46:35.878 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.a 2024-09-21T06:46:35.878 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.a 2024-09-21T06:46:35.879 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.a 2024-09-21T06:46:35.879 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.a 2024-09-21T06:46:35.879 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.a 2024-09-21T06:46:35.879 DEBUG:tasks.check_counter:Getting stats from d 2024-09-21T06:46:35.879 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph daemon mds.d perf dump 2024-09-21T06:46:36.139 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:46:36.681 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:46:36.681 INFO:teuthology.orchestra.run.smithi007.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T06:46:36.681 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_messages": 0, 2024-09-21T06:46:36.681 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages": 2, 2024-09-21T06:46:36.681 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_bytes": 0, 2024-09-21T06:46:36.681 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_bytes": 0, 2024-09-21T06:46:36.681 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_created_connections": 4, 2024-09-21T06:46:36.682 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_active_connections": 0, 2024-09-21T06:46:36.682 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_total_time": 0.001374760, 2024-09-21T06:46:36.682 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T06:46:36.682 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_recv_time": 0.000349141, 2024-09-21T06:46:36.682 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:46:36.682 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:46:36.682 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-21T06:46:36.682 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-21T06:46:36.682 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-21T06:46:36.682 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:36.682 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:46:36.682 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-21T06:46:36.682 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-21T06:46:36.683 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-21T06:46:36.683 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:36.683 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T06:46:36.683 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T06:46:36.683 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:36.683 INFO:teuthology.orchestra.run.smithi007.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T06:46:36.683 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_messages": 216, 2024-09-21T06:46:36.683 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages": 209, 2024-09-21T06:46:36.683 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_bytes": 838368, 2024-09-21T06:46:36.683 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_bytes": 127232, 2024-09-21T06:46:36.683 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_created_connections": 2, 2024-09-21T06:46:36.683 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_active_connections": 1, 2024-09-21T06:46:36.683 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_total_time": 0.040169270, 2024-09-21T06:46:36.683 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_send_time": 0.018384841, 2024-09-21T06:46:36.684 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_recv_time": 0.029407736, 2024-09-21T06:46:36.684 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:46:36.684 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:46:36.684 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 209, 2024-09-21T06:46:36.684 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.016197533, 2024-09-21T06:46:36.684 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000077500 2024-09-21T06:46:36.684 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:36.684 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:46:36.684 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-21T06:46:36.684 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-21T06:46:36.684 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-21T06:46:36.684 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:36.684 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_encrypted_bytes": 838368, 2024-09-21T06:46:36.684 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_encrypted_bytes": 127232 2024-09-21T06:46:36.685 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:36.685 INFO:teuthology.orchestra.run.smithi007.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T06:46:36.685 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_messages": 1, 2024-09-21T06:46:36.685 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages": 156, 2024-09-21T06:46:36.685 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_bytes": 160, 2024-09-21T06:46:36.685 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_bytes": 107696, 2024-09-21T06:46:36.685 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_created_connections": 3, 2024-09-21T06:46:36.685 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_active_connections": 2, 2024-09-21T06:46:36.685 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_total_time": 0.015299154, 2024-09-21T06:46:36.685 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_send_time": 0.012392801, 2024-09-21T06:46:36.685 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_recv_time": 0.001311959, 2024-09-21T06:46:36.685 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:46:36.685 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:46:36.685 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 154, 2024-09-21T06:46:36.686 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.007094566, 2024-09-21T06:46:36.686 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000046068 2024-09-21T06:46:36.686 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:36.686 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:46:36.686 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-21T06:46:36.686 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-21T06:46:36.686 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-21T06:46:36.686 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:36.686 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T06:46:36.686 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_encrypted_bytes": 107696 2024-09-21T06:46:36.686 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:36.686 INFO:teuthology.orchestra.run.smithi007.stdout: "cct": { 2024-09-21T06:46:36.686 INFO:teuthology.orchestra.run.smithi007.stdout: "total_workers": 0, 2024-09-21T06:46:36.686 INFO:teuthology.orchestra.run.smithi007.stdout: "unhealthy_workers": 0 2024-09-21T06:46:36.687 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:36.687 INFO:teuthology.orchestra.run.smithi007.stdout: "mempool": { 2024-09-21T06:46:36.687 INFO:teuthology.orchestra.run.smithi007.stdout: "bloom_filter_bytes": 0, 2024-09-21T06:46:36.687 INFO:teuthology.orchestra.run.smithi007.stdout: "bloom_filter_items": 0, 2024-09-21T06:46:36.687 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T06:46:36.687 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_alloc_items": 0, 2024-09-21T06:46:36.687 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T06:46:36.687 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_data_items": 0, 2024-09-21T06:46:36.687 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T06:46:36.687 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T06:46:36.687 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T06:46:36.687 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T06:46:36.687 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T06:46:36.687 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_other_items": 0, 2024-09-21T06:46:36.687 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T06:46:36.688 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T06:46:36.688 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_extent_bytes": 0, 2024-09-21T06:46:36.688 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_extent_items": 0, 2024-09-21T06:46:36.688 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_blob_bytes": 0, 2024-09-21T06:46:36.688 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_blob_items": 0, 2024-09-21T06:46:36.688 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T06:46:36.688 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T06:46:36.688 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T06:46:36.688 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T06:46:36.688 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T06:46:36.688 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_items": 0, 2024-09-21T06:46:36.688 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_txc_bytes": 0, 2024-09-21T06:46:36.688 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_txc_items": 0, 2024-09-21T06:46:36.688 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T06:46:36.688 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T06:46:36.689 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_bytes": 0, 2024-09-21T06:46:36.689 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_items": 0, 2024-09-21T06:46:36.689 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_bytes": 0, 2024-09-21T06:46:36.689 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_items": 0, 2024-09-21T06:46:36.689 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T06:46:36.689 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_reader_items": 0, 2024-09-21T06:46:36.689 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T06:46:36.689 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_writer_items": 0, 2024-09-21T06:46:36.689 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_anon_bytes": 149047, 2024-09-21T06:46:36.689 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_anon_items": 31, 2024-09-21T06:46:36.689 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_meta_bytes": 0, 2024-09-21T06:46:36.689 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_meta_items": 0, 2024-09-21T06:46:36.689 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_bytes": 0, 2024-09-21T06:46:36.689 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_items": 0, 2024-09-21T06:46:36.690 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mapbl_bytes": 0, 2024-09-21T06:46:36.690 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mapbl_items": 0, 2024-09-21T06:46:36.690 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pglog_bytes": 0, 2024-09-21T06:46:36.690 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pglog_items": 0, 2024-09-21T06:46:36.690 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_bytes": 0, 2024-09-21T06:46:36.690 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_items": 0, 2024-09-21T06:46:36.690 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T06:46:36.690 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_mapping_items": 0, 2024-09-21T06:46:36.690 INFO:teuthology.orchestra.run.smithi007.stdout: "pgmap_bytes": 0, 2024-09-21T06:46:36.690 INFO:teuthology.orchestra.run.smithi007.stdout: "pgmap_items": 0, 2024-09-21T06:46:36.690 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_co_bytes": 968, 2024-09-21T06:46:36.690 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_co_items": 2, 2024-09-21T06:46:36.690 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_1_bytes": 0, 2024-09-21T06:46:36.690 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_1_items": 0, 2024-09-21T06:46:36.691 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_2_bytes": 0, 2024-09-21T06:46:36.691 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_2_items": 0 2024-09-21T06:46:36.691 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:36.691 INFO:teuthology.orchestra.run.smithi007.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T06:46:36.691 INFO:teuthology.orchestra.run.smithi007.stdout: "val": 0, 2024-09-21T06:46:36.691 INFO:teuthology.orchestra.run.smithi007.stdout: "max": 104857600, 2024-09-21T06:46:36.691 INFO:teuthology.orchestra.run.smithi007.stdout: "get_started": 0, 2024-09-21T06:46:36.691 INFO:teuthology.orchestra.run.smithi007.stdout: "get": 213, 2024-09-21T06:46:36.691 INFO:teuthology.orchestra.run.smithi007.stdout: "get_sum": 805434, 2024-09-21T06:46:36.691 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_fail": 0, 2024-09-21T06:46:36.691 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_success": 213, 2024-09-21T06:46:36.691 INFO:teuthology.orchestra.run.smithi007.stdout: "take": 0, 2024-09-21T06:46:36.691 INFO:teuthology.orchestra.run.smithi007.stdout: "take_sum": 0, 2024-09-21T06:46:36.691 INFO:teuthology.orchestra.run.smithi007.stdout: "put": 213, 2024-09-21T06:46:36.692 INFO:teuthology.orchestra.run.smithi007.stdout: "put_sum": 805434, 2024-09-21T06:46:36.692 INFO:teuthology.orchestra.run.smithi007.stdout: "wait": { 2024-09-21T06:46:36.692 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-21T06:46:36.692 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-21T06:46:36.692 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-21T06:46:36.692 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:36.692 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:36.692 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:46:37.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:46:37 smithi007 ceph-mon[30983]: pgmap v639: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:46:37.368 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:46:37 smithi018 ceph-mon[34477]: pgmap v639: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:46:37.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:46:37 smithi144 ceph-mon[34653]: pgmap v639: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:46:37.617 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-21T06:46:37.617 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-21T06:46:37.617 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2024-09-21T06:46:37.617 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2024-09-21T06:46:37.617 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2024-09-21T06:46:37.617 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2024-09-21T06:46:37.617 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2024-09-21T06:46:37.617 DEBUG:tasks.check_counter:Getting stats from g 2024-09-21T06:46:37.617 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph daemon mds.g perf dump 2024-09-21T06:46:37.881 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:46:38.458 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:46:38.459 INFO:teuthology.orchestra.run.smithi007.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T06:46:38.459 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_messages": 207, 2024-09-21T06:46:38.459 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages": 202, 2024-09-21T06:46:38.459 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_bytes": 833952, 2024-09-21T06:46:38.459 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_bytes": 124064, 2024-09-21T06:46:38.459 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_created_connections": 4, 2024-09-21T06:46:38.459 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_active_connections": 0, 2024-09-21T06:46:38.459 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_total_time": 0.041437033, 2024-09-21T06:46:38.459 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_send_time": 0.019279684, 2024-09-21T06:46:38.459 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_recv_time": 0.028228318, 2024-09-21T06:46:38.459 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:46:38.460 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:46:38.460 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 201, 2024-09-21T06:46:38.460 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.011646180, 2024-09-21T06:46:38.460 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000057941 2024-09-21T06:46:38.460 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:38.460 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:46:38.460 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-21T06:46:38.460 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-21T06:46:38.460 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-21T06:46:38.460 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:38.460 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_encrypted_bytes": 833952, 2024-09-21T06:46:38.460 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_encrypted_bytes": 124064 2024-09-21T06:46:38.460 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:38.461 INFO:teuthology.orchestra.run.smithi007.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T06:46:38.461 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_messages": 1, 2024-09-21T06:46:38.461 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages": 153, 2024-09-21T06:46:38.461 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_bytes": 160, 2024-09-21T06:46:38.461 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_bytes": 107168, 2024-09-21T06:46:38.461 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_created_connections": 3, 2024-09-21T06:46:38.461 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_active_connections": 2, 2024-09-21T06:46:38.461 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_total_time": 0.015782780, 2024-09-21T06:46:38.461 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_send_time": 0.012442106, 2024-09-21T06:46:38.461 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_recv_time": 0.001663238, 2024-09-21T06:46:38.461 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:46:38.461 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:46:38.461 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 151, 2024-09-21T06:46:38.461 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.007984270, 2024-09-21T06:46:38.461 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000052875 2024-09-21T06:46:38.462 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:38.462 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:46:38.462 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-21T06:46:38.462 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-21T06:46:38.462 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-21T06:46:38.462 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:38.462 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T06:46:38.462 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_encrypted_bytes": 107168 2024-09-21T06:46:38.462 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:38.462 INFO:teuthology.orchestra.run.smithi007.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T06:46:38.462 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_messages": 4, 2024-09-21T06:46:38.462 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages": 4, 2024-09-21T06:46:38.462 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_bytes": 2992, 2024-09-21T06:46:38.463 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_bytes": 448, 2024-09-21T06:46:38.463 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_created_connections": 2, 2024-09-21T06:46:38.463 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_active_connections": 1, 2024-09-21T06:46:38.463 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_total_time": 0.002425967, 2024-09-21T06:46:38.463 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_send_time": 0.000046831, 2024-09-21T06:46:38.463 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_recv_time": 0.002363504, 2024-09-21T06:46:38.463 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:46:38.463 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:46:38.463 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 3, 2024-09-21T06:46:38.463 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.004323142, 2024-09-21T06:46:38.463 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.001441047 2024-09-21T06:46:38.463 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:38.463 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:46:38.463 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-21T06:46:38.463 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-21T06:46:38.464 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-21T06:46:38.464 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:38.464 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-21T06:46:38.464 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T06:46:38.464 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:38.464 INFO:teuthology.orchestra.run.smithi007.stdout: "cct": { 2024-09-21T06:46:38.464 INFO:teuthology.orchestra.run.smithi007.stdout: "total_workers": 0, 2024-09-21T06:46:38.464 INFO:teuthology.orchestra.run.smithi007.stdout: "unhealthy_workers": 0 2024-09-21T06:46:38.464 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:38.464 INFO:teuthology.orchestra.run.smithi007.stdout: "mempool": { 2024-09-21T06:46:38.464 INFO:teuthology.orchestra.run.smithi007.stdout: "bloom_filter_bytes": 0, 2024-09-21T06:46:38.464 INFO:teuthology.orchestra.run.smithi007.stdout: "bloom_filter_items": 0, 2024-09-21T06:46:38.464 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T06:46:38.464 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_alloc_items": 0, 2024-09-21T06:46:38.465 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T06:46:38.465 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_data_items": 0, 2024-09-21T06:46:38.465 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T06:46:38.465 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T06:46:38.465 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T06:46:38.465 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T06:46:38.465 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T06:46:38.465 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_other_items": 0, 2024-09-21T06:46:38.465 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T06:46:38.465 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T06:46:38.465 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_extent_bytes": 0, 2024-09-21T06:46:38.465 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_extent_items": 0, 2024-09-21T06:46:38.465 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_blob_bytes": 0, 2024-09-21T06:46:38.465 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_blob_items": 0, 2024-09-21T06:46:38.466 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T06:46:38.466 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T06:46:38.466 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T06:46:38.466 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T06:46:38.466 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T06:46:38.466 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_items": 0, 2024-09-21T06:46:38.466 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_txc_bytes": 0, 2024-09-21T06:46:38.466 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_txc_items": 0, 2024-09-21T06:46:38.466 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T06:46:38.466 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T06:46:38.466 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_bytes": 0, 2024-09-21T06:46:38.466 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_items": 0, 2024-09-21T06:46:38.467 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_bytes": 0, 2024-09-21T06:46:38.467 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_items": 0, 2024-09-21T06:46:38.467 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T06:46:38.467 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_reader_items": 0, 2024-09-21T06:46:38.467 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T06:46:38.467 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_writer_items": 0, 2024-09-21T06:46:38.467 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_anon_bytes": 148967, 2024-09-21T06:46:38.467 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_anon_items": 29, 2024-09-21T06:46:38.467 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_meta_bytes": 0, 2024-09-21T06:46:38.467 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_meta_items": 0, 2024-09-21T06:46:38.467 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_bytes": 0, 2024-09-21T06:46:38.467 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_items": 0, 2024-09-21T06:46:38.467 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mapbl_bytes": 0, 2024-09-21T06:46:38.467 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mapbl_items": 0, 2024-09-21T06:46:38.468 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pglog_bytes": 0, 2024-09-21T06:46:38.468 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pglog_items": 0, 2024-09-21T06:46:38.468 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_bytes": 0, 2024-09-21T06:46:38.468 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_items": 0, 2024-09-21T06:46:38.468 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T06:46:38.468 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_mapping_items": 0, 2024-09-21T06:46:38.468 INFO:teuthology.orchestra.run.smithi007.stdout: "pgmap_bytes": 0, 2024-09-21T06:46:38.468 INFO:teuthology.orchestra.run.smithi007.stdout: "pgmap_items": 0, 2024-09-21T06:46:38.468 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_co_bytes": 968, 2024-09-21T06:46:38.468 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_co_items": 2, 2024-09-21T06:46:38.468 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_1_bytes": 0, 2024-09-21T06:46:38.468 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_1_items": 0, 2024-09-21T06:46:38.468 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_2_bytes": 0, 2024-09-21T06:46:38.468 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_2_items": 0 2024-09-21T06:46:38.468 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:38.468 INFO:teuthology.orchestra.run.smithi007.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T06:46:38.469 INFO:teuthology.orchestra.run.smithi007.stdout: "val": 0, 2024-09-21T06:46:38.469 INFO:teuthology.orchestra.run.smithi007.stdout: "max": 104857600, 2024-09-21T06:46:38.469 INFO:teuthology.orchestra.run.smithi007.stdout: "get_started": 0, 2024-09-21T06:46:38.469 INFO:teuthology.orchestra.run.smithi007.stdout: "get": 208, 2024-09-21T06:46:38.469 INFO:teuthology.orchestra.run.smithi007.stdout: "get_sum": 804720, 2024-09-21T06:46:38.469 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_fail": 0, 2024-09-21T06:46:38.469 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_success": 208, 2024-09-21T06:46:38.469 INFO:teuthology.orchestra.run.smithi007.stdout: "take": 0, 2024-09-21T06:46:38.469 INFO:teuthology.orchestra.run.smithi007.stdout: "take_sum": 0, 2024-09-21T06:46:38.469 INFO:teuthology.orchestra.run.smithi007.stdout: "put": 208, 2024-09-21T06:46:38.469 INFO:teuthology.orchestra.run.smithi007.stdout: "put_sum": 804720, 2024-09-21T06:46:38.469 INFO:teuthology.orchestra.run.smithi007.stdout: "wait": { 2024-09-21T06:46:38.469 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-21T06:46:38.469 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-21T06:46:38.469 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-21T06:46:38.470 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:38.470 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:38.470 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:46:39.295 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:46:39 smithi007 ceph-mon[30983]: pgmap v640: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:46:39.295 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:46:39 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:46:39.296 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.g 2024-09-21T06:46:39.297 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.g 2024-09-21T06:46:39.297 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.g 2024-09-21T06:46:39.297 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.g 2024-09-21T06:46:39.297 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.g 2024-09-21T06:46:39.297 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.g 2024-09-21T06:46:39.297 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.g 2024-09-21T06:46:39.297 DEBUG:tasks.check_counter:Getting stats from j 2024-09-21T06:46:39.297 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph daemon mds.j perf dump 2024-09-21T06:46:39.339 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:46:39 smithi144 ceph-mon[34653]: pgmap v640: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:46:39.339 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:46:39 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:46:39.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:46:39 smithi018 ceph-mon[34477]: pgmap v640: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:46:39.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:46:39 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T06:46:40.202 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:46:40.744 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2024-09-21T06:46:40.744 INFO:teuthology.orchestra.run.smithi007.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T06:46:40.744 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_messages": 217, 2024-09-21T06:46:40.744 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages": 210, 2024-09-21T06:46:40.744 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_bytes": 838640, 2024-09-21T06:46:40.744 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_bytes": 127872, 2024-09-21T06:46:40.744 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_created_connections": 4, 2024-09-21T06:46:40.744 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_active_connections": 0, 2024-09-21T06:46:40.744 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_total_time": 0.043492413, 2024-09-21T06:46:40.745 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_send_time": 0.018594934, 2024-09-21T06:46:40.745 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_recv_time": 0.031220918, 2024-09-21T06:46:40.745 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:46:40.745 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:46:40.745 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 210, 2024-09-21T06:46:40.745 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.015373727, 2024-09-21T06:46:40.745 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000073208 2024-09-21T06:46:40.745 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:40.745 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:46:40.745 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-21T06:46:40.745 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-21T06:46:40.745 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-21T06:46:40.745 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:40.745 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_encrypted_bytes": 838640, 2024-09-21T06:46:40.745 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_encrypted_bytes": 127872 2024-09-21T06:46:40.746 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:40.746 INFO:teuthology.orchestra.run.smithi007.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T06:46:40.746 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_messages": 1, 2024-09-21T06:46:40.746 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages": 158, 2024-09-21T06:46:40.746 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_bytes": 160, 2024-09-21T06:46:40.746 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_bytes": 108048, 2024-09-21T06:46:40.746 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_created_connections": 3, 2024-09-21T06:46:40.746 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_active_connections": 2, 2024-09-21T06:46:40.746 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_total_time": 0.015924315, 2024-09-21T06:46:40.746 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_send_time": 0.012825339, 2024-09-21T06:46:40.746 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_recv_time": 0.001379320, 2024-09-21T06:46:40.746 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:46:40.746 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:46:40.747 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 156, 2024-09-21T06:46:40.747 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.008566402, 2024-09-21T06:46:40.747 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000054912 2024-09-21T06:46:40.747 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:40.747 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:46:40.747 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-21T06:46:40.747 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-21T06:46:40.747 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-21T06:46:40.747 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:40.747 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T06:46:40.747 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_encrypted_bytes": 108048 2024-09-21T06:46:40.747 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:40.747 INFO:teuthology.orchestra.run.smithi007.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T06:46:40.747 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_messages": 0, 2024-09-21T06:46:40.747 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages": 2, 2024-09-21T06:46:40.748 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_bytes": 0, 2024-09-21T06:46:40.748 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_bytes": 0, 2024-09-21T06:46:40.748 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_created_connections": 2, 2024-09-21T06:46:40.748 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_active_connections": 1, 2024-09-21T06:46:40.748 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_total_time": 0.000442898, 2024-09-21T06:46:40.748 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T06:46:40.748 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_recv_time": 0.000370325, 2024-09-21T06:46:40.748 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:46:40.748 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:46:40.748 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-21T06:46:40.748 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-21T06:46:40.748 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-21T06:46:40.748 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:40.748 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:46:40.748 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-21T06:46:40.749 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-21T06:46:40.749 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-21T06:46:40.749 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:40.749 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T06:46:40.749 INFO:teuthology.orchestra.run.smithi007.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T06:46:40.749 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:40.749 INFO:teuthology.orchestra.run.smithi007.stdout: "cct": { 2024-09-21T06:46:40.749 INFO:teuthology.orchestra.run.smithi007.stdout: "total_workers": 0, 2024-09-21T06:46:40.749 INFO:teuthology.orchestra.run.smithi007.stdout: "unhealthy_workers": 0 2024-09-21T06:46:40.749 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:40.749 INFO:teuthology.orchestra.run.smithi007.stdout: "mempool": { 2024-09-21T06:46:40.749 INFO:teuthology.orchestra.run.smithi007.stdout: "bloom_filter_bytes": 0, 2024-09-21T06:46:40.749 INFO:teuthology.orchestra.run.smithi007.stdout: "bloom_filter_items": 0, 2024-09-21T06:46:40.749 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T06:46:40.749 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_alloc_items": 0, 2024-09-21T06:46:40.749 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T06:46:40.750 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_data_items": 0, 2024-09-21T06:46:40.750 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T06:46:40.750 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T06:46:40.750 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T06:46:40.750 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T06:46:40.750 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T06:46:40.750 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_other_items": 0, 2024-09-21T06:46:40.750 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T06:46:40.750 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T06:46:40.750 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_extent_bytes": 0, 2024-09-21T06:46:40.750 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_extent_items": 0, 2024-09-21T06:46:40.750 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_blob_bytes": 0, 2024-09-21T06:46:40.750 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_blob_items": 0, 2024-09-21T06:46:40.750 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T06:46:40.750 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T06:46:40.751 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T06:46:40.751 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T06:46:40.751 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T06:46:40.751 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_items": 0, 2024-09-21T06:46:40.751 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_txc_bytes": 0, 2024-09-21T06:46:40.751 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_txc_items": 0, 2024-09-21T06:46:40.751 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T06:46:40.751 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T06:46:40.751 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_bytes": 0, 2024-09-21T06:46:40.751 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_writing_items": 0, 2024-09-21T06:46:40.751 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_bytes": 0, 2024-09-21T06:46:40.751 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_items": 0, 2024-09-21T06:46:40.751 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T06:46:40.751 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_reader_items": 0, 2024-09-21T06:46:40.751 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T06:46:40.751 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_file_writer_items": 0, 2024-09-21T06:46:40.752 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_anon_bytes": 148967, 2024-09-21T06:46:40.752 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_anon_items": 29, 2024-09-21T06:46:40.752 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_meta_bytes": 0, 2024-09-21T06:46:40.752 INFO:teuthology.orchestra.run.smithi007.stdout: "buffer_meta_items": 0, 2024-09-21T06:46:40.752 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_bytes": 0, 2024-09-21T06:46:40.752 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_items": 0, 2024-09-21T06:46:40.752 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mapbl_bytes": 0, 2024-09-21T06:46:40.752 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mapbl_items": 0, 2024-09-21T06:46:40.752 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pglog_bytes": 0, 2024-09-21T06:46:40.752 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pglog_items": 0, 2024-09-21T06:46:40.752 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_bytes": 0, 2024-09-21T06:46:40.752 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_items": 0, 2024-09-21T06:46:40.752 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T06:46:40.752 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_mapping_items": 0, 2024-09-21T06:46:40.752 INFO:teuthology.orchestra.run.smithi007.stdout: "pgmap_bytes": 0, 2024-09-21T06:46:40.753 INFO:teuthology.orchestra.run.smithi007.stdout: "pgmap_items": 0, 2024-09-21T06:46:40.753 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_co_bytes": 968, 2024-09-21T06:46:40.753 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_co_items": 2, 2024-09-21T06:46:40.753 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_1_bytes": 0, 2024-09-21T06:46:40.753 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_1_items": 0, 2024-09-21T06:46:40.753 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_2_bytes": 0, 2024-09-21T06:46:40.753 INFO:teuthology.orchestra.run.smithi007.stdout: "unittest_2_items": 0 2024-09-21T06:46:40.753 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2024-09-21T06:46:40.753 INFO:teuthology.orchestra.run.smithi007.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T06:46:40.753 INFO:teuthology.orchestra.run.smithi007.stdout: "val": 0, 2024-09-21T06:46:40.753 INFO:teuthology.orchestra.run.smithi007.stdout: "max": 104857600, 2024-09-21T06:46:40.753 INFO:teuthology.orchestra.run.smithi007.stdout: "get_started": 0, 2024-09-21T06:46:40.753 INFO:teuthology.orchestra.run.smithi007.stdout: "get": 214, 2024-09-21T06:46:40.753 INFO:teuthology.orchestra.run.smithi007.stdout: "get_sum": 805564, 2024-09-21T06:46:40.753 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_fail": 0, 2024-09-21T06:46:40.753 INFO:teuthology.orchestra.run.smithi007.stdout: "get_or_fail_success": 214, 2024-09-21T06:46:40.754 INFO:teuthology.orchestra.run.smithi007.stdout: "take": 0, 2024-09-21T06:46:40.754 INFO:teuthology.orchestra.run.smithi007.stdout: "take_sum": 0, 2024-09-21T06:46:40.754 INFO:teuthology.orchestra.run.smithi007.stdout: "put": 214, 2024-09-21T06:46:40.754 INFO:teuthology.orchestra.run.smithi007.stdout: "put_sum": 805564, 2024-09-21T06:46:40.754 INFO:teuthology.orchestra.run.smithi007.stdout: "wait": { 2024-09-21T06:46:40.754 INFO:teuthology.orchestra.run.smithi007.stdout: "avgcount": 0, 2024-09-21T06:46:40.754 INFO:teuthology.orchestra.run.smithi007.stdout: "sum": 0.000000000, 2024-09-21T06:46:40.754 INFO:teuthology.orchestra.run.smithi007.stdout: "avgtime": 0.000000000 2024-09-21T06:46:40.754 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:40.754 INFO:teuthology.orchestra.run.smithi007.stdout: } 2024-09-21T06:46:40.754 INFO:teuthology.orchestra.run.smithi007.stdout:} 2024-09-21T06:46:41.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:46:40 smithi144 ceph-mon[34653]: pgmap v641: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:46:41.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:46:40 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:46:41.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:46:40 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:46:41.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:46:40 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:46:41.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:46:40 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:46:41.339 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:46:40 smithi007 ceph-mon[30983]: pgmap v641: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:46:41.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:46:40 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:46:41.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:46:40 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:46:41.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:46:40 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:46:41.340 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:46:40 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:46:41.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:46:40 smithi018 ceph-mon[34477]: pgmap v641: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:46:41.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:46:40 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:46:41.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:46:40 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:46:41.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:46:40 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:46:41.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:46:40 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:46:41.379 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-09-21T06:46:41.379 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-09-21T06:46:41.379 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2024-09-21T06:46:41.379 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2024-09-21T06:46:41.379 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2024-09-21T06:46:41.379 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2024-09-21T06:46:41.379 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2024-09-21T06:46:41.380 DEBUG:tasks.check_counter:Getting stats from b 2024-09-21T06:46:41.380 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph daemon mds.b perf dump 2024-09-21T06:46:41.648 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T06:46:42.178 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-21T06:46:42.178 INFO:teuthology.orchestra.run.smithi018.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T06:46:42.178 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_messages": 5926, 2024-09-21T06:46:42.178 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages": 5823, 2024-09-21T06:46:42.178 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_bytes": 1693253, 2024-09-21T06:46:42.178 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_bytes": 10275636, 2024-09-21T06:46:42.178 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_created_connections": 10, 2024-09-21T06:46:42.178 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_active_connections": 4, 2024-09-21T06:46:42.178 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_total_time": 0.644174257, 2024-09-21T06:46:42.179 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_send_time": 0.277881008, 2024-09-21T06:46:42.179 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_recv_time": 0.155593178, 2024-09-21T06:46:42.179 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_fast_dispatch_time": 0.166502503, 2024-09-21T06:46:42.179 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:46:42.179 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 5824, 2024-09-21T06:46:42.179 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 1.857833655, 2024-09-21T06:46:42.179 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000318996 2024-09-21T06:46:42.179 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:42.179 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:46:42.179 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 975, 2024-09-21T06:46:42.179 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000253668, 2024-09-21T06:46:42.179 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000260 2024-09-21T06:46:42.179 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:42.179 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T06:46:42.180 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T06:46:42.180 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:42.180 INFO:teuthology.orchestra.run.smithi018.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T06:46:42.180 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_messages": 3733, 2024-09-21T06:46:42.180 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages": 3782, 2024-09-21T06:46:42.180 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_bytes": 908047, 2024-09-21T06:46:42.180 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_bytes": 5582322, 2024-09-21T06:46:42.180 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_created_connections": 164, 2024-09-21T06:46:42.180 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_active_connections": 9, 2024-09-21T06:46:42.180 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_total_time": 0.427628170, 2024-09-21T06:46:42.180 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_send_time": 0.165325072, 2024-09-21T06:46:42.180 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_recv_time": 0.156616367, 2024-09-21T06:46:42.180 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_fast_dispatch_time": 0.090726073, 2024-09-21T06:46:42.180 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:46:42.181 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 3784, 2024-09-21T06:46:42.181 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.335198611, 2024-09-21T06:46:42.181 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000088583 2024-09-21T06:46:42.181 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:42.181 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:46:42.181 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 1132, 2024-09-21T06:46:42.181 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000253695, 2024-09-21T06:46:42.181 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000224 2024-09-21T06:46:42.181 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:42.181 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-21T06:46:42.181 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_encrypted_bytes": 362640 2024-09-21T06:46:42.181 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:42.181 INFO:teuthology.orchestra.run.smithi018.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T06:46:42.181 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_messages": 6837, 2024-09-21T06:46:42.181 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages": 7191, 2024-09-21T06:46:42.182 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_bytes": 3178692, 2024-09-21T06:46:42.182 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_bytes": 2866625, 2024-09-21T06:46:42.182 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_created_connections": 28, 2024-09-21T06:46:42.182 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_active_connections": 8, 2024-09-21T06:46:42.182 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_total_time": 0.726215433, 2024-09-21T06:46:42.182 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_send_time": 0.316311124, 2024-09-21T06:46:42.182 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_recv_time": 0.436493842, 2024-09-21T06:46:42.182 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_fast_dispatch_time": 0.110240430, 2024-09-21T06:46:42.182 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:46:42.182 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 7184, 2024-09-21T06:46:42.182 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 1.352859080, 2024-09-21T06:46:42.182 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000188315 2024-09-21T06:46:42.182 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:42.183 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:46:42.183 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 9702, 2024-09-21T06:46:42.183 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.002753719, 2024-09-21T06:46:42.183 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000283 2024-09-21T06:46:42.183 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:42.183 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_encrypted_bytes": 1256960, 2024-09-21T06:46:42.183 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_encrypted_bytes": 276672 2024-09-21T06:46:42.183 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:42.183 INFO:teuthology.orchestra.run.smithi018.stdout: "cct": { 2024-09-21T06:46:42.183 INFO:teuthology.orchestra.run.smithi018.stdout: "total_workers": 1, 2024-09-21T06:46:42.183 INFO:teuthology.orchestra.run.smithi018.stdout: "unhealthy_workers": 0 2024-09-21T06:46:42.183 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:42.183 INFO:teuthology.orchestra.run.smithi018.stdout: "finisher-MDSRank": { 2024-09-21T06:46:42.183 INFO:teuthology.orchestra.run.smithi018.stdout: "queue_len": 0, 2024-09-21T06:46:42.184 INFO:teuthology.orchestra.run.smithi018.stdout: "complete_latency": { 2024-09-21T06:46:42.184 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 5579, 2024-09-21T06:46:42.184 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 2.078273775, 2024-09-21T06:46:42.184 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000372517 2024-09-21T06:46:42.184 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T06:46:42.184 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:42.184 INFO:teuthology.orchestra.run.smithi018.stdout: "finisher-PurgeQueue": { 2024-09-21T06:46:42.184 INFO:teuthology.orchestra.run.smithi018.stdout: "queue_len": 0, 2024-09-21T06:46:42.184 INFO:teuthology.orchestra.run.smithi018.stdout: "complete_latency": { 2024-09-21T06:46:42.184 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 4268, 2024-09-21T06:46:42.184 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.139840613, 2024-09-21T06:46:42.184 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000032764 2024-09-21T06:46:42.184 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T06:46:42.185 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:42.185 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": { 2024-09-21T06:46:42.185 INFO:teuthology.orchestra.run.smithi018.stdout: "request": 231, 2024-09-21T06:46:42.185 INFO:teuthology.orchestra.run.smithi018.stdout: "reply": 231, 2024-09-21T06:46:42.185 INFO:teuthology.orchestra.run.smithi018.stdout: "reply_latency": { 2024-09-21T06:46:42.185 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 231, 2024-09-21T06:46:42.185 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.186595183, 2024-09-21T06:46:42.185 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000807771 2024-09-21T06:46:42.185 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:42.185 INFO:teuthology.orchestra.run.smithi018.stdout: "slow_reply": 0, 2024-09-21T06:46:42.185 INFO:teuthology.orchestra.run.smithi018.stdout: "forward": 0, 2024-09-21T06:46:42.185 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_fetch_complete": 0, 2024-09-21T06:46:42.185 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_fetch_keys": 0, 2024-09-21T06:46:42.185 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_commit": 74, 2024-09-21T06:46:42.186 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_split": 0, 2024-09-21T06:46:42.186 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_merge": 0, 2024-09-21T06:46:42.186 INFO:teuthology.orchestra.run.smithi018.stdout: "inodes": 30, 2024-09-21T06:46:42.186 INFO:teuthology.orchestra.run.smithi018.stdout: "inodes_top": 5, 2024-09-21T06:46:42.186 INFO:teuthology.orchestra.run.smithi018.stdout: "inodes_bottom": 25, 2024-09-21T06:46:42.186 INFO:teuthology.orchestra.run.smithi018.stdout: "inodes_pin_tail": 0, 2024-09-21T06:46:42.186 INFO:teuthology.orchestra.run.smithi018.stdout: "inodes_pinned": 22, 2024-09-21T06:46:42.186 INFO:teuthology.orchestra.run.smithi018.stdout: "inodes_expired": 0, 2024-09-21T06:46:42.186 INFO:teuthology.orchestra.run.smithi018.stdout: "inodes_with_caps": 2, 2024-09-21T06:46:42.186 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": 2, 2024-09-21T06:46:42.186 INFO:teuthology.orchestra.run.smithi018.stdout: "subtrees": 2, 2024-09-21T06:46:42.186 INFO:teuthology.orchestra.run.smithi018.stdout: "traverse": 447, 2024-09-21T06:46:42.186 INFO:teuthology.orchestra.run.smithi018.stdout: "traverse_hit": 440, 2024-09-21T06:46:42.186 INFO:teuthology.orchestra.run.smithi018.stdout: "traverse_forward": 0, 2024-09-21T06:46:42.187 INFO:teuthology.orchestra.run.smithi018.stdout: "traverse_discover": 0, 2024-09-21T06:46:42.187 INFO:teuthology.orchestra.run.smithi018.stdout: "traverse_dir_fetch": 0, 2024-09-21T06:46:42.187 INFO:teuthology.orchestra.run.smithi018.stdout: "traverse_remote_ino": 0, 2024-09-21T06:46:42.187 INFO:teuthology.orchestra.run.smithi018.stdout: "traverse_lock": 0, 2024-09-21T06:46:42.187 INFO:teuthology.orchestra.run.smithi018.stdout: "load_cent": 0, 2024-09-21T06:46:42.187 INFO:teuthology.orchestra.run.smithi018.stdout: "q": 0, 2024-09-21T06:46:42.187 INFO:teuthology.orchestra.run.smithi018.stdout: "exported": 0, 2024-09-21T06:46:42.187 INFO:teuthology.orchestra.run.smithi018.stdout: "exported_inodes": 0, 2024-09-21T06:46:42.187 INFO:teuthology.orchestra.run.smithi018.stdout: "imported": 0, 2024-09-21T06:46:42.187 INFO:teuthology.orchestra.run.smithi018.stdout: "imported_inodes": 0, 2024-09-21T06:46:42.187 INFO:teuthology.orchestra.run.smithi018.stdout: "openino_dir_fetch": 0, 2024-09-21T06:46:42.187 INFO:teuthology.orchestra.run.smithi018.stdout: "openino_backtrace_fetch": 238, 2024-09-21T06:46:42.187 INFO:teuthology.orchestra.run.smithi018.stdout: "openino_peer_discover": 0, 2024-09-21T06:46:42.187 INFO:teuthology.orchestra.run.smithi018.stdout: "root_rfiles": 4, 2024-09-21T06:46:42.187 INFO:teuthology.orchestra.run.smithi018.stdout: "root_rbytes": 234, 2024-09-21T06:46:42.188 INFO:teuthology.orchestra.run.smithi018.stdout: "root_rsnaps": 6, 2024-09-21T06:46:42.188 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_backtrace_fetch": 238, 2024-09-21T06:46:42.188 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_set_tag": 0, 2024-09-21T06:46:42.188 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T06:46:42.188 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_inotable_repaired": 0, 2024-09-21T06:46:42.188 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_dir_inodes": 152, 2024-09-21T06:46:42.188 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_dir_base_inodes": 21, 2024-09-21T06:46:42.188 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_dirfrag_rstats": 131, 2024-09-21T06:46:42.188 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_file_inodes": 86, 2024-09-21T06:46:42.188 INFO:teuthology.orchestra.run.smithi018.stdout: "handle_inode_file_caps": 0, 2024-09-21T06:46:42.188 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_cap_op_revoke": 22, 2024-09-21T06:46:42.188 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_cap_op_grant": 1632, 2024-09-21T06:46:42.188 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T06:46:42.188 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T06:46:42.188 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T06:46:42.189 INFO:teuthology.orchestra.run.smithi018.stdout: "handle_client_caps": 3843, 2024-09-21T06:46:42.189 INFO:teuthology.orchestra.run.smithi018.stdout: "handle_client_caps_dirty": 3784, 2024-09-21T06:46:42.189 INFO:teuthology.orchestra.run.smithi018.stdout: "handle_client_cap_release": 5, 2024-09-21T06:46:42.189 INFO:teuthology.orchestra.run.smithi018.stdout: "process_request_cap_release": 25 2024-09-21T06:46:42.189 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:42.189 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_cache": { 2024-09-21T06:46:42.189 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_update": 5, 2024-09-21T06:46:42.189 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_update_receipt": 0, 2024-09-21T06:46:42.189 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_try_discover": 0, 2024-09-21T06:46:42.189 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_send_discover": 0, 2024-09-21T06:46:42.189 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_handle_discover": 12, 2024-09-21T06:46:42.189 INFO:teuthology.orchestra.run.smithi018.stdout: "num_strays": 2, 2024-09-21T06:46:42.189 INFO:teuthology.orchestra.run.smithi018.stdout: "num_strays_delayed": 0, 2024-09-21T06:46:42.189 INFO:teuthology.orchestra.run.smithi018.stdout: "num_strays_enqueuing": 0, 2024-09-21T06:46:42.190 INFO:teuthology.orchestra.run.smithi018.stdout: "strays_created": 5, 2024-09-21T06:46:42.190 INFO:teuthology.orchestra.run.smithi018.stdout: "strays_enqueued": 3, 2024-09-21T06:46:42.190 INFO:teuthology.orchestra.run.smithi018.stdout: "strays_reintegrated": 0, 2024-09-21T06:46:42.190 INFO:teuthology.orchestra.run.smithi018.stdout: "strays_migrated": 0, 2024-09-21T06:46:42.190 INFO:teuthology.orchestra.run.smithi018.stdout: "num_recovering_processing": 0, 2024-09-21T06:46:42.190 INFO:teuthology.orchestra.run.smithi018.stdout: "num_recovering_enqueued": 0, 2024-09-21T06:46:42.190 INFO:teuthology.orchestra.run.smithi018.stdout: "num_recovering_prioritized": 0, 2024-09-21T06:46:42.190 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_started": 0, 2024-09-21T06:46:42.190 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_completed": 0, 2024-09-21T06:46:42.190 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_quiesce_path": 0, 2024-09-21T06:46:42.190 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_quiesce_inode": 0, 2024-09-21T06:46:42.190 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_enqueue_scrub": 21, 2024-09-21T06:46:42.190 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_exportdir": 0, 2024-09-21T06:46:42.191 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_flush": 0, 2024-09-21T06:46:42.191 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_fragmentdir": 0, 2024-09-21T06:46:42.191 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_fragstats": 0, 2024-09-21T06:46:42.191 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_inodestats": 0, 2024-09-21T06:46:42.191 INFO:teuthology.orchestra.run.smithi018.stdout: "uninline_started": 0, 2024-09-21T06:46:42.191 INFO:teuthology.orchestra.run.smithi018.stdout: "uninline_succeeded": 0, 2024-09-21T06:46:42.191 INFO:teuthology.orchestra.run.smithi018.stdout: "uninline_write_failed": 0 2024-09-21T06:46:42.191 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:42.191 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_log": { 2024-09-21T06:46:42.191 INFO:teuthology.orchestra.run.smithi018.stdout: "evlrg": 0, 2024-09-21T06:46:42.191 INFO:teuthology.orchestra.run.smithi018.stdout: "evadd": 3932, 2024-09-21T06:46:42.191 INFO:teuthology.orchestra.run.smithi018.stdout: "evex": 3863, 2024-09-21T06:46:42.191 INFO:teuthology.orchestra.run.smithi018.stdout: "evtrm": 3863, 2024-09-21T06:46:42.191 INFO:teuthology.orchestra.run.smithi018.stdout: "ev": 69, 2024-09-21T06:46:42.192 INFO:teuthology.orchestra.run.smithi018.stdout: "evexg": 0, 2024-09-21T06:46:42.192 INFO:teuthology.orchestra.run.smithi018.stdout: "evexd": 886, 2024-09-21T06:46:42.192 INFO:teuthology.orchestra.run.smithi018.stdout: "segadd": 16, 2024-09-21T06:46:42.192 INFO:teuthology.orchestra.run.smithi018.stdout: "segex": 15, 2024-09-21T06:46:42.192 INFO:teuthology.orchestra.run.smithi018.stdout: "segtrm": 15, 2024-09-21T06:46:42.192 INFO:teuthology.orchestra.run.smithi018.stdout: "seg": 1, 2024-09-21T06:46:42.192 INFO:teuthology.orchestra.run.smithi018.stdout: "segmjr": 1, 2024-09-21T06:46:42.192 INFO:teuthology.orchestra.run.smithi018.stdout: "segexg": 0, 2024-09-21T06:46:42.192 INFO:teuthology.orchestra.run.smithi018.stdout: "segexd": 2, 2024-09-21T06:46:42.192 INFO:teuthology.orchestra.run.smithi018.stdout: "expos": 14517774, 2024-09-21T06:46:42.192 INFO:teuthology.orchestra.run.smithi018.stdout: "wrpos": 14644446, 2024-09-21T06:46:42.192 INFO:teuthology.orchestra.run.smithi018.stdout: "rdpos": 0, 2024-09-21T06:46:42.192 INFO:teuthology.orchestra.run.smithi018.stdout: "jlat": { 2024-09-21T06:46:42.192 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 3901, 2024-09-21T06:46:42.192 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 130.092621687, 2024-09-21T06:46:42.192 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.033348531 2024-09-21T06:46:42.193 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:42.193 INFO:teuthology.orchestra.run.smithi018.stdout: "replayed": 0 2024-09-21T06:46:42.193 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:42.193 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_mem": { 2024-09-21T06:46:42.193 INFO:teuthology.orchestra.run.smithi018.stdout: "ino": 25, 2024-09-21T06:46:42.193 INFO:teuthology.orchestra.run.smithi018.stdout: "ino+": 49, 2024-09-21T06:46:42.193 INFO:teuthology.orchestra.run.smithi018.stdout: "ino-": 24, 2024-09-21T06:46:42.193 INFO:teuthology.orchestra.run.smithi018.stdout: "dir": 20, 2024-09-21T06:46:42.193 INFO:teuthology.orchestra.run.smithi018.stdout: "dir+": 20, 2024-09-21T06:46:42.193 INFO:teuthology.orchestra.run.smithi018.stdout: "dir-": 0, 2024-09-21T06:46:42.193 INFO:teuthology.orchestra.run.smithi018.stdout: "dn": 30, 2024-09-21T06:46:42.193 INFO:teuthology.orchestra.run.smithi018.stdout: "dn+": 35, 2024-09-21T06:46:42.193 INFO:teuthology.orchestra.run.smithi018.stdout: "dn-": 5, 2024-09-21T06:46:42.193 INFO:teuthology.orchestra.run.smithi018.stdout: "cap": 2, 2024-09-21T06:46:42.193 INFO:teuthology.orchestra.run.smithi018.stdout: "cap+": 18, 2024-09-21T06:46:42.194 INFO:teuthology.orchestra.run.smithi018.stdout: "cap-": 16, 2024-09-21T06:46:42.194 INFO:teuthology.orchestra.run.smithi018.stdout: "rss": 125700, 2024-09-21T06:46:42.194 INFO:teuthology.orchestra.run.smithi018.stdout: "heap": 341721088 2024-09-21T06:46:42.194 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:42.194 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_server": { 2024-09-21T06:46:42.194 INFO:teuthology.orchestra.run.smithi018.stdout: "dispatch_client_request": 279, 2024-09-21T06:46:42.194 INFO:teuthology.orchestra.run.smithi018.stdout: "dispatch_server_request": 0, 2024-09-21T06:46:42.194 INFO:teuthology.orchestra.run.smithi018.stdout: "handle_client_request": 231, 2024-09-21T06:46:42.194 INFO:teuthology.orchestra.run.smithi018.stdout: "handle_client_session": 27, 2024-09-21T06:46:42.194 INFO:teuthology.orchestra.run.smithi018.stdout: "handle_peer_request": 0, 2024-09-21T06:46:42.194 INFO:teuthology.orchestra.run.smithi018.stdout: "req_create_latency": { 2024-09-21T06:46:42.194 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 7, 2024-09-21T06:46:42.194 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.007136330, 2024-09-21T06:46:42.194 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.001019475 2024-09-21T06:46:42.195 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:42.195 INFO:teuthology.orchestra.run.smithi018.stdout: "req_getattr_latency": { 2024-09-21T06:46:42.195 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 172, 2024-09-21T06:46:42.195 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.039341674, 2024-09-21T06:46:42.195 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000228730 2024-09-21T06:46:42.195 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:42.195 INFO:teuthology.orchestra.run.smithi018.stdout: "req_getfilelock_latency": { 2024-09-21T06:46:42.195 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:42.195 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:42.195 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:42.195 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:42.195 INFO:teuthology.orchestra.run.smithi018.stdout: "req_link_latency": { 2024-09-21T06:46:42.195 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:42.195 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:42.195 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:42.196 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:42.196 INFO:teuthology.orchestra.run.smithi018.stdout: "req_lookup_latency": { 2024-09-21T06:46:42.196 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:42.196 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:42.196 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:42.196 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:42.196 INFO:teuthology.orchestra.run.smithi018.stdout: "req_lookuphash_latency": { 2024-09-21T06:46:42.196 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:42.196 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:42.196 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:42.196 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:42.196 INFO:teuthology.orchestra.run.smithi018.stdout: "req_lookupino_latency": { 2024-09-21T06:46:42.196 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:42.196 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:42.196 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:42.197 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:42.197 INFO:teuthology.orchestra.run.smithi018.stdout: "req_lookupname_latency": { 2024-09-21T06:46:42.197 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:42.197 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:42.197 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:42.197 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:42.197 INFO:teuthology.orchestra.run.smithi018.stdout: "req_lookupparent_latency": { 2024-09-21T06:46:42.197 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:42.197 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:42.197 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:42.197 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:42.197 INFO:teuthology.orchestra.run.smithi018.stdout: "req_lookupsnap_latency": { 2024-09-21T06:46:42.197 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:42.197 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:42.197 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:42.198 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:42.198 INFO:teuthology.orchestra.run.smithi018.stdout: "req_lssnap_latency": { 2024-09-21T06:46:42.198 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 10, 2024-09-21T06:46:42.199 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.001581764, 2024-09-21T06:46:42.199 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000158176 2024-09-21T06:46:42.199 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:42.199 INFO:teuthology.orchestra.run.smithi018.stdout: "req_mkdir_latency": { 2024-09-21T06:46:42.199 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 8, 2024-09-21T06:46:42.199 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.013317621, 2024-09-21T06:46:42.199 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.001664702 2024-09-21T06:46:42.199 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:42.199 INFO:teuthology.orchestra.run.smithi018.stdout: "req_mknod_latency": { 2024-09-21T06:46:42.199 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:42.199 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:42.199 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:42.199 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:42.200 INFO:teuthology.orchestra.run.smithi018.stdout: "req_mksnap_latency": { 2024-09-21T06:46:42.200 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 10, 2024-09-21T06:46:42.200 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.057023828, 2024-09-21T06:46:42.200 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.005702382 2024-09-21T06:46:42.200 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:42.200 INFO:teuthology.orchestra.run.smithi018.stdout: "req_open_latency": { 2024-09-21T06:46:42.200 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 1, 2024-09-21T06:46:42.200 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000235597, 2024-09-21T06:46:42.200 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000235597 2024-09-21T06:46:42.200 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:42.200 INFO:teuthology.orchestra.run.smithi018.stdout: "req_readdir_latency": { 2024-09-21T06:46:42.200 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 2, 2024-09-21T06:46:42.200 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.007496181, 2024-09-21T06:46:42.200 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.003748090 2024-09-21T06:46:42.201 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:42.201 INFO:teuthology.orchestra.run.smithi018.stdout: "req_rename_latency": { 2024-09-21T06:46:42.201 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 2, 2024-09-21T06:46:42.201 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.002256979, 2024-09-21T06:46:42.201 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.001128489 2024-09-21T06:46:42.201 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:42.201 INFO:teuthology.orchestra.run.smithi018.stdout: "req_renamesnap_latency": { 2024-09-21T06:46:42.201 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:42.201 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:42.201 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:42.201 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:42.201 INFO:teuthology.orchestra.run.smithi018.stdout: "req_snapdiff_latency": { 2024-09-21T06:46:42.201 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:42.201 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:42.201 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:42.202 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:42.202 INFO:teuthology.orchestra.run.smithi018.stdout: "req_rmdir_latency": { 2024-09-21T06:46:42.202 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 2, 2024-09-21T06:46:42.202 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.008290462, 2024-09-21T06:46:42.202 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.004145231 2024-09-21T06:46:42.202 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:42.202 INFO:teuthology.orchestra.run.smithi018.stdout: "req_rmsnap_latency": { 2024-09-21T06:46:42.202 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 4, 2024-09-21T06:46:42.202 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.020143135, 2024-09-21T06:46:42.202 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.005035783 2024-09-21T06:46:42.202 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:42.203 INFO:teuthology.orchestra.run.smithi018.stdout: "req_rmxattr_latency": { 2024-09-21T06:46:42.203 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:42.203 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:42.203 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:42.203 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:42.203 INFO:teuthology.orchestra.run.smithi018.stdout: "req_setattr_latency": { 2024-09-21T06:46:42.203 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 1, 2024-09-21T06:46:42.203 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.001881017, 2024-09-21T06:46:42.203 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.001881017 2024-09-21T06:46:42.203 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:42.203 INFO:teuthology.orchestra.run.smithi018.stdout: "req_setdirlayout_latency": { 2024-09-21T06:46:42.203 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:42.203 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:42.203 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:42.204 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:42.204 INFO:teuthology.orchestra.run.smithi018.stdout: "req_setfilelock_latency": { 2024-09-21T06:46:42.204 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:42.204 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:42.204 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:42.204 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:42.204 INFO:teuthology.orchestra.run.smithi018.stdout: "req_setlayout_latency": { 2024-09-21T06:46:42.204 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:42.204 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:42.204 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:42.204 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:42.204 INFO:teuthology.orchestra.run.smithi018.stdout: "req_setxattr_latency": { 2024-09-21T06:46:42.204 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 9, 2024-09-21T06:46:42.204 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.022080478, 2024-09-21T06:46:42.204 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.002453386 2024-09-21T06:46:42.205 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:42.205 INFO:teuthology.orchestra.run.smithi018.stdout: "req_symlink_latency": { 2024-09-21T06:46:42.205 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:42.205 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:42.205 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:42.205 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:42.205 INFO:teuthology.orchestra.run.smithi018.stdout: "req_unlink_latency": { 2024-09-21T06:46:42.205 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 3, 2024-09-21T06:46:42.205 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.005810117, 2024-09-21T06:46:42.205 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.001936705 2024-09-21T06:46:42.205 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:42.205 INFO:teuthology.orchestra.run.smithi018.stdout: "cap_revoke_eviction": 0, 2024-09-21T06:46:42.205 INFO:teuthology.orchestra.run.smithi018.stdout: "cap_acquisition_throttle": 0, 2024-09-21T06:46:42.205 INFO:teuthology.orchestra.run.smithi018.stdout: "req_getvxattr_latency": { 2024-09-21T06:46:42.206 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:42.206 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:42.206 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:42.206 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T06:46:42.206 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:42.206 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_sessions": { 2024-09-21T06:46:42.206 INFO:teuthology.orchestra.run.smithi018.stdout: "session_count": 2, 2024-09-21T06:46:42.206 INFO:teuthology.orchestra.run.smithi018.stdout: "session_add": 3, 2024-09-21T06:46:42.206 INFO:teuthology.orchestra.run.smithi018.stdout: "session_remove": 1, 2024-09-21T06:46:42.206 INFO:teuthology.orchestra.run.smithi018.stdout: "sessions_open": 2, 2024-09-21T06:46:42.206 INFO:teuthology.orchestra.run.smithi018.stdout: "sessions_stale": 0, 2024-09-21T06:46:42.206 INFO:teuthology.orchestra.run.smithi018.stdout: "total_load": 27, 2024-09-21T06:46:42.206 INFO:teuthology.orchestra.run.smithi018.stdout: "average_load": 13, 2024-09-21T06:46:42.206 INFO:teuthology.orchestra.run.smithi018.stdout: "avg_session_uptime": 604, 2024-09-21T06:46:42.206 INFO:teuthology.orchestra.run.smithi018.stdout: "mdthresh_evicted": 0 2024-09-21T06:46:42.207 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:42.207 INFO:teuthology.orchestra.run.smithi018.stdout: "mempool": { 2024-09-21T06:46:42.207 INFO:teuthology.orchestra.run.smithi018.stdout: "bloom_filter_bytes": 0, 2024-09-21T06:46:42.207 INFO:teuthology.orchestra.run.smithi018.stdout: "bloom_filter_items": 0, 2024-09-21T06:46:42.207 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T06:46:42.207 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_alloc_items": 0, 2024-09-21T06:46:42.207 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T06:46:42.207 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_data_items": 0, 2024-09-21T06:46:42.207 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T06:46:42.207 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T06:46:42.207 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T06:46:42.207 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T06:46:42.207 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T06:46:42.208 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_other_items": 0, 2024-09-21T06:46:42.208 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T06:46:42.208 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T06:46:42.208 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_extent_bytes": 0, 2024-09-21T06:46:42.208 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_extent_items": 0, 2024-09-21T06:46:42.208 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_blob_bytes": 0, 2024-09-21T06:46:42.209 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_blob_items": 0, 2024-09-21T06:46:42.209 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T06:46:42.209 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T06:46:42.209 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T06:46:42.209 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T06:46:42.209 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T06:46:42.209 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_items": 0, 2024-09-21T06:46:42.210 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_txc_bytes": 0, 2024-09-21T06:46:42.210 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_txc_items": 0, 2024-09-21T06:46:42.210 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T06:46:42.210 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T06:46:42.210 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_bytes": 0, 2024-09-21T06:46:42.210 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_items": 0, 2024-09-21T06:46:42.211 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_bytes": 0, 2024-09-21T06:46:42.211 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_items": 0, 2024-09-21T06:46:42.211 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T06:46:42.211 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_reader_items": 0, 2024-09-21T06:46:42.211 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T06:46:42.211 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_writer_items": 0, 2024-09-21T06:46:42.211 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_anon_bytes": 343219, 2024-09-21T06:46:42.211 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_anon_items": 146, 2024-09-21T06:46:42.211 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_meta_bytes": 792, 2024-09-21T06:46:42.212 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_meta_items": 9, 2024-09-21T06:46:42.212 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_bytes": 0, 2024-09-21T06:46:42.213 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_items": 0, 2024-09-21T06:46:42.213 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mapbl_bytes": 0, 2024-09-21T06:46:42.214 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mapbl_items": 0, 2024-09-21T06:46:42.214 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pglog_bytes": 0, 2024-09-21T06:46:42.214 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pglog_items": 0, 2024-09-21T06:46:42.214 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_bytes": 7872, 2024-09-21T06:46:42.214 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_items": 174, 2024-09-21T06:46:42.214 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T06:46:42.214 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_mapping_items": 0, 2024-09-21T06:46:42.214 INFO:teuthology.orchestra.run.smithi018.stdout: "pgmap_bytes": 0, 2024-09-21T06:46:42.214 INFO:teuthology.orchestra.run.smithi018.stdout: "pgmap_items": 0, 2024-09-21T06:46:42.214 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_co_bytes": 120537, 2024-09-21T06:46:42.215 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_co_items": 1090, 2024-09-21T06:46:42.215 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_1_bytes": 0, 2024-09-21T06:46:42.215 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_1_items": 0, 2024-09-21T06:46:42.215 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_2_bytes": 0, 2024-09-21T06:46:42.215 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_2_items": 0 2024-09-21T06:46:42.215 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:42.215 INFO:teuthology.orchestra.run.smithi018.stdout: "objecter": { 2024-09-21T06:46:42.215 INFO:teuthology.orchestra.run.smithi018.stdout: "op_active": 0, 2024-09-21T06:46:42.215 INFO:teuthology.orchestra.run.smithi018.stdout: "op_laggy": 0, 2024-09-21T06:46:42.215 INFO:teuthology.orchestra.run.smithi018.stdout: "op_send": 9514, 2024-09-21T06:46:42.216 INFO:teuthology.orchestra.run.smithi018.stdout: "op_send_bytes": 10565432, 2024-09-21T06:46:42.216 INFO:teuthology.orchestra.run.smithi018.stdout: "op_resend": 31, 2024-09-21T06:46:42.216 INFO:teuthology.orchestra.run.smithi018.stdout: "op_reply": 9514, 2024-09-21T06:46:42.216 INFO:teuthology.orchestra.run.smithi018.stdout: "op_latency": { 2024-09-21T06:46:42.216 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 9514, 2024-09-21T06:46:42.216 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 174.941857614, 2024-09-21T06:46:42.216 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.018387834 2024-09-21T06:46:42.216 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:42.216 INFO:teuthology.orchestra.run.smithi018.stdout: "op_inflight": 0, 2024-09-21T06:46:42.216 INFO:teuthology.orchestra.run.smithi018.stdout: "oplen_avg": { 2024-09-21T06:46:42.216 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 9514, 2024-09-21T06:46:42.216 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 9723 2024-09-21T06:46:42.216 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:42.216 INFO:teuthology.orchestra.run.smithi018.stdout: "op": 9514, 2024-09-21T06:46:42.217 INFO:teuthology.orchestra.run.smithi018.stdout: "op_r": 283, 2024-09-21T06:46:42.217 INFO:teuthology.orchestra.run.smithi018.stdout: "op_w": 9231, 2024-09-21T06:46:42.217 INFO:teuthology.orchestra.run.smithi018.stdout: "op_rmw": 0, 2024-09-21T06:46:42.217 INFO:teuthology.orchestra.run.smithi018.stdout: "op_pg": 0, 2024-09-21T06:46:42.217 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_stat": 54, 2024-09-21T06:46:42.217 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_create": 30, 2024-09-21T06:46:42.217 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_read": 24, 2024-09-21T06:46:42.217 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_write": 3904, 2024-09-21T06:46:42.217 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_writefull": 50, 2024-09-21T06:46:42.217 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_writesame": 0, 2024-09-21T06:46:42.217 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_append": 0, 2024-09-21T06:46:42.217 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_zero": 0, 2024-09-21T06:46:42.217 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_truncate": 0, 2024-09-21T06:46:42.217 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_delete": 5126, 2024-09-21T06:46:42.217 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_mapext": 0, 2024-09-21T06:46:42.218 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_sparse_read": 0, 2024-09-21T06:46:42.218 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_clonerange": 0, 2024-09-21T06:46:42.218 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_getxattr": 259, 2024-09-21T06:46:42.218 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_setxattr": 60, 2024-09-21T06:46:42.218 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_cmpxattr": 0, 2024-09-21T06:46:42.218 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_rmxattr": 0, 2024-09-21T06:46:42.218 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_resetxattrs": 0, 2024-09-21T06:46:42.218 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_call": 0, 2024-09-21T06:46:42.218 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_watch": 0, 2024-09-21T06:46:42.218 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_notify": 0, 2024-09-21T06:46:42.218 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T06:46:42.218 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_pgls": 0, 2024-09-21T06:46:42.219 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_pgls_filter": 0, 2024-09-21T06:46:42.219 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_other": 0, 2024-09-21T06:46:42.219 INFO:teuthology.orchestra.run.smithi018.stdout: "linger_active": 0, 2024-09-21T06:46:42.219 INFO:teuthology.orchestra.run.smithi018.stdout: "linger_send": 0, 2024-09-21T06:46:42.219 INFO:teuthology.orchestra.run.smithi018.stdout: "linger_resend": 0, 2024-09-21T06:46:42.219 INFO:teuthology.orchestra.run.smithi018.stdout: "linger_ping": 0, 2024-09-21T06:46:42.219 INFO:teuthology.orchestra.run.smithi018.stdout: "poolop_active": 0, 2024-09-21T06:46:42.219 INFO:teuthology.orchestra.run.smithi018.stdout: "poolop_send": 0, 2024-09-21T06:46:42.219 INFO:teuthology.orchestra.run.smithi018.stdout: "poolop_resend": 0, 2024-09-21T06:46:42.219 INFO:teuthology.orchestra.run.smithi018.stdout: "poolstat_active": 0, 2024-09-21T06:46:42.219 INFO:teuthology.orchestra.run.smithi018.stdout: "poolstat_send": 0, 2024-09-21T06:46:42.219 INFO:teuthology.orchestra.run.smithi018.stdout: "poolstat_resend": 0, 2024-09-21T06:46:42.219 INFO:teuthology.orchestra.run.smithi018.stdout: "statfs_active": 0, 2024-09-21T06:46:42.219 INFO:teuthology.orchestra.run.smithi018.stdout: "statfs_send": 0, 2024-09-21T06:46:42.219 INFO:teuthology.orchestra.run.smithi018.stdout: "statfs_resend": 0, 2024-09-21T06:46:42.220 INFO:teuthology.orchestra.run.smithi018.stdout: "command_active": 0, 2024-09-21T06:46:42.220 INFO:teuthology.orchestra.run.smithi018.stdout: "command_send": 0, 2024-09-21T06:46:42.220 INFO:teuthology.orchestra.run.smithi018.stdout: "command_resend": 0, 2024-09-21T06:46:42.220 INFO:teuthology.orchestra.run.smithi018.stdout: "map_epoch": 85, 2024-09-21T06:46:42.220 INFO:teuthology.orchestra.run.smithi018.stdout: "map_full": 0, 2024-09-21T06:46:42.220 INFO:teuthology.orchestra.run.smithi018.stdout: "map_inc": 10, 2024-09-21T06:46:42.220 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_sessions": 12, 2024-09-21T06:46:42.220 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_session_open": 12, 2024-09-21T06:46:42.220 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_session_close": 0, 2024-09-21T06:46:42.220 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_laggy": 0, 2024-09-21T06:46:42.220 INFO:teuthology.orchestra.run.smithi018.stdout: "omap_wr": 200, 2024-09-21T06:46:42.220 INFO:teuthology.orchestra.run.smithi018.stdout: "omap_rd": 0, 2024-09-21T06:46:42.220 INFO:teuthology.orchestra.run.smithi018.stdout: "omap_del": 16 2024-09-21T06:46:42.220 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:42.220 INFO:teuthology.orchestra.run.smithi018.stdout: "oft": { 2024-09-21T06:46:42.221 INFO:teuthology.orchestra.run.smithi018.stdout: "omap_total_objs": 1, 2024-09-21T06:46:42.221 INFO:teuthology.orchestra.run.smithi018.stdout: "omap_total_kv_pairs": 0, 2024-09-21T06:46:42.221 INFO:teuthology.orchestra.run.smithi018.stdout: "omap_total_updates": 0, 2024-09-21T06:46:42.221 INFO:teuthology.orchestra.run.smithi018.stdout: "omap_total_removes": 0 2024-09-21T06:46:42.221 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:42.221 INFO:teuthology.orchestra.run.smithi018.stdout: "purge_queue": { 2024-09-21T06:46:42.221 INFO:teuthology.orchestra.run.smithi018.stdout: "pq_executing_ops": 0, 2024-09-21T06:46:42.221 INFO:teuthology.orchestra.run.smithi018.stdout: "pq_executing_ops_high_water": 3584, 2024-09-21T06:46:42.221 INFO:teuthology.orchestra.run.smithi018.stdout: "pq_executing": 0, 2024-09-21T06:46:42.221 INFO:teuthology.orchestra.run.smithi018.stdout: "pq_executing_high_water": 1, 2024-09-21T06:46:42.221 INFO:teuthology.orchestra.run.smithi018.stdout: "pq_executed_ops": 4610, 2024-09-21T06:46:42.221 INFO:teuthology.orchestra.run.smithi018.stdout: "pq_executed": 3, 2024-09-21T06:46:42.221 INFO:teuthology.orchestra.run.smithi018.stdout: "pq_item_in_journal": 0 2024-09-21T06:46:42.221 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:42.222 INFO:teuthology.orchestra.run.smithi018.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T06:46:42.222 INFO:teuthology.orchestra.run.smithi018.stdout: "val": 0, 2024-09-21T06:46:42.222 INFO:teuthology.orchestra.run.smithi018.stdout: "max": 104857600, 2024-09-21T06:46:42.222 INFO:teuthology.orchestra.run.smithi018.stdout: "get_started": 0, 2024-09-21T06:46:42.222 INFO:teuthology.orchestra.run.smithi018.stdout: "get": 16492, 2024-09-21T06:46:42.222 INFO:teuthology.orchestra.run.smithi018.stdout: "get_sum": 4238885, 2024-09-21T06:46:42.222 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_fail": 0, 2024-09-21T06:46:42.222 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_success": 16492, 2024-09-21T06:46:42.222 INFO:teuthology.orchestra.run.smithi018.stdout: "take": 0, 2024-09-21T06:46:42.222 INFO:teuthology.orchestra.run.smithi018.stdout: "take_sum": 0, 2024-09-21T06:46:42.222 INFO:teuthology.orchestra.run.smithi018.stdout: "put": 16492, 2024-09-21T06:46:42.222 INFO:teuthology.orchestra.run.smithi018.stdout: "put_sum": 4238885, 2024-09-21T06:46:42.222 INFO:teuthology.orchestra.run.smithi018.stdout: "wait": { 2024-09-21T06:46:42.222 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:42.223 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:42.223 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:42.223 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T06:46:42.223 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:42.223 INFO:teuthology.orchestra.run.smithi018.stdout: "throttle-objecter_bytes": { 2024-09-21T06:46:42.223 INFO:teuthology.orchestra.run.smithi018.stdout: "val": 0, 2024-09-21T06:46:42.223 INFO:teuthology.orchestra.run.smithi018.stdout: "max": 104857600, 2024-09-21T06:46:42.223 INFO:teuthology.orchestra.run.smithi018.stdout: "get_started": 0, 2024-09-21T06:46:42.223 INFO:teuthology.orchestra.run.smithi018.stdout: "get": 0, 2024-09-21T06:46:42.223 INFO:teuthology.orchestra.run.smithi018.stdout: "get_sum": 0, 2024-09-21T06:46:42.223 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_fail": 0, 2024-09-21T06:46:42.223 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_success": 0, 2024-09-21T06:46:42.224 INFO:teuthology.orchestra.run.smithi018.stdout: "take": 9514, 2024-09-21T06:46:42.224 INFO:teuthology.orchestra.run.smithi018.stdout: "take_sum": 10565735, 2024-09-21T06:46:42.224 INFO:teuthology.orchestra.run.smithi018.stdout: "put": 9514, 2024-09-21T06:46:42.224 INFO:teuthology.orchestra.run.smithi018.stdout: "put_sum": 10565735, 2024-09-21T06:46:42.224 INFO:teuthology.orchestra.run.smithi018.stdout: "wait": { 2024-09-21T06:46:42.224 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:42.224 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:42.225 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:42.225 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T06:46:42.225 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:42.225 INFO:teuthology.orchestra.run.smithi018.stdout: "throttle-objecter_ops": { 2024-09-21T06:46:42.225 INFO:teuthology.orchestra.run.smithi018.stdout: "val": 0, 2024-09-21T06:46:42.226 INFO:teuthology.orchestra.run.smithi018.stdout: "max": 1024, 2024-09-21T06:46:42.226 INFO:teuthology.orchestra.run.smithi018.stdout: "get_started": 0, 2024-09-21T06:46:42.226 INFO:teuthology.orchestra.run.smithi018.stdout: "get": 0, 2024-09-21T06:46:42.226 INFO:teuthology.orchestra.run.smithi018.stdout: "get_sum": 0, 2024-09-21T06:46:42.226 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_fail": 0, 2024-09-21T06:46:42.226 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_success": 0, 2024-09-21T06:46:42.226 INFO:teuthology.orchestra.run.smithi018.stdout: "take": 9514, 2024-09-21T06:46:42.227 INFO:teuthology.orchestra.run.smithi018.stdout: "take_sum": 9514, 2024-09-21T06:46:42.227 INFO:teuthology.orchestra.run.smithi018.stdout: "put": 9514, 2024-09-21T06:46:42.227 INFO:teuthology.orchestra.run.smithi018.stdout: "put_sum": 9514, 2024-09-21T06:46:42.227 INFO:teuthology.orchestra.run.smithi018.stdout: "wait": { 2024-09-21T06:46:42.227 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:42.227 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:42.227 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:42.227 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T06:46:42.227 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:42.228 INFO:teuthology.orchestra.run.smithi018.stdout: "throttle-write_buf_throttle": { 2024-09-21T06:46:42.228 INFO:teuthology.orchestra.run.smithi018.stdout: "val": 0, 2024-09-21T06:46:42.228 INFO:teuthology.orchestra.run.smithi018.stdout: "max": 3758096384, 2024-09-21T06:46:42.228 INFO:teuthology.orchestra.run.smithi018.stdout: "get_started": 0, 2024-09-21T06:46:42.228 INFO:teuthology.orchestra.run.smithi018.stdout: "get": 3, 2024-09-21T06:46:42.228 INFO:teuthology.orchestra.run.smithi018.stdout: "get_sum": 303, 2024-09-21T06:46:42.228 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_fail": 0, 2024-09-21T06:46:42.228 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_success": 3, 2024-09-21T06:46:42.228 INFO:teuthology.orchestra.run.smithi018.stdout: "take": 0, 2024-09-21T06:46:42.228 INFO:teuthology.orchestra.run.smithi018.stdout: "take_sum": 0, 2024-09-21T06:46:42.228 INFO:teuthology.orchestra.run.smithi018.stdout: "put": 3, 2024-09-21T06:46:42.228 INFO:teuthology.orchestra.run.smithi018.stdout: "put_sum": 303, 2024-09-21T06:46:42.228 INFO:teuthology.orchestra.run.smithi018.stdout: "wait": { 2024-09-21T06:46:42.228 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:42.228 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:42.229 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:42.229 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T06:46:42.229 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:42.229 INFO:teuthology.orchestra.run.smithi018.stdout: "throttle-write_buf_throttle-0x5632c1fff5f0": { 2024-09-21T06:46:42.229 INFO:teuthology.orchestra.run.smithi018.stdout: "val": 0, 2024-09-21T06:46:42.229 INFO:teuthology.orchestra.run.smithi018.stdout: "max": 3758096384, 2024-09-21T06:46:42.229 INFO:teuthology.orchestra.run.smithi018.stdout: "get_started": 0, 2024-09-21T06:46:42.229 INFO:teuthology.orchestra.run.smithi018.stdout: "get": 3932, 2024-09-21T06:46:42.229 INFO:teuthology.orchestra.run.smithi018.stdout: "get_sum": 10450142, 2024-09-21T06:46:42.229 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_fail": 0, 2024-09-21T06:46:42.229 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_success": 3932, 2024-09-21T06:46:42.229 INFO:teuthology.orchestra.run.smithi018.stdout: "take": 0, 2024-09-21T06:46:42.229 INFO:teuthology.orchestra.run.smithi018.stdout: "take_sum": 0, 2024-09-21T06:46:42.229 INFO:teuthology.orchestra.run.smithi018.stdout: "put": 3901, 2024-09-21T06:46:42.229 INFO:teuthology.orchestra.run.smithi018.stdout: "put_sum": 10450142, 2024-09-21T06:46:42.230 INFO:teuthology.orchestra.run.smithi018.stdout: "wait": { 2024-09-21T06:46:42.230 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:42.230 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:42.230 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:42.230 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T06:46:42.230 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:42.230 INFO:teuthology.orchestra.run.smithi018.stdout: "trackedop": { 2024-09-21T06:46:42.230 INFO:teuthology.orchestra.run.smithi018.stdout: "slow_ops_count": 0 2024-09-21T06:46:42.230 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T06:46:42.230 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-21T06:46:42.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:46:42 smithi018 ceph-mon[34477]: pgmap v642: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:46:42.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:46:42 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:46:42.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:46:42 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:46:42.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:46:42 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:46:42.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:46:42 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:46:42.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:46:42 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:46:43.008 INFO:tasks.check_counter:Daemon mds.b mds.exported=0 2024-09-21T06:46:43.008 INFO:tasks.check_counter:Daemon mds.b mds.imported=0 2024-09-21T06:46:43.008 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=5 2024-09-21T06:46:43.008 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=0 2024-09-21T06:46:43.008 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=6 2024-09-21T06:46:43.008 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=10 2024-09-21T06:46:43.008 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=4 2024-09-21T06:46:43.008 DEBUG:tasks.check_counter:Getting stats from e 2024-09-21T06:46:43.009 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph daemon mds.e perf dump 2024-09-21T06:46:43.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:46:42 smithi144 ceph-mon[34653]: pgmap v642: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:46:43.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:46:42 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:46:43.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:46:42 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:46:43.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:46:42 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:46:43.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:46:42 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:46:43.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:46:42 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:46:43.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:46:42 smithi007 ceph-mon[30983]: pgmap v642: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:46:43.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:46:42 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:46:43.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:46:42 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:46:43.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:46:42 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T06:46:43.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:46:42 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T06:46:43.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:46:42 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' 2024-09-21T06:46:43.264 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T06:46:43.792 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-21T06:46:43.792 INFO:teuthology.orchestra.run.smithi018.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T06:46:43.792 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_messages": 739, 2024-09-21T06:46:43.792 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages": 739, 2024-09-21T06:46:43.792 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_bytes": 197273, 2024-09-21T06:46:43.792 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_bytes": 234242, 2024-09-21T06:46:43.792 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_created_connections": 6, 2024-09-21T06:46:43.792 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_active_connections": 2, 2024-09-21T06:46:43.792 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_total_time": 0.094204048, 2024-09-21T06:46:43.793 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_send_time": 0.047300020, 2024-09-21T06:46:43.793 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_recv_time": 0.019567888, 2024-09-21T06:46:43.793 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_fast_dispatch_time": 0.018990899, 2024-09-21T06:46:43.793 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:46:43.793 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 738, 2024-09-21T06:46:43.793 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.037568077, 2024-09-21T06:46:43.793 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000050905 2024-09-21T06:46:43.793 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:43.793 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:46:43.793 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:43.793 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:43.793 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:43.793 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:43.793 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-21T06:46:43.793 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T06:46:43.794 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:43.794 INFO:teuthology.orchestra.run.smithi018.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T06:46:43.794 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_messages": 632, 2024-09-21T06:46:43.794 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages": 788, 2024-09-21T06:46:43.794 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_bytes": 155408, 2024-09-21T06:46:43.794 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_bytes": 558775, 2024-09-21T06:46:43.794 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_created_connections": 5, 2024-09-21T06:46:43.794 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_active_connections": 4, 2024-09-21T06:46:43.794 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_total_time": 0.088843559, 2024-09-21T06:46:43.794 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_send_time": 0.041957600, 2024-09-21T06:46:43.794 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_recv_time": 0.015840985, 2024-09-21T06:46:43.794 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_fast_dispatch_time": 0.023274450, 2024-09-21T06:46:43.794 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:46:43.794 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 786, 2024-09-21T06:46:43.795 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.037167233, 2024-09-21T06:46:43.795 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000047286 2024-09-21T06:46:43.795 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:43.795 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:46:43.795 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:43.795 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:43.795 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:43.795 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:43.795 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T06:46:43.795 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_encrypted_bytes": 358112 2024-09-21T06:46:43.795 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:43.795 INFO:teuthology.orchestra.run.smithi018.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T06:46:43.796 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_messages": 958, 2024-09-21T06:46:43.796 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages": 951, 2024-09-21T06:46:43.796 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_bytes": 1108480, 2024-09-21T06:46:43.796 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_bytes": 361678, 2024-09-21T06:46:43.796 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_created_connections": 3, 2024-09-21T06:46:43.796 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_active_connections": 2, 2024-09-21T06:46:43.796 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_total_time": 0.165632698, 2024-09-21T06:46:43.796 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_send_time": 0.070558908, 2024-09-21T06:46:43.796 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_recv_time": 0.060862798, 2024-09-21T06:46:43.796 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_fast_dispatch_time": 0.034497644, 2024-09-21T06:46:43.796 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:46:43.796 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 950, 2024-09-21T06:46:43.796 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.059663014, 2024-09-21T06:46:43.796 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000062803 2024-09-21T06:46:43.796 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:43.797 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:46:43.797 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:43.797 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:43.797 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:43.797 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:43.797 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_encrypted_bytes": 863536, 2024-09-21T06:46:43.797 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_encrypted_bytes": 129856 2024-09-21T06:46:43.797 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:43.797 INFO:teuthology.orchestra.run.smithi018.stdout: "cct": { 2024-09-21T06:46:43.797 INFO:teuthology.orchestra.run.smithi018.stdout: "total_workers": 1, 2024-09-21T06:46:43.797 INFO:teuthology.orchestra.run.smithi018.stdout: "unhealthy_workers": 0 2024-09-21T06:46:43.797 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:43.797 INFO:teuthology.orchestra.run.smithi018.stdout: "finisher-MDSRank": { 2024-09-21T06:46:43.797 INFO:teuthology.orchestra.run.smithi018.stdout: "queue_len": 0, 2024-09-21T06:46:43.797 INFO:teuthology.orchestra.run.smithi018.stdout: "complete_latency": { 2024-09-21T06:46:43.798 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 3459, 2024-09-21T06:46:43.798 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.120725576, 2024-09-21T06:46:43.798 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000034901 2024-09-21T06:46:43.798 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T06:46:43.798 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:43.798 INFO:teuthology.orchestra.run.smithi018.stdout: "finisher-PurgeQueue": { 2024-09-21T06:46:43.798 INFO:teuthology.orchestra.run.smithi018.stdout: "queue_len": 0, 2024-09-21T06:46:43.798 INFO:teuthology.orchestra.run.smithi018.stdout: "complete_latency": { 2024-09-21T06:46:43.798 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:43.798 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:43.798 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:43.798 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T06:46:43.798 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:43.798 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": { 2024-09-21T06:46:43.798 INFO:teuthology.orchestra.run.smithi018.stdout: "request": 0, 2024-09-21T06:46:43.799 INFO:teuthology.orchestra.run.smithi018.stdout: "reply": 0, 2024-09-21T06:46:43.799 INFO:teuthology.orchestra.run.smithi018.stdout: "reply_latency": { 2024-09-21T06:46:43.799 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:43.799 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:43.799 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:43.799 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:43.799 INFO:teuthology.orchestra.run.smithi018.stdout: "slow_reply": 0, 2024-09-21T06:46:43.799 INFO:teuthology.orchestra.run.smithi018.stdout: "forward": 0, 2024-09-21T06:46:43.799 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_fetch_complete": 0, 2024-09-21T06:46:43.799 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_fetch_keys": 0, 2024-09-21T06:46:43.799 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_commit": 0, 2024-09-21T06:46:43.799 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_split": 0, 2024-09-21T06:46:43.799 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_merge": 0, 2024-09-21T06:46:43.799 INFO:teuthology.orchestra.run.smithi018.stdout: "inodes": 0, 2024-09-21T06:46:43.799 INFO:teuthology.orchestra.run.smithi018.stdout: "inodes_top": 0, 2024-09-21T06:46:43.799 INFO:teuthology.orchestra.run.smithi018.stdout: "inodes_bottom": 0, 2024-09-21T06:46:43.800 INFO:teuthology.orchestra.run.smithi018.stdout: "inodes_pin_tail": 0, 2024-09-21T06:46:43.800 INFO:teuthology.orchestra.run.smithi018.stdout: "inodes_pinned": 0, 2024-09-21T06:46:43.800 INFO:teuthology.orchestra.run.smithi018.stdout: "inodes_expired": 0, 2024-09-21T06:46:43.800 INFO:teuthology.orchestra.run.smithi018.stdout: "inodes_with_caps": 0, 2024-09-21T06:46:43.800 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": 0, 2024-09-21T06:46:43.800 INFO:teuthology.orchestra.run.smithi018.stdout: "subtrees": 1, 2024-09-21T06:46:43.800 INFO:teuthology.orchestra.run.smithi018.stdout: "traverse": 0, 2024-09-21T06:46:43.800 INFO:teuthology.orchestra.run.smithi018.stdout: "traverse_hit": 0, 2024-09-21T06:46:43.800 INFO:teuthology.orchestra.run.smithi018.stdout: "traverse_forward": 0, 2024-09-21T06:46:43.800 INFO:teuthology.orchestra.run.smithi018.stdout: "traverse_discover": 0, 2024-09-21T06:46:43.800 INFO:teuthology.orchestra.run.smithi018.stdout: "traverse_dir_fetch": 0, 2024-09-21T06:46:43.800 INFO:teuthology.orchestra.run.smithi018.stdout: "traverse_remote_ino": 0, 2024-09-21T06:46:43.800 INFO:teuthology.orchestra.run.smithi018.stdout: "traverse_lock": 0, 2024-09-21T06:46:43.800 INFO:teuthology.orchestra.run.smithi018.stdout: "load_cent": 0, 2024-09-21T06:46:43.801 INFO:teuthology.orchestra.run.smithi018.stdout: "q": 0, 2024-09-21T06:46:43.801 INFO:teuthology.orchestra.run.smithi018.stdout: "exported": 0, 2024-09-21T06:46:43.801 INFO:teuthology.orchestra.run.smithi018.stdout: "exported_inodes": 0, 2024-09-21T06:46:43.801 INFO:teuthology.orchestra.run.smithi018.stdout: "imported": 0, 2024-09-21T06:46:43.801 INFO:teuthology.orchestra.run.smithi018.stdout: "imported_inodes": 0, 2024-09-21T06:46:43.801 INFO:teuthology.orchestra.run.smithi018.stdout: "openino_dir_fetch": 0, 2024-09-21T06:46:43.801 INFO:teuthology.orchestra.run.smithi018.stdout: "openino_backtrace_fetch": 0, 2024-09-21T06:46:43.801 INFO:teuthology.orchestra.run.smithi018.stdout: "openino_peer_discover": 0, 2024-09-21T06:46:43.801 INFO:teuthology.orchestra.run.smithi018.stdout: "root_rfiles": 0, 2024-09-21T06:46:43.801 INFO:teuthology.orchestra.run.smithi018.stdout: "root_rbytes": 0, 2024-09-21T06:46:43.801 INFO:teuthology.orchestra.run.smithi018.stdout: "root_rsnaps": 0, 2024-09-21T06:46:43.801 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T06:46:43.801 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_set_tag": 0, 2024-09-21T06:46:43.801 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T06:46:43.802 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_inotable_repaired": 0, 2024-09-21T06:46:43.802 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_dir_inodes": 0, 2024-09-21T06:46:43.802 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T06:46:43.802 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T06:46:43.802 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_file_inodes": 0, 2024-09-21T06:46:43.802 INFO:teuthology.orchestra.run.smithi018.stdout: "handle_inode_file_caps": 0, 2024-09-21T06:46:43.802 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T06:46:43.802 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_cap_op_grant": 0, 2024-09-21T06:46:43.802 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T06:46:43.802 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T06:46:43.802 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T06:46:43.802 INFO:teuthology.orchestra.run.smithi018.stdout: "handle_client_caps": 0, 2024-09-21T06:46:43.802 INFO:teuthology.orchestra.run.smithi018.stdout: "handle_client_caps_dirty": 0, 2024-09-21T06:46:43.802 INFO:teuthology.orchestra.run.smithi018.stdout: "handle_client_cap_release": 0, 2024-09-21T06:46:43.802 INFO:teuthology.orchestra.run.smithi018.stdout: "process_request_cap_release": 0 2024-09-21T06:46:43.803 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:43.803 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_cache": { 2024-09-21T06:46:43.803 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_update": 0, 2024-09-21T06:46:43.803 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_update_receipt": 0, 2024-09-21T06:46:43.803 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_try_discover": 0, 2024-09-21T06:46:43.803 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_send_discover": 0, 2024-09-21T06:46:43.803 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_handle_discover": 0, 2024-09-21T06:46:43.803 INFO:teuthology.orchestra.run.smithi018.stdout: "num_strays": 0, 2024-09-21T06:46:43.803 INFO:teuthology.orchestra.run.smithi018.stdout: "num_strays_delayed": 0, 2024-09-21T06:46:43.803 INFO:teuthology.orchestra.run.smithi018.stdout: "num_strays_enqueuing": 0, 2024-09-21T06:46:43.803 INFO:teuthology.orchestra.run.smithi018.stdout: "strays_created": 0, 2024-09-21T06:46:43.803 INFO:teuthology.orchestra.run.smithi018.stdout: "strays_enqueued": 0, 2024-09-21T06:46:43.803 INFO:teuthology.orchestra.run.smithi018.stdout: "strays_reintegrated": 0, 2024-09-21T06:46:43.803 INFO:teuthology.orchestra.run.smithi018.stdout: "strays_migrated": 0, 2024-09-21T06:46:43.803 INFO:teuthology.orchestra.run.smithi018.stdout: "num_recovering_processing": 0, 2024-09-21T06:46:43.803 INFO:teuthology.orchestra.run.smithi018.stdout: "num_recovering_enqueued": 0, 2024-09-21T06:46:43.804 INFO:teuthology.orchestra.run.smithi018.stdout: "num_recovering_prioritized": 0, 2024-09-21T06:46:43.804 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_started": 0, 2024-09-21T06:46:43.804 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_completed": 0, 2024-09-21T06:46:43.804 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_quiesce_path": 0, 2024-09-21T06:46:43.804 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_quiesce_inode": 0, 2024-09-21T06:46:43.804 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T06:46:43.804 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_exportdir": 0, 2024-09-21T06:46:43.804 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_flush": 0, 2024-09-21T06:46:43.804 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_fragmentdir": 0, 2024-09-21T06:46:43.804 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_fragstats": 0, 2024-09-21T06:46:43.804 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_inodestats": 0, 2024-09-21T06:46:43.804 INFO:teuthology.orchestra.run.smithi018.stdout: "uninline_started": 0, 2024-09-21T06:46:43.804 INFO:teuthology.orchestra.run.smithi018.stdout: "uninline_succeeded": 0, 2024-09-21T06:46:43.804 INFO:teuthology.orchestra.run.smithi018.stdout: "uninline_write_failed": 0 2024-09-21T06:46:43.804 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:43.804 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_log": { 2024-09-21T06:46:43.805 INFO:teuthology.orchestra.run.smithi018.stdout: "evlrg": 0, 2024-09-21T06:46:43.805 INFO:teuthology.orchestra.run.smithi018.stdout: "evadd": 0, 2024-09-21T06:46:43.805 INFO:teuthology.orchestra.run.smithi018.stdout: "evex": 0, 2024-09-21T06:46:43.805 INFO:teuthology.orchestra.run.smithi018.stdout: "evtrm": 0, 2024-09-21T06:46:43.805 INFO:teuthology.orchestra.run.smithi018.stdout: "ev": 4, 2024-09-21T06:46:43.805 INFO:teuthology.orchestra.run.smithi018.stdout: "evexg": 0, 2024-09-21T06:46:43.805 INFO:teuthology.orchestra.run.smithi018.stdout: "evexd": 0, 2024-09-21T06:46:43.805 INFO:teuthology.orchestra.run.smithi018.stdout: "segadd": 0, 2024-09-21T06:46:43.805 INFO:teuthology.orchestra.run.smithi018.stdout: "segex": 0, 2024-09-21T06:46:43.805 INFO:teuthology.orchestra.run.smithi018.stdout: "segtrm": 0, 2024-09-21T06:46:43.805 INFO:teuthology.orchestra.run.smithi018.stdout: "seg": 2, 2024-09-21T06:46:43.805 INFO:teuthology.orchestra.run.smithi018.stdout: "segmjr": 2, 2024-09-21T06:46:43.805 INFO:teuthology.orchestra.run.smithi018.stdout: "segexg": 0, 2024-09-21T06:46:43.805 INFO:teuthology.orchestra.run.smithi018.stdout: "segexd": 0, 2024-09-21T06:46:43.805 INFO:teuthology.orchestra.run.smithi018.stdout: "expos": 4194304, 2024-09-21T06:46:43.805 INFO:teuthology.orchestra.run.smithi018.stdout: "wrpos": 4195424, 2024-09-21T06:46:43.806 INFO:teuthology.orchestra.run.smithi018.stdout: "rdpos": 4195283, 2024-09-21T06:46:43.806 INFO:teuthology.orchestra.run.smithi018.stdout: "jlat": { 2024-09-21T06:46:43.806 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:43.806 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:43.806 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:43.806 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:43.806 INFO:teuthology.orchestra.run.smithi018.stdout: "replayed": 4 2024-09-21T06:46:43.806 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:43.806 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_mem": { 2024-09-21T06:46:43.806 INFO:teuthology.orchestra.run.smithi018.stdout: "ino": 3, 2024-09-21T06:46:43.806 INFO:teuthology.orchestra.run.smithi018.stdout: "ino+": 3, 2024-09-21T06:46:43.806 INFO:teuthology.orchestra.run.smithi018.stdout: "ino-": 0, 2024-09-21T06:46:43.806 INFO:teuthology.orchestra.run.smithi018.stdout: "dir": 1, 2024-09-21T06:46:43.807 INFO:teuthology.orchestra.run.smithi018.stdout: "dir+": 1, 2024-09-21T06:46:43.807 INFO:teuthology.orchestra.run.smithi018.stdout: "dir-": 0, 2024-09-21T06:46:43.807 INFO:teuthology.orchestra.run.smithi018.stdout: "dn": 0, 2024-09-21T06:46:43.807 INFO:teuthology.orchestra.run.smithi018.stdout: "dn+": 0, 2024-09-21T06:46:43.807 INFO:teuthology.orchestra.run.smithi018.stdout: "dn-": 0, 2024-09-21T06:46:43.807 INFO:teuthology.orchestra.run.smithi018.stdout: "cap": 0, 2024-09-21T06:46:43.807 INFO:teuthology.orchestra.run.smithi018.stdout: "cap+": 0, 2024-09-21T06:46:43.807 INFO:teuthology.orchestra.run.smithi018.stdout: "cap-": 0, 2024-09-21T06:46:43.807 INFO:teuthology.orchestra.run.smithi018.stdout: "rss": 116908, 2024-09-21T06:46:43.807 INFO:teuthology.orchestra.run.smithi018.stdout: "heap": 316420096 2024-09-21T06:46:43.807 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:43.807 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_server": { 2024-09-21T06:46:43.807 INFO:teuthology.orchestra.run.smithi018.stdout: "dispatch_client_request": 0, 2024-09-21T06:46:43.807 INFO:teuthology.orchestra.run.smithi018.stdout: "dispatch_server_request": 0, 2024-09-21T06:46:43.808 INFO:teuthology.orchestra.run.smithi018.stdout: "handle_client_request": 0, 2024-09-21T06:46:43.808 INFO:teuthology.orchestra.run.smithi018.stdout: "handle_client_session": 0, 2024-09-21T06:46:43.808 INFO:teuthology.orchestra.run.smithi018.stdout: "handle_peer_request": 0, 2024-09-21T06:46:43.808 INFO:teuthology.orchestra.run.smithi018.stdout: "req_create_latency": { 2024-09-21T06:46:43.808 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:43.808 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:43.808 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:43.808 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:43.808 INFO:teuthology.orchestra.run.smithi018.stdout: "req_getattr_latency": { 2024-09-21T06:46:43.808 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:43.808 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:43.808 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:43.808 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:43.808 INFO:teuthology.orchestra.run.smithi018.stdout: "req_getfilelock_latency": { 2024-09-21T06:46:43.808 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:43.808 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:43.809 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:43.809 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:43.809 INFO:teuthology.orchestra.run.smithi018.stdout: "req_link_latency": { 2024-09-21T06:46:43.809 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:43.809 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:43.809 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:43.809 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:43.809 INFO:teuthology.orchestra.run.smithi018.stdout: "req_lookup_latency": { 2024-09-21T06:46:43.809 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:43.809 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:43.809 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:43.809 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:43.810 INFO:teuthology.orchestra.run.smithi018.stdout: "req_lookuphash_latency": { 2024-09-21T06:46:43.810 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:43.810 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:43.810 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:43.810 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:43.810 INFO:teuthology.orchestra.run.smithi018.stdout: "req_lookupino_latency": { 2024-09-21T06:46:43.810 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:43.810 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:43.810 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:43.810 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:43.810 INFO:teuthology.orchestra.run.smithi018.stdout: "req_lookupname_latency": { 2024-09-21T06:46:43.810 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:43.810 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:43.810 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:43.811 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:43.811 INFO:teuthology.orchestra.run.smithi018.stdout: "req_lookupparent_latency": { 2024-09-21T06:46:43.811 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:43.811 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:43.811 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:43.811 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:43.811 INFO:teuthology.orchestra.run.smithi018.stdout: "req_lookupsnap_latency": { 2024-09-21T06:46:43.811 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:43.811 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:43.811 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:43.811 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:43.811 INFO:teuthology.orchestra.run.smithi018.stdout: "req_lssnap_latency": { 2024-09-21T06:46:43.811 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:43.811 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:43.812 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:43.812 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:43.812 INFO:teuthology.orchestra.run.smithi018.stdout: "req_mkdir_latency": { 2024-09-21T06:46:43.812 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:43.812 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:43.812 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:43.812 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:43.812 INFO:teuthology.orchestra.run.smithi018.stdout: "req_mknod_latency": { 2024-09-21T06:46:43.813 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:43.813 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:43.813 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:43.813 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:43.813 INFO:teuthology.orchestra.run.smithi018.stdout: "req_mksnap_latency": { 2024-09-21T06:46:43.813 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:43.813 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:43.813 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:43.813 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:43.813 INFO:teuthology.orchestra.run.smithi018.stdout: "req_open_latency": { 2024-09-21T06:46:43.813 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:43.813 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:43.813 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:43.813 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:43.813 INFO:teuthology.orchestra.run.smithi018.stdout: "req_readdir_latency": { 2024-09-21T06:46:43.814 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:43.814 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:43.814 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:43.814 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:43.814 INFO:teuthology.orchestra.run.smithi018.stdout: "req_rename_latency": { 2024-09-21T06:46:43.814 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:43.814 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:43.814 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:43.814 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:43.814 INFO:teuthology.orchestra.run.smithi018.stdout: "req_renamesnap_latency": { 2024-09-21T06:46:43.814 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:43.814 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:43.814 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:43.814 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:43.815 INFO:teuthology.orchestra.run.smithi018.stdout: "req_snapdiff_latency": { 2024-09-21T06:46:43.815 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:43.815 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:43.815 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:43.815 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:43.815 INFO:teuthology.orchestra.run.smithi018.stdout: "req_rmdir_latency": { 2024-09-21T06:46:43.815 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:43.815 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:43.815 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:43.815 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:43.815 INFO:teuthology.orchestra.run.smithi018.stdout: "req_rmsnap_latency": { 2024-09-21T06:46:43.815 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:43.815 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:43.815 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:43.815 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:43.815 INFO:teuthology.orchestra.run.smithi018.stdout: "req_rmxattr_latency": { 2024-09-21T06:46:43.816 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:43.816 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:43.816 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:43.816 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:43.816 INFO:teuthology.orchestra.run.smithi018.stdout: "req_setattr_latency": { 2024-09-21T06:46:43.816 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:43.816 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:43.816 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:43.816 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:43.816 INFO:teuthology.orchestra.run.smithi018.stdout: "req_setdirlayout_latency": { 2024-09-21T06:46:43.816 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:43.816 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:43.816 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:43.816 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:43.817 INFO:teuthology.orchestra.run.smithi018.stdout: "req_setfilelock_latency": { 2024-09-21T06:46:43.817 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:43.817 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:43.817 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:43.817 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:43.817 INFO:teuthology.orchestra.run.smithi018.stdout: "req_setlayout_latency": { 2024-09-21T06:46:43.817 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:43.817 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:43.817 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:43.817 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:43.817 INFO:teuthology.orchestra.run.smithi018.stdout: "req_setxattr_latency": { 2024-09-21T06:46:43.817 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:43.817 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:43.817 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:43.817 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:43.818 INFO:teuthology.orchestra.run.smithi018.stdout: "req_symlink_latency": { 2024-09-21T06:46:43.818 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:43.818 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:43.818 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:43.818 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:43.818 INFO:teuthology.orchestra.run.smithi018.stdout: "req_unlink_latency": { 2024-09-21T06:46:43.818 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:43.818 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:43.818 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:43.818 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:43.818 INFO:teuthology.orchestra.run.smithi018.stdout: "cap_revoke_eviction": 0, 2024-09-21T06:46:43.818 INFO:teuthology.orchestra.run.smithi018.stdout: "cap_acquisition_throttle": 0, 2024-09-21T06:46:43.818 INFO:teuthology.orchestra.run.smithi018.stdout: "req_getvxattr_latency": { 2024-09-21T06:46:43.818 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:43.818 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:43.818 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:43.819 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T06:46:43.819 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:43.819 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_sessions": { 2024-09-21T06:46:43.819 INFO:teuthology.orchestra.run.smithi018.stdout: "session_count": 0, 2024-09-21T06:46:43.819 INFO:teuthology.orchestra.run.smithi018.stdout: "session_add": 1, 2024-09-21T06:46:43.819 INFO:teuthology.orchestra.run.smithi018.stdout: "session_remove": 1, 2024-09-21T06:46:43.819 INFO:teuthology.orchestra.run.smithi018.stdout: "sessions_open": 1, 2024-09-21T06:46:43.819 INFO:teuthology.orchestra.run.smithi018.stdout: "sessions_stale": 0, 2024-09-21T06:46:43.819 INFO:teuthology.orchestra.run.smithi018.stdout: "total_load": 0, 2024-09-21T06:46:43.819 INFO:teuthology.orchestra.run.smithi018.stdout: "average_load": 0, 2024-09-21T06:46:43.819 INFO:teuthology.orchestra.run.smithi018.stdout: "avg_session_uptime": 1319, 2024-09-21T06:46:43.819 INFO:teuthology.orchestra.run.smithi018.stdout: "mdthresh_evicted": 0 2024-09-21T06:46:43.819 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:43.819 INFO:teuthology.orchestra.run.smithi018.stdout: "mempool": { 2024-09-21T06:46:43.819 INFO:teuthology.orchestra.run.smithi018.stdout: "bloom_filter_bytes": 0, 2024-09-21T06:46:43.819 INFO:teuthology.orchestra.run.smithi018.stdout: "bloom_filter_items": 0, 2024-09-21T06:46:43.820 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T06:46:43.820 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_alloc_items": 0, 2024-09-21T06:46:43.820 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T06:46:43.820 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_data_items": 0, 2024-09-21T06:46:43.820 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T06:46:43.820 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T06:46:43.820 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T06:46:43.820 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T06:46:43.820 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T06:46:43.820 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_other_items": 0, 2024-09-21T06:46:43.820 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T06:46:43.820 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T06:46:43.820 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_extent_bytes": 0, 2024-09-21T06:46:43.820 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_extent_items": 0, 2024-09-21T06:46:43.821 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_blob_bytes": 0, 2024-09-21T06:46:43.821 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_blob_items": 0, 2024-09-21T06:46:43.821 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T06:46:43.821 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T06:46:43.821 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T06:46:43.821 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T06:46:43.821 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T06:46:43.821 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_items": 0, 2024-09-21T06:46:43.821 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_txc_bytes": 0, 2024-09-21T06:46:43.821 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_txc_items": 0, 2024-09-21T06:46:43.821 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T06:46:43.821 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T06:46:43.821 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_bytes": 0, 2024-09-21T06:46:43.821 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_items": 0, 2024-09-21T06:46:43.821 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_bytes": 0, 2024-09-21T06:46:43.822 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_items": 0, 2024-09-21T06:46:43.822 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T06:46:43.822 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_reader_items": 0, 2024-09-21T06:46:43.822 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T06:46:43.822 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_writer_items": 0, 2024-09-21T06:46:43.822 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_anon_bytes": 189400, 2024-09-21T06:46:43.822 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_anon_items": 51, 2024-09-21T06:46:43.822 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_meta_bytes": 0, 2024-09-21T06:46:43.822 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_meta_items": 0, 2024-09-21T06:46:43.822 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_bytes": 0, 2024-09-21T06:46:43.822 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_items": 0, 2024-09-21T06:46:43.822 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mapbl_bytes": 0, 2024-09-21T06:46:43.822 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mapbl_items": 0, 2024-09-21T06:46:43.822 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pglog_bytes": 0, 2024-09-21T06:46:43.822 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pglog_items": 0, 2024-09-21T06:46:43.823 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_bytes": 7872, 2024-09-21T06:46:43.823 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_items": 174, 2024-09-21T06:46:43.823 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T06:46:43.823 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_mapping_items": 0, 2024-09-21T06:46:43.823 INFO:teuthology.orchestra.run.smithi018.stdout: "pgmap_bytes": 0, 2024-09-21T06:46:43.823 INFO:teuthology.orchestra.run.smithi018.stdout: "pgmap_items": 0, 2024-09-21T06:46:43.823 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_co_bytes": 8672, 2024-09-21T06:46:43.823 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_co_items": 13, 2024-09-21T06:46:43.823 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_1_bytes": 0, 2024-09-21T06:46:43.823 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_1_items": 0, 2024-09-21T06:46:43.823 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_2_bytes": 0, 2024-09-21T06:46:43.823 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_2_items": 0 2024-09-21T06:46:43.823 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:43.823 INFO:teuthology.orchestra.run.smithi018.stdout: "objecter": { 2024-09-21T06:46:43.823 INFO:teuthology.orchestra.run.smithi018.stdout: "op_active": 0, 2024-09-21T06:46:43.823 INFO:teuthology.orchestra.run.smithi018.stdout: "op_laggy": 0, 2024-09-21T06:46:43.824 INFO:teuthology.orchestra.run.smithi018.stdout: "op_send": 2095, 2024-09-21T06:46:43.824 INFO:teuthology.orchestra.run.smithi018.stdout: "op_send_bytes": 21, 2024-09-21T06:46:43.824 INFO:teuthology.orchestra.run.smithi018.stdout: "op_resend": 3, 2024-09-21T06:46:43.824 INFO:teuthology.orchestra.run.smithi018.stdout: "op_reply": 2095, 2024-09-21T06:46:43.824 INFO:teuthology.orchestra.run.smithi018.stdout: "op_latency": { 2024-09-21T06:46:43.824 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 2095, 2024-09-21T06:46:43.824 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 1.392983047, 2024-09-21T06:46:43.824 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000664908 2024-09-21T06:46:43.824 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:43.824 INFO:teuthology.orchestra.run.smithi018.stdout: "op_inflight": 0, 2024-09-21T06:46:43.824 INFO:teuthology.orchestra.run.smithi018.stdout: "oplen_avg": { 2024-09-21T06:46:43.824 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 2095, 2024-09-21T06:46:43.824 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 2096 2024-09-21T06:46:43.824 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:43.824 INFO:teuthology.orchestra.run.smithi018.stdout: "op": 2095, 2024-09-21T06:46:43.824 INFO:teuthology.orchestra.run.smithi018.stdout: "op_r": 2095, 2024-09-21T06:46:43.824 INFO:teuthology.orchestra.run.smithi018.stdout: "op_w": 0, 2024-09-21T06:46:43.825 INFO:teuthology.orchestra.run.smithi018.stdout: "op_rmw": 0, 2024-09-21T06:46:43.825 INFO:teuthology.orchestra.run.smithi018.stdout: "op_pg": 0, 2024-09-21T06:46:43.825 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_stat": 1358, 2024-09-21T06:46:43.825 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_create": 0, 2024-09-21T06:46:43.825 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_read": 735, 2024-09-21T06:46:43.825 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_write": 0, 2024-09-21T06:46:43.825 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_writefull": 0, 2024-09-21T06:46:43.825 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_writesame": 0, 2024-09-21T06:46:43.825 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_append": 0, 2024-09-21T06:46:43.825 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_zero": 0, 2024-09-21T06:46:43.825 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_truncate": 0, 2024-09-21T06:46:43.825 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_delete": 0, 2024-09-21T06:46:43.825 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_mapext": 0, 2024-09-21T06:46:43.825 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_sparse_read": 0, 2024-09-21T06:46:43.825 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_clonerange": 0, 2024-09-21T06:46:43.826 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_getxattr": 1, 2024-09-21T06:46:43.826 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_setxattr": 0, 2024-09-21T06:46:43.826 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_cmpxattr": 0, 2024-09-21T06:46:43.826 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_rmxattr": 0, 2024-09-21T06:46:43.826 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_resetxattrs": 0, 2024-09-21T06:46:43.826 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_call": 0, 2024-09-21T06:46:43.826 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_watch": 0, 2024-09-21T06:46:43.826 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_notify": 0, 2024-09-21T06:46:43.826 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T06:46:43.826 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_pgls": 0, 2024-09-21T06:46:43.826 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_pgls_filter": 0, 2024-09-21T06:46:43.826 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_other": 0, 2024-09-21T06:46:43.826 INFO:teuthology.orchestra.run.smithi018.stdout: "linger_active": 0, 2024-09-21T06:46:43.826 INFO:teuthology.orchestra.run.smithi018.stdout: "linger_send": 0, 2024-09-21T06:46:43.827 INFO:teuthology.orchestra.run.smithi018.stdout: "linger_resend": 0, 2024-09-21T06:46:43.827 INFO:teuthology.orchestra.run.smithi018.stdout: "linger_ping": 0, 2024-09-21T06:46:43.827 INFO:teuthology.orchestra.run.smithi018.stdout: "poolop_active": 0, 2024-09-21T06:46:43.827 INFO:teuthology.orchestra.run.smithi018.stdout: "poolop_send": 0, 2024-09-21T06:46:43.827 INFO:teuthology.orchestra.run.smithi018.stdout: "poolop_resend": 0, 2024-09-21T06:46:43.827 INFO:teuthology.orchestra.run.smithi018.stdout: "poolstat_active": 0, 2024-09-21T06:46:43.827 INFO:teuthology.orchestra.run.smithi018.stdout: "poolstat_send": 0, 2024-09-21T06:46:43.827 INFO:teuthology.orchestra.run.smithi018.stdout: "poolstat_resend": 0, 2024-09-21T06:46:43.827 INFO:teuthology.orchestra.run.smithi018.stdout: "statfs_active": 0, 2024-09-21T06:46:43.827 INFO:teuthology.orchestra.run.smithi018.stdout: "statfs_send": 0, 2024-09-21T06:46:43.827 INFO:teuthology.orchestra.run.smithi018.stdout: "statfs_resend": 0, 2024-09-21T06:46:43.827 INFO:teuthology.orchestra.run.smithi018.stdout: "command_active": 0, 2024-09-21T06:46:43.827 INFO:teuthology.orchestra.run.smithi018.stdout: "command_send": 0, 2024-09-21T06:46:43.827 INFO:teuthology.orchestra.run.smithi018.stdout: "command_resend": 0, 2024-09-21T06:46:43.827 INFO:teuthology.orchestra.run.smithi018.stdout: "map_epoch": 85, 2024-09-21T06:46:43.827 INFO:teuthology.orchestra.run.smithi018.stdout: "map_full": 0, 2024-09-21T06:46:43.827 INFO:teuthology.orchestra.run.smithi018.stdout: "map_inc": 10, 2024-09-21T06:46:43.828 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_sessions": 5, 2024-09-21T06:46:43.828 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_session_open": 5, 2024-09-21T06:46:43.828 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_session_close": 0, 2024-09-21T06:46:43.828 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_laggy": 0, 2024-09-21T06:46:43.828 INFO:teuthology.orchestra.run.smithi018.stdout: "omap_wr": 0, 2024-09-21T06:46:43.828 INFO:teuthology.orchestra.run.smithi018.stdout: "omap_rd": 2, 2024-09-21T06:46:43.828 INFO:teuthology.orchestra.run.smithi018.stdout: "omap_del": 0 2024-09-21T06:46:43.828 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:43.828 INFO:teuthology.orchestra.run.smithi018.stdout: "oft": { 2024-09-21T06:46:43.828 INFO:teuthology.orchestra.run.smithi018.stdout: "omap_total_objs": 0, 2024-09-21T06:46:43.828 INFO:teuthology.orchestra.run.smithi018.stdout: "omap_total_kv_pairs": 0, 2024-09-21T06:46:43.828 INFO:teuthology.orchestra.run.smithi018.stdout: "omap_total_updates": 0, 2024-09-21T06:46:43.828 INFO:teuthology.orchestra.run.smithi018.stdout: "omap_total_removes": 0 2024-09-21T06:46:43.828 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:43.829 INFO:teuthology.orchestra.run.smithi018.stdout: "purge_queue": { 2024-09-21T06:46:43.829 INFO:teuthology.orchestra.run.smithi018.stdout: "pq_executing_ops": 0, 2024-09-21T06:46:43.829 INFO:teuthology.orchestra.run.smithi018.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T06:46:43.829 INFO:teuthology.orchestra.run.smithi018.stdout: "pq_executing": 0, 2024-09-21T06:46:43.829 INFO:teuthology.orchestra.run.smithi018.stdout: "pq_executing_high_water": 0, 2024-09-21T06:46:43.829 INFO:teuthology.orchestra.run.smithi018.stdout: "pq_executed_ops": 0, 2024-09-21T06:46:43.829 INFO:teuthology.orchestra.run.smithi018.stdout: "pq_executed": 0, 2024-09-21T06:46:43.829 INFO:teuthology.orchestra.run.smithi018.stdout: "pq_item_in_journal": 0 2024-09-21T06:46:43.829 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:43.829 INFO:teuthology.orchestra.run.smithi018.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T06:46:43.829 INFO:teuthology.orchestra.run.smithi018.stdout: "val": 0, 2024-09-21T06:46:43.829 INFO:teuthology.orchestra.run.smithi018.stdout: "max": 104857600, 2024-09-21T06:46:43.829 INFO:teuthology.orchestra.run.smithi018.stdout: "get_started": 0, 2024-09-21T06:46:43.829 INFO:teuthology.orchestra.run.smithi018.stdout: "get": 2325, 2024-09-21T06:46:43.829 INFO:teuthology.orchestra.run.smithi018.stdout: "get_sum": 1237188, 2024-09-21T06:46:43.829 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_fail": 0, 2024-09-21T06:46:43.829 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_success": 2325, 2024-09-21T06:46:43.830 INFO:teuthology.orchestra.run.smithi018.stdout: "take": 0, 2024-09-21T06:46:43.830 INFO:teuthology.orchestra.run.smithi018.stdout: "take_sum": 0, 2024-09-21T06:46:43.830 INFO:teuthology.orchestra.run.smithi018.stdout: "put": 2325, 2024-09-21T06:46:43.830 INFO:teuthology.orchestra.run.smithi018.stdout: "put_sum": 1237188, 2024-09-21T06:46:43.830 INFO:teuthology.orchestra.run.smithi018.stdout: "wait": { 2024-09-21T06:46:43.830 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:43.830 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:43.830 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:43.830 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T06:46:43.830 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:43.830 INFO:teuthology.orchestra.run.smithi018.stdout: "throttle-objecter_bytes": { 2024-09-21T06:46:43.830 INFO:teuthology.orchestra.run.smithi018.stdout: "val": 0, 2024-09-21T06:46:43.830 INFO:teuthology.orchestra.run.smithi018.stdout: "max": 104857600, 2024-09-21T06:46:43.830 INFO:teuthology.orchestra.run.smithi018.stdout: "get_started": 0, 2024-09-21T06:46:43.830 INFO:teuthology.orchestra.run.smithi018.stdout: "get": 0, 2024-09-21T06:46:43.831 INFO:teuthology.orchestra.run.smithi018.stdout: "get_sum": 0, 2024-09-21T06:46:43.831 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_fail": 0, 2024-09-21T06:46:43.831 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_success": 0, 2024-09-21T06:46:43.831 INFO:teuthology.orchestra.run.smithi018.stdout: "take": 2095, 2024-09-21T06:46:43.831 INFO:teuthology.orchestra.run.smithi018.stdout: "take_sum": 1125, 2024-09-21T06:46:43.831 INFO:teuthology.orchestra.run.smithi018.stdout: "put": 2095, 2024-09-21T06:46:43.831 INFO:teuthology.orchestra.run.smithi018.stdout: "put_sum": 1125, 2024-09-21T06:46:43.831 INFO:teuthology.orchestra.run.smithi018.stdout: "wait": { 2024-09-21T06:46:43.831 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:43.831 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:43.831 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:43.831 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T06:46:43.831 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:43.831 INFO:teuthology.orchestra.run.smithi018.stdout: "throttle-objecter_ops": { 2024-09-21T06:46:43.832 INFO:teuthology.orchestra.run.smithi018.stdout: "val": 0, 2024-09-21T06:46:43.832 INFO:teuthology.orchestra.run.smithi018.stdout: "max": 1024, 2024-09-21T06:46:43.832 INFO:teuthology.orchestra.run.smithi018.stdout: "get_started": 0, 2024-09-21T06:46:43.832 INFO:teuthology.orchestra.run.smithi018.stdout: "get": 0, 2024-09-21T06:46:43.832 INFO:teuthology.orchestra.run.smithi018.stdout: "get_sum": 0, 2024-09-21T06:46:43.832 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_fail": 0, 2024-09-21T06:46:43.832 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_success": 0, 2024-09-21T06:46:43.832 INFO:teuthology.orchestra.run.smithi018.stdout: "take": 2095, 2024-09-21T06:46:43.832 INFO:teuthology.orchestra.run.smithi018.stdout: "take_sum": 2095, 2024-09-21T06:46:43.832 INFO:teuthology.orchestra.run.smithi018.stdout: "put": 2095, 2024-09-21T06:46:43.832 INFO:teuthology.orchestra.run.smithi018.stdout: "put_sum": 2095, 2024-09-21T06:46:43.832 INFO:teuthology.orchestra.run.smithi018.stdout: "wait": { 2024-09-21T06:46:43.832 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:43.832 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:43.832 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:43.832 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T06:46:43.833 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:43.833 INFO:teuthology.orchestra.run.smithi018.stdout: "throttle-write_buf_throttle": { 2024-09-21T06:46:43.833 INFO:teuthology.orchestra.run.smithi018.stdout: "val": 0, 2024-09-21T06:46:43.833 INFO:teuthology.orchestra.run.smithi018.stdout: "max": 3758096384, 2024-09-21T06:46:43.833 INFO:teuthology.orchestra.run.smithi018.stdout: "get_started": 0, 2024-09-21T06:46:43.833 INFO:teuthology.orchestra.run.smithi018.stdout: "get": 0, 2024-09-21T06:46:43.833 INFO:teuthology.orchestra.run.smithi018.stdout: "get_sum": 0, 2024-09-21T06:46:43.833 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_fail": 0, 2024-09-21T06:46:43.833 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_success": 0, 2024-09-21T06:46:43.833 INFO:teuthology.orchestra.run.smithi018.stdout: "take": 0, 2024-09-21T06:46:43.833 INFO:teuthology.orchestra.run.smithi018.stdout: "take_sum": 0, 2024-09-21T06:46:43.833 INFO:teuthology.orchestra.run.smithi018.stdout: "put": 0, 2024-09-21T06:46:43.833 INFO:teuthology.orchestra.run.smithi018.stdout: "put_sum": 0, 2024-09-21T06:46:43.833 INFO:teuthology.orchestra.run.smithi018.stdout: "wait": { 2024-09-21T06:46:43.833 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:43.833 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:43.833 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:43.834 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T06:46:43.834 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:43.834 INFO:teuthology.orchestra.run.smithi018.stdout: "throttle-write_buf_throttle-0x55ea719f5520": { 2024-09-21T06:46:43.834 INFO:teuthology.orchestra.run.smithi018.stdout: "val": 0, 2024-09-21T06:46:43.834 INFO:teuthology.orchestra.run.smithi018.stdout: "max": 3758096384, 2024-09-21T06:46:43.834 INFO:teuthology.orchestra.run.smithi018.stdout: "get_started": 0, 2024-09-21T06:46:43.834 INFO:teuthology.orchestra.run.smithi018.stdout: "get": 0, 2024-09-21T06:46:43.834 INFO:teuthology.orchestra.run.smithi018.stdout: "get_sum": 0, 2024-09-21T06:46:43.834 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_fail": 0, 2024-09-21T06:46:43.834 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_success": 0, 2024-09-21T06:46:43.834 INFO:teuthology.orchestra.run.smithi018.stdout: "take": 0, 2024-09-21T06:46:43.834 INFO:teuthology.orchestra.run.smithi018.stdout: "take_sum": 0, 2024-09-21T06:46:43.834 INFO:teuthology.orchestra.run.smithi018.stdout: "put": 0, 2024-09-21T06:46:43.834 INFO:teuthology.orchestra.run.smithi018.stdout: "put_sum": 0, 2024-09-21T06:46:43.834 INFO:teuthology.orchestra.run.smithi018.stdout: "wait": { 2024-09-21T06:46:43.835 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:43.835 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:43.835 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:43.835 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T06:46:43.835 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:43.835 INFO:teuthology.orchestra.run.smithi018.stdout: "trackedop": { 2024-09-21T06:46:43.835 INFO:teuthology.orchestra.run.smithi018.stdout: "slow_ops_count": 0 2024-09-21T06:46:43.835 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T06:46:43.835 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-21T06:46:44.575 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-09-21T06:46:44.575 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-09-21T06:46:44.576 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=0 2024-09-21T06:46:44.576 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=0 2024-09-21T06:46:44.576 INFO:tasks.check_counter:Daemon mds.e mds.root_rsnaps=0 2024-09-21T06:46:44.576 INFO:tasks.check_counter:Daemon mds.e mds_server.req_mksnap_latency.avgcount=0 2024-09-21T06:46:44.576 INFO:tasks.check_counter:Daemon mds.e mds_server.req_rmsnap_latency.avgcount=0 2024-09-21T06:46:44.576 DEBUG:tasks.check_counter:Getting stats from h 2024-09-21T06:46:44.576 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph daemon mds.h perf dump 2024-09-21T06:46:44.829 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T06:46:44.869 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:46:44 smithi018 ceph-mon[34477]: pgmap v643: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:46:45.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:46:44 smithi144 ceph-mon[34653]: pgmap v643: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:46:45.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:46:44 smithi007 ceph-mon[30983]: pgmap v643: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:46:45.365 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-21T06:46:45.365 INFO:teuthology.orchestra.run.smithi018.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T06:46:45.366 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_messages": 321, 2024-09-21T06:46:45.366 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages": 314, 2024-09-21T06:46:45.366 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_bytes": 884371, 2024-09-21T06:46:45.366 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_bytes": 659627, 2024-09-21T06:46:45.366 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_created_connections": 51, 2024-09-21T06:46:45.366 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_active_connections": 4, 2024-09-21T06:46:45.366 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_total_time": 0.067734869, 2024-09-21T06:46:45.366 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_send_time": 0.023286980, 2024-09-21T06:46:45.366 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_recv_time": 0.049078472, 2024-09-21T06:46:45.366 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_fast_dispatch_time": 0.000324392, 2024-09-21T06:46:45.366 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:46:45.366 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 311, 2024-09-21T06:46:45.366 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.026292869, 2024-09-21T06:46:45.367 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000084542 2024-09-21T06:46:45.367 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:45.367 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:46:45.367 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 53, 2024-09-21T06:46:45.367 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000005663, 2024-09-21T06:46:45.367 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000106 2024-09-21T06:46:45.367 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:45.367 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_encrypted_bytes": 874848, 2024-09-21T06:46:45.367 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_encrypted_bytes": 135456 2024-09-21T06:46:45.367 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:45.367 INFO:teuthology.orchestra.run.smithi018.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T06:46:45.367 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_messages": 71, 2024-09-21T06:46:45.367 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages": 222, 2024-09-21T06:46:45.367 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_bytes": 25349, 2024-09-21T06:46:45.367 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_bytes": 439915, 2024-09-21T06:46:45.368 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_created_connections": 11, 2024-09-21T06:46:45.368 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_active_connections": 4, 2024-09-21T06:46:45.368 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_total_time": 0.022058368, 2024-09-21T06:46:45.368 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_send_time": 0.011959651, 2024-09-21T06:46:45.368 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_recv_time": 0.008453230, 2024-09-21T06:46:45.368 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_fast_dispatch_time": 0.000381349, 2024-09-21T06:46:45.368 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:46:45.368 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 223, 2024-09-21T06:46:45.368 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.035139679, 2024-09-21T06:46:45.368 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000157577 2024-09-21T06:46:45.368 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:45.368 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:46:45.368 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 94, 2024-09-21T06:46:45.368 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000021097, 2024-09-21T06:46:45.368 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000224 2024-09-21T06:46:45.369 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:45.369 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-21T06:46:45.369 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_encrypted_bytes": 360032 2024-09-21T06:46:45.369 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:45.369 INFO:teuthology.orchestra.run.smithi018.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T06:46:45.369 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_messages": 458, 2024-09-21T06:46:45.369 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages": 559, 2024-09-21T06:46:45.369 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_bytes": 122785, 2024-09-21T06:46:45.369 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_bytes": 113522, 2024-09-21T06:46:45.369 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_created_connections": 6, 2024-09-21T06:46:45.369 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_active_connections": 4, 2024-09-21T06:46:45.369 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_total_time": 0.075521748, 2024-09-21T06:46:45.369 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_send_time": 0.040280754, 2024-09-21T06:46:45.369 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_recv_time": 0.031392341, 2024-09-21T06:46:45.370 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_fast_dispatch_time": 0.004039759, 2024-09-21T06:46:45.370 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:46:45.370 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 557, 2024-09-21T06:46:45.370 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.038688096, 2024-09-21T06:46:45.370 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000069457 2024-09-21T06:46:45.370 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:45.370 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:46:45.370 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 987, 2024-09-21T06:46:45.370 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000239166, 2024-09-21T06:46:45.370 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000242 2024-09-21T06:46:45.370 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:45.370 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T06:46:45.370 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T06:46:45.370 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:45.370 INFO:teuthology.orchestra.run.smithi018.stdout: "cct": { 2024-09-21T06:46:45.371 INFO:teuthology.orchestra.run.smithi018.stdout: "total_workers": 1, 2024-09-21T06:46:45.371 INFO:teuthology.orchestra.run.smithi018.stdout: "unhealthy_workers": 0 2024-09-21T06:46:45.371 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:45.371 INFO:teuthology.orchestra.run.smithi018.stdout: "finisher-MDSRank": { 2024-09-21T06:46:45.371 INFO:teuthology.orchestra.run.smithi018.stdout: "queue_len": 0, 2024-09-21T06:46:45.371 INFO:teuthology.orchestra.run.smithi018.stdout: "complete_latency": { 2024-09-21T06:46:45.371 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 48, 2024-09-21T06:46:45.371 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.001483282, 2024-09-21T06:46:45.371 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000030901 2024-09-21T06:46:45.371 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T06:46:45.371 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:45.371 INFO:teuthology.orchestra.run.smithi018.stdout: "finisher-PurgeQueue": { 2024-09-21T06:46:45.371 INFO:teuthology.orchestra.run.smithi018.stdout: "queue_len": 0, 2024-09-21T06:46:45.371 INFO:teuthology.orchestra.run.smithi018.stdout: "complete_latency": { 2024-09-21T06:46:45.371 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 2, 2024-09-21T06:46:45.372 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000032688, 2024-09-21T06:46:45.372 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000016344 2024-09-21T06:46:45.372 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T06:46:45.372 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:45.372 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": { 2024-09-21T06:46:45.372 INFO:teuthology.orchestra.run.smithi018.stdout: "request": 2, 2024-09-21T06:46:45.372 INFO:teuthology.orchestra.run.smithi018.stdout: "reply": 1, 2024-09-21T06:46:45.372 INFO:teuthology.orchestra.run.smithi018.stdout: "reply_latency": { 2024-09-21T06:46:45.372 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 1, 2024-09-21T06:46:45.372 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000203604, 2024-09-21T06:46:45.372 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000203604 2024-09-21T06:46:45.372 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:45.372 INFO:teuthology.orchestra.run.smithi018.stdout: "slow_reply": 0, 2024-09-21T06:46:45.372 INFO:teuthology.orchestra.run.smithi018.stdout: "forward": 1, 2024-09-21T06:46:45.373 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_fetch_complete": 0, 2024-09-21T06:46:45.373 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_fetch_keys": 0, 2024-09-21T06:46:45.373 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_commit": 11, 2024-09-21T06:46:45.373 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_split": 0, 2024-09-21T06:46:45.373 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_merge": 0, 2024-09-21T06:46:45.373 INFO:teuthology.orchestra.run.smithi018.stdout: "inodes": 14, 2024-09-21T06:46:45.373 INFO:teuthology.orchestra.run.smithi018.stdout: "inodes_top": 1, 2024-09-21T06:46:45.373 INFO:teuthology.orchestra.run.smithi018.stdout: "inodes_bottom": 13, 2024-09-21T06:46:45.373 INFO:teuthology.orchestra.run.smithi018.stdout: "inodes_pin_tail": 0, 2024-09-21T06:46:45.373 INFO:teuthology.orchestra.run.smithi018.stdout: "inodes_pinned": 12, 2024-09-21T06:46:45.373 INFO:teuthology.orchestra.run.smithi018.stdout: "inodes_expired": 0, 2024-09-21T06:46:45.373 INFO:teuthology.orchestra.run.smithi018.stdout: "inodes_with_caps": 0, 2024-09-21T06:46:45.373 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": 0, 2024-09-21T06:46:45.373 INFO:teuthology.orchestra.run.smithi018.stdout: "subtrees": 2, 2024-09-21T06:46:45.373 INFO:teuthology.orchestra.run.smithi018.stdout: "traverse": 8, 2024-09-21T06:46:45.374 INFO:teuthology.orchestra.run.smithi018.stdout: "traverse_hit": 4, 2024-09-21T06:46:45.374 INFO:teuthology.orchestra.run.smithi018.stdout: "traverse_forward": 0, 2024-09-21T06:46:45.374 INFO:teuthology.orchestra.run.smithi018.stdout: "traverse_discover": 3, 2024-09-21T06:46:45.374 INFO:teuthology.orchestra.run.smithi018.stdout: "traverse_dir_fetch": 0, 2024-09-21T06:46:45.374 INFO:teuthology.orchestra.run.smithi018.stdout: "traverse_remote_ino": 0, 2024-09-21T06:46:45.374 INFO:teuthology.orchestra.run.smithi018.stdout: "traverse_lock": 0, 2024-09-21T06:46:45.374 INFO:teuthology.orchestra.run.smithi018.stdout: "load_cent": 0, 2024-09-21T06:46:45.374 INFO:teuthology.orchestra.run.smithi018.stdout: "q": 0, 2024-09-21T06:46:45.374 INFO:teuthology.orchestra.run.smithi018.stdout: "exported": 0, 2024-09-21T06:46:45.374 INFO:teuthology.orchestra.run.smithi018.stdout: "exported_inodes": 0, 2024-09-21T06:46:45.374 INFO:teuthology.orchestra.run.smithi018.stdout: "imported": 0, 2024-09-21T06:46:45.374 INFO:teuthology.orchestra.run.smithi018.stdout: "imported_inodes": 0, 2024-09-21T06:46:45.374 INFO:teuthology.orchestra.run.smithi018.stdout: "openino_dir_fetch": 0, 2024-09-21T06:46:45.374 INFO:teuthology.orchestra.run.smithi018.stdout: "openino_backtrace_fetch": 0, 2024-09-21T06:46:45.375 INFO:teuthology.orchestra.run.smithi018.stdout: "openino_peer_discover": 0, 2024-09-21T06:46:45.375 INFO:teuthology.orchestra.run.smithi018.stdout: "root_rfiles": 4, 2024-09-21T06:46:45.375 INFO:teuthology.orchestra.run.smithi018.stdout: "root_rbytes": 234, 2024-09-21T06:46:45.375 INFO:teuthology.orchestra.run.smithi018.stdout: "root_rsnaps": 6, 2024-09-21T06:46:45.375 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T06:46:45.375 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_set_tag": 0, 2024-09-21T06:46:45.375 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T06:46:45.375 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_inotable_repaired": 0, 2024-09-21T06:46:45.375 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_dir_inodes": 0, 2024-09-21T06:46:45.375 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T06:46:45.375 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T06:46:45.375 INFO:teuthology.orchestra.run.smithi018.stdout: "scrub_file_inodes": 0, 2024-09-21T06:46:45.375 INFO:teuthology.orchestra.run.smithi018.stdout: "handle_inode_file_caps": 0, 2024-09-21T06:46:45.375 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T06:46:45.375 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_cap_op_grant": 0, 2024-09-21T06:46:45.375 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T06:46:45.376 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T06:46:45.376 INFO:teuthology.orchestra.run.smithi018.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T06:46:45.376 INFO:teuthology.orchestra.run.smithi018.stdout: "handle_client_caps": 0, 2024-09-21T06:46:45.376 INFO:teuthology.orchestra.run.smithi018.stdout: "handle_client_caps_dirty": 0, 2024-09-21T06:46:45.376 INFO:teuthology.orchestra.run.smithi018.stdout: "handle_client_cap_release": 0, 2024-09-21T06:46:45.376 INFO:teuthology.orchestra.run.smithi018.stdout: "process_request_cap_release": 1 2024-09-21T06:46:45.376 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:45.376 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_cache": { 2024-09-21T06:46:45.376 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_update": 0, 2024-09-21T06:46:45.376 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_update_receipt": 6, 2024-09-21T06:46:45.376 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_try_discover": 4, 2024-09-21T06:46:45.376 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_send_discover": 6, 2024-09-21T06:46:45.376 INFO:teuthology.orchestra.run.smithi018.stdout: "dir_handle_discover": 0, 2024-09-21T06:46:45.376 INFO:teuthology.orchestra.run.smithi018.stdout: "num_strays": 0, 2024-09-21T06:46:45.376 INFO:teuthology.orchestra.run.smithi018.stdout: "num_strays_delayed": 0, 2024-09-21T06:46:45.377 INFO:teuthology.orchestra.run.smithi018.stdout: "num_strays_enqueuing": 0, 2024-09-21T06:46:45.377 INFO:teuthology.orchestra.run.smithi018.stdout: "strays_created": 0, 2024-09-21T06:46:45.377 INFO:teuthology.orchestra.run.smithi018.stdout: "strays_enqueued": 0, 2024-09-21T06:46:45.377 INFO:teuthology.orchestra.run.smithi018.stdout: "strays_reintegrated": 0, 2024-09-21T06:46:45.377 INFO:teuthology.orchestra.run.smithi018.stdout: "strays_migrated": 0, 2024-09-21T06:46:45.377 INFO:teuthology.orchestra.run.smithi018.stdout: "num_recovering_processing": 0, 2024-09-21T06:46:45.377 INFO:teuthology.orchestra.run.smithi018.stdout: "num_recovering_enqueued": 0, 2024-09-21T06:46:45.377 INFO:teuthology.orchestra.run.smithi018.stdout: "num_recovering_prioritized": 0, 2024-09-21T06:46:45.377 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_started": 0, 2024-09-21T06:46:45.377 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_completed": 0, 2024-09-21T06:46:45.377 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_quiesce_path": 0, 2024-09-21T06:46:45.377 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_quiesce_inode": 0, 2024-09-21T06:46:45.377 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T06:46:45.377 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_exportdir": 0, 2024-09-21T06:46:45.377 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_flush": 0, 2024-09-21T06:46:45.378 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_fragmentdir": 0, 2024-09-21T06:46:45.378 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_fragstats": 0, 2024-09-21T06:46:45.378 INFO:teuthology.orchestra.run.smithi018.stdout: "ireq_inodestats": 0, 2024-09-21T06:46:45.378 INFO:teuthology.orchestra.run.smithi018.stdout: "uninline_started": 0, 2024-09-21T06:46:45.378 INFO:teuthology.orchestra.run.smithi018.stdout: "uninline_succeeded": 0, 2024-09-21T06:46:45.378 INFO:teuthology.orchestra.run.smithi018.stdout: "uninline_write_failed": 0 2024-09-21T06:46:45.378 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:45.378 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_log": { 2024-09-21T06:46:45.378 INFO:teuthology.orchestra.run.smithi018.stdout: "evlrg": 0, 2024-09-21T06:46:45.378 INFO:teuthology.orchestra.run.smithi018.stdout: "evadd": 4, 2024-09-21T06:46:45.378 INFO:teuthology.orchestra.run.smithi018.stdout: "evex": 0, 2024-09-21T06:46:45.378 INFO:teuthology.orchestra.run.smithi018.stdout: "evtrm": 0, 2024-09-21T06:46:45.378 INFO:teuthology.orchestra.run.smithi018.stdout: "ev": 4, 2024-09-21T06:46:45.378 INFO:teuthology.orchestra.run.smithi018.stdout: "evexg": 0, 2024-09-21T06:46:45.379 INFO:teuthology.orchestra.run.smithi018.stdout: "evexd": 0, 2024-09-21T06:46:45.379 INFO:teuthology.orchestra.run.smithi018.stdout: "segadd": 2, 2024-09-21T06:46:45.379 INFO:teuthology.orchestra.run.smithi018.stdout: "segex": 0, 2024-09-21T06:46:45.379 INFO:teuthology.orchestra.run.smithi018.stdout: "segtrm": 0, 2024-09-21T06:46:45.379 INFO:teuthology.orchestra.run.smithi018.stdout: "seg": 2, 2024-09-21T06:46:45.379 INFO:teuthology.orchestra.run.smithi018.stdout: "segmjr": 2, 2024-09-21T06:46:45.379 INFO:teuthology.orchestra.run.smithi018.stdout: "segexg": 0, 2024-09-21T06:46:45.379 INFO:teuthology.orchestra.run.smithi018.stdout: "segexd": 0, 2024-09-21T06:46:45.379 INFO:teuthology.orchestra.run.smithi018.stdout: "expos": 4194304, 2024-09-21T06:46:45.379 INFO:teuthology.orchestra.run.smithi018.stdout: "wrpos": 4195424, 2024-09-21T06:46:45.379 INFO:teuthology.orchestra.run.smithi018.stdout: "rdpos": 0, 2024-09-21T06:46:45.379 INFO:teuthology.orchestra.run.smithi018.stdout: "jlat": { 2024-09-21T06:46:45.379 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 3, 2024-09-21T06:46:45.379 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.005823435, 2024-09-21T06:46:45.380 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.001941145 2024-09-21T06:46:45.380 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:45.380 INFO:teuthology.orchestra.run.smithi018.stdout: "replayed": 0 2024-09-21T06:46:45.380 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:45.380 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_mem": { 2024-09-21T06:46:45.380 INFO:teuthology.orchestra.run.smithi018.stdout: "ino": 17, 2024-09-21T06:46:45.380 INFO:teuthology.orchestra.run.smithi018.stdout: "ino+": 17, 2024-09-21T06:46:45.380 INFO:teuthology.orchestra.run.smithi018.stdout: "ino-": 0, 2024-09-21T06:46:45.380 INFO:teuthology.orchestra.run.smithi018.stdout: "dir": 16, 2024-09-21T06:46:45.380 INFO:teuthology.orchestra.run.smithi018.stdout: "dir+": 17, 2024-09-21T06:46:45.380 INFO:teuthology.orchestra.run.smithi018.stdout: "dir-": 1, 2024-09-21T06:46:45.380 INFO:teuthology.orchestra.run.smithi018.stdout: "dn": 14, 2024-09-21T06:46:45.380 INFO:teuthology.orchestra.run.smithi018.stdout: "dn+": 14, 2024-09-21T06:46:45.380 INFO:teuthology.orchestra.run.smithi018.stdout: "dn-": 0, 2024-09-21T06:46:45.380 INFO:teuthology.orchestra.run.smithi018.stdout: "cap": 0, 2024-09-21T06:46:45.380 INFO:teuthology.orchestra.run.smithi018.stdout: "cap+": 1, 2024-09-21T06:46:45.381 INFO:teuthology.orchestra.run.smithi018.stdout: "cap-": 1, 2024-09-21T06:46:45.381 INFO:teuthology.orchestra.run.smithi018.stdout: "rss": 118896, 2024-09-21T06:46:45.381 INFO:teuthology.orchestra.run.smithi018.stdout: "heap": 324812800 2024-09-21T06:46:45.381 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:45.381 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_server": { 2024-09-21T06:46:45.381 INFO:teuthology.orchestra.run.smithi018.stdout: "dispatch_client_request": 3, 2024-09-21T06:46:45.381 INFO:teuthology.orchestra.run.smithi018.stdout: "dispatch_server_request": 0, 2024-09-21T06:46:45.381 INFO:teuthology.orchestra.run.smithi018.stdout: "handle_client_request": 2, 2024-09-21T06:46:45.381 INFO:teuthology.orchestra.run.smithi018.stdout: "handle_client_session": 4, 2024-09-21T06:46:45.381 INFO:teuthology.orchestra.run.smithi018.stdout: "handle_peer_request": 0, 2024-09-21T06:46:45.381 INFO:teuthology.orchestra.run.smithi018.stdout: "req_create_latency": { 2024-09-21T06:46:45.381 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:45.381 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:45.381 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:45.381 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:45.382 INFO:teuthology.orchestra.run.smithi018.stdout: "req_getattr_latency": { 2024-09-21T06:46:45.382 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 1, 2024-09-21T06:46:45.382 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000203604, 2024-09-21T06:46:45.382 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000203604 2024-09-21T06:46:45.382 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:45.382 INFO:teuthology.orchestra.run.smithi018.stdout: "req_getfilelock_latency": { 2024-09-21T06:46:45.382 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:45.382 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:45.382 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:45.382 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:45.382 INFO:teuthology.orchestra.run.smithi018.stdout: "req_link_latency": { 2024-09-21T06:46:45.382 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:45.382 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:45.382 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:45.382 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:45.383 INFO:teuthology.orchestra.run.smithi018.stdout: "req_lookup_latency": { 2024-09-21T06:46:45.383 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:45.383 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:45.383 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:45.383 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:45.383 INFO:teuthology.orchestra.run.smithi018.stdout: "req_lookuphash_latency": { 2024-09-21T06:46:45.383 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:45.383 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:45.383 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:45.383 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:45.383 INFO:teuthology.orchestra.run.smithi018.stdout: "req_lookupino_latency": { 2024-09-21T06:46:45.383 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:45.383 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:45.383 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:45.383 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:45.384 INFO:teuthology.orchestra.run.smithi018.stdout: "req_lookupname_latency": { 2024-09-21T06:46:45.384 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:45.384 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:45.384 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:45.384 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:45.384 INFO:teuthology.orchestra.run.smithi018.stdout: "req_lookupparent_latency": { 2024-09-21T06:46:45.384 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:45.384 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:45.384 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:45.384 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:45.384 INFO:teuthology.orchestra.run.smithi018.stdout: "req_lookupsnap_latency": { 2024-09-21T06:46:45.384 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:45.384 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:45.384 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:45.384 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:45.385 INFO:teuthology.orchestra.run.smithi018.stdout: "req_lssnap_latency": { 2024-09-21T06:46:45.385 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:45.385 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:45.385 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:45.385 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:45.385 INFO:teuthology.orchestra.run.smithi018.stdout: "req_mkdir_latency": { 2024-09-21T06:46:45.385 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:45.385 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:45.386 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:45.386 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:45.386 INFO:teuthology.orchestra.run.smithi018.stdout: "req_mknod_latency": { 2024-09-21T06:46:45.386 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:45.386 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:45.386 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:45.386 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:45.386 INFO:teuthology.orchestra.run.smithi018.stdout: "req_mksnap_latency": { 2024-09-21T06:46:45.386 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:45.386 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:45.386 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:45.386 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:45.386 INFO:teuthology.orchestra.run.smithi018.stdout: "req_open_latency": { 2024-09-21T06:46:45.386 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:45.387 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:45.387 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:45.387 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:45.387 INFO:teuthology.orchestra.run.smithi018.stdout: "req_readdir_latency": { 2024-09-21T06:46:45.387 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:45.387 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:45.387 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:45.387 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:45.387 INFO:teuthology.orchestra.run.smithi018.stdout: "req_rename_latency": { 2024-09-21T06:46:45.387 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:45.387 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:45.387 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:45.387 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:45.387 INFO:teuthology.orchestra.run.smithi018.stdout: "req_renamesnap_latency": { 2024-09-21T06:46:45.387 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:45.388 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:45.388 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:45.388 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:45.388 INFO:teuthology.orchestra.run.smithi018.stdout: "req_snapdiff_latency": { 2024-09-21T06:46:45.388 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:45.388 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:45.388 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:45.388 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:45.388 INFO:teuthology.orchestra.run.smithi018.stdout: "req_rmdir_latency": { 2024-09-21T06:46:45.388 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:45.388 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:45.388 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:45.388 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:45.388 INFO:teuthology.orchestra.run.smithi018.stdout: "req_rmsnap_latency": { 2024-09-21T06:46:45.388 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:45.389 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:45.389 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:45.389 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:45.389 INFO:teuthology.orchestra.run.smithi018.stdout: "req_rmxattr_latency": { 2024-09-21T06:46:45.389 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:45.389 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:45.389 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:45.389 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:45.389 INFO:teuthology.orchestra.run.smithi018.stdout: "req_setattr_latency": { 2024-09-21T06:46:45.389 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:45.389 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:45.389 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:45.389 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:45.389 INFO:teuthology.orchestra.run.smithi018.stdout: "req_setdirlayout_latency": { 2024-09-21T06:46:45.389 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:45.390 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:45.390 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:45.390 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:45.390 INFO:teuthology.orchestra.run.smithi018.stdout: "req_setfilelock_latency": { 2024-09-21T06:46:45.390 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:45.390 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:45.390 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:45.390 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:45.390 INFO:teuthology.orchestra.run.smithi018.stdout: "req_setlayout_latency": { 2024-09-21T06:46:45.390 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:45.390 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:45.390 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:45.390 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:45.390 INFO:teuthology.orchestra.run.smithi018.stdout: "req_setxattr_latency": { 2024-09-21T06:46:45.391 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:45.391 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:45.391 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:45.391 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:45.391 INFO:teuthology.orchestra.run.smithi018.stdout: "req_symlink_latency": { 2024-09-21T06:46:45.391 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:45.391 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:45.391 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:45.391 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:45.391 INFO:teuthology.orchestra.run.smithi018.stdout: "req_unlink_latency": { 2024-09-21T06:46:45.391 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:45.391 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:45.391 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:45.391 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:45.391 INFO:teuthology.orchestra.run.smithi018.stdout: "cap_revoke_eviction": 0, 2024-09-21T06:46:45.392 INFO:teuthology.orchestra.run.smithi018.stdout: "cap_acquisition_throttle": 0, 2024-09-21T06:46:45.392 INFO:teuthology.orchestra.run.smithi018.stdout: "req_getvxattr_latency": { 2024-09-21T06:46:45.392 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:45.392 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:45.392 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:45.392 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T06:46:45.392 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:45.392 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_sessions": { 2024-09-21T06:46:45.392 INFO:teuthology.orchestra.run.smithi018.stdout: "session_count": 0, 2024-09-21T06:46:45.392 INFO:teuthology.orchestra.run.smithi018.stdout: "session_add": 1, 2024-09-21T06:46:45.392 INFO:teuthology.orchestra.run.smithi018.stdout: "session_remove": 1, 2024-09-21T06:46:45.392 INFO:teuthology.orchestra.run.smithi018.stdout: "sessions_open": 0, 2024-09-21T06:46:45.392 INFO:teuthology.orchestra.run.smithi018.stdout: "sessions_stale": 0, 2024-09-21T06:46:45.392 INFO:teuthology.orchestra.run.smithi018.stdout: "total_load": 1, 2024-09-21T06:46:45.392 INFO:teuthology.orchestra.run.smithi018.stdout: "average_load": 1, 2024-09-21T06:46:45.393 INFO:teuthology.orchestra.run.smithi018.stdout: "avg_session_uptime": 95, 2024-09-21T06:46:45.393 INFO:teuthology.orchestra.run.smithi018.stdout: "mdthresh_evicted": 0 2024-09-21T06:46:45.393 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:45.393 INFO:teuthology.orchestra.run.smithi018.stdout: "mempool": { 2024-09-21T06:46:45.393 INFO:teuthology.orchestra.run.smithi018.stdout: "bloom_filter_bytes": 0, 2024-09-21T06:46:45.393 INFO:teuthology.orchestra.run.smithi018.stdout: "bloom_filter_items": 0, 2024-09-21T06:46:45.393 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T06:46:45.393 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_alloc_items": 0, 2024-09-21T06:46:45.393 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T06:46:45.393 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_data_items": 0, 2024-09-21T06:46:45.393 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T06:46:45.393 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T06:46:45.393 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T06:46:45.393 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T06:46:45.393 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T06:46:45.394 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_other_items": 0, 2024-09-21T06:46:45.394 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T06:46:45.394 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T06:46:45.394 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_extent_bytes": 0, 2024-09-21T06:46:45.394 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_extent_items": 0, 2024-09-21T06:46:45.394 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_blob_bytes": 0, 2024-09-21T06:46:45.394 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_blob_items": 0, 2024-09-21T06:46:45.394 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T06:46:45.394 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T06:46:45.394 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T06:46:45.394 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T06:46:45.394 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T06:46:45.394 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_items": 0, 2024-09-21T06:46:45.394 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_txc_bytes": 0, 2024-09-21T06:46:45.395 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_txc_items": 0, 2024-09-21T06:46:45.395 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T06:46:45.395 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T06:46:45.395 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_bytes": 0, 2024-09-21T06:46:45.395 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_items": 0, 2024-09-21T06:46:45.395 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_bytes": 0, 2024-09-21T06:46:45.395 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_items": 0, 2024-09-21T06:46:45.395 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T06:46:45.395 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_reader_items": 0, 2024-09-21T06:46:45.395 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T06:46:45.395 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_writer_items": 0, 2024-09-21T06:46:45.395 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_anon_bytes": 238471, 2024-09-21T06:46:45.395 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_anon_items": 76, 2024-09-21T06:46:45.395 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_meta_bytes": 0, 2024-09-21T06:46:45.395 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_meta_items": 0, 2024-09-21T06:46:45.396 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_bytes": 0, 2024-09-21T06:46:45.396 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_items": 0, 2024-09-21T06:46:45.396 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mapbl_bytes": 0, 2024-09-21T06:46:45.396 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mapbl_items": 0, 2024-09-21T06:46:45.396 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pglog_bytes": 0, 2024-09-21T06:46:45.396 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pglog_items": 0, 2024-09-21T06:46:45.396 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_bytes": 7872, 2024-09-21T06:46:45.396 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_items": 174, 2024-09-21T06:46:45.396 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T06:46:45.396 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_mapping_items": 0, 2024-09-21T06:46:45.396 INFO:teuthology.orchestra.run.smithi018.stdout: "pgmap_bytes": 0, 2024-09-21T06:46:45.396 INFO:teuthology.orchestra.run.smithi018.stdout: "pgmap_items": 0, 2024-09-21T06:46:45.396 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_co_bytes": 69440, 2024-09-21T06:46:45.396 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_co_items": 255, 2024-09-21T06:46:45.396 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_1_bytes": 0, 2024-09-21T06:46:45.396 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_1_items": 0, 2024-09-21T06:46:45.397 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_2_bytes": 0, 2024-09-21T06:46:45.397 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_2_items": 0 2024-09-21T06:46:45.397 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:45.397 INFO:teuthology.orchestra.run.smithi018.stdout: "objecter": { 2024-09-21T06:46:45.397 INFO:teuthology.orchestra.run.smithi018.stdout: "op_active": 0, 2024-09-21T06:46:45.397 INFO:teuthology.orchestra.run.smithi018.stdout: "op_laggy": 0, 2024-09-21T06:46:45.397 INFO:teuthology.orchestra.run.smithi018.stdout: "op_send": 38, 2024-09-21T06:46:45.397 INFO:teuthology.orchestra.run.smithi018.stdout: "op_send_bytes": 11332, 2024-09-21T06:46:45.397 INFO:teuthology.orchestra.run.smithi018.stdout: "op_resend": 33, 2024-09-21T06:46:45.397 INFO:teuthology.orchestra.run.smithi018.stdout: "op_reply": 38, 2024-09-21T06:46:45.397 INFO:teuthology.orchestra.run.smithi018.stdout: "op_latency": { 2024-09-21T06:46:45.397 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 38, 2024-09-21T06:46:45.397 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.224997282, 2024-09-21T06:46:45.397 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.005920981 2024-09-21T06:46:45.397 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:45.398 INFO:teuthology.orchestra.run.smithi018.stdout: "op_inflight": 0, 2024-09-21T06:46:45.398 INFO:teuthology.orchestra.run.smithi018.stdout: "oplen_avg": { 2024-09-21T06:46:45.398 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 38, 2024-09-21T06:46:45.398 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 60 2024-09-21T06:46:45.398 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:45.398 INFO:teuthology.orchestra.run.smithi018.stdout: "op": 38, 2024-09-21T06:46:45.398 INFO:teuthology.orchestra.run.smithi018.stdout: "op_r": 0, 2024-09-21T06:46:45.398 INFO:teuthology.orchestra.run.smithi018.stdout: "op_w": 38, 2024-09-21T06:46:45.398 INFO:teuthology.orchestra.run.smithi018.stdout: "op_rmw": 0, 2024-09-21T06:46:45.398 INFO:teuthology.orchestra.run.smithi018.stdout: "op_pg": 0, 2024-09-21T06:46:45.398 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_stat": 0, 2024-09-21T06:46:45.398 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_create": 10, 2024-09-21T06:46:45.398 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_read": 0, 2024-09-21T06:46:45.398 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_write": 3, 2024-09-21T06:46:45.398 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_writefull": 6, 2024-09-21T06:46:45.399 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_writesame": 0, 2024-09-21T06:46:45.399 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_append": 0, 2024-09-21T06:46:45.399 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_zero": 0, 2024-09-21T06:46:45.399 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_truncate": 0, 2024-09-21T06:46:45.399 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_delete": 6, 2024-09-21T06:46:45.399 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_mapext": 0, 2024-09-21T06:46:45.399 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_sparse_read": 0, 2024-09-21T06:46:45.399 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_clonerange": 0, 2024-09-21T06:46:45.399 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_getxattr": 0, 2024-09-21T06:46:45.399 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_setxattr": 20, 2024-09-21T06:46:45.399 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_cmpxattr": 0, 2024-09-21T06:46:45.399 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_rmxattr": 0, 2024-09-21T06:46:45.399 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_resetxattrs": 0, 2024-09-21T06:46:45.399 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_call": 0, 2024-09-21T06:46:45.399 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_watch": 0, 2024-09-21T06:46:45.400 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_notify": 0, 2024-09-21T06:46:45.400 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T06:46:45.400 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_pgls": 0, 2024-09-21T06:46:45.400 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_pgls_filter": 0, 2024-09-21T06:46:45.400 INFO:teuthology.orchestra.run.smithi018.stdout: "osdop_other": 0, 2024-09-21T06:46:45.400 INFO:teuthology.orchestra.run.smithi018.stdout: "linger_active": 0, 2024-09-21T06:46:45.400 INFO:teuthology.orchestra.run.smithi018.stdout: "linger_send": 0, 2024-09-21T06:46:45.400 INFO:teuthology.orchestra.run.smithi018.stdout: "linger_resend": 0, 2024-09-21T06:46:45.400 INFO:teuthology.orchestra.run.smithi018.stdout: "linger_ping": 0, 2024-09-21T06:46:45.400 INFO:teuthology.orchestra.run.smithi018.stdout: "poolop_active": 0, 2024-09-21T06:46:45.400 INFO:teuthology.orchestra.run.smithi018.stdout: "poolop_send": 0, 2024-09-21T06:46:45.400 INFO:teuthology.orchestra.run.smithi018.stdout: "poolop_resend": 0, 2024-09-21T06:46:45.400 INFO:teuthology.orchestra.run.smithi018.stdout: "poolstat_active": 0, 2024-09-21T06:46:45.400 INFO:teuthology.orchestra.run.smithi018.stdout: "poolstat_send": 0, 2024-09-21T06:46:45.400 INFO:teuthology.orchestra.run.smithi018.stdout: "poolstat_resend": 0, 2024-09-21T06:46:45.401 INFO:teuthology.orchestra.run.smithi018.stdout: "statfs_active": 0, 2024-09-21T06:46:45.401 INFO:teuthology.orchestra.run.smithi018.stdout: "statfs_send": 0, 2024-09-21T06:46:45.401 INFO:teuthology.orchestra.run.smithi018.stdout: "statfs_resend": 0, 2024-09-21T06:46:45.401 INFO:teuthology.orchestra.run.smithi018.stdout: "command_active": 0, 2024-09-21T06:46:45.401 INFO:teuthology.orchestra.run.smithi018.stdout: "command_send": 0, 2024-09-21T06:46:45.401 INFO:teuthology.orchestra.run.smithi018.stdout: "command_resend": 0, 2024-09-21T06:46:45.401 INFO:teuthology.orchestra.run.smithi018.stdout: "map_epoch": 85, 2024-09-21T06:46:45.401 INFO:teuthology.orchestra.run.smithi018.stdout: "map_full": 0, 2024-09-21T06:46:45.401 INFO:teuthology.orchestra.run.smithi018.stdout: "map_inc": 10, 2024-09-21T06:46:45.401 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_sessions": 8, 2024-09-21T06:46:45.401 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_session_open": 8, 2024-09-21T06:46:45.401 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_session_close": 0, 2024-09-21T06:46:45.401 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_laggy": 0, 2024-09-21T06:46:45.401 INFO:teuthology.orchestra.run.smithi018.stdout: "omap_wr": 14, 2024-09-21T06:46:45.401 INFO:teuthology.orchestra.run.smithi018.stdout: "omap_rd": 0, 2024-09-21T06:46:45.402 INFO:teuthology.orchestra.run.smithi018.stdout: "omap_del": 1 2024-09-21T06:46:45.402 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:45.402 INFO:teuthology.orchestra.run.smithi018.stdout: "oft": { 2024-09-21T06:46:45.402 INFO:teuthology.orchestra.run.smithi018.stdout: "omap_total_objs": 1, 2024-09-21T06:46:45.402 INFO:teuthology.orchestra.run.smithi018.stdout: "omap_total_kv_pairs": 0, 2024-09-21T06:46:45.402 INFO:teuthology.orchestra.run.smithi018.stdout: "omap_total_updates": 0, 2024-09-21T06:46:45.402 INFO:teuthology.orchestra.run.smithi018.stdout: "omap_total_removes": 0 2024-09-21T06:46:45.402 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:45.402 INFO:teuthology.orchestra.run.smithi018.stdout: "purge_queue": { 2024-09-21T06:46:45.402 INFO:teuthology.orchestra.run.smithi018.stdout: "pq_executing_ops": 0, 2024-09-21T06:46:45.402 INFO:teuthology.orchestra.run.smithi018.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T06:46:45.402 INFO:teuthology.orchestra.run.smithi018.stdout: "pq_executing": 0, 2024-09-21T06:46:45.402 INFO:teuthology.orchestra.run.smithi018.stdout: "pq_executing_high_water": 0, 2024-09-21T06:46:45.402 INFO:teuthology.orchestra.run.smithi018.stdout: "pq_executed_ops": 0, 2024-09-21T06:46:45.402 INFO:teuthology.orchestra.run.smithi018.stdout: "pq_executed": 0, 2024-09-21T06:46:45.403 INFO:teuthology.orchestra.run.smithi018.stdout: "pq_item_in_journal": 0 2024-09-21T06:46:45.403 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:45.403 INFO:teuthology.orchestra.run.smithi018.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T06:46:45.403 INFO:teuthology.orchestra.run.smithi018.stdout: "val": 0, 2024-09-21T06:46:45.403 INFO:teuthology.orchestra.run.smithi018.stdout: "max": 104857600, 2024-09-21T06:46:45.403 INFO:teuthology.orchestra.run.smithi018.stdout: "get_started": 0, 2024-09-21T06:46:45.403 INFO:teuthology.orchestra.run.smithi018.stdout: "get": 846, 2024-09-21T06:46:45.403 INFO:teuthology.orchestra.run.smithi018.stdout: "get_sum": 939957, 2024-09-21T06:46:45.403 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_fail": 0, 2024-09-21T06:46:45.403 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_success": 846, 2024-09-21T06:46:45.403 INFO:teuthology.orchestra.run.smithi018.stdout: "take": 0, 2024-09-21T06:46:45.403 INFO:teuthology.orchestra.run.smithi018.stdout: "take_sum": 0, 2024-09-21T06:46:45.403 INFO:teuthology.orchestra.run.smithi018.stdout: "put": 846, 2024-09-21T06:46:45.403 INFO:teuthology.orchestra.run.smithi018.stdout: "put_sum": 939957, 2024-09-21T06:46:45.403 INFO:teuthology.orchestra.run.smithi018.stdout: "wait": { 2024-09-21T06:46:45.404 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:45.404 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:45.404 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:45.404 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T06:46:45.404 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:45.404 INFO:teuthology.orchestra.run.smithi018.stdout: "throttle-objecter_bytes": { 2024-09-21T06:46:45.404 INFO:teuthology.orchestra.run.smithi018.stdout: "val": 0, 2024-09-21T06:46:45.404 INFO:teuthology.orchestra.run.smithi018.stdout: "max": 104857600, 2024-09-21T06:46:45.404 INFO:teuthology.orchestra.run.smithi018.stdout: "get_started": 0, 2024-09-21T06:46:45.404 INFO:teuthology.orchestra.run.smithi018.stdout: "get": 0, 2024-09-21T06:46:45.404 INFO:teuthology.orchestra.run.smithi018.stdout: "get_sum": 0, 2024-09-21T06:46:45.404 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_fail": 0, 2024-09-21T06:46:45.404 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_success": 0, 2024-09-21T06:46:45.404 INFO:teuthology.orchestra.run.smithi018.stdout: "take": 38, 2024-09-21T06:46:45.404 INFO:teuthology.orchestra.run.smithi018.stdout: "take_sum": 11332, 2024-09-21T06:46:45.404 INFO:teuthology.orchestra.run.smithi018.stdout: "put": 38, 2024-09-21T06:46:45.405 INFO:teuthology.orchestra.run.smithi018.stdout: "put_sum": 11332, 2024-09-21T06:46:45.405 INFO:teuthology.orchestra.run.smithi018.stdout: "wait": { 2024-09-21T06:46:45.405 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:45.405 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:45.405 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:45.405 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T06:46:45.405 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:45.405 INFO:teuthology.orchestra.run.smithi018.stdout: "throttle-objecter_ops": { 2024-09-21T06:46:45.405 INFO:teuthology.orchestra.run.smithi018.stdout: "val": 0, 2024-09-21T06:46:45.405 INFO:teuthology.orchestra.run.smithi018.stdout: "max": 1024, 2024-09-21T06:46:45.405 INFO:teuthology.orchestra.run.smithi018.stdout: "get_started": 0, 2024-09-21T06:46:45.405 INFO:teuthology.orchestra.run.smithi018.stdout: "get": 0, 2024-09-21T06:46:45.405 INFO:teuthology.orchestra.run.smithi018.stdout: "get_sum": 0, 2024-09-21T06:46:45.405 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_fail": 0, 2024-09-21T06:46:45.406 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_success": 0, 2024-09-21T06:46:45.406 INFO:teuthology.orchestra.run.smithi018.stdout: "take": 38, 2024-09-21T06:46:45.406 INFO:teuthology.orchestra.run.smithi018.stdout: "take_sum": 38, 2024-09-21T06:46:45.406 INFO:teuthology.orchestra.run.smithi018.stdout: "put": 38, 2024-09-21T06:46:45.406 INFO:teuthology.orchestra.run.smithi018.stdout: "put_sum": 38, 2024-09-21T06:46:45.406 INFO:teuthology.orchestra.run.smithi018.stdout: "wait": { 2024-09-21T06:46:45.406 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:45.406 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:45.406 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:45.406 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T06:46:45.406 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:45.406 INFO:teuthology.orchestra.run.smithi018.stdout: "throttle-write_buf_throttle": { 2024-09-21T06:46:45.406 INFO:teuthology.orchestra.run.smithi018.stdout: "val": 0, 2024-09-21T06:46:45.406 INFO:teuthology.orchestra.run.smithi018.stdout: "max": 3758096384, 2024-09-21T06:46:45.406 INFO:teuthology.orchestra.run.smithi018.stdout: "get_started": 0, 2024-09-21T06:46:45.407 INFO:teuthology.orchestra.run.smithi018.stdout: "get": 0, 2024-09-21T06:46:45.407 INFO:teuthology.orchestra.run.smithi018.stdout: "get_sum": 0, 2024-09-21T06:46:45.407 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_fail": 0, 2024-09-21T06:46:45.407 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_success": 0, 2024-09-21T06:46:45.407 INFO:teuthology.orchestra.run.smithi018.stdout: "take": 0, 2024-09-21T06:46:45.407 INFO:teuthology.orchestra.run.smithi018.stdout: "take_sum": 0, 2024-09-21T06:46:45.407 INFO:teuthology.orchestra.run.smithi018.stdout: "put": 0, 2024-09-21T06:46:45.407 INFO:teuthology.orchestra.run.smithi018.stdout: "put_sum": 0, 2024-09-21T06:46:45.407 INFO:teuthology.orchestra.run.smithi018.stdout: "wait": { 2024-09-21T06:46:45.407 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:45.407 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:45.407 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:45.407 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T06:46:45.407 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:45.407 INFO:teuthology.orchestra.run.smithi018.stdout: "throttle-write_buf_throttle-0x55cce18e1380": { 2024-09-21T06:46:45.408 INFO:teuthology.orchestra.run.smithi018.stdout: "val": 0, 2024-09-21T06:46:45.408 INFO:teuthology.orchestra.run.smithi018.stdout: "max": 3758096384, 2024-09-21T06:46:45.408 INFO:teuthology.orchestra.run.smithi018.stdout: "get_started": 0, 2024-09-21T06:46:45.408 INFO:teuthology.orchestra.run.smithi018.stdout: "get": 4, 2024-09-21T06:46:45.408 INFO:teuthology.orchestra.run.smithi018.stdout: "get_sum": 1120, 2024-09-21T06:46:45.408 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_fail": 0, 2024-09-21T06:46:45.408 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_success": 4, 2024-09-21T06:46:45.408 INFO:teuthology.orchestra.run.smithi018.stdout: "take": 0, 2024-09-21T06:46:45.408 INFO:teuthology.orchestra.run.smithi018.stdout: "take_sum": 0, 2024-09-21T06:46:45.408 INFO:teuthology.orchestra.run.smithi018.stdout: "put": 3, 2024-09-21T06:46:45.408 INFO:teuthology.orchestra.run.smithi018.stdout: "put_sum": 1120, 2024-09-21T06:46:45.408 INFO:teuthology.orchestra.run.smithi018.stdout: "wait": { 2024-09-21T06:46:45.408 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:45.408 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:45.409 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:45.409 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T06:46:45.409 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:45.409 INFO:teuthology.orchestra.run.smithi018.stdout: "trackedop": { 2024-09-21T06:46:45.409 INFO:teuthology.orchestra.run.smithi018.stdout: "slow_ops_count": 0 2024-09-21T06:46:45.409 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T06:46:45.409 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-21T06:46:46.142 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-09-21T06:46:46.142 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-09-21T06:46:46.142 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=0 2024-09-21T06:46:46.142 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=6 2024-09-21T06:46:46.142 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=6 2024-09-21T06:46:46.142 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2024-09-21T06:46:46.142 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2024-09-21T06:46:46.142 DEBUG:tasks.check_counter:Getting stats from k 2024-09-21T06:46:46.142 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph daemon mds.k perf dump 2024-09-21T06:46:46.394 INFO:teuthology.orchestra.run.smithi018.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T06:46:46.779 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:46:46 smithi018 ceph-mon[34477]: pgmap v644: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:46:46.901 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-21T06:46:46.901 INFO:teuthology.orchestra.run.smithi018.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T06:46:46.901 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_messages": 0, 2024-09-21T06:46:46.902 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages": 2, 2024-09-21T06:46:46.902 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_bytes": 0, 2024-09-21T06:46:46.902 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_bytes": 0, 2024-09-21T06:46:46.902 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_created_connections": 4, 2024-09-21T06:46:46.902 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_active_connections": 0, 2024-09-21T06:46:46.902 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_total_time": 0.001155191, 2024-09-21T06:46:46.902 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T06:46:46.902 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_recv_time": 0.000227033, 2024-09-21T06:46:46.902 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:46:46.902 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:46:46.902 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:46.902 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:46.902 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:46.903 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:46.903 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:46:46.903 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:46.903 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:46.903 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:46.903 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:46.903 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T06:46:46.903 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T06:46:46.903 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:46.903 INFO:teuthology.orchestra.run.smithi018.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T06:46:46.903 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_messages": 1, 2024-09-21T06:46:46.903 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages": 160, 2024-09-21T06:46:46.903 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_bytes": 160, 2024-09-21T06:46:46.903 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_bytes": 108400, 2024-09-21T06:46:46.903 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_created_connections": 3, 2024-09-21T06:46:46.903 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_active_connections": 2, 2024-09-21T06:46:46.904 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_total_time": 0.014168151, 2024-09-21T06:46:46.904 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_send_time": 0.011369721, 2024-09-21T06:46:46.904 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_recv_time": 0.000839146, 2024-09-21T06:46:46.904 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:46:46.904 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:46:46.904 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 158, 2024-09-21T06:46:46.904 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.009940047, 2024-09-21T06:46:46.904 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000062911 2024-09-21T06:46:46.904 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:46.904 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:46:46.904 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:46.904 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:46.904 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:46.904 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:46.905 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T06:46:46.905 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_encrypted_bytes": 108400 2024-09-21T06:46:46.905 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:46.905 INFO:teuthology.orchestra.run.smithi018.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T06:46:46.905 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_messages": 220, 2024-09-21T06:46:46.905 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages": 213, 2024-09-21T06:46:46.905 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_bytes": 839456, 2024-09-21T06:46:46.905 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_bytes": 129792, 2024-09-21T06:46:46.905 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_created_connections": 2, 2024-09-21T06:46:46.905 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_active_connections": 1, 2024-09-21T06:46:46.905 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_total_time": 0.045696955, 2024-09-21T06:46:46.905 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_send_time": 0.019704043, 2024-09-21T06:46:46.905 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_recv_time": 0.034820972, 2024-09-21T06:46:46.905 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:46:46.906 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:46:46.906 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 213, 2024-09-21T06:46:46.906 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.016660944, 2024-09-21T06:46:46.906 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000078220 2024-09-21T06:46:46.906 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:46.906 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:46:46.906 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:46.906 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:46.906 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:46.906 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:46.906 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_recv_encrypted_bytes": 839456, 2024-09-21T06:46:46.906 INFO:teuthology.orchestra.run.smithi018.stdout: "msgr_send_encrypted_bytes": 129792 2024-09-21T06:46:46.906 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:46.906 INFO:teuthology.orchestra.run.smithi018.stdout: "cct": { 2024-09-21T06:46:46.907 INFO:teuthology.orchestra.run.smithi018.stdout: "total_workers": 0, 2024-09-21T06:46:46.907 INFO:teuthology.orchestra.run.smithi018.stdout: "unhealthy_workers": 0 2024-09-21T06:46:46.907 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:46.907 INFO:teuthology.orchestra.run.smithi018.stdout: "mempool": { 2024-09-21T06:46:46.907 INFO:teuthology.orchestra.run.smithi018.stdout: "bloom_filter_bytes": 0, 2024-09-21T06:46:46.907 INFO:teuthology.orchestra.run.smithi018.stdout: "bloom_filter_items": 0, 2024-09-21T06:46:46.907 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T06:46:46.907 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_alloc_items": 0, 2024-09-21T06:46:46.907 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T06:46:46.907 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_data_items": 0, 2024-09-21T06:46:46.907 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T06:46:46.907 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T06:46:46.907 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T06:46:46.908 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T06:46:46.908 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T06:46:46.908 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_other_items": 0, 2024-09-21T06:46:46.908 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T06:46:46.908 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T06:46:46.908 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_extent_bytes": 0, 2024-09-21T06:46:46.908 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_extent_items": 0, 2024-09-21T06:46:46.908 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_blob_bytes": 0, 2024-09-21T06:46:46.908 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_blob_items": 0, 2024-09-21T06:46:46.908 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T06:46:46.908 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T06:46:46.908 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T06:46:46.908 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T06:46:46.908 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T06:46:46.909 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_fsck_items": 0, 2024-09-21T06:46:46.909 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_txc_bytes": 0, 2024-09-21T06:46:46.909 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_txc_items": 0, 2024-09-21T06:46:46.909 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T06:46:46.909 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T06:46:46.909 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_bytes": 0, 2024-09-21T06:46:46.909 INFO:teuthology.orchestra.run.smithi018.stdout: "bluestore_writing_items": 0, 2024-09-21T06:46:46.909 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_bytes": 0, 2024-09-21T06:46:46.909 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_items": 0, 2024-09-21T06:46:46.909 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T06:46:46.909 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_reader_items": 0, 2024-09-21T06:46:46.909 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T06:46:46.909 INFO:teuthology.orchestra.run.smithi018.stdout: "bluefs_file_writer_items": 0, 2024-09-21T06:46:46.910 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_anon_bytes": 148967, 2024-09-21T06:46:46.910 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_anon_items": 29, 2024-09-21T06:46:46.910 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_meta_bytes": 0, 2024-09-21T06:46:46.910 INFO:teuthology.orchestra.run.smithi018.stdout: "buffer_meta_items": 0, 2024-09-21T06:46:46.910 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_bytes": 0, 2024-09-21T06:46:46.910 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_items": 0, 2024-09-21T06:46:46.910 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mapbl_bytes": 0, 2024-09-21T06:46:46.910 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_mapbl_items": 0, 2024-09-21T06:46:46.910 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pglog_bytes": 0, 2024-09-21T06:46:46.910 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_pglog_items": 0, 2024-09-21T06:46:46.910 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_bytes": 0, 2024-09-21T06:46:46.910 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_items": 0, 2024-09-21T06:46:46.911 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T06:46:46.911 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_mapping_items": 0, 2024-09-21T06:46:46.911 INFO:teuthology.orchestra.run.smithi018.stdout: "pgmap_bytes": 0, 2024-09-21T06:46:46.911 INFO:teuthology.orchestra.run.smithi018.stdout: "pgmap_items": 0, 2024-09-21T06:46:46.911 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_co_bytes": 968, 2024-09-21T06:46:46.911 INFO:teuthology.orchestra.run.smithi018.stdout: "mds_co_items": 2, 2024-09-21T06:46:46.911 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_1_bytes": 0, 2024-09-21T06:46:46.911 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_1_items": 0, 2024-09-21T06:46:46.911 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_2_bytes": 0, 2024-09-21T06:46:46.911 INFO:teuthology.orchestra.run.smithi018.stdout: "unittest_2_items": 0 2024-09-21T06:46:46.911 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-21T06:46:46.912 INFO:teuthology.orchestra.run.smithi018.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T06:46:46.912 INFO:teuthology.orchestra.run.smithi018.stdout: "val": 0, 2024-09-21T06:46:46.912 INFO:teuthology.orchestra.run.smithi018.stdout: "max": 104857600, 2024-09-21T06:46:46.912 INFO:teuthology.orchestra.run.smithi018.stdout: "get_started": 0, 2024-09-21T06:46:46.912 INFO:teuthology.orchestra.run.smithi018.stdout: "get": 217, 2024-09-21T06:46:46.912 INFO:teuthology.orchestra.run.smithi018.stdout: "get_sum": 805954, 2024-09-21T06:46:46.912 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_fail": 0, 2024-09-21T06:46:46.912 INFO:teuthology.orchestra.run.smithi018.stdout: "get_or_fail_success": 217, 2024-09-21T06:46:46.912 INFO:teuthology.orchestra.run.smithi018.stdout: "take": 0, 2024-09-21T06:46:46.912 INFO:teuthology.orchestra.run.smithi018.stdout: "take_sum": 0, 2024-09-21T06:46:46.912 INFO:teuthology.orchestra.run.smithi018.stdout: "put": 217, 2024-09-21T06:46:46.912 INFO:teuthology.orchestra.run.smithi018.stdout: "put_sum": 805954, 2024-09-21T06:46:46.912 INFO:teuthology.orchestra.run.smithi018.stdout: "wait": { 2024-09-21T06:46:46.912 INFO:teuthology.orchestra.run.smithi018.stdout: "avgcount": 0, 2024-09-21T06:46:46.912 INFO:teuthology.orchestra.run.smithi018.stdout: "sum": 0.000000000, 2024-09-21T06:46:46.913 INFO:teuthology.orchestra.run.smithi018.stdout: "avgtime": 0.000000000 2024-09-21T06:46:46.913 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T06:46:46.913 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-21T06:46:46.913 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-21T06:46:47.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:46:46 smithi144 ceph-mon[34653]: pgmap v644: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:46:47.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:46:46 smithi007 ceph-mon[30983]: pgmap v644: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:46:47.588 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.k 2024-09-21T06:46:47.588 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.k 2024-09-21T06:46:47.589 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.k 2024-09-21T06:46:47.589 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.k 2024-09-21T06:46:47.589 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.k 2024-09-21T06:46:47.589 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.k 2024-09-21T06:46:47.589 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.k 2024-09-21T06:46:47.589 DEBUG:tasks.check_counter:Getting stats from c 2024-09-21T06:46:47.589 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph daemon mds.c perf dump 2024-09-21T06:46:47.851 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:46:48.368 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-21T06:46:48.368 INFO:teuthology.orchestra.run.smithi144.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T06:46:48.368 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_messages": 1210, 2024-09-21T06:46:48.369 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages": 1203, 2024-09-21T06:46:48.369 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_bytes": 5369002, 2024-09-21T06:46:48.369 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_bytes": 441338, 2024-09-21T06:46:48.369 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_created_connections": 5, 2024-09-21T06:46:48.369 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_active_connections": 1, 2024-09-21T06:46:48.369 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_total_time": 0.186543013, 2024-09-21T06:46:48.369 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_send_time": 0.077824349, 2024-09-21T06:46:48.369 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_recv_time": 0.067910900, 2024-09-21T06:46:48.369 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_fast_dispatch_time": 0.038955628, 2024-09-21T06:46:48.369 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:46:48.369 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 1202, 2024-09-21T06:46:48.369 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.067326863, 2024-09-21T06:46:48.370 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000056012 2024-09-21T06:46:48.370 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:48.370 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:46:48.370 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:48.370 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:48.370 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:48.370 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:48.370 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_encrypted_bytes": 863424, 2024-09-21T06:46:48.370 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_encrypted_bytes": 129376 2024-09-21T06:46:48.370 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:48.370 INFO:teuthology.orchestra.run.smithi144.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T06:46:48.370 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_messages": 1067, 2024-09-21T06:46:48.370 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages": 1221, 2024-09-21T06:46:48.370 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_bytes": 2334722, 2024-09-21T06:46:48.371 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_bytes": 697990, 2024-09-21T06:46:48.371 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_created_connections": 5, 2024-09-21T06:46:48.371 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_active_connections": 4, 2024-09-21T06:46:48.371 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_total_time": 0.112866858, 2024-09-21T06:46:48.371 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_send_time": 0.054274756, 2024-09-21T06:46:48.371 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_recv_time": 0.023274381, 2024-09-21T06:46:48.371 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_fast_dispatch_time": 0.027358144, 2024-09-21T06:46:48.371 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:46:48.371 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 1220, 2024-09-21T06:46:48.371 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.075314572, 2024-09-21T06:46:48.371 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000061733 2024-09-21T06:46:48.371 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:48.371 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:46:48.371 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:48.371 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:48.372 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:48.372 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:48.372 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-21T06:46:48.372 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_encrypted_bytes": 360208 2024-09-21T06:46:48.372 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:48.372 INFO:teuthology.orchestra.run.smithi144.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T06:46:48.372 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_messages": 243, 2024-09-21T06:46:48.372 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages": 245, 2024-09-21T06:46:48.372 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_bytes": 4254620, 2024-09-21T06:46:48.372 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_bytes": 77281, 2024-09-21T06:46:48.372 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_created_connections": 4, 2024-09-21T06:46:48.372 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_active_connections": 3, 2024-09-21T06:46:48.372 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_total_time": 0.031694939, 2024-09-21T06:46:48.372 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_send_time": 0.013046832, 2024-09-21T06:46:48.372 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_recv_time": 0.008066687, 2024-09-21T06:46:48.373 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_fast_dispatch_time": 0.008329324, 2024-09-21T06:46:48.373 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:46:48.373 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 243, 2024-09-21T06:46:48.373 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.010463156, 2024-09-21T06:46:48.373 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000043058 2024-09-21T06:46:48.373 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:48.373 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:46:48.373 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:48.373 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:48.373 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:48.373 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:48.373 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T06:46:48.373 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T06:46:48.373 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:48.373 INFO:teuthology.orchestra.run.smithi144.stdout: "cct": { 2024-09-21T06:46:48.374 INFO:teuthology.orchestra.run.smithi144.stdout: "total_workers": 1, 2024-09-21T06:46:48.374 INFO:teuthology.orchestra.run.smithi144.stdout: "unhealthy_workers": 0 2024-09-21T06:46:48.374 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:48.374 INFO:teuthology.orchestra.run.smithi144.stdout: "finisher-MDSRank": { 2024-09-21T06:46:48.374 INFO:teuthology.orchestra.run.smithi144.stdout: "queue_len": 0, 2024-09-21T06:46:48.374 INFO:teuthology.orchestra.run.smithi144.stdout: "complete_latency": { 2024-09-21T06:46:48.374 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 3816, 2024-09-21T06:46:48.374 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.123735091, 2024-09-21T06:46:48.374 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000032425 2024-09-21T06:46:48.374 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-21T06:46:48.374 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:48.374 INFO:teuthology.orchestra.run.smithi144.stdout: "finisher-PurgeQueue": { 2024-09-21T06:46:48.374 INFO:teuthology.orchestra.run.smithi144.stdout: "queue_len": 0, 2024-09-21T06:46:48.374 INFO:teuthology.orchestra.run.smithi144.stdout: "complete_latency": { 2024-09-21T06:46:48.375 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:48.375 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:48.375 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:48.375 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-21T06:46:48.375 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:48.375 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": { 2024-09-21T06:46:48.375 INFO:teuthology.orchestra.run.smithi144.stdout: "request": 0, 2024-09-21T06:46:48.375 INFO:teuthology.orchestra.run.smithi144.stdout: "reply": 0, 2024-09-21T06:46:48.375 INFO:teuthology.orchestra.run.smithi144.stdout: "reply_latency": { 2024-09-21T06:46:48.375 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:48.375 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:48.375 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:48.375 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:48.375 INFO:teuthology.orchestra.run.smithi144.stdout: "slow_reply": 0, 2024-09-21T06:46:48.375 INFO:teuthology.orchestra.run.smithi144.stdout: "forward": 0, 2024-09-21T06:46:48.375 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_fetch_complete": 0, 2024-09-21T06:46:48.376 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_fetch_keys": 0, 2024-09-21T06:46:48.376 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_commit": 0, 2024-09-21T06:46:48.376 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_split": 0, 2024-09-21T06:46:48.376 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_merge": 0, 2024-09-21T06:46:48.376 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes": 27, 2024-09-21T06:46:48.376 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_top": 8, 2024-09-21T06:46:48.376 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_bottom": 19, 2024-09-21T06:46:48.376 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_pin_tail": 0, 2024-09-21T06:46:48.376 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_pinned": 16, 2024-09-21T06:46:48.376 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_expired": 0, 2024-09-21T06:46:48.376 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_with_caps": 0, 2024-09-21T06:46:48.376 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": 0, 2024-09-21T06:46:48.376 INFO:teuthology.orchestra.run.smithi144.stdout: "subtrees": 2, 2024-09-21T06:46:48.377 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse": 0, 2024-09-21T06:46:48.377 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_hit": 0, 2024-09-21T06:46:48.377 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_forward": 0, 2024-09-21T06:46:48.377 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_discover": 0, 2024-09-21T06:46:48.377 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_dir_fetch": 0, 2024-09-21T06:46:48.377 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_remote_ino": 0, 2024-09-21T06:46:48.377 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_lock": 0, 2024-09-21T06:46:48.377 INFO:teuthology.orchestra.run.smithi144.stdout: "load_cent": 0, 2024-09-21T06:46:48.377 INFO:teuthology.orchestra.run.smithi144.stdout: "q": 0, 2024-09-21T06:46:48.377 INFO:teuthology.orchestra.run.smithi144.stdout: "exported": 0, 2024-09-21T06:46:48.377 INFO:teuthology.orchestra.run.smithi144.stdout: "exported_inodes": 0, 2024-09-21T06:46:48.377 INFO:teuthology.orchestra.run.smithi144.stdout: "imported": 0, 2024-09-21T06:46:48.377 INFO:teuthology.orchestra.run.smithi144.stdout: "imported_inodes": 0, 2024-09-21T06:46:48.377 INFO:teuthology.orchestra.run.smithi144.stdout: "openino_dir_fetch": 0, 2024-09-21T06:46:48.377 INFO:teuthology.orchestra.run.smithi144.stdout: "openino_backtrace_fetch": 0, 2024-09-21T06:46:48.378 INFO:teuthology.orchestra.run.smithi144.stdout: "openino_peer_discover": 0, 2024-09-21T06:46:48.378 INFO:teuthology.orchestra.run.smithi144.stdout: "root_rfiles": 4, 2024-09-21T06:46:48.378 INFO:teuthology.orchestra.run.smithi144.stdout: "root_rbytes": 234, 2024-09-21T06:46:48.378 INFO:teuthology.orchestra.run.smithi144.stdout: "root_rsnaps": 6, 2024-09-21T06:46:48.378 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T06:46:48.378 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_set_tag": 0, 2024-09-21T06:46:48.378 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T06:46:48.378 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_inotable_repaired": 0, 2024-09-21T06:46:48.378 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_dir_inodes": 0, 2024-09-21T06:46:48.378 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T06:46:48.378 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T06:46:48.378 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_file_inodes": 0, 2024-09-21T06:46:48.378 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_inode_file_caps": 0, 2024-09-21T06:46:48.378 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T06:46:48.378 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_grant": 0, 2024-09-21T06:46:48.379 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T06:46:48.379 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T06:46:48.379 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T06:46:48.379 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_caps": 0, 2024-09-21T06:46:48.379 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_caps_dirty": 0, 2024-09-21T06:46:48.379 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_cap_release": 0, 2024-09-21T06:46:48.379 INFO:teuthology.orchestra.run.smithi144.stdout: "process_request_cap_release": 0 2024-09-21T06:46:48.379 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:48.379 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_cache": { 2024-09-21T06:46:48.379 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_update": 0, 2024-09-21T06:46:48.379 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_update_receipt": 0, 2024-09-21T06:46:48.379 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_try_discover": 0, 2024-09-21T06:46:48.379 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_send_discover": 0, 2024-09-21T06:46:48.379 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_handle_discover": 0, 2024-09-21T06:46:48.379 INFO:teuthology.orchestra.run.smithi144.stdout: "num_strays": 0, 2024-09-21T06:46:48.380 INFO:teuthology.orchestra.run.smithi144.stdout: "num_strays_delayed": 0, 2024-09-21T06:46:48.380 INFO:teuthology.orchestra.run.smithi144.stdout: "num_strays_enqueuing": 0, 2024-09-21T06:46:48.380 INFO:teuthology.orchestra.run.smithi144.stdout: "strays_created": 0, 2024-09-21T06:46:48.380 INFO:teuthology.orchestra.run.smithi144.stdout: "strays_enqueued": 0, 2024-09-21T06:46:48.380 INFO:teuthology.orchestra.run.smithi144.stdout: "strays_reintegrated": 0, 2024-09-21T06:46:48.380 INFO:teuthology.orchestra.run.smithi144.stdout: "strays_migrated": 0, 2024-09-21T06:46:48.380 INFO:teuthology.orchestra.run.smithi144.stdout: "num_recovering_processing": 0, 2024-09-21T06:46:48.380 INFO:teuthology.orchestra.run.smithi144.stdout: "num_recovering_enqueued": 0, 2024-09-21T06:46:48.380 INFO:teuthology.orchestra.run.smithi144.stdout: "num_recovering_prioritized": 0, 2024-09-21T06:46:48.380 INFO:teuthology.orchestra.run.smithi144.stdout: "recovery_started": 0, 2024-09-21T06:46:48.380 INFO:teuthology.orchestra.run.smithi144.stdout: "recovery_completed": 0, 2024-09-21T06:46:48.380 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_quiesce_path": 0, 2024-09-21T06:46:48.380 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_quiesce_inode": 0, 2024-09-21T06:46:48.380 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T06:46:48.380 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_exportdir": 0, 2024-09-21T06:46:48.381 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_flush": 0, 2024-09-21T06:46:48.381 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_fragmentdir": 0, 2024-09-21T06:46:48.381 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_fragstats": 0, 2024-09-21T06:46:48.381 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_inodestats": 0, 2024-09-21T06:46:48.381 INFO:teuthology.orchestra.run.smithi144.stdout: "uninline_started": 0, 2024-09-21T06:46:48.381 INFO:teuthology.orchestra.run.smithi144.stdout: "uninline_succeeded": 0, 2024-09-21T06:46:48.381 INFO:teuthology.orchestra.run.smithi144.stdout: "uninline_write_failed": 0 2024-09-21T06:46:48.381 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:48.381 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_log": { 2024-09-21T06:46:48.381 INFO:teuthology.orchestra.run.smithi144.stdout: "evlrg": 0, 2024-09-21T06:46:48.381 INFO:teuthology.orchestra.run.smithi144.stdout: "evadd": 0, 2024-09-21T06:46:48.381 INFO:teuthology.orchestra.run.smithi144.stdout: "evex": 0, 2024-09-21T06:46:48.381 INFO:teuthology.orchestra.run.smithi144.stdout: "evtrm": 0, 2024-09-21T06:46:48.381 INFO:teuthology.orchestra.run.smithi144.stdout: "ev": 3932, 2024-09-21T06:46:48.381 INFO:teuthology.orchestra.run.smithi144.stdout: "evexg": 0, 2024-09-21T06:46:48.381 INFO:teuthology.orchestra.run.smithi144.stdout: "evexd": 0, 2024-09-21T06:46:48.382 INFO:teuthology.orchestra.run.smithi144.stdout: "segadd": 0, 2024-09-21T06:46:48.382 INFO:teuthology.orchestra.run.smithi144.stdout: "segex": 0, 2024-09-21T06:46:48.382 INFO:teuthology.orchestra.run.smithi144.stdout: "segtrm": 0, 2024-09-21T06:46:48.382 INFO:teuthology.orchestra.run.smithi144.stdout: "seg": 2, 2024-09-21T06:46:48.382 INFO:teuthology.orchestra.run.smithi144.stdout: "segmjr": 12, 2024-09-21T06:46:48.382 INFO:teuthology.orchestra.run.smithi144.stdout: "segexg": 0, 2024-09-21T06:46:48.382 INFO:teuthology.orchestra.run.smithi144.stdout: "segexd": 0, 2024-09-21T06:46:48.382 INFO:teuthology.orchestra.run.smithi144.stdout: "expos": 14517774, 2024-09-21T06:46:48.382 INFO:teuthology.orchestra.run.smithi144.stdout: "wrpos": 14644446, 2024-09-21T06:46:48.382 INFO:teuthology.orchestra.run.smithi144.stdout: "rdpos": 14644334, 2024-09-21T06:46:48.382 INFO:teuthology.orchestra.run.smithi144.stdout: "jlat": { 2024-09-21T06:46:48.382 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:48.382 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:48.382 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:48.382 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:48.383 INFO:teuthology.orchestra.run.smithi144.stdout: "replayed": 3932 2024-09-21T06:46:48.383 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:48.383 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_mem": { 2024-09-21T06:46:48.383 INFO:teuthology.orchestra.run.smithi144.stdout: "ino": 18, 2024-09-21T06:46:48.383 INFO:teuthology.orchestra.run.smithi144.stdout: "ino+": 21, 2024-09-21T06:46:48.383 INFO:teuthology.orchestra.run.smithi144.stdout: "ino-": 3, 2024-09-21T06:46:48.383 INFO:teuthology.orchestra.run.smithi144.stdout: "dir": 13, 2024-09-21T06:46:48.383 INFO:teuthology.orchestra.run.smithi144.stdout: "dir+": 13, 2024-09-21T06:46:48.383 INFO:teuthology.orchestra.run.smithi144.stdout: "dir-": 0, 2024-09-21T06:46:48.383 INFO:teuthology.orchestra.run.smithi144.stdout: "dn": 27, 2024-09-21T06:46:48.383 INFO:teuthology.orchestra.run.smithi144.stdout: "dn+": 27, 2024-09-21T06:46:48.383 INFO:teuthology.orchestra.run.smithi144.stdout: "dn-": 0, 2024-09-21T06:46:48.383 INFO:teuthology.orchestra.run.smithi144.stdout: "cap": 0, 2024-09-21T06:46:48.383 INFO:teuthology.orchestra.run.smithi144.stdout: "cap+": 0, 2024-09-21T06:46:48.383 INFO:teuthology.orchestra.run.smithi144.stdout: "cap-": 0, 2024-09-21T06:46:48.384 INFO:teuthology.orchestra.run.smithi144.stdout: "rss": 121140, 2024-09-21T06:46:48.384 INFO:teuthology.orchestra.run.smithi144.stdout: "heap": 319143936 2024-09-21T06:46:48.384 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:48.384 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_server": { 2024-09-21T06:46:48.384 INFO:teuthology.orchestra.run.smithi144.stdout: "dispatch_client_request": 0, 2024-09-21T06:46:48.384 INFO:teuthology.orchestra.run.smithi144.stdout: "dispatch_server_request": 0, 2024-09-21T06:46:48.384 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_request": 0, 2024-09-21T06:46:48.384 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_session": 0, 2024-09-21T06:46:48.384 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_peer_request": 0, 2024-09-21T06:46:48.384 INFO:teuthology.orchestra.run.smithi144.stdout: "req_create_latency": { 2024-09-21T06:46:48.384 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:48.384 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:48.384 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:48.384 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:48.384 INFO:teuthology.orchestra.run.smithi144.stdout: "req_getattr_latency": { 2024-09-21T06:46:48.384 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:48.385 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:48.385 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:48.385 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:48.385 INFO:teuthology.orchestra.run.smithi144.stdout: "req_getfilelock_latency": { 2024-09-21T06:46:48.385 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:48.385 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:48.385 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:48.385 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:48.385 INFO:teuthology.orchestra.run.smithi144.stdout: "req_link_latency": { 2024-09-21T06:46:48.385 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:48.385 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:48.385 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:48.385 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:48.385 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookup_latency": { 2024-09-21T06:46:48.385 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:48.386 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:48.386 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:48.386 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:48.386 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookuphash_latency": { 2024-09-21T06:46:48.386 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:48.386 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:48.386 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:48.386 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:48.386 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookupino_latency": { 2024-09-21T06:46:48.386 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:48.386 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:48.386 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:48.386 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:48.386 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookupname_latency": { 2024-09-21T06:46:48.386 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:48.387 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:48.387 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:48.387 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:48.387 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookupparent_latency": { 2024-09-21T06:46:48.387 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:48.387 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:48.387 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:48.387 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:48.387 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookupsnap_latency": { 2024-09-21T06:46:48.387 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:48.387 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:48.387 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:48.387 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:48.387 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lssnap_latency": { 2024-09-21T06:46:48.387 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:48.388 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:48.388 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:48.388 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:48.388 INFO:teuthology.orchestra.run.smithi144.stdout: "req_mkdir_latency": { 2024-09-21T06:46:48.388 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:48.388 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:48.389 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:48.389 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:48.389 INFO:teuthology.orchestra.run.smithi144.stdout: "req_mknod_latency": { 2024-09-21T06:46:48.389 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:48.389 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:48.389 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:48.389 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:48.389 INFO:teuthology.orchestra.run.smithi144.stdout: "req_mksnap_latency": { 2024-09-21T06:46:48.389 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:48.389 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:48.389 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:48.389 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:48.389 INFO:teuthology.orchestra.run.smithi144.stdout: "req_open_latency": { 2024-09-21T06:46:48.389 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:48.389 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:48.390 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:48.390 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:48.390 INFO:teuthology.orchestra.run.smithi144.stdout: "req_readdir_latency": { 2024-09-21T06:46:48.390 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:48.390 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:48.390 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:48.390 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:48.390 INFO:teuthology.orchestra.run.smithi144.stdout: "req_rename_latency": { 2024-09-21T06:46:48.390 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:48.390 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:48.390 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:48.390 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:48.390 INFO:teuthology.orchestra.run.smithi144.stdout: "req_renamesnap_latency": { 2024-09-21T06:46:48.390 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:48.390 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:48.391 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:48.391 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:48.391 INFO:teuthology.orchestra.run.smithi144.stdout: "req_snapdiff_latency": { 2024-09-21T06:46:48.391 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:48.391 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:48.391 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:48.391 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:48.391 INFO:teuthology.orchestra.run.smithi144.stdout: "req_rmdir_latency": { 2024-09-21T06:46:48.391 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:48.391 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:48.391 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:48.391 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:48.391 INFO:teuthology.orchestra.run.smithi144.stdout: "req_rmsnap_latency": { 2024-09-21T06:46:48.391 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:48.392 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:48.392 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:48.392 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:48.392 INFO:teuthology.orchestra.run.smithi144.stdout: "req_rmxattr_latency": { 2024-09-21T06:46:48.392 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:48.392 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:48.392 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:48.392 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:48.392 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setattr_latency": { 2024-09-21T06:46:48.392 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:48.392 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:48.392 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:48.392 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:48.392 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setdirlayout_latency": { 2024-09-21T06:46:48.393 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:48.393 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:48.393 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:48.393 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:48.393 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setfilelock_latency": { 2024-09-21T06:46:48.393 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:48.393 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:48.393 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:48.393 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:48.393 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setlayout_latency": { 2024-09-21T06:46:48.393 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:48.393 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:48.393 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:48.393 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:48.393 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setxattr_latency": { 2024-09-21T06:46:48.394 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:48.394 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:48.394 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:48.394 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:48.394 INFO:teuthology.orchestra.run.smithi144.stdout: "req_symlink_latency": { 2024-09-21T06:46:48.394 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:48.394 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:48.394 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:48.394 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:48.394 INFO:teuthology.orchestra.run.smithi144.stdout: "req_unlink_latency": { 2024-09-21T06:46:48.394 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:48.394 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:48.394 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:48.394 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:48.395 INFO:teuthology.orchestra.run.smithi144.stdout: "cap_revoke_eviction": 0, 2024-09-21T06:46:48.395 INFO:teuthology.orchestra.run.smithi144.stdout: "cap_acquisition_throttle": 0, 2024-09-21T06:46:48.395 INFO:teuthology.orchestra.run.smithi144.stdout: "req_getvxattr_latency": { 2024-09-21T06:46:48.395 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:48.395 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:48.395 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:48.395 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-21T06:46:48.395 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:48.395 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_sessions": { 2024-09-21T06:46:48.395 INFO:teuthology.orchestra.run.smithi144.stdout: "session_count": 2, 2024-09-21T06:46:48.395 INFO:teuthology.orchestra.run.smithi144.stdout: "session_add": 3, 2024-09-21T06:46:48.395 INFO:teuthology.orchestra.run.smithi144.stdout: "session_remove": 1, 2024-09-21T06:46:48.395 INFO:teuthology.orchestra.run.smithi144.stdout: "sessions_open": 2, 2024-09-21T06:46:48.395 INFO:teuthology.orchestra.run.smithi144.stdout: "sessions_stale": 0, 2024-09-21T06:46:48.395 INFO:teuthology.orchestra.run.smithi144.stdout: "total_load": 0, 2024-09-21T06:46:48.396 INFO:teuthology.orchestra.run.smithi144.stdout: "average_load": 0, 2024-09-21T06:46:48.396 INFO:teuthology.orchestra.run.smithi144.stdout: "avg_session_uptime": 3170, 2024-09-21T06:46:48.396 INFO:teuthology.orchestra.run.smithi144.stdout: "mdthresh_evicted": 0 2024-09-21T06:46:48.396 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:48.396 INFO:teuthology.orchestra.run.smithi144.stdout: "mempool": { 2024-09-21T06:46:48.396 INFO:teuthology.orchestra.run.smithi144.stdout: "bloom_filter_bytes": 0, 2024-09-21T06:46:48.396 INFO:teuthology.orchestra.run.smithi144.stdout: "bloom_filter_items": 0, 2024-09-21T06:46:48.396 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T06:46:48.396 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_alloc_items": 0, 2024-09-21T06:46:48.396 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T06:46:48.396 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_data_items": 0, 2024-09-21T06:46:48.396 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T06:46:48.396 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T06:46:48.396 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T06:46:48.397 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T06:46:48.397 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T06:46:48.397 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_other_items": 0, 2024-09-21T06:46:48.397 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T06:46:48.397 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T06:46:48.397 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_extent_bytes": 0, 2024-09-21T06:46:48.397 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_extent_items": 0, 2024-09-21T06:46:48.397 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_blob_bytes": 0, 2024-09-21T06:46:48.397 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_blob_items": 0, 2024-09-21T06:46:48.397 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T06:46:48.397 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T06:46:48.397 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T06:46:48.397 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T06:46:48.397 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T06:46:48.397 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_fsck_items": 0, 2024-09-21T06:46:48.398 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_txc_bytes": 0, 2024-09-21T06:46:48.398 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_txc_items": 0, 2024-09-21T06:46:48.398 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T06:46:48.398 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T06:46:48.398 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_bytes": 0, 2024-09-21T06:46:48.398 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_items": 0, 2024-09-21T06:46:48.398 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_bytes": 0, 2024-09-21T06:46:48.398 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_items": 0, 2024-09-21T06:46:48.398 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T06:46:48.398 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_reader_items": 0, 2024-09-21T06:46:48.398 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T06:46:48.398 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_writer_items": 0, 2024-09-21T06:46:48.398 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_anon_bytes": 189546, 2024-09-21T06:46:48.398 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_anon_items": 55, 2024-09-21T06:46:48.399 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_meta_bytes": 0, 2024-09-21T06:46:48.399 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_meta_items": 0, 2024-09-21T06:46:48.399 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_bytes": 0, 2024-09-21T06:46:48.399 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_items": 0, 2024-09-21T06:46:48.399 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_mapbl_bytes": 0, 2024-09-21T06:46:48.399 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_mapbl_items": 0, 2024-09-21T06:46:48.399 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_pglog_bytes": 0, 2024-09-21T06:46:48.399 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_pglog_items": 0, 2024-09-21T06:46:48.399 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_bytes": 7872, 2024-09-21T06:46:48.399 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_items": 174, 2024-09-21T06:46:48.399 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T06:46:48.399 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_mapping_items": 0, 2024-09-21T06:46:48.399 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap_bytes": 0, 2024-09-21T06:46:48.399 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap_items": 0, 2024-09-21T06:46:48.399 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_co_bytes": 91049, 2024-09-21T06:46:48.400 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_co_items": 705, 2024-09-21T06:46:48.400 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_1_bytes": 0, 2024-09-21T06:46:48.400 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_1_items": 0, 2024-09-21T06:46:48.400 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_2_bytes": 0, 2024-09-21T06:46:48.400 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_2_items": 0 2024-09-21T06:46:48.400 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:48.400 INFO:teuthology.orchestra.run.smithi144.stdout: "objecter": { 2024-09-21T06:46:48.400 INFO:teuthology.orchestra.run.smithi144.stdout: "op_active": 0, 2024-09-21T06:46:48.400 INFO:teuthology.orchestra.run.smithi144.stdout: "op_laggy": 0, 2024-09-21T06:46:48.400 INFO:teuthology.orchestra.run.smithi144.stdout: "op_send": 2286, 2024-09-21T06:46:48.400 INFO:teuthology.orchestra.run.smithi144.stdout: "op_send_bytes": 26, 2024-09-21T06:46:48.400 INFO:teuthology.orchestra.run.smithi144.stdout: "op_resend": 4, 2024-09-21T06:46:48.400 INFO:teuthology.orchestra.run.smithi144.stdout: "op_reply": 2286, 2024-09-21T06:46:48.400 INFO:teuthology.orchestra.run.smithi144.stdout: "op_latency": { 2024-09-21T06:46:48.400 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 2286, 2024-09-21T06:46:48.401 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 1.376976325, 2024-09-21T06:46:48.401 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000602351 2024-09-21T06:46:48.401 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:48.401 INFO:teuthology.orchestra.run.smithi144.stdout: "op_inflight": 0, 2024-09-21T06:46:48.401 INFO:teuthology.orchestra.run.smithi144.stdout: "oplen_avg": { 2024-09-21T06:46:48.401 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 2286, 2024-09-21T06:46:48.401 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 2287 2024-09-21T06:46:48.401 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:48.401 INFO:teuthology.orchestra.run.smithi144.stdout: "op": 2286, 2024-09-21T06:46:48.401 INFO:teuthology.orchestra.run.smithi144.stdout: "op_r": 2286, 2024-09-21T06:46:48.401 INFO:teuthology.orchestra.run.smithi144.stdout: "op_w": 0, 2024-09-21T06:46:48.401 INFO:teuthology.orchestra.run.smithi144.stdout: "op_rmw": 0, 2024-09-21T06:46:48.401 INFO:teuthology.orchestra.run.smithi144.stdout: "op_pg": 0, 2024-09-21T06:46:48.401 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_stat": 1457, 2024-09-21T06:46:48.401 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_create": 0, 2024-09-21T06:46:48.401 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_read": 826, 2024-09-21T06:46:48.402 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_write": 0, 2024-09-21T06:46:48.402 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_writefull": 0, 2024-09-21T06:46:48.402 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_writesame": 0, 2024-09-21T06:46:48.402 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_append": 0, 2024-09-21T06:46:48.402 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_zero": 0, 2024-09-21T06:46:48.402 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_truncate": 0, 2024-09-21T06:46:48.402 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_delete": 0, 2024-09-21T06:46:48.402 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_mapext": 0, 2024-09-21T06:46:48.402 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_sparse_read": 0, 2024-09-21T06:46:48.402 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_clonerange": 0, 2024-09-21T06:46:48.402 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_getxattr": 2, 2024-09-21T06:46:48.402 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_setxattr": 0, 2024-09-21T06:46:48.402 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_cmpxattr": 0, 2024-09-21T06:46:48.402 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_rmxattr": 0, 2024-09-21T06:46:48.402 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_resetxattrs": 0, 2024-09-21T06:46:48.403 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_call": 0, 2024-09-21T06:46:48.403 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_watch": 0, 2024-09-21T06:46:48.403 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_notify": 0, 2024-09-21T06:46:48.403 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T06:46:48.403 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_pgls": 0, 2024-09-21T06:46:48.403 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_pgls_filter": 0, 2024-09-21T06:46:48.403 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_other": 0, 2024-09-21T06:46:48.403 INFO:teuthology.orchestra.run.smithi144.stdout: "linger_active": 0, 2024-09-21T06:46:48.403 INFO:teuthology.orchestra.run.smithi144.stdout: "linger_send": 0, 2024-09-21T06:46:48.403 INFO:teuthology.orchestra.run.smithi144.stdout: "linger_resend": 0, 2024-09-21T06:46:48.403 INFO:teuthology.orchestra.run.smithi144.stdout: "linger_ping": 0, 2024-09-21T06:46:48.403 INFO:teuthology.orchestra.run.smithi144.stdout: "poolop_active": 0, 2024-09-21T06:46:48.403 INFO:teuthology.orchestra.run.smithi144.stdout: "poolop_send": 0, 2024-09-21T06:46:48.403 INFO:teuthology.orchestra.run.smithi144.stdout: "poolop_resend": 0, 2024-09-21T06:46:48.403 INFO:teuthology.orchestra.run.smithi144.stdout: "poolstat_active": 0, 2024-09-21T06:46:48.404 INFO:teuthology.orchestra.run.smithi144.stdout: "poolstat_send": 0, 2024-09-21T06:46:48.404 INFO:teuthology.orchestra.run.smithi144.stdout: "poolstat_resend": 0, 2024-09-21T06:46:48.404 INFO:teuthology.orchestra.run.smithi144.stdout: "statfs_active": 0, 2024-09-21T06:46:48.404 INFO:teuthology.orchestra.run.smithi144.stdout: "statfs_send": 0, 2024-09-21T06:46:48.404 INFO:teuthology.orchestra.run.smithi144.stdout: "statfs_resend": 0, 2024-09-21T06:46:48.404 INFO:teuthology.orchestra.run.smithi144.stdout: "command_active": 0, 2024-09-21T06:46:48.404 INFO:teuthology.orchestra.run.smithi144.stdout: "command_send": 0, 2024-09-21T06:46:48.404 INFO:teuthology.orchestra.run.smithi144.stdout: "command_resend": 0, 2024-09-21T06:46:48.404 INFO:teuthology.orchestra.run.smithi144.stdout: "map_epoch": 85, 2024-09-21T06:46:48.404 INFO:teuthology.orchestra.run.smithi144.stdout: "map_full": 0, 2024-09-21T06:46:48.404 INFO:teuthology.orchestra.run.smithi144.stdout: "map_inc": 10, 2024-09-21T06:46:48.404 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_sessions": 5, 2024-09-21T06:46:48.404 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_session_open": 5, 2024-09-21T06:46:48.404 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_session_close": 0, 2024-09-21T06:46:48.404 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_laggy": 0, 2024-09-21T06:46:48.405 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_wr": 0, 2024-09-21T06:46:48.405 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_rd": 2, 2024-09-21T06:46:48.405 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_del": 0 2024-09-21T06:46:48.405 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:48.405 INFO:teuthology.orchestra.run.smithi144.stdout: "oft": { 2024-09-21T06:46:48.405 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_total_objs": 0, 2024-09-21T06:46:48.405 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_total_kv_pairs": 0, 2024-09-21T06:46:48.405 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_total_updates": 0, 2024-09-21T06:46:48.405 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_total_removes": 0 2024-09-21T06:46:48.405 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:48.405 INFO:teuthology.orchestra.run.smithi144.stdout: "purge_queue": { 2024-09-21T06:46:48.405 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executing_ops": 0, 2024-09-21T06:46:48.405 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T06:46:48.405 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executing": 0, 2024-09-21T06:46:48.405 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executing_high_water": 0, 2024-09-21T06:46:48.406 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executed_ops": 0, 2024-09-21T06:46:48.406 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executed": 0, 2024-09-21T06:46:48.406 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_item_in_journal": 0 2024-09-21T06:46:48.406 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:48.406 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T06:46:48.406 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-21T06:46:48.406 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 104857600, 2024-09-21T06:46:48.406 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-21T06:46:48.406 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 2516, 2024-09-21T06:46:48.406 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 11717187, 2024-09-21T06:46:48.406 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-21T06:46:48.406 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 2516, 2024-09-21T06:46:48.406 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 0, 2024-09-21T06:46:48.406 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 0, 2024-09-21T06:46:48.406 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 2516, 2024-09-21T06:46:48.407 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 11717187, 2024-09-21T06:46:48.407 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-21T06:46:48.407 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:48.407 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:48.407 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:48.407 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-21T06:46:48.407 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:48.407 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-objecter_bytes": { 2024-09-21T06:46:48.407 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-21T06:46:48.407 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 104857600, 2024-09-21T06:46:48.407 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-21T06:46:48.407 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 0, 2024-09-21T06:46:48.407 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 0, 2024-09-21T06:46:48.407 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-21T06:46:48.407 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 0, 2024-09-21T06:46:48.408 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 2286, 2024-09-21T06:46:48.408 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 10450152, 2024-09-21T06:46:48.408 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 2286, 2024-09-21T06:46:48.408 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 10450152, 2024-09-21T06:46:48.408 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-21T06:46:48.408 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:48.408 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:48.408 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:48.408 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-21T06:46:48.408 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:48.408 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-objecter_ops": { 2024-09-21T06:46:48.408 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-21T06:46:48.408 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 1024, 2024-09-21T06:46:48.408 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-21T06:46:48.408 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 0, 2024-09-21T06:46:48.409 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 0, 2024-09-21T06:46:48.409 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-21T06:46:48.409 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 0, 2024-09-21T06:46:48.409 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 2286, 2024-09-21T06:46:48.409 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 2286, 2024-09-21T06:46:48.409 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 2286, 2024-09-21T06:46:48.409 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 2286, 2024-09-21T06:46:48.409 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-21T06:46:48.409 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:48.409 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:48.409 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:48.409 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-21T06:46:48.409 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:48.409 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-write_buf_throttle": { 2024-09-21T06:46:48.409 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-21T06:46:48.410 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 3758096384, 2024-09-21T06:46:48.410 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-21T06:46:48.410 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 0, 2024-09-21T06:46:48.410 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 0, 2024-09-21T06:46:48.410 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-21T06:46:48.410 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 0, 2024-09-21T06:46:48.410 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 0, 2024-09-21T06:46:48.410 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 0, 2024-09-21T06:46:48.410 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 0, 2024-09-21T06:46:48.410 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 0, 2024-09-21T06:46:48.410 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-21T06:46:48.410 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:48.410 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:48.410 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:48.410 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-21T06:46:48.411 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:48.411 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-write_buf_throttle-0x55a081999520": { 2024-09-21T06:46:48.411 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-21T06:46:48.411 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 3758096384, 2024-09-21T06:46:48.411 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-21T06:46:48.411 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 0, 2024-09-21T06:46:48.411 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 0, 2024-09-21T06:46:48.411 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-21T06:46:48.411 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 0, 2024-09-21T06:46:48.411 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 0, 2024-09-21T06:46:48.411 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 0, 2024-09-21T06:46:48.411 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 0, 2024-09-21T06:46:48.411 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 0, 2024-09-21T06:46:48.411 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-21T06:46:48.411 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:48.411 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:48.412 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:48.412 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-21T06:46:48.412 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:48.412 INFO:teuthology.orchestra.run.smithi144.stdout: "trackedop": { 2024-09-21T06:46:48.412 INFO:teuthology.orchestra.run.smithi144.stdout: "slow_ops_count": 0 2024-09-21T06:46:48.412 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-21T06:46:48.412 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-21T06:46:48.785 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:46:48 smithi144 ceph-mon[34653]: pgmap v645: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:46:49.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:46:48 smithi007 ceph-mon[30983]: pgmap v645: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:46:49.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:46:48 smithi018 ceph-mon[34477]: pgmap v645: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:46:49.312 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-09-21T06:46:49.313 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2024-09-21T06:46:49.313 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=0 2024-09-21T06:46:49.313 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=0 2024-09-21T06:46:49.313 INFO:tasks.check_counter:Daemon mds.c mds.root_rsnaps=6 2024-09-21T06:46:49.313 INFO:tasks.check_counter:Daemon mds.c mds_server.req_mksnap_latency.avgcount=0 2024-09-21T06:46:49.313 INFO:tasks.check_counter:Daemon mds.c mds_server.req_rmsnap_latency.avgcount=0 2024-09-21T06:46:49.313 DEBUG:tasks.check_counter:Getting stats from f 2024-09-21T06:46:49.313 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph daemon mds.f perf dump 2024-09-21T06:46:49.568 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:46:50.102 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-21T06:46:50.102 INFO:teuthology.orchestra.run.smithi144.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T06:46:50.103 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_messages": 965, 2024-09-21T06:46:50.103 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages": 958, 2024-09-21T06:46:50.103 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_bytes": 1110768, 2024-09-21T06:46:50.103 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_bytes": 364226, 2024-09-21T06:46:50.103 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_created_connections": 5, 2024-09-21T06:46:50.103 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_active_connections": 1, 2024-09-21T06:46:50.103 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_total_time": 0.163802721, 2024-09-21T06:46:50.103 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_send_time": 0.069371040, 2024-09-21T06:46:50.103 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_recv_time": 0.060080781, 2024-09-21T06:46:50.103 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_fast_dispatch_time": 0.034612709, 2024-09-21T06:46:50.103 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:46:50.103 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 957, 2024-09-21T06:46:50.103 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.056217323, 2024-09-21T06:46:50.103 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000058743 2024-09-21T06:46:50.103 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:50.104 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:46:50.104 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:50.104 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:50.104 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:50.104 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:50.104 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_encrypted_bytes": 863808, 2024-09-21T06:46:50.104 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_encrypted_bytes": 130496 2024-09-21T06:46:50.104 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:50.104 INFO:teuthology.orchestra.run.smithi144.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T06:46:50.104 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_messages": 3, 2024-09-21T06:46:50.104 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages": 160, 2024-09-21T06:46:50.104 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_bytes": 716, 2024-09-21T06:46:50.104 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_bytes": 360650, 2024-09-21T06:46:50.104 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_created_connections": 4, 2024-09-21T06:46:50.105 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_active_connections": 3, 2024-09-21T06:46:50.105 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_total_time": 0.012597326, 2024-09-21T06:46:50.105 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_send_time": 0.009319170, 2024-09-21T06:46:50.105 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_recv_time": 0.001604667, 2024-09-21T06:46:50.105 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_fast_dispatch_time": 0.000066931, 2024-09-21T06:46:50.105 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:46:50.105 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 158, 2024-09-21T06:46:50.105 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.009480231, 2024-09-21T06:46:50.105 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000060001 2024-09-21T06:46:50.105 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:50.105 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:46:50.105 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:50.105 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:50.106 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:50.106 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:50.106 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T06:46:50.106 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_encrypted_bytes": 359952 2024-09-21T06:46:50.106 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:50.106 INFO:teuthology.orchestra.run.smithi144.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T06:46:50.106 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_messages": 1382, 2024-09-21T06:46:50.106 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages": 1382, 2024-09-21T06:46:50.106 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_bytes": 356204, 2024-09-21T06:46:50.106 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_bytes": 438659, 2024-09-21T06:46:50.106 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_created_connections": 4, 2024-09-21T06:46:50.106 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_active_connections": 3, 2024-09-21T06:46:50.106 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_total_time": 0.128499202, 2024-09-21T06:46:50.106 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_send_time": 0.055382066, 2024-09-21T06:46:50.107 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_recv_time": 0.028318020, 2024-09-21T06:46:50.107 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_fast_dispatch_time": 0.037210376, 2024-09-21T06:46:50.107 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:46:50.107 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 1381, 2024-09-21T06:46:50.107 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.073416676, 2024-09-21T06:46:50.107 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000053161 2024-09-21T06:46:50.107 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:50.107 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:46:50.107 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:50.107 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:50.107 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:50.107 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:50.107 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-21T06:46:50.107 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T06:46:50.108 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:50.108 INFO:teuthology.orchestra.run.smithi144.stdout: "cct": { 2024-09-21T06:46:50.108 INFO:teuthology.orchestra.run.smithi144.stdout: "total_workers": 1, 2024-09-21T06:46:50.108 INFO:teuthology.orchestra.run.smithi144.stdout: "unhealthy_workers": 0 2024-09-21T06:46:50.108 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:50.108 INFO:teuthology.orchestra.run.smithi144.stdout: "finisher-MDSRank": { 2024-09-21T06:46:50.108 INFO:teuthology.orchestra.run.smithi144.stdout: "queue_len": 0, 2024-09-21T06:46:50.108 INFO:teuthology.orchestra.run.smithi144.stdout: "complete_latency": { 2024-09-21T06:46:50.108 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 3587, 2024-09-21T06:46:50.108 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.115292128, 2024-09-21T06:46:50.108 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000032141 2024-09-21T06:46:50.108 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-21T06:46:50.108 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:50.108 INFO:teuthology.orchestra.run.smithi144.stdout: "finisher-PurgeQueue": { 2024-09-21T06:46:50.108 INFO:teuthology.orchestra.run.smithi144.stdout: "queue_len": 0, 2024-09-21T06:46:50.109 INFO:teuthology.orchestra.run.smithi144.stdout: "complete_latency": { 2024-09-21T06:46:50.109 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:50.109 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:50.109 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:50.109 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-21T06:46:50.109 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:50.109 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": { 2024-09-21T06:46:50.109 INFO:teuthology.orchestra.run.smithi144.stdout: "request": 0, 2024-09-21T06:46:50.109 INFO:teuthology.orchestra.run.smithi144.stdout: "reply": 0, 2024-09-21T06:46:50.109 INFO:teuthology.orchestra.run.smithi144.stdout: "reply_latency": { 2024-09-21T06:46:50.109 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:50.109 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:50.109 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:50.109 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:50.109 INFO:teuthology.orchestra.run.smithi144.stdout: "slow_reply": 0, 2024-09-21T06:46:50.110 INFO:teuthology.orchestra.run.smithi144.stdout: "forward": 0, 2024-09-21T06:46:50.110 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_fetch_complete": 0, 2024-09-21T06:46:50.110 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_fetch_keys": 0, 2024-09-21T06:46:50.110 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_commit": 0, 2024-09-21T06:46:50.110 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_split": 0, 2024-09-21T06:46:50.110 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_merge": 0, 2024-09-21T06:46:50.110 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes": 0, 2024-09-21T06:46:50.110 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_top": 0, 2024-09-21T06:46:50.110 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_bottom": 0, 2024-09-21T06:46:50.110 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_pin_tail": 0, 2024-09-21T06:46:50.110 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_pinned": 0, 2024-09-21T06:46:50.110 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_expired": 0, 2024-09-21T06:46:50.110 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_with_caps": 0, 2024-09-21T06:46:50.110 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": 0, 2024-09-21T06:46:50.111 INFO:teuthology.orchestra.run.smithi144.stdout: "subtrees": 1, 2024-09-21T06:46:50.111 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse": 0, 2024-09-21T06:46:50.111 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_hit": 0, 2024-09-21T06:46:50.111 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_forward": 0, 2024-09-21T06:46:50.111 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_discover": 0, 2024-09-21T06:46:50.111 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_dir_fetch": 0, 2024-09-21T06:46:50.111 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_remote_ino": 0, 2024-09-21T06:46:50.111 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_lock": 0, 2024-09-21T06:46:50.111 INFO:teuthology.orchestra.run.smithi144.stdout: "load_cent": 0, 2024-09-21T06:46:50.111 INFO:teuthology.orchestra.run.smithi144.stdout: "q": 0, 2024-09-21T06:46:50.111 INFO:teuthology.orchestra.run.smithi144.stdout: "exported": 0, 2024-09-21T06:46:50.111 INFO:teuthology.orchestra.run.smithi144.stdout: "exported_inodes": 0, 2024-09-21T06:46:50.111 INFO:teuthology.orchestra.run.smithi144.stdout: "imported": 0, 2024-09-21T06:46:50.111 INFO:teuthology.orchestra.run.smithi144.stdout: "imported_inodes": 0, 2024-09-21T06:46:50.111 INFO:teuthology.orchestra.run.smithi144.stdout: "openino_dir_fetch": 0, 2024-09-21T06:46:50.112 INFO:teuthology.orchestra.run.smithi144.stdout: "openino_backtrace_fetch": 0, 2024-09-21T06:46:50.112 INFO:teuthology.orchestra.run.smithi144.stdout: "openino_peer_discover": 0, 2024-09-21T06:46:50.112 INFO:teuthology.orchestra.run.smithi144.stdout: "root_rfiles": 0, 2024-09-21T06:46:50.112 INFO:teuthology.orchestra.run.smithi144.stdout: "root_rbytes": 0, 2024-09-21T06:46:50.112 INFO:teuthology.orchestra.run.smithi144.stdout: "root_rsnaps": 0, 2024-09-21T06:46:50.112 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T06:46:50.112 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_set_tag": 0, 2024-09-21T06:46:50.112 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T06:46:50.112 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_inotable_repaired": 0, 2024-09-21T06:46:50.112 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_dir_inodes": 0, 2024-09-21T06:46:50.112 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T06:46:50.112 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T06:46:50.112 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_file_inodes": 0, 2024-09-21T06:46:50.112 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_inode_file_caps": 0, 2024-09-21T06:46:50.112 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T06:46:50.113 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_grant": 0, 2024-09-21T06:46:50.113 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T06:46:50.113 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T06:46:50.113 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T06:46:50.113 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_caps": 0, 2024-09-21T06:46:50.113 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_caps_dirty": 0, 2024-09-21T06:46:50.113 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_cap_release": 0, 2024-09-21T06:46:50.113 INFO:teuthology.orchestra.run.smithi144.stdout: "process_request_cap_release": 0 2024-09-21T06:46:50.113 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:50.113 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_cache": { 2024-09-21T06:46:50.113 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_update": 0, 2024-09-21T06:46:50.113 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_update_receipt": 0, 2024-09-21T06:46:50.113 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_try_discover": 0, 2024-09-21T06:46:50.113 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_send_discover": 0, 2024-09-21T06:46:50.113 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_handle_discover": 0, 2024-09-21T06:46:50.114 INFO:teuthology.orchestra.run.smithi144.stdout: "num_strays": 0, 2024-09-21T06:46:50.114 INFO:teuthology.orchestra.run.smithi144.stdout: "num_strays_delayed": 0, 2024-09-21T06:46:50.114 INFO:teuthology.orchestra.run.smithi144.stdout: "num_strays_enqueuing": 0, 2024-09-21T06:46:50.114 INFO:teuthology.orchestra.run.smithi144.stdout: "strays_created": 0, 2024-09-21T06:46:50.114 INFO:teuthology.orchestra.run.smithi144.stdout: "strays_enqueued": 0, 2024-09-21T06:46:50.114 INFO:teuthology.orchestra.run.smithi144.stdout: "strays_reintegrated": 0, 2024-09-21T06:46:50.114 INFO:teuthology.orchestra.run.smithi144.stdout: "strays_migrated": 0, 2024-09-21T06:46:50.114 INFO:teuthology.orchestra.run.smithi144.stdout: "num_recovering_processing": 0, 2024-09-21T06:46:50.114 INFO:teuthology.orchestra.run.smithi144.stdout: "num_recovering_enqueued": 0, 2024-09-21T06:46:50.114 INFO:teuthology.orchestra.run.smithi144.stdout: "num_recovering_prioritized": 0, 2024-09-21T06:46:50.114 INFO:teuthology.orchestra.run.smithi144.stdout: "recovery_started": 0, 2024-09-21T06:46:50.114 INFO:teuthology.orchestra.run.smithi144.stdout: "recovery_completed": 0, 2024-09-21T06:46:50.114 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_quiesce_path": 0, 2024-09-21T06:46:50.114 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_quiesce_inode": 0, 2024-09-21T06:46:50.114 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T06:46:50.115 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_exportdir": 0, 2024-09-21T06:46:50.115 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_flush": 0, 2024-09-21T06:46:50.115 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_fragmentdir": 0, 2024-09-21T06:46:50.115 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_fragstats": 0, 2024-09-21T06:46:50.115 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_inodestats": 0, 2024-09-21T06:46:50.115 INFO:teuthology.orchestra.run.smithi144.stdout: "uninline_started": 0, 2024-09-21T06:46:50.115 INFO:teuthology.orchestra.run.smithi144.stdout: "uninline_succeeded": 0, 2024-09-21T06:46:50.115 INFO:teuthology.orchestra.run.smithi144.stdout: "uninline_write_failed": 0 2024-09-21T06:46:50.115 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:50.115 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_log": { 2024-09-21T06:46:50.115 INFO:teuthology.orchestra.run.smithi144.stdout: "evlrg": 0, 2024-09-21T06:46:50.115 INFO:teuthology.orchestra.run.smithi144.stdout: "evadd": 0, 2024-09-21T06:46:50.115 INFO:teuthology.orchestra.run.smithi144.stdout: "evex": 0, 2024-09-21T06:46:50.115 INFO:teuthology.orchestra.run.smithi144.stdout: "evtrm": 0, 2024-09-21T06:46:50.115 INFO:teuthology.orchestra.run.smithi144.stdout: "ev": 6, 2024-09-21T06:46:50.116 INFO:teuthology.orchestra.run.smithi144.stdout: "evexg": 0, 2024-09-21T06:46:50.116 INFO:teuthology.orchestra.run.smithi144.stdout: "evexd": 0, 2024-09-21T06:46:50.116 INFO:teuthology.orchestra.run.smithi144.stdout: "segadd": 0, 2024-09-21T06:46:50.116 INFO:teuthology.orchestra.run.smithi144.stdout: "segex": 0, 2024-09-21T06:46:50.116 INFO:teuthology.orchestra.run.smithi144.stdout: "segtrm": 0, 2024-09-21T06:46:50.116 INFO:teuthology.orchestra.run.smithi144.stdout: "seg": 2, 2024-09-21T06:46:50.116 INFO:teuthology.orchestra.run.smithi144.stdout: "segmjr": 2, 2024-09-21T06:46:50.116 INFO:teuthology.orchestra.run.smithi144.stdout: "segexg": 0, 2024-09-21T06:46:50.116 INFO:teuthology.orchestra.run.smithi144.stdout: "segexd": 0, 2024-09-21T06:46:50.116 INFO:teuthology.orchestra.run.smithi144.stdout: "expos": 4194304, 2024-09-21T06:46:50.116 INFO:teuthology.orchestra.run.smithi144.stdout: "wrpos": 4196123, 2024-09-21T06:46:50.116 INFO:teuthology.orchestra.run.smithi144.stdout: "rdpos": 4195732, 2024-09-21T06:46:50.116 INFO:teuthology.orchestra.run.smithi144.stdout: "jlat": { 2024-09-21T06:46:50.116 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:50.116 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:50.117 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:50.117 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:50.117 INFO:teuthology.orchestra.run.smithi144.stdout: "replayed": 6 2024-09-21T06:46:50.117 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:50.117 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_mem": { 2024-09-21T06:46:50.117 INFO:teuthology.orchestra.run.smithi144.stdout: "ino": 3, 2024-09-21T06:46:50.117 INFO:teuthology.orchestra.run.smithi144.stdout: "ino+": 3, 2024-09-21T06:46:50.117 INFO:teuthology.orchestra.run.smithi144.stdout: "ino-": 0, 2024-09-21T06:46:50.117 INFO:teuthology.orchestra.run.smithi144.stdout: "dir": 1, 2024-09-21T06:46:50.117 INFO:teuthology.orchestra.run.smithi144.stdout: "dir+": 1, 2024-09-21T06:46:50.117 INFO:teuthology.orchestra.run.smithi144.stdout: "dir-": 0, 2024-09-21T06:46:50.117 INFO:teuthology.orchestra.run.smithi144.stdout: "dn": 0, 2024-09-21T06:46:50.117 INFO:teuthology.orchestra.run.smithi144.stdout: "dn+": 0, 2024-09-21T06:46:50.117 INFO:teuthology.orchestra.run.smithi144.stdout: "dn-": 0, 2024-09-21T06:46:50.117 INFO:teuthology.orchestra.run.smithi144.stdout: "cap": 0, 2024-09-21T06:46:50.117 INFO:teuthology.orchestra.run.smithi144.stdout: "cap+": 0, 2024-09-21T06:46:50.118 INFO:teuthology.orchestra.run.smithi144.stdout: "cap-": 0, 2024-09-21T06:46:50.118 INFO:teuthology.orchestra.run.smithi144.stdout: "rss": 116816, 2024-09-21T06:46:50.118 INFO:teuthology.orchestra.run.smithi144.stdout: "heap": 316420096 2024-09-21T06:46:50.118 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:50.118 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_server": { 2024-09-21T06:46:50.118 INFO:teuthology.orchestra.run.smithi144.stdout: "dispatch_client_request": 0, 2024-09-21T06:46:50.118 INFO:teuthology.orchestra.run.smithi144.stdout: "dispatch_server_request": 0, 2024-09-21T06:46:50.118 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_request": 0, 2024-09-21T06:46:50.118 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_session": 0, 2024-09-21T06:46:50.118 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_peer_request": 0, 2024-09-21T06:46:50.118 INFO:teuthology.orchestra.run.smithi144.stdout: "req_create_latency": { 2024-09-21T06:46:50.118 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:50.118 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:50.118 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:50.119 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:50.119 INFO:teuthology.orchestra.run.smithi144.stdout: "req_getattr_latency": { 2024-09-21T06:46:50.119 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:50.119 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:50.119 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:50.119 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:50.119 INFO:teuthology.orchestra.run.smithi144.stdout: "req_getfilelock_latency": { 2024-09-21T06:46:50.119 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:50.119 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:50.119 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:50.119 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:50.119 INFO:teuthology.orchestra.run.smithi144.stdout: "req_link_latency": { 2024-09-21T06:46:50.119 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:50.119 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:50.119 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:50.120 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:50.120 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookup_latency": { 2024-09-21T06:46:50.120 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:50.120 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:50.120 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:50.120 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:50.120 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookuphash_latency": { 2024-09-21T06:46:50.120 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:50.120 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:50.120 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:50.120 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:50.120 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookupino_latency": { 2024-09-21T06:46:50.120 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:50.120 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:50.120 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:50.121 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:50.121 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookupname_latency": { 2024-09-21T06:46:50.121 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:50.121 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:50.121 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:50.121 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:50.121 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookupparent_latency": { 2024-09-21T06:46:50.121 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:50.121 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:50.121 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:50.121 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:50.121 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookupsnap_latency": { 2024-09-21T06:46:50.121 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:50.121 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:50.121 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:50.122 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:50.122 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lssnap_latency": { 2024-09-21T06:46:50.122 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:50.122 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:50.122 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:50.122 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:50.123 INFO:teuthology.orchestra.run.smithi144.stdout: "req_mkdir_latency": { 2024-09-21T06:46:50.123 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:50.123 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:50.123 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:50.123 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:50.123 INFO:teuthology.orchestra.run.smithi144.stdout: "req_mknod_latency": { 2024-09-21T06:46:50.123 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:50.123 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:50.123 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:50.123 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:50.123 INFO:teuthology.orchestra.run.smithi144.stdout: "req_mksnap_latency": { 2024-09-21T06:46:50.123 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:50.123 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:50.123 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:50.124 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:50.124 INFO:teuthology.orchestra.run.smithi144.stdout: "req_open_latency": { 2024-09-21T06:46:50.124 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:50.124 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:50.124 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:50.124 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:50.124 INFO:teuthology.orchestra.run.smithi144.stdout: "req_readdir_latency": { 2024-09-21T06:46:50.124 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:50.124 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:50.124 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:50.124 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:50.124 INFO:teuthology.orchestra.run.smithi144.stdout: "req_rename_latency": { 2024-09-21T06:46:50.124 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:50.125 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:50.125 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:50.125 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:50.125 INFO:teuthology.orchestra.run.smithi144.stdout: "req_renamesnap_latency": { 2024-09-21T06:46:50.125 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:50.125 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:50.125 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:50.125 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:50.125 INFO:teuthology.orchestra.run.smithi144.stdout: "req_snapdiff_latency": { 2024-09-21T06:46:50.125 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:50.125 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:50.125 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:50.125 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:50.125 INFO:teuthology.orchestra.run.smithi144.stdout: "req_rmdir_latency": { 2024-09-21T06:46:50.125 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:50.125 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:50.126 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:50.126 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:50.126 INFO:teuthology.orchestra.run.smithi144.stdout: "req_rmsnap_latency": { 2024-09-21T06:46:50.126 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:50.126 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:50.126 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:50.126 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:50.126 INFO:teuthology.orchestra.run.smithi144.stdout: "req_rmxattr_latency": { 2024-09-21T06:46:50.126 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:50.126 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:50.126 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:50.126 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:50.126 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setattr_latency": { 2024-09-21T06:46:50.126 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:50.126 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:50.127 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:50.127 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:50.127 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setdirlayout_latency": { 2024-09-21T06:46:50.127 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:50.127 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:50.127 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:50.127 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:50.127 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setfilelock_latency": { 2024-09-21T06:46:50.127 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:50.127 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:50.127 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:50.127 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:50.127 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setlayout_latency": { 2024-09-21T06:46:50.127 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:50.127 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:50.128 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:50.128 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:50.128 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setxattr_latency": { 2024-09-21T06:46:50.128 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:50.128 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:50.128 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:50.128 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:50.128 INFO:teuthology.orchestra.run.smithi144.stdout: "req_symlink_latency": { 2024-09-21T06:46:50.128 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:50.128 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:50.128 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:50.128 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:50.128 INFO:teuthology.orchestra.run.smithi144.stdout: "req_unlink_latency": { 2024-09-21T06:46:50.128 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:50.129 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:50.129 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:50.129 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:50.129 INFO:teuthology.orchestra.run.smithi144.stdout: "cap_revoke_eviction": 0, 2024-09-21T06:46:50.129 INFO:teuthology.orchestra.run.smithi144.stdout: "cap_acquisition_throttle": 0, 2024-09-21T06:46:50.129 INFO:teuthology.orchestra.run.smithi144.stdout: "req_getvxattr_latency": { 2024-09-21T06:46:50.129 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:50.129 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:50.129 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:50.129 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-21T06:46:50.129 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:50.129 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_sessions": { 2024-09-21T06:46:50.129 INFO:teuthology.orchestra.run.smithi144.stdout: "session_count": 2, 2024-09-21T06:46:50.129 INFO:teuthology.orchestra.run.smithi144.stdout: "session_add": 3, 2024-09-21T06:46:50.130 INFO:teuthology.orchestra.run.smithi144.stdout: "session_remove": 1, 2024-09-21T06:46:50.130 INFO:teuthology.orchestra.run.smithi144.stdout: "sessions_open": 2, 2024-09-21T06:46:50.130 INFO:teuthology.orchestra.run.smithi144.stdout: "sessions_stale": 0, 2024-09-21T06:46:50.130 INFO:teuthology.orchestra.run.smithi144.stdout: "total_load": 0, 2024-09-21T06:46:50.130 INFO:teuthology.orchestra.run.smithi144.stdout: "average_load": 0, 2024-09-21T06:46:50.130 INFO:teuthology.orchestra.run.smithi144.stdout: "avg_session_uptime": 1951, 2024-09-21T06:46:50.130 INFO:teuthology.orchestra.run.smithi144.stdout: "mdthresh_evicted": 0 2024-09-21T06:46:50.130 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:50.130 INFO:teuthology.orchestra.run.smithi144.stdout: "mempool": { 2024-09-21T06:46:50.130 INFO:teuthology.orchestra.run.smithi144.stdout: "bloom_filter_bytes": 0, 2024-09-21T06:46:50.130 INFO:teuthology.orchestra.run.smithi144.stdout: "bloom_filter_items": 0, 2024-09-21T06:46:50.130 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T06:46:50.130 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_alloc_items": 0, 2024-09-21T06:46:50.130 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T06:46:50.131 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_data_items": 0, 2024-09-21T06:46:50.131 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T06:46:50.131 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T06:46:50.131 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T06:46:50.131 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T06:46:50.131 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T06:46:50.131 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_other_items": 0, 2024-09-21T06:46:50.131 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T06:46:50.131 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T06:46:50.131 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_extent_bytes": 0, 2024-09-21T06:46:50.131 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_extent_items": 0, 2024-09-21T06:46:50.131 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_blob_bytes": 0, 2024-09-21T06:46:50.131 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_blob_items": 0, 2024-09-21T06:46:50.131 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T06:46:50.131 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T06:46:50.132 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T06:46:50.132 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T06:46:50.132 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T06:46:50.132 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_fsck_items": 0, 2024-09-21T06:46:50.132 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_txc_bytes": 0, 2024-09-21T06:46:50.132 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_txc_items": 0, 2024-09-21T06:46:50.132 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T06:46:50.132 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T06:46:50.132 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_bytes": 0, 2024-09-21T06:46:50.132 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_items": 0, 2024-09-21T06:46:50.132 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_bytes": 0, 2024-09-21T06:46:50.132 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_items": 0, 2024-09-21T06:46:50.132 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T06:46:50.132 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_reader_items": 0, 2024-09-21T06:46:50.132 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T06:46:50.133 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_writer_items": 0, 2024-09-21T06:46:50.133 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_anon_bytes": 181303, 2024-09-21T06:46:50.133 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_anon_items": 46, 2024-09-21T06:46:50.133 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_meta_bytes": 0, 2024-09-21T06:46:50.133 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_meta_items": 0, 2024-09-21T06:46:50.133 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_bytes": 0, 2024-09-21T06:46:50.133 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_items": 0, 2024-09-21T06:46:50.133 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_mapbl_bytes": 0, 2024-09-21T06:46:50.133 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_mapbl_items": 0, 2024-09-21T06:46:50.133 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_pglog_bytes": 0, 2024-09-21T06:46:50.133 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_pglog_items": 0, 2024-09-21T06:46:50.133 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_bytes": 7872, 2024-09-21T06:46:50.133 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_items": 174, 2024-09-21T06:46:50.133 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T06:46:50.133 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_mapping_items": 0, 2024-09-21T06:46:50.134 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap_bytes": 0, 2024-09-21T06:46:50.134 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap_items": 0, 2024-09-21T06:46:50.134 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_co_bytes": 8672, 2024-09-21T06:46:50.134 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_co_items": 13, 2024-09-21T06:46:50.134 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_1_bytes": 0, 2024-09-21T06:46:50.134 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_1_items": 0, 2024-09-21T06:46:50.134 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_2_bytes": 0, 2024-09-21T06:46:50.134 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_2_items": 0 2024-09-21T06:46:50.134 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:50.134 INFO:teuthology.orchestra.run.smithi144.stdout: "objecter": { 2024-09-21T06:46:50.134 INFO:teuthology.orchestra.run.smithi144.stdout: "op_active": 0, 2024-09-21T06:46:50.134 INFO:teuthology.orchestra.run.smithi144.stdout: "op_laggy": 0, 2024-09-21T06:46:50.134 INFO:teuthology.orchestra.run.smithi144.stdout: "op_send": 2115, 2024-09-21T06:46:50.134 INFO:teuthology.orchestra.run.smithi144.stdout: "op_send_bytes": 21, 2024-09-21T06:46:50.134 INFO:teuthology.orchestra.run.smithi144.stdout: "op_resend": 3, 2024-09-21T06:46:50.135 INFO:teuthology.orchestra.run.smithi144.stdout: "op_reply": 2115, 2024-09-21T06:46:50.135 INFO:teuthology.orchestra.run.smithi144.stdout: "op_latency": { 2024-09-21T06:46:50.135 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 2115, 2024-09-21T06:46:50.135 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 1.214979121, 2024-09-21T06:46:50.135 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000574458 2024-09-21T06:46:50.135 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:50.135 INFO:teuthology.orchestra.run.smithi144.stdout: "op_inflight": 0, 2024-09-21T06:46:50.135 INFO:teuthology.orchestra.run.smithi144.stdout: "oplen_avg": { 2024-09-21T06:46:50.135 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 2115, 2024-09-21T06:46:50.135 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 2116 2024-09-21T06:46:50.135 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:50.135 INFO:teuthology.orchestra.run.smithi144.stdout: "op": 2115, 2024-09-21T06:46:50.135 INFO:teuthology.orchestra.run.smithi144.stdout: "op_r": 2115, 2024-09-21T06:46:50.135 INFO:teuthology.orchestra.run.smithi144.stdout: "op_w": 0, 2024-09-21T06:46:50.135 INFO:teuthology.orchestra.run.smithi144.stdout: "op_rmw": 0, 2024-09-21T06:46:50.136 INFO:teuthology.orchestra.run.smithi144.stdout: "op_pg": 0, 2024-09-21T06:46:50.136 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_stat": 1370, 2024-09-21T06:46:50.136 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_create": 0, 2024-09-21T06:46:50.136 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_read": 743, 2024-09-21T06:46:50.136 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_write": 0, 2024-09-21T06:46:50.136 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_writefull": 0, 2024-09-21T06:46:50.136 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_writesame": 0, 2024-09-21T06:46:50.136 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_append": 0, 2024-09-21T06:46:50.136 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_zero": 0, 2024-09-21T06:46:50.136 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_truncate": 0, 2024-09-21T06:46:50.136 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_delete": 0, 2024-09-21T06:46:50.136 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_mapext": 0, 2024-09-21T06:46:50.136 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_sparse_read": 0, 2024-09-21T06:46:50.136 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_clonerange": 0, 2024-09-21T06:46:50.136 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_getxattr": 1, 2024-09-21T06:46:50.137 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_setxattr": 0, 2024-09-21T06:46:50.137 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_cmpxattr": 0, 2024-09-21T06:46:50.137 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_rmxattr": 0, 2024-09-21T06:46:50.137 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_resetxattrs": 0, 2024-09-21T06:46:50.137 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_call": 0, 2024-09-21T06:46:50.137 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_watch": 0, 2024-09-21T06:46:50.137 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_notify": 0, 2024-09-21T06:46:50.137 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T06:46:50.137 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_pgls": 0, 2024-09-21T06:46:50.137 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_pgls_filter": 0, 2024-09-21T06:46:50.137 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_other": 0, 2024-09-21T06:46:50.137 INFO:teuthology.orchestra.run.smithi144.stdout: "linger_active": 0, 2024-09-21T06:46:50.137 INFO:teuthology.orchestra.run.smithi144.stdout: "linger_send": 0, 2024-09-21T06:46:50.137 INFO:teuthology.orchestra.run.smithi144.stdout: "linger_resend": 0, 2024-09-21T06:46:50.137 INFO:teuthology.orchestra.run.smithi144.stdout: "linger_ping": 0, 2024-09-21T06:46:50.137 INFO:teuthology.orchestra.run.smithi144.stdout: "poolop_active": 0, 2024-09-21T06:46:50.138 INFO:teuthology.orchestra.run.smithi144.stdout: "poolop_send": 0, 2024-09-21T06:46:50.138 INFO:teuthology.orchestra.run.smithi144.stdout: "poolop_resend": 0, 2024-09-21T06:46:50.138 INFO:teuthology.orchestra.run.smithi144.stdout: "poolstat_active": 0, 2024-09-21T06:46:50.138 INFO:teuthology.orchestra.run.smithi144.stdout: "poolstat_send": 0, 2024-09-21T06:46:50.138 INFO:teuthology.orchestra.run.smithi144.stdout: "poolstat_resend": 0, 2024-09-21T06:46:50.138 INFO:teuthology.orchestra.run.smithi144.stdout: "statfs_active": 0, 2024-09-21T06:46:50.138 INFO:teuthology.orchestra.run.smithi144.stdout: "statfs_send": 0, 2024-09-21T06:46:50.138 INFO:teuthology.orchestra.run.smithi144.stdout: "statfs_resend": 0, 2024-09-21T06:46:50.138 INFO:teuthology.orchestra.run.smithi144.stdout: "command_active": 0, 2024-09-21T06:46:50.138 INFO:teuthology.orchestra.run.smithi144.stdout: "command_send": 0, 2024-09-21T06:46:50.138 INFO:teuthology.orchestra.run.smithi144.stdout: "command_resend": 0, 2024-09-21T06:46:50.138 INFO:teuthology.orchestra.run.smithi144.stdout: "map_epoch": 85, 2024-09-21T06:46:50.138 INFO:teuthology.orchestra.run.smithi144.stdout: "map_full": 0, 2024-09-21T06:46:50.139 INFO:teuthology.orchestra.run.smithi144.stdout: "map_inc": 10, 2024-09-21T06:46:50.139 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_sessions": 4, 2024-09-21T06:46:50.139 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_session_open": 4, 2024-09-21T06:46:50.139 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_session_close": 0, 2024-09-21T06:46:50.139 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_laggy": 0, 2024-09-21T06:46:50.139 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_wr": 0, 2024-09-21T06:46:50.139 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_rd": 2, 2024-09-21T06:46:50.139 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_del": 0 2024-09-21T06:46:50.139 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:50.139 INFO:teuthology.orchestra.run.smithi144.stdout: "oft": { 2024-09-21T06:46:50.139 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_total_objs": 0, 2024-09-21T06:46:50.139 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_total_kv_pairs": 0, 2024-09-21T06:46:50.139 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_total_updates": 0, 2024-09-21T06:46:50.139 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_total_removes": 0 2024-09-21T06:46:50.139 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:50.140 INFO:teuthology.orchestra.run.smithi144.stdout: "purge_queue": { 2024-09-21T06:46:50.140 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executing_ops": 0, 2024-09-21T06:46:50.140 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T06:46:50.140 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executing": 0, 2024-09-21T06:46:50.140 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executing_high_water": 0, 2024-09-21T06:46:50.140 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executed_ops": 0, 2024-09-21T06:46:50.140 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executed": 0, 2024-09-21T06:46:50.140 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_item_in_journal": 0 2024-09-21T06:46:50.140 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:50.140 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T06:46:50.140 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-21T06:46:50.140 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 104857600, 2024-09-21T06:46:50.140 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-21T06:46:50.140 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 2346, 2024-09-21T06:46:50.140 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 1241773, 2024-09-21T06:46:50.141 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-21T06:46:50.141 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 2346, 2024-09-21T06:46:50.141 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 0, 2024-09-21T06:46:50.141 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 0, 2024-09-21T06:46:50.141 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 2346, 2024-09-21T06:46:50.141 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 1241773, 2024-09-21T06:46:50.141 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-21T06:46:50.141 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:50.141 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:50.141 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:50.141 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-21T06:46:50.141 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:50.141 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-objecter_bytes": { 2024-09-21T06:46:50.141 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-21T06:46:50.141 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 104857600, 2024-09-21T06:46:50.142 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-21T06:46:50.142 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 0, 2024-09-21T06:46:50.142 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 0, 2024-09-21T06:46:50.142 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-21T06:46:50.142 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 0, 2024-09-21T06:46:50.142 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 2115, 2024-09-21T06:46:50.142 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 1824, 2024-09-21T06:46:50.142 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 2115, 2024-09-21T06:46:50.142 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 1824, 2024-09-21T06:46:50.142 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-21T06:46:50.142 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:50.142 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:50.142 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:50.142 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-21T06:46:50.142 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:50.143 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-objecter_ops": { 2024-09-21T06:46:50.143 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-21T06:46:50.143 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 1024, 2024-09-21T06:46:50.143 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-21T06:46:50.143 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 0, 2024-09-21T06:46:50.143 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 0, 2024-09-21T06:46:50.143 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-21T06:46:50.143 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 0, 2024-09-21T06:46:50.143 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 2115, 2024-09-21T06:46:50.143 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 2115, 2024-09-21T06:46:50.143 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 2115, 2024-09-21T06:46:50.143 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 2115, 2024-09-21T06:46:50.143 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-21T06:46:50.143 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:50.143 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:50.144 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:50.144 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-21T06:46:50.144 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:50.144 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-write_buf_throttle": { 2024-09-21T06:46:50.144 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-21T06:46:50.144 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 3758096384, 2024-09-21T06:46:50.144 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-21T06:46:50.144 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 0, 2024-09-21T06:46:50.144 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 0, 2024-09-21T06:46:50.144 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-21T06:46:50.144 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 0, 2024-09-21T06:46:50.144 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 0, 2024-09-21T06:46:50.144 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 0, 2024-09-21T06:46:50.144 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 0, 2024-09-21T06:46:50.145 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 0, 2024-09-21T06:46:50.145 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-21T06:46:50.145 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:50.145 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:50.145 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:50.145 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-21T06:46:50.145 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:50.145 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-write_buf_throttle-0x55bf6a3df450": { 2024-09-21T06:46:50.145 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-21T06:46:50.145 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 3758096384, 2024-09-21T06:46:50.145 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-21T06:46:50.145 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 0, 2024-09-21T06:46:50.145 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 0, 2024-09-21T06:46:50.145 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-21T06:46:50.145 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 0, 2024-09-21T06:46:50.146 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 0, 2024-09-21T06:46:50.146 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 0, 2024-09-21T06:46:50.146 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 0, 2024-09-21T06:46:50.146 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 0, 2024-09-21T06:46:50.146 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-21T06:46:50.146 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:50.146 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:50.146 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:50.146 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-21T06:46:50.146 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:50.146 INFO:teuthology.orchestra.run.smithi144.stdout: "trackedop": { 2024-09-21T06:46:50.146 INFO:teuthology.orchestra.run.smithi144.stdout: "slow_ops_count": 0 2024-09-21T06:46:50.146 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-21T06:46:50.146 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-21T06:46:50.735 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:46:50 smithi144 ceph-mon[34653]: pgmap v646: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:46:50.763 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-09-21T06:46:50.763 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-09-21T06:46:50.763 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=0 2024-09-21T06:46:50.763 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=0 2024-09-21T06:46:50.763 INFO:tasks.check_counter:Daemon mds.f mds.root_rsnaps=0 2024-09-21T06:46:50.763 INFO:tasks.check_counter:Daemon mds.f mds_server.req_mksnap_latency.avgcount=0 2024-09-21T06:46:50.763 INFO:tasks.check_counter:Daemon mds.f mds_server.req_rmsnap_latency.avgcount=0 2024-09-21T06:46:50.763 DEBUG:tasks.check_counter:Getting stats from i 2024-09-21T06:46:50.764 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph daemon mds.i perf dump 2024-09-21T06:46:51.014 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:46:51.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:46:50 smithi007 ceph-mon[30983]: pgmap v646: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:46:51.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:46:50 smithi018 ceph-mon[34477]: pgmap v646: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:46:51.502 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-21T06:46:51.502 INFO:teuthology.orchestra.run.smithi144.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T06:46:51.502 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_messages": 480, 2024-09-21T06:46:51.502 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages": 601, 2024-09-21T06:46:51.502 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_bytes": 126887, 2024-09-21T06:46:51.502 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_bytes": 348404, 2024-09-21T06:46:51.502 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_created_connections": 11, 2024-09-21T06:46:51.502 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_active_connections": 4, 2024-09-21T06:46:51.502 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_total_time": 0.079887855, 2024-09-21T06:46:51.503 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_send_time": 0.035886286, 2024-09-21T06:46:51.503 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_recv_time": 0.033712774, 2024-09-21T06:46:51.503 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_fast_dispatch_time": 0.005204589, 2024-09-21T06:46:51.503 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:46:51.503 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 599, 2024-09-21T06:46:51.503 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.055297101, 2024-09-21T06:46:51.503 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000092315 2024-09-21T06:46:51.503 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:51.503 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:46:51.503 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 1028, 2024-09-21T06:46:51.503 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000286503, 2024-09-21T06:46:51.503 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000278 2024-09-21T06:46:51.503 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:51.503 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_encrypted_bytes": 1568, 2024-09-21T06:46:51.504 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_encrypted_bytes": 5152 2024-09-21T06:46:51.504 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:51.504 INFO:teuthology.orchestra.run.smithi144.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T06:46:51.504 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_messages": 70, 2024-09-21T06:46:51.504 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages": 252, 2024-09-21T06:46:51.504 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_bytes": 14395, 2024-09-21T06:46:51.504 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_bytes": 868383, 2024-09-21T06:46:51.504 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_created_connections": 50, 2024-09-21T06:46:51.504 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_active_connections": 6, 2024-09-21T06:46:51.504 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_total_time": 0.042387004, 2024-09-21T06:46:51.504 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_send_time": 0.014710908, 2024-09-21T06:46:51.504 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_recv_time": 0.024288403, 2024-09-21T06:46:51.504 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_fast_dispatch_time": 0.000297937, 2024-09-21T06:46:51.504 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:46:51.505 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 251, 2024-09-21T06:46:51.505 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.031479794, 2024-09-21T06:46:51.505 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000125417 2024-09-21T06:46:51.505 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:51.505 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:46:51.505 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 92, 2024-09-21T06:46:51.505 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000016323, 2024-09-21T06:46:51.505 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000177 2024-09-21T06:46:51.505 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:51.505 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_encrypted_bytes": 4080, 2024-09-21T06:46:51.505 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_encrypted_bytes": 362608 2024-09-21T06:46:51.505 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:51.505 INFO:teuthology.orchestra.run.smithi144.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T06:46:51.505 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_messages": 324, 2024-09-21T06:46:51.505 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages": 313, 2024-09-21T06:46:51.506 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_bytes": 898446, 2024-09-21T06:46:51.506 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_bytes": 211713, 2024-09-21T06:46:51.506 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_created_connections": 10, 2024-09-21T06:46:51.506 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_active_connections": 5, 2024-09-21T06:46:51.506 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_total_time": 0.052043229, 2024-09-21T06:46:51.506 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_send_time": 0.023365538, 2024-09-21T06:46:51.506 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_recv_time": 0.037827622, 2024-09-21T06:46:51.506 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_fast_dispatch_time": 0.000328113, 2024-09-21T06:46:51.506 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:46:51.506 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 312, 2024-09-21T06:46:51.506 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.024546435, 2024-09-21T06:46:51.506 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000078674 2024-09-21T06:46:51.506 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:51.506 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:46:51.507 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 100, 2024-09-21T06:46:51.507 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000024929, 2024-09-21T06:46:51.507 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000249 2024-09-21T06:46:51.507 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:51.507 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_encrypted_bytes": 877232, 2024-09-21T06:46:51.507 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_encrypted_bytes": 134016 2024-09-21T06:46:51.507 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:51.507 INFO:teuthology.orchestra.run.smithi144.stdout: "cct": { 2024-09-21T06:46:51.507 INFO:teuthology.orchestra.run.smithi144.stdout: "total_workers": 1, 2024-09-21T06:46:51.507 INFO:teuthology.orchestra.run.smithi144.stdout: "unhealthy_workers": 0 2024-09-21T06:46:51.507 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:51.507 INFO:teuthology.orchestra.run.smithi144.stdout: "finisher-MDSRank": { 2024-09-21T06:46:51.507 INFO:teuthology.orchestra.run.smithi144.stdout: "queue_len": 0, 2024-09-21T06:46:51.507 INFO:teuthology.orchestra.run.smithi144.stdout: "complete_latency": { 2024-09-21T06:46:51.507 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 54, 2024-09-21T06:46:51.508 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.001597960, 2024-09-21T06:46:51.508 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000029591 2024-09-21T06:46:51.508 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-21T06:46:51.508 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:51.508 INFO:teuthology.orchestra.run.smithi144.stdout: "finisher-PurgeQueue": { 2024-09-21T06:46:51.508 INFO:teuthology.orchestra.run.smithi144.stdout: "queue_len": 0, 2024-09-21T06:46:51.508 INFO:teuthology.orchestra.run.smithi144.stdout: "complete_latency": { 2024-09-21T06:46:51.508 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 2, 2024-09-21T06:46:51.508 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000033156, 2024-09-21T06:46:51.508 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000016578 2024-09-21T06:46:51.508 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-21T06:46:51.508 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:51.508 INFO:teuthology.orchestra.run.smithi144.stdout: "mds": { 2024-09-21T06:46:51.508 INFO:teuthology.orchestra.run.smithi144.stdout: "request": 2, 2024-09-21T06:46:51.509 INFO:teuthology.orchestra.run.smithi144.stdout: "reply": 2, 2024-09-21T06:46:51.509 INFO:teuthology.orchestra.run.smithi144.stdout: "reply_latency": { 2024-09-21T06:46:51.509 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 2, 2024-09-21T06:46:51.509 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000243419, 2024-09-21T06:46:51.509 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000121709 2024-09-21T06:46:51.509 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:51.509 INFO:teuthology.orchestra.run.smithi144.stdout: "slow_reply": 0, 2024-09-21T06:46:51.509 INFO:teuthology.orchestra.run.smithi144.stdout: "forward": 0, 2024-09-21T06:46:51.509 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_fetch_complete": 0, 2024-09-21T06:46:51.509 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_fetch_keys": 0, 2024-09-21T06:46:51.509 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_commit": 11, 2024-09-21T06:46:51.509 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_split": 0, 2024-09-21T06:46:51.509 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_merge": 0, 2024-09-21T06:46:51.509 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes": 14, 2024-09-21T06:46:51.510 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_top": 1, 2024-09-21T06:46:51.510 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_bottom": 13, 2024-09-21T06:46:51.510 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_pin_tail": 0, 2024-09-21T06:46:51.510 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_pinned": 13, 2024-09-21T06:46:51.510 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_expired": 0, 2024-09-21T06:46:51.510 INFO:teuthology.orchestra.run.smithi144.stdout: "inodes_with_caps": 2, 2024-09-21T06:46:51.510 INFO:teuthology.orchestra.run.smithi144.stdout: "caps": 2, 2024-09-21T06:46:51.510 INFO:teuthology.orchestra.run.smithi144.stdout: "subtrees": 2, 2024-09-21T06:46:51.510 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse": 5, 2024-09-21T06:46:51.510 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_hit": 3, 2024-09-21T06:46:51.510 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_forward": 0, 2024-09-21T06:46:51.510 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_discover": 2, 2024-09-21T06:46:51.510 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_dir_fetch": 0, 2024-09-21T06:46:51.510 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_remote_ino": 0, 2024-09-21T06:46:51.511 INFO:teuthology.orchestra.run.smithi144.stdout: "traverse_lock": 0, 2024-09-21T06:46:51.511 INFO:teuthology.orchestra.run.smithi144.stdout: "load_cent": 1000, 2024-09-21T06:46:51.511 INFO:teuthology.orchestra.run.smithi144.stdout: "q": 1, 2024-09-21T06:46:51.511 INFO:teuthology.orchestra.run.smithi144.stdout: "exported": 0, 2024-09-21T06:46:51.511 INFO:teuthology.orchestra.run.smithi144.stdout: "exported_inodes": 0, 2024-09-21T06:46:51.511 INFO:teuthology.orchestra.run.smithi144.stdout: "imported": 0, 2024-09-21T06:46:51.511 INFO:teuthology.orchestra.run.smithi144.stdout: "imported_inodes": 0, 2024-09-21T06:46:51.511 INFO:teuthology.orchestra.run.smithi144.stdout: "openino_dir_fetch": 0, 2024-09-21T06:46:51.511 INFO:teuthology.orchestra.run.smithi144.stdout: "openino_backtrace_fetch": 0, 2024-09-21T06:46:51.511 INFO:teuthology.orchestra.run.smithi144.stdout: "openino_peer_discover": 0, 2024-09-21T06:46:51.511 INFO:teuthology.orchestra.run.smithi144.stdout: "root_rfiles": 4, 2024-09-21T06:46:51.511 INFO:teuthology.orchestra.run.smithi144.stdout: "root_rbytes": 234, 2024-09-21T06:46:51.511 INFO:teuthology.orchestra.run.smithi144.stdout: "root_rsnaps": 6, 2024-09-21T06:46:51.511 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T06:46:51.511 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_set_tag": 0, 2024-09-21T06:46:51.512 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T06:46:51.512 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_inotable_repaired": 0, 2024-09-21T06:46:51.512 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_dir_inodes": 0, 2024-09-21T06:46:51.512 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T06:46:51.512 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T06:46:51.512 INFO:teuthology.orchestra.run.smithi144.stdout: "scrub_file_inodes": 0, 2024-09-21T06:46:51.512 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_inode_file_caps": 0, 2024-09-21T06:46:51.512 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T06:46:51.512 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_grant": 0, 2024-09-21T06:46:51.512 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T06:46:51.512 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T06:46:51.512 INFO:teuthology.orchestra.run.smithi144.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T06:46:51.512 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_caps": 0, 2024-09-21T06:46:51.512 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_caps_dirty": 0, 2024-09-21T06:46:51.512 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_cap_release": 0, 2024-09-21T06:46:51.513 INFO:teuthology.orchestra.run.smithi144.stdout: "process_request_cap_release": 0 2024-09-21T06:46:51.513 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:51.513 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_cache": { 2024-09-21T06:46:51.513 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_update": 0, 2024-09-21T06:46:51.513 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_update_receipt": 8, 2024-09-21T06:46:51.513 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_try_discover": 5, 2024-09-21T06:46:51.513 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_send_discover": 6, 2024-09-21T06:46:51.513 INFO:teuthology.orchestra.run.smithi144.stdout: "dir_handle_discover": 0, 2024-09-21T06:46:51.513 INFO:teuthology.orchestra.run.smithi144.stdout: "num_strays": 0, 2024-09-21T06:46:51.513 INFO:teuthology.orchestra.run.smithi144.stdout: "num_strays_delayed": 0, 2024-09-21T06:46:51.513 INFO:teuthology.orchestra.run.smithi144.stdout: "num_strays_enqueuing": 0, 2024-09-21T06:46:51.513 INFO:teuthology.orchestra.run.smithi144.stdout: "strays_created": 0, 2024-09-21T06:46:51.513 INFO:teuthology.orchestra.run.smithi144.stdout: "strays_enqueued": 0, 2024-09-21T06:46:51.513 INFO:teuthology.orchestra.run.smithi144.stdout: "strays_reintegrated": 0, 2024-09-21T06:46:51.514 INFO:teuthology.orchestra.run.smithi144.stdout: "strays_migrated": 0, 2024-09-21T06:46:51.514 INFO:teuthology.orchestra.run.smithi144.stdout: "num_recovering_processing": 0, 2024-09-21T06:46:51.514 INFO:teuthology.orchestra.run.smithi144.stdout: "num_recovering_enqueued": 0, 2024-09-21T06:46:51.514 INFO:teuthology.orchestra.run.smithi144.stdout: "num_recovering_prioritized": 0, 2024-09-21T06:46:51.514 INFO:teuthology.orchestra.run.smithi144.stdout: "recovery_started": 0, 2024-09-21T06:46:51.514 INFO:teuthology.orchestra.run.smithi144.stdout: "recovery_completed": 0, 2024-09-21T06:46:51.514 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_quiesce_path": 0, 2024-09-21T06:46:51.514 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_quiesce_inode": 0, 2024-09-21T06:46:51.514 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T06:46:51.514 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_exportdir": 0, 2024-09-21T06:46:51.515 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_flush": 0, 2024-09-21T06:46:51.515 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_fragmentdir": 0, 2024-09-21T06:46:51.515 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_fragstats": 0, 2024-09-21T06:46:51.515 INFO:teuthology.orchestra.run.smithi144.stdout: "ireq_inodestats": 0, 2024-09-21T06:46:51.515 INFO:teuthology.orchestra.run.smithi144.stdout: "uninline_started": 0, 2024-09-21T06:46:51.515 INFO:teuthology.orchestra.run.smithi144.stdout: "uninline_succeeded": 0, 2024-09-21T06:46:51.515 INFO:teuthology.orchestra.run.smithi144.stdout: "uninline_write_failed": 0 2024-09-21T06:46:51.515 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:51.515 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_log": { 2024-09-21T06:46:51.515 INFO:teuthology.orchestra.run.smithi144.stdout: "evlrg": 0, 2024-09-21T06:46:51.515 INFO:teuthology.orchestra.run.smithi144.stdout: "evadd": 6, 2024-09-21T06:46:51.515 INFO:teuthology.orchestra.run.smithi144.stdout: "evex": 0, 2024-09-21T06:46:51.515 INFO:teuthology.orchestra.run.smithi144.stdout: "evtrm": 0, 2024-09-21T06:46:51.515 INFO:teuthology.orchestra.run.smithi144.stdout: "ev": 6, 2024-09-21T06:46:51.516 INFO:teuthology.orchestra.run.smithi144.stdout: "evexg": 0, 2024-09-21T06:46:51.516 INFO:teuthology.orchestra.run.smithi144.stdout: "evexd": 0, 2024-09-21T06:46:51.516 INFO:teuthology.orchestra.run.smithi144.stdout: "segadd": 2, 2024-09-21T06:46:51.516 INFO:teuthology.orchestra.run.smithi144.stdout: "segex": 0, 2024-09-21T06:46:51.516 INFO:teuthology.orchestra.run.smithi144.stdout: "segtrm": 0, 2024-09-21T06:46:51.516 INFO:teuthology.orchestra.run.smithi144.stdout: "seg": 2, 2024-09-21T06:46:51.516 INFO:teuthology.orchestra.run.smithi144.stdout: "segmjr": 2, 2024-09-21T06:46:51.516 INFO:teuthology.orchestra.run.smithi144.stdout: "segexg": 0, 2024-09-21T06:46:51.516 INFO:teuthology.orchestra.run.smithi144.stdout: "segexd": 0, 2024-09-21T06:46:51.516 INFO:teuthology.orchestra.run.smithi144.stdout: "expos": 4194304, 2024-09-21T06:46:51.516 INFO:teuthology.orchestra.run.smithi144.stdout: "wrpos": 4196123, 2024-09-21T06:46:51.516 INFO:teuthology.orchestra.run.smithi144.stdout: "rdpos": 0, 2024-09-21T06:46:51.516 INFO:teuthology.orchestra.run.smithi144.stdout: "jlat": { 2024-09-21T06:46:51.516 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 5, 2024-09-21T06:46:51.516 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.009319913, 2024-09-21T06:46:51.517 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.001863982 2024-09-21T06:46:51.517 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:51.517 INFO:teuthology.orchestra.run.smithi144.stdout: "replayed": 0 2024-09-21T06:46:51.517 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:51.517 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_mem": { 2024-09-21T06:46:51.517 INFO:teuthology.orchestra.run.smithi144.stdout: "ino": 17, 2024-09-21T06:46:51.517 INFO:teuthology.orchestra.run.smithi144.stdout: "ino+": 17, 2024-09-21T06:46:51.517 INFO:teuthology.orchestra.run.smithi144.stdout: "ino-": 0, 2024-09-21T06:46:51.517 INFO:teuthology.orchestra.run.smithi144.stdout: "dir": 16, 2024-09-21T06:46:51.517 INFO:teuthology.orchestra.run.smithi144.stdout: "dir+": 18, 2024-09-21T06:46:51.517 INFO:teuthology.orchestra.run.smithi144.stdout: "dir-": 2, 2024-09-21T06:46:51.517 INFO:teuthology.orchestra.run.smithi144.stdout: "dn": 14, 2024-09-21T06:46:51.517 INFO:teuthology.orchestra.run.smithi144.stdout: "dn+": 14, 2024-09-21T06:46:51.517 INFO:teuthology.orchestra.run.smithi144.stdout: "dn-": 0, 2024-09-21T06:46:51.517 INFO:teuthology.orchestra.run.smithi144.stdout: "cap": 2, 2024-09-21T06:46:51.517 INFO:teuthology.orchestra.run.smithi144.stdout: "cap+": 2, 2024-09-21T06:46:51.518 INFO:teuthology.orchestra.run.smithi144.stdout: "cap-": 0, 2024-09-21T06:46:51.518 INFO:teuthology.orchestra.run.smithi144.stdout: "rss": 117920, 2024-09-21T06:46:51.518 INFO:teuthology.orchestra.run.smithi144.stdout: "heap": 325861376 2024-09-21T06:46:51.518 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:51.518 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_server": { 2024-09-21T06:46:51.518 INFO:teuthology.orchestra.run.smithi144.stdout: "dispatch_client_request": 2, 2024-09-21T06:46:51.518 INFO:teuthology.orchestra.run.smithi144.stdout: "dispatch_server_request": 0, 2024-09-21T06:46:51.518 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_request": 2, 2024-09-21T06:46:51.518 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_client_session": 21, 2024-09-21T06:46:51.518 INFO:teuthology.orchestra.run.smithi144.stdout: "handle_peer_request": 0, 2024-09-21T06:46:51.518 INFO:teuthology.orchestra.run.smithi144.stdout: "req_create_latency": { 2024-09-21T06:46:51.518 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:51.518 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:51.518 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:51.519 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:51.519 INFO:teuthology.orchestra.run.smithi144.stdout: "req_getattr_latency": { 2024-09-21T06:46:51.519 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:51.519 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:51.519 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:51.519 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:51.519 INFO:teuthology.orchestra.run.smithi144.stdout: "req_getfilelock_latency": { 2024-09-21T06:46:51.519 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:51.519 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:51.519 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:51.519 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:51.519 INFO:teuthology.orchestra.run.smithi144.stdout: "req_link_latency": { 2024-09-21T06:46:51.519 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:51.519 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:51.519 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:51.519 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:51.520 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookup_latency": { 2024-09-21T06:46:51.520 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:51.520 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:51.520 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:51.520 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:51.520 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookuphash_latency": { 2024-09-21T06:46:51.520 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:51.520 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:51.520 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:51.520 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:51.520 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookupino_latency": { 2024-09-21T06:46:51.520 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 2, 2024-09-21T06:46:51.520 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000243419, 2024-09-21T06:46:51.521 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000121709 2024-09-21T06:46:51.521 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:51.521 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookupname_latency": { 2024-09-21T06:46:51.521 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:51.521 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:51.521 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:51.521 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:51.521 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookupparent_latency": { 2024-09-21T06:46:51.521 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:51.521 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:51.521 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:51.521 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:51.522 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lookupsnap_latency": { 2024-09-21T06:46:51.522 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:51.522 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:51.522 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:51.522 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:51.522 INFO:teuthology.orchestra.run.smithi144.stdout: "req_lssnap_latency": { 2024-09-21T06:46:51.522 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:51.522 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:51.523 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:51.523 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:51.523 INFO:teuthology.orchestra.run.smithi144.stdout: "req_mkdir_latency": { 2024-09-21T06:46:51.523 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:51.523 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:51.523 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:51.523 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:51.523 INFO:teuthology.orchestra.run.smithi144.stdout: "req_mknod_latency": { 2024-09-21T06:46:51.523 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:51.524 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:51.524 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:51.524 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:51.524 INFO:teuthology.orchestra.run.smithi144.stdout: "req_mksnap_latency": { 2024-09-21T06:46:51.524 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:51.524 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:51.524 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:51.524 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:51.524 INFO:teuthology.orchestra.run.smithi144.stdout: "req_open_latency": { 2024-09-21T06:46:51.524 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:51.524 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:51.524 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:51.524 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:51.524 INFO:teuthology.orchestra.run.smithi144.stdout: "req_readdir_latency": { 2024-09-21T06:46:51.525 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:51.525 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:51.525 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:51.525 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:51.525 INFO:teuthology.orchestra.run.smithi144.stdout: "req_rename_latency": { 2024-09-21T06:46:51.525 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:51.525 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:51.525 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:51.525 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:51.525 INFO:teuthology.orchestra.run.smithi144.stdout: "req_renamesnap_latency": { 2024-09-21T06:46:51.525 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:51.525 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:51.525 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:51.525 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:51.526 INFO:teuthology.orchestra.run.smithi144.stdout: "req_snapdiff_latency": { 2024-09-21T06:46:51.526 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:51.526 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:51.526 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:51.526 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:51.526 INFO:teuthology.orchestra.run.smithi144.stdout: "req_rmdir_latency": { 2024-09-21T06:46:51.526 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:51.526 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:51.526 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:51.526 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:51.526 INFO:teuthology.orchestra.run.smithi144.stdout: "req_rmsnap_latency": { 2024-09-21T06:46:51.526 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:51.526 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:51.526 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:51.527 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:51.527 INFO:teuthology.orchestra.run.smithi144.stdout: "req_rmxattr_latency": { 2024-09-21T06:46:51.527 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:51.527 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:51.527 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:51.527 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:51.527 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setattr_latency": { 2024-09-21T06:46:51.527 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:51.527 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:51.527 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:51.527 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:51.527 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setdirlayout_latency": { 2024-09-21T06:46:51.527 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:51.527 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:51.527 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:51.528 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:51.528 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setfilelock_latency": { 2024-09-21T06:46:51.528 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:51.528 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:51.528 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:51.528 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:51.528 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setlayout_latency": { 2024-09-21T06:46:51.528 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:51.528 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:51.528 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:51.528 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:51.529 INFO:teuthology.orchestra.run.smithi144.stdout: "req_setxattr_latency": { 2024-09-21T06:46:51.529 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:51.529 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:51.529 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:51.529 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:51.529 INFO:teuthology.orchestra.run.smithi144.stdout: "req_symlink_latency": { 2024-09-21T06:46:51.529 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:51.529 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:51.529 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:51.529 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:51.529 INFO:teuthology.orchestra.run.smithi144.stdout: "req_unlink_latency": { 2024-09-21T06:46:51.529 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:51.529 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:51.529 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:51.529 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:51.530 INFO:teuthology.orchestra.run.smithi144.stdout: "cap_revoke_eviction": 0, 2024-09-21T06:46:51.530 INFO:teuthology.orchestra.run.smithi144.stdout: "cap_acquisition_throttle": 0, 2024-09-21T06:46:51.530 INFO:teuthology.orchestra.run.smithi144.stdout: "req_getvxattr_latency": { 2024-09-21T06:46:51.530 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:51.530 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:51.530 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:51.530 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-21T06:46:51.530 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:51.530 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_sessions": { 2024-09-21T06:46:51.530 INFO:teuthology.orchestra.run.smithi144.stdout: "session_count": 2, 2024-09-21T06:46:51.530 INFO:teuthology.orchestra.run.smithi144.stdout: "session_add": 3, 2024-09-21T06:46:51.530 INFO:teuthology.orchestra.run.smithi144.stdout: "session_remove": 1, 2024-09-21T06:46:51.530 INFO:teuthology.orchestra.run.smithi144.stdout: "sessions_open": 2, 2024-09-21T06:46:51.531 INFO:teuthology.orchestra.run.smithi144.stdout: "sessions_stale": 0, 2024-09-21T06:46:51.531 INFO:teuthology.orchestra.run.smithi144.stdout: "total_load": 1, 2024-09-21T06:46:51.531 INFO:teuthology.orchestra.run.smithi144.stdout: "average_load": 1, 2024-09-21T06:46:51.531 INFO:teuthology.orchestra.run.smithi144.stdout: "avg_session_uptime": 610, 2024-09-21T06:46:51.531 INFO:teuthology.orchestra.run.smithi144.stdout: "mdthresh_evicted": 0 2024-09-21T06:46:51.531 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:51.531 INFO:teuthology.orchestra.run.smithi144.stdout: "mempool": { 2024-09-21T06:46:51.531 INFO:teuthology.orchestra.run.smithi144.stdout: "bloom_filter_bytes": 0, 2024-09-21T06:46:51.531 INFO:teuthology.orchestra.run.smithi144.stdout: "bloom_filter_items": 0, 2024-09-21T06:46:51.531 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T06:46:51.531 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_alloc_items": 0, 2024-09-21T06:46:51.531 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T06:46:51.532 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_data_items": 0, 2024-09-21T06:46:51.532 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T06:46:51.532 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T06:46:51.532 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T06:46:51.532 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T06:46:51.532 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T06:46:51.532 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_other_items": 0, 2024-09-21T06:46:51.532 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T06:46:51.532 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T06:46:51.532 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_extent_bytes": 0, 2024-09-21T06:46:51.532 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_extent_items": 0, 2024-09-21T06:46:51.532 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_blob_bytes": 0, 2024-09-21T06:46:51.533 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_blob_items": 0, 2024-09-21T06:46:51.533 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T06:46:51.533 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T06:46:51.533 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T06:46:51.533 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T06:46:51.533 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T06:46:51.533 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_fsck_items": 0, 2024-09-21T06:46:51.533 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_txc_bytes": 0, 2024-09-21T06:46:51.533 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_txc_items": 0, 2024-09-21T06:46:51.533 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T06:46:51.533 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T06:46:51.533 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_bytes": 0, 2024-09-21T06:46:51.533 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_items": 0, 2024-09-21T06:46:51.533 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_bytes": 0, 2024-09-21T06:46:51.533 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_items": 0, 2024-09-21T06:46:51.533 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T06:46:51.534 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_reader_items": 0, 2024-09-21T06:46:51.534 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T06:46:51.534 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_writer_items": 0, 2024-09-21T06:46:51.534 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_anon_bytes": 278735, 2024-09-21T06:46:51.534 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_anon_items": 93, 2024-09-21T06:46:51.534 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_meta_bytes": 0, 2024-09-21T06:46:51.534 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_meta_items": 0, 2024-09-21T06:46:51.534 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_bytes": 0, 2024-09-21T06:46:51.534 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_items": 0, 2024-09-21T06:46:51.534 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_mapbl_bytes": 0, 2024-09-21T06:46:51.534 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_mapbl_items": 0, 2024-09-21T06:46:51.534 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_pglog_bytes": 0, 2024-09-21T06:46:51.534 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_pglog_items": 0, 2024-09-21T06:46:51.535 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_bytes": 7872, 2024-09-21T06:46:51.535 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_items": 174, 2024-09-21T06:46:51.535 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T06:46:51.535 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_mapping_items": 0, 2024-09-21T06:46:51.535 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap_bytes": 0, 2024-09-21T06:46:51.535 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap_items": 0, 2024-09-21T06:46:51.535 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_co_bytes": 70056, 2024-09-21T06:46:51.535 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_co_items": 256, 2024-09-21T06:46:51.535 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_1_bytes": 0, 2024-09-21T06:46:51.535 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_1_items": 0, 2024-09-21T06:46:51.535 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_2_bytes": 0, 2024-09-21T06:46:51.535 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_2_items": 0 2024-09-21T06:46:51.535 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:51.536 INFO:teuthology.orchestra.run.smithi144.stdout: "objecter": { 2024-09-21T06:46:51.536 INFO:teuthology.orchestra.run.smithi144.stdout: "op_active": 0, 2024-09-21T06:46:51.536 INFO:teuthology.orchestra.run.smithi144.stdout: "op_laggy": 0, 2024-09-21T06:46:51.536 INFO:teuthology.orchestra.run.smithi144.stdout: "op_send": 42, 2024-09-21T06:46:51.536 INFO:teuthology.orchestra.run.smithi144.stdout: "op_send_bytes": 12332, 2024-09-21T06:46:51.536 INFO:teuthology.orchestra.run.smithi144.stdout: "op_resend": 33, 2024-09-21T06:46:51.536 INFO:teuthology.orchestra.run.smithi144.stdout: "op_reply": 42, 2024-09-21T06:46:51.536 INFO:teuthology.orchestra.run.smithi144.stdout: "op_latency": { 2024-09-21T06:46:51.536 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 42, 2024-09-21T06:46:51.536 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.248995750, 2024-09-21T06:46:51.536 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.005928470 2024-09-21T06:46:51.536 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:51.536 INFO:teuthology.orchestra.run.smithi144.stdout: "op_inflight": 0, 2024-09-21T06:46:51.536 INFO:teuthology.orchestra.run.smithi144.stdout: "oplen_avg": { 2024-09-21T06:46:51.537 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 42, 2024-09-21T06:46:51.537 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 65 2024-09-21T06:46:51.537 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:51.537 INFO:teuthology.orchestra.run.smithi144.stdout: "op": 42, 2024-09-21T06:46:51.537 INFO:teuthology.orchestra.run.smithi144.stdout: "op_r": 0, 2024-09-21T06:46:51.537 INFO:teuthology.orchestra.run.smithi144.stdout: "op_w": 42, 2024-09-21T06:46:51.537 INFO:teuthology.orchestra.run.smithi144.stdout: "op_rmw": 0, 2024-09-21T06:46:51.537 INFO:teuthology.orchestra.run.smithi144.stdout: "op_pg": 0, 2024-09-21T06:46:51.537 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_stat": 0, 2024-09-21T06:46:51.537 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_create": 10, 2024-09-21T06:46:51.538 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_read": 0, 2024-09-21T06:46:51.538 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_write": 5, 2024-09-21T06:46:51.538 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_writefull": 7, 2024-09-21T06:46:51.538 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_writesame": 0, 2024-09-21T06:46:51.538 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_append": 0, 2024-09-21T06:46:51.538 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_zero": 0, 2024-09-21T06:46:51.538 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_truncate": 0, 2024-09-21T06:46:51.538 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_delete": 6, 2024-09-21T06:46:51.539 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_mapext": 0, 2024-09-21T06:46:51.539 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_sparse_read": 0, 2024-09-21T06:46:51.539 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_clonerange": 0, 2024-09-21T06:46:51.539 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_getxattr": 0, 2024-09-21T06:46:51.539 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_setxattr": 20, 2024-09-21T06:46:51.539 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_cmpxattr": 0, 2024-09-21T06:46:51.539 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_rmxattr": 0, 2024-09-21T06:46:51.540 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_resetxattrs": 0, 2024-09-21T06:46:51.540 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_call": 0, 2024-09-21T06:46:51.540 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_watch": 0, 2024-09-21T06:46:51.540 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_notify": 0, 2024-09-21T06:46:51.540 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T06:46:51.540 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_pgls": 0, 2024-09-21T06:46:51.540 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_pgls_filter": 0, 2024-09-21T06:46:51.540 INFO:teuthology.orchestra.run.smithi144.stdout: "osdop_other": 0, 2024-09-21T06:46:51.541 INFO:teuthology.orchestra.run.smithi144.stdout: "linger_active": 0, 2024-09-21T06:46:51.541 INFO:teuthology.orchestra.run.smithi144.stdout: "linger_send": 0, 2024-09-21T06:46:51.541 INFO:teuthology.orchestra.run.smithi144.stdout: "linger_resend": 0, 2024-09-21T06:46:51.541 INFO:teuthology.orchestra.run.smithi144.stdout: "linger_ping": 0, 2024-09-21T06:46:51.541 INFO:teuthology.orchestra.run.smithi144.stdout: "poolop_active": 0, 2024-09-21T06:46:51.541 INFO:teuthology.orchestra.run.smithi144.stdout: "poolop_send": 0, 2024-09-21T06:46:51.541 INFO:teuthology.orchestra.run.smithi144.stdout: "poolop_resend": 0, 2024-09-21T06:46:51.541 INFO:teuthology.orchestra.run.smithi144.stdout: "poolstat_active": 0, 2024-09-21T06:46:51.542 INFO:teuthology.orchestra.run.smithi144.stdout: "poolstat_send": 0, 2024-09-21T06:46:51.542 INFO:teuthology.orchestra.run.smithi144.stdout: "poolstat_resend": 0, 2024-09-21T06:46:51.542 INFO:teuthology.orchestra.run.smithi144.stdout: "statfs_active": 0, 2024-09-21T06:46:51.542 INFO:teuthology.orchestra.run.smithi144.stdout: "statfs_send": 0, 2024-09-21T06:46:51.542 INFO:teuthology.orchestra.run.smithi144.stdout: "statfs_resend": 0, 2024-09-21T06:46:51.542 INFO:teuthology.orchestra.run.smithi144.stdout: "command_active": 0, 2024-09-21T06:46:51.542 INFO:teuthology.orchestra.run.smithi144.stdout: "command_send": 0, 2024-09-21T06:46:51.542 INFO:teuthology.orchestra.run.smithi144.stdout: "command_resend": 0, 2024-09-21T06:46:51.543 INFO:teuthology.orchestra.run.smithi144.stdout: "map_epoch": 85, 2024-09-21T06:46:51.543 INFO:teuthology.orchestra.run.smithi144.stdout: "map_full": 0, 2024-09-21T06:46:51.543 INFO:teuthology.orchestra.run.smithi144.stdout: "map_inc": 10, 2024-09-21T06:46:51.543 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_sessions": 9, 2024-09-21T06:46:51.543 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_session_open": 9, 2024-09-21T06:46:51.543 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_session_close": 0, 2024-09-21T06:46:51.543 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_laggy": 0, 2024-09-21T06:46:51.544 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_wr": 16, 2024-09-21T06:46:51.544 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_rd": 0, 2024-09-21T06:46:51.544 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_del": 1 2024-09-21T06:46:51.544 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:51.544 INFO:teuthology.orchestra.run.smithi144.stdout: "oft": { 2024-09-21T06:46:51.544 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_total_objs": 1, 2024-09-21T06:46:51.545 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_total_kv_pairs": 0, 2024-09-21T06:46:51.545 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_total_updates": 0, 2024-09-21T06:46:51.545 INFO:teuthology.orchestra.run.smithi144.stdout: "omap_total_removes": 0 2024-09-21T06:46:51.545 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:51.545 INFO:teuthology.orchestra.run.smithi144.stdout: "purge_queue": { 2024-09-21T06:46:51.545 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executing_ops": 0, 2024-09-21T06:46:51.545 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T06:46:51.545 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executing": 0, 2024-09-21T06:46:51.546 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executing_high_water": 0, 2024-09-21T06:46:51.546 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executed_ops": 0, 2024-09-21T06:46:51.546 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_executed": 0, 2024-09-21T06:46:51.546 INFO:teuthology.orchestra.run.smithi144.stdout: "pq_item_in_journal": 0 2024-09-21T06:46:51.546 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:51.546 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T06:46:51.546 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-21T06:46:51.546 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 104857600, 2024-09-21T06:46:51.546 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-21T06:46:51.546 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 870, 2024-09-21T06:46:51.546 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 944679, 2024-09-21T06:46:51.547 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-21T06:46:51.547 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 870, 2024-09-21T06:46:51.547 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 0, 2024-09-21T06:46:51.547 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 0, 2024-09-21T06:46:51.547 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 870, 2024-09-21T06:46:51.547 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 944679, 2024-09-21T06:46:51.547 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-21T06:46:51.547 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:51.547 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:51.547 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:51.547 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-21T06:46:51.547 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:51.548 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-objecter_bytes": { 2024-09-21T06:46:51.548 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-21T06:46:51.548 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 104857600, 2024-09-21T06:46:51.548 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-21T06:46:51.548 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 0, 2024-09-21T06:46:51.548 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 0, 2024-09-21T06:46:51.548 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-21T06:46:51.548 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 0, 2024-09-21T06:46:51.548 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 42, 2024-09-21T06:46:51.548 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 12332, 2024-09-21T06:46:51.549 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 42, 2024-09-21T06:46:51.549 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 12332, 2024-09-21T06:46:51.549 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-21T06:46:51.549 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:51.549 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:51.549 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:51.549 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-21T06:46:51.549 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:51.549 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-objecter_ops": { 2024-09-21T06:46:51.549 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-21T06:46:51.549 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 1024, 2024-09-21T06:46:51.549 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-21T06:46:51.549 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 0, 2024-09-21T06:46:51.549 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 0, 2024-09-21T06:46:51.550 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-21T06:46:51.550 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 0, 2024-09-21T06:46:51.550 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 42, 2024-09-21T06:46:51.550 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 42, 2024-09-21T06:46:51.550 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 42, 2024-09-21T06:46:51.550 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 42, 2024-09-21T06:46:51.550 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-21T06:46:51.550 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:51.550 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:51.550 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:51.550 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-21T06:46:51.550 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:51.551 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-write_buf_throttle": { 2024-09-21T06:46:51.551 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-21T06:46:51.551 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 3758096384, 2024-09-21T06:46:51.551 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-21T06:46:51.551 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 0, 2024-09-21T06:46:51.551 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 0, 2024-09-21T06:46:51.551 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-21T06:46:51.551 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 0, 2024-09-21T06:46:51.551 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 0, 2024-09-21T06:46:51.551 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 0, 2024-09-21T06:46:51.551 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 0, 2024-09-21T06:46:51.551 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 0, 2024-09-21T06:46:51.551 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-21T06:46:51.551 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:51.552 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:51.552 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:51.552 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-21T06:46:51.552 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:51.552 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-write_buf_throttle-0x5638172176c0": { 2024-09-21T06:46:51.552 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-21T06:46:51.552 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 3758096384, 2024-09-21T06:46:51.552 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-21T06:46:51.552 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 6, 2024-09-21T06:46:51.552 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 1819, 2024-09-21T06:46:51.552 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-21T06:46:51.552 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 6, 2024-09-21T06:46:51.552 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 0, 2024-09-21T06:46:51.553 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 0, 2024-09-21T06:46:51.553 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 5, 2024-09-21T06:46:51.553 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 1819, 2024-09-21T06:46:51.553 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-21T06:46:51.553 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:51.553 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:51.553 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:51.553 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-21T06:46:51.553 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:51.553 INFO:teuthology.orchestra.run.smithi144.stdout: "trackedop": { 2024-09-21T06:46:51.553 INFO:teuthology.orchestra.run.smithi144.stdout: "slow_ops_count": 0 2024-09-21T06:46:51.553 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-21T06:46:51.554 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-21T06:46:52.399 INFO:tasks.check_counter:Daemon mds.i mds.exported=0 2024-09-21T06:46:52.400 INFO:tasks.check_counter:Daemon mds.i mds.imported=0 2024-09-21T06:46:52.400 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=0 2024-09-21T06:46:52.400 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=8 2024-09-21T06:46:52.400 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=6 2024-09-21T06:46:52.400 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=0 2024-09-21T06:46:52.400 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=0 2024-09-21T06:46:52.400 DEBUG:tasks.check_counter:Getting stats from l 2024-09-21T06:46:52.400 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph daemon mds.l perf dump 2024-09-21T06:46:52.647 INFO:teuthology.orchestra.run.smithi144.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T06:46:52.915 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:46:52 smithi144 ceph-mon[34653]: pgmap v647: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:46:53.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:46:52 smithi007 ceph-mon[30983]: pgmap v647: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:46:53.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:46:52 smithi018 ceph-mon[34477]: pgmap v647: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-21T06:46:53.169 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-09-21T06:46:53.169 INFO:teuthology.orchestra.run.smithi144.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T06:46:53.169 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_messages": 0, 2024-09-21T06:46:53.169 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages": 2, 2024-09-21T06:46:53.169 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_bytes": 0, 2024-09-21T06:46:53.169 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_bytes": 0, 2024-09-21T06:46:53.169 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_created_connections": 4, 2024-09-21T06:46:53.169 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_active_connections": 0, 2024-09-21T06:46:53.170 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_total_time": 0.000947479, 2024-09-21T06:46:53.170 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T06:46:53.170 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_recv_time": 0.000152546, 2024-09-21T06:46:53.170 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:46:53.170 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:46:53.170 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:53.170 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:53.170 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:53.170 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:53.170 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:46:53.170 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:53.170 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:53.170 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:53.170 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:53.171 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T06:46:53.171 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T06:46:53.171 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:53.171 INFO:teuthology.orchestra.run.smithi144.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T06:46:53.171 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_messages": 218, 2024-09-21T06:46:53.171 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages": 213, 2024-09-21T06:46:53.171 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_bytes": 837008, 2024-09-21T06:46:53.171 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_bytes": 130624, 2024-09-21T06:46:53.171 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_created_connections": 2, 2024-09-21T06:46:53.171 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_active_connections": 1, 2024-09-21T06:46:53.171 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_total_time": 0.041377304, 2024-09-21T06:46:53.171 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_send_time": 0.018828086, 2024-09-21T06:46:53.171 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_recv_time": 0.032656318, 2024-09-21T06:46:53.171 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:46:53.171 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:46:53.172 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 212, 2024-09-21T06:46:53.172 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.014544061, 2024-09-21T06:46:53.172 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000068604 2024-09-21T06:46:53.172 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:53.172 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:46:53.172 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:53.172 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:53.172 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:53.172 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:53.172 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_encrypted_bytes": 837008, 2024-09-21T06:46:53.172 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_encrypted_bytes": 130624 2024-09-21T06:46:53.172 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:53.172 INFO:teuthology.orchestra.run.smithi144.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T06:46:53.172 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_messages": 5, 2024-09-21T06:46:53.173 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages": 164, 2024-09-21T06:46:53.173 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_bytes": 3152, 2024-09-21T06:46:53.173 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_bytes": 109200, 2024-09-21T06:46:53.173 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_created_connections": 3, 2024-09-21T06:46:53.173 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_active_connections": 2, 2024-09-21T06:46:53.173 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_total_time": 0.016191653, 2024-09-21T06:46:53.173 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_send_time": 0.011399081, 2024-09-21T06:46:53.173 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_recv_time": 0.002761591, 2024-09-21T06:46:53.173 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T06:46:53.173 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T06:46:53.173 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 163, 2024-09-21T06:46:53.173 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.014992468, 2024-09-21T06:46:53.173 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000091978 2024-09-21T06:46:53.173 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:53.173 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_handle_ack_lat": { 2024-09-21T06:46:53.173 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:53.174 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:53.174 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:53.174 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:53.174 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-21T06:46:53.174 INFO:teuthology.orchestra.run.smithi144.stdout: "msgr_send_encrypted_bytes": 109200 2024-09-21T06:46:53.174 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:53.174 INFO:teuthology.orchestra.run.smithi144.stdout: "cct": { 2024-09-21T06:46:53.174 INFO:teuthology.orchestra.run.smithi144.stdout: "total_workers": 0, 2024-09-21T06:46:53.174 INFO:teuthology.orchestra.run.smithi144.stdout: "unhealthy_workers": 0 2024-09-21T06:46:53.174 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:53.174 INFO:teuthology.orchestra.run.smithi144.stdout: "mempool": { 2024-09-21T06:46:53.174 INFO:teuthology.orchestra.run.smithi144.stdout: "bloom_filter_bytes": 0, 2024-09-21T06:46:53.174 INFO:teuthology.orchestra.run.smithi144.stdout: "bloom_filter_items": 0, 2024-09-21T06:46:53.175 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T06:46:53.175 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_alloc_items": 0, 2024-09-21T06:46:53.175 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T06:46:53.175 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_data_items": 0, 2024-09-21T06:46:53.175 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T06:46:53.175 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T06:46:53.175 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T06:46:53.175 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T06:46:53.175 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T06:46:53.175 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_other_items": 0, 2024-09-21T06:46:53.175 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T06:46:53.175 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T06:46:53.175 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_extent_bytes": 0, 2024-09-21T06:46:53.175 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_extent_items": 0, 2024-09-21T06:46:53.175 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_blob_bytes": 0, 2024-09-21T06:46:53.176 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_blob_items": 0, 2024-09-21T06:46:53.176 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T06:46:53.176 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T06:46:53.176 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T06:46:53.176 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T06:46:53.176 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T06:46:53.176 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_fsck_items": 0, 2024-09-21T06:46:53.176 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_txc_bytes": 0, 2024-09-21T06:46:53.176 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_txc_items": 0, 2024-09-21T06:46:53.176 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T06:46:53.176 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T06:46:53.176 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_bytes": 0, 2024-09-21T06:46:53.176 INFO:teuthology.orchestra.run.smithi144.stdout: "bluestore_writing_items": 0, 2024-09-21T06:46:53.176 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_bytes": 0, 2024-09-21T06:46:53.177 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_items": 0, 2024-09-21T06:46:53.177 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T06:46:53.177 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_reader_items": 0, 2024-09-21T06:46:53.177 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T06:46:53.177 INFO:teuthology.orchestra.run.smithi144.stdout: "bluefs_file_writer_items": 0, 2024-09-21T06:46:53.177 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_anon_bytes": 149007, 2024-09-21T06:46:53.177 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_anon_items": 30, 2024-09-21T06:46:53.177 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_meta_bytes": 0, 2024-09-21T06:46:53.177 INFO:teuthology.orchestra.run.smithi144.stdout: "buffer_meta_items": 0, 2024-09-21T06:46:53.177 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_bytes": 0, 2024-09-21T06:46:53.177 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_items": 0, 2024-09-21T06:46:53.177 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_mapbl_bytes": 0, 2024-09-21T06:46:53.177 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_mapbl_items": 0, 2024-09-21T06:46:53.178 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_pglog_bytes": 0, 2024-09-21T06:46:53.178 INFO:teuthology.orchestra.run.smithi144.stdout: "osd_pglog_items": 0, 2024-09-21T06:46:53.178 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_bytes": 0, 2024-09-21T06:46:53.178 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_items": 0, 2024-09-21T06:46:53.178 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T06:46:53.178 INFO:teuthology.orchestra.run.smithi144.stdout: "osdmap_mapping_items": 0, 2024-09-21T06:46:53.178 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap_bytes": 0, 2024-09-21T06:46:53.178 INFO:teuthology.orchestra.run.smithi144.stdout: "pgmap_items": 0, 2024-09-21T06:46:53.178 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_co_bytes": 968, 2024-09-21T06:46:53.178 INFO:teuthology.orchestra.run.smithi144.stdout: "mds_co_items": 2, 2024-09-21T06:46:53.178 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_1_bytes": 0, 2024-09-21T06:46:53.178 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_1_items": 0, 2024-09-21T06:46:53.178 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_2_bytes": 0, 2024-09-21T06:46:53.178 INFO:teuthology.orchestra.run.smithi144.stdout: "unittest_2_items": 0 2024-09-21T06:46:53.179 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-09-21T06:46:53.179 INFO:teuthology.orchestra.run.smithi144.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T06:46:53.179 INFO:teuthology.orchestra.run.smithi144.stdout: "val": 0, 2024-09-21T06:46:53.179 INFO:teuthology.orchestra.run.smithi144.stdout: "max": 104857600, 2024-09-21T06:46:53.179 INFO:teuthology.orchestra.run.smithi144.stdout: "get_started": 0, 2024-09-21T06:46:53.179 INFO:teuthology.orchestra.run.smithi144.stdout: "get": 219, 2024-09-21T06:46:53.179 INFO:teuthology.orchestra.run.smithi144.stdout: "get_sum": 806214, 2024-09-21T06:46:53.179 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_fail": 0, 2024-09-21T06:46:53.179 INFO:teuthology.orchestra.run.smithi144.stdout: "get_or_fail_success": 219, 2024-09-21T06:46:53.179 INFO:teuthology.orchestra.run.smithi144.stdout: "take": 0, 2024-09-21T06:46:53.179 INFO:teuthology.orchestra.run.smithi144.stdout: "take_sum": 0, 2024-09-21T06:46:53.179 INFO:teuthology.orchestra.run.smithi144.stdout: "put": 219, 2024-09-21T06:46:53.179 INFO:teuthology.orchestra.run.smithi144.stdout: "put_sum": 806214, 2024-09-21T06:46:53.179 INFO:teuthology.orchestra.run.smithi144.stdout: "wait": { 2024-09-21T06:46:53.179 INFO:teuthology.orchestra.run.smithi144.stdout: "avgcount": 0, 2024-09-21T06:46:53.180 INFO:teuthology.orchestra.run.smithi144.stdout: "sum": 0.000000000, 2024-09-21T06:46:53.180 INFO:teuthology.orchestra.run.smithi144.stdout: "avgtime": 0.000000000 2024-09-21T06:46:53.180 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-21T06:46:53.180 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-09-21T06:46:53.180 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-09-21T06:46:53.842 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.l 2024-09-21T06:46:53.842 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.l 2024-09-21T06:46:53.843 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.l 2024-09-21T06:46:53.843 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.l 2024-09-21T06:46:53.843 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.l 2024-09-21T06:46:53.843 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.l 2024-09-21T06:46:53.843 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.l 2024-09-21T06:46:53.843 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-21T06:46:53.852 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-21T06:46:53.852 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-21T06:46:53.853 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:46:53.874 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2024-09-21T06:46:53.875 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T06:46:53.935 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph osd blocklist ls 2024-09-21T06:46:54.248 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:46:54.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:54.736+0000 7f23b37a8640 1 -- 172.21.15.7:0/3131244517 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23ac108cf0 msgr2=0x7f23ac10f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:54.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:54.736+0000 7f23b37a8640 1 --2- 172.21.15.7:0/3131244517 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23ac108cf0 0x7f23ac10f520 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f23a4009ca0 tx=0x7f23a402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:46:54.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:54.736+0000 7f23b37a8640 1 -- 172.21.15.7:0/3131244517 shutdown_connections 2024-09-21T06:46:54.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:54.736+0000 7f23b37a8640 1 --2- 172.21.15.7:0/3131244517 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23ac108cf0 0x7f23ac10f520 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:54.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:54.736+0000 7f23b37a8640 1 --2- 172.21.15.7:0/3131244517 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f23ac1083a0 0x7f23ac1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:54.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:54.736+0000 7f23b37a8640 1 --2- 172.21.15.7:0/3131244517 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23ac102a60 0x7f23ac102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:54.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:54.736+0000 7f23b37a8640 1 -- 172.21.15.7:0/3131244517 >> 172.21.15.7:0/3131244517 conn(0x7f23ac079730 msgr2=0x7f23ac079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:54.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:54.736+0000 7f23b37a8640 1 -- 172.21.15.7:0/3131244517 shutdown_connections 2024-09-21T06:46:54.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:54.736+0000 7f23b37a8640 1 -- 172.21.15.7:0/3131244517 wait complete. 2024-09-21T06:46:54.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:54.737+0000 7f23b37a8640 1 Processor -- start 2024-09-21T06:46:54.751 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:54.737+0000 7f23b37a8640 1 -- start start 2024-09-21T06:46:54.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:54.737+0000 7f23b37a8640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23ac102a60 0x7f23ac0ff670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:54.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:54.737+0000 7f23b37a8640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23ac1083a0 0x7f23ac0ffbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:54.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:54.737+0000 7f23b37a8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f23ac108cf0 0x7f23ac1000f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:54.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:54.737+0000 7f23b37a8640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f23ac112960 con 0x7f23ac102a60 2024-09-21T06:46:54.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:54.737+0000 7f23b37a8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f23ac1127e0 con 0x7f23ac108cf0 2024-09-21T06:46:54.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:54.737+0000 7f23b37a8640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f23ac112ae0 con 0x7f23ac1083a0 2024-09-21T06:46:54.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:54.737+0000 7f23b1544640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23ac102a60 0x7f23ac0ff670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:54.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:54.737+0000 7f23b1544640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23ac102a60 0x7f23ac0ff670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37462/0 (socket says 172.21.15.7:37462) 2024-09-21T06:46:54.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:54.737+0000 7f23b1544640 1 -- 172.21.15.7:0/3447965966 learned_addr learned my addr 172.21.15.7:0/3447965966 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:46:54.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:54.738+0000 7f23b0d43640 1 --2- 172.21.15.7:0/3447965966 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23ac1083a0 0x7f23ac0ffbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:54.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:54.738+0000 7f23b1d45640 1 --2- 172.21.15.7:0/3447965966 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f23ac108cf0 0x7f23ac1000f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:54.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:54.738+0000 7f23b1544640 1 -- 172.21.15.7:0/3447965966 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23ac1083a0 msgr2=0x7f23ac0ffbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:54.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:54.738+0000 7f23b1544640 1 --2- 172.21.15.7:0/3447965966 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23ac1083a0 0x7f23ac0ffbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:54.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:54.738+0000 7f23b1544640 1 -- 172.21.15.7:0/3447965966 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f23ac108cf0 msgr2=0x7f23ac1000f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:54.752 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:54.738+0000 7f23b1544640 1 --2- 172.21.15.7:0/3447965966 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f23ac108cf0 0x7f23ac1000f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:54.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:54.738+0000 7f23b1544640 1 -- 172.21.15.7:0/3447965966 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23ac1a86e0 con 0x7f23ac102a60 2024-09-21T06:46:54.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:54.738+0000 7f23b0d43640 1 --2- 172.21.15.7:0/3447965966 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23ac1083a0 0x7f23ac0ffbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:46:54.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:54.738+0000 7f23b1544640 1 --2- 172.21.15.7:0/3447965966 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23ac102a60 0x7f23ac0ff670 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f23a800c890 tx=0x7f23a800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:54.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:54.738+0000 7f23a27fc640 1 -- 172.21.15.7:0/3447965966 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a8004220 con 0x7f23ac102a60 2024-09-21T06:46:54.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:54.738+0000 7f23a27fc640 1 -- 172.21.15.7:0/3447965966 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f23a80043c0 con 0x7f23ac102a60 2024-09-21T06:46:54.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:54.738+0000 7f23b37a8640 1 -- 172.21.15.7:0/3447965966 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23ac1a89d0 con 0x7f23ac102a60 2024-09-21T06:46:54.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:54.738+0000 7f23a27fc640 1 -- 172.21.15.7:0/3447965966 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a8004a00 con 0x7f23ac102a60 2024-09-21T06:46:54.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:54.738+0000 7f23b37a8640 1 -- 172.21.15.7:0/3447965966 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23ac1a8f60 con 0x7f23ac102a60 2024-09-21T06:46:54.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:54.739+0000 7f23b37a8640 1 -- 172.21.15.7:0/3447965966 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23ac102e70 con 0x7f23ac102a60 2024-09-21T06:46:54.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:54.741+0000 7f23a27fc640 1 -- 172.21.15.7:0/3447965966 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f23a80079b0 con 0x7f23ac102a60 2024-09-21T06:46:54.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:54.742+0000 7f23a27fc640 1 --2- 172.21.15.7:0/3447965966 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f23980b6700 0x7f23980b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:54.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:54.742+0000 7f23b0d43640 1 --2- 172.21.15.7:0/3447965966 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f23980b6700 0x7f23980b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:54.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:54.742+0000 7f23a27fc640 1 -- 172.21.15.7:0/3447965966 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8412+0+0 (secure 0 0 0) 0x7f23a80e7460 con 0x7f23ac102a60 2024-09-21T06:46:54.753 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:54.742+0000 7f23b0d43640 1 --2- 172.21.15.7:0/3447965966 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f23980b6700 0x7f23980b8c10 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f239c005fd0 tx=0x7f239c005850 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:54.754 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:54.746+0000 7f23a27fc640 1 -- 172.21.15.7:0/3447965966 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f23a8014030 con 0x7f23ac102a60 2024-09-21T06:46:54.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:54.949+0000 7f23b37a8640 1 -- 172.21.15.7:0/3447965966 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f23ac1a9390 con 0x7f23ac102a60 2024-09-21T06:46:54.952 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:46:54 smithi007 ceph-mon[30983]: pgmap v648: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:46:54.952 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:54.950+0000 7f23a27fc640 1 -- 172.21.15.7:0/3447965966 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 15 entries v85) ==== 81+0+871 (secure 0 0 0) 0x7f23a80ada20 con 0x7f23ac102a60 2024-09-21T06:46:54.952 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:0/1296137341 2024-09-22T06:27:43.044484+0000 2024-09-21T06:46:54.953 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6801/3879502931 2024-09-22T06:27:43.044484+0000 2024-09-21T06:46:54.953 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:0/1926706877 2024-09-22T06:26:40.520265+0000 2024-09-21T06:46:54.953 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:0/2034370456 2024-09-22T06:26:14.181426+0000 2024-09-21T06:46:54.953 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6801/3339522713 2024-09-22T06:26:14.181426+0000 2024-09-21T06:46:54.953 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6800/3339522713 2024-09-22T06:26:14.181426+0000 2024-09-21T06:46:54.953 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:0/3586807770 2024-09-22T06:26:14.181426+0000 2024-09-21T06:46:54.953 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:0/1814223919 2024-09-22T06:27:43.044484+0000 2024-09-21T06:46:54.953 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:0/601150037 2024-09-22T06:26:40.520265+0000 2024-09-21T06:46:54.953 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6800/3876787626 2024-09-22T06:26:40.520265+0000 2024-09-21T06:46:54.953 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:0/186444636 2024-09-22T06:26:14.181426+0000 2024-09-21T06:46:54.953 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:0/2180184348 2024-09-22T06:26:40.520265+0000 2024-09-21T06:46:54.953 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6801/3876787626 2024-09-22T06:26:40.520265+0000 2024-09-21T06:46:54.953 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:0/2931793461 2024-09-22T06:27:43.044484+0000 2024-09-21T06:46:54.953 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.15.7:6800/3879502931 2024-09-22T06:27:43.044484+0000 2024-09-21T06:46:54.954 INFO:teuthology.orchestra.run.smithi007.stderr:listed 15 entries 2024-09-21T06:46:54.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:54.952+0000 7f23b37a8640 1 -- 172.21.15.7:0/3447965966 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f23980b6700 msgr2=0x7f23980b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:54.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:54.952+0000 7f23b37a8640 1 --2- 172.21.15.7:0/3447965966 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f23980b6700 0x7f23980b8c10 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f239c005fd0 tx=0x7f239c005850 comp rx=0 tx=0).stop 2024-09-21T06:46:54.954 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:54.952+0000 7f23b37a8640 1 -- 172.21.15.7:0/3447965966 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23ac102a60 msgr2=0x7f23ac0ff670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:54.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:54.952+0000 7f23b37a8640 1 --2- 172.21.15.7:0/3447965966 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23ac102a60 0x7f23ac0ff670 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f23a800c890 tx=0x7f23a800cd50 comp rx=0 tx=0).stop 2024-09-21T06:46:54.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:54.952+0000 7f23b37a8640 1 -- 172.21.15.7:0/3447965966 shutdown_connections 2024-09-21T06:46:54.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:54.952+0000 7f23b37a8640 1 --2- 172.21.15.7:0/3447965966 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f23980b6700 0x7f23980b8c10 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:54.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:54.952+0000 7f23b37a8640 1 --2- 172.21.15.7:0/3447965966 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f23ac108cf0 0x7f23ac1000f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:54.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:54.952+0000 7f23b37a8640 1 --2- 172.21.15.7:0/3447965966 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f23ac1083a0 0x7f23ac0ffbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:54.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:54.952+0000 7f23b37a8640 1 --2- 172.21.15.7:0/3447965966 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f23ac102a60 0x7f23ac0ff670 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:54.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:54.952+0000 7f23b37a8640 1 -- 172.21.15.7:0/3447965966 >> 172.21.15.7:0/3447965966 conn(0x7f23ac079730 msgr2=0x7f23ac1019e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:54.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:54.953+0000 7f23b37a8640 1 -- 172.21.15.7:0/3447965966 shutdown_connections 2024-09-21T06:46:54.955 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:54.953+0000 7f23b37a8640 1 -- 172.21.15.7:0/3447965966 wait complete. 2024-09-21T06:46:55.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:46:54 smithi144 ceph-mon[34653]: pgmap v648: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:46:55.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:46:54 smithi018 ceph-mon[34477]: pgmap v648: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-21T06:46:55.596 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-21T06:46:55.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:46:55.596 DEBUG:teuthology.orchestra.run.smithi007:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-21T06:46:55.642 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2024-09-21T06:46:55.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:46:55.643 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-21T06:46:55.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:46:55.676 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2024-09-21T06:46:55.732 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-21T06:46:55.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:46:55.733 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T06:46:55.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T06:46:55.799 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link delete ceph-brx 2024-09-21T06:46:55.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:46:55 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/3447965966' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T06:46:55.894 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-21T06:46:55.905 INFO:tasks.cephadm:Teardown begin 2024-09-21T06:46:55.905 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-21T06:46:55.906 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:46:56.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:46:55 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/3447965966' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T06:46:56.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:46:55 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/3447965966' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T06:46:56.168 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:46:56.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:56.687+0000 7fa4acaee640 1 -- 172.21.15.7:0/241182921 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4a810de10 msgr2=0x7fa4a8110300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:56.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:56.687+0000 7fa4acaee640 1 --2- 172.21.15.7:0/241182921 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4a810de10 0x7fa4a8110300 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7fa4a0009ca0 tx=0x7fa4a002a8c0 comp rx=0 tx=0).stop 2024-09-21T06:46:56.695 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:56.687+0000 7fa4acaee640 1 -- 172.21.15.7:0/241182921 shutdown_connections 2024-09-21T06:46:56.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:56.687+0000 7fa4acaee640 1 --2- 172.21.15.7:0/241182921 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4a810de10 0x7fa4a8110300 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:56.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:56.687+0000 7fa4acaee640 1 --2- 172.21.15.7:0/241182921 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4a8105300 0x7fa4a810d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:56.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:56.687+0000 7fa4acaee640 1 --2- 172.21.15.7:0/241182921 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa4a81049b0 0x7fa4a8104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:56.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:56.687+0000 7fa4acaee640 1 -- 172.21.15.7:0/241182921 >> 172.21.15.7:0/241182921 conn(0x7fa4a8079730 msgr2=0x7fa4a8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:56.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:56.687+0000 7fa4acaee640 1 -- 172.21.15.7:0/241182921 shutdown_connections 2024-09-21T06:46:56.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:56.687+0000 7fa4acaee640 1 -- 172.21.15.7:0/241182921 wait complete. 2024-09-21T06:46:56.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:56.688+0000 7fa4acaee640 1 Processor -- start 2024-09-21T06:46:56.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:56.688+0000 7fa4acaee640 1 -- start start 2024-09-21T06:46:56.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:56.688+0000 7fa4acaee640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4a81049b0 0x7fa4a819c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:56.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:56.688+0000 7fa4acaee640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa4a8105300 0x7fa4a819cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:56.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:56.688+0000 7fa4acaee640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4a810de10 0x7fa4a81a1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:56.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:56.688+0000 7fa4acaee640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fa4a8113a70 con 0x7fa4a81049b0 2024-09-21T06:46:56.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:56.688+0000 7fa4acaee640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa4a81138f0 con 0x7fa4a8105300 2024-09-21T06:46:56.696 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:56.688+0000 7fa4acaee640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fa4a8113bf0 con 0x7fa4a810de10 2024-09-21T06:46:56.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:56.688+0000 7fa4a659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4a81049b0 0x7fa4a819c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:56.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:56.689+0000 7fa4a659c640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4a81049b0 0x7fa4a819c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37484/0 (socket says 172.21.15.7:37484) 2024-09-21T06:46:56.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:56.689+0000 7fa4a659c640 1 -- 172.21.15.7:0/4099308159 learned_addr learned my addr 172.21.15.7:0/4099308159 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:46:56.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:56.689+0000 7fa4a6d9d640 1 --2- 172.21.15.7:0/4099308159 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4a810de10 0x7fa4a81a1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:56.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:56.689+0000 7fa4a5d9b640 1 --2- 172.21.15.7:0/4099308159 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa4a8105300 0x7fa4a819cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:56.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:56.689+0000 7fa4a659c640 1 -- 172.21.15.7:0/4099308159 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4a810de10 msgr2=0x7fa4a81a1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:56.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:56.689+0000 7fa4a659c640 1 --2- 172.21.15.7:0/4099308159 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4a810de10 0x7fa4a81a1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:56.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:56.689+0000 7fa4a659c640 1 -- 172.21.15.7:0/4099308159 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa4a8105300 msgr2=0x7fa4a819cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:56.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:56.689+0000 7fa4a659c640 1 --2- 172.21.15.7:0/4099308159 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa4a8105300 0x7fa4a819cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:56.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:56.689+0000 7fa4a659c640 1 -- 172.21.15.7:0/4099308159 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4a81a2570 con 0x7fa4a81049b0 2024-09-21T06:46:56.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:56.689+0000 7fa4a659c640 1 --2- 172.21.15.7:0/4099308159 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4a81049b0 0x7fa4a819c6c0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7fa49800e9c0 tx=0x7fa49800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:56.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:56.689+0000 7fa4977fe640 1 -- 172.21.15.7:0/4099308159 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa49800cd80 con 0x7fa4a81049b0 2024-09-21T06:46:56.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:56.689+0000 7fa4acaee640 1 -- 172.21.15.7:0/4099308159 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4a81a2860 con 0x7fa4a81049b0 2024-09-21T06:46:56.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:56.689+0000 7fa4977fe640 1 -- 172.21.15.7:0/4099308159 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa4980035f0 con 0x7fa4a81049b0 2024-09-21T06:46:56.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:56.689+0000 7fa4977fe640 1 -- 172.21.15.7:0/4099308159 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa498010690 con 0x7fa4a81049b0 2024-09-21T06:46:56.697 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:56.689+0000 7fa4acaee640 1 -- 172.21.15.7:0/4099308159 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4a81a9080 con 0x7fa4a81049b0 2024-09-21T06:46:56.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:56.691+0000 7fa4acaee640 1 -- 172.21.15.7:0/4099308159 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4a8104dc0 con 0x7fa4a81049b0 2024-09-21T06:46:56.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:56.692+0000 7fa4977fe640 1 -- 172.21.15.7:0/4099308159 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7fa4980037a0 con 0x7fa4a81049b0 2024-09-21T06:46:56.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:56.693+0000 7fa4977fe640 1 --2- 172.21.15.7:0/4099308159 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa4900b66b0 0x7fa4900b8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:56.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:56.693+0000 7fa4a5d9b640 1 --2- 172.21.15.7:0/4099308159 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa4900b66b0 0x7fa4900b8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:56.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:56.693+0000 7fa4977fe640 1 -- 172.21.15.7:0/4099308159 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8412+0+0 (secure 0 0 0) 0x7fa4980e7bc0 con 0x7fa4a81049b0 2024-09-21T06:46:56.698 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:56.694+0000 7fa4a5d9b640 1 --2- 172.21.15.7:0/4099308159 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa4900b66b0 0x7fa4900b8bc0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fa4a810fb00 tx=0x7fa49c00c4a0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:56.699 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:56.697+0000 7fa4977fe640 1 -- 172.21.15.7:0/4099308159 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa4980ae120 con 0x7fa4a81049b0 2024-09-21T06:46:56.930 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:56.928+0000 7fa4acaee640 1 -- 172.21.15.7:0/4099308159 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa4a819d7f0 con 0x7fa4a81049b0 2024-09-21T06:46:56.930 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:46:56 smithi007 ceph-mon[30983]: pgmap v649: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:46:56.931 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:56.929+0000 7fa4977fe640 1 -- 172.21.15.7:0/4099308159 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11899 (secure 0 0 0) 0x7fa4980b2500 con 0x7fa4a81049b0 2024-09-21T06:46:56.931 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:46:56.931 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-21T06:36:10:753693+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2015971546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2015971546},{"type":"v1","addr":"172.21.15.7:6835","nonce":2015971546}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/2350816224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":2350816224},{"type":"v1","addr":"172.21.15.7:6837","nonce":2350816224}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14823,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/1669980572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":1669980572},{"type":"v1","addr":"172.21.15.7:6839","nonce":1669980572}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14835,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/2528308973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":2528308973},{"type":"v1","addr":"172.21.15.7:6841","nonce":2528308973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24623,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1337382979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1337382979},{"type":"v1","addr":"172.21.15.18:6833","nonce":1337382979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/2751454345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":2751454345},{"type":"v1","addr":"172.21.15.144:6833","nonce":2751454345}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:34:24.627168+0000","modified":"2024-09-21T06:36:10.737288+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24716,"mds_1":24688,"mds_2":24686},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24656":{"gid":24656,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6835/158884796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":158884796},{"type":"v1","addr":"172.21.15.18:6835","nonce":158884796}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6835/3636739922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3636739922},{"type":"v1","addr":"172.21.15.144:6835","nonce":3636739922}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24673":{"gid":24673,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6837/1126341753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":1126341753},{"type":"v1","addr":"172.21.15.144:6837","nonce":1126341753}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.18:6837/1539670694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1539670694},{"type":"v1","addr":"172.21.15.18:6837","nonce":1539670694}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24688":{"gid":24688,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.144:6839/4027821922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":4027821922},{"type":"v1","addr":"172.21.15.144:6839","nonce":4027821922}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24716":{"gid":24716,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.18:6839/3798713532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":3798713532},{"type":"v1","addr":"172.21.15.18:6839","nonce":3798713532}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24716,"qdb_cluster":[24716,24688,24686]},"id":1}]} 2024-09-21T06:46:56.932 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-21T06:46:56.933 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:56.931+0000 7fa4acaee640 1 -- 172.21.15.7:0/4099308159 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa4900b66b0 msgr2=0x7fa4900b8bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:56.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:56.931+0000 7fa4acaee640 1 --2- 172.21.15.7:0/4099308159 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa4900b66b0 0x7fa4900b8bc0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fa4a810fb00 tx=0x7fa49c00c4a0 comp rx=0 tx=0).stop 2024-09-21T06:46:56.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:56.931+0000 7fa4acaee640 1 -- 172.21.15.7:0/4099308159 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4a81049b0 msgr2=0x7fa4a819c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:56.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:56.931+0000 7fa4acaee640 1 --2- 172.21.15.7:0/4099308159 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4a81049b0 0x7fa4a819c6c0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7fa49800e9c0 tx=0x7fa49800ee80 comp rx=0 tx=0).stop 2024-09-21T06:46:56.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:56.932+0000 7fa4acaee640 1 -- 172.21.15.7:0/4099308159 shutdown_connections 2024-09-21T06:46:56.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:56.932+0000 7fa4acaee640 1 --2- 172.21.15.7:0/4099308159 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fa4900b66b0 0x7fa4900b8bc0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:56.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:56.932+0000 7fa4acaee640 1 --2- 172.21.15.7:0/4099308159 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fa4a810de10 0x7fa4a81a1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:56.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:56.932+0000 7fa4acaee640 1 --2- 172.21.15.7:0/4099308159 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa4a8105300 0x7fa4a819cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:56.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:56.932+0000 7fa4acaee640 1 --2- 172.21.15.7:0/4099308159 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fa4a81049b0 0x7fa4a819c6c0 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:56.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:56.932+0000 7fa4acaee640 1 -- 172.21.15.7:0/4099308159 >> 172.21.15.7:0/4099308159 conn(0x7fa4a8079730 msgr2=0x7fa4a81036a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:56.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:56.932+0000 7fa4acaee640 1 -- 172.21.15.7:0/4099308159 shutdown_connections 2024-09-21T06:46:56.934 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:56.932+0000 7fa4acaee640 1 -- 172.21.15.7:0/4099308159 wait complete. 2024-09-21T06:46:57.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:46:56 smithi144 ceph-mon[34653]: pgmap v649: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:46:57.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:46:56 smithi018 ceph-mon[34477]: pgmap v649: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T06:46:57.609 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T06:46:57.839 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:46:57 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/4099308159' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:46:57.873 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:46:58.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:46:57 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/4099308159' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:46:58.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:46:57 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/4099308159' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:46:58.329 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:58.327+0000 7feb01407640 1 -- 172.21.15.7:0/3486535502 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feafc109e00 msgr2=0x7feafc110630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:58.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:58.327+0000 7feb01407640 1 --2- 172.21.15.7:0/3486535502 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feafc109e00 0x7feafc110630 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7feaf4009ca0 tx=0x7feaf402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:46:58.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:58.327+0000 7feb01407640 1 -- 172.21.15.7:0/3486535502 shutdown_connections 2024-09-21T06:46:58.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:58.327+0000 7feb01407640 1 --2- 172.21.15.7:0/3486535502 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feafc109e00 0x7feafc110630 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:58.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:58.327+0000 7feb01407640 1 --2- 172.21.15.7:0/3486535502 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feafc1094b0 0x7feafc1098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:58.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:58.327+0000 7feb01407640 1 --2- 172.21.15.7:0/3486535502 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feafc103b70 0x7feafc103f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:58.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:58.327+0000 7feb01407640 1 -- 172.21.15.7:0/3486535502 >> 172.21.15.7:0/3486535502 conn(0x7feafc0ff5e0 msgr2=0x7feafc101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:58.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:58.327+0000 7feb01407640 1 -- 172.21.15.7:0/3486535502 shutdown_connections 2024-09-21T06:46:58.330 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:58.327+0000 7feb01407640 1 -- 172.21.15.7:0/3486535502 wait complete. 2024-09-21T06:46:58.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:58.328+0000 7feb01407640 1 Processor -- start 2024-09-21T06:46:58.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:58.328+0000 7feb01407640 1 -- start start 2024-09-21T06:46:58.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:58.329+0000 7feb01407640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feafc103b70 0x7feafc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:58.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:58.329+0000 7feb01407640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feafc1094b0 0x7feafc075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:58.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:58.329+0000 7feb01407640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feafc109e00 0x7feafc076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:58.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:58.329+0000 7feb01407640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7feafc113ac0 con 0x7feafc109e00 2024-09-21T06:46:58.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:58.329+0000 7feb01407640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7feafc113940 con 0x7feafc103b70 2024-09-21T06:46:58.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:58.329+0000 7feb01407640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7feafc113c40 con 0x7feafc1094b0 2024-09-21T06:46:58.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:58.329+0000 7feafb7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feafc109e00 0x7feafc076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:58.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:58.329+0000 7feafa7fc640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feafc1094b0 0x7feafc075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:58.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:58.329+0000 7feafb7fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feafc109e00 0x7feafc076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37510/0 (socket says 172.21.15.7:37510) 2024-09-21T06:46:58.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:58.329+0000 7feafb7fe640 1 -- 172.21.15.7:0/142412419 learned_addr learned my addr 172.21.15.7:0/142412419 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:46:58.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:58.329+0000 7feafaffd640 1 --2- 172.21.15.7:0/142412419 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feafc103b70 0x7feafc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:58.332 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:58.329+0000 7feafb7fe640 1 -- 172.21.15.7:0/142412419 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feafc1094b0 msgr2=0x7feafc075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:58.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:58.329+0000 7feafb7fe640 1 --2- 172.21.15.7:0/142412419 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feafc1094b0 0x7feafc075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:58.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:58.329+0000 7feafb7fe640 1 -- 172.21.15.7:0/142412419 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feafc103b70 msgr2=0x7feafc075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:58.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:58.329+0000 7feafb7fe640 1 --2- 172.21.15.7:0/142412419 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feafc103b70 0x7feafc075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:58.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:58.329+0000 7feafb7fe640 1 -- 172.21.15.7:0/142412419 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feafc1a8710 con 0x7feafc109e00 2024-09-21T06:46:58.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:58.330+0000 7feafb7fe640 1 --2- 172.21.15.7:0/142412419 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feafc109e00 0x7feafc076190 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7feaf4005cc0 tx=0x7feaf402f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:58.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:58.330+0000 7feae3fff640 1 -- 172.21.15.7:0/142412419 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf4003bf0 con 0x7feafc109e00 2024-09-21T06:46:58.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:58.330+0000 7feb01407640 1 -- 172.21.15.7:0/142412419 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feafc1a89a0 con 0x7feafc109e00 2024-09-21T06:46:58.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:58.330+0000 7feae3fff640 1 -- 172.21.15.7:0/142412419 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feaf4003d90 con 0x7feafc109e00 2024-09-21T06:46:58.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:58.330+0000 7feae3fff640 1 -- 172.21.15.7:0/142412419 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf402fbc0 con 0x7feafc109e00 2024-09-21T06:46:58.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:58.330+0000 7feb01407640 1 -- 172.21.15.7:0/142412419 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feafc1a8f30 con 0x7feafc109e00 2024-09-21T06:46:58.333 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:58.331+0000 7feb01407640 1 -- 172.21.15.7:0/142412419 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feafc103f80 con 0x7feafc109e00 2024-09-21T06:46:58.334 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:58.333+0000 7feae3fff640 1 -- 172.21.15.7:0/142412419 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7feaf402fd60 con 0x7feafc109e00 2024-09-21T06:46:58.335 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:58.334+0000 7feae3fff640 1 --2- 172.21.15.7:0/142412419 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7feae40b6680 0x7feae40b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:58.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:58.334+0000 7feafaffd640 1 --2- 172.21.15.7:0/142412419 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7feae40b6680 0x7feae40b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:58.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:58.334+0000 7feae3fff640 1 -- 172.21.15.7:0/142412419 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8412+0+0 (secure 0 0 0) 0x7feaf4108ca0 con 0x7feafc109e00 2024-09-21T06:46:58.336 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:58.334+0000 7feafaffd640 1 --2- 172.21.15.7:0/142412419 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7feae40b6680 0x7feae40b8b90 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7feafc077160 tx=0x7feaec00b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:58.339 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:58.337+0000 7feae3fff640 1 -- 172.21.15.7:0/142412419 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7feaf40cf260 con 0x7feafc109e00 2024-09-21T06:46:58.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:58.563+0000 7feb01407640 1 -- 172.21.15.7:0/142412419 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feafc02e640 con 0x7feafc109e00 2024-09-21T06:46:58.565 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:58.564+0000 7feae3fff640 1 -- 172.21.15.7:0/142412419 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11899 (secure 0 0 0) 0x7feaf40d3640 con 0x7feafc109e00 2024-09-21T06:46:58.566 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:46:58.566 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":25,"btime":"2024-09-21T06:36:10:753693+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14760,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6835/2015971546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6834","nonce":2015971546},{"type":"v1","addr":"172.21.15.7:6835","nonce":2015971546}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14772,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6837/2350816224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6836","nonce":2350816224},{"type":"v1","addr":"172.21.15.7:6837","nonce":2350816224}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14823,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6839/1669980572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6838","nonce":1669980572},{"type":"v1","addr":"172.21.15.7:6839","nonce":1669980572}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14835,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6841/2528308973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6840","nonce":2528308973},{"type":"v1","addr":"172.21.15.7:6841","nonce":2528308973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24623,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/1337382979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1337382979},{"type":"v1","addr":"172.21.15.18:6833","nonce":1337382979}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24625,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.144:6833/2751454345","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6832","nonce":2751454345},{"type":"v1","addr":"172.21.15.144:6833","nonce":2751454345}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":25,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T06:34:24.627168+0000","modified":"2024-09-21T06:36:10.737288+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24716,"mds_1":24688,"mds_2":24686},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24656":{"gid":24656,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.18:6835/158884796","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":158884796},{"type":"v1","addr":"172.21.15.18:6835","nonce":158884796}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24667":{"gid":24667,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6835/3636739922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6834","nonce":3636739922},{"type":"v1","addr":"172.21.15.144:6835","nonce":3636739922}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24673":{"gid":24673,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.144:6837/1126341753","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6836","nonce":1126341753},{"type":"v1","addr":"172.21.15.144:6837","nonce":1126341753}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24686":{"gid":24686,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.18:6837/1539670694","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6836","nonce":1539670694},{"type":"v1","addr":"172.21.15.18:6837","nonce":1539670694}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24688":{"gid":24688,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.144:6839/4027821922","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6838","nonce":4027821922},{"type":"v1","addr":"172.21.15.144:6839","nonce":4027821922}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24716":{"gid":24716,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.18:6839/3798713532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6838","nonce":3798713532},{"type":"v1","addr":"172.21.15.18:6839","nonce":3798713532}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24716,"qdb_cluster":[24716,24688,24686]},"id":1}]} 2024-09-21T06:46:58.566 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 25 2024-09-21T06:46:58.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:58.566+0000 7feb01407640 1 -- 172.21.15.7:0/142412419 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7feae40b6680 msgr2=0x7feae40b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:58.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:58.566+0000 7feb01407640 1 --2- 172.21.15.7:0/142412419 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7feae40b6680 0x7feae40b8b90 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7feafc077160 tx=0x7feaec00b390 comp rx=0 tx=0).stop 2024-09-21T06:46:58.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:58.566+0000 7feb01407640 1 -- 172.21.15.7:0/142412419 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feafc109e00 msgr2=0x7feafc076190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:58.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:58.566+0000 7feb01407640 1 --2- 172.21.15.7:0/142412419 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feafc109e00 0x7feafc076190 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7feaf4005cc0 tx=0x7feaf402f380 comp rx=0 tx=0).stop 2024-09-21T06:46:58.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:58.566+0000 7feb01407640 1 -- 172.21.15.7:0/142412419 shutdown_connections 2024-09-21T06:46:58.568 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:58.566+0000 7feb01407640 1 --2- 172.21.15.7:0/142412419 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7feae40b6680 0x7feae40b8b90 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:58.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:58.566+0000 7feb01407640 1 --2- 172.21.15.7:0/142412419 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7feafc109e00 0x7feafc076190 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:58.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:58.566+0000 7feb01407640 1 --2- 172.21.15.7:0/142412419 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7feafc1094b0 0x7feafc075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:58.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:58.566+0000 7feb01407640 1 --2- 172.21.15.7:0/142412419 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feafc103b70 0x7feafc075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:58.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:58.566+0000 7feb01407640 1 -- 172.21.15.7:0/142412419 >> 172.21.15.7:0/142412419 conn(0x7feafc0ff5e0 msgr2=0x7feafc101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:58.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:58.566+0000 7feb01407640 1 -- 172.21.15.7:0/142412419 shutdown_connections 2024-09-21T06:46:58.569 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:58.566+0000 7feb01407640 1 -- 172.21.15.7:0/142412419 wait complete. 2024-09-21T06:46:58.997 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:46:58 smithi144 ceph-mon[34653]: pgmap v650: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-21T06:46:58.998 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:46:58 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/142412419' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:46:59.020 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:46:58 smithi007 ceph-mon[30983]: pgmap v650: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-21T06:46:59.020 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:46:58 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/142412419' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:46:59.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:46:58 smithi018 ceph-mon[34477]: pgmap v650: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-21T06:46:59.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:46:58 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/142412419' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T06:46:59.217 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T06:46:59.479 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:46:59.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:59.955+0000 7f345aa9a640 1 -- 172.21.15.7:0/2565591768 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3454108cf0 msgr2=0x7f345410f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:59.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:59.955+0000 7f345aa9a640 1 --2- 172.21.15.7:0/2565591768 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3454108cf0 0x7f345410f520 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f344c009ca0 tx=0x7f344c02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:46:59.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:59.955+0000 7f345aa9a640 1 -- 172.21.15.7:0/2565591768 shutdown_connections 2024-09-21T06:46:59.966 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:59.955+0000 7f345aa9a640 1 --2- 172.21.15.7:0/2565591768 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f3454108cf0 0x7f345410f520 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:59.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:59.955+0000 7f345aa9a640 1 --2- 172.21.15.7:0/2565591768 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f34541083a0 0x7f34541087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:59.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:59.955+0000 7f345aa9a640 1 --2- 172.21.15.7:0/2565591768 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3454102a60 0x7f3454102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:59.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:59.955+0000 7f345aa9a640 1 -- 172.21.15.7:0/2565591768 >> 172.21.15.7:0/2565591768 conn(0x7f3454079730 msgr2=0x7f3454079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:46:59.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:59.955+0000 7f345aa9a640 1 -- 172.21.15.7:0/2565591768 shutdown_connections 2024-09-21T06:46:59.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:59.955+0000 7f345aa9a640 1 -- 172.21.15.7:0/2565591768 wait complete. 2024-09-21T06:46:59.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:59.956+0000 7f345aa9a640 1 Processor -- start 2024-09-21T06:46:59.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:59.956+0000 7f345aa9a640 1 -- start start 2024-09-21T06:46:59.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:59.956+0000 7f345aa9a640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3454102a60 0x7f345419b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:59.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:59.956+0000 7f345aa9a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f34541083a0 0x7f345419b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:59.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:59.956+0000 7f345aa9a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3454108cf0 0x7f345419bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:59.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:59.956+0000 7f345aa9a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f34541129c0 con 0x7f34541083a0 2024-09-21T06:46:59.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:59.956+0000 7f345aa9a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3454112840 con 0x7f3454108cf0 2024-09-21T06:46:59.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:59.956+0000 7f345aa9a640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f3454112b40 con 0x7f3454102a60 2024-09-21T06:46:59.967 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:59.956+0000 7f3453fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f34541083a0 0x7f345419b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:59.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:59.956+0000 7f3453fff640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f34541083a0 0x7f345419b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:37528/0 (socket says 172.21.15.7:37528) 2024-09-21T06:46:59.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:59.956+0000 7f3453fff640 1 -- 172.21.15.7:0/2034678653 learned_addr learned my addr 172.21.15.7:0/2034678653 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:46:59.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:59.956+0000 7f3459037640 1 --2- 172.21.15.7:0/2034678653 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3454108cf0 0x7f345419bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:59.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:59.956+0000 7f3458836640 1 --2- 172.21.15.7:0/2034678653 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3454102a60 0x7f345419b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:59.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:59.956+0000 7f3453fff640 1 -- 172.21.15.7:0/2034678653 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3454102a60 msgr2=0x7f345419b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:59.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:59.957+0000 7f3453fff640 1 --2- 172.21.15.7:0/2034678653 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3454102a60 0x7f345419b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:59.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:59.957+0000 7f3453fff640 1 -- 172.21.15.7:0/2034678653 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3454108cf0 msgr2=0x7f345419bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:46:59.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:59.957+0000 7f3453fff640 1 --2- 172.21.15.7:0/2034678653 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3454108cf0 0x7f345419bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:46:59.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:59.957+0000 7f3453fff640 1 -- 172.21.15.7:0/2034678653 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34541a6580 con 0x7f34541083a0 2024-09-21T06:46:59.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:59.957+0000 7f3453fff640 1 --2- 172.21.15.7:0/2034678653 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f34541083a0 0x7f345419b7b0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f343c00d770 tx=0x7f343c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:59.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:59.957+0000 7f3451ffb640 1 -- 172.21.15.7:0/2034678653 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f343c017070 con 0x7f34541083a0 2024-09-21T06:46:59.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:59.957+0000 7f345aa9a640 1 -- 172.21.15.7:0/2034678653 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34541a6870 con 0x7f34541083a0 2024-09-21T06:46:59.968 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:59.957+0000 7f3451ffb640 1 -- 172.21.15.7:0/2034678653 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f343c009c30 con 0x7f34541083a0 2024-09-21T06:46:59.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:59.957+0000 7f3451ffb640 1 -- 172.21.15.7:0/2034678653 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f343c00f620 con 0x7f34541083a0 2024-09-21T06:46:59.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:59.957+0000 7f345aa9a640 1 -- 172.21.15.7:0/2034678653 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34541a6e80 con 0x7f34541083a0 2024-09-21T06:46:59.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:59.958+0000 7f345aa9a640 1 -- 172.21.15.7:0/2034678653 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3454102e70 con 0x7f34541083a0 2024-09-21T06:46:59.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:59.960+0000 7f3451ffb640 1 -- 172.21.15.7:0/2034678653 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f343c01a070 con 0x7f34541083a0 2024-09-21T06:46:59.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:59.960+0000 7f3451ffb640 1 --2- 172.21.15.7:0/2034678653 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f34400b6680 0x7f34400b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:46:59.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:59.961+0000 7f3458836640 1 --2- 172.21.15.7:0/2034678653 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f34400b6680 0x7f34400b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:46:59.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:59.961+0000 7f3451ffb640 1 -- 172.21.15.7:0/2034678653 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8412+0+0 (secure 0 0 0) 0x7f343c0e7190 con 0x7f34541083a0 2024-09-21T06:46:59.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:59.961+0000 7f3458836640 1 --2- 172.21.15.7:0/2034678653 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f34400b6680 0x7f34400b8b90 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f345406ba20 tx=0x7f3444008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:46:59.969 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:46:59.964+0000 7f3451ffb640 1 -- 172.21.15.7:0/2034678653 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f343c009de0 con 0x7f34541083a0 2024-09-21T06:47:00.156 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:00.154+0000 7f345aa9a640 1 -- 172.21.15.7:0/2034678653 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f345406b2d0 con 0x7f34541083a0 2024-09-21T06:47:00.157 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:00.155+0000 7f3451ffb640 1 -- 172.21.15.7:0/2034678653 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+22881 (secure 0 0 0) 0x7f345406b2d0 con 0x7f34541083a0 2024-09-21T06:47:00.157 INFO:teuthology.orchestra.run.smithi007.stdout: 2024-09-21T06:47:00.158 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":85,"fsid":"347cb918-77e2-11ef-baf5-efdc52797490","created":"2024-09-21T06:25:51.925032+0000","modified":"2024-09-21T06:46:22.919218+0000","last_up_change":"2024-09-21T06:33:32.888843+0000","last_in_change":"2024-09-21T06:33:09.926778+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T06:29:41.514179+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T06:34:20.531755+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T06:34:22.552541+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":84,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1be5c4a4-3931-4d8b-95c7-c05f5b73fcfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":942632794},{"type":"v1","addr":"172.21.15.7:6803","nonce":942632794}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":942632794},{"type":"v1","addr":"172.21.15.7:6805","nonce":942632794}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":942632794},{"type":"v1","addr":"172.21.15.7:6809","nonce":942632794}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":942632794},{"type":"v1","addr":"172.21.15.7:6807","nonce":942632794}]},"public_addr":"172.21.15.7:6803/942632794","cluster_addr":"172.21.15.7:6805/942632794","heartbeat_back_addr":"172.21.15.7:6809/942632794","heartbeat_front_addr":"172.21.15.7:6807/942632794","state":["exists","up"]},{"osd":1,"uuid":"7ae136a8-c614-47e5-b265-c6cfa857a7fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":1839342931},{"type":"v1","addr":"172.21.15.18:6801","nonce":1839342931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":1839342931},{"type":"v1","addr":"172.21.15.18:6803","nonce":1839342931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":1839342931},{"type":"v1","addr":"172.21.15.18:6807","nonce":1839342931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":1839342931},{"type":"v1","addr":"172.21.15.18:6805","nonce":1839342931}]},"public_addr":"172.21.15.18:6801/1839342931","cluster_addr":"172.21.15.18:6803/1839342931","heartbeat_back_addr":"172.21.15.18:6807/1839342931","heartbeat_front_addr":"172.21.15.18:6805/1839342931","state":["exists","up"]},{"osd":2,"uuid":"97b13994-4680-4573-9c2e-ac65ea740e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":1699582162},{"type":"v1","addr":"172.21.15.144:6801","nonce":1699582162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":1699582162},{"type":"v1","addr":"172.21.15.144:6803","nonce":1699582162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":1699582162},{"type":"v1","addr":"172.21.15.144:6807","nonce":1699582162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":1699582162},{"type":"v1","addr":"172.21.15.144:6805","nonce":1699582162}]},"public_addr":"172.21.15.144:6801/1699582162","cluster_addr":"172.21.15.144:6803/1699582162","heartbeat_back_addr":"172.21.15.144:6807/1699582162","heartbeat_front_addr":"172.21.15.144:6805/1699582162","state":["exists","up"]},{"osd":3,"uuid":"ddf70d51-404d-491d-a6a8-15fca4ef01db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":3202935163},{"type":"v1","addr":"172.21.15.7:6811","nonce":3202935163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":3202935163},{"type":"v1","addr":"172.21.15.7:6813","nonce":3202935163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":3202935163},{"type":"v1","addr":"172.21.15.7:6817","nonce":3202935163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":3202935163},{"type":"v1","addr":"172.21.15.7:6815","nonce":3202935163}]},"public_addr":"172.21.15.7:6811/3202935163","cluster_addr":"172.21.15.7:6813/3202935163","heartbeat_back_addr":"172.21.15.7:6817/3202935163","heartbeat_front_addr":"172.21.15.7:6815/3202935163","state":["exists","up"]},{"osd":4,"uuid":"f2ae4340-accf-4ac0-a4d3-c08302712ce1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":1058105724},{"type":"v1","addr":"172.21.15.18:6809","nonce":1058105724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":1058105724},{"type":"v1","addr":"172.21.15.18:6811","nonce":1058105724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":1058105724},{"type":"v1","addr":"172.21.15.18:6815","nonce":1058105724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":1058105724},{"type":"v1","addr":"172.21.15.18:6813","nonce":1058105724}]},"public_addr":"172.21.15.18:6809/1058105724","cluster_addr":"172.21.15.18:6811/1058105724","heartbeat_back_addr":"172.21.15.18:6815/1058105724","heartbeat_front_addr":"172.21.15.18:6813/1058105724","state":["exists","up"]},{"osd":5,"uuid":"d56abc37-de6f-47a4-9f5e-67224da78f4c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6808","nonce":2814586621},{"type":"v1","addr":"172.21.15.144:6809","nonce":2814586621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6810","nonce":2814586621},{"type":"v1","addr":"172.21.15.144:6811","nonce":2814586621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6814","nonce":2814586621},{"type":"v1","addr":"172.21.15.144:6815","nonce":2814586621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6812","nonce":2814586621},{"type":"v1","addr":"172.21.15.144:6813","nonce":2814586621}]},"public_addr":"172.21.15.144:6809/2814586621","cluster_addr":"172.21.15.144:6811/2814586621","heartbeat_back_addr":"172.21.15.144:6815/2814586621","heartbeat_front_addr":"172.21.15.144:6813/2814586621","state":["exists","up"]},{"osd":6,"uuid":"9145650c-e9b1-4e5a-ae6f-17c8960146e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":3770978305},{"type":"v1","addr":"172.21.15.7:6819","nonce":3770978305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":3770978305},{"type":"v1","addr":"172.21.15.7:6821","nonce":3770978305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":3770978305},{"type":"v1","addr":"172.21.15.7:6825","nonce":3770978305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":3770978305},{"type":"v1","addr":"172.21.15.7:6823","nonce":3770978305}]},"public_addr":"172.21.15.7:6819/3770978305","cluster_addr":"172.21.15.7:6821/3770978305","heartbeat_back_addr":"172.21.15.7:6825/3770978305","heartbeat_front_addr":"172.21.15.7:6823/3770978305","state":["exists","up"]},{"osd":7,"uuid":"ca658683-38f7-47ca-b32e-512fe4738ef1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":1322408496},{"type":"v1","addr":"172.21.15.18:6817","nonce":1322408496}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":1322408496},{"type":"v1","addr":"172.21.15.18:6819","nonce":1322408496}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":1322408496},{"type":"v1","addr":"172.21.15.18:6823","nonce":1322408496}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":1322408496},{"type":"v1","addr":"172.21.15.18:6821","nonce":1322408496}]},"public_addr":"172.21.15.18:6817/1322408496","cluster_addr":"172.21.15.18:6819/1322408496","heartbeat_back_addr":"172.21.15.18:6823/1322408496","heartbeat_front_addr":"172.21.15.18:6821/1322408496","state":["exists","up"]},{"osd":8,"uuid":"40d1f37e-6fac-40b9-9319-78f4fc3a6f20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6816","nonce":1011657022},{"type":"v1","addr":"172.21.15.144:6817","nonce":1011657022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6818","nonce":1011657022},{"type":"v1","addr":"172.21.15.144:6819","nonce":1011657022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6822","nonce":1011657022},{"type":"v1","addr":"172.21.15.144:6823","nonce":1011657022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6820","nonce":1011657022},{"type":"v1","addr":"172.21.15.144:6821","nonce":1011657022}]},"public_addr":"172.21.15.144:6817/1011657022","cluster_addr":"172.21.15.144:6819/1011657022","heartbeat_back_addr":"172.21.15.144:6823/1011657022","heartbeat_front_addr":"172.21.15.144:6821/1011657022","state":["exists","up"]},{"osd":9,"uuid":"ad12d6f7-fd21-49bd-a343-744f3cff4bbb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":256146339},{"type":"v1","addr":"172.21.15.7:6827","nonce":256146339}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":256146339},{"type":"v1","addr":"172.21.15.7:6829","nonce":256146339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6832","nonce":256146339},{"type":"v1","addr":"172.21.15.7:6833","nonce":256146339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":256146339},{"type":"v1","addr":"172.21.15.7:6831","nonce":256146339}]},"public_addr":"172.21.15.7:6827/256146339","cluster_addr":"172.21.15.7:6829/256146339","heartbeat_back_addr":"172.21.15.7:6833/256146339","heartbeat_front_addr":"172.21.15.7:6831/256146339","state":["exists","up"]},{"osd":10,"uuid":"1317a2ad-ec15-4096-b2da-689475b7cacc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":2038885362},{"type":"v1","addr":"172.21.15.18:6825","nonce":2038885362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":2038885362},{"type":"v1","addr":"172.21.15.18:6827","nonce":2038885362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":2038885362},{"type":"v1","addr":"172.21.15.18:6831","nonce":2038885362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":2038885362},{"type":"v1","addr":"172.21.15.18:6829","nonce":2038885362}]},"public_addr":"172.21.15.18:6825/2038885362","cluster_addr":"172.21.15.18:6827/2038885362","heartbeat_back_addr":"172.21.15.18:6831/2038885362","heartbeat_front_addr":"172.21.15.18:6829/2038885362","state":["exists","up"]},{"osd":11,"uuid":"f9252acb-7290-4923-89f3-844c868d4b39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":76,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6824","nonce":1047060848},{"type":"v1","addr":"172.21.15.144:6825","nonce":1047060848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6826","nonce":1047060848},{"type":"v1","addr":"172.21.15.144:6827","nonce":1047060848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6830","nonce":1047060848},{"type":"v1","addr":"172.21.15.144:6831","nonce":1047060848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6828","nonce":1047060848},{"type":"v1","addr":"172.21.15.144:6829","nonce":1047060848}]},"public_addr":"172.21.15.144:6825/1047060848","cluster_addr":"172.21.15.144:6827/1047060848","heartbeat_back_addr":"172.21.15.144:6831/1047060848","heartbeat_front_addr":"172.21.15.144:6829/1047060848","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:28:48.842729+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:29:13.946624+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:29:38.589666+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:30:05.116339+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:30:30.562090+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:30:55.586210+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:31:22.138457+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:31:49.178090+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:32:13.687830+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:32:40.408193+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:33:06.044578+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T06:33:30.988851+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.7:0/1296137341":"2024-09-22T06:27:43.044484+0000","172.21.15.7:6801/3879502931":"2024-09-22T06:27:43.044484+0000","172.21.15.7:0/1926706877":"2024-09-22T06:26:40.520265+0000","172.21.15.7:0/2034370456":"2024-09-22T06:26:14.181426+0000","172.21.15.7:6801/3339522713":"2024-09-22T06:26:14.181426+0000","172.21.15.7:6800/3339522713":"2024-09-22T06:26:14.181426+0000","172.21.15.7:0/3586807770":"2024-09-22T06:26:14.181426+0000","172.21.15.7:0/1814223919":"2024-09-22T06:27:43.044484+0000","172.21.15.7:0/601150037":"2024-09-22T06:26:40.520265+0000","172.21.15.7:6800/3876787626":"2024-09-22T06:26:40.520265+0000","172.21.15.7:0/186444636":"2024-09-22T06:26:14.181426+0000","172.21.15.7:0/2180184348":"2024-09-22T06:26:40.520265+0000","172.21.15.7:6801/3876787626":"2024-09-22T06:26:40.520265+0000","172.21.15.7:0/2931793461":"2024-09-22T06:27:43.044484+0000","172.21.15.7:6800/3879502931":"2024-09-22T06:27:43.044484+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T06:47:00.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:00.158+0000 7f345aa9a640 1 -- 172.21.15.7:0/2034678653 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f34400b6680 msgr2=0x7f34400b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:00.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:00.158+0000 7f345aa9a640 1 --2- 172.21.15.7:0/2034678653 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f34400b6680 0x7f34400b8b90 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f345406ba20 tx=0x7f3444008040 comp rx=0 tx=0).stop 2024-09-21T06:47:00.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:00.158+0000 7f345aa9a640 1 -- 172.21.15.7:0/2034678653 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f34541083a0 msgr2=0x7f345419b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:00.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:00.158+0000 7f345aa9a640 1 --2- 172.21.15.7:0/2034678653 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f34541083a0 0x7f345419b7b0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f343c00d770 tx=0x7f343c00dc30 comp rx=0 tx=0).stop 2024-09-21T06:47:00.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:00.158+0000 7f345aa9a640 1 -- 172.21.15.7:0/2034678653 shutdown_connections 2024-09-21T06:47:00.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:00.158+0000 7f345aa9a640 1 --2- 172.21.15.7:0/2034678653 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f34400b6680 0x7f34400b8b90 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:00.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:00.158+0000 7f345aa9a640 1 --2- 172.21.15.7:0/2034678653 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3454108cf0 0x7f345419bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:00.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:00.158+0000 7f345aa9a640 1 --2- 172.21.15.7:0/2034678653 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f34541083a0 0x7f345419b7b0 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:00.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:00.158+0000 7f345aa9a640 1 --2- 172.21.15.7:0/2034678653 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f3454102a60 0x7f345419b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:00.160 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:00.158+0000 7f345aa9a640 1 -- 172.21.15.7:0/2034678653 >> 172.21.15.7:0/2034678653 conn(0x7f3454079730 msgr2=0x7f34541052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:00.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:00.158+0000 7f345aa9a640 1 -- 172.21.15.7:0/2034678653 shutdown_connections 2024-09-21T06:47:00.161 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:00.158+0000 7f345aa9a640 1 -- 172.21.15.7:0/2034678653 wait complete. 2024-09-21T06:47:00.779 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:47:00 smithi007 ceph-mon[30983]: pgmap v651: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-21T06:47:00.780 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:47:00 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2034678653' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:47:00.808 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph fs fail cephfs 2024-09-21T06:47:01.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:47:00 smithi144 ceph-mon[34653]: pgmap v651: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-21T06:47:01.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:47:00 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/2034678653' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:47:01.064 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:47:01.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:47:00 smithi018 ceph-mon[34477]: pgmap v651: 97 pgs: 97 active+clean; 3.3 MiB data, 426 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-21T06:47:01.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:47:00 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/2034678653' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T06:47:01.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:01.542+0000 7f48b7c69640 1 -- 172.21.15.7:0/2858479887 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48b0103b60 msgr2=0x7f48b0103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:01.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:01.542+0000 7f48b7c69640 1 --2- 172.21.15.7:0/2858479887 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48b0103b60 0x7f48b0103f70 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f48ac009900 tx=0x7f48ac02a410 comp rx=0 tx=0).stop 2024-09-21T06:47:01.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:01.542+0000 7f48b7c69640 1 -- 172.21.15.7:0/2858479887 shutdown_connections 2024-09-21T06:47:01.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:01.542+0000 7f48b7c69640 1 --2- 172.21.15.7:0/2858479887 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f48b0109df0 0x7f48b0110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:01.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:01.542+0000 7f48b7c69640 1 --2- 172.21.15.7:0/2858479887 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f48b01094a0 0x7f48b01098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:01.551 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:01.542+0000 7f48b7c69640 1 --2- 172.21.15.7:0/2858479887 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48b0103b60 0x7f48b0103f70 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:01.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:01.542+0000 7f48b7c69640 1 -- 172.21.15.7:0/2858479887 >> 172.21.15.7:0/2858479887 conn(0x7f48b007b850 msgr2=0x7f48b007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:01.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:01.543+0000 7f48b7c69640 1 -- 172.21.15.7:0/2858479887 shutdown_connections 2024-09-21T06:47:01.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:01.543+0000 7f48b7c69640 1 -- 172.21.15.7:0/2858479887 wait complete. 2024-09-21T06:47:01.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:01.543+0000 7f48b7c69640 1 Processor -- start 2024-09-21T06:47:01.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:01.543+0000 7f48b7c69640 1 -- start start 2024-09-21T06:47:01.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:01.543+0000 7f48b7c69640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48b0103b60 0x7f48b019a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:01.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:01.544+0000 7f48b7c69640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f48b01094a0 0x7f48b019aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:01.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:01.544+0000 7f48b7c69640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f48b0109df0 0x7f48b019fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:01.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:01.544+0000 7f48b7c69640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f48b0113b40 con 0x7f48b0103b60 2024-09-21T06:47:01.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:01.544+0000 7f48b7c69640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f48b01139c0 con 0x7f48b0109df0 2024-09-21T06:47:01.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:01.544+0000 7f48b7c69640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f48b0113cc0 con 0x7f48b01094a0 2024-09-21T06:47:01.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:01.544+0000 7f48b5a05640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48b0103b60 0x7f48b019a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:01.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:01.544+0000 7f48b5a05640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48b0103b60 0x7f48b019a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:45996/0 (socket says 172.21.15.7:45996) 2024-09-21T06:47:01.552 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:01.544+0000 7f48b5a05640 1 -- 172.21.15.7:0/3635686874 learned_addr learned my addr 172.21.15.7:0/3635686874 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:47:01.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:01.544+0000 7f48b5204640 1 --2- 172.21.15.7:0/3635686874 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f48b01094a0 0x7f48b019aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:01.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:01.544+0000 7f48b6206640 1 --2- 172.21.15.7:0/3635686874 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f48b0109df0 0x7f48b019fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:01.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:01.544+0000 7f48b5a05640 1 -- 172.21.15.7:0/3635686874 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f48b01094a0 msgr2=0x7f48b019aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:01.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:01.544+0000 7f48b5a05640 1 --2- 172.21.15.7:0/3635686874 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f48b01094a0 0x7f48b019aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:01.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:01.544+0000 7f48b5a05640 1 -- 172.21.15.7:0/3635686874 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f48b0109df0 msgr2=0x7f48b019fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:01.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:01.544+0000 7f48b5a05640 1 --2- 172.21.15.7:0/3635686874 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f48b0109df0 0x7f48b019fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:01.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:01.544+0000 7f48b5a05640 1 -- 172.21.15.7:0/3635686874 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48b01a0460 con 0x7f48b0103b60 2024-09-21T06:47:01.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:01.544+0000 7f48b5204640 1 --2- 172.21.15.7:0/3635686874 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f48b01094a0 0x7f48b019aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T06:47:01.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:01.544+0000 7f48b5a05640 1 --2- 172.21.15.7:0/3635686874 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48b0103b60 0x7f48b019a4f0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f48ac005ab0 tx=0x7f48ac003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:01.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:01.544+0000 7f48a6ffd640 1 -- 172.21.15.7:0/3635686874 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48ac03f070 con 0x7f48b0103b60 2024-09-21T06:47:01.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:01.544+0000 7f48a6ffd640 1 -- 172.21.15.7:0/3635686874 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f48ac031d60 con 0x7f48b0103b60 2024-09-21T06:47:01.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:01.544+0000 7f48b7c69640 1 -- 172.21.15.7:0/3635686874 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48b01a06f0 con 0x7f48b0103b60 2024-09-21T06:47:01.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:01.544+0000 7f48a6ffd640 1 -- 172.21.15.7:0/3635686874 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48ac035030 con 0x7f48b0103b60 2024-09-21T06:47:01.553 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:01.545+0000 7f48b7c69640 1 -- 172.21.15.7:0/3635686874 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48b01a6eb0 con 0x7f48b0103b60 2024-09-21T06:47:01.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:01.546+0000 7f48b7c69640 1 -- 172.21.15.7:0/3635686874 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48b0103f70 con 0x7f48b0103b60 2024-09-21T06:47:01.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:01.547+0000 7f48a6ffd640 1 -- 172.21.15.7:0/3635686874 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f48ac042070 con 0x7f48b0103b60 2024-09-21T06:47:01.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:01.548+0000 7f48a6ffd640 1 --2- 172.21.15.7:0/3635686874 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f489c0b6700 0x7f489c0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:01.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:01.548+0000 7f48b5204640 1 --2- 172.21.15.7:0/3635686874 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f489c0b6700 0x7f489c0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:01.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:01.548+0000 7f48a6ffd640 1 -- 172.21.15.7:0/3635686874 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8412+0+0 (secure 0 0 0) 0x7f48ac108590 con 0x7f48b0103b60 2024-09-21T06:47:01.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:01.549+0000 7f48b5204640 1 --2- 172.21.15.7:0/3635686874 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f489c0b6700 0x7f489c0b8c10 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f48b0109040 tx=0x7f48a0008040 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:01.554 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:01.552+0000 7f48a6ffd640 1 -- 172.21.15.7:0/3635686874 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f48ac0ceb50 con 0x7f48b0103b60 2024-09-21T06:47:01.782 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:01.780+0000 7f48b7c69640 1 -- 172.21.15.7:0/3635686874 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f48b002e640 con 0x7f48b0103b60 2024-09-21T06:47:01.785 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:01.783+0000 7f48a6ffd640 1 -- 172.21.15.7:0/3635686874 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v26) ==== 161+0+0 (secure 0 0 0) 0x7f48ac0d2f30 con 0x7f48b0103b60 2024-09-21T06:47:01.785 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-21T06:47:01.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:01.786+0000 7f48b7c69640 1 -- 172.21.15.7:0/3635686874 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f489c0b6700 msgr2=0x7f489c0b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:01.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:01.786+0000 7f48b7c69640 1 --2- 172.21.15.7:0/3635686874 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f489c0b6700 0x7f489c0b8c10 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f48b0109040 tx=0x7f48a0008040 comp rx=0 tx=0).stop 2024-09-21T06:47:01.788 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:01.786+0000 7f48b7c69640 1 -- 172.21.15.7:0/3635686874 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48b0103b60 msgr2=0x7f48b019a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:01.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:01.786+0000 7f48b7c69640 1 --2- 172.21.15.7:0/3635686874 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48b0103b60 0x7f48b019a4f0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f48ac005ab0 tx=0x7f48ac003cd0 comp rx=0 tx=0).stop 2024-09-21T06:47:01.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:01.787+0000 7f48b7c69640 1 -- 172.21.15.7:0/3635686874 shutdown_connections 2024-09-21T06:47:01.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:01.787+0000 7f48b7c69640 1 --2- 172.21.15.7:0/3635686874 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f489c0b6700 0x7f489c0b8c10 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:01.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:01.787+0000 7f48b7c69640 1 --2- 172.21.15.7:0/3635686874 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f48b0109df0 0x7f48b019fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:01.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:01.787+0000 7f48b7c69640 1 --2- 172.21.15.7:0/3635686874 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f48b01094a0 0x7f48b019aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:01.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:01.787+0000 7f48b7c69640 1 --2- 172.21.15.7:0/3635686874 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f48b0103b60 0x7f48b019a4f0 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:01.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:01.787+0000 7f48b7c69640 1 -- 172.21.15.7:0/3635686874 >> 172.21.15.7:0/3635686874 conn(0x7f48b007b850 msgr2=0x7f48b0107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:01.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:01.787+0000 7f48b7c69640 1 -- 172.21.15.7:0/3635686874 shutdown_connections 2024-09-21T06:47:01.789 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:01.787+0000 7f48b7c69640 1 -- 172.21.15.7:0/3635686874 wait complete. 2024-09-21T06:47:02.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:47:01 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mon-a[30979]: 2024-09-21T06:47:01.782+0000 7feeaf1fe640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T06:47:02.119 INFO:journalctl@ceph.mds.b.smithi018.stdout:Sep 21 06:47:01 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-b[63345]: ignoring --setuser ceph since I am not root 2024-09-21T06:47:02.119 INFO:journalctl@ceph.mds.b.smithi018.stdout:Sep 21 06:47:01 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-b[63345]: ignoring --setgroup ceph since I am not root 2024-09-21T06:47:02.119 INFO:journalctl@ceph.mds.b.smithi018.stdout:Sep 21 06:47:01 smithi018 ceph-mds[63349]: -- 172.21.15.18:0/2689966555 <== mon.2 v2:172.21.15.18:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c2d8041860 con 0x55c2dc1e9600 2024-09-21T06:47:02.119 INFO:journalctl@ceph.mds.b.smithi018.stdout:Sep 21 06:47:01 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-b[63345]: starting mds.b at 2024-09-21T06:47:02.120 INFO:journalctl@ceph.mds.e.smithi018.stdout:Sep 21 06:47:01 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-e[62805]: ignoring --setuser ceph since I am not root 2024-09-21T06:47:02.120 INFO:journalctl@ceph.mds.e.smithi018.stdout:Sep 21 06:47:01 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-e[62805]: ignoring --setgroup ceph since I am not root 2024-09-21T06:47:02.120 INFO:journalctl@ceph.mds.e.smithi018.stdout:Sep 21 06:47:01 smithi018 ceph-mds[62809]: -- 172.21.15.18:0/1607240503 <== mon.2 v2:172.21.15.18:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55cd5a429860 con 0x55cd5e5d1180 2024-09-21T06:47:02.120 INFO:journalctl@ceph.mds.e.smithi018.stdout:Sep 21 06:47:01 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-e[62805]: starting mds.e at 2024-09-21T06:47:02.120 INFO:journalctl@ceph.mds.h.smithi018.stdout:Sep 21 06:47:01 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-h[63079]: ignoring --setuser ceph since I am not root 2024-09-21T06:47:02.120 INFO:journalctl@ceph.mds.h.smithi018.stdout:Sep 21 06:47:01 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-h[63079]: ignoring --setgroup ceph since I am not root 2024-09-21T06:47:02.120 INFO:journalctl@ceph.mds.h.smithi018.stdout:Sep 21 06:47:01 smithi018 ceph-mds[63083]: -- 172.21.15.18:0/45349316 <== mon.0 v2:172.21.15.7:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557782be7860 con 0x557786d8fa80 2024-09-21T06:47:02.120 INFO:journalctl@ceph.mds.h.smithi018.stdout:Sep 21 06:47:01 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-h[63079]: starting mds.h at 2024-09-21T06:47:02.285 INFO:journalctl@ceph.mds.f.smithi144.stdout:Sep 21 06:47:01 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-f[63784]: ignoring --setuser ceph since I am not root 2024-09-21T06:47:02.285 INFO:journalctl@ceph.mds.f.smithi144.stdout:Sep 21 06:47:01 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-f[63784]: ignoring --setgroup ceph since I am not root 2024-09-21T06:47:02.285 INFO:journalctl@ceph.mds.f.smithi144.stdout:Sep 21 06:47:01 smithi144 ceph-mds[63788]: -- 172.21.15.144:0/2348111223 <== mon.1 v2:172.21.15.144:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563fe7205860 con 0x563feb3ad600 2024-09-21T06:47:02.285 INFO:journalctl@ceph.mds.f.smithi144.stdout:Sep 21 06:47:01 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-f[63784]: starting mds.f at 2024-09-21T06:47:02.285 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 21 06:47:01 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-i[64318]: ignoring --setuser ceph since I am not root 2024-09-21T06:47:02.285 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 21 06:47:01 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-i[64318]: ignoring --setgroup ceph since I am not root 2024-09-21T06:47:02.286 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 21 06:47:01 smithi144 ceph-mds[64322]: -- 172.21.15.144:0/3726854593 <== mon.1 v2:172.21.15.144:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5605604d9860 con 0x560564681180 2024-09-21T06:47:02.286 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 21 06:47:01 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-i[64318]: starting mds.i at 2024-09-21T06:47:02.286 INFO:journalctl@ceph.mds.c.smithi144.stdout:Sep 21 06:47:01 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-c[64051]: ignoring --setuser ceph since I am not root 2024-09-21T06:47:02.286 INFO:journalctl@ceph.mds.c.smithi144.stdout:Sep 21 06:47:01 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-c[64051]: ignoring --setgroup ceph since I am not root 2024-09-21T06:47:02.286 INFO:journalctl@ceph.mds.c.smithi144.stdout:Sep 21 06:47:01 smithi144 ceph-mds[64055]: -- 172.21.15.144:0/437327495 <== mon.1 v2:172.21.15.144:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55fc362b5860 con 0x55fc3a45d180 2024-09-21T06:47:02.286 INFO:journalctl@ceph.mds.c.smithi144.stdout:Sep 21 06:47:01 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-c[64051]: starting mds.c at 2024-09-21T06:47:02.455 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-21T06:47:02.717 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:47:02.977 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:47:02 smithi007 ceph-mon[30983]: pgmap v652: 97 pgs: 97 active+clean; 3.3 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 938 B/s wr, 7 op/s 2024-09-21T06:47:02.977 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:47:02 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/3635686874' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T06:47:02.977 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:47:02 smithi007 ceph-mon[30983]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T06:47:02.977 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:47:02 smithi007 ceph-mon[30983]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T06:47:02.977 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:47:02 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/3635686874' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-21T06:47:02.977 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:47:02 smithi007 ceph-mon[30983]: osdmap e86: 12 total, 12 up, 12 in 2024-09-21T06:47:02.977 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:47:02 smithi007 ceph-mon[30983]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-21T06:47:03.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:47:02 smithi144 ceph-mon[34653]: pgmap v652: 97 pgs: 97 active+clean; 3.3 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 938 B/s wr, 7 op/s 2024-09-21T06:47:03.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:47:02 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/3635686874' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T06:47:03.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:47:02 smithi144 ceph-mon[34653]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T06:47:03.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:47:02 smithi144 ceph-mon[34653]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T06:47:03.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:47:02 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/3635686874' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-21T06:47:03.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:47:02 smithi144 ceph-mon[34653]: osdmap e86: 12 total, 12 up, 12 in 2024-09-21T06:47:03.036 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:47:02 smithi144 ceph-mon[34653]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-21T06:47:03.036 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:47:02 smithi018 ceph-mon[34477]: pgmap v652: 97 pgs: 97 active+clean; 3.3 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 938 B/s wr, 7 op/s 2024-09-21T06:47:03.036 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:47:02 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/3635686874' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T06:47:03.036 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:47:02 smithi018 ceph-mon[34477]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T06:47:03.036 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:47:02 smithi018 ceph-mon[34477]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T06:47:03.036 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:47:02 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/3635686874' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-21T06:47:03.036 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:47:02 smithi018 ceph-mon[34477]: osdmap e86: 12 total, 12 up, 12 in 2024-09-21T06:47:03.036 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:47:02 smithi018 ceph-mon[34477]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-21T06:47:03.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:03.199+0000 7fb5b966a640 1 -- 172.21.15.7:0/3424880791 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5b4107c30 msgr2=0x7fb5b41080f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:03.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:03.199+0000 7fb5b966a640 1 --2- 172.21.15.7:0/3424880791 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5b4107c30 0x7fb5b41080f0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac009ca0 tx=0x7fb5ac02a8c0 comp rx=0 tx=0).stop 2024-09-21T06:47:03.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:03.199+0000 7fb5b966a640 1 -- 172.21.15.7:0/3424880791 shutdown_connections 2024-09-21T06:47:03.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:03.199+0000 7fb5b966a640 1 --2- 172.21.15.7:0/3424880791 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5b4107c30 0x7fb5b41080f0 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:03.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:03.199+0000 7fb5b966a640 1 --2- 172.21.15.7:0/3424880791 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb5b4103170 0x7fb5b41076a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:03.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:03.199+0000 7fb5b966a640 1 --2- 172.21.15.7:0/3424880791 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5b4102820 0x7fb5b4102c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:03.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:03.199+0000 7fb5b966a640 1 -- 172.21.15.7:0/3424880791 >> 172.21.15.7:0/3424880791 conn(0x7fb5b4079760 msgr2=0x7fb5b4079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:03.201 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:03.199+0000 7fb5b966a640 1 -- 172.21.15.7:0/3424880791 shutdown_connections 2024-09-21T06:47:03.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:03.199+0000 7fb5b966a640 1 -- 172.21.15.7:0/3424880791 wait complete. 2024-09-21T06:47:03.202 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:03.199+0000 7fb5b966a640 1 Processor -- start 2024-09-21T06:47:03.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:03.200+0000 7fb5b966a640 1 -- start start 2024-09-21T06:47:03.203 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:03.200+0000 7fb5b966a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb5b4102820 0x7fb5b41a0a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:03.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:03.200+0000 7fb5b966a640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5b4103170 0x7fb5b41a0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:03.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:03.200+0000 7fb5b966a640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5b4107c30 0x7fb5b41a6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:03.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:03.200+0000 7fb5b966a640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b411a0a0 con 0x7fb5b4107c30 2024-09-21T06:47:03.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:03.200+0000 7fb5b966a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b4119f20 con 0x7fb5b4102820 2024-09-21T06:47:03.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:03.200+0000 7fb5b966a640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b411a220 con 0x7fb5b4103170 2024-09-21T06:47:03.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:03.200+0000 7fb5b37fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5b4107c30 0x7fb5b41a6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:03.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:03.200+0000 7fb5b2ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb5b4102820 0x7fb5b41a0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:03.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:03.200+0000 7fb5b37fe640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5b4107c30 0x7fb5b41a6270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46012/0 (socket says 172.21.15.7:46012) 2024-09-21T06:47:03.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:03.200+0000 7fb5b37fe640 1 -- 172.21.15.7:0/1016726359 learned_addr learned my addr 172.21.15.7:0/1016726359 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:47:03.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:03.200+0000 7fb5aa7fc640 1 --2- 172.21.15.7:0/1016726359 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5b4103170 0x7fb5b41a0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:03.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:03.200+0000 7fb5b2ffd640 1 -- 172.21.15.7:0/1016726359 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5b4103170 msgr2=0x7fb5b41a0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:03.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:03.200+0000 7fb5b2ffd640 1 --2- 172.21.15.7:0/1016726359 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5b4103170 0x7fb5b41a0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:03.204 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:03.200+0000 7fb5b2ffd640 1 -- 172.21.15.7:0/1016726359 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5b4107c30 msgr2=0x7fb5b41a6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:03.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:03.200+0000 7fb5b2ffd640 1 --2- 172.21.15.7:0/1016726359 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5b4107c30 0x7fb5b41a6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:03.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:03.200+0000 7fb5b2ffd640 1 -- 172.21.15.7:0/1016726359 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5b41a69a0 con 0x7fb5b4102820 2024-09-21T06:47:03.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:03.201+0000 7fb5b2ffd640 1 --2- 172.21.15.7:0/1016726359 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb5b4102820 0x7fb5b41a0a30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb5a400d6a0 tx=0x7fb5a400db60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:03.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:03.201+0000 7fb5b0ff9640 1 -- 172.21.15.7:0/1016726359 <== mon.2 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5a4017070 con 0x7fb5b4102820 2024-09-21T06:47:03.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:03.201+0000 7fb5b966a640 1 -- 172.21.15.7:0/1016726359 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5b41a6c90 con 0x7fb5b4102820 2024-09-21T06:47:03.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:03.201+0000 7fb5b0ff9640 1 -- 172.21.15.7:0/1016726359 <== mon.2 v2:172.21.15.18:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb5a4009cd0 con 0x7fb5b4102820 2024-09-21T06:47:03.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:03.201+0000 7fb5b0ff9640 1 -- 172.21.15.7:0/1016726359 <== mon.2 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5a4003b60 con 0x7fb5b4102820 2024-09-21T06:47:03.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:03.201+0000 7fb5b966a640 1 -- 172.21.15.7:0/1016726359 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5b41ad3f0 con 0x7fb5b4102820 2024-09-21T06:47:03.205 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:03.202+0000 7fb5b966a640 1 -- 172.21.15.7:0/1016726359 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5b406c1f0 con 0x7fb5b4102820 2024-09-21T06:47:03.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:03.204+0000 7fb5b0ff9640 1 -- 172.21.15.7:0/1016726359 <== mon.2 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7fb5a40042b0 con 0x7fb5b4102820 2024-09-21T06:47:03.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:03.205+0000 7fb5b0ff9640 1 --2- 172.21.15.7:0/1016726359 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fb5a00b6680 0x7fb5a00b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:03.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:03.205+0000 7fb5aa7fc640 1 --2- 172.21.15.7:0/1016726359 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fb5a00b6680 0x7fb5a00b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:03.206 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:03.205+0000 7fb5b0ff9640 1 -- 172.21.15.7:0/1016726359 <== mon.2 v2:172.21.15.18:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8626+0+0 (secure 0 0 0) 0x7fb5a40e7540 con 0x7fb5b4102820 2024-09-21T06:47:03.207 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:03.205+0000 7fb5aa7fc640 1 --2- 172.21.15.7:0/1016726359 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fb5a00b6680 0x7fb5a00b8b90 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fb59c0095f0 tx=0x7fb59c005f90 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:03.209 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:03.208+0000 7fb5b0ff9640 1 -- 172.21.15.7:0/1016726359 <== mon.2 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb5a40ada20 con 0x7fb5b4102820 2024-09-21T06:47:03.458 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:03.456+0000 7fb5b966a640 1 -- 172.21.15.7:0/1016726359 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fb5b41a1b60 con 0x7fb5b4102820 2024-09-21T06:47:03.796 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:03.794+0000 7fb5b0ff9640 1 -- 172.21.15.7:0/1016726359 <== mon.2 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v28) ==== 104+0+0 (secure 0 0 0) 0x7fb5a40b1e00 con 0x7fb5b4102820 2024-09-21T06:47:03.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:03.796+0000 7fb5b966a640 1 -- 172.21.15.7:0/1016726359 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fb5a00b6680 msgr2=0x7fb5a00b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:03.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:03.796+0000 7fb5b966a640 1 --2- 172.21.15.7:0/1016726359 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fb5a00b6680 0x7fb5a00b8b90 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fb59c0095f0 tx=0x7fb59c005f90 comp rx=0 tx=0).stop 2024-09-21T06:47:03.798 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:03.796+0000 7fb5b966a640 1 -- 172.21.15.7:0/1016726359 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb5b4102820 msgr2=0x7fb5b41a0a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:03.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:03.796+0000 7fb5b966a640 1 --2- 172.21.15.7:0/1016726359 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb5b4102820 0x7fb5b41a0a30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb5a400d6a0 tx=0x7fb5a400db60 comp rx=0 tx=0).stop 2024-09-21T06:47:03.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:03.797+0000 7fb5b966a640 1 -- 172.21.15.7:0/1016726359 shutdown_connections 2024-09-21T06:47:03.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:03.797+0000 7fb5b966a640 1 --2- 172.21.15.7:0/1016726359 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7fb5a00b6680 0x7fb5a00b8b90 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:03.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:03.797+0000 7fb5b966a640 1 --2- 172.21.15.7:0/1016726359 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7fb5b4107c30 0x7fb5b41a6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:03.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:03.797+0000 7fb5b966a640 1 --2- 172.21.15.7:0/1016726359 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7fb5b4103170 0x7fb5b41a0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:03.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:03.797+0000 7fb5b966a640 1 --2- 172.21.15.7:0/1016726359 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb5b4102820 0x7fb5b41a0a30 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:03.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:03.797+0000 7fb5b966a640 1 -- 172.21.15.7:0/1016726359 >> 172.21.15.7:0/1016726359 conn(0x7fb5b4079760 msgr2=0x7fb5b4105650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:03.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:03.797+0000 7fb5b966a640 1 -- 172.21.15.7:0/1016726359 shutdown_connections 2024-09-21T06:47:03.799 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:03.797+0000 7fb5b966a640 1 -- 172.21.15.7:0/1016726359 wait complete. 2024-09-21T06:47:04.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:47:03 smithi007 ceph-mon[30983]: mds.? [v2:172.21.15.18:6834/2090420551,v1:172.21.15.18:6835/2090420551] up:boot 2024-09-21T06:47:04.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:47:03 smithi007 ceph-mon[30983]: mds.? [v2:172.21.15.144:6834/1752171245,v1:172.21.15.144:6835/1752171245] up:boot 2024-09-21T06:47:04.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:47:03 smithi007 ceph-mon[30983]: mds.? [v2:172.21.15.144:6836/3115012131,v1:172.21.15.144:6837/3115012131] up:boot 2024-09-21T06:47:04.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:47:03 smithi007 ceph-mon[30983]: mds.? [v2:172.21.15.144:6838/4169022961,v1:172.21.15.144:6839/4169022961] up:boot 2024-09-21T06:47:04.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:47:03 smithi007 ceph-mon[30983]: mds.? [v2:172.21.15.18:6836/3394291904,v1:172.21.15.18:6838/3394291904] up:boot 2024-09-21T06:47:04.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:47:03 smithi007 ceph-mon[30983]: mds.? [v2:172.21.15.18:6837/1657640600,v1:172.21.15.18:6839/1657640600] up:boot 2024-09-21T06:47:04.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:47:03 smithi007 ceph-mon[30983]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-21T06:47:04.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:47:03 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T06:47:04.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:47:03 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T06:47:04.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:47:03 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T06:47:04.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:47:03 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T06:47:04.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:47:03 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T06:47:04.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:47:03 smithi007 ceph-mon[30983]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T06:47:04.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:47:03 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/1016726359' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T06:47:04.091 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:47:03 smithi007 ceph-mon[30983]: from='client.? ' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T06:47:04.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:47:03 smithi018 ceph-mon[34477]: mds.? [v2:172.21.15.18:6834/2090420551,v1:172.21.15.18:6835/2090420551] up:boot 2024-09-21T06:47:04.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:47:03 smithi018 ceph-mon[34477]: mds.? [v2:172.21.15.144:6834/1752171245,v1:172.21.15.144:6835/1752171245] up:boot 2024-09-21T06:47:04.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:47:03 smithi018 ceph-mon[34477]: mds.? [v2:172.21.15.144:6836/3115012131,v1:172.21.15.144:6837/3115012131] up:boot 2024-09-21T06:47:04.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:47:03 smithi018 ceph-mon[34477]: mds.? [v2:172.21.15.144:6838/4169022961,v1:172.21.15.144:6839/4169022961] up:boot 2024-09-21T06:47:04.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:47:03 smithi018 ceph-mon[34477]: mds.? [v2:172.21.15.18:6836/3394291904,v1:172.21.15.18:6838/3394291904] up:boot 2024-09-21T06:47:04.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:47:03 smithi018 ceph-mon[34477]: mds.? [v2:172.21.15.18:6837/1657640600,v1:172.21.15.18:6839/1657640600] up:boot 2024-09-21T06:47:04.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:47:03 smithi018 ceph-mon[34477]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-21T06:47:04.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:47:03 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T06:47:04.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:47:03 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T06:47:04.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:47:03 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T06:47:04.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:47:03 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T06:47:04.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:47:03 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T06:47:04.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:47:03 smithi018 ceph-mon[34477]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T06:47:04.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:47:03 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/1016726359' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T06:47:04.120 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:47:03 smithi018 ceph-mon[34477]: from='client.? ' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T06:47:04.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:47:03 smithi144 ceph-mon[34653]: mds.? [v2:172.21.15.18:6834/2090420551,v1:172.21.15.18:6835/2090420551] up:boot 2024-09-21T06:47:04.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:47:03 smithi144 ceph-mon[34653]: mds.? [v2:172.21.15.144:6834/1752171245,v1:172.21.15.144:6835/1752171245] up:boot 2024-09-21T06:47:04.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:47:03 smithi144 ceph-mon[34653]: mds.? [v2:172.21.15.144:6836/3115012131,v1:172.21.15.144:6837/3115012131] up:boot 2024-09-21T06:47:04.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:47:03 smithi144 ceph-mon[34653]: mds.? [v2:172.21.15.144:6838/4169022961,v1:172.21.15.144:6839/4169022961] up:boot 2024-09-21T06:47:04.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:47:03 smithi144 ceph-mon[34653]: mds.? [v2:172.21.15.18:6836/3394291904,v1:172.21.15.18:6838/3394291904] up:boot 2024-09-21T06:47:04.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:47:03 smithi144 ceph-mon[34653]: mds.? [v2:172.21.15.18:6837/1657640600,v1:172.21.15.18:6839/1657640600] up:boot 2024-09-21T06:47:04.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:47:03 smithi144 ceph-mon[34653]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-21T06:47:04.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:47:03 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T06:47:04.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:47:03 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T06:47:04.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:47:03 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T06:47:04.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:47:03 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T06:47:04.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:47:03 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T06:47:04.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:47:03 smithi144 ceph-mon[34653]: from='mgr.14223 172.21.15.7:0/963264594' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T06:47:04.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:47:03 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/1016726359' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T06:47:04.286 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:47:03 smithi144 ceph-mon[34653]: from='client.? ' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T06:47:04.423 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-21T06:47:04.686 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:47:05.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:47:04 smithi007 ceph-mon[30983]: pgmap v654: 97 pgs: 97 active+clean; 3.3 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-21T06:47:05.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:47:04 smithi007 ceph-mon[30983]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T06:47:05.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:47:04 smithi007 ceph-mon[30983]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T06:47:05.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:47:04 smithi007 ceph-mon[30983]: Cluster is now healthy 2024-09-21T06:47:05.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:47:04 smithi007 ceph-mon[30983]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-21T06:47:05.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:47:04 smithi007 ceph-mon[30983]: fsmap 12 up:standby 2024-09-21T06:47:05.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:47:04 smithi018 ceph-mon[34477]: pgmap v654: 97 pgs: 97 active+clean; 3.3 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-21T06:47:05.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:47:04 smithi018 ceph-mon[34477]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T06:47:05.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:47:04 smithi018 ceph-mon[34477]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T06:47:05.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:47:04 smithi018 ceph-mon[34477]: Cluster is now healthy 2024-09-21T06:47:05.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:47:04 smithi018 ceph-mon[34477]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-21T06:47:05.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:47:04 smithi018 ceph-mon[34477]: fsmap 12 up:standby 2024-09-21T06:47:05.186 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:47:04 smithi144 ceph-mon[34653]: pgmap v654: 97 pgs: 97 active+clean; 3.3 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-21T06:47:05.186 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:47:04 smithi144 ceph-mon[34653]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T06:47:05.186 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:47:04 smithi144 ceph-mon[34653]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T06:47:05.186 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:47:04 smithi144 ceph-mon[34653]: Cluster is now healthy 2024-09-21T06:47:05.187 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:47:04 smithi144 ceph-mon[34653]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-21T06:47:05.187 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:47:04 smithi144 ceph-mon[34653]: fsmap 12 up:standby 2024-09-21T06:47:05.233 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:05.231+0000 7f833f686640 1 -- 172.21.15.7:0/498983117 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8338102a60 msgr2=0x7f8338102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:05.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:05.231+0000 7f833f686640 1 --2- 172.21.15.7:0/498983117 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8338102a60 0x7f8338102e70 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f8334009900 tx=0x7f833402a410 comp rx=0 tx=0).stop 2024-09-21T06:47:05.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:05.231+0000 7f833f686640 1 -- 172.21.15.7:0/498983117 shutdown_connections 2024-09-21T06:47:05.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:05.231+0000 7f833f686640 1 --2- 172.21.15.7:0/498983117 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f8338108cf0 0x7f833810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:05.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:05.231+0000 7f833f686640 1 --2- 172.21.15.7:0/498983117 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f83381083a0 0x7f83381087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:05.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:05.231+0000 7f833f686640 1 --2- 172.21.15.7:0/498983117 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8338102a60 0x7f8338102e70 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:05.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:05.231+0000 7f833f686640 1 -- 172.21.15.7:0/498983117 >> 172.21.15.7:0/498983117 conn(0x7f8338079760 msgr2=0x7f8338079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:05.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:05.232+0000 7f833f686640 1 -- 172.21.15.7:0/498983117 shutdown_connections 2024-09-21T06:47:05.234 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:05.232+0000 7f833f686640 1 -- 172.21.15.7:0/498983117 wait complete. 2024-09-21T06:47:05.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:05.232+0000 7f833f686640 1 Processor -- start 2024-09-21T06:47:05.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:05.232+0000 7f833f686640 1 -- start start 2024-09-21T06:47:05.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:05.233+0000 7f833f686640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8338102a60 0x7f833819b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:05.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:05.233+0000 7f833f686640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f83381083a0 0x7f833819b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:05.236 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:05.233+0000 7f833f686640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8338108cf0 0x7f833819bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:05.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:05.233+0000 7f833f686640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f83381129b0 con 0x7f8338102a60 2024-09-21T06:47:05.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:05.233+0000 7f833f686640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8338112830 con 0x7f8338108cf0 2024-09-21T06:47:05.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:05.233+0000 7f833f686640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f8338112b30 con 0x7f83381083a0 2024-09-21T06:47:05.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:05.233+0000 7f833d422640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8338102a60 0x7f833819b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:05.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:05.233+0000 7f833d422640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8338102a60 0x7f833819b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46036/0 (socket says 172.21.15.7:46036) 2024-09-21T06:47:05.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:05.233+0000 7f833d422640 1 -- 172.21.15.7:0/2293078258 learned_addr learned my addr 172.21.15.7:0/2293078258 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:47:05.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:05.233+0000 7f833cc21640 1 --2- 172.21.15.7:0/2293078258 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f83381083a0 0x7f833819b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:05.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:05.233+0000 7f833dc23640 1 --2- 172.21.15.7:0/2293078258 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8338108cf0 0x7f833819bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:05.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:05.233+0000 7f833d422640 1 -- 172.21.15.7:0/2293078258 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f83381083a0 msgr2=0x7f833819b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:05.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:05.233+0000 7f833d422640 1 --2- 172.21.15.7:0/2293078258 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f83381083a0 0x7f833819b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:05.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:05.233+0000 7f833d422640 1 -- 172.21.15.7:0/2293078258 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8338108cf0 msgr2=0x7f833819bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:05.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:05.233+0000 7f833d422640 1 --2- 172.21.15.7:0/2293078258 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8338108cf0 0x7f833819bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:05.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:05.233+0000 7f833d422640 1 -- 172.21.15.7:0/2293078258 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83381a64d0 con 0x7f8338102a60 2024-09-21T06:47:05.237 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:05.233+0000 7f833d422640 1 --2- 172.21.15.7:0/2293078258 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8338102a60 0x7f833819b2a0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f8334005940 tx=0x7f83340042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:05.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:05.234+0000 7f832e7fc640 1 -- 172.21.15.7:0/2293078258 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f833403f030 con 0x7f8338102a60 2024-09-21T06:47:05.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:05.234+0000 7f833f686640 1 -- 172.21.15.7:0/2293078258 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83381a6760 con 0x7f8338102a60 2024-09-21T06:47:05.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:05.234+0000 7f832e7fc640 1 -- 172.21.15.7:0/2293078258 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8334003cb0 con 0x7f8338102a60 2024-09-21T06:47:05.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:05.234+0000 7f832e7fc640 1 -- 172.21.15.7:0/2293078258 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8334035070 con 0x7f8338102a60 2024-09-21T06:47:05.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:05.234+0000 7f833f686640 1 -- 172.21.15.7:0/2293078258 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83381a6c90 con 0x7f8338102a60 2024-09-21T06:47:05.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:05.235+0000 7f833f686640 1 -- 172.21.15.7:0/2293078258 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8338103ce0 con 0x7f8338102a60 2024-09-21T06:47:05.238 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:05.236+0000 7f832e7fc640 1 -- 172.21.15.7:0/2293078258 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f8334042030 con 0x7f8338102a60 2024-09-21T06:47:05.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:05.237+0000 7f832e7fc640 1 --2- 172.21.15.7:0/2293078258 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f83240b6680 0x7f83240b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:05.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:05.237+0000 7f833cc21640 1 --2- 172.21.15.7:0/2293078258 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f83240b6680 0x7f83240b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:05.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:05.237+0000 7f832e7fc640 1 -- 172.21.15.7:0/2293078258 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8626+0+0 (secure 0 0 0) 0x7f83341083c0 con 0x7f8338102a60 2024-09-21T06:47:05.239 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:05.238+0000 7f833cc21640 1 --2- 172.21.15.7:0/2293078258 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f83240b6680 0x7f83240b8b90 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f8338108180 tx=0x7f832800a2d0 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:05.242 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:05.241+0000 7f832e7fc640 1 -- 172.21.15.7:0/2293078258 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f83340ce840 con 0x7f8338102a60 2024-09-21T06:47:05.433 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:05.431+0000 7f833f686640 1 -- 172.21.15.7:0/2293078258 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f8338102e70 con 0x7f8338102a60 2024-09-21T06:47:05.800 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:05.798+0000 7f832e7fc640 1 -- 172.21.15.7:0/2293078258 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v87) ==== 181+0+0 (secure 0 0 0) 0x7f8338102e70 con 0x7f8338102a60 2024-09-21T06:47:05.800 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_metadata' removed 2024-09-21T06:47:05.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:05.801+0000 7f833f686640 1 -- 172.21.15.7:0/2293078258 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f83240b6680 msgr2=0x7f83240b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:05.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:05.801+0000 7f833f686640 1 --2- 172.21.15.7:0/2293078258 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f83240b6680 0x7f83240b8b90 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f8338108180 tx=0x7f832800a2d0 comp rx=0 tx=0).stop 2024-09-21T06:47:05.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:05.801+0000 7f833f686640 1 -- 172.21.15.7:0/2293078258 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8338102a60 msgr2=0x7f833819b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:05.803 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:05.801+0000 7f833f686640 1 --2- 172.21.15.7:0/2293078258 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8338102a60 0x7f833819b2a0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f8334005940 tx=0x7f83340042f0 comp rx=0 tx=0).stop 2024-09-21T06:47:05.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:05.802+0000 7f833f686640 1 -- 172.21.15.7:0/2293078258 shutdown_connections 2024-09-21T06:47:05.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:05.802+0000 7f833f686640 1 --2- 172.21.15.7:0/2293078258 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f83240b6680 0x7f83240b8b90 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:05.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:05.802+0000 7f833f686640 1 --2- 172.21.15.7:0/2293078258 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8338108cf0 0x7f833819bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:05.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:05.802+0000 7f833f686640 1 --2- 172.21.15.7:0/2293078258 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f83381083a0 0x7f833819b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:05.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:05.802+0000 7f833f686640 1 --2- 172.21.15.7:0/2293078258 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f8338102a60 0x7f833819b2a0 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:05.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:05.802+0000 7f833f686640 1 -- 172.21.15.7:0/2293078258 >> 172.21.15.7:0/2293078258 conn(0x7f8338079760 msgr2=0x7f8338106450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:05.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:05.802+0000 7f833f686640 1 -- 172.21.15.7:0/2293078258 shutdown_connections 2024-09-21T06:47:05.804 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:05.802+0000 7f833f686640 1 -- 172.21.15.7:0/2293078258 wait complete. 2024-09-21T06:47:06.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:47:05 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2293078258' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T06:47:06.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:47:05 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/2293078258' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T06:47:06.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:47:05 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/2293078258' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T06:47:06.504 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid 347cb918-77e2-11ef-baf5-efdc52797490 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-21T06:47:06.771 INFO:teuthology.orchestra.run.smithi007.stderr:Inferring config /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T06:47:07.053 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:47:06 smithi007 ceph-mon[30983]: pgmap v655: 97 pgs: 97 active+clean; 3.3 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-09-21T06:47:07.054 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:47:06 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2293078258' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T06:47:07.054 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:47:06 smithi007 ceph-mon[30983]: osdmap e87: 12 total, 12 up, 12 in 2024-09-21T06:47:07.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:47:06 smithi018 ceph-mon[34477]: pgmap v655: 97 pgs: 97 active+clean; 3.3 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-09-21T06:47:07.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:47:06 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/2293078258' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T06:47:07.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:47:06 smithi018 ceph-mon[34477]: osdmap e87: 12 total, 12 up, 12 in 2024-09-21T06:47:07.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:07.267+0000 7f25b2a9d640 1 -- 172.21.15.7:0/321075061 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25ac108cf0 msgr2=0x7f25ac10f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:07.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:07.267+0000 7f25b2a9d640 1 --2- 172.21.15.7:0/321075061 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25ac108cf0 0x7f25ac10f520 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f25a4009ca0 tx=0x7f25a402a8c0 comp rx=0 tx=0).stop 2024-09-21T06:47:07.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:07.267+0000 7f25b2a9d640 1 -- 172.21.15.7:0/321075061 shutdown_connections 2024-09-21T06:47:07.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:07.267+0000 7f25b2a9d640 1 --2- 172.21.15.7:0/321075061 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25ac108cf0 0x7f25ac10f520 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:07.269 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:07.267+0000 7f25b2a9d640 1 --2- 172.21.15.7:0/321075061 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25ac1083a0 0x7f25ac1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:07.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:07.267+0000 7f25b2a9d640 1 --2- 172.21.15.7:0/321075061 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f25ac102a60 0x7f25ac102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:07.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:07.267+0000 7f25b2a9d640 1 -- 172.21.15.7:0/321075061 >> 172.21.15.7:0/321075061 conn(0x7f25ac079730 msgr2=0x7f25ac079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:07.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:07.267+0000 7f25b2a9d640 1 -- 172.21.15.7:0/321075061 shutdown_connections 2024-09-21T06:47:07.270 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:07.267+0000 7f25b2a9d640 1 -- 172.21.15.7:0/321075061 wait complete. 2024-09-21T06:47:07.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:07.268+0000 7f25b2a9d640 1 Processor -- start 2024-09-21T06:47:07.271 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:07.268+0000 7f25b2a9d640 1 -- start start 2024-09-21T06:47:07.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:07.268+0000 7f25b2a9d640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25ac102a60 0x7f25ac19c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:07.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:07.268+0000 7f25b2a9d640 1 --2- >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f25ac1083a0 0x7f25ac19cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:07.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:07.268+0000 7f25b2a9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25ac108cf0 0x7f25ac1a1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:07.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:07.268+0000 7f25b2a9d640 1 -- --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_getmap magic: 0 -- 0x7f25ac113a80 con 0x7f25ac102a60 2024-09-21T06:47:07.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:07.268+0000 7f25b2a9d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f25ac113900 con 0x7f25ac108cf0 2024-09-21T06:47:07.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:07.268+0000 7f25b2a9d640 1 -- --> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] -- mon_getmap magic: 0 -- 0x7f25ac113c00 con 0x7f25ac1083a0 2024-09-21T06:47:07.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:07.268+0000 7f25b0839640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25ac102a60 0x7f25ac19c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:07.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:07.268+0000 7f25b0839640 1 --2- >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25ac102a60 0x7f25ac19c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.7:3300/0 says I am v2:172.21.15.7:46060/0 (socket says 172.21.15.7:46060) 2024-09-21T06:47:07.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:07.268+0000 7f25b0839640 1 -- 172.21.15.7:0/2967957728 learned_addr learned my addr 172.21.15.7:0/2967957728 (peer_addr_for_me v2:172.21.15.7:0/0) 2024-09-21T06:47:07.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:07.269+0000 7f25b103a640 1 --2- 172.21.15.7:0/2967957728 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25ac108cf0 0x7f25ac1a1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:07.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:07.269+0000 7f25abfff640 1 --2- 172.21.15.7:0/2967957728 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f25ac1083a0 0x7f25ac19cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:07.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:07.269+0000 7f25b0839640 1 -- 172.21.15.7:0/2967957728 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f25ac1083a0 msgr2=0x7f25ac19cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:07.272 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:07.269+0000 7f25b0839640 1 --2- 172.21.15.7:0/2967957728 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f25ac1083a0 0x7f25ac19cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:07.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:07.269+0000 7f25b0839640 1 -- 172.21.15.7:0/2967957728 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25ac108cf0 msgr2=0x7f25ac1a1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:07.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:07.269+0000 7f25b0839640 1 --2- 172.21.15.7:0/2967957728 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25ac108cf0 0x7f25ac1a1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:07.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:07.269+0000 7f25b0839640 1 -- 172.21.15.7:0/2967957728 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25ac1a2580 con 0x7f25ac102a60 2024-09-21T06:47:07.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:07.269+0000 7f25b0839640 1 --2- 172.21.15.7:0/2967957728 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25ac102a60 0x7f25ac19c610 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f259c00d770 tx=0x7f259c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:07.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:07.269+0000 7f25a9ffb640 1 -- 172.21.15.7:0/2967957728 <== mon.0 v2:172.21.15.7:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f259c017070 con 0x7f25ac102a60 2024-09-21T06:47:07.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:07.269+0000 7f25a9ffb640 1 -- 172.21.15.7:0/2967957728 <== mon.0 v2:172.21.15.7:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f259c0054d0 con 0x7f25ac102a60 2024-09-21T06:47:07.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:07.269+0000 7f25b2a9d640 1 -- 172.21.15.7:0/2967957728 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25ac1a2870 con 0x7f25ac102a60 2024-09-21T06:47:07.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:07.269+0000 7f25a9ffb640 1 -- 172.21.15.7:0/2967957728 <== mon.0 v2:172.21.15.7:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f259c004c30 con 0x7f25ac102a60 2024-09-21T06:47:07.273 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:07.269+0000 7f25b2a9d640 1 -- 172.21.15.7:0/2967957728 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25ac1a8fd0 con 0x7f25ac102a60 2024-09-21T06:47:07.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:07.271+0000 7f25b2a9d640 1 -- 172.21.15.7:0/2967957728 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25ac102e70 con 0x7f25ac102a60 2024-09-21T06:47:07.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:07.272+0000 7f25a9ffb640 1 -- 172.21.15.7:0/2967957728 <== mon.0 v2:172.21.15.7:3300/0 4 ==== mgrmap(e 25) ==== 154642+0+0 (secure 0 0 0) 0x7f259c004dd0 con 0x7f25ac102a60 2024-09-21T06:47:07.274 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:07.273+0000 7f25a9ffb640 1 --2- 172.21.15.7:0/2967957728 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f25940b6680 0x7f25940b8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T06:47:07.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:07.273+0000 7f25abfff640 1 --2- 172.21.15.7:0/2967957728 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f25940b6680 0x7f25940b8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T06:47:07.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:07.273+0000 7f25a9ffb640 1 -- 172.21.15.7:0/2967957728 <== mon.0 v2:172.21.15.7:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8130+0+0 (secure 0 0 0) 0x7f259c0e7340 con 0x7f25ac102a60 2024-09-21T06:47:07.275 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:07.273+0000 7f25abfff640 1 --2- 172.21.15.7:0/2967957728 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f25940b6680 0x7f25940b8b90 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f25ac079b80 tx=0x7f25a000b390 comp rx=0 tx=0).ready entity=mgr.14223 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T06:47:07.277 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:07.276+0000 7f25a9ffb640 1 -- 172.21.15.7:0/2967957728 <== mon.0 v2:172.21.15.7:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f259c0b1e40 con 0x7f25ac102a60 2024-09-21T06:47:07.284 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:47:06 smithi144 ceph-mon[34653]: pgmap v655: 97 pgs: 97 active+clean; 3.3 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 27 op/s 2024-09-21T06:47:07.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:47:06 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/2293078258' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T06:47:07.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:47:06 smithi144 ceph-mon[34653]: osdmap e87: 12 total, 12 up, 12 in 2024-09-21T06:47:07.468 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:07.466+0000 7f25b2a9d640 1 -- 172.21.15.7:0/2967957728 --> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f25ac1a9270 con 0x7f25ac102a60 2024-09-21T06:47:07.807 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:07.805+0000 7f25a9ffb640 1 -- 172.21.15.7:0/2967957728 <== mon.0 v2:172.21.15.7:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v88) ==== 169+0+0 (secure 0 0 0) 0x7f259c0b6d80 con 0x7f25ac102a60 2024-09-21T06:47:07.808 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data' removed 2024-09-21T06:47:07.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:07.809+0000 7f25b2a9d640 1 -- 172.21.15.7:0/2967957728 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f25940b6680 msgr2=0x7f25940b8b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:07.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:07.809+0000 7f25b2a9d640 1 --2- 172.21.15.7:0/2967957728 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f25940b6680 0x7f25940b8b90 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f25ac079b80 tx=0x7f25a000b390 comp rx=0 tx=0).stop 2024-09-21T06:47:07.811 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:07.809+0000 7f25b2a9d640 1 -- 172.21.15.7:0/2967957728 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25ac102a60 msgr2=0x7f25ac19c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T06:47:07.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:07.809+0000 7f25b2a9d640 1 --2- 172.21.15.7:0/2967957728 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25ac102a60 0x7f25ac19c610 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f259c00d770 tx=0x7f259c00dc30 comp rx=0 tx=0).stop 2024-09-21T06:47:07.812 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:07.810+0000 7f25b2a9d640 1 -- 172.21.15.7:0/2967957728 shutdown_connections 2024-09-21T06:47:07.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:07.810+0000 7f25b2a9d640 1 --2- 172.21.15.7:0/2967957728 >> [v2:172.21.15.7:6800/3442812985,v1:172.21.15.7:6801/3442812985] conn(0x7f25940b6680 0x7f25940b8b90 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:07.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:07.810+0000 7f25b2a9d640 1 --2- 172.21.15.7:0/2967957728 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25ac108cf0 0x7f25ac1a1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:07.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:07.810+0000 7f25b2a9d640 1 --2- 172.21.15.7:0/2967957728 >> [v2:172.21.15.144:3300/0,v1:172.21.15.144:6789/0] conn(0x7f25ac1083a0 0x7f25ac19cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:07.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:07.810+0000 7f25b2a9d640 1 --2- 172.21.15.7:0/2967957728 >> [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] conn(0x7f25ac102a60 0x7f25ac19c610 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T06:47:07.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:07.810+0000 7f25b2a9d640 1 -- 172.21.15.7:0/2967957728 >> 172.21.15.7:0/2967957728 conn(0x7f25ac079730 msgr2=0x7f25ac104130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T06:47:07.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:07.811+0000 7f25b2a9d640 1 -- 172.21.15.7:0/2967957728 shutdown_connections 2024-09-21T06:47:07.813 INFO:teuthology.orchestra.run.smithi007.stderr:2024-09-21T06:47:07.811+0000 7f25b2a9d640 1 -- 172.21.15.7:0/2967957728 wait complete. 2024-09-21T06:47:08.089 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:47:07 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2967957728' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T06:47:08.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:47:07 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/2967957728' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T06:47:08.285 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:47:07 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/2967957728' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T06:47:08.578 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T06:47:08.607 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T06:47:08.648 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T06:47:08.680 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-21T06:47:08.680 DEBUG:teuthology.orchestra.run.smithi007:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T06:47:08.697 DEBUG:teuthology.orchestra.run.smithi018:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T06:47:08.715 DEBUG:teuthology.orchestra.run.smithi144:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T06:47:08.737 INFO:tasks.cephadm:Stopping all daemons... 2024-09-21T06:47:08.738 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-21T06:47:08.738 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ceph-347cb918-77e2-11ef-baf5-efdc52797490@mon.a 2024-09-21T06:47:08.809 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:47:08 smithi007 systemd[1]: Stopping Ceph mon.a for 347cb918-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:47:09.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:47:08 smithi144 ceph-mon[34653]: pgmap v657: 65 pgs: 65 active+clean; 577 KiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:47:09.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:47:08 smithi144 ceph-mon[34653]: from='client.? 172.21.15.7:0/2967957728' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T06:47:09.035 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:47:08 smithi144 ceph-mon[34653]: osdmap e88: 12 total, 12 up, 12 in 2024-09-21T06:47:09.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:47:08 smithi007 ceph-mon[30983]: pgmap v657: 65 pgs: 65 active+clean; 577 KiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:47:09.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:47:08 smithi007 ceph-mon[30983]: from='client.? 172.21.15.7:0/2967957728' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T06:47:09.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:47:08 smithi007 ceph-mon[30983]: osdmap e88: 12 total, 12 up, 12 in 2024-09-21T06:47:09.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:47:09 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mon-a[30979]: 2024-09-21T06:47:09.022+0000 7feeb4a09640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:47:09.090 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:47:09 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mon-a[30979]: 2024-09-21T06:47:09.022+0000 7feeb4a09640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-21T06:47:09.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:47:08 smithi018 ceph-mon[34477]: pgmap v657: 65 pgs: 65 active+clean; 577 KiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T06:47:09.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:47:08 smithi018 ceph-mon[34477]: from='client.? 172.21.15.7:0/2967957728' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T06:47:09.119 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:47:08 smithi018 ceph-mon[34477]: osdmap e88: 12 total, 12 up, 12 in 2024-09-21T06:47:09.470 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:47:09 smithi007 podman[106986]: 2024-09-21 06:47:09.197510681 +0000 UTC m=+0.269873031 container died bb65e9bcd0004436a7a1d4028d121d805af79dcbb81f1350d21ee5a0f6b77eb8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mon-a, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T06:47:09.839 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:47:09 smithi007 podman[106986]: 2024-09-21 06:47:09.556825171 +0000 UTC m=+0.629187557 container cleanup bb65e9bcd0004436a7a1d4028d121d805af79dcbb81f1350d21ee5a0f6b77eb8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mon-a, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS) 2024-09-21T06:47:09.840 INFO:journalctl@ceph.mon.a.smithi007.stdout:Sep 21 06:47:09 smithi007 bash[106986]: ceph-347cb918-77e2-11ef-baf5-efdc52797490-mon-a 2024-09-21T06:47:09.989 DEBUG:teuthology.orchestra.run.smithi007:> sudo pkill -f 'journalctl -f -n 0 -u ceph-347cb918-77e2-11ef-baf5-efdc52797490@mon.a.service' 2024-09-21T06:47:10.049 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:47:10.049 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-21T06:47:10.049 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-21T06:47:10.049 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ceph-347cb918-77e2-11ef-baf5-efdc52797490@mon.b 2024-09-21T06:47:10.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:47:10 smithi018 systemd[1]: Stopping Ceph mon.b for 347cb918-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:47:10.627 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:47:10 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mon-b[34473]: 2024-09-21T06:47:10.369+0000 7f8f5bc80640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:47:10.627 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:47:10 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mon-b[34473]: 2024-09-21T06:47:10.369+0000 7f8f5bc80640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-21T06:47:10.922 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:47:10 smithi018 podman[66582]: 2024-09-21 06:47:10.626278662 +0000 UTC m=+0.374412116 container died 94a21ea7d42578838ee775fc44baa81af0b11a32ead15ec4559f0e8efbbef1d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mon-b, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-21T06:47:11.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:47:11 smithi018 podman[66582]: 2024-09-21 06:47:11.020612345 +0000 UTC m=+0.768745804 container cleanup 94a21ea7d42578838ee775fc44baa81af0b11a32ead15ec4559f0e8efbbef1d0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mon-b, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-21T06:47:11.369 INFO:journalctl@ceph.mon.b.smithi018.stdout:Sep 21 06:47:11 smithi018 bash[66582]: ceph-347cb918-77e2-11ef-baf5-efdc52797490-mon-b 2024-09-21T06:47:11.517 DEBUG:teuthology.orchestra.run.smithi018:> sudo pkill -f 'journalctl -f -n 0 -u ceph-347cb918-77e2-11ef-baf5-efdc52797490@mon.b.service' 2024-09-21T06:47:11.561 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:47:11.562 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-21T06:47:11.562 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-21T06:47:11.562 DEBUG:teuthology.orchestra.run.smithi144:> sudo systemctl stop ceph-347cb918-77e2-11ef-baf5-efdc52797490@mon.c 2024-09-21T06:47:11.886 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:47:11 smithi144 systemd[1]: Stopping Ceph mon.c for 347cb918-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:47:12.193 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:47:11 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mon-c[34648]: 2024-09-21T06:47:11.884+0000 7f7973b1b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:47:12.194 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:47:11 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mon-c[34648]: 2024-09-21T06:47:11.884+0000 7f7973b1b640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-21T06:47:12.194 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:47:11 smithi144 podman[67643]: 2024-09-21 06:47:11.904958677 +0000 UTC m=+0.151148480 container died a6ea9d24ccb32fa1a6784af5ea9f0a819717c6edaa2a86a809b3ffb7579e268c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mon-c, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux ) 2024-09-21T06:47:12.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:47:12 smithi144 podman[67643]: 2024-09-21 06:47:12.282683266 +0000 UTC m=+0.528873060 container cleanup a6ea9d24ccb32fa1a6784af5ea9f0a819717c6edaa2a86a809b3ffb7579e268c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mon-c, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True) 2024-09-21T06:47:12.535 INFO:journalctl@ceph.mon.c.smithi144.stdout:Sep 21 06:47:12 smithi144 bash[67643]: ceph-347cb918-77e2-11ef-baf5-efdc52797490-mon-c 2024-09-21T06:47:12.712 DEBUG:teuthology.orchestra.run.smithi144:> sudo pkill -f 'journalctl -f -n 0 -u ceph-347cb918-77e2-11ef-baf5-efdc52797490@mon.c.service' 2024-09-21T06:47:12.759 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:47:12.759 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-21T06:47:12.760 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-21T06:47:12.760 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ceph-347cb918-77e2-11ef-baf5-efdc52797490@mgr.x 2024-09-21T06:47:13.089 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:47:12 smithi007 systemd[1]: Stopping Ceph mgr.x for 347cb918-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:47:13.423 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:47:13 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: 2024-09-21T06:47:13.094+0000 7fd670000640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:47:13.423 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:47:13 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x[31209]: 2024-09-21T06:47:13.094+0000 7fd670000640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-09-21T06:47:13.423 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:47:13 smithi007 podman[107105]: 2024-09-21 06:47:13.135877151 +0000 UTC m=+0.175222693 container died 57ee5d7cdfd5c91834141496bf8af8a478fbebeb5eae902859809bcb5d716381 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-21T06:47:13.840 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:47:13 smithi007 podman[107105]: 2024-09-21 06:47:13.646569469 +0000 UTC m=+0.685915054 container cleanup 57ee5d7cdfd5c91834141496bf8af8a478fbebeb5eae902859809bcb5d716381 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731) 2024-09-21T06:47:13.840 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:47:13 smithi007 bash[107105]: ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x 2024-09-21T06:47:14.137 INFO:journalctl@ceph.mgr.x.smithi007.stdout:Sep 21 06:47:13 smithi007 podman[107118]: 2024-09-21 06:47:13.876215577 +0000 UTC m=+0.742639399 container remove 57ee5d7cdfd5c91834141496bf8af8a478fbebeb5eae902859809bcb5d716381 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-x, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-21T06:47:14.141 DEBUG:teuthology.orchestra.run.smithi007:> sudo pkill -f 'journalctl -f -n 0 -u ceph-347cb918-77e2-11ef-baf5-efdc52797490@mgr.x.service' 2024-09-21T06:47:14.176 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:47:14.176 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-21T06:47:14.176 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-21T06:47:14.176 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ceph-347cb918-77e2-11ef-baf5-efdc52797490@mgr.y 2024-09-21T06:47:14.530 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 21 06:47:14 smithi018 systemd[1]: Stopping Ceph mgr.y for 347cb918-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:47:14.843 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 21 06:47:14 smithi018 podman[66706]: 2024-09-21 06:47:14.529501151 +0000 UTC m=+0.142324770 container stop d6428692c41630d2fe3af19b3cee3c49ce7f785acb7d2c92f301fb8d481c120b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-y, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:47:14.844 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 21 06:47:14 smithi018 podman[66706]: 2024-09-21 06:47:14.555191598 +0000 UTC m=+0.168015218 container died d6428692c41630d2fe3af19b3cee3c49ce7f785acb7d2c92f301fb8d481c120b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-y, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS) 2024-09-21T06:47:15.119 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 21 06:47:14 smithi018 podman[66706]: 2024-09-21 06:47:14.933959893 +0000 UTC m=+0.546783520 container cleanup d6428692c41630d2fe3af19b3cee3c49ce7f785acb7d2c92f301fb8d481c120b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-y, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-21T06:47:15.119 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 21 06:47:14 smithi018 bash[66706]: ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-y 2024-09-21T06:47:15.361 DEBUG:teuthology.orchestra.run.smithi018:> sudo pkill -f 'journalctl -f -n 0 -u ceph-347cb918-77e2-11ef-baf5-efdc52797490@mgr.y.service' 2024-09-21T06:47:15.383 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 21 06:47:15 smithi018 podman[66720]: 2024-09-21 06:47:15.118566123 +0000 UTC m=+0.583104250 container remove d6428692c41630d2fe3af19b3cee3c49ce7f785acb7d2c92f301fb8d481c120b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-y, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2) 2024-09-21T06:47:15.383 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 21 06:47:15 smithi018 systemd[1]: ceph-347cb918-77e2-11ef-baf5-efdc52797490@mgr.y.service: Main process exited, code=exited, status=143/n/a 2024-09-21T06:47:15.383 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 21 06:47:15 smithi018 systemd[1]: ceph-347cb918-77e2-11ef-baf5-efdc52797490@mgr.y.service: Failed with result 'exit-code'. 2024-09-21T06:47:15.383 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 21 06:47:15 smithi018 systemd[1]: Stopped Ceph mgr.y for 347cb918-77e2-11ef-baf5-efdc52797490. 2024-09-21T06:47:15.383 INFO:journalctl@ceph.mgr.y.smithi018.stdout:Sep 21 06:47:15 smithi018 systemd[1]: ceph-347cb918-77e2-11ef-baf5-efdc52797490@mgr.y.service: Consumed 7.579s CPU time. 2024-09-21T06:47:15.395 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:47:15.395 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-21T06:47:15.396 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-21T06:47:15.396 DEBUG:teuthology.orchestra.run.smithi144:> sudo systemctl stop ceph-347cb918-77e2-11ef-baf5-efdc52797490@mgr.z 2024-09-21T06:47:15.744 INFO:journalctl@ceph.mgr.z.smithi144.stdout:Sep 21 06:47:15 smithi144 systemd[1]: Stopping Ceph mgr.z for 347cb918-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:47:16.035 INFO:journalctl@ceph.mgr.z.smithi144.stdout:Sep 21 06:47:15 smithi144 podman[67763]: 2024-09-21 06:47:15.743379469 +0000 UTC m=+0.153009538 container died ee87c85254f1a98671fee1e67f14f7b9f6f823d0eb502fb853c2157ab91105ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-z, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-21T06:47:16.390 INFO:journalctl@ceph.mgr.z.smithi144.stdout:Sep 21 06:47:16 smithi144 podman[67763]: 2024-09-21 06:47:16.146426564 +0000 UTC m=+0.556056689 container cleanup ee87c85254f1a98671fee1e67f14f7b9f6f823d0eb502fb853c2157ab91105ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-z, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-21T06:47:16.391 INFO:journalctl@ceph.mgr.z.smithi144.stdout:Sep 21 06:47:16 smithi144 bash[67763]: ceph-347cb918-77e2-11ef-baf5-efdc52797490-mgr-z 2024-09-21T06:47:16.536 DEBUG:teuthology.orchestra.run.smithi144:> sudo pkill -f 'journalctl -f -n 0 -u ceph-347cb918-77e2-11ef-baf5-efdc52797490@mgr.z.service' 2024-09-21T06:47:16.570 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:47:16.570 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-21T06:47:16.571 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-21T06:47:16.571 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ceph-347cb918-77e2-11ef-baf5-efdc52797490@osd.0 2024-09-21T06:47:16.877 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 21 06:47:16 smithi007 systemd[1]: Stopping Ceph osd.0 for 347cb918-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:47:17.340 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 21 06:47:16 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-0[47737]: 2024-09-21T06:47:16.876+0000 7ffb206bf640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:47:17.340 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 21 06:47:16 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-0[47737]: 2024-09-21T06:47:16.876+0000 7ffb206bf640 -1 osd.0 88 *** Got signal Terminated *** 2024-09-21T06:47:17.340 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 21 06:47:16 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-0[47737]: 2024-09-21T06:47:16.876+0000 7ffb206bf640 -1 osd.0 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T06:47:22.755 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 21 06:47:22 smithi007 podman[107229]: 2024-09-21 06:47:22.363685689 +0000 UTC m=+5.599766431 container died e634e7e7dbbd3a347a1c59340059a3990e8326f25a63de17e9629d78c7970bac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-21T06:47:23.090 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 21 06:47:22 smithi007 podman[107229]: 2024-09-21 06:47:22.936080774 +0000 UTC m=+6.172161557 container cleanup e634e7e7dbbd3a347a1c59340059a3990e8326f25a63de17e9629d78c7970bac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-21T06:47:23.090 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 21 06:47:22 smithi007 bash[107229]: ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-0 2024-09-21T06:47:23.571 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 21 06:47:23 smithi007 podman[107244]: 2024-09-21 06:47:23.229662438 +0000 UTC m=+0.862611593 container remove e634e7e7dbbd3a347a1c59340059a3990e8326f25a63de17e9629d78c7970bac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-0, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-21T06:47:23.840 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 21 06:47:23 smithi007 podman[107335]: 2024-09-21 06:47:23.472885791 +0000 UTC m=+0.016205603 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:47:23.840 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 21 06:47:23 smithi007 podman[107335]: 2024-09-21 06:47:23.630856542 +0000 UTC m=+0.174176357 container create 2850119df790bf5bfa846a040b95d3b25a6a9dcdd085115c8f6e575377ebbe08 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-0-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-21T06:47:24.340 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 21 06:47:24 smithi007 podman[107335]: 2024-09-21 06:47:24.025718191 +0000 UTC m=+0.569038003 container init 2850119df790bf5bfa846a040b95d3b25a6a9dcdd085115c8f6e575377ebbe08 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-0-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD) 2024-09-21T06:47:24.340 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 21 06:47:24 smithi007 podman[107335]: 2024-09-21 06:47:24.029171004 +0000 UTC m=+0.572490818 container start 2850119df790bf5bfa846a040b95d3b25a6a9dcdd085115c8f6e575377ebbe08 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-0-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0) 2024-09-21T06:47:24.340 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 21 06:47:24 smithi007 podman[107335]: 2024-09-21 06:47:24.117571082 +0000 UTC m=+0.660890906 container attach 2850119df790bf5bfa846a040b95d3b25a6a9dcdd085115c8f6e575377ebbe08 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-0-deactivate, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:47:24.340 INFO:journalctl@ceph.osd.0.smithi007.stdout:Sep 21 06:47:24 smithi007 podman[107335]: 2024-09-21 06:47:24.227878034 +0000 UTC m=+0.771197846 container died 2850119df790bf5bfa846a040b95d3b25a6a9dcdd085115c8f6e575377ebbe08 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-0-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T06:47:24.903 DEBUG:teuthology.orchestra.run.smithi007:> sudo pkill -f 'journalctl -f -n 0 -u ceph-347cb918-77e2-11ef-baf5-efdc52797490@osd.0.service' 2024-09-21T06:47:24.949 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:47:24.949 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-21T06:47:24.949 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-21T06:47:24.949 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ceph-347cb918-77e2-11ef-baf5-efdc52797490@osd.1 2024-09-21T06:47:25.264 INFO:journalctl@ceph.osd.1.smithi018.stdout:Sep 21 06:47:24 smithi018 systemd[1]: Stopping Ceph osd.1 for 347cb918-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:47:25.619 INFO:journalctl@ceph.osd.1.smithi018.stdout:Sep 21 06:47:25 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-1[39091]: 2024-09-21T06:47:25.263+0000 7fbff7a83640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:47:25.619 INFO:journalctl@ceph.osd.1.smithi018.stdout:Sep 21 06:47:25 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-1[39091]: 2024-09-21T06:47:25.263+0000 7fbff7a83640 -1 osd.1 88 *** Got signal Terminated *** 2024-09-21T06:47:25.619 INFO:journalctl@ceph.osd.1.smithi018.stdout:Sep 21 06:47:25 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-1[39091]: 2024-09-21T06:47:25.263+0000 7fbff7a83640 -1 osd.1 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T06:47:31.098 INFO:journalctl@ceph.osd.1.smithi018.stdout:Sep 21 06:47:30 smithi018 podman[66831]: 2024-09-21 06:47:30.784026032 +0000 UTC m=+5.639295860 container died 0e35f0c95310d9ef92ddeb8d1a4918e1c6f3f1d64d2dfaccd48a0afe8a751fc0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True) 2024-09-21T06:47:31.369 INFO:journalctl@ceph.osd.1.smithi018.stdout:Sep 21 06:47:31 smithi018 podman[66831]: 2024-09-21 06:47:31.196340034 +0000 UTC m=+6.051609856 container cleanup 0e35f0c95310d9ef92ddeb8d1a4918e1c6f3f1d64d2dfaccd48a0afe8a751fc0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-1, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-21T06:47:31.369 INFO:journalctl@ceph.osd.1.smithi018.stdout:Sep 21 06:47:31 smithi018 bash[66831]: ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-1 2024-09-21T06:47:31.869 INFO:journalctl@ceph.osd.1.smithi018.stdout:Sep 21 06:47:31 smithi018 podman[66848]: 2024-09-21 06:47:31.522826255 +0000 UTC m=+0.736887217 container remove 0e35f0c95310d9ef92ddeb8d1a4918e1c6f3f1d64d2dfaccd48a0afe8a751fc0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-1, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-21T06:47:32.235 INFO:journalctl@ceph.osd.1.smithi018.stdout:Sep 21 06:47:31 smithi018 podman[66936]: 2024-09-21 06:47:31.871148065 +0000 UTC m=+0.016047155 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:47:32.235 INFO:journalctl@ceph.osd.1.smithi018.stdout:Sep 21 06:47:31 smithi018 podman[66936]: 2024-09-21 06:47:31.982004044 +0000 UTC m=+0.126903123 container create 4ee9bad556311c775380115b6891bc6555340fd9386d90efba3be874068a472a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-1-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-21T06:47:32.619 INFO:journalctl@ceph.osd.1.smithi018.stdout:Sep 21 06:47:32 smithi018 podman[66936]: 2024-09-21 06:47:32.234555717 +0000 UTC m=+0.379454796 container init 4ee9bad556311c775380115b6891bc6555340fd9386d90efba3be874068a472a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-1-deactivate, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-21T06:47:32.619 INFO:journalctl@ceph.osd.1.smithi018.stdout:Sep 21 06:47:32 smithi018 podman[66936]: 2024-09-21 06:47:32.239115769 +0000 UTC m=+0.384014857 container start 4ee9bad556311c775380115b6891bc6555340fd9386d90efba3be874068a472a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-1-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2) 2024-09-21T06:47:32.619 INFO:journalctl@ceph.osd.1.smithi018.stdout:Sep 21 06:47:32 smithi018 podman[66936]: 2024-09-21 06:47:32.334704498 +0000 UTC m=+0.479603579 container attach 4ee9bad556311c775380115b6891bc6555340fd9386d90efba3be874068a472a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-1-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-21T06:47:32.619 INFO:journalctl@ceph.osd.1.smithi018.stdout:Sep 21 06:47:32 smithi018 podman[66936]: 2024-09-21 06:47:32.433381817 +0000 UTC m=+0.578280907 container died 4ee9bad556311c775380115b6891bc6555340fd9386d90efba3be874068a472a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-1-deactivate, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:47:33.187 DEBUG:teuthology.orchestra.run.smithi018:> sudo pkill -f 'journalctl -f -n 0 -u ceph-347cb918-77e2-11ef-baf5-efdc52797490@osd.1.service' 2024-09-21T06:47:33.231 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:47:33.231 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-21T06:47:33.231 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-21T06:47:33.231 DEBUG:teuthology.orchestra.run.smithi144:> sudo systemctl stop ceph-347cb918-77e2-11ef-baf5-efdc52797490@osd.2 2024-09-21T06:47:33.535 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 21 06:47:33 smithi144 systemd[1]: Stopping Ceph osd.2 for 347cb918-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:47:34.035 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 21 06:47:33 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-2[39773]: 2024-09-21T06:47:33.565+0000 7f9e1d810640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:47:34.035 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 21 06:47:33 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-2[39773]: 2024-09-21T06:47:33.565+0000 7f9e1d810640 -1 osd.2 88 *** Got signal Terminated *** 2024-09-21T06:47:34.035 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 21 06:47:33 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-2[39773]: 2024-09-21T06:47:33.565+0000 7f9e1d810640 -1 osd.2 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T06:47:39.219 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 21 06:47:38 smithi144 podman[67887]: 2024-09-21 06:47:38.91642564 +0000 UTC m=+5.490244278 container died 27245d4381c748fb2e18b0ca956406c53a5141846ab45b47aafbdd69a9da7d71 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-21T06:47:39.535 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 21 06:47:39 smithi144 podman[67887]: 2024-09-21 06:47:39.325361292 +0000 UTC m=+5.899179918 container cleanup 27245d4381c748fb2e18b0ca956406c53a5141846ab45b47aafbdd69a9da7d71 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T06:47:39.535 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 21 06:47:39 smithi144 bash[67887]: ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-2 2024-09-21T06:47:39.990 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 21 06:47:39 smithi144 podman[67903]: 2024-09-21 06:47:39.560336547 +0000 UTC m=+0.643115363 container remove 27245d4381c748fb2e18b0ca956406c53a5141846ab45b47aafbdd69a9da7d71 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-21T06:47:40.248 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 21 06:47:39 smithi144 podman[67989]: 2024-09-21 06:47:39.891757891 +0000 UTC m=+0.015635833 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:47:40.248 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 21 06:47:40 smithi144 podman[67989]: 2024-09-21 06:47:40.011307096 +0000 UTC m=+0.135185078 container create 368e06af9d08f8682c1bf0dca6b274278681d67e8678ca25eae9024cc3e0f4a6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-2-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True) 2024-09-21T06:47:40.535 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 21 06:47:40 smithi144 podman[67989]: 2024-09-21 06:47:40.247473467 +0000 UTC m=+0.371351402 container init 368e06af9d08f8682c1bf0dca6b274278681d67e8678ca25eae9024cc3e0f4a6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-2-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True) 2024-09-21T06:47:40.535 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 21 06:47:40 smithi144 podman[67989]: 2024-09-21 06:47:40.250817754 +0000 UTC m=+0.374695694 container start 368e06af9d08f8682c1bf0dca6b274278681d67e8678ca25eae9024cc3e0f4a6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-2-deactivate, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-21T06:47:40.535 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 21 06:47:40 smithi144 podman[67989]: 2024-09-21 06:47:40.355890145 +0000 UTC m=+0.479768089 container attach 368e06af9d08f8682c1bf0dca6b274278681d67e8678ca25eae9024cc3e0f4a6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-2-deactivate, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-21T06:47:40.535 INFO:journalctl@ceph.osd.2.smithi144.stdout:Sep 21 06:47:40 smithi144 podman[68013]: 2024-09-21 06:47:40.473142587 +0000 UTC m=+0.017120423 container died 368e06af9d08f8682c1bf0dca6b274278681d67e8678ca25eae9024cc3e0f4a6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-2-deactivate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-21T06:47:41.084 DEBUG:teuthology.orchestra.run.smithi144:> sudo pkill -f 'journalctl -f -n 0 -u ceph-347cb918-77e2-11ef-baf5-efdc52797490@osd.2.service' 2024-09-21T06:47:41.123 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:47:41.124 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-21T06:47:41.124 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-21T06:47:41.124 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ceph-347cb918-77e2-11ef-baf5-efdc52797490@osd.3 2024-09-21T06:47:41.450 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 21 06:47:41 smithi007 systemd[1]: Stopping Ceph osd.3 for 347cb918-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:47:41.839 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 21 06:47:41 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-3[54169]: 2024-09-21T06:47:41.448+0000 7f1016359640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:47:41.840 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 21 06:47:41 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-3[54169]: 2024-09-21T06:47:41.448+0000 7f1016359640 -1 osd.3 88 *** Got signal Terminated *** 2024-09-21T06:47:41.840 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 21 06:47:41 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-3[54169]: 2024-09-21T06:47:41.448+0000 7f1016359640 -1 osd.3 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T06:47:43.340 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:47:42 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-6[60437]: 2024-09-21T06:47:42.894+0000 7f2a6f214640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:19.260743+0000 front 2024-09-21T06:47:19.260823+0000 (oldest deadline 2024-09-21T06:47:42.760858+0000) 2024-09-21T06:47:43.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:47:42 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:47:42.879+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.479118+0000 front 2024-09-21T06:47:20.479041+0000 (oldest deadline 2024-09-21T06:47:42.779148+0000) 2024-09-21T06:47:43.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:47:43 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:47:43.166+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.153182+0000 front 2024-09-21T06:47:20.153132+0000 (oldest deadline 2024-09-21T06:47:43.053177+0000) 2024-09-21T06:47:44.339 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:47:43 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-6[60437]: 2024-09-21T06:47:43.927+0000 7f2a6f214640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:19.260743+0000 front 2024-09-21T06:47:19.260823+0000 (oldest deadline 2024-09-21T06:47:42.760858+0000) 2024-09-21T06:47:44.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:47:43 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:47:43.873+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.479118+0000 front 2024-09-21T06:47:20.479041+0000 (oldest deadline 2024-09-21T06:47:42.779148+0000) 2024-09-21T06:47:44.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:47:44 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:47:44.174+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.153182+0000 front 2024-09-21T06:47:20.153132+0000 (oldest deadline 2024-09-21T06:47:43.053177+0000) 2024-09-21T06:47:45.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:47:44 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:47:44.857+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.479118+0000 front 2024-09-21T06:47:20.479041+0000 (oldest deadline 2024-09-21T06:47:42.779148+0000) 2024-09-21T06:47:45.340 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:47:44 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-6[60437]: 2024-09-21T06:47:44.888+0000 7f2a6f214640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:19.260743+0000 front 2024-09-21T06:47:19.260823+0000 (oldest deadline 2024-09-21T06:47:42.760858+0000) 2024-09-21T06:47:45.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:47:45 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:47:45.146+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.153182+0000 front 2024-09-21T06:47:20.153132+0000 (oldest deadline 2024-09-21T06:47:43.053177+0000) 2024-09-21T06:47:46.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:47:45 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:47:45.817+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.479118+0000 front 2024-09-21T06:47:20.479041+0000 (oldest deadline 2024-09-21T06:47:42.779148+0000) 2024-09-21T06:47:46.339 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 21 06:47:46 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-3[54169]: 2024-09-21T06:47:46.019+0000 7f100e93c640 -1 osd.3 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.506662+0000 front 2024-09-21T06:47:20.506707+0000 (oldest deadline 2024-09-21T06:47:45.206741+0000) 2024-09-21T06:47:46.340 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:47:45 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-6[60437]: 2024-09-21T06:47:45.873+0000 7f2a6f214640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:19.260743+0000 front 2024-09-21T06:47:19.260823+0000 (oldest deadline 2024-09-21T06:47:42.760858+0000) 2024-09-21T06:47:46.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:47:46 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:47:46.104+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.153182+0000 front 2024-09-21T06:47:20.153132+0000 (oldest deadline 2024-09-21T06:47:43.053177+0000) 2024-09-21T06:47:47.035 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 06:47:46 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-5[45912]: 2024-09-21T06:47:46.538+0000 7f0c5fcff640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:19.808521+0000 front 2024-09-21T06:47:19.808546+0000 (oldest deadline 2024-09-21T06:47:45.708372+0000) 2024-09-21T06:47:47.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:47:46 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:47:46.836+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.479118+0000 front 2024-09-21T06:47:20.479041+0000 (oldest deadline 2024-09-21T06:47:42.779148+0000) 2024-09-21T06:47:47.185 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 21 06:47:46 smithi007 podman[107437]: 2024-09-21 06:47:46.92133984 +0000 UTC m=+5.592631492 container died 5d4370a5018ac8b9e56b70d4410a8581040305ce502db2a40422ea3379090b3f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-3, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:47:47.185 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:47:46 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-6[60437]: 2024-09-21T06:47:46.899+0000 7f2a6f214640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:19.260743+0000 front 2024-09-21T06:47:19.260823+0000 (oldest deadline 2024-09-21T06:47:42.760858+0000) 2024-09-21T06:47:47.467 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 21 06:47:47 smithi007 podman[107437]: 2024-09-21 06:47:47.265456006 +0000 UTC m=+5.936747692 container cleanup 5d4370a5018ac8b9e56b70d4410a8581040305ce502db2a40422ea3379090b3f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-3, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:47:47.468 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 21 06:47:47 smithi007 bash[107437]: ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-3 2024-09-21T06:47:47.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:47:47 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:47:47.123+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.153182+0000 front 2024-09-21T06:47:20.153132+0000 (oldest deadline 2024-09-21T06:47:43.053177+0000) 2024-09-21T06:47:47.839 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 21 06:47:47 smithi007 podman[107453]: 2024-09-21 06:47:47.466747237 +0000 UTC m=+0.538812523 container remove 5d4370a5018ac8b9e56b70d4410a8581040305ce502db2a40422ea3379090b3f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-3, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:47:48.035 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 06:47:47 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-5[45912]: 2024-09-21T06:47:47.537+0000 7f0c5fcff640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:19.808521+0000 front 2024-09-21T06:47:19.808546+0000 (oldest deadline 2024-09-21T06:47:45.708372+0000) 2024-09-21T06:47:48.163 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:47:47 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-6[60437]: 2024-09-21T06:47:47.859+0000 7f2a6f214640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:19.260743+0000 front 2024-09-21T06:47:19.260823+0000 (oldest deadline 2024-09-21T06:47:42.760858+0000) 2024-09-21T06:47:48.163 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 21 06:47:47 smithi007 podman[107542]: 2024-09-21 06:47:47.801352912 +0000 UTC m=+0.016353647 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:47:48.163 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 21 06:47:47 smithi007 podman[107542]: 2024-09-21 06:47:47.917998426 +0000 UTC m=+0.132999188 container create e6bf8ab34f31068ee8d9e1f331d078e332846f868e620832b02fff7f39ece91f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-3-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-21T06:47:48.163 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 21 06:47:48 smithi007 podman[107542]: 2024-09-21 06:47:48.162167654 +0000 UTC m=+0.377168384 container init e6bf8ab34f31068ee8d9e1f331d078e332846f868e620832b02fff7f39ece91f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-3-deactivate, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-21T06:47:48.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:47:47 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:47:47.868+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.479118+0000 front 2024-09-21T06:47:20.479041+0000 (oldest deadline 2024-09-21T06:47:42.779148+0000) 2024-09-21T06:47:48.494 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:47:48 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:47:48.096+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.153182+0000 front 2024-09-21T06:47:20.153132+0000 (oldest deadline 2024-09-21T06:47:43.053177+0000) 2024-09-21T06:47:48.590 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 21 06:47:48 smithi007 podman[107542]: 2024-09-21 06:47:48.165874403 +0000 UTC m=+0.380875131 container start e6bf8ab34f31068ee8d9e1f331d078e332846f868e620832b02fff7f39ece91f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-3-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:47:48.590 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 21 06:47:48 smithi007 podman[107542]: 2024-09-21 06:47:48.270776422 +0000 UTC m=+0.485777157 container attach e6bf8ab34f31068ee8d9e1f331d078e332846f868e620832b02fff7f39ece91f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-3-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-21T06:47:48.590 INFO:journalctl@ceph.osd.3.smithi007.stdout:Sep 21 06:47:48 smithi007 podman[107542]: 2024-09-21 06:47:48.367380433 +0000 UTC m=+0.582381164 container died e6bf8ab34f31068ee8d9e1f331d078e332846f868e620832b02fff7f39ece91f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:47:48.590 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:47:48 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:47:48.171+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:21.525704+0000 front 2024-09-21T06:47:21.525444+0000 (oldest deadline 2024-09-21T06:47:47.425656+0000) 2024-09-21T06:47:48.785 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 06:47:48 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-5[45912]: 2024-09-21T06:47:48.492+0000 7f0c5fcff640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:19.808521+0000 front 2024-09-21T06:47:19.808546+0000 (oldest deadline 2024-09-21T06:47:45.708372+0000) 2024-09-21T06:47:48.959 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:47:48 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-6[60437]: 2024-09-21T06:47:48.838+0000 7f2a6f214640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:19.260743+0000 front 2024-09-21T06:47:19.260823+0000 (oldest deadline 2024-09-21T06:47:42.760858+0000) 2024-09-21T06:47:48.986 DEBUG:teuthology.orchestra.run.smithi007:> sudo pkill -f 'journalctl -f -n 0 -u ceph-347cb918-77e2-11ef-baf5-efdc52797490@osd.3.service' 2024-09-21T06:47:49.029 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:47:49.029 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-21T06:47:49.029 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-21T06:47:49.029 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ceph-347cb918-77e2-11ef-baf5-efdc52797490@osd.4 2024-09-21T06:47:49.079 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:47:48 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:47:48.825+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.479118+0000 front 2024-09-21T06:47:20.479041+0000 (oldest deadline 2024-09-21T06:47:42.779148+0000) 2024-09-21T06:47:49.340 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:47:49 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:47:49.185+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:21.525704+0000 front 2024-09-21T06:47:21.525444+0000 (oldest deadline 2024-09-21T06:47:47.425656+0000) 2024-09-21T06:47:49.342 INFO:journalctl@ceph.osd.4.smithi018.stdout:Sep 21 06:47:49 smithi018 systemd[1]: Stopping Ceph osd.4 for 347cb918-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:47:49.448 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:47:49 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:47:49.058+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.153182+0000 front 2024-09-21T06:47:20.153132+0000 (oldest deadline 2024-09-21T06:47:43.053177+0000) 2024-09-21T06:47:49.619 INFO:journalctl@ceph.osd.4.smithi018.stdout:Sep 21 06:47:49 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-4[45350]: 2024-09-21T06:47:49.340+0000 7f594736d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:47:49.619 INFO:journalctl@ceph.osd.4.smithi018.stdout:Sep 21 06:47:49 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-4[45350]: 2024-09-21T06:47:49.340+0000 7f594736d640 -1 osd.4 88 *** Got signal Terminated *** 2024-09-21T06:47:49.619 INFO:journalctl@ceph.osd.4.smithi018.stdout:Sep 21 06:47:49 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-4[45350]: 2024-09-21T06:47:49.340+0000 7f594736d640 -1 osd.4 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T06:47:49.785 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 06:47:49 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-5[45912]: 2024-09-21T06:47:49.447+0000 7f0c5fcff640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:19.808521+0000 front 2024-09-21T06:47:19.808546+0000 (oldest deadline 2024-09-21T06:47:45.708372+0000) 2024-09-21T06:47:50.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:47:49 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:47:49.858+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.479118+0000 front 2024-09-21T06:47:20.479041+0000 (oldest deadline 2024-09-21T06:47:42.779148+0000) 2024-09-21T06:47:50.209 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:47:49 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-6[60437]: 2024-09-21T06:47:49.845+0000 7f2a6f214640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:19.260743+0000 front 2024-09-21T06:47:19.260823+0000 (oldest deadline 2024-09-21T06:47:42.760858+0000) 2024-09-21T06:47:50.441 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:47:50 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:47:50.039+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.153182+0000 front 2024-09-21T06:47:20.153132+0000 (oldest deadline 2024-09-21T06:47:43.053177+0000) 2024-09-21T06:47:50.589 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:47:50 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:47:50.208+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:21.525704+0000 front 2024-09-21T06:47:21.525444+0000 (oldest deadline 2024-09-21T06:47:47.425656+0000) 2024-09-21T06:47:50.785 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 06:47:50 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-5[45912]: 2024-09-21T06:47:50.439+0000 7f0c5fcff640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:19.808521+0000 front 2024-09-21T06:47:19.808546+0000 (oldest deadline 2024-09-21T06:47:45.708372+0000) 2024-09-21T06:47:51.089 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:47:50 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-6[60437]: 2024-09-21T06:47:50.799+0000 7f2a6f214640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:19.260743+0000 front 2024-09-21T06:47:19.260823+0000 (oldest deadline 2024-09-21T06:47:42.760858+0000) 2024-09-21T06:47:51.285 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:47:51 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:47:51.030+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.153182+0000 front 2024-09-21T06:47:20.153132+0000 (oldest deadline 2024-09-21T06:47:43.053177+0000) 2024-09-21T06:47:51.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:47:50 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:47:50.895+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.479118+0000 front 2024-09-21T06:47:20.479041+0000 (oldest deadline 2024-09-21T06:47:42.779148+0000) 2024-09-21T06:47:51.590 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:47:51 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:47:51.245+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:21.525704+0000 front 2024-09-21T06:47:21.525444+0000 (oldest deadline 2024-09-21T06:47:47.425656+0000) 2024-09-21T06:47:51.590 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:47:51 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:47:51.245+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:27.926922+0000 front 2024-09-21T06:47:27.926812+0000 (oldest deadline 2024-09-21T06:47:50.826798+0000) 2024-09-21T06:47:51.785 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 06:47:51 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-5[45912]: 2024-09-21T06:47:51.484+0000 7f0c5fcff640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:19.808521+0000 front 2024-09-21T06:47:19.808546+0000 (oldest deadline 2024-09-21T06:47:45.708372+0000) 2024-09-21T06:47:52.089 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:47:51 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-6[60437]: 2024-09-21T06:47:51.789+0000 7f2a6f214640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:19.260743+0000 front 2024-09-21T06:47:19.260823+0000 (oldest deadline 2024-09-21T06:47:42.760858+0000) 2024-09-21T06:47:52.285 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:47:52 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:47:52.014+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.153182+0000 front 2024-09-21T06:47:20.153132+0000 (oldest deadline 2024-09-21T06:47:43.053177+0000) 2024-09-21T06:47:52.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:47:51 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:47:51.889+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.479118+0000 front 2024-09-21T06:47:20.479041+0000 (oldest deadline 2024-09-21T06:47:42.779148+0000) 2024-09-21T06:47:52.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:47:51 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:47:51.889+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.680367+0000 front 2024-09-21T06:47:28.680320+0000 (oldest deadline 2024-09-21T06:47:51.580480+0000) 2024-09-21T06:47:52.590 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:47:52 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:47:52.255+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:21.525704+0000 front 2024-09-21T06:47:21.525444+0000 (oldest deadline 2024-09-21T06:47:47.425656+0000) 2024-09-21T06:47:52.590 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:47:52 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:47:52.255+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:27.926922+0000 front 2024-09-21T06:47:27.926812+0000 (oldest deadline 2024-09-21T06:47:50.826798+0000) 2024-09-21T06:47:52.785 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 06:47:52 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-5[45912]: 2024-09-21T06:47:52.504+0000 7f0c5fcff640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:19.808521+0000 front 2024-09-21T06:47:19.808546+0000 (oldest deadline 2024-09-21T06:47:45.708372+0000) 2024-09-21T06:47:52.869 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 21 06:47:52 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-7[51832]: 2024-09-21T06:47:52.435+0000 7f8eba953640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:26.506838+0000 front 2024-09-21T06:47:26.506866+0000 (oldest deadline 2024-09-21T06:47:51.806954+0000) 2024-09-21T06:47:53.089 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:47:52 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-6[60437]: 2024-09-21T06:47:52.761+0000 7f2a6f214640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:19.260743+0000 front 2024-09-21T06:47:19.260823+0000 (oldest deadline 2024-09-21T06:47:42.760858+0000) 2024-09-21T06:47:53.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:47:52 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:47:52.904+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.479118+0000 front 2024-09-21T06:47:20.479041+0000 (oldest deadline 2024-09-21T06:47:42.779148+0000) 2024-09-21T06:47:53.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:47:52 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:47:52.904+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.680367+0000 front 2024-09-21T06:47:28.680320+0000 (oldest deadline 2024-09-21T06:47:51.580480+0000) 2024-09-21T06:47:53.458 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:47:53 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:47:53.062+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.153182+0000 front 2024-09-21T06:47:20.153132+0000 (oldest deadline 2024-09-21T06:47:43.053177+0000) 2024-09-21T06:47:53.458 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:47:53 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:47:53.062+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.854893+0000 front 2024-09-21T06:47:28.854866+0000 (oldest deadline 2024-09-21T06:47:52.954830+0000) 2024-09-21T06:47:53.589 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:47:53 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:47:53.272+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:21.525704+0000 front 2024-09-21T06:47:21.525444+0000 (oldest deadline 2024-09-21T06:47:47.425656+0000) 2024-09-21T06:47:53.590 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:47:53 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:47:53.272+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:27.926922+0000 front 2024-09-21T06:47:27.926812+0000 (oldest deadline 2024-09-21T06:47:50.826798+0000) 2024-09-21T06:47:53.785 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 06:47:53 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-5[45912]: 2024-09-21T06:47:53.457+0000 7f0c5fcff640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:19.808521+0000 front 2024-09-21T06:47:19.808546+0000 (oldest deadline 2024-09-21T06:47:45.708372+0000) 2024-09-21T06:47:53.869 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 21 06:47:53 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-7[51832]: 2024-09-21T06:47:53.429+0000 7f8eba953640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:26.506838+0000 front 2024-09-21T06:47:26.506866+0000 (oldest deadline 2024-09-21T06:47:51.806954+0000) 2024-09-21T06:47:54.089 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:47:53 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-6[60437]: 2024-09-21T06:47:53.719+0000 7f2a6f214640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:19.260743+0000 front 2024-09-21T06:47:19.260823+0000 (oldest deadline 2024-09-21T06:47:42.760858+0000) 2024-09-21T06:47:54.285 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:47:54 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:47:54.026+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.153182+0000 front 2024-09-21T06:47:20.153132+0000 (oldest deadline 2024-09-21T06:47:43.053177+0000) 2024-09-21T06:47:54.285 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:47:54 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:47:54.026+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.854893+0000 front 2024-09-21T06:47:28.854866+0000 (oldest deadline 2024-09-21T06:47:52.954830+0000) 2024-09-21T06:47:54.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:47:53 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:47:53.916+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.479118+0000 front 2024-09-21T06:47:20.479041+0000 (oldest deadline 2024-09-21T06:47:42.779148+0000) 2024-09-21T06:47:54.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:47:53 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:47:53.916+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.680367+0000 front 2024-09-21T06:47:28.680320+0000 (oldest deadline 2024-09-21T06:47:51.580480+0000) 2024-09-21T06:47:54.589 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:47:54 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:47:54.286+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:21.525704+0000 front 2024-09-21T06:47:21.525444+0000 (oldest deadline 2024-09-21T06:47:47.425656+0000) 2024-09-21T06:47:54.590 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:47:54 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:47:54.286+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:27.926922+0000 front 2024-09-21T06:47:27.926812+0000 (oldest deadline 2024-09-21T06:47:50.826798+0000) 2024-09-21T06:47:54.785 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 06:47:54 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-5[45912]: 2024-09-21T06:47:54.502+0000 7f0c5fcff640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:19.808521+0000 front 2024-09-21T06:47:19.808546+0000 (oldest deadline 2024-09-21T06:47:45.708372+0000) 2024-09-21T06:47:54.785 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 06:47:54 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-5[45912]: 2024-09-21T06:47:54.502+0000 7f0c5fcff640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:29.809440+0000 front 2024-09-21T06:47:29.809371+0000 (oldest deadline 2024-09-21T06:47:53.909298+0000) 2024-09-21T06:47:54.786 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:47:54 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:47:54.446+0000 7f95c5ee3640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:27.715108+0000 front 2024-09-21T06:47:27.715279+0000 (oldest deadline 2024-09-21T06:47:53.615085+0000) 2024-09-21T06:47:54.869 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 21 06:47:54 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-7[51832]: 2024-09-21T06:47:54.471+0000 7f8eba953640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:26.506838+0000 front 2024-09-21T06:47:26.506866+0000 (oldest deadline 2024-09-21T06:47:51.806954+0000) 2024-09-21T06:47:54.869 INFO:journalctl@ceph.osd.4.smithi018.stdout:Sep 21 06:47:54 smithi018 podman[67048]: 2024-09-21 06:47:54.658721018 +0000 UTC m=+5.430538380 container died 7c3c07f61565247fe5d0e1dfb531e344eabeecc987a26b7ce294efc2712ec53d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True) 2024-09-21T06:47:55.089 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:47:54 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-6[60437]: 2024-09-21T06:47:54.711+0000 7f2a6f214640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:19.260743+0000 front 2024-09-21T06:47:19.260823+0000 (oldest deadline 2024-09-21T06:47:42.760858+0000) 2024-09-21T06:47:55.268 INFO:journalctl@ceph.osd.4.smithi018.stdout:Sep 21 06:47:55 smithi018 podman[67048]: 2024-09-21 06:47:55.057135316 +0000 UTC m=+5.828952677 container cleanup 7c3c07f61565247fe5d0e1dfb531e344eabeecc987a26b7ce294efc2712ec53d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-4, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T06:47:55.268 INFO:journalctl@ceph.osd.4.smithi018.stdout:Sep 21 06:47:55 smithi018 bash[67048]: ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-4 2024-09-21T06:47:55.268 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:47:54 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:47:54.933+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.479118+0000 front 2024-09-21T06:47:20.479041+0000 (oldest deadline 2024-09-21T06:47:42.779148+0000) 2024-09-21T06:47:55.268 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:47:54 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:47:54.933+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.680367+0000 front 2024-09-21T06:47:28.680320+0000 (oldest deadline 2024-09-21T06:47:51.580480+0000) 2024-09-21T06:47:55.285 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:47:55 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:47:55.030+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.153182+0000 front 2024-09-21T06:47:20.153132+0000 (oldest deadline 2024-09-21T06:47:43.053177+0000) 2024-09-21T06:47:55.285 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:47:55 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:47:55.030+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.854893+0000 front 2024-09-21T06:47:28.854866+0000 (oldest deadline 2024-09-21T06:47:52.954830+0000) 2024-09-21T06:47:55.589 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:47:55 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:47:55.268+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:21.525704+0000 front 2024-09-21T06:47:21.525444+0000 (oldest deadline 2024-09-21T06:47:47.425656+0000) 2024-09-21T06:47:55.589 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:47:55 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:47:55.268+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:27.926922+0000 front 2024-09-21T06:47:27.926812+0000 (oldest deadline 2024-09-21T06:47:50.826798+0000) 2024-09-21T06:47:55.619 INFO:journalctl@ceph.osd.4.smithi018.stdout:Sep 21 06:47:55 smithi018 podman[67063]: 2024-09-21 06:47:55.267250847 +0000 UTC m=+0.602921405 container remove 7c3c07f61565247fe5d0e1dfb531e344eabeecc987a26b7ce294efc2712ec53d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2) 2024-09-21T06:47:55.619 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 21 06:47:55 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-7[51832]: 2024-09-21T06:47:55.499+0000 7f8eba953640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:26.506838+0000 front 2024-09-21T06:47:26.506866+0000 (oldest deadline 2024-09-21T06:47:51.806954+0000) 2024-09-21T06:47:55.785 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:47:55 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:47:55.434+0000 7f95c5ee3640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:27.715108+0000 front 2024-09-21T06:47:27.715279+0000 (oldest deadline 2024-09-21T06:47:53.615085+0000) 2024-09-21T06:47:55.785 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 06:47:55 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-5[45912]: 2024-09-21T06:47:55.543+0000 7f0c5fcff640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:19.808521+0000 front 2024-09-21T06:47:19.808546+0000 (oldest deadline 2024-09-21T06:47:45.708372+0000) 2024-09-21T06:47:55.785 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 06:47:55 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-5[45912]: 2024-09-21T06:47:55.543+0000 7f0c5fcff640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:29.809440+0000 front 2024-09-21T06:47:29.809371+0000 (oldest deadline 2024-09-21T06:47:53.909298+0000) 2024-09-21T06:47:55.936 INFO:journalctl@ceph.osd.4.smithi018.stdout:Sep 21 06:47:55 smithi018 podman[67154]: 2024-09-21 06:47:55.580639747 +0000 UTC m=+0.016031395 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:47:55.936 INFO:journalctl@ceph.osd.4.smithi018.stdout:Sep 21 06:47:55 smithi018 podman[67154]: 2024-09-21 06:47:55.818140507 +0000 UTC m=+0.253532146 container create 1b9d9fb72ceb6e3405c11c0a36a108d596a400cec2a0be7373cb50928f696176 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True) 2024-09-21T06:47:56.089 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:47:55 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-6[60437]: 2024-09-21T06:47:55.689+0000 7f2a6f214640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:19.260743+0000 front 2024-09-21T06:47:19.260823+0000 (oldest deadline 2024-09-21T06:47:42.760858+0000) 2024-09-21T06:47:56.090 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:47:55 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-6[60437]: 2024-09-21T06:47:55.689+0000 7f2a6f214640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:25.662475+0000 front 2024-09-21T06:47:25.662446+0000 (oldest deadline 2024-09-21T06:47:55.662697+0000) 2024-09-21T06:47:56.267 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:47:55 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:47:55.934+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.479118+0000 front 2024-09-21T06:47:20.479041+0000 (oldest deadline 2024-09-21T06:47:42.779148+0000) 2024-09-21T06:47:56.267 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:47:55 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:47:55.934+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.680367+0000 front 2024-09-21T06:47:28.680320+0000 (oldest deadline 2024-09-21T06:47:51.580480+0000) 2024-09-21T06:47:56.267 INFO:journalctl@ceph.osd.4.smithi018.stdout:Sep 21 06:47:56 smithi018 podman[67154]: 2024-09-21 06:47:56.070707402 +0000 UTC m=+0.506099041 container init 1b9d9fb72ceb6e3405c11c0a36a108d596a400cec2a0be7373cb50928f696176 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0) 2024-09-21T06:47:56.267 INFO:journalctl@ceph.osd.4.smithi018.stdout:Sep 21 06:47:56 smithi018 podman[67154]: 2024-09-21 06:47:56.073969671 +0000 UTC m=+0.509361316 container start 1b9d9fb72ceb6e3405c11c0a36a108d596a400cec2a0be7373cb50928f696176 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-4-deactivate, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:47:56.267 INFO:journalctl@ceph.osd.4.smithi018.stdout:Sep 21 06:47:56 smithi018 podman[67154]: 2024-09-21 06:47:56.153823896 +0000 UTC m=+0.589215540 container attach 1b9d9fb72ceb6e3405c11c0a36a108d596a400cec2a0be7373cb50928f696176 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-4-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-21T06:47:56.285 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:47:56 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:47:56.026+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.153182+0000 front 2024-09-21T06:47:20.153132+0000 (oldest deadline 2024-09-21T06:47:43.053177+0000) 2024-09-21T06:47:56.285 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:47:56 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:47:56.026+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.854893+0000 front 2024-09-21T06:47:28.854866+0000 (oldest deadline 2024-09-21T06:47:52.954830+0000) 2024-09-21T06:47:56.575 INFO:journalctl@ceph.osd.4.smithi018.stdout:Sep 21 06:47:56 smithi018 podman[67154]: 2024-09-21 06:47:56.266007081 +0000 UTC m=+0.701398729 container died 1b9d9fb72ceb6e3405c11c0a36a108d596a400cec2a0be7373cb50928f696176 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-4-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T06:47:56.575 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 21 06:47:56 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-7[51832]: 2024-09-21T06:47:56.496+0000 7f8eba953640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:26.506838+0000 front 2024-09-21T06:47:26.506866+0000 (oldest deadline 2024-09-21T06:47:51.806954+0000) 2024-09-21T06:47:56.589 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:47:56 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:47:56.247+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:21.525704+0000 front 2024-09-21T06:47:21.525444+0000 (oldest deadline 2024-09-21T06:47:47.425656+0000) 2024-09-21T06:47:56.589 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:47:56 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:47:56.247+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:27.926922+0000 front 2024-09-21T06:47:27.926812+0000 (oldest deadline 2024-09-21T06:47:50.826798+0000) 2024-09-21T06:47:56.785 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:47:56 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:47:56.444+0000 7f95c5ee3640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:27.715108+0000 front 2024-09-21T06:47:27.715279+0000 (oldest deadline 2024-09-21T06:47:53.615085+0000) 2024-09-21T06:47:56.785 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 06:47:56 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-5[45912]: 2024-09-21T06:47:56.496+0000 7f0c5fcff640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:19.808521+0000 front 2024-09-21T06:47:19.808546+0000 (oldest deadline 2024-09-21T06:47:45.708372+0000) 2024-09-21T06:47:56.785 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 06:47:56 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-5[45912]: 2024-09-21T06:47:56.496+0000 7f0c5fcff640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:29.809440+0000 front 2024-09-21T06:47:29.809371+0000 (oldest deadline 2024-09-21T06:47:53.909298+0000) 2024-09-21T06:47:56.861 DEBUG:teuthology.orchestra.run.smithi018:> sudo pkill -f 'journalctl -f -n 0 -u ceph-347cb918-77e2-11ef-baf5-efdc52797490@osd.4.service' 2024-09-21T06:47:56.900 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:47:56.900 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-21T06:47:56.900 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-21T06:47:56.901 DEBUG:teuthology.orchestra.run.smithi144:> sudo systemctl stop ceph-347cb918-77e2-11ef-baf5-efdc52797490@osd.5 2024-09-21T06:47:57.089 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:47:56 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-6[60437]: 2024-09-21T06:47:56.714+0000 7f2a6f214640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:19.260743+0000 front 2024-09-21T06:47:19.260823+0000 (oldest deadline 2024-09-21T06:47:42.760858+0000) 2024-09-21T06:47:57.090 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:47:56 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-6[60437]: 2024-09-21T06:47:56.714+0000 7f2a6f214640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:25.662475+0000 front 2024-09-21T06:47:25.662446+0000 (oldest deadline 2024-09-21T06:47:55.662697+0000) 2024-09-21T06:47:57.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:47:56 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:47:56.922+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.479118+0000 front 2024-09-21T06:47:20.479041+0000 (oldest deadline 2024-09-21T06:47:42.779148+0000) 2024-09-21T06:47:57.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:47:56 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:47:56.922+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.680367+0000 front 2024-09-21T06:47:28.680320+0000 (oldest deadline 2024-09-21T06:47:51.580480+0000) 2024-09-21T06:47:57.214 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 06:47:56 smithi144 systemd[1]: Stopping Ceph osd.5 for 347cb918-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:47:57.214 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:47:57 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:47:57.051+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.153182+0000 front 2024-09-21T06:47:20.153132+0000 (oldest deadline 2024-09-21T06:47:43.053177+0000) 2024-09-21T06:47:57.214 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:47:57 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:47:57.051+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.854893+0000 front 2024-09-21T06:47:28.854866+0000 (oldest deadline 2024-09-21T06:47:52.954830+0000) 2024-09-21T06:47:57.535 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:47:57 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:47:57.448+0000 7f95c5ee3640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:27.715108+0000 front 2024-09-21T06:47:27.715279+0000 (oldest deadline 2024-09-21T06:47:53.615085+0000) 2024-09-21T06:47:57.535 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 06:47:57 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-5[45912]: 2024-09-21T06:47:57.212+0000 7f0c63714640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:47:57.535 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 06:47:57 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-5[45912]: 2024-09-21T06:47:57.212+0000 7f0c63714640 -1 osd.5 88 *** Got signal Terminated *** 2024-09-21T06:47:57.535 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 06:47:57 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-5[45912]: 2024-09-21T06:47:57.212+0000 7f0c63714640 -1 osd.5 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T06:47:57.589 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:47:57 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:47:57.264+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:21.525704+0000 front 2024-09-21T06:47:21.525444+0000 (oldest deadline 2024-09-21T06:47:47.425656+0000) 2024-09-21T06:47:57.590 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:47:57 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:47:57.264+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:27.926922+0000 front 2024-09-21T06:47:27.926812+0000 (oldest deadline 2024-09-21T06:47:50.826798+0000) 2024-09-21T06:47:57.869 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 21 06:47:57 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-7[51832]: 2024-09-21T06:47:57.494+0000 7f8eba953640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:26.506838+0000 front 2024-09-21T06:47:26.506866+0000 (oldest deadline 2024-09-21T06:47:51.806954+0000) 2024-09-21T06:47:58.031 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 06:47:57 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-5[45912]: 2024-09-21T06:47:57.544+0000 7f0c5fcff640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:19.808521+0000 front 2024-09-21T06:47:19.808546+0000 (oldest deadline 2024-09-21T06:47:45.708372+0000) 2024-09-21T06:47:58.031 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 06:47:57 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-5[45912]: 2024-09-21T06:47:57.544+0000 7f0c5fcff640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:29.809440+0000 front 2024-09-21T06:47:29.809371+0000 (oldest deadline 2024-09-21T06:47:53.909298+0000) 2024-09-21T06:47:58.089 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:47:57 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-6[60437]: 2024-09-21T06:47:57.672+0000 7f2a6f214640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:19.260743+0000 front 2024-09-21T06:47:19.260823+0000 (oldest deadline 2024-09-21T06:47:42.760858+0000) 2024-09-21T06:47:58.090 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:47:57 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-6[60437]: 2024-09-21T06:47:57.672+0000 7f2a6f214640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:25.662475+0000 front 2024-09-21T06:47:25.662446+0000 (oldest deadline 2024-09-21T06:47:55.662697+0000) 2024-09-21T06:47:58.285 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:47:58 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:47:58.030+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.153182+0000 front 2024-09-21T06:47:20.153132+0000 (oldest deadline 2024-09-21T06:47:43.053177+0000) 2024-09-21T06:47:58.285 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:47:58 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:47:58.030+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.854893+0000 front 2024-09-21T06:47:28.854866+0000 (oldest deadline 2024-09-21T06:47:52.954830+0000) 2024-09-21T06:47:58.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:47:57 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:47:57.894+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.479118+0000 front 2024-09-21T06:47:20.479041+0000 (oldest deadline 2024-09-21T06:47:42.779148+0000) 2024-09-21T06:47:58.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:47:57 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:47:57.894+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.680367+0000 front 2024-09-21T06:47:28.680320+0000 (oldest deadline 2024-09-21T06:47:51.580480+0000) 2024-09-21T06:47:58.590 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:47:58 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:47:58.280+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:21.525704+0000 front 2024-09-21T06:47:21.525444+0000 (oldest deadline 2024-09-21T06:47:47.425656+0000) 2024-09-21T06:47:58.590 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:47:58 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:47:58.280+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:27.926922+0000 front 2024-09-21T06:47:27.926812+0000 (oldest deadline 2024-09-21T06:47:50.826798+0000) 2024-09-21T06:47:58.785 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:47:58 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:47:58.452+0000 7f95c5ee3640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:27.715108+0000 front 2024-09-21T06:47:27.715279+0000 (oldest deadline 2024-09-21T06:47:53.615085+0000) 2024-09-21T06:47:58.785 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 06:47:58 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-5[45912]: 2024-09-21T06:47:58.521+0000 7f0c5fcff640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:19.808521+0000 front 2024-09-21T06:47:19.808546+0000 (oldest deadline 2024-09-21T06:47:45.708372+0000) 2024-09-21T06:47:58.785 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 06:47:58 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-5[45912]: 2024-09-21T06:47:58.521+0000 7f0c5fcff640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:29.809440+0000 front 2024-09-21T06:47:29.809371+0000 (oldest deadline 2024-09-21T06:47:53.909298+0000) 2024-09-21T06:47:58.869 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 21 06:47:58 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-7[51832]: 2024-09-21T06:47:58.484+0000 7f8eba953640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:26.506838+0000 front 2024-09-21T06:47:26.506866+0000 (oldest deadline 2024-09-21T06:47:51.806954+0000) 2024-09-21T06:47:59.090 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:47:58 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-6[60437]: 2024-09-21T06:47:58.657+0000 7f2a6f214640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:19.260743+0000 front 2024-09-21T06:47:19.260823+0000 (oldest deadline 2024-09-21T06:47:42.760858+0000) 2024-09-21T06:47:59.090 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:47:58 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-6[60437]: 2024-09-21T06:47:58.657+0000 7f2a6f214640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:25.662475+0000 front 2024-09-21T06:47:25.662446+0000 (oldest deadline 2024-09-21T06:47:55.662697+0000) 2024-09-21T06:47:59.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:47:58 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:47:58.906+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.479118+0000 front 2024-09-21T06:47:20.479041+0000 (oldest deadline 2024-09-21T06:47:42.779148+0000) 2024-09-21T06:47:59.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:47:58 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:47:58.906+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.680367+0000 front 2024-09-21T06:47:28.680320+0000 (oldest deadline 2024-09-21T06:47:51.580480+0000) 2024-09-21T06:47:59.411 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:47:59 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:47:59.048+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.153182+0000 front 2024-09-21T06:47:20.153132+0000 (oldest deadline 2024-09-21T06:47:43.053177+0000) 2024-09-21T06:47:59.411 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:47:59 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:47:59.048+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.854893+0000 front 2024-09-21T06:47:28.854866+0000 (oldest deadline 2024-09-21T06:47:52.954830+0000) 2024-09-21T06:47:59.590 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:47:59 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:47:59.238+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:21.525704+0000 front 2024-09-21T06:47:21.525444+0000 (oldest deadline 2024-09-21T06:47:47.425656+0000) 2024-09-21T06:47:59.590 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:47:59 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:47:59.238+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:27.926922+0000 front 2024-09-21T06:47:27.926812+0000 (oldest deadline 2024-09-21T06:47:50.826798+0000) 2024-09-21T06:47:59.785 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:47:59 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:47:59.409+0000 7f95c5ee3640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:27.715108+0000 front 2024-09-21T06:47:27.715279+0000 (oldest deadline 2024-09-21T06:47:53.615085+0000) 2024-09-21T06:47:59.785 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 06:47:59 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-5[45912]: 2024-09-21T06:47:59.517+0000 7f0c5fcff640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:19.808521+0000 front 2024-09-21T06:47:19.808546+0000 (oldest deadline 2024-09-21T06:47:45.708372+0000) 2024-09-21T06:47:59.785 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 06:47:59 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-5[45912]: 2024-09-21T06:47:59.517+0000 7f0c5fcff640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:29.809440+0000 front 2024-09-21T06:47:29.809371+0000 (oldest deadline 2024-09-21T06:47:53.909298+0000) 2024-09-21T06:47:59.869 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 21 06:47:59 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-7[51832]: 2024-09-21T06:47:59.463+0000 7f8eba953640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:26.506838+0000 front 2024-09-21T06:47:26.506866+0000 (oldest deadline 2024-09-21T06:47:51.806954+0000) 2024-09-21T06:47:59.869 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 21 06:47:59 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-7[51832]: 2024-09-21T06:47:59.463+0000 7f8eba953640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.507988+0000 front 2024-09-21T06:47:36.508059+0000 (oldest deadline 2024-09-21T06:47:59.407803+0000) 2024-09-21T06:48:00.090 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:47:59 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-6[60437]: 2024-09-21T06:47:59.620+0000 7f2a6f214640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:19.260743+0000 front 2024-09-21T06:47:19.260823+0000 (oldest deadline 2024-09-21T06:47:42.760858+0000) 2024-09-21T06:48:00.090 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:47:59 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-6[60437]: 2024-09-21T06:47:59.620+0000 7f2a6f214640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:25.662475+0000 front 2024-09-21T06:47:25.662446+0000 (oldest deadline 2024-09-21T06:47:55.662697+0000) 2024-09-21T06:48:00.285 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:00 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:00.013+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.153182+0000 front 2024-09-21T06:47:20.153132+0000 (oldest deadline 2024-09-21T06:47:43.053177+0000) 2024-09-21T06:48:00.285 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:00 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:00.013+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.854893+0000 front 2024-09-21T06:47:28.854866+0000 (oldest deadline 2024-09-21T06:47:52.954830+0000) 2024-09-21T06:48:00.285 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:00 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:00.013+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.656042+0000 front 2024-09-21T06:47:37.656018+0000 (oldest deadline 2024-09-21T06:47:59.856770+0000) 2024-09-21T06:48:00.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:47:59 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:47:59.870+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.479118+0000 front 2024-09-21T06:47:20.479041+0000 (oldest deadline 2024-09-21T06:47:42.779148+0000) 2024-09-21T06:48:00.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:47:59 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:47:59.870+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.680367+0000 front 2024-09-21T06:47:28.680320+0000 (oldest deadline 2024-09-21T06:47:51.580480+0000) 2024-09-21T06:48:00.589 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:00 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:00.279+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:21.525704+0000 front 2024-09-21T06:47:21.525444+0000 (oldest deadline 2024-09-21T06:47:47.425656+0000) 2024-09-21T06:48:00.590 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:00 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:00.279+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:27.926922+0000 front 2024-09-21T06:47:27.926812+0000 (oldest deadline 2024-09-21T06:47:50.826798+0000) 2024-09-21T06:48:00.785 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 06:48:00 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-5[45912]: 2024-09-21T06:48:00.489+0000 7f0c5fcff640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:19.808521+0000 front 2024-09-21T06:47:19.808546+0000 (oldest deadline 2024-09-21T06:47:45.708372+0000) 2024-09-21T06:48:00.785 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 06:48:00 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-5[45912]: 2024-09-21T06:48:00.489+0000 7f0c5fcff640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:29.809440+0000 front 2024-09-21T06:47:29.809371+0000 (oldest deadline 2024-09-21T06:47:53.909298+0000) 2024-09-21T06:48:00.785 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:00 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:48:00.454+0000 7f95c5ee3640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:27.715108+0000 front 2024-09-21T06:47:27.715279+0000 (oldest deadline 2024-09-21T06:47:53.615085+0000) 2024-09-21T06:48:00.785 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:00 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:48:00.454+0000 7f95c5ee3640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.516125+0000 front 2024-09-21T06:47:36.516474+0000 (oldest deadline 2024-09-21T06:48:00.016164+0000) 2024-09-21T06:48:00.835 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 21 06:48:00 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-7[51832]: 2024-09-21T06:48:00.447+0000 7f8eba953640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:26.506838+0000 front 2024-09-21T06:47:26.506866+0000 (oldest deadline 2024-09-21T06:47:51.806954+0000) 2024-09-21T06:48:00.835 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 21 06:48:00 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-7[51832]: 2024-09-21T06:48:00.447+0000 7f8eba953640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.507988+0000 front 2024-09-21T06:47:36.508059+0000 (oldest deadline 2024-09-21T06:47:59.407803+0000) 2024-09-21T06:48:01.089 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:48:00 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-6[60437]: 2024-09-21T06:48:00.643+0000 7f2a6f214640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:19.260743+0000 front 2024-09-21T06:47:19.260823+0000 (oldest deadline 2024-09-21T06:47:42.760858+0000) 2024-09-21T06:48:01.090 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:48:00 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-6[60437]: 2024-09-21T06:48:00.643+0000 7f2a6f214640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:25.662475+0000 front 2024-09-21T06:47:25.662446+0000 (oldest deadline 2024-09-21T06:47:55.662697+0000) 2024-09-21T06:48:01.118 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:00 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:00.833+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.479118+0000 front 2024-09-21T06:47:20.479041+0000 (oldest deadline 2024-09-21T06:47:42.779148+0000) 2024-09-21T06:48:01.118 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:00 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:00.833+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.680367+0000 front 2024-09-21T06:47:28.680320+0000 (oldest deadline 2024-09-21T06:47:51.580480+0000) 2024-09-21T06:48:01.492 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:01 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:01.054+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.153182+0000 front 2024-09-21T06:47:20.153132+0000 (oldest deadline 2024-09-21T06:47:43.053177+0000) 2024-09-21T06:48:01.492 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:01 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:01.054+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.854893+0000 front 2024-09-21T06:47:28.854866+0000 (oldest deadline 2024-09-21T06:47:52.954830+0000) 2024-09-21T06:48:01.492 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:01 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:01.054+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.656042+0000 front 2024-09-21T06:47:37.656018+0000 (oldest deadline 2024-09-21T06:47:59.856770+0000) 2024-09-21T06:48:01.589 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:01 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:01.263+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:21.525704+0000 front 2024-09-21T06:47:21.525444+0000 (oldest deadline 2024-09-21T06:47:47.425656+0000) 2024-09-21T06:48:01.590 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:01 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:01.263+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:27.926922+0000 front 2024-09-21T06:47:27.926812+0000 (oldest deadline 2024-09-21T06:47:50.826798+0000) 2024-09-21T06:48:01.590 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:01 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:01.263+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.728100+0000 front 2024-09-21T06:47:36.727861+0000 (oldest deadline 2024-09-21T06:48:00.828027+0000) 2024-09-21T06:48:01.785 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:01 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:48:01.490+0000 7f95c5ee3640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:27.715108+0000 front 2024-09-21T06:47:27.715279+0000 (oldest deadline 2024-09-21T06:47:53.615085+0000) 2024-09-21T06:48:01.785 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:01 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:48:01.490+0000 7f95c5ee3640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.516125+0000 front 2024-09-21T06:47:36.516474+0000 (oldest deadline 2024-09-21T06:48:00.016164+0000) 2024-09-21T06:48:01.785 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 06:48:01 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-5[45912]: 2024-09-21T06:48:01.496+0000 7f0c5fcff640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:19.808521+0000 front 2024-09-21T06:47:19.808546+0000 (oldest deadline 2024-09-21T06:47:45.708372+0000) 2024-09-21T06:48:01.785 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 06:48:01 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-5[45912]: 2024-09-21T06:48:01.496+0000 7f0c5fcff640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:29.809440+0000 front 2024-09-21T06:47:29.809371+0000 (oldest deadline 2024-09-21T06:47:53.909298+0000) 2024-09-21T06:48:01.785 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 06:48:01 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-5[45912]: 2024-09-21T06:48:01.496+0000 7f0c5fcff640 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:33.909794+0000 front 2024-09-21T06:47:33.909763+0000 (oldest deadline 2024-09-21T06:48:00.910546+0000) 2024-09-21T06:48:01.868 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 21 06:48:01 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-7[51832]: 2024-09-21T06:48:01.452+0000 7f8eba953640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:26.506838+0000 front 2024-09-21T06:47:26.506866+0000 (oldest deadline 2024-09-21T06:47:51.806954+0000) 2024-09-21T06:48:01.869 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 21 06:48:01 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-7[51832]: 2024-09-21T06:48:01.452+0000 7f8eba953640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.507988+0000 front 2024-09-21T06:47:36.508059+0000 (oldest deadline 2024-09-21T06:47:59.407803+0000) 2024-09-21T06:48:02.089 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:48:01 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-6[60437]: 2024-09-21T06:48:01.688+0000 7f2a6f214640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:19.260743+0000 front 2024-09-21T06:47:19.260823+0000 (oldest deadline 2024-09-21T06:47:42.760858+0000) 2024-09-21T06:48:02.090 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:48:01 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-6[60437]: 2024-09-21T06:48:01.688+0000 7f2a6f214640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:25.662475+0000 front 2024-09-21T06:47:25.662446+0000 (oldest deadline 2024-09-21T06:47:55.662697+0000) 2024-09-21T06:48:02.090 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:48:01 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-6[60437]: 2024-09-21T06:48:01.688+0000 7f2a6f214640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.763847+0000 front 2024-09-21T06:47:36.763882+0000 (oldest deadline 2024-09-21T06:48:00.863649+0000) 2024-09-21T06:48:02.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:01 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:01.866+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.479118+0000 front 2024-09-21T06:47:20.479041+0000 (oldest deadline 2024-09-21T06:47:42.779148+0000) 2024-09-21T06:48:02.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:01 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:01.866+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.680367+0000 front 2024-09-21T06:47:28.680320+0000 (oldest deadline 2024-09-21T06:47:51.580480+0000) 2024-09-21T06:48:02.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:01 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:01.866+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.982225+0000 front 2024-09-21T06:47:37.982324+0000 (oldest deadline 2024-09-21T06:48:01.482191+0000) 2024-09-21T06:48:02.285 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:02 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:02.024+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.153182+0000 front 2024-09-21T06:47:20.153132+0000 (oldest deadline 2024-09-21T06:47:43.053177+0000) 2024-09-21T06:48:02.285 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:02 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:02.024+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.854893+0000 front 2024-09-21T06:47:28.854866+0000 (oldest deadline 2024-09-21T06:47:52.954830+0000) 2024-09-21T06:48:02.285 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:02 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:02.024+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.656042+0000 front 2024-09-21T06:47:37.656018+0000 (oldest deadline 2024-09-21T06:47:59.856770+0000) 2024-09-21T06:48:02.589 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:02 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:02.290+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:21.525704+0000 front 2024-09-21T06:47:21.525444+0000 (oldest deadline 2024-09-21T06:47:47.425656+0000) 2024-09-21T06:48:02.590 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:02 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:02.290+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:27.926922+0000 front 2024-09-21T06:47:27.926812+0000 (oldest deadline 2024-09-21T06:47:50.826798+0000) 2024-09-21T06:48:02.590 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:02 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:02.290+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.728100+0000 front 2024-09-21T06:47:36.727861+0000 (oldest deadline 2024-09-21T06:48:00.828027+0000) 2024-09-21T06:48:02.785 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 06:48:02 smithi144 podman[68107]: 2024-09-21 06:48:02.630726585 +0000 UTC m=+5.539530145 container died 86fe110027d2f99456a7e659bd12cea31d993059fd82b0e1db5362510c5e5c12 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-5, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-21T06:48:02.785 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:02 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:48:02.512+0000 7f95c5ee3640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:27.715108+0000 front 2024-09-21T06:47:27.715279+0000 (oldest deadline 2024-09-21T06:47:53.615085+0000) 2024-09-21T06:48:02.785 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:02 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:48:02.512+0000 7f95c5ee3640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.516125+0000 front 2024-09-21T06:47:36.516474+0000 (oldest deadline 2024-09-21T06:48:00.016164+0000) 2024-09-21T06:48:02.833 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 21 06:48:02 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-7[51832]: 2024-09-21T06:48:02.414+0000 7f8eba953640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:26.506838+0000 front 2024-09-21T06:47:26.506866+0000 (oldest deadline 2024-09-21T06:47:51.806954+0000) 2024-09-21T06:48:02.833 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 21 06:48:02 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-7[51832]: 2024-09-21T06:48:02.414+0000 7f8eba953640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.507988+0000 front 2024-09-21T06:47:36.508059+0000 (oldest deadline 2024-09-21T06:47:59.407803+0000) 2024-09-21T06:48:03.090 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:48:02 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-6[60437]: 2024-09-21T06:48:02.654+0000 7f2a6f214640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:19.260743+0000 front 2024-09-21T06:47:19.260823+0000 (oldest deadline 2024-09-21T06:47:42.760858+0000) 2024-09-21T06:48:03.090 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:48:02 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-6[60437]: 2024-09-21T06:48:02.654+0000 7f2a6f214640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:25.662475+0000 front 2024-09-21T06:47:25.662446+0000 (oldest deadline 2024-09-21T06:47:55.662697+0000) 2024-09-21T06:48:03.090 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:48:02 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-6[60437]: 2024-09-21T06:48:02.654+0000 7f2a6f214640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.763847+0000 front 2024-09-21T06:47:36.763882+0000 (oldest deadline 2024-09-21T06:48:00.863649+0000) 2024-09-21T06:48:03.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:02 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:02.831+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.479118+0000 front 2024-09-21T06:47:20.479041+0000 (oldest deadline 2024-09-21T06:47:42.779148+0000) 2024-09-21T06:48:03.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:02 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:02.831+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.680367+0000 front 2024-09-21T06:47:28.680320+0000 (oldest deadline 2024-09-21T06:47:51.580480+0000) 2024-09-21T06:48:03.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:02 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:02.831+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.982225+0000 front 2024-09-21T06:47:37.982324+0000 (oldest deadline 2024-09-21T06:48:01.482191+0000) 2024-09-21T06:48:03.281 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 06:48:03 smithi144 podman[68107]: 2024-09-21 06:48:03.045559781 +0000 UTC m=+5.954363330 container cleanup 86fe110027d2f99456a7e659bd12cea31d993059fd82b0e1db5362510c5e5c12 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-5, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-21T06:48:03.282 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 06:48:03 smithi144 bash[68107]: ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-5 2024-09-21T06:48:03.282 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:03 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:03.056+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.153182+0000 front 2024-09-21T06:47:20.153132+0000 (oldest deadline 2024-09-21T06:47:43.053177+0000) 2024-09-21T06:48:03.282 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:03 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:03.056+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.854893+0000 front 2024-09-21T06:47:28.854866+0000 (oldest deadline 2024-09-21T06:47:52.954830+0000) 2024-09-21T06:48:03.282 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:03 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:03.056+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.656042+0000 front 2024-09-21T06:47:37.656018+0000 (oldest deadline 2024-09-21T06:47:59.856770+0000) 2024-09-21T06:48:03.535 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 06:48:03 smithi144 podman[68122]: 2024-09-21 06:48:03.280345323 +0000 UTC m=+0.647222392 container remove 86fe110027d2f99456a7e659bd12cea31d993059fd82b0e1db5362510c5e5c12 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-5, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-21T06:48:03.590 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:03 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:03.264+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:21.525704+0000 front 2024-09-21T06:47:21.525444+0000 (oldest deadline 2024-09-21T06:47:47.425656+0000) 2024-09-21T06:48:03.590 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:03 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:03.264+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:27.926922+0000 front 2024-09-21T06:47:27.926812+0000 (oldest deadline 2024-09-21T06:47:50.826798+0000) 2024-09-21T06:48:03.590 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:03 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:03.264+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.728100+0000 front 2024-09-21T06:47:36.727861+0000 (oldest deadline 2024-09-21T06:48:00.828027+0000) 2024-09-21T06:48:03.837 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:03 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:48:03.540+0000 7f95c5ee3640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:27.715108+0000 front 2024-09-21T06:47:27.715279+0000 (oldest deadline 2024-09-21T06:47:53.615085+0000) 2024-09-21T06:48:03.837 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:03 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:48:03.540+0000 7f95c5ee3640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.516125+0000 front 2024-09-21T06:47:36.516474+0000 (oldest deadline 2024-09-21T06:48:00.016164+0000) 2024-09-21T06:48:03.837 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 06:48:03 smithi144 podman[68212]: 2024-09-21 06:48:03.617139917 +0000 UTC m=+0.016127631 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:48:03.837 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 06:48:03 smithi144 podman[68212]: 2024-09-21 06:48:03.722855194 +0000 UTC m=+0.121842900 container create 519ff177d23cbb30fdb20d8c704f40f0177aac4385b30cffb83c280a42278067 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-5-deactivate, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T06:48:03.862 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 21 06:48:03 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-7[51832]: 2024-09-21T06:48:03.434+0000 7f8eba953640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:26.506838+0000 front 2024-09-21T06:47:26.506866+0000 (oldest deadline 2024-09-21T06:47:51.806954+0000) 2024-09-21T06:48:03.862 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 21 06:48:03 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-7[51832]: 2024-09-21T06:48:03.434+0000 7f8eba953640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.507988+0000 front 2024-09-21T06:47:36.508059+0000 (oldest deadline 2024-09-21T06:47:59.407803+0000) 2024-09-21T06:48:04.089 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:48:03 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-6[60437]: 2024-09-21T06:48:03.652+0000 7f2a6f214640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:19.260743+0000 front 2024-09-21T06:47:19.260823+0000 (oldest deadline 2024-09-21T06:47:42.760858+0000) 2024-09-21T06:48:04.090 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:48:03 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-6[60437]: 2024-09-21T06:48:03.652+0000 7f2a6f214640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:25.662475+0000 front 2024-09-21T06:47:25.662446+0000 (oldest deadline 2024-09-21T06:47:55.662697+0000) 2024-09-21T06:48:04.090 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:48:03 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-6[60437]: 2024-09-21T06:48:03.652+0000 7f2a6f214640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.763847+0000 front 2024-09-21T06:47:36.763882+0000 (oldest deadline 2024-09-21T06:48:00.863649+0000) 2024-09-21T06:48:04.106 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 06:48:04 smithi144 podman[68212]: 2024-09-21 06:48:04.000836796 +0000 UTC m=+0.399824515 container init 519ff177d23cbb30fdb20d8c704f40f0177aac4385b30cffb83c280a42278067 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-5-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-21T06:48:04.106 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 06:48:04 smithi144 podman[68212]: 2024-09-21 06:48:04.003995842 +0000 UTC m=+0.402983549 container start 519ff177d23cbb30fdb20d8c704f40f0177aac4385b30cffb83c280a42278067 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-5-deactivate, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T06:48:04.106 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 06:48:04 smithi144 podman[68212]: 2024-09-21 06:48:04.105299873 +0000 UTC m=+0.504287594 container attach 519ff177d23cbb30fdb20d8c704f40f0177aac4385b30cffb83c280a42278067 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-5-deactivate, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-21T06:48:04.117 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:03 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:03.860+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.479118+0000 front 2024-09-21T06:47:20.479041+0000 (oldest deadline 2024-09-21T06:47:42.779148+0000) 2024-09-21T06:48:04.117 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:03 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:03.860+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.680367+0000 front 2024-09-21T06:47:28.680320+0000 (oldest deadline 2024-09-21T06:47:51.580480+0000) 2024-09-21T06:48:04.118 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:03 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:03.860+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.982225+0000 front 2024-09-21T06:47:37.982324+0000 (oldest deadline 2024-09-21T06:48:01.482191+0000) 2024-09-21T06:48:04.535 INFO:journalctl@ceph.osd.5.smithi144.stdout:Sep 21 06:48:04 smithi144 podman[68212]: 2024-09-21 06:48:04.198067711 +0000 UTC m=+0.597055425 container died 519ff177d23cbb30fdb20d8c704f40f0177aac4385b30cffb83c280a42278067 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-5-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2) 2024-09-21T06:48:04.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:04 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:04.106+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.153182+0000 front 2024-09-21T06:47:20.153132+0000 (oldest deadline 2024-09-21T06:47:43.053177+0000) 2024-09-21T06:48:04.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:04 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:04.106+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.854893+0000 front 2024-09-21T06:47:28.854866+0000 (oldest deadline 2024-09-21T06:47:52.954830+0000) 2024-09-21T06:48:04.536 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:04 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:04.106+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.656042+0000 front 2024-09-21T06:47:37.656018+0000 (oldest deadline 2024-09-21T06:47:59.856770+0000) 2024-09-21T06:48:04.589 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:04 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:04.241+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:21.525704+0000 front 2024-09-21T06:47:21.525444+0000 (oldest deadline 2024-09-21T06:47:47.425656+0000) 2024-09-21T06:48:04.590 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:04 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:04.241+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:27.926922+0000 front 2024-09-21T06:47:27.926812+0000 (oldest deadline 2024-09-21T06:47:50.826798+0000) 2024-09-21T06:48:04.590 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:04 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:04.241+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.728100+0000 front 2024-09-21T06:47:36.727861+0000 (oldest deadline 2024-09-21T06:48:00.828027+0000) 2024-09-21T06:48:04.853 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 21 06:48:04 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-7[51832]: 2024-09-21T06:48:04.407+0000 7f8eba953640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:26.506838+0000 front 2024-09-21T06:47:26.506866+0000 (oldest deadline 2024-09-21T06:47:51.806954+0000) 2024-09-21T06:48:04.853 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 21 06:48:04 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-7[51832]: 2024-09-21T06:48:04.407+0000 7f8eba953640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.507988+0000 front 2024-09-21T06:47:36.508059+0000 (oldest deadline 2024-09-21T06:47:59.407803+0000) 2024-09-21T06:48:04.872 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:04 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:48:04.588+0000 7f95c5ee3640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:27.715108+0000 front 2024-09-21T06:47:27.715279+0000 (oldest deadline 2024-09-21T06:47:53.615085+0000) 2024-09-21T06:48:04.873 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:04 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:48:04.588+0000 7f95c5ee3640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.516125+0000 front 2024-09-21T06:47:36.516474+0000 (oldest deadline 2024-09-21T06:48:00.016164+0000) 2024-09-21T06:48:04.894 DEBUG:teuthology.orchestra.run.smithi144:> sudo pkill -f 'journalctl -f -n 0 -u ceph-347cb918-77e2-11ef-baf5-efdc52797490@osd.5.service' 2024-09-21T06:48:04.938 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:48:04.938 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-21T06:48:04.939 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-21T06:48:04.939 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ceph-347cb918-77e2-11ef-baf5-efdc52797490@osd.6 2024-09-21T06:48:04.967 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:48:04 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-6[60437]: 2024-09-21T06:48:04.665+0000 7f2a6f214640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:19.260743+0000 front 2024-09-21T06:47:19.260823+0000 (oldest deadline 2024-09-21T06:47:42.760858+0000) 2024-09-21T06:48:04.968 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:48:04 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-6[60437]: 2024-09-21T06:48:04.665+0000 7f2a6f214640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:25.662475+0000 front 2024-09-21T06:47:25.662446+0000 (oldest deadline 2024-09-21T06:47:55.662697+0000) 2024-09-21T06:48:04.968 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:48:04 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-6[60437]: 2024-09-21T06:48:04.665+0000 7f2a6f214640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.763847+0000 front 2024-09-21T06:47:36.763882+0000 (oldest deadline 2024-09-21T06:48:00.863649+0000) 2024-09-21T06:48:05.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:04 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:04.852+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.479118+0000 front 2024-09-21T06:47:20.479041+0000 (oldest deadline 2024-09-21T06:47:42.779148+0000) 2024-09-21T06:48:05.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:04 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:04.852+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.680367+0000 front 2024-09-21T06:47:28.680320+0000 (oldest deadline 2024-09-21T06:47:51.580480+0000) 2024-09-21T06:48:05.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:04 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:04.852+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.982225+0000 front 2024-09-21T06:47:37.982324+0000 (oldest deadline 2024-09-21T06:48:01.482191+0000) 2024-09-21T06:48:05.256 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:48:04 smithi007 systemd[1]: Stopping Ceph osd.6 for 347cb918-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:48:05.285 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:05 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:05.106+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.153182+0000 front 2024-09-21T06:47:20.153132+0000 (oldest deadline 2024-09-21T06:47:43.053177+0000) 2024-09-21T06:48:05.285 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:05 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:05.106+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.854893+0000 front 2024-09-21T06:47:28.854866+0000 (oldest deadline 2024-09-21T06:47:52.954830+0000) 2024-09-21T06:48:05.285 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:05 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:05.106+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.656042+0000 front 2024-09-21T06:47:37.656018+0000 (oldest deadline 2024-09-21T06:47:59.856770+0000) 2024-09-21T06:48:05.589 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:48:05 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-6[60437]: 2024-09-21T06:48:05.260+0000 7f2a76c31640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:48:05.590 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:48:05 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-6[60437]: 2024-09-21T06:48:05.260+0000 7f2a76c31640 -1 osd.6 88 *** Got signal Terminated *** 2024-09-21T06:48:05.590 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:48:05 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-6[60437]: 2024-09-21T06:48:05.260+0000 7f2a76c31640 -1 osd.6 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T06:48:05.590 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:05 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:05.255+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:21.525704+0000 front 2024-09-21T06:47:21.525444+0000 (oldest deadline 2024-09-21T06:47:47.425656+0000) 2024-09-21T06:48:05.590 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:05 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:05.255+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:27.926922+0000 front 2024-09-21T06:47:27.926812+0000 (oldest deadline 2024-09-21T06:47:50.826798+0000) 2024-09-21T06:48:05.590 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:05 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:05.255+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.728100+0000 front 2024-09-21T06:47:36.727861+0000 (oldest deadline 2024-09-21T06:48:00.828027+0000) 2024-09-21T06:48:05.854 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 21 06:48:05 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-7[51832]: 2024-09-21T06:48:05.369+0000 7f8eba953640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:26.506838+0000 front 2024-09-21T06:47:26.506866+0000 (oldest deadline 2024-09-21T06:47:51.806954+0000) 2024-09-21T06:48:05.854 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 21 06:48:05 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-7[51832]: 2024-09-21T06:48:05.369+0000 7f8eba953640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.507988+0000 front 2024-09-21T06:47:36.508059+0000 (oldest deadline 2024-09-21T06:47:59.407803+0000) 2024-09-21T06:48:06.035 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:05 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:48:05.620+0000 7f95c5ee3640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:27.715108+0000 front 2024-09-21T06:47:27.715279+0000 (oldest deadline 2024-09-21T06:47:53.615085+0000) 2024-09-21T06:48:06.035 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:05 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:48:05.620+0000 7f95c5ee3640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.516125+0000 front 2024-09-21T06:47:36.516474+0000 (oldest deadline 2024-09-21T06:48:00.016164+0000) 2024-09-21T06:48:06.089 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:48:05 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-6[60437]: 2024-09-21T06:48:05.667+0000 7f2a6f214640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:19.260743+0000 front 2024-09-21T06:47:19.260823+0000 (oldest deadline 2024-09-21T06:47:42.760858+0000) 2024-09-21T06:48:06.089 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:48:05 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-6[60437]: 2024-09-21T06:48:05.667+0000 7f2a6f214640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:25.662475+0000 front 2024-09-21T06:47:25.662446+0000 (oldest deadline 2024-09-21T06:47:55.662697+0000) 2024-09-21T06:48:06.090 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:48:05 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-6[60437]: 2024-09-21T06:48:05.667+0000 7f2a6f214640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.763847+0000 front 2024-09-21T06:47:36.763882+0000 (oldest deadline 2024-09-21T06:48:00.863649+0000) 2024-09-21T06:48:06.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:05 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:05.852+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.479118+0000 front 2024-09-21T06:47:20.479041+0000 (oldest deadline 2024-09-21T06:47:42.779148+0000) 2024-09-21T06:48:06.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:05 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:05.852+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.680367+0000 front 2024-09-21T06:47:28.680320+0000 (oldest deadline 2024-09-21T06:47:51.580480+0000) 2024-09-21T06:48:06.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:05 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:05.852+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.982225+0000 front 2024-09-21T06:47:37.982324+0000 (oldest deadline 2024-09-21T06:48:01.482191+0000) 2024-09-21T06:48:06.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:06 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:06.156+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.153182+0000 front 2024-09-21T06:47:20.153132+0000 (oldest deadline 2024-09-21T06:47:43.053177+0000) 2024-09-21T06:48:06.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:06 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:06.156+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.854893+0000 front 2024-09-21T06:47:28.854866+0000 (oldest deadline 2024-09-21T06:47:52.954830+0000) 2024-09-21T06:48:06.536 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:06 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:06.156+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.656042+0000 front 2024-09-21T06:47:37.656018+0000 (oldest deadline 2024-09-21T06:47:59.856770+0000) 2024-09-21T06:48:06.590 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:06 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:06.263+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:21.525704+0000 front 2024-09-21T06:47:21.525444+0000 (oldest deadline 2024-09-21T06:47:47.425656+0000) 2024-09-21T06:48:06.590 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:06 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:06.263+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:27.926922+0000 front 2024-09-21T06:47:27.926812+0000 (oldest deadline 2024-09-21T06:47:50.826798+0000) 2024-09-21T06:48:06.590 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:06 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:06.263+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.728100+0000 front 2024-09-21T06:47:36.727861+0000 (oldest deadline 2024-09-21T06:48:00.828027+0000) 2024-09-21T06:48:06.619 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 21 06:48:06 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-7[51832]: 2024-09-21T06:48:06.348+0000 7f8eba953640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:26.506838+0000 front 2024-09-21T06:47:26.506866+0000 (oldest deadline 2024-09-21T06:47:51.806954+0000) 2024-09-21T06:48:06.619 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 21 06:48:06 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-7[51832]: 2024-09-21T06:48:06.348+0000 7f8eba953640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.507988+0000 front 2024-09-21T06:47:36.508059+0000 (oldest deadline 2024-09-21T06:47:59.407803+0000) 2024-09-21T06:48:07.035 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:06 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:48:06.608+0000 7f95c5ee3640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:27.715108+0000 front 2024-09-21T06:47:27.715279+0000 (oldest deadline 2024-09-21T06:47:53.615085+0000) 2024-09-21T06:48:07.035 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:06 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:48:06.608+0000 7f95c5ee3640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.516125+0000 front 2024-09-21T06:47:36.516474+0000 (oldest deadline 2024-09-21T06:48:00.016164+0000) 2024-09-21T06:48:07.089 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:48:06 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-6[60437]: 2024-09-21T06:48:06.633+0000 7f2a6f214640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:19.260743+0000 front 2024-09-21T06:47:19.260823+0000 (oldest deadline 2024-09-21T06:47:42.760858+0000) 2024-09-21T06:48:07.090 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:48:06 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-6[60437]: 2024-09-21T06:48:06.633+0000 7f2a6f214640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:25.662475+0000 front 2024-09-21T06:47:25.662446+0000 (oldest deadline 2024-09-21T06:47:55.662697+0000) 2024-09-21T06:48:07.090 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:48:06 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-6[60437]: 2024-09-21T06:48:06.633+0000 7f2a6f214640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.763847+0000 front 2024-09-21T06:47:36.763882+0000 (oldest deadline 2024-09-21T06:48:00.863649+0000) 2024-09-21T06:48:07.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:06 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:06.848+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.479118+0000 front 2024-09-21T06:47:20.479041+0000 (oldest deadline 2024-09-21T06:47:42.779148+0000) 2024-09-21T06:48:07.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:06 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:06.848+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.680367+0000 front 2024-09-21T06:47:28.680320+0000 (oldest deadline 2024-09-21T06:47:51.580480+0000) 2024-09-21T06:48:07.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:06 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:06.848+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.982225+0000 front 2024-09-21T06:47:37.982324+0000 (oldest deadline 2024-09-21T06:48:01.482191+0000) 2024-09-21T06:48:07.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:07 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:07.170+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.153182+0000 front 2024-09-21T06:47:20.153132+0000 (oldest deadline 2024-09-21T06:47:43.053177+0000) 2024-09-21T06:48:07.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:07 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:07.170+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.854893+0000 front 2024-09-21T06:47:28.854866+0000 (oldest deadline 2024-09-21T06:47:52.954830+0000) 2024-09-21T06:48:07.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:07 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:07.170+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.656042+0000 front 2024-09-21T06:47:37.656018+0000 (oldest deadline 2024-09-21T06:47:59.856770+0000) 2024-09-21T06:48:07.589 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:07 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:07.272+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:21.525704+0000 front 2024-09-21T06:47:21.525444+0000 (oldest deadline 2024-09-21T06:47:47.425656+0000) 2024-09-21T06:48:07.590 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:07 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:07.272+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:27.926922+0000 front 2024-09-21T06:47:27.926812+0000 (oldest deadline 2024-09-21T06:47:50.826798+0000) 2024-09-21T06:48:07.590 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:07 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:07.272+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.728100+0000 front 2024-09-21T06:47:36.727861+0000 (oldest deadline 2024-09-21T06:48:00.828027+0000) 2024-09-21T06:48:07.869 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 21 06:48:07 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-7[51832]: 2024-09-21T06:48:07.388+0000 7f8eba953640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:26.506838+0000 front 2024-09-21T06:47:26.506866+0000 (oldest deadline 2024-09-21T06:47:51.806954+0000) 2024-09-21T06:48:07.869 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 21 06:48:07 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-7[51832]: 2024-09-21T06:48:07.388+0000 7f8eba953640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.507988+0000 front 2024-09-21T06:47:36.508059+0000 (oldest deadline 2024-09-21T06:47:59.407803+0000) 2024-09-21T06:48:08.035 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:07 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:48:07.612+0000 7f95c5ee3640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:27.715108+0000 front 2024-09-21T06:47:27.715279+0000 (oldest deadline 2024-09-21T06:47:53.615085+0000) 2024-09-21T06:48:08.035 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:07 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:48:07.612+0000 7f95c5ee3640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.516125+0000 front 2024-09-21T06:47:36.516474+0000 (oldest deadline 2024-09-21T06:48:00.016164+0000) 2024-09-21T06:48:08.090 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:48:07 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-6[60437]: 2024-09-21T06:48:07.645+0000 7f2a6f214640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:19.260743+0000 front 2024-09-21T06:47:19.260823+0000 (oldest deadline 2024-09-21T06:47:42.760858+0000) 2024-09-21T06:48:08.090 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:48:07 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-6[60437]: 2024-09-21T06:48:07.645+0000 7f2a6f214640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:25.662475+0000 front 2024-09-21T06:47:25.662446+0000 (oldest deadline 2024-09-21T06:47:55.662697+0000) 2024-09-21T06:48:08.090 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:48:07 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-6[60437]: 2024-09-21T06:48:07.645+0000 7f2a6f214640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.763847+0000 front 2024-09-21T06:47:36.763882+0000 (oldest deadline 2024-09-21T06:48:00.863649+0000) 2024-09-21T06:48:08.342 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:07 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:07.870+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.479118+0000 front 2024-09-21T06:47:20.479041+0000 (oldest deadline 2024-09-21T06:47:42.779148+0000) 2024-09-21T06:48:08.343 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:07 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:07.870+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.680367+0000 front 2024-09-21T06:47:28.680320+0000 (oldest deadline 2024-09-21T06:47:51.580480+0000) 2024-09-21T06:48:08.343 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:07 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:07.870+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.982225+0000 front 2024-09-21T06:47:37.982324+0000 (oldest deadline 2024-09-21T06:48:01.482191+0000) 2024-09-21T06:48:08.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:08 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:08.159+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.153182+0000 front 2024-09-21T06:47:20.153132+0000 (oldest deadline 2024-09-21T06:47:43.053177+0000) 2024-09-21T06:48:08.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:08 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:08.159+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.854893+0000 front 2024-09-21T06:47:28.854866+0000 (oldest deadline 2024-09-21T06:47:52.954830+0000) 2024-09-21T06:48:08.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:08 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:08.159+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.656042+0000 front 2024-09-21T06:47:37.656018+0000 (oldest deadline 2024-09-21T06:47:59.856770+0000) 2024-09-21T06:48:08.589 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:08 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:08.282+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:21.525704+0000 front 2024-09-21T06:47:21.525444+0000 (oldest deadline 2024-09-21T06:47:47.425656+0000) 2024-09-21T06:48:08.589 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:08 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:08.282+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:27.926922+0000 front 2024-09-21T06:47:27.926812+0000 (oldest deadline 2024-09-21T06:47:50.826798+0000) 2024-09-21T06:48:08.590 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:08 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:08.282+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.728100+0000 front 2024-09-21T06:47:36.727861+0000 (oldest deadline 2024-09-21T06:48:00.828027+0000) 2024-09-21T06:48:08.619 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 21 06:48:08 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-7[51832]: 2024-09-21T06:48:08.341+0000 7f8eba953640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:26.506838+0000 front 2024-09-21T06:47:26.506866+0000 (oldest deadline 2024-09-21T06:47:51.806954+0000) 2024-09-21T06:48:08.619 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 21 06:48:08 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-7[51832]: 2024-09-21T06:48:08.341+0000 7f8eba953640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.507988+0000 front 2024-09-21T06:47:36.508059+0000 (oldest deadline 2024-09-21T06:47:59.407803+0000) 2024-09-21T06:48:08.619 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 21 06:48:08 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-7[51832]: 2024-09-21T06:48:08.341+0000 7f8eba953640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:47:45.309044+0000 front 2024-09-21T06:47:45.309159+0000 (oldest deadline 2024-09-21T06:48:08.209035+0000) 2024-09-21T06:48:09.035 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:08 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:48:08.608+0000 7f95c5ee3640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:27.715108+0000 front 2024-09-21T06:47:27.715279+0000 (oldest deadline 2024-09-21T06:47:53.615085+0000) 2024-09-21T06:48:09.035 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:08 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:48:08.608+0000 7f95c5ee3640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.516125+0000 front 2024-09-21T06:47:36.516474+0000 (oldest deadline 2024-09-21T06:48:00.016164+0000) 2024-09-21T06:48:09.090 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:48:08 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-6[60437]: 2024-09-21T06:48:08.681+0000 7f2a6f214640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:19.260743+0000 front 2024-09-21T06:47:19.260823+0000 (oldest deadline 2024-09-21T06:47:42.760858+0000) 2024-09-21T06:48:09.090 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:48:08 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-6[60437]: 2024-09-21T06:48:08.681+0000 7f2a6f214640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:25.662475+0000 front 2024-09-21T06:47:25.662446+0000 (oldest deadline 2024-09-21T06:47:55.662697+0000) 2024-09-21T06:48:09.090 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:48:08 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-6[60437]: 2024-09-21T06:48:08.681+0000 7f2a6f214640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.763847+0000 front 2024-09-21T06:47:36.763882+0000 (oldest deadline 2024-09-21T06:48:00.863649+0000) 2024-09-21T06:48:09.305 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:09 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:09.117+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.153182+0000 front 2024-09-21T06:47:20.153132+0000 (oldest deadline 2024-09-21T06:47:43.053177+0000) 2024-09-21T06:48:09.305 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:09 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:09.117+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.854893+0000 front 2024-09-21T06:47:28.854866+0000 (oldest deadline 2024-09-21T06:47:52.954830+0000) 2024-09-21T06:48:09.305 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:09 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:09.117+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.656042+0000 front 2024-09-21T06:47:37.656018+0000 (oldest deadline 2024-09-21T06:47:59.856770+0000) 2024-09-21T06:48:09.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:08 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:08.885+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.479118+0000 front 2024-09-21T06:47:20.479041+0000 (oldest deadline 2024-09-21T06:47:42.779148+0000) 2024-09-21T06:48:09.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:08 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:08.885+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.680367+0000 front 2024-09-21T06:47:28.680320+0000 (oldest deadline 2024-09-21T06:47:51.580480+0000) 2024-09-21T06:48:09.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:08 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:08.885+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.982225+0000 front 2024-09-21T06:47:37.982324+0000 (oldest deadline 2024-09-21T06:48:01.482191+0000) 2024-09-21T06:48:09.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:08 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:08.885+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:47:43.683853+0000 front 2024-09-21T06:47:43.683837+0000 (oldest deadline 2024-09-21T06:48:08.383662+0000) 2024-09-21T06:48:09.590 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:09 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:09.278+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:21.525704+0000 front 2024-09-21T06:47:21.525444+0000 (oldest deadline 2024-09-21T06:47:47.425656+0000) 2024-09-21T06:48:09.590 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:09 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:09.278+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:27.926922+0000 front 2024-09-21T06:47:27.926812+0000 (oldest deadline 2024-09-21T06:47:50.826798+0000) 2024-09-21T06:48:09.590 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:09 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:09.278+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.728100+0000 front 2024-09-21T06:47:36.727861+0000 (oldest deadline 2024-09-21T06:48:00.828027+0000) 2024-09-21T06:48:09.852 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 21 06:48:09 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-7[51832]: 2024-09-21T06:48:09.373+0000 7f8eba953640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:26.506838+0000 front 2024-09-21T06:47:26.506866+0000 (oldest deadline 2024-09-21T06:47:51.806954+0000) 2024-09-21T06:48:09.852 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 21 06:48:09 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-7[51832]: 2024-09-21T06:48:09.373+0000 7f8eba953640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.507988+0000 front 2024-09-21T06:47:36.508059+0000 (oldest deadline 2024-09-21T06:47:59.407803+0000) 2024-09-21T06:48:09.852 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 21 06:48:09 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-7[51832]: 2024-09-21T06:48:09.373+0000 7f8eba953640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:47:45.309044+0000 front 2024-09-21T06:47:45.309159+0000 (oldest deadline 2024-09-21T06:48:08.209035+0000) 2024-09-21T06:48:10.035 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:09 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:48:09.574+0000 7f95c5ee3640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:27.715108+0000 front 2024-09-21T06:47:27.715279+0000 (oldest deadline 2024-09-21T06:47:53.615085+0000) 2024-09-21T06:48:10.035 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:09 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:48:09.574+0000 7f95c5ee3640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.516125+0000 front 2024-09-21T06:47:36.516474+0000 (oldest deadline 2024-09-21T06:48:00.016164+0000) 2024-09-21T06:48:10.089 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:48:09 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-6[60437]: 2024-09-21T06:48:09.681+0000 7f2a6f214640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:19.260743+0000 front 2024-09-21T06:47:19.260823+0000 (oldest deadline 2024-09-21T06:47:42.760858+0000) 2024-09-21T06:48:10.089 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:48:09 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-6[60437]: 2024-09-21T06:48:09.681+0000 7f2a6f214640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:25.662475+0000 front 2024-09-21T06:47:25.662446+0000 (oldest deadline 2024-09-21T06:47:55.662697+0000) 2024-09-21T06:48:10.090 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:48:09 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-6[60437]: 2024-09-21T06:48:09.681+0000 7f2a6f214640 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.763847+0000 front 2024-09-21T06:47:36.763882+0000 (oldest deadline 2024-09-21T06:48:00.863649+0000) 2024-09-21T06:48:10.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:09 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:09.850+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.479118+0000 front 2024-09-21T06:47:20.479041+0000 (oldest deadline 2024-09-21T06:47:42.779148+0000) 2024-09-21T06:48:10.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:09 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:09.850+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.680367+0000 front 2024-09-21T06:47:28.680320+0000 (oldest deadline 2024-09-21T06:47:51.580480+0000) 2024-09-21T06:48:10.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:09 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:09.850+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.982225+0000 front 2024-09-21T06:47:37.982324+0000 (oldest deadline 2024-09-21T06:48:01.482191+0000) 2024-09-21T06:48:10.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:09 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:09.850+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:47:43.683853+0000 front 2024-09-21T06:47:43.683837+0000 (oldest deadline 2024-09-21T06:48:08.383662+0000) 2024-09-21T06:48:10.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:10 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:10.149+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.153182+0000 front 2024-09-21T06:47:20.153132+0000 (oldest deadline 2024-09-21T06:47:43.053177+0000) 2024-09-21T06:48:10.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:10 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:10.149+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.854893+0000 front 2024-09-21T06:47:28.854866+0000 (oldest deadline 2024-09-21T06:47:52.954830+0000) 2024-09-21T06:48:10.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:10 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:10.149+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.656042+0000 front 2024-09-21T06:47:37.656018+0000 (oldest deadline 2024-09-21T06:47:59.856770+0000) 2024-09-21T06:48:10.590 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:10 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:10.323+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:21.525704+0000 front 2024-09-21T06:47:21.525444+0000 (oldest deadline 2024-09-21T06:47:47.425656+0000) 2024-09-21T06:48:10.590 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:10 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:10.323+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:27.926922+0000 front 2024-09-21T06:47:27.926812+0000 (oldest deadline 2024-09-21T06:47:50.826798+0000) 2024-09-21T06:48:10.590 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:10 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:10.323+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.728100+0000 front 2024-09-21T06:47:36.727861+0000 (oldest deadline 2024-09-21T06:48:00.828027+0000) 2024-09-21T06:48:10.810 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 21 06:48:10 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-7[51832]: 2024-09-21T06:48:10.397+0000 7f8eba953640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:26.506838+0000 front 2024-09-21T06:47:26.506866+0000 (oldest deadline 2024-09-21T06:47:51.806954+0000) 2024-09-21T06:48:10.810 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 21 06:48:10 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-7[51832]: 2024-09-21T06:48:10.397+0000 7f8eba953640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.507988+0000 front 2024-09-21T06:47:36.508059+0000 (oldest deadline 2024-09-21T06:47:59.407803+0000) 2024-09-21T06:48:10.810 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 21 06:48:10 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-7[51832]: 2024-09-21T06:48:10.397+0000 7f8eba953640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:47:45.309044+0000 front 2024-09-21T06:47:45.309159+0000 (oldest deadline 2024-09-21T06:48:08.209035+0000) 2024-09-21T06:48:11.035 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:10 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:48:10.620+0000 7f95c5ee3640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:27.715108+0000 front 2024-09-21T06:47:27.715279+0000 (oldest deadline 2024-09-21T06:47:53.615085+0000) 2024-09-21T06:48:11.035 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:10 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:48:10.621+0000 7f95c5ee3640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.516125+0000 front 2024-09-21T06:47:36.516474+0000 (oldest deadline 2024-09-21T06:48:00.016164+0000) 2024-09-21T06:48:11.035 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:10 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:48:10.621+0000 7f95c5ee3640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:47:46.417496+0000 front 2024-09-21T06:47:46.417414+0000 (oldest deadline 2024-09-21T06:48:09.917375+0000) 2024-09-21T06:48:11.079 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:48:10 smithi007 podman[107643]: 2024-09-21 06:48:10.80204086 +0000 UTC m=+5.653924009 container died 8357f51d35e4e217a5d57b23910beae3095abd5b25f244aefdc5df3af906984f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-6, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True) 2024-09-21T06:48:11.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:10 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:10.808+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.479118+0000 front 2024-09-21T06:47:20.479041+0000 (oldest deadline 2024-09-21T06:47:42.779148+0000) 2024-09-21T06:48:11.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:10 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:10.808+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.680367+0000 front 2024-09-21T06:47:28.680320+0000 (oldest deadline 2024-09-21T06:47:51.580480+0000) 2024-09-21T06:48:11.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:10 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:10.808+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.982225+0000 front 2024-09-21T06:47:37.982324+0000 (oldest deadline 2024-09-21T06:48:01.482191+0000) 2024-09-21T06:48:11.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:10 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:10.808+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:47:43.683853+0000 front 2024-09-21T06:47:43.683837+0000 (oldest deadline 2024-09-21T06:48:08.383662+0000) 2024-09-21T06:48:11.339 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:11 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:11.298+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:21.525704+0000 front 2024-09-21T06:47:21.525444+0000 (oldest deadline 2024-09-21T06:47:47.425656+0000) 2024-09-21T06:48:11.340 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:11 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:11.298+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:27.926922+0000 front 2024-09-21T06:47:27.926812+0000 (oldest deadline 2024-09-21T06:47:50.826798+0000) 2024-09-21T06:48:11.340 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:11 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:11.298+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.728100+0000 front 2024-09-21T06:47:36.727861+0000 (oldest deadline 2024-09-21T06:48:00.828027+0000) 2024-09-21T06:48:11.340 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:48:11 smithi007 podman[107643]: 2024-09-21 06:48:11.235727767 +0000 UTC m=+6.087610898 container cleanup 8357f51d35e4e217a5d57b23910beae3095abd5b25f244aefdc5df3af906984f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-6, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T06:48:11.340 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:48:11 smithi007 bash[107643]: ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-6 2024-09-21T06:48:11.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:11 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:11.125+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.153182+0000 front 2024-09-21T06:47:20.153132+0000 (oldest deadline 2024-09-21T06:47:43.053177+0000) 2024-09-21T06:48:11.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:11 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:11.125+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.854893+0000 front 2024-09-21T06:47:28.854866+0000 (oldest deadline 2024-09-21T06:47:52.954830+0000) 2024-09-21T06:48:11.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:11 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:11.125+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.656042+0000 front 2024-09-21T06:47:37.656018+0000 (oldest deadline 2024-09-21T06:47:59.856770+0000) 2024-09-21T06:48:11.834 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 21 06:48:11 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-7[51832]: 2024-09-21T06:48:11.435+0000 7f8eba953640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:26.506838+0000 front 2024-09-21T06:47:26.506866+0000 (oldest deadline 2024-09-21T06:47:51.806954+0000) 2024-09-21T06:48:11.834 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 21 06:48:11 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-7[51832]: 2024-09-21T06:48:11.435+0000 7f8eba953640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.507988+0000 front 2024-09-21T06:47:36.508059+0000 (oldest deadline 2024-09-21T06:47:59.407803+0000) 2024-09-21T06:48:11.834 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 21 06:48:11 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-7[51832]: 2024-09-21T06:48:11.435+0000 7f8eba953640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:47:45.309044+0000 front 2024-09-21T06:47:45.309159+0000 (oldest deadline 2024-09-21T06:48:08.209035+0000) 2024-09-21T06:48:11.839 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:48:11 smithi007 podman[107658]: 2024-09-21 06:48:11.437359164 +0000 UTC m=+0.629313620 container remove 8357f51d35e4e217a5d57b23910beae3095abd5b25f244aefdc5df3af906984f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-6, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-21T06:48:12.035 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:11 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:48:11.667+0000 7f95c5ee3640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:27.715108+0000 front 2024-09-21T06:47:27.715279+0000 (oldest deadline 2024-09-21T06:47:53.615085+0000) 2024-09-21T06:48:12.035 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:11 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:48:11.667+0000 7f95c5ee3640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.516125+0000 front 2024-09-21T06:47:36.516474+0000 (oldest deadline 2024-09-21T06:48:00.016164+0000) 2024-09-21T06:48:12.035 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:11 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:48:11.667+0000 7f95c5ee3640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:47:46.417496+0000 front 2024-09-21T06:47:46.417414+0000 (oldest deadline 2024-09-21T06:48:09.917375+0000) 2024-09-21T06:48:12.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:11 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:11.832+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.479118+0000 front 2024-09-21T06:47:20.479041+0000 (oldest deadline 2024-09-21T06:47:42.779148+0000) 2024-09-21T06:48:12.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:11 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:11.832+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.680367+0000 front 2024-09-21T06:47:28.680320+0000 (oldest deadline 2024-09-21T06:47:51.580480+0000) 2024-09-21T06:48:12.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:11 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:11.832+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.982225+0000 front 2024-09-21T06:47:37.982324+0000 (oldest deadline 2024-09-21T06:48:01.482191+0000) 2024-09-21T06:48:12.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:11 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:11.832+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:47:43.683853+0000 front 2024-09-21T06:47:43.683837+0000 (oldest deadline 2024-09-21T06:48:08.383662+0000) 2024-09-21T06:48:12.141 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:48:11 smithi007 podman[107749]: 2024-09-21 06:48:11.76624751 +0000 UTC m=+0.016297693 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:48:12.142 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:48:11 smithi007 podman[107749]: 2024-09-21 06:48:11.896510487 +0000 UTC m=+0.146560655 container create 8c9d93a3f46b5d1f17dd88481d968a9431047b30f14ccceadca592b8bf7b4831 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-6-deactivate, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-21T06:48:12.142 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:48:12 smithi007 podman[107749]: 2024-09-21 06:48:12.140891648 +0000 UTC m=+0.390941836 container init 8c9d93a3f46b5d1f17dd88481d968a9431047b30f14ccceadca592b8bf7b4831 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-6-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-21T06:48:12.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:12 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:12.111+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.153182+0000 front 2024-09-21T06:47:20.153132+0000 (oldest deadline 2024-09-21T06:47:43.053177+0000) 2024-09-21T06:48:12.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:12 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:12.112+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.854893+0000 front 2024-09-21T06:47:28.854866+0000 (oldest deadline 2024-09-21T06:47:52.954830+0000) 2024-09-21T06:48:12.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:12 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:12.112+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.656042+0000 front 2024-09-21T06:47:37.656018+0000 (oldest deadline 2024-09-21T06:47:59.856770+0000) 2024-09-21T06:48:12.590 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:48:12 smithi007 podman[107749]: 2024-09-21 06:48:12.144513408 +0000 UTC m=+0.394563577 container start 8c9d93a3f46b5d1f17dd88481d968a9431047b30f14ccceadca592b8bf7b4831 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-6-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T06:48:12.590 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:48:12 smithi007 podman[107749]: 2024-09-21 06:48:12.249206143 +0000 UTC m=+0.499256326 container attach 8c9d93a3f46b5d1f17dd88481d968a9431047b30f14ccceadca592b8bf7b4831 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-6-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2) 2024-09-21T06:48:12.590 INFO:journalctl@ceph.osd.6.smithi007.stdout:Sep 21 06:48:12 smithi007 podman[107749]: 2024-09-21 06:48:12.3353225 +0000 UTC m=+0.585372669 container died 8c9d93a3f46b5d1f17dd88481d968a9431047b30f14ccceadca592b8bf7b4831 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-6-deactivate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:48:12.590 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:12 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:12.271+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:21.525704+0000 front 2024-09-21T06:47:21.525444+0000 (oldest deadline 2024-09-21T06:47:47.425656+0000) 2024-09-21T06:48:12.590 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:12 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:12.271+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:27.926922+0000 front 2024-09-21T06:47:27.926812+0000 (oldest deadline 2024-09-21T06:47:50.826798+0000) 2024-09-21T06:48:12.591 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:12 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:12.271+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.728100+0000 front 2024-09-21T06:47:36.727861+0000 (oldest deadline 2024-09-21T06:48:00.828027+0000) 2024-09-21T06:48:12.591 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:12 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:12.271+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:47:46.029813+0000 front 2024-09-21T06:47:46.029714+0000 (oldest deadline 2024-09-21T06:48:11.830335+0000) 2024-09-21T06:48:12.792 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 21 06:48:12 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-7[51832]: 2024-09-21T06:48:12.455+0000 7f8eba953640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:26.506838+0000 front 2024-09-21T06:47:26.506866+0000 (oldest deadline 2024-09-21T06:47:51.806954+0000) 2024-09-21T06:48:12.793 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 21 06:48:12 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-7[51832]: 2024-09-21T06:48:12.455+0000 7f8eba953640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.507988+0000 front 2024-09-21T06:47:36.508059+0000 (oldest deadline 2024-09-21T06:47:59.407803+0000) 2024-09-21T06:48:12.793 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 21 06:48:12 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-7[51832]: 2024-09-21T06:48:12.455+0000 7f8eba953640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:47:45.309044+0000 front 2024-09-21T06:47:45.309159+0000 (oldest deadline 2024-09-21T06:48:08.209035+0000) 2024-09-21T06:48:13.006 DEBUG:teuthology.orchestra.run.smithi007:> sudo pkill -f 'journalctl -f -n 0 -u ceph-347cb918-77e2-11ef-baf5-efdc52797490@osd.6.service' 2024-09-21T06:48:13.035 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:12 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:48:12.649+0000 7f95c5ee3640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:27.715108+0000 front 2024-09-21T06:47:27.715279+0000 (oldest deadline 2024-09-21T06:47:53.615085+0000) 2024-09-21T06:48:13.035 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:12 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:48:12.649+0000 7f95c5ee3640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.516125+0000 front 2024-09-21T06:47:36.516474+0000 (oldest deadline 2024-09-21T06:48:00.016164+0000) 2024-09-21T06:48:13.035 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:12 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:48:12.649+0000 7f95c5ee3640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:47:46.417496+0000 front 2024-09-21T06:47:46.417414+0000 (oldest deadline 2024-09-21T06:48:09.917375+0000) 2024-09-21T06:48:13.088 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:48:13.089 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-21T06:48:13.089 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-21T06:48:13.089 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ceph-347cb918-77e2-11ef-baf5-efdc52797490@osd.7 2024-09-21T06:48:13.117 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:12 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:12.791+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.479118+0000 front 2024-09-21T06:47:20.479041+0000 (oldest deadline 2024-09-21T06:47:42.779148+0000) 2024-09-21T06:48:13.117 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:12 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:12.791+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.680367+0000 front 2024-09-21T06:47:28.680320+0000 (oldest deadline 2024-09-21T06:47:51.580480+0000) 2024-09-21T06:48:13.118 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:12 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:12.791+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.982225+0000 front 2024-09-21T06:47:37.982324+0000 (oldest deadline 2024-09-21T06:48:01.482191+0000) 2024-09-21T06:48:13.118 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:12 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:12.791+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:47:43.683853+0000 front 2024-09-21T06:47:43.683837+0000 (oldest deadline 2024-09-21T06:48:08.383662+0000) 2024-09-21T06:48:13.369 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 21 06:48:13 smithi018 systemd[1]: Stopping Ceph osd.7 for 347cb918-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:48:13.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:13 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:13.081+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.153182+0000 front 2024-09-21T06:47:20.153132+0000 (oldest deadline 2024-09-21T06:47:43.053177+0000) 2024-09-21T06:48:13.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:13 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:13.081+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.854893+0000 front 2024-09-21T06:47:28.854866+0000 (oldest deadline 2024-09-21T06:47:52.954830+0000) 2024-09-21T06:48:13.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:13 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:13.081+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.656042+0000 front 2024-09-21T06:47:37.656018+0000 (oldest deadline 2024-09-21T06:47:59.856770+0000) 2024-09-21T06:48:13.590 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:13 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:13.305+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:21.525704+0000 front 2024-09-21T06:47:21.525444+0000 (oldest deadline 2024-09-21T06:47:47.425656+0000) 2024-09-21T06:48:13.590 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:13 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:13.305+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:27.926922+0000 front 2024-09-21T06:47:27.926812+0000 (oldest deadline 2024-09-21T06:47:50.826798+0000) 2024-09-21T06:48:13.590 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:13 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:13.305+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.728100+0000 front 2024-09-21T06:47:36.727861+0000 (oldest deadline 2024-09-21T06:48:00.828027+0000) 2024-09-21T06:48:13.590 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:13 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:13.305+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:47:46.029813+0000 front 2024-09-21T06:47:46.029714+0000 (oldest deadline 2024-09-21T06:48:11.830335+0000) 2024-09-21T06:48:13.831 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 21 06:48:13 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-7[51832]: 2024-09-21T06:48:13.417+0000 7f8ebe368640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:48:13.831 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 21 06:48:13 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-7[51832]: 2024-09-21T06:48:13.417+0000 7f8ebe368640 -1 osd.7 88 *** Got signal Terminated *** 2024-09-21T06:48:13.831 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 21 06:48:13 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-7[51832]: 2024-09-21T06:48:13.417+0000 7f8ebe368640 -1 osd.7 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T06:48:13.831 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 21 06:48:13 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-7[51832]: 2024-09-21T06:48:13.421+0000 7f8eba953640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:26.506838+0000 front 2024-09-21T06:47:26.506866+0000 (oldest deadline 2024-09-21T06:47:51.806954+0000) 2024-09-21T06:48:13.831 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 21 06:48:13 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-7[51832]: 2024-09-21T06:48:13.421+0000 7f8eba953640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.507988+0000 front 2024-09-21T06:47:36.508059+0000 (oldest deadline 2024-09-21T06:47:59.407803+0000) 2024-09-21T06:48:13.831 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 21 06:48:13 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-7[51832]: 2024-09-21T06:48:13.421+0000 7f8eba953640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:47:45.309044+0000 front 2024-09-21T06:47:45.309159+0000 (oldest deadline 2024-09-21T06:48:08.209035+0000) 2024-09-21T06:48:14.035 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:13 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:48:13.656+0000 7f95c5ee3640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:27.715108+0000 front 2024-09-21T06:47:27.715279+0000 (oldest deadline 2024-09-21T06:47:53.615085+0000) 2024-09-21T06:48:14.035 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:13 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:48:13.656+0000 7f95c5ee3640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.516125+0000 front 2024-09-21T06:47:36.516474+0000 (oldest deadline 2024-09-21T06:48:00.016164+0000) 2024-09-21T06:48:14.035 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:13 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:48:13.656+0000 7f95c5ee3640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:47:46.417496+0000 front 2024-09-21T06:47:46.417414+0000 (oldest deadline 2024-09-21T06:48:09.917375+0000) 2024-09-21T06:48:14.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:13 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:13.829+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.479118+0000 front 2024-09-21T06:47:20.479041+0000 (oldest deadline 2024-09-21T06:47:42.779148+0000) 2024-09-21T06:48:14.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:13 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:13.829+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.680367+0000 front 2024-09-21T06:47:28.680320+0000 (oldest deadline 2024-09-21T06:47:51.580480+0000) 2024-09-21T06:48:14.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:13 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:13.829+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.982225+0000 front 2024-09-21T06:47:37.982324+0000 (oldest deadline 2024-09-21T06:48:01.482191+0000) 2024-09-21T06:48:14.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:13 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:13.829+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:47:43.683853+0000 front 2024-09-21T06:47:43.683837+0000 (oldest deadline 2024-09-21T06:48:08.383662+0000) 2024-09-21T06:48:14.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:14 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:14.113+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.153182+0000 front 2024-09-21T06:47:20.153132+0000 (oldest deadline 2024-09-21T06:47:43.053177+0000) 2024-09-21T06:48:14.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:14 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:14.113+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.854893+0000 front 2024-09-21T06:47:28.854866+0000 (oldest deadline 2024-09-21T06:47:52.954830+0000) 2024-09-21T06:48:14.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:14 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:14.113+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.656042+0000 front 2024-09-21T06:47:37.656018+0000 (oldest deadline 2024-09-21T06:47:59.856770+0000) 2024-09-21T06:48:14.619 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 21 06:48:14 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-7[51832]: 2024-09-21T06:48:14.416+0000 7f8eba953640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:26.506838+0000 front 2024-09-21T06:47:26.506866+0000 (oldest deadline 2024-09-21T06:47:51.806954+0000) 2024-09-21T06:48:14.619 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 21 06:48:14 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-7[51832]: 2024-09-21T06:48:14.416+0000 7f8eba953640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.507988+0000 front 2024-09-21T06:47:36.508059+0000 (oldest deadline 2024-09-21T06:47:59.407803+0000) 2024-09-21T06:48:14.619 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 21 06:48:14 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-7[51832]: 2024-09-21T06:48:14.416+0000 7f8eba953640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:47:45.309044+0000 front 2024-09-21T06:47:45.309159+0000 (oldest deadline 2024-09-21T06:48:08.209035+0000) 2024-09-21T06:48:14.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:14 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:14.356+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:21.525704+0000 front 2024-09-21T06:47:21.525444+0000 (oldest deadline 2024-09-21T06:47:47.425656+0000) 2024-09-21T06:48:14.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:14 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:14.356+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:27.926922+0000 front 2024-09-21T06:47:27.926812+0000 (oldest deadline 2024-09-21T06:47:50.826798+0000) 2024-09-21T06:48:14.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:14 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:14.356+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.728100+0000 front 2024-09-21T06:47:36.727861+0000 (oldest deadline 2024-09-21T06:48:00.828027+0000) 2024-09-21T06:48:14.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:14 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:14.356+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:47:46.029813+0000 front 2024-09-21T06:47:46.029714+0000 (oldest deadline 2024-09-21T06:48:11.830335+0000) 2024-09-21T06:48:15.035 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:14 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:48:14.612+0000 7f95c5ee3640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:27.715108+0000 front 2024-09-21T06:47:27.715279+0000 (oldest deadline 2024-09-21T06:47:53.615085+0000) 2024-09-21T06:48:15.035 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:14 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:48:14.612+0000 7f95c5ee3640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.516125+0000 front 2024-09-21T06:47:36.516474+0000 (oldest deadline 2024-09-21T06:48:00.016164+0000) 2024-09-21T06:48:15.035 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:14 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:48:14.612+0000 7f95c5ee3640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:47:46.417496+0000 front 2024-09-21T06:47:46.417414+0000 (oldest deadline 2024-09-21T06:48:09.917375+0000) 2024-09-21T06:48:15.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:14 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:14.844+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.479118+0000 front 2024-09-21T06:47:20.479041+0000 (oldest deadline 2024-09-21T06:47:42.779148+0000) 2024-09-21T06:48:15.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:14 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:14.844+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.680367+0000 front 2024-09-21T06:47:28.680320+0000 (oldest deadline 2024-09-21T06:47:51.580480+0000) 2024-09-21T06:48:15.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:14 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:14.844+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.982225+0000 front 2024-09-21T06:47:37.982324+0000 (oldest deadline 2024-09-21T06:48:01.482191+0000) 2024-09-21T06:48:15.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:14 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:14.844+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:47:43.683853+0000 front 2024-09-21T06:47:43.683837+0000 (oldest deadline 2024-09-21T06:48:08.383662+0000) 2024-09-21T06:48:15.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:15 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:15.151+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.153182+0000 front 2024-09-21T06:47:20.153132+0000 (oldest deadline 2024-09-21T06:47:43.053177+0000) 2024-09-21T06:48:15.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:15 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:15.151+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.854893+0000 front 2024-09-21T06:47:28.854866+0000 (oldest deadline 2024-09-21T06:47:52.954830+0000) 2024-09-21T06:48:15.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:15 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:15.151+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.656042+0000 front 2024-09-21T06:47:37.656018+0000 (oldest deadline 2024-09-21T06:47:59.856770+0000) 2024-09-21T06:48:15.813 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 21 06:48:15 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-7[51832]: 2024-09-21T06:48:15.379+0000 7f8eba953640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:26.506838+0000 front 2024-09-21T06:47:26.506866+0000 (oldest deadline 2024-09-21T06:47:51.806954+0000) 2024-09-21T06:48:15.813 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 21 06:48:15 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-7[51832]: 2024-09-21T06:48:15.379+0000 7f8eba953640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.507988+0000 front 2024-09-21T06:47:36.508059+0000 (oldest deadline 2024-09-21T06:47:59.407803+0000) 2024-09-21T06:48:15.813 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 21 06:48:15 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-7[51832]: 2024-09-21T06:48:15.379+0000 7f8eba953640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:47:45.309044+0000 front 2024-09-21T06:47:45.309159+0000 (oldest deadline 2024-09-21T06:48:08.209035+0000) 2024-09-21T06:48:15.839 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:15 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:15.392+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:21.525704+0000 front 2024-09-21T06:47:21.525444+0000 (oldest deadline 2024-09-21T06:47:47.425656+0000) 2024-09-21T06:48:15.839 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:15 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:15.392+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:27.926922+0000 front 2024-09-21T06:47:27.926812+0000 (oldest deadline 2024-09-21T06:47:50.826798+0000) 2024-09-21T06:48:15.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:15 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:15.392+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.728100+0000 front 2024-09-21T06:47:36.727861+0000 (oldest deadline 2024-09-21T06:48:00.828027+0000) 2024-09-21T06:48:15.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:15 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:15.392+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:47:46.029813+0000 front 2024-09-21T06:47:46.029714+0000 (oldest deadline 2024-09-21T06:48:11.830335+0000) 2024-09-21T06:48:16.035 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:15 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:48:15.649+0000 7f95c5ee3640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:27.715108+0000 front 2024-09-21T06:47:27.715279+0000 (oldest deadline 2024-09-21T06:47:53.615085+0000) 2024-09-21T06:48:16.035 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:15 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:48:15.649+0000 7f95c5ee3640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.516125+0000 front 2024-09-21T06:47:36.516474+0000 (oldest deadline 2024-09-21T06:48:00.016164+0000) 2024-09-21T06:48:16.035 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:15 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:48:15.649+0000 7f95c5ee3640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:47:46.417496+0000 front 2024-09-21T06:47:46.417414+0000 (oldest deadline 2024-09-21T06:48:09.917375+0000) 2024-09-21T06:48:16.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:15 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:15.811+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.479118+0000 front 2024-09-21T06:47:20.479041+0000 (oldest deadline 2024-09-21T06:47:42.779148+0000) 2024-09-21T06:48:16.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:15 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:15.811+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.680367+0000 front 2024-09-21T06:47:28.680320+0000 (oldest deadline 2024-09-21T06:47:51.580480+0000) 2024-09-21T06:48:16.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:15 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:15.811+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.982225+0000 front 2024-09-21T06:47:37.982324+0000 (oldest deadline 2024-09-21T06:48:01.482191+0000) 2024-09-21T06:48:16.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:15 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:15.811+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:47:43.683853+0000 front 2024-09-21T06:47:43.683837+0000 (oldest deadline 2024-09-21T06:48:08.383662+0000) 2024-09-21T06:48:16.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:16 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:16.189+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.153182+0000 front 2024-09-21T06:47:20.153132+0000 (oldest deadline 2024-09-21T06:47:43.053177+0000) 2024-09-21T06:48:16.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:16 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:16.189+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.854893+0000 front 2024-09-21T06:47:28.854866+0000 (oldest deadline 2024-09-21T06:47:52.954830+0000) 2024-09-21T06:48:16.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:16 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:16.189+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.656042+0000 front 2024-09-21T06:47:37.656018+0000 (oldest deadline 2024-09-21T06:47:59.856770+0000) 2024-09-21T06:48:16.818 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 21 06:48:16 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-7[51832]: 2024-09-21T06:48:16.391+0000 7f8eba953640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:26.506838+0000 front 2024-09-21T06:47:26.506866+0000 (oldest deadline 2024-09-21T06:47:51.806954+0000) 2024-09-21T06:48:16.819 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 21 06:48:16 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-7[51832]: 2024-09-21T06:48:16.391+0000 7f8eba953640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.507988+0000 front 2024-09-21T06:47:36.508059+0000 (oldest deadline 2024-09-21T06:47:59.407803+0000) 2024-09-21T06:48:16.819 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 21 06:48:16 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-7[51832]: 2024-09-21T06:48:16.391+0000 7f8eba953640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:47:45.309044+0000 front 2024-09-21T06:47:45.309159+0000 (oldest deadline 2024-09-21T06:48:08.209035+0000) 2024-09-21T06:48:16.839 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:16 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:16.375+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:21.525704+0000 front 2024-09-21T06:47:21.525444+0000 (oldest deadline 2024-09-21T06:47:47.425656+0000) 2024-09-21T06:48:16.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:16 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:16.375+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:27.926922+0000 front 2024-09-21T06:47:27.926812+0000 (oldest deadline 2024-09-21T06:47:50.826798+0000) 2024-09-21T06:48:16.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:16 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:16.375+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.728100+0000 front 2024-09-21T06:47:36.727861+0000 (oldest deadline 2024-09-21T06:48:00.828027+0000) 2024-09-21T06:48:16.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:16 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:16.375+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:47:46.029813+0000 front 2024-09-21T06:47:46.029714+0000 (oldest deadline 2024-09-21T06:48:11.830335+0000) 2024-09-21T06:48:17.035 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:16 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:48:16.698+0000 7f95c5ee3640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:27.715108+0000 front 2024-09-21T06:47:27.715279+0000 (oldest deadline 2024-09-21T06:47:53.615085+0000) 2024-09-21T06:48:17.035 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:16 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:48:16.698+0000 7f95c5ee3640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.516125+0000 front 2024-09-21T06:47:36.516474+0000 (oldest deadline 2024-09-21T06:48:00.016164+0000) 2024-09-21T06:48:17.035 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:16 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:48:16.698+0000 7f95c5ee3640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:47:46.417496+0000 front 2024-09-21T06:47:46.417414+0000 (oldest deadline 2024-09-21T06:48:09.917375+0000) 2024-09-21T06:48:17.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:16 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:16.817+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.479118+0000 front 2024-09-21T06:47:20.479041+0000 (oldest deadline 2024-09-21T06:47:42.779148+0000) 2024-09-21T06:48:17.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:16 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:16.817+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.680367+0000 front 2024-09-21T06:47:28.680320+0000 (oldest deadline 2024-09-21T06:47:51.580480+0000) 2024-09-21T06:48:17.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:16 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:16.817+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.982225+0000 front 2024-09-21T06:47:37.982324+0000 (oldest deadline 2024-09-21T06:48:01.482191+0000) 2024-09-21T06:48:17.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:16 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:16.817+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:47:43.683853+0000 front 2024-09-21T06:47:43.683837+0000 (oldest deadline 2024-09-21T06:48:08.383662+0000) 2024-09-21T06:48:17.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:16 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:16.817+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-21T06:47:50.684581+0000 front 2024-09-21T06:47:50.684614+0000 (oldest deadline 2024-09-21T06:48:15.984607+0000) 2024-09-21T06:48:17.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:17 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:17.163+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.153182+0000 front 2024-09-21T06:47:20.153132+0000 (oldest deadline 2024-09-21T06:47:43.053177+0000) 2024-09-21T06:48:17.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:17 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:17.163+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.854893+0000 front 2024-09-21T06:47:28.854866+0000 (oldest deadline 2024-09-21T06:47:52.954830+0000) 2024-09-21T06:48:17.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:17 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:17.163+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.656042+0000 front 2024-09-21T06:47:37.656018+0000 (oldest deadline 2024-09-21T06:47:59.856770+0000) 2024-09-21T06:48:17.619 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 21 06:48:17 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-7[51832]: 2024-09-21T06:48:17.366+0000 7f8eba953640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:26.506838+0000 front 2024-09-21T06:47:26.506866+0000 (oldest deadline 2024-09-21T06:47:51.806954+0000) 2024-09-21T06:48:17.619 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 21 06:48:17 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-7[51832]: 2024-09-21T06:48:17.366+0000 7f8eba953640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.507988+0000 front 2024-09-21T06:47:36.508059+0000 (oldest deadline 2024-09-21T06:47:59.407803+0000) 2024-09-21T06:48:17.619 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 21 06:48:17 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-7[51832]: 2024-09-21T06:48:17.366+0000 7f8eba953640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:47:45.309044+0000 front 2024-09-21T06:47:45.309159+0000 (oldest deadline 2024-09-21T06:48:08.209035+0000) 2024-09-21T06:48:17.619 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 21 06:48:17 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-7[51832]: 2024-09-21T06:48:17.366+0000 7f8eba953640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-21T06:47:52.909886+0000 front 2024-09-21T06:47:52.909927+0000 (oldest deadline 2024-09-21T06:48:16.409969+0000) 2024-09-21T06:48:17.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:17 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:17.352+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:21.525704+0000 front 2024-09-21T06:47:21.525444+0000 (oldest deadline 2024-09-21T06:47:47.425656+0000) 2024-09-21T06:48:17.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:17 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:17.352+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:27.926922+0000 front 2024-09-21T06:47:27.926812+0000 (oldest deadline 2024-09-21T06:47:50.826798+0000) 2024-09-21T06:48:17.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:17 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:17.352+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.728100+0000 front 2024-09-21T06:47:36.727861+0000 (oldest deadline 2024-09-21T06:48:00.828027+0000) 2024-09-21T06:48:17.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:17 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:17.352+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:47:46.029813+0000 front 2024-09-21T06:47:46.029714+0000 (oldest deadline 2024-09-21T06:48:11.830335+0000) 2024-09-21T06:48:17.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:17 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:17.352+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-21T06:47:51.830912+0000 front 2024-09-21T06:47:51.830904+0000 (oldest deadline 2024-09-21T06:48:17.130838+0000) 2024-09-21T06:48:18.035 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:17 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:48:17.660+0000 7f95c5ee3640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:27.715108+0000 front 2024-09-21T06:47:27.715279+0000 (oldest deadline 2024-09-21T06:47:53.615085+0000) 2024-09-21T06:48:18.035 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:17 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:48:17.660+0000 7f95c5ee3640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.516125+0000 front 2024-09-21T06:47:36.516474+0000 (oldest deadline 2024-09-21T06:48:00.016164+0000) 2024-09-21T06:48:18.035 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:17 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:48:17.660+0000 7f95c5ee3640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:47:46.417496+0000 front 2024-09-21T06:47:46.417414+0000 (oldest deadline 2024-09-21T06:48:09.917375+0000) 2024-09-21T06:48:18.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:17 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:17.830+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.479118+0000 front 2024-09-21T06:47:20.479041+0000 (oldest deadline 2024-09-21T06:47:42.779148+0000) 2024-09-21T06:48:18.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:17 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:17.830+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.680367+0000 front 2024-09-21T06:47:28.680320+0000 (oldest deadline 2024-09-21T06:47:51.580480+0000) 2024-09-21T06:48:18.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:17 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:17.830+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.982225+0000 front 2024-09-21T06:47:37.982324+0000 (oldest deadline 2024-09-21T06:48:01.482191+0000) 2024-09-21T06:48:18.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:17 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:17.830+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:47:43.683853+0000 front 2024-09-21T06:47:43.683837+0000 (oldest deadline 2024-09-21T06:48:08.383662+0000) 2024-09-21T06:48:18.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:17 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:17.830+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-21T06:47:50.684581+0000 front 2024-09-21T06:47:50.684614+0000 (oldest deadline 2024-09-21T06:48:15.984607+0000) 2024-09-21T06:48:18.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:18 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:18.162+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.153182+0000 front 2024-09-21T06:47:20.153132+0000 (oldest deadline 2024-09-21T06:47:43.053177+0000) 2024-09-21T06:48:18.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:18 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:18.162+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.854893+0000 front 2024-09-21T06:47:28.854866+0000 (oldest deadline 2024-09-21T06:47:52.954830+0000) 2024-09-21T06:48:18.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:18 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:18.162+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.656042+0000 front 2024-09-21T06:47:37.656018+0000 (oldest deadline 2024-09-21T06:47:59.856770+0000) 2024-09-21T06:48:18.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:18 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:18.162+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-21T06:47:53.859097+0000 front 2024-09-21T06:47:53.859198+0000 (oldest deadline 2024-09-21T06:48:17.959226+0000) 2024-09-21T06:48:18.619 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 21 06:48:18 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-7[51832]: 2024-09-21T06:48:18.336+0000 7f8eba953640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:26.506838+0000 front 2024-09-21T06:47:26.506866+0000 (oldest deadline 2024-09-21T06:47:51.806954+0000) 2024-09-21T06:48:18.619 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 21 06:48:18 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-7[51832]: 2024-09-21T06:48:18.336+0000 7f8eba953640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.507988+0000 front 2024-09-21T06:47:36.508059+0000 (oldest deadline 2024-09-21T06:47:59.407803+0000) 2024-09-21T06:48:18.619 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 21 06:48:18 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-7[51832]: 2024-09-21T06:48:18.336+0000 7f8eba953640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:47:45.309044+0000 front 2024-09-21T06:47:45.309159+0000 (oldest deadline 2024-09-21T06:48:08.209035+0000) 2024-09-21T06:48:18.619 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 21 06:48:18 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-7[51832]: 2024-09-21T06:48:18.336+0000 7f8eba953640 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-21T06:47:52.909886+0000 front 2024-09-21T06:47:52.909927+0000 (oldest deadline 2024-09-21T06:48:16.409969+0000) 2024-09-21T06:48:18.839 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:18 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:18.396+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:21.525704+0000 front 2024-09-21T06:47:21.525444+0000 (oldest deadline 2024-09-21T06:47:47.425656+0000) 2024-09-21T06:48:18.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:18 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:18.396+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:27.926922+0000 front 2024-09-21T06:47:27.926812+0000 (oldest deadline 2024-09-21T06:47:50.826798+0000) 2024-09-21T06:48:18.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:18 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:18.396+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.728100+0000 front 2024-09-21T06:47:36.727861+0000 (oldest deadline 2024-09-21T06:48:00.828027+0000) 2024-09-21T06:48:18.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:18 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:18.396+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:47:46.029813+0000 front 2024-09-21T06:47:46.029714+0000 (oldest deadline 2024-09-21T06:48:11.830335+0000) 2024-09-21T06:48:18.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:18 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:18.396+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-21T06:47:51.830912+0000 front 2024-09-21T06:47:51.830904+0000 (oldest deadline 2024-09-21T06:48:17.130838+0000) 2024-09-21T06:48:19.035 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:18 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:48:18.674+0000 7f95c5ee3640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:27.715108+0000 front 2024-09-21T06:47:27.715279+0000 (oldest deadline 2024-09-21T06:47:53.615085+0000) 2024-09-21T06:48:19.035 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:18 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:48:18.674+0000 7f95c5ee3640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.516125+0000 front 2024-09-21T06:47:36.516474+0000 (oldest deadline 2024-09-21T06:48:00.016164+0000) 2024-09-21T06:48:19.035 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:18 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:48:18.674+0000 7f95c5ee3640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:47:46.417496+0000 front 2024-09-21T06:47:46.417414+0000 (oldest deadline 2024-09-21T06:48:09.917375+0000) 2024-09-21T06:48:19.119 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 21 06:48:18 smithi018 podman[67270]: 2024-09-21 06:48:18.81969487 +0000 UTC m=+5.529410693 container died 7e40a1d7b593d7d40cd80d4228dfd64e4e5733380d43f56f29ecd0c8c9622698 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-7, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T06:48:19.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:18 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:18.864+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.479118+0000 front 2024-09-21T06:47:20.479041+0000 (oldest deadline 2024-09-21T06:47:42.779148+0000) 2024-09-21T06:48:19.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:18 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:18.864+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.680367+0000 front 2024-09-21T06:47:28.680320+0000 (oldest deadline 2024-09-21T06:47:51.580480+0000) 2024-09-21T06:48:19.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:18 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:18.864+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.982225+0000 front 2024-09-21T06:47:37.982324+0000 (oldest deadline 2024-09-21T06:48:01.482191+0000) 2024-09-21T06:48:19.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:18 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:18.864+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:47:43.683853+0000 front 2024-09-21T06:47:43.683837+0000 (oldest deadline 2024-09-21T06:48:08.383662+0000) 2024-09-21T06:48:19.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:18 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:18.864+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-21T06:47:50.684581+0000 front 2024-09-21T06:47:50.684614+0000 (oldest deadline 2024-09-21T06:48:15.984607+0000) 2024-09-21T06:48:19.478 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 21 06:48:19 smithi018 podman[67270]: 2024-09-21 06:48:19.226290151 +0000 UTC m=+5.936005973 container cleanup 7e40a1d7b593d7d40cd80d4228dfd64e4e5733380d43f56f29ecd0c8c9622698 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-21T06:48:19.478 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 21 06:48:19 smithi018 bash[67270]: ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-7 2024-09-21T06:48:19.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:19 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:19.123+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.153182+0000 front 2024-09-21T06:47:20.153132+0000 (oldest deadline 2024-09-21T06:47:43.053177+0000) 2024-09-21T06:48:19.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:19 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:19.123+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.854893+0000 front 2024-09-21T06:47:28.854866+0000 (oldest deadline 2024-09-21T06:47:52.954830+0000) 2024-09-21T06:48:19.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:19 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:19.123+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.656042+0000 front 2024-09-21T06:47:37.656018+0000 (oldest deadline 2024-09-21T06:47:59.856770+0000) 2024-09-21T06:48:19.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:19 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:19.123+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-21T06:47:53.859097+0000 front 2024-09-21T06:47:53.859198+0000 (oldest deadline 2024-09-21T06:48:17.959226+0000) 2024-09-21T06:48:19.839 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:19 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:19.365+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:21.525704+0000 front 2024-09-21T06:47:21.525444+0000 (oldest deadline 2024-09-21T06:47:47.425656+0000) 2024-09-21T06:48:19.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:19 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:19.365+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:27.926922+0000 front 2024-09-21T06:47:27.926812+0000 (oldest deadline 2024-09-21T06:47:50.826798+0000) 2024-09-21T06:48:19.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:19 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:19.365+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.728100+0000 front 2024-09-21T06:47:36.727861+0000 (oldest deadline 2024-09-21T06:48:00.828027+0000) 2024-09-21T06:48:19.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:19 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:19.365+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:47:46.029813+0000 front 2024-09-21T06:47:46.029714+0000 (oldest deadline 2024-09-21T06:48:11.830335+0000) 2024-09-21T06:48:19.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:19 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:19.365+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-21T06:47:51.830912+0000 front 2024-09-21T06:47:51.830904+0000 (oldest deadline 2024-09-21T06:48:17.130838+0000) 2024-09-21T06:48:19.844 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 21 06:48:19 smithi018 podman[67285]: 2024-09-21 06:48:19.477605097 +0000 UTC m=+0.649068455 container remove 7e40a1d7b593d7d40cd80d4228dfd64e4e5733380d43f56f29ecd0c8c9622698 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-7, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T06:48:20.035 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:19 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:48:19.680+0000 7f95c5ee3640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:27.715108+0000 front 2024-09-21T06:47:27.715279+0000 (oldest deadline 2024-09-21T06:47:53.615085+0000) 2024-09-21T06:48:20.035 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:19 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:48:19.681+0000 7f95c5ee3640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.516125+0000 front 2024-09-21T06:47:36.516474+0000 (oldest deadline 2024-09-21T06:48:00.016164+0000) 2024-09-21T06:48:20.035 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:19 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:48:19.681+0000 7f95c5ee3640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:47:46.417496+0000 front 2024-09-21T06:47:46.417414+0000 (oldest deadline 2024-09-21T06:48:09.917375+0000) 2024-09-21T06:48:20.035 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:19 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:48:19.681+0000 7f95c5ee3640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-21T06:47:53.418560+0000 front 2024-09-21T06:47:53.418623+0000 (oldest deadline 2024-09-21T06:48:19.219051+0000) 2024-09-21T06:48:20.119 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 21 06:48:19 smithi018 podman[67372]: 2024-09-21 06:48:19.74659885 +0000 UTC m=+0.016284894 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:48:20.119 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 21 06:48:19 smithi018 podman[67372]: 2024-09-21 06:48:19.870076187 +0000 UTC m=+0.139762215 container create fd73b04400b7d9ae5aebb15412c72b5be7348a8820245fee408665d7769ddf19 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-7-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2) 2024-09-21T06:48:20.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:19 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:19.855+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.479118+0000 front 2024-09-21T06:47:20.479041+0000 (oldest deadline 2024-09-21T06:47:42.779148+0000) 2024-09-21T06:48:20.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:19 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:19.855+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.680367+0000 front 2024-09-21T06:47:28.680320+0000 (oldest deadline 2024-09-21T06:47:51.580480+0000) 2024-09-21T06:48:20.120 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:19 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:19.855+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.982225+0000 front 2024-09-21T06:47:37.982324+0000 (oldest deadline 2024-09-21T06:48:01.482191+0000) 2024-09-21T06:48:20.120 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:19 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:19.855+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:47:43.683853+0000 front 2024-09-21T06:47:43.683837+0000 (oldest deadline 2024-09-21T06:48:08.383662+0000) 2024-09-21T06:48:20.120 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:19 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:19.855+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-21T06:47:50.684581+0000 front 2024-09-21T06:47:50.684614+0000 (oldest deadline 2024-09-21T06:48:15.984607+0000) 2024-09-21T06:48:20.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:20 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:20.099+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.153182+0000 front 2024-09-21T06:47:20.153132+0000 (oldest deadline 2024-09-21T06:47:43.053177+0000) 2024-09-21T06:48:20.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:20 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:20.099+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.854893+0000 front 2024-09-21T06:47:28.854866+0000 (oldest deadline 2024-09-21T06:47:52.954830+0000) 2024-09-21T06:48:20.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:20 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:20.099+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.656042+0000 front 2024-09-21T06:47:37.656018+0000 (oldest deadline 2024-09-21T06:47:59.856770+0000) 2024-09-21T06:48:20.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:20 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:20.099+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-21T06:47:53.859097+0000 front 2024-09-21T06:47:53.859198+0000 (oldest deadline 2024-09-21T06:48:17.959226+0000) 2024-09-21T06:48:20.619 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 21 06:48:20 smithi018 podman[67372]: 2024-09-21 06:48:20.164521868 +0000 UTC m=+0.434207908 container init fd73b04400b7d9ae5aebb15412c72b5be7348a8820245fee408665d7769ddf19 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-7-deactivate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2) 2024-09-21T06:48:20.619 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 21 06:48:20 smithi018 podman[67372]: 2024-09-21 06:48:20.168064548 +0000 UTC m=+0.437750578 container start fd73b04400b7d9ae5aebb15412c72b5be7348a8820245fee408665d7769ddf19 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-7-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-21T06:48:20.619 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 21 06:48:20 smithi018 podman[67372]: 2024-09-21 06:48:20.264529344 +0000 UTC m=+0.534215376 container attach fd73b04400b7d9ae5aebb15412c72b5be7348a8820245fee408665d7769ddf19 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-7-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:48:20.619 INFO:journalctl@ceph.osd.7.smithi018.stdout:Sep 21 06:48:20 smithi018 podman[67372]: 2024-09-21 06:48:20.355514492 +0000 UTC m=+0.625200522 container died fd73b04400b7d9ae5aebb15412c72b5be7348a8820245fee408665d7769ddf19 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-7-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True) 2024-09-21T06:48:20.839 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:20 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:20.371+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:21.525704+0000 front 2024-09-21T06:47:21.525444+0000 (oldest deadline 2024-09-21T06:47:47.425656+0000) 2024-09-21T06:48:20.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:20 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:20.371+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:27.926922+0000 front 2024-09-21T06:47:27.926812+0000 (oldest deadline 2024-09-21T06:47:50.826798+0000) 2024-09-21T06:48:20.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:20 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:20.371+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.728100+0000 front 2024-09-21T06:47:36.727861+0000 (oldest deadline 2024-09-21T06:48:00.828027+0000) 2024-09-21T06:48:20.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:20 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:20.371+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:47:46.029813+0000 front 2024-09-21T06:47:46.029714+0000 (oldest deadline 2024-09-21T06:48:11.830335+0000) 2024-09-21T06:48:20.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:20 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:20.371+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-21T06:47:51.830912+0000 front 2024-09-21T06:47:51.830904+0000 (oldest deadline 2024-09-21T06:48:17.130838+0000) 2024-09-21T06:48:21.035 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:20 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:48:20.684+0000 7f95c5ee3640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:27.715108+0000 front 2024-09-21T06:47:27.715279+0000 (oldest deadline 2024-09-21T06:47:53.615085+0000) 2024-09-21T06:48:21.035 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:20 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:48:20.684+0000 7f95c5ee3640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.516125+0000 front 2024-09-21T06:47:36.516474+0000 (oldest deadline 2024-09-21T06:48:00.016164+0000) 2024-09-21T06:48:21.035 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:20 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:48:20.684+0000 7f95c5ee3640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:47:46.417496+0000 front 2024-09-21T06:47:46.417414+0000 (oldest deadline 2024-09-21T06:48:09.917375+0000) 2024-09-21T06:48:21.035 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:20 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:48:20.684+0000 7f95c5ee3640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-21T06:47:53.418560+0000 front 2024-09-21T06:47:53.418623+0000 (oldest deadline 2024-09-21T06:48:19.219051+0000) 2024-09-21T06:48:21.035 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:20 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:20.827+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.479118+0000 front 2024-09-21T06:47:20.479041+0000 (oldest deadline 2024-09-21T06:47:42.779148+0000) 2024-09-21T06:48:21.036 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:20 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:20.827+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.680367+0000 front 2024-09-21T06:47:28.680320+0000 (oldest deadline 2024-09-21T06:47:51.580480+0000) 2024-09-21T06:48:21.036 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:20 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:20.827+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.982225+0000 front 2024-09-21T06:47:37.982324+0000 (oldest deadline 2024-09-21T06:48:01.482191+0000) 2024-09-21T06:48:21.036 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:20 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:20.827+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:47:43.683853+0000 front 2024-09-21T06:47:43.683837+0000 (oldest deadline 2024-09-21T06:48:08.383662+0000) 2024-09-21T06:48:21.036 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:20 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:20.827+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-21T06:47:50.684581+0000 front 2024-09-21T06:47:50.684614+0000 (oldest deadline 2024-09-21T06:48:15.984607+0000) 2024-09-21T06:48:21.069 DEBUG:teuthology.orchestra.run.smithi018:> sudo pkill -f 'journalctl -f -n 0 -u ceph-347cb918-77e2-11ef-baf5-efdc52797490@osd.7.service' 2024-09-21T06:48:21.151 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:48:21.151 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-21T06:48:21.151 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-21T06:48:21.151 DEBUG:teuthology.orchestra.run.smithi144:> sudo systemctl stop ceph-347cb918-77e2-11ef-baf5-efdc52797490@osd.8 2024-09-21T06:48:21.441 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:21 smithi144 systemd[1]: Stopping Ceph osd.8 for 347cb918-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:48:21.442 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:21 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:48:21.439+0000 7f95cd900640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:48:21.442 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:21 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:48:21.439+0000 7f95cd900640 -1 osd.8 88 *** Got signal Terminated *** 2024-09-21T06:48:21.442 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:21 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:21.132+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.153182+0000 front 2024-09-21T06:47:20.153132+0000 (oldest deadline 2024-09-21T06:47:43.053177+0000) 2024-09-21T06:48:21.442 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:21 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:21.132+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.854893+0000 front 2024-09-21T06:47:28.854866+0000 (oldest deadline 2024-09-21T06:47:52.954830+0000) 2024-09-21T06:48:21.442 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:21 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:21.132+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.656042+0000 front 2024-09-21T06:47:37.656018+0000 (oldest deadline 2024-09-21T06:47:59.856770+0000) 2024-09-21T06:48:21.442 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:21 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:21.132+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-21T06:47:53.859097+0000 front 2024-09-21T06:47:53.859198+0000 (oldest deadline 2024-09-21T06:48:17.959226+0000) 2024-09-21T06:48:21.733 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:21 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:48:21.439+0000 7f95cd900640 -1 osd.8 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T06:48:21.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:21 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:21.387+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:21.525704+0000 front 2024-09-21T06:47:21.525444+0000 (oldest deadline 2024-09-21T06:47:47.425656+0000) 2024-09-21T06:48:21.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:21 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:21.387+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:27.926922+0000 front 2024-09-21T06:47:27.926812+0000 (oldest deadline 2024-09-21T06:47:50.826798+0000) 2024-09-21T06:48:21.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:21 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:21.387+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.728100+0000 front 2024-09-21T06:47:36.727861+0000 (oldest deadline 2024-09-21T06:48:00.828027+0000) 2024-09-21T06:48:21.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:21 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:21.387+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:47:46.029813+0000 front 2024-09-21T06:47:46.029714+0000 (oldest deadline 2024-09-21T06:48:11.830335+0000) 2024-09-21T06:48:21.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:21 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:21.387+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-21T06:47:51.830912+0000 front 2024-09-21T06:47:51.830904+0000 (oldest deadline 2024-09-21T06:48:17.130838+0000) 2024-09-21T06:48:22.035 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:21 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:48:21.731+0000 7f95c5ee3640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:27.715108+0000 front 2024-09-21T06:47:27.715279+0000 (oldest deadline 2024-09-21T06:47:53.615085+0000) 2024-09-21T06:48:22.035 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:21 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:48:21.731+0000 7f95c5ee3640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.516125+0000 front 2024-09-21T06:47:36.516474+0000 (oldest deadline 2024-09-21T06:48:00.016164+0000) 2024-09-21T06:48:22.035 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:21 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:48:21.731+0000 7f95c5ee3640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:47:46.417496+0000 front 2024-09-21T06:47:46.417414+0000 (oldest deadline 2024-09-21T06:48:09.917375+0000) 2024-09-21T06:48:22.035 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:21 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:48:21.731+0000 7f95c5ee3640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-21T06:47:53.418560+0000 front 2024-09-21T06:47:53.418623+0000 (oldest deadline 2024-09-21T06:48:19.219051+0000) 2024-09-21T06:48:22.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:21 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:21.797+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.479118+0000 front 2024-09-21T06:47:20.479041+0000 (oldest deadline 2024-09-21T06:47:42.779148+0000) 2024-09-21T06:48:22.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:21 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:21.797+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.680367+0000 front 2024-09-21T06:47:28.680320+0000 (oldest deadline 2024-09-21T06:47:51.580480+0000) 2024-09-21T06:48:22.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:21 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:21.797+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.982225+0000 front 2024-09-21T06:47:37.982324+0000 (oldest deadline 2024-09-21T06:48:01.482191+0000) 2024-09-21T06:48:22.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:21 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:21.797+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:47:43.683853+0000 front 2024-09-21T06:47:43.683837+0000 (oldest deadline 2024-09-21T06:48:08.383662+0000) 2024-09-21T06:48:22.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:21 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:21.797+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-21T06:47:50.684581+0000 front 2024-09-21T06:47:50.684614+0000 (oldest deadline 2024-09-21T06:48:15.984607+0000) 2024-09-21T06:48:22.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:22 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:22.180+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.153182+0000 front 2024-09-21T06:47:20.153132+0000 (oldest deadline 2024-09-21T06:47:43.053177+0000) 2024-09-21T06:48:22.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:22 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:22.180+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.854893+0000 front 2024-09-21T06:47:28.854866+0000 (oldest deadline 2024-09-21T06:47:52.954830+0000) 2024-09-21T06:48:22.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:22 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:22.180+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.656042+0000 front 2024-09-21T06:47:37.656018+0000 (oldest deadline 2024-09-21T06:47:59.856770+0000) 2024-09-21T06:48:22.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:22 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:22.180+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-21T06:47:53.859097+0000 front 2024-09-21T06:47:53.859198+0000 (oldest deadline 2024-09-21T06:48:17.959226+0000) 2024-09-21T06:48:22.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:22 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:22.405+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:21.525704+0000 front 2024-09-21T06:47:21.525444+0000 (oldest deadline 2024-09-21T06:47:47.425656+0000) 2024-09-21T06:48:22.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:22 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:22.405+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:27.926922+0000 front 2024-09-21T06:47:27.926812+0000 (oldest deadline 2024-09-21T06:47:50.826798+0000) 2024-09-21T06:48:22.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:22 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:22.405+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.728100+0000 front 2024-09-21T06:47:36.727861+0000 (oldest deadline 2024-09-21T06:48:00.828027+0000) 2024-09-21T06:48:22.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:22 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:22.405+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:47:46.029813+0000 front 2024-09-21T06:47:46.029714+0000 (oldest deadline 2024-09-21T06:48:11.830335+0000) 2024-09-21T06:48:22.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:22 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:22.405+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-21T06:47:51.830912+0000 front 2024-09-21T06:47:51.830904+0000 (oldest deadline 2024-09-21T06:48:17.130838+0000) 2024-09-21T06:48:23.035 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:22 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:48:22.700+0000 7f95c5ee3640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:27.715108+0000 front 2024-09-21T06:47:27.715279+0000 (oldest deadline 2024-09-21T06:47:53.615085+0000) 2024-09-21T06:48:23.035 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:22 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:48:22.700+0000 7f95c5ee3640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.516125+0000 front 2024-09-21T06:47:36.516474+0000 (oldest deadline 2024-09-21T06:48:00.016164+0000) 2024-09-21T06:48:23.035 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:22 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:48:22.700+0000 7f95c5ee3640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:47:46.417496+0000 front 2024-09-21T06:47:46.417414+0000 (oldest deadline 2024-09-21T06:48:09.917375+0000) 2024-09-21T06:48:23.035 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:22 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:48:22.700+0000 7f95c5ee3640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-21T06:47:53.418560+0000 front 2024-09-21T06:47:53.418623+0000 (oldest deadline 2024-09-21T06:48:19.219051+0000) 2024-09-21T06:48:23.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:22 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:22.817+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.479118+0000 front 2024-09-21T06:47:20.479041+0000 (oldest deadline 2024-09-21T06:47:42.779148+0000) 2024-09-21T06:48:23.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:22 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:22.817+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.680367+0000 front 2024-09-21T06:47:28.680320+0000 (oldest deadline 2024-09-21T06:47:51.580480+0000) 2024-09-21T06:48:23.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:22 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:22.817+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.982225+0000 front 2024-09-21T06:47:37.982324+0000 (oldest deadline 2024-09-21T06:48:01.482191+0000) 2024-09-21T06:48:23.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:22 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:22.817+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:47:43.683853+0000 front 2024-09-21T06:47:43.683837+0000 (oldest deadline 2024-09-21T06:48:08.383662+0000) 2024-09-21T06:48:23.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:22 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:22.817+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-21T06:47:50.684581+0000 front 2024-09-21T06:47:50.684614+0000 (oldest deadline 2024-09-21T06:48:15.984607+0000) 2024-09-21T06:48:23.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:23 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:23.188+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.153182+0000 front 2024-09-21T06:47:20.153132+0000 (oldest deadline 2024-09-21T06:47:43.053177+0000) 2024-09-21T06:48:23.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:23 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:23.188+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.854893+0000 front 2024-09-21T06:47:28.854866+0000 (oldest deadline 2024-09-21T06:47:52.954830+0000) 2024-09-21T06:48:23.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:23 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:23.188+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.656042+0000 front 2024-09-21T06:47:37.656018+0000 (oldest deadline 2024-09-21T06:47:59.856770+0000) 2024-09-21T06:48:23.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:23 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:23.188+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-21T06:47:53.859097+0000 front 2024-09-21T06:47:53.859198+0000 (oldest deadline 2024-09-21T06:48:17.959226+0000) 2024-09-21T06:48:23.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:23 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:23.452+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:21.525704+0000 front 2024-09-21T06:47:21.525444+0000 (oldest deadline 2024-09-21T06:47:47.425656+0000) 2024-09-21T06:48:23.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:23 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:23.452+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:27.926922+0000 front 2024-09-21T06:47:27.926812+0000 (oldest deadline 2024-09-21T06:47:50.826798+0000) 2024-09-21T06:48:23.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:23 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:23.452+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.728100+0000 front 2024-09-21T06:47:36.727861+0000 (oldest deadline 2024-09-21T06:48:00.828027+0000) 2024-09-21T06:48:23.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:23 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:23.452+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:47:46.029813+0000 front 2024-09-21T06:47:46.029714+0000 (oldest deadline 2024-09-21T06:48:11.830335+0000) 2024-09-21T06:48:23.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:23 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:23.452+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-21T06:47:51.830912+0000 front 2024-09-21T06:47:51.830904+0000 (oldest deadline 2024-09-21T06:48:17.130838+0000) 2024-09-21T06:48:24.035 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:23 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:48:23.742+0000 7f95c5ee3640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:27.715108+0000 front 2024-09-21T06:47:27.715279+0000 (oldest deadline 2024-09-21T06:47:53.615085+0000) 2024-09-21T06:48:24.035 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:23 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:48:23.742+0000 7f95c5ee3640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.516125+0000 front 2024-09-21T06:47:36.516474+0000 (oldest deadline 2024-09-21T06:48:00.016164+0000) 2024-09-21T06:48:24.035 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:23 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:48:23.742+0000 7f95c5ee3640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:47:46.417496+0000 front 2024-09-21T06:47:46.417414+0000 (oldest deadline 2024-09-21T06:48:09.917375+0000) 2024-09-21T06:48:24.035 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:23 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:48:23.742+0000 7f95c5ee3640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-21T06:47:53.418560+0000 front 2024-09-21T06:47:53.418623+0000 (oldest deadline 2024-09-21T06:48:19.219051+0000) 2024-09-21T06:48:24.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:23 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:23.848+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.479118+0000 front 2024-09-21T06:47:20.479041+0000 (oldest deadline 2024-09-21T06:47:42.779148+0000) 2024-09-21T06:48:24.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:23 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:23.848+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.680367+0000 front 2024-09-21T06:47:28.680320+0000 (oldest deadline 2024-09-21T06:47:51.580480+0000) 2024-09-21T06:48:24.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:23 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:23.848+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.982225+0000 front 2024-09-21T06:47:37.982324+0000 (oldest deadline 2024-09-21T06:48:01.482191+0000) 2024-09-21T06:48:24.120 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:23 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:23.848+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:47:43.683853+0000 front 2024-09-21T06:47:43.683837+0000 (oldest deadline 2024-09-21T06:48:08.383662+0000) 2024-09-21T06:48:24.120 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:23 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:23.848+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-21T06:47:50.684581+0000 front 2024-09-21T06:47:50.684614+0000 (oldest deadline 2024-09-21T06:48:15.984607+0000) 2024-09-21T06:48:24.120 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:23 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:23.848+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:47:59.485466+0000 front 2024-09-21T06:47:59.485556+0000 (oldest deadline 2024-09-21T06:48:23.585369+0000) 2024-09-21T06:48:24.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:24 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:24.206+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.153182+0000 front 2024-09-21T06:47:20.153132+0000 (oldest deadline 2024-09-21T06:47:43.053177+0000) 2024-09-21T06:48:24.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:24 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:24.206+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.854893+0000 front 2024-09-21T06:47:28.854866+0000 (oldest deadline 2024-09-21T06:47:52.954830+0000) 2024-09-21T06:48:24.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:24 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:24.206+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.656042+0000 front 2024-09-21T06:47:37.656018+0000 (oldest deadline 2024-09-21T06:47:59.856770+0000) 2024-09-21T06:48:24.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:24 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:24.206+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-21T06:47:53.859097+0000 front 2024-09-21T06:47:53.859198+0000 (oldest deadline 2024-09-21T06:48:17.959226+0000) 2024-09-21T06:48:24.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:24 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:24.419+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:21.525704+0000 front 2024-09-21T06:47:21.525444+0000 (oldest deadline 2024-09-21T06:47:47.425656+0000) 2024-09-21T06:48:24.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:24 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:24.419+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:27.926922+0000 front 2024-09-21T06:47:27.926812+0000 (oldest deadline 2024-09-21T06:47:50.826798+0000) 2024-09-21T06:48:24.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:24 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:24.419+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.728100+0000 front 2024-09-21T06:47:36.727861+0000 (oldest deadline 2024-09-21T06:48:00.828027+0000) 2024-09-21T06:48:24.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:24 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:24.419+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:47:46.029813+0000 front 2024-09-21T06:47:46.029714+0000 (oldest deadline 2024-09-21T06:48:11.830335+0000) 2024-09-21T06:48:24.841 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:24 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:24.419+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-21T06:47:51.830912+0000 front 2024-09-21T06:47:51.830904+0000 (oldest deadline 2024-09-21T06:48:17.130838+0000) 2024-09-21T06:48:25.035 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:24 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:48:24.776+0000 7f95c5ee3640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:27.715108+0000 front 2024-09-21T06:47:27.715279+0000 (oldest deadline 2024-09-21T06:47:53.615085+0000) 2024-09-21T06:48:25.035 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:24 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:48:24.776+0000 7f95c5ee3640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.516125+0000 front 2024-09-21T06:47:36.516474+0000 (oldest deadline 2024-09-21T06:48:00.016164+0000) 2024-09-21T06:48:25.035 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:24 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:48:24.776+0000 7f95c5ee3640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:47:46.417496+0000 front 2024-09-21T06:47:46.417414+0000 (oldest deadline 2024-09-21T06:48:09.917375+0000) 2024-09-21T06:48:25.035 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:24 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:48:24.776+0000 7f95c5ee3640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-21T06:47:53.418560+0000 front 2024-09-21T06:47:53.418623+0000 (oldest deadline 2024-09-21T06:48:19.219051+0000) 2024-09-21T06:48:25.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:24 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:24.892+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.479118+0000 front 2024-09-21T06:47:20.479041+0000 (oldest deadline 2024-09-21T06:47:42.779148+0000) 2024-09-21T06:48:25.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:24 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:24.892+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.680367+0000 front 2024-09-21T06:47:28.680320+0000 (oldest deadline 2024-09-21T06:47:51.580480+0000) 2024-09-21T06:48:25.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:24 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:24.892+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.982225+0000 front 2024-09-21T06:47:37.982324+0000 (oldest deadline 2024-09-21T06:48:01.482191+0000) 2024-09-21T06:48:25.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:24 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:24.892+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:47:43.683853+0000 front 2024-09-21T06:47:43.683837+0000 (oldest deadline 2024-09-21T06:48:08.383662+0000) 2024-09-21T06:48:25.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:24 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:24.892+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-21T06:47:50.684581+0000 front 2024-09-21T06:47:50.684614+0000 (oldest deadline 2024-09-21T06:48:15.984607+0000) 2024-09-21T06:48:25.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:24 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:24.892+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:47:59.485466+0000 front 2024-09-21T06:47:59.485556+0000 (oldest deadline 2024-09-21T06:48:23.585369+0000) 2024-09-21T06:48:25.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:25 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:25.203+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.153182+0000 front 2024-09-21T06:47:20.153132+0000 (oldest deadline 2024-09-21T06:47:43.053177+0000) 2024-09-21T06:48:25.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:25 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:25.203+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.854893+0000 front 2024-09-21T06:47:28.854866+0000 (oldest deadline 2024-09-21T06:47:52.954830+0000) 2024-09-21T06:48:25.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:25 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:25.203+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.656042+0000 front 2024-09-21T06:47:37.656018+0000 (oldest deadline 2024-09-21T06:47:59.856770+0000) 2024-09-21T06:48:25.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:25 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:25.203+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-21T06:47:53.859097+0000 front 2024-09-21T06:47:53.859198+0000 (oldest deadline 2024-09-21T06:48:17.959226+0000) 2024-09-21T06:48:25.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:25 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:25.203+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:47:59.060089+0000 front 2024-09-21T06:47:59.060063+0000 (oldest deadline 2024-09-21T06:48:24.960040+0000) 2024-09-21T06:48:25.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:25 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:25.438+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:21.525704+0000 front 2024-09-21T06:47:21.525444+0000 (oldest deadline 2024-09-21T06:47:47.425656+0000) 2024-09-21T06:48:25.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:25 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:25.438+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:27.926922+0000 front 2024-09-21T06:47:27.926812+0000 (oldest deadline 2024-09-21T06:47:50.826798+0000) 2024-09-21T06:48:25.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:25 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:25.438+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.728100+0000 front 2024-09-21T06:47:36.727861+0000 (oldest deadline 2024-09-21T06:48:00.828027+0000) 2024-09-21T06:48:25.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:25 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:25.438+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:47:46.029813+0000 front 2024-09-21T06:47:46.029714+0000 (oldest deadline 2024-09-21T06:48:11.830335+0000) 2024-09-21T06:48:25.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:25 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:25.438+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-21T06:47:51.830912+0000 front 2024-09-21T06:47:51.830904+0000 (oldest deadline 2024-09-21T06:48:17.130838+0000) 2024-09-21T06:48:26.035 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:25 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:48:25.759+0000 7f95c5ee3640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:27.715108+0000 front 2024-09-21T06:47:27.715279+0000 (oldest deadline 2024-09-21T06:47:53.615085+0000) 2024-09-21T06:48:26.035 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:25 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:48:25.759+0000 7f95c5ee3640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.516125+0000 front 2024-09-21T06:47:36.516474+0000 (oldest deadline 2024-09-21T06:48:00.016164+0000) 2024-09-21T06:48:26.035 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:25 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:48:25.759+0000 7f95c5ee3640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:47:46.417496+0000 front 2024-09-21T06:47:46.417414+0000 (oldest deadline 2024-09-21T06:48:09.917375+0000) 2024-09-21T06:48:26.035 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:25 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:48:25.759+0000 7f95c5ee3640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-21T06:47:53.418560+0000 front 2024-09-21T06:47:53.418623+0000 (oldest deadline 2024-09-21T06:48:19.219051+0000) 2024-09-21T06:48:26.035 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:25 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8[52390]: 2024-09-21T06:48:25.759+0000 7f95c5ee3640 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:47:59.219450+0000 front 2024-09-21T06:47:59.219485+0000 (oldest deadline 2024-09-21T06:48:25.119628+0000) 2024-09-21T06:48:26.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:25 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:25.913+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.479118+0000 front 2024-09-21T06:47:20.479041+0000 (oldest deadline 2024-09-21T06:47:42.779148+0000) 2024-09-21T06:48:26.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:25 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:25.913+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.680367+0000 front 2024-09-21T06:47:28.680320+0000 (oldest deadline 2024-09-21T06:47:51.580480+0000) 2024-09-21T06:48:26.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:25 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:25.913+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.982225+0000 front 2024-09-21T06:47:37.982324+0000 (oldest deadline 2024-09-21T06:48:01.482191+0000) 2024-09-21T06:48:26.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:25 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:25.913+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:47:43.683853+0000 front 2024-09-21T06:47:43.683837+0000 (oldest deadline 2024-09-21T06:48:08.383662+0000) 2024-09-21T06:48:26.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:25 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:25.913+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-21T06:47:50.684581+0000 front 2024-09-21T06:47:50.684614+0000 (oldest deadline 2024-09-21T06:48:15.984607+0000) 2024-09-21T06:48:26.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:25 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:25.913+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:47:59.485466+0000 front 2024-09-21T06:47:59.485556+0000 (oldest deadline 2024-09-21T06:48:23.585369+0000) 2024-09-21T06:48:26.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:26 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:26.214+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.153182+0000 front 2024-09-21T06:47:20.153132+0000 (oldest deadline 2024-09-21T06:47:43.053177+0000) 2024-09-21T06:48:26.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:26 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:26.214+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.854893+0000 front 2024-09-21T06:47:28.854866+0000 (oldest deadline 2024-09-21T06:47:52.954830+0000) 2024-09-21T06:48:26.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:26 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:26.214+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.656042+0000 front 2024-09-21T06:47:37.656018+0000 (oldest deadline 2024-09-21T06:47:59.856770+0000) 2024-09-21T06:48:26.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:26 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:26.214+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-21T06:47:53.859097+0000 front 2024-09-21T06:47:53.859198+0000 (oldest deadline 2024-09-21T06:48:17.959226+0000) 2024-09-21T06:48:26.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:26 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:26.214+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:47:59.060089+0000 front 2024-09-21T06:47:59.060063+0000 (oldest deadline 2024-09-21T06:48:24.960040+0000) 2024-09-21T06:48:26.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:26 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:26.426+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:21.525704+0000 front 2024-09-21T06:47:21.525444+0000 (oldest deadline 2024-09-21T06:47:47.425656+0000) 2024-09-21T06:48:26.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:26 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:26.426+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:27.926922+0000 front 2024-09-21T06:47:27.926812+0000 (oldest deadline 2024-09-21T06:47:50.826798+0000) 2024-09-21T06:48:26.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:26 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:26.426+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.728100+0000 front 2024-09-21T06:47:36.727861+0000 (oldest deadline 2024-09-21T06:48:00.828027+0000) 2024-09-21T06:48:26.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:26 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:26.426+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:47:46.029813+0000 front 2024-09-21T06:47:46.029714+0000 (oldest deadline 2024-09-21T06:48:11.830335+0000) 2024-09-21T06:48:26.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:26 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:26.426+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-21T06:47:51.830912+0000 front 2024-09-21T06:47:51.830904+0000 (oldest deadline 2024-09-21T06:48:17.130838+0000) 2024-09-21T06:48:27.183 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:26 smithi144 podman[68327]: 2024-09-21 06:48:26.901716217 +0000 UTC m=+5.554522996 container died d22015ba1f14aa1e7ed2865ea4b37cc29cc3b01d679d871faf074305d73c510e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-21T06:48:27.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:26 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:26.946+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.479118+0000 front 2024-09-21T06:47:20.479041+0000 (oldest deadline 2024-09-21T06:47:42.779148+0000) 2024-09-21T06:48:27.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:26 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:26.946+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.680367+0000 front 2024-09-21T06:47:28.680320+0000 (oldest deadline 2024-09-21T06:47:51.580480+0000) 2024-09-21T06:48:27.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:26 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:26.946+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.982225+0000 front 2024-09-21T06:47:37.982324+0000 (oldest deadline 2024-09-21T06:48:01.482191+0000) 2024-09-21T06:48:27.370 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:26 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:26.946+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:47:43.683853+0000 front 2024-09-21T06:47:43.683837+0000 (oldest deadline 2024-09-21T06:48:08.383662+0000) 2024-09-21T06:48:27.370 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:26 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:26.946+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-21T06:47:50.684581+0000 front 2024-09-21T06:47:50.684614+0000 (oldest deadline 2024-09-21T06:48:15.984607+0000) 2024-09-21T06:48:27.370 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:26 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:26.946+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:47:59.485466+0000 front 2024-09-21T06:47:59.485556+0000 (oldest deadline 2024-09-21T06:48:23.585369+0000) 2024-09-21T06:48:27.535 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:27 smithi144 podman[68327]: 2024-09-21 06:48:27.248203934 +0000 UTC m=+5.901010708 container cleanup d22015ba1f14aa1e7ed2865ea4b37cc29cc3b01d679d871faf074305d73c510e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:48:27.535 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:27 smithi144 bash[68327]: ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8 2024-09-21T06:48:27.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:27 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:27.181+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.153182+0000 front 2024-09-21T06:47:20.153132+0000 (oldest deadline 2024-09-21T06:47:43.053177+0000) 2024-09-21T06:48:27.536 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:27 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:27.181+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.854893+0000 front 2024-09-21T06:47:28.854866+0000 (oldest deadline 2024-09-21T06:47:52.954830+0000) 2024-09-21T06:48:27.536 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:27 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:27.181+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.656042+0000 front 2024-09-21T06:47:37.656018+0000 (oldest deadline 2024-09-21T06:47:59.856770+0000) 2024-09-21T06:48:27.536 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:27 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:27.181+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-21T06:47:53.859097+0000 front 2024-09-21T06:47:53.859198+0000 (oldest deadline 2024-09-21T06:48:17.959226+0000) 2024-09-21T06:48:27.536 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:27 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:27.181+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:47:59.060089+0000 front 2024-09-21T06:47:59.060063+0000 (oldest deadline 2024-09-21T06:48:24.960040+0000) 2024-09-21T06:48:27.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:27 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:27.442+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:21.525704+0000 front 2024-09-21T06:47:21.525444+0000 (oldest deadline 2024-09-21T06:47:47.425656+0000) 2024-09-21T06:48:27.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:27 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:27.442+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:27.926922+0000 front 2024-09-21T06:47:27.926812+0000 (oldest deadline 2024-09-21T06:47:50.826798+0000) 2024-09-21T06:48:27.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:27 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:27.442+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.728100+0000 front 2024-09-21T06:47:36.727861+0000 (oldest deadline 2024-09-21T06:48:00.828027+0000) 2024-09-21T06:48:27.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:27 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:27.442+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:47:46.029813+0000 front 2024-09-21T06:47:46.029714+0000 (oldest deadline 2024-09-21T06:48:11.830335+0000) 2024-09-21T06:48:27.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:27 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:27.442+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-21T06:47:51.830912+0000 front 2024-09-21T06:47:51.830904+0000 (oldest deadline 2024-09-21T06:48:17.130838+0000) 2024-09-21T06:48:27.901 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:27 smithi144 podman[68343]: 2024-09-21 06:48:27.566139023 +0000 UTC m=+0.662852040 container remove d22015ba1f14aa1e7ed2865ea4b37cc29cc3b01d679d871faf074305d73c510e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:48:28.172 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:27 smithi144 podman[68432]: 2024-09-21 06:48:27.900417838 +0000 UTC m=+0.100454577 container create 1d4f48eab7cf5a198cbc9b3ecc5d1af999b45548e8e5e70b4486d9d4420f120d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-21T06:48:28.173 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:27 smithi144 podman[68432]: 2024-09-21 06:48:27.816192575 +0000 UTC m=+0.016229315 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:48:28.173 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:28 smithi144 podman[68432]: 2024-09-21 06:48:28.144409771 +0000 UTC m=+0.344446524 container init 1d4f48eab7cf5a198cbc9b3ecc5d1af999b45548e8e5e70b4486d9d4420f120d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8-deactivate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:48:28.173 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:28 smithi144 podman[68432]: 2024-09-21 06:48:28.14785998 +0000 UTC m=+0.347896723 container start 1d4f48eab7cf5a198cbc9b3ecc5d1af999b45548e8e5e70b4486d9d4420f120d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8-deactivate, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-21T06:48:28.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:27 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:27.910+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.479118+0000 front 2024-09-21T06:47:20.479041+0000 (oldest deadline 2024-09-21T06:47:42.779148+0000) 2024-09-21T06:48:28.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:27 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:27.910+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.680367+0000 front 2024-09-21T06:47:28.680320+0000 (oldest deadline 2024-09-21T06:47:51.580480+0000) 2024-09-21T06:48:28.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:27 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:27.910+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.982225+0000 front 2024-09-21T06:47:37.982324+0000 (oldest deadline 2024-09-21T06:48:01.482191+0000) 2024-09-21T06:48:28.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:27 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:27.910+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:47:43.683853+0000 front 2024-09-21T06:47:43.683837+0000 (oldest deadline 2024-09-21T06:48:08.383662+0000) 2024-09-21T06:48:28.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:27 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:27.910+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-21T06:47:50.684581+0000 front 2024-09-21T06:47:50.684614+0000 (oldest deadline 2024-09-21T06:48:15.984607+0000) 2024-09-21T06:48:28.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:27 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:27.910+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:47:59.485466+0000 front 2024-09-21T06:47:59.485556+0000 (oldest deadline 2024-09-21T06:48:23.585369+0000) 2024-09-21T06:48:28.535 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:28 smithi144 podman[68432]: 2024-09-21 06:48:28.26140139 +0000 UTC m=+0.461438151 container attach 1d4f48eab7cf5a198cbc9b3ecc5d1af999b45548e8e5e70b4486d9d4420f120d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-21T06:48:28.535 INFO:journalctl@ceph.osd.8.smithi144.stdout:Sep 21 06:48:28 smithi144 podman[68432]: 2024-09-21 06:48:28.343484874 +0000 UTC m=+0.543521629 container died 1d4f48eab7cf5a198cbc9b3ecc5d1af999b45548e8e5e70b4486d9d4420f120d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-8-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T06:48:28.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:28 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:28.171+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.153182+0000 front 2024-09-21T06:47:20.153132+0000 (oldest deadline 2024-09-21T06:47:43.053177+0000) 2024-09-21T06:48:28.536 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:28 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:28.171+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.854893+0000 front 2024-09-21T06:47:28.854866+0000 (oldest deadline 2024-09-21T06:47:52.954830+0000) 2024-09-21T06:48:28.536 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:28 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:28.171+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.656042+0000 front 2024-09-21T06:47:37.656018+0000 (oldest deadline 2024-09-21T06:47:59.856770+0000) 2024-09-21T06:48:28.536 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:28 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:28.171+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-21T06:47:53.859097+0000 front 2024-09-21T06:47:53.859198+0000 (oldest deadline 2024-09-21T06:48:17.959226+0000) 2024-09-21T06:48:28.536 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:28 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:28.171+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:47:59.060089+0000 front 2024-09-21T06:47:59.060063+0000 (oldest deadline 2024-09-21T06:48:24.960040+0000) 2024-09-21T06:48:28.839 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:28 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:28.434+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:21.525704+0000 front 2024-09-21T06:47:21.525444+0000 (oldest deadline 2024-09-21T06:47:47.425656+0000) 2024-09-21T06:48:28.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:28 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:28.434+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:27.926922+0000 front 2024-09-21T06:47:27.926812+0000 (oldest deadline 2024-09-21T06:47:50.826798+0000) 2024-09-21T06:48:28.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:28 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:28.434+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.728100+0000 front 2024-09-21T06:47:36.727861+0000 (oldest deadline 2024-09-21T06:48:00.828027+0000) 2024-09-21T06:48:28.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:28 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:28.434+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:47:46.029813+0000 front 2024-09-21T06:47:46.029714+0000 (oldest deadline 2024-09-21T06:48:11.830335+0000) 2024-09-21T06:48:28.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:28 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:28.434+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-21T06:47:51.830912+0000 front 2024-09-21T06:47:51.830904+0000 (oldest deadline 2024-09-21T06:48:17.130838+0000) 2024-09-21T06:48:28.991 DEBUG:teuthology.orchestra.run.smithi144:> sudo pkill -f 'journalctl -f -n 0 -u ceph-347cb918-77e2-11ef-baf5-efdc52797490@osd.8.service' 2024-09-21T06:48:29.034 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:48:29.034 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-21T06:48:29.034 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-21T06:48:29.034 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ceph-347cb918-77e2-11ef-baf5-efdc52797490@osd.9 2024-09-21T06:48:29.285 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:29 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:29.163+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.153182+0000 front 2024-09-21T06:47:20.153132+0000 (oldest deadline 2024-09-21T06:47:43.053177+0000) 2024-09-21T06:48:29.285 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:29 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:29.163+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.854893+0000 front 2024-09-21T06:47:28.854866+0000 (oldest deadline 2024-09-21T06:47:52.954830+0000) 2024-09-21T06:48:29.285 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:29 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:29.163+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.656042+0000 front 2024-09-21T06:47:37.656018+0000 (oldest deadline 2024-09-21T06:47:59.856770+0000) 2024-09-21T06:48:29.285 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:29 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:29.163+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-21T06:47:53.859097+0000 front 2024-09-21T06:47:53.859198+0000 (oldest deadline 2024-09-21T06:48:17.959226+0000) 2024-09-21T06:48:29.285 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:29 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:29.163+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:47:59.060089+0000 front 2024-09-21T06:47:59.060063+0000 (oldest deadline 2024-09-21T06:48:24.960040+0000) 2024-09-21T06:48:29.339 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:29 smithi007 systemd[1]: Stopping Ceph osd.9 for 347cb918-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:48:29.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:28 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:28.923+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.479118+0000 front 2024-09-21T06:47:20.479041+0000 (oldest deadline 2024-09-21T06:47:42.779148+0000) 2024-09-21T06:48:29.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:28 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:28.923+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.680367+0000 front 2024-09-21T06:47:28.680320+0000 (oldest deadline 2024-09-21T06:47:51.580480+0000) 2024-09-21T06:48:29.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:28 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:28.923+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.982225+0000 front 2024-09-21T06:47:37.982324+0000 (oldest deadline 2024-09-21T06:48:01.482191+0000) 2024-09-21T06:48:29.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:28 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:28.923+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:47:43.683853+0000 front 2024-09-21T06:47:43.683837+0000 (oldest deadline 2024-09-21T06:48:08.383662+0000) 2024-09-21T06:48:29.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:28 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:28.923+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-21T06:47:50.684581+0000 front 2024-09-21T06:47:50.684614+0000 (oldest deadline 2024-09-21T06:48:15.984607+0000) 2024-09-21T06:48:29.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:28 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:28.923+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:47:59.485466+0000 front 2024-09-21T06:47:59.485556+0000 (oldest deadline 2024-09-21T06:48:23.585369+0000) 2024-09-21T06:48:29.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:29 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:29.362+0000 7f36659e2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:48:29.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:29 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:29.362+0000 7f36659e2640 -1 osd.9 88 *** Got signal Terminated *** 2024-09-21T06:48:29.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:29 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:29.362+0000 7f36659e2640 -1 osd.9 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T06:48:29.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:29 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:29.393+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:21.525704+0000 front 2024-09-21T06:47:21.525444+0000 (oldest deadline 2024-09-21T06:47:47.425656+0000) 2024-09-21T06:48:29.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:29 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:29.394+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:27.926922+0000 front 2024-09-21T06:47:27.926812+0000 (oldest deadline 2024-09-21T06:47:50.826798+0000) 2024-09-21T06:48:29.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:29 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:29.394+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.728100+0000 front 2024-09-21T06:47:36.727861+0000 (oldest deadline 2024-09-21T06:48:00.828027+0000) 2024-09-21T06:48:29.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:29 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:29.394+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:47:46.029813+0000 front 2024-09-21T06:47:46.029714+0000 (oldest deadline 2024-09-21T06:48:11.830335+0000) 2024-09-21T06:48:29.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:29 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:29.394+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-21T06:47:51.830912+0000 front 2024-09-21T06:47:51.830904+0000 (oldest deadline 2024-09-21T06:48:17.130838+0000) 2024-09-21T06:48:30.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:29 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:29.927+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.479118+0000 front 2024-09-21T06:47:20.479041+0000 (oldest deadline 2024-09-21T06:47:42.779148+0000) 2024-09-21T06:48:30.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:29 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:29.927+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.680367+0000 front 2024-09-21T06:47:28.680320+0000 (oldest deadline 2024-09-21T06:47:51.580480+0000) 2024-09-21T06:48:30.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:29 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:29.927+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.982225+0000 front 2024-09-21T06:47:37.982324+0000 (oldest deadline 2024-09-21T06:48:01.482191+0000) 2024-09-21T06:48:30.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:29 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:29.927+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:47:43.683853+0000 front 2024-09-21T06:47:43.683837+0000 (oldest deadline 2024-09-21T06:48:08.383662+0000) 2024-09-21T06:48:30.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:29 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:29.927+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-21T06:47:50.684581+0000 front 2024-09-21T06:47:50.684614+0000 (oldest deadline 2024-09-21T06:48:15.984607+0000) 2024-09-21T06:48:30.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:29 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:29.927+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:47:59.485466+0000 front 2024-09-21T06:47:59.485556+0000 (oldest deadline 2024-09-21T06:48:23.585369+0000) 2024-09-21T06:48:30.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:30 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:30.120+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.153182+0000 front 2024-09-21T06:47:20.153132+0000 (oldest deadline 2024-09-21T06:47:43.053177+0000) 2024-09-21T06:48:30.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:30 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:30.120+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.854893+0000 front 2024-09-21T06:47:28.854866+0000 (oldest deadline 2024-09-21T06:47:52.954830+0000) 2024-09-21T06:48:30.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:30 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:30.120+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.656042+0000 front 2024-09-21T06:47:37.656018+0000 (oldest deadline 2024-09-21T06:47:59.856770+0000) 2024-09-21T06:48:30.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:30 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:30.120+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-21T06:47:53.859097+0000 front 2024-09-21T06:47:53.859198+0000 (oldest deadline 2024-09-21T06:48:17.959226+0000) 2024-09-21T06:48:30.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:30 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:30.120+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:47:59.060089+0000 front 2024-09-21T06:47:59.060063+0000 (oldest deadline 2024-09-21T06:48:24.960040+0000) 2024-09-21T06:48:30.839 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:30 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:30.407+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:21.525704+0000 front 2024-09-21T06:47:21.525444+0000 (oldest deadline 2024-09-21T06:47:47.425656+0000) 2024-09-21T06:48:30.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:30 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:30.407+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:27.926922+0000 front 2024-09-21T06:47:27.926812+0000 (oldest deadline 2024-09-21T06:47:50.826798+0000) 2024-09-21T06:48:30.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:30 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:30.407+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.728100+0000 front 2024-09-21T06:47:36.727861+0000 (oldest deadline 2024-09-21T06:48:00.828027+0000) 2024-09-21T06:48:30.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:30 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:30.407+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:47:46.029813+0000 front 2024-09-21T06:47:46.029714+0000 (oldest deadline 2024-09-21T06:48:11.830335+0000) 2024-09-21T06:48:30.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:30 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:30.407+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-21T06:47:51.830912+0000 front 2024-09-21T06:47:51.830904+0000 (oldest deadline 2024-09-21T06:48:17.130838+0000) 2024-09-21T06:48:31.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:30 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:30.955+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.479118+0000 front 2024-09-21T06:47:20.479041+0000 (oldest deadline 2024-09-21T06:47:42.779148+0000) 2024-09-21T06:48:31.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:30 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:30.955+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.680367+0000 front 2024-09-21T06:47:28.680320+0000 (oldest deadline 2024-09-21T06:47:51.580480+0000) 2024-09-21T06:48:31.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:30 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:30.955+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.982225+0000 front 2024-09-21T06:47:37.982324+0000 (oldest deadline 2024-09-21T06:48:01.482191+0000) 2024-09-21T06:48:31.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:30 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:30.955+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:47:43.683853+0000 front 2024-09-21T06:47:43.683837+0000 (oldest deadline 2024-09-21T06:48:08.383662+0000) 2024-09-21T06:48:31.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:30 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:30.955+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-21T06:47:50.684581+0000 front 2024-09-21T06:47:50.684614+0000 (oldest deadline 2024-09-21T06:48:15.984607+0000) 2024-09-21T06:48:31.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:30 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:30.955+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:47:59.485466+0000 front 2024-09-21T06:47:59.485556+0000 (oldest deadline 2024-09-21T06:48:23.585369+0000) 2024-09-21T06:48:31.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:31 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:31.134+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.153182+0000 front 2024-09-21T06:47:20.153132+0000 (oldest deadline 2024-09-21T06:47:43.053177+0000) 2024-09-21T06:48:31.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:31 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:31.134+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.854893+0000 front 2024-09-21T06:47:28.854866+0000 (oldest deadline 2024-09-21T06:47:52.954830+0000) 2024-09-21T06:48:31.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:31 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:31.134+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.656042+0000 front 2024-09-21T06:47:37.656018+0000 (oldest deadline 2024-09-21T06:47:59.856770+0000) 2024-09-21T06:48:31.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:31 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:31.134+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-21T06:47:53.859097+0000 front 2024-09-21T06:47:53.859198+0000 (oldest deadline 2024-09-21T06:48:17.959226+0000) 2024-09-21T06:48:31.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:31 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:31.134+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:47:59.060089+0000 front 2024-09-21T06:47:59.060063+0000 (oldest deadline 2024-09-21T06:48:24.960040+0000) 2024-09-21T06:48:31.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:31 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:31.134+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-21T06:48:04.960715+0000 front 2024-09-21T06:48:04.960577+0000 (oldest deadline 2024-09-21T06:48:30.860590+0000) 2024-09-21T06:48:31.839 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:31 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:31.389+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:21.525704+0000 front 2024-09-21T06:47:21.525444+0000 (oldest deadline 2024-09-21T06:47:47.425656+0000) 2024-09-21T06:48:31.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:31 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:31.389+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:27.926922+0000 front 2024-09-21T06:47:27.926812+0000 (oldest deadline 2024-09-21T06:47:50.826798+0000) 2024-09-21T06:48:31.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:31 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:31.389+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.728100+0000 front 2024-09-21T06:47:36.727861+0000 (oldest deadline 2024-09-21T06:48:00.828027+0000) 2024-09-21T06:48:31.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:31 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:31.389+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:47:46.029813+0000 front 2024-09-21T06:47:46.029714+0000 (oldest deadline 2024-09-21T06:48:11.830335+0000) 2024-09-21T06:48:31.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:31 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:31.389+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-21T06:47:51.830912+0000 front 2024-09-21T06:47:51.830904+0000 (oldest deadline 2024-09-21T06:48:17.130838+0000) 2024-09-21T06:48:32.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:32 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:32.005+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.479118+0000 front 2024-09-21T06:47:20.479041+0000 (oldest deadline 2024-09-21T06:47:42.779148+0000) 2024-09-21T06:48:32.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:32 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:32.005+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.680367+0000 front 2024-09-21T06:47:28.680320+0000 (oldest deadline 2024-09-21T06:47:51.580480+0000) 2024-09-21T06:48:32.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:32 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:32.005+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.982225+0000 front 2024-09-21T06:47:37.982324+0000 (oldest deadline 2024-09-21T06:48:01.482191+0000) 2024-09-21T06:48:32.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:32 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:32.005+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:47:43.683853+0000 front 2024-09-21T06:47:43.683837+0000 (oldest deadline 2024-09-21T06:48:08.383662+0000) 2024-09-21T06:48:32.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:32 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:32.005+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-21T06:47:50.684581+0000 front 2024-09-21T06:47:50.684614+0000 (oldest deadline 2024-09-21T06:48:15.984607+0000) 2024-09-21T06:48:32.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:32 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:32.005+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:47:59.485466+0000 front 2024-09-21T06:47:59.485556+0000 (oldest deadline 2024-09-21T06:48:23.585369+0000) 2024-09-21T06:48:32.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:32 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:32.097+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.153182+0000 front 2024-09-21T06:47:20.153132+0000 (oldest deadline 2024-09-21T06:47:43.053177+0000) 2024-09-21T06:48:32.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:32 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:32.097+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.854893+0000 front 2024-09-21T06:47:28.854866+0000 (oldest deadline 2024-09-21T06:47:52.954830+0000) 2024-09-21T06:48:32.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:32 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:32.097+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.656042+0000 front 2024-09-21T06:47:37.656018+0000 (oldest deadline 2024-09-21T06:47:59.856770+0000) 2024-09-21T06:48:32.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:32 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:32.097+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-21T06:47:53.859097+0000 front 2024-09-21T06:47:53.859198+0000 (oldest deadline 2024-09-21T06:48:17.959226+0000) 2024-09-21T06:48:32.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:32 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:32.097+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:47:59.060089+0000 front 2024-09-21T06:47:59.060063+0000 (oldest deadline 2024-09-21T06:48:24.960040+0000) 2024-09-21T06:48:32.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:32 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:32.097+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-21T06:48:04.960715+0000 front 2024-09-21T06:48:04.960577+0000 (oldest deadline 2024-09-21T06:48:30.860590+0000) 2024-09-21T06:48:32.839 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:32 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:32.366+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:21.525704+0000 front 2024-09-21T06:47:21.525444+0000 (oldest deadline 2024-09-21T06:47:47.425656+0000) 2024-09-21T06:48:32.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:32 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:32.366+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:27.926922+0000 front 2024-09-21T06:47:27.926812+0000 (oldest deadline 2024-09-21T06:47:50.826798+0000) 2024-09-21T06:48:32.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:32 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:32.366+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.728100+0000 front 2024-09-21T06:47:36.727861+0000 (oldest deadline 2024-09-21T06:48:00.828027+0000) 2024-09-21T06:48:32.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:32 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:32.366+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:47:46.029813+0000 front 2024-09-21T06:47:46.029714+0000 (oldest deadline 2024-09-21T06:48:11.830335+0000) 2024-09-21T06:48:32.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:32 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:32.366+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-21T06:47:51.830912+0000 front 2024-09-21T06:47:51.830904+0000 (oldest deadline 2024-09-21T06:48:17.130838+0000) 2024-09-21T06:48:33.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:32 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:32.966+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.479118+0000 front 2024-09-21T06:47:20.479041+0000 (oldest deadline 2024-09-21T06:47:42.779148+0000) 2024-09-21T06:48:33.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:32 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:32.966+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.680367+0000 front 2024-09-21T06:47:28.680320+0000 (oldest deadline 2024-09-21T06:47:51.580480+0000) 2024-09-21T06:48:33.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:32 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:32.966+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.982225+0000 front 2024-09-21T06:47:37.982324+0000 (oldest deadline 2024-09-21T06:48:01.482191+0000) 2024-09-21T06:48:33.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:32 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:32.966+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:47:43.683853+0000 front 2024-09-21T06:47:43.683837+0000 (oldest deadline 2024-09-21T06:48:08.383662+0000) 2024-09-21T06:48:33.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:32 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:32.966+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-21T06:47:50.684581+0000 front 2024-09-21T06:47:50.684614+0000 (oldest deadline 2024-09-21T06:48:15.984607+0000) 2024-09-21T06:48:33.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:32 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:32.966+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:47:59.485466+0000 front 2024-09-21T06:47:59.485556+0000 (oldest deadline 2024-09-21T06:48:23.585369+0000) 2024-09-21T06:48:33.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:32 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:32.966+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-21T06:48:09.486396+0000 front 2024-09-21T06:48:09.486323+0000 (oldest deadline 2024-09-21T06:48:32.386173+0000) 2024-09-21T06:48:33.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:33 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:33.135+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.153182+0000 front 2024-09-21T06:47:20.153132+0000 (oldest deadline 2024-09-21T06:47:43.053177+0000) 2024-09-21T06:48:33.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:33 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:33.135+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.854893+0000 front 2024-09-21T06:47:28.854866+0000 (oldest deadline 2024-09-21T06:47:52.954830+0000) 2024-09-21T06:48:33.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:33 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:33.135+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.656042+0000 front 2024-09-21T06:47:37.656018+0000 (oldest deadline 2024-09-21T06:47:59.856770+0000) 2024-09-21T06:48:33.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:33 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:33.135+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-21T06:47:53.859097+0000 front 2024-09-21T06:47:53.859198+0000 (oldest deadline 2024-09-21T06:48:17.959226+0000) 2024-09-21T06:48:33.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:33 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:33.135+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:47:59.060089+0000 front 2024-09-21T06:47:59.060063+0000 (oldest deadline 2024-09-21T06:48:24.960040+0000) 2024-09-21T06:48:33.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:33 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:33.135+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-21T06:48:04.960715+0000 front 2024-09-21T06:48:04.960577+0000 (oldest deadline 2024-09-21T06:48:30.860590+0000) 2024-09-21T06:48:33.839 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:33 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:33.364+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:21.525704+0000 front 2024-09-21T06:47:21.525444+0000 (oldest deadline 2024-09-21T06:47:47.425656+0000) 2024-09-21T06:48:33.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:33 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:33.364+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:27.926922+0000 front 2024-09-21T06:47:27.926812+0000 (oldest deadline 2024-09-21T06:47:50.826798+0000) 2024-09-21T06:48:33.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:33 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:33.364+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:36.728100+0000 front 2024-09-21T06:47:36.727861+0000 (oldest deadline 2024-09-21T06:48:00.828027+0000) 2024-09-21T06:48:33.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:33 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:33.364+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:47:46.029813+0000 front 2024-09-21T06:47:46.029714+0000 (oldest deadline 2024-09-21T06:48:11.830335+0000) 2024-09-21T06:48:33.840 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:33 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9[66631]: 2024-09-21T06:48:33.364+0000 7f3661fcd640 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-21T06:47:51.830912+0000 front 2024-09-21T06:47:51.830904+0000 (oldest deadline 2024-09-21T06:48:17.130838+0000) 2024-09-21T06:48:34.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:34 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:34.005+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.479118+0000 front 2024-09-21T06:47:20.479041+0000 (oldest deadline 2024-09-21T06:47:42.779148+0000) 2024-09-21T06:48:34.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:34 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:34.005+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.680367+0000 front 2024-09-21T06:47:28.680320+0000 (oldest deadline 2024-09-21T06:47:51.580480+0000) 2024-09-21T06:48:34.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:34 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:34.005+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.982225+0000 front 2024-09-21T06:47:37.982324+0000 (oldest deadline 2024-09-21T06:48:01.482191+0000) 2024-09-21T06:48:34.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:34 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:34.005+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:47:43.683853+0000 front 2024-09-21T06:47:43.683837+0000 (oldest deadline 2024-09-21T06:48:08.383662+0000) 2024-09-21T06:48:34.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:34 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:34.005+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-21T06:47:50.684581+0000 front 2024-09-21T06:47:50.684614+0000 (oldest deadline 2024-09-21T06:48:15.984607+0000) 2024-09-21T06:48:34.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:34 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:34.005+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:47:59.485466+0000 front 2024-09-21T06:47:59.485556+0000 (oldest deadline 2024-09-21T06:48:23.585369+0000) 2024-09-21T06:48:34.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:34 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:34.005+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-21T06:48:09.486396+0000 front 2024-09-21T06:48:09.486323+0000 (oldest deadline 2024-09-21T06:48:32.386173+0000) 2024-09-21T06:48:34.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:34 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:34.169+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.153182+0000 front 2024-09-21T06:47:20.153132+0000 (oldest deadline 2024-09-21T06:47:43.053177+0000) 2024-09-21T06:48:34.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:34 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:34.169+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.854893+0000 front 2024-09-21T06:47:28.854866+0000 (oldest deadline 2024-09-21T06:47:52.954830+0000) 2024-09-21T06:48:34.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:34 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:34.169+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.656042+0000 front 2024-09-21T06:47:37.656018+0000 (oldest deadline 2024-09-21T06:47:59.856770+0000) 2024-09-21T06:48:34.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:34 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:34.169+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-21T06:47:53.859097+0000 front 2024-09-21T06:47:53.859198+0000 (oldest deadline 2024-09-21T06:48:17.959226+0000) 2024-09-21T06:48:34.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:34 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:34.169+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:47:59.060089+0000 front 2024-09-21T06:47:59.060063+0000 (oldest deadline 2024-09-21T06:48:24.960040+0000) 2024-09-21T06:48:34.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:34 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:34.169+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-21T06:48:04.960715+0000 front 2024-09-21T06:48:04.960577+0000 (oldest deadline 2024-09-21T06:48:30.860590+0000) 2024-09-21T06:48:35.090 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:34 smithi007 podman[107852]: 2024-09-21 06:48:34.76749433 +0000 UTC m=+5.531469617 container died 74acc268ebecec2b2df2cb386ac3a82778da7c53e1e385c393b529421e89b4ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0) 2024-09-21T06:48:35.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:34 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:34.980+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.479118+0000 front 2024-09-21T06:47:20.479041+0000 (oldest deadline 2024-09-21T06:47:42.779148+0000) 2024-09-21T06:48:35.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:34 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:34.980+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.680367+0000 front 2024-09-21T06:47:28.680320+0000 (oldest deadline 2024-09-21T06:47:51.580480+0000) 2024-09-21T06:48:35.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:34 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:34.980+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.982225+0000 front 2024-09-21T06:47:37.982324+0000 (oldest deadline 2024-09-21T06:48:01.482191+0000) 2024-09-21T06:48:35.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:34 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:34.980+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:47:43.683853+0000 front 2024-09-21T06:47:43.683837+0000 (oldest deadline 2024-09-21T06:48:08.383662+0000) 2024-09-21T06:48:35.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:34 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:34.980+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-21T06:47:50.684581+0000 front 2024-09-21T06:47:50.684614+0000 (oldest deadline 2024-09-21T06:48:15.984607+0000) 2024-09-21T06:48:35.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:34 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:34.980+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:47:59.485466+0000 front 2024-09-21T06:47:59.485556+0000 (oldest deadline 2024-09-21T06:48:23.585369+0000) 2024-09-21T06:48:35.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:34 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:34.980+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-21T06:48:09.486396+0000 front 2024-09-21T06:48:09.486323+0000 (oldest deadline 2024-09-21T06:48:32.386173+0000) 2024-09-21T06:48:35.407 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:35 smithi007 podman[107852]: 2024-09-21 06:48:35.146113756 +0000 UTC m=+5.910089072 container cleanup 74acc268ebecec2b2df2cb386ac3a82778da7c53e1e385c393b529421e89b4ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2) 2024-09-21T06:48:35.407 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:35 smithi007 bash[107852]: ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9 2024-09-21T06:48:35.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:35 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:35.171+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.153182+0000 front 2024-09-21T06:47:20.153132+0000 (oldest deadline 2024-09-21T06:47:43.053177+0000) 2024-09-21T06:48:35.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:35 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:35.171+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.854893+0000 front 2024-09-21T06:47:28.854866+0000 (oldest deadline 2024-09-21T06:47:52.954830+0000) 2024-09-21T06:48:35.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:35 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:35.171+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.656042+0000 front 2024-09-21T06:47:37.656018+0000 (oldest deadline 2024-09-21T06:47:59.856770+0000) 2024-09-21T06:48:35.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:35 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:35.171+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-21T06:47:53.859097+0000 front 2024-09-21T06:47:53.859198+0000 (oldest deadline 2024-09-21T06:48:17.959226+0000) 2024-09-21T06:48:35.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:35 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:35.171+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:47:59.060089+0000 front 2024-09-21T06:47:59.060063+0000 (oldest deadline 2024-09-21T06:48:24.960040+0000) 2024-09-21T06:48:35.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:35 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:35.171+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-21T06:48:04.960715+0000 front 2024-09-21T06:48:04.960577+0000 (oldest deadline 2024-09-21T06:48:30.860590+0000) 2024-09-21T06:48:35.774 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:35 smithi007 podman[107869]: 2024-09-21 06:48:35.405768146 +0000 UTC m=+0.637326217 container remove 74acc268ebecec2b2df2cb386ac3a82778da7c53e1e385c393b529421e89b4ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, ceph=True) 2024-09-21T06:48:36.090 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:35 smithi007 podman[107957]: 2024-09-21 06:48:35.676107903 +0000 UTC m=+0.016086110 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:48:36.090 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:35 smithi007 podman[107957]: 2024-09-21 06:48:35.811191118 +0000 UTC m=+0.151169367 container create b8ec0490eff6f85c738be0f87429746bf7f69615d79f571a363daa66f08bbaec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9-deactivate, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-21T06:48:36.090 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:35 smithi007 podman[107957]: 2024-09-21 06:48:35.99258485 +0000 UTC m=+0.332563060 container init b8ec0490eff6f85c738be0f87429746bf7f69615d79f571a363daa66f08bbaec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9-deactivate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-21T06:48:36.090 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:35 smithi007 podman[107957]: 2024-09-21 06:48:35.995907695 +0000 UTC m=+0.335885905 container start b8ec0490eff6f85c738be0f87429746bf7f69615d79f571a363daa66f08bbaec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-21T06:48:36.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:35 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:35.955+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.479118+0000 front 2024-09-21T06:47:20.479041+0000 (oldest deadline 2024-09-21T06:47:42.779148+0000) 2024-09-21T06:48:36.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:35 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:35.955+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.680367+0000 front 2024-09-21T06:47:28.680320+0000 (oldest deadline 2024-09-21T06:47:51.580480+0000) 2024-09-21T06:48:36.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:35 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:35.955+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.982225+0000 front 2024-09-21T06:47:37.982324+0000 (oldest deadline 2024-09-21T06:48:01.482191+0000) 2024-09-21T06:48:36.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:35 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:35.955+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:47:43.683853+0000 front 2024-09-21T06:47:43.683837+0000 (oldest deadline 2024-09-21T06:48:08.383662+0000) 2024-09-21T06:48:36.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:35 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:35.955+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-21T06:47:50.684581+0000 front 2024-09-21T06:47:50.684614+0000 (oldest deadline 2024-09-21T06:48:15.984607+0000) 2024-09-21T06:48:36.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:35 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:35.955+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:47:59.485466+0000 front 2024-09-21T06:47:59.485556+0000 (oldest deadline 2024-09-21T06:48:23.585369+0000) 2024-09-21T06:48:36.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:35 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:35.955+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-21T06:48:09.486396+0000 front 2024-09-21T06:48:09.486323+0000 (oldest deadline 2024-09-21T06:48:32.386173+0000) 2024-09-21T06:48:36.488 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:36 smithi007 podman[107957]: 2024-09-21 06:48:36.209126507 +0000 UTC m=+0.549104738 container attach b8ec0490eff6f85c738be0f87429746bf7f69615d79f571a363daa66f08bbaec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731) 2024-09-21T06:48:36.488 INFO:journalctl@ceph.osd.9.smithi007.stdout:Sep 21 06:48:36 smithi007 podman[107957]: 2024-09-21 06:48:36.209665065 +0000 UTC m=+0.549643280 container died b8ec0490eff6f85c738be0f87429746bf7f69615d79f571a363daa66f08bbaec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-9-deactivate, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-21T06:48:36.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:36 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:36.175+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.153182+0000 front 2024-09-21T06:47:20.153132+0000 (oldest deadline 2024-09-21T06:47:43.053177+0000) 2024-09-21T06:48:36.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:36 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:36.175+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.854893+0000 front 2024-09-21T06:47:28.854866+0000 (oldest deadline 2024-09-21T06:47:52.954830+0000) 2024-09-21T06:48:36.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:36 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:36.175+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.656042+0000 front 2024-09-21T06:47:37.656018+0000 (oldest deadline 2024-09-21T06:47:59.856770+0000) 2024-09-21T06:48:36.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:36 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:36.175+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-21T06:47:53.859097+0000 front 2024-09-21T06:47:53.859198+0000 (oldest deadline 2024-09-21T06:48:17.959226+0000) 2024-09-21T06:48:36.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:36 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:36.175+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:47:59.060089+0000 front 2024-09-21T06:47:59.060063+0000 (oldest deadline 2024-09-21T06:48:24.960040+0000) 2024-09-21T06:48:36.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:36 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:36.175+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-21T06:48:04.960715+0000 front 2024-09-21T06:48:04.960577+0000 (oldest deadline 2024-09-21T06:48:30.860590+0000) 2024-09-21T06:48:36.782 DEBUG:teuthology.orchestra.run.smithi007:> sudo pkill -f 'journalctl -f -n 0 -u ceph-347cb918-77e2-11ef-baf5-efdc52797490@osd.9.service' 2024-09-21T06:48:36.824 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:48:36.824 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-21T06:48:36.824 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-21T06:48:36.824 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ceph-347cb918-77e2-11ef-baf5-efdc52797490@osd.10 2024-09-21T06:48:37.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:36 smithi018 systemd[1]: Stopping Ceph osd.10 for 347cb918-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:48:37.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:36 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:36.974+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.479118+0000 front 2024-09-21T06:47:20.479041+0000 (oldest deadline 2024-09-21T06:47:42.779148+0000) 2024-09-21T06:48:37.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:36 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:36.974+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.680367+0000 front 2024-09-21T06:47:28.680320+0000 (oldest deadline 2024-09-21T06:47:51.580480+0000) 2024-09-21T06:48:37.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:36 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:36.974+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.982225+0000 front 2024-09-21T06:47:37.982324+0000 (oldest deadline 2024-09-21T06:48:01.482191+0000) 2024-09-21T06:48:37.119 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:36 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:36.974+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:47:43.683853+0000 front 2024-09-21T06:47:43.683837+0000 (oldest deadline 2024-09-21T06:48:08.383662+0000) 2024-09-21T06:48:37.120 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:36 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:36.974+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-21T06:47:50.684581+0000 front 2024-09-21T06:47:50.684614+0000 (oldest deadline 2024-09-21T06:48:15.984607+0000) 2024-09-21T06:48:37.120 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:36 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:36.974+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:47:59.485466+0000 front 2024-09-21T06:47:59.485556+0000 (oldest deadline 2024-09-21T06:48:23.585369+0000) 2024-09-21T06:48:37.120 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:36 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:36.974+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-21T06:48:09.486396+0000 front 2024-09-21T06:48:09.486323+0000 (oldest deadline 2024-09-21T06:48:32.386173+0000) 2024-09-21T06:48:37.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:37 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:37.212+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.153182+0000 front 2024-09-21T06:47:20.153132+0000 (oldest deadline 2024-09-21T06:47:43.053177+0000) 2024-09-21T06:48:37.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:37 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:37.212+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.854893+0000 front 2024-09-21T06:47:28.854866+0000 (oldest deadline 2024-09-21T06:47:52.954830+0000) 2024-09-21T06:48:37.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:37 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:37.212+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.656042+0000 front 2024-09-21T06:47:37.656018+0000 (oldest deadline 2024-09-21T06:47:59.856770+0000) 2024-09-21T06:48:37.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:37 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:37.212+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-21T06:47:53.859097+0000 front 2024-09-21T06:47:53.859198+0000 (oldest deadline 2024-09-21T06:48:17.959226+0000) 2024-09-21T06:48:37.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:37 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:37.212+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:47:59.060089+0000 front 2024-09-21T06:47:59.060063+0000 (oldest deadline 2024-09-21T06:48:24.960040+0000) 2024-09-21T06:48:37.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:37 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:37.212+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-21T06:48:04.960715+0000 front 2024-09-21T06:48:04.960577+0000 (oldest deadline 2024-09-21T06:48:30.860590+0000) 2024-09-21T06:48:37.619 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:37 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:37.120+0000 7f3d6c749640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:48:37.619 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:37 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:37.120+0000 7f3d6c749640 -1 osd.10 88 *** Got signal Terminated *** 2024-09-21T06:48:37.619 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:37 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:37.120+0000 7f3d6c749640 -1 osd.10 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T06:48:38.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:38 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:38.014+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.479118+0000 front 2024-09-21T06:47:20.479041+0000 (oldest deadline 2024-09-21T06:47:42.779148+0000) 2024-09-21T06:48:38.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:38 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:38.014+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.680367+0000 front 2024-09-21T06:47:28.680320+0000 (oldest deadline 2024-09-21T06:47:51.580480+0000) 2024-09-21T06:48:38.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:38 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:38.014+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.982225+0000 front 2024-09-21T06:47:37.982324+0000 (oldest deadline 2024-09-21T06:48:01.482191+0000) 2024-09-21T06:48:38.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:38 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:38.014+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:47:43.683853+0000 front 2024-09-21T06:47:43.683837+0000 (oldest deadline 2024-09-21T06:48:08.383662+0000) 2024-09-21T06:48:38.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:38 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:38.014+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-21T06:47:50.684581+0000 front 2024-09-21T06:47:50.684614+0000 (oldest deadline 2024-09-21T06:48:15.984607+0000) 2024-09-21T06:48:38.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:38 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:38.014+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:47:59.485466+0000 front 2024-09-21T06:47:59.485556+0000 (oldest deadline 2024-09-21T06:48:23.585369+0000) 2024-09-21T06:48:38.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:38 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:38.014+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-21T06:48:09.486396+0000 front 2024-09-21T06:48:09.486323+0000 (oldest deadline 2024-09-21T06:48:32.386173+0000) 2024-09-21T06:48:38.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:38 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:38.213+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.153182+0000 front 2024-09-21T06:47:20.153132+0000 (oldest deadline 2024-09-21T06:47:43.053177+0000) 2024-09-21T06:48:38.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:38 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:38.213+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.854893+0000 front 2024-09-21T06:47:28.854866+0000 (oldest deadline 2024-09-21T06:47:52.954830+0000) 2024-09-21T06:48:38.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:38 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:38.213+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.656042+0000 front 2024-09-21T06:47:37.656018+0000 (oldest deadline 2024-09-21T06:47:59.856770+0000) 2024-09-21T06:48:38.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:38 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:38.213+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-21T06:47:53.859097+0000 front 2024-09-21T06:47:53.859198+0000 (oldest deadline 2024-09-21T06:48:17.959226+0000) 2024-09-21T06:48:38.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:38 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:38.213+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:47:59.060089+0000 front 2024-09-21T06:47:59.060063+0000 (oldest deadline 2024-09-21T06:48:24.960040+0000) 2024-09-21T06:48:38.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:38 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:38.213+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-21T06:48:04.960715+0000 front 2024-09-21T06:48:04.960577+0000 (oldest deadline 2024-09-21T06:48:30.860590+0000) 2024-09-21T06:48:39.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:38 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:38.997+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.479118+0000 front 2024-09-21T06:47:20.479041+0000 (oldest deadline 2024-09-21T06:47:42.779148+0000) 2024-09-21T06:48:39.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:38 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:38.997+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.680367+0000 front 2024-09-21T06:47:28.680320+0000 (oldest deadline 2024-09-21T06:47:51.580480+0000) 2024-09-21T06:48:39.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:38 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:38.997+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.982225+0000 front 2024-09-21T06:47:37.982324+0000 (oldest deadline 2024-09-21T06:48:01.482191+0000) 2024-09-21T06:48:39.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:38 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:38.997+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:47:43.683853+0000 front 2024-09-21T06:47:43.683837+0000 (oldest deadline 2024-09-21T06:48:08.383662+0000) 2024-09-21T06:48:39.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:38 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:38.997+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-21T06:47:50.684581+0000 front 2024-09-21T06:47:50.684614+0000 (oldest deadline 2024-09-21T06:48:15.984607+0000) 2024-09-21T06:48:39.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:38 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:38.997+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:47:59.485466+0000 front 2024-09-21T06:47:59.485556+0000 (oldest deadline 2024-09-21T06:48:23.585369+0000) 2024-09-21T06:48:39.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:38 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:38.997+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-21T06:48:09.486396+0000 front 2024-09-21T06:48:09.486323+0000 (oldest deadline 2024-09-21T06:48:32.386173+0000) 2024-09-21T06:48:39.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:39 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:39.192+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.153182+0000 front 2024-09-21T06:47:20.153132+0000 (oldest deadline 2024-09-21T06:47:43.053177+0000) 2024-09-21T06:48:39.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:39 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:39.192+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.854893+0000 front 2024-09-21T06:47:28.854866+0000 (oldest deadline 2024-09-21T06:47:52.954830+0000) 2024-09-21T06:48:39.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:39 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:39.192+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.656042+0000 front 2024-09-21T06:47:37.656018+0000 (oldest deadline 2024-09-21T06:47:59.856770+0000) 2024-09-21T06:48:39.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:39 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:39.192+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-21T06:47:53.859097+0000 front 2024-09-21T06:47:53.859198+0000 (oldest deadline 2024-09-21T06:48:17.959226+0000) 2024-09-21T06:48:39.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:39 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:39.192+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:47:59.060089+0000 front 2024-09-21T06:47:59.060063+0000 (oldest deadline 2024-09-21T06:48:24.960040+0000) 2024-09-21T06:48:39.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:39 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:39.192+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-21T06:48:04.960715+0000 front 2024-09-21T06:48:04.960577+0000 (oldest deadline 2024-09-21T06:48:30.860590+0000) 2024-09-21T06:48:40.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:39 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:39.993+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.479118+0000 front 2024-09-21T06:47:20.479041+0000 (oldest deadline 2024-09-21T06:47:42.779148+0000) 2024-09-21T06:48:40.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:39 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:39.993+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.680367+0000 front 2024-09-21T06:47:28.680320+0000 (oldest deadline 2024-09-21T06:47:51.580480+0000) 2024-09-21T06:48:40.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:39 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:39.994+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.982225+0000 front 2024-09-21T06:47:37.982324+0000 (oldest deadline 2024-09-21T06:48:01.482191+0000) 2024-09-21T06:48:40.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:39 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:39.994+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:47:43.683853+0000 front 2024-09-21T06:47:43.683837+0000 (oldest deadline 2024-09-21T06:48:08.383662+0000) 2024-09-21T06:48:40.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:39 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:39.994+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-21T06:47:50.684581+0000 front 2024-09-21T06:47:50.684614+0000 (oldest deadline 2024-09-21T06:48:15.984607+0000) 2024-09-21T06:48:40.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:39 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:39.994+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:47:59.485466+0000 front 2024-09-21T06:47:59.485556+0000 (oldest deadline 2024-09-21T06:48:23.585369+0000) 2024-09-21T06:48:40.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:39 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:39.994+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-21T06:48:09.486396+0000 front 2024-09-21T06:48:09.486323+0000 (oldest deadline 2024-09-21T06:48:32.386173+0000) 2024-09-21T06:48:40.511 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:40 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:40.148+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.153182+0000 front 2024-09-21T06:47:20.153132+0000 (oldest deadline 2024-09-21T06:47:43.053177+0000) 2024-09-21T06:48:40.512 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:40 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:40.148+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.854893+0000 front 2024-09-21T06:47:28.854866+0000 (oldest deadline 2024-09-21T06:47:52.954830+0000) 2024-09-21T06:48:40.512 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:40 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:40.148+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.656042+0000 front 2024-09-21T06:47:37.656018+0000 (oldest deadline 2024-09-21T06:47:59.856770+0000) 2024-09-21T06:48:40.512 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:40 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:40.148+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-21T06:47:53.859097+0000 front 2024-09-21T06:47:53.859198+0000 (oldest deadline 2024-09-21T06:48:17.959226+0000) 2024-09-21T06:48:40.512 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:40 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:40.148+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:47:59.060089+0000 front 2024-09-21T06:47:59.060063+0000 (oldest deadline 2024-09-21T06:48:24.960040+0000) 2024-09-21T06:48:40.512 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:40 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:40.148+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-21T06:48:04.960715+0000 front 2024-09-21T06:48:04.960577+0000 (oldest deadline 2024-09-21T06:48:30.860590+0000) 2024-09-21T06:48:41.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:40 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:40.976+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.479118+0000 front 2024-09-21T06:47:20.479041+0000 (oldest deadline 2024-09-21T06:47:42.779148+0000) 2024-09-21T06:48:41.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:40 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:40.976+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.680367+0000 front 2024-09-21T06:47:28.680320+0000 (oldest deadline 2024-09-21T06:47:51.580480+0000) 2024-09-21T06:48:41.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:40 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:40.976+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.982225+0000 front 2024-09-21T06:47:37.982324+0000 (oldest deadline 2024-09-21T06:48:01.482191+0000) 2024-09-21T06:48:41.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:40 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:40.976+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:47:43.683853+0000 front 2024-09-21T06:47:43.683837+0000 (oldest deadline 2024-09-21T06:48:08.383662+0000) 2024-09-21T06:48:41.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:40 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:40.976+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-21T06:47:50.684581+0000 front 2024-09-21T06:47:50.684614+0000 (oldest deadline 2024-09-21T06:48:15.984607+0000) 2024-09-21T06:48:41.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:40 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:40.976+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:47:59.485466+0000 front 2024-09-21T06:47:59.485556+0000 (oldest deadline 2024-09-21T06:48:23.585369+0000) 2024-09-21T06:48:41.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:40 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:40.976+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-21T06:48:09.486396+0000 front 2024-09-21T06:48:09.486323+0000 (oldest deadline 2024-09-21T06:48:32.386173+0000) 2024-09-21T06:48:41.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:41 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:41.136+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.153182+0000 front 2024-09-21T06:47:20.153132+0000 (oldest deadline 2024-09-21T06:47:43.053177+0000) 2024-09-21T06:48:41.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:41 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:41.136+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.854893+0000 front 2024-09-21T06:47:28.854866+0000 (oldest deadline 2024-09-21T06:47:52.954830+0000) 2024-09-21T06:48:41.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:41 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:41.136+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.656042+0000 front 2024-09-21T06:47:37.656018+0000 (oldest deadline 2024-09-21T06:47:59.856770+0000) 2024-09-21T06:48:41.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:41 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:41.136+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-21T06:47:53.859097+0000 front 2024-09-21T06:47:53.859198+0000 (oldest deadline 2024-09-21T06:48:17.959226+0000) 2024-09-21T06:48:41.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:41 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:41.136+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:47:59.060089+0000 front 2024-09-21T06:47:59.060063+0000 (oldest deadline 2024-09-21T06:48:24.960040+0000) 2024-09-21T06:48:41.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:41 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:41.136+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-21T06:48:04.960715+0000 front 2024-09-21T06:48:04.960577+0000 (oldest deadline 2024-09-21T06:48:30.860590+0000) 2024-09-21T06:48:42.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:41 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:41.976+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.479118+0000 front 2024-09-21T06:47:20.479041+0000 (oldest deadline 2024-09-21T06:47:42.779148+0000) 2024-09-21T06:48:42.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:41 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:41.976+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.680367+0000 front 2024-09-21T06:47:28.680320+0000 (oldest deadline 2024-09-21T06:47:51.580480+0000) 2024-09-21T06:48:42.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:41 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:41.976+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.982225+0000 front 2024-09-21T06:47:37.982324+0000 (oldest deadline 2024-09-21T06:48:01.482191+0000) 2024-09-21T06:48:42.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:41 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:41.976+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6814 osd.3 since back 2024-09-21T06:47:43.683853+0000 front 2024-09-21T06:47:43.683837+0000 (oldest deadline 2024-09-21T06:48:08.383662+0000) 2024-09-21T06:48:42.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:41 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:41.976+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-21T06:47:50.684581+0000 front 2024-09-21T06:47:50.684614+0000 (oldest deadline 2024-09-21T06:48:15.984607+0000) 2024-09-21T06:48:42.370 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:41 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:41.976+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:47:59.485466+0000 front 2024-09-21T06:47:59.485556+0000 (oldest deadline 2024-09-21T06:48:23.585369+0000) 2024-09-21T06:48:42.370 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:41 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10[58477]: 2024-09-21T06:48:41.976+0000 7f3d68d34640 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-21T06:48:09.486396+0000 front 2024-09-21T06:48:09.486323+0000 (oldest deadline 2024-09-21T06:48:32.386173+0000) 2024-09-21T06:48:42.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:42 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:42.141+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.153182+0000 front 2024-09-21T06:47:20.153132+0000 (oldest deadline 2024-09-21T06:47:43.053177+0000) 2024-09-21T06:48:42.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:42 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:42.141+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.854893+0000 front 2024-09-21T06:47:28.854866+0000 (oldest deadline 2024-09-21T06:47:52.954830+0000) 2024-09-21T06:48:42.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:42 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:42.141+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.656042+0000 front 2024-09-21T06:47:37.656018+0000 (oldest deadline 2024-09-21T06:47:59.856770+0000) 2024-09-21T06:48:42.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:42 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:42.141+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-21T06:47:53.859097+0000 front 2024-09-21T06:47:53.859198+0000 (oldest deadline 2024-09-21T06:48:17.959226+0000) 2024-09-21T06:48:42.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:42 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:42.141+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:47:59.060089+0000 front 2024-09-21T06:47:59.060063+0000 (oldest deadline 2024-09-21T06:48:24.960040+0000) 2024-09-21T06:48:42.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:42 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:42.141+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-21T06:48:04.960715+0000 front 2024-09-21T06:48:04.960577+0000 (oldest deadline 2024-09-21T06:48:30.860590+0000) 2024-09-21T06:48:42.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:42 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:42.141+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6820 osd.7 since back 2024-09-21T06:48:16.661950+0000 front 2024-09-21T06:48:16.661848+0000 (oldest deadline 2024-09-21T06:48:41.361807+0000) 2024-09-21T06:48:42.688 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:42 smithi018 podman[67492]: 2024-09-21 06:48:42.485377693 +0000 UTC m=+5.465917692 container died 7227115ebccbb1a369bfc301823115e169ac39545aceaba2893ebeab2a968208 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2) 2024-09-21T06:48:42.982 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:42 smithi018 podman[67492]: 2024-09-21 06:48:42.777884191 +0000 UTC m=+5.758424194 container cleanup 7227115ebccbb1a369bfc301823115e169ac39545aceaba2893ebeab2a968208 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-21T06:48:42.983 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:42 smithi018 bash[67492]: ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10 2024-09-21T06:48:43.369 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:43 smithi018 podman[67507]: 2024-09-21 06:48:43.03759278 +0000 UTC m=+0.545771007 container remove 7227115ebccbb1a369bfc301823115e169ac39545aceaba2893ebeab2a968208 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731) 2024-09-21T06:48:43.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:43 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:43.141+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.153182+0000 front 2024-09-21T06:47:20.153132+0000 (oldest deadline 2024-09-21T06:47:43.053177+0000) 2024-09-21T06:48:43.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:43 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:43.141+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.854893+0000 front 2024-09-21T06:47:28.854866+0000 (oldest deadline 2024-09-21T06:47:52.954830+0000) 2024-09-21T06:48:43.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:43 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:43.141+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.656042+0000 front 2024-09-21T06:47:37.656018+0000 (oldest deadline 2024-09-21T06:47:59.856770+0000) 2024-09-21T06:48:43.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:43 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:43.141+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-21T06:47:53.859097+0000 front 2024-09-21T06:47:53.859198+0000 (oldest deadline 2024-09-21T06:48:17.959226+0000) 2024-09-21T06:48:43.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:43 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:43.141+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:47:59.060089+0000 front 2024-09-21T06:47:59.060063+0000 (oldest deadline 2024-09-21T06:48:24.960040+0000) 2024-09-21T06:48:43.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:43 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:43.141+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-21T06:48:04.960715+0000 front 2024-09-21T06:48:04.960577+0000 (oldest deadline 2024-09-21T06:48:30.860590+0000) 2024-09-21T06:48:43.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:43 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:43.141+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6820 osd.7 since back 2024-09-21T06:48:16.661950+0000 front 2024-09-21T06:48:16.661848+0000 (oldest deadline 2024-09-21T06:48:41.361807+0000) 2024-09-21T06:48:43.649 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:43 smithi018 podman[67595]: 2024-09-21 06:48:43.298930158 +0000 UTC m=+0.015806825 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:48:43.649 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:43 smithi018 podman[67595]: 2024-09-21 06:48:43.413289361 +0000 UTC m=+0.130166016 container create 2845f6df55d4103710989ad829cc1e8493119165b763e043905ac65f9186acad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10-deactivate, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS) 2024-09-21T06:48:43.650 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:43 smithi018 podman[67595]: 2024-09-21 06:48:43.648865678 +0000 UTC m=+0.365742337 container init 2845f6df55d4103710989ad829cc1e8493119165b763e043905ac65f9186acad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10-deactivate, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T06:48:44.077 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:43 smithi018 podman[67595]: 2024-09-21 06:48:43.652383138 +0000 UTC m=+0.369259803 container start 2845f6df55d4103710989ad829cc1e8493119165b763e043905ac65f9186acad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10-deactivate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-21T06:48:44.077 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:43 smithi018 podman[67595]: 2024-09-21 06:48:43.732064915 +0000 UTC m=+0.448941578 container attach 2845f6df55d4103710989ad829cc1e8493119165b763e043905ac65f9186acad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-21T06:48:44.077 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:43 smithi018 podman[67618]: 2024-09-21 06:48:43.869284072 +0000 UTC m=+0.016849598 container died 2845f6df55d4103710989ad829cc1e8493119165b763e043905ac65f9186acad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-21T06:48:44.330 INFO:journalctl@ceph.osd.10.smithi018.stdout:Sep 21 06:48:44 smithi018 podman[67618]: 2024-09-21 06:48:44.318648772 +0000 UTC m=+0.466214280 container remove 2845f6df55d4103710989ad829cc1e8493119165b763e043905ac65f9186acad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-10-deactivate, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True) 2024-09-21T06:48:44.336 DEBUG:teuthology.orchestra.run.smithi018:> sudo pkill -f 'journalctl -f -n 0 -u ceph-347cb918-77e2-11ef-baf5-efdc52797490@osd.10.service' 2024-09-21T06:48:44.375 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:48:44.375 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-21T06:48:44.375 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-21T06:48:44.375 DEBUG:teuthology.orchestra.run.smithi144:> sudo systemctl stop ceph-347cb918-77e2-11ef-baf5-efdc52797490@osd.11 2024-09-21T06:48:44.427 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:44 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:44.170+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.153182+0000 front 2024-09-21T06:47:20.153132+0000 (oldest deadline 2024-09-21T06:47:43.053177+0000) 2024-09-21T06:48:44.427 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:44 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:44.170+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.854893+0000 front 2024-09-21T06:47:28.854866+0000 (oldest deadline 2024-09-21T06:47:52.954830+0000) 2024-09-21T06:48:44.427 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:44 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:44.170+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.656042+0000 front 2024-09-21T06:47:37.656018+0000 (oldest deadline 2024-09-21T06:47:59.856770+0000) 2024-09-21T06:48:44.427 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:44 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:44.170+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-21T06:47:53.859097+0000 front 2024-09-21T06:47:53.859198+0000 (oldest deadline 2024-09-21T06:48:17.959226+0000) 2024-09-21T06:48:44.427 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:44 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:44.170+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:47:59.060089+0000 front 2024-09-21T06:47:59.060063+0000 (oldest deadline 2024-09-21T06:48:24.960040+0000) 2024-09-21T06:48:44.427 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:44 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:44.170+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-21T06:48:04.960715+0000 front 2024-09-21T06:48:04.960577+0000 (oldest deadline 2024-09-21T06:48:30.860590+0000) 2024-09-21T06:48:44.427 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:44 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:44.170+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6820 osd.7 since back 2024-09-21T06:48:16.661950+0000 front 2024-09-21T06:48:16.661848+0000 (oldest deadline 2024-09-21T06:48:41.361807+0000) 2024-09-21T06:48:44.685 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:44 smithi144 systemd[1]: Stopping Ceph osd.11 for 347cb918-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:48:45.035 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:44 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:44.683+0000 7fc4a81d7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:48:45.035 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:44 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:44.683+0000 7fc4a81d7640 -1 osd.11 88 *** Got signal Terminated *** 2024-09-21T06:48:45.035 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:44 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:44.683+0000 7fc4a81d7640 -1 osd.11 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T06:48:45.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:45 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:45.152+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.153182+0000 front 2024-09-21T06:47:20.153132+0000 (oldest deadline 2024-09-21T06:47:43.053177+0000) 2024-09-21T06:48:45.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:45 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:45.152+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.854893+0000 front 2024-09-21T06:47:28.854866+0000 (oldest deadline 2024-09-21T06:47:52.954830+0000) 2024-09-21T06:48:45.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:45 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:45.152+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.656042+0000 front 2024-09-21T06:47:37.656018+0000 (oldest deadline 2024-09-21T06:47:59.856770+0000) 2024-09-21T06:48:45.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:45 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:45.152+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-21T06:47:53.859097+0000 front 2024-09-21T06:47:53.859198+0000 (oldest deadline 2024-09-21T06:48:17.959226+0000) 2024-09-21T06:48:45.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:45 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:45.152+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:47:59.060089+0000 front 2024-09-21T06:47:59.060063+0000 (oldest deadline 2024-09-21T06:48:24.960040+0000) 2024-09-21T06:48:45.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:45 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:45.152+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-21T06:48:04.960715+0000 front 2024-09-21T06:48:04.960577+0000 (oldest deadline 2024-09-21T06:48:30.860590+0000) 2024-09-21T06:48:45.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:45 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:45.152+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6820 osd.7 since back 2024-09-21T06:48:16.661950+0000 front 2024-09-21T06:48:16.661848+0000 (oldest deadline 2024-09-21T06:48:41.361807+0000) 2024-09-21T06:48:46.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:46 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:46.169+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.153182+0000 front 2024-09-21T06:47:20.153132+0000 (oldest deadline 2024-09-21T06:47:43.053177+0000) 2024-09-21T06:48:46.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:46 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:46.169+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.854893+0000 front 2024-09-21T06:47:28.854866+0000 (oldest deadline 2024-09-21T06:47:52.954830+0000) 2024-09-21T06:48:46.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:46 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:46.169+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.656042+0000 front 2024-09-21T06:47:37.656018+0000 (oldest deadline 2024-09-21T06:47:59.856770+0000) 2024-09-21T06:48:46.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:46 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:46.169+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-21T06:47:53.859097+0000 front 2024-09-21T06:47:53.859198+0000 (oldest deadline 2024-09-21T06:48:17.959226+0000) 2024-09-21T06:48:46.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:46 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:46.169+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:47:59.060089+0000 front 2024-09-21T06:47:59.060063+0000 (oldest deadline 2024-09-21T06:48:24.960040+0000) 2024-09-21T06:48:46.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:46 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:46.169+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-21T06:48:04.960715+0000 front 2024-09-21T06:48:04.960577+0000 (oldest deadline 2024-09-21T06:48:30.860590+0000) 2024-09-21T06:48:46.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:46 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:46.169+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6820 osd.7 since back 2024-09-21T06:48:16.661950+0000 front 2024-09-21T06:48:16.661848+0000 (oldest deadline 2024-09-21T06:48:41.361807+0000) 2024-09-21T06:48:47.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:47 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:47.207+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.153182+0000 front 2024-09-21T06:47:20.153132+0000 (oldest deadline 2024-09-21T06:47:43.053177+0000) 2024-09-21T06:48:47.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:47 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:47.207+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.854893+0000 front 2024-09-21T06:47:28.854866+0000 (oldest deadline 2024-09-21T06:47:52.954830+0000) 2024-09-21T06:48:47.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:47 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:47.207+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.656042+0000 front 2024-09-21T06:47:37.656018+0000 (oldest deadline 2024-09-21T06:47:59.856770+0000) 2024-09-21T06:48:47.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:47 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:47.207+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-21T06:47:53.859097+0000 front 2024-09-21T06:47:53.859198+0000 (oldest deadline 2024-09-21T06:48:17.959226+0000) 2024-09-21T06:48:47.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:47 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:47.207+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:47:59.060089+0000 front 2024-09-21T06:47:59.060063+0000 (oldest deadline 2024-09-21T06:48:24.960040+0000) 2024-09-21T06:48:47.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:47 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:47.207+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-21T06:48:04.960715+0000 front 2024-09-21T06:48:04.960577+0000 (oldest deadline 2024-09-21T06:48:30.860590+0000) 2024-09-21T06:48:47.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:47 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:47.207+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6820 osd.7 since back 2024-09-21T06:48:16.661950+0000 front 2024-09-21T06:48:16.661848+0000 (oldest deadline 2024-09-21T06:48:41.361807+0000) 2024-09-21T06:48:48.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:48 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:48.244+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.153182+0000 front 2024-09-21T06:47:20.153132+0000 (oldest deadline 2024-09-21T06:47:43.053177+0000) 2024-09-21T06:48:48.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:48 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:48.244+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.854893+0000 front 2024-09-21T06:47:28.854866+0000 (oldest deadline 2024-09-21T06:47:52.954830+0000) 2024-09-21T06:48:48.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:48 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:48.244+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.656042+0000 front 2024-09-21T06:47:37.656018+0000 (oldest deadline 2024-09-21T06:47:59.856770+0000) 2024-09-21T06:48:48.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:48 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:48.244+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-21T06:47:53.859097+0000 front 2024-09-21T06:47:53.859198+0000 (oldest deadline 2024-09-21T06:48:17.959226+0000) 2024-09-21T06:48:48.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:48 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:48.244+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:47:59.060089+0000 front 2024-09-21T06:47:59.060063+0000 (oldest deadline 2024-09-21T06:48:24.960040+0000) 2024-09-21T06:48:48.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:48 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:48.244+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-21T06:48:04.960715+0000 front 2024-09-21T06:48:04.960577+0000 (oldest deadline 2024-09-21T06:48:30.860590+0000) 2024-09-21T06:48:48.536 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:48 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:48.244+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6820 osd.7 since back 2024-09-21T06:48:16.661950+0000 front 2024-09-21T06:48:16.661848+0000 (oldest deadline 2024-09-21T06:48:41.361807+0000) 2024-09-21T06:48:49.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:49 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:49.231+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6806 osd.0 since back 2024-09-21T06:47:20.153182+0000 front 2024-09-21T06:47:20.153132+0000 (oldest deadline 2024-09-21T06:47:43.053177+0000) 2024-09-21T06:48:49.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:49 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:49.231+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6804 osd.1 since back 2024-09-21T06:47:28.854893+0000 front 2024-09-21T06:47:28.854866+0000 (oldest deadline 2024-09-21T06:47:52.954830+0000) 2024-09-21T06:48:49.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:49 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:49.231+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6804 osd.2 since back 2024-09-21T06:47:37.656042+0000 front 2024-09-21T06:47:37.656018+0000 (oldest deadline 2024-09-21T06:47:59.856770+0000) 2024-09-21T06:48:49.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:49 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:49.231+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6812 osd.4 since back 2024-09-21T06:47:53.859097+0000 front 2024-09-21T06:47:53.859198+0000 (oldest deadline 2024-09-21T06:48:17.959226+0000) 2024-09-21T06:48:49.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:49 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:49.231+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.144:6812 osd.5 since back 2024-09-21T06:47:59.060089+0000 front 2024-09-21T06:47:59.060063+0000 (oldest deadline 2024-09-21T06:48:24.960040+0000) 2024-09-21T06:48:49.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:49 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:49.231+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.7:6822 osd.6 since back 2024-09-21T06:48:04.960715+0000 front 2024-09-21T06:48:04.960577+0000 (oldest deadline 2024-09-21T06:48:30.860590+0000) 2024-09-21T06:48:49.535 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:49 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11[59062]: 2024-09-21T06:48:49.231+0000 7fc4a47c2640 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.18:6820 osd.7 since back 2024-09-21T06:48:16.661950+0000 front 2024-09-21T06:48:16.661848+0000 (oldest deadline 2024-09-21T06:48:41.361807+0000) 2024-09-21T06:48:50.285 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:50 smithi144 podman[68551]: 2024-09-21 06:48:50.055078007 +0000 UTC m=+5.482810804 container died ce808055bfbef2ea68ed91447998c9ceda5c42a4692fb77c86034e8f7adcf8a2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-21T06:48:50.577 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:50 smithi144 podman[68551]: 2024-09-21 06:48:50.416926625 +0000 UTC m=+5.844659463 container cleanup ce808055bfbef2ea68ed91447998c9ceda5c42a4692fb77c86034e8f7adcf8a2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-21T06:48:50.578 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:50 smithi144 bash[68551]: ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11 2024-09-21T06:48:51.026 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:50 smithi144 podman[68568]: 2024-09-21 06:48:50.718436721 +0000 UTC m=+0.659004433 container remove ce808055bfbef2ea68ed91447998c9ceda5c42a4692fb77c86034e8f7adcf8a2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2) 2024-09-21T06:48:51.285 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:51 smithi144 podman[68657]: 2024-09-21 06:48:50.928712706 +0000 UTC m=+0.016021340 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T06:48:51.285 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:51 smithi144 podman[68657]: 2024-09-21 06:48:51.027427171 +0000 UTC m=+0.114735806 container create a02c4261d8f2535d54a319402ccc222b3829c654e654b08bd8d329d42b272e74 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11-deactivate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-21T06:48:51.785 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:51 smithi144 podman[68657]: 2024-09-21 06:48:51.346565842 +0000 UTC m=+0.433874473 container init a02c4261d8f2535d54a319402ccc222b3829c654e654b08bd8d329d42b272e74 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:48:51.785 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:51 smithi144 podman[68657]: 2024-09-21 06:48:51.349852284 +0000 UTC m=+0.437160917 container start a02c4261d8f2535d54a319402ccc222b3829c654e654b08bd8d329d42b272e74 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-21T06:48:51.785 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:51 smithi144 podman[68657]: 2024-09-21 06:48:51.429879503 +0000 UTC m=+0.517188150 container attach a02c4261d8f2535d54a319402ccc222b3829c654e654b08bd8d329d42b272e74 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-21T06:48:51.785 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:51 smithi144 podman[68657]: 2024-09-21 06:48:51.53656058 +0000 UTC m=+0.623869225 container died a02c4261d8f2535d54a319402ccc222b3829c654e654b08bd8d329d42b272e74 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-21T06:48:52.071 INFO:journalctl@ceph.osd.11.smithi144.stdout:Sep 21 06:48:52 smithi144 podman[68680]: 2024-09-21 06:48:52.049428955 +0000 UTC m=+0.506715111 container remove a02c4261d8f2535d54a319402ccc222b3829c654e654b08bd8d329d42b272e74 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-osd-11-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0) 2024-09-21T06:48:52.076 DEBUG:teuthology.orchestra.run.smithi144:> sudo pkill -f 'journalctl -f -n 0 -u ceph-347cb918-77e2-11ef-baf5-efdc52797490@osd.11.service' 2024-09-21T06:48:52.115 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:48:52.115 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-21T06:48:52.115 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-21T06:48:52.116 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ceph-347cb918-77e2-11ef-baf5-efdc52797490@mds.a 2024-09-21T06:48:52.407 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 21 06:48:52 smithi007 systemd[1]: Stopping Ceph mds.a for 347cb918-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:48:52.672 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 21 06:48:52 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-a[73099]: 2024-09-21T06:48:52.430+0000 7f067ed71640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:48:52.673 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 21 06:48:52 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-a[73099]: 2024-09-21T06:48:52.430+0000 7f067ed71640 -1 mds.a *** got signal Terminated *** 2024-09-21T06:48:56.090 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 21 06:48:55 smithi007 podman[108058]: 2024-09-21 06:48:55.822121684 +0000 UTC m=+3.506818590 container died 5fb8c4bc6f7c75fa773249a9ef7b67fa098a71ad1982e6ee9241b5e0e63eb8c6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-a, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:48:56.590 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 21 06:48:56 smithi007 podman[108058]: 2024-09-21 06:48:56.230641962 +0000 UTC m=+3.915338854 container cleanup 5fb8c4bc6f7c75fa773249a9ef7b67fa098a71ad1982e6ee9241b5e0e63eb8c6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-a, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:48:56.590 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 21 06:48:56 smithi007 bash[108058]: ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-a 2024-09-21T06:48:56.889 INFO:journalctl@ceph.mds.a.smithi007.stdout:Sep 21 06:48:56 smithi007 podman[108083]: 2024-09-21 06:48:56.615446956 +0000 UTC m=+0.788484817 container remove 5fb8c4bc6f7c75fa773249a9ef7b67fa098a71ad1982e6ee9241b5e0e63eb8c6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-a, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T06:48:56.962 DEBUG:teuthology.orchestra.run.smithi007:> sudo pkill -f 'journalctl -f -n 0 -u ceph-347cb918-77e2-11ef-baf5-efdc52797490@mds.a.service' 2024-09-21T06:48:57.000 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:48:57.001 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-21T06:48:57.001 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-21T06:48:57.001 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ceph-347cb918-77e2-11ef-baf5-efdc52797490@mds.d 2024-09-21T06:48:57.328 INFO:journalctl@ceph.mds.d.smithi007.stdout:Sep 21 06:48:57 smithi007 systemd[1]: Stopping Ceph mds.d for 347cb918-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:48:57.589 INFO:journalctl@ceph.mds.d.smithi007.stdout:Sep 21 06:48:57 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-d[71982]: 2024-09-21T06:48:57.325+0000 7fc2ecc86640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:48:57.590 INFO:journalctl@ceph.mds.d.smithi007.stdout:Sep 21 06:48:57 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-d[71982]: 2024-09-21T06:48:57.325+0000 7fc2ecc86640 -1 mds.d *** got signal Terminated *** 2024-09-21T06:49:00.861 INFO:journalctl@ceph.mds.d.smithi007.stdout:Sep 21 06:49:00 smithi007 podman[108189]: 2024-09-21 06:49:00.592763145 +0000 UTC m=+3.367825850 container died 6cc42bc4bf22a49d810fdc0154401ec9229bf7c5b4c016cb5ecee3dba09434bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-d, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:49:01.295 INFO:journalctl@ceph.mds.d.smithi007.stdout:Sep 21 06:49:01 smithi007 podman[108189]: 2024-09-21 06:49:01.034343106 +0000 UTC m=+3.809405803 container cleanup 6cc42bc4bf22a49d810fdc0154401ec9229bf7c5b4c016cb5ecee3dba09434bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-d, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True) 2024-09-21T06:49:01.295 INFO:journalctl@ceph.mds.d.smithi007.stdout:Sep 21 06:49:01 smithi007 bash[108189]: ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-d 2024-09-21T06:49:01.526 DEBUG:teuthology.orchestra.run.smithi007:> sudo pkill -f 'journalctl -f -n 0 -u ceph-347cb918-77e2-11ef-baf5-efdc52797490@mds.d.service' 2024-09-21T06:49:01.551 INFO:journalctl@ceph.mds.d.smithi007.stdout:Sep 21 06:49:01 smithi007 podman[108201]: 2024-09-21 06:49:01.294776637 +0000 UTC m=+0.699443484 container remove 6cc42bc4bf22a49d810fdc0154401ec9229bf7c5b4c016cb5ecee3dba09434bd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-d, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-21T06:49:01.551 INFO:journalctl@ceph.mds.d.smithi007.stdout:Sep 21 06:49:01 smithi007 systemd[1]: ceph-347cb918-77e2-11ef-baf5-efdc52797490@mds.d.service: Deactivated successfully. 2024-09-21T06:49:01.551 INFO:journalctl@ceph.mds.d.smithi007.stdout:Sep 21 06:49:01 smithi007 systemd[1]: Stopped Ceph mds.d for 347cb918-77e2-11ef-baf5-efdc52797490. 2024-09-21T06:49:01.552 INFO:journalctl@ceph.mds.d.smithi007.stdout:Sep 21 06:49:01 smithi007 systemd[1]: ceph-347cb918-77e2-11ef-baf5-efdc52797490@mds.d.service: Consumed 1.084s CPU time. 2024-09-21T06:49:01.563 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:49:01.563 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-21T06:49:01.563 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-21T06:49:01.563 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ceph-347cb918-77e2-11ef-baf5-efdc52797490@mds.g 2024-09-21T06:49:01.840 INFO:journalctl@ceph.mds.g.smithi007.stdout:Sep 21 06:49:01 smithi007 systemd[1]: Stopping Ceph mds.g for 347cb918-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:49:02.339 INFO:journalctl@ceph.mds.g.smithi007.stdout:Sep 21 06:49:01 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-g[72737]: 2024-09-21T06:49:01.880+0000 7f37bde04640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:49:02.340 INFO:journalctl@ceph.mds.g.smithi007.stdout:Sep 21 06:49:01 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-g[72737]: 2024-09-21T06:49:01.880+0000 7f37bde04640 -1 mds.g *** got signal Terminated *** 2024-09-21T06:49:04.782 INFO:journalctl@ceph.mds.g.smithi007.stdout:Sep 21 06:49:04 smithi007 podman[108312]: 2024-09-21 06:49:04.383664874 +0000 UTC m=+2.603058898 container died edf98fb6a6ec235c73f6afde16ba2a82d83916d3a7e980674643bf155a1e247d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-g, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:49:04.782 INFO:journalctl@ceph.mds.g.smithi007.stdout:Sep 21 06:49:04 smithi007 podman[108312]: 2024-09-21 06:49:04.781004676 +0000 UTC m=+3.000398700 container cleanup edf98fb6a6ec235c73f6afde16ba2a82d83916d3a7e980674643bf155a1e247d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-g, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:49:05.089 INFO:journalctl@ceph.mds.g.smithi007.stdout:Sep 21 06:49:04 smithi007 bash[108312]: ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-g 2024-09-21T06:49:05.090 INFO:journalctl@ceph.mds.g.smithi007.stdout:Sep 21 06:49:05 smithi007 podman[108324]: 2024-09-21 06:49:05.015929364 +0000 UTC m=+0.622501928 container remove edf98fb6a6ec235c73f6afde16ba2a82d83916d3a7e980674643bf155a1e247d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-g, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-21T06:49:05.173 DEBUG:teuthology.orchestra.run.smithi007:> sudo pkill -f 'journalctl -f -n 0 -u ceph-347cb918-77e2-11ef-baf5-efdc52797490@mds.g.service' 2024-09-21T06:49:05.206 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:49:05.207 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-21T06:49:05.207 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-21T06:49:05.207 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ceph-347cb918-77e2-11ef-baf5-efdc52797490@mds.j 2024-09-21T06:49:05.519 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 21 06:49:05 smithi007 systemd[1]: Stopping Ceph mds.j for 347cb918-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:49:05.839 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 21 06:49:05 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-j[71616]: 2024-09-21T06:49:05.517+0000 7f08a3a8f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:49:05.840 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 21 06:49:05 smithi007 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-j[71616]: 2024-09-21T06:49:05.517+0000 7f08a3a8f640 -1 mds.j *** got signal Terminated *** 2024-09-21T06:49:09.340 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 21 06:49:08 smithi007 podman[108433]: 2024-09-21 06:49:08.847771538 +0000 UTC m=+3.422361839 container died 03424d6687b67a6ecfd31436512328cf89726b833d726080b5dc9e2b51a0c3da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-j, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True) 2024-09-21T06:49:09.713 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 21 06:49:09 smithi007 podman[108433]: 2024-09-21 06:49:09.368292075 +0000 UTC m=+3.942882418 container cleanup 03424d6687b67a6ecfd31436512328cf89726b833d726080b5dc9e2b51a0c3da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-j, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2) 2024-09-21T06:49:09.713 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 21 06:49:09 smithi007 bash[108433]: ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-j 2024-09-21T06:49:09.713 INFO:journalctl@ceph.mds.j.smithi007.stdout:Sep 21 06:49:09 smithi007 podman[108446]: 2024-09-21 06:49:09.519535526 +0000 UTC m=+0.664902999 container remove 03424d6687b67a6ecfd31436512328cf89726b833d726080b5dc9e2b51a0c3da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-j, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=) 2024-09-21T06:49:09.738 DEBUG:teuthology.orchestra.run.smithi007:> sudo pkill -f 'journalctl -f -n 0 -u ceph-347cb918-77e2-11ef-baf5-efdc52797490@mds.j.service' 2024-09-21T06:49:09.771 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:49:09.771 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-21T06:49:09.771 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-21T06:49:09.771 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ceph-347cb918-77e2-11ef-baf5-efdc52797490@mds.b 2024-09-21T06:49:10.087 INFO:journalctl@ceph.mds.b.smithi018.stdout:Sep 21 06:49:09 smithi018 systemd[1]: Stopping Ceph mds.b for 347cb918-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:49:10.369 INFO:journalctl@ceph.mds.b.smithi018.stdout:Sep 21 06:49:10 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-b[63345]: 2024-09-21T06:49:10.084+0000 7fbcc181e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:49:10.369 INFO:journalctl@ceph.mds.b.smithi018.stdout:Sep 21 06:49:10 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-b[63345]: 2024-09-21T06:49:10.084+0000 7fbcc181e640 -1 mds.b *** got signal Terminated *** 2024-09-21T06:49:14.169 INFO:journalctl@ceph.mds.b.smithi018.stdout:Sep 21 06:49:13 smithi018 podman[67697]: 2024-09-21 06:49:13.875535421 +0000 UTC m=+3.904071204 container died 3e5a1fe678c9785df320f37835685f4377cda6a21561883b46c3045f7b65bb4e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-b, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:49:14.511 INFO:journalctl@ceph.mds.b.smithi018.stdout:Sep 21 06:49:14 smithi018 podman[67697]: 2024-09-21 06:49:14.276469056 +0000 UTC m=+4.305004841 container cleanup 3e5a1fe678c9785df320f37835685f4377cda6a21561883b46c3045f7b65bb4e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-b, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-21T06:49:14.511 INFO:journalctl@ceph.mds.b.smithi018.stdout:Sep 21 06:49:14 smithi018 bash[67697]: ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-b 2024-09-21T06:49:14.669 DEBUG:teuthology.orchestra.run.smithi018:> sudo pkill -f 'journalctl -f -n 0 -u ceph-347cb918-77e2-11ef-baf5-efdc52797490@mds.b.service' 2024-09-21T06:49:14.705 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:49:14.705 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-21T06:49:14.706 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-21T06:49:14.706 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ceph-347cb918-77e2-11ef-baf5-efdc52797490@mds.e 2024-09-21T06:49:15.023 INFO:journalctl@ceph.mds.e.smithi018.stdout:Sep 21 06:49:14 smithi018 systemd[1]: Stopping Ceph mds.e for 347cb918-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:49:15.369 INFO:journalctl@ceph.mds.e.smithi018.stdout:Sep 21 06:49:15 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-e[62805]: 2024-09-21T06:49:15.020+0000 7f96d341c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:49:15.369 INFO:journalctl@ceph.mds.e.smithi018.stdout:Sep 21 06:49:15 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-e[62805]: 2024-09-21T06:49:15.020+0000 7f96d341c640 -1 mds.e *** got signal Terminated *** 2024-09-21T06:49:18.156 INFO:journalctl@ceph.mds.e.smithi018.stdout:Sep 21 06:49:17 smithi018 podman[67830]: 2024-09-21 06:49:17.901862487 +0000 UTC m=+2.974101369 container died aa9eeb36ea325739646f6a56742add88423b7fefdc28941eb45f0a715aef7f99 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-e, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T06:49:18.440 INFO:journalctl@ceph.mds.e.smithi018.stdout:Sep 21 06:49:18 smithi018 podman[67830]: 2024-09-21 06:49:18.237897991 +0000 UTC m=+3.310136869 container cleanup aa9eeb36ea325739646f6a56742add88423b7fefdc28941eb45f0a715aef7f99 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-e, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True) 2024-09-21T06:49:18.440 INFO:journalctl@ceph.mds.e.smithi018.stdout:Sep 21 06:49:18 smithi018 bash[67830]: ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-e 2024-09-21T06:49:18.683 DEBUG:teuthology.orchestra.run.smithi018:> sudo pkill -f 'journalctl -f -n 0 -u ceph-347cb918-77e2-11ef-baf5-efdc52797490@mds.e.service' 2024-09-21T06:49:18.704 INFO:journalctl@ceph.mds.e.smithi018.stdout:Sep 21 06:49:18 smithi018 podman[67842]: 2024-09-21 06:49:18.439112905 +0000 UTC m=+0.533358204 container remove aa9eeb36ea325739646f6a56742add88423b7fefdc28941eb45f0a715aef7f99 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-e, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-21T06:49:18.705 INFO:journalctl@ceph.mds.e.smithi018.stdout:Sep 21 06:49:18 smithi018 systemd[1]: ceph-347cb918-77e2-11ef-baf5-efdc52797490@mds.e.service: Deactivated successfully. 2024-09-21T06:49:18.705 INFO:journalctl@ceph.mds.e.smithi018.stdout:Sep 21 06:49:18 smithi018 systemd[1]: Stopped Ceph mds.e for 347cb918-77e2-11ef-baf5-efdc52797490. 2024-09-21T06:49:18.705 INFO:journalctl@ceph.mds.e.smithi018.stdout:Sep 21 06:49:18 smithi018 systemd[1]: ceph-347cb918-77e2-11ef-baf5-efdc52797490@mds.e.service: Consumed 2.340s CPU time. 2024-09-21T06:49:18.716 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:49:18.716 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-21T06:49:18.716 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-21T06:49:18.716 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ceph-347cb918-77e2-11ef-baf5-efdc52797490@mds.h 2024-09-21T06:49:19.034 INFO:journalctl@ceph.mds.h.smithi018.stdout:Sep 21 06:49:18 smithi018 systemd[1]: Stopping Ceph mds.h for 347cb918-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:49:19.369 INFO:journalctl@ceph.mds.h.smithi018.stdout:Sep 21 06:49:19 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-h[63079]: 2024-09-21T06:49:19.032+0000 7fa47ea5d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:49:19.369 INFO:journalctl@ceph.mds.h.smithi018.stdout:Sep 21 06:49:19 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-h[63079]: 2024-09-21T06:49:19.032+0000 7fa47ea5d640 -1 mds.h *** got signal Terminated *** 2024-09-21T06:49:22.185 INFO:journalctl@ceph.mds.h.smithi018.stdout:Sep 21 06:49:21 smithi018 podman[67951]: 2024-09-21 06:49:21.906290664 +0000 UTC m=+2.975487568 container died 44ffd7432ba8335517b802797696a5215ffee011034cd90d5a65838456492cd0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-h, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2) 2024-09-21T06:49:22.527 INFO:journalctl@ceph.mds.h.smithi018.stdout:Sep 21 06:49:22 smithi018 podman[67951]: 2024-09-21 06:49:22.274775636 +0000 UTC m=+3.343972548 container cleanup 44ffd7432ba8335517b802797696a5215ffee011034cd90d5a65838456492cd0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-h, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-21T06:49:22.527 INFO:journalctl@ceph.mds.h.smithi018.stdout:Sep 21 06:49:22 smithi018 bash[67951]: ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-h 2024-09-21T06:49:22.715 DEBUG:teuthology.orchestra.run.smithi018:> sudo pkill -f 'journalctl -f -n 0 -u ceph-347cb918-77e2-11ef-baf5-efdc52797490@mds.h.service' 2024-09-21T06:49:22.747 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:49:22.747 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-21T06:49:22.747 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-21T06:49:22.747 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ceph-347cb918-77e2-11ef-baf5-efdc52797490@mds.k 2024-09-21T06:49:23.063 INFO:journalctl@ceph.mds.k.smithi018.stdout:Sep 21 06:49:22 smithi018 systemd[1]: Stopping Ceph mds.k for 347cb918-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:49:23.369 INFO:journalctl@ceph.mds.k.smithi018.stdout:Sep 21 06:49:23 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-k[62522]: 2024-09-21T06:49:23.061+0000 7fc9e2ea2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:49:23.369 INFO:journalctl@ceph.mds.k.smithi018.stdout:Sep 21 06:49:23 smithi018 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-k[62522]: 2024-09-21T06:49:23.061+0000 7fc9e2ea2640 -1 mds.k *** got signal Terminated *** 2024-09-21T06:49:25.896 INFO:journalctl@ceph.mds.k.smithi018.stdout:Sep 21 06:49:25 smithi018 podman[68075]: 2024-09-21 06:49:25.628729337 +0000 UTC m=+2.663970999 container died 7795c07c94a025b61666446b90f159e420cc4c7dec207eb2032a2c08b6b4a593 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-k, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:49:26.263 INFO:journalctl@ceph.mds.k.smithi018.stdout:Sep 21 06:49:25 smithi018 podman[68075]: 2024-09-21 06:49:25.995072076 +0000 UTC m=+3.030313736 container cleanup 7795c07c94a025b61666446b90f159e420cc4c7dec207eb2032a2c08b6b4a593 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-k, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-21T06:49:26.264 INFO:journalctl@ceph.mds.k.smithi018.stdout:Sep 21 06:49:25 smithi018 bash[68075]: ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-k 2024-09-21T06:49:26.425 DEBUG:teuthology.orchestra.run.smithi018:> sudo pkill -f 'journalctl -f -n 0 -u ceph-347cb918-77e2-11ef-baf5-efdc52797490@mds.k.service' 2024-09-21T06:49:26.456 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:49:26.456 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-21T06:49:26.456 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-21T06:49:26.456 DEBUG:teuthology.orchestra.run.smithi144:> sudo systemctl stop ceph-347cb918-77e2-11ef-baf5-efdc52797490@mds.c 2024-09-21T06:49:26.734 INFO:journalctl@ceph.mds.c.smithi144.stdout:Sep 21 06:49:26 smithi144 systemd[1]: Stopping Ceph mds.c for 347cb918-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:49:26.734 INFO:journalctl@ceph.mds.c.smithi144.stdout:Sep 21 06:49:26 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-c[64051]: 2024-09-21T06:49:26.730+0000 7fd2b308d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:49:26.734 INFO:journalctl@ceph.mds.c.smithi144.stdout:Sep 21 06:49:26 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-c[64051]: 2024-09-21T06:49:26.730+0000 7fd2b308d640 -1 mds.c *** got signal Terminated *** 2024-09-21T06:49:30.225 INFO:journalctl@ceph.mds.c.smithi144.stdout:Sep 21 06:49:29 smithi144 podman[68761]: 2024-09-21 06:49:29.892467937 +0000 UTC m=+3.241521263 container died d7d0d7dcfb66c3236f70f64e8cd4f8cb34bda6482b004a6f22c992f623cafddc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-c, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T06:49:30.533 INFO:journalctl@ceph.mds.c.smithi144.stdout:Sep 21 06:49:30 smithi144 podman[68761]: 2024-09-21 06:49:30.306091915 +0000 UTC m=+3.655145197 container cleanup d7d0d7dcfb66c3236f70f64e8cd4f8cb34bda6482b004a6f22c992f623cafddc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-c, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-21T06:49:30.533 INFO:journalctl@ceph.mds.c.smithi144.stdout:Sep 21 06:49:30 smithi144 bash[68761]: ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-c 2024-09-21T06:49:30.669 DEBUG:teuthology.orchestra.run.smithi144:> sudo pkill -f 'journalctl -f -n 0 -u ceph-347cb918-77e2-11ef-baf5-efdc52797490@mds.c.service' 2024-09-21T06:49:30.705 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:49:30.706 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-21T06:49:30.706 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-21T06:49:30.706 DEBUG:teuthology.orchestra.run.smithi144:> sudo systemctl stop ceph-347cb918-77e2-11ef-baf5-efdc52797490@mds.f 2024-09-21T06:49:31.285 INFO:journalctl@ceph.mds.f.smithi144.stdout:Sep 21 06:49:30 smithi144 systemd[1]: Stopping Ceph mds.f for 347cb918-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:49:31.285 INFO:journalctl@ceph.mds.f.smithi144.stdout:Sep 21 06:49:31 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-f[63784]: 2024-09-21T06:49:31.016+0000 7f9c011be640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:49:31.285 INFO:journalctl@ceph.mds.f.smithi144.stdout:Sep 21 06:49:31 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-f[63784]: 2024-09-21T06:49:31.016+0000 7f9c011be640 -1 mds.f *** got signal Terminated *** 2024-09-21T06:49:34.177 INFO:journalctl@ceph.mds.f.smithi144.stdout:Sep 21 06:49:33 smithi144 podman[68894]: 2024-09-21 06:49:33.883604688 +0000 UTC m=+2.963055522 container died c116017ced5b380085612bc41d3b62c833da89969cf458655e979977573926d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-f, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-21T06:49:34.177 INFO:journalctl@ceph.mds.f.smithi144.stdout:Sep 21 06:49:34 smithi144 podman[68894]: 2024-09-21 06:49:34.176264385 +0000 UTC m=+3.255715262 container cleanup c116017ced5b380085612bc41d3b62c833da89969cf458655e979977573926d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-f, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS) 2024-09-21T06:49:34.531 INFO:journalctl@ceph.mds.f.smithi144.stdout:Sep 21 06:49:34 smithi144 bash[68894]: ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-f 2024-09-21T06:49:34.531 INFO:journalctl@ceph.mds.f.smithi144.stdout:Sep 21 06:49:34 smithi144 podman[68906]: 2024-09-21 06:49:34.404459937 +0000 UTC m=+0.515000707 container remove c116017ced5b380085612bc41d3b62c833da89969cf458655e979977573926d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-f, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T06:49:34.556 DEBUG:teuthology.orchestra.run.smithi144:> sudo pkill -f 'journalctl -f -n 0 -u ceph-347cb918-77e2-11ef-baf5-efdc52797490@mds.f.service' 2024-09-21T06:49:34.589 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:49:34.589 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-21T06:49:34.589 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-21T06:49:34.589 DEBUG:teuthology.orchestra.run.smithi144:> sudo systemctl stop ceph-347cb918-77e2-11ef-baf5-efdc52797490@mds.i 2024-09-21T06:49:34.908 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 21 06:49:34 smithi144 systemd[1]: Stopping Ceph mds.i for 347cb918-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:49:35.285 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 21 06:49:34 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-i[64318]: 2024-09-21T06:49:34.906+0000 7f0a3ea22640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:49:35.285 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 21 06:49:34 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-i[64318]: 2024-09-21T06:49:34.906+0000 7f0a3ea22640 -1 mds.i *** got signal Terminated *** 2024-09-21T06:49:38.184 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 21 06:49:37 smithi144 podman[69016]: 2024-09-21 06:49:37.896264876 +0000 UTC m=+3.091612555 container died d06ca82fd5543c00d57ad9b7f56b57448cb741a89aac035156a09a5a1f7b84a2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-i, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T06:49:38.501 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 21 06:49:38 smithi144 podman[69016]: 2024-09-21 06:49:38.27377087 +0000 UTC m=+3.469118538 container cleanup d06ca82fd5543c00d57ad9b7f56b57448cb741a89aac035156a09a5a1f7b84a2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-i, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T06:49:38.501 INFO:journalctl@ceph.mds.i.smithi144.stdout:Sep 21 06:49:38 smithi144 bash[69016]: ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-i 2024-09-21T06:49:38.654 DEBUG:teuthology.orchestra.run.smithi144:> sudo pkill -f 'journalctl -f -n 0 -u ceph-347cb918-77e2-11ef-baf5-efdc52797490@mds.i.service' 2024-09-21T06:49:38.686 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:49:38.686 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-21T06:49:38.686 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-21T06:49:38.686 DEBUG:teuthology.orchestra.run.smithi144:> sudo systemctl stop ceph-347cb918-77e2-11ef-baf5-efdc52797490@mds.l 2024-09-21T06:49:39.035 INFO:journalctl@ceph.mds.l.smithi144.stdout:Sep 21 06:49:38 smithi144 systemd[1]: Stopping Ceph mds.l for 347cb918-77e2-11ef-baf5-efdc52797490... 2024-09-21T06:49:39.035 INFO:journalctl@ceph.mds.l.smithi144.stdout:Sep 21 06:49:38 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-l[63505]: 2024-09-21T06:49:38.977+0000 7faadc0ee640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T06:49:39.035 INFO:journalctl@ceph.mds.l.smithi144.stdout:Sep 21 06:49:38 smithi144 ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-l[63505]: 2024-09-21T06:49:38.977+0000 7faadc0ee640 -1 mds.l *** got signal Terminated *** 2024-09-21T06:49:43.219 INFO:journalctl@ceph.mds.l.smithi144.stdout:Sep 21 06:49:42 smithi144 podman[69136]: 2024-09-21 06:49:42.928970076 +0000 UTC m=+4.023232231 container died ba23d0dfafca3c9350ea5c89e33a08a721b54977127d868b24ae24a55f421e1f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-l, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T06:49:43.219 INFO:journalctl@ceph.mds.l.smithi144.stdout:Sep 21 06:49:43 smithi144 podman[69136]: 2024-09-21 06:49:43.218590895 +0000 UTC m=+4.312853048 container cleanup ba23d0dfafca3c9350ea5c89e33a08a721b54977127d868b24ae24a55f421e1f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-l, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-21T06:49:43.535 INFO:journalctl@ceph.mds.l.smithi144.stdout:Sep 21 06:49:43 smithi144 bash[69136]: ceph-347cb918-77e2-11ef-baf5-efdc52797490-mds-l 2024-09-21T06:49:43.699 DEBUG:teuthology.orchestra.run.smithi144:> sudo pkill -f 'journalctl -f -n 0 -u ceph-347cb918-77e2-11ef-baf5-efdc52797490@mds.l.service' 2024-09-21T06:49:43.731 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T06:49:43.732 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-21T06:49:43.732 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 347cb918-77e2-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-21T06:49:43.945 INFO:teuthology.orchestra.run.smithi007.stdout:Deleting cluster with fsid: 347cb918-77e2-11ef-baf5-efdc52797490 2024-09-21T06:49:46.468 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 347cb918-77e2-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-21T06:49:46.677 INFO:teuthology.orchestra.run.smithi018.stdout:Deleting cluster with fsid: 347cb918-77e2-11ef-baf5-efdc52797490 2024-09-21T06:49:49.184 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 347cb918-77e2-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-21T06:49:49.387 INFO:teuthology.orchestra.run.smithi144.stdout:Deleting cluster with fsid: 347cb918-77e2-11ef-baf5-efdc52797490 2024-09-21T06:49:51.760 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T06:49:51.795 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T06:49:51.827 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T06:49:51.854 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-21T06:49:51.855 DEBUG:teuthology.misc:Transferring archived files from smithi007:/var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913545/remote/smithi007/crash 2024-09-21T06:49:51.856 DEBUG:teuthology.orchestra.run.smithi007:> sudo tar c -f - -C /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/crash -- . 2024-09-21T06:49:51.900 INFO:teuthology.orchestra.run.smithi007.stderr:tar: /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T06:49:51.900 INFO:teuthology.orchestra.run.smithi007.stderr:tar: Error is not recoverable: exiting now 2024-09-21T06:49:51.902 DEBUG:teuthology.misc:Transferring archived files from smithi018:/var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913545/remote/smithi018/crash 2024-09-21T06:49:51.903 DEBUG:teuthology.orchestra.run.smithi018:> sudo tar c -f - -C /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/crash -- . 2024-09-21T06:49:51.951 INFO:teuthology.orchestra.run.smithi018.stderr:tar: /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T06:49:51.951 INFO:teuthology.orchestra.run.smithi018.stderr:tar: Error is not recoverable: exiting now 2024-09-21T06:49:51.953 DEBUG:teuthology.misc:Transferring archived files from smithi144:/var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913545/remote/smithi144/crash 2024-09-21T06:49:51.954 DEBUG:teuthology.orchestra.run.smithi144:> sudo tar c -f - -C /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/crash -- . 2024-09-21T06:49:52.008 INFO:teuthology.orchestra.run.smithi144.stderr:tar: /var/lib/ceph/347cb918-77e2-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T06:49:52.008 INFO:teuthology.orchestra.run.smithi144.stderr:tar: Error is not recoverable: exiting now 2024-09-21T06:49:52.009 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-21T06:49:52.010 DEBUG:teuthology.orchestra.run.smithi007:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-21T06:49:52.060 INFO:tasks.cephadm:Compressing logs... 2024-09-21T06:49:52.060 DEBUG:teuthology.orchestra.run.smithi007:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T06:49:52.063 DEBUG:teuthology.orchestra.run.smithi018:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T06:49:52.065 DEBUG:teuthology.orchestra.run.smithi144:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T06:49:52.088 INFO:teuthology.orchestra.run.smithi007.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-osd.0.log 2024-09-21T06:49:52.088 INFO:teuthology.orchestra.run.smithi007.stderr:: No such file or directory 2024-09-21T06:49:52.089 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-osd.9.log 2024-09-21T06:49:52.089 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-21T06:49:52.089 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-21T06:49:52.094 INFO:teuthology.orchestra.run.smithi018.stderr:find: ‘/var/log/rbd-target-api’: No such file or directorygzip 2024-09-21T06:49:52.094 INFO:teuthology.orchestra.run.smithi018.stderr: -5 --verbose -- /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-osd.10.log 2024-09-21T06:49:52.094 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-osd.1.log 2024-09-21T06:49:52.094 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-osd.7.log 2024-09-21T06:49:52.094 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-osd.10.log: /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-21T06:49:52.094 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-mds.b.log 2024-09-21T06:49:52.094 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-mds.k.log 2024-09-21T06:49:52.094 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-osd.4.log 2024-09-21T06:49:52.099 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-mds.a.log 2024-09-21T06:49:52.099 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-21T06:49:52.099 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph.audit.log: /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-mon.a.log 2024-09-21T06:49:52.100 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-mds.g.log 2024-09-21T06:49:52.100 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-mon.a.log: 83.8% -- replaced with /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-21T06:49:52.100 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-osd.6.log 2024-09-21T06:49:52.100 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph.log 2024-09-21T06:49:52.100 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-osd.6.log: 90.0% -- replaced with /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-21T06:49:52.100 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-mds.d.log 2024-09-21T06:49:52.100 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph.log: 95.0% -- replaced with /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-mds.a.log.gz 2024-09-21T06:49:52.100 INFO:teuthology.orchestra.run.smithi007.stderr: 87.5% -- replaced with /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-21T06:49:52.100 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-mgr.x.log 2024-09-21T06:49:52.100 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-mds.j.log 2024-09-21T06:49:52.100 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-mgr.x.log: 95.1% -- replaced with /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-mds.g.log.gz 2024-09-21T06:49:52.101 INFO:teuthology.orchestra.run.smithi144.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-21T06:49:52.101 INFO:teuthology.orchestra.run.smithi144.stderr:: No such file or directory 2024-09-21T06:49:52.102 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-21T06:49:52.102 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose --/var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-volume.log: /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-mds.i.log 2024-09-21T06:49:52.102 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-mon.c.log 2024-09-21T06:49:52.102 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-21T06:49:52.102 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-osd.11.log 2024-09-21T06:49:52.102 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-mon.c.log: /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-osd.2.log 2024-09-21T06:49:52.102 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-osd.11.log: 80.5% -- replaced with /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-21T06:49:52.102 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-osd.5.log 2024-09-21T06:49:52.102 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph.log 2024-09-21T06:49:52.102 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-mds.l.log 2024-09-21T06:49:52.102 INFO:teuthology.orchestra.run.smithi144.stderr: 90.2% -- replaced with /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-21T06:49:52.102 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph.log: gzip -5 --verbose -- /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-osd.8.log 2024-09-21T06:49:52.102 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-mds.l.log: 87.5% -- replaced with /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-21T06:49:52.102 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-mgr.z.log 2024-09-21T06:49:52.103 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-osd.8.log: 95.0% -- replaced with /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-mds.l.log.gz 2024-09-21T06:49:52.103 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-mds.c.log 2024-09-21T06:49:52.105 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-mds.b.log: /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-21T06:49:52.105 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-osd.4.log: /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph.audit.log: 90.1% -- replaced with /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-21T06:49:52.105 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-21T06:49:52.105 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-mgr.y.log 2024-09-21T06:49:52.105 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph.cephadm.log: 80.5% -- replaced with /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-21T06:49:52.105 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph.log 2024-09-21T06:49:52.105 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-mgr.y.log: 95.0% -- replaced with /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-mds.k.log.gz 2024-09-21T06:49:52.105 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-mds.h.log 2024-09-21T06:49:52.105 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph.log: 87.5% -- replaced with /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-21T06:49:52.105 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-mgr.z.log: 90.9% -- replaced with /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-21T06:49:52.105 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-mds.f.log 2024-09-21T06:49:52.106 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-mon.b.log 2024-09-21T06:49:52.107 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-mds.h.log: 90.8% -- replaced with /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-21T06:49:52.107 INFO:teuthology.orchestra.run.smithi018.stderr: 92.4% -- replaced with /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-mgr.y.log.gz 2024-09-21T06:49:52.107 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-mds.e.log 2024-09-21T06:49:52.108 INFO:teuthology.orchestra.run.smithi007.stderr: 95.0% -- replaced with /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-mds.d.log.gz 2024-09-21T06:49:52.108 INFO:teuthology.orchestra.run.smithi007.stderr: 90.9% -- replaced with /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-21T06:49:52.108 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-osd.3.log 2024-09-21T06:49:52.108 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T06:49:52.109 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-mds.c.log: 92.6% -- replaced with /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-mgr.z.log.gz 2024-09-21T06:49:52.109 INFO:teuthology.orchestra.run.smithi144.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T06:49:52.109 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T06:49:52.112 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-osd.3.log: /var/log/ceph/cephadm.log: 95.1% -- replaced with /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-mds.j.log.gz 2024-09-21T06:49:52.113 INFO:teuthology.orchestra.run.smithi007.stderr: 94.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T06:49:52.122 INFO:teuthology.orchestra.run.smithi144.stderr:/var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-mds.f.log: /var/log/ceph/cephadm.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T06:49:52.123 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-mds.e.log: /var/log/ceph/cephadm.log: 91.9% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T06:49:52.166 INFO:teuthology.orchestra.run.smithi144.stderr: 92.6% -- replaced with /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-mds.i.log.gz 2024-09-21T06:49:52.181 INFO:teuthology.orchestra.run.smithi018.stderr: 92.9% -- replaced with /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-mds.h.log.gz 2024-09-21T06:49:52.193 INFO:teuthology.orchestra.run.smithi144.stderr: 94.5% -- replaced with /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-mds.f.log.gz 2024-09-21T06:49:52.196 INFO:teuthology.orchestra.run.smithi018.stderr: 94.3% -- replaced with /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-mds.e.log.gz 2024-09-21T06:49:52.383 INFO:teuthology.orchestra.run.smithi144.stderr: 96.0% -- replaced with /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-mds.c.log.gz 2024-09-21T06:49:52.460 INFO:teuthology.orchestra.run.smithi007.stderr: 90.3% -- replaced with /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-mgr.x.log.gz 2024-09-21T06:49:52.492 INFO:teuthology.orchestra.run.smithi144.stderr: 91.8% -- replaced with /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-mon.c.log.gz 2024-09-21T06:49:52.584 INFO:teuthology.orchestra.run.smithi018.stderr: 91.7% -- replaced with /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-mon.b.log.gz 2024-09-21T06:49:53.348 INFO:teuthology.orchestra.run.smithi007.stderr: 90.3% -- replaced with /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-mon.a.log.gz 2024-09-21T06:49:53.868 INFO:teuthology.orchestra.run.smithi018.stderr: 94.3% -- replaced with /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-mds.b.log.gz 2024-09-21T06:49:55.147 INFO:teuthology.orchestra.run.smithi007.stderr: 93.9% -- replaced with /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-osd.9.log.gz 2024-09-21T06:49:55.881 INFO:teuthology.orchestra.run.smithi144.stderr: 94.1% -- replaced with /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-osd.11.log.gz 2024-09-21T06:49:56.150 INFO:teuthology.orchestra.run.smithi144.stderr: 93.8% -- replaced with /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-osd.8.log.gz 2024-09-21T06:49:56.296 INFO:teuthology.orchestra.run.smithi007.stderr: 94.0% -- replaced with /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-osd.0.log.gz 2024-09-21T06:49:56.312 INFO:teuthology.orchestra.run.smithi007.stderr: 94.0% -- replaced with /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-osd.6.log.gz 2024-09-21T06:49:56.357 INFO:teuthology.orchestra.run.smithi018.stderr: 93.7% -- replaced with /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-osd.7.log.gz 2024-09-21T06:49:56.976 INFO:teuthology.orchestra.run.smithi018.stderr: 93.6% -- replaced with /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-osd.10.log.gz 2024-09-21T06:49:57.038 INFO:teuthology.orchestra.run.smithi018.stderr: 94.2% -- replaced with /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-osd.4.log.gz 2024-09-21T06:49:57.188 INFO:teuthology.orchestra.run.smithi144.stderr: 93.7% -- replaced with /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-osd.2.log.gz 2024-09-21T06:49:57.200 INFO:teuthology.orchestra.run.smithi144.stderr: 93.6% -- replaced with /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-osd.5.log.gz 2024-09-21T06:49:57.202 INFO:teuthology.orchestra.run.smithi144.stderr: 2024-09-21T06:49:57.202 INFO:teuthology.orchestra.run.smithi144.stderr:real 0m5.123s 2024-09-21T06:49:57.203 INFO:teuthology.orchestra.run.smithi144.stderr:user 0m18.215s 2024-09-21T06:49:57.203 INFO:teuthology.orchestra.run.smithi144.stderr:sys 0m0.703s 2024-09-21T06:49:57.438 INFO:teuthology.orchestra.run.smithi018.stderr: 93.9% -- replaced with /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-osd.1.log.gz 2024-09-21T06:49:57.440 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-09-21T06:49:57.440 INFO:teuthology.orchestra.run.smithi018.stderr:real 0m5.361s 2024-09-21T06:49:57.440 INFO:teuthology.orchestra.run.smithi018.stderr:user 0m21.196s 2024-09-21T06:49:57.441 INFO:teuthology.orchestra.run.smithi018.stderr:sys 0m0.699s 2024-09-21T06:49:57.541 INFO:teuthology.orchestra.run.smithi007.stderr: 94.0% -- replaced with /var/log/ceph/347cb918-77e2-11ef-baf5-efdc52797490/ceph-osd.3.log.gz 2024-09-21T06:49:57.542 INFO:teuthology.orchestra.run.smithi007.stderr: 2024-09-21T06:49:57.542 INFO:teuthology.orchestra.run.smithi007.stderr:real 0m5.465s 2024-09-21T06:49:57.542 INFO:teuthology.orchestra.run.smithi007.stderr:user 0m17.956s 2024-09-21T06:49:57.543 INFO:teuthology.orchestra.run.smithi007.stderr:sys 0m0.637s 2024-09-21T06:49:57.543 INFO:tasks.cephadm:Archiving logs... 2024-09-21T06:49:57.543 DEBUG:teuthology.misc:Transferring archived files from smithi007:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913545/remote/smithi007/log 2024-09-21T06:49:57.544 DEBUG:teuthology.orchestra.run.smithi007:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T06:49:59.925 DEBUG:teuthology.misc:Transferring archived files from smithi018:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913545/remote/smithi018/log 2024-09-21T06:49:59.926 DEBUG:teuthology.orchestra.run.smithi018:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T06:50:02.712 DEBUG:teuthology.misc:Transferring archived files from smithi144:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913545/remote/smithi144/log 2024-09-21T06:50:02.713 DEBUG:teuthology.orchestra.run.smithi144:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T06:50:05.344 INFO:tasks.cephadm:Removing cluster... 2024-09-21T06:50:05.344 DEBUG:teuthology.orchestra.run.smithi007:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 347cb918-77e2-11ef-baf5-efdc52797490 --force 2024-09-21T06:50:05.557 INFO:teuthology.orchestra.run.smithi007.stdout:Deleting cluster with fsid: 347cb918-77e2-11ef-baf5-efdc52797490 2024-09-21T06:50:05.846 DEBUG:teuthology.orchestra.run.smithi018:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 347cb918-77e2-11ef-baf5-efdc52797490 --force 2024-09-21T06:50:06.057 INFO:teuthology.orchestra.run.smithi018.stdout:Deleting cluster with fsid: 347cb918-77e2-11ef-baf5-efdc52797490 2024-09-21T06:50:06.342 DEBUG:teuthology.orchestra.run.smithi144:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 347cb918-77e2-11ef-baf5-efdc52797490 --force 2024-09-21T06:50:06.547 INFO:teuthology.orchestra.run.smithi144.stdout:Deleting cluster with fsid: 347cb918-77e2-11ef-baf5-efdc52797490 2024-09-21T06:50:06.826 INFO:tasks.cephadm:Removing cephadm ... 2024-09-21T06:50:06.826 DEBUG:teuthology.orchestra.run.smithi007:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T06:50:06.845 DEBUG:teuthology.orchestra.run.smithi018:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T06:50:06.862 DEBUG:teuthology.orchestra.run.smithi144:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T06:50:06.878 INFO:tasks.cephadm:Teardown complete 2024-09-21T06:50:06.878 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-21T06:50:06.894 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-21T06:50:06.894 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T06:50:06.897 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T06:50:06.904 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T06:50:07.008 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-21T06:50:07.019 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-21T06:50:07.019 DEBUG:teuthology.orchestra.run.smithi007:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T06:50:07.021 DEBUG:teuthology.orchestra.run.smithi018:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T06:50:07.024 DEBUG:teuthology.orchestra.run.smithi144:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T06:50:07.036 INFO:teuthology.orchestra.run.smithi018.stderr:bash: line 1: ntpq: command not found 2024-09-21T06:50:07.037 INFO:teuthology.orchestra.run.smithi007.stderr:bash: line 1: ntpq: command not found 2024-09-21T06:50:07.038 INFO:teuthology.orchestra.run.smithi144.stderr:bash: line 1: ntpq: command not found 2024-09-21T06:50:07.041 INFO:teuthology.orchestra.run.smithi018.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T06:50:07.041 INFO:teuthology.orchestra.run.smithi018.stdout:=============================================================================== 2024-09-21T06:50:07.041 INFO:teuthology.orchestra.run.smithi018.stdout:^* hv01.front.sepia.ceph.com 3 6 377 8 -58us[ -57us] +/- 39ms 2024-09-21T06:50:07.041 INFO:teuthology.orchestra.run.smithi018.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 5 +38us[ +38us] +/- 65ms 2024-09-21T06:50:07.041 INFO:teuthology.orchestra.run.smithi018.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 7 +37us[ +37us] +/- 66ms 2024-09-21T06:50:07.041 INFO:teuthology.orchestra.run.smithi018.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:50:07.043 INFO:teuthology.orchestra.run.smithi007.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T06:50:07.043 INFO:teuthology.orchestra.run.smithi007.stdout:=============================================================================== 2024-09-21T06:50:07.043 INFO:teuthology.orchestra.run.smithi007.stdout:^* hv01.front.sepia.ceph.com 3 6 377 10 -39us[ -25us] +/- 39ms 2024-09-21T06:50:07.043 INFO:teuthology.orchestra.run.smithi007.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 4 +32us[ +32us] +/- 65ms 2024-09-21T06:50:07.043 INFO:teuthology.orchestra.run.smithi007.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 3 +52us[ +52us] +/- 66ms 2024-09-21T06:50:07.043 INFO:teuthology.orchestra.run.smithi007.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:50:07.044 INFO:teuthology.orchestra.run.smithi144.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T06:50:07.044 INFO:teuthology.orchestra.run.smithi144.stdout:=============================================================================== 2024-09-21T06:50:07.044 INFO:teuthology.orchestra.run.smithi144.stdout:^* hv01.front.sepia.ceph.com 3 6 377 5 -50us[ -52us] +/- 39ms 2024-09-21T06:50:07.044 INFO:teuthology.orchestra.run.smithi144.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 7 +27us[ +25us] +/- 65ms 2024-09-21T06:50:07.044 INFO:teuthology.orchestra.run.smithi144.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 5 +45us[ +45us] +/- 66ms 2024-09-21T06:50:07.044 INFO:teuthology.orchestra.run.smithi144.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T06:50:07.044 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-21T06:50:07.057 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-21T06:50:07.057 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-21T06:50:07.068 DEBUG:teuthology.orchestra.run.smithi007:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T06:50:07.171 DEBUG:teuthology.orchestra.run.smithi018:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T06:50:07.240 DEBUG:teuthology.orchestra.run.smithi144:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T06:50:07.305 DEBUG:teuthology.orchestra.run.smithi007:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T06:50:07.336 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:50:07.337 DEBUG:teuthology.orchestra.run.smithi018:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T06:50:07.366 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:50:07.367 DEBUG:teuthology.orchestra.run.smithi144:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T06:50:07.395 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:50:07.396 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-21T06:50:07.408 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-21T06:50:07.423 INFO:teuthology.task.internal:Duration was 1879.592076 seconds 2024-09-21T06:50:07.423 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-21T06:50:07.434 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-21T06:50:07.434 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T06:50:07.437 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T06:50:07.439 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T06:50:07.477 INFO:teuthology.orchestra.run.smithi007.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T06:50:07.477 INFO:teuthology.orchestra.run.smithi018.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T06:50:07.478 INFO:teuthology.orchestra.run.smithi144.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T06:50:07.905 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-21T06:50:07.906 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi007.front.sepia.ceph.com 2024-09-21T06:50:07.906 DEBUG:teuthology.orchestra.run.smithi007:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T06:50:07.930 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi018.front.sepia.ceph.com 2024-09-21T06:50:07.930 DEBUG:teuthology.orchestra.run.smithi018:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T06:50:07.974 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi144.front.sepia.ceph.com 2024-09-21T06:50:07.974 DEBUG:teuthology.orchestra.run.smithi144:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T06:50:07.996 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-21T06:50:07.996 DEBUG:teuthology.orchestra.run.smithi007:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T06:50:07.998 DEBUG:teuthology.orchestra.run.smithi018:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T06:50:08.018 DEBUG:teuthology.orchestra.run.smithi144:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T06:50:08.061 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-21T06:50:08.062 DEBUG:teuthology.orchestra.run.smithi007:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T06:50:08.070 DEBUG:teuthology.orchestra.run.smithi018:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T06:50:08.086 DEBUG:teuthology.orchestra.run.smithi144:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T06:50:09.261 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-21T06:50:09.278 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-21T06:50:09.278 DEBUG:teuthology.orchestra.run.smithi007:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T06:50:09.305 DEBUG:teuthology.orchestra.run.smithi018:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T06:50:09.335 DEBUG:teuthology.orchestra.run.smithi144:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T06:50:09.361 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-21T06:50:09.372 DEBUG:teuthology.orchestra.run.smithi007:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T06:50:09.375 DEBUG:teuthology.orchestra.run.smithi018:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T06:50:09.377 DEBUG:teuthology.orchestra.run.smithi144:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T06:50:09.396 INFO:teuthology.orchestra.run.smithi007.stdout:kernel.core_pattern = core 2024-09-21T06:50:09.402 INFO:teuthology.orchestra.run.smithi018.stdout:kernel.core_pattern = core 2024-09-21T06:50:09.425 INFO:teuthology.orchestra.run.smithi144.stdout:kernel.core_pattern = core 2024-09-21T06:50:09.457 DEBUG:teuthology.orchestra.run.smithi007:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T06:50:09.471 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:50:09.471 DEBUG:teuthology.orchestra.run.smithi018:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T06:50:09.487 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:50:09.487 DEBUG:teuthology.orchestra.run.smithi144:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T06:50:09.511 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T06:50:09.512 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-21T06:50:09.525 INFO:teuthology.task.internal:Transferring archived files... 2024-09-21T06:50:09.526 DEBUG:teuthology.misc:Transferring archived files from smithi007:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913545/remote/smithi007 2024-09-21T06:50:09.526 DEBUG:teuthology.orchestra.run.smithi007:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T06:50:09.591 DEBUG:teuthology.misc:Transferring archived files from smithi018:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913545/remote/smithi018 2024-09-21T06:50:09.592 DEBUG:teuthology.orchestra.run.smithi018:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T06:50:09.631 DEBUG:teuthology.misc:Transferring archived files from smithi144:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913545/remote/smithi144 2024-09-21T06:50:09.632 DEBUG:teuthology.orchestra.run.smithi144:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T06:50:09.667 INFO:teuthology.task.internal:Removing archive directory... 2024-09-21T06:50:09.668 DEBUG:teuthology.orchestra.run.smithi007:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T06:50:09.670 DEBUG:teuthology.orchestra.run.smithi018:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T06:50:09.673 DEBUG:teuthology.orchestra.run.smithi144:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T06:50:09.717 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-21T06:50:09.737 INFO:teuthology.task.internal:Not uploading archives. 2024-09-21T06:50:09.737 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-21T06:50:09.748 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-21T06:50:09.748 DEBUG:teuthology.orchestra.run.smithi007:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T06:50:09.750 DEBUG:teuthology.orchestra.run.smithi018:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T06:50:09.753 DEBUG:teuthology.orchestra.run.smithi144:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T06:50:09.763 INFO:teuthology.orchestra.run.smithi007.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 06:50 /home/ubuntu/cephtest 2024-09-21T06:50:09.767 INFO:teuthology.orchestra.run.smithi018.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 06:50 /home/ubuntu/cephtest 2024-09-21T06:50:09.772 INFO:teuthology.orchestra.run.smithi144.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 06:50 /home/ubuntu/cephtest 2024-09-21T06:50:09.773 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-21T06:50:09.787 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-21T06:50:09.829 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-quiesce/no 6-workunit/suites/iozone}} duration: 1879.5920760631561 flavor: default owner: scheduled_pdonnell@teuthology success: true 2024-09-21T06:50:09.829 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T06:50:09.920 INFO:teuthology.run:pass